2024-09-12T16:04:11.460 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T16:04:11.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T16:04:11.555 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/dis-2024-09-12_15:21:08-rbd-wip-dis-testing-distro-default-smithi/7902667 branch: wip-dis-testing description: rbd/device/{base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/rbd_fsx_nbd} email: idryomov@gmail.com first_in_suite: false job_id: '7902667' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: dis-2024-09-12_15:21:08-rbd-wip-dis-testing-distro-default-smithi no_nested_subset: false openstack: - machine: cpus: 1 disk: 40 ram: 8000 volumes: count: 4 size: 30 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-dis-testing ceph: conf: global: mon client directed command retry: 5 mon warn on pool no app: false ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: d61b08865d4d98738f45ff2e4806d7fb6d03eca1 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: extra_packages: - rbd-nbd flavor: default sha1: d61b08865d4d98738f45ff2e4806d7fb6d03eca1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-dis-testing sha1: d61b08865d4d98738f45ff2e4806d7fb6d03eca1 owner: scheduled_dis@teuthology priority: 70 repo: https://github.com/ceph/ceph-ci roles: - - mon.a - mon.c - osd.0 - osd.1 - osd.2 - - mon.b - mgr.x - osd.3 - osd.4 - osd.5 - - client.0 seed: 1680 sha1: d61b08865d4d98738f45ff2e4806d7fb6d03eca1 sleep_before_teardown: 0 subset: 42/100 suite: rbd suite_branch: wip-dis-testing suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_d61b08865d4d98738f45ff2e4806d7fb6d03eca1/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci suite_sha1: d61b08865d4d98738f45ff2e4806d7fb6d03eca1 targets: smithi017.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJYXmr8XHw7t6N2whg2Wi6wKeUdKkAhOtbkX5Ol7sAxgjjUAXINdOPZjhOzI/zl/PFcEDX39H32Ydc4jPQy5r7s= smithi047.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGs5GbkKnoUp1Q9hd/wKOxIWtiHgV6fGa0eKDcQC26DPnG9XMmtFl4bBebvS3I4J0Q+wgj75M4fHAypnnGz0epk= smithi204.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE6ilMD6vT+JK+mg2lCBjt3wDPMLrJxmuwPmJztrLKDNoxMMbcozoA3iEjpJUARzZ/qhR1+qcp752PaltVbz9e0= tasks: - install: null - ceph: null - thrashosds: timeout: 1200 - rbd_fsx: clients: - client.0 holebdy: 512 nbd: true ops: 6000 punch_holes: true readbdy: 512 truncbdy: 512 writebdy: 512 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-12_15:21:08 tube: smithi user: dis verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T16:04:11.555 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_d61b08865d4d98738f45ff2e4806d7fb6d03eca1/qa; will attempt to use it 2024-09-12T16:04:11.556 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_d61b08865d4d98738f45ff2e4806d7fb6d03eca1/qa/tasks 2024-09-12T16:04:11.556 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T16:04:11.558 INFO:teuthology.task.internal:Checking packages... 2024-09-12T16:04:11.578 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd61b08865d4d98738f45ff2e4806d7fb6d03eca1' 2024-09-12T16:04:11.579 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T16:04:11.579 INFO:teuthology.packaging:ref: None 2024-09-12T16:04:11.579 INFO:teuthology.packaging:tag: None 2024-09-12T16:04:11.579 INFO:teuthology.packaging:branch: wip-dis-testing 2024-09-12T16:04:11.579 INFO:teuthology.packaging:sha1: d61b08865d4d98738f45ff2e4806d7fb6d03eca1 2024-09-12T16:04:11.579 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-dis-testing 2024-09-12T16:04:11.745 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4883.gd61b0886 2024-09-12T16:04:11.747 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T16:04:11.754 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T16:04:11.754 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T16:04:11.767 INFO:teuthology.task.internal:Saving configuration 2024-09-12T16:04:11.780 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T16:04:11.789 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T16:04:11.816 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2024-09-12_15:21:08-rbd-wip-dis-testing-distro-default-smithi/7902667', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 15:58:58.312993', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJYXmr8XHw7t6N2whg2Wi6wKeUdKkAhOtbkX5Ol7sAxgjjUAXINdOPZjhOzI/zl/PFcEDX39H32Ydc4jPQy5r7s='} 2024-09-12T16:04:11.833 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi047.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2024-09-12_15:21:08-rbd-wip-dis-testing-distro-default-smithi/7902667', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 15:58:58.314237', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGs5GbkKnoUp1Q9hd/wKOxIWtiHgV6fGa0eKDcQC26DPnG9XMmtFl4bBebvS3I4J0Q+wgj75M4fHAypnnGz0epk='} 2024-09-12T16:04:11.852 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi204.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2024-09-12_15:21:08-rbd-wip-dis-testing-distro-default-smithi/7902667', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 15:58:58.315252', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE6ilMD6vT+JK+mg2lCBjt3wDPMLrJxmuwPmJztrLKDNoxMMbcozoA3iEjpJUARzZ/qhR1+qcp752PaltVbz9e0='} 2024-09-12T16:04:11.852 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T16:04:11.859 INFO:teuthology.task.internal:roles: ubuntu@smithi017.front.sepia.ceph.com - ['mon.a', 'mon.c', 'osd.0', 'osd.1', 'osd.2'] 2024-09-12T16:04:11.860 INFO:teuthology.task.internal:roles: ubuntu@smithi047.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.3', 'osd.4', 'osd.5'] 2024-09-12T16:04:11.860 INFO:teuthology.task.internal:roles: ubuntu@smithi204.front.sepia.ceph.com - ['client.0'] 2024-09-12T16:04:11.860 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T16:04:11.946 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2bb8e17ac0>, signals=[15]) 2024-09-12T16:04:11.946 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T16:04:11.953 INFO:teuthology.task.internal:Opening connections... 2024-09-12T16:04:11.954 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi017.front.sepia.ceph.com 2024-09-12T16:04:11.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:04:12.032 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi047.front.sepia.ceph.com 2024-09-12T16:04:12.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:04:12.106 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T16:04:12.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:04:12.179 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T16:04:12.186 DEBUG:teuthology.orchestra.run.smithi017:> uname -m 2024-09-12T16:04:12.204 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2024-09-12T16:04:12.205 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2024-09-12T16:04:12.262 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream" 2024-09-12T16:04:12.262 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="9" 2024-09-12T16:04:12.262 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos" 2024-09-12T16:04:12.262 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora" 2024-09-12T16:04:12.262 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="9" 2024-09-12T16:04:12.262 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el9" 2024-09-12T16:04:12.262 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T16:04:12.262 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2024-09-12T16:04:12.263 INFO:teuthology.orchestra.run.smithi017.stdout:LOGO="fedora-logo-icon" 2024-09-12T16:04:12.263 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T16:04:12.263 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/" 2024-09-12T16:04:12.263 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T16:04:12.263 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T16:04:12.263 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T16:04:12.263 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2024-09-12T16:04:12.289 DEBUG:teuthology.orchestra.run.smithi047:> uname -m 2024-09-12T16:04:12.307 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64 2024-09-12T16:04:12.307 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release 2024-09-12T16:04:12.365 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="CentOS Stream" 2024-09-12T16:04:12.365 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="9" 2024-09-12T16:04:12.365 INFO:teuthology.orchestra.run.smithi047.stdout:ID="centos" 2024-09-12T16:04:12.365 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE="rhel fedora" 2024-09-12T16:04:12.366 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="9" 2024-09-12T16:04:12.366 INFO:teuthology.orchestra.run.smithi047.stdout:PLATFORM_ID="platform:el9" 2024-09-12T16:04:12.366 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T16:04:12.366 INFO:teuthology.orchestra.run.smithi047.stdout:ANSI_COLOR="0;31" 2024-09-12T16:04:12.366 INFO:teuthology.orchestra.run.smithi047.stdout:LOGO="fedora-logo-icon" 2024-09-12T16:04:12.366 INFO:teuthology.orchestra.run.smithi047.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T16:04:12.366 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://centos.org/" 2024-09-12T16:04:12.366 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T16:04:12.366 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T16:04:12.366 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T16:04:12.367 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2024-09-12T16:04:12.389 DEBUG:teuthology.orchestra.run.smithi204:> uname -m 2024-09-12T16:04:12.408 INFO:teuthology.orchestra.run.smithi204.stdout:x86_64 2024-09-12T16:04:12.408 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release 2024-09-12T16:04:12.466 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="CentOS Stream" 2024-09-12T16:04:12.466 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="9" 2024-09-12T16:04:12.466 INFO:teuthology.orchestra.run.smithi204.stdout:ID="centos" 2024-09-12T16:04:12.466 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE="rhel fedora" 2024-09-12T16:04:12.466 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="9" 2024-09-12T16:04:12.466 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM_ID="platform:el9" 2024-09-12T16:04:12.466 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T16:04:12.466 INFO:teuthology.orchestra.run.smithi204.stdout:ANSI_COLOR="0;31" 2024-09-12T16:04:12.466 INFO:teuthology.orchestra.run.smithi204.stdout:LOGO="fedora-logo-icon" 2024-09-12T16:04:12.466 INFO:teuthology.orchestra.run.smithi204.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T16:04:12.466 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://centos.org/" 2024-09-12T16:04:12.467 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T16:04:12.467 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T16:04:12.467 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T16:04:12.467 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2024-09-12T16:04:12.489 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T16:04:12.500 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T16:04:12.507 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T16:04:12.508 DEBUG:teuthology.orchestra.run.smithi017:> test '!' -e /home/ubuntu/cephtest 2024-09-12T16:04:12.510 DEBUG:teuthology.orchestra.run.smithi047:> test '!' -e /home/ubuntu/cephtest 2024-09-12T16:04:12.513 DEBUG:teuthology.orchestra.run.smithi204:> test '!' -e /home/ubuntu/cephtest 2024-09-12T16:04:12.530 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T16:04:12.537 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T16:04:12.538 DEBUG:teuthology.orchestra.run.smithi017:> test -z $(ls -A /var/lib/ceph) 2024-09-12T16:04:12.568 DEBUG:teuthology.orchestra.run.smithi047:> test -z $(ls -A /var/lib/ceph) 2024-09-12T16:04:12.571 DEBUG:teuthology.orchestra.run.smithi204:> test -z $(ls -A /var/lib/ceph) 2024-09-12T16:04:12.606 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T16:04:12.671 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T16:04:12.688 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T16:04:12.688 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'client.0': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T16:04:12.688 DEBUG:teuthology.orchestra.run.smithi017:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T16:04:12.689 DEBUG:teuthology.orchestra.run.smithi047:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T16:04:12.689 DEBUG:teuthology.orchestra.run.smithi204:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T16:04:12.705 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:04:12.705 DEBUG:teuthology.orchestra.run.smithi204:> uname -r 2024-09-12T16:04:12.706 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:04:12.707 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:04:12.707 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-09-12T16:04:12.708 DEBUG:teuthology.orchestra.run.smithi017:> uname -r 2024-09-12T16:04:12.762 INFO:teuthology.orchestra.run.smithi204.stdout:5.14.0-503.el9.x86_64 2024-09-12T16:04:12.762 INFO:teuthology.task.kernel:Running kernel on smithi204: 5.14.0-503.el9.x86_64 2024-09-12T16:04:12.762 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum install -y kernel 2024-09-12T16:04:12.764 INFO:teuthology.orchestra.run.smithi017.stdout:5.14.0-503.el9.x86_64 2024-09-12T16:04:12.765 INFO:teuthology.task.kernel:Running kernel on smithi017: 5.14.0-503.el9.x86_64 2024-09-12T16:04:12.765 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum install -y kernel 2024-09-12T16:04:12.766 INFO:teuthology.orchestra.run.smithi047.stdout:5.14.0-503.el9.x86_64 2024-09-12T16:04:12.766 INFO:teuthology.task.kernel:Running kernel on smithi047: 5.14.0-503.el9.x86_64 2024-09-12T16:04:12.766 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum install -y kernel 2024-09-12T16:04:15.142 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-09-12T16:04:15.401 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - BaseOS 8.8 MB/s | 8.2 MB 00:00 2024-09-12T16:04:17.361 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-12T16:04:17.659 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - AppStream 15 MB/s | 20 MB 00:01 2024-09-12T16:04:18.177 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - BaseOS 2.2 MB/s | 8.2 MB 00:03 2024-09-12T16:04:21.770 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-12T16:04:23.018 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 6.5 MB 00:01 2024-09-12T16:04:23.254 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - Extras packages 66 kB/s | 19 kB 00:00 2024-09-12T16:04:24.150 INFO:teuthology.orchestra.run.smithi204.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-12T16:04:24.669 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 19 kB 00:00 2024-09-12T16:04:25.807 INFO:teuthology.orchestra.run.smithi047.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:01 2024-09-12T16:04:29.606 INFO:teuthology.orchestra.run.smithi204.stdout:lab-extras 48 kB/s | 1.7 kB 00:00 2024-09-12T16:04:31.479 INFO:teuthology.orchestra.run.smithi047.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-12T16:04:31.587 INFO:teuthology.orchestra.run.smithi204.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T16:04:31.587 INFO:teuthology.orchestra.run.smithi204.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T16:04:31.672 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-09-12T16:04:31.678 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:04:31.679 INFO:teuthology.orchestra.run.smithi204.stdout: Package Architecture Version Repository Size 2024-09-12T16:04:31.679 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:04:31.679 INFO:teuthology.orchestra.run.smithi204.stdout:Installing: 2024-09-12T16:04:31.679 INFO:teuthology.orchestra.run.smithi204.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T16:04:31.679 INFO:teuthology.orchestra.run.smithi204.stdout:Installing dependencies: 2024-09-12T16:04:31.679 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T16:04:31.679 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T16:04:31.679 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T16:04:31.679 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:04:31.679 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction Summary 2024-09-12T16:04:31.679 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:04:31.679 INFO:teuthology.orchestra.run.smithi204.stdout:Install 4 Packages 2024-09-12T16:04:31.679 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:04:31.680 INFO:teuthology.orchestra.run.smithi204.stdout:Total download size: 79 M 2024-09-12T16:04:31.680 INFO:teuthology.orchestra.run.smithi204.stdout:Installed size: 126 M 2024-09-12T16:04:31.680 INFO:teuthology.orchestra.run.smithi204.stdout:Downloading Packages: 2024-09-12T16:04:32.249 INFO:teuthology.orchestra.run.smithi204.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 78 kB/s | 23 kB 00:00 2024-09-12T16:04:33.536 INFO:teuthology.orchestra.run.smithi047.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T16:04:33.536 INFO:teuthology.orchestra.run.smithi047.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T16:04:33.621 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T16:04:33.639 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:04:33.640 INFO:teuthology.orchestra.run.smithi047.stdout: Package Architecture Version Repository Size 2024-09-12T16:04:33.640 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:04:33.640 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-12T16:04:33.640 INFO:teuthology.orchestra.run.smithi047.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T16:04:33.640 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-12T16:04:33.640 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T16:04:33.640 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T16:04:33.640 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T16:04:33.640 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:04:33.640 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-12T16:04:33.640 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:04:33.640 INFO:teuthology.orchestra.run.smithi047.stdout:Install 4 Packages 2024-09-12T16:04:33.641 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:04:33.641 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 79 M 2024-09-12T16:04:33.641 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 126 M 2024-09-12T16:04:33.641 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-12T16:04:33.806 INFO:teuthology.orchestra.run.smithi047.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 203 kB/s | 23 kB 00:00 2024-09-12T16:04:36.814 INFO:teuthology.orchestra.run.smithi047.stdout:(2/4): kernel-modules-core-5.14.0-505.el9.x86_6 9.5 MB/s | 29 MB 00:03 2024-09-12T16:04:36.909 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 20 MB 00:17 2024-09-12T16:04:37.531 INFO:teuthology.orchestra.run.smithi047.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 9.0 MB/s | 35 MB 00:03 2024-09-12T16:04:38.091 INFO:teuthology.orchestra.run.smithi204.stdout:(2/4): kernel-modules-core-5.14.0-505.el9.x86_6 4.9 MB/s | 29 MB 00:05 2024-09-12T16:04:38.623 INFO:teuthology.orchestra.run.smithi047.stdout:(4/4): kernel-core-5.14.0-505.el9.x86_64.rpm 3.2 MB/s | 16 MB 00:04 2024-09-12T16:04:38.623 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:04:38.623 INFO:teuthology.orchestra.run.smithi047.stdout:Total 16 MB/s | 79 MB 00:04 2024-09-12T16:04:39.334 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-12T16:04:39.707 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-12T16:04:39.708 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-12T16:04:40.199 INFO:teuthology.orchestra.run.smithi204.stdout:(3/4): kernel-core-5.14.0-505.el9.x86_64.rpm 1.9 MB/s | 16 MB 00:08 2024-09-12T16:04:40.684 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-12T16:04:40.685 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-12T16:04:41.410 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-12T16:04:42.994 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - Extras packages 62 kB/s | 19 kB 00:00 2024-09-12T16:04:43.271 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-12T16:04:43.756 INFO:teuthology.orchestra.run.smithi017.stdout:Extra Packages for Enterprise Linux 36 MB/s | 23 MB 00:00 2024-09-12T16:04:43.951 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T16:04:44.033 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T16:04:46.827 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T16:04:46.959 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T16:04:49.596 INFO:teuthology.orchestra.run.smithi017.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2024-09-12T16:04:51.627 INFO:teuthology.orchestra.run.smithi017.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T16:04:51.627 INFO:teuthology.orchestra.run.smithi017.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T16:04:51.734 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-12T16:04:51.745 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:04:51.745 INFO:teuthology.orchestra.run.smithi017.stdout: Package Architecture Version Repository Size 2024-09-12T16:04:51.745 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:04:51.745 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-12T16:04:51.745 INFO:teuthology.orchestra.run.smithi017.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T16:04:51.745 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-09-12T16:04:51.746 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T16:04:51.746 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T16:04:51.746 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T16:04:51.746 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:04:51.746 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-12T16:04:51.746 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:04:51.746 INFO:teuthology.orchestra.run.smithi017.stdout:Install 4 Packages 2024-09-12T16:04:51.746 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:04:51.747 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 79 M 2024-09-12T16:04:51.747 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 126 M 2024-09-12T16:04:51.747 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-12T16:04:52.083 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T16:04:52.126 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T16:04:52.422 INFO:teuthology.orchestra.run.smithi017.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 40 kB/s | 23 kB 00:00 2024-09-12T16:04:54.239 INFO:teuthology.orchestra.run.smithi017.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 6.5 MB/s | 16 MB 00:02 2024-09-12T16:04:54.722 INFO:teuthology.orchestra.run.smithi017.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 12 MB/s | 29 MB 00:02 2024-09-12T16:04:55.048 INFO:teuthology.orchestra.run.smithi017.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 11 MB/s | 35 MB 00:03 2024-09-12T16:04:55.048 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:04:55.048 INFO:teuthology.orchestra.run.smithi017.stdout:Total 24 MB/s | 79 MB 00:03 2024-09-12T16:04:55.758 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-12T16:04:56.133 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-12T16:04:56.133 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-12T16:04:57.132 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-12T16:04:57.132 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-12T16:04:57.267 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T16:04:59.688 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-12T16:05:00.360 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T16:05:00.441 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T16:05:01.213 INFO:teuthology.orchestra.run.smithi204.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 1.2 MB/s | 35 MB 00:29 2024-09-12T16:05:01.214 INFO:teuthology.orchestra.run.smithi204.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:05:01.214 INFO:teuthology.orchestra.run.smithi204.stdout:Total 2.7 MB/s | 79 MB 00:29 2024-09-12T16:05:01.890 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction check 2024-09-12T16:05:02.234 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction check succeeded. 2024-09-12T16:05:02.235 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction test 2024-09-12T16:05:03.212 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction test succeeded. 2024-09-12T16:05:03.213 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction 2024-09-12T16:05:03.243 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T16:05:03.367 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T16:05:05.658 INFO:teuthology.orchestra.run.smithi204.stdout: Preparing : 1/1 2024-09-12T16:05:06.324 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T16:05:06.523 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T16:05:08.490 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T16:05:08.534 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T16:05:09.309 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T16:05:09.437 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T16:05:13.673 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T16:05:14.247 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T16:05:14.287 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T16:05:19.127 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T16:05:36.068 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T16:05:36.109 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T16:05:36.463 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T16:05:36.463 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T16:05:36.463 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T16:05:36.463 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T16:05:37.303 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T16:05:37.303 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:05:37.303 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-12T16:05:37.303 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T16:05:37.303 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T16:05:37.303 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T16:05:37.303 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T16:05:37.304 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:05:37.304 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T16:05:37.652 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T16:05:37.786 INFO:teuthology.orchestra.run.smithi047.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T16:05:37.786 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T16:05:37.787 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T16:05:37.787 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T16:05:37.787 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T16:05:37.787 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-12T16:05:37.787 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi047.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T16:05:37.787 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T16:05:37.846 INFO:teuthology.orchestra.run.smithi047.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T16:05:37.846 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T16:05:37.847 DEBUG:teuthology.orchestra.run.smithi047:> sudo rpm -qi grub2-tools 2024-09-12T16:05:37.878 INFO:teuthology.orchestra.run.smithi047.stdout:Name : grub2-tools 2024-09-12T16:05:37.878 INFO:teuthology.orchestra.run.smithi047.stdout:Epoch : 1 2024-09-12T16:05:37.879 INFO:teuthology.orchestra.run.smithi047.stdout:Version : 2.06 2024-09-12T16:05:37.879 INFO:teuthology.orchestra.run.smithi047.stdout:Release : 82.el9 2024-09-12T16:05:37.879 INFO:teuthology.orchestra.run.smithi047.stdout:Architecture: x86_64 2024-09-12T16:05:37.879 INFO:teuthology.orchestra.run.smithi047.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T16:05:37.879 INFO:teuthology.orchestra.run.smithi047.stdout:Group : Unspecified 2024-09-12T16:05:37.879 INFO:teuthology.orchestra.run.smithi047.stdout:Size : 8274670 2024-09-12T16:05:37.879 INFO:teuthology.orchestra.run.smithi047.stdout:License : GPLv3+ 2024-09-12T16:05:37.879 INFO:teuthology.orchestra.run.smithi047.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T16:05:37.879 INFO:teuthology.orchestra.run.smithi047.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T16:05:37.879 INFO:teuthology.orchestra.run.smithi047.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T16:05:37.879 INFO:teuthology.orchestra.run.smithi047.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T16:05:37.880 INFO:teuthology.orchestra.run.smithi047.stdout:Packager : builder@centos.org 2024-09-12T16:05:37.880 INFO:teuthology.orchestra.run.smithi047.stdout:Vendor : CentOS 2024-09-12T16:05:37.880 INFO:teuthology.orchestra.run.smithi047.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T16:05:37.880 INFO:teuthology.orchestra.run.smithi047.stdout:Summary : Support tools for GRUB. 2024-09-12T16:05:37.880 INFO:teuthology.orchestra.run.smithi047.stdout:Description : 2024-09-12T16:05:37.880 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:05:37.880 INFO:teuthology.orchestra.run.smithi047.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T16:05:37.880 INFO:teuthology.orchestra.run.smithi047.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T16:05:37.880 INFO:teuthology.orchestra.run.smithi047.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T16:05:37.880 INFO:teuthology.orchestra.run.smithi047.stdout:hardware devices. 2024-09-12T16:05:37.880 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:05:37.880 INFO:teuthology.orchestra.run.smithi047.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T16:05:37.881 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T16:05:37.881 INFO:teuthology.task.kernel:Updating grub on smithi047 to boot 5.14.0-505.el9.x86_64 2024-09-12T16:05:37.881 DEBUG:teuthology.orchestra.run.smithi047:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T16:05:38.511 INFO:teuthology.orchestra.run.smithi047.stderr:Generating grub configuration file ... 2024-09-12T16:05:39.835 INFO:teuthology.orchestra.run.smithi047.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T16:05:39.862 INFO:teuthology.orchestra.run.smithi047.stderr:done 2024-09-12T16:05:39.865 DEBUG:teuthology.orchestra.run.smithi047:> mktemp 2024-09-12T16:05:39.880 INFO:teuthology.orchestra.run.smithi047.stdout:/tmp/tmp.uIbElMWtp2 2024-09-12T16:05:39.880 DEBUG:teuthology.orchestra.run.smithi047:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.uIbElMWtp2 2024-09-12T16:05:39.946 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0666 /tmp/tmp.uIbElMWtp2 2024-09-12T16:05:40.088 DEBUG:teuthology.orchestra.remote:smithi047:/tmp/tmp.uIbElMWtp2 is 6KB 2024-09-12T16:05:40.137 DEBUG:teuthology.orchestra.run.smithi047:> rm -fr /tmp/tmp.uIbElMWtp2 2024-09-12T16:05:40.152 DEBUG:teuthology.orchestra.run.smithi047:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T16:05:40.215 INFO:teuthology.orchestra.run.smithi047.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T16:05:40.215 INFO:teuthology.orchestra.run.smithi047.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T16:05:40.215 INFO:teuthology.orchestra.run.smithi047.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T16:05:40.215 INFO:teuthology.orchestra.run.smithi047.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T16:05:40.216 DEBUG:teuthology.orchestra.run.smithi047:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T16:05:40.385 DEBUG:teuthology.orchestra.run.smithi047:> sudo shutdown -r now 2024-09-12T16:05:52.734 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T16:05:52.775 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T16:05:53.137 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T16:05:53.137 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T16:05:53.137 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T16:05:53.137 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T16:05:53.934 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T16:05:53.935 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:05:53.935 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-12T16:05:53.935 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T16:05:53.935 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T16:05:53.935 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T16:05:53.935 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T16:05:53.935 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:05:53.935 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-12T16:05:54.282 DEBUG:teuthology.orchestra.run.smithi017:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T16:05:54.368 INFO:teuthology.orchestra.run.smithi017.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T16:05:54.368 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T16:05:54.368 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T16:05:54.368 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T16:05:54.368 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T16:05:54.369 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T16:05:54.369 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi017.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T16:05:54.369 DEBUG:teuthology.orchestra.run.smithi017:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T16:05:54.428 INFO:teuthology.orchestra.run.smithi017.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T16:05:54.428 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T16:05:54.428 DEBUG:teuthology.orchestra.run.smithi017:> sudo rpm -qi grub2-tools 2024-09-12T16:05:54.467 INFO:teuthology.orchestra.run.smithi017.stdout:Name : grub2-tools 2024-09-12T16:05:54.468 INFO:teuthology.orchestra.run.smithi017.stdout:Epoch : 1 2024-09-12T16:05:54.468 INFO:teuthology.orchestra.run.smithi017.stdout:Version : 2.06 2024-09-12T16:05:54.468 INFO:teuthology.orchestra.run.smithi017.stdout:Release : 82.el9 2024-09-12T16:05:54.468 INFO:teuthology.orchestra.run.smithi017.stdout:Architecture: x86_64 2024-09-12T16:05:54.468 INFO:teuthology.orchestra.run.smithi017.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T16:05:54.468 INFO:teuthology.orchestra.run.smithi017.stdout:Group : Unspecified 2024-09-12T16:05:54.468 INFO:teuthology.orchestra.run.smithi017.stdout:Size : 8274670 2024-09-12T16:05:54.468 INFO:teuthology.orchestra.run.smithi017.stdout:License : GPLv3+ 2024-09-12T16:05:54.468 INFO:teuthology.orchestra.run.smithi017.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T16:05:54.468 INFO:teuthology.orchestra.run.smithi017.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T16:05:54.468 INFO:teuthology.orchestra.run.smithi017.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T16:05:54.469 INFO:teuthology.orchestra.run.smithi017.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T16:05:54.469 INFO:teuthology.orchestra.run.smithi017.stdout:Packager : builder@centos.org 2024-09-12T16:05:54.469 INFO:teuthology.orchestra.run.smithi017.stdout:Vendor : CentOS 2024-09-12T16:05:54.469 INFO:teuthology.orchestra.run.smithi017.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T16:05:54.469 INFO:teuthology.orchestra.run.smithi017.stdout:Summary : Support tools for GRUB. 2024-09-12T16:05:54.469 INFO:teuthology.orchestra.run.smithi017.stdout:Description : 2024-09-12T16:05:54.469 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:05:54.469 INFO:teuthology.orchestra.run.smithi017.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T16:05:54.469 INFO:teuthology.orchestra.run.smithi017.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T16:05:54.469 INFO:teuthology.orchestra.run.smithi017.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T16:05:54.469 INFO:teuthology.orchestra.run.smithi017.stdout:hardware devices. 2024-09-12T16:05:54.469 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:05:54.469 INFO:teuthology.orchestra.run.smithi017.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T16:05:54.470 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T16:05:54.470 INFO:teuthology.task.kernel:Updating grub on smithi017 to boot 5.14.0-505.el9.x86_64 2024-09-12T16:05:54.470 DEBUG:teuthology.orchestra.run.smithi017:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T16:05:55.095 INFO:teuthology.orchestra.run.smithi017.stderr:Generating grub configuration file ... 2024-09-12T16:05:56.437 INFO:teuthology.orchestra.run.smithi017.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T16:05:56.460 INFO:teuthology.orchestra.run.smithi017.stderr:done 2024-09-12T16:05:56.462 DEBUG:teuthology.orchestra.run.smithi017:> mktemp 2024-09-12T16:05:56.477 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.nl9A2D6rzo 2024-09-12T16:05:56.477 DEBUG:teuthology.orchestra.run.smithi017:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.nl9A2D6rzo 2024-09-12T16:05:56.543 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.nl9A2D6rzo 2024-09-12T16:05:56.681 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.nl9A2D6rzo is 6KB 2024-09-12T16:05:56.701 DEBUG:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.nl9A2D6rzo 2024-09-12T16:05:56.715 DEBUG:teuthology.orchestra.run.smithi017:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T16:05:56.777 INFO:teuthology.orchestra.run.smithi017.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T16:05:56.777 INFO:teuthology.orchestra.run.smithi017.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T16:05:56.777 INFO:teuthology.orchestra.run.smithi017.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T16:05:56.777 INFO:teuthology.orchestra.run.smithi017.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T16:05:56.778 DEBUG:teuthology.orchestra.run.smithi017:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T16:05:56.925 DEBUG:teuthology.orchestra.run.smithi017:> sudo shutdown -r now 2024-09-12T16:05:57.079 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T16:05:57.118 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T16:05:57.442 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T16:05:57.442 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T16:05:57.442 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T16:05:57.442 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T16:05:58.304 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T16:05:58.304 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:05:58.305 INFO:teuthology.orchestra.run.smithi204.stdout:Installed: 2024-09-12T16:05:58.305 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T16:05:58.305 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T16:05:58.305 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T16:05:58.305 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T16:05:58.305 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:05:58.305 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-09-12T16:05:58.654 DEBUG:teuthology.orchestra.run.smithi204:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T16:05:58.741 INFO:teuthology.orchestra.run.smithi204.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T16:05:58.741 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T16:05:58.741 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T16:05:58.741 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T16:05:58.741 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T16:05:58.742 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-12T16:05:58.742 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi204.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T16:05:58.742 DEBUG:teuthology.orchestra.run.smithi204:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T16:05:58.801 INFO:teuthology.orchestra.run.smithi204.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T16:05:58.801 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T16:05:58.801 DEBUG:teuthology.orchestra.run.smithi204:> sudo rpm -qi grub2-tools 2024-09-12T16:05:58.833 INFO:teuthology.orchestra.run.smithi204.stdout:Name : grub2-tools 2024-09-12T16:05:58.833 INFO:teuthology.orchestra.run.smithi204.stdout:Epoch : 1 2024-09-12T16:05:58.833 INFO:teuthology.orchestra.run.smithi204.stdout:Version : 2.06 2024-09-12T16:05:58.833 INFO:teuthology.orchestra.run.smithi204.stdout:Release : 82.el9 2024-09-12T16:05:58.833 INFO:teuthology.orchestra.run.smithi204.stdout:Architecture: x86_64 2024-09-12T16:05:58.833 INFO:teuthology.orchestra.run.smithi204.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T16:05:58.833 INFO:teuthology.orchestra.run.smithi204.stdout:Group : Unspecified 2024-09-12T16:05:58.833 INFO:teuthology.orchestra.run.smithi204.stdout:Size : 8274670 2024-09-12T16:05:58.834 INFO:teuthology.orchestra.run.smithi204.stdout:License : GPLv3+ 2024-09-12T16:05:58.834 INFO:teuthology.orchestra.run.smithi204.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T16:05:58.834 INFO:teuthology.orchestra.run.smithi204.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T16:05:58.834 INFO:teuthology.orchestra.run.smithi204.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T16:05:58.834 INFO:teuthology.orchestra.run.smithi204.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T16:05:58.834 INFO:teuthology.orchestra.run.smithi204.stdout:Packager : builder@centos.org 2024-09-12T16:05:58.834 INFO:teuthology.orchestra.run.smithi204.stdout:Vendor : CentOS 2024-09-12T16:05:58.834 INFO:teuthology.orchestra.run.smithi204.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T16:05:58.834 INFO:teuthology.orchestra.run.smithi204.stdout:Summary : Support tools for GRUB. 2024-09-12T16:05:58.834 INFO:teuthology.orchestra.run.smithi204.stdout:Description : 2024-09-12T16:05:58.834 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:05:58.834 INFO:teuthology.orchestra.run.smithi204.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T16:05:58.835 INFO:teuthology.orchestra.run.smithi204.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T16:05:58.835 INFO:teuthology.orchestra.run.smithi204.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T16:05:58.835 INFO:teuthology.orchestra.run.smithi204.stdout:hardware devices. 2024-09-12T16:05:58.835 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:05:58.835 INFO:teuthology.orchestra.run.smithi204.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T16:05:58.836 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T16:05:58.836 INFO:teuthology.task.kernel:Updating grub on smithi204 to boot 5.14.0-505.el9.x86_64 2024-09-12T16:05:58.836 DEBUG:teuthology.orchestra.run.smithi204:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T16:05:59.472 INFO:teuthology.orchestra.run.smithi204.stderr:Generating grub configuration file ... 2024-09-12T16:06:00.923 INFO:teuthology.orchestra.run.smithi204.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T16:06:00.962 INFO:teuthology.orchestra.run.smithi204.stderr:done 2024-09-12T16:06:00.970 DEBUG:teuthology.orchestra.run.smithi204:> mktemp 2024-09-12T16:06:00.986 INFO:teuthology.orchestra.run.smithi204.stdout:/tmp/tmp.r5U1Few66u 2024-09-12T16:06:00.986 DEBUG:teuthology.orchestra.run.smithi204:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.r5U1Few66u 2024-09-12T16:06:01.053 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 0666 /tmp/tmp.r5U1Few66u 2024-09-12T16:06:01.192 DEBUG:teuthology.orchestra.remote:smithi204:/tmp/tmp.r5U1Few66u is 6KB 2024-09-12T16:06:01.240 DEBUG:teuthology.orchestra.run.smithi204:> rm -fr /tmp/tmp.r5U1Few66u 2024-09-12T16:06:01.255 DEBUG:teuthology.orchestra.run.smithi204:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T16:06:01.317 INFO:teuthology.orchestra.run.smithi204.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T16:06:01.317 INFO:teuthology.orchestra.run.smithi204.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T16:06:01.318 INFO:teuthology.orchestra.run.smithi204.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T16:06:01.318 INFO:teuthology.orchestra.run.smithi204.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T16:06:01.319 DEBUG:teuthology.orchestra.run.smithi204:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T16:06:01.474 DEBUG:teuthology.orchestra.run.smithi204:> sudo shutdown -r now 2024-09-12T16:06:10.397 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-12T16:06:10.397 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-12T16:06:10.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:06:26.941 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T16:06:26.942 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-12T16:06:26.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:06:28.925 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-09-12T16:06:31.479 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-12T16:06:31.479 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-12T16:06:31.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:06:37.931 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-12T16:06:37.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:06:45.309 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.17 2024-09-12T16:06:49.917 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-09-12T16:06:54.313 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-12T16:06:54.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:06:58.921 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-12T16:06:58.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:07:01.981 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-09-12T16:07:13.993 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-12T16:07:13.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:07:37.958 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T16:07:49.969 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-12T16:07:49.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:07:50.285 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-09-12T16:07:50.671 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-12T16:07:50.671 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-12T16:07:50.672 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-09-12T16:07:50.689 INFO:teuthology.orchestra.run.smithi047.stdout:5.14.0-505.el9.x86_64 2024-09-12T16:07:50.690 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T16:07:50.690 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T16:07:50.690 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T16:07:51.690 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-12T16:07:51.691 DEBUG:teuthology.orchestra.run.smithi047:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T16:07:51.765 INFO:teuthology.orchestra.run.smithi047.stdout:ttyS1 2024-09-12T16:07:51.782 DEBUG:teuthology.parallel:result is None 2024-09-12T16:07:54.316 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T16:08:06.317 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-12T16:08:06.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:08:06.693 DEBUG:teuthology.orchestra.run.smithi017:> true 2024-09-12T16:08:07.043 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-12T16:08:07.044 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-12T16:08:07.044 DEBUG:teuthology.orchestra.run.smithi017:> uname -r 2024-09-12T16:08:07.060 INFO:teuthology.orchestra.run.smithi017.stdout:5.14.0-505.el9.x86_64 2024-09-12T16:08:07.060 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T16:08:07.060 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T16:08:07.061 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T16:08:08.062 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T16:08:08.062 DEBUG:teuthology.orchestra.run.smithi017:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T16:08:08.139 INFO:teuthology.orchestra.run.smithi017.stdout:ttyS1 2024-09-12T16:08:08.160 DEBUG:teuthology.parallel:result is None 2024-09-12T16:08:13.997 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T16:08:28.998 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-12T16:08:28.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:08:29.308 DEBUG:teuthology.orchestra.run.smithi204:> true 2024-09-12T16:08:29.678 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-12T16:08:29.679 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-12T16:08:29.679 DEBUG:teuthology.orchestra.run.smithi204:> uname -r 2024-09-12T16:08:29.695 INFO:teuthology.orchestra.run.smithi204.stdout:5.14.0-505.el9.x86_64 2024-09-12T16:08:29.696 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T16:08:29.696 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T16:08:29.696 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T16:08:30.697 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2024-09-12T16:08:30.697 DEBUG:teuthology.orchestra.run.smithi204:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T16:08:30.795 INFO:teuthology.orchestra.run.smithi204.stdout:ttyS1 2024-09-12T16:08:30.817 DEBUG:teuthology.parallel:result is None 2024-09-12T16:08:30.817 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T16:08:30.824 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T16:08:30.824 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T16:08:30.826 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T16:08:30.829 DEBUG:teuthology.orchestra.run.smithi204:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T16:08:30.847 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T16:08:30.854 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T16:08:30.860 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T16:08:30.861 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T16:08:30.886 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T16:08:30.889 DEBUG:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T16:08:30.918 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T16:08:30.925 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T16:08:30.926 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T16:08:30.949 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T16:08:30.955 DEBUG:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T16:08:30.984 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T16:08:30.989 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T16:08:30.990 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T16:08:30.996 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T16:08:31.001 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T16:08:31.001 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T16:08:31.004 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T16:08:31.011 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T16:08:31.011 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T16:08:31.040 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T16:08:31.046 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T16:08:31.074 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T16:08:31.083 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T16:08:31.083 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T16:08:31.114 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T16:08:31.116 DEBUG:teuthology.orchestra.run.smithi204:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T16:08:31.133 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T16:08:31.213 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T16:08:31.255 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T16:08:31.335 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T16:08:31.381 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T16:08:31.381 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T16:08:31.449 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T16:08:31.486 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T16:08:31.553 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T16:08:31.640 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T16:08:31.683 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T16:08:31.683 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T16:08:31.752 DEBUG:teuthology.orchestra.run.smithi204:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T16:08:31.794 DEBUG:teuthology.orchestra.run.smithi204:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T16:08:31.854 DEBUG:teuthology.orchestra.run.smithi204:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T16:08:31.939 DEBUG:teuthology.orchestra.run.smithi204:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T16:08:31.981 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T16:08:31.981 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T16:08:32.048 DEBUG:teuthology.orchestra.run.smithi017:> sudo service rsyslog restart 2024-09-12T16:08:32.050 DEBUG:teuthology.orchestra.run.smithi047:> sudo service rsyslog restart 2024-09-12T16:08:32.053 DEBUG:teuthology.orchestra.run.smithi204:> sudo service rsyslog restart 2024-09-12T16:08:32.095 INFO:teuthology.orchestra.run.smithi017.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T16:08:32.107 INFO:teuthology.orchestra.run.smithi047.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T16:08:32.133 INFO:teuthology.orchestra.run.smithi204.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T16:08:32.638 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T16:08:32.646 INFO:teuthology.task.internal:Starting timer... 2024-09-12T16:08:32.646 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T16:08:32.657 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T16:08:32.666 DEBUG:teuthology.orchestra.run.smithi017:> sudo service auditd rotate 2024-09-12T16:08:32.727 INFO:teuthology.orchestra.run.smithi017.stdout:Rotating logs: 2024-09-12T16:08:32.729 DEBUG:teuthology.orchestra.run.smithi047:> sudo service auditd rotate 2024-09-12T16:08:32.785 INFO:teuthology.orchestra.run.smithi047.stdout:Rotating logs: 2024-09-12T16:08:32.787 DEBUG:teuthology.orchestra.run.smithi204:> sudo service auditd rotate 2024-09-12T16:08:32.841 INFO:teuthology.orchestra.run.smithi204.stdout:Rotating logs: 2024-09-12T16:08:32.844 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T16:08:32.844 DEBUG:teuthology.orchestra.run.smithi017:> /usr/sbin/getenforce 2024-09-12T16:08:32.871 INFO:teuthology.orchestra.run.smithi017.stdout:Permissive 2024-09-12T16:08:32.871 DEBUG:teuthology.orchestra.run.smithi047:> /usr/sbin/getenforce 2024-09-12T16:08:32.893 INFO:teuthology.orchestra.run.smithi047.stdout:Permissive 2024-09-12T16:08:32.894 DEBUG:teuthology.orchestra.run.smithi204:> /usr/sbin/getenforce 2024-09-12T16:08:32.917 INFO:teuthology.orchestra.run.smithi204.stdout:Permissive 2024-09-12T16:08:32.918 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi017.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi047.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi204.front.sepia.ceph.com': 'permissive'} 2024-09-12T16:08:32.918 DEBUG:teuthology.orchestra.run.smithi017:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T16:08:32.947 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:08:32.947 DEBUG:teuthology.orchestra.run.smithi047:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T16:08:32.978 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:08:32.978 DEBUG:teuthology.orchestra.run.smithi204:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T16:08:33.007 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:08:33.007 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T16:08:33.007 DEBUG:teuthology.orchestra.run.smithi017:> sudo /usr/sbin/setenforce permissive 2024-09-12T16:08:33.038 DEBUG:teuthology.orchestra.run.smithi047:> sudo /usr/sbin/setenforce permissive 2024-09-12T16:08:33.077 DEBUG:teuthology.orchestra.run.smithi204:> sudo /usr/sbin/setenforce permissive 2024-09-12T16:08:33.110 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T16:08:33.121 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-12T16:08:33.124 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-12T16:08:33.242 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T16:08:33.253 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T16:08:33.254 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi017.front.sepia.ceph.com,smithi047.front.sepia.ceph.com,smithi204.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T16:12:31.587 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi017.front.sepia.ceph.com'), Remote(name='ubuntu@smithi047.front.sepia.ceph.com'), Remote(name='ubuntu@smithi204.front.sepia.ceph.com')] 2024-09-12T16:12:31.589 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-12T16:12:31.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:12:31.688 DEBUG:teuthology.orchestra.run.smithi017:> true 2024-09-12T16:12:31.770 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-12T16:12:31.770 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-12T16:12:31.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:12:31.849 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-09-12T16:12:31.934 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-12T16:12:31.934 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-12T16:12:31.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:12:32.013 DEBUG:teuthology.orchestra.run.smithi204:> true 2024-09-12T16:12:32.093 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-12T16:12:32.094 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T16:12:32.105 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T16:12:32.105 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T16:12:32.105 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T16:12:32.108 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T16:12:32.108 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T16:12:32.111 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T16:12:32.111 DEBUG:teuthology.orchestra.run.smithi204:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T16:12:32.141 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T16:12:32.141 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T16:12:32.157 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T16:12:32.158 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T16:12:32.164 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T16:12:32.179 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T16:12:32.184 INFO:teuthology.orchestra.run.smithi047.stderr:sudo: ntpd: command not found 2024-09-12T16:12:32.185 INFO:teuthology.orchestra.run.smithi017.stderr:sudo: ntpd: command not found 2024-09-12T16:12:32.195 INFO:teuthology.orchestra.run.smithi047.stdout:506 Cannot talk to daemon 2024-09-12T16:12:32.198 INFO:teuthology.orchestra.run.smithi017.stdout:506 Cannot talk to daemon 2024-09-12T16:12:32.205 INFO:teuthology.orchestra.run.smithi204.stderr:sudo: ntpd: command not found 2024-09-12T16:12:32.211 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T16:12:32.213 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T16:12:32.216 INFO:teuthology.orchestra.run.smithi204.stdout:506 Cannot talk to daemon 2024-09-12T16:12:32.227 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T16:12:32.228 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T16:12:32.234 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T16:12:32.244 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T16:12:32.286 INFO:teuthology.orchestra.run.smithi017.stderr:bash: line 1: ntpq: command not found 2024-09-12T16:12:32.287 INFO:teuthology.orchestra.run.smithi047.stderr:bash: line 1: ntpq: command not found 2024-09-12T16:12:32.290 INFO:teuthology.orchestra.run.smithi017.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T16:12:32.290 INFO:teuthology.orchestra.run.smithi017.stdout:=============================================================================== 2024-09-12T16:12:32.290 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T16:12:32.290 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T16:12:32.290 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T16:12:32.290 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T16:12:32.292 INFO:teuthology.orchestra.run.smithi047.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T16:12:32.292 INFO:teuthology.orchestra.run.smithi047.stdout:=============================================================================== 2024-09-12T16:12:32.292 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T16:12:32.292 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T16:12:32.292 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T16:12:32.292 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T16:12:32.299 INFO:teuthology.orchestra.run.smithi204.stderr:bash: line 1: ntpq: command not found 2024-09-12T16:12:32.302 INFO:teuthology.orchestra.run.smithi204.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T16:12:32.303 INFO:teuthology.orchestra.run.smithi204.stdout:=============================================================================== 2024-09-12T16:12:32.303 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T16:12:32.303 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T16:12:32.303 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T16:12:32.303 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T16:12:32.304 INFO:teuthology.run_tasks:Running task install... 2024-09-12T16:12:32.312 DEBUG:teuthology.task.install:project ceph 2024-09-12T16:12:32.312 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'extra_packages': ['rbd-nbd'], 'flavor': 'default', 'sha1': 'd61b08865d4d98738f45ff2e4806d7fb6d03eca1'}} 2024-09-12T16:12:32.312 DEBUG:teuthology.task.install:config {'extra_packages': ['rbd-nbd'], 'flavor': 'default', 'sha1': 'd61b08865d4d98738f45ff2e4806d7fb6d03eca1'} 2024-09-12T16:12:32.312 INFO:teuthology.task.install:Using flavor: default 2024-09-12T16:12:32.319 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T16:12:32.319 INFO:teuthology.task.install:extra packages: ['rbd-nbd'] 2024-09-12T16:12:32.320 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': ['rbd-nbd'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd61b08865d4d98738f45ff2e4806d7fb6d03eca1', 'tag': None, 'wait_for_package': False} 2024-09-12T16:12:32.320 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d61b08865d4d98738f45ff2e4806d7fb6d03eca1 2024-09-12T16:12:32.323 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': ['rbd-nbd'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd61b08865d4d98738f45ff2e4806d7fb6d03eca1', 'tag': None, 'wait_for_package': False} 2024-09-12T16:12:32.323 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d61b08865d4d98738f45ff2e4806d7fb6d03eca1 2024-09-12T16:12:32.324 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': ['rbd-nbd'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd61b08865d4d98738f45ff2e4806d7fb6d03eca1', 'tag': None, 'wait_for_package': False} 2024-09-12T16:12:32.324 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d61b08865d4d98738f45ff2e4806d7fb6d03eca1 2024-09-12T16:12:32.466 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/centos/9/flavors/default/ 2024-09-12T16:12:32.466 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4883.gd61b0886 2024-09-12T16:12:32.477 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/centos/9/flavors/default/ 2024-09-12T16:12:32.477 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4883.gd61b0886 2024-09-12T16:12:32.480 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/centos/9/flavors/default/ 2024-09-12T16:12:32.480 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4883.gd61b0886 2024-09-12T16:12:32.576 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T16:12:32.576 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T16:12:32.576 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T16:12:32.586 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T16:12:32.586 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T16:12:32.586 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T16:12:32.594 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T16:12:32.594 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T16:12:32.594 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T16:12:32.604 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, rbd-nbd on remote rpm x86_64 2024-09-12T16:12:32.604 DEBUG:teuthology.orchestra.run.smithi017:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T16:12:32.612 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, rbd-nbd on remote rpm x86_64 2024-09-12T16:12:32.613 DEBUG:teuthology.orchestra.run.smithi204:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T16:12:32.621 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, rbd-nbd on remote rpm x86_64 2024-09-12T16:12:32.621 DEBUG:teuthology.orchestra.run.smithi047:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T16:12:32.671 DEBUG:teuthology.orchestra.run.smithi017:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T16:12:32.678 DEBUG:teuthology.orchestra.run.smithi204:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T16:12:32.687 DEBUG:teuthology.orchestra.run.smithi047:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T16:12:32.749 DEBUG:teuthology.orchestra.run.smithi017:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T16:12:32.754 DEBUG:teuthology.orchestra.run.smithi204:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T16:12:32.764 DEBUG:teuthology.orchestra.run.smithi047:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T16:12:32.814 INFO:teuthology.orchestra.run.smithi017.stdout:check_obsoletes = 1 2024-09-12T16:12:32.816 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum clean all 2024-09-12T16:12:32.819 INFO:teuthology.orchestra.run.smithi204.stdout:check_obsoletes = 1 2024-09-12T16:12:32.821 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum clean all 2024-09-12T16:12:32.829 INFO:teuthology.orchestra.run.smithi047.stdout:check_obsoletes = 1 2024-09-12T16:12:32.831 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum clean all 2024-09-12T16:12:33.054 INFO:teuthology.orchestra.run.smithi017.stdout:45 files removed 2024-09-12T16:12:33.057 INFO:teuthology.orchestra.run.smithi204.stdout:45 files removed 2024-09-12T16:12:33.070 INFO:teuthology.orchestra.run.smithi047.stdout:45 files removed 2024-09-12T16:12:33.082 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-radosgw 2024-09-12T16:12:33.088 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum -y install ceph-radosgw 2024-09-12T16:12:33.098 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-radosgw 2024-09-12T16:12:33.636 INFO:teuthology.orchestra.run.smithi204.stdout:ceph packages for x86_64 320 kB/s | 84 kB 00:00 2024-09-12T16:12:33.661 INFO:teuthology.orchestra.run.smithi017.stdout:ceph packages for x86_64 300 kB/s | 84 kB 00:00 2024-09-12T16:12:33.671 INFO:teuthology.orchestra.run.smithi047.stdout:ceph packages for x86_64 308 kB/s | 84 kB 00:00 2024-09-12T16:12:33.911 INFO:teuthology.orchestra.run.smithi204.stdout:ceph noarch packages 104 kB/s | 24 kB 00:00 2024-09-12T16:12:33.953 INFO:teuthology.orchestra.run.smithi017.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-09-12T16:12:33.964 INFO:teuthology.orchestra.run.smithi047.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-09-12T16:12:34.178 INFO:teuthology.orchestra.run.smithi204.stdout:ceph source packages 8.4 kB/s | 1.9 kB 00:00 2024-09-12T16:12:34.229 INFO:teuthology.orchestra.run.smithi017.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-12T16:12:34.248 INFO:teuthology.orchestra.run.smithi047.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-12T16:12:34.979 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-09-12T16:12:35.765 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - BaseOS 5.6 MB/s | 8.2 MB 00:01 2024-09-12T16:12:35.987 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.2 MB 00:01 2024-09-12T16:12:36.789 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-12T16:12:38.030 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - AppStream 21 MB/s | 20 MB 00:00 2024-09-12T16:12:38.891 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - AppStream 10 MB/s | 20 MB 00:01 2024-09-12T16:12:42.323 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 6.5 MB 00:01 2024-09-12T16:12:42.481 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-12T16:12:43.358 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-12T16:12:44.024 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - Extras packages 59 kB/s | 19 kB 00:00 2024-09-12T16:12:44.032 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 19 kB 00:00 2024-09-12T16:12:44.803 INFO:teuthology.orchestra.run.smithi204.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-12T16:12:45.170 INFO:teuthology.orchestra.run.smithi017.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-12T16:12:45.651 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 19 kB 00:00 2024-09-12T16:12:46.580 INFO:teuthology.orchestra.run.smithi047.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-12T16:12:50.226 INFO:teuthology.orchestra.run.smithi204.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-12T16:12:50.825 INFO:teuthology.orchestra.run.smithi017.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-12T16:12:52.344 INFO:teuthology.orchestra.run.smithi047.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-12T16:12:52.628 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-09-12T16:12:52.644 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:12:52.645 INFO:teuthology.orchestra.run.smithi204.stdout: Package Arch Version Repository Size 2024-09-12T16:12:52.645 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:12:52.645 INFO:teuthology.orchestra.run.smithi204.stdout:Installing: 2024-09-12T16:12:52.645 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-radosgw x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 11 M 2024-09-12T16:12:52.645 INFO:teuthology.orchestra.run.smithi204.stdout:Upgrading: 2024-09-12T16:12:52.645 INFO:teuthology.orchestra.run.smithi204.stdout: librados2 x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 3.5 M 2024-09-12T16:12:52.645 INFO:teuthology.orchestra.run.smithi204.stdout: librbd1 x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 3.2 M 2024-09-12T16:12:52.645 INFO:teuthology.orchestra.run.smithi204.stdout:Installing dependencies: 2024-09-12T16:12:52.645 INFO:teuthology.orchestra.run.smithi204.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T16:12:52.645 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-base x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 5.5 M 2024-09-12T16:12:52.645 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-common x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 22 M 2024-09-12T16:12:52.645 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-selinux x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 25 k 2024-09-12T16:12:52.646 INFO:teuthology.orchestra.run.smithi204.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T16:12:52.646 INFO:teuthology.orchestra.run.smithi204.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T16:12:52.646 INFO:teuthology.orchestra.run.smithi204.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T16:12:52.646 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs2 x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 755 k 2024-09-12T16:12:52.646 INFO:teuthology.orchestra.run.smithi204.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-12T16:12:52.646 INFO:teuthology.orchestra.run.smithi204.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T16:12:52.646 INFO:teuthology.orchestra.run.smithi204.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T16:12:52.646 INFO:teuthology.orchestra.run.smithi204.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T16:12:52.646 INFO:teuthology.orchestra.run.smithi204.stdout: libradosstriper1 x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 508 k 2024-09-12T16:12:52.646 INFO:teuthology.orchestra.run.smithi204.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T16:12:52.646 INFO:teuthology.orchestra.run.smithi204.stdout: librgw2 x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 5.5 M 2024-09-12T16:12:52.646 INFO:teuthology.orchestra.run.smithi204.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T16:12:52.646 INFO:teuthology.orchestra.run.smithi204.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T16:12:52.647 INFO:teuthology.orchestra.run.smithi204.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T16:12:52.647 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-argparse x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 45 k 2024-09-12T16:12:52.647 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-common x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 143 k 2024-09-12T16:12:52.647 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cephfs x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 162 k 2024-09-12T16:12:52.647 INFO:teuthology.orchestra.run.smithi204.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T16:12:52.647 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rados x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 321 k 2024-09-12T16:12:52.647 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rbd x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 307 k 2024-09-12T16:12:52.647 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rgw x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 99 k 2024-09-12T16:12:52.647 INFO:teuthology.orchestra.run.smithi204.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T16:12:52.647 INFO:teuthology.orchestra.run.smithi204.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T16:12:52.647 INFO:teuthology.orchestra.run.smithi204.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T16:12:52.647 INFO:teuthology.orchestra.run.smithi204.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T16:12:52.647 INFO:teuthology.orchestra.run.smithi204.stdout:Installing weak dependencies: 2024-09-12T16:12:52.648 INFO:teuthology.orchestra.run.smithi204.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T16:12:52.648 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:12:52.648 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction Summary 2024-09-12T16:12:52.648 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:12:52.648 INFO:teuthology.orchestra.run.smithi204.stdout:Install 31 Packages 2024-09-12T16:12:52.648 INFO:teuthology.orchestra.run.smithi204.stdout:Upgrade 2 Packages 2024-09-12T16:12:52.648 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:12:52.648 INFO:teuthology.orchestra.run.smithi204.stdout:Total download size: 62 M 2024-09-12T16:12:52.649 INFO:teuthology.orchestra.run.smithi204.stdout:Downloading Packages: 2024-09-12T16:12:53.247 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-12T16:12:53.250 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:12:53.251 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-09-12T16:12:53.251 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:12:53.251 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-12T16:12:53.251 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 11 M 2024-09-12T16:12:53.251 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrading: 2024-09-12T16:12:53.251 INFO:teuthology.orchestra.run.smithi017.stdout: librados2 x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 3.5 M 2024-09-12T16:12:53.251 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1 x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 3.2 M 2024-09-12T16:12:53.251 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-09-12T16:12:53.251 INFO:teuthology.orchestra.run.smithi017.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T16:12:53.251 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 5.5 M 2024-09-12T16:12:53.251 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 22 M 2024-09-12T16:12:53.251 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-selinux x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 25 k 2024-09-12T16:12:53.252 INFO:teuthology.orchestra.run.smithi017.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T16:12:53.252 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T16:12:53.252 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T16:12:53.252 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2 x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 755 k 2024-09-12T16:12:53.252 INFO:teuthology.orchestra.run.smithi017.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-12T16:12:53.252 INFO:teuthology.orchestra.run.smithi017.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T16:12:53.252 INFO:teuthology.orchestra.run.smithi017.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T16:12:53.252 INFO:teuthology.orchestra.run.smithi017.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T16:12:53.252 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1 x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 508 k 2024-09-12T16:12:53.252 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T16:12:53.252 INFO:teuthology.orchestra.run.smithi017.stdout: librgw2 x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 5.5 M 2024-09-12T16:12:53.252 INFO:teuthology.orchestra.run.smithi017.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T16:12:53.252 INFO:teuthology.orchestra.run.smithi017.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T16:12:53.253 INFO:teuthology.orchestra.run.smithi017.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T16:12:53.253 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 45 k 2024-09-12T16:12:53.253 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-common x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 143 k 2024-09-12T16:12:53.253 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 162 k 2024-09-12T16:12:53.253 INFO:teuthology.orchestra.run.smithi017.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T16:12:53.253 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 321 k 2024-09-12T16:12:53.253 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 307 k 2024-09-12T16:12:53.253 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 99 k 2024-09-12T16:12:53.253 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T16:12:53.253 INFO:teuthology.orchestra.run.smithi017.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T16:12:53.253 INFO:teuthology.orchestra.run.smithi017.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T16:12:53.253 INFO:teuthology.orchestra.run.smithi017.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T16:12:53.254 INFO:teuthology.orchestra.run.smithi017.stdout:Installing weak dependencies: 2024-09-12T16:12:53.254 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T16:12:53.254 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:12:53.254 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-12T16:12:53.254 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:12:53.254 INFO:teuthology.orchestra.run.smithi017.stdout:Install 31 Packages 2024-09-12T16:12:53.254 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrade 2 Packages 2024-09-12T16:12:53.254 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:12:53.255 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 62 M 2024-09-12T16:12:53.255 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-12T16:12:53.268 INFO:teuthology.orchestra.run.smithi204.stdout:(1/33): ceph-base-19.3.0-4883.gd61b0886.el9.x86 11 MB/s | 5.5 MB 00:00 2024-09-12T16:12:53.327 INFO:teuthology.orchestra.run.smithi204.stdout:(2/33): ceph-selinux-19.3.0-4883.gd61b0886.el9. 432 kB/s | 25 kB 00:00 2024-09-12T16:12:53.444 INFO:teuthology.orchestra.run.smithi204.stdout:(3/33): libcephfs2-19.3.0-4883.gd61b0886.el9.x8 6.3 MB/s | 755 kB 00:00 2024-09-12T16:12:53.544 INFO:teuthology.orchestra.run.smithi204.stdout:(4/33): libradosstriper1-19.3.0-4883.gd61b0886. 5.0 MB/s | 508 kB 00:00 2024-09-12T16:12:53.786 INFO:teuthology.orchestra.run.smithi204.stdout:(5/33): ceph-common-19.3.0-4883.gd61b0886.el9.x 21 MB/s | 22 MB 00:01 2024-09-12T16:12:53.912 INFO:teuthology.orchestra.run.smithi204.stdout:(6/33): ceph-radosgw-19.3.0-4883.gd61b0886.el9. 9.5 MB/s | 11 MB 00:01 2024-09-12T16:12:53.937 INFO:teuthology.orchestra.run.smithi204.stdout:(7/33): python3-ceph-argparse-19.3.0-4883.gd61b 301 kB/s | 45 kB 00:00 2024-09-12T16:12:54.029 INFO:teuthology.orchestra.run.smithi204.stdout:(8/33): librgw2-19.3.0-4883.gd61b0886.el9.x86_6 11 MB/s | 5.5 MB 00:00 2024-09-12T16:12:54.063 INFO:teuthology.orchestra.run.smithi204.stdout:(9/33): python3-ceph-common-19.3.0-4883.gd61b08 949 kB/s | 143 kB 00:00 2024-09-12T16:12:54.104 INFO:teuthology.orchestra.run.smithi204.stdout:(10/33): python3-cephfs-19.3.0-4883.gd61b0886.e 969 kB/s | 162 kB 00:00 2024-09-12T16:12:54.127 INFO:teuthology.orchestra.run.smithi017.stdout:(1/33): ceph-base-19.3.0-4883.gd61b0886.el9.x86 12 MB/s | 5.5 MB 00:00 2024-09-12T16:12:54.129 INFO:teuthology.orchestra.run.smithi204.stdout:(11/33): python3-rbd-19.3.0-4883.gd61b0886.el9. 4.5 MB/s | 307 kB 00:00 2024-09-12T16:12:54.154 INFO:teuthology.orchestra.run.smithi204.stdout:(12/33): python3-rados-19.3.0-4883.gd61b0886.el 2.5 MB/s | 321 kB 00:00 2024-09-12T16:12:54.180 INFO:teuthology.orchestra.run.smithi204.stdout:(13/33): python3-rgw-19.3.0-4883.gd61b0886.el9. 1.3 MB/s | 99 kB 00:00 2024-09-12T16:12:54.185 INFO:teuthology.orchestra.run.smithi017.stdout:(2/33): ceph-selinux-19.3.0-4883.gd61b0886.el9. 433 kB/s | 25 kB 00:00 2024-09-12T16:12:54.261 INFO:teuthology.orchestra.run.smithi017.stdout:(3/33): libcephfs2-19.3.0-4883.gd61b0886.el9.x8 9.8 MB/s | 755 kB 00:00 2024-09-12T16:12:54.353 INFO:teuthology.orchestra.run.smithi017.stdout:(4/33): libradosstriper1-19.3.0-4883.gd61b0886. 5.4 MB/s | 508 kB 00:00 2024-09-12T16:12:54.622 INFO:teuthology.orchestra.run.smithi204.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 217 kB/s | 107 kB 00:00 2024-09-12T16:12:54.705 INFO:teuthology.orchestra.run.smithi204.stdout:(15/33): libnbd-1.20.2-2.el9.x86_64.rpm 310 kB/s | 171 kB 00:00 2024-09-12T16:12:54.711 INFO:teuthology.orchestra.run.smithi017.stdout:(5/33): ceph-radosgw-19.3.0-4883.gd61b0886.el9. 11 MB/s | 11 MB 00:01 2024-09-12T16:12:54.731 INFO:teuthology.orchestra.run.smithi204.stdout:(16/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 291 kB/s | 160 kB 00:00 2024-09-12T16:12:54.756 INFO:teuthology.orchestra.run.smithi204.stdout:(17/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 338 kB/s | 45 kB 00:00 2024-09-12T16:12:54.781 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T16:12:54.800 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:12:54.800 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-09-12T16:12:54.800 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:12:54.800 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-12T16:12:54.800 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-radosgw x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 11 M 2024-09-12T16:12:54.800 INFO:teuthology.orchestra.run.smithi047.stdout:Upgrading: 2024-09-12T16:12:54.800 INFO:teuthology.orchestra.run.smithi047.stdout: librados2 x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 3.5 M 2024-09-12T16:12:54.800 INFO:teuthology.orchestra.run.smithi047.stdout: librbd1 x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 3.2 M 2024-09-12T16:12:54.801 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-12T16:12:54.801 INFO:teuthology.orchestra.run.smithi047.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T16:12:54.801 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 5.5 M 2024-09-12T16:12:54.801 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-common x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 22 M 2024-09-12T16:12:54.801 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-selinux x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 25 k 2024-09-12T16:12:54.801 INFO:teuthology.orchestra.run.smithi047.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T16:12:54.801 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T16:12:54.801 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T16:12:54.801 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs2 x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 755 k 2024-09-12T16:12:54.801 INFO:teuthology.orchestra.run.smithi047.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-12T16:12:54.801 INFO:teuthology.orchestra.run.smithi047.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T16:12:54.801 INFO:teuthology.orchestra.run.smithi047.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T16:12:54.801 INFO:teuthology.orchestra.run.smithi047.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T16:12:54.802 INFO:teuthology.orchestra.run.smithi047.stdout: libradosstriper1 x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 508 k 2024-09-12T16:12:54.802 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T16:12:54.802 INFO:teuthology.orchestra.run.smithi047.stdout: librgw2 x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 5.5 M 2024-09-12T16:12:54.802 INFO:teuthology.orchestra.run.smithi047.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T16:12:54.802 INFO:teuthology.orchestra.run.smithi047.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T16:12:54.802 INFO:teuthology.orchestra.run.smithi047.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T16:12:54.802 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 45 k 2024-09-12T16:12:54.802 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-common x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 143 k 2024-09-12T16:12:54.802 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cephfs x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 162 k 2024-09-12T16:12:54.802 INFO:teuthology.orchestra.run.smithi047.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T16:12:54.802 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 321 k 2024-09-12T16:12:54.802 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rbd x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 307 k 2024-09-12T16:12:54.802 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rgw x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 99 k 2024-09-12T16:12:54.803 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T16:12:54.803 INFO:teuthology.orchestra.run.smithi047.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T16:12:54.803 INFO:teuthology.orchestra.run.smithi047.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T16:12:54.803 INFO:teuthology.orchestra.run.smithi047.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T16:12:54.803 INFO:teuthology.orchestra.run.smithi047.stdout:Installing weak dependencies: 2024-09-12T16:12:54.803 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T16:12:54.803 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:12:54.803 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-12T16:12:54.803 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:12:54.803 INFO:teuthology.orchestra.run.smithi047.stdout:Install 31 Packages 2024-09-12T16:12:54.803 INFO:teuthology.orchestra.run.smithi047.stdout:Upgrade 2 Packages 2024-09-12T16:12:54.803 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:12:54.804 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 62 M 2024-09-12T16:12:54.804 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-12T16:12:54.814 INFO:teuthology.orchestra.run.smithi017.stdout:(6/33): librgw2-19.3.0-4883.gd61b0886.el9.x86_6 12 MB/s | 5.5 MB 00:00 2024-09-12T16:12:54.845 INFO:teuthology.orchestra.run.smithi017.stdout:(7/33): python3-ceph-argparse-19.3.0-4883.gd61b 338 kB/s | 45 kB 00:00 2024-09-12T16:12:54.871 INFO:teuthology.orchestra.run.smithi017.stdout:(8/33): python3-ceph-common-19.3.0-4883.gd61b08 2.5 MB/s | 143 kB 00:00 2024-09-12T16:12:54.873 INFO:teuthology.orchestra.run.smithi204.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 363 kB/s | 42 kB 00:00 2024-09-12T16:12:54.896 INFO:teuthology.orchestra.run.smithi017.stdout:(9/33): python3-cephfs-19.3.0-4883.gd61b0886.el 3.1 MB/s | 162 kB 00:00 2024-09-12T16:12:54.930 INFO:teuthology.orchestra.run.smithi017.stdout:(10/33): python3-rados-19.3.0-4883.gd61b0886.el 5.3 MB/s | 321 kB 00:00 2024-09-12T16:12:54.931 INFO:teuthology.orchestra.run.smithi204.stdout:(19/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.4 MB/s | 292 kB 00:00 2024-09-12T16:12:54.955 INFO:teuthology.orchestra.run.smithi017.stdout:(11/33): python3-rbd-19.3.0-4883.gd61b0886.el9. 5.1 MB/s | 307 kB 00:00 2024-09-12T16:12:54.980 INFO:teuthology.orchestra.run.smithi017.stdout:(12/33): python3-rgw-19.3.0-4883.gd61b0886.el9. 1.9 MB/s | 99 kB 00:00 2024-09-12T16:12:55.007 INFO:teuthology.orchestra.run.smithi204.stdout:(20/33): librdkafka-1.6.1-102.el9.x86_64.rpm 2.1 MB/s | 662 kB 00:00 2024-09-12T16:12:55.041 INFO:teuthology.orchestra.run.smithi204.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 330 kB/s | 36 kB 00:00 2024-09-12T16:12:55.107 INFO:teuthology.orchestra.run.smithi204.stdout:(22/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 4.5 MB/s | 308 kB 00:00 2024-09-12T16:12:55.133 INFO:teuthology.orchestra.run.smithi204.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 377 kB/s | 47 kB 00:00 2024-09-12T16:12:55.166 INFO:teuthology.orchestra.run.smithi204.stdout:(24/33): qatlib-24.02.0-1.el9.x86_64.rpm 753 kB/s | 221 kB 00:00 2024-09-12T16:12:55.209 INFO:teuthology.orchestra.run.smithi204.stdout:(25/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 344 kB/s | 26 kB 00:00 2024-09-12T16:12:55.230 INFO:teuthology.orchestra.run.smithi017.stdout:(13/33): ceph-common-19.3.0-4883.gd61b0886.el9. 14 MB/s | 22 MB 00:01 2024-09-12T16:12:55.233 INFO:teuthology.orchestra.run.smithi204.stdout:(26/33): libunwind-1.6.2-1.el9.x86_64.rpm 2.9 MB/s | 67 kB 00:00 2024-09-12T16:12:55.259 INFO:teuthology.orchestra.run.smithi204.stdout:(27/33): liboath-2.6.7-2.el9.x86_64.rpm 537 kB/s | 49 kB 00:00 2024-09-12T16:12:55.272 INFO:teuthology.orchestra.run.smithi017.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 337 kB/s | 107 kB 00:00 2024-09-12T16:12:55.293 INFO:teuthology.orchestra.run.smithi204.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.7 MB/s | 191 kB 00:00 2024-09-12T16:12:55.297 INFO:teuthology.orchestra.run.smithi017.stdout:(15/33): libnbd-1.20.2-2.el9.x86_64.rpm 538 kB/s | 171 kB 00:00 2024-09-12T16:12:55.334 INFO:teuthology.orchestra.run.smithi204.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.1 MB/s | 839 kB 00:00 2024-09-12T16:12:55.347 INFO:teuthology.orchestra.run.smithi017.stdout:(16/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-12T16:12:55.373 INFO:teuthology.orchestra.run.smithi017.stdout:(17/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 449 kB/s | 45 kB 00:00 2024-09-12T16:12:55.426 INFO:teuthology.orchestra.run.smithi204.stdout:(30/33): libarrow-9.0.0-11.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-09-12T16:12:55.448 INFO:teuthology.orchestra.run.smithi017.stdout:(18/33): librdkafka-1.6.1-102.el9.x86_64.rpm 4.3 MB/s | 662 kB 00:00 2024-09-12T16:12:55.468 INFO:teuthology.orchestra.run.smithi204.stdout:(31/33): thrift-0.15.0-2.el9.x86_64.rpm 9.0 MB/s | 1.6 MB 00:00 2024-09-12T16:12:55.473 INFO:teuthology.orchestra.run.smithi017.stdout:(19/33): python3-prettytable-0.7.2-27.el9.noarc 422 kB/s | 42 kB 00:00 2024-09-12T16:12:55.499 INFO:teuthology.orchestra.run.smithi017.stdout:(20/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.9 MB/s | 292 kB 00:00 2024-09-12T16:12:55.558 INFO:teuthology.orchestra.run.smithi017.stdout:(21/33): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-09-12T16:12:55.583 INFO:teuthology.orchestra.run.smithi017.stdout:(22/33): qatlib-service-24.02.0-1.el9.x86_64.rp 329 kB/s | 36 kB 00:00 2024-09-12T16:12:55.585 INFO:teuthology.orchestra.run.smithi204.stdout:(32/33): librados2-19.3.0-4883.gd61b0886.el9.x8 14 MB/s | 3.5 MB 00:00 2024-09-12T16:12:55.608 INFO:teuthology.orchestra.run.smithi017.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 435 kB/s | 47 kB 00:00 2024-09-12T16:12:55.667 INFO:teuthology.orchestra.run.smithi017.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2024-09-12T16:12:55.669 INFO:teuthology.orchestra.run.smithi204.stdout:(33/33): librbd1-19.3.0-4883.gd61b0886.el9.x86_ 13 MB/s | 3.2 MB 00:00 2024-09-12T16:12:55.674 INFO:teuthology.orchestra.run.smithi204.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:12:55.674 INFO:teuthology.orchestra.run.smithi204.stdout:Total 20 MB/s | 62 MB 00:03 2024-09-12T16:12:55.692 INFO:teuthology.orchestra.run.smithi017.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-12T16:12:55.717 INFO:teuthology.orchestra.run.smithi017.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 278 kB/s | 26 kB 00:00 2024-09-12T16:12:55.742 INFO:teuthology.orchestra.run.smithi017.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-12T16:12:55.768 INFO:teuthology.orchestra.run.smithi017.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-12T16:12:55.789 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction check 2024-09-12T16:12:55.810 INFO:teuthology.orchestra.run.smithi017.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-12T16:12:55.825 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction check succeeded. 2024-09-12T16:12:55.825 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction test 2024-09-12T16:12:55.868 INFO:teuthology.orchestra.run.smithi017.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-12T16:12:55.952 INFO:teuthology.orchestra.run.smithi017.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-12T16:12:56.335 INFO:teuthology.orchestra.run.smithi017.stdout:(32/33): librados2-19.3.0-4883.gd61b0886.el9.x8 6.6 MB/s | 3.5 MB 00:00 2024-09-12T16:12:56.345 INFO:teuthology.orchestra.run.smithi047.stdout:(1/33): ceph-radosgw-19.3.0-4883.gd61b0886.el9. 12 MB/s | 11 MB 00:00 2024-09-12T16:12:56.387 INFO:teuthology.orchestra.run.smithi047.stdout:(2/33): ceph-selinux-19.3.0-4883.gd61b0886.el9. 607 kB/s | 25 kB 00:00 2024-09-12T16:12:56.494 INFO:teuthology.orchestra.run.smithi017.stdout:(33/33): librbd1-19.3.0-4883.gd61b0886.el9.x86_ 5.2 MB/s | 3.2 MB 00:00 2024-09-12T16:12:56.499 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:12:56.499 INFO:teuthology.orchestra.run.smithi017.stdout:Total 19 MB/s | 62 MB 00:03 2024-09-12T16:12:56.506 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction test succeeded. 2024-09-12T16:12:56.507 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction 2024-09-12T16:12:56.617 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-12T16:12:56.629 INFO:teuthology.orchestra.run.smithi047.stdout:(3/33): ceph-common-19.3.0-4883.gd61b0886.el9.x 19 MB/s | 22 MB 00:01 2024-09-12T16:12:56.659 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-12T16:12:56.659 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-12T16:12:56.671 INFO:teuthology.orchestra.run.smithi047.stdout:(4/33): libcephfs2-19.3.0-4883.gd61b0886.el9.x8 2.6 MB/s | 755 kB 00:00 2024-09-12T16:12:56.696 INFO:teuthology.orchestra.run.smithi047.stdout:(5/33): libradosstriper1-19.3.0-4883.gd61b0886. 7.5 MB/s | 508 kB 00:00 2024-09-12T16:12:56.738 INFO:teuthology.orchestra.run.smithi047.stdout:(6/33): python3-ceph-argparse-19.3.0-4883.gd61b 1.1 MB/s | 45 kB 00:00 2024-09-12T16:12:56.789 INFO:teuthology.orchestra.run.smithi047.stdout:(7/33): python3-ceph-common-19.3.0-4883.gd61b08 2.8 MB/s | 143 kB 00:00 2024-09-12T16:12:56.839 INFO:teuthology.orchestra.run.smithi047.stdout:(8/33): python3-cephfs-19.3.0-4883.gd61b0886.el 3.2 MB/s | 162 kB 00:00 2024-09-12T16:12:56.914 INFO:teuthology.orchestra.run.smithi047.stdout:(9/33): librgw2-19.3.0-4883.gd61b0886.el9.x86_6 23 MB/s | 5.5 MB 00:00 2024-09-12T16:12:56.939 INFO:teuthology.orchestra.run.smithi047.stdout:(10/33): python3-rados-19.3.0-4883.gd61b0886.el 3.1 MB/s | 321 kB 00:00 2024-09-12T16:12:56.973 INFO:teuthology.orchestra.run.smithi047.stdout:(11/33): python3-rbd-19.3.0-4883.gd61b0886.el9. 5.1 MB/s | 307 kB 00:00 2024-09-12T16:12:56.998 INFO:teuthology.orchestra.run.smithi047.stdout:(12/33): python3-rgw-19.3.0-4883.gd61b0886.el9. 1.7 MB/s | 99 kB 00:00 2024-09-12T16:12:57.115 INFO:teuthology.orchestra.run.smithi047.stdout:(13/33): boost-program-options-1.75.0-8.el9.x86 754 kB/s | 107 kB 00:00 2024-09-12T16:12:57.166 INFO:teuthology.orchestra.run.smithi047.stdout:(14/33): libnbd-1.20.2-2.el9.x86_64.rpm 1.0 MB/s | 171 kB 00:00 2024-09-12T16:12:57.191 INFO:teuthology.orchestra.run.smithi047.stdout:(15/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-12T16:12:57.216 INFO:teuthology.orchestra.run.smithi047.stdout:(16/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2024-09-12T16:12:57.333 INFO:teuthology.orchestra.run.smithi047.stdout:(17/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-12T16:12:57.340 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-12T16:12:57.340 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-12T16:12:57.384 INFO:teuthology.orchestra.run.smithi047.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 846 kB/s | 42 kB 00:00 2024-09-12T16:12:57.409 INFO:teuthology.orchestra.run.smithi047.stdout:(19/33): librdkafka-1.6.1-102.el9.x86_64.rpm 3.0 MB/s | 662 kB 00:00 2024-09-12T16:12:57.459 INFO:teuthology.orchestra.run.smithi047.stdout:(20/33): qatlib-service-24.02.0-1.el9.x86_64.rp 719 kB/s | 36 kB 00:00 2024-09-12T16:12:57.484 INFO:teuthology.orchestra.run.smithi047.stdout:(21/33): qatlib-24.02.0-1.el9.x86_64.rpm 2.1 MB/s | 221 kB 00:00 2024-09-12T16:12:57.534 INFO:teuthology.orchestra.run.smithi047.stdout:(22/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 6.0 MB/s | 308 kB 00:00 2024-09-12T16:12:57.560 INFO:teuthology.orchestra.run.smithi047.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 471 kB/s | 47 kB 00:00 2024-09-12T16:12:57.610 INFO:teuthology.orchestra.run.smithi047.stdout:(24/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 522 kB/s | 26 kB 00:00 2024-09-12T16:12:57.635 INFO:teuthology.orchestra.run.smithi047.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T16:12:57.661 INFO:teuthology.orchestra.run.smithi047.stdout:(26/33): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-12T16:12:57.719 INFO:teuthology.orchestra.run.smithi047.stdout:(27/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-12T16:12:57.778 INFO:teuthology.orchestra.run.smithi047.stdout:(28/33): libarrow-9.0.0-11.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-12T16:12:57.803 INFO:teuthology.orchestra.run.smithi047.stdout:(29/33): re2-20211101-20.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-12T16:12:57.882 INFO:teuthology.orchestra.run.smithi047.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-12T16:12:58.021 INFO:teuthology.orchestra.run.smithi204.stdout: Preparing : 1/1 2024-09-12T16:12:58.095 INFO:teuthology.orchestra.run.smithi047.stdout:(31/33): librados2-19.3.0-4883.gd61b0886.el9.x8 12 MB/s | 3.5 MB 00:00 2024-09-12T16:12:58.103 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-12T16:12:58.132 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/35 2024-09-12T16:12:58.166 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/35 2024-09-12T16:12:58.170 INFO:teuthology.orchestra.run.smithi047.stdout:(32/33): librbd1-19.3.0-4883.gd61b0886.el9.x86_ 11 MB/s | 3.2 MB 00:00 2024-09-12T16:12:58.188 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-12T16:12:58.209 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-12T16:12:58.346 INFO:teuthology.orchestra.run.smithi047.stdout:(33/33): ceph-base-19.3.0-4883.gd61b0886.el9.x8 1.9 MB/s | 5.5 MB 00:02 2024-09-12T16:12:58.351 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:12:58.351 INFO:teuthology.orchestra.run.smithi047.stdout:Total 17 MB/s | 62 MB 00:03 2024-09-12T16:12:58.399 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-12T16:12:58.452 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-12T16:12:58.474 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-12T16:12:58.515 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-12T16:12:58.515 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-12T16:12:58.798 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/35 2024-09-12T16:12:58.891 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-12T16:12:58.909 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : librados2-2:19.3.0-4883.gd61b0886.el9.x86_64 7/35 2024-09-12T16:12:58.974 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-12T16:12:59.002 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librados2-2:19.3.0-4883.gd61b0886.el9.x86_64 7/35 2024-09-12T16:12:59.007 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/35 2024-09-12T16:12:59.033 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/35 2024-09-12T16:12:59.055 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-12T16:12:59.077 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-12T16:12:59.089 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rados-2:19.3.0-4883.gd61b0886.el9.x86_64 8/35 2024-09-12T16:12:59.119 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libcephfs2-2:19.3.0-4883.gd61b0886.el9.x86_64 9/35 2024-09-12T16:12:59.182 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libcephfs2-2:19.3.0-4883.gd61b0886.el9.x86_64 9/35 2024-09-12T16:12:59.218 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/35 2024-09-12T16:12:59.246 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-12T16:12:59.246 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-12T16:12:59.262 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-ceph-argparse-2:19.3.0-4883.gd61b0886.el9. 11/35 2024-09-12T16:12:59.275 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-12T16:12:59.329 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-12T16:12:59.331 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cephfs-2:19.3.0-4883.gd61b0886.el9.x86_64 12/35 2024-09-12T16:12:59.354 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libradosstriper1-2:19.3.0-4883.gd61b0886.el9.x86_6 13/35 2024-09-12T16:12:59.402 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4883.gd61b0886.el9.x86_6 13/35 2024-09-12T16:12:59.436 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/35 2024-09-12T16:12:59.544 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/35 2024-09-12T16:12:59.580 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/35 2024-09-12T16:12:59.620 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/35 2024-09-12T16:12:59.661 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/35 2024-09-12T16:12:59.690 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/35 2024-09-12T16:12:59.726 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-12T16:12:59.734 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/35 2024-09-12T16:12:59.760 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/35 2024-09-12T16:12:59.793 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : librados2-2:19.3.0-4883.gd61b0886.el9.x86_64 7/35 2024-09-12T16:12:59.886 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados2-2:19.3.0-4883.gd61b0886.el9.x86_64 7/35 2024-09-12T16:12:59.976 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rados-2:19.3.0-4883.gd61b0886.el9.x86_64 8/35 2024-09-12T16:13:00.011 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs2-2:19.3.0-4883.gd61b0886.el9.x86_64 9/35 2024-09-12T16:13:00.082 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephfs2-2:19.3.0-4883.gd61b0886.el9.x86_64 9/35 2024-09-12T16:13:00.088 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-12T16:13:00.119 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/35 2024-09-12T16:13:00.136 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : librbd1-2:19.3.0-4883.gd61b0886.el9.x86_64 23/35 2024-09-12T16:13:00.164 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ceph-argparse-2:19.3.0-4883.gd61b0886.el9. 11/35 2024-09-12T16:13:00.229 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librbd1-2:19.3.0-4883.gd61b0886.el9.x86_64 23/35 2024-09-12T16:13:00.234 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cephfs-2:19.3.0-4883.gd61b0886.el9.x86_64 12/35 2024-09-12T16:13:00.258 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rbd-2:19.3.0-4883.gd61b0886.el9.x86_64 24/35 2024-09-12T16:13:00.263 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libradosstriper1-2:19.3.0-4883.gd61b0886.el9.x86_6 13/35 2024-09-12T16:13:00.294 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-12T16:13:00.344 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4883.gd61b0886.el9.x86_6 13/35 2024-09-12T16:13:00.379 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/35 2024-09-12T16:13:00.490 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/35 2024-09-12T16:13:00.521 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/35 2024-09-12T16:13:00.562 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/35 2024-09-12T16:13:00.594 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/35 2024-09-12T16:13:00.632 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/35 2024-09-12T16:13:00.671 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-12T16:13:00.710 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/35 2024-09-12T16:13:00.769 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-12T16:13:00.794 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-12T16:13:00.822 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librgw2-2:19.3.0-4883.gd61b0886.el9.x86_64 27/35 2024-09-12T16:13:00.872 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-12T16:13:00.894 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librgw2-2:19.3.0-4883.gd61b0886.el9.x86_64 27/35 2024-09-12T16:13:00.901 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/35 2024-09-12T16:13:00.951 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/35 2024-09-12T16:13:00.972 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rgw-2:19.3.0-4883.gd61b0886.el9.x86_64 28/35 2024-09-12T16:13:00.974 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-12T16:13:01.004 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-12T16:13:01.008 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-ceph-common-2:19.3.0-4883.gd61b0886.el9.x8 29/35 2024-09-12T16:13:01.058 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-12T16:13:01.103 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : librbd1-2:19.3.0-4883.gd61b0886.el9.x86_64 23/35 2024-09-12T16:13:01.196 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librbd1-2:19.3.0-4883.gd61b0886.el9.x86_64 23/35 2024-09-12T16:13:01.203 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-12T16:13:01.225 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rbd-2:19.3.0-4883.gd61b0886.el9.x86_64 24/35 2024-09-12T16:13:01.256 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-12T16:13:01.261 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-12T16:13:01.656 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/35 2024-09-12T16:13:01.719 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : librados2-2:19.3.0-4883.gd61b0886.el9.x86_64 7/35 2024-09-12T16:13:01.781 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-12T16:13:01.806 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librgw2-2:19.3.0-4883.gd61b0886.el9.x86_64 27/35 2024-09-12T16:13:01.813 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados2-2:19.3.0-4883.gd61b0886.el9.x86_64 7/35 2024-09-12T16:13:01.878 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librgw2-2:19.3.0-4883.gd61b0886.el9.x86_64 27/35 2024-09-12T16:13:01.902 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rados-2:19.3.0-4883.gd61b0886.el9.x86_64 8/35 2024-09-12T16:13:01.929 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephfs2-2:19.3.0-4883.gd61b0886.el9.x86_64 9/35 2024-09-12T16:13:01.958 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rgw-2:19.3.0-4883.gd61b0886.el9.x86_64 28/35 2024-09-12T16:13:01.992 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ceph-common-2:19.3.0-4883.gd61b0886.el9.x8 29/35 2024-09-12T16:13:02.017 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephfs2-2:19.3.0-4883.gd61b0886.el9.x86_64 9/35 2024-09-12T16:13:02.054 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/35 2024-09-12T16:13:02.099 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ceph-argparse-2:19.3.0-4883.gd61b0886.el9. 11/35 2024-09-12T16:13:02.169 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cephfs-2:19.3.0-4883.gd61b0886.el9.x86_64 12/35 2024-09-12T16:13:02.198 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libradosstriper1-2:19.3.0-4883.gd61b0886.el9.x86_6 13/35 2024-09-12T16:13:02.262 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4883.gd61b0886.el9.x86_6 13/35 2024-09-12T16:13:02.297 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/35 2024-09-12T16:13:02.416 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/35 2024-09-12T16:13:02.456 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/35 2024-09-12T16:13:02.497 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/35 2024-09-12T16:13:02.529 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/35 2024-09-12T16:13:02.559 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/35 2024-09-12T16:13:02.591 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-12T16:13:02.629 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/35 2024-09-12T16:13:02.972 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-12T16:13:03.138 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : librbd1-2:19.3.0-4883.gd61b0886.el9.x86_64 23/35 2024-09-12T16:13:03.230 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librbd1-2:19.3.0-4883.gd61b0886.el9.x86_64 23/35 2024-09-12T16:13:03.260 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rbd-2:19.3.0-4883.gd61b0886.el9.x86_64 24/35 2024-09-12T16:13:03.296 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-12T16:13:03.363 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-common-2:19.3.0-4883.gd61b0886.el9.x86_64 30/35 2024-09-12T16:13:03.405 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-common-2:19.3.0-4883.gd61b0886.el9.x86_64 30/35 2024-09-12T16:13:03.813 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-12T16:13:03.999 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-common-2:19.3.0-4883.gd61b0886.el9.x86_64 30/35 2024-09-12T16:13:03.999 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librgw2-2:19.3.0-4883.gd61b0886.el9.x86_64 27/35 2024-09-12T16:13:04.013 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librgw2-2:19.3.0-4883.gd61b0886.el9.x86_64 27/35 2024-09-12T16:13:04.017 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-base-2:19.3.0-4883.gd61b0886.el9.x86_64 31/35 2024-09-12T16:13:04.102 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rgw-2:19.3.0-4883.gd61b0886.el9.x86_64 28/35 2024-09-12T16:13:04.107 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-base-2:19.3.0-4883.gd61b0886.el9.x86_64 31/35 2024-09-12T16:13:04.107 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T16:13:04.108 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T16:13:04.108 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:13:04.135 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ceph-common-2:19.3.0-4883.gd61b0886.el9.x8 29/35 2024-09-12T16:13:04.143 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-selinux-2:19.3.0-4883.gd61b0886.el9.x86_64 32/35 2024-09-12T16:13:04.468 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-common-2:19.3.0-4883.gd61b0886.el9.x86_64 30/35 2024-09-12T16:13:04.505 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-common-2:19.3.0-4883.gd61b0886.el9.x86_64 30/35 2024-09-12T16:13:05.097 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-common-2:19.3.0-4883.gd61b0886.el9.x86_64 30/35 2024-09-12T16:13:05.133 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-base-2:19.3.0-4883.gd61b0886.el9.x86_64 31/35 2024-09-12T16:13:05.228 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-base-2:19.3.0-4883.gd61b0886.el9.x86_64 31/35 2024-09-12T16:13:05.228 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T16:13:05.228 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T16:13:05.228 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:13:05.260 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-selinux-2:19.3.0-4883.gd61b0886.el9.x86_64 32/35 2024-09-12T16:13:06.544 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-common-2:19.3.0-4883.gd61b0886.el9.x86_64 30/35 2024-09-12T16:13:06.581 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-common-2:19.3.0-4883.gd61b0886.el9.x86_64 30/35 2024-09-12T16:13:07.174 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-common-2:19.3.0-4883.gd61b0886.el9.x86_64 30/35 2024-09-12T16:13:07.209 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-base-2:19.3.0-4883.gd61b0886.el9.x86_64 31/35 2024-09-12T16:13:07.285 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-base-2:19.3.0-4883.gd61b0886.el9.x86_64 31/35 2024-09-12T16:13:07.285 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T16:13:07.285 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T16:13:07.285 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:13:07.336 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-selinux-2:19.3.0-4883.gd61b0886.el9.x86_64 32/35 2024-09-12T16:13:14.161 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4883.gd61b0886.el9.x86_64 32/35 2024-09-12T16:13:14.161 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /sys 2024-09-12T16:13:14.162 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /proc 2024-09-12T16:13:14.162 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /mnt 2024-09-12T16:13:14.162 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /var/tmp 2024-09-12T16:13:14.162 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /home 2024-09-12T16:13:14.162 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /root 2024-09-12T16:13:14.162 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /tmp 2024-09-12T16:13:14.162 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:13:15.180 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-radosgw-2:19.3.0-4883.gd61b0886.el9.x86_64 33/35 2024-09-12T16:13:15.205 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4883.gd61b0886.el9.x86_64 33/35 2024-09-12T16:13:15.205 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:13:15.206 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T16:13:15.206 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T16:13:15.206 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T16:13:15.206 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:13:15.208 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-12T16:13:15.291 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-12T16:13:15.291 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-12T16:13:15.728 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4883.gd61b0886.el9.x86_64 32/35 2024-09-12T16:13:15.729 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /sys 2024-09-12T16:13:15.729 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /proc 2024-09-12T16:13:15.729 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /mnt 2024-09-12T16:13:15.729 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /var/tmp 2024-09-12T16:13:15.729 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /home 2024-09-12T16:13:15.729 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /root 2024-09-12T16:13:15.729 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /tmp 2024-09-12T16:13:15.729 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:13:16.488 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-12T16:13:16.489 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-base-2:19.3.0-4883.gd61b0886.el9.x86_64 1/35 2024-09-12T16:13:16.489 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-common-2:19.3.0-4883.gd61b0886.el9.x86_64 2/35 2024-09-12T16:13:16.489 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-radosgw-2:19.3.0-4883.gd61b0886.el9.x86_64 3/35 2024-09-12T16:13:16.489 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-selinux-2:19.3.0-4883.gd61b0886.el9.x86_64 4/35 2024-09-12T16:13:16.489 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libcephfs2-2:19.3.0-4883.gd61b0886.el9.x86_64 5/35 2024-09-12T16:13:16.489 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libradosstriper1-2:19.3.0-4883.gd61b0886.el9.x86_6 6/35 2024-09-12T16:13:16.489 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librgw2-2:19.3.0-4883.gd61b0886.el9.x86_64 7/35 2024-09-12T16:13:16.489 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4883.gd61b0886.el9. 8/35 2024-09-12T16:13:16.489 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-ceph-common-2:19.3.0-4883.gd61b0886.el9.x8 9/35 2024-09-12T16:13:16.489 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cephfs-2:19.3.0-4883.gd61b0886.el9.x86_64 10/35 2024-09-12T16:13:16.489 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rados-2:19.3.0-4883.gd61b0886.el9.x86_64 11/35 2024-09-12T16:13:16.489 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rbd-2:19.3.0-4883.gd61b0886.el9.x86_64 12/35 2024-09-12T16:13:16.489 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rgw-2:19.3.0-4883.gd61b0886.el9.x86_64 13/35 2024-09-12T16:13:16.490 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-12T16:13:16.490 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-12T16:13:16.490 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-12T16:13:16.490 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-12T16:13:16.490 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-12T16:13:16.490 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-12T16:13:16.490 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-12T16:13:16.490 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-12T16:13:16.490 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-12T16:13:16.490 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-12T16:13:16.490 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-12T16:13:16.490 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-12T16:13:16.491 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-12T16:13:16.491 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-12T16:13:16.491 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-12T16:13:16.491 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-12T16:13:16.491 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-12T16:13:16.491 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-12T16:13:16.492 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librados2-2:19.3.0-4883.gd61b0886.el9.x86_64 32/35 2024-09-12T16:13:16.492 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-12T16:13:16.492 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librbd1-2:19.3.0-4883.gd61b0886.el9.x86_64 34/35 2024-09-12T16:13:16.780 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-radosgw-2:19.3.0-4883.gd61b0886.el9.x86_64 33/35 2024-09-12T16:13:16.806 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4883.gd61b0886.el9.x86_64 33/35 2024-09-12T16:13:16.806 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:13:16.806 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T16:13:16.806 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T16:13:16.806 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T16:13:16.807 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:13:16.808 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-12T16:13:16.898 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-12T16:13:16.898 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-12T16:13:17.424 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-12T16:13:17.424 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:13:17.424 INFO:teuthology.orchestra.run.smithi204.stdout:Upgraded: 2024-09-12T16:13:17.424 INFO:teuthology.orchestra.run.smithi204.stdout: librados2-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:17.424 INFO:teuthology.orchestra.run.smithi204.stdout: librbd1-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:17.424 INFO:teuthology.orchestra.run.smithi204.stdout:Installed: 2024-09-12T16:13:17.424 INFO:teuthology.orchestra.run.smithi204.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T16:13:17.424 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-base-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:17.425 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-common-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:17.425 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-radosgw-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:17.425 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-selinux-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:17.425 INFO:teuthology.orchestra.run.smithi204.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T16:13:17.425 INFO:teuthology.orchestra.run.smithi204.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T16:13:17.425 INFO:teuthology.orchestra.run.smithi204.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T16:13:17.425 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs2-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:17.425 INFO:teuthology.orchestra.run.smithi204.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-12T16:13:17.425 INFO:teuthology.orchestra.run.smithi204.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T16:13:17.425 INFO:teuthology.orchestra.run.smithi204.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T16:13:17.425 INFO:teuthology.orchestra.run.smithi204.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T16:13:17.425 INFO:teuthology.orchestra.run.smithi204.stdout: libradosstriper1-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:17.425 INFO:teuthology.orchestra.run.smithi204.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T16:13:17.425 INFO:teuthology.orchestra.run.smithi204.stdout: librgw2-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:17.426 INFO:teuthology.orchestra.run.smithi204.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T16:13:17.426 INFO:teuthology.orchestra.run.smithi204.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T16:13:17.426 INFO:teuthology.orchestra.run.smithi204.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T16:13:17.426 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-argparse-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:17.426 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-common-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:17.426 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cephfs-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:17.426 INFO:teuthology.orchestra.run.smithi204.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T16:13:17.426 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rados-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:17.426 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rbd-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:17.426 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rgw-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:17.426 INFO:teuthology.orchestra.run.smithi204.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T16:13:17.426 INFO:teuthology.orchestra.run.smithi204.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T16:13:17.426 INFO:teuthology.orchestra.run.smithi204.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T16:13:17.426 INFO:teuthology.orchestra.run.smithi204.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T16:13:17.426 INFO:teuthology.orchestra.run.smithi204.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T16:13:17.427 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:13:17.427 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-09-12T16:13:17.729 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum -y install ceph-test 2024-09-12T16:13:17.778 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4883.gd61b0886.el9.x86_64 32/35 2024-09-12T16:13:17.778 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /sys 2024-09-12T16:13:17.778 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /proc 2024-09-12T16:13:17.778 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /mnt 2024-09-12T16:13:17.778 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /var/tmp 2024-09-12T16:13:17.778 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /home 2024-09-12T16:13:17.778 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /root 2024-09-12T16:13:17.778 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /tmp 2024-09-12T16:13:17.778 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:13:18.102 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-12T16:13:18.102 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-base-2:19.3.0-4883.gd61b0886.el9.x86_64 1/35 2024-09-12T16:13:18.103 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-common-2:19.3.0-4883.gd61b0886.el9.x86_64 2/35 2024-09-12T16:13:18.103 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-radosgw-2:19.3.0-4883.gd61b0886.el9.x86_64 3/35 2024-09-12T16:13:18.103 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-selinux-2:19.3.0-4883.gd61b0886.el9.x86_64 4/35 2024-09-12T16:13:18.103 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs2-2:19.3.0-4883.gd61b0886.el9.x86_64 5/35 2024-09-12T16:13:18.103 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libradosstriper1-2:19.3.0-4883.gd61b0886.el9.x86_6 6/35 2024-09-12T16:13:18.103 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librgw2-2:19.3.0-4883.gd61b0886.el9.x86_64 7/35 2024-09-12T16:13:18.103 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4883.gd61b0886.el9. 8/35 2024-09-12T16:13:18.103 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ceph-common-2:19.3.0-4883.gd61b0886.el9.x8 9/35 2024-09-12T16:13:18.103 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cephfs-2:19.3.0-4883.gd61b0886.el9.x86_64 10/35 2024-09-12T16:13:18.103 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rados-2:19.3.0-4883.gd61b0886.el9.x86_64 11/35 2024-09-12T16:13:18.103 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rbd-2:19.3.0-4883.gd61b0886.el9.x86_64 12/35 2024-09-12T16:13:18.103 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rgw-2:19.3.0-4883.gd61b0886.el9.x86_64 13/35 2024-09-12T16:13:18.103 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-12T16:13:18.104 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-12T16:13:18.104 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-12T16:13:18.104 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-12T16:13:18.104 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-12T16:13:18.104 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-12T16:13:18.104 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-12T16:13:18.104 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-12T16:13:18.104 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-12T16:13:18.104 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-12T16:13:18.104 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-12T16:13:18.104 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-12T16:13:18.104 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-12T16:13:18.104 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-12T16:13:18.105 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-12T16:13:18.105 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-12T16:13:18.105 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-12T16:13:18.105 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-12T16:13:18.106 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-2:19.3.0-4883.gd61b0886.el9.x86_64 32/35 2024-09-12T16:13:18.106 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-12T16:13:18.106 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-2:19.3.0-4883.gd61b0886.el9.x86_64 34/35 2024-09-12T16:13:18.301 INFO:teuthology.orchestra.run.smithi204.stdout:Last metadata expiration check: 0:00:28 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:13:18.435 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-09-12T16:13:18.435 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:13:18.435 INFO:teuthology.orchestra.run.smithi204.stdout: Package Arch Version Repository Size 2024-09-12T16:13:18.436 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:13:18.436 INFO:teuthology.orchestra.run.smithi204.stdout:Installing: 2024-09-12T16:13:18.436 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-test x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 50 M 2024-09-12T16:13:18.436 INFO:teuthology.orchestra.run.smithi204.stdout:Installing dependencies: 2024-09-12T16:13:18.436 INFO:teuthology.orchestra.run.smithi204.stdout: libcephsqlite x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 161 k 2024-09-12T16:13:18.436 INFO:teuthology.orchestra.run.smithi204.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T16:13:18.436 INFO:teuthology.orchestra.run.smithi204.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T16:13:18.436 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:13:18.436 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction Summary 2024-09-12T16:13:18.436 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:13:18.436 INFO:teuthology.orchestra.run.smithi204.stdout:Install 4 Packages 2024-09-12T16:13:18.436 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:13:18.437 INFO:teuthology.orchestra.run.smithi204.stdout:Total download size: 51 M 2024-09-12T16:13:18.437 INFO:teuthology.orchestra.run.smithi204.stdout:Installed size: 217 M 2024-09-12T16:13:18.437 INFO:teuthology.orchestra.run.smithi204.stdout:Downloading Packages: 2024-09-12T16:13:18.688 INFO:teuthology.orchestra.run.smithi204.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.5 MB/s | 304 kB 00:00 2024-09-12T16:13:18.713 INFO:teuthology.orchestra.run.smithi204.stdout:(2/4): libcephsqlite-19.3.0-4883.gd61b0886.el9. 713 kB/s | 161 kB 00:00 2024-09-12T16:13:18.739 INFO:teuthology.orchestra.run.smithi204.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-12T16:13:18.821 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-radosgw-2:19.3.0-4883.gd61b0886.el9.x86_64 33/35 2024-09-12T16:13:18.848 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4883.gd61b0886.el9.x86_64 33/35 2024-09-12T16:13:18.848 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:13:18.848 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T16:13:18.848 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T16:13:18.848 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T16:13:18.849 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:13:18.850 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-12T16:13:18.940 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-12T16:13:18.940 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-12T16:13:19.150 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-12T16:13:19.150 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:13:19.151 INFO:teuthology.orchestra.run.smithi017.stdout:Upgraded: 2024-09-12T16:13:19.151 INFO:teuthology.orchestra.run.smithi017.stdout: librados2-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:19.151 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:19.151 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-12T16:13:19.151 INFO:teuthology.orchestra.run.smithi017.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T16:13:19.151 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:19.151 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:19.151 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:19.152 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-selinux-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:19.152 INFO:teuthology.orchestra.run.smithi017.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T16:13:19.152 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T16:13:19.152 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T16:13:19.152 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:19.152 INFO:teuthology.orchestra.run.smithi017.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-12T16:13:19.152 INFO:teuthology.orchestra.run.smithi017.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T16:13:19.152 INFO:teuthology.orchestra.run.smithi017.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T16:13:19.153 INFO:teuthology.orchestra.run.smithi017.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T16:13:19.153 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:19.153 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T16:13:19.153 INFO:teuthology.orchestra.run.smithi017.stdout: librgw2-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:19.153 INFO:teuthology.orchestra.run.smithi017.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T16:13:19.153 INFO:teuthology.orchestra.run.smithi017.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T16:13:19.153 INFO:teuthology.orchestra.run.smithi017.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T16:13:19.154 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:19.154 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-common-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:19.154 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:19.154 INFO:teuthology.orchestra.run.smithi017.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T16:13:19.154 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:19.154 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:19.154 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:19.154 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T16:13:19.154 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T16:13:19.154 INFO:teuthology.orchestra.run.smithi017.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T16:13:19.154 INFO:teuthology.orchestra.run.smithi017.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T16:13:19.154 INFO:teuthology.orchestra.run.smithi017.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T16:13:19.155 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:13:19.155 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-12T16:13:19.494 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-test 2024-09-12T16:13:20.083 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:00:30 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:13:20.122 INFO:teuthology.orchestra.run.smithi204.stdout:(4/4): ceph-test-19.3.0-4883.gd61b0886.el9.x86_ 31 MB/s | 50 MB 00:01 2024-09-12T16:13:20.125 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-12T16:13:20.125 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-base-2:19.3.0-4883.gd61b0886.el9.x86_64 1/35 2024-09-12T16:13:20.125 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-common-2:19.3.0-4883.gd61b0886.el9.x86_64 2/35 2024-09-12T16:13:20.125 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-radosgw-2:19.3.0-4883.gd61b0886.el9.x86_64 3/35 2024-09-12T16:13:20.126 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-selinux-2:19.3.0-4883.gd61b0886.el9.x86_64 4/35 2024-09-12T16:13:20.126 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephfs2-2:19.3.0-4883.gd61b0886.el9.x86_64 5/35 2024-09-12T16:13:20.126 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libradosstriper1-2:19.3.0-4883.gd61b0886.el9.x86_6 6/35 2024-09-12T16:13:20.126 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librgw2-2:19.3.0-4883.gd61b0886.el9.x86_64 7/35 2024-09-12T16:13:20.126 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4883.gd61b0886.el9. 8/35 2024-09-12T16:13:20.126 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ceph-common-2:19.3.0-4883.gd61b0886.el9.x8 9/35 2024-09-12T16:13:20.126 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cephfs-2:19.3.0-4883.gd61b0886.el9.x86_64 10/35 2024-09-12T16:13:20.126 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rados-2:19.3.0-4883.gd61b0886.el9.x86_64 11/35 2024-09-12T16:13:20.126 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rbd-2:19.3.0-4883.gd61b0886.el9.x86_64 12/35 2024-09-12T16:13:20.126 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rgw-2:19.3.0-4883.gd61b0886.el9.x86_64 13/35 2024-09-12T16:13:20.126 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-12T16:13:20.126 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-12T16:13:20.126 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-12T16:13:20.127 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-12T16:13:20.127 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-12T16:13:20.127 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-12T16:13:20.127 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-12T16:13:20.127 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-12T16:13:20.127 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-12T16:13:20.127 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-12T16:13:20.127 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-12T16:13:20.127 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-12T16:13:20.127 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-12T16:13:20.128 INFO:teuthology.orchestra.run.smithi204.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:13:20.128 INFO:teuthology.orchestra.run.smithi204.stdout:Total 30 MB/s | 51 MB 00:01 2024-09-12T16:13:20.129 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-12T16:13:20.129 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-12T16:13:20.129 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-12T16:13:20.129 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-12T16:13:20.129 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-12T16:13:20.129 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados2-2:19.3.0-4883.gd61b0886.el9.x86_64 32/35 2024-09-12T16:13:20.129 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-12T16:13:20.129 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librbd1-2:19.3.0-4883.gd61b0886.el9.x86_64 34/35 2024-09-12T16:13:20.151 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction check 2024-09-12T16:13:20.171 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction check succeeded. 2024-09-12T16:13:20.171 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction test 2024-09-12T16:13:20.223 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-12T16:13:20.224 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:13:20.224 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-09-12T16:13:20.224 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:13:20.224 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-12T16:13:20.224 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 50 M 2024-09-12T16:13:20.224 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-09-12T16:13:20.224 INFO:teuthology.orchestra.run.smithi017.stdout: libcephsqlite x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 161 k 2024-09-12T16:13:20.224 INFO:teuthology.orchestra.run.smithi017.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T16:13:20.224 INFO:teuthology.orchestra.run.smithi017.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T16:13:20.224 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:13:20.224 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-12T16:13:20.225 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:13:20.225 INFO:teuthology.orchestra.run.smithi017.stdout:Install 4 Packages 2024-09-12T16:13:20.225 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:13:20.225 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 51 M 2024-09-12T16:13:20.225 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 217 M 2024-09-12T16:13:20.225 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-12T16:13:20.454 INFO:teuthology.orchestra.run.smithi017.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.4 MB/s | 304 kB 00:00 2024-09-12T16:13:20.479 INFO:teuthology.orchestra.run.smithi017.stdout:(2/4): libcephsqlite-19.3.0-4883.gd61b0886.el9. 696 kB/s | 161 kB 00:00 2024-09-12T16:13:20.504 INFO:teuthology.orchestra.run.smithi017.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-12T16:13:20.579 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction test succeeded. 2024-09-12T16:13:20.580 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction 2024-09-12T16:13:20.989 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-12T16:13:20.989 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:13:20.989 INFO:teuthology.orchestra.run.smithi047.stdout:Upgraded: 2024-09-12T16:13:20.989 INFO:teuthology.orchestra.run.smithi047.stdout: librados2-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:20.989 INFO:teuthology.orchestra.run.smithi047.stdout: librbd1-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:20.989 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-12T16:13:20.989 INFO:teuthology.orchestra.run.smithi047.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T16:13:20.989 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:20.989 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-common-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:20.989 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-radosgw-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:20.990 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-selinux-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:20.990 INFO:teuthology.orchestra.run.smithi047.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T16:13:20.990 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T16:13:20.990 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T16:13:20.990 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs2-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:20.990 INFO:teuthology.orchestra.run.smithi047.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-12T16:13:20.990 INFO:teuthology.orchestra.run.smithi047.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T16:13:20.990 INFO:teuthology.orchestra.run.smithi047.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T16:13:20.990 INFO:teuthology.orchestra.run.smithi047.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T16:13:20.990 INFO:teuthology.orchestra.run.smithi047.stdout: libradosstriper1-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:20.990 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T16:13:20.990 INFO:teuthology.orchestra.run.smithi047.stdout: librgw2-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:20.990 INFO:teuthology.orchestra.run.smithi047.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T16:13:20.990 INFO:teuthology.orchestra.run.smithi047.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T16:13:20.991 INFO:teuthology.orchestra.run.smithi047.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T16:13:20.991 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:20.991 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-common-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:20.991 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cephfs-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:20.991 INFO:teuthology.orchestra.run.smithi047.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T16:13:20.991 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:20.991 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rbd-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:20.991 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rgw-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:20.991 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T16:13:20.991 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T16:13:20.991 INFO:teuthology.orchestra.run.smithi047.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T16:13:20.991 INFO:teuthology.orchestra.run.smithi047.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T16:13:20.991 INFO:teuthology.orchestra.run.smithi047.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T16:13:20.992 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:13:20.992 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T16:13:21.140 INFO:teuthology.orchestra.run.smithi204.stdout: Preparing : 1/1 2024-09-12T16:13:21.222 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-12T16:13:21.262 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-12T16:13:21.291 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libcephsqlite-2:19.3.0-4883.gd61b0886.el9.x86_64 3/4 2024-09-12T16:13:21.339 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-test 2024-09-12T16:13:21.855 INFO:teuthology.orchestra.run.smithi017.stdout:(4/4): ceph-test-19.3.0-4883.gd61b0886.el9.x86_ 31 MB/s | 50 MB 00:01 2024-09-12T16:13:21.857 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:13:21.857 INFO:teuthology.orchestra.run.smithi017.stdout:Total 31 MB/s | 51 MB 00:01 2024-09-12T16:13:21.886 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-12T16:13:21.909 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-12T16:13:21.909 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-12T16:13:21.928 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:00:29 ago on Thu 12 Sep 2024 04:12:52 PM UTC. 2024-09-12T16:13:22.074 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T16:13:22.074 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:13:22.074 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-09-12T16:13:22.074 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:13:22.074 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-12T16:13:22.075 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-test x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 50 M 2024-09-12T16:13:22.075 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-12T16:13:22.075 INFO:teuthology.orchestra.run.smithi047.stdout: libcephsqlite x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 161 k 2024-09-12T16:13:22.075 INFO:teuthology.orchestra.run.smithi047.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T16:13:22.075 INFO:teuthology.orchestra.run.smithi047.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T16:13:22.075 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:13:22.075 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-12T16:13:22.075 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:13:22.075 INFO:teuthology.orchestra.run.smithi047.stdout:Install 4 Packages 2024-09-12T16:13:22.075 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:13:22.076 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 51 M 2024-09-12T16:13:22.076 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 217 M 2024-09-12T16:13:22.076 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-12T16:13:22.319 INFO:teuthology.orchestra.run.smithi047.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 2.1 MB/s | 304 kB 00:00 2024-09-12T16:13:22.335 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-12T16:13:22.335 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-12T16:13:22.361 INFO:teuthology.orchestra.run.smithi047.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-12T16:13:22.378 INFO:teuthology.orchestra.run.smithi047.stdout:(3/4): libcephsqlite-19.3.0-4883.gd61b0886.el9. 793 kB/s | 161 kB 00:00 2024-09-12T16:13:22.901 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-12T16:13:22.973 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-12T16:13:23.012 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-12T16:13:23.040 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephsqlite-2:19.3.0-4883.gd61b0886.el9.x86_64 3/4 2024-09-12T16:13:23.745 INFO:teuthology.orchestra.run.smithi047.stdout:(4/4): ceph-test-19.3.0-4883.gd61b0886.el9.x86_ 32 MB/s | 50 MB 00:01 2024-09-12T16:13:23.747 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:13:23.747 INFO:teuthology.orchestra.run.smithi047.stdout:Total 30 MB/s | 51 MB 00:01 2024-09-12T16:13:23.776 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-12T16:13:23.799 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-12T16:13:23.799 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-12T16:13:24.227 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-12T16:13:24.227 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-12T16:13:24.871 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-12T16:13:24.945 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-12T16:13:24.986 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-12T16:13:25.014 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephsqlite-2:19.3.0-4883.gd61b0886.el9.x86_64 3/4 2024-09-12T16:13:26.055 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4883.gd61b0886.el9.x86_64 3/4 2024-09-12T16:13:26.140 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-test-2:19.3.0-4883.gd61b0886.el9.x86_64 4/4 2024-09-12T16:13:28.092 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4883.gd61b0886.el9.x86_64 3/4 2024-09-12T16:13:28.184 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-test-2:19.3.0-4883.gd61b0886.el9.x86_64 4/4 2024-09-12T16:13:28.574 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-test-2:19.3.0-4883.gd61b0886.el9.x86_64 4/4 2024-09-12T16:13:28.574 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-test-2:19.3.0-4883.gd61b0886.el9.x86_64 1/4 2024-09-12T16:13:28.574 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libcephsqlite-2:19.3.0-4883.gd61b0886.el9.x86_64 2/4 2024-09-12T16:13:28.574 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-12T16:13:28.922 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-12T16:13:28.923 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:13:28.923 INFO:teuthology.orchestra.run.smithi204.stdout:Installed: 2024-09-12T16:13:28.923 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-test-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:28.923 INFO:teuthology.orchestra.run.smithi204.stdout: libcephsqlite-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:28.923 INFO:teuthology.orchestra.run.smithi204.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T16:13:28.923 INFO:teuthology.orchestra.run.smithi204.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T16:13:28.923 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:13:28.923 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-09-12T16:13:29.198 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum -y install ceph 2024-09-12T16:13:29.776 INFO:teuthology.orchestra.run.smithi204.stdout:Last metadata expiration check: 0:00:39 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:13:29.913 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-09-12T16:13:29.915 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:13:29.915 INFO:teuthology.orchestra.run.smithi204.stdout: Package Arch Version Repository Size 2024-09-12T16:13:29.915 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:13:29.916 INFO:teuthology.orchestra.run.smithi204.stdout:Installing: 2024-09-12T16:13:29.916 INFO:teuthology.orchestra.run.smithi204.stdout: ceph x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 6.6 k 2024-09-12T16:13:29.916 INFO:teuthology.orchestra.run.smithi204.stdout:Installing dependencies: 2024-09-12T16:13:29.916 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mds x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 2.4 M 2024-09-12T16:13:29.916 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 1.5 M 2024-09-12T16:13:29.916 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4883.gd61b0886.el9 ceph-noarch 291 k 2024-09-12T16:13:29.916 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mon x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 4.8 M 2024-09-12T16:13:29.916 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-osd x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 17 M 2024-09-12T16:13:29.916 INFO:teuthology.orchestra.run.smithi204.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T16:13:29.916 INFO:teuthology.orchestra.run.smithi204.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T16:13:29.916 INFO:teuthology.orchestra.run.smithi204.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T16:13:29.916 INFO:teuthology.orchestra.run.smithi204.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T16:13:29.916 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T16:13:29.916 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T16:13:29.917 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T16:13:29.917 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T16:13:29.917 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T16:13:29.917 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T16:13:29.917 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-collections 2024-09-12T16:13:29.917 INFO:teuthology.orchestra.run.smithi204.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-12T16:13:29.917 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T16:13:29.917 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T16:13:29.917 INFO:teuthology.orchestra.run.smithi204.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T16:13:29.917 INFO:teuthology.orchestra.run.smithi204.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T16:13:29.917 INFO:teuthology.orchestra.run.smithi204.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T16:13:29.917 INFO:teuthology.orchestra.run.smithi204.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T16:13:29.917 INFO:teuthology.orchestra.run.smithi204.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T16:13:29.918 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T16:13:29.918 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T16:13:29.918 INFO:teuthology.orchestra.run.smithi204.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T16:13:29.918 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T16:13:29.918 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T16:13:29.918 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T16:13:29.918 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T16:13:29.918 INFO:teuthology.orchestra.run.smithi204.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T16:13:29.918 INFO:teuthology.orchestra.run.smithi204.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T16:13:29.918 INFO:teuthology.orchestra.run.smithi204.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T16:13:29.918 INFO:teuthology.orchestra.run.smithi204.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T16:13:29.918 INFO:teuthology.orchestra.run.smithi204.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T16:13:29.918 INFO:teuthology.orchestra.run.smithi204.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T16:13:29.919 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:13:29.919 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction Summary 2024-09-12T16:13:29.919 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:13:29.919 INFO:teuthology.orchestra.run.smithi204.stdout:Install 37 Packages 2024-09-12T16:13:29.919 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:13:29.919 INFO:teuthology.orchestra.run.smithi204.stdout:Total download size: 31 M 2024-09-12T16:13:29.920 INFO:teuthology.orchestra.run.smithi204.stdout:Installed size: 109 M 2024-09-12T16:13:29.920 INFO:teuthology.orchestra.run.smithi204.stdout:Downloading Packages: 2024-09-12T16:13:30.042 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4883.gd61b0886.el9.x86_64 3/4 2024-09-12T16:13:30.131 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-test-2:19.3.0-4883.gd61b0886.el9.x86_64 4/4 2024-09-12T16:13:30.515 INFO:teuthology.orchestra.run.smithi204.stdout:(1/37): ceph-19.3.0-4883.gd61b0886.el9.x86_64.r 52 kB/s | 6.6 kB 00:00 2024-09-12T16:13:30.526 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-test-2:19.3.0-4883.gd61b0886.el9.x86_64 4/4 2024-09-12T16:13:30.526 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-test-2:19.3.0-4883.gd61b0886.el9.x86_64 1/4 2024-09-12T16:13:30.526 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephsqlite-2:19.3.0-4883.gd61b0886.el9.x86_64 2/4 2024-09-12T16:13:30.526 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-12T16:13:30.724 INFO:teuthology.orchestra.run.smithi204.stdout:(2/37): ceph-mgr-19.3.0-4883.gd61b0886.el9.x86_ 4.6 MB/s | 1.5 MB 00:00 2024-09-12T16:13:30.774 INFO:teuthology.orchestra.run.smithi204.stdout:(3/37): ceph-mds-19.3.0-4883.gd61b0886.el9.x86_ 6.2 MB/s | 2.4 MB 00:00 2024-09-12T16:13:30.857 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-12T16:13:30.857 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:13:30.857 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-12T16:13:30.857 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:30.857 INFO:teuthology.orchestra.run.smithi017.stdout: libcephsqlite-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:30.857 INFO:teuthology.orchestra.run.smithi017.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T16:13:30.857 INFO:teuthology.orchestra.run.smithi017.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T16:13:30.858 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:13:30.858 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-12T16:13:30.883 INFO:teuthology.orchestra.run.smithi204.stdout:(4/37): ceph-mon-19.3.0-4883.gd61b0886.el9.x86_ 13 MB/s | 4.8 MB 00:00 2024-09-12T16:13:30.908 INFO:teuthology.orchestra.run.smithi204.stdout:(5/37): ceph-mgr-modules-core-19.3.0-4883.gd61b 2.1 MB/s | 291 kB 00:00 2024-09-12T16:13:31.092 INFO:teuthology.orchestra.run.smithi204.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-09-12T16:13:31.176 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph 2024-09-12T16:13:31.292 INFO:teuthology.orchestra.run.smithi204.stdout:(7/37): ceph-osd-19.3.0-4883.gd61b0886.el9.x86_ 30 MB/s | 17 MB 00:00 2024-09-12T16:13:31.317 INFO:teuthology.orchestra.run.smithi204.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 473 kB/s | 106 kB 00:00 2024-09-12T16:13:31.359 INFO:teuthology.orchestra.run.smithi204.stdout:(9/37): python3-cryptography-36.0.1-4.el9.x86_6 2.7 MB/s | 1.2 MB 00:00 2024-09-12T16:13:31.384 INFO:teuthology.orchestra.run.smithi204.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 1.8 MB/s | 125 kB 00:00 2024-09-12T16:13:31.426 INFO:teuthology.orchestra.run.smithi204.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 3.1 MB/s | 215 kB 00:00 2024-09-12T16:13:31.527 INFO:teuthology.orchestra.run.smithi204.stdout:(12/37): python3-pycparser-2.20-6.el9.noarch.rp 577 kB/s | 135 kB 00:00 2024-09-12T16:13:31.760 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:00:41 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:13:31.900 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-12T16:13:31.902 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:13:31.902 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-09-12T16:13:31.902 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:13:31.902 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-12T16:13:31.902 INFO:teuthology.orchestra.run.smithi017.stdout: ceph x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 6.6 k 2024-09-12T16:13:31.903 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-09-12T16:13:31.903 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 2.4 M 2024-09-12T16:13:31.903 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 1.5 M 2024-09-12T16:13:31.903 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4883.gd61b0886.el9 ceph-noarch 291 k 2024-09-12T16:13:31.903 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 4.8 M 2024-09-12T16:13:31.903 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 17 M 2024-09-12T16:13:31.903 INFO:teuthology.orchestra.run.smithi017.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T16:13:31.903 INFO:teuthology.orchestra.run.smithi017.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T16:13:31.903 INFO:teuthology.orchestra.run.smithi017.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T16:13:31.903 INFO:teuthology.orchestra.run.smithi017.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T16:13:31.903 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T16:13:31.903 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T16:13:31.903 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T16:13:31.904 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T16:13:31.904 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T16:13:31.904 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T16:13:31.904 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-collections 2024-09-12T16:13:31.904 INFO:teuthology.orchestra.run.smithi017.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-12T16:13:31.904 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T16:13:31.904 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T16:13:31.904 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T16:13:31.904 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T16:13:31.904 INFO:teuthology.orchestra.run.smithi017.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T16:13:31.904 INFO:teuthology.orchestra.run.smithi017.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T16:13:31.904 INFO:teuthology.orchestra.run.smithi017.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T16:13:31.904 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T16:13:31.905 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T16:13:31.905 INFO:teuthology.orchestra.run.smithi017.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T16:13:31.905 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T16:13:31.905 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T16:13:31.905 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T16:13:31.905 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T16:13:31.905 INFO:teuthology.orchestra.run.smithi017.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T16:13:31.905 INFO:teuthology.orchestra.run.smithi017.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T16:13:31.905 INFO:teuthology.orchestra.run.smithi017.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T16:13:31.905 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T16:13:31.905 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T16:13:31.905 INFO:teuthology.orchestra.run.smithi017.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T16:13:31.906 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:13:31.906 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-12T16:13:31.906 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:13:31.906 INFO:teuthology.orchestra.run.smithi017.stdout:Install 37 Packages 2024-09-12T16:13:31.906 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:13:31.906 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 31 M 2024-09-12T16:13:31.906 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 109 M 2024-09-12T16:13:31.907 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-12T16:13:32.069 INFO:teuthology.orchestra.run.smithi204.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 64 kB/s | 35 kB 00:00 2024-09-12T16:13:32.119 INFO:teuthology.orchestra.run.smithi204.stdout:(14/37): lua-5.4.4-4.el9.x86_64.rpm 257 kB/s | 188 kB 00:00 2024-09-12T16:13:32.144 INFO:teuthology.orchestra.run.smithi204.stdout:(15/37): python3-mako-1.1.4-6.el9.noarch.rpm 240 kB/s | 172 kB 00:00 2024-09-12T16:13:32.614 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-test-2:19.3.0-4883.gd61b0886.el9.x86_64 4/4 2024-09-12T16:13:32.614 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-test-2:19.3.0-4883.gd61b0886.el9.x86_64 1/4 2024-09-12T16:13:32.614 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephsqlite-2:19.3.0-4883.gd61b0886.el9.x86_64 2/4 2024-09-12T16:13:32.614 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-12T16:13:32.711 INFO:teuthology.orchestra.run.smithi204.stdout:(16/37): python3-toml-0.10.2-6.el9.noarch.rpm 73 kB/s | 42 kB 00:00 2024-09-12T16:13:32.753 INFO:teuthology.orchestra.run.smithi204.stdout:(17/37): python3-packaging-20.9-5.el9.noarch.rp 113 kB/s | 77 kB 00:00 2024-09-12T16:13:32.778 INFO:teuthology.orchestra.run.smithi204.stdout:(18/37): python3-pytz-2021.1-5.el9.noarch.rpm 77 kB/s | 51 kB 00:00 2024-09-12T16:13:32.820 INFO:teuthology.orchestra.run.smithi204.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.3 MB/s | 151 kB 00:00 2024-09-12T16:13:32.845 INFO:teuthology.orchestra.run.smithi204.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 167 kB/s | 22 kB 00:00 2024-09-12T16:13:32.871 INFO:teuthology.orchestra.run.smithi204.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 471 kB/s | 43 kB 00:00 2024-09-12T16:13:32.889 INFO:teuthology.orchestra.run.smithi017.stdout:(1/37): ceph-19.3.0-4883.gd61b0886.el9.x86_64.r 53 kB/s | 6.6 kB 00:00 2024-09-12T16:13:32.905 INFO:teuthology.orchestra.run.smithi204.stdout:(22/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-09-12T16:13:32.916 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-12T16:13:32.916 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:13:32.916 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-12T16:13:32.916 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-test-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:32.916 INFO:teuthology.orchestra.run.smithi047.stdout: libcephsqlite-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:32.916 INFO:teuthology.orchestra.run.smithi047.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T16:13:32.916 INFO:teuthology.orchestra.run.smithi047.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T16:13:32.916 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:13:32.916 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T16:13:32.930 INFO:teuthology.orchestra.run.smithi204.stdout:(23/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 210 kB/s | 11 kB 00:00 2024-09-12T16:13:32.955 INFO:teuthology.orchestra.run.smithi204.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 366 kB/s | 18 kB 00:00 2024-09-12T16:13:32.980 INFO:teuthology.orchestra.run.smithi204.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 462 kB/s | 23 kB 00:00 2024-09-12T16:13:33.006 INFO:teuthology.orchestra.run.smithi204.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-12T16:13:33.026 INFO:teuthology.orchestra.run.smithi204.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 432 kB/s | 20 kB 00:00 2024-09-12T16:13:33.053 INFO:teuthology.orchestra.run.smithi204.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 1.0 MB/s | 46 kB 00:00 2024-09-12T16:13:33.077 INFO:teuthology.orchestra.run.smithi204.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-12T16:13:33.081 INFO:teuthology.orchestra.run.smithi017.stdout:(2/37): ceph-mgr-19.3.0-4883.gd61b0886.el9.x86_ 4.8 MB/s | 1.5 MB 00:00 2024-09-12T16:13:33.102 INFO:teuthology.orchestra.run.smithi204.stdout:(30/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.4 MB/s | 358 kB 00:00 2024-09-12T16:13:33.127 INFO:teuthology.orchestra.run.smithi204.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 327 kB/s | 16 kB 00:00 2024-09-12T16:13:33.153 INFO:teuthology.orchestra.run.smithi204.stdout:(32/37): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-12T16:13:33.173 INFO:teuthology.orchestra.run.smithi017.stdout:(3/37): ceph-mds-19.3.0-4883.gd61b0886.el9.x86_ 5.8 MB/s | 2.4 MB 00:00 2024-09-12T16:13:33.178 INFO:teuthology.orchestra.run.smithi204.stdout:(33/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-09-12T16:13:33.179 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph 2024-09-12T16:13:33.203 INFO:teuthology.orchestra.run.smithi204.stdout:(34/37): python3-tempora-5.0.0-2.el9.noarch.rpm 474 kB/s | 36 kB 00:00 2024-09-12T16:13:33.220 INFO:teuthology.orchestra.run.smithi204.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 1.2 MB/s | 20 kB 00:00 2024-09-12T16:13:33.239 INFO:teuthology.orchestra.run.smithi017.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4883.gd61b 4.3 MB/s | 291 kB 00:00 2024-09-12T16:13:33.253 INFO:teuthology.orchestra.run.smithi204.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-12T16:13:33.287 INFO:teuthology.orchestra.run.smithi204.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.0 MB/s | 427 kB 00:00 2024-09-12T16:13:33.292 INFO:teuthology.orchestra.run.smithi204.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:13:33.292 INFO:teuthology.orchestra.run.smithi204.stdout:Total 9.1 MB/s | 31 MB 00:03 2024-09-12T16:13:33.446 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction check 2024-09-12T16:13:33.482 INFO:teuthology.orchestra.run.smithi017.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.0 MB/s | 253 kB 00:00 2024-09-12T16:13:33.487 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction check succeeded. 2024-09-12T16:13:33.487 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction test 2024-09-12T16:13:33.557 INFO:teuthology.orchestra.run.smithi017.stdout:(6/37): ceph-mon-19.3.0-4883.gd61b0886.el9.x86_ 7.2 MB/s | 4.8 MB 00:00 2024-09-12T16:13:33.749 INFO:teuthology.orchestra.run.smithi017.stdout:(7/37): ceph-osd-19.3.0-4883.gd61b0886.el9.x86_ 26 MB/s | 17 MB 00:00 2024-09-12T16:13:33.768 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:00:41 ago on Thu 12 Sep 2024 04:12:52 PM UTC. 2024-09-12T16:13:33.841 INFO:teuthology.orchestra.run.smithi017.stdout:(8/37): python3-cryptography-36.0.1-4.el9.x86_6 3.4 MB/s | 1.2 MB 00:00 2024-09-12T16:13:33.891 INFO:teuthology.orchestra.run.smithi017.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.4 MB/s | 125 kB 00:00 2024-09-12T16:13:33.916 INFO:teuthology.orchestra.run.smithi017.stdout:(10/37): python3-ply-3.11-14.el9.noarch.rpm 297 kB/s | 106 kB 00:00 2024-09-12T16:13:33.918 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T16:13:33.921 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:13:33.921 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-09-12T16:13:33.921 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:13:33.921 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-12T16:13:33.921 INFO:teuthology.orchestra.run.smithi047.stdout: ceph x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 6.6 k 2024-09-12T16:13:33.921 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-12T16:13:33.921 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mds x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 2.4 M 2024-09-12T16:13:33.921 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 1.5 M 2024-09-12T16:13:33.921 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4883.gd61b0886.el9 ceph-noarch 291 k 2024-09-12T16:13:33.921 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mon x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 4.8 M 2024-09-12T16:13:33.921 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-osd x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 17 M 2024-09-12T16:13:33.922 INFO:teuthology.orchestra.run.smithi047.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T16:13:33.922 INFO:teuthology.orchestra.run.smithi047.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T16:13:33.922 INFO:teuthology.orchestra.run.smithi047.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T16:13:33.922 INFO:teuthology.orchestra.run.smithi047.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T16:13:33.922 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T16:13:33.922 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T16:13:33.922 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T16:13:33.922 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T16:13:33.922 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T16:13:33.922 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T16:13:33.922 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-collections 2024-09-12T16:13:33.922 INFO:teuthology.orchestra.run.smithi047.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-12T16:13:33.922 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T16:13:33.922 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T16:13:33.923 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T16:13:33.923 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T16:13:33.923 INFO:teuthology.orchestra.run.smithi047.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T16:13:33.923 INFO:teuthology.orchestra.run.smithi047.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T16:13:33.923 INFO:teuthology.orchestra.run.smithi047.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T16:13:33.923 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T16:13:33.923 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T16:13:33.923 INFO:teuthology.orchestra.run.smithi047.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T16:13:33.923 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T16:13:33.923 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T16:13:33.923 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T16:13:33.924 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T16:13:33.924 INFO:teuthology.orchestra.run.smithi047.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T16:13:33.924 INFO:teuthology.orchestra.run.smithi047.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T16:13:33.924 INFO:teuthology.orchestra.run.smithi047.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T16:13:33.924 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T16:13:33.924 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T16:13:33.924 INFO:teuthology.orchestra.run.smithi047.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T16:13:33.924 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:13:33.924 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-12T16:13:33.924 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:13:33.924 INFO:teuthology.orchestra.run.smithi047.stdout:Install 37 Packages 2024-09-12T16:13:33.924 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:13:33.925 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 31 M 2024-09-12T16:13:33.925 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 109 M 2024-09-12T16:13:33.925 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-12T16:13:33.950 INFO:teuthology.orchestra.run.smithi017.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 3.6 MB/s | 215 kB 00:00 2024-09-12T16:13:33.962 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction test succeeded. 2024-09-12T16:13:33.963 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction 2024-09-12T16:13:33.975 INFO:teuthology.orchestra.run.smithi017.stdout:(12/37): python3-pycparser-2.20-6.el9.noarch.rp 599 kB/s | 135 kB 00:00 2024-09-12T16:13:34.017 INFO:teuthology.orchestra.run.smithi017.stdout:(13/37): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-09-12T16:13:34.034 INFO:teuthology.orchestra.run.smithi017.stdout:(14/37): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-09-12T16:13:34.068 INFO:teuthology.orchestra.run.smithi017.stdout:(15/37): python3-markupsafe-1.1.1-12.el9.x86_64 377 kB/s | 35 kB 00:00 2024-09-12T16:13:34.093 INFO:teuthology.orchestra.run.smithi017.stdout:(16/37): python3-packaging-20.9-5.el9.noarch.rp 1.0 MB/s | 77 kB 00:00 2024-09-12T16:13:34.118 INFO:teuthology.orchestra.run.smithi017.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 608 kB/s | 51 kB 00:00 2024-09-12T16:13:34.152 INFO:teuthology.orchestra.run.smithi017.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 497 kB/s | 42 kB 00:00 2024-09-12T16:13:34.194 INFO:teuthology.orchestra.run.smithi017.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2024-09-12T16:13:34.219 INFO:teuthology.orchestra.run.smithi017.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 670 kB/s | 43 kB 00:00 2024-09-12T16:13:34.256 INFO:teuthology.orchestra.run.smithi017.stdout:(21/37): lua-devel-5.4.4-4.el9.x86_64.rpm 137 kB/s | 22 kB 00:00 2024-09-12T16:13:34.282 INFO:teuthology.orchestra.run.smithi017.stdout:(22/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-09-12T16:13:34.315 INFO:teuthology.orchestra.run.smithi017.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 732 kB/s | 18 kB 00:00 2024-09-12T16:13:34.340 INFO:teuthology.orchestra.run.smithi017.stdout:(24/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 127 kB/s | 11 kB 00:00 2024-09-12T16:13:34.365 INFO:teuthology.orchestra.run.smithi017.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 484 kB/s | 23 kB 00:00 2024-09-12T16:13:34.391 INFO:teuthology.orchestra.run.smithi017.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 785 kB/s | 19 kB 00:00 2024-09-12T16:13:34.416 INFO:teuthology.orchestra.run.smithi017.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 395 kB/s | 20 kB 00:00 2024-09-12T16:13:34.441 INFO:teuthology.orchestra.run.smithi017.stdout:(28/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.6 MB/s | 358 kB 00:00 2024-09-12T16:13:34.467 INFO:teuthology.orchestra.run.smithi017.stdout:(29/37): python3-logutils-0.3.5-21.el9.noarch.r 922 kB/s | 46 kB 00:00 2024-09-12T16:13:34.492 INFO:teuthology.orchestra.run.smithi017.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-12T16:13:34.517 INFO:teuthology.orchestra.run.smithi017.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 328 kB/s | 16 kB 00:00 2024-09-12T16:13:34.542 INFO:teuthology.orchestra.run.smithi017.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-12T16:13:34.567 INFO:teuthology.orchestra.run.smithi017.stdout:(33/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-09-12T16:13:34.593 INFO:teuthology.orchestra.run.smithi017.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-12T16:13:34.618 INFO:teuthology.orchestra.run.smithi017.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 809 kB/s | 20 kB 00:00 2024-09-12T16:13:34.643 INFO:teuthology.orchestra.run.smithi017.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-12T16:13:34.668 INFO:teuthology.orchestra.run.smithi017.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-12T16:13:34.673 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:13:34.673 INFO:teuthology.orchestra.run.smithi017.stdout:Total 11 MB/s | 31 MB 00:02 2024-09-12T16:13:34.831 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-12T16:13:34.875 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-12T16:13:34.875 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-12T16:13:34.955 INFO:teuthology.orchestra.run.smithi047.stdout:(1/37): ceph-19.3.0-4883.gd61b0886.el9.x86_64.r 33 kB/s | 6.6 kB 00:00 2024-09-12T16:13:35.188 INFO:teuthology.orchestra.run.smithi047.stdout:(2/37): ceph-mgr-19.3.0-4883.gd61b0886.el9.x86_ 3.5 MB/s | 1.5 MB 00:00 2024-09-12T16:13:35.314 INFO:teuthology.orchestra.run.smithi047.stdout:(3/37): ceph-mds-19.3.0-4883.gd61b0886.el9.x86_ 4.3 MB/s | 2.4 MB 00:00 2024-09-12T16:13:35.335 INFO:teuthology.orchestra.run.smithi204.stdout: Preparing : 1/1 2024-09-12T16:13:35.388 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-12T16:13:35.389 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-12T16:13:35.397 INFO:teuthology.orchestra.run.smithi047.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4883.gd61b 3.4 MB/s | 291 kB 00:00 2024-09-12T16:13:35.408 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-12T16:13:35.449 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-12T16:13:35.481 INFO:teuthology.orchestra.run.smithi047.stdout:(5/37): ceph-mon-19.3.0-4883.gd61b0886.el9.x86_ 9.1 MB/s | 4.8 MB 00:00 2024-09-12T16:13:35.484 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-12T16:13:35.556 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-12T16:13:35.600 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-12T16:13:35.640 INFO:teuthology.orchestra.run.smithi047.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.0 MB/s | 253 kB 00:00 2024-09-12T16:13:35.641 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-12T16:13:35.690 INFO:teuthology.orchestra.run.smithi047.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-12T16:13:35.732 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-12T16:13:35.773 INFO:teuthology.orchestra.run.smithi047.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 1.6 MB/s | 135 kB 00:00 2024-09-12T16:13:35.819 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-12T16:13:35.860 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-12T16:13:35.895 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-12T16:13:35.925 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-12T16:13:35.957 INFO:teuthology.orchestra.run.smithi047.stdout:(9/37): ceph-osd-19.3.0-4883.gd61b0886.el9.x86_ 22 MB/s | 17 MB 00:00 2024-09-12T16:13:35.960 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-12T16:13:35.993 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-12T16:13:36.032 INFO:teuthology.orchestra.run.smithi047.stdout:(10/37): python3-cryptography-36.0.1-4.el9.x86_ 2.2 MB/s | 1.2 MB 00:00 2024-09-12T16:13:36.042 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-12T16:13:36.049 INFO:teuthology.orchestra.run.smithi047.stdout:(11/37): python3-requests-2.25.1-8.el9.noarch.r 452 kB/s | 125 kB 00:00 2024-09-12T16:13:36.077 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-12T16:13:36.113 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-12T16:13:36.160 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-12T16:13:36.174 INFO:teuthology.orchestra.run.smithi047.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 1.3 MB/s | 188 kB 00:00 2024-09-12T16:13:36.192 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-12T16:13:36.200 INFO:teuthology.orchestra.run.smithi047.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-12T16:13:36.225 INFO:teuthology.orchestra.run.smithi047.stdout:(14/37): python3-urllib3-1.26.5-6.el9.noarch.rp 802 kB/s | 215 kB 00:00 2024-09-12T16:13:36.242 INFO:teuthology.orchestra.run.smithi047.stdout:(15/37): python3-markupsafe-1.1.1-12.el9.x86_64 515 kB/s | 35 kB 00:00 2024-09-12T16:13:36.273 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-12T16:13:36.359 INFO:teuthology.orchestra.run.smithi047.stdout:(16/37): python3-packaging-20.9-5.el9.noarch.rp 486 kB/s | 77 kB 00:00 2024-09-12T16:13:36.376 INFO:teuthology.orchestra.run.smithi047.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 312 kB/s | 42 kB 00:00 2024-09-12T16:13:36.393 INFO:teuthology.orchestra.run.smithi047.stdout:(18/37): python3-pytz-2021.1-5.el9.noarch.rpm 305 kB/s | 51 kB 00:00 2024-09-12T16:13:36.410 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-12T16:13:36.443 INFO:teuthology.orchestra.run.smithi047.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-12T16:13:36.472 INFO:teuthology.orchestra.run.smithi047.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 198 kB/s | 22 kB 00:00 2024-09-12T16:13:36.482 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-12T16:13:36.505 INFO:teuthology.orchestra.run.smithi047.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 387 kB/s | 43 kB 00:00 2024-09-12T16:13:36.530 INFO:teuthology.orchestra.run.smithi047.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 468 kB/s | 11 kB 00:00 2024-09-12T16:13:36.544 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-12T16:13:36.556 INFO:teuthology.orchestra.run.smithi047.stdout:(23/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-09-12T16:13:36.581 INFO:teuthology.orchestra.run.smithi047.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 352 kB/s | 18 kB 00:00 2024-09-12T16:13:36.586 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-12T16:13:36.606 INFO:teuthology.orchestra.run.smithi047.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 939 kB/s | 23 kB 00:00 2024-09-12T16:13:36.632 INFO:teuthology.orchestra.run.smithi047.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 389 kB/s | 19 kB 00:00 2024-09-12T16:13:36.635 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-12T16:13:36.657 INFO:teuthology.orchestra.run.smithi047.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-09-12T16:13:36.682 INFO:teuthology.orchestra.run.smithi047.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 923 kB/s | 46 kB 00:00 2024-09-12T16:13:36.690 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-12T16:13:36.708 INFO:teuthology.orchestra.run.smithi047.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-12T16:13:36.733 INFO:teuthology.orchestra.run.smithi047.stdout:(30/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.3 MB/s | 358 kB 00:00 2024-09-12T16:13:36.758 INFO:teuthology.orchestra.run.smithi047.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 327 kB/s | 16 kB 00:00 2024-09-12T16:13:36.783 INFO:teuthology.orchestra.run.smithi047.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-09-12T16:13:36.800 INFO:teuthology.orchestra.run.smithi047.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 864 kB/s | 36 kB 00:00 2024-09-12T16:13:36.825 INFO:teuthology.orchestra.run.smithi047.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-09-12T16:13:36.842 INFO:teuthology.orchestra.run.smithi047.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 1.2 MB/s | 20 kB 00:00 2024-09-12T16:13:36.868 INFO:teuthology.orchestra.run.smithi047.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-09-12T16:13:36.884 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-12T16:13:36.909 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-12T16:13:36.909 INFO:teuthology.orchestra.run.smithi047.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-09-12T16:13:36.913 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:13:36.913 INFO:teuthology.orchestra.run.smithi047.stdout:Total 10 MB/s | 31 MB 00:02 2024-09-12T16:13:36.932 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-12T16:13:36.972 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-12T16:13:37.001 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-12T16:13:37.011 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-12T16:13:37.041 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-12T16:13:37.070 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-12T16:13:37.090 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-12T16:13:37.114 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-12T16:13:37.114 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-12T16:13:37.118 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-12T16:13:37.133 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-12T16:13:37.166 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-12T16:13:37.198 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-12T16:13:37.260 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-12T16:13:37.312 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-12T16:13:37.404 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-12T16:13:37.420 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4883.gd61b0886.el9. 32/37 2024-09-12T16:13:37.450 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-2:19.3.0-4883.gd61b0886.el9.x86_64 33/37 2024-09-12T16:13:37.452 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-12T16:13:37.476 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4883.gd61b0886.el9.x86_64 33/37 2024-09-12T16:13:37.476 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:13:37.476 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T16:13:37.476 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T16:13:37.476 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T16:13:37.476 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:13:37.486 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-12T16:13:37.516 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-12T16:13:37.550 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-12T16:13:37.583 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-12T16:13:37.634 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-12T16:13:37.643 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-12T16:13:37.644 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-12T16:13:37.676 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-12T16:13:37.710 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-12T16:13:37.760 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-12T16:13:37.800 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-12T16:13:37.885 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-12T16:13:38.163 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-12T16:13:38.246 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-12T16:13:38.297 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-12T16:13:38.335 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-12T16:13:38.393 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-12T16:13:38.458 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-12T16:13:38.663 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-12T16:13:38.722 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-12T16:13:38.804 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-12T16:13:38.902 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-12T16:13:38.946 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-12T16:13:38.953 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-osd-2:19.3.0-4883.gd61b0886.el9.x86_64 34/37 2024-09-12T16:13:38.981 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-osd-2:19.3.0-4883.gd61b0886.el9.x86_64 34/37 2024-09-12T16:13:38.981 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:13:38.981 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T16:13:38.981 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T16:13:38.981 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T16:13:38.981 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:13:39.027 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-12T16:13:39.083 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-12T16:13:39.087 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-12T16:13:39.130 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-12T16:13:39.165 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-12T16:13:39.242 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-12T16:13:39.250 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4883.gd61b0886.el9. 32/37 2024-09-12T16:13:39.281 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-2:19.3.0-4883.gd61b0886.el9.x86_64 33/37 2024-09-12T16:13:39.281 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-12T16:13:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4883.gd61b0886.el9.x86_64 33/37 2024-09-12T16:13:39.308 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:13:39.308 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T16:13:39.308 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T16:13:39.308 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T16:13:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:13:39.314 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-12T16:13:39.412 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-12T16:13:39.429 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mon-2:19.3.0-4883.gd61b0886.el9.x86_64 35/37 2024-09-12T16:13:39.452 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mon-2:19.3.0-4883.gd61b0886.el9.x86_64 35/37 2024-09-12T16:13:39.452 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:13:39.452 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T16:13:39.453 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T16:13:39.453 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T16:13:39.453 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:13:39.488 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-12T16:13:39.534 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-12T16:13:39.577 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-12T16:13:39.606 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-12T16:13:39.641 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-12T16:13:39.674 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-12T16:13:39.679 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mds-2:19.3.0-4883.gd61b0886.el9.x86_64 36/37 2024-09-12T16:13:39.703 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mds-2:19.3.0-4883.gd61b0886.el9.x86_64 36/37 2024-09-12T16:13:39.703 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:13:39.703 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T16:13:39.704 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T16:13:39.704 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T16:13:39.704 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:13:39.715 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-12T16:13:39.758 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-12T16:13:39.767 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-2:19.3.0-4883.gd61b0886.el9.x86_64 37/37 2024-09-12T16:13:39.792 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-12T16:13:39.842 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-12T16:13:39.882 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-12T16:13:39.959 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-12T16:13:40.119 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-12T16:13:40.196 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-12T16:13:40.255 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-12T16:13:40.292 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-12T16:13:40.360 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-12T16:13:40.423 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-12T16:13:40.630 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-12T16:13:40.679 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-12T16:13:40.762 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-12T16:13:40.859 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-12T16:13:40.865 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-osd-2:19.3.0-4883.gd61b0886.el9.x86_64 34/37 2024-09-12T16:13:40.894 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-osd-2:19.3.0-4883.gd61b0886.el9.x86_64 34/37 2024-09-12T16:13:40.894 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:13:40.894 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T16:13:40.894 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T16:13:40.894 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T16:13:40.895 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:13:40.895 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-12T16:13:41.033 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-12T16:13:41.208 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4883.gd61b0886.el9. 32/37 2024-09-12T16:13:41.238 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-2:19.3.0-4883.gd61b0886.el9.x86_64 33/37 2024-09-12T16:13:41.267 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4883.gd61b0886.el9.x86_64 33/37 2024-09-12T16:13:41.267 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:13:41.267 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T16:13:41.267 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T16:13:41.267 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T16:13:41.267 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:13:41.358 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mon-2:19.3.0-4883.gd61b0886.el9.x86_64 35/37 2024-09-12T16:13:41.383 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mon-2:19.3.0-4883.gd61b0886.el9.x86_64 35/37 2024-09-12T16:13:41.383 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:13:41.383 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T16:13:41.383 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T16:13:41.384 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T16:13:41.384 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:13:41.465 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-2:19.3.0-4883.gd61b0886.el9.x86_64 37/37 2024-09-12T16:13:41.465 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-2:19.3.0-4883.gd61b0886.el9.x86_64 1/37 2024-09-12T16:13:41.466 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mds-2:19.3.0-4883.gd61b0886.el9.x86_64 2/37 2024-09-12T16:13:41.466 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-2:19.3.0-4883.gd61b0886.el9.x86_64 3/37 2024-09-12T16:13:41.466 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mon-2:19.3.0-4883.gd61b0886.el9.x86_64 4/37 2024-09-12T16:13:41.466 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-osd-2:19.3.0-4883.gd61b0886.el9.x86_64 5/37 2024-09-12T16:13:41.466 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4883.gd61b0886.el9. 6/37 2024-09-12T16:13:41.466 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-12T16:13:41.466 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-12T16:13:41.466 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-12T16:13:41.466 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-12T16:13:41.466 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-12T16:13:41.466 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-12T16:13:41.466 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-12T16:13:41.466 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-12T16:13:41.467 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-12T16:13:41.467 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-12T16:13:41.467 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-12T16:13:41.467 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-12T16:13:41.467 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-12T16:13:41.467 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-12T16:13:41.467 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-12T16:13:41.467 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-12T16:13:41.467 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-12T16:13:41.467 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-12T16:13:41.467 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-12T16:13:41.467 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-12T16:13:41.467 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-12T16:13:41.468 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-12T16:13:41.468 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-12T16:13:41.468 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-12T16:13:41.468 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-12T16:13:41.468 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-12T16:13:41.468 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-12T16:13:41.468 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-12T16:13:41.468 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-12T16:13:41.468 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-12T16:13:41.617 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mds-2:19.3.0-4883.gd61b0886.el9.x86_64 36/37 2024-09-12T16:13:41.641 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mds-2:19.3.0-4883.gd61b0886.el9.x86_64 36/37 2024-09-12T16:13:41.641 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:13:41.641 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T16:13:41.642 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T16:13:41.642 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T16:13:41.642 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:13:41.700 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-2:19.3.0-4883.gd61b0886.el9.x86_64 37/37 2024-09-12T16:13:42.423 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-12T16:13:42.424 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:13:42.424 INFO:teuthology.orchestra.run.smithi204.stdout:Installed: 2024-09-12T16:13:42.424 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:42.424 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mds-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:42.424 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:42.424 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-modules-core-2:19.3.0-4883.gd61b0886.el9.noarch 2024-09-12T16:13:42.424 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mon-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:42.424 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-osd-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:42.424 INFO:teuthology.orchestra.run.smithi204.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T16:13:42.424 INFO:teuthology.orchestra.run.smithi204.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T16:13:42.424 INFO:teuthology.orchestra.run.smithi204.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T16:13:42.424 INFO:teuthology.orchestra.run.smithi204.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T16:13:42.425 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T16:13:42.425 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T16:13:42.425 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T16:13:42.425 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T16:13:42.425 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T16:13:42.425 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T16:13:42.425 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T16:13:42.425 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T16:13:42.425 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T16:13:42.425 INFO:teuthology.orchestra.run.smithi204.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T16:13:42.425 INFO:teuthology.orchestra.run.smithi204.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T16:13:42.426 INFO:teuthology.orchestra.run.smithi204.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T16:13:42.426 INFO:teuthology.orchestra.run.smithi204.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T16:13:42.426 INFO:teuthology.orchestra.run.smithi204.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T16:13:42.426 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T16:13:42.426 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T16:13:42.426 INFO:teuthology.orchestra.run.smithi204.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T16:13:42.426 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T16:13:42.426 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T16:13:42.426 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T16:13:42.426 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T16:13:42.426 INFO:teuthology.orchestra.run.smithi204.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T16:13:42.426 INFO:teuthology.orchestra.run.smithi204.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T16:13:42.426 INFO:teuthology.orchestra.run.smithi204.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T16:13:42.426 INFO:teuthology.orchestra.run.smithi204.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T16:13:42.427 INFO:teuthology.orchestra.run.smithi204.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T16:13:42.427 INFO:teuthology.orchestra.run.smithi204.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T16:13:42.427 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:13:42.427 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-09-12T16:13:42.765 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum -y install ceph-base 2024-09-12T16:13:42.814 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-osd-2:19.3.0-4883.gd61b0886.el9.x86_64 34/37 2024-09-12T16:13:42.843 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-osd-2:19.3.0-4883.gd61b0886.el9.x86_64 34/37 2024-09-12T16:13:42.843 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:13:42.843 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T16:13:42.844 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T16:13:42.844 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T16:13:42.844 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:13:43.306 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mon-2:19.3.0-4883.gd61b0886.el9.x86_64 35/37 2024-09-12T16:13:43.331 INFO:teuthology.orchestra.run.smithi204.stdout:Last metadata expiration check: 0:00:53 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:13:43.332 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mon-2:19.3.0-4883.gd61b0886.el9.x86_64 35/37 2024-09-12T16:13:43.332 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:13:43.332 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T16:13:43.332 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T16:13:43.332 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T16:13:43.332 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:13:43.422 INFO:teuthology.orchestra.run.smithi204.stdout:Package ceph-base-2:19.3.0-4883.gd61b0886.el9.x86_64 is already installed. 2024-09-12T16:13:43.464 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-09-12T16:13:43.465 INFO:teuthology.orchestra.run.smithi204.stdout:Nothing to do. 2024-09-12T16:13:43.465 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-09-12T16:13:43.481 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-2:19.3.0-4883.gd61b0886.el9.x86_64 37/37 2024-09-12T16:13:43.481 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-2:19.3.0-4883.gd61b0886.el9.x86_64 1/37 2024-09-12T16:13:43.481 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mds-2:19.3.0-4883.gd61b0886.el9.x86_64 2/37 2024-09-12T16:13:43.481 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-2:19.3.0-4883.gd61b0886.el9.x86_64 3/37 2024-09-12T16:13:43.481 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mon-2:19.3.0-4883.gd61b0886.el9.x86_64 4/37 2024-09-12T16:13:43.481 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-osd-2:19.3.0-4883.gd61b0886.el9.x86_64 5/37 2024-09-12T16:13:43.481 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4883.gd61b0886.el9. 6/37 2024-09-12T16:13:43.481 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-12T16:13:43.481 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-12T16:13:43.482 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-12T16:13:43.482 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-12T16:13:43.482 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-12T16:13:43.482 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-12T16:13:43.482 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-12T16:13:43.482 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-12T16:13:43.482 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-12T16:13:43.482 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-12T16:13:43.482 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-12T16:13:43.482 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-12T16:13:43.482 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-12T16:13:43.482 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-12T16:13:43.482 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-12T16:13:43.482 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-12T16:13:43.482 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-12T16:13:43.483 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-12T16:13:43.483 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-12T16:13:43.484 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-12T16:13:43.484 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-12T16:13:43.484 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-12T16:13:43.484 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-12T16:13:43.484 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-12T16:13:43.484 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-12T16:13:43.484 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-12T16:13:43.484 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-12T16:13:43.485 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-12T16:13:43.485 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-12T16:13:43.485 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-12T16:13:43.540 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum -y install cephadm 2024-09-12T16:13:43.582 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mds-2:19.3.0-4883.gd61b0886.el9.x86_64 36/37 2024-09-12T16:13:43.607 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mds-2:19.3.0-4883.gd61b0886.el9.x86_64 36/37 2024-09-12T16:13:43.607 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:13:43.607 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T16:13:43.608 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T16:13:43.608 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T16:13:43.608 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:13:43.674 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-2:19.3.0-4883.gd61b0886.el9.x86_64 37/37 2024-09-12T16:13:44.105 INFO:teuthology.orchestra.run.smithi204.stdout:Last metadata expiration check: 0:00:54 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:13:44.237 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-09-12T16:13:44.237 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:13:44.238 INFO:teuthology.orchestra.run.smithi204.stdout: Package Arch Version Repository Size 2024-09-12T16:13:44.238 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:13:44.238 INFO:teuthology.orchestra.run.smithi204.stdout:Installing: 2024-09-12T16:13:44.238 INFO:teuthology.orchestra.run.smithi204.stdout: cephadm noarch 2:19.3.0-4883.gd61b0886.el9 ceph-noarch 784 k 2024-09-12T16:13:44.238 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:13:44.238 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction Summary 2024-09-12T16:13:44.238 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:13:44.238 INFO:teuthology.orchestra.run.smithi204.stdout:Install 1 Package 2024-09-12T16:13:44.238 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:13:44.238 INFO:teuthology.orchestra.run.smithi204.stdout:Total download size: 784 k 2024-09-12T16:13:44.238 INFO:teuthology.orchestra.run.smithi204.stdout:Installed size: 791 k 2024-09-12T16:13:44.238 INFO:teuthology.orchestra.run.smithi204.stdout:Downloading Packages: 2024-09-12T16:13:44.414 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-12T16:13:44.414 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:13:44.414 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-12T16:13:44.414 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:44.414 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:44.414 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:44.414 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core-2:19.3.0-4883.gd61b0886.el9.noarch 2024-09-12T16:13:44.415 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:44.415 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:44.415 INFO:teuthology.orchestra.run.smithi017.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T16:13:44.415 INFO:teuthology.orchestra.run.smithi017.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T16:13:44.415 INFO:teuthology.orchestra.run.smithi017.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T16:13:44.415 INFO:teuthology.orchestra.run.smithi017.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T16:13:44.415 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T16:13:44.415 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T16:13:44.415 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T16:13:44.415 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T16:13:44.415 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T16:13:44.415 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T16:13:44.415 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T16:13:44.416 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T16:13:44.416 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T16:13:44.416 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T16:13:44.416 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T16:13:44.416 INFO:teuthology.orchestra.run.smithi017.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T16:13:44.416 INFO:teuthology.orchestra.run.smithi017.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T16:13:44.416 INFO:teuthology.orchestra.run.smithi017.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T16:13:44.416 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T16:13:44.416 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T16:13:44.416 INFO:teuthology.orchestra.run.smithi017.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T16:13:44.416 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T16:13:44.417 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T16:13:44.417 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T16:13:44.417 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T16:13:44.417 INFO:teuthology.orchestra.run.smithi017.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T16:13:44.417 INFO:teuthology.orchestra.run.smithi017.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T16:13:44.417 INFO:teuthology.orchestra.run.smithi017.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T16:13:44.417 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T16:13:44.417 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T16:13:44.417 INFO:teuthology.orchestra.run.smithi017.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T16:13:44.417 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:13:44.417 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-12T16:13:44.496 INFO:teuthology.orchestra.run.smithi204.stdout:cephadm-19.3.0-4883.gd61b0886.el9.noarch.rpm 3.0 MB/s | 784 kB 00:00 2024-09-12T16:13:44.497 INFO:teuthology.orchestra.run.smithi204.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:13:44.497 INFO:teuthology.orchestra.run.smithi204.stdout:Total 3.0 MB/s | 784 kB 00:00 2024-09-12T16:13:44.497 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction check 2024-09-12T16:13:44.502 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction check succeeded. 2024-09-12T16:13:44.502 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction test 2024-09-12T16:13:44.508 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction test succeeded. 2024-09-12T16:13:44.508 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction 2024-09-12T16:13:44.583 INFO:teuthology.orchestra.run.smithi204.stdout: Preparing : 1/1 2024-09-12T16:13:44.773 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-base 2024-09-12T16:13:45.002 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: cephadm-2:19.3.0-4883.gd61b0886.el9.noarch 1/1 2024-09-12T16:13:45.102 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : cephadm-2:19.3.0-4883.gd61b0886.el9.noarch 1/1 2024-09-12T16:13:45.269 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-2:19.3.0-4883.gd61b0886.el9.x86_64 37/37 2024-09-12T16:13:45.270 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-2:19.3.0-4883.gd61b0886.el9.x86_64 1/37 2024-09-12T16:13:45.270 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mds-2:19.3.0-4883.gd61b0886.el9.x86_64 2/37 2024-09-12T16:13:45.270 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-2:19.3.0-4883.gd61b0886.el9.x86_64 3/37 2024-09-12T16:13:45.270 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mon-2:19.3.0-4883.gd61b0886.el9.x86_64 4/37 2024-09-12T16:13:45.270 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-osd-2:19.3.0-4883.gd61b0886.el9.x86_64 5/37 2024-09-12T16:13:45.270 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4883.gd61b0886.el9. 6/37 2024-09-12T16:13:45.270 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-12T16:13:45.270 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-12T16:13:45.270 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-12T16:13:45.270 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-12T16:13:45.270 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-12T16:13:45.270 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-12T16:13:45.270 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-12T16:13:45.270 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-12T16:13:45.271 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-12T16:13:45.271 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-12T16:13:45.271 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-12T16:13:45.271 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-12T16:13:45.271 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-12T16:13:45.271 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-12T16:13:45.271 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-12T16:13:45.271 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-12T16:13:45.271 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-12T16:13:45.271 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-12T16:13:45.271 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-12T16:13:45.271 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-12T16:13:45.271 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-12T16:13:45.271 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-12T16:13:45.272 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-12T16:13:45.272 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-12T16:13:45.272 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-12T16:13:45.272 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-12T16:13:45.272 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-12T16:13:45.272 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-12T16:13:45.272 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-12T16:13:45.272 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-12T16:13:45.378 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:00:55 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:13:45.457 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: cephadm-2:19.3.0-4883.gd61b0886.el9.noarch 1/1 2024-09-12T16:13:45.475 INFO:teuthology.orchestra.run.smithi017.stdout:Package ceph-base-2:19.3.0-4883.gd61b0886.el9.x86_64 is already installed. 2024-09-12T16:13:45.521 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-12T16:13:45.522 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-09-12T16:13:45.522 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-12T16:13:45.603 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install cephadm 2024-09-12T16:13:45.704 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : cephadm-2:19.3.0-4883.gd61b0886.el9.noarch 1/1 2024-09-12T16:13:45.704 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:13:45.704 INFO:teuthology.orchestra.run.smithi204.stdout:Installed: 2024-09-12T16:13:45.704 INFO:teuthology.orchestra.run.smithi204.stdout: cephadm-2:19.3.0-4883.gd61b0886.el9.noarch 2024-09-12T16:13:45.704 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:13:45.704 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-09-12T16:13:45.937 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum -y install ceph-immutable-object-cache 2024-09-12T16:13:46.206 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:00:56 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:13:46.206 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-12T16:13:46.207 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:13:46.207 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-12T16:13:46.207 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:46.207 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mds-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:46.207 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:46.207 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core-2:19.3.0-4883.gd61b0886.el9.noarch 2024-09-12T16:13:46.207 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mon-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:46.207 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-osd-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:46.207 INFO:teuthology.orchestra.run.smithi047.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T16:13:46.207 INFO:teuthology.orchestra.run.smithi047.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T16:13:46.207 INFO:teuthology.orchestra.run.smithi047.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T16:13:46.208 INFO:teuthology.orchestra.run.smithi047.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T16:13:46.208 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T16:13:46.208 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T16:13:46.208 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T16:13:46.208 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T16:13:46.208 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T16:13:46.208 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T16:13:46.208 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T16:13:46.208 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T16:13:46.208 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T16:13:46.208 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T16:13:46.209 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T16:13:46.209 INFO:teuthology.orchestra.run.smithi047.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T16:13:46.209 INFO:teuthology.orchestra.run.smithi047.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T16:13:46.209 INFO:teuthology.orchestra.run.smithi047.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T16:13:46.209 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T16:13:46.209 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T16:13:46.209 INFO:teuthology.orchestra.run.smithi047.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T16:13:46.209 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T16:13:46.209 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T16:13:46.209 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T16:13:46.209 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T16:13:46.209 INFO:teuthology.orchestra.run.smithi047.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T16:13:46.209 INFO:teuthology.orchestra.run.smithi047.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T16:13:46.209 INFO:teuthology.orchestra.run.smithi047.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T16:13:46.210 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T16:13:46.210 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T16:13:46.210 INFO:teuthology.orchestra.run.smithi047.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T16:13:46.210 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:13:46.210 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T16:13:46.345 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-12T16:13:46.346 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:13:46.346 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-09-12T16:13:46.346 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:13:46.346 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-12T16:13:46.346 INFO:teuthology.orchestra.run.smithi017.stdout: cephadm noarch 2:19.3.0-4883.gd61b0886.el9 ceph-noarch 784 k 2024-09-12T16:13:46.346 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:13:46.346 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-12T16:13:46.346 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:13:46.346 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2024-09-12T16:13:46.346 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:13:46.346 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 784 k 2024-09-12T16:13:46.346 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 791 k 2024-09-12T16:13:46.346 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-12T16:13:46.515 INFO:teuthology.orchestra.run.smithi204.stdout:Last metadata expiration check: 0:00:56 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:13:46.608 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-base 2024-09-12T16:13:46.629 INFO:teuthology.orchestra.run.smithi017.stdout:cephadm-19.3.0-4883.gd61b0886.el9.noarch.rpm 2.7 MB/s | 784 kB 00:00 2024-09-12T16:13:46.629 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:13:46.630 INFO:teuthology.orchestra.run.smithi017.stdout:Total 2.7 MB/s | 784 kB 00:00 2024-09-12T16:13:46.630 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-12T16:13:46.636 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-12T16:13:46.636 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-12T16:13:46.642 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-12T16:13:46.642 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-12T16:13:46.651 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-09-12T16:13:46.651 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:13:46.651 INFO:teuthology.orchestra.run.smithi204.stdout: Package Arch Version Repo Size 2024-09-12T16:13:46.652 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:13:46.652 INFO:teuthology.orchestra.run.smithi204.stdout:Installing: 2024-09-12T16:13:46.652 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 145 k 2024-09-12T16:13:46.652 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:13:46.652 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction Summary 2024-09-12T16:13:46.652 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:13:46.652 INFO:teuthology.orchestra.run.smithi204.stdout:Install 1 Package 2024-09-12T16:13:46.652 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:13:46.653 INFO:teuthology.orchestra.run.smithi204.stdout:Total download size: 145 k 2024-09-12T16:13:46.653 INFO:teuthology.orchestra.run.smithi204.stdout:Installed size: 432 k 2024-09-12T16:13:46.653 INFO:teuthology.orchestra.run.smithi204.stdout:Downloading Packages: 2024-09-12T16:13:46.715 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-12T16:13:46.870 INFO:teuthology.orchestra.run.smithi204.stdout:ceph-immutable-object-cache-19.3.0-4883.gd61b08 668 kB/s | 145 kB 00:00 2024-09-12T16:13:46.871 INFO:teuthology.orchestra.run.smithi204.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:13:46.871 INFO:teuthology.orchestra.run.smithi204.stdout:Total 663 kB/s | 145 kB 00:00 2024-09-12T16:13:46.871 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction check 2024-09-12T16:13:46.878 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction check succeeded. 2024-09-12T16:13:46.879 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction test 2024-09-12T16:13:46.937 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction test succeeded. 2024-09-12T16:13:46.937 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction 2024-09-12T16:13:47.076 INFO:teuthology.orchestra.run.smithi204.stdout: Preparing : 1/1 2024-09-12T16:13:47.146 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4883.gd61b0886. 1/1 2024-09-12T16:13:47.149 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: cephadm-2:19.3.0-4883.gd61b0886.el9.noarch 1/1 2024-09-12T16:13:47.172 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4883.gd61b0886. 1/1 2024-09-12T16:13:47.172 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:13:47.172 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T16:13:47.172 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:13:47.200 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:00:55 ago on Thu 12 Sep 2024 04:12:52 PM UTC. 2024-09-12T16:13:47.251 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephadm-2:19.3.0-4883.gd61b0886.el9.noarch 1/1 2024-09-12T16:13:47.292 INFO:teuthology.orchestra.run.smithi047.stdout:Package ceph-base-2:19.3.0-4883.gd61b0886.el9.x86_64 is already installed. 2024-09-12T16:13:47.336 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T16:13:47.338 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-09-12T16:13:47.338 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T16:13:47.399 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install cephadm 2024-09-12T16:13:47.633 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: cephadm-2:19.3.0-4883.gd61b0886.el9.noarch 1/1 2024-09-12T16:13:47.905 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephadm-2:19.3.0-4883.gd61b0886.el9.noarch 1/1 2024-09-12T16:13:47.905 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:13:47.905 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-12T16:13:47.905 INFO:teuthology.orchestra.run.smithi017.stdout: cephadm-2:19.3.0-4883.gd61b0886.el9.noarch 2024-09-12T16:13:47.905 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:13:47.906 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-12T16:13:47.985 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:00:55 ago on Thu 12 Sep 2024 04:12:52 PM UTC. 2024-09-12T16:13:48.096 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4883.gd61b0886. 1/1 2024-09-12T16:13:48.096 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:13:48.096 INFO:teuthology.orchestra.run.smithi204.stdout:Installed: 2024-09-12T16:13:48.096 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-immutable-object-cache-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:48.096 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:13:48.096 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-09-12T16:13:48.116 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-immutable-object-cache 2024-09-12T16:13:48.122 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T16:13:48.123 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:13:48.123 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-09-12T16:13:48.123 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:13:48.123 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-12T16:13:48.123 INFO:teuthology.orchestra.run.smithi047.stdout: cephadm noarch 2:19.3.0-4883.gd61b0886.el9 ceph-noarch 784 k 2024-09-12T16:13:48.123 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:13:48.123 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-12T16:13:48.123 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:13:48.123 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-09-12T16:13:48.124 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:13:48.124 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 784 k 2024-09-12T16:13:48.124 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 791 k 2024-09-12T16:13:48.124 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-12T16:13:48.340 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum -y install ceph-mgr 2024-09-12T16:13:48.423 INFO:teuthology.orchestra.run.smithi047.stdout:cephadm-19.3.0-4883.gd61b0886.el9.noarch.rpm 2.6 MB/s | 784 kB 00:00 2024-09-12T16:13:48.424 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:13:48.424 INFO:teuthology.orchestra.run.smithi047.stdout:Total 2.5 MB/s | 784 kB 00:00 2024-09-12T16:13:48.424 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-12T16:13:48.430 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-12T16:13:48.430 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-12T16:13:48.436 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-12T16:13:48.436 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-12T16:13:48.517 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-12T16:13:48.711 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:00:58 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:13:48.850 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-12T16:13:48.850 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:13:48.850 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repo Size 2024-09-12T16:13:48.851 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:13:48.851 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-12T16:13:48.851 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 145 k 2024-09-12T16:13:48.851 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:13:48.851 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-12T16:13:48.851 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:13:48.851 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2024-09-12T16:13:48.851 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:13:48.851 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 145 k 2024-09-12T16:13:48.851 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 432 k 2024-09-12T16:13:48.851 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-12T16:13:48.919 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: cephadm-2:19.3.0-4883.gd61b0886.el9.noarch 1/1 2024-09-12T16:13:48.924 INFO:teuthology.orchestra.run.smithi204.stdout:Last metadata expiration check: 0:00:58 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:13:49.004 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephadm-2:19.3.0-4883.gd61b0886.el9.noarch 1/1 2024-09-12T16:13:49.014 INFO:teuthology.orchestra.run.smithi204.stdout:Package ceph-mgr-2:19.3.0-4883.gd61b0886.el9.x86_64 is already installed. 2024-09-12T16:13:49.033 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-immutable-object-cache-19.3.0-4883.gd61b08 796 kB/s | 145 kB 00:00 2024-09-12T16:13:49.034 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:13:49.034 INFO:teuthology.orchestra.run.smithi017.stdout:Total 790 kB/s | 145 kB 00:00 2024-09-12T16:13:49.034 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-12T16:13:49.042 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-12T16:13:49.043 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-12T16:13:49.056 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-09-12T16:13:49.057 INFO:teuthology.orchestra.run.smithi204.stdout:Nothing to do. 2024-09-12T16:13:49.057 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-09-12T16:13:49.103 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-12T16:13:49.103 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-12T16:13:49.130 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum -y install ceph-mgr-dashboard 2024-09-12T16:13:49.254 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-12T16:13:49.318 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4883.gd61b0886. 1/1 2024-09-12T16:13:49.344 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4883.gd61b0886. 1/1 2024-09-12T16:13:49.344 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:13:49.344 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T16:13:49.344 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:13:49.345 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: cephadm-2:19.3.0-4883.gd61b0886.el9.noarch 1/1 2024-09-12T16:13:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephadm-2:19.3.0-4883.gd61b0886.el9.noarch 1/1 2024-09-12T16:13:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:13:49.600 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-12T16:13:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: cephadm-2:19.3.0-4883.gd61b0886.el9.noarch 2024-09-12T16:13:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:13:49.601 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T16:13:49.690 INFO:teuthology.orchestra.run.smithi204.stdout:Last metadata expiration check: 0:00:59 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:13:49.810 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-immutable-object-cache 2024-09-12T16:13:49.821 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-09-12T16:13:49.822 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:13:49.823 INFO:teuthology.orchestra.run.smithi204.stdout: Package Arch Version Repository Size 2024-09-12T16:13:49.823 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:13:49.823 INFO:teuthology.orchestra.run.smithi204.stdout:Installing: 2024-09-12T16:13:49.823 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4883.gd61b0886.el9 ceph-noarch 14 M 2024-09-12T16:13:49.823 INFO:teuthology.orchestra.run.smithi204.stdout:Installing dependencies: 2024-09-12T16:13:49.823 INFO:teuthology.orchestra.run.smithi204.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T16:13:49.823 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4883.gd61b0886.el9 ceph-noarch 34 k 2024-09-12T16:13:49.823 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4883.gd61b0886.el9 ceph-noarch 16 k 2024-09-12T16:13:49.823 INFO:teuthology.orchestra.run.smithi204.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T16:13:49.823 INFO:teuthology.orchestra.run.smithi204.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T16:13:49.823 INFO:teuthology.orchestra.run.smithi204.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T16:13:49.823 INFO:teuthology.orchestra.run.smithi204.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T16:13:49.824 INFO:teuthology.orchestra.run.smithi204.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T16:13:49.824 INFO:teuthology.orchestra.run.smithi204.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T16:13:49.824 INFO:teuthology.orchestra.run.smithi204.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T16:13:49.824 INFO:teuthology.orchestra.run.smithi204.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T16:13:49.824 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:13:49.824 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction Summary 2024-09-12T16:13:49.824 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:13:49.824 INFO:teuthology.orchestra.run.smithi204.stdout:Install 12 Packages 2024-09-12T16:13:49.824 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:13:49.825 INFO:teuthology.orchestra.run.smithi204.stdout:Total download size: 19 M 2024-09-12T16:13:49.825 INFO:teuthology.orchestra.run.smithi204.stdout:Installed size: 159 M 2024-09-12T16:13:49.825 INFO:teuthology.orchestra.run.smithi204.stdout:Downloading Packages: 2024-09-12T16:13:50.262 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4883.gd61b0886. 1/1 2024-09-12T16:13:50.262 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:13:50.262 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-12T16:13:50.262 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:50.262 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:13:50.262 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-12T16:13:50.405 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:00:58 ago on Thu 12 Sep 2024 04:12:52 PM UTC. 2024-09-12T16:13:50.487 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-mgr 2024-09-12T16:13:50.544 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T16:13:50.544 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:13:50.544 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repo Size 2024-09-12T16:13:50.544 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:13:50.545 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-12T16:13:50.545 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 145 k 2024-09-12T16:13:50.545 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:13:50.545 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-12T16:13:50.545 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:13:50.545 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-09-12T16:13:50.545 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:13:50.546 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 145 k 2024-09-12T16:13:50.546 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 432 k 2024-09-12T16:13:50.546 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-12T16:13:50.566 INFO:teuthology.orchestra.run.smithi204.stdout:(1/12): ceph-prometheus-alerts-19.3.0-4883.gd61 106 kB/s | 16 kB 00:00 2024-09-12T16:13:50.591 INFO:teuthology.orchestra.run.smithi204.stdout:(2/12): ceph-grafana-dashboards-19.3.0-4883.gd6 190 kB/s | 34 kB 00:00 2024-09-12T16:13:50.733 INFO:teuthology.orchestra.run.smithi204.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.9 MB/s | 269 kB 00:00 2024-09-12T16:13:50.737 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-immutable-object-cache-19.3.0-4883.gd61b08 756 kB/s | 145 kB 00:00 2024-09-12T16:13:50.738 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:13:50.739 INFO:teuthology.orchestra.run.smithi047.stdout:Total 750 kB/s | 145 kB 00:00 2024-09-12T16:13:50.739 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-12T16:13:50.747 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-12T16:13:50.747 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-12T16:13:50.807 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-12T16:13:50.808 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-12T16:13:50.900 INFO:teuthology.orchestra.run.smithi204.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 3.0 MB/s | 1.0 MB 00:00 2024-09-12T16:13:50.964 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-12T16:13:51.055 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4883.gd61b0886. 1/1 2024-09-12T16:13:51.082 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4883.gd61b0886. 1/1 2024-09-12T16:13:51.082 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:13:51.082 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T16:13:51.082 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:13:51.084 INFO:teuthology.orchestra.run.smithi204.stdout:(5/12): ceph-mgr-dashboard-19.3.0-4883.gd61b088 21 MB/s | 14 MB 00:00 2024-09-12T16:13:51.086 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:01 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:13:51.134 INFO:teuthology.orchestra.run.smithi204.stdout:(6/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 2.3 MB/s | 548 kB 00:00 2024-09-12T16:13:51.159 INFO:teuthology.orchestra.run.smithi204.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 259 kB/s | 19 kB 00:00 2024-09-12T16:13:51.179 INFO:teuthology.orchestra.run.smithi017.stdout:Package ceph-mgr-2:19.3.0-4883.gd61b0886.el9.x86_64 is already installed. 2024-09-12T16:13:51.184 INFO:teuthology.orchestra.run.smithi204.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.7 MB/s | 144 kB 00:00 2024-09-12T16:13:51.210 INFO:teuthology.orchestra.run.smithi204.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-12T16:13:51.226 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-12T16:13:51.226 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-09-12T16:13:51.226 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-12T16:13:51.235 INFO:teuthology.orchestra.run.smithi204.stdout:(10/12): protobuf-compiler-3.14.0-13.el9.x86_64 1.7 MB/s | 863 kB 00:00 2024-09-12T16:13:51.260 INFO:teuthology.orchestra.run.smithi204.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-09-12T16:13:51.288 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-mgr-dashboard 2024-09-12T16:13:51.311 INFO:teuthology.orchestra.run.smithi204.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 12 MB/s | 2.0 MB 00:00 2024-09-12T16:13:51.315 INFO:teuthology.orchestra.run.smithi204.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:13:51.315 INFO:teuthology.orchestra.run.smithi204.stdout:Total 13 MB/s | 19 MB 00:01 2024-09-12T16:13:51.363 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction check 2024-09-12T16:13:51.383 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction check succeeded. 2024-09-12T16:13:51.383 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction test 2024-09-12T16:13:51.651 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction test succeeded. 2024-09-12T16:13:51.651 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction 2024-09-12T16:13:51.874 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:01 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:13:52.014 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-12T16:13:52.015 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:13:52.015 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-09-12T16:13:52.015 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:13:52.015 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-12T16:13:52.015 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4883.gd61b0886.el9 ceph-noarch 14 M 2024-09-12T16:13:52.015 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-09-12T16:13:52.015 INFO:teuthology.orchestra.run.smithi017.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T16:13:52.016 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4883.gd61b0886.el9 ceph-noarch 34 k 2024-09-12T16:13:52.016 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4883.gd61b0886.el9 ceph-noarch 16 k 2024-09-12T16:13:52.016 INFO:teuthology.orchestra.run.smithi017.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T16:13:52.016 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T16:13:52.016 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T16:13:52.016 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T16:13:52.016 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T16:13:52.016 INFO:teuthology.orchestra.run.smithi017.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T16:13:52.016 INFO:teuthology.orchestra.run.smithi017.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T16:13:52.016 INFO:teuthology.orchestra.run.smithi017.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T16:13:52.016 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:13:52.016 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-12T16:13:52.016 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:13:52.017 INFO:teuthology.orchestra.run.smithi017.stdout:Install 12 Packages 2024-09-12T16:13:52.017 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:13:52.017 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 19 M 2024-09-12T16:13:52.017 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 159 M 2024-09-12T16:13:52.017 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-12T16:13:52.033 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4883.gd61b0886. 1/1 2024-09-12T16:13:52.033 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:13:52.033 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-12T16:13:52.033 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-immutable-object-cache-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:13:52.033 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:13:52.033 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T16:13:52.249 INFO:teuthology.orchestra.run.smithi204.stdout: Preparing : 1/1 2024-09-12T16:13:52.265 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-mgr 2024-09-12T16:13:52.328 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-12T16:13:52.363 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-12T16:13:52.410 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-12T16:13:52.449 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-12T16:13:52.504 INFO:teuthology.orchestra.run.smithi017.stdout:(1/12): ceph-prometheus-alerts-19.3.0-4883.gd61 108 kB/s | 16 kB 00:00 2024-09-12T16:13:52.529 INFO:teuthology.orchestra.run.smithi017.stdout:(2/12): ceph-grafana-dashboards-19.3.0-4883.gd6 193 kB/s | 34 kB 00:00 2024-09-12T16:13:52.536 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-12T16:13:52.667 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-12T16:13:52.696 INFO:teuthology.orchestra.run.smithi017.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.6 MB/s | 269 kB 00:00 2024-09-12T16:13:52.746 INFO:teuthology.orchestra.run.smithi017.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.2 MB/s | 1.0 MB 00:00 2024-09-12T16:13:52.760 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-12T16:13:52.796 INFO:teuthology.orchestra.run.smithi017.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-12T16:13:52.812 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-12T16:13:52.822 INFO:teuthology.orchestra.run.smithi017.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 777 kB/s | 19 kB 00:00 2024-09-12T16:13:52.841 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-12T16:13:52.860 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:00 ago on Thu 12 Sep 2024 04:12:52 PM UTC. 2024-09-12T16:13:52.873 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4883.gd61b0886.el9 10/12 2024-09-12T16:13:52.955 INFO:teuthology.orchestra.run.smithi047.stdout:Package ceph-mgr-2:19.3.0-4883.gd61b0886.el9.x86_64 is already installed. 2024-09-12T16:13:52.997 INFO:teuthology.orchestra.run.smithi017.stdout:(7/12): ceph-mgr-dashboard-19.3.0-4883.gd61b088 22 MB/s | 14 MB 00:00 2024-09-12T16:13:52.999 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T16:13:53.000 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-09-12T16:13:53.000 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T16:13:53.056 INFO:teuthology.orchestra.run.smithi017.stdout:(8/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 8.7 MB/s | 2.0 MB 00:00 2024-09-12T16:13:53.064 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-mgr-dashboard 2024-09-12T16:13:53.081 INFO:teuthology.orchestra.run.smithi017.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.3 MB/s | 31 kB 00:00 2024-09-12T16:13:53.106 INFO:teuthology.orchestra.run.smithi017.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 7.4 MB/s | 188 kB 00:00 2024-09-12T16:13:53.132 INFO:teuthology.orchestra.run.smithi017.stdout:(11/12): python3-grpcio-tools-1.46.7-10.el9.x86 1.1 MB/s | 144 kB 00:00 2024-09-12T16:13:53.157 INFO:teuthology.orchestra.run.smithi017.stdout:(12/12): protobuf-compiler-3.14.0-13.el9.x86_64 1.8 MB/s | 863 kB 00:00 2024-09-12T16:13:53.160 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:13:53.161 INFO:teuthology.orchestra.run.smithi017.stdout:Total 17 MB/s | 19 MB 00:01 2024-09-12T16:13:53.210 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-12T16:13:53.230 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-12T16:13:53.230 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-12T16:13:53.509 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-12T16:13:53.509 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-12T16:13:53.648 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:01 ago on Thu 12 Sep 2024 04:12:52 PM UTC. 2024-09-12T16:13:53.786 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T16:13:53.787 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:13:53.787 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-09-12T16:13:53.787 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:13:53.787 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-12T16:13:53.787 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4883.gd61b0886.el9 ceph-noarch 14 M 2024-09-12T16:13:53.787 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-12T16:13:53.787 INFO:teuthology.orchestra.run.smithi047.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T16:13:53.787 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4883.gd61b0886.el9 ceph-noarch 34 k 2024-09-12T16:13:53.787 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4883.gd61b0886.el9 ceph-noarch 16 k 2024-09-12T16:13:53.787 INFO:teuthology.orchestra.run.smithi047.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T16:13:53.788 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T16:13:53.788 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T16:13:53.788 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T16:13:53.788 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T16:13:53.788 INFO:teuthology.orchestra.run.smithi047.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T16:13:53.788 INFO:teuthology.orchestra.run.smithi047.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T16:13:53.788 INFO:teuthology.orchestra.run.smithi047.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T16:13:53.788 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:13:53.788 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-12T16:13:53.788 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:13:53.788 INFO:teuthology.orchestra.run.smithi047.stdout:Install 12 Packages 2024-09-12T16:13:53.789 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:13:53.789 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 19 M 2024-09-12T16:13:53.789 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 159 M 2024-09-12T16:13:53.789 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-12T16:13:54.125 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-12T16:13:54.208 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-12T16:13:54.252 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-12T16:13:54.299 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-12T16:13:54.337 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-12T16:13:54.424 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-12T16:13:54.491 INFO:teuthology.orchestra.run.smithi047.stdout:(1/12): ceph-grafana-dashboards-19.3.0-4883.gd6 238 kB/s | 34 kB 00:00 2024-09-12T16:13:54.516 INFO:teuthology.orchestra.run.smithi047.stdout:(2/12): ceph-prometheus-alerts-19.3.0-4883.gd61 97 kB/s | 16 kB 00:00 2024-09-12T16:13:54.561 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-12T16:13:54.653 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-12T16:13:54.658 INFO:teuthology.orchestra.run.smithi047.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.9 MB/s | 269 kB 00:00 2024-09-12T16:13:54.701 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-12T16:13:54.729 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-12T16:13:54.761 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4883.gd61b0886.el9 10/12 2024-09-12T16:13:54.825 INFO:teuthology.orchestra.run.smithi047.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 3.0 MB/s | 1.0 MB 00:00 2024-09-12T16:13:54.884 INFO:teuthology.orchestra.run.smithi047.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 9.2 MB/s | 548 kB 00:00 2024-09-12T16:13:54.909 INFO:teuthology.orchestra.run.smithi047.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 786 kB/s | 19 kB 00:00 2024-09-12T16:13:55.068 INFO:teuthology.orchestra.run.smithi047.stdout:(7/12): ceph-mgr-dashboard-19.3.0-4883.gd61b088 20 MB/s | 14 MB 00:00 2024-09-12T16:13:55.118 INFO:teuthology.orchestra.run.smithi047.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 2.9 MB/s | 144 kB 00:00 2024-09-12T16:13:55.160 INFO:teuthology.orchestra.run.smithi047.stdout:(9/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 8.4 MB/s | 2.0 MB 00:00 2024-09-12T16:13:55.185 INFO:teuthology.orchestra.run.smithi047.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 462 kB/s | 31 kB 00:00 2024-09-12T16:13:55.210 INFO:teuthology.orchestra.run.smithi047.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 7.3 MB/s | 188 kB 00:00 2024-09-12T16:13:55.769 INFO:teuthology.orchestra.run.smithi047.stdout:(12/12): protobuf-compiler-3.14.0-13.el9.x86_64 777 kB/s | 863 kB 00:01 2024-09-12T16:13:55.775 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:13:55.775 INFO:teuthology.orchestra.run.smithi047.stdout:Total 9.7 MB/s | 19 MB 00:01 2024-09-12T16:13:55.828 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-12T16:13:55.850 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-12T16:13:55.850 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-12T16:13:56.056 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4883.gd61b0886.el 11/12 2024-09-12T16:13:56.111 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4883.gd61b0886.el9.noa 12/12 2024-09-12T16:13:56.139 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-12T16:13:56.140 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-12T16:13:56.768 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-12T16:13:56.845 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-12T16:13:56.889 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-12T16:13:56.936 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-12T16:13:56.965 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-12T16:13:57.061 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-12T16:13:57.197 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-12T16:13:57.289 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-12T16:13:57.338 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-12T16:13:57.365 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-12T16:13:57.398 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4883.gd61b0886.el9 10/12 2024-09-12T16:13:58.121 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4883.gd61b0886.el9.noa 12/12 2024-09-12T16:13:58.121 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4883.gd61b0886.el 1/12 2024-09-12T16:13:58.121 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4883.gd61b0886.el9.noa 2/12 2024-09-12T16:13:58.121 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4883.gd61b0886.el9 3/12 2024-09-12T16:13:58.121 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-12T16:13:58.121 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-12T16:13:58.121 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-12T16:13:58.121 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-12T16:13:58.121 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-12T16:13:58.121 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-12T16:13:58.122 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-12T16:13:58.122 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-12T16:13:58.139 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4883.gd61b0886.el 11/12 2024-09-12T16:13:58.190 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4883.gd61b0886.el9.noa 12/12 2024-09-12T16:13:58.445 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-12T16:13:58.445 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:13:58.445 INFO:teuthology.orchestra.run.smithi204.stdout:Installed: 2024-09-12T16:13:58.445 INFO:teuthology.orchestra.run.smithi204.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T16:13:58.445 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-grafana-dashboards-2:19.3.0-4883.gd61b0886.el9.noarch 2024-09-12T16:13:58.445 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-dashboard-2:19.3.0-4883.gd61b0886.el9.noarch 2024-09-12T16:13:58.445 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-prometheus-alerts-2:19.3.0-4883.gd61b0886.el9.noarch 2024-09-12T16:13:58.445 INFO:teuthology.orchestra.run.smithi204.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T16:13:58.445 INFO:teuthology.orchestra.run.smithi204.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T16:13:58.446 INFO:teuthology.orchestra.run.smithi204.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T16:13:58.446 INFO:teuthology.orchestra.run.smithi204.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T16:13:58.446 INFO:teuthology.orchestra.run.smithi204.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T16:13:58.446 INFO:teuthology.orchestra.run.smithi204.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T16:13:58.446 INFO:teuthology.orchestra.run.smithi204.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T16:13:58.446 INFO:teuthology.orchestra.run.smithi204.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T16:13:58.446 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:13:58.446 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-09-12T16:13:58.717 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-12T16:13:59.284 INFO:teuthology.orchestra.run.smithi204.stdout:Last metadata expiration check: 0:01:09 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:13:59.419 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-09-12T16:13:59.420 INFO:teuthology.orchestra.run.smithi204.stdout:======================================================================================= 2024-09-12T16:13:59.420 INFO:teuthology.orchestra.run.smithi204.stdout: Package Arch Version Repository Size 2024-09-12T16:13:59.420 INFO:teuthology.orchestra.run.smithi204.stdout:======================================================================================= 2024-09-12T16:13:59.420 INFO:teuthology.orchestra.run.smithi204.stdout:Installing: 2024-09-12T16:13:59.420 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4883.gd61b0886.el9 ceph-noarch 7.4 M 2024-09-12T16:13:59.420 INFO:teuthology.orchestra.run.smithi204.stdout:Installing dependencies: 2024-09-12T16:13:59.420 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T16:13:59.421 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T16:13:59.421 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T16:13:59.421 INFO:teuthology.orchestra.run.smithi204.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T16:13:59.421 INFO:teuthology.orchestra.run.smithi204.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T16:13:59.421 INFO:teuthology.orchestra.run.smithi204.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T16:13:59.421 INFO:teuthology.orchestra.run.smithi204.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T16:13:59.421 INFO:teuthology.orchestra.run.smithi204.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T16:13:59.421 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T16:13:59.421 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T16:13:59.421 INFO:teuthology.orchestra.run.smithi204.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T16:13:59.421 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:13:59.422 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction Summary 2024-09-12T16:13:59.422 INFO:teuthology.orchestra.run.smithi204.stdout:======================================================================================= 2024-09-12T16:13:59.422 INFO:teuthology.orchestra.run.smithi204.stdout:Install 12 Packages 2024-09-12T16:13:59.422 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:13:59.422 INFO:teuthology.orchestra.run.smithi204.stdout:Total download size: 38 M 2024-09-12T16:13:59.422 INFO:teuthology.orchestra.run.smithi204.stdout:Installed size: 212 M 2024-09-12T16:13:59.423 INFO:teuthology.orchestra.run.smithi204.stdout:Downloading Packages: 2024-09-12T16:14:00.118 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4883.gd61b0886.el9.noa 12/12 2024-09-12T16:14:00.118 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4883.gd61b0886.el 1/12 2024-09-12T16:14:00.118 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4883.gd61b0886.el9.noa 2/12 2024-09-12T16:14:00.118 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4883.gd61b0886.el9 3/12 2024-09-12T16:14:00.118 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-12T16:14:00.118 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-12T16:14:00.118 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-12T16:14:00.119 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-12T16:14:00.119 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-12T16:14:00.119 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-12T16:14:00.119 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-12T16:14:00.119 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-12T16:14:00.285 INFO:teuthology.orchestra.run.smithi204.stdout:(1/12): ceph-mgr-diskprediction-local-19.3.0-48 9.6 MB/s | 7.4 MB 00:00 2024-09-12T16:14:00.310 INFO:teuthology.orchestra.run.smithi204.stdout:(2/12): libquadmath-11.5.0-2.el9.x86_64.rpm 241 kB/s | 191 kB 00:00 2024-09-12T16:14:00.411 INFO:teuthology.orchestra.run.smithi204.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 261 kB/s | 33 kB 00:00 2024-09-12T16:14:00.436 INFO:teuthology.orchestra.run.smithi204.stdout:(4/12): libgfortran-11.5.0-2.el9.x86_64.rpm 871 kB/s | 801 kB 00:00 2024-09-12T16:14:00.453 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-12T16:14:00.453 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:00.453 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-12T16:14:00.453 INFO:teuthology.orchestra.run.smithi017.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T16:14:00.453 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-grafana-dashboards-2:19.3.0-4883.gd61b0886.el9.noarch 2024-09-12T16:14:00.453 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard-2:19.3.0-4883.gd61b0886.el9.noarch 2024-09-12T16:14:00.453 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-prometheus-alerts-2:19.3.0-4883.gd61b0886.el9.noarch 2024-09-12T16:14:00.453 INFO:teuthology.orchestra.run.smithi017.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T16:14:00.453 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T16:14:00.454 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T16:14:00.454 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T16:14:00.454 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T16:14:00.454 INFO:teuthology.orchestra.run.smithi017.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T16:14:00.454 INFO:teuthology.orchestra.run.smithi017.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T16:14:00.454 INFO:teuthology.orchestra.run.smithi017.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T16:14:00.454 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:00.454 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-12T16:14:00.461 INFO:teuthology.orchestra.run.smithi204.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 362 kB/s | 18 kB 00:00 2024-09-12T16:14:00.545 INFO:teuthology.orchestra.run.smithi204.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 355 kB/s | 38 kB 00:00 2024-09-12T16:14:00.662 INFO:teuthology.orchestra.run.smithi204.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.1 MB/s | 245 kB 00:00 2024-09-12T16:14:00.688 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-12T16:14:00.769 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4883.gd61b0886.el 11/12 2024-09-12T16:14:00.835 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4883.gd61b0886.el9.noa 12/12 2024-09-12T16:14:01.229 INFO:teuthology.orchestra.run.smithi204.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.3 MB/s | 3.0 MB 00:00 2024-09-12T16:14:01.273 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:11 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:14:01.371 INFO:teuthology.orchestra.run.smithi204.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.7 MB/s | 250 kB 00:00 2024-09-12T16:14:01.412 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-12T16:14:01.413 INFO:teuthology.orchestra.run.smithi017.stdout:======================================================================================= 2024-09-12T16:14:01.413 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-09-12T16:14:01.413 INFO:teuthology.orchestra.run.smithi017.stdout:======================================================================================= 2024-09-12T16:14:01.413 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-12T16:14:01.414 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4883.gd61b0886.el9 ceph-noarch 7.4 M 2024-09-12T16:14:01.414 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-09-12T16:14:01.414 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T16:14:01.414 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T16:14:01.414 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T16:14:01.414 INFO:teuthology.orchestra.run.smithi017.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T16:14:01.414 INFO:teuthology.orchestra.run.smithi017.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T16:14:01.414 INFO:teuthology.orchestra.run.smithi017.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T16:14:01.414 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T16:14:01.414 INFO:teuthology.orchestra.run.smithi017.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T16:14:01.414 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T16:14:01.414 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T16:14:01.414 INFO:teuthology.orchestra.run.smithi017.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T16:14:01.415 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:01.415 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-12T16:14:01.415 INFO:teuthology.orchestra.run.smithi017.stdout:======================================================================================= 2024-09-12T16:14:01.415 INFO:teuthology.orchestra.run.smithi017.stdout:Install 12 Packages 2024-09-12T16:14:01.415 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:01.416 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 38 M 2024-09-12T16:14:01.416 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 212 M 2024-09-12T16:14:01.416 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-12T16:14:01.939 INFO:teuthology.orchestra.run.smithi017.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 868 kB/s | 191 kB 00:00 2024-09-12T16:14:01.998 INFO:teuthology.orchestra.run.smithi017.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 801 kB 00:00 2024-09-12T16:14:02.073 INFO:teuthology.orchestra.run.smithi017.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 245 kB/s | 33 kB 00:00 2024-09-12T16:14:02.123 INFO:teuthology.orchestra.run.smithi017.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 364 kB/s | 18 kB 00:00 2024-09-12T16:14:02.174 INFO:teuthology.orchestra.run.smithi017.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 769 kB/s | 38 kB 00:00 2024-09-12T16:14:02.221 INFO:teuthology.orchestra.run.smithi204.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 2.8 MB/s | 4.9 MB 00:01 2024-09-12T16:14:02.524 INFO:teuthology.orchestra.run.smithi017.stdout:(6/12): ceph-mgr-diskprediction-local-19.3.0-48 9.2 MB/s | 7.4 MB 00:00 2024-09-12T16:14:02.599 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4883.gd61b0886.el9.noa 12/12 2024-09-12T16:14:02.599 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4883.gd61b0886.el 1/12 2024-09-12T16:14:02.599 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4883.gd61b0886.el9.noa 2/12 2024-09-12T16:14:02.599 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4883.gd61b0886.el9 3/12 2024-09-12T16:14:02.599 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-12T16:14:02.599 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-12T16:14:02.599 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-12T16:14:02.599 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-12T16:14:02.599 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-12T16:14:02.600 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-12T16:14:02.600 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-12T16:14:02.600 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-12T16:14:02.663 INFO:teuthology.orchestra.run.smithi204.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.5 MB/s | 5.1 MB 00:02 2024-09-12T16:14:02.758 INFO:teuthology.orchestra.run.smithi017.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.0 MB/s | 245 kB 00:00 2024-09-12T16:14:02.924 INFO:teuthology.orchestra.run.smithi017.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.2 MB/s | 3.0 MB 00:00 2024-09-12T16:14:02.941 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-12T16:14:02.941 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:02.941 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-12T16:14:02.941 INFO:teuthology.orchestra.run.smithi047.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T16:14:02.941 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-grafana-dashboards-2:19.3.0-4883.gd61b0886.el9.noarch 2024-09-12T16:14:02.941 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard-2:19.3.0-4883.gd61b0886.el9.noarch 2024-09-12T16:14:02.941 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-prometheus-alerts-2:19.3.0-4883.gd61b0886.el9.noarch 2024-09-12T16:14:02.941 INFO:teuthology.orchestra.run.smithi047.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T16:14:02.941 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T16:14:02.941 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T16:14:02.941 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T16:14:02.942 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T16:14:02.942 INFO:teuthology.orchestra.run.smithi047.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T16:14:02.942 INFO:teuthology.orchestra.run.smithi047.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T16:14:02.942 INFO:teuthology.orchestra.run.smithi047.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T16:14:02.942 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:02.942 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T16:14:03.066 INFO:teuthology.orchestra.run.smithi017.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.7 MB/s | 250 kB 00:00 2024-09-12T16:14:03.186 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-12T16:14:03.777 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:11 ago on Thu 12 Sep 2024 04:12:52 PM UTC. 2024-09-12T16:14:03.900 INFO:teuthology.orchestra.run.smithi017.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 2.9 MB/s | 4.9 MB 00:01 2024-09-12T16:14:03.917 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T16:14:03.919 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================= 2024-09-12T16:14:03.919 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-09-12T16:14:03.919 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================= 2024-09-12T16:14:03.919 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-12T16:14:03.919 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4883.gd61b0886.el9 ceph-noarch 7.4 M 2024-09-12T16:14:03.919 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-12T16:14:03.919 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T16:14:03.919 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T16:14:03.919 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T16:14:03.919 INFO:teuthology.orchestra.run.smithi047.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T16:14:03.919 INFO:teuthology.orchestra.run.smithi047.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T16:14:03.919 INFO:teuthology.orchestra.run.smithi047.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T16:14:03.920 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T16:14:03.920 INFO:teuthology.orchestra.run.smithi047.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T16:14:03.920 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T16:14:03.920 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T16:14:03.920 INFO:teuthology.orchestra.run.smithi047.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T16:14:03.920 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:03.920 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-12T16:14:03.920 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================= 2024-09-12T16:14:03.920 INFO:teuthology.orchestra.run.smithi047.stdout:Install 12 Packages 2024-09-12T16:14:03.920 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:03.921 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 38 M 2024-09-12T16:14:03.921 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 212 M 2024-09-12T16:14:03.921 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-12T16:14:04.384 INFO:teuthology.orchestra.run.smithi047.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 191 kB 00:00 2024-09-12T16:14:04.425 INFO:teuthology.orchestra.run.smithi047.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.4 MB/s | 801 kB 00:00 2024-09-12T16:14:04.517 INFO:teuthology.orchestra.run.smithi047.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 246 kB/s | 33 kB 00:00 2024-09-12T16:14:04.617 INFO:teuthology.orchestra.run.smithi017.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.7 MB/s | 5.1 MB 00:01 2024-09-12T16:14:04.626 INFO:teuthology.orchestra.run.smithi047.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 15 MB/s | 3.0 MB 00:00 2024-09-12T16:14:04.643 INFO:teuthology.orchestra.run.smithi047.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 145 kB/s | 18 kB 00:00 2024-09-12T16:14:04.702 INFO:teuthology.orchestra.run.smithi047.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 510 kB/s | 38 kB 00:00 2024-09-12T16:14:04.802 INFO:teuthology.orchestra.run.smithi047.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-12T16:14:04.902 INFO:teuthology.orchestra.run.smithi047.stdout:(8/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 19 MB/s | 4.9 MB 00:00 2024-09-12T16:14:05.011 INFO:teuthology.orchestra.run.smithi047.stdout:(9/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 24 MB/s | 5.1 MB 00:00 2024-09-12T16:14:05.036 INFO:teuthology.orchestra.run.smithi047.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 1.8 MB/s | 250 kB 00:00 2024-09-12T16:14:05.203 INFO:teuthology.orchestra.run.smithi047.stdout:(11/12): ceph-mgr-diskprediction-local-19.3.0-4 7.7 MB/s | 7.4 MB 00:00 2024-09-12T16:14:05.462 INFO:teuthology.orchestra.run.smithi047.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 36 MB/s | 16 MB 00:00 2024-09-12T16:14:05.463 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:14:05.463 INFO:teuthology.orchestra.run.smithi047.stdout:Total 25 MB/s | 38 MB 00:01 2024-09-12T16:14:05.829 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-12T16:14:05.856 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-12T16:14:05.857 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-12T16:14:06.313 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-12T16:14:06.313 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-12T16:14:07.126 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-12T16:14:07.201 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-12T16:14:07.248 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-12T16:14:07.348 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-12T16:14:07.386 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-12T16:14:07.580 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-12T16:14:07.610 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-12T16:14:07.690 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-12T16:14:08.380 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-12T16:14:08.503 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-12T16:14:08.641 INFO:teuthology.orchestra.run.smithi017.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 2.9 MB/s | 16 MB 00:05 2024-09-12T16:14:08.642 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:14:08.643 INFO:teuthology.orchestra.run.smithi017.stdout:Total 5.3 MB/s | 38 MB 00:07 2024-09-12T16:14:09.009 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-12T16:14:09.036 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-12T16:14:09.036 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-12T16:14:09.129 INFO:teuthology.orchestra.run.smithi204.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 2.1 MB/s | 16 MB 00:07 2024-09-12T16:14:09.130 INFO:teuthology.orchestra.run.smithi204.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:14:09.130 INFO:teuthology.orchestra.run.smithi204.stdout:Total 3.9 MB/s | 38 MB 00:09 2024-09-12T16:14:09.487 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-12T16:14:09.487 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-12T16:14:09.490 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction check 2024-09-12T16:14:09.517 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction check succeeded. 2024-09-12T16:14:09.517 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction test 2024-09-12T16:14:09.830 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-12T16:14:09.947 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction test succeeded. 2024-09-12T16:14:09.947 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction 2024-09-12T16:14:10.275 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-12T16:14:10.348 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-12T16:14:10.394 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-12T16:14:10.494 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-12T16:14:10.541 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-12T16:14:10.710 INFO:teuthology.orchestra.run.smithi204.stdout: Preparing : 1/1 2024-09-12T16:14:10.734 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-12T16:14:10.764 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-12T16:14:10.772 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-12T16:14:10.815 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-12T16:14:10.852 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-12T16:14:10.915 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-12T16:14:10.924 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-12T16:14:10.953 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-12T16:14:10.959 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4883.gd61b0 12/12 2024-09-12T16:14:11.140 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-12T16:14:11.177 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-12T16:14:11.254 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-12T16:14:11.561 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-12T16:14:11.691 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-12T16:14:11.903 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-12T16:14:12.017 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-12T16:14:13.013 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-12T16:14:13.256 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-12T16:14:13.407 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4883.gd61b0 12/12 2024-09-12T16:14:13.407 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4883.gd61b0 1/12 2024-09-12T16:14:13.407 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-12T16:14:13.407 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-12T16:14:13.407 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-12T16:14:13.407 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-12T16:14:13.407 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-12T16:14:13.407 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-12T16:14:13.407 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-12T16:14:13.407 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-12T16:14:13.407 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-12T16:14:13.407 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-12T16:14:13.823 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-12T16:14:13.823 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:13.823 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-12T16:14:13.823 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4883.gd61b0886.el9.noarch 2024-09-12T16:14:13.823 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T16:14:13.823 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T16:14:13.823 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T16:14:13.823 INFO:teuthology.orchestra.run.smithi047.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T16:14:13.824 INFO:teuthology.orchestra.run.smithi047.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T16:14:13.824 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T16:14:13.824 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T16:14:13.824 INFO:teuthology.orchestra.run.smithi047.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T16:14:13.824 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T16:14:13.824 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T16:14:13.824 INFO:teuthology.orchestra.run.smithi047.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T16:14:13.824 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:13.824 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T16:14:14.110 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-12T16:14:14.139 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4883.gd61b0 12/12 2024-09-12T16:14:14.160 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-mgr-rook 2024-09-12T16:14:14.316 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-12T16:14:14.344 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4883.gd61b0 12/12 2024-09-12T16:14:14.754 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:22 ago on Thu 12 Sep 2024 04:12:52 PM UTC. 2024-09-12T16:14:14.891 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T16:14:14.893 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:14:14.893 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-09-12T16:14:14.893 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:14:14.893 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-12T16:14:14.893 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-rook noarch 2:19.3.0-4883.gd61b0886.el9 ceph-noarch 49 k 2024-09-12T16:14:14.893 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-12T16:14:14.893 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T16:14:14.894 INFO:teuthology.orchestra.run.smithi047.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T16:14:14.894 INFO:teuthology.orchestra.run.smithi047.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T16:14:14.894 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T16:14:14.894 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T16:14:14.894 INFO:teuthology.orchestra.run.smithi047.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T16:14:14.894 INFO:teuthology.orchestra.run.smithi047.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T16:14:14.894 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T16:14:14.894 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T16:14:14.894 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T16:14:14.894 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T16:14:14.894 INFO:teuthology.orchestra.run.smithi047.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T16:14:14.894 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:14.894 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-12T16:14:14.894 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:14:14.895 INFO:teuthology.orchestra.run.smithi047.stdout:Install 13 Packages 2024-09-12T16:14:14.895 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:14.895 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 2.2 M 2024-09-12T16:14:14.895 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 26 M 2024-09-12T16:14:14.895 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-12T16:14:15.435 INFO:teuthology.orchestra.run.smithi047.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 177 kB/s | 19 kB 00:00 2024-09-12T16:14:15.460 INFO:teuthology.orchestra.run.smithi047.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 192 kB/s | 26 kB 00:00 2024-09-12T16:14:15.485 INFO:teuthology.orchestra.run.smithi047.stdout:(3/13): ceph-mgr-rook-19.3.0-4883.gd61b0886.el9 311 kB/s | 49 kB 00:00 2024-09-12T16:14:15.527 INFO:teuthology.orchestra.run.smithi047.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.4 MB/s | 222 kB 00:00 2024-09-12T16:14:15.569 INFO:teuthology.orchestra.run.smithi047.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-12T16:14:15.603 INFO:teuthology.orchestra.run.smithi047.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 713 kB/s | 54 kB 00:00 2024-09-12T16:14:15.637 INFO:teuthology.orchestra.run.smithi047.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 480 kB/s | 32 kB 00:00 2024-09-12T16:14:15.662 INFO:teuthology.orchestra.run.smithi047.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.5 MB/s | 279 kB 00:00 2024-09-12T16:14:15.687 INFO:teuthology.orchestra.run.smithi047.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 172 kB/s | 14 kB 00:00 2024-09-12T16:14:15.721 INFO:teuthology.orchestra.run.smithi047.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T16:14:15.746 INFO:teuthology.orchestra.run.smithi047.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 2.0 MB/s | 220 kB 00:00 2024-09-12T16:14:15.779 INFO:teuthology.orchestra.run.smithi047.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.6 MB/s | 90 kB 00:00 2024-09-12T16:14:15.821 INFO:teuthology.orchestra.run.smithi047.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.4 MB/s | 1.0 MB 00:00 2024-09-12T16:14:15.824 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:14:15.824 INFO:teuthology.orchestra.run.smithi047.stdout:Total 2.4 MB/s | 2.2 MB 00:00 2024-09-12T16:14:15.891 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-12T16:14:15.907 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-12T16:14:15.907 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-12T16:14:16.004 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-12T16:14:16.005 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-12T16:14:16.520 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-12T16:14:16.687 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-12T16:14:16.729 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4883.gd61b0 12/12 2024-09-12T16:14:16.729 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4883.gd61b0 1/12 2024-09-12T16:14:16.729 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-12T16:14:16.729 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-12T16:14:16.729 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-12T16:14:16.730 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-12T16:14:16.730 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-12T16:14:16.730 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-12T16:14:16.730 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-12T16:14:16.730 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-12T16:14:16.730 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-12T16:14:16.730 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-12T16:14:16.749 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-12T16:14:16.805 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-12T16:14:16.841 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-12T16:14:16.882 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-12T16:14:16.989 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-12T16:14:17.086 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4883.gd61b0 12/12 2024-09-12T16:14:17.087 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4883.gd61b0 1/12 2024-09-12T16:14:17.087 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-12T16:14:17.087 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-12T16:14:17.087 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-12T16:14:17.087 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-12T16:14:17.087 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-12T16:14:17.087 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-12T16:14:17.087 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-12T16:14:17.087 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-12T16:14:17.088 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-12T16:14:17.088 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-12T16:14:17.098 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-12T16:14:17.136 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-12T16:14:17.136 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:17.136 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-12T16:14:17.136 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4883.gd61b0886.el9.noarch 2024-09-12T16:14:17.137 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T16:14:17.137 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T16:14:17.137 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T16:14:17.137 INFO:teuthology.orchestra.run.smithi017.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T16:14:17.137 INFO:teuthology.orchestra.run.smithi017.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T16:14:17.137 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T16:14:17.137 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T16:14:17.137 INFO:teuthology.orchestra.run.smithi017.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T16:14:17.137 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T16:14:17.137 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T16:14:17.137 INFO:teuthology.orchestra.run.smithi017.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T16:14:17.138 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:17.138 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-12T16:14:17.168 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-12T16:14:17.530 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-mgr-rook 2024-09-12T16:14:17.537 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-12T16:14:17.537 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:17.537 INFO:teuthology.orchestra.run.smithi204.stdout:Installed: 2024-09-12T16:14:17.537 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4883.gd61b0886.el9.noarch 2024-09-12T16:14:17.537 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T16:14:17.537 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T16:14:17.537 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T16:14:17.537 INFO:teuthology.orchestra.run.smithi204.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T16:14:17.537 INFO:teuthology.orchestra.run.smithi204.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T16:14:17.538 INFO:teuthology.orchestra.run.smithi204.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T16:14:17.538 INFO:teuthology.orchestra.run.smithi204.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T16:14:17.538 INFO:teuthology.orchestra.run.smithi204.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T16:14:17.538 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T16:14:17.538 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T16:14:17.538 INFO:teuthology.orchestra.run.smithi204.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T16:14:17.538 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:17.538 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-09-12T16:14:17.929 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-12T16:14:17.932 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum -y install ceph-mgr-rook 2024-09-12T16:14:17.973 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-12T16:14:18.006 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-12T16:14:18.055 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-12T16:14:18.084 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-rook-2:19.3.0-4883.gd61b0886.el9.noarch 13/13 2024-09-12T16:14:18.131 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:28 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:14:18.274 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-12T16:14:18.275 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:14:18.275 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-09-12T16:14:18.275 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:14:18.276 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-12T16:14:18.276 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-rook noarch 2:19.3.0-4883.gd61b0886.el9 ceph-noarch 49 k 2024-09-12T16:14:18.276 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-09-12T16:14:18.276 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T16:14:18.276 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T16:14:18.276 INFO:teuthology.orchestra.run.smithi017.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T16:14:18.276 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T16:14:18.276 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T16:14:18.276 INFO:teuthology.orchestra.run.smithi017.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T16:14:18.276 INFO:teuthology.orchestra.run.smithi017.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T16:14:18.276 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T16:14:18.276 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T16:14:18.276 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T16:14:18.277 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T16:14:18.277 INFO:teuthology.orchestra.run.smithi017.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T16:14:18.277 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:18.277 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-12T16:14:18.277 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:14:18.277 INFO:teuthology.orchestra.run.smithi017.stdout:Install 13 Packages 2024-09-12T16:14:18.277 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:18.277 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 2.2 M 2024-09-12T16:14:18.278 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 26 M 2024-09-12T16:14:18.278 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-12T16:14:18.513 INFO:teuthology.orchestra.run.smithi204.stdout:Last metadata expiration check: 0:01:28 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:14:18.647 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-09-12T16:14:18.649 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:14:18.649 INFO:teuthology.orchestra.run.smithi204.stdout: Package Arch Version Repository Size 2024-09-12T16:14:18.649 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:14:18.649 INFO:teuthology.orchestra.run.smithi204.stdout:Installing: 2024-09-12T16:14:18.649 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-rook noarch 2:19.3.0-4883.gd61b0886.el9 ceph-noarch 49 k 2024-09-12T16:14:18.649 INFO:teuthology.orchestra.run.smithi204.stdout:Installing dependencies: 2024-09-12T16:14:18.649 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T16:14:18.649 INFO:teuthology.orchestra.run.smithi204.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T16:14:18.649 INFO:teuthology.orchestra.run.smithi204.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T16:14:18.649 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T16:14:18.649 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T16:14:18.649 INFO:teuthology.orchestra.run.smithi204.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T16:14:18.649 INFO:teuthology.orchestra.run.smithi204.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T16:14:18.650 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T16:14:18.650 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T16:14:18.650 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T16:14:18.650 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T16:14:18.650 INFO:teuthology.orchestra.run.smithi204.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T16:14:18.650 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:18.650 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction Summary 2024-09-12T16:14:18.650 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:14:18.650 INFO:teuthology.orchestra.run.smithi204.stdout:Install 13 Packages 2024-09-12T16:14:18.650 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:18.651 INFO:teuthology.orchestra.run.smithi204.stdout:Total download size: 2.2 M 2024-09-12T16:14:18.651 INFO:teuthology.orchestra.run.smithi204.stdout:Installed size: 26 M 2024-09-12T16:14:18.651 INFO:teuthology.orchestra.run.smithi204.stdout:Downloading Packages: 2024-09-12T16:14:18.852 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4883.gd61b0886.el9.noarch 13/13 2024-09-12T16:14:18.852 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4883.gd61b0886.el9.noarch 1/13 2024-09-12T16:14:18.852 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-12T16:14:18.852 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-12T16:14:18.852 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-12T16:14:18.852 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-12T16:14:18.852 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-12T16:14:18.852 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-12T16:14:18.853 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-12T16:14:18.853 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-12T16:14:18.853 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-12T16:14:18.853 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-12T16:14:18.853 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-12T16:14:18.954 INFO:teuthology.orchestra.run.smithi204.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 337 kB/s | 26 kB 00:00 2024-09-12T16:14:18.970 INFO:teuthology.orchestra.run.smithi204.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 207 kB/s | 19 kB 00:00 2024-09-12T16:14:19.031 INFO:teuthology.orchestra.run.smithi017.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 64 kB/s | 19 kB 00:00 2024-09-12T16:14:19.045 INFO:teuthology.orchestra.run.smithi204.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.9 MB/s | 222 kB 00:00 2024-09-12T16:14:19.056 INFO:teuthology.orchestra.run.smithi017.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 79 kB/s | 26 kB 00:00 2024-09-12T16:14:19.071 INFO:teuthology.orchestra.run.smithi204.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 159 kB 00:00 2024-09-12T16:14:19.096 INFO:teuthology.orchestra.run.smithi204.stdout:(5/13): ceph-mgr-rook-19.3.0-4883.gd61b0886.el9 225 kB/s | 49 kB 00:00 2024-09-12T16:14:19.121 INFO:teuthology.orchestra.run.smithi204.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-12T16:14:19.155 INFO:teuthology.orchestra.run.smithi204.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.5 MB/s | 279 kB 00:00 2024-09-12T16:14:19.206 INFO:teuthology.orchestra.run.smithi204.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 295 kB/s | 32 kB 00:00 2024-09-12T16:14:19.215 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-12T16:14:19.215 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:19.215 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-12T16:14:19.215 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-rook-2:19.3.0-4883.gd61b0886.el9.noarch 2024-09-12T16:14:19.215 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T16:14:19.215 INFO:teuthology.orchestra.run.smithi047.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T16:14:19.215 INFO:teuthology.orchestra.run.smithi047.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T16:14:19.215 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T16:14:19.215 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T16:14:19.215 INFO:teuthology.orchestra.run.smithi047.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T16:14:19.216 INFO:teuthology.orchestra.run.smithi047.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T16:14:19.216 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T16:14:19.216 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T16:14:19.216 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T16:14:19.216 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T16:14:19.216 INFO:teuthology.orchestra.run.smithi047.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T16:14:19.216 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:19.216 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T16:14:19.231 INFO:teuthology.orchestra.run.smithi204.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 129 kB/s | 14 kB 00:00 2024-09-12T16:14:19.256 INFO:teuthology.orchestra.run.smithi204.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T16:14:19.281 INFO:teuthology.orchestra.run.smithi204.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 1.9 MB/s | 220 kB 00:00 2024-09-12T16:14:19.306 INFO:teuthology.orchestra.run.smithi204.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2024-09-12T16:14:19.340 INFO:teuthology.orchestra.run.smithi204.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.7 MB/s | 1.0 MB 00:00 2024-09-12T16:14:19.343 INFO:teuthology.orchestra.run.smithi204.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:14:19.343 INFO:teuthology.orchestra.run.smithi204.stdout:Total 3.2 MB/s | 2.2 MB 00:00 2024-09-12T16:14:19.408 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction check 2024-09-12T16:14:19.423 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction check succeeded. 2024-09-12T16:14:19.423 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction test 2024-09-12T16:14:19.440 INFO:teuthology.orchestra.run.smithi017.stdout:(3/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 414 kB/s | 159 kB 00:00 2024-09-12T16:14:19.478 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-mgr-cephadm 2024-09-12T16:14:19.490 INFO:teuthology.orchestra.run.smithi017.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 484 kB/s | 222 kB 00:00 2024-09-12T16:14:19.511 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction test succeeded. 2024-09-12T16:14:19.513 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction 2024-09-12T16:14:19.599 INFO:teuthology.orchestra.run.smithi017.stdout:(5/13): python3-requests-oauthlib-1.3.0-12.el9. 494 kB/s | 54 kB 00:00 2024-09-12T16:14:19.649 INFO:teuthology.orchestra.run.smithi017.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.3 MB/s | 279 kB 00:00 2024-09-12T16:14:19.674 INFO:teuthology.orchestra.run.smithi017.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 428 kB/s | 32 kB 00:00 2024-09-12T16:14:19.708 INFO:teuthology.orchestra.run.smithi017.stdout:(8/13): python3-google-auth-2.34.0-1.el9.noarch 8.2 MB/s | 220 kB 00:00 2024-09-12T16:14:19.724 INFO:teuthology.orchestra.run.smithi017.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 187 kB/s | 14 kB 00:00 2024-09-12T16:14:19.741 INFO:teuthology.orchestra.run.smithi017.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-09-12T16:14:19.767 INFO:teuthology.orchestra.run.smithi017.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.5 MB/s | 90 kB 00:00 2024-09-12T16:14:19.800 INFO:teuthology.orchestra.run.smithi017.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 11 MB/s | 1.0 MB 00:00 2024-09-12T16:14:20.019 INFO:teuthology.orchestra.run.smithi204.stdout: Preparing : 1/1 2024-09-12T16:14:20.069 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:28 ago on Thu 12 Sep 2024 04:12:52 PM UTC. 2024-09-12T16:14:20.198 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-12T16:14:20.208 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T16:14:20.209 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:14:20.209 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-09-12T16:14:20.209 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:14:20.209 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-12T16:14:20.210 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4883.gd61b0886.el9 ceph-noarch 154 k 2024-09-12T16:14:20.210 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-12T16:14:20.210 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T16:14:20.210 INFO:teuthology.orchestra.run.smithi047.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T16:14:20.210 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T16:14:20.210 INFO:teuthology.orchestra.run.smithi047.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T16:14:20.210 INFO:teuthology.orchestra.run.smithi047.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T16:14:20.210 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:20.210 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-12T16:14:20.210 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:14:20.210 INFO:teuthology.orchestra.run.smithi047.stdout:Install 6 Packages 2024-09-12T16:14:20.210 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:20.211 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 7.0 M 2024-09-12T16:14:20.211 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 33 M 2024-09-12T16:14:20.211 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-12T16:14:20.258 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-12T16:14:20.340 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-12T16:14:20.376 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-12T16:14:20.418 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-12T16:14:20.521 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-12T16:14:20.623 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-12T16:14:20.678 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-12T16:14:20.956 INFO:teuthology.orchestra.run.smithi047.stdout:(1/6): ceph-mgr-cephadm-19.3.0-4883.gd61b0886.e 747 kB/s | 154 kB 00:00 2024-09-12T16:14:21.006 INFO:teuthology.orchestra.run.smithi047.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-12T16:14:21.032 INFO:teuthology.orchestra.run.smithi047.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-12T16:14:21.057 INFO:teuthology.orchestra.run.smithi047.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-12T16:14:21.382 INFO:teuthology.orchestra.run.smithi047.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 392 kB/s | 248 kB 00:00 2024-09-12T16:14:21.413 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-12T16:14:21.450 INFO:teuthology.orchestra.run.smithi017.stdout:(13/13): ceph-mgr-rook-19.3.0-4883.gd61b0886.el 18 kB/s | 49 kB 00:02 2024-09-12T16:14:21.453 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:14:21.453 INFO:teuthology.orchestra.run.smithi017.stdout:Total 714 kB/s | 2.2 MB 00:03 2024-09-12T16:14:21.467 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-12T16:14:21.501 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-12T16:14:21.525 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-12T16:14:21.542 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-12T16:14:21.542 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-12T16:14:21.549 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-12T16:14:21.578 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-rook-2:19.3.0-4883.gd61b0886.el9.noarch 13/13 2024-09-12T16:14:21.642 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-12T16:14:21.642 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-12T16:14:22.165 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-12T16:14:22.350 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-12T16:14:22.356 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4883.gd61b0886.el9.noarch 13/13 2024-09-12T16:14:22.356 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4883.gd61b0886.el9.noarch 1/13 2024-09-12T16:14:22.356 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-12T16:14:22.356 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-12T16:14:22.356 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-12T16:14:22.356 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-12T16:14:22.356 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-12T16:14:22.356 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-12T16:14:22.356 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-12T16:14:22.356 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-12T16:14:22.356 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-12T16:14:22.356 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-12T16:14:22.357 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-12T16:14:22.403 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-12T16:14:22.460 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-12T16:14:22.495 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-12T16:14:22.537 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-12T16:14:22.653 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-12T16:14:22.692 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-12T16:14:22.692 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:22.692 INFO:teuthology.orchestra.run.smithi204.stdout:Installed: 2024-09-12T16:14:22.693 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-rook-2:19.3.0-4883.gd61b0886.el9.noarch 2024-09-12T16:14:22.693 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T16:14:22.693 INFO:teuthology.orchestra.run.smithi204.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T16:14:22.693 INFO:teuthology.orchestra.run.smithi204.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T16:14:22.693 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T16:14:22.693 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T16:14:22.693 INFO:teuthology.orchestra.run.smithi204.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T16:14:22.693 INFO:teuthology.orchestra.run.smithi204.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T16:14:22.693 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T16:14:22.693 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T16:14:22.693 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T16:14:22.693 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T16:14:22.693 INFO:teuthology.orchestra.run.smithi204.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T16:14:22.693 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:22.694 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-09-12T16:14:22.787 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-12T16:14:22.848 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-12T16:14:22.972 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum -y install ceph-mgr-cephadm 2024-09-12T16:14:23.374 INFO:teuthology.orchestra.run.smithi047.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 2.3 MB/s | 6.0 MB 00:02 2024-09-12T16:14:23.376 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:14:23.376 INFO:teuthology.orchestra.run.smithi047.stdout:Total 2.2 MB/s | 7.0 MB 00:03 2024-09-12T16:14:23.452 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-12T16:14:23.465 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-12T16:14:23.465 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-12T16:14:23.542 INFO:teuthology.orchestra.run.smithi204.stdout:Last metadata expiration check: 0:01:33 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:14:23.572 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-12T16:14:23.572 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-12T16:14:23.616 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-12T16:14:23.668 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-12T16:14:23.675 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-09-12T16:14:23.676 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:14:23.676 INFO:teuthology.orchestra.run.smithi204.stdout: Package Arch Version Repository Size 2024-09-12T16:14:23.676 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:14:23.676 INFO:teuthology.orchestra.run.smithi204.stdout:Installing: 2024-09-12T16:14:23.676 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4883.gd61b0886.el9 ceph-noarch 154 k 2024-09-12T16:14:23.676 INFO:teuthology.orchestra.run.smithi204.stdout:Installing dependencies: 2024-09-12T16:14:23.676 INFO:teuthology.orchestra.run.smithi204.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T16:14:23.676 INFO:teuthology.orchestra.run.smithi204.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T16:14:23.676 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T16:14:23.676 INFO:teuthology.orchestra.run.smithi204.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T16:14:23.677 INFO:teuthology.orchestra.run.smithi204.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T16:14:23.677 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:23.677 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction Summary 2024-09-12T16:14:23.677 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:14:23.677 INFO:teuthology.orchestra.run.smithi204.stdout:Install 6 Packages 2024-09-12T16:14:23.677 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:23.677 INFO:teuthology.orchestra.run.smithi204.stdout:Total download size: 7.0 M 2024-09-12T16:14:23.678 INFO:teuthology.orchestra.run.smithi204.stdout:Installed size: 33 M 2024-09-12T16:14:23.678 INFO:teuthology.orchestra.run.smithi204.stdout:Downloading Packages: 2024-09-12T16:14:23.702 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-12T16:14:23.751 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-12T16:14:23.780 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-rook-2:19.3.0-4883.gd61b0886.el9.noarch 13/13 2024-09-12T16:14:23.888 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-12T16:14:23.993 INFO:teuthology.orchestra.run.smithi204.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.0 MB/s | 248 kB 00:00 2024-09-12T16:14:24.052 INFO:teuthology.orchestra.run.smithi204.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 9.2 MB/s | 548 kB 00:00 2024-09-12T16:14:24.057 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-12T16:14:24.077 INFO:teuthology.orchestra.run.smithi204.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-12T16:14:24.102 INFO:teuthology.orchestra.run.smithi204.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-12T16:14:24.118 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-12T16:14:24.186 INFO:teuthology.orchestra.run.smithi204.stdout:(5/6): ceph-mgr-cephadm-19.3.0-4883.gd61b0886.e 361 kB/s | 154 kB 00:00 2024-09-12T16:14:24.550 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4883.gd61b0886.el9.noarch 13/13 2024-09-12T16:14:24.550 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4883.gd61b0886.el9.noarch 1/13 2024-09-12T16:14:24.551 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-12T16:14:24.551 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-12T16:14:24.551 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-12T16:14:24.551 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-12T16:14:24.551 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-12T16:14:24.551 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-12T16:14:24.552 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-12T16:14:24.552 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-12T16:14:24.552 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-12T16:14:24.552 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-12T16:14:24.552 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-12T16:14:24.680 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-12T16:14:24.774 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-12T16:14:24.850 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-12T16:14:24.888 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4883.gd61b0886.el9.noarch 6/6 2024-09-12T16:14:24.891 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-12T16:14:24.892 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:24.892 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-12T16:14:24.892 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-rook-2:19.3.0-4883.gd61b0886.el9.noarch 2024-09-12T16:14:24.892 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T16:14:24.892 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T16:14:24.892 INFO:teuthology.orchestra.run.smithi017.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T16:14:24.892 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T16:14:24.892 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T16:14:24.892 INFO:teuthology.orchestra.run.smithi017.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T16:14:24.892 INFO:teuthology.orchestra.run.smithi017.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T16:14:24.892 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T16:14:24.892 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T16:14:24.893 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T16:14:24.893 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T16:14:24.893 INFO:teuthology.orchestra.run.smithi017.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T16:14:24.893 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:24.893 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-12T16:14:25.138 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-mgr-cephadm 2024-09-12T16:14:25.599 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4883.gd61b0886.el9.noarch 6/6 2024-09-12T16:14:25.599 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4883.gd61b0886.el9.noarch 1/6 2024-09-12T16:14:25.599 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-12T16:14:25.599 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-12T16:14:25.600 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-12T16:14:25.600 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-12T16:14:25.731 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:35 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:14:25.872 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-12T16:14:25.872 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:14:25.873 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-09-12T16:14:25.873 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:14:25.873 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-12T16:14:25.873 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4883.gd61b0886.el9 ceph-noarch 154 k 2024-09-12T16:14:25.873 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-09-12T16:14:25.873 INFO:teuthology.orchestra.run.smithi017.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T16:14:25.873 INFO:teuthology.orchestra.run.smithi017.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T16:14:25.873 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T16:14:25.873 INFO:teuthology.orchestra.run.smithi017.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T16:14:25.873 INFO:teuthology.orchestra.run.smithi017.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T16:14:25.873 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:25.873 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-12T16:14:25.874 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:14:25.874 INFO:teuthology.orchestra.run.smithi017.stdout:Install 6 Packages 2024-09-12T16:14:25.874 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:25.874 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 7.0 M 2024-09-12T16:14:25.874 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 33 M 2024-09-12T16:14:25.874 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-12T16:14:25.888 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-12T16:14:25.888 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:25.888 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-12T16:14:25.888 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-cephadm-2:19.3.0-4883.gd61b0886.el9.noarch 2024-09-12T16:14:25.888 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T16:14:25.888 INFO:teuthology.orchestra.run.smithi047.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T16:14:25.888 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T16:14:25.888 INFO:teuthology.orchestra.run.smithi047.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T16:14:25.888 INFO:teuthology.orchestra.run.smithi047.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T16:14:25.888 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:25.889 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T16:14:26.123 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-fuse 2024-09-12T16:14:26.286 INFO:teuthology.orchestra.run.smithi204.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 2.4 MB/s | 6.0 MB 00:02 2024-09-12T16:14:26.288 INFO:teuthology.orchestra.run.smithi204.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:14:26.288 INFO:teuthology.orchestra.run.smithi204.stdout:Total 2.7 MB/s | 7.0 MB 00:02 2024-09-12T16:14:26.294 INFO:teuthology.orchestra.run.smithi017.stdout:(1/6): ceph-mgr-cephadm-19.3.0-4883.gd61b0886.e 686 kB/s | 154 kB 00:00 2024-09-12T16:14:26.344 INFO:teuthology.orchestra.run.smithi017.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-12T16:14:26.359 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction check 2024-09-12T16:14:26.361 INFO:teuthology.orchestra.run.smithi017.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 3.4 MB/s | 58 kB 00:00 2024-09-12T16:14:26.370 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction check succeeded. 2024-09-12T16:14:26.370 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction test 2024-09-12T16:14:26.387 INFO:teuthology.orchestra.run.smithi017.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-12T16:14:26.472 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction test succeeded. 2024-09-12T16:14:26.472 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction 2024-09-12T16:14:26.712 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:34 ago on Thu 12 Sep 2024 04:12:52 PM UTC. 2024-09-12T16:14:26.737 INFO:teuthology.orchestra.run.smithi017.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 372 kB/s | 248 kB 00:00 2024-09-12T16:14:26.789 INFO:teuthology.orchestra.run.smithi204.stdout: Preparing : 1/1 2024-09-12T16:14:26.852 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T16:14:26.853 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:14:26.853 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-09-12T16:14:26.853 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:14:26.853 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-12T16:14:26.853 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-fuse x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 900 k 2024-09-12T16:14:26.853 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-12T16:14:26.853 INFO:teuthology.orchestra.run.smithi047.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T16:14:26.853 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:26.853 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-12T16:14:26.853 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:14:26.854 INFO:teuthology.orchestra.run.smithi047.stdout:Install 2 Packages 2024-09-12T16:14:26.854 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:26.854 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 980 k 2024-09-12T16:14:26.854 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 2.9 M 2024-09-12T16:14:26.854 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-12T16:14:26.970 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-12T16:14:27.021 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-12T16:14:27.167 INFO:teuthology.orchestra.run.smithi047.stdout:(1/2): ceph-fuse-19.3.0-4883.gd61b0886.el9.x86_ 3.0 MB/s | 900 kB 00:00 2024-09-12T16:14:27.384 INFO:teuthology.orchestra.run.smithi047.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 157 kB/s | 80 kB 00:00 2024-09-12T16:14:27.385 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:14:27.385 INFO:teuthology.orchestra.run.smithi047.stdout:Total 1.8 MB/s | 980 kB 00:00 2024-09-12T16:14:27.398 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-12T16:14:27.422 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-12T16:14:27.422 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-12T16:14:27.509 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-12T16:14:27.510 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-12T16:14:27.549 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-12T16:14:27.632 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-12T16:14:27.701 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-12T16:14:27.705 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-12T16:14:27.733 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4883.gd61b0886.el9.noarch 6/6 2024-09-12T16:14:27.858 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-12T16:14:27.937 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-fuse-2:19.3.0-4883.gd61b0886.el9.x86_64 2/2 2024-09-12T16:14:28.506 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4883.gd61b0886.el9.noarch 6/6 2024-09-12T16:14:28.506 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4883.gd61b0886.el9.noarch 1/6 2024-09-12T16:14:28.507 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-12T16:14:28.507 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-12T16:14:28.507 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-12T16:14:28.507 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-12T16:14:28.572 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4883.gd61b0886.el9.x86_64 2/2 2024-09-12T16:14:28.572 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-fuse-2:19.3.0-4883.gd61b0886.el9.x86_64 1/2 2024-09-12T16:14:28.765 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-12T16:14:28.765 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:28.765 INFO:teuthology.orchestra.run.smithi204.stdout:Installed: 2024-09-12T16:14:28.765 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-cephadm-2:19.3.0-4883.gd61b0886.el9.noarch 2024-09-12T16:14:28.766 INFO:teuthology.orchestra.run.smithi204.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T16:14:28.766 INFO:teuthology.orchestra.run.smithi204.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T16:14:28.766 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T16:14:28.766 INFO:teuthology.orchestra.run.smithi204.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T16:14:28.766 INFO:teuthology.orchestra.run.smithi204.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T16:14:28.766 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:28.766 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-09-12T16:14:28.879 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-12T16:14:28.880 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:28.880 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-12T16:14:28.880 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-fuse-2:19.3.0-4883.gd61b0886.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-12T16:14:28.880 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:28.880 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T16:14:29.035 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum -y install ceph-fuse 2024-09-12T16:14:29.158 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-volume 2024-09-12T16:14:29.170 INFO:teuthology.orchestra.run.smithi017.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 1.9 MB/s | 6.0 MB 00:03 2024-09-12T16:14:29.172 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:14:29.172 INFO:teuthology.orchestra.run.smithi017.stdout:Total 2.1 MB/s | 7.0 MB 00:03 2024-09-12T16:14:29.246 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-12T16:14:29.258 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-12T16:14:29.258 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-12T16:14:29.365 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-12T16:14:29.365 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-12T16:14:29.611 INFO:teuthology.orchestra.run.smithi204.stdout:Last metadata expiration check: 0:01:39 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:14:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-12T16:14:29.745 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-09-12T16:14:29.745 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:14:29.745 INFO:teuthology.orchestra.run.smithi204.stdout: Package Arch Version Repository Size 2024-09-12T16:14:29.745 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:14:29.745 INFO:teuthology.orchestra.run.smithi204.stdout:Installing: 2024-09-12T16:14:29.745 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-fuse x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 900 k 2024-09-12T16:14:29.745 INFO:teuthology.orchestra.run.smithi204.stdout:Installing dependencies: 2024-09-12T16:14:29.745 INFO:teuthology.orchestra.run.smithi204.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T16:14:29.745 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:29.745 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction Summary 2024-09-12T16:14:29.745 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:14:29.746 INFO:teuthology.orchestra.run.smithi204.stdout:Install 2 Packages 2024-09-12T16:14:29.746 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:29.746 INFO:teuthology.orchestra.run.smithi204.stdout:Total download size: 980 k 2024-09-12T16:14:29.746 INFO:teuthology.orchestra.run.smithi204.stdout:Installed size: 2.9 M 2024-09-12T16:14:29.746 INFO:teuthology.orchestra.run.smithi204.stdout:Downloading Packages: 2024-09-12T16:14:29.762 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:37 ago on Thu 12 Sep 2024 04:12:52 PM UTC. 2024-09-12T16:14:29.860 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-12T16:14:29.901 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T16:14:29.901 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:14:29.902 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-09-12T16:14:29.902 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:14:29.902 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-12T16:14:29.902 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-volume noarch 2:19.3.0-4883.gd61b0886.el9 ceph-noarch 285 k 2024-09-12T16:14:29.902 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:29.902 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-12T16:14:29.902 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:14:29.902 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-09-12T16:14:29.902 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:29.903 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 285 k 2024-09-12T16:14:29.903 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 1.3 M 2024-09-12T16:14:29.903 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-12T16:14:29.907 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-12T16:14:30.046 INFO:teuthology.orchestra.run.smithi204.stdout:(1/2): ceph-fuse-19.3.0-4883.gd61b0886.el9.x86_ 3.5 MB/s | 900 kB 00:00 2024-09-12T16:14:30.131 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-volume-19.3.0-4883.gd61b0886.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-12T16:14:30.131 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:14:30.131 INFO:teuthology.orchestra.run.smithi047.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-12T16:14:30.132 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-12T16:14:30.141 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-12T16:14:30.141 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-12T16:14:30.163 INFO:teuthology.orchestra.run.smithi204.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 215 kB/s | 80 kB 00:00 2024-09-12T16:14:30.163 INFO:teuthology.orchestra.run.smithi204.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:14:30.164 INFO:teuthology.orchestra.run.smithi204.stdout:Total 2.3 MB/s | 980 kB 00:00 2024-09-12T16:14:30.175 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-12T16:14:30.175 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-12T16:14:30.176 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction check 2024-09-12T16:14:30.197 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction check succeeded. 2024-09-12T16:14:30.198 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction test 2024-09-12T16:14:30.280 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction test succeeded. 2024-09-12T16:14:30.280 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction 2024-09-12T16:14:30.416 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-12T16:14:30.458 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-12T16:14:30.465 INFO:teuthology.orchestra.run.smithi204.stdout: Preparing : 1/1 2024-09-12T16:14:30.474 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-volume-2:19.3.0-4883.gd61b0886.el9.noarch 1/1 2024-09-12T16:14:30.491 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-volume-2:19.3.0-4883.gd61b0886.el9.noarch 1/1 2024-09-12T16:14:30.491 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:14:30.491 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T16:14:30.491 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:30.545 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-12T16:14:30.616 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-12T16:14:30.621 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-12T16:14:30.643 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4883.gd61b0886.el9.noarch 6/6 2024-09-12T16:14:30.678 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-fuse-2:19.3.0-4883.gd61b0886.el9.x86_64 2/2 2024-09-12T16:14:31.337 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4883.gd61b0886.el9.x86_64 2/2 2024-09-12T16:14:31.337 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-fuse-2:19.3.0-4883.gd61b0886.el9.x86_64 1/2 2024-09-12T16:14:31.409 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4883.gd61b0886.el9.noarch 6/6 2024-09-12T16:14:31.409 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4883.gd61b0886.el9.noarch 1/6 2024-09-12T16:14:31.409 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-12T16:14:31.409 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-12T16:14:31.409 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-12T16:14:31.409 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-12T16:14:31.444 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-volume-2:19.3.0-4883.gd61b0886.el9.noarch 1/1 2024-09-12T16:14:31.444 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:31.445 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-12T16:14:31.445 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-volume-2:19.3.0-4883.gd61b0886.el9.noarch 2024-09-12T16:14:31.445 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:31.445 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T16:14:31.583 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-12T16:14:31.583 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:31.583 INFO:teuthology.orchestra.run.smithi204.stdout:Installed: 2024-09-12T16:14:31.583 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-fuse-2:19.3.0-4883.gd61b0886.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-12T16:14:31.583 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:31.583 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-09-12T16:14:31.691 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-12T16:14:31.691 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:31.691 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-12T16:14:31.691 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-cephadm-2:19.3.0-4883.gd61b0886.el9.noarch 2024-09-12T16:14:31.691 INFO:teuthology.orchestra.run.smithi017.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T16:14:31.691 INFO:teuthology.orchestra.run.smithi017.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T16:14:31.692 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T16:14:31.692 INFO:teuthology.orchestra.run.smithi017.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T16:14:31.692 INFO:teuthology.orchestra.run.smithi017.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T16:14:31.692 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:31.692 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-12T16:14:31.722 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install librados-devel 2024-09-12T16:14:31.905 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum -y install ceph-volume 2024-09-12T16:14:31.944 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-fuse 2024-09-12T16:14:32.319 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:40 ago on Thu 12 Sep 2024 04:12:52 PM UTC. 2024-09-12T16:14:32.459 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T16:14:32.459 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:14:32.459 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repo Size 2024-09-12T16:14:32.460 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:14:32.460 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-12T16:14:32.460 INFO:teuthology.orchestra.run.smithi047.stdout: librados-devel x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 127 k 2024-09-12T16:14:32.460 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:32.460 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-12T16:14:32.460 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:14:32.460 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-09-12T16:14:32.460 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:32.460 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 127 k 2024-09-12T16:14:32.460 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 456 k 2024-09-12T16:14:32.460 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-12T16:14:32.489 INFO:teuthology.orchestra.run.smithi204.stdout:Last metadata expiration check: 0:01:42 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:14:32.538 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:42 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:14:32.630 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-09-12T16:14:32.631 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:14:32.631 INFO:teuthology.orchestra.run.smithi204.stdout: Package Arch Version Repository Size 2024-09-12T16:14:32.631 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:14:32.631 INFO:teuthology.orchestra.run.smithi204.stdout:Installing: 2024-09-12T16:14:32.631 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-volume noarch 2:19.3.0-4883.gd61b0886.el9 ceph-noarch 285 k 2024-09-12T16:14:32.631 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:32.631 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction Summary 2024-09-12T16:14:32.631 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:14:32.631 INFO:teuthology.orchestra.run.smithi204.stdout:Install 1 Package 2024-09-12T16:14:32.631 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:32.631 INFO:teuthology.orchestra.run.smithi204.stdout:Total download size: 285 k 2024-09-12T16:14:32.631 INFO:teuthology.orchestra.run.smithi204.stdout:Installed size: 1.3 M 2024-09-12T16:14:32.632 INFO:teuthology.orchestra.run.smithi204.stdout:Downloading Packages: 2024-09-12T16:14:32.652 INFO:teuthology.orchestra.run.smithi047.stdout:librados-devel-19.3.0-4883.gd61b0886.el9.x86_64 660 kB/s | 127 kB 00:00 2024-09-12T16:14:32.653 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:14:32.654 INFO:teuthology.orchestra.run.smithi047.stdout:Total 654 kB/s | 127 kB 00:00 2024-09-12T16:14:32.654 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-12T16:14:32.660 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-12T16:14:32.660 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-12T16:14:32.677 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-12T16:14:32.678 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:14:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-09-12T16:14:32.678 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:14:32.678 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-12T16:14:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 900 k 2024-09-12T16:14:32.678 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-09-12T16:14:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T16:14:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:32.678 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-12T16:14:32.678 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:14:32.678 INFO:teuthology.orchestra.run.smithi017.stdout:Install 2 Packages 2024-09-12T16:14:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:32.679 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 980 k 2024-09-12T16:14:32.679 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 2.9 M 2024-09-12T16:14:32.679 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-12T16:14:32.728 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-12T16:14:32.728 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-12T16:14:32.869 INFO:teuthology.orchestra.run.smithi204.stdout:ceph-volume-19.3.0-4883.gd61b0886.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-12T16:14:32.869 INFO:teuthology.orchestra.run.smithi204.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:14:32.869 INFO:teuthology.orchestra.run.smithi204.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-12T16:14:32.870 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction check 2024-09-12T16:14:32.878 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction check succeeded. 2024-09-12T16:14:32.878 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction test 2024-09-12T16:14:32.888 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-12T16:14:32.907 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction test succeeded. 2024-09-12T16:14:32.907 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction 2024-09-12T16:14:32.986 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librados-devel-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:33.098 INFO:teuthology.orchestra.run.smithi017.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 526 kB/s | 80 kB 00:00 2024-09-12T16:14:33.127 INFO:teuthology.orchestra.run.smithi204.stdout: Preparing : 1/1 2024-09-12T16:14:33.187 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-volume-2:19.3.0-4883.gd61b0886.el9.noarch 1/1 2024-09-12T16:14:33.203 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-volume-2:19.3.0-4883.gd61b0886.el9.noarch 1/1 2024-09-12T16:14:33.203 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:14:33.204 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T16:14:33.204 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:33.214 INFO:teuthology.orchestra.run.smithi017.stdout:(2/2): ceph-fuse-19.3.0-4883.gd61b0886.el9.x86_ 3.3 MB/s | 900 kB 00:00 2024-09-12T16:14:33.215 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:14:33.216 INFO:teuthology.orchestra.run.smithi017.stdout:Total 1.8 MB/s | 980 kB 00:00 2024-09-12T16:14:33.228 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-12T16:14:33.251 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-12T16:14:33.251 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-12T16:14:33.338 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-12T16:14:33.338 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-12T16:14:33.437 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados-devel-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:33.644 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-12T16:14:33.694 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados-devel-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:33.694 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:33.694 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-12T16:14:33.694 INFO:teuthology.orchestra.run.smithi047.stdout: librados-devel-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:14:33.695 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:33.695 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T16:14:33.780 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-12T16:14:33.851 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-fuse-2:19.3.0-4883.gd61b0886.el9.x86_64 2/2 2024-09-12T16:14:33.929 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install libcephfs2 2024-09-12T16:14:34.189 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-volume-2:19.3.0-4883.gd61b0886.el9.noarch 1/1 2024-09-12T16:14:34.189 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:34.189 INFO:teuthology.orchestra.run.smithi204.stdout:Installed: 2024-09-12T16:14:34.189 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-volume-2:19.3.0-4883.gd61b0886.el9.noarch 2024-09-12T16:14:34.189 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:34.189 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-09-12T16:14:34.515 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum -y install librados-devel 2024-09-12T16:14:34.531 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:42 ago on Thu 12 Sep 2024 04:12:52 PM UTC. 2024-09-12T16:14:34.567 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4883.gd61b0886.el9.x86_64 2/2 2024-09-12T16:14:34.567 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-fuse-2:19.3.0-4883.gd61b0886.el9.x86_64 1/2 2024-09-12T16:14:34.627 INFO:teuthology.orchestra.run.smithi047.stdout:Package libcephfs2-2:19.3.0-4883.gd61b0886.el9.x86_64 is already installed. 2024-09-12T16:14:34.673 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T16:14:34.674 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-09-12T16:14:34.674 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T16:14:34.735 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install libcephfs-devel 2024-09-12T16:14:34.851 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-12T16:14:34.851 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:34.851 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-12T16:14:34.851 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse-2:19.3.0-4883.gd61b0886.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-12T16:14:34.852 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:34.852 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-12T16:14:35.102 INFO:teuthology.orchestra.run.smithi204.stdout:Last metadata expiration check: 0:01:45 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:14:35.136 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-volume 2024-09-12T16:14:35.239 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-09-12T16:14:35.240 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:14:35.240 INFO:teuthology.orchestra.run.smithi204.stdout: Package Arch Version Repo Size 2024-09-12T16:14:35.240 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:14:35.240 INFO:teuthology.orchestra.run.smithi204.stdout:Installing: 2024-09-12T16:14:35.240 INFO:teuthology.orchestra.run.smithi204.stdout: librados-devel x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 127 k 2024-09-12T16:14:35.240 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:35.240 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction Summary 2024-09-12T16:14:35.240 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:14:35.240 INFO:teuthology.orchestra.run.smithi204.stdout:Install 1 Package 2024-09-12T16:14:35.241 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:35.241 INFO:teuthology.orchestra.run.smithi204.stdout:Total download size: 127 k 2024-09-12T16:14:35.241 INFO:teuthology.orchestra.run.smithi204.stdout:Installed size: 456 k 2024-09-12T16:14:35.241 INFO:teuthology.orchestra.run.smithi204.stdout:Downloading Packages: 2024-09-12T16:14:35.330 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:43 ago on Thu 12 Sep 2024 04:12:52 PM UTC. 2024-09-12T16:14:35.457 INFO:teuthology.orchestra.run.smithi204.stdout:librados-devel-19.3.0-4883.gd61b0886.el9.x86_64 584 kB/s | 127 kB 00:00 2024-09-12T16:14:35.458 INFO:teuthology.orchestra.run.smithi204.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:14:35.458 INFO:teuthology.orchestra.run.smithi204.stdout:Total 580 kB/s | 127 kB 00:00 2024-09-12T16:14:35.458 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction check 2024-09-12T16:14:35.464 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction check succeeded. 2024-09-12T16:14:35.464 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction test 2024-09-12T16:14:35.469 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T16:14:35.470 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:14:35.470 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repo Size 2024-09-12T16:14:35.470 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:14:35.470 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-12T16:14:35.471 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs-devel x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 32 k 2024-09-12T16:14:35.471 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:35.471 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-12T16:14:35.471 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:14:35.471 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-09-12T16:14:35.471 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:35.471 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 32 k 2024-09-12T16:14:35.471 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 142 k 2024-09-12T16:14:35.471 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-12T16:14:35.530 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction test succeeded. 2024-09-12T16:14:35.530 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction 2024-09-12T16:14:35.631 INFO:teuthology.orchestra.run.smithi047.stdout:libcephfs-devel-19.3.0-4883.gd61b0886.el9.x86_6 199 kB/s | 32 kB 00:00 2024-09-12T16:14:35.631 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:14:35.632 INFO:teuthology.orchestra.run.smithi047.stdout:Total 197 kB/s | 32 kB 00:00 2024-09-12T16:14:35.632 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-12T16:14:35.635 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-12T16:14:35.635 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-12T16:14:35.660 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-12T16:14:35.660 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-12T16:14:35.683 INFO:teuthology.orchestra.run.smithi204.stdout: Preparing : 1/1 2024-09-12T16:14:35.738 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:45 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:14:35.754 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-12T16:14:35.789 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librados-devel-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:35.856 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephfs-devel-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:35.880 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-12T16:14:35.880 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:14:35.880 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-09-12T16:14:35.880 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:14:35.881 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-12T16:14:35.881 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-volume noarch 2:19.3.0-4883.gd61b0886.el9 ceph-noarch 285 k 2024-09-12T16:14:35.881 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:35.881 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-12T16:14:35.881 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:14:35.881 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2024-09-12T16:14:35.881 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:35.881 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 285 k 2024-09-12T16:14:35.881 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 1.3 M 2024-09-12T16:14:35.881 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-12T16:14:36.119 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-volume-19.3.0-4883.gd61b0886.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-12T16:14:36.119 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:14:36.120 INFO:teuthology.orchestra.run.smithi017.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-12T16:14:36.120 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-12T16:14:36.129 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-12T16:14:36.129 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-12T16:14:36.159 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-12T16:14:36.160 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-12T16:14:36.208 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librados-devel-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:36.215 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:36.395 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-12T16:14:36.461 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephfs-devel-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:36.461 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:36.461 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-12T16:14:36.461 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs-devel-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:14:36.461 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:36.461 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T16:14:36.463 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-volume-2:19.3.0-4883.gd61b0886.el9.noarch 1/1 2024-09-12T16:14:36.469 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librados-devel-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:36.469 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:36.469 INFO:teuthology.orchestra.run.smithi204.stdout:Installed: 2024-09-12T16:14:36.469 INFO:teuthology.orchestra.run.smithi204.stdout: librados-devel-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:14:36.469 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:36.469 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-09-12T16:14:36.480 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-volume-2:19.3.0-4883.gd61b0886.el9.noarch 1/1 2024-09-12T16:14:36.480 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:14:36.480 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T16:14:36.480 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:36.637 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install librados2 2024-09-12T16:14:36.701 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum -y install libcephfs2 2024-09-12T16:14:37.227 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:45 ago on Thu 12 Sep 2024 04:12:52 PM UTC. 2024-09-12T16:14:37.280 INFO:teuthology.orchestra.run.smithi204.stdout:Last metadata expiration check: 0:01:47 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:14:37.319 INFO:teuthology.orchestra.run.smithi047.stdout:Package librados2-2:19.3.0-4883.gd61b0886.el9.x86_64 is already installed. 2024-09-12T16:14:37.365 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T16:14:37.366 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-09-12T16:14:37.366 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T16:14:37.372 INFO:teuthology.orchestra.run.smithi204.stdout:Package libcephfs2-2:19.3.0-4883.gd61b0886.el9.x86_64 is already installed. 2024-09-12T16:14:37.416 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-09-12T16:14:37.417 INFO:teuthology.orchestra.run.smithi204.stdout:Nothing to do. 2024-09-12T16:14:37.417 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-09-12T16:14:37.435 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install librbd1 2024-09-12T16:14:37.456 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-volume-2:19.3.0-4883.gd61b0886.el9.noarch 1/1 2024-09-12T16:14:37.456 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:37.456 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-12T16:14:37.456 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-volume-2:19.3.0-4883.gd61b0886.el9.noarch 2024-09-12T16:14:37.456 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:37.456 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-12T16:14:37.499 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum -y install libcephfs-devel 2024-09-12T16:14:37.775 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install librados-devel 2024-09-12T16:14:38.031 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:46 ago on Thu 12 Sep 2024 04:12:52 PM UTC. 2024-09-12T16:14:38.072 INFO:teuthology.orchestra.run.smithi204.stdout:Last metadata expiration check: 0:01:48 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:14:38.124 INFO:teuthology.orchestra.run.smithi047.stdout:Package librbd1-2:19.3.0-4883.gd61b0886.el9.x86_64 is already installed. 2024-09-12T16:14:38.169 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T16:14:38.170 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-09-12T16:14:38.170 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T16:14:38.205 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-09-12T16:14:38.206 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:14:38.206 INFO:teuthology.orchestra.run.smithi204.stdout: Package Arch Version Repo Size 2024-09-12T16:14:38.206 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:14:38.206 INFO:teuthology.orchestra.run.smithi204.stdout:Installing: 2024-09-12T16:14:38.206 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs-devel x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 32 k 2024-09-12T16:14:38.206 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:38.207 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction Summary 2024-09-12T16:14:38.207 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:14:38.207 INFO:teuthology.orchestra.run.smithi204.stdout:Install 1 Package 2024-09-12T16:14:38.207 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:38.207 INFO:teuthology.orchestra.run.smithi204.stdout:Total download size: 32 k 2024-09-12T16:14:38.207 INFO:teuthology.orchestra.run.smithi204.stdout:Installed size: 142 k 2024-09-12T16:14:38.207 INFO:teuthology.orchestra.run.smithi204.stdout:Downloading Packages: 2024-09-12T16:14:38.232 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install python3-rados 2024-09-12T16:14:38.353 INFO:teuthology.orchestra.run.smithi204.stdout:libcephfs-devel-19.3.0-4883.gd61b0886.el9.x86_6 217 kB/s | 32 kB 00:00 2024-09-12T16:14:38.354 INFO:teuthology.orchestra.run.smithi204.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:14:38.354 INFO:teuthology.orchestra.run.smithi204.stdout:Total 215 kB/s | 32 kB 00:00 2024-09-12T16:14:38.354 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction check 2024-09-12T16:14:38.357 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction check succeeded. 2024-09-12T16:14:38.358 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction test 2024-09-12T16:14:38.373 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:48 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:14:38.375 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction test succeeded. 2024-09-12T16:14:38.375 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction 2024-09-12T16:14:38.462 INFO:teuthology.orchestra.run.smithi204.stdout: Preparing : 1/1 2024-09-12T16:14:38.513 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-12T16:14:38.513 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:14:38.514 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repo Size 2024-09-12T16:14:38.514 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:14:38.514 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-12T16:14:38.514 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 127 k 2024-09-12T16:14:38.514 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:38.514 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-12T16:14:38.514 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:14:38.514 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2024-09-12T16:14:38.514 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:38.514 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 127 k 2024-09-12T16:14:38.514 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 456 k 2024-09-12T16:14:38.514 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-12T16:14:38.584 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libcephfs-devel-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:38.708 INFO:teuthology.orchestra.run.smithi017.stdout:librados-devel-19.3.0-4883.gd61b0886.el9.x86_64 654 kB/s | 127 kB 00:00 2024-09-12T16:14:38.709 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:14:38.709 INFO:teuthology.orchestra.run.smithi017.stdout:Total 649 kB/s | 127 kB 00:00 2024-09-12T16:14:38.709 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-12T16:14:38.715 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-12T16:14:38.715 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-12T16:14:38.786 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-12T16:14:38.786 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-12T16:14:38.829 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:46 ago on Thu 12 Sep 2024 04:12:52 PM UTC. 2024-09-12T16:14:38.924 INFO:teuthology.orchestra.run.smithi047.stdout:Package python3-rados-2:19.3.0-4883.gd61b0886.el9.x86_64 is already installed. 2024-09-12T16:14:38.944 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-12T16:14:38.969 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:38.970 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T16:14:38.971 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-09-12T16:14:38.971 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T16:14:39.031 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install python3-rgw 2024-09-12T16:14:39.053 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librados-devel-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:39.197 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libcephfs-devel-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:39.197 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:39.197 INFO:teuthology.orchestra.run.smithi204.stdout:Installed: 2024-09-12T16:14:39.198 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs-devel-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:14:39.198 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:39.198 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-09-12T16:14:39.400 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum -y install librados2 2024-09-12T16:14:39.513 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados-devel-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:39.628 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:47 ago on Thu 12 Sep 2024 04:12:52 PM UTC. 2024-09-12T16:14:39.722 INFO:teuthology.orchestra.run.smithi047.stdout:Package python3-rgw-2:19.3.0-4883.gd61b0886.el9.x86_64 is already installed. 2024-09-12T16:14:39.754 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados-devel-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:39.755 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:39.755 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-12T16:14:39.755 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:14:39.755 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:39.755 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-12T16:14:39.769 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T16:14:39.770 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-09-12T16:14:39.770 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T16:14:39.834 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install python3-cephfs 2024-09-12T16:14:39.972 INFO:teuthology.orchestra.run.smithi204.stdout:Last metadata expiration check: 0:01:49 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:14:40.034 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install libcephfs2 2024-09-12T16:14:40.064 INFO:teuthology.orchestra.run.smithi204.stdout:Package librados2-2:19.3.0-4883.gd61b0886.el9.x86_64 is already installed. 2024-09-12T16:14:40.107 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-09-12T16:14:40.108 INFO:teuthology.orchestra.run.smithi204.stdout:Nothing to do. 2024-09-12T16:14:40.108 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-09-12T16:14:40.180 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum -y install librbd1 2024-09-12T16:14:40.422 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:48 ago on Thu 12 Sep 2024 04:12:52 PM UTC. 2024-09-12T16:14:40.514 INFO:teuthology.orchestra.run.smithi047.stdout:Package python3-cephfs-2:19.3.0-4883.gd61b0886.el9.x86_64 is already installed. 2024-09-12T16:14:40.560 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T16:14:40.561 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-09-12T16:14:40.561 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T16:14:40.622 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install python3-rbd 2024-09-12T16:14:40.633 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:50 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:14:40.728 INFO:teuthology.orchestra.run.smithi017.stdout:Package libcephfs2-2:19.3.0-4883.gd61b0886.el9.x86_64 is already installed. 2024-09-12T16:14:40.753 INFO:teuthology.orchestra.run.smithi204.stdout:Last metadata expiration check: 0:01:50 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:14:40.775 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-12T16:14:40.776 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-09-12T16:14:40.777 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-12T16:14:40.844 INFO:teuthology.orchestra.run.smithi204.stdout:Package librbd1-2:19.3.0-4883.gd61b0886.el9.x86_64 is already installed. 2024-09-12T16:14:40.853 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install libcephfs-devel 2024-09-12T16:14:40.887 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-09-12T16:14:40.888 INFO:teuthology.orchestra.run.smithi204.stdout:Nothing to do. 2024-09-12T16:14:40.888 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-09-12T16:14:40.965 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum -y install python3-rados 2024-09-12T16:14:41.218 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:49 ago on Thu 12 Sep 2024 04:12:52 PM UTC. 2024-09-12T16:14:41.316 INFO:teuthology.orchestra.run.smithi047.stdout:Package python3-rbd-2:19.3.0-4883.gd61b0886.el9.x86_64 is already installed. 2024-09-12T16:14:41.363 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T16:14:41.364 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-09-12T16:14:41.364 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T16:14:41.427 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install rbd-fuse 2024-09-12T16:14:41.448 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:51 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:14:41.540 INFO:teuthology.orchestra.run.smithi204.stdout:Last metadata expiration check: 0:01:51 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:14:41.757 INFO:teuthology.orchestra.run.smithi204.stdout:Package python3-rados-2:19.3.0-4883.gd61b0886.el9.x86_64 is already installed. 2024-09-12T16:14:41.758 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-09-12T16:14:41.758 INFO:teuthology.orchestra.run.smithi204.stdout:Nothing to do. 2024-09-12T16:14:41.758 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-09-12T16:14:41.758 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum -y install python3-rgw 2024-09-12T16:14:41.758 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-12T16:14:41.758 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:14:41.759 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repo Size 2024-09-12T16:14:41.759 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:14:41.759 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-12T16:14:41.759 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-devel x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 32 k 2024-09-12T16:14:41.759 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:41.759 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-12T16:14:41.759 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:14:41.759 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2024-09-12T16:14:41.759 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:41.759 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 32 k 2024-09-12T16:14:41.759 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 142 k 2024-09-12T16:14:41.759 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-12T16:14:41.760 INFO:teuthology.orchestra.run.smithi017.stdout:libcephfs-devel-19.3.0-4883.gd61b0886.el9.x86_6 207 kB/s | 32 kB 00:00 2024-09-12T16:14:41.760 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:14:41.760 INFO:teuthology.orchestra.run.smithi017.stdout:Total 205 kB/s | 32 kB 00:00 2024-09-12T16:14:41.760 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-12T16:14:41.760 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-12T16:14:41.760 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-12T16:14:41.767 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-12T16:14:41.767 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-12T16:14:41.862 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-12T16:14:41.979 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs-devel-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:42.047 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:50 ago on Thu 12 Sep 2024 04:12:52 PM UTC. 2024-09-12T16:14:42.189 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T16:14:42.189 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:14:42.189 INFO:teuthology.orchestra.run.smithi047.stdout: Package Architecture Version Repository Size 2024-09-12T16:14:42.190 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:14:42.190 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-12T16:14:42.190 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-fuse x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 85 k 2024-09-12T16:14:42.190 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:42.190 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-12T16:14:42.190 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:14:42.190 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-09-12T16:14:42.190 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:42.190 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 85 k 2024-09-12T16:14:42.190 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 231 k 2024-09-12T16:14:42.190 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-12T16:14:42.333 INFO:teuthology.orchestra.run.smithi204.stdout:Last metadata expiration check: 0:01:52 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:14:42.347 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:42.384 INFO:teuthology.orchestra.run.smithi047.stdout:rbd-fuse-19.3.0-4883.gd61b0886.el9.x86_64.rpm 439 kB/s | 85 kB 00:00 2024-09-12T16:14:42.385 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:14:42.386 INFO:teuthology.orchestra.run.smithi047.stdout:Total 435 kB/s | 85 kB 00:00 2024-09-12T16:14:42.386 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-12T16:14:42.393 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-12T16:14:42.393 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-12T16:14:42.425 INFO:teuthology.orchestra.run.smithi204.stdout:Package python3-rgw-2:19.3.0-4883.gd61b0886.el9.x86_64 is already installed. 2024-09-12T16:14:42.460 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-12T16:14:42.460 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-12T16:14:42.469 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-09-12T16:14:42.470 INFO:teuthology.orchestra.run.smithi204.stdout:Nothing to do. 2024-09-12T16:14:42.470 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-09-12T16:14:42.548 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum -y install python3-cephfs 2024-09-12T16:14:42.571 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs-devel-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:42.572 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:42.572 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-12T16:14:42.572 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-devel-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:14:42.572 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:42.572 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-12T16:14:42.612 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-12T16:14:42.710 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-fuse-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:42.752 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install librados2 2024-09-12T16:14:43.094 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:43.117 INFO:teuthology.orchestra.run.smithi204.stdout:Last metadata expiration check: 0:01:53 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:14:43.207 INFO:teuthology.orchestra.run.smithi204.stdout:Package python3-cephfs-2:19.3.0-4883.gd61b0886.el9.x86_64 is already installed. 2024-09-12T16:14:43.250 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-09-12T16:14:43.251 INFO:teuthology.orchestra.run.smithi204.stdout:Nothing to do. 2024-09-12T16:14:43.252 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-09-12T16:14:43.323 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum -y install python3-rbd 2024-09-12T16:14:43.327 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-fuse-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:43.327 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:43.327 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-12T16:14:43.328 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-fuse-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:14:43.328 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:43.328 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T16:14:43.341 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:53 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:14:43.434 INFO:teuthology.orchestra.run.smithi017.stdout:Package librados2-2:19.3.0-4883.gd61b0886.el9.x86_64 is already installed. 2024-09-12T16:14:43.479 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-12T16:14:43.481 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-09-12T16:14:43.481 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-12T16:14:43.549 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install librbd1 2024-09-12T16:14:43.580 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install rbd-mirror 2024-09-12T16:14:43.899 INFO:teuthology.orchestra.run.smithi204.stdout:Last metadata expiration check: 0:01:53 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:14:43.990 INFO:teuthology.orchestra.run.smithi204.stdout:Package python3-rbd-2:19.3.0-4883.gd61b0886.el9.x86_64 is already installed. 2024-09-12T16:14:44.034 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-09-12T16:14:44.035 INFO:teuthology.orchestra.run.smithi204.stdout:Nothing to do. 2024-09-12T16:14:44.035 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-09-12T16:14:44.106 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum -y install rbd-fuse 2024-09-12T16:14:44.136 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:54 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:14:44.168 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:52 ago on Thu 12 Sep 2024 04:12:52 PM UTC. 2024-09-12T16:14:44.231 INFO:teuthology.orchestra.run.smithi017.stdout:Package librbd1-2:19.3.0-4883.gd61b0886.el9.x86_64 is already installed. 2024-09-12T16:14:44.277 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-12T16:14:44.278 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-09-12T16:14:44.278 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-12T16:14:44.309 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T16:14:44.310 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:14:44.310 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repo Size 2024-09-12T16:14:44.310 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:14:44.310 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-12T16:14:44.310 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-mirror x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 3.2 M 2024-09-12T16:14:44.310 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:44.310 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-12T16:14:44.310 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:14:44.310 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-09-12T16:14:44.311 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:44.311 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 3.2 M 2024-09-12T16:14:44.311 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 14 M 2024-09-12T16:14:44.311 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-12T16:14:44.346 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install python3-rados 2024-09-12T16:14:44.654 INFO:teuthology.orchestra.run.smithi047.stdout:rbd-mirror-19.3.0-4883.gd61b0886.el9.x86_64.rpm 9.3 MB/s | 3.2 MB 00:00 2024-09-12T16:14:44.655 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:14:44.655 INFO:teuthology.orchestra.run.smithi047.stdout:Total 9.2 MB/s | 3.2 MB 00:00 2024-09-12T16:14:44.656 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-12T16:14:44.666 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-12T16:14:44.666 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-12T16:14:44.674 INFO:teuthology.orchestra.run.smithi204.stdout:Last metadata expiration check: 0:01:54 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:14:44.752 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-12T16:14:44.752 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-12T16:14:44.808 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-09-12T16:14:44.809 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:14:44.809 INFO:teuthology.orchestra.run.smithi204.stdout: Package Architecture Version Repository Size 2024-09-12T16:14:44.809 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:14:44.809 INFO:teuthology.orchestra.run.smithi204.stdout:Installing: 2024-09-12T16:14:44.809 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-fuse x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 85 k 2024-09-12T16:14:44.809 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:44.809 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction Summary 2024-09-12T16:14:44.809 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:14:44.810 INFO:teuthology.orchestra.run.smithi204.stdout:Install 1 Package 2024-09-12T16:14:44.810 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:44.810 INFO:teuthology.orchestra.run.smithi204.stdout:Total download size: 85 k 2024-09-12T16:14:44.810 INFO:teuthology.orchestra.run.smithi204.stdout:Installed size: 231 k 2024-09-12T16:14:44.810 INFO:teuthology.orchestra.run.smithi204.stdout:Downloading Packages: 2024-09-12T16:14:44.945 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:54 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:14:44.998 INFO:teuthology.orchestra.run.smithi204.stdout:rbd-fuse-19.3.0-4883.gd61b0886.el9.x86_64.rpm 453 kB/s | 85 kB 00:00 2024-09-12T16:14:44.999 INFO:teuthology.orchestra.run.smithi204.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:14:44.999 INFO:teuthology.orchestra.run.smithi204.stdout:Total 450 kB/s | 85 kB 00:00 2024-09-12T16:14:44.999 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction check 2024-09-12T16:14:45.006 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction check succeeded. 2024-09-12T16:14:45.006 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction test 2024-09-12T16:14:45.038 INFO:teuthology.orchestra.run.smithi017.stdout:Package python3-rados-2:19.3.0-4883.gd61b0886.el9.x86_64 is already installed. 2024-09-12T16:14:45.071 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction test succeeded. 2024-09-12T16:14:45.071 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction 2024-09-12T16:14:45.084 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-12T16:14:45.085 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-09-12T16:14:45.085 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-12T16:14:45.155 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install python3-rgw 2024-09-12T16:14:45.217 INFO:teuthology.orchestra.run.smithi204.stdout: Preparing : 1/1 2024-09-12T16:14:45.217 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-12T16:14:45.272 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-mirror-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:45.299 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:45.299 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:14:45.299 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T16:14:45.299 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T16:14:45.299 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T16:14:45.300 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:45.329 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : rbd-fuse-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:45.708 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:45.749 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:55 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:14:45.844 INFO:teuthology.orchestra.run.smithi017.stdout:Package python3-rgw-2:19.3.0-4883.gd61b0886.el9.x86_64 is already installed. 2024-09-12T16:14:45.889 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-12T16:14:45.891 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-09-12T16:14:45.891 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-12T16:14:45.964 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install python3-cephfs 2024-09-12T16:14:45.967 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : rbd-fuse-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:45.968 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:45.968 INFO:teuthology.orchestra.run.smithi204.stdout:Installed: 2024-09-12T16:14:45.968 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-fuse-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:14:45.968 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:45.968 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-09-12T16:14:46.252 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum -y install rbd-mirror 2024-09-12T16:14:46.394 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-mirror-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:46.394 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:46.394 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-12T16:14:46.394 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-mirror-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:14:46.394 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:46.394 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T16:14:46.557 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:56 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:14:46.645 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install rbd-nbd 2024-09-12T16:14:46.651 INFO:teuthology.orchestra.run.smithi017.stdout:Package python3-cephfs-2:19.3.0-4883.gd61b0886.el9.x86_64 is already installed. 2024-09-12T16:14:46.696 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-12T16:14:46.698 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-09-12T16:14:46.701 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-12T16:14:46.765 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install python3-rbd 2024-09-12T16:14:46.846 INFO:teuthology.orchestra.run.smithi204.stdout:Last metadata expiration check: 0:01:56 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:14:46.986 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-09-12T16:14:46.987 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:14:46.987 INFO:teuthology.orchestra.run.smithi204.stdout: Package Arch Version Repo Size 2024-09-12T16:14:46.987 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:14:46.987 INFO:teuthology.orchestra.run.smithi204.stdout:Installing: 2024-09-12T16:14:46.988 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-mirror x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 3.2 M 2024-09-12T16:14:46.988 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:46.988 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction Summary 2024-09-12T16:14:46.988 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:14:46.988 INFO:teuthology.orchestra.run.smithi204.stdout:Install 1 Package 2024-09-12T16:14:46.988 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:46.988 INFO:teuthology.orchestra.run.smithi204.stdout:Total download size: 3.2 M 2024-09-12T16:14:46.988 INFO:teuthology.orchestra.run.smithi204.stdout:Installed size: 14 M 2024-09-12T16:14:46.988 INFO:teuthology.orchestra.run.smithi204.stdout:Downloading Packages: 2024-09-12T16:14:47.247 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:55 ago on Thu 12 Sep 2024 04:12:52 PM UTC. 2024-09-12T16:14:47.336 INFO:teuthology.orchestra.run.smithi204.stdout:rbd-mirror-19.3.0-4883.gd61b0886.el9.x86_64.rpm 9.2 MB/s | 3.2 MB 00:00 2024-09-12T16:14:47.337 INFO:teuthology.orchestra.run.smithi204.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:14:47.337 INFO:teuthology.orchestra.run.smithi204.stdout:Total 9.1 MB/s | 3.2 MB 00:00 2024-09-12T16:14:47.337 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction check 2024-09-12T16:14:47.346 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction check succeeded. 2024-09-12T16:14:47.346 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction test 2024-09-12T16:14:47.363 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:57 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:14:47.387 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T16:14:47.388 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:14:47.388 INFO:teuthology.orchestra.run.smithi047.stdout: Package Architecture Version Repository Size 2024-09-12T16:14:47.388 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:14:47.388 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-12T16:14:47.388 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-nbd x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 171 k 2024-09-12T16:14:47.388 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:47.388 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-12T16:14:47.388 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T16:14:47.389 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-09-12T16:14:47.389 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:47.389 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 171 k 2024-09-12T16:14:47.389 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 490 k 2024-09-12T16:14:47.389 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-12T16:14:47.429 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction test succeeded. 2024-09-12T16:14:47.430 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction 2024-09-12T16:14:47.457 INFO:teuthology.orchestra.run.smithi017.stdout:Package python3-rbd-2:19.3.0-4883.gd61b0886.el9.x86_64 is already installed. 2024-09-12T16:14:47.503 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-12T16:14:47.504 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-09-12T16:14:47.505 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-12T16:14:47.581 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install rbd-fuse 2024-09-12T16:14:47.599 INFO:teuthology.orchestra.run.smithi047.stdout:rbd-nbd-19.3.0-4883.gd61b0886.el9.x86_64.rpm 813 kB/s | 171 kB 00:00 2024-09-12T16:14:47.600 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:14:47.600 INFO:teuthology.orchestra.run.smithi047.stdout:Total 807 kB/s | 171 kB 00:00 2024-09-12T16:14:47.600 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-12T16:14:47.609 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-12T16:14:47.609 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-12T16:14:47.677 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-12T16:14:47.677 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-12T16:14:47.838 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-12T16:14:47.870 INFO:teuthology.orchestra.run.smithi204.stdout: Preparing : 1/1 2024-09-12T16:14:47.937 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : rbd-mirror-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:47.944 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-nbd-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:47.964 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:47.964 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:14:47.964 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T16:14:47.964 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T16:14:47.964 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T16:14:47.964 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:48.191 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:58 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:14:48.333 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-12T16:14:48.333 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:14:48.333 INFO:teuthology.orchestra.run.smithi017.stdout: Package Architecture Version Repository Size 2024-09-12T16:14:48.333 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:14:48.333 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-12T16:14:48.333 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 85 k 2024-09-12T16:14:48.334 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:48.334 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-12T16:14:48.334 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:14:48.334 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2024-09-12T16:14:48.334 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:48.334 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 85 k 2024-09-12T16:14:48.335 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 231 k 2024-09-12T16:14:48.335 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-12T16:14:48.359 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:48.540 INFO:teuthology.orchestra.run.smithi017.stdout:rbd-fuse-19.3.0-4883.gd61b0886.el9.x86_64.rpm 414 kB/s | 85 kB 00:00 2024-09-12T16:14:48.541 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:14:48.541 INFO:teuthology.orchestra.run.smithi017.stdout:Total 411 kB/s | 85 kB 00:00 2024-09-12T16:14:48.541 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-12T16:14:48.549 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-12T16:14:48.549 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-12T16:14:48.616 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-12T16:14:48.616 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-12T16:14:48.635 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-nbd-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:48.635 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:48.635 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-12T16:14:48.635 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-nbd-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:14:48.636 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:48.636 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T16:14:48.770 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-12T16:14:48.874 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-fuse-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:48.887 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install rbd-nbd 2024-09-12T16:14:49.122 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : rbd-mirror-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:49.122 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:49.122 INFO:teuthology.orchestra.run.smithi204.stdout:Installed: 2024-09-12T16:14:49.122 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-mirror-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:14:49.122 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:49.122 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-09-12T16:14:49.235 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:49.342 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum -y install rbd-nbd 2024-09-12T16:14:49.479 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:57 ago on Thu 12 Sep 2024 04:12:52 PM UTC. 2024-09-12T16:14:49.496 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-fuse-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:49.496 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:49.496 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-12T16:14:49.496 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:14:49.496 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:49.497 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-12T16:14:49.572 INFO:teuthology.orchestra.run.smithi047.stdout:Package rbd-nbd-2:19.3.0-4883.gd61b0886.el9.x86_64 is already installed. 2024-09-12T16:14:49.617 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T16:14:49.618 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-09-12T16:14:49.619 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T16:14:49.691 DEBUG:teuthology.parallel:result is None 2024-09-12T16:14:49.791 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install rbd-mirror 2024-09-12T16:14:49.929 INFO:teuthology.orchestra.run.smithi204.stdout:Last metadata expiration check: 0:01:59 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:14:50.064 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-09-12T16:14:50.065 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:14:50.065 INFO:teuthology.orchestra.run.smithi204.stdout: Package Architecture Version Repository Size 2024-09-12T16:14:50.065 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:14:50.065 INFO:teuthology.orchestra.run.smithi204.stdout:Installing: 2024-09-12T16:14:50.065 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-nbd x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 171 k 2024-09-12T16:14:50.065 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:50.065 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction Summary 2024-09-12T16:14:50.065 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T16:14:50.065 INFO:teuthology.orchestra.run.smithi204.stdout:Install 1 Package 2024-09-12T16:14:50.066 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:50.066 INFO:teuthology.orchestra.run.smithi204.stdout:Total download size: 171 k 2024-09-12T16:14:50.066 INFO:teuthology.orchestra.run.smithi204.stdout:Installed size: 490 k 2024-09-12T16:14:50.066 INFO:teuthology.orchestra.run.smithi204.stdout:Downloading Packages: 2024-09-12T16:14:50.282 INFO:teuthology.orchestra.run.smithi204.stdout:rbd-nbd-19.3.0-4883.gd61b0886.el9.x86_64.rpm 792 kB/s | 171 kB 00:00 2024-09-12T16:14:50.283 INFO:teuthology.orchestra.run.smithi204.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:14:50.283 INFO:teuthology.orchestra.run.smithi204.stdout:Total 786 kB/s | 171 kB 00:00 2024-09-12T16:14:50.283 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction check 2024-09-12T16:14:50.291 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction check succeeded. 2024-09-12T16:14:50.291 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction test 2024-09-12T16:14:50.355 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction test succeeded. 2024-09-12T16:14:50.355 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction 2024-09-12T16:14:50.385 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:02:00 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:14:50.507 INFO:teuthology.orchestra.run.smithi204.stdout: Preparing : 1/1 2024-09-12T16:14:50.529 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-12T16:14:50.530 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:14:50.530 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repo Size 2024-09-12T16:14:50.530 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:14:50.530 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-12T16:14:50.531 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 3.2 M 2024-09-12T16:14:50.531 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:50.531 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-12T16:14:50.531 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:14:50.531 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2024-09-12T16:14:50.531 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:50.531 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 3.2 M 2024-09-12T16:14:50.531 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 14 M 2024-09-12T16:14:50.531 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-12T16:14:50.613 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : rbd-nbd-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:50.886 INFO:teuthology.orchestra.run.smithi017.stdout:rbd-mirror-19.3.0-4883.gd61b0886.el9.x86_64.rpm 9.0 MB/s | 3.2 MB 00:00 2024-09-12T16:14:50.886 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:14:50.887 INFO:teuthology.orchestra.run.smithi017.stdout:Total 9.0 MB/s | 3.2 MB 00:00 2024-09-12T16:14:50.887 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-12T16:14:50.897 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-12T16:14:50.897 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-12T16:14:50.983 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-12T16:14:50.984 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-12T16:14:51.033 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:51.287 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : rbd-nbd-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:51.288 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:51.288 INFO:teuthology.orchestra.run.smithi204.stdout:Installed: 2024-09-12T16:14:51.288 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-nbd-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:14:51.288 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:51.288 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-09-12T16:14:51.448 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-12T16:14:51.511 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-mirror-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:51.538 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:51.538 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:14:51.538 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T16:14:51.538 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T16:14:51.538 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T16:14:51.538 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:51.540 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum -y install rbd-nbd 2024-09-12T16:14:52.122 INFO:teuthology.orchestra.run.smithi204.stdout:Last metadata expiration check: 0:02:02 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:14:52.213 INFO:teuthology.orchestra.run.smithi204.stdout:Package rbd-nbd-2:19.3.0-4883.gd61b0886.el9.x86_64 is already installed. 2024-09-12T16:14:52.258 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-09-12T16:14:52.259 INFO:teuthology.orchestra.run.smithi204.stdout:Nothing to do. 2024-09-12T16:14:52.259 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-09-12T16:14:52.347 DEBUG:teuthology.parallel:result is None 2024-09-12T16:14:52.630 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-mirror-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:52.630 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:52.630 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-12T16:14:52.630 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:14:52.630 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:52.630 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-12T16:14:52.864 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install rbd-nbd 2024-09-12T16:14:53.457 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:02:03 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:14:53.597 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-12T16:14:53.598 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:14:53.598 INFO:teuthology.orchestra.run.smithi017.stdout: Package Architecture Version Repository Size 2024-09-12T16:14:53.598 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:14:53.598 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-12T16:14:53.598 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd x86_64 2:19.3.0-4883.gd61b0886.el9 ceph 171 k 2024-09-12T16:14:53.598 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:53.598 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-12T16:14:53.598 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-12T16:14:53.598 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2024-09-12T16:14:53.598 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:53.599 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 171 k 2024-09-12T16:14:53.599 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 490 k 2024-09-12T16:14:53.599 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-12T16:14:53.815 INFO:teuthology.orchestra.run.smithi017.stdout:rbd-nbd-19.3.0-4883.gd61b0886.el9.x86_64.rpm 792 kB/s | 171 kB 00:00 2024-09-12T16:14:53.815 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:14:53.815 INFO:teuthology.orchestra.run.smithi017.stdout:Total 786 kB/s | 171 kB 00:00 2024-09-12T16:14:53.816 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-12T16:14:53.824 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-12T16:14:53.824 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-12T16:14:53.892 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-12T16:14:53.892 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-12T16:14:54.053 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-12T16:14:54.157 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-nbd-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:54.557 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:54.822 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-nbd-2:19.3.0-4883.gd61b0886.el9.x86_64 1/1 2024-09-12T16:14:54.822 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:54.822 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-12T16:14:54.822 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd-2:19.3.0-4883.gd61b0886.el9.x86_64 2024-09-12T16:14:54.822 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:54.822 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-12T16:14:55.069 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install rbd-nbd 2024-09-12T16:14:55.662 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:02:05 ago on Thu 12 Sep 2024 04:12:50 PM UTC. 2024-09-12T16:14:55.757 INFO:teuthology.orchestra.run.smithi017.stdout:Package rbd-nbd-2:19.3.0-4883.gd61b0886.el9.x86_64 is already installed. 2024-09-12T16:14:55.805 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-12T16:14:55.805 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-09-12T16:14:55.805 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-12T16:14:55.877 DEBUG:teuthology.parallel:result is None 2024-09-12T16:14:55.878 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d61b08865d4d98738f45ff2e4806d7fb6d03eca1 2024-09-12T16:14:56.038 DEBUG:teuthology.orchestra.run.smithi017:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T16:14:56.060 INFO:teuthology.orchestra.run.smithi017.stdout:19.3.0-4883.gd61b0886.el9 2024-09-12T16:14:56.061 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4883.gd61b0886.el9 2024-09-12T16:14:56.061 INFO:teuthology.task.install:The correct ceph version 19.3.0-4883.gd61b0886 is installed. 2024-09-12T16:14:56.063 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d61b08865d4d98738f45ff2e4806d7fb6d03eca1 2024-09-12T16:14:56.200 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T16:14:56.227 INFO:teuthology.orchestra.run.smithi047.stdout:19.3.0-4883.gd61b0886.el9 2024-09-12T16:14:56.227 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4883.gd61b0886.el9 2024-09-12T16:14:56.227 INFO:teuthology.task.install:The correct ceph version 19.3.0-4883.gd61b0886 is installed. 2024-09-12T16:14:56.229 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d61b08865d4d98738f45ff2e4806d7fb6d03eca1 2024-09-12T16:14:56.365 DEBUG:teuthology.orchestra.run.smithi204:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T16:14:56.391 INFO:teuthology.orchestra.run.smithi204.stdout:19.3.0-4883.gd61b0886.el9 2024-09-12T16:14:56.391 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4883.gd61b0886.el9 2024-09-12T16:14:56.391 INFO:teuthology.task.install:The correct ceph version 19.3.0-4883.gd61b0886 is installed. 2024-09-12T16:14:56.393 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T16:14:56.393 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T16:14:56.393 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T16:14:56.423 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T16:14:56.423 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T16:14:56.454 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T16:14:56.454 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T16:14:56.485 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T16:14:56.485 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T16:14:56.485 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T16:14:56.513 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T16:14:56.582 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T16:14:56.582 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T16:14:56.612 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T16:14:56.683 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T16:14:56.683 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T16:14:56.712 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T16:14:56.778 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T16:14:56.778 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T16:14:56.778 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T16:14:56.807 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T16:14:56.876 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T16:14:56.876 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T16:14:56.907 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T16:14:56.977 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T16:14:56.977 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T16:14:57.002 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T16:14:57.068 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T16:14:57.068 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T16:14:57.068 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T16:14:57.097 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T16:14:57.166 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T16:14:57.166 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T16:14:57.197 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T16:14:57.268 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T16:14:57.268 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T16:14:57.292 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T16:14:57.358 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T16:14:57.435 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T16:14:57.435 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 777 /var/log/ceph 2024-09-12T16:14:57.438 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 777 /var/log/ceph 2024-09-12T16:14:57.440 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 777 /var/log/ceph 2024-09-12T16:14:57.468 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T16:14:57.468 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T16:14:57.509 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T16:14:57.512 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T16:14:57.538 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T16:14:57.538 DEBUG:teuthology.orchestra.run.smithi017:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T16:14:57.580 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T16:14:57.583 DEBUG:teuthology.orchestra.run.smithi204:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T16:14:57.617 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T16:14:57.618 INFO:tasks.ceph:config {'conf': {'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T16:14:57.618 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/dis-2024-09-12_15:21:08-rbd-wip-dis-testing-distro-default-smithi/7902667', 'branch': 'wip-dis-testing', 'description': 'rbd/device/{base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/rbd_fsx_nbd}', 'email': 'idryomov@gmail.com', 'first_in_suite': False, 'job_id': '7902667', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'dis-2024-09-12_15:21:08-rbd-wip-dis-testing-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'machine': {'cpus': 1, 'disk': 40, 'ram': 8000}, 'volumes': {'count': 4, 'size': 30}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-dis-testing'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': 'd61b08865d4d98738f45ff2e4806d7fb6d03eca1'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'extra_packages': ['rbd-nbd'], 'flavor': 'default', 'sha1': 'd61b08865d4d98738f45ff2e4806d7fb6d03eca1'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-dis-testing', 'sha1': 'd61b08865d4d98738f45ff2e4806d7fb6d03eca1'}}, 'owner': 'scheduled_dis@teuthology', 'priority': 70, 'repo': 'https://github.com/ceph/ceph-ci', 'roles': [['mon.a', 'mon.c', 'osd.0', 'osd.1', 'osd.2'], ['mon.b', 'mgr.x', 'osd.3', 'osd.4', 'osd.5'], ['client.0']], 'seed': 1680, 'sha1': 'd61b08865d4d98738f45ff2e4806d7fb6d03eca1', 'sleep_before_teardown': 0, 'subset': '42/100', 'suite': 'rbd', 'suite_branch': 'wip-dis-testing', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_d61b08865d4d98738f45ff2e4806d7fb6d03eca1/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci', 'suite_sha1': 'd61b08865d4d98738f45ff2e4806d7fb6d03eca1', 'targets': {'smithi017.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJYXmr8XHw7t6N2whg2Wi6wKeUdKkAhOtbkX5Ol7sAxgjjUAXINdOPZjhOzI/zl/PFcEDX39H32Ydc4jPQy5r7s=', 'smithi047.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGs5GbkKnoUp1Q9hd/wKOxIWtiHgV6fGa0eKDcQC26DPnG9XMmtFl4bBebvS3I4J0Q+wgj75M4fHAypnnGz0epk=', 'smithi204.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE6ilMD6vT+JK+mg2lCBjt3wDPMLrJxmuwPmJztrLKDNoxMMbcozoA3iEjpJUARzZ/qhR1+qcp752PaltVbz9e0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'thrashosds': {'timeout': 1200}}, {'rbd_fsx': {'clients': ['client.0'], 'holebdy': 512, 'nbd': True, 'ops': 6000, 'punch_holes': True, 'readbdy': 512, 'truncbdy': 512, 'writebdy': 512}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-12_15:21:08', 'tube': 'smithi', 'user': 'dis', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T16:14:57.618 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T16:14:57.648 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T16:14:57.651 DEBUG:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T16:14:57.667 DEBUG:teuthology.orchestra.run.smithi017:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T16:14:57.706 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T16:14:57.709 DEBUG:teuthology.orchestra.run.smithi204:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T16:14:57.734 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T16:14:57.734 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T16:14:57.789 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T16:14:57.789 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_1 2024-09-12T16:14:57.846 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T16:14:57.846 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T16:14:57.846 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-12T16:14:57.847 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T16:14:57.847 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T16:14:57.847 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-12 16:14:51.801145422 +0000 2024-09-12T16:14:57.847 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-12 16:12:12.486378280 +0000 2024-09-12T16:14:57.847 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-12 16:12:12.486378280 +0000 2024-09-12T16:14:57.847 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-09-12 16:12:12.486378280 +0000 2024-09-12T16:14:57.847 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T16:14:57.912 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-12T16:14:57.912 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-12T16:14:57.912 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000109207 s, 4.7 MB/s 2024-09-12T16:14:57.914 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T16:14:57.971 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_2 2024-09-12T16:14:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T16:14:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T16:14:58.029 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-12T16:14:58.029 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T16:14:58.029 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T16:14:58.029 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-12 16:14:51.801145422 +0000 2024-09-12T16:14:58.029 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-12 16:12:12.807374729 +0000 2024-09-12T16:14:58.029 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-12 16:12:12.807374729 +0000 2024-09-12T16:14:58.029 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-09-12 16:12:12.807374729 +0000 2024-09-12T16:14:58.029 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T16:14:58.093 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-12T16:14:58.094 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-12T16:14:58.094 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 9.079e-05 s, 5.6 MB/s 2024-09-12T16:14:58.095 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T16:14:58.152 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_3 2024-09-12T16:14:58.208 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T16:14:58.208 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T16:14:58.208 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-12T16:14:58.208 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T16:14:58.208 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T16:14:58.208 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-12 16:14:51.802145411 +0000 2024-09-12T16:14:58.208 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-12 16:12:13.131371144 +0000 2024-09-12T16:14:58.208 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-12 16:12:13.131371144 +0000 2024-09-12T16:14:58.209 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-09-12 16:12:13.131371144 +0000 2024-09-12T16:14:58.209 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T16:14:58.272 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-12T16:14:58.272 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-12T16:14:58.273 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000112417 s, 4.6 MB/s 2024-09-12T16:14:58.274 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T16:14:58.331 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_4 2024-09-12T16:14:58.388 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T16:14:58.388 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T16:14:58.388 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-12T16:14:58.388 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T16:14:58.388 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T16:14:58.388 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-12 16:14:51.802145411 +0000 2024-09-12T16:14:58.388 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-12 16:12:13.455367559 +0000 2024-09-12T16:14:58.389 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-12 16:12:13.455367559 +0000 2024-09-12T16:14:58.389 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-09-12 16:12:13.455367559 +0000 2024-09-12T16:14:58.389 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T16:14:58.452 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-12T16:14:58.452 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-12T16:14:58.452 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000102164 s, 5.0 MB/s 2024-09-12T16:14:58.453 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T16:14:58.511 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-12T16:14:58.511 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T16:14:58.511 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T16:14:58.531 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T16:14:58.531 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_1 2024-09-12T16:14:58.590 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T16:14:58.590 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T16:14:58.591 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-12T16:14:58.591 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T16:14:58.591 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T16:14:58.591 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-09-12 16:14:45.575169295 +0000 2024-09-12T16:14:58.591 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-09-12 16:12:01.254886972 +0000 2024-09-12T16:14:58.591 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-09-12 16:12:01.254886972 +0000 2024-09-12T16:14:58.591 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-09-12 16:12:01.254886972 +0000 2024-09-12T16:14:58.591 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T16:14:58.661 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-09-12T16:14:58.661 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-09-12T16:14:58.661 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.0001194 s, 4.3 MB/s 2024-09-12T16:14:58.662 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T16:14:58.722 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_2 2024-09-12T16:14:58.780 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T16:14:58.780 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T16:14:58.780 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-12T16:14:58.780 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T16:14:58.780 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T16:14:58.780 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-09-12 16:14:45.575169295 +0000 2024-09-12T16:14:58.781 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-09-12 16:12:01.575880227 +0000 2024-09-12T16:14:58.781 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-09-12 16:12:01.575880227 +0000 2024-09-12T16:14:58.781 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-09-12 16:12:01.575880227 +0000 2024-09-12T16:14:58.781 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T16:14:58.848 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-09-12T16:14:58.848 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-09-12T16:14:58.848 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000119897 s, 4.3 MB/s 2024-09-12T16:14:58.850 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T16:14:58.910 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_3 2024-09-12T16:14:58.969 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T16:14:58.969 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T16:14:58.969 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-12T16:14:58.969 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T16:14:58.969 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T16:14:58.969 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-09-12 16:14:45.576169273 +0000 2024-09-12T16:14:58.969 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-09-12 16:12:01.897873462 +0000 2024-09-12T16:14:58.970 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-09-12 16:12:01.897873462 +0000 2024-09-12T16:14:58.970 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-09-12 16:12:01.897873462 +0000 2024-09-12T16:14:58.970 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T16:14:59.038 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-09-12T16:14:59.038 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-09-12T16:14:59.038 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000128464 s, 4.0 MB/s 2024-09-12T16:14:59.040 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T16:14:59.099 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_4 2024-09-12T16:14:59.158 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T16:14:59.158 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T16:14:59.158 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-12T16:14:59.158 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T16:14:59.158 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T16:14:59.158 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-09-12 16:14:45.576169273 +0000 2024-09-12T16:14:59.159 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-09-12 16:12:02.230866465 +0000 2024-09-12T16:14:59.159 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-09-12 16:12:02.230866465 +0000 2024-09-12T16:14:59.159 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-09-12 16:12:02.230866465 +0000 2024-09-12T16:14:59.159 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T16:14:59.225 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-09-12T16:14:59.226 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-09-12T16:14:59.226 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000108214 s, 4.7 MB/s 2024-09-12T16:14:59.227 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T16:14:59.286 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-12T16:14:59.286 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi017.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi047.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2024-09-12T16:14:59.286 INFO:tasks.ceph:Generating config... 2024-09-12T16:14:59.288 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-12T16:14:59.288 INFO:tasks.ceph:[global] mon warn on pool no app = False 2024-09-12T16:14:59.288 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-12T16:14:59.288 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T16:14:59.288 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T16:14:59.288 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T16:14:59.288 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T16:14:59.288 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T16:14:59.288 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T16:14:59.288 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T16:14:59.289 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-12T16:14:59.289 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T16:14:59.289 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T16:14:59.289 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T16:14:59.289 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T16:14:59.289 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T16:14:59.289 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T16:14:59.289 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T16:14:59.289 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T16:14:59.289 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T16:14:59.289 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T16:14:59.289 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-12T16:14:59.289 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T16:14:59.290 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-12T16:14:59.290 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T16:14:59.290 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T16:14:59.290 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T16:14:59.343 INFO:teuthology.orchestra.run.smithi017.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T16:14:59.345 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T16:14:59.391 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T16:14:59.416 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.17'), ('mon.c', '[v2:172.21.15.17:3301,v1:172.21.15.17:6790]'), ('mon.b', '172.21.15.47')] 2024-09-12T16:14:59.417 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.17,[v2:172.21.15.17:3301,v1:172.21.15.17:6790],172.21.15.47', 'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-12T16:14:59.417 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T16:14:59.417 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T16:14:59.473 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.17 --addv c '[v2:172.21.15.17:3301,v1:172.21.15.17:6790]' --add b 172.21.15.47 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:14:59.561 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:14:59.561 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool: generated fsid 66dcb8ed-8de5-4784-8071-fd6b3bf3b78f 2024-09-12T16:14:59.561 INFO:teuthology.orchestra.run.smithi017.stdout:setting min_mon_release = quincy 2024-09-12T16:14:59.561 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 0 2024-09-12T16:14:59.561 INFO:teuthology.orchestra.run.smithi017.stdout:fsid 66dcb8ed-8de5-4784-8071-fd6b3bf3b78f 2024-09-12T16:14:59.561 INFO:teuthology.orchestra.run.smithi017.stdout:last_changed 2024-09-12T16:14:59.560914+0000 2024-09-12T16:14:59.561 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-12T16:14:59.560914+0000 2024-09-12T16:14:59.562 INFO:teuthology.orchestra.run.smithi017.stdout:min_mon_release 17 (quincy) 2024-09-12T16:14:59.562 INFO:teuthology.orchestra.run.smithi017.stdout:election_strategy: 1 2024-09-12T16:14:59.562 INFO:teuthology.orchestra.run.smithi017.stdout:0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2024-09-12T16:14:59.562 INFO:teuthology.orchestra.run.smithi017.stdout:1: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.b 2024-09-12T16:14:59.562 INFO:teuthology.orchestra.run.smithi017.stdout:2: [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] mon.c 2024-09-12T16:14:59.562 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T16:14:59.563 DEBUG:teuthology.orchestra.run.smithi017:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T16:14:59.579 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 66dcb8ed-8de5-4784-8071-fd6b3bf3b78f... 2024-09-12T16:14:59.579 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T16:14:59.621 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T16:14:59.623 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T16:14:59.662 INFO:teuthology.orchestra.run.smithi017.stdout:[global] 2024-09-12T16:14:59.663 INFO:teuthology.orchestra.run.smithi017.stdout: chdir = "" 2024-09-12T16:14:59.663 INFO:teuthology.orchestra.run.smithi017.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T16:14:59.663 INFO:teuthology.orchestra.run.smithi017.stdout: auth supported = cephx 2024-09-12T16:14:59.663 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:59.663 INFO:teuthology.orchestra.run.smithi017.stdout: filestore xattr use omap = true 2024-09-12T16:14:59.663 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:59.663 INFO:teuthology.orchestra.run.smithi017.stdout: mon clock drift allowed = 1.000 2024-09-12T16:14:59.663 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:59.663 INFO:teuthology.orchestra.run.smithi017.stdout: osd crush chooseleaf type = 0 2024-09-12T16:14:59.663 INFO:teuthology.orchestra.run.smithi017.stdout: auth debug = true 2024-09-12T16:14:59.663 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:59.664 INFO:teuthology.orchestra.run.smithi017.stdout: ms die on old message = true 2024-09-12T16:14:59.664 INFO:teuthology.orchestra.run.smithi017.stdout: ms die on bug = true 2024-09-12T16:14:59.664 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:59.664 INFO:teuthology.orchestra.run.smithi017.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T16:14:59.664 INFO:teuthology.orchestra.run.smithi017.stdout: mon pg warn max object skew = 0 2024-09-12T16:14:59.664 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:59.664 INFO:teuthology.orchestra.run.smithi017.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T16:14:59.664 INFO:teuthology.orchestra.run.smithi017.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T16:14:59.664 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:59.664 INFO:teuthology.orchestra.run.smithi017.stdout: osd pool default size = 2 2024-09-12T16:14:59.664 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:59.664 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd allow primary affinity = true 2024-09-12T16:14:59.664 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd allow pg remap = true 2024-09-12T16:14:59.665 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on legacy crush tunables = false 2024-09-12T16:14:59.665 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on crush straw calc version zero = false 2024-09-12T16:14:59.665 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on no sortbitwise = false 2024-09-12T16:14:59.665 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on osd down out interval zero = false 2024-09-12T16:14:59.665 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on too few osds = false 2024-09-12T16:14:59.665 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T16:14:59.665 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T16:14:59.665 INFO:teuthology.orchestra.run.smithi017.stdout: mon_allow_pool_size_one = true 2024-09-12T16:14:59.665 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:59.665 INFO:teuthology.orchestra.run.smithi017.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T16:14:59.665 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:59.665 INFO:teuthology.orchestra.run.smithi017.stdout: osd default data pool replay window = 5 2024-09-12T16:14:59.665 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:59.665 INFO:teuthology.orchestra.run.smithi017.stdout: mon allow pool delete = true 2024-09-12T16:14:59.666 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:59.666 INFO:teuthology.orchestra.run.smithi017.stdout: mon cluster log file level = debug 2024-09-12T16:14:59.666 INFO:teuthology.orchestra.run.smithi017.stdout: debug asserts on shutdown = true 2024-09-12T16:14:59.666 INFO:teuthology.orchestra.run.smithi017.stdout: mon health detail to clog = false 2024-09-12T16:14:59.666 INFO:teuthology.orchestra.run.smithi017.stdout: mon host = "172.21.15.17,[v2:172.21.15.17:3301,v1:172.21.15.17:6790],172.21.15.47" 2024-09-12T16:14:59.666 INFO:teuthology.orchestra.run.smithi017.stdout: mon client directed command retry = 5 2024-09-12T16:14:59.666 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on pool no app = False 2024-09-12T16:14:59.666 INFO:teuthology.orchestra.run.smithi017.stdout: ms inject socket failures = 5000 2024-09-12T16:14:59.666 INFO:teuthology.orchestra.run.smithi017.stdout: fsid = 66dcb8ed-8de5-4784-8071-fd6b3bf3b78f 2024-09-12T16:14:59.666 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:59.666 INFO:teuthology.orchestra.run.smithi017.stdout:[osd] 2024-09-12T16:14:59.666 INFO:teuthology.orchestra.run.smithi017.stdout: osd journal size = 100 2024-09-12T16:14:59.667 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:59.667 INFO:teuthology.orchestra.run.smithi017.stdout: osd scrub load threshold = 5.0 2024-09-12T16:14:59.667 INFO:teuthology.orchestra.run.smithi017.stdout: osd scrub max interval = 600 2024-09-12T16:14:59.667 INFO:teuthology.orchestra.run.smithi017.stdout: osd mclock profile = high_recovery_ops 2024-09-12T16:14:59.667 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:59.667 INFO:teuthology.orchestra.run.smithi017.stdout: osd recover clone overlap = true 2024-09-12T16:14:59.667 INFO:teuthology.orchestra.run.smithi017.stdout: osd recovery max chunk = 1048576 2024-09-12T16:14:59.667 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:59.667 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug shutdown = true 2024-09-12T16:14:59.667 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug op order = true 2024-09-12T16:14:59.667 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug verify stray on activate = true 2024-09-12T16:14:59.667 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug trim objects = true 2024-09-12T16:14:59.668 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:59.668 INFO:teuthology.orchestra.run.smithi017.stdout: osd open classes on start = true 2024-09-12T16:14:59.668 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug pg log writeout = true 2024-09-12T16:14:59.668 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:59.668 INFO:teuthology.orchestra.run.smithi017.stdout: osd deep scrub update digest min age = 30 2024-09-12T16:14:59.668 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:59.668 INFO:teuthology.orchestra.run.smithi017.stdout: osd map max advance = 10 2024-09-12T16:14:59.668 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:59.668 INFO:teuthology.orchestra.run.smithi017.stdout: journal zero on create = true 2024-09-12T16:14:59.668 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:59.668 INFO:teuthology.orchestra.run.smithi017.stdout: filestore ondisk finisher threads = 3 2024-09-12T16:14:59.668 INFO:teuthology.orchestra.run.smithi017.stdout: filestore apply finisher threads = 3 2024-09-12T16:14:59.668 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:59.668 INFO:teuthology.orchestra.run.smithi017.stdout: bdev debug aio = true 2024-09-12T16:14:59.669 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug misdirected ops = true 2024-09-12T16:14:59.669 INFO:teuthology.orchestra.run.smithi017.stdout: bdev async discard = True 2024-09-12T16:14:59.669 INFO:teuthology.orchestra.run.smithi017.stdout: bdev enable discard = True 2024-09-12T16:14:59.669 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore allocator = bitmap 2024-09-12T16:14:59.669 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore block size = 96636764160 2024-09-12T16:14:59.669 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore fsck on mount = True 2024-09-12T16:14:59.669 INFO:teuthology.orchestra.run.smithi017.stdout: debug bluefs = 1/20 2024-09-12T16:14:59.669 INFO:teuthology.orchestra.run.smithi017.stdout: debug bluestore = 1/20 2024-09-12T16:14:59.669 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-09-12T16:14:59.669 INFO:teuthology.orchestra.run.smithi017.stdout: debug osd = 20 2024-09-12T16:14:59.670 INFO:teuthology.orchestra.run.smithi017.stdout: debug rocksdb = 4/10 2024-09-12T16:14:59.670 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T16:14:59.670 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd full ratio = 0.9 2024-09-12T16:14:59.670 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd nearfull ratio = 0.8 2024-09-12T16:14:59.670 INFO:teuthology.orchestra.run.smithi017.stdout: osd blocked scrub grace period = 3600 2024-09-12T16:14:59.670 INFO:teuthology.orchestra.run.smithi017.stdout: osd failsafe full ratio = 0.95 2024-09-12T16:14:59.670 INFO:teuthology.orchestra.run.smithi017.stdout: osd max markdown count = 1000 2024-09-12T16:14:59.671 INFO:teuthology.orchestra.run.smithi017.stdout: osd objectstore = bluestore 2024-09-12T16:14:59.671 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:59.671 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr] 2024-09-12T16:14:59.671 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-09-12T16:14:59.671 INFO:teuthology.orchestra.run.smithi017.stdout: debug mgr = 20 2024-09-12T16:14:59.671 INFO:teuthology.orchestra.run.smithi017.stdout: debug mon = 20 2024-09-12T16:14:59.671 INFO:teuthology.orchestra.run.smithi017.stdout: debug auth = 20 2024-09-12T16:14:59.671 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min pgs per osd = 4 2024-09-12T16:14:59.672 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min bytes per osd = 10 2024-09-12T16:14:59.672 INFO:teuthology.orchestra.run.smithi017.stdout: mgr/telemetry/nag = false 2024-09-12T16:14:59.672 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:59.672 INFO:teuthology.orchestra.run.smithi017.stdout:[mon] 2024-09-12T16:14:59.672 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-09-12T16:14:59.672 INFO:teuthology.orchestra.run.smithi017.stdout: debug mon = 20 2024-09-12T16:14:59.672 INFO:teuthology.orchestra.run.smithi017.stdout: debug paxos = 20 2024-09-12T16:14:59.672 INFO:teuthology.orchestra.run.smithi017.stdout: debug auth = 20 2024-09-12T16:14:59.672 INFO:teuthology.orchestra.run.smithi017.stdout: mon data avail warn = 5 2024-09-12T16:14:59.672 INFO:teuthology.orchestra.run.smithi017.stdout: mon mgr mkfs grace = 240 2024-09-12T16:14:59.673 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min pgs per osd = 4 2024-09-12T16:14:59.673 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd reporter subtree level = osd 2024-09-12T16:14:59.673 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd prime pg temp = true 2024-09-12T16:14:59.673 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min bytes per osd = 10 2024-09-12T16:14:59.673 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:59.673 INFO:teuthology.orchestra.run.smithi017.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T16:14:59.673 INFO:teuthology.orchestra.run.smithi017.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T16:14:59.674 INFO:teuthology.orchestra.run.smithi017.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T16:14:59.674 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:59.674 INFO:teuthology.orchestra.run.smithi017.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T16:14:59.674 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T16:14:59.674 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T16:14:59.674 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:59.674 INFO:teuthology.orchestra.run.smithi017.stdout: # 1m isn't quite enough 2024-09-12T16:14:59.674 INFO:teuthology.orchestra.run.smithi017.stdout: mon_down_mkfs_grace = 2m 2024-09-12T16:14:59.674 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:59.674 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_filestore_osds = false 2024-09-12T16:14:59.675 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:14:59.675 INFO:teuthology.orchestra.run.smithi017.stdout:[client] 2024-09-12T16:14:59.675 INFO:teuthology.orchestra.run.smithi017.stdout: rgw cache enabled = true 2024-09-12T16:14:59.675 INFO:teuthology.orchestra.run.smithi017.stdout: rgw enable ops log = true 2024-09-12T16:14:59.675 INFO:teuthology.orchestra.run.smithi017.stdout: rgw enable usage log = true 2024-09-12T16:14:59.675 INFO:teuthology.orchestra.run.smithi017.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T16:14:59.675 INFO:teuthology.orchestra.run.smithi017.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T16:14:59.675 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.a] 2024-09-12T16:14:59.675 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.c] 2024-09-12T16:14:59.675 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.b] 2024-09-12T16:14:59.676 INFO:teuthology.orchestra.run.smithi204.stdout:[global] 2024-09-12T16:14:59.676 INFO:teuthology.orchestra.run.smithi204.stdout: chdir = "" 2024-09-12T16:14:59.676 INFO:teuthology.orchestra.run.smithi204.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T16:14:59.676 INFO:teuthology.orchestra.run.smithi204.stdout: auth supported = cephx 2024-09-12T16:14:59.676 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:59.676 INFO:teuthology.orchestra.run.smithi204.stdout: filestore xattr use omap = true 2024-09-12T16:14:59.676 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:59.676 INFO:teuthology.orchestra.run.smithi204.stdout: mon clock drift allowed = 1.000 2024-09-12T16:14:59.677 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:59.677 INFO:teuthology.orchestra.run.smithi204.stdout: osd crush chooseleaf type = 0 2024-09-12T16:14:59.677 INFO:teuthology.orchestra.run.smithi204.stdout: auth debug = true 2024-09-12T16:14:59.677 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:59.677 INFO:teuthology.orchestra.run.smithi204.stdout: ms die on old message = true 2024-09-12T16:14:59.677 INFO:teuthology.orchestra.run.smithi204.stdout: ms die on bug = true 2024-09-12T16:14:59.677 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:59.677 INFO:teuthology.orchestra.run.smithi204.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T16:14:59.677 INFO:teuthology.orchestra.run.smithi204.stdout: mon pg warn max object skew = 0 2024-09-12T16:14:59.677 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:59.678 INFO:teuthology.orchestra.run.smithi204.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T16:14:59.678 INFO:teuthology.orchestra.run.smithi204.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T16:14:59.678 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:59.678 INFO:teuthology.orchestra.run.smithi204.stdout: osd pool default size = 2 2024-09-12T16:14:59.678 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:59.678 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd allow primary affinity = true 2024-09-12T16:14:59.678 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd allow pg remap = true 2024-09-12T16:14:59.678 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on legacy crush tunables = false 2024-09-12T16:14:59.678 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on crush straw calc version zero = false 2024-09-12T16:14:59.678 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on no sortbitwise = false 2024-09-12T16:14:59.678 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on osd down out interval zero = false 2024-09-12T16:14:59.679 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on too few osds = false 2024-09-12T16:14:59.679 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T16:14:59.679 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T16:14:59.679 INFO:teuthology.orchestra.run.smithi204.stdout: mon_allow_pool_size_one = true 2024-09-12T16:14:59.679 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:59.679 INFO:teuthology.orchestra.run.smithi204.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T16:14:59.679 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:59.679 INFO:teuthology.orchestra.run.smithi204.stdout: osd default data pool replay window = 5 2024-09-12T16:14:59.679 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:59.679 INFO:teuthology.orchestra.run.smithi204.stdout: mon allow pool delete = true 2024-09-12T16:14:59.679 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:59.680 INFO:teuthology.orchestra.run.smithi204.stdout: mon cluster log file level = debug 2024-09-12T16:14:59.680 INFO:teuthology.orchestra.run.smithi204.stdout: debug asserts on shutdown = true 2024-09-12T16:14:59.680 INFO:teuthology.orchestra.run.smithi204.stdout: mon health detail to clog = false 2024-09-12T16:14:59.680 INFO:teuthology.orchestra.run.smithi204.stdout: mon host = "172.21.15.17,[v2:172.21.15.17:3301,v1:172.21.15.17:6790],172.21.15.47" 2024-09-12T16:14:59.680 INFO:teuthology.orchestra.run.smithi204.stdout: mon client directed command retry = 5 2024-09-12T16:14:59.680 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on pool no app = False 2024-09-12T16:14:59.680 INFO:teuthology.orchestra.run.smithi204.stdout: ms inject socket failures = 5000 2024-09-12T16:14:59.680 INFO:teuthology.orchestra.run.smithi204.stdout: fsid = 66dcb8ed-8de5-4784-8071-fd6b3bf3b78f 2024-09-12T16:14:59.680 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:59.680 INFO:teuthology.orchestra.run.smithi204.stdout:[osd] 2024-09-12T16:14:59.680 INFO:teuthology.orchestra.run.smithi204.stdout: osd journal size = 100 2024-09-12T16:14:59.681 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:59.681 INFO:teuthology.orchestra.run.smithi204.stdout: osd scrub load threshold = 5.0 2024-09-12T16:14:59.681 INFO:teuthology.orchestra.run.smithi204.stdout: osd scrub max interval = 600 2024-09-12T16:14:59.681 INFO:teuthology.orchestra.run.smithi204.stdout: osd mclock profile = high_recovery_ops 2024-09-12T16:14:59.681 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:59.681 INFO:teuthology.orchestra.run.smithi204.stdout: osd recover clone overlap = true 2024-09-12T16:14:59.681 INFO:teuthology.orchestra.run.smithi204.stdout: osd recovery max chunk = 1048576 2024-09-12T16:14:59.681 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:59.681 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug shutdown = true 2024-09-12T16:14:59.681 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug op order = true 2024-09-12T16:14:59.681 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug verify stray on activate = true 2024-09-12T16:14:59.682 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug trim objects = true 2024-09-12T16:14:59.682 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:59.682 INFO:teuthology.orchestra.run.smithi204.stdout: osd open classes on start = true 2024-09-12T16:14:59.682 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug pg log writeout = true 2024-09-12T16:14:59.682 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:59.682 INFO:teuthology.orchestra.run.smithi204.stdout: osd deep scrub update digest min age = 30 2024-09-12T16:14:59.682 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:59.682 INFO:teuthology.orchestra.run.smithi204.stdout: osd map max advance = 10 2024-09-12T16:14:59.682 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:59.682 INFO:teuthology.orchestra.run.smithi204.stdout: journal zero on create = true 2024-09-12T16:14:59.682 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:59.682 INFO:teuthology.orchestra.run.smithi204.stdout: filestore ondisk finisher threads = 3 2024-09-12T16:14:59.683 INFO:teuthology.orchestra.run.smithi204.stdout: filestore apply finisher threads = 3 2024-09-12T16:14:59.683 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:59.683 INFO:teuthology.orchestra.run.smithi204.stdout: bdev debug aio = true 2024-09-12T16:14:59.683 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug misdirected ops = true 2024-09-12T16:14:59.683 INFO:teuthology.orchestra.run.smithi204.stdout: bdev async discard = True 2024-09-12T16:14:59.683 INFO:teuthology.orchestra.run.smithi204.stdout: bdev enable discard = True 2024-09-12T16:14:59.683 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore allocator = bitmap 2024-09-12T16:14:59.683 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore block size = 96636764160 2024-09-12T16:14:59.683 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore fsck on mount = True 2024-09-12T16:14:59.683 INFO:teuthology.orchestra.run.smithi204.stdout: debug bluefs = 1/20 2024-09-12T16:14:59.683 INFO:teuthology.orchestra.run.smithi204.stdout: debug bluestore = 1/20 2024-09-12T16:14:59.683 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-09-12T16:14:59.684 INFO:teuthology.orchestra.run.smithi204.stdout: debug osd = 20 2024-09-12T16:14:59.684 INFO:teuthology.orchestra.run.smithi204.stdout: debug rocksdb = 4/10 2024-09-12T16:14:59.684 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T16:14:59.684 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd full ratio = 0.9 2024-09-12T16:14:59.684 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd nearfull ratio = 0.8 2024-09-12T16:14:59.684 INFO:teuthology.orchestra.run.smithi204.stdout: osd blocked scrub grace period = 3600 2024-09-12T16:14:59.684 INFO:teuthology.orchestra.run.smithi204.stdout: osd failsafe full ratio = 0.95 2024-09-12T16:14:59.684 INFO:teuthology.orchestra.run.smithi204.stdout: osd max markdown count = 1000 2024-09-12T16:14:59.684 INFO:teuthology.orchestra.run.smithi204.stdout: osd objectstore = bluestore 2024-09-12T16:14:59.684 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:59.684 INFO:teuthology.orchestra.run.smithi204.stdout:[mgr] 2024-09-12T16:14:59.684 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-09-12T16:14:59.684 INFO:teuthology.orchestra.run.smithi204.stdout: debug mgr = 20 2024-09-12T16:14:59.685 INFO:teuthology.orchestra.run.smithi204.stdout: debug mon = 20 2024-09-12T16:14:59.685 INFO:teuthology.orchestra.run.smithi204.stdout: debug auth = 20 2024-09-12T16:14:59.685 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min pgs per osd = 4 2024-09-12T16:14:59.685 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min bytes per osd = 10 2024-09-12T16:14:59.685 INFO:teuthology.orchestra.run.smithi204.stdout: mgr/telemetry/nag = false 2024-09-12T16:14:59.685 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:59.685 INFO:teuthology.orchestra.run.smithi204.stdout:[mon] 2024-09-12T16:14:59.685 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-09-12T16:14:59.685 INFO:teuthology.orchestra.run.smithi204.stdout: debug mon = 20 2024-09-12T16:14:59.685 INFO:teuthology.orchestra.run.smithi204.stdout: debug paxos = 20 2024-09-12T16:14:59.685 INFO:teuthology.orchestra.run.smithi204.stdout: debug auth = 20 2024-09-12T16:14:59.685 INFO:teuthology.orchestra.run.smithi204.stdout: mon data avail warn = 5 2024-09-12T16:14:59.685 INFO:teuthology.orchestra.run.smithi204.stdout: mon mgr mkfs grace = 240 2024-09-12T16:14:59.686 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min pgs per osd = 4 2024-09-12T16:14:59.686 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd reporter subtree level = osd 2024-09-12T16:14:59.686 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd prime pg temp = true 2024-09-12T16:14:59.686 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min bytes per osd = 10 2024-09-12T16:14:59.686 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:59.686 INFO:teuthology.orchestra.run.smithi204.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T16:14:59.686 INFO:teuthology.orchestra.run.smithi204.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T16:14:59.686 INFO:teuthology.orchestra.run.smithi204.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T16:14:59.686 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:59.686 INFO:teuthology.orchestra.run.smithi204.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T16:14:59.686 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T16:14:59.687 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T16:14:59.687 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:59.687 INFO:teuthology.orchestra.run.smithi204.stdout: # 1m isn't quite enough 2024-09-12T16:14:59.687 INFO:teuthology.orchestra.run.smithi204.stdout: mon_down_mkfs_grace = 2m 2024-09-12T16:14:59.687 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:59.687 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_filestore_osds = false 2024-09-12T16:14:59.687 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T16:14:59.687 INFO:teuthology.orchestra.run.smithi204.stdout:[client] 2024-09-12T16:14:59.687 INFO:teuthology.orchestra.run.smithi204.stdout: rgw cache enabled = true 2024-09-12T16:14:59.687 INFO:teuthology.orchestra.run.smithi204.stdout: rgw enable ops log = true 2024-09-12T16:14:59.687 INFO:teuthology.orchestra.run.smithi204.stdout: rgw enable usage log = true 2024-09-12T16:14:59.687 INFO:teuthology.orchestra.run.smithi204.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T16:14:59.687 INFO:teuthology.orchestra.run.smithi204.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T16:14:59.687 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.a] 2024-09-12T16:14:59.688 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.c] 2024-09-12T16:14:59.688 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.b] 2024-09-12T16:14:59.688 INFO:teuthology.orchestra.run.smithi047.stdout:[global] 2024-09-12T16:14:59.688 INFO:teuthology.orchestra.run.smithi047.stdout: chdir = "" 2024-09-12T16:14:59.688 INFO:teuthology.orchestra.run.smithi047.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T16:14:59.688 INFO:teuthology.orchestra.run.smithi047.stdout: auth supported = cephx 2024-09-12T16:14:59.688 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:59.688 INFO:teuthology.orchestra.run.smithi047.stdout: filestore xattr use omap = true 2024-09-12T16:14:59.688 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:59.688 INFO:teuthology.orchestra.run.smithi047.stdout: mon clock drift allowed = 1.000 2024-09-12T16:14:59.689 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:59.689 INFO:teuthology.orchestra.run.smithi047.stdout: osd crush chooseleaf type = 0 2024-09-12T16:14:59.689 INFO:teuthology.orchestra.run.smithi047.stdout: auth debug = true 2024-09-12T16:14:59.689 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:59.689 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on old message = true 2024-09-12T16:14:59.689 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on bug = true 2024-09-12T16:14:59.689 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:59.689 INFO:teuthology.orchestra.run.smithi047.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T16:14:59.689 INFO:teuthology.orchestra.run.smithi047.stdout: mon pg warn max object skew = 0 2024-09-12T16:14:59.689 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:59.689 INFO:teuthology.orchestra.run.smithi047.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T16:14:59.689 INFO:teuthology.orchestra.run.smithi047.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T16:14:59.689 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:59.690 INFO:teuthology.orchestra.run.smithi047.stdout: osd pool default size = 2 2024-09-12T16:14:59.690 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:59.690 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd allow primary affinity = true 2024-09-12T16:14:59.690 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd allow pg remap = true 2024-09-12T16:14:59.690 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on legacy crush tunables = false 2024-09-12T16:14:59.690 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on crush straw calc version zero = false 2024-09-12T16:14:59.690 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on no sortbitwise = false 2024-09-12T16:14:59.690 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on osd down out interval zero = false 2024-09-12T16:14:59.690 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on too few osds = false 2024-09-12T16:14:59.690 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T16:14:59.691 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T16:14:59.691 INFO:teuthology.orchestra.run.smithi047.stdout: mon_allow_pool_size_one = true 2024-09-12T16:14:59.691 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:59.691 INFO:teuthology.orchestra.run.smithi047.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T16:14:59.691 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:59.691 INFO:teuthology.orchestra.run.smithi047.stdout: osd default data pool replay window = 5 2024-09-12T16:14:59.691 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:59.691 INFO:teuthology.orchestra.run.smithi047.stdout: mon allow pool delete = true 2024-09-12T16:14:59.691 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:59.691 INFO:teuthology.orchestra.run.smithi047.stdout: mon cluster log file level = debug 2024-09-12T16:14:59.691 INFO:teuthology.orchestra.run.smithi047.stdout: debug asserts on shutdown = true 2024-09-12T16:14:59.691 INFO:teuthology.orchestra.run.smithi047.stdout: mon health detail to clog = false 2024-09-12T16:14:59.691 INFO:teuthology.orchestra.run.smithi047.stdout: mon host = "172.21.15.17,[v2:172.21.15.17:3301,v1:172.21.15.17:6790],172.21.15.47" 2024-09-12T16:14:59.691 INFO:teuthology.orchestra.run.smithi047.stdout: mon client directed command retry = 5 2024-09-12T16:14:59.692 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on pool no app = False 2024-09-12T16:14:59.692 INFO:teuthology.orchestra.run.smithi047.stdout: ms inject socket failures = 5000 2024-09-12T16:14:59.692 INFO:teuthology.orchestra.run.smithi047.stdout: fsid = 66dcb8ed-8de5-4784-8071-fd6b3bf3b78f 2024-09-12T16:14:59.692 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:59.692 INFO:teuthology.orchestra.run.smithi047.stdout:[osd] 2024-09-12T16:14:59.692 INFO:teuthology.orchestra.run.smithi047.stdout: osd journal size = 100 2024-09-12T16:14:59.692 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:59.692 INFO:teuthology.orchestra.run.smithi047.stdout: osd scrub load threshold = 5.0 2024-09-12T16:14:59.692 INFO:teuthology.orchestra.run.smithi047.stdout: osd scrub max interval = 600 2024-09-12T16:14:59.692 INFO:teuthology.orchestra.run.smithi047.stdout: osd mclock profile = high_recovery_ops 2024-09-12T16:14:59.692 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:59.693 INFO:teuthology.orchestra.run.smithi047.stdout: osd recover clone overlap = true 2024-09-12T16:14:59.693 INFO:teuthology.orchestra.run.smithi047.stdout: osd recovery max chunk = 1048576 2024-09-12T16:14:59.693 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:59.693 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug shutdown = true 2024-09-12T16:14:59.693 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug op order = true 2024-09-12T16:14:59.693 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug verify stray on activate = true 2024-09-12T16:14:59.693 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug trim objects = true 2024-09-12T16:14:59.693 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:59.693 INFO:teuthology.orchestra.run.smithi047.stdout: osd open classes on start = true 2024-09-12T16:14:59.693 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug pg log writeout = true 2024-09-12T16:14:59.693 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:59.693 INFO:teuthology.orchestra.run.smithi047.stdout: osd deep scrub update digest min age = 30 2024-09-12T16:14:59.693 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:59.694 INFO:teuthology.orchestra.run.smithi047.stdout: osd map max advance = 10 2024-09-12T16:14:59.694 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:59.694 INFO:teuthology.orchestra.run.smithi047.stdout: journal zero on create = true 2024-09-12T16:14:59.694 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:59.694 INFO:teuthology.orchestra.run.smithi047.stdout: filestore ondisk finisher threads = 3 2024-09-12T16:14:59.694 INFO:teuthology.orchestra.run.smithi047.stdout: filestore apply finisher threads = 3 2024-09-12T16:14:59.694 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:59.694 INFO:teuthology.orchestra.run.smithi047.stdout: bdev debug aio = true 2024-09-12T16:14:59.694 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug misdirected ops = true 2024-09-12T16:14:59.694 INFO:teuthology.orchestra.run.smithi047.stdout: bdev async discard = True 2024-09-12T16:14:59.694 INFO:teuthology.orchestra.run.smithi047.stdout: bdev enable discard = True 2024-09-12T16:14:59.694 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore allocator = bitmap 2024-09-12T16:14:59.694 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore block size = 96636764160 2024-09-12T16:14:59.694 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore fsck on mount = True 2024-09-12T16:14:59.694 INFO:teuthology.orchestra.run.smithi047.stdout: debug bluefs = 1/20 2024-09-12T16:14:59.695 INFO:teuthology.orchestra.run.smithi047.stdout: debug bluestore = 1/20 2024-09-12T16:14:59.695 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-09-12T16:14:59.695 INFO:teuthology.orchestra.run.smithi047.stdout: debug osd = 20 2024-09-12T16:14:59.695 INFO:teuthology.orchestra.run.smithi047.stdout: debug rocksdb = 4/10 2024-09-12T16:14:59.695 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T16:14:59.695 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd full ratio = 0.9 2024-09-12T16:14:59.695 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd nearfull ratio = 0.8 2024-09-12T16:14:59.695 INFO:teuthology.orchestra.run.smithi047.stdout: osd blocked scrub grace period = 3600 2024-09-12T16:14:59.695 INFO:teuthology.orchestra.run.smithi047.stdout: osd failsafe full ratio = 0.95 2024-09-12T16:14:59.695 INFO:teuthology.orchestra.run.smithi047.stdout: osd max markdown count = 1000 2024-09-12T16:14:59.695 INFO:teuthology.orchestra.run.smithi047.stdout: osd objectstore = bluestore 2024-09-12T16:14:59.695 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:59.695 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr] 2024-09-12T16:14:59.695 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-09-12T16:14:59.696 INFO:teuthology.orchestra.run.smithi047.stdout: debug mgr = 20 2024-09-12T16:14:59.696 INFO:teuthology.orchestra.run.smithi047.stdout: debug mon = 20 2024-09-12T16:14:59.696 INFO:teuthology.orchestra.run.smithi047.stdout: debug auth = 20 2024-09-12T16:14:59.696 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min pgs per osd = 4 2024-09-12T16:14:59.696 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min bytes per osd = 10 2024-09-12T16:14:59.696 INFO:teuthology.orchestra.run.smithi047.stdout: mgr/telemetry/nag = false 2024-09-12T16:14:59.696 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:59.696 INFO:teuthology.orchestra.run.smithi047.stdout:[mon] 2024-09-12T16:14:59.696 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-09-12T16:14:59.696 INFO:teuthology.orchestra.run.smithi047.stdout: debug mon = 20 2024-09-12T16:14:59.696 INFO:teuthology.orchestra.run.smithi047.stdout: debug paxos = 20 2024-09-12T16:14:59.696 INFO:teuthology.orchestra.run.smithi047.stdout: debug auth = 20 2024-09-12T16:14:59.696 INFO:teuthology.orchestra.run.smithi047.stdout: mon data avail warn = 5 2024-09-12T16:14:59.696 INFO:teuthology.orchestra.run.smithi047.stdout: mon mgr mkfs grace = 240 2024-09-12T16:14:59.697 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min pgs per osd = 4 2024-09-12T16:14:59.697 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd reporter subtree level = osd 2024-09-12T16:14:59.697 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd prime pg temp = true 2024-09-12T16:14:59.697 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min bytes per osd = 10 2024-09-12T16:14:59.697 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:59.697 INFO:teuthology.orchestra.run.smithi047.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T16:14:59.697 INFO:teuthology.orchestra.run.smithi047.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T16:14:59.697 INFO:teuthology.orchestra.run.smithi047.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T16:14:59.697 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:59.697 INFO:teuthology.orchestra.run.smithi047.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T16:14:59.697 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T16:14:59.697 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T16:14:59.698 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:59.698 INFO:teuthology.orchestra.run.smithi047.stdout: # 1m isn't quite enough 2024-09-12T16:14:59.698 INFO:teuthology.orchestra.run.smithi047.stdout: mon_down_mkfs_grace = 2m 2024-09-12T16:14:59.698 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:59.698 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_filestore_osds = false 2024-09-12T16:14:59.698 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T16:14:59.698 INFO:teuthology.orchestra.run.smithi047.stdout:[client] 2024-09-12T16:14:59.698 INFO:teuthology.orchestra.run.smithi047.stdout: rgw cache enabled = true 2024-09-12T16:14:59.698 INFO:teuthology.orchestra.run.smithi047.stdout: rgw enable ops log = true 2024-09-12T16:14:59.699 INFO:teuthology.orchestra.run.smithi047.stdout: rgw enable usage log = true 2024-09-12T16:14:59.699 INFO:teuthology.orchestra.run.smithi047.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T16:14:59.699 INFO:teuthology.orchestra.run.smithi047.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T16:14:59.699 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.a] 2024-09-12T16:14:59.699 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.c] 2024-09-12T16:14:59.699 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.b] 2024-09-12T16:14:59.702 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T16:14:59.703 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T16:14:59.797 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T16:14:59.797 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T16:14:59.797 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T16:14:59.813 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T16:14:59.813 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T16:14:59.868 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi017.front.sepia.ceph.com 2024-09-12T16:14:59.869 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T16:14:59.869 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T16:14:59.869 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T16:14:59.944 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T16:14:59.944 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:15:00.001 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi047.front.sepia.ceph.com 2024-09-12T16:15:00.001 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T16:15:00.001 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T16:15:00.001 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T16:15:00.044 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T16:15:00.044 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:15:00.103 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T16:15:00.103 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T16:15:00.103 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T16:15:00.103 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T16:15:00.144 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T16:15:00.144 DEBUG:teuthology.orchestra.run.smithi204:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:15:00.201 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T16:15:00.202 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T16:15:00.202 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T16:15:00.269 INFO:teuthology.orchestra.run.smithi047.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T16:15:00.272 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T16:15:00.272 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T16:15:00.272 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T16:15:00.327 INFO:teuthology.orchestra.run.smithi204.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T16:15:00.341 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T16:15:00.341 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi017.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi047.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2024-09-12T16:15:00.341 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T16:15:00.368 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-12T16:15:00.368 INFO:tasks.ceph:role: osd.0 2024-09-12T16:15:00.368 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-12T16:15:00.368 DEBUG:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T16:15:00.434 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T16:15:00.434 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T16:15:00.434 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T16:15:00.434 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T16:15:00.434 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T16:15:00.434 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2024-09-12T16:15:00.434 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T16:15:00.435 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T16:15:00.435 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T16:15:00.435 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T16:15:00.467 INFO:teuthology.orchestra.run.smithi017.stdout:Discarding blocks...Done. 2024-09-12T16:15:00.469 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2024-09-12T16:15:00.469 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T16:15:00.538 DEBUG:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T16:15:00.610 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T16:15:00.676 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-12T16:15:00.677 INFO:tasks.ceph:role: osd.1 2024-09-12T16:15:00.677 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-12T16:15:00.677 DEBUG:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T16:15:00.742 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T16:15:00.742 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T16:15:00.743 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T16:15:00.743 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T16:15:00.743 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T16:15:00.743 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2024-09-12T16:15:00.743 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T16:15:00.743 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T16:15:00.743 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T16:15:00.743 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T16:15:00.776 INFO:teuthology.orchestra.run.smithi017.stdout:Discarding blocks...Done. 2024-09-12T16:15:00.778 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2024-09-12T16:15:00.778 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-12T16:15:00.847 DEBUG:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T16:15:00.918 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T16:15:00.984 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-12T16:15:00.984 INFO:tasks.ceph:role: osd.2 2024-09-12T16:15:00.984 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-12T16:15:00.984 DEBUG:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T16:15:01.049 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T16:15:01.049 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T16:15:01.049 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T16:15:01.049 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T16:15:01.049 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T16:15:01.049 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2024-09-12T16:15:01.049 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T16:15:01.050 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T16:15:01.050 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T16:15:01.050 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T16:15:01.081 INFO:teuthology.orchestra.run.smithi017.stdout:Discarding blocks...Done. 2024-09-12T16:15:01.084 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2024-09-12T16:15:01.084 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-12T16:15:01.153 DEBUG:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T16:15:01.224 DEBUG:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:15:01.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-12T16:15:01.317+0000 7f90c6334640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T16:15:01.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-12T16:15:01.317+0000 7f90c6334640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T16:15:01.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-12T16:15:01.317+0000 7f90c6334640 -1 bdev(0x55f0735f5800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T16:15:01.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-12T16:15:01.318+0000 7f90c6334640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T16:15:04.489 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T16:15:04.522 DEBUG:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:15:04.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-12T16:15:04.614+0000 7facf5145640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T16:15:04.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-12T16:15:04.614+0000 7facf5145640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T16:15:04.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-12T16:15:04.614+0000 7facf5145640 -1 bdev(0x55a220d69800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T16:15:04.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-12T16:15:04.614+0000 7facf5145640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T16:15:07.782 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T16:15:07.813 DEBUG:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:15:07.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-12T16:15:07.904+0000 7fa6ee819640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T16:15:07.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-12T16:15:07.904+0000 7fa6ee819640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T16:15:07.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-12T16:15:07.904+0000 7fa6ee819640 -1 bdev(0x55f083bd3800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T16:15:07.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-12T16:15:07.904+0000 7fa6ee819640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T16:15:10.829 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T16:15:10.859 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T16:15:10.890 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-12T16:15:10.890 INFO:tasks.ceph:role: osd.3 2024-09-12T16:15:10.890 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi047.front.sepia.ceph.com 2024-09-12T16:15:10.890 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T16:15:10.960 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T16:15:10.960 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T16:15:10.960 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T16:15:10.960 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T16:15:10.960 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T16:15:10.960 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-09-12T16:15:10.960 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T16:15:10.960 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T16:15:10.960 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T16:15:10.960 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T16:15:10.994 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-09-12T16:15:10.996 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-09-12T16:15:10.996 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2024-09-12T16:15:11.067 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T16:15:11.139 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-12T16:15:11.206 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-12T16:15:11.206 INFO:tasks.ceph:role: osd.4 2024-09-12T16:15:11.206 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi047.front.sepia.ceph.com 2024-09-12T16:15:11.206 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T16:15:11.271 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T16:15:11.271 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T16:15:11.271 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T16:15:11.271 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T16:15:11.271 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T16:15:11.271 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-09-12T16:15:11.271 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T16:15:11.271 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T16:15:11.272 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T16:15:11.272 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T16:15:11.303 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-09-12T16:15:11.305 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-09-12T16:15:11.306 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2024-09-12T16:15:11.376 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-12T16:15:11.446 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-12T16:15:11.512 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-12T16:15:11.512 INFO:tasks.ceph:role: osd.5 2024-09-12T16:15:11.512 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi047.front.sepia.ceph.com 2024-09-12T16:15:11.513 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T16:15:11.578 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T16:15:11.578 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T16:15:11.578 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T16:15:11.578 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T16:15:11.578 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T16:15:11.579 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-09-12T16:15:11.579 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T16:15:11.579 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T16:15:11.579 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T16:15:11.579 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T16:15:11.610 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-09-12T16:15:11.612 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-09-12T16:15:11.612 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5 2024-09-12T16:15:11.682 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-12T16:15:11.752 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:15:11.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T16:15:11.845+0000 7efd673bf640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T16:15:11.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T16:15:11.845+0000 7efd673bf640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T16:15:11.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T16:15:11.845+0000 7efd673bf640 -1 bdev(0x5579f82bb800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T16:15:11.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T16:15:11.845+0000 7efd673bf640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T16:15:15.041 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T16:15:15.073 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:15:15.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T16:15:15.164+0000 7f56df631640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-12T16:15:15.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T16:15:15.164+0000 7f56df631640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-12T16:15:15.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T16:15:15.164+0000 7f56df631640 -1 bdev(0x55703a7a5800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-12T16:15:15.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T16:15:15.164+0000 7f56df631640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-12T16:15:18.081 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T16:15:18.111 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:15:18.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T16:15:18.202+0000 7f728c419640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-12T16:15:18.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T16:15:18.203+0000 7f728c419640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-12T16:15:18.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T16:15:18.203+0000 7f728c419640 -1 bdev(0x564155235800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-12T16:15:18.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T16:15:18.203+0000 7f728c419640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-12T16:15:21.365 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T16:15:21.395 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T16:15:21.396 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T16:15:21.396 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T16:15:21.427 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T16:15:21.427 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T16:15:21.499 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T16:15:21.499 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T16:15:21.568 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T16:15:21.568 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T16:15:21.599 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T16:15:21.600 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T16:15:21.670 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T16:15:21.670 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-12T16:15:21.739 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T16:15:21.740 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-12T16:15:21.807 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T16:15:21.807 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T16:15:21.827 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T16:15:21.827 DEBUG:teuthology.orchestra.run.smithi017:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T16:15:21.830 DEBUG:teuthology.orchestra.run.smithi047:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T16:15:21.856 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.0] 2024-09-12T16:15:21.856 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQCFE+Nm1Lv9EhAA1S9758AJBVdLtEH7rjM59w== 2024-09-12T16:15:21.856 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.1] 2024-09-12T16:15:21.856 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQCIE+NmGuGuJBAAn33pYzTOpPQIgSFVEDTMDQ== 2024-09-12T16:15:21.857 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.2] 2024-09-12T16:15:21.857 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQCLE+NmZcX/NRAA2HHvYr6CDH339gefV/G1sQ== 2024-09-12T16:15:21.857 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr.x] 2024-09-12T16:15:21.857 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQCEE+NmbKAKEBAADXlOCPOhUr+2ITHuoRxlLQ== 2024-09-12T16:15:21.857 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.3] 2024-09-12T16:15:21.857 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQCPE+NmmUZ2MhAACetu9XB0YBDjNIER/sYQKg== 2024-09-12T16:15:21.857 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.4] 2024-09-12T16:15:21.857 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQCTE+NmEXzaCRAAnliRw+iTXZiTRfiEQRmqZg== 2024-09-12T16:15:21.857 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.5] 2024-09-12T16:15:21.857 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQCWE+Nms18qDBAAIabcijcdx1b7ram6Xvk3WA== 2024-09-12T16:15:21.857 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2024-09-12T16:15:21.857 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQCEE+NmKt2JExAAD5hjl6q9Gi85jrpMigb1XQ== 2024-09-12T16:15:21.876 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.0] 2024-09-12T16:15:21.876 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCFE+Nm1Lv9EhAA1S9758AJBVdLtEH7rjM59w== 2024-09-12T16:15:21.877 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.1] 2024-09-12T16:15:21.877 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCIE+NmGuGuJBAAn33pYzTOpPQIgSFVEDTMDQ== 2024-09-12T16:15:21.877 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.2] 2024-09-12T16:15:21.877 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCLE+NmZcX/NRAA2HHvYr6CDH339gefV/G1sQ== 2024-09-12T16:15:21.877 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr.x] 2024-09-12T16:15:21.877 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCEE+NmbKAKEBAADXlOCPOhUr+2ITHuoRxlLQ== 2024-09-12T16:15:21.877 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.3] 2024-09-12T16:15:21.877 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCPE+NmmUZ2MhAACetu9XB0YBDjNIER/sYQKg== 2024-09-12T16:15:21.877 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.4] 2024-09-12T16:15:21.877 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCTE+NmEXzaCRAAnliRw+iTXZiTRfiEQRmqZg== 2024-09-12T16:15:21.877 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.5] 2024-09-12T16:15:21.877 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCWE+Nms18qDBAAIabcijcdx1b7ram6Xvk3WA== 2024-09-12T16:15:21.877 INFO:teuthology.orchestra.run.smithi047.stdout:[client.0] 2024-09-12T16:15:21.878 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCEE+NmKt2JExAAD5hjl6q9Gi85jrpMigb1XQ== 2024-09-12T16:15:21.878 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:15:21.901 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:15:21.973 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:15:21.976 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:15:22.029 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:15:22.031 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:15:22.083 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T16:15:22.085 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T16:15:22.139 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:15:22.141 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:15:22.194 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:15:22.196 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:15:22.248 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:15:22.250 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:15:22.302 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T16:15:22.305 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T16:15:22.359 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T16:15:22.360 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T16:15:22.384 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T16:15:22.482 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T16:15:22.508 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T16:15:22.573 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T16:15:22.672 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T16:15:22.697 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T16:15:22.724 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T16:15:22.822 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T16:15:22.847 DEBUG:teuthology.orchestra.run.smithi017:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:15:22.850 DEBUG:teuthology.orchestra.run.smithi047:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:15:22.903 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T16:15:22.903 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T16:15:22.904 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T16:15:22.906 INFO:tasks.ceph.mon.a:Started 2024-09-12T16:15:22.906 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T16:15:22.906 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T16:15:22.908 INFO:tasks.ceph.mon.c:Started 2024-09-12T16:15:22.908 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T16:15:22.908 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T16:15:22.945 INFO:tasks.ceph.mon.b:Started 2024-09-12T16:15:22.945 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T16:15:22.946 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T16:15:22.946 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T16:15:22.948 INFO:tasks.ceph.mgr.x:Started 2024-09-12T16:15:22.948 DEBUG:tasks.ceph:set 0 configs 2024-09-12T16:15:22.948 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T16:15:22.948 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T16:15:28.301 INFO:teuthology.orchestra.run.smithi017.stderr:adjusted tunables profile to default 2024-09-12T16:15:28.313 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T16:15:28.313 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T16:15:28.314 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T16:15:28.314 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T16:15:28.340 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T16:15:28.340 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T16:15:28.407 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T16:15:28.407 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T16:15:28.474 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T16:15:28.474 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T16:15:28.500 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T16:15:28.500 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-12T16:15:28.566 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T16:15:28.566 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-12T16:15:28.632 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd new aabea24b-3f1f-4555-80c3-5caecf2e2001 0 2024-09-12T16:15:28.857 INFO:teuthology.orchestra.run.smithi047.stdout:0 2024-09-12T16:15:28.868 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd new 7a17ca3b-8e49-4d92-a633-45d3e4a45b4e 1 2024-09-12T16:15:29.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T16:15:29.171+0000 7f626667a640 0 --2- 172.21.15.47:0/2231389167 >> v2:172.21.15.47:3300/0 conn(0x7f62600745b0 0x7f626013c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T16:15:29.255 INFO:teuthology.orchestra.run.smithi047.stdout:1 2024-09-12T16:15:29.267 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd new dae09a32-24c6-464c-bee8-04ef2c42f7e4 2 2024-09-12T16:15:29.452 INFO:teuthology.orchestra.run.smithi047.stdout:2 2024-09-12T16:15:29.463 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd new 9cc5463c-cdb4-4a6a-b526-39a60de417f4 3 2024-09-12T16:15:29.647 INFO:teuthology.orchestra.run.smithi047.stdout:3 2024-09-12T16:15:29.658 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd new 1e329af3-a88a-4a95-b822-01519079084b 4 2024-09-12T16:15:29.845 INFO:teuthology.orchestra.run.smithi047.stdout:4 2024-09-12T16:15:29.856 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd new c255a252-3afe-4aad-b44c-85820867c960 5 2024-09-12T16:15:30.042 INFO:teuthology.orchestra.run.smithi047.stdout:5 2024-09-12T16:15:30.053 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T16:15:30.053 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T16:15:30.056 INFO:tasks.ceph.osd.0:Started 2024-09-12T16:15:30.056 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T16:15:30.056 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T16:15:30.058 INFO:tasks.ceph.osd.1:Started 2024-09-12T16:15:30.059 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T16:15:30.059 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T16:15:30.061 INFO:tasks.ceph.osd.2:Started 2024-09-12T16:15:30.061 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T16:15:30.061 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T16:15:30.064 INFO:tasks.ceph.osd.3:Started 2024-09-12T16:15:30.064 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T16:15:30.064 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T16:15:30.066 INFO:tasks.ceph.osd.4:Started 2024-09-12T16:15:30.066 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T16:15:30.066 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T16:15:30.069 INFO:tasks.ceph.osd.5:Started 2024-09-12T16:15:30.069 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T16:15:30.256 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:15:30.256 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":8,"fsid":"66dcb8ed-8de5-4784-8071-fd6b3bf3b78f","created":"2024-09-12T16:15:28.208893+0000","modified":"2024-09-12T16:15:30.039657+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T16:15:30.039657+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"aabea24b-3f1f-4555-80c3-5caecf2e2001","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7a17ca3b-8e49-4d92-a633-45d3e4a45b4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"dae09a32-24c6-464c-bee8-04ef2c42f7e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9cc5463c-cdb4-4a6a-b526-39a60de417f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1e329af3-a88a-4a95-b822-01519079084b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c255a252-3afe-4aad-b44c-85820867c960","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T16:15:30.267 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T16:15:30.267 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T16:15:30.871 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T16:15:31.046 INFO:teuthology.misc.health.smithi017.stdout: 2024-09-12T16:15:31.046 INFO:teuthology.misc.health.smithi017.stdout:{"epoch":8,"fsid":"66dcb8ed-8de5-4784-8071-fd6b3bf3b78f","created":"2024-09-12T16:15:28.208893+0000","modified":"2024-09-12T16:15:30.039657+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T16:15:30.039657+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"aabea24b-3f1f-4555-80c3-5caecf2e2001","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7a17ca3b-8e49-4d92-a633-45d3e4a45b4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"dae09a32-24c6-464c-bee8-04ef2c42f7e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9cc5463c-cdb4-4a6a-b526-39a60de417f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1e329af3-a88a-4a95-b822-01519079084b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c255a252-3afe-4aad-b44c-85820867c960","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T16:15:31.056 DEBUG:teuthology.misc:0 of 6 OSDs are up 2024-09-12T16:15:31.267 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:15:31.267+0000 7f5645754640 -1 Falling back to public interface 2024-09-12T16:15:31.269 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:15:31.268+0000 7f0030a0b640 -1 Falling back to public interface 2024-09-12T16:15:31.285 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:15:31.284+0000 7fc51f956640 -1 Falling back to public interface 2024-09-12T16:15:31.509 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:15:31.508+0000 7f1c72bfd640 -1 Falling back to public interface 2024-09-12T16:15:31.517 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:15:31.517+0000 7f97b5fc5640 -1 Falling back to public interface 2024-09-12T16:15:31.747 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:15:31.746+0000 7f0b71c1e640 -1 Falling back to public interface 2024-09-12T16:15:33.665 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-09-12T16:15:33.664+0000 7fd458b99640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T16:15:33.665 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-09-12T16:15:33.665+0000 7fd458b99640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T16:15:34.777 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:15:34.776+0000 7f5645754640 -1 osd.0 0 log_to_monitors true 2024-09-12T16:15:35.065 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:15:35.065+0000 7f0030a0b640 -1 osd.5 0 log_to_monitors true 2024-09-12T16:15:35.081 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:15:35.081+0000 7f1c72bfd640 -1 osd.3 0 log_to_monitors true 2024-09-12T16:15:35.297 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:15:35.297+0000 7f97b5fc5640 -1 osd.4 0 log_to_monitors true 2024-09-12T16:15:35.313 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:15:35.312+0000 7fc51f956640 -1 osd.1 0 log_to_monitors true 2024-09-12T16:15:35.504 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:15:35.504+0000 7f0b71c1e640 -1 osd.2 0 log_to_monitors true 2024-09-12T16:15:37.662 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T16:15:37.746 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:15:37.745+0000 7fc51c0f9640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T16:15:37.759 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:15:37.758+0000 7fc513704640 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T16:15:37.761 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:15:37.760+0000 7f0b6de72640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T16:15:37.782 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:15:37.781+0000 7f0b6547d640 -1 osd.2 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T16:15:37.888 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:15:37.887+0000 7f97b1f54640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T16:15:37.899 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:15:37.899+0000 7f97a9d73640 -1 osd.4 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T16:15:37.902 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:15:37.901+0000 7f1c6f3a0640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T16:15:37.913 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:15:37.913+0000 7f1c669ab640 -1 osd.3 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T16:15:37.926 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:15:37.926+0000 7f002c41c640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T16:15:37.935 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:15:37.935+0000 7f002423b640 -1 osd.5 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T16:15:38.068 INFO:teuthology.misc.health.smithi017.stdout: 2024-09-12T16:15:38.068 INFO:teuthology.misc.health.smithi017.stdout:{"epoch":10,"fsid":"66dcb8ed-8de5-4784-8071-fd6b3bf3b78f","created":"2024-09-12T16:15:28.208893+0000","modified":"2024-09-12T16:15:36.667217+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T16:15:30.039657+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"aabea24b-3f1f-4555-80c3-5caecf2e2001","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7a17ca3b-8e49-4d92-a633-45d3e4a45b4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"dae09a32-24c6-464c-bee8-04ef2c42f7e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9cc5463c-cdb4-4a6a-b526-39a60de417f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1e329af3-a88a-4a95-b822-01519079084b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c255a252-3afe-4aad-b44c-85820867c960","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T16:15:38.080 DEBUG:teuthology.misc:0 of 6 OSDs are up 2024-09-12T16:15:38.420 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:15:38.419+0000 7f56416e3640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T16:15:38.439 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:15:38.438+0000 7f5639502640 -1 osd.0 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T16:15:44.686 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T16:15:44.992 INFO:teuthology.misc.health.smithi017.stdout: 2024-09-12T16:15:44.992 INFO:teuthology.misc.health.smithi017.stdout:{"epoch":15,"fsid":"66dcb8ed-8de5-4784-8071-fd6b3bf3b78f","created":"2024-09-12T16:15:28.208893+0000","modified":"2024-09-12T16:15:42.760319+0000","last_up_change":"2024-09-12T16:15:38.748644+0000","last_in_change":"2024-09-12T16:15:30.039657+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T16:15:40.677216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aabea24b-3f1f-4555-80c3-5caecf2e2001","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1385915755},{"type":"v1","addr":"172.21.15.17:6801","nonce":1385915755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1385915755},{"type":"v1","addr":"172.21.15.17:6803","nonce":1385915755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1385915755},{"type":"v1","addr":"172.21.15.17:6807","nonce":1385915755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1385915755},{"type":"v1","addr":"172.21.15.17:6805","nonce":1385915755}]},"public_addr":"172.21.15.17:6801/1385915755","cluster_addr":"172.21.15.17:6803/1385915755","heartbeat_back_addr":"172.21.15.17:6807/1385915755","heartbeat_front_addr":"172.21.15.17:6805/1385915755","state":["exists","up"]},{"osd":1,"uuid":"7a17ca3b-8e49-4d92-a633-45d3e4a45b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":3906173234},{"type":"v1","addr":"172.21.15.17:6809","nonce":3906173234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3906173234},{"type":"v1","addr":"172.21.15.17:6811","nonce":3906173234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3906173234},{"type":"v1","addr":"172.21.15.17:6815","nonce":3906173234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3906173234},{"type":"v1","addr":"172.21.15.17:6813","nonce":3906173234}]},"public_addr":"172.21.15.17:6809/3906173234","cluster_addr":"172.21.15.17:6811/3906173234","heartbeat_back_addr":"172.21.15.17:6815/3906173234","heartbeat_front_addr":"172.21.15.17:6813/3906173234","state":["exists","up"]},{"osd":2,"uuid":"dae09a32-24c6-464c-bee8-04ef2c42f7e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1974346628},{"type":"v1","addr":"172.21.15.17:6817","nonce":1974346628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":1974346628},{"type":"v1","addr":"172.21.15.17:6819","nonce":1974346628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":1974346628},{"type":"v1","addr":"172.21.15.17:6823","nonce":1974346628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":1974346628},{"type":"v1","addr":"172.21.15.17:6821","nonce":1974346628}]},"public_addr":"172.21.15.17:6817/1974346628","cluster_addr":"172.21.15.17:6819/1974346628","heartbeat_back_addr":"172.21.15.17:6823/1974346628","heartbeat_front_addr":"172.21.15.17:6821/1974346628","state":["exists","up"]},{"osd":3,"uuid":"9cc5463c-cdb4-4a6a-b526-39a60de417f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3370202675},{"type":"v1","addr":"172.21.15.47:6809","nonce":3370202675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3370202675},{"type":"v1","addr":"172.21.15.47:6811","nonce":3370202675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3370202675},{"type":"v1","addr":"172.21.15.47:6815","nonce":3370202675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3370202675},{"type":"v1","addr":"172.21.15.47:6813","nonce":3370202675}]},"public_addr":"172.21.15.47:6809/3370202675","cluster_addr":"172.21.15.47:6811/3370202675","heartbeat_back_addr":"172.21.15.47:6815/3370202675","heartbeat_front_addr":"172.21.15.47:6813/3370202675","state":["exists","up"]},{"osd":4,"uuid":"1e329af3-a88a-4a95-b822-01519079084b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":1823488259},{"type":"v1","addr":"172.21.15.47:6817","nonce":1823488259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1823488259},{"type":"v1","addr":"172.21.15.47:6819","nonce":1823488259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1823488259},{"type":"v1","addr":"172.21.15.47:6823","nonce":1823488259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1823488259},{"type":"v1","addr":"172.21.15.47:6821","nonce":1823488259}]},"public_addr":"172.21.15.47:6817/1823488259","cluster_addr":"172.21.15.47:6819/1823488259","heartbeat_back_addr":"172.21.15.47:6823/1823488259","heartbeat_front_addr":"172.21.15.47:6821/1823488259","state":["exists","up"]},{"osd":5,"uuid":"c255a252-3afe-4aad-b44c-85820867c960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":3328086750},{"type":"v1","addr":"172.21.15.47:6801","nonce":3328086750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":3328086750},{"type":"v1","addr":"172.21.15.47:6803","nonce":3328086750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":3328086750},{"type":"v1","addr":"172.21.15.47:6807","nonce":3328086750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":3328086750},{"type":"v1","addr":"172.21.15.47:6805","nonce":3328086750}]},"public_addr":"172.21.15.47:6801/3328086750","cluster_addr":"172.21.15.47:6803/3328086750","heartbeat_back_addr":"172.21.15.47:6807/3328086750","heartbeat_front_addr":"172.21.15.47:6805/3328086750","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:15:35.752566+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:15:36.269665+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:15:36.524745+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:15:36.095607+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:15:36.294055+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:15:36.092708+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T16:15:45.004 DEBUG:teuthology.misc:6 of 6 OSDs are up 2024-09-12T16:15:45.005 INFO:tasks.ceph:Creating RBD pool 2024-09-12T16:15:45.005 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T16:15:45.807 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'rbd' created 2024-09-12T16:15:45.823 DEBUG:teuthology.orchestra.run.smithi017:> rbd --cluster ceph pool init rbd 2024-09-12T16:15:48.832 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T16:15:48.833 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-12T16:15:48.833 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T16:15:49.141 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:15:49.154 INFO:teuthology.orchestra.run.smithi017.stdout:[{"version":7,"timestamp":"2024-09-12T16:15:38.420942+0000","name":"","changes":[{"name":"osd.0/osd_mclock_max_capacity_iops_ssd","new_value":"6417.770825"}]}] 2024-09-12T16:15:49.154 INFO:tasks.ceph_manager:config epoch is 7 2024-09-12T16:15:49.155 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T16:15:49.155 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T16:15:49.155 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T16:15:49.504 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:15:49.516 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1487003183},{"type":"v1","addr":"172.21.15.47:6825","nonce":1487003183}]},"active_addr":"172.21.15.47:6825/1487003183","active_change":"2024-09-12T16:15:32.652603+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":592480281}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":2948918136}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":2839662899}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":2008475874}]}]} 2024-09-12T16:15:49.519 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T16:15:49.520 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T16:15:49.520 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T16:15:49.819 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:15:49.819 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":19,"fsid":"66dcb8ed-8de5-4784-8071-fd6b3bf3b78f","created":"2024-09-12T16:15:28.208893+0000","modified":"2024-09-12T16:15:48.816439+0000","last_up_change":"2024-09-12T16:15:38.748644+0000","last_in_change":"2024-09-12T16:15:30.039657+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T16:15:40.677216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T16:15:45.306180+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aabea24b-3f1f-4555-80c3-5caecf2e2001","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1385915755},{"type":"v1","addr":"172.21.15.17:6801","nonce":1385915755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1385915755},{"type":"v1","addr":"172.21.15.17:6803","nonce":1385915755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1385915755},{"type":"v1","addr":"172.21.15.17:6807","nonce":1385915755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1385915755},{"type":"v1","addr":"172.21.15.17:6805","nonce":1385915755}]},"public_addr":"172.21.15.17:6801/1385915755","cluster_addr":"172.21.15.17:6803/1385915755","heartbeat_back_addr":"172.21.15.17:6807/1385915755","heartbeat_front_addr":"172.21.15.17:6805/1385915755","state":["exists","up"]},{"osd":1,"uuid":"7a17ca3b-8e49-4d92-a633-45d3e4a45b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":3906173234},{"type":"v1","addr":"172.21.15.17:6809","nonce":3906173234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3906173234},{"type":"v1","addr":"172.21.15.17:6811","nonce":3906173234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3906173234},{"type":"v1","addr":"172.21.15.17:6815","nonce":3906173234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3906173234},{"type":"v1","addr":"172.21.15.17:6813","nonce":3906173234}]},"public_addr":"172.21.15.17:6809/3906173234","cluster_addr":"172.21.15.17:6811/3906173234","heartbeat_back_addr":"172.21.15.17:6815/3906173234","heartbeat_front_addr":"172.21.15.17:6813/3906173234","state":["exists","up"]},{"osd":2,"uuid":"dae09a32-24c6-464c-bee8-04ef2c42f7e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1974346628},{"type":"v1","addr":"172.21.15.17:6817","nonce":1974346628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":1974346628},{"type":"v1","addr":"172.21.15.17:6819","nonce":1974346628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":1974346628},{"type":"v1","addr":"172.21.15.17:6823","nonce":1974346628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":1974346628},{"type":"v1","addr":"172.21.15.17:6821","nonce":1974346628}]},"public_addr":"172.21.15.17:6817/1974346628","cluster_addr":"172.21.15.17:6819/1974346628","heartbeat_back_addr":"172.21.15.17:6823/1974346628","heartbeat_front_addr":"172.21.15.17:6821/1974346628","state":["exists","up"]},{"osd":3,"uuid":"9cc5463c-cdb4-4a6a-b526-39a60de417f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3370202675},{"type":"v1","addr":"172.21.15.47:6809","nonce":3370202675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3370202675},{"type":"v1","addr":"172.21.15.47:6811","nonce":3370202675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3370202675},{"type":"v1","addr":"172.21.15.47:6815","nonce":3370202675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3370202675},{"type":"v1","addr":"172.21.15.47:6813","nonce":3370202675}]},"public_addr":"172.21.15.47:6809/3370202675","cluster_addr":"172.21.15.47:6811/3370202675","heartbeat_back_addr":"172.21.15.47:6815/3370202675","heartbeat_front_addr":"172.21.15.47:6813/3370202675","state":["exists","up"]},{"osd":4,"uuid":"1e329af3-a88a-4a95-b822-01519079084b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":1823488259},{"type":"v1","addr":"172.21.15.47:6817","nonce":1823488259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1823488259},{"type":"v1","addr":"172.21.15.47:6819","nonce":1823488259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1823488259},{"type":"v1","addr":"172.21.15.47:6823","nonce":1823488259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1823488259},{"type":"v1","addr":"172.21.15.47:6821","nonce":1823488259}]},"public_addr":"172.21.15.47:6817/1823488259","cluster_addr":"172.21.15.47:6819/1823488259","heartbeat_back_addr":"172.21.15.47:6823/1823488259","heartbeat_front_addr":"172.21.15.47:6821/1823488259","state":["exists","up"]},{"osd":5,"uuid":"c255a252-3afe-4aad-b44c-85820867c960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":3328086750},{"type":"v1","addr":"172.21.15.47:6801","nonce":3328086750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":3328086750},{"type":"v1","addr":"172.21.15.47:6803","nonce":3328086750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":3328086750},{"type":"v1","addr":"172.21.15.47:6807","nonce":3328086750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":3328086750},{"type":"v1","addr":"172.21.15.47:6805","nonce":3328086750}]},"public_addr":"172.21.15.47:6801/3328086750","cluster_addr":"172.21.15.47:6803/3328086750","heartbeat_back_addr":"172.21.15.47:6807/3328086750","heartbeat_front_addr":"172.21.15.47:6805/3328086750","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:15:35.752566+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:15:36.269665+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:15:36.524745+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:15:36.095607+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:15:36.294055+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:15:36.092708+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T16:15:49.832 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T16:15:49.832 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T16:15:50.129 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:15:50.129 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":19,"fsid":"66dcb8ed-8de5-4784-8071-fd6b3bf3b78f","created":"2024-09-12T16:15:28.208893+0000","modified":"2024-09-12T16:15:48.816439+0000","last_up_change":"2024-09-12T16:15:38.748644+0000","last_in_change":"2024-09-12T16:15:30.039657+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T16:15:40.677216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T16:15:45.306180+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aabea24b-3f1f-4555-80c3-5caecf2e2001","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1385915755},{"type":"v1","addr":"172.21.15.17:6801","nonce":1385915755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1385915755},{"type":"v1","addr":"172.21.15.17:6803","nonce":1385915755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1385915755},{"type":"v1","addr":"172.21.15.17:6807","nonce":1385915755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1385915755},{"type":"v1","addr":"172.21.15.17:6805","nonce":1385915755}]},"public_addr":"172.21.15.17:6801/1385915755","cluster_addr":"172.21.15.17:6803/1385915755","heartbeat_back_addr":"172.21.15.17:6807/1385915755","heartbeat_front_addr":"172.21.15.17:6805/1385915755","state":["exists","up"]},{"osd":1,"uuid":"7a17ca3b-8e49-4d92-a633-45d3e4a45b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":3906173234},{"type":"v1","addr":"172.21.15.17:6809","nonce":3906173234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3906173234},{"type":"v1","addr":"172.21.15.17:6811","nonce":3906173234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3906173234},{"type":"v1","addr":"172.21.15.17:6815","nonce":3906173234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3906173234},{"type":"v1","addr":"172.21.15.17:6813","nonce":3906173234}]},"public_addr":"172.21.15.17:6809/3906173234","cluster_addr":"172.21.15.17:6811/3906173234","heartbeat_back_addr":"172.21.15.17:6815/3906173234","heartbeat_front_addr":"172.21.15.17:6813/3906173234","state":["exists","up"]},{"osd":2,"uuid":"dae09a32-24c6-464c-bee8-04ef2c42f7e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1974346628},{"type":"v1","addr":"172.21.15.17:6817","nonce":1974346628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":1974346628},{"type":"v1","addr":"172.21.15.17:6819","nonce":1974346628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":1974346628},{"type":"v1","addr":"172.21.15.17:6823","nonce":1974346628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":1974346628},{"type":"v1","addr":"172.21.15.17:6821","nonce":1974346628}]},"public_addr":"172.21.15.17:6817/1974346628","cluster_addr":"172.21.15.17:6819/1974346628","heartbeat_back_addr":"172.21.15.17:6823/1974346628","heartbeat_front_addr":"172.21.15.17:6821/1974346628","state":["exists","up"]},{"osd":3,"uuid":"9cc5463c-cdb4-4a6a-b526-39a60de417f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3370202675},{"type":"v1","addr":"172.21.15.47:6809","nonce":3370202675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3370202675},{"type":"v1","addr":"172.21.15.47:6811","nonce":3370202675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3370202675},{"type":"v1","addr":"172.21.15.47:6815","nonce":3370202675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3370202675},{"type":"v1","addr":"172.21.15.47:6813","nonce":3370202675}]},"public_addr":"172.21.15.47:6809/3370202675","cluster_addr":"172.21.15.47:6811/3370202675","heartbeat_back_addr":"172.21.15.47:6815/3370202675","heartbeat_front_addr":"172.21.15.47:6813/3370202675","state":["exists","up"]},{"osd":4,"uuid":"1e329af3-a88a-4a95-b822-01519079084b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":1823488259},{"type":"v1","addr":"172.21.15.47:6817","nonce":1823488259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1823488259},{"type":"v1","addr":"172.21.15.47:6819","nonce":1823488259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1823488259},{"type":"v1","addr":"172.21.15.47:6823","nonce":1823488259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1823488259},{"type":"v1","addr":"172.21.15.47:6821","nonce":1823488259}]},"public_addr":"172.21.15.47:6817/1823488259","cluster_addr":"172.21.15.47:6819/1823488259","heartbeat_back_addr":"172.21.15.47:6823/1823488259","heartbeat_front_addr":"172.21.15.47:6821/1823488259","state":["exists","up"]},{"osd":5,"uuid":"c255a252-3afe-4aad-b44c-85820867c960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":3328086750},{"type":"v1","addr":"172.21.15.47:6801","nonce":3328086750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":3328086750},{"type":"v1","addr":"172.21.15.47:6803","nonce":3328086750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":3328086750},{"type":"v1","addr":"172.21.15.47:6807","nonce":3328086750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":3328086750},{"type":"v1","addr":"172.21.15.47:6805","nonce":3328086750}]},"public_addr":"172.21.15.47:6801/3328086750","cluster_addr":"172.21.15.47:6803/3328086750","heartbeat_back_addr":"172.21.15.47:6807/3328086750","heartbeat_front_addr":"172.21.15.47:6805/3328086750","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:15:35.752566+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:15:36.269665+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:15:36.524745+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:15:36.095607+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:15:36.294055+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:15:36.092708+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T16:15:50.142 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T16:15:50.142 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T16:15:50.143 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T16:15:50.143 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T16:15:50.144 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T16:15:50.144 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T16:15:50.304 INFO:teuthology.orchestra.run.smithi017.stdout:47244640261 2024-09-12T16:15:50.304 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T16:15:50.305 INFO:teuthology.orchestra.run.smithi017.stdout:47244640262 2024-09-12T16:15:50.306 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T16:15:50.350 INFO:teuthology.orchestra.run.smithi017.stdout:47244640261 2024-09-12T16:15:50.350 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T16:15:50.350 INFO:teuthology.orchestra.run.smithi017.stdout:47244640262 2024-09-12T16:15:50.351 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T16:15:50.359 INFO:teuthology.orchestra.run.smithi017.stdout:47244640260 2024-09-12T16:15:50.360 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T16:15:50.363 INFO:teuthology.orchestra.run.smithi017.stdout:47244640263 2024-09-12T16:15:50.363 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T16:15:50.694 INFO:teuthology.orchestra.run.smithi017.stdout:47244640259 2024-09-12T16:15:50.707 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640259 for osd.1 2024-09-12T16:15:50.729 INFO:teuthology.orchestra.run.smithi017.stdout:47244640260 2024-09-12T16:15:50.742 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640260 for osd.0 2024-09-12T16:15:50.813 INFO:teuthology.orchestra.run.smithi017.stdout:47244640259 2024-09-12T16:15:50.831 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640259 for osd.4 2024-09-12T16:15:50.860 INFO:teuthology.orchestra.run.smithi017.stdout:47244640262 2024-09-12T16:15:50.875 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640262 for osd.3 2024-09-12T16:15:50.876 DEBUG:teuthology.parallel:result is None 2024-09-12T16:15:50.877 INFO:teuthology.orchestra.run.smithi017.stdout:47244640263 2024-09-12T16:15:50.891 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640263 got 47244640263 for osd.2 2024-09-12T16:15:50.891 DEBUG:teuthology.parallel:result is None 2024-09-12T16:15:50.921 INFO:teuthology.orchestra.run.smithi017.stdout:47244640260 2024-09-12T16:15:50.934 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640260 for osd.5 2024-09-12T16:15:50.934 DEBUG:teuthology.parallel:result is None 2024-09-12T16:15:51.708 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T16:15:51.744 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T16:15:51.833 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T16:15:52.063 INFO:teuthology.orchestra.run.smithi017.stdout:47244640261 2024-09-12T16:15:52.076 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640261 for osd.1 2024-09-12T16:15:52.076 DEBUG:teuthology.parallel:result is None 2024-09-12T16:15:52.108 INFO:teuthology.orchestra.run.smithi017.stdout:47244640262 2024-09-12T16:15:52.121 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640262 for osd.0 2024-09-12T16:15:52.121 DEBUG:teuthology.parallel:result is None 2024-09-12T16:15:52.195 INFO:teuthology.orchestra.run.smithi017.stdout:47244640261 2024-09-12T16:15:52.208 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640261 for osd.4 2024-09-12T16:15:52.208 DEBUG:teuthology.parallel:result is None 2024-09-12T16:15:52.208 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T16:15:52.209 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T16:15:52.502 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:15:52.502 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-12T16:15:52.514 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-12T16:15:50.661887+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":193564,"kb_used_data":2224,"kb_used_omap":9,"kb_used_meta":191158,"kb_avail":566037476,"statfs":{"total":579820584960,"available":579622375424,"internally_reserved":0,"allocated":2277376,"data_stored":1544350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":195746465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.853889"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T16:15:48.822675+0000","last_change":"2024-09-12T16:15:48.822675+0000","last_active":"2024-09-12T16:15:48.822675+0000","last_peered":"2024-09-12T16:15:48.822675+0000","last_clean":"2024-09-12T16:15:48.822675+0000","last_became_active":"2024-09-12T16:15:46.818683+0000","last_became_peered":"2024-09-12T16:15:46.818683+0000","last_unstale":"2024-09-12T16:15:48.822675+0000","last_undegraded":"2024-09-12T16:15:48.822675+0000","last_fullsized":"2024-09-12T16:15:48.822675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:32.099284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073961600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T16:15:48.822729+0000","last_change":"2024-09-12T16:15:48.822729+0000","last_active":"2024-09-12T16:15:48.822729+0000","last_peered":"2024-09-12T16:15:48.822729+0000","last_clean":"2024-09-12T16:15:48.822729+0000","last_became_active":"2024-09-12T16:15:46.818462+0000","last_became_peered":"2024-09-12T16:15:46.818462+0000","last_unstale":"2024-09-12T16:15:48.822729+0000","last_undegraded":"2024-09-12T16:15:48.822729+0000","last_fullsized":"2024-09-12T16:15:48.822729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:25.975652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066384400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T16:15:48.822426+0000","last_change":"2024-09-12T16:15:48.822426+0000","last_active":"2024-09-12T16:15:48.822426+0000","last_peered":"2024-09-12T16:15:48.822426+0000","last_clean":"2024-09-12T16:15:48.822426+0000","last_became_active":"2024-09-12T16:15:46.819353+0000","last_became_peered":"2024-09-12T16:15:46.819353+0000","last_unstale":"2024-09-12T16:15:48.822426+0000","last_undegraded":"2024-09-12T16:15:48.822426+0000","last_fullsized":"2024-09-12T16:15:48.822426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:23:56.141583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053074700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T16:15:48.822724+0000","last_change":"2024-09-12T16:15:48.822724+0000","last_active":"2024-09-12T16:15:48.822724+0000","last_peered":"2024-09-12T16:15:48.822724+0000","last_clean":"2024-09-12T16:15:48.822724+0000","last_became_active":"2024-09-12T16:15:46.818676+0000","last_became_peered":"2024-09-12T16:15:46.818676+0000","last_unstale":"2024-09-12T16:15:48.822724+0000","last_undegraded":"2024-09-12T16:15:48.822724+0000","last_fullsized":"2024-09-12T16:15:48.822724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:11.170806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065522900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T16:15:48.826856+0000","last_change":"2024-09-12T16:15:48.826199+0000","last_active":"2024-09-12T16:15:48.826856+0000","last_peered":"2024-09-12T16:15:48.826856+0000","last_clean":"2024-09-12T16:15:48.826856+0000","last_became_active":"2024-09-12T16:15:46.818299+0000","last_became_peered":"2024-09-12T16:15:46.818299+0000","last_unstale":"2024-09-12T16:15:48.826856+0000","last_undegraded":"2024-09-12T16:15:48.826856+0000","last_fullsized":"2024-09-12T16:15:48.826856+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:16.049427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097434300000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T16:15:48.823334+0000","last_change":"2024-09-12T16:15:48.823334+0000","last_active":"2024-09-12T16:15:48.823334+0000","last_peered":"2024-09-12T16:15:48.823334+0000","last_clean":"2024-09-12T16:15:48.823334+0000","last_became_active":"2024-09-12T16:15:46.818043+0000","last_became_peered":"2024-09-12T16:15:46.818043+0000","last_unstale":"2024-09-12T16:15:48.823334+0000","last_undegraded":"2024-09-12T16:15:48.823334+0000","last_fullsized":"2024-09-12T16:15:48.823334+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:01.642351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001016344,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T16:15:48.822423+0000","last_change":"2024-09-12T16:15:48.822423+0000","last_active":"2024-09-12T16:15:48.822423+0000","last_peered":"2024-09-12T16:15:48.822423+0000","last_clean":"2024-09-12T16:15:48.822423+0000","last_became_active":"2024-09-12T16:15:46.820368+0000","last_became_peered":"2024-09-12T16:15:46.820368+0000","last_unstale":"2024-09-12T16:15:48.822423+0000","last_undegraded":"2024-09-12T16:15:48.822423+0000","last_fullsized":"2024-09-12T16:15:48.822423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:01.722710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055533999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T16:15:48.825828+0000","last_change":"2024-09-12T16:15:48.825828+0000","last_active":"2024-09-12T16:15:48.825828+0000","last_peered":"2024-09-12T16:15:48.825828+0000","last_clean":"2024-09-12T16:15:48.825828+0000","last_became_active":"2024-09-12T16:15:46.818654+0000","last_became_peered":"2024-09-12T16:15:46.818654+0000","last_unstale":"2024-09-12T16:15:48.825828+0000","last_undegraded":"2024-09-12T16:15:48.825828+0000","last_fullsized":"2024-09-12T16:15:48.825828+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:43.109521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055290899999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'72","reported_seq":111,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T16:15:48.821768+0000","last_change":"2024-09-12T16:15:42.320223+0000","last_active":"2024-09-12T16:15:48.821768+0000","last_peered":"2024-09-12T16:15:48.821768+0000","last_clean":"2024-09-12T16:15:48.821768+0000","last_became_active":"2024-09-12T16:15:42.319118+0000","last_became_peered":"2024-09-12T16:15:42.319118+0000","last_unstale":"2024-09-12T16:15:48.821768+0000","last_undegraded":"2024-09-12T16:15:48.821768+0000","last_fullsized":"2024-09-12T16:15:48.821768+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:40.751677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:40.751677+0000","last_clean_scrub_stamp":"2024-09-12T16:15:40.751677+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:57.860633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":184320,"data_stored":60615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640261,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":180224,"data_stored":60596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640262,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":774144,"data_stored":650964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640263,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":180224,"data_stored":60596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640261,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":184320,"data_stored":60615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640262,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36112,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335728,"statfs":{"total":96636764160,"available":96599785472,"internally_reserved":0,"allocated":774144,"data_stored":650964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T16:15:52.515 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T16:15:52.811 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:15:52.811 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-12T16:15:52.822 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-12T16:15:52.662440+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":193564,"kb_used_data":2224,"kb_used_omap":9,"kb_used_meta":191158,"kb_avail":566037476,"statfs":{"total":579820584960,"available":579622375424,"internally_reserved":0,"allocated":2277376,"data_stored":1544350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":195746465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001441"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T16:15:48.822675+0000","last_change":"2024-09-12T16:15:48.822675+0000","last_active":"2024-09-12T16:15:48.822675+0000","last_peered":"2024-09-12T16:15:48.822675+0000","last_clean":"2024-09-12T16:15:48.822675+0000","last_became_active":"2024-09-12T16:15:46.818683+0000","last_became_peered":"2024-09-12T16:15:46.818683+0000","last_unstale":"2024-09-12T16:15:48.822675+0000","last_undegraded":"2024-09-12T16:15:48.822675+0000","last_fullsized":"2024-09-12T16:15:48.822675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:32.099284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073961600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T16:15:48.822729+0000","last_change":"2024-09-12T16:15:48.822729+0000","last_active":"2024-09-12T16:15:48.822729+0000","last_peered":"2024-09-12T16:15:48.822729+0000","last_clean":"2024-09-12T16:15:48.822729+0000","last_became_active":"2024-09-12T16:15:46.818462+0000","last_became_peered":"2024-09-12T16:15:46.818462+0000","last_unstale":"2024-09-12T16:15:48.822729+0000","last_undegraded":"2024-09-12T16:15:48.822729+0000","last_fullsized":"2024-09-12T16:15:48.822729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:25.975652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066384400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T16:15:48.822426+0000","last_change":"2024-09-12T16:15:48.822426+0000","last_active":"2024-09-12T16:15:48.822426+0000","last_peered":"2024-09-12T16:15:48.822426+0000","last_clean":"2024-09-12T16:15:48.822426+0000","last_became_active":"2024-09-12T16:15:46.819353+0000","last_became_peered":"2024-09-12T16:15:46.819353+0000","last_unstale":"2024-09-12T16:15:48.822426+0000","last_undegraded":"2024-09-12T16:15:48.822426+0000","last_fullsized":"2024-09-12T16:15:48.822426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:23:56.141583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053074700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T16:15:48.822724+0000","last_change":"2024-09-12T16:15:48.822724+0000","last_active":"2024-09-12T16:15:48.822724+0000","last_peered":"2024-09-12T16:15:48.822724+0000","last_clean":"2024-09-12T16:15:48.822724+0000","last_became_active":"2024-09-12T16:15:46.818676+0000","last_became_peered":"2024-09-12T16:15:46.818676+0000","last_unstale":"2024-09-12T16:15:48.822724+0000","last_undegraded":"2024-09-12T16:15:48.822724+0000","last_fullsized":"2024-09-12T16:15:48.822724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:11.170806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065522900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T16:15:48.826856+0000","last_change":"2024-09-12T16:15:48.826199+0000","last_active":"2024-09-12T16:15:48.826856+0000","last_peered":"2024-09-12T16:15:48.826856+0000","last_clean":"2024-09-12T16:15:48.826856+0000","last_became_active":"2024-09-12T16:15:46.818299+0000","last_became_peered":"2024-09-12T16:15:46.818299+0000","last_unstale":"2024-09-12T16:15:48.826856+0000","last_undegraded":"2024-09-12T16:15:48.826856+0000","last_fullsized":"2024-09-12T16:15:48.826856+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:16.049427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097434300000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T16:15:48.823334+0000","last_change":"2024-09-12T16:15:48.823334+0000","last_active":"2024-09-12T16:15:48.823334+0000","last_peered":"2024-09-12T16:15:48.823334+0000","last_clean":"2024-09-12T16:15:48.823334+0000","last_became_active":"2024-09-12T16:15:46.818043+0000","last_became_peered":"2024-09-12T16:15:46.818043+0000","last_unstale":"2024-09-12T16:15:48.823334+0000","last_undegraded":"2024-09-12T16:15:48.823334+0000","last_fullsized":"2024-09-12T16:15:48.823334+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:01.642351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001016344,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T16:15:48.822423+0000","last_change":"2024-09-12T16:15:48.822423+0000","last_active":"2024-09-12T16:15:48.822423+0000","last_peered":"2024-09-12T16:15:48.822423+0000","last_clean":"2024-09-12T16:15:48.822423+0000","last_became_active":"2024-09-12T16:15:46.820368+0000","last_became_peered":"2024-09-12T16:15:46.820368+0000","last_unstale":"2024-09-12T16:15:48.822423+0000","last_undegraded":"2024-09-12T16:15:48.822423+0000","last_fullsized":"2024-09-12T16:15:48.822423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:01.722710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055533999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T16:15:48.825828+0000","last_change":"2024-09-12T16:15:48.825828+0000","last_active":"2024-09-12T16:15:48.825828+0000","last_peered":"2024-09-12T16:15:48.825828+0000","last_clean":"2024-09-12T16:15:48.825828+0000","last_became_active":"2024-09-12T16:15:46.818654+0000","last_became_peered":"2024-09-12T16:15:46.818654+0000","last_unstale":"2024-09-12T16:15:48.825828+0000","last_undegraded":"2024-09-12T16:15:48.825828+0000","last_fullsized":"2024-09-12T16:15:48.825828+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:43.109521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055290899999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'72","reported_seq":111,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T16:15:48.821768+0000","last_change":"2024-09-12T16:15:42.320223+0000","last_active":"2024-09-12T16:15:48.821768+0000","last_peered":"2024-09-12T16:15:48.821768+0000","last_clean":"2024-09-12T16:15:48.821768+0000","last_became_active":"2024-09-12T16:15:42.319118+0000","last_became_peered":"2024-09-12T16:15:42.319118+0000","last_unstale":"2024-09-12T16:15:48.821768+0000","last_undegraded":"2024-09-12T16:15:48.821768+0000","last_fullsized":"2024-09-12T16:15:48.821768+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:40.751677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:40.751677+0000","last_clean_scrub_stamp":"2024-09-12T16:15:40.751677+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:57.860633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":184320,"data_stored":60615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640261,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":180224,"data_stored":60596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640262,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":774144,"data_stored":650964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640263,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":180224,"data_stored":60596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640261,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":184320,"data_stored":60615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640262,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36112,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335728,"statfs":{"total":96636764160,"available":96599785472,"internally_reserved":0,"allocated":774144,"data_stored":650964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T16:15:52.822 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T16:15:52.823 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T16:15:52.823 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T16:15:52.823 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T16:15:53.158 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:15:53.159 INFO:teuthology.orchestra.run.smithi017.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T16:15:53.171 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T16:15:53.172 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-12T16:15:53.201 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-12T16:15:53.201 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-dis-testing'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': 'd61b08865d4d98738f45ff2e4806d7fb6d03eca1'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'extra_packages': ['rbd-nbd'], 'flavor': 'default', 'sha1': 'd61b08865d4d98738f45ff2e4806d7fb6d03eca1'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-dis-testing', 'sha1': 'd61b08865d4d98738f45ff2e4806d7fb6d03eca1'}} 2024-09-12T16:15:53.201 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-12T16:15:53.201 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-12T16:15:53.519 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-12T16:15:53.520 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T16:15:53.520 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T16:15:53.816 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:15:53.817 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-12T16:15:53.829 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-12T16:15:52.992518+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":193564,"kb_used_data":2224,"kb_used_omap":9,"kb_used_meta":191158,"kb_avail":566037476,"statfs":{"total":579820584960,"available":579622375424,"internally_reserved":0,"allocated":2277376,"data_stored":1544350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":195746465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.180599"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T16:15:48.822675+0000","last_change":"2024-09-12T16:15:48.822675+0000","last_active":"2024-09-12T16:15:48.822675+0000","last_peered":"2024-09-12T16:15:48.822675+0000","last_clean":"2024-09-12T16:15:48.822675+0000","last_became_active":"2024-09-12T16:15:46.818683+0000","last_became_peered":"2024-09-12T16:15:46.818683+0000","last_unstale":"2024-09-12T16:15:48.822675+0000","last_undegraded":"2024-09-12T16:15:48.822675+0000","last_fullsized":"2024-09-12T16:15:48.822675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:32.099284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073961600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T16:15:48.822729+0000","last_change":"2024-09-12T16:15:48.822729+0000","last_active":"2024-09-12T16:15:48.822729+0000","last_peered":"2024-09-12T16:15:48.822729+0000","last_clean":"2024-09-12T16:15:48.822729+0000","last_became_active":"2024-09-12T16:15:46.818462+0000","last_became_peered":"2024-09-12T16:15:46.818462+0000","last_unstale":"2024-09-12T16:15:48.822729+0000","last_undegraded":"2024-09-12T16:15:48.822729+0000","last_fullsized":"2024-09-12T16:15:48.822729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:25.975652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066384400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T16:15:48.822426+0000","last_change":"2024-09-12T16:15:48.822426+0000","last_active":"2024-09-12T16:15:48.822426+0000","last_peered":"2024-09-12T16:15:48.822426+0000","last_clean":"2024-09-12T16:15:48.822426+0000","last_became_active":"2024-09-12T16:15:46.819353+0000","last_became_peered":"2024-09-12T16:15:46.819353+0000","last_unstale":"2024-09-12T16:15:48.822426+0000","last_undegraded":"2024-09-12T16:15:48.822426+0000","last_fullsized":"2024-09-12T16:15:48.822426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:23:56.141583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053074700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T16:15:48.822724+0000","last_change":"2024-09-12T16:15:48.822724+0000","last_active":"2024-09-12T16:15:48.822724+0000","last_peered":"2024-09-12T16:15:48.822724+0000","last_clean":"2024-09-12T16:15:48.822724+0000","last_became_active":"2024-09-12T16:15:46.818676+0000","last_became_peered":"2024-09-12T16:15:46.818676+0000","last_unstale":"2024-09-12T16:15:48.822724+0000","last_undegraded":"2024-09-12T16:15:48.822724+0000","last_fullsized":"2024-09-12T16:15:48.822724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:11.170806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065522900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T16:15:48.826856+0000","last_change":"2024-09-12T16:15:48.826199+0000","last_active":"2024-09-12T16:15:48.826856+0000","last_peered":"2024-09-12T16:15:48.826856+0000","last_clean":"2024-09-12T16:15:48.826856+0000","last_became_active":"2024-09-12T16:15:46.818299+0000","last_became_peered":"2024-09-12T16:15:46.818299+0000","last_unstale":"2024-09-12T16:15:48.826856+0000","last_undegraded":"2024-09-12T16:15:48.826856+0000","last_fullsized":"2024-09-12T16:15:48.826856+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:16.049427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097434300000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T16:15:48.823334+0000","last_change":"2024-09-12T16:15:48.823334+0000","last_active":"2024-09-12T16:15:48.823334+0000","last_peered":"2024-09-12T16:15:48.823334+0000","last_clean":"2024-09-12T16:15:48.823334+0000","last_became_active":"2024-09-12T16:15:46.818043+0000","last_became_peered":"2024-09-12T16:15:46.818043+0000","last_unstale":"2024-09-12T16:15:48.823334+0000","last_undegraded":"2024-09-12T16:15:48.823334+0000","last_fullsized":"2024-09-12T16:15:48.823334+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:01.642351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001016344,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T16:15:48.822423+0000","last_change":"2024-09-12T16:15:48.822423+0000","last_active":"2024-09-12T16:15:48.822423+0000","last_peered":"2024-09-12T16:15:48.822423+0000","last_clean":"2024-09-12T16:15:48.822423+0000","last_became_active":"2024-09-12T16:15:46.820368+0000","last_became_peered":"2024-09-12T16:15:46.820368+0000","last_unstale":"2024-09-12T16:15:48.822423+0000","last_undegraded":"2024-09-12T16:15:48.822423+0000","last_fullsized":"2024-09-12T16:15:48.822423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:01.722710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055533999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T16:15:48.825828+0000","last_change":"2024-09-12T16:15:48.825828+0000","last_active":"2024-09-12T16:15:48.825828+0000","last_peered":"2024-09-12T16:15:48.825828+0000","last_clean":"2024-09-12T16:15:48.825828+0000","last_became_active":"2024-09-12T16:15:46.818654+0000","last_became_peered":"2024-09-12T16:15:46.818654+0000","last_unstale":"2024-09-12T16:15:48.825828+0000","last_undegraded":"2024-09-12T16:15:48.825828+0000","last_fullsized":"2024-09-12T16:15:48.825828+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:43.109521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055290899999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'72","reported_seq":111,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T16:15:48.821768+0000","last_change":"2024-09-12T16:15:42.320223+0000","last_active":"2024-09-12T16:15:48.821768+0000","last_peered":"2024-09-12T16:15:48.821768+0000","last_clean":"2024-09-12T16:15:48.821768+0000","last_became_active":"2024-09-12T16:15:42.319118+0000","last_became_peered":"2024-09-12T16:15:42.319118+0000","last_unstale":"2024-09-12T16:15:48.821768+0000","last_undegraded":"2024-09-12T16:15:48.821768+0000","last_fullsized":"2024-09-12T16:15:48.821768+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:40.751677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:40.751677+0000","last_clean_scrub_stamp":"2024-09-12T16:15:40.751677+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:57.860633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":184320,"data_stored":60615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640261,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":180224,"data_stored":60596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640262,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":774144,"data_stored":650964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640263,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":180224,"data_stored":60596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640261,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":184320,"data_stored":60615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640262,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36112,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335728,"statfs":{"total":96636764160,"available":96599785472,"internally_reserved":0,"allocated":774144,"data_stored":650964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T16:15:53.830 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T16:15:54.124 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:15:54.125 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-12T16:15:54.136 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-12T16:15:52.992518+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":193564,"kb_used_data":2224,"kb_used_omap":9,"kb_used_meta":191158,"kb_avail":566037476,"statfs":{"total":579820584960,"available":579622375424,"internally_reserved":0,"allocated":2277376,"data_stored":1544350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":195746465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.180599"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T16:15:48.822675+0000","last_change":"2024-09-12T16:15:48.822675+0000","last_active":"2024-09-12T16:15:48.822675+0000","last_peered":"2024-09-12T16:15:48.822675+0000","last_clean":"2024-09-12T16:15:48.822675+0000","last_became_active":"2024-09-12T16:15:46.818683+0000","last_became_peered":"2024-09-12T16:15:46.818683+0000","last_unstale":"2024-09-12T16:15:48.822675+0000","last_undegraded":"2024-09-12T16:15:48.822675+0000","last_fullsized":"2024-09-12T16:15:48.822675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:32.099284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073961600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T16:15:48.822729+0000","last_change":"2024-09-12T16:15:48.822729+0000","last_active":"2024-09-12T16:15:48.822729+0000","last_peered":"2024-09-12T16:15:48.822729+0000","last_clean":"2024-09-12T16:15:48.822729+0000","last_became_active":"2024-09-12T16:15:46.818462+0000","last_became_peered":"2024-09-12T16:15:46.818462+0000","last_unstale":"2024-09-12T16:15:48.822729+0000","last_undegraded":"2024-09-12T16:15:48.822729+0000","last_fullsized":"2024-09-12T16:15:48.822729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:25.975652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066384400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T16:15:48.822426+0000","last_change":"2024-09-12T16:15:48.822426+0000","last_active":"2024-09-12T16:15:48.822426+0000","last_peered":"2024-09-12T16:15:48.822426+0000","last_clean":"2024-09-12T16:15:48.822426+0000","last_became_active":"2024-09-12T16:15:46.819353+0000","last_became_peered":"2024-09-12T16:15:46.819353+0000","last_unstale":"2024-09-12T16:15:48.822426+0000","last_undegraded":"2024-09-12T16:15:48.822426+0000","last_fullsized":"2024-09-12T16:15:48.822426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:23:56.141583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053074700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T16:15:48.822724+0000","last_change":"2024-09-12T16:15:48.822724+0000","last_active":"2024-09-12T16:15:48.822724+0000","last_peered":"2024-09-12T16:15:48.822724+0000","last_clean":"2024-09-12T16:15:48.822724+0000","last_became_active":"2024-09-12T16:15:46.818676+0000","last_became_peered":"2024-09-12T16:15:46.818676+0000","last_unstale":"2024-09-12T16:15:48.822724+0000","last_undegraded":"2024-09-12T16:15:48.822724+0000","last_fullsized":"2024-09-12T16:15:48.822724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:11.170806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065522900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T16:15:48.826856+0000","last_change":"2024-09-12T16:15:48.826199+0000","last_active":"2024-09-12T16:15:48.826856+0000","last_peered":"2024-09-12T16:15:48.826856+0000","last_clean":"2024-09-12T16:15:48.826856+0000","last_became_active":"2024-09-12T16:15:46.818299+0000","last_became_peered":"2024-09-12T16:15:46.818299+0000","last_unstale":"2024-09-12T16:15:48.826856+0000","last_undegraded":"2024-09-12T16:15:48.826856+0000","last_fullsized":"2024-09-12T16:15:48.826856+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:16.049427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097434300000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T16:15:48.823334+0000","last_change":"2024-09-12T16:15:48.823334+0000","last_active":"2024-09-12T16:15:48.823334+0000","last_peered":"2024-09-12T16:15:48.823334+0000","last_clean":"2024-09-12T16:15:48.823334+0000","last_became_active":"2024-09-12T16:15:46.818043+0000","last_became_peered":"2024-09-12T16:15:46.818043+0000","last_unstale":"2024-09-12T16:15:48.823334+0000","last_undegraded":"2024-09-12T16:15:48.823334+0000","last_fullsized":"2024-09-12T16:15:48.823334+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:01.642351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001016344,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T16:15:48.822423+0000","last_change":"2024-09-12T16:15:48.822423+0000","last_active":"2024-09-12T16:15:48.822423+0000","last_peered":"2024-09-12T16:15:48.822423+0000","last_clean":"2024-09-12T16:15:48.822423+0000","last_became_active":"2024-09-12T16:15:46.820368+0000","last_became_peered":"2024-09-12T16:15:46.820368+0000","last_unstale":"2024-09-12T16:15:48.822423+0000","last_undegraded":"2024-09-12T16:15:48.822423+0000","last_fullsized":"2024-09-12T16:15:48.822423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:01.722710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055533999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T16:15:48.825828+0000","last_change":"2024-09-12T16:15:48.825828+0000","last_active":"2024-09-12T16:15:48.825828+0000","last_peered":"2024-09-12T16:15:48.825828+0000","last_clean":"2024-09-12T16:15:48.825828+0000","last_became_active":"2024-09-12T16:15:46.818654+0000","last_became_peered":"2024-09-12T16:15:46.818654+0000","last_unstale":"2024-09-12T16:15:48.825828+0000","last_undegraded":"2024-09-12T16:15:48.825828+0000","last_fullsized":"2024-09-12T16:15:48.825828+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:43.109521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055290899999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'72","reported_seq":111,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T16:15:48.821768+0000","last_change":"2024-09-12T16:15:42.320223+0000","last_active":"2024-09-12T16:15:48.821768+0000","last_peered":"2024-09-12T16:15:48.821768+0000","last_clean":"2024-09-12T16:15:48.821768+0000","last_became_active":"2024-09-12T16:15:42.319118+0000","last_became_peered":"2024-09-12T16:15:42.319118+0000","last_unstale":"2024-09-12T16:15:48.821768+0000","last_undegraded":"2024-09-12T16:15:48.821768+0000","last_fullsized":"2024-09-12T16:15:48.821768+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:40.751677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:40.751677+0000","last_clean_scrub_stamp":"2024-09-12T16:15:40.751677+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:57.860633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":184320,"data_stored":60615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640261,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":180224,"data_stored":60596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640262,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":774144,"data_stored":650964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640263,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":180224,"data_stored":60596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640261,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":184320,"data_stored":60615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640262,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36112,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335728,"statfs":{"total":96636764160,"available":96599785472,"internally_reserved":0,"allocated":774144,"data_stored":650964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T16:15:54.137 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T16:15:54.138 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-12T16:15:54.436 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 20 2024-09-12T16:15:54.436 INFO:teuthology.orchestra.run.smithi017.stdout:fsid 66dcb8ed-8de5-4784-8071-fd6b3bf3b78f 2024-09-12T16:15:54.436 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-12T16:15:28.208893+0000 2024-09-12T16:15:54.436 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-12T16:15:52.990644+0000 2024-09-12T16:15:54.436 INFO:teuthology.orchestra.run.smithi017.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-12T16:15:54.436 INFO:teuthology.orchestra.run.smithi017.stdout:crush_version 4 2024-09-12T16:15:54.436 INFO:teuthology.orchestra.run.smithi017.stdout:full_ratio 0.95 2024-09-12T16:15:54.436 INFO:teuthology.orchestra.run.smithi017.stdout:backfillfull_ratio 0.9 2024-09-12T16:15:54.436 INFO:teuthology.orchestra.run.smithi017.stdout:nearfull_ratio 0.85 2024-09-12T16:15:54.436 INFO:teuthology.orchestra.run.smithi017.stdout:require_min_compat_client luminous 2024-09-12T16:15:54.437 INFO:teuthology.orchestra.run.smithi017.stdout:min_compat_client jewel 2024-09-12T16:15:54.437 INFO:teuthology.orchestra.run.smithi017.stdout:require_osd_release squid 2024-09-12T16:15:54.437 INFO:teuthology.orchestra.run.smithi017.stdout:stretch_mode_enabled false 2024-09-12T16:15:54.437 INFO:teuthology.orchestra.run.smithi017.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 15 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 6.06 2024-09-12T16:15:54.437 INFO:teuthology.orchestra.run.smithi017.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 19 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 2.25 2024-09-12T16:15:54.437 INFO:teuthology.orchestra.run.smithi017.stdout:max_osd 6 2024-09-12T16:15:54.437 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 up in weight 1 up_from 11 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6800/1385915755,v1:172.21.15.17:6801/1385915755] [v2:172.21.15.17:6802/1385915755,v1:172.21.15.17:6803/1385915755] exists,up aabea24b-3f1f-4555-80c3-5caecf2e2001 2024-09-12T16:15:54.437 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 up in weight 1 up_from 11 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6808/3906173234,v1:172.21.15.17:6809/3906173234] [v2:172.21.15.17:6810/3906173234,v1:172.21.15.17:6811/3906173234] exists,up 7a17ca3b-8e49-4d92-a633-45d3e4a45b4e 2024-09-12T16:15:54.437 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 up in weight 1 up_from 11 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6816/1974346628,v1:172.21.15.17:6817/1974346628] [v2:172.21.15.17:6818/1974346628,v1:172.21.15.17:6819/1974346628] exists,up dae09a32-24c6-464c-bee8-04ef2c42f7e4 2024-09-12T16:15:54.437 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 up in weight 1 up_from 11 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.47:6808/3370202675,v1:172.21.15.47:6809/3370202675] [v2:172.21.15.47:6810/3370202675,v1:172.21.15.47:6811/3370202675] exists,up 9cc5463c-cdb4-4a6a-b526-39a60de417f4 2024-09-12T16:15:54.437 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 up in weight 1 up_from 11 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.47:6816/1823488259,v1:172.21.15.47:6817/1823488259] [v2:172.21.15.47:6818/1823488259,v1:172.21.15.47:6819/1823488259] exists,up 1e329af3-a88a-4a95-b822-01519079084b 2024-09-12T16:15:54.437 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 up in weight 1 up_from 11 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.47:6800/3328086750,v1:172.21.15.47:6801/3328086750] [v2:172.21.15.47:6802/3328086750,v1:172.21.15.47:6803/3328086750] exists,up c255a252-3afe-4aad-b44c-85820867c960 2024-09-12T16:15:54.449 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 11 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6800/1385915755,v1:172.21.15.17:6801/1385915755] [v2:172.21.15.17:6802/1385915755,v1:172.21.15.17:6803/1385915755] exists,up aabea24b-3f1f-4555-80c3-5caecf2e2001', 'osd.1 up in weight 1 up_from 11 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6808/3906173234,v1:172.21.15.17:6809/3906173234] [v2:172.21.15.17:6810/3906173234,v1:172.21.15.17:6811/3906173234] exists,up 7a17ca3b-8e49-4d92-a633-45d3e4a45b4e', 'osd.2 up in weight 1 up_from 11 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6816/1974346628,v1:172.21.15.17:6817/1974346628] [v2:172.21.15.17:6818/1974346628,v1:172.21.15.17:6819/1974346628] exists,up dae09a32-24c6-464c-bee8-04ef2c42f7e4', 'osd.3 up in weight 1 up_from 11 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.47:6808/3370202675,v1:172.21.15.47:6809/3370202675] [v2:172.21.15.47:6810/3370202675,v1:172.21.15.47:6811/3370202675] exists,up 9cc5463c-cdb4-4a6a-b526-39a60de417f4', 'osd.4 up in weight 1 up_from 11 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.47:6816/1823488259,v1:172.21.15.47:6817/1823488259] [v2:172.21.15.47:6818/1823488259,v1:172.21.15.47:6819/1823488259] exists,up 1e329af3-a88a-4a95-b822-01519079084b', 'osd.5 up in weight 1 up_from 11 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.47:6800/3328086750,v1:172.21.15.47:6801/3328086750] [v2:172.21.15.47:6802/3328086750,v1:172.21.15.47:6803/3328086750] exists,up c255a252-3afe-4aad-b44c-85820867c960'] 2024-09-12T16:15:54.449 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-12T16:15:54.551 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:15:54.551 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mon.a", 2024-09-12T16:15:54.551 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster": "ceph", 2024-09-12T16:15:54.551 INFO:teuthology.orchestra.run.smithi017.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-12T16:15:54.551 INFO:teuthology.orchestra.run.smithi017.stdout: "admin_socket_mode": "", 2024-09-12T16:15:54.551 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-12T16:15:54.551 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_client_required": "cephx, none", 2024-09-12T16:15:54.551 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_cluster_required": "cephx", 2024-09-12T16:15:54.551 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_debug": "true", 2024-09-12T16:15:54.551 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-12T16:15:54.552 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-12T16:15:54.552 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_service_required": "cephx", 2024-09-12T16:15:54.552 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-12T16:15:54.552 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_supported": "cephx", 2024-09-12T16:15:54.552 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_aio": "true", 2024-09-12T16:15:54.552 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-12T16:15:54.552 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_aio_poll_ms": "250", 2024-09-12T16:15:54.552 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_aio_reap_max": "16", 2024-09-12T16:15:54.552 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_async_discard_threads": "0", 2024-09-12T16:15:54.552 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_block_size": "4096", 2024-09-12T16:15:54.552 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_debug_aio": "false", 2024-09-12T16:15:54.552 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-12T16:15:54.553 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-12T16:15:54.553 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_debug_inflight_ios": "false", 2024-09-12T16:15:54.553 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_enable_discard": "false", 2024-09-12T16:15:54.553 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_flock_retry": "3", 2024-09-12T16:15:54.553 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-12T16:15:54.553 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_inject_crash": "0", 2024-09-12T16:15:54.553 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-12T16:15:54.553 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_ioring": "false", 2024-09-12T16:15:54.553 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_ioring_hipri": "false", 2024-09-12T16:15:54.553 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-12T16:15:54.553 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-12T16:15:54.553 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-12T16:15:54.553 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-12T16:15:54.554 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-12T16:15:54.554 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-12T16:15:54.554 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_type": "", 2024-09-12T16:15:54.554 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_alloc_size": "1048576", 2024-09-12T16:15:54.554 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_allocator": "hybrid", 2024-09-12T16:15:54.554 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_buffered_io": "true", 2024-09-12T16:15:54.554 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_check_for_zeros": "false", 2024-09-12T16:15:54.554 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-12T16:15:54.554 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-12T16:15:54.554 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_compact_log_sync": "false", 2024-09-12T16:15:54.554 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-12T16:15:54.554 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-12T16:15:54.555 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-12T16:15:54.555 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-12T16:15:54.555 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_max_log_runway": "4194304", 2024-09-12T16:15:54.555 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_max_prefetch": "1048576", 2024-09-12T16:15:54.555 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_min_flush_size": "524288", 2024-09-12T16:15:54.555 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_min_log_runway": "1048576", 2024-09-12T16:15:54.555 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_replay_recovery": "false", 2024-09-12T16:15:54.555 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-12T16:15:54.555 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-12T16:15:54.555 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_sync_write": "false", 2024-09-12T16:15:54.555 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-12T16:15:54.555 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-12T16:15:54.556 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-12T16:15:54.556 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_allocation_from_file": "true", 2024-09-12T16:15:54.556 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_allocator": "hybrid", 2024-09-12T16:15:54.556 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_async_db_compaction": "true", 2024-09-12T16:15:54.556 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-12T16:15:54.556 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-12T16:15:54.556 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-12T16:15:54.556 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-12T16:15:54.556 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_bdev_label_multi": "true", 2024-09-12T16:15:54.556 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-12T16:15:54.556 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-12T16:15:54.556 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-12T16:15:54.556 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-12T16:15:54.557 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-12T16:15:54.557 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_create": "true", 2024-09-12T16:15:54.557 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_db_create": "false", 2024-09-12T16:15:54.557 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_db_path": "", 2024-09-12T16:15:54.557 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_db_size": "0", 2024-09-12T16:15:54.557 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_path": "", 2024-09-12T16:15:54.557 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_preallocate_file": "false", 2024-09-12T16:15:54.557 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_size": "107374182400", 2024-09-12T16:15:54.557 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_wal_create": "false", 2024-09-12T16:15:54.557 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_wal_path": "", 2024-09-12T16:15:54.557 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_wal_size": "100663296", 2024-09-12T16:15:54.557 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_bluefs": "true", 2024-09-12T16:15:54.557 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-12T16:15:54.558 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-12T16:15:54.558 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-12T16:15:54.558 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_btree2_alloc_weight_factor": "2.000000", 2024-09-12T16:15:54.558 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-12T16:15:54.558 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T16:15:54.558 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T16:15:54.558 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-12T16:15:54.558 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T16:15:54.558 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_autotune": "true", 2024-09-12T16:15:54.558 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-12T16:15:54.558 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-12T16:15:54.558 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-12T16:15:54.558 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-12T16:15:54.558 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_size": "0", 2024-09-12T16:15:54.559 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-12T16:15:54.559 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-12T16:15:54.559 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-12T16:15:54.559 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-12T16:15:54.559 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_type": "2q", 2024-09-12T16:15:54.559 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-12T16:15:54.559 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_clone_cow": "true", 2024-09-12T16:15:54.559 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-12T16:15:54.559 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-12T16:15:54.559 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-12T16:15:54.559 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-12T16:15:54.559 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-12T16:15:54.559 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-12T16:15:54.560 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-12T16:15:54.560 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_compression_mode": "none", 2024-09-12T16:15:54.560 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-12T16:15:54.560 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_csum_type": "crc32c", 2024-09-12T16:15:54.560 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-09-12T16:15:54.560 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-12T16:15:54.560 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_freelist": "false", 2024-09-12T16:15:54.560 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-12T16:15:54.560 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-12T16:15:54.560 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-12T16:15:54.560 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-12T16:15:54.560 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-12T16:15:54.560 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-12T16:15:54.561 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-12T16:15:54.561 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-12T16:15:54.561 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-12T16:15:54.562 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-12T16:15:54.562 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-12T16:15:54.562 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-12T16:15:54.562 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_small_allocations": "0", 2024-09-12T16:15:54.562 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-12T16:15:54.562 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_default_buffered_read": "true", 2024-09-12T16:15:54.562 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_default_buffered_write": "false", 2024-09-12T16:15:54.562 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-12T16:15:54.562 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-12T16:15:54.562 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-12T16:15:54.562 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-12T16:15:54.562 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-12T16:15:54.563 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-12T16:15:54.563 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-12T16:15:54.563 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-12T16:15:54.563 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-12T16:15:54.563 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fail_eio": "false", 2024-09-12T16:15:54.563 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-12T16:15:54.563 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-12T16:15:54.563 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-12T16:15:54.563 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-12T16:15:54.563 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-12T16:15:54.564 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-12T16:15:54.564 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_on_mount": "false", 2024-09-12T16:15:54.564 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-12T16:15:54.564 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_on_umount": "false", 2024-09-12T16:15:54.564 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-12T16:15:54.564 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-12T16:15:54.564 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-12T16:15:54.564 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-12T16:15:54.564 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-12T16:15:54.564 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-12T16:15:54.564 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-12T16:15:54.564 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-12T16:15:54.564 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_ignore_data_csum": "false", 2024-09-12T16:15:54.565 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-12T16:15:54.565 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-12T16:15:54.565 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-12T16:15:54.565 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-12T16:15:54.565 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_log_op_age": "5.000000", 2024-09-12T16:15:54.565 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_max_alloc_size": "0", 2024-09-12T16:15:54.565 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_max_blob_size": "0", 2024-09-12T16:15:54.565 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-12T16:15:54.565 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-12T16:15:54.565 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-12T16:15:54.565 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_max_deferred_txc": "32", 2024-09-12T16:15:54.565 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_min_alloc_size": "0", 2024-09-12T16:15:54.565 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-12T16:15:54.565 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-12T16:15:54.566 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_nid_prealloc": "1024", 2024-09-12T16:15:54.566 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-12T16:15:54.566 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-12T16:15:54.566 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-12T16:15:54.566 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-12T16:15:54.566 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_retry_disk_reads": "3", 2024-09-12T16:15:54.566 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_rocksdb_cf": "true", 2024-09-12T16:15:54.566 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-12T16:15:54.566 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-12T16:15:54.566 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-12T16:15:54.566 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-12T16:15:54.566 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-12T16:15:54.566 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-12T16:15:54.567 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-12T16:15:54.567 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-12T16:15:54.567 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_spdk_mem": "512", 2024-09-12T16:15:54.567 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-12T16:15:54.567 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-12T16:15:54.567 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-12T16:15:54.567 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-12T16:15:54.567 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-12T16:15:54.567 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-12T16:15:54.567 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-12T16:15:54.567 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_tracing": "false", 2024-09-12T16:15:54.567 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-12T16:15:54.567 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-12T16:15:54.568 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-12T16:15:54.568 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-12T16:15:54.568 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-12T16:15:54.568 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-12T16:15:54.568 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-12T16:15:54.568 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-12T16:15:54.568 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-12T16:15:54.568 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_write_v2": "false", 2024-09-12T16:15:54.568 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_write_v2_random": "false", 2024-09-12T16:15:54.568 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_zero_block_detection": "false", 2024-09-12T16:15:54.568 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-12T16:15:54.568 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-12T16:15:54.568 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-12T16:15:54.569 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-12T16:15:54.569 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-12T16:15:54.569 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-12T16:15:54.569 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-12T16:15:54.569 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-12T16:15:54.569 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-12T16:15:54.569 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-12T16:15:54.569 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-12T16:15:54.569 INFO:teuthology.orchestra.run.smithi017.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-12T16:15:54.569 INFO:teuthology.orchestra.run.smithi017.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-12T16:15:54.569 INFO:teuthology.orchestra.run.smithi017.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-12T16:15:54.569 INFO:teuthology.orchestra.run.smithi017.stdout: "cephx_cluster_require_signatures": "false", 2024-09-12T16:15:54.569 INFO:teuthology.orchestra.run.smithi017.stdout: "cephx_cluster_require_version": "2", 2024-09-12T16:15:54.570 INFO:teuthology.orchestra.run.smithi017.stdout: "cephx_require_signatures": "false", 2024-09-12T16:15:54.570 INFO:teuthology.orchestra.run.smithi017.stdout: "cephx_require_version": "2", 2024-09-12T16:15:54.570 INFO:teuthology.orchestra.run.smithi017.stdout: "cephx_service_require_signatures": "false", 2024-09-12T16:15:54.570 INFO:teuthology.orchestra.run.smithi017.stdout: "cephx_service_require_version": "2", 2024-09-12T16:15:54.570 INFO:teuthology.orchestra.run.smithi017.stdout: "cephx_sign_messages": "true", 2024-09-12T16:15:54.570 INFO:teuthology.orchestra.run.smithi017.stdout: "chdir": "", 2024-09-12T16:15:54.570 INFO:teuthology.orchestra.run.smithi017.stdout: "client_acl_type": "", 2024-09-12T16:15:54.570 INFO:teuthology.orchestra.run.smithi017.stdout: "client_asio_thread_count": "2", 2024-09-12T16:15:54.570 INFO:teuthology.orchestra.run.smithi017.stdout: "client_cache_mid": "0.750000", 2024-09-12T16:15:54.570 INFO:teuthology.orchestra.run.smithi017.stdout: "client_cache_size": "16384", 2024-09-12T16:15:54.570 INFO:teuthology.orchestra.run.smithi017.stdout: "client_caps_release_delay": "5", 2024-09-12T16:15:54.570 INFO:teuthology.orchestra.run.smithi017.stdout: "client_check_pool_perm": "true", 2024-09-12T16:15:54.570 INFO:teuthology.orchestra.run.smithi017.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-12T16:15:54.571 INFO:teuthology.orchestra.run.smithi017.stdout: "client_debug_force_sync_read": "false", 2024-09-12T16:15:54.571 INFO:teuthology.orchestra.run.smithi017.stdout: "client_debug_getattr_caps": "false", 2024-09-12T16:15:54.571 INFO:teuthology.orchestra.run.smithi017.stdout: "client_debug_inject_features": "", 2024-09-12T16:15:54.571 INFO:teuthology.orchestra.run.smithi017.stdout: "client_debug_inject_tick_delay": "0", 2024-09-12T16:15:54.571 INFO:teuthology.orchestra.run.smithi017.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-12T16:15:54.571 INFO:teuthology.orchestra.run.smithi017.stdout: "client_die_on_failed_remount": "false", 2024-09-12T16:15:54.571 INFO:teuthology.orchestra.run.smithi017.stdout: "client_dirsize_rbytes": "true", 2024-09-12T16:15:54.571 INFO:teuthology.orchestra.run.smithi017.stdout: "client_force_lazyio": "false", 2024-09-12T16:15:54.571 INFO:teuthology.orchestra.run.smithi017.stdout: "client_fs": "", 2024-09-12T16:15:54.571 INFO:teuthology.orchestra.run.smithi017.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-12T16:15:54.571 INFO:teuthology.orchestra.run.smithi017.stdout: "client_inject_release_failure": "false", 2024-09-12T16:15:54.571 INFO:teuthology.orchestra.run.smithi017.stdout: "client_max_inline_size": "4096", 2024-09-12T16:15:54.571 INFO:teuthology.orchestra.run.smithi017.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-12T16:15:54.571 INFO:teuthology.orchestra.run.smithi017.stdout: "client_mds_namespace": "", 2024-09-12T16:15:54.572 INFO:teuthology.orchestra.run.smithi017.stdout: "client_metadata": "", 2024-09-12T16:15:54.572 INFO:teuthology.orchestra.run.smithi017.stdout: "client_mount_gid": "-1", 2024-09-12T16:15:54.572 INFO:teuthology.orchestra.run.smithi017.stdout: "client_mount_timeout": "300", 2024-09-12T16:15:54.572 INFO:teuthology.orchestra.run.smithi017.stdout: "client_mount_uid": "-1", 2024-09-12T16:15:54.572 INFO:teuthology.orchestra.run.smithi017.stdout: "client_mountpoint": "/", 2024-09-12T16:15:54.572 INFO:teuthology.orchestra.run.smithi017.stdout: "client_notify_timeout": "10", 2024-09-12T16:15:54.572 INFO:teuthology.orchestra.run.smithi017.stdout: "client_oc": "true", 2024-09-12T16:15:54.572 INFO:teuthology.orchestra.run.smithi017.stdout: "client_oc_max_dirty": "104857600", 2024-09-12T16:15:54.572 INFO:teuthology.orchestra.run.smithi017.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-12T16:15:54.572 INFO:teuthology.orchestra.run.smithi017.stdout: "client_oc_max_objects": "1000", 2024-09-12T16:15:54.572 INFO:teuthology.orchestra.run.smithi017.stdout: "client_oc_size": "209715200", 2024-09-12T16:15:54.572 INFO:teuthology.orchestra.run.smithi017.stdout: "client_oc_target_dirty": "8388608", 2024-09-12T16:15:54.572 INFO:teuthology.orchestra.run.smithi017.stdout: "client_permissions": "true", 2024-09-12T16:15:54.573 INFO:teuthology.orchestra.run.smithi017.stdout: "client_quota": "true", 2024-09-12T16:15:54.573 INFO:teuthology.orchestra.run.smithi017.stdout: "client_quota_df": "true", 2024-09-12T16:15:54.573 INFO:teuthology.orchestra.run.smithi017.stdout: "client_readahead_max_bytes": "0", 2024-09-12T16:15:54.573 INFO:teuthology.orchestra.run.smithi017.stdout: "client_readahead_max_periods": "4", 2024-09-12T16:15:54.573 INFO:teuthology.orchestra.run.smithi017.stdout: "client_readahead_min": "131072", 2024-09-12T16:15:54.573 INFO:teuthology.orchestra.run.smithi017.stdout: "client_reconnect_stale": "false", 2024-09-12T16:15:54.573 INFO:teuthology.orchestra.run.smithi017.stdout: "client_shutdown_timeout": "30", 2024-09-12T16:15:54.573 INFO:teuthology.orchestra.run.smithi017.stdout: "client_snapdir": ".snap", 2024-09-12T16:15:54.573 INFO:teuthology.orchestra.run.smithi017.stdout: "client_tick_interval": "1", 2024-09-12T16:15:54.573 INFO:teuthology.orchestra.run.smithi017.stdout: "client_trace": "", 2024-09-12T16:15:54.573 INFO:teuthology.orchestra.run.smithi017.stdout: "client_try_dentry_invalidate": "false", 2024-09-12T16:15:54.573 INFO:teuthology.orchestra.run.smithi017.stdout: "client_use_faked_inos": "false", 2024-09-12T16:15:54.573 INFO:teuthology.orchestra.run.smithi017.stdout: "client_use_random_mds": "false", 2024-09-12T16:15:54.573 INFO:teuthology.orchestra.run.smithi017.stdout: "clog_to_graylog": "false", 2024-09-12T16:15:54.574 INFO:teuthology.orchestra.run.smithi017.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-12T16:15:54.574 INFO:teuthology.orchestra.run.smithi017.stdout: "clog_to_graylog_port": "12201", 2024-09-12T16:15:54.574 INFO:teuthology.orchestra.run.smithi017.stdout: "clog_to_monitors": "default=true", 2024-09-12T16:15:54.574 INFO:teuthology.orchestra.run.smithi017.stdout: "clog_to_syslog": "false", 2024-09-12T16:15:54.574 INFO:teuthology.orchestra.run.smithi017.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-12T16:15:54.574 INFO:teuthology.orchestra.run.smithi017.stdout: "clog_to_syslog_level": "info", 2024-09-12T16:15:54.574 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "-", 2024-09-12T16:15:54.574 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_network": "", 2024-09-12T16:15:54.574 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_network_interface": "", 2024-09-12T16:15:54.574 INFO:teuthology.orchestra.run.smithi017.stdout: "compressor_zlib_isal": "false", 2024-09-12T16:15:54.574 INFO:teuthology.orchestra.run.smithi017.stdout: "compressor_zlib_level": "5", 2024-09-12T16:15:54.574 INFO:teuthology.orchestra.run.smithi017.stdout: "compressor_zlib_winsize": "-15", 2024-09-12T16:15:54.574 INFO:teuthology.orchestra.run.smithi017.stdout: "compressor_zstd_level": "1", 2024-09-12T16:15:54.575 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-12T16:15:54.575 INFO:teuthology.orchestra.run.smithi017.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-12T16:15:54.575 INFO:teuthology.orchestra.run.smithi017.stdout: "crimson_alien_op_num_threads": "6", 2024-09-12T16:15:54.575 INFO:teuthology.orchestra.run.smithi017.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-12T16:15:54.575 INFO:teuthology.orchestra.run.smithi017.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-12T16:15:54.575 INFO:teuthology.orchestra.run.smithi017.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-12T16:15:54.575 INFO:teuthology.orchestra.run.smithi017.stdout: "crimson_osd_stat_interval": "0", 2024-09-12T16:15:54.575 INFO:teuthology.orchestra.run.smithi017.stdout: "crimson_seastar_cpu_cores": "", 2024-09-12T16:15:54.575 INFO:teuthology.orchestra.run.smithi017.stdout: "crimson_seastar_num_threads": "0", 2024-09-12T16:15:54.575 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_location": "", 2024-09-12T16:15:54.575 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_location_hook": "", 2024-09-12T16:15:54.575 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_location_hook_timeout": "10", 2024-09-12T16:15:54.575 INFO:teuthology.orchestra.run.smithi017.stdout: "daemonize": "false", 2024-09-12T16:15:54.576 INFO:teuthology.orchestra.run.smithi017.stdout: "daos_pool": "tank", 2024-09-12T16:15:54.576 INFO:teuthology.orchestra.run.smithi017.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-12T16:15:54.576 INFO:teuthology.orchestra.run.smithi017.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-12T16:15:54.576 INFO:teuthology.orchestra.run.smithi017.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-12T16:15:54.576 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_alienstore": "0/5", 2024-09-12T16:15:54.576 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_allow_any_pool_priority": "false", 2024-09-12T16:15:54.576 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_asok": "1/5", 2024-09-12T16:15:54.576 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_asok_assert_abort": "false", 2024-09-12T16:15:54.576 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_asserts_on_shutdown": "true", 2024-09-12T16:15:54.576 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_auth": "20/20", 2024-09-12T16:15:54.576 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_bdev": "1/3", 2024-09-12T16:15:54.576 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_bluefs": "1/5", 2024-09-12T16:15:54.576 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_bluestore": "1/5", 2024-09-12T16:15:54.576 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_buffer": "0/1", 2024-09-12T16:15:54.577 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_ceph_dedup": "0/5", 2024-09-12T16:15:54.577 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_ceph_exporter": "1/5", 2024-09-12T16:15:54.577 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_cephfs_mirror": "0/5", 2024-09-12T16:15:54.577 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_cephsqlite": "0/5", 2024-09-12T16:15:54.577 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_client": "0/5", 2024-09-12T16:15:54.577 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_compressor": "1/5", 2024-09-12T16:15:54.577 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_context": "0/1", 2024-09-12T16:15:54.577 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_crimson_interrupt": "0/5", 2024-09-12T16:15:54.577 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_crush": "1/1", 2024-09-12T16:15:54.577 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_crypto": "1/5", 2024-09-12T16:15:54.578 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_cyanstore": "0/5", 2024-09-12T16:15:54.578 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_deliberately_leak_memory": "false", 2024-09-12T16:15:54.578 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_disable_randomized_ping": "false", 2024-09-12T16:15:54.578 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_dpdk": "1/5", 2024-09-12T16:15:54.578 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_eventtrace": "1/5", 2024-09-12T16:15:54.578 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_filer": "0/1", 2024-09-12T16:15:54.578 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_filestore": "1/3", 2024-09-12T16:15:54.578 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_finisher": "1/1", 2024-09-12T16:15:54.578 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_fuse": "1/5", 2024-09-12T16:15:54.578 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_heartbeat_testing_span": "0", 2024-09-12T16:15:54.578 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_heartbeatmap": "1/5", 2024-09-12T16:15:54.578 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-12T16:15:54.578 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_javaclient": "1/5", 2024-09-12T16:15:54.579 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_journal": "1/3", 2024-09-12T16:15:54.579 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_journaler": "0/5", 2024-09-12T16:15:54.579 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_kstore": "1/5", 2024-09-12T16:15:54.579 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_lockdep": "0/1", 2024-09-12T16:15:54.579 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mclock": "1/5", 2024-09-12T16:15:54.579 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mds": "1/5", 2024-09-12T16:15:54.579 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mds_balancer": "1/5", 2024-09-12T16:15:54.579 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mds_locker": "1/5", 2024-09-12T16:15:54.579 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mds_log": "1/5", 2024-09-12T16:15:54.579 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mds_log_expire": "1/5", 2024-09-12T16:15:54.579 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mds_migrator": "1/5", 2024-09-12T16:15:54.579 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mds_quiesce": "3/5", 2024-09-12T16:15:54.579 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_memstore": "1/5", 2024-09-12T16:15:54.579 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mgr": "2/5", 2024-09-12T16:15:54.580 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mgrc": "1/5", 2024-09-12T16:15:54.580 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mon": "20/20", 2024-09-12T16:15:54.580 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_monc": "0/10", 2024-09-12T16:15:54.580 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_ms": "1/1", 2024-09-12T16:15:54.580 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_none": "0/5", 2024-09-12T16:15:54.580 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_objclass": "0/5", 2024-09-12T16:15:54.580 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_objectcacher": "0/5", 2024-09-12T16:15:54.580 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_objecter": "0/1", 2024-09-12T16:15:54.580 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_optracker": "0/5", 2024-09-12T16:15:54.580 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_osd": "1/5", 2024-09-12T16:15:54.580 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_paxos": "20/20", 2024-09-12T16:15:54.580 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_perfcounter": "1/5", 2024-09-12T16:15:54.580 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_prioritycache": "1/5", 2024-09-12T16:15:54.581 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rados": "0/5", 2024-09-12T16:15:54.581 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rbd": "0/5", 2024-09-12T16:15:54.581 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rbd_mirror": "0/5", 2024-09-12T16:15:54.581 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rbd_pwl": "0/5", 2024-09-12T16:15:54.581 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rbd_replay": "0/5", 2024-09-12T16:15:54.581 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_refs": "0/0", 2024-09-12T16:15:54.581 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_reserver": "1/1", 2024-09-12T16:15:54.581 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rgw": "1/5", 2024-09-12T16:15:54.581 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rgw_access": "1/5", 2024-09-12T16:15:54.581 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rgw_datacache": "1/5", 2024-09-12T16:15:54.581 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rgw_dbstore": "1/5", 2024-09-12T16:15:54.581 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rgw_flight": "1/5", 2024-09-12T16:15:54.581 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-12T16:15:54.581 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rgw_notification": "1/5", 2024-09-12T16:15:54.582 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rgw_sync": "1/5", 2024-09-12T16:15:54.582 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rocksdb": "4/5", 2024-09-12T16:15:54.582 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore": "0/5", 2024-09-12T16:15:54.582 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_backref": "0/5", 2024-09-12T16:15:54.582 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_cache": "0/5", 2024-09-12T16:15:54.582 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_cleaner": "0/5", 2024-09-12T16:15:54.582 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_device": "0/5", 2024-09-12T16:15:54.582 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_epm": "0/5", 2024-09-12T16:15:54.582 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-12T16:15:54.582 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_journal": "0/5", 2024-09-12T16:15:54.582 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_lba": "0/5", 2024-09-12T16:15:54.582 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_odata": "0/5", 2024-09-12T16:15:54.583 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_omap": "0/5", 2024-09-12T16:15:54.583 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_onode": "0/5", 2024-09-12T16:15:54.583 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_t": "0/5", 2024-09-12T16:15:54.583 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_tm": "0/5", 2024-09-12T16:15:54.583 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_striper": "0/1", 2024-09-12T16:15:54.583 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_test": "0/5", 2024-09-12T16:15:54.583 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_throttle": "1/1", 2024-09-12T16:15:54.583 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_timer": "0/1", 2024-09-12T16:15:54.583 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_tp": "0/5", 2024-09-12T16:15:54.583 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_trace": "1/5", 2024-09-12T16:15:54.583 INFO:teuthology.orchestra.run.smithi017.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-12T16:15:54.583 INFO:teuthology.orchestra.run.smithi017.stdout: "device_failure_prediction_mode": "none", 2024-09-12T16:15:54.583 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-12T16:15:54.584 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-09-12T16:15:54.584 INFO:teuthology.orchestra.run.smithi017.stdout: "err_to_graylog": "false", 2024-09-12T16:15:54.584 INFO:teuthology.orchestra.run.smithi017.stdout: "err_to_journald": "false", 2024-09-12T16:15:54.584 INFO:teuthology.orchestra.run.smithi017.stdout: "err_to_stderr": "true", 2024-09-12T16:15:54.584 INFO:teuthology.orchestra.run.smithi017.stdout: "err_to_syslog": "false", 2024-09-12T16:15:54.584 INFO:teuthology.orchestra.run.smithi017.stdout: "event_tracing": "false", 2024-09-12T16:15:54.584 INFO:teuthology.orchestra.run.smithi017.stdout: "exporter_addr": "0.0.0.0", 2024-09-12T16:15:54.584 INFO:teuthology.orchestra.run.smithi017.stdout: "exporter_cert_file": "", 2024-09-12T16:15:54.584 INFO:teuthology.orchestra.run.smithi017.stdout: "exporter_http_port": "9926", 2024-09-12T16:15:54.584 INFO:teuthology.orchestra.run.smithi017.stdout: "exporter_key_file": "", 2024-09-12T16:15:54.584 INFO:teuthology.orchestra.run.smithi017.stdout: "exporter_prio_limit": "5", 2024-09-12T16:15:54.584 INFO:teuthology.orchestra.run.smithi017.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-12T16:15:54.584 INFO:teuthology.orchestra.run.smithi017.stdout: "exporter_sort_metrics": "true", 2024-09-12T16:15:54.585 INFO:teuthology.orchestra.run.smithi017.stdout: "exporter_stats_period": "5", 2024-09-12T16:15:54.585 INFO:teuthology.orchestra.run.smithi017.stdout: "fake_statfs_for_testing": "0", 2024-09-12T16:15:54.585 INFO:teuthology.orchestra.run.smithi017.stdout: "fatal_signal_handlers": "true", 2024-09-12T16:15:54.585 INFO:teuthology.orchestra.run.smithi017.stdout: "filer_max_purge_ops": "10", 2024-09-12T16:15:54.585 INFO:teuthology.orchestra.run.smithi017.stdout: "filer_max_truncate_ops": "128", 2024-09-12T16:15:54.585 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_apply_finisher_threads": "1", 2024-09-12T16:15:54.585 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_blackhole": "false", 2024-09-12T16:15:54.585 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_btrfs_clone_range": "true", 2024-09-12T16:15:54.585 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_btrfs_snap": "true", 2024-09-12T16:15:54.585 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_caller_concurrency": "10", 2024-09-12T16:15:54.585 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_collect_device_partition_information": "true", 2024-09-12T16:15:54.585 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_commit_timeout": "600.000000", 2024-09-12T16:15:54.585 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_debug_inject_read_err": "false", 2024-09-12T16:15:54.586 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_debug_omap_check": "false", 2024-09-12T16:15:54.586 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_debug_verify_split": "false", 2024-09-12T16:15:54.586 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_dump_file": "", 2024-09-12T16:15:54.586 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-12T16:15:54.586 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-12T16:15:54.586 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_fadvise": "true", 2024-09-12T16:15:54.586 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_fail_eio": "true", 2024-09-12T16:15:54.586 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_fd_cache_shards": "16", 2024-09-12T16:15:54.586 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_fd_cache_size": "128", 2024-09-12T16:15:54.586 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_fiemap": "false", 2024-09-12T16:15:54.586 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_fiemap_threshold": "4096", 2024-09-12T16:15:54.586 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-12T16:15:54.586 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-12T16:15:54.586 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_inject_stall": "0", 2024-09-12T16:15:54.587 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_journal_parallel": "false", 2024-09-12T16:15:54.587 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_journal_trailing": "false", 2024-09-12T16:15:54.587 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_journal_writeahead": "false", 2024-09-12T16:15:54.587 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_kill_at": "0", 2024-09-12T16:15:54.587 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-12T16:15:54.587 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-12T16:15:54.587 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-12T16:15:54.587 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-12T16:15:54.587 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-12T16:15:54.587 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_inline_xattrs": "0", 2024-09-12T16:15:54.587 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-12T16:15:54.587 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-12T16:15:54.587 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-12T16:15:54.588 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-12T16:15:54.588 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_xattr_value_size": "0", 2024-09-12T16:15:54.588 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-12T16:15:54.588 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-12T16:15:54.588 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-12T16:15:54.588 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_merge_threshold": "-10", 2024-09-12T16:15:54.588 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-12T16:15:54.588 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_odsync_write": "false", 2024-09-12T16:15:54.588 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_omap_backend": "rocksdb", 2024-09-12T16:15:54.588 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_omap_backend_path": "", 2024-09-12T16:15:54.589 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-12T16:15:54.589 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-12T16:15:54.589 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-12T16:15:54.589 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_op_thread_timeout": "60", 2024-09-12T16:15:54.589 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_op_threads": "2", 2024-09-12T16:15:54.589 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_punch_hole": "false", 2024-09-12T16:15:54.589 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-12T16:15:54.589 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-12T16:15:54.589 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-12T16:15:54.589 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-12T16:15:54.589 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-12T16:15:54.589 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-12T16:15:54.589 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-12T16:15:54.589 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-12T16:15:54.590 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-12T16:15:54.590 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_max_ops": "50", 2024-09-12T16:15:54.590 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-12T16:15:54.590 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_seek_data_hole": "false", 2024-09-12T16:15:54.590 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_sloppy_crc": "false", 2024-09-12T16:15:54.590 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-12T16:15:54.590 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_splice": "false", 2024-09-12T16:15:54.590 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_split_multiple": "2", 2024-09-12T16:15:54.590 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_split_rand_factor": "20", 2024-09-12T16:15:54.590 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_update_to": "1000", 2024-09-12T16:15:54.590 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-12T16:15:54.590 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-12T16:15:54.590 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-12T16:15:54.591 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-12T16:15:54.591 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-12T16:15:54.591 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-12T16:15:54.591 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_enable": "true", 2024-09-12T16:15:54.591 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-12T16:15:54.591 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-12T16:15:54.591 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-12T16:15:54.591 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-12T16:15:54.591 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-12T16:15:54.591 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-12T16:15:54.591 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_xfs_extsize": "false", 2024-09-12T16:15:54.591 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_zfs_snap": "false", 2024-09-12T16:15:54.591 INFO:teuthology.orchestra.run.smithi017.stdout: "fio_dir": "/tmp/fio", 2024-09-12T16:15:54.592 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "66dcb8ed-8de5-4784-8071-fd6b3bf3b78f", 2024-09-12T16:15:54.592 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_allow_other": "true", 2024-09-12T16:15:54.592 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_atomic_o_trunc": "true", 2024-09-12T16:15:54.592 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_big_writes": "true", 2024-09-12T16:15:54.592 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_debug": "false", 2024-09-12T16:15:54.592 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_default_permissions": "false", 2024-09-12T16:15:54.592 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_disable_pagecache": "false", 2024-09-12T16:15:54.592 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_max_write": "0", 2024-09-12T16:15:54.592 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_multithreaded": "true", 2024-09-12T16:15:54.592 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_require_active_mds": "true", 2024-09-12T16:15:54.592 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_set_user_groups": "true", 2024-09-12T16:15:54.592 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_splice_move": "true", 2024-09-12T16:15:54.592 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_splice_read": "true", 2024-09-12T16:15:54.592 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_splice_write": "true", 2024-09-12T16:15:54.593 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-12T16:15:54.593 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_use_invalidate_cb": "true", 2024-09-12T16:15:54.593 INFO:teuthology.orchestra.run.smithi017.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-12T16:15:54.593 INFO:teuthology.orchestra.run.smithi017.stdout: "gss_target_name": "ceph", 2024-09-12T16:15:54.593 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_file": "", 2024-09-12T16:15:54.593 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_inject_failure": "0", 2024-09-12T16:15:54.593 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_interval": "5", 2024-09-12T16:15:54.593 INFO:teuthology.orchestra.run.smithi017.stdout: "host": "smithi017", 2024-09-12T16:15:54.593 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-12T16:15:54.593 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-12T16:15:54.593 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-12T16:15:54.593 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-12T16:15:54.593 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-12T16:15:54.594 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-12T16:15:54.594 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-12T16:15:54.594 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-12T16:15:54.594 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-12T16:15:54.594 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-12T16:15:54.594 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-12T16:15:54.594 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-12T16:15:54.594 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-12T16:15:54.594 INFO:teuthology.orchestra.run.smithi017.stdout: "inject_early_sigterm": "false", 2024-09-12T16:15:54.594 INFO:teuthology.orchestra.run.smithi017.stdout: "jaeger_agent_port": "6799", 2024-09-12T16:15:54.594 INFO:teuthology.orchestra.run.smithi017.stdout: "jaeger_tracing_enable": "false", 2024-09-12T16:15:54.594 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_aio": "true", 2024-09-12T16:15:54.594 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_align_min_size": "65536", 2024-09-12T16:15:54.595 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_block_align": "true", 2024-09-12T16:15:54.595 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_block_size": "4096", 2024-09-12T16:15:54.595 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_dio": "true", 2024-09-12T16:15:54.595 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_discard": "false", 2024-09-12T16:15:54.595 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_force_aio": "false", 2024-09-12T16:15:54.595 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_ignore_corruption": "false", 2024-09-12T16:15:54.595 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_max_write_bytes": "10485760", 2024-09-12T16:15:54.595 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_max_write_entries": "100", 2024-09-12T16:15:54.595 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_replay_from": "0", 2024-09-12T16:15:54.595 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-12T16:15:54.595 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-12T16:15:54.595 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-12T16:15:54.595 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-12T16:15:54.595 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_write_header_frequency": "0", 2024-09-12T16:15:54.596 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_zero_on_create": "false", 2024-09-12T16:15:54.596 INFO:teuthology.orchestra.run.smithi017.stdout: "journaler_prefetch_periods": "10", 2024-09-12T16:15:54.596 INFO:teuthology.orchestra.run.smithi017.stdout: "journaler_prezero_periods": "5", 2024-09-12T16:15:54.596 INFO:teuthology.orchestra.run.smithi017.stdout: "journaler_write_head_interval": "15", 2024-09-12T16:15:54.596 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "", 2024-09-12T16:15:54.596 INFO:teuthology.orchestra.run.smithi017.stdout: "keyfile": "", 2024-09-12T16:15:54.596 INFO:teuthology.orchestra.run.smithi017.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-12T16:15:54.596 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_backend": "rocksdb", 2024-09-12T16:15:54.596 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_default_stripe_size": "65536", 2024-09-12T16:15:54.596 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_fsck_on_mount": "false", 2024-09-12T16:15:54.596 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-12T16:15:54.596 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_max_bytes": "67108864", 2024-09-12T16:15:54.596 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_max_ops": "512", 2024-09-12T16:15:54.597 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_nid_prealloc": "1024", 2024-09-12T16:15:54.597 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_onode_map_size": "1024", 2024-09-12T16:15:54.597 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-12T16:15:54.597 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_sync_submit_transaction": "false", 2024-09-12T16:15:54.597 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_sync_transaction": "false", 2024-09-12T16:15:54.597 INFO:teuthology.orchestra.run.smithi017.stdout: "librados_thread_count": "2", 2024-09-12T16:15:54.597 INFO:teuthology.orchestra.run.smithi017.stdout: "lockdep": "false", 2024-09-12T16:15:54.597 INFO:teuthology.orchestra.run.smithi017.stdout: "lockdep_force_backtrace": "false", 2024-09-12T16:15:54.597 INFO:teuthology.orchestra.run.smithi017.stdout: "log_coarse_timestamps": "true", 2024-09-12T16:15:54.597 INFO:teuthology.orchestra.run.smithi017.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-12T16:15:54.597 INFO:teuthology.orchestra.run.smithi017.stdout: "log_flush_on_exit": "false", 2024-09-12T16:15:54.597 INFO:teuthology.orchestra.run.smithi017.stdout: "log_graylog_host": "127.0.0.1", 2024-09-12T16:15:54.597 INFO:teuthology.orchestra.run.smithi017.stdout: "log_graylog_port": "12201", 2024-09-12T16:15:54.597 INFO:teuthology.orchestra.run.smithi017.stdout: "log_max_new": "1000", 2024-09-12T16:15:54.598 INFO:teuthology.orchestra.run.smithi017.stdout: "log_max_recent": "10000", 2024-09-12T16:15:54.598 INFO:teuthology.orchestra.run.smithi017.stdout: "log_stderr_prefix": "", 2024-09-12T16:15:54.598 INFO:teuthology.orchestra.run.smithi017.stdout: "log_stop_at_utilization": "0.970000", 2024-09-12T16:15:54.598 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": "true", 2024-09-12T16:15:54.598 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_graylog": "false", 2024-09-12T16:15:54.598 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_journald": "false", 2024-09-12T16:15:54.598 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_stderr": "false", 2024-09-12T16:15:54.598 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_syslog": "false", 2024-09-12T16:15:54.598 INFO:teuthology.orchestra.run.smithi017.stdout: "max_rotating_auth_attempts": "10", 2024-09-12T16:15:54.598 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-12T16:15:54.598 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_action_on_write_error": "1", 2024-09-12T16:15:54.598 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_alternate_name_max": "8192", 2024-09-12T16:15:54.598 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_asio_thread_count": "2", 2024-09-12T16:15:54.599 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_export_pin": "true", 2024-09-12T16:15:54.599 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_fragment_dirs": "true", 2024-09-12T16:15:54.599 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-12T16:15:54.599 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_fragment_interval": "5", 2024-09-12T16:15:54.599 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-12T16:15:54.599 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-12T16:15:54.599 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_interval": "10", 2024-09-12T16:15:54.599 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_max": "-1", 2024-09-12T16:15:54.599 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_max_until": "-1", 2024-09-12T16:15:54.599 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_merge_size": "50", 2024-09-12T16:15:54.599 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_midchunk": "0.300000", 2024-09-12T16:15:54.599 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-12T16:15:54.599 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_min_start": "0.200000", 2024-09-12T16:15:54.599 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_minchunk": "0.001000", 2024-09-12T16:15:54.600 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_mode": "0", 2024-09-12T16:15:54.600 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_need_max": "1.200000", 2024-09-12T16:15:54.600 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_need_min": "0.800000", 2024-09-12T16:15:54.600 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_overload_epochs": "2", 2024-09-12T16:15:54.600 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-12T16:15:54.600 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-12T16:15:54.600 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_split_bits": "3", 2024-09-12T16:15:54.600 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-12T16:15:54.600 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_split_size": "10000", 2024-09-12T16:15:54.600 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-12T16:15:54.600 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_target_decay": "10.000000", 2024-09-12T16:15:54.600 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-12T16:15:54.600 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_beacon_grace": "15.000000", 2024-09-12T16:15:54.600 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_beacon_interval": "4.000000", 2024-09-12T16:15:54.601 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-12T16:15:54.601 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-12T16:15:54.601 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache_mid": "0.700000", 2024-09-12T16:15:54.601 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-12T16:15:54.601 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache_quiesce_delay": "0", 2024-09-12T16:15:54.601 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-12T16:15:54.601 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-12T16:15:54.601 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-12T16:15:54.601 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache_release_free_interval": "10", 2024-09-12T16:15:54.601 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache_reservation": "0.050000", 2024-09-12T16:15:54.601 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-12T16:15:54.601 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache_trim_interval": "1", 2024-09-12T16:15:54.601 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache_trim_threshold": "262144", 2024-09-12T16:15:54.602 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-12T16:15:54.602 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-12T16:15:54.602 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-12T16:15:54.602 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_client_prealloc_inos": "1000", 2024-09-12T16:15:54.602 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-12T16:15:54.602 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_connect_bootstrapping": "false", 2024-09-12T16:15:54.602 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_damage_table_max_entries": "10000", 2024-09-12T16:15:54.602 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-12T16:15:54.602 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_debug_auth_pins": "false", 2024-09-12T16:15:54.602 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_debug_frag": "false", 2024-09-12T16:15:54.602 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_debug_scatterstat": "false", 2024-09-12T16:15:54.602 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_debug_subtrees": "false", 2024-09-12T16:15:54.602 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_decay_halflife": "5.000000", 2024-09-12T16:15:54.602 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_default_dir_hash": "2", 2024-09-12T16:15:54.603 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_defer_session_stale": "true", 2024-09-12T16:15:54.603 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_deny_all_reconnect": "false", 2024-09-12T16:15:54.603 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_dir_keys_per_op": "16384", 2024-09-12T16:15:54.603 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_dir_max_commit_size": "10", 2024-09-12T16:15:54.603 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_dir_max_entries": "0", 2024-09-12T16:15:54.603 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_dir_prefetch": "true", 2024-09-12T16:15:54.603 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-12T16:15:54.603 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-12T16:15:54.603 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_dump_cache_on_map": "false", 2024-09-12T16:15:54.603 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-12T16:15:54.603 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-12T16:15:54.603 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_early_reply": "true", 2024-09-12T16:15:54.603 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_enable_op_tracker": "true", 2024-09-12T16:15:54.603 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_enforce_unique_name": "true", 2024-09-12T16:15:54.604 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-12T16:15:54.604 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-12T16:15:54.604 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_export_ephemeral_random": "true", 2024-09-12T16:15:54.604 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-12T16:15:54.604 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-12T16:15:54.604 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-12T16:15:54.604 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-12T16:15:54.604 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-12T16:15:54.604 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-12T16:15:54.604 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-12T16:15:54.604 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-12T16:15:54.604 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_health_summarize_threshold": "10", 2024-09-12T16:15:54.604 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-12T16:15:54.605 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-12T16:15:54.605 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_inject_health_dummy": "false", 2024-09-12T16:15:54.605 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-12T16:15:54.605 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_inject_migrator_session_race": "false", 2024-09-12T16:15:54.605 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-12T16:15:54.605 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-12T16:15:54.605 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-12T16:15:54.605 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_join_fs": "", 2024-09-12T16:15:54.605 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_journal_format": "1", 2024-09-12T16:15:54.605 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-12T16:15:54.605 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_create_at": "0", 2024-09-12T16:15:54.605 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_dirfrag_at": "0", 2024-09-12T16:15:54.605 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_export_at": "0", 2024-09-12T16:15:54.605 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_import_at": "0", 2024-09-12T16:15:54.606 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_journal_at": "0", 2024-09-12T16:15:54.606 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_journal_expire_at": "0", 2024-09-12T16:15:54.606 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_journal_replay_at": "0", 2024-09-12T16:15:54.606 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_link_at": "0", 2024-09-12T16:15:54.606 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_mdstable_at": "0", 2024-09-12T16:15:54.606 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_openc_at": "0", 2024-09-12T16:15:54.606 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_rename_at": "0", 2024-09-12T16:15:54.606 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_shutdown_at": "0", 2024-09-12T16:15:54.606 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_event_large_threshold": "524288", 2024-09-12T16:15:54.606 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_events_per_segment": "1024", 2024-09-12T16:15:54.606 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-12T16:15:54.606 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_max_events": "-1", 2024-09-12T16:15:54.606 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_max_segments": "128", 2024-09-12T16:15:54.606 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_pause": "false", 2024-09-12T16:15:54.607 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_segment_size": "0", 2024-09-12T16:15:54.607 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-12T16:15:54.607 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-12T16:15:54.607 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-12T16:15:54.607 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_trim_threshold": "128", 2024-09-12T16:15:54.607 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-12T16:15:54.607 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_warn_factor": "2.000000", 2024-09-12T16:15:54.607 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_caps_per_client": "1048576", 2024-09-12T16:15:54.607 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_completed_flushes": "100000", 2024-09-12T16:15:54.607 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_completed_requests": "100000", 2024-09-12T16:15:54.607 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_export_size": "20971520", 2024-09-12T16:15:54.607 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_file_recover": "32", 2024-09-12T16:15:54.607 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_purge_files": "64", 2024-09-12T16:15:54.607 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_purge_ops": "8192", 2024-09-12T16:15:54.608 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-12T16:15:54.608 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-12T16:15:54.608 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_snaps_per_dir": "100", 2024-09-12T16:15:54.608 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_metrics_update_interval": "2", 2024-09-12T16:15:54.608 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_min_caps_per_client": "100", 2024-09-12T16:15:54.608 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_min_caps_working_set": "10000", 2024-09-12T16:15:54.608 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-12T16:15:54.608 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_numa_node": "-1", 2024-09-12T16:15:54.608 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-12T16:15:54.608 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_op_complaint_time": "30.000000", 2024-09-12T16:15:54.608 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_op_history_duration": "600", 2024-09-12T16:15:54.608 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_op_history_size": "20", 2024-09-12T16:15:54.608 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_op_history_slow_op_size": "20", 2024-09-12T16:15:54.609 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-12T16:15:54.609 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_op_log_threshold": "5", 2024-09-12T16:15:54.609 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_ping_grace": "15", 2024-09-12T16:15:54.609 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_ping_interval": "5", 2024-09-12T16:15:54.609 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-12T16:15:54.609 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-12T16:15:54.609 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_recall_max_caps": "30000", 2024-09-12T16:15:54.609 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-12T16:15:54.609 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-12T16:15:54.609 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-12T16:15:54.609 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_recall_warning_threshold": "262144", 2024-09-12T16:15:54.609 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-12T16:15:54.609 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_replay_interval": "1.000000", 2024-09-12T16:15:54.610 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-12T16:15:54.610 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-12T16:15:54.610 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_root_ino_gid": "0", 2024-09-12T16:15:54.610 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_root_ino_uid": "0", 2024-09-12T16:15:54.610 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-12T16:15:54.610 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_scrub_stats_review_period": "1", 2024-09-12T16:15:54.610 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_server_dispatch_client_request_delay": "0", 2024-09-12T16:15:54.610 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2024-09-12T16:15:54.610 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-12T16:15:54.610 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-12T16:15:54.610 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-12T16:15:54.610 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-12T16:15:54.610 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-12T16:15:54.610 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-12T16:15:54.611 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-12T16:15:54.611 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-12T16:15:54.611 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-12T16:15:54.611 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_shutdown_check": "0", 2024-09-12T16:15:54.611 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_skip_ino": "0", 2024-09-12T16:15:54.611 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-12T16:15:54.611 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_snap_max_uid": "4294967294", 2024-09-12T16:15:54.611 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_snap_min_uid": "0", 2024-09-12T16:15:54.611 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_snap_rstat": "false", 2024-09-12T16:15:54.611 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_standby_replay_damaged": "false", 2024-09-12T16:15:54.611 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_symlink_recovery": "true", 2024-09-12T16:15:54.612 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-12T16:15:54.612 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_thrash_exports": "0", 2024-09-12T16:15:54.612 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_thrash_fragments": "0", 2024-09-12T16:15:54.612 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_tick_interval": "5.000000", 2024-09-12T16:15:54.612 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_valgrind_exit": "false", 2024-09-12T16:15:54.612 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_verify_backtrace": "1", 2024-09-12T16:15:54.612 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_verify_scatter": "false", 2024-09-12T16:15:54.612 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-12T16:15:54.612 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_wipe_sessions": "false", 2024-09-12T16:15:54.612 INFO:teuthology.orchestra.run.smithi017.stdout: "mempool_debug": "false", 2024-09-12T16:15:54.612 INFO:teuthology.orchestra.run.smithi017.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-12T16:15:54.613 INFO:teuthology.orchestra.run.smithi017.stdout: "memstore_device_bytes": "1073741824", 2024-09-12T16:15:54.613 INFO:teuthology.orchestra.run.smithi017.stdout: "memstore_page_set": "false", 2024-09-12T16:15:54.613 INFO:teuthology.orchestra.run.smithi017.stdout: "memstore_page_size": "65536", 2024-09-12T16:15:54.613 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_client_bytes": "134217728", 2024-09-12T16:15:54.613 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_client_messages": "512", 2024-09-12T16:15:54.613 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-12T16:15:54.613 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-12T16:15:54.613 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-12T16:15:54.613 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-12T16:15:54.613 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_disabled_modules": "", 2024-09-12T16:15:54.613 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_enable_op_tracker": "true", 2024-09-12T16:15:54.613 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-12T16:15:54.613 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_max_pg_creating": "1024", 2024-09-12T16:15:54.613 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_max_pg_num_change": "128", 2024-09-12T16:15:54.614 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_mds_bytes": "134217728", 2024-09-12T16:15:54.614 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_mds_messages": "128", 2024-09-12T16:15:54.614 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-12T16:15:54.614 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_mon_bytes": "134217728", 2024-09-12T16:15:54.614 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_mon_messages": "128", 2024-09-12T16:15:54.614 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-12T16:15:54.614 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-12T16:15:54.614 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_op_history_duration": "600", 2024-09-12T16:15:54.614 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_op_history_size": "20", 2024-09-12T16:15:54.614 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-12T16:15:54.614 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-12T16:15:54.614 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_op_log_threshold": "5", 2024-09-12T16:15:54.614 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_osd_bytes": "536870912", 2024-09-12T16:15:54.614 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_osd_messages": "8192", 2024-09-12T16:15:54.615 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_pool": "true", 2024-09-12T16:15:54.615 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-12T16:15:54.615 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_standby_modules": "true", 2024-09-12T16:15:54.615 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_stats_period": "5", 2024-09-12T16:15:54.615 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_stats_threshold": "5", 2024-09-12T16:15:54.615 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_tick_period": "2", 2024-09-12T16:15:54.615 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-12T16:15:54.615 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-12T16:15:54.615 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_allow_pool_delete": "true", 2024-09-12T16:15:54.615 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_allow_pool_size_one": "true", 2024-09-12T16:15:54.615 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_auth_validate_all_caps": "true", 2024-09-12T16:15:54.615 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-12T16:15:54.615 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-12T16:15:54.616 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_bytes": "104857600", 2024-09-12T16:15:54.616 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_directed_command_retry": "5", 2024-09-12T16:15:54.616 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-12T16:15:54.616 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-12T16:15:54.616 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-12T16:15:54.616 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-12T16:15:54.616 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_hunt_parallel": "3", 2024-09-12T16:15:54.616 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_log_interval": "1.000000", 2024-09-12T16:15:54.616 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-12T16:15:54.616 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_ping_interval": "10.000000", 2024-09-12T16:15:54.616 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-12T16:15:54.616 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_target_rank": "-1", 2024-09-12T16:15:54.616 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-12T16:15:54.616 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-12T16:15:54.617 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-12T16:15:54.617 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_level": "debug", 2024-09-12T16:15:54.617 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_to_file": "true", 2024-09-12T16:15:54.617 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-12T16:15:54.617 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-12T16:15:54.617 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-12T16:15:54.617 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_to_journald": "false", 2024-09-12T16:15:54.617 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-12T16:15:54.617 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-12T16:15:54.617 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-12T16:15:54.617 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_compact_on_bootstrap": "false", 2024-09-12T16:15:54.617 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_compact_on_start": "false", 2024-09-12T16:15:54.617 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_compact_on_trim": "true", 2024-09-12T16:15:54.618 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-12T16:15:54.618 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-12T16:15:54.618 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-12T16:15:54.618 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cpu_threads": "4", 2024-09-12T16:15:54.618 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_crush_min_required_version": "hammer", 2024-09-12T16:15:54.618 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_daemon_bytes": "419430400", 2024-09-12T16:15:54.618 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-12T16:15:54.618 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_data_avail_crit": "5", 2024-09-12T16:15:54.618 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_data_avail_warn": "5", 2024-09-12T16:15:54.618 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_data_size_warn": "16106127360", 2024-09-12T16:15:54.618 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-12T16:15:54.618 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-12T16:15:54.618 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_dump_json": "false", 2024-09-12T16:15:54.618 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-12T16:15:54.619 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_dump_transactions": "false", 2024-09-12T16:15:54.619 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_extra_checks": "false", 2024-09-12T16:15:54.619 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-12T16:15:54.619 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-12T16:15:54.619 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_no_require_reef": "false", 2024-09-12T16:15:54.619 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_no_require_squid": "false", 2024-09-12T16:15:54.619 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-12T16:15:54.619 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-12T16:15:54.619 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-12T16:15:54.619 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_down_mkfs_grace": "120", 2024-09-12T16:15:54.619 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_down_uptime_grace": "60", 2024-09-12T16:15:54.619 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_election_default_strategy": "1", 2024-09-12T16:15:54.619 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_election_timeout": "5.000000", 2024-09-12T16:15:54.619 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-12T16:15:54.620 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_elector_ping_divisor": "2", 2024-09-12T16:15:54.620 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-12T16:15:54.620 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_enable_op_tracker": "true", 2024-09-12T16:15:54.620 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_fake_pool_delete": "false", 2024-09-12T16:15:54.620 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_force_quorum_join": "false", 2024-09-12T16:15:54.620 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-12T16:15:54.620 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_globalid_prealloc": "10000", 2024-09-12T16:15:54.620 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_health_detail_to_clog": "false", 2024-09-12T16:15:54.620 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_health_log_update_period": "5", 2024-09-12T16:15:54.620 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_health_max_detail": "50", 2024-09-12T16:15:54.620 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_health_to_clog": "true", 2024-09-12T16:15:54.620 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_health_to_clog_interval": "600", 2024-09-12T16:15:54.620 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-12T16:15:54.621 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_host": "172.21.15.17,[v2:172.21.15.17:3301,v1:172.21.15.17:6790],172.21.15.47", 2024-09-12T16:15:54.621 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_host_override": "", 2024-09-12T16:15:54.621 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_initial_members": "", 2024-09-12T16:15:54.621 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-12T16:15:54.621 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-12T16:15:54.621 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-12T16:15:54.621 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-12T16:15:54.621 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-12T16:15:54.621 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_lease": "5.000000", 2024-09-12T16:15:54.621 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-12T16:15:54.621 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-12T16:15:54.621 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_log_full_interval": "50", 2024-09-12T16:15:54.621 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_log_max": "10000", 2024-09-12T16:15:54.621 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_log_max_summary": "50", 2024-09-12T16:15:54.622 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-12T16:15:54.622 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_max_log_epochs": "500", 2024-09-12T16:15:54.622 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-12T16:15:54.622 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-12T16:15:54.622 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_max_nvmeof_epochs": "500", 2024-09-12T16:15:54.622 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_max_osd": "10000", 2024-09-12T16:15:54.622 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_max_pg_per_osd": "10000", 2024-09-12T16:15:54.622 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_max_pool_pg_num": "65536", 2024-09-12T16:15:54.622 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-12T16:15:54.622 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-12T16:15:54.622 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_mds_force_trim_to": "0", 2024-09-12T16:15:54.622 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_mds_skip_sanity": "false", 2024-09-12T16:15:54.623 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_memory_autotune": "true", 2024-09-12T16:15:54.623 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_memory_target": "2147483648", 2024-09-12T16:15:54.623 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_mgr_beacon_grace": "30", 2024-09-12T16:15:54.623 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-12T16:15:54.623 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_mgr_digest_period": "5", 2024-09-12T16:15:54.623 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_mgr_inactive_grace": "60", 2024-09-12T16:15:54.623 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-12T16:15:54.623 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-12T16:15:54.623 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_min_osdmap_epochs": "500", 2024-09-12T16:15:54.624 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_nvmeofgw_beacon_grace": "10", 2024-09-12T16:15:54.624 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_nvmeofgw_set_group_id_retry": "1000", 2024-09-12T16:15:54.624 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_op_complaint_time": "30", 2024-09-12T16:15:54.624 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_op_history_duration": "600", 2024-09-12T16:15:54.624 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_op_history_size": "20", 2024-09-12T16:15:54.624 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_op_history_slow_op_size": "20", 2024-09-12T16:15:54.624 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-12T16:15:54.624 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_op_log_threshold": "5", 2024-09-12T16:15:54.624 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-12T16:15:54.624 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-12T16:15:54.625 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-12T16:15:54.625 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_auto_mark_in": "false", 2024-09-12T16:15:54.625 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-12T16:15:54.625 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-12T16:15:54.625 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-12T16:15:54.625 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_cache_size": "500", 2024-09-12T16:15:54.625 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-12T16:15:54.625 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-12T16:15:54.625 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-12T16:15:54.625 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_down_out_interval": "600", 2024-09-12T16:15:54.625 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-12T16:15:54.625 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-12T16:15:54.626 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_force_trim_to": "0", 2024-09-12T16:15:54.626 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-12T16:15:54.626 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-12T16:15:54.626 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-12T16:15:54.626 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-12T16:15:54.626 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-12T16:15:54.626 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-12T16:15:54.626 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-12T16:15:54.626 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_min_down_reporters": "2", 2024-09-12T16:15:54.626 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-12T16:15:54.626 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-12T16:15:54.626 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-12T16:15:54.626 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-12T16:15:54.627 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-12T16:15:54.627 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-12T16:15:54.627 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_report_timeout": "900", 2024-09-12T16:15:54.627 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-12T16:15:54.627 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-12T16:15:54.627 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-12T16:15:54.627 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-12T16:15:54.627 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-12T16:15:54.627 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-12T16:15:54.627 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-12T16:15:54.627 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-12T16:15:54.627 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-12T16:15:54.628 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_pg_stuck_threshold": "60", 2024-09-12T16:15:54.628 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-12T16:15:54.628 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-12T16:15:54.628 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-12T16:15:54.628 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-12T16:15:54.628 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-12T16:15:54.628 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-12T16:15:54.628 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_probe_timeout": "2.000000", 2024-09-12T16:15:54.628 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_reweight_max_change": "0.050000", 2024-09-12T16:15:54.628 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_reweight_max_osds": "4", 2024-09-12T16:15:54.628 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-12T16:15:54.628 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-12T16:15:54.629 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-12T16:15:54.629 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-12T16:15:54.629 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-12T16:15:54.629 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_scrub_interval": "86400", 2024-09-12T16:15:54.629 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_scrub_max_keys": "100", 2024-09-12T16:15:54.629 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_scrub_timeout": "300", 2024-09-12T16:15:54.629 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_session_timeout": "300", 2024-09-12T16:15:54.629 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_smart_report_timeout": "5", 2024-09-12T16:15:54.629 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_stat_smooth_intervals": "6", 2024-09-12T16:15:54.629 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-12T16:15:54.629 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_stretch_pool_min_size": "2", 2024-09-12T16:15:54.629 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_stretch_pool_size": "4", 2024-09-12T16:15:54.630 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-12T16:15:54.630 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-12T16:15:54.630 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_sync_debug": "false", 2024-09-12T16:15:54.630 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-12T16:15:54.630 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-12T16:15:54.630 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_sync_provider_kill_at": "0", 2024-09-12T16:15:54.630 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_sync_requester_kill_at": "0", 2024-09-12T16:15:54.630 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_sync_timeout": "60.000000", 2024-09-12T16:15:54.630 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_target_pg_per_osd": "100", 2024-09-12T16:15:54.630 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_tick_interval": "5", 2024-09-12T16:15:54.630 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_timecheck_interval": "300.000000", 2024-09-12T16:15:54.630 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-12T16:15:54.630 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_use_min_delay_socket": "false", 2024-09-12T16:15:54.631 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_older_version_delay": "604800", 2024-09-12T16:15:54.631 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-12T16:15:54.631 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-12T16:15:54.631 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-12T16:15:54.631 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-12T16:15:54.631 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-12T16:15:54.631 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-12T16:15:54.631 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-12T16:15:54.631 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_misplaced": "false", 2024-09-12T16:15:54.631 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-12T16:15:54.631 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_older_version": "true", 2024-09-12T16:15:54.631 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-12T16:15:54.631 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_pool_no_app": "false", 2024-09-12T16:15:54.632 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-12T16:15:54.632 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-12T16:15:54.632 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-12T16:15:54.632 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-12T16:15:54.632 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-12T16:15:54.632 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-12T16:15:54.632 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-12T16:15:54.632 INFO:teuthology.orchestra.run.smithi017.stdout: "monmap": "", 2024-09-12T16:15:54.632 INFO:teuthology.orchestra.run.smithi017.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-12T16:15:54.632 INFO:teuthology.orchestra.run.smithi017.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-12T16:15:54.632 INFO:teuthology.orchestra.run.smithi017.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-12T16:15:54.633 INFO:teuthology.orchestra.run.smithi017.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-12T16:15:54.633 INFO:teuthology.orchestra.run.smithi017.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-12T16:15:54.633 INFO:teuthology.orchestra.run.smithi017.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-12T16:15:54.633 INFO:teuthology.orchestra.run.smithi017.stdout: "motr_tracing_enabled": "false", 2024-09-12T16:15:54.633 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_op_threads": "3", 2024-09-12T16:15:54.633 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-12T16:15:54.633 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_cm": "false", 2024-09-12T16:15:54.633 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_device_name": "", 2024-09-12T16:15:54.633 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_dscp": "96", 2024-09-12T16:15:54.633 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-12T16:15:54.633 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-12T16:15:54.634 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_local_gid": "", 2024-09-12T16:15:54.634 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-12T16:15:54.634 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_port_num": "1", 2024-09-12T16:15:54.634 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-12T16:15:54.634 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-12T16:15:54.634 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-12T16:15:54.634 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-12T16:15:54.634 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_sl": "3", 2024-09-12T16:15:54.634 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_support_srq": "true", 2024-09-12T16:15:54.634 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_type": "ib", 2024-09-12T16:15:54.634 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_reap_threshold": "5", 2024-09-12T16:15:54.635 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_before_connect": "false", 2024-09-12T16:15:54.635 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_ipv4": "true", 2024-09-12T16:15:54.635 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_ipv6": "false", 2024-09-12T16:15:54.635 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_msgr1": "true", 2024-09-12T16:15:54.635 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_msgr2": "true", 2024-09-12T16:15:54.635 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_port_max": "7568", 2024-09-12T16:15:54.635 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_port_min": "6800", 2024-09-12T16:15:54.635 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-12T16:15:54.635 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_retry_count": "3", 2024-09-12T16:15:54.635 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_retry_delay": "5", 2024-09-12T16:15:54.635 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_blackhole_client": "false", 2024-09-12T16:15:54.635 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_blackhole_mds": "false", 2024-09-12T16:15:54.636 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_blackhole_mgr": "false", 2024-09-12T16:15:54.636 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_blackhole_mon": "false", 2024-09-12T16:15:54.636 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_blackhole_osd": "false", 2024-09-12T16:15:54.636 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_client_mode": "crc secure", 2024-09-12T16:15:54.636 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_client_throttle_retry_time_interval": "5000", 2024-09-12T16:15:54.636 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_cluster_mode": "crc secure", 2024-09-12T16:15:54.637 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_cluster_type": "", 2024-09-12T16:15:54.637 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_compress_secure": "false", 2024-09-12T16:15:54.637 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_connection_idle_timeout": "900", 2024-09-12T16:15:54.637 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_connection_ready_timeout": "10", 2024-09-12T16:15:54.637 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_crc_data": "true", 2024-09-12T16:15:54.637 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_crc_header": "true", 2024-09-12T16:15:54.637 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_die_on_bad_msg": "false", 2024-09-12T16:15:54.637 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_die_on_bug": "true", 2024-09-12T16:15:54.637 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_die_on_old_message": "true", 2024-09-12T16:15:54.637 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_die_on_skipped_message": "false", 2024-09-12T16:15:54.637 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-12T16:15:54.638 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-12T16:15:54.638 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_coremask": "0xF", 2024-09-12T16:15:54.638 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-12T16:15:54.638 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-12T16:15:54.638 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_enable_tso": "true", 2024-09-12T16:15:54.638 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-12T16:15:54.638 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-12T16:15:54.638 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_hugepages": "", 2024-09-12T16:15:54.638 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-12T16:15:54.638 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-12T16:15:54.638 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_lro": "true", 2024-09-12T16:15:54.639 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_memory_channel": "4", 2024-09-12T16:15:54.639 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-12T16:15:54.639 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_pmd": "", 2024-09-12T16:15:54.639 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_port_id": "0", 2024-09-12T16:15:54.639 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-12T16:15:54.639 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-12T16:15:54.639 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dump_on_send": "false", 2024-09-12T16:15:54.639 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_initial_backoff": "0.200000", 2024-09-12T16:15:54.639 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_inject_delay_max": "1.000000", 2024-09-12T16:15:54.639 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-12T16:15:54.639 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_inject_delay_type": "", 2024-09-12T16:15:54.640 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-12T16:15:54.640 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_inject_network_congestion": "0", 2024-09-12T16:15:54.640 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_inject_socket_failures": "5000", 2024-09-12T16:15:54.640 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_learn_addr_from_peer": "true", 2024-09-12T16:15:54.640 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_max_accept_failures": "4", 2024-09-12T16:15:54.640 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_max_backoff": "15.000000", 2024-09-12T16:15:54.640 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_mon_client_mode": "secure crc", 2024-09-12T16:15:54.640 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-12T16:15:54.640 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_mon_service_mode": "secure crc", 2024-09-12T16:15:54.640 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_osd_compress_min_size": "1024", 2024-09-12T16:15:54.640 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_osd_compress_mode": "none", 2024-09-12T16:15:54.641 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-12T16:15:54.641 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-12T16:15:54.641 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_pq_min_cost": "65536", 2024-09-12T16:15:54.641 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_public_type": "", 2024-09-12T16:15:54.641 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_service_mode": "crc secure", 2024-09-12T16:15:54.641 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_tcp_listen_backlog": "512", 2024-09-12T16:15:54.641 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_tcp_nodelay": "true", 2024-09-12T16:15:54.641 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-12T16:15:54.641 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_tcp_rcvbuf": "0", 2024-09-12T16:15:54.641 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_time_events_min_wait_interval": "1000", 2024-09-12T16:15:54.641 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_type": "async+posix", 2024-09-12T16:15:54.642 INFO:teuthology.orchestra.run.smithi017.stdout: "no_config_file": "false", 2024-09-12T16:15:54.642 INFO:teuthology.orchestra.run.smithi017.stdout: "nvmeof_mon_client_disconnect_panic": "100", 2024-09-12T16:15:54.642 INFO:teuthology.orchestra.run.smithi017.stdout: "nvmeof_mon_client_tick_period": "2", 2024-09-12T16:15:54.642 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter_completion_locks_per_session": "32", 2024-09-12T16:15:54.642 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-12T16:15:54.642 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-12T16:15:54.642 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter_inflight_ops": "1024", 2024-09-12T16:15:54.642 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-12T16:15:54.642 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-12T16:15:54.642 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter_tick_interval": "5.000000", 2024-09-12T16:15:54.642 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter_timeout": "10.000000", 2024-09-12T16:15:54.643 INFO:teuthology.orchestra.run.smithi017.stdout: "objectstore_blackhole": "false", 2024-09-12T16:15:54.643 INFO:teuthology.orchestra.run.smithi017.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-12T16:15:54.643 INFO:teuthology.orchestra.run.smithi017.stdout: "openssl_engine_opts": "", 2024-09-12T16:15:54.643 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_agent_delay_time": "5.000000", 2024-09-12T16:15:54.643 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_agent_hist_halflife": "1000", 2024-09-12T16:15:54.643 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_agent_max_low_ops": "2", 2024-09-12T16:15:54.643 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_agent_max_ops": "4", 2024-09-12T16:15:54.643 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-12T16:15:54.643 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-12T16:15:54.643 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_agent_slop": "0.020000", 2024-09-12T16:15:54.643 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-12T16:15:54.644 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-12T16:15:54.644 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_asio_thread_count": "2", 2024-09-12T16:15:54.644 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_async_recovery_min_cost": "100", 2024-09-12T16:15:54.644 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-12T16:15:54.644 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-12T16:15:54.644 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_backfill_scan_max": "512", 2024-09-12T16:15:54.644 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_backfill_scan_min": "64", 2024-09-12T16:15:54.644 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_backoff_on_degraded": "false", 2024-09-12T16:15:54.644 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_backoff_on_peering": "false", 2024-09-12T16:15:54.644 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_backoff_on_unfound": "true", 2024-09-12T16:15:54.644 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_beacon_report_interval": "300", 2024-09-12T16:15:54.645 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bench_duration": "30", 2024-09-12T16:15:54.645 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-12T16:15:54.645 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bench_max_block_size": "67108864", 2024-09-12T16:15:54.645 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-12T16:15:54.645 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_blkin_trace_all": "false", 2024-09-12T16:15:54.645 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-12T16:15:54.645 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-12T16:15:54.645 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-12T16:15:54.645 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-12T16:15:54.645 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_check_for_log_corruption": "false", 2024-09-12T16:15:54.645 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-12T16:15:54.645 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-12T16:15:54.646 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-09-12T16:15:54.646 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-12T16:15:54.646 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_class_update_on_start": "true", 2024-09-12T16:15:54.646 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_client_message_cap": "256", 2024-09-12T16:15:54.646 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_client_message_size_cap": "524288000", 2024-09-12T16:15:54.646 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_client_op_priority": "63", 2024-09-12T16:15:54.646 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_client_watch_timeout": "30", 2024-09-12T16:15:54.646 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_command_max_records": "256", 2024-09-12T16:15:54.646 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_compact_on_start": "false", 2024-09-12T16:15:54.646 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-12T16:15:54.646 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-12T16:15:54.647 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-12T16:15:54.647 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_crush_update_on_start": "true", 2024-09-12T16:15:54.647 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_crush_update_weight_set": "true", 2024-09-12T16:15:54.647 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-12T16:15:54.647 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-12T16:15:54.647 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-12T16:15:54.647 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-12T16:15:54.647 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-12T16:15:54.647 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_feed_pullee": "-1", 2024-09-12T16:15:54.647 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-12T16:15:54.647 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-12T16:15:54.647 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-12T16:15:54.648 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_misdirected_ops": "false", 2024-09-12T16:15:54.648 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_no_acting_change": "false", 2024-09-12T16:15:54.648 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_no_purge_strays": "false", 2024-09-12T16:15:54.648 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_op_order": "false", 2024-09-12T16:15:54.648 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-12T16:15:54.648 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-12T16:15:54.648 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-12T16:15:54.648 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-12T16:15:54.648 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_shutdown": "false", 2024-09-12T16:15:54.648 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-12T16:15:54.648 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-12T16:15:54.648 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_trim_objects": "false", 2024-09-12T16:15:54.649 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-12T16:15:54.649 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-12T16:15:54.649 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_verify_snaps": "false", 2024-09-12T16:15:54.649 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-12T16:15:54.649 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-12T16:15:54.649 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_deep_scrub_keys": "1024", 2024-09-12T16:15:54.649 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-12T16:15:54.649 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-12T16:15:54.649 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-12T16:15:54.649 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_deep_scrub_stride": "524288", 2024-09-12T16:15:54.649 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-12T16:15:54.650 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-12T16:15:54.650 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_default_notify_timeout": "30", 2024-09-12T16:15:54.650 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_delete_sleep": "0.000000", 2024-09-12T16:15:54.650 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-12T16:15:54.650 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-12T16:15:54.650 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-12T16:15:54.650 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_discard_disconnected_ops": "true", 2024-09-12T16:15:54.650 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_ec_partial_reads": "true", 2024-09-12T16:15:54.650 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_enable_op_tracker": "true", 2024-09-12T16:15:54.650 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-12T16:15:54.650 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-12T16:15:54.651 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-12T16:15:54.651 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-12T16:15:54.651 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_fast_info": "true", 2024-09-12T16:15:54.651 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_fast_shutdown": "true", 2024-09-12T16:15:54.651 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-12T16:15:54.651 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-12T16:15:54.651 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-12T16:15:54.651 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-12T16:15:54.651 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-12T16:15:54.651 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_function_tracing": "false", 2024-09-12T16:15:54.651 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_heartbeat_grace": "20", 2024-09-12T16:15:54.652 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_heartbeat_interval": "6", 2024-09-12T16:15:54.652 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-12T16:15:54.652 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_heartbeat_min_peers": "10", 2024-09-12T16:15:54.652 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_heartbeat_min_size": "2000", 2024-09-12T16:15:54.652 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_heartbeat_stale": "600", 2024-09-12T16:15:54.652 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-12T16:15:54.652 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_hit_set_max_size": "100000", 2024-09-12T16:15:54.652 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_hit_set_min_size": "1000", 2024-09-12T16:15:54.652 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-12T16:15:54.652 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-12T16:15:54.652 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-12T16:15:54.653 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-12T16:15:54.653 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-12T16:15:54.653 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-12T16:15:54.653 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_journal_size": "5120", 2024-09-12T16:15:54.653 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_kill_backfill_at": "0", 2024-09-12T16:15:54.653 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-12T16:15:54.653 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_map_cache_size": "50", 2024-09-12T16:15:54.653 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_map_dedup": "true", 2024-09-12T16:15:54.653 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_map_message_max": "40", 2024-09-12T16:15:54.653 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-12T16:15:54.653 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_map_share_max_epochs": "40", 2024-09-12T16:15:54.654 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_attr_name_len": "100", 2024-09-12T16:15:54.654 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_attr_size": "0", 2024-09-12T16:15:54.654 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_backfills": "1", 2024-09-12T16:15:54.654 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_markdown_count": "5", 2024-09-12T16:15:54.654 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_markdown_period": "600", 2024-09-12T16:15:54.654 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_object_name_len": "2048", 2024-09-12T16:15:54.654 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_object_namespace_len": "256", 2024-09-12T16:15:54.654 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_object_size": "134217728", 2024-09-12T16:15:54.654 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-12T16:15:54.654 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-12T16:15:54.654 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_pg_blocked_by": "16", 2024-09-12T16:15:54.655 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_pg_log_entries": "10000", 2024-09-12T16:15:54.655 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-12T16:15:54.655 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_pgls": "1024", 2024-09-12T16:15:54.655 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_push_cost": "8388608", 2024-09-12T16:15:54.655 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_push_objects": "10", 2024-09-12T16:15:54.655 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_scrubs": "3", 2024-09-12T16:15:54.655 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-12T16:15:54.655 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_trimming_pgs": "2", 2024-09-12T16:15:54.655 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_write_op_reply_len": "64", 2024-09-12T16:15:54.655 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_write_size": "90", 2024-09-12T16:15:54.655 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-12T16:15:54.655 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-12T16:15:54.656 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-12T16:15:54.656 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-12T16:15:54.656 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-12T16:15:54.656 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-12T16:15:54.656 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-12T16:15:54.656 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-12T16:15:54.656 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_profile": "balanced", 2024-09-12T16:15:54.656 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-12T16:15:54.656 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-12T16:15:54.656 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-12T16:15:54.656 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-12T16:15:54.657 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-12T16:15:54.657 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-12T16:15:54.657 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-12T16:15:54.657 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-12T16:15:54.657 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-12T16:15:54.657 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-12T16:15:54.657 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-12T16:15:54.657 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_memory_base": "805306368", 2024-09-12T16:15:54.657 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_memory_cache_min": "134217728", 2024-09-12T16:15:54.657 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-12T16:15:54.657 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-12T16:15:54.657 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_memory_target": "4294967296", 2024-09-12T16:15:54.658 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_memory_target_autotune": "false", 2024-09-12T16:15:54.658 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-12T16:15:54.658 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_min_pg_log_entries": "250", 2024-09-12T16:15:54.658 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_min_recovery_priority": "0", 2024-09-12T16:15:54.658 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-12T16:15:54.658 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-12T16:15:54.658 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mon_report_interval": "5", 2024-09-12T16:15:54.658 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-12T16:15:54.658 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-12T16:15:54.658 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_num_cache_shards": "32", 2024-09-12T16:15:54.658 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_num_op_tracker_shard": "32", 2024-09-12T16:15:54.658 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_numa_auto_affinity": "true", 2024-09-12T16:15:54.659 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_numa_node": "-1", 2024-09-12T16:15:54.659 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_numa_prefer_iface": "true", 2024-09-12T16:15:54.659 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-12T16:15:54.659 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_objecter_finishers": "1", 2024-09-12T16:15:54.659 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_objectstore": "bluestore", 2024-09-12T16:15:54.659 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_objectstore_fuse": "false", 2024-09-12T16:15:54.659 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_objectstore_ideal_list_max": "64", 2024-09-12T16:15:54.659 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_objectstore_tracing": "false", 2024-09-12T16:15:54.659 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_complaint_time": "30.000000", 2024-09-12T16:15:54.659 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_history_duration": "600", 2024-09-12T16:15:54.659 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_history_size": "20", 2024-09-12T16:15:54.659 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_history_slow_op_size": "20", 2024-09-12T16:15:54.660 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-12T16:15:54.660 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_log_threshold": "5", 2024-09-12T16:15:54.660 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_num_shards": "0", 2024-09-12T16:15:54.660 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_num_shards_hdd": "5", 2024-09-12T16:15:54.660 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_num_shards_ssd": "8", 2024-09-12T16:15:54.660 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-12T16:15:54.660 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-12T16:15:54.660 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-12T16:15:54.660 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-12T16:15:54.660 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_pq_min_cost": "65536", 2024-09-12T16:15:54.660 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-12T16:15:54.660 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_queue_cut_off": "high", 2024-09-12T16:15:54.661 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-12T16:15:54.661 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_thread_timeout": "15", 2024-09-12T16:15:54.661 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_open_classes_on_start": "true", 2024-09-12T16:15:54.661 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_os_flags": "0", 2024-09-12T16:15:54.661 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_peering_op_priority": "255", 2024-09-12T16:15:54.661 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_delete_cost": "1048576", 2024-09-12T16:15:54.661 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_delete_priority": "5", 2024-09-12T16:15:54.661 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-12T16:15:54.661 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-12T16:15:54.661 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-12T16:15:54.662 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_log_trim_max": "10000", 2024-09-12T16:15:54.662 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_log_trim_min": "100", 2024-09-12T16:15:54.662 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-12T16:15:54.662 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-12T16:15:54.662 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-12T16:15:54.662 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-12T16:15:54.662 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-12T16:15:54.662 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-12T16:15:54.662 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-12T16:15:54.662 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-12T16:15:54.662 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-12T16:15:54.662 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-12T16:15:54.663 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_crimson": "false", 2024-09-12T16:15:54.663 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-12T16:15:54.663 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-12T16:15:54.663 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-12T16:15:54.663 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-12T16:15:54.663 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-12T16:15:54.663 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-12T16:15:54.663 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-12T16:15:54.663 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-12T16:15:54.663 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_flags": "0", 2024-09-12T16:15:54.663 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-12T16:15:54.664 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_min_size": "0", 2024-09-12T16:15:54.664 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-12T16:15:54.664 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_pg_num": "32", 2024-09-12T16:15:54.664 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_pgp_num": "0", 2024-09-12T16:15:54.664 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-12T16:15:54.664 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_read_ratio": "70", 2024-09-12T16:15:54.664 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_size": "2", 2024-09-12T16:15:54.664 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_type": "replicated", 2024-09-12T16:15:54.664 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-12T16:15:54.664 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-12T16:15:54.664 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_push_per_object_cost": "1000", 2024-09-12T16:15:54.665 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-12T16:15:54.665 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recover_clone_overlap": "true", 2024-09-12T16:15:54.665 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-12T16:15:54.665 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_cost": "20971520", 2024-09-12T16:15:54.665 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-12T16:15:54.665 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_max_active": "0", 2024-09-12T16:15:54.665 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-12T16:15:54.665 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-12T16:15:54.665 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-12T16:15:54.665 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-12T16:15:54.665 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_max_single_start": "1", 2024-09-12T16:15:54.666 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_op_priority": "3", 2024-09-12T16:15:54.666 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-12T16:15:54.666 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_priority": "5", 2024-09-12T16:15:54.666 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-12T16:15:54.666 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_sleep": "0.000000", 2024-09-12T16:15:54.666 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-12T16:15:54.666 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-12T16:15:54.666 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-12T16:15:54.666 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_repair_during_recovery": "false", 2024-09-12T16:15:54.666 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_requested_scrub_priority": "120", 2024-09-12T16:15:54.666 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-12T16:15:54.666 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-12T16:15:54.667 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_auto_repair": "false", 2024-09-12T16:15:54.667 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-12T16:15:54.667 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-12T16:15:54.667 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_begin_hour": "0", 2024-09-12T16:15:54.667 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_begin_week_day": "0", 2024-09-12T16:15:54.667 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_chunk_max": "25", 2024-09-12T16:15:54.667 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_chunk_min": "5", 2024-09-12T16:15:54.667 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_cost": "52428800", 2024-09-12T16:15:54.667 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-12T16:15:54.667 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_during_recovery": "false", 2024-09-12T16:15:54.667 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_end_hour": "0", 2024-09-12T16:15:54.667 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_end_week_day": "0", 2024-09-12T16:15:54.668 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_event_cost": "4096", 2024-09-12T16:15:54.668 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-12T16:15:54.668 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-12T16:15:54.668 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_invalid_stats": "true", 2024-09-12T16:15:54.668 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-12T16:15:54.668 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-12T16:15:54.668 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_max_preemptions": "5", 2024-09-12T16:15:54.668 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-12T16:15:54.668 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_priority": "5", 2024-09-12T16:15:54.668 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_retry_after_noscrub": "60", 2024-09-12T16:15:54.668 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_retry_delay": "30", 2024-09-12T16:15:54.668 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_retry_new_interval": "10", 2024-09-12T16:15:54.669 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_retry_pg_state": "60", 2024-09-12T16:15:54.669 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_retry_trimming": "10", 2024-09-12T16:15:54.669 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_sleep": "0.000000", 2024-09-12T16:15:54.669 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-12T16:15:54.669 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-12T16:15:54.669 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-12T16:15:54.669 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-09-12T16:15:54.669 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_skip_data_digest": "false", 2024-09-12T16:15:54.669 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_smart_report_timeout": "5", 2024-09-12T16:15:54.669 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_snap_trim_cost": "1048576", 2024-09-12T16:15:54.670 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_snap_trim_priority": "5", 2024-09-12T16:15:54.670 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-12T16:15:54.670 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-12T16:15:54.670 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-12T16:15:54.670 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-12T16:15:54.670 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-12T16:15:54.670 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-12T16:15:54.670 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-12T16:15:54.670 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_target_transaction_size": "30", 2024-09-12T16:15:54.670 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-12T16:15:54.670 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-12T16:15:54.671 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-12T16:15:54.671 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-12T16:15:54.671 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-12T16:15:54.671 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-12T16:15:54.671 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-12T16:15:54.671 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-12T16:15:54.671 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-12T16:15:54.671 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-12T16:15:54.671 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tracing": "false", 2024-09-12T16:15:54.671 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_use_stale_snap": "false", 2024-09-12T16:15:54.671 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T16:15:54.672 INFO:teuthology.orchestra.run.smithi017.stdout: "osdc_blkin_trace_all": "false", 2024-09-12T16:15:54.672 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_kill_at": "0", 2024-09-12T16:15:54.672 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_max_join_drift": "10", 2024-09-12T16:15:54.672 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_min": "500", 2024-09-12T16:15:54.672 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_min_wait": "0.050000", 2024-09-12T16:15:54.672 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_propose_interval": "1.000000", 2024-09-12T16:15:54.672 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_service_trim_max": "500", 2024-09-12T16:15:54.672 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-12T16:15:54.672 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_service_trim_min": "250", 2024-09-12T16:15:54.673 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_stash_full_interval": "25", 2024-09-12T16:15:54.673 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_trim_max": "500", 2024-09-12T16:15:54.673 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_trim_min": "250", 2024-09-12T16:15:54.673 INFO:teuthology.orchestra.run.smithi017.stdout: "perf": "true", 2024-09-12T16:15:54.673 INFO:teuthology.orchestra.run.smithi017.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-12T16:15:54.673 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-12T16:15:54.673 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-09-12T16:15:54.673 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "-", 2024-09-12T16:15:54.673 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrv": "", 2024-09-12T16:15:54.673 INFO:teuthology.orchestra.run.smithi017.stdout: "public_bind_addr": "-", 2024-09-12T16:15:54.673 INFO:teuthology.orchestra.run.smithi017.stdout: "public_network": "", 2024-09-12T16:15:54.673 INFO:teuthology.orchestra.run.smithi017.stdout: "public_network_interface": "", 2024-09-12T16:15:54.674 INFO:teuthology.orchestra.run.smithi017.stdout: "qat_compressor_busy_polling": "false", 2024-09-12T16:15:54.674 INFO:teuthology.orchestra.run.smithi017.stdout: "qat_compressor_enabled": "false", 2024-09-12T16:15:54.674 INFO:teuthology.orchestra.run.smithi017.stdout: "qat_compressor_session_max_number": "256", 2024-09-12T16:15:54.674 INFO:teuthology.orchestra.run.smithi017.stdout: "rados_mon_op_timeout": "0", 2024-09-12T16:15:54.674 INFO:teuthology.orchestra.run.smithi017.stdout: "rados_osd_op_timeout": "0", 2024-09-12T16:15:54.674 INFO:teuthology.orchestra.run.smithi017.stdout: "rados_tracing": "false", 2024-09-12T16:15:54.674 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_atime_update_interval": "60", 2024-09-12T16:15:54.674 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-12T16:15:54.674 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_balance_parent_reads": "false", 2024-09-12T16:15:54.674 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_balance_snap_reads": "false", 2024-09-12T16:15:54.674 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_blkin_trace_all": "false", 2024-09-12T16:15:54.675 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-12T16:15:54.675 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-12T16:15:54.675 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_cache": "true", 2024-09-12T16:15:54.675 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-12T16:15:54.675 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-12T16:15:54.675 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-12T16:15:54.675 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-12T16:15:54.675 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_cache_policy": "writearound", 2024-09-12T16:15:54.675 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_cache_size": "33554432", 2024-09-12T16:15:54.675 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-12T16:15:54.675 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-12T16:15:54.676 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_clone_copy_on_read": "false", 2024-09-12T16:15:54.676 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_compression_hint": "none", 2024-09-12T16:15:54.676 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_concurrent_management_ops": "10", 2024-09-12T16:15:54.676 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-12T16:15:54.676 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_clone_format": "auto", 2024-09-12T16:15:54.676 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_data_pool": "", 2024-09-12T16:15:54.676 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_features": "61", 2024-09-12T16:15:54.676 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_format": "2", 2024-09-12T16:15:54.676 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_map_options": "", 2024-09-12T16:15:54.676 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_order": "22", 2024-09-12T16:15:54.676 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_pool": "rbd", 2024-09-12T16:15:54.676 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-12T16:15:54.677 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_stripe_count": "0", 2024-09-12T16:15:54.677 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_stripe_unit": "0", 2024-09-12T16:15:54.677 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-12T16:15:54.677 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-12T16:15:54.677 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-12T16:15:54.677 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_enable_alloc_hint": "true", 2024-09-12T16:15:54.677 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-12T16:15:54.677 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_io_scheduler": "simple", 2024-09-12T16:15:54.677 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-12T16:15:54.677 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-12T16:15:54.678 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-12T16:15:54.678 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-12T16:15:54.678 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-12T16:15:54.678 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-12T16:15:54.678 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-12T16:15:54.678 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-12T16:15:54.678 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-12T16:15:54.678 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_order": "24", 2024-09-12T16:15:54.678 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_pool": "", 2024-09-12T16:15:54.679 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_splay_width": "4", 2024-09-12T16:15:54.679 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_localize_parent_reads": "false", 2024-09-12T16:15:54.679 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_localize_snap_reads": "false", 2024-09-12T16:15:54.679 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-12T16:15:54.679 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-12T16:15:54.679 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-12T16:15:54.679 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-12T16:15:54.679 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-12T16:15:54.679 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-12T16:15:54.679 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-12T16:15:54.679 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-12T16:15:54.679 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-12T16:15:54.680 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-12T16:15:54.680 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-12T16:15:54.680 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-12T16:15:54.680 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-12T16:15:54.680 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-12T16:15:54.680 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-12T16:15:54.680 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-12T16:15:54.680 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-12T16:15:54.680 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-12T16:15:54.680 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-12T16:15:54.680 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-12T16:15:54.681 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-12T16:15:54.681 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-12T16:15:54.681 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-12T16:15:54.681 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-12T16:15:54.681 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-12T16:15:54.681 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-12T16:15:54.681 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-12T16:15:54.681 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-12T16:15:54.681 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-12T16:15:54.681 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-12T16:15:54.681 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-12T16:15:54.682 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mtime_update_interval": "60", 2024-09-12T16:15:54.682 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_non_blocking_aio": "true", 2024-09-12T16:15:54.682 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_op_thread_timeout": "60", 2024-09-12T16:15:54.682 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_op_threads": "1", 2024-09-12T16:15:54.682 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_parent_cache_enabled": "false", 2024-09-12T16:15:54.682 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-12T16:15:54.682 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-12T16:15:54.682 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-12T16:15:54.682 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_plugins": "", 2024-09-12T16:15:54.682 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_bps_burst": "0", 2024-09-12T16:15:54.682 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-12T16:15:54.683 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_bps_limit": "0", 2024-09-12T16:15:54.683 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_exclude_ops": "0", 2024-09-12T16:15:54.683 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_iops_burst": "0", 2024-09-12T16:15:54.683 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-12T16:15:54.683 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_iops_limit": "0", 2024-09-12T16:15:54.683 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-12T16:15:54.683 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-12T16:15:54.683 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-12T16:15:54.683 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-12T16:15:54.683 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-12T16:15:54.683 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-12T16:15:54.683 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-12T16:15:54.683 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-12T16:15:54.684 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-12T16:15:54.684 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-12T16:15:54.684 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-12T16:15:54.684 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-12T16:15:54.684 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-12T16:15:54.684 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-12T16:15:54.684 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_read_from_replica_policy": "default", 2024-09-12T16:15:54.684 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-12T16:15:54.684 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-12T16:15:54.684 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-12T16:15:54.684 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-12T16:15:54.685 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_skip_partial_discard": "true", 2024-09-12T16:15:54.685 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-12T16:15:54.685 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_tracing": "false", 2024-09-12T16:15:54.685 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_validate_names": "true", 2024-09-12T16:15:54.685 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_validate_pool": "true", 2024-09-12T16:15:54.685 INFO:teuthology.orchestra.run.smithi017.stdout: "restapi_base_url": "", 2024-09-12T16:15:54.685 INFO:teuthology.orchestra.run.smithi017.stdout: "restapi_log_level": "", 2024-09-12T16:15:54.685 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-12T16:15:54.685 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-12T16:15:54.685 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_acl_grants_max_num": "100", 2024-09-12T16:15:54.685 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_admin_entry": "admin", 2024-09-12T16:15:54.685 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-12T16:15:54.686 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_asio_assert_yielding": "false", 2024-09-12T16:15:54.686 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_backend_store": "rados", 2024-09-12T16:15:54.686 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_barbican_url": "", 2024-09-12T16:15:54.686 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_beast_enable_async": "true", 2024-09-12T16:15:54.686 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_bucket_counters_cache": "false", 2024-09-12T16:15:54.686 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-12T16:15:54.686 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-12T16:15:54.686 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-12T16:15:54.686 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-12T16:15:54.686 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-12T16:15:54.686 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-12T16:15:54.687 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-12T16:15:54.687 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-12T16:15:54.687 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_cache_enabled": "true", 2024-09-12T16:15:54.687 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_cache_expiry_interval": "900", 2024-09-12T16:15:54.687 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_cache_lru_size": "25000", 2024-09-12T16:15:54.687 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_config_store": "rados", 2024-09-12T16:15:54.687 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_content_length_compat": "false", 2024-09-12T16:15:54.687 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_copy_obj_progress": "true", 2024-09-12T16:15:54.687 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-12T16:15:54.687 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_cors_rules_max_num": "100", 2024-09-12T16:15:54.687 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_cross_domain_policy": "", 2024-09-12T16:15:54.688 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-12T16:15:54.688 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_kmip_addr": "", 2024-09-12T16:15:54.688 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-12T16:15:54.688 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-12T16:15:54.688 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-12T16:15:54.688 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-12T16:15:54.688 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_kmip_password": "", 2024-09-12T16:15:54.688 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-12T16:15:54.688 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_kmip_username": "", 2024-09-12T16:15:54.688 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_require_ssl": "true", 2024-09-12T16:15:54.688 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-12T16:15:54.689 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-12T16:15:54.689 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-12T16:15:54.689 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-12T16:15:54.689 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-12T16:15:54.689 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-12T16:15:54.689 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-12T16:15:54.689 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-12T16:15:54.689 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-12T16:15:54.689 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-12T16:15:54.689 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-12T16:15:54.690 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-12T16:15:54.690 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-12T16:15:54.690 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-12T16:15:54.690 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-12T16:15:54.690 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_addr": "", 2024-09-12T16:15:54.690 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_auth": "token", 2024-09-12T16:15:54.690 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_namespace": "", 2024-09-12T16:15:54.690 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_prefix": "", 2024-09-12T16:15:54.690 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-12T16:15:54.690 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-12T16:15:54.690 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-12T16:15:54.690 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-12T16:15:54.691 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_token_file": "", 2024-09-12T16:15:54.691 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-12T16:15:54.691 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_curl_buffersize": "524288", 2024-09-12T16:15:54.691 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-12T16:15:54.691 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_curl_low_speed_time": "300", 2024-09-12T16:15:54.691 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-12T16:15:54.691 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-12T16:15:54.691 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-12T16:15:54.691 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-12T16:15:54.691 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-12T16:15:54.691 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-12T16:15:54.692 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-12T16:15:54.692 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-12T16:15:54.692 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-12T16:15:54.692 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-12T16:15:54.692 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d4n_address": "127.0.0.1:6379", 2024-09-12T16:15:54.692 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d4n_l1_datacache_address": "127.0.0.1:6379", 2024-09-12T16:15:54.692 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2024-09-12T16:15:54.692 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d4n_l1_datacache_size": "1073741824", 2024-09-12T16:15:54.692 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2024-09-12T16:15:54.692 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d4n_l1_fadvise": "4", 2024-09-12T16:15:54.693 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d4n_libaio_aio_num": "64", 2024-09-12T16:15:54.693 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d4n_libaio_aio_threads": "20", 2024-09-12T16:15:54.693 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-12T16:15:54.693 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_data_log_changes_size": "1000", 2024-09-12T16:15:54.693 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_data_log_num_shards": "128", 2024-09-12T16:15:54.693 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-12T16:15:54.693 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_data_log_window": "30", 2024-09-12T16:15:54.693 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-12T16:15:54.693 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-12T16:15:54.693 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-12T16:15:54.693 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-12T16:15:54.694 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-12T16:15:54.694 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-12T16:15:54.694 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-12T16:15:54.694 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-12T16:15:54.694 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-12T16:15:54.694 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-12T16:15:54.694 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-12T16:15:54.694 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-12T16:15:54.694 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-12T16:15:54.694 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_disable_s3select": "false", 2024-09-12T16:15:54.694 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-12T16:15:54.695 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-12T16:15:54.695 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-12T16:15:54.695 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-12T16:15:54.695 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-12T16:15:54.695 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-12T16:15:54.695 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-12T16:15:54.695 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-12T16:15:54.695 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-12T16:15:54.695 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-12T16:15:54.695 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-12T16:15:54.695 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-12T16:15:54.695 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dns_name": "", 2024-09-12T16:15:54.695 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dns_s3website_name": "", 2024-09-12T16:15:54.695 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dynamic_resharding": "true", 2024-09-12T16:15:54.696 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dynamic_resharding_may_reduce": "true", 2024-09-12T16:15:54.696 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dynamic_resharding_reduction_wait": "120", 2024-09-12T16:15:54.696 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-12T16:15:54.696 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_enable_gc_threads": "true", 2024-09-12T16:15:54.696 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_enable_lc_threads": "true", 2024-09-12T16:15:54.696 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_enable_mdsearch": "true", 2024-09-12T16:15:54.696 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_enable_ops_log": "false", 2024-09-12T16:15:54.696 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_enable_quota_threads": "true", 2024-09-12T16:15:54.696 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_enable_static_website": "false", 2024-09-12T16:15:54.696 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_enable_usage_log": "false", 2024-09-12T16:15:54.696 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_enforce_swift_acls": "true", 2024-09-12T16:15:54.696 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_exit_timeout_secs": "120", 2024-09-12T16:15:54.697 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_expose_bucket": "false", 2024-09-12T16:15:54.697 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_extended_http_attrs": "", 2024-09-12T16:15:54.697 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_filter": "none", 2024-09-12T16:15:54.697 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-12T16:15:54.697 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_frontends": "beast port=7480", 2024-09-12T16:15:54.697 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-12T16:15:54.697 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_gc_max_deferred": "50", 2024-09-12T16:15:54.697 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-12T16:15:54.697 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_gc_max_objs": "32", 2024-09-12T16:15:54.697 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-12T16:15:54.697 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-12T16:15:54.697 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-12T16:15:54.698 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-12T16:15:54.698 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_gc_processor_period": "3600", 2024-09-12T16:15:54.698 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-12T16:15:54.698 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-12T16:15:54.698 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-12T16:15:54.698 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-12T16:15:54.698 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_init_timeout": "300", 2024-09-12T16:15:54.698 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-12T16:15:54.698 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-12T16:15:54.698 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_kafka_connection_idle": "300", 2024-09-12T16:15:54.698 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-12T16:15:54.698 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-12T16:15:54.698 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-12T16:15:54.699 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-12T16:15:54.699 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-12T16:15:54.699 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_admin_domain": "", 2024-09-12T16:15:54.699 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_admin_password": "", 2024-09-12T16:15:54.699 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_admin_password_path": "", 2024-09-12T16:15:54.699 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_admin_project": "", 2024-09-12T16:15:54.699 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_admin_tenant": "", 2024-09-12T16:15:54.699 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_admin_token": "", 2024-09-12T16:15:54.699 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_admin_token_path": "", 2024-09-12T16:15:54.699 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_admin_user": "", 2024-09-12T16:15:54.699 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_barbican_domain": "", 2024-09-12T16:15:54.700 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_barbican_password": "", 2024-09-12T16:15:54.700 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_barbican_project": "", 2024-09-12T16:15:54.700 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-12T16:15:54.700 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_barbican_user": "", 2024-09-12T16:15:54.700 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-12T16:15:54.700 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-12T16:15:54.700 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-12T16:15:54.700 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-12T16:15:54.700 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-12T16:15:54.700 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_url": "", 2024-09-12T16:15:54.700 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-12T16:15:54.701 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_lc_debug_interval": "-1", 2024-09-12T16:15:54.701 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_lc_lock_max_time": "90", 2024-09-12T16:15:54.701 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_lc_max_objs": "32", 2024-09-12T16:15:54.701 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_lc_max_rules": "1000", 2024-09-12T16:15:54.701 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_lc_max_worker": "3", 2024-09-12T16:15:54.701 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-12T16:15:54.701 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_lc_thread_delay": "0", 2024-09-12T16:15:54.701 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-12T16:15:54.701 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ldap_dnattr": "uid", 2024-09-12T16:15:54.701 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-12T16:15:54.701 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ldap_searchfilter": "", 2024-09-12T16:15:54.701 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-12T16:15:54.702 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ldap_uri": "", 2024-09-12T16:15:54.702 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_lfuda_sync_frequency": "60", 2024-09-12T16:15:54.702 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-12T16:15:54.702 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-12T16:15:54.702 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-12T16:15:54.702 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_log_http_headers": "", 2024-09-12T16:15:54.702 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-12T16:15:54.702 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-12T16:15:54.702 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_log_object_name_utc": "false", 2024-09-12T16:15:54.702 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-12T16:15:54.702 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-12T16:15:54.703 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_attr_name_len": "0", 2024-09-12T16:15:54.703 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_attr_size": "0", 2024-09-12T16:15:54.703 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-12T16:15:54.703 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_chunk_size": "4194304", 2024-09-12T16:15:54.703 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-12T16:15:54.703 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-12T16:15:54.703 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-12T16:15:54.703 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_listing_results": "5000", 2024-09-12T16:15:54.703 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_notify_retries": "10", 2024-09-12T16:15:54.703 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-12T16:15:54.703 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_put_param_size": "1048576", 2024-09-12T16:15:54.704 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_put_size": "5368709120", 2024-09-12T16:15:54.704 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_slo_entries": "1000", 2024-09-12T16:15:54.704 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_md_log_max_shards": "64", 2024-09-12T16:15:54.704 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-12T16:15:54.704 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-12T16:15:54.704 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-12T16:15:54.704 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-12T16:15:54.704 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_mp_lock_max_time": "600", 2024-09-12T16:15:54.704 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-12T16:15:54.704 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-12T16:15:54.704 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-12T16:15:54.705 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-12T16:15:54.705 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-12T16:15:54.705 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-12T16:15:54.705 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-12T16:15:54.705 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-12T16:15:54.705 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_max_gc": "300", 2024-09-12T16:15:54.705 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-12T16:15:54.705 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-12T16:15:54.705 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-12T16:15:54.705 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-12T16:15:54.705 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-12T16:15:54.705 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-12T16:15:54.706 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-12T16:15:54.706 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_num_async_rados_threads": "32", 2024-09-12T16:15:54.706 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_num_control_oids": "8", 2024-09-12T16:15:54.706 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_numa_node": "-1", 2024-09-12T16:15:54.706 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-12T16:15:54.706 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-12T16:15:54.706 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_objexp_chunk_size": "100", 2024-09-12T16:15:54.706 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_objexp_gc_interval": "600", 2024-09-12T16:15:54.706 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-12T16:15:54.706 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-12T16:15:54.706 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-12T16:15:54.706 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_op_thread_timeout": "600", 2024-09-12T16:15:54.707 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_op_tracing": "false", 2024-09-12T16:15:54.707 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_opa_token": "", 2024-09-12T16:15:54.707 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_opa_url": "", 2024-09-12T16:15:54.707 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_opa_verify_ssl": "true", 2024-09-12T16:15:54.707 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-12T16:15:54.707 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-12T16:15:54.707 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ops_log_rados": "false", 2024-09-12T16:15:54.707 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ops_log_socket_path": "", 2024-09-12T16:15:54.707 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-12T16:15:54.707 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-12T16:15:54.707 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-12T16:15:54.707 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_period_push_interval": "2.000000", 2024-09-12T16:15:54.707 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-12T16:15:54.708 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-12T16:15:54.708 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-12T16:15:54.708 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-12T16:15:54.708 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_posix_cache_lanes": "3", 2024-09-12T16:15:54.708 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-12T16:15:54.708 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-12T16:15:54.708 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_posix_cache_partitions": "3", 2024-09-12T16:15:54.708 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-12T16:15:54.708 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_print_continue": "true", 2024-09-12T16:15:54.708 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-12T16:15:54.709 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-12T16:15:54.709 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-12T16:15:54.709 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-12T16:15:54.709 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-12T16:15:54.709 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_rados_tracing": "false", 2024-09-12T16:15:54.709 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_realm": "", 2024-09-12T16:15:54.709 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_realm_id": "", 2024-09-12T16:15:54.709 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-12T16:15:54.709 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_region": "", 2024-09-12T16:15:54.709 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-12T16:15:54.709 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-12T16:15:54.709 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-12T16:15:54.710 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-12T16:15:54.710 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_request_uri": "", 2024-09-12T16:15:54.710 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_reshard_batch_size": "64", 2024-09-12T16:15:54.710 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-12T16:15:54.710 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_reshard_debug_interval": "-1", 2024-09-12T16:15:54.710 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_reshard_max_aio": "128", 2024-09-12T16:15:54.710 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_reshard_num_logs": "16", 2024-09-12T16:15:54.710 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_reshard_progress_judge_interval": "120", 2024-09-12T16:15:54.710 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_reshard_progress_judge_ratio": "0.500000", 2024-09-12T16:15:54.710 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_reshard_thread_interval": "600", 2024-09-12T16:15:54.711 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_reshardlog_threshold": "30000", 2024-09-12T16:15:54.711 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_resolve_cname": "false", 2024-09-12T16:15:54.711 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-12T16:15:54.711 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_run_sync_thread": "true", 2024-09-12T16:15:54.711 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-12T16:15:54.711 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-12T16:15:54.711 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-12T16:15:54.711 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-12T16:15:54.711 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-12T16:15:54.711 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-12T16:15:54.711 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-12T16:15:54.711 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-12T16:15:54.712 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-12T16:15:54.712 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_scheduler_type": "throttler", 2024-09-12T16:15:54.712 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_script_uri": "", 2024-09-12T16:15:54.712 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_service_provider_name": "", 2024-09-12T16:15:54.712 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-12T16:15:54.712 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sts_client_id": "", 2024-09-12T16:15:54.712 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sts_client_secret": "", 2024-09-12T16:15:54.712 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sts_entry": "sts", 2024-09-12T16:15:54.712 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sts_key": "sts", 2024-09-12T16:15:54.712 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-12T16:15:54.713 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sts_min_session_duration": "900", 2024-09-12T16:15:54.713 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sts_token_introspection_url": "", 2024-09-12T16:15:54.713 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_account_in_url": "false", 2024-09-12T16:15:54.713 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_auth_entry": "auth", 2024-09-12T16:15:54.713 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_auth_url": "", 2024-09-12T16:15:54.713 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_custom_header": "", 2024-09-12T16:15:54.713 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-12T16:15:54.713 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_need_stats": "true", 2024-09-12T16:15:54.713 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_tenant_name": "", 2024-09-12T16:15:54.714 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_token_expiration": "86400", 2024-09-12T16:15:54.714 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_url": "", 2024-09-12T16:15:54.714 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_url_prefix": "swift", 2024-09-12T16:15:54.714 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-12T16:15:54.714 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-12T16:15:54.714 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-12T16:15:54.714 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_lease_period": "120", 2024-09-12T16:15:54.714 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-12T16:15:54.714 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-12T16:15:54.714 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-12T16:15:54.714 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-12T16:15:54.714 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-12T16:15:54.715 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-12T16:15:54.715 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-12T16:15:54.715 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-12T16:15:54.715 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-12T16:15:54.715 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_thread_pool_size": "512", 2024-09-12T16:15:54.715 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-12T16:15:54.715 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-12T16:15:54.715 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-12T16:15:54.715 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-12T16:15:54.715 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_torrent_comment": "", 2024-09-12T16:15:54.715 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_torrent_createby": "", 2024-09-12T16:15:54.716 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_torrent_encoding": "", 2024-09-12T16:15:54.716 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_torrent_flag": "false", 2024-09-12T16:15:54.716 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-12T16:15:54.716 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_torrent_origin": "", 2024-09-12T16:15:54.716 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-12T16:15:54.716 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_torrent_tracker": "", 2024-09-12T16:15:54.716 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_trust_forwarded_https": "false", 2024-09-12T16:15:54.716 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-12T16:15:54.716 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-12T16:15:54.716 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_usage_max_shards": "32", 2024-09-12T16:15:54.716 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_usage_max_user_shards": "1", 2024-09-12T16:15:54.717 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_use_opa_authz": "false", 2024-09-12T16:15:54.717 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_counters_cache": "false", 2024-09-12T16:15:54.717 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-12T16:15:54.717 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-12T16:15:54.717 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-12T16:15:54.717 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_max_buckets": "1000", 2024-09-12T16:15:54.717 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_policies_max_num": "100", 2024-09-12T16:15:54.717 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-12T16:15:54.717 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-12T16:15:54.717 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-12T16:15:54.717 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-12T16:15:54.718 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_unique_email": "true", 2024-09-12T16:15:54.718 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_verify_ssl": "true", 2024-09-12T16:15:54.718 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-12T16:15:54.718 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_zone": "", 2024-09-12T16:15:54.718 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_zone_id": "", 2024-09-12T16:15:54.718 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-12T16:15:54.718 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_zonegroup": "", 2024-09-12T16:15:54.718 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_zonegroup_id": "", 2024-09-12T16:15:54.718 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-12T16:15:54.718 INFO:teuthology.orchestra.run.smithi017.stdout: "rgwlc_auto_session_clear": "true", 2024-09-12T16:15:54.718 INFO:teuthology.orchestra.run.smithi017.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-12T16:15:54.719 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_block_size": "4096", 2024-09-12T16:15:54.719 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-12T16:15:54.719 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-12T16:15:54.719 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-12T16:15:54.719 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-12T16:15:54.719 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-12T16:15:54.719 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_cache_size": "536870912", 2024-09-12T16:15:54.719 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-12T16:15:54.719 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-12T16:15:54.719 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-12T16:15:54.719 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-12T16:15:54.719 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-12T16:15:54.719 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-12T16:15:54.720 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-12T16:15:54.720 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-12T16:15:54.720 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_index_type": "binary_search", 2024-09-12T16:15:54.720 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-12T16:15:54.720 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-12T16:15:54.720 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_partition_filters": "false", 2024-09-12T16:15:54.720 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_perf": "false", 2024-09-12T16:15:54.720 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-12T16:15:54.720 INFO:teuthology.orchestra.run.smithi017.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-12T16:15:54.720 INFO:teuthology.orchestra.run.smithi017.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-12T16:15:54.720 INFO:teuthology.orchestra.run.smithi017.stdout: "run_dir": "/var/run/ceph", 2024-09-12T16:15:54.721 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_block_create": "true", 2024-09-12T16:15:54.721 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_cache_lru_size": "67108864", 2024-09-12T16:15:54.721 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-12T16:15:54.721 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-12T16:15:54.721 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_default_max_object_size": "16777216", 2024-09-12T16:15:54.721 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-12T16:15:54.721 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_device_size": "53687091200", 2024-09-12T16:15:54.721 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-12T16:15:54.721 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_full_integrity_check": "false", 2024-09-12T16:15:54.721 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_journal_batch_capacity": "16", 2024-09-12T16:15:54.721 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-12T16:15:54.721 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-12T16:15:54.721 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-12T16:15:54.722 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_main_device_type": "SSD", 2024-09-12T16:15:54.722 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-12T16:15:54.722 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-12T16:15:54.722 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-12T16:15:54.722 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-12T16:15:54.722 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-12T16:15:54.722 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-12T16:15:54.722 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_segment_size": "67108864", 2024-09-12T16:15:54.722 INFO:teuthology.orchestra.run.smithi017.stdout: "set_keepcaps": "false", 2024-09-12T16:15:54.722 INFO:teuthology.orchestra.run.smithi017.stdout: "setgroup": "", 2024-09-12T16:15:54.722 INFO:teuthology.orchestra.run.smithi017.stdout: "setuser": "", 2024-09-12T16:15:54.723 INFO:teuthology.orchestra.run.smithi017.stdout: "setuser_match_path": "", 2024-09-12T16:15:54.723 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-12T16:15:54.723 INFO:teuthology.orchestra.run.smithi017.stdout: "thp": "false", 2024-09-12T16:15:54.723 INFO:teuthology.orchestra.run.smithi017.stdout: "threadpool_default_timeout": "60", 2024-09-12T16:15:54.723 INFO:teuthology.orchestra.run.smithi017.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-12T16:15:54.723 INFO:teuthology.orchestra.run.smithi017.stdout: "throttler_perf_counter": "true", 2024-09-12T16:15:54.723 INFO:teuthology.orchestra.run.smithi017.stdout: "tmp_dir": "/tmp", 2024-09-12T16:15:54.723 INFO:teuthology.orchestra.run.smithi017.stdout: "tmp_file_template": "/tmp/ceph-mon.a.XXXXXX", 2024-09-12T16:15:54.723 INFO:teuthology.orchestra.run.smithi017.stdout: "uadk_compressor_enabled": "false", 2024-09-12T16:15:54.723 INFO:teuthology.orchestra.run.smithi017.stdout: "uadk_wd_sync_ctx_num": "2" 2024-09-12T16:15:54.723 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:15:54.726 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-12T16:15:54.841 INFO:teuthology.orchestra.run.smithi017.stdout:mon.a: {} 2024-09-12T16:15:54.841 INFO:teuthology.orchestra.run.smithi017.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T16:15:54.851 INFO:teuthology.orchestra.run.smithi017.stdout:mon.b: {} 2024-09-12T16:15:54.851 INFO:teuthology.orchestra.run.smithi017.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T16:15:54.859 INFO:teuthology.orchestra.run.smithi017.stdout:mon.c: {} 2024-09-12T16:15:54.859 INFO:teuthology.orchestra.run.smithi017.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T16:15:54.870 DEBUG:teuthology.orchestra.run.smithi017:> type ceph-objectstore-tool 2024-09-12T16:15:54.885 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-12T16:15:54.885 DEBUG:teuthology.orchestra.run.smithi047:> type ceph-objectstore-tool 2024-09-12T16:15:54.903 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-12T16:15:54.903 INFO:teuthology.run_tasks:Running task rbd_fsx... 2024-09-12T16:15:54.913 INFO:tasks.rbd_fsx:starting rbd_fsx... 2024-09-12T16:15:54.914 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-12T16:15:54.914 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-12T16:15:54.914 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T16:15:54.914 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-09-12T16:15:54.914 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 1.0 2024-09-12T16:15:54.915 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-12T16:15:54.915 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-12T16:15:54.915 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T16:15:54.915 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-12T16:15:54.916 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:15:54.916 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-12T16:15:54.916 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T16:15:54.916 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 512 -w 512 -t 512 -h 512 -l 250000000 -S 0 -N 6000 -M pool_client.0 image_client.0 2024-09-12T16:15:54.944 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:15:54.943+0000 7f002d431640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32213) UID: 0 2024-09-12T16:15:55.017 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:15:55.016+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:15:55.044 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:15:55.044 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:15:55.045 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:15:55.045 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:15:55.054 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:15:55.065 INFO:teuthology.orchestra.run.smithi204.stdout:mapped writes DISABLED 2024-09-12T16:15:55.066 INFO:teuthology.orchestra.run.smithi204.stdout:mapped reads DISABLED 2024-09-12T16:15:55.066 INFO:teuthology.orchestra.run.smithi204.stdout:Seed set to 5618 2024-09-12T16:15:55.066 INFO:teuthology.orchestra.run.smithi204.stdout:rbd-nbd mode enabled 2024-09-12T16:15:55.066 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:15:55.066 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:15:55.091 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:15:55.091 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:15:55.117 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:15:55.116+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:15:55.124 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:15:55.124 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:15:55.142 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:15:55.142 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:15:55.159 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:15:55.159 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:15:55.165 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:15:55.165 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:15:55.175 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:15:55.195 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:15:55.195 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:15:55.218 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:15:55.217+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:15:55.303 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:15:55.303 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:15:55.312 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:15:55.356 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:15:55.355+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:15:55.419 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:15:55.419 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:15:55.419 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:15:55.418+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:15:55.427 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:15:55.520 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:15:55.519+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:15:55.575 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:15:55.575 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:15:55.583 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:15:55.620 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:15:55.619+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:15:55.690 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:15:55.690 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:15:55.698 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:15:55.721 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:15:55.720+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:15:55.806 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:15:55.806 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:15:55.815 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:15:55.859 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:15:55.858+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:15:55.922 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:15:55.922 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:15:55.922 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:15:55.921+0000 7f002d431640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32213) UID: 0 2024-09-12T16:15:55.930 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:15:56.001 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2024-09-12T16:15:56.004 INFO:teuthology.orchestra.run.smithi017.stdout:moved 0 / 18 (0%) 2024-09-12T16:15:56.004 INFO:teuthology.orchestra.run.smithi017.stdout:avg 3 2024-09-12T16:15:56.004 INFO:teuthology.orchestra.run.smithi017.stdout:stddev 1.52753 -> 1.52753 (expected baseline 1.58114) 2024-09-12T16:15:56.004 INFO:teuthology.orchestra.run.smithi017.stdout:min osd.4 with 1 -> 1 pgs (0.333333 -> 0.333333 * mean) 2024-09-12T16:15:56.005 INFO:teuthology.orchestra.run.smithi017.stdout:max osd.1 with 5 -> 5 pgs (1.66667 -> 1.66667 * mean) 2024-09-12T16:15:56.005 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:15:56.005 INFO:teuthology.orchestra.run.smithi017.stdout:oload 110 2024-09-12T16:15:56.005 INFO:teuthology.orchestra.run.smithi017.stdout:max_change 1 2024-09-12T16:15:56.005 INFO:teuthology.orchestra.run.smithi017.stdout:max_change_osds 4 2024-09-12T16:15:56.005 INFO:teuthology.orchestra.run.smithi017.stdout:average_utilization 0.0003 2024-09-12T16:15:56.005 INFO:teuthology.orchestra.run.smithi017.stdout:overload_utilization 0.0004 2024-09-12T16:15:56.005 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 weight 1.0000 -> 0.8933 2024-09-12T16:15:56.021 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-09-12T16:15:56.021 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 1.0 2024-09-12T16:15:56.063 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:15:56.062+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:15:56.085 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:15:56.085 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:15:56.095 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:15:56.136 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:15:56.135+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:15:56.215 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:15:56.215 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:15:56.224 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:15:56.225 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:15:56.224+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:15:56.326 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:15:56.325+0000 7f002d431640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32213) UID: 0 2024-09-12T16:15:56.331 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:15:56.331 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:15:56.340 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:15:56.363 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-09-12T16:15:56.362+0000 7fd458b99640 -1 mgr.server reply reply (1) Operation not permitted no change 2024-09-12T16:15:56.364 INFO:teuthology.orchestra.run.smithi017.stdout:moved 1 / 82 (1.21951%) 2024-09-12T16:15:56.364 INFO:teuthology.orchestra.run.smithi017.stdout:avg 13.6667 2024-09-12T16:15:56.364 INFO:teuthology.orchestra.run.smithi017.stdout:stddev 1.79505 -> 2.13437 (expected baseline 3.37474) 2024-09-12T16:15:56.364 INFO:teuthology.orchestra.run.smithi017.stdout:min osd.0 with 12 -> 11 pgs (0.878049 -> 0.804878 * mean) 2024-09-12T16:15:56.364 INFO:teuthology.orchestra.run.smithi017.stdout:max osd.3 with 17 -> 17 pgs (1.2439 -> 1.2439 * mean) 2024-09-12T16:15:56.364 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:15:56.364 INFO:teuthology.orchestra.run.smithi017.stdout:oload 110 2024-09-12T16:15:56.364 INFO:teuthology.orchestra.run.smithi017.stdout:max_change 1 2024-09-12T16:15:56.365 INFO:teuthology.orchestra.run.smithi017.stdout:max_change_osds 4 2024-09-12T16:15:56.365 INFO:teuthology.orchestra.run.smithi017.stdout:average_utilization 0.0003 2024-09-12T16:15:56.365 INFO:teuthology.orchestra.run.smithi017.stdout:overload_utilization 0.0004 2024-09-12T16:15:56.365 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 weight 0.8933 -> 0.7980 2024-09-12T16:15:56.365 INFO:teuthology.orchestra.run.smithi017.stderr:no change 2024-09-12T16:15:56.377 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-09-12T16:15:56.377 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 3.0 2024-09-12T16:15:56.426 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:15:56.425+0000 7f002d431640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32213) UID: 0 2024-09-12T16:15:56.470 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:15:56.470 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:15:56.479 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:15:56.563 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:15:56.562+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:15:56.627 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:15:56.627 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:15:56.627 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:15:56.627+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:15:56.635 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:15:56.713 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-09-12T16:15:56.712+0000 7fd458b99640 -1 mgr.server reply reply (1) Operation not permitted no change 2024-09-12T16:15:56.714 INFO:teuthology.orchestra.run.smithi017.stdout:moved 1 / 82 (1.21951%) 2024-09-12T16:15:56.714 INFO:teuthology.orchestra.run.smithi017.stdout:avg 13.6667 2024-09-12T16:15:56.714 INFO:teuthology.orchestra.run.smithi017.stdout:stddev 1.79505 -> 2.13437 (expected baseline 3.37474) 2024-09-12T16:15:56.714 INFO:teuthology.orchestra.run.smithi017.stdout:min osd.0 with 12 -> 11 pgs (0.878049 -> 0.804878 * mean) 2024-09-12T16:15:56.714 INFO:teuthology.orchestra.run.smithi017.stdout:max osd.3 with 17 -> 17 pgs (1.2439 -> 1.2439 * mean) 2024-09-12T16:15:56.714 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:15:56.714 INFO:teuthology.orchestra.run.smithi017.stdout:oload 110 2024-09-12T16:15:56.714 INFO:teuthology.orchestra.run.smithi017.stdout:max_change 3 2024-09-12T16:15:56.714 INFO:teuthology.orchestra.run.smithi017.stdout:max_change_osds 4 2024-09-12T16:15:56.715 INFO:teuthology.orchestra.run.smithi017.stdout:average_utilization 0.0003 2024-09-12T16:15:56.715 INFO:teuthology.orchestra.run.smithi017.stdout:overload_utilization 0.0004 2024-09-12T16:15:56.715 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 weight 0.8933 -> 0.7980 2024-09-12T16:15:56.715 INFO:teuthology.orchestra.run.smithi017.stderr:no change 2024-09-12T16:15:56.726 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-09-12T16:15:56.727 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 1.0 2024-09-12T16:15:56.768 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:15:56.767+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:15:56.781 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:15:56.782 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:15:56.790 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:15:56.831 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:15:56.830+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:15:56.929 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:15:56.928+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:15:56.936 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:15:56.937 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:15:56.945 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:15:57.030 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:15:57.029+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:15:57.075 INFO:teuthology.orchestra.run.smithi017.stdout:moved 0 / 82 (0%) 2024-09-12T16:15:57.076 INFO:teuthology.orchestra.run.smithi017.stdout:avg 13.6667 2024-09-12T16:15:57.076 INFO:teuthology.orchestra.run.smithi017.stdout:stddev 1.79505 -> 1.79505 (expected baseline 3.37474) 2024-09-12T16:15:57.076 INFO:teuthology.orchestra.run.smithi017.stdout:min osd.0 with 12 -> 12 pgs (0.878049 -> 0.878049 * mean) 2024-09-12T16:15:57.076 INFO:teuthology.orchestra.run.smithi017.stdout:max osd.3 with 17 -> 17 pgs (1.2439 -> 1.2439 * mean) 2024-09-12T16:15:57.076 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:15:57.076 INFO:teuthology.orchestra.run.smithi017.stdout:oload 1000 2024-09-12T16:15:57.076 INFO:teuthology.orchestra.run.smithi017.stdout:max_change 1 2024-09-12T16:15:57.076 INFO:teuthology.orchestra.run.smithi017.stdout:max_change_osds 4 2024-09-12T16:15:57.076 INFO:teuthology.orchestra.run.smithi017.stdout:average_utilization 0.0003 2024-09-12T16:15:57.076 INFO:teuthology.orchestra.run.smithi017.stdout:overload_utilization 0.0034 2024-09-12T16:15:57.076 INFO:teuthology.orchestra.run.smithi017.stderr:no change 2024-09-12T16:15:57.089 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-09-12T16:15:57.089 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 0.05 2024-09-12T16:15:57.100 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:15:57.100 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:15:57.109 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:15:57.133 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:15:57.132+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:15:57.208 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T16:15:57.252 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:15:57.251+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:15:57.257 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:15:57.257 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:15:57.266 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:15:57.331 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:15:57.331 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:15:57.332 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:15:57.331+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:15:57.348 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:15:57.348 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:15:57.364 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:15:57.365 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:15:57.374 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:15:57.374 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:15:57.381 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:15:57.382 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:15:57.382 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:15:57.399 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:15:57.399 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:15:57.416 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:15:57.416 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:15:57.469 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:15:57.468+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:15:57.491 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:15:57.491 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:15:57.491 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:15:57.491 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:15:57.499 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:15:57.535 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:15:57.534+0000 7f002d431640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32213) UID: 0 2024-09-12T16:15:57.636 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:15:57.635+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:15:57.646 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:15:57.647 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:15:57.647 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:15:57.647 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:15:57.647 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:15:57.655 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:15:57.736 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:15:57.735+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:15:57.765 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:15:57.765 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:15:57.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:15:57.765 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:15:57.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.765 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4180.0:16 1.0 e14/13 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 14'6, mlcod=14'4)", 2024-09-12T16:15:57.765 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:15:42.332202+0000", 2024-09-12T16:15:57.765 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.431123918000001, 2024-09-12T16:15:57.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00098047400000000006, 2024-09-12T16:15:57.765 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:15:57.765 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:15:57.766 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:57.766 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:15:57.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:15:57.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.332202+0000", 2024-09-12T16:15:57.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:15:57.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.332202+0000", 2024-09-12T16:15:57.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:15:57.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.332204+0000", 2024-09-12T16:15:57.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5600000000000001e-06 2024-09-12T16:15:57.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:15:57.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.332216+0000", 2024-09-12T16:15:57.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1749999999999999e-05 2024-09-12T16:15:57.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.768 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:15:57.768 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.332240+0000", 2024-09-12T16:15:57.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3776000000000001e-05 2024-09-12T16:15:57.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.768 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:15:57.768 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.332253+0000", 2024-09-12T16:15:57.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3073e-05 2024-09-12T16:15:57.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.768 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:15:57.768 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.332376+0000", 2024-09-12T16:15:57.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000123299 2024-09-12T16:15:57.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:15:57.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.332414+0000", 2024-09-12T16:15:57.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8356999999999999e-05 2024-09-12T16:15:57.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:15:57.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.333140+0000", 2024-09-12T16:15:57.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00072576900000000002 2024-09-12T16:15:57.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:15:57.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.333183+0000", 2024-09-12T16:15:57.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2889999999999998e-05 2024-09-12T16:15:57.770 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.770 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:15:57.770 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.770 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4180.0:20 1.0 e14/13 1:30306672:devicehealth::main.db.0000000000000000:head v 14'10, mlcod=14'8)", 2024-09-12T16:15:57.770 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:15:42.337651+0000", 2024-09-12T16:15:57.770 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.42567519, 2024-09-12T16:15:57.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00097556800000000001, 2024-09-12T16:15:57.770 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:15:57.770 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:15:57.770 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:57.771 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:15:57.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:15:57.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.337651+0000", 2024-09-12T16:15:57.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:15:57.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.337651+0000", 2024-09-12T16:15:57.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:15:57.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.337653+0000", 2024-09-12T16:15:57.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.03e-06 2024-09-12T16:15:57.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.772 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:15:57.772 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.337741+0000", 2024-09-12T16:15:57.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7682999999999994e-05 2024-09-12T16:15:57.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.772 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:15:57.772 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.337755+0000", 2024-09-12T16:15:57.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3869999999999999e-05 2024-09-12T16:15:57.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:15:57.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.337761+0000", 2024-09-12T16:15:57.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7819999999999999e-06 2024-09-12T16:15:57.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:15:57.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.337812+0000", 2024-09-12T16:15:57.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1792999999999997e-05 2024-09-12T16:15:57.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:15:57.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.337828+0000", 2024-09-12T16:15:57.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6115000000000001e-05 2024-09-12T16:15:57.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:15:57.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.338586+0000", 2024-09-12T16:15:57.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00075730199999999995 2024-09-12T16:15:57.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:15:57.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.338627+0000", 2024-09-12T16:15:57.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0992999999999999e-05 2024-09-12T16:15:57.775 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.775 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:15:57.775 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.775 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4180.0:21 1.0 e14/13 1:30306672:devicehealth::main.db.0000000000000000:head v 14'11, mlcod=14'8)", 2024-09-12T16:15:57.775 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:15:42.338144+0000", 2024-09-12T16:15:57.775 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.425182595000001, 2024-09-12T16:15:57.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011193240000000001, 2024-09-12T16:15:57.775 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:15:57.775 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:15:57.775 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:57.776 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:15:57.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.776 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:15:57.776 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.338144+0000", 2024-09-12T16:15:57.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.776 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:15:57.776 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.338144+0000", 2024-09-12T16:15:57.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.777 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:15:57.777 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.338145+0000", 2024-09-12T16:15:57.777 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1650000000000001e-06 2024-09-12T16:15:57.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.777 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:15:57.777 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.338204+0000", 2024-09-12T16:15:57.777 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8884000000000001e-05 2024-09-12T16:15:57.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.777 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:15:57.777 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.338217+0000", 2024-09-12T16:15:57.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2747e-05 2024-09-12T16:15:57.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:15:57.778 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.338223+0000", 2024-09-12T16:15:57.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0120000000000002e-06 2024-09-12T16:15:57.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:15:57.778 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.338283+0000", 2024-09-12T16:15:57.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0427000000000003e-05 2024-09-12T16:15:57.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:15:57.779 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.338297+0000", 2024-09-12T16:15:57.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.419e-05 2024-09-12T16:15:57.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.779 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:15:57.779 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.339211+0000", 2024-09-12T16:15:57.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00091386400000000002 2024-09-12T16:15:57.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.779 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:15:57.779 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.339263+0000", 2024-09-12T16:15:57.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2034999999999999e-05 2024-09-12T16:15:57.779 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.779 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:15:57.780 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.780 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4180.0:22 1.0 e14/13 1:30306672:devicehealth::main.db.0000000000000000:head v 14'12, mlcod=14'8)", 2024-09-12T16:15:57.780 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:15:42.338718+0000", 2024-09-12T16:15:57.780 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.424608135, 2024-09-12T16:15:57.780 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010818100000000001, 2024-09-12T16:15:57.780 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:15:57.780 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:15:57.780 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:57.780 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:15:57.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.780 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:15:57.780 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.338718+0000", 2024-09-12T16:15:57.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.781 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:15:57.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.338718+0000", 2024-09-12T16:15:57.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.781 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:15:57.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.338719+0000", 2024-09-12T16:15:57.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6300000000000005e-07 2024-09-12T16:15:57.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:15:57.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.338809+0000", 2024-09-12T16:15:57.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9827000000000006e-05 2024-09-12T16:15:57.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:15:57.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.338825+0000", 2024-09-12T16:15:57.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5741999999999999e-05 2024-09-12T16:15:57.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:15:57.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.338831+0000", 2024-09-12T16:15:57.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6819999999999997e-06 2024-09-12T16:15:57.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:15:57.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.338888+0000", 2024-09-12T16:15:57.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7027999999999997e-05 2024-09-12T16:15:57.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:15:57.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.338929+0000", 2024-09-12T16:15:57.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0747000000000001e-05 2024-09-12T16:15:57.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:15:57.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.339761+0000", 2024-09-12T16:15:57.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00083194200000000001 2024-09-12T16:15:57.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.784 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:15:57.784 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.339800+0000", 2024-09-12T16:15:57.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9178999999999999e-05 2024-09-12T16:15:57.784 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.784 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:15:57.784 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.784 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4180.0:23 1.0 e14/13 1:30306672:devicehealth::main.db.0000000000000000:head v 14'13, mlcod=14'8)", 2024-09-12T16:15:57.784 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:15:42.339205+0000", 2024-09-12T16:15:57.784 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.424121867, 2024-09-12T16:15:57.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00091247300000000002, 2024-09-12T16:15:57.784 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:15:57.785 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:15:57.785 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:57.785 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:15:57.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.785 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:15:57.785 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.339205+0000", 2024-09-12T16:15:57.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.785 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:15:57.785 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.339205+0000", 2024-09-12T16:15:57.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.786 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:15:57.786 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.339205+0000", 2024-09-12T16:15:57.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8899999999999999e-07 2024-09-12T16:15:57.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.786 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:15:57.786 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.339283+0000", 2024-09-12T16:15:57.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8287000000000004e-05 2024-09-12T16:15:57.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.786 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:15:57.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.339298+0000", 2024-09-12T16:15:57.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4280999999999999e-05 2024-09-12T16:15:57.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:15:57.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.339302+0000", 2024-09-12T16:15:57.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6330000000000004e-06 2024-09-12T16:15:57.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:15:57.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.339356+0000", 2024-09-12T16:15:57.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3378000000000003e-05 2024-09-12T16:15:57.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:15:57.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.339379+0000", 2024-09-12T16:15:57.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3271000000000001e-05 2024-09-12T16:15:57.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:15:57.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.340068+0000", 2024-09-12T16:15:57.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00068863599999999996 2024-09-12T16:15:57.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:15:57.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.340117+0000", 2024-09-12T16:15:57.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9397999999999997e-05 2024-09-12T16:15:57.789 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.789 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:15:57.789 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.789 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4180.0:24 1.0 e14/13 1:30306672:devicehealth::main.db.0000000000000000:head v 14'14, mlcod=14'10)", 2024-09-12T16:15:57.789 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:15:42.340023+0000", 2024-09-12T16:15:57.789 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.423303555, 2024-09-12T16:15:57.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00090312900000000002, 2024-09-12T16:15:57.789 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:15:57.789 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:15:57.789 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:57.790 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:15:57.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.790 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:15:57.790 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.340023+0000", 2024-09-12T16:15:57.790 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.790 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:15:57.790 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.340023+0000", 2024-09-12T16:15:57.790 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.790 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:15:57.790 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.340024+0000", 2024-09-12T16:15:57.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4099999999999997e-07 2024-09-12T16:15:57.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:15:57.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.340086+0000", 2024-09-12T16:15:57.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1735000000000004e-05 2024-09-12T16:15:57.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:15:57.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.340097+0000", 2024-09-12T16:15:57.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1584e-05 2024-09-12T16:15:57.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:15:57.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.340104+0000", 2024-09-12T16:15:57.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6919999999999996e-06 2024-09-12T16:15:57.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.792 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:15:57.792 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.340145+0000", 2024-09-12T16:15:57.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1387999999999997e-05 2024-09-12T16:15:57.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.792 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:15:57.792 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.340160+0000", 2024-09-12T16:15:57.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4782e-05 2024-09-12T16:15:57.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.793 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:15:57.793 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.340881+0000", 2024-09-12T16:15:57.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00072066000000000003 2024-09-12T16:15:57.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.793 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:15:57.793 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.340926+0000", 2024-09-12T16:15:57.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5346999999999998e-05 2024-09-12T16:15:57.793 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.793 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:15:57.793 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.793 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4180.0:28 1.0 e14/13 1:30306672:devicehealth::main.db.0000000000000000:head v 14'18, mlcod=14'16)", 2024-09-12T16:15:57.794 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:15:42.351547+0000", 2024-09-12T16:15:57.794 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.411779033, 2024-09-12T16:15:57.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00092795699999999998, 2024-09-12T16:15:57.794 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:15:57.794 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:15:57.794 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:57.794 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:15:57.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:15:57.794 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.351547+0000", 2024-09-12T16:15:57.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:15:57.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.351547+0000", 2024-09-12T16:15:57.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:15:57.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.351549+0000", 2024-09-12T16:15:57.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7999999999999999e-06 2024-09-12T16:15:57.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:15:57.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.351563+0000", 2024-09-12T16:15:57.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4313e-05 2024-09-12T16:15:57.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:15:57.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.351590+0000", 2024-09-12T16:15:57.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6959999999999999e-05 2024-09-12T16:15:57.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:15:57.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.351602+0000", 2024-09-12T16:15:57.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2016e-05 2024-09-12T16:15:57.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:15:57.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.351731+0000", 2024-09-12T16:15:57.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000128379 2024-09-12T16:15:57.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.797 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:15:57.797 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.351796+0000", 2024-09-12T16:15:57.797 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5425999999999993e-05 2024-09-12T16:15:57.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.797 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:15:57.797 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.352437+0000", 2024-09-12T16:15:57.797 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00064075999999999998 2024-09-12T16:15:57.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.797 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:15:57.797 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.352475+0000", 2024-09-12T16:15:57.797 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8303000000000002e-05 2024-09-12T16:15:57.798 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.798 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:15:57.798 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.798 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4180.0:34 1.0 e14/13 1:30306672:devicehealth::main.db.0000000000000000:head v 14'20, mlcod=14'18)", 2024-09-12T16:15:57.798 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:15:42.424881+0000", 2024-09-12T16:15:57.798 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.338445460999999, 2024-09-12T16:15:57.798 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00093751000000000001, 2024-09-12T16:15:57.798 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:15:57.798 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:15:57.798 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:57.798 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:15:57.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.798 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:15:57.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.424881+0000", 2024-09-12T16:15:57.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:15:57.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.424881+0000", 2024-09-12T16:15:57.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:15:57.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.424888+0000", 2024-09-12T16:15:57.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0779999999999998e-06 2024-09-12T16:15:57.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:15:57.800 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.424900+0000", 2024-09-12T16:15:57.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2452999999999999e-05 2024-09-12T16:15:57.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:15:57.800 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.424928+0000", 2024-09-12T16:15:57.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7504999999999998e-05 2024-09-12T16:15:57.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:15:57.800 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.424943+0000", 2024-09-12T16:15:57.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5444999999999999e-05 2024-09-12T16:15:57.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:15:57.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.425034+0000", 2024-09-12T16:15:57.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0389000000000005e-05 2024-09-12T16:15:57.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:15:57.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.425054+0000", 2024-09-12T16:15:57.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.018e-05 2024-09-12T16:15:57.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:15:57.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.425763+0000", 2024-09-12T16:15:57.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00070901899999999997 2024-09-12T16:15:57.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:15:57.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.425818+0000", 2024-09-12T16:15:57.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5441e-05 2024-09-12T16:15:57.802 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.802 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:15:57.802 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.802 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4180.0:39 1.0 e14/13 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 14'21, mlcod=14'19)", 2024-09-12T16:15:57.802 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:15:42.428043+0000", 2024-09-12T16:15:57.802 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.335283414999999, 2024-09-12T16:15:57.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00091926099999999999, 2024-09-12T16:15:57.802 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:15:57.803 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:15:57.803 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:57.803 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:15:57.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:15:57.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.428043+0000", 2024-09-12T16:15:57.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:15:57.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.428043+0000", 2024-09-12T16:15:57.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:15:57.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.428045+0000", 2024-09-12T16:15:57.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.75e-06 2024-09-12T16:15:57.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:15:57.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.428067+0000", 2024-09-12T16:15:57.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1852999999999999e-05 2024-09-12T16:15:57.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:15:57.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.428093+0000", 2024-09-12T16:15:57.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.618e-05 2024-09-12T16:15:57.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:15:57.805 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.428105+0000", 2024-09-12T16:15:57.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.182e-05 2024-09-12T16:15:57.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:15:57.805 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.428232+0000", 2024-09-12T16:15:57.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000127167 2024-09-12T16:15:57.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:15:57.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.428256+0000", 2024-09-12T16:15:57.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3988000000000001e-05 2024-09-12T16:15:57.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:15:57.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.428924+0000", 2024-09-12T16:15:57.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00066859700000000005 2024-09-12T16:15:57.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:15:57.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.428962+0000", 2024-09-12T16:15:57.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7905999999999999e-05 2024-09-12T16:15:57.806 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.806 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:15:57.806 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.807 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4180.0:40 1.0 e14/13 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 14'22, mlcod=14'19)", 2024-09-12T16:15:57.807 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:15:42.428521+0000", 2024-09-12T16:15:57.807 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.334805199, 2024-09-12T16:15:57.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010044539999999999, 2024-09-12T16:15:57.807 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:15:57.807 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:15:57.807 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:57.807 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:15:57.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:15:57.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.428521+0000", 2024-09-12T16:15:57.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:15:57.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.428521+0000", 2024-09-12T16:15:57.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:15:57.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.428522+0000", 2024-09-12T16:15:57.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3399999999999998e-07 2024-09-12T16:15:57.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:15:57.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.428527+0000", 2024-09-12T16:15:57.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2549999999999997e-06 2024-09-12T16:15:57.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:15:57.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.428540+0000", 2024-09-12T16:15:57.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2414e-05 2024-09-12T16:15:57.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:15:57.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.428550+0000", 2024-09-12T16:15:57.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.961e-06 2024-09-12T16:15:57.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:15:57.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.428600+0000", 2024-09-12T16:15:57.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0367000000000001e-05 2024-09-12T16:15:57.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.810 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:15:57.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.428622+0000", 2024-09-12T16:15:57.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2059999999999999e-05 2024-09-12T16:15:57.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.810 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:15:57.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.429482+0000", 2024-09-12T16:15:57.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00085953600000000005 2024-09-12T16:15:57.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.811 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.811 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:15:57.811 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.429526+0000", 2024-09-12T16:15:57.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4127e-05 2024-09-12T16:15:57.811 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.811 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:15:57.811 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.811 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.811 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4180.0:41 1.0 e14/13 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 14'23, mlcod=14'19)", 2024-09-12T16:15:57.811 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:15:42.428948+0000", 2024-09-12T16:15:57.811 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.334378431999999, 2024-09-12T16:15:57.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00097424299999999996, 2024-09-12T16:15:57.812 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:15:57.812 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:15:57.812 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:57.812 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:15:57.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:15:57.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.428948+0000", 2024-09-12T16:15:57.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:15:57.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.428948+0000", 2024-09-12T16:15:57.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:15:57.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.428949+0000", 2024-09-12T16:15:57.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0299999999999998e-07 2024-09-12T16:15:57.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:15:57.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.429021+0000", 2024-09-12T16:15:57.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2490999999999994e-05 2024-09-12T16:15:57.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:15:57.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.429032+0000", 2024-09-12T16:15:57.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0855e-05 2024-09-12T16:15:57.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:15:57.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.429040+0000", 2024-09-12T16:15:57.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3629999999999994e-06 2024-09-12T16:15:57.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:15:57.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.429083+0000", 2024-09-12T16:15:57.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2386999999999999e-05 2024-09-12T16:15:57.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:15:57.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.429097+0000", 2024-09-12T16:15:57.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3978000000000001e-05 2024-09-12T16:15:57.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.815 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:15:57.815 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.429879+0000", 2024-09-12T16:15:57.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000782597 2024-09-12T16:15:57.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.815 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:15:57.815 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.429922+0000", 2024-09-12T16:15:57.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2769000000000003e-05 2024-09-12T16:15:57.815 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.815 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:15:57.815 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.816 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4180.0:44 1.0 e14/13 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 14'26, mlcod=14'22)", 2024-09-12T16:15:57.816 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:15:42.430996+0000", 2024-09-12T16:15:57.816 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.332330749, 2024-09-12T16:15:57.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001114746, 2024-09-12T16:15:57.816 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:15:57.816 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:15:57.816 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:57.816 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:15:57.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.816 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:15:57.816 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.430996+0000", 2024-09-12T16:15:57.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:15:57.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.430996+0000", 2024-09-12T16:15:57.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:15:57.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.430996+0000", 2024-09-12T16:15:57.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7599999999999997e-07 2024-09-12T16:15:57.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:15:57.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.431067+0000", 2024-09-12T16:15:57.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0581999999999996e-05 2024-09-12T16:15:57.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:15:57.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.431078+0000", 2024-09-12T16:15:57.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0743e-05 2024-09-12T16:15:57.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:15:57.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.431085+0000", 2024-09-12T16:15:57.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7789999999999996e-06 2024-09-12T16:15:57.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:15:57.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.431119+0000", 2024-09-12T16:15:57.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3368999999999998e-05 2024-09-12T16:15:57.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:15:57.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.431133+0000", 2024-09-12T16:15:57.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3825999999999999e-05 2024-09-12T16:15:57.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:15:57.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.432071+0000", 2024-09-12T16:15:57.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00093873800000000005 2024-09-12T16:15:57.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.820 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:15:57.820 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.432110+0000", 2024-09-12T16:15:57.820 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9133e-05 2024-09-12T16:15:57.820 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.820 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:15:57.820 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.820 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4180.0:55 1.0 e14/13 1:30306672:devicehealth::main.db.0000000000000000:head v 14'37, mlcod=14'33)", 2024-09-12T16:15:57.820 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:15:42.439140+0000", 2024-09-12T16:15:57.820 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.324186795999999, 2024-09-12T16:15:57.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00087704299999999998, 2024-09-12T16:15:57.821 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:15:57.821 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:15:57.821 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:57.821 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:15:57.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.821 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:15:57.821 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.439140+0000", 2024-09-12T16:15:57.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.821 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:15:57.821 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.439140+0000", 2024-09-12T16:15:57.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.822 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:15:57.822 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.439140+0000", 2024-09-12T16:15:57.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.51e-07 2024-09-12T16:15:57.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.822 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:15:57.822 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.439219+0000", 2024-09-12T16:15:57.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8620000000000003e-05 2024-09-12T16:15:57.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.823 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.823 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:15:57.823 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.439229+0000", 2024-09-12T16:15:57.823 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0327e-05 2024-09-12T16:15:57.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.823 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.823 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:15:57.823 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.439233+0000", 2024-09-12T16:15:57.823 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7230000000000002e-06 2024-09-12T16:15:57.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.824 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:15:57.824 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.439268+0000", 2024-09-12T16:15:57.824 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5391e-05 2024-09-12T16:15:57.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.824 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:15:57.824 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.439280+0000", 2024-09-12T16:15:57.824 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1943000000000001e-05 2024-09-12T16:15:57.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.824 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:15:57.824 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.439970+0000", 2024-09-12T16:15:57.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00068968399999999998 2024-09-12T16:15:57.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.825 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:15:57.825 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.440017+0000", 2024-09-12T16:15:57.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6903999999999997e-05 2024-09-12T16:15:57.825 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.825 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:15:57.825 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.825 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4180.0:59 1.0 e14/13 1:30306672:devicehealth::main.db.0000000000000000:head v 14'41, mlcod=14'39)", 2024-09-12T16:15:57.825 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:15:42.606576+0000", 2024-09-12T16:15:57.826 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.156750165, 2024-09-12T16:15:57.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00095399199999999997, 2024-09-12T16:15:57.826 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:15:57.826 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:15:57.826 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:57.826 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:15:57.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:15:57.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.606576+0000", 2024-09-12T16:15:57.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:15:57.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.606576+0000", 2024-09-12T16:15:57.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:15:57.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.606579+0000", 2024-09-12T16:15:57.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3640000000000002e-06 2024-09-12T16:15:57.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:15:57.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.606599+0000", 2024-09-12T16:15:57.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.012e-05 2024-09-12T16:15:57.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:15:57.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.606629+0000", 2024-09-12T16:15:57.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0383e-05 2024-09-12T16:15:57.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:15:57.828 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.606651+0000", 2024-09-12T16:15:57.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2183000000000001e-05 2024-09-12T16:15:57.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:15:57.828 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.606814+0000", 2024-09-12T16:15:57.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016233299999999999 2024-09-12T16:15:57.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:15:57.829 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.606843+0000", 2024-09-12T16:15:57.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9098000000000002e-05 2024-09-12T16:15:57.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.829 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:15:57.829 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.607486+0000", 2024-09-12T16:15:57.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000643157 2024-09-12T16:15:57.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.829 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:15:57.829 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.607530+0000", 2024-09-12T16:15:57.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4354000000000003e-05 2024-09-12T16:15:57.829 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.829 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:15:57.830 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.830 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4180.0:66 1.0 e14/13 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 14'44, mlcod=14'40)", 2024-09-12T16:15:57.830 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:15:42.610540+0000", 2024-09-12T16:15:57.830 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.152786517999999, 2024-09-12T16:15:57.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001092263, 2024-09-12T16:15:57.830 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:15:57.830 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:15:57.830 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:57.830 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:15:57.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.830 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:15:57.830 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.610540+0000", 2024-09-12T16:15:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:15:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.610540+0000", 2024-09-12T16:15:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:15:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.610540+0000", 2024-09-12T16:15:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.06e-07 2024-09-12T16:15:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:15:57.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.610604+0000", 2024-09-12T16:15:57.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3392999999999994e-05 2024-09-12T16:15:57.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.832 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:15:57.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.610611+0000", 2024-09-12T16:15:57.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8820000000000003e-06 2024-09-12T16:15:57.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.832 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:15:57.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.610615+0000", 2024-09-12T16:15:57.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8840000000000004e-06 2024-09-12T16:15:57.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:15:57.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.610668+0000", 2024-09-12T16:15:57.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3007999999999998e-05 2024-09-12T16:15:57.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:15:57.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.610688+0000", 2024-09-12T16:15:57.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0044999999999999e-05 2024-09-12T16:15:57.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:15:57.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.611606+0000", 2024-09-12T16:15:57.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00091845100000000003 2024-09-12T16:15:57.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:15:57.834 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.611632+0000", 2024-09-12T16:15:57.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5993999999999999e-05 2024-09-12T16:15:57.834 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.834 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:15:57.834 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.834 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4180.0:75 1.0 e14/13 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 14'53, mlcod=14'50)", 2024-09-12T16:15:57.834 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:15:42.617143+0000", 2024-09-12T16:15:57.834 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.14618302, 2024-09-12T16:15:57.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001076832, 2024-09-12T16:15:57.834 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:15:57.834 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:15:57.835 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:57.835 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:15:57.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:15:57.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.617143+0000", 2024-09-12T16:15:57.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:15:57.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.617143+0000", 2024-09-12T16:15:57.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:15:57.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.617144+0000", 2024-09-12T16:15:57.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0200000000000002e-07 2024-09-12T16:15:57.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:15:57.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.617214+0000", 2024-09-12T16:15:57.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9720000000000003e-05 2024-09-12T16:15:57.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:15:57.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.617223+0000", 2024-09-12T16:15:57.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.611e-06 2024-09-12T16:15:57.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:15:57.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.617227+0000", 2024-09-12T16:15:57.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0509999999999998e-06 2024-09-12T16:15:57.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:15:57.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.617271+0000", 2024-09-12T16:15:57.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3723999999999997e-05 2024-09-12T16:15:57.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:15:57.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.617292+0000", 2024-09-12T16:15:57.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0633999999999999e-05 2024-09-12T16:15:57.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:15:57.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.618198+0000", 2024-09-12T16:15:57.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00090661300000000002 2024-09-12T16:15:57.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:15:57.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.618220+0000", 2024-09-12T16:15:57.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1977e-05 2024-09-12T16:15:57.838 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.838 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:15:57.838 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.838 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4180.0:77 1.0 e14/13 1:30306672:devicehealth::main.db.0000000000000000:head v 14'55, mlcod=14'53)", 2024-09-12T16:15:57.839 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:15:42.619188+0000", 2024-09-12T16:15:57.839 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.144138835, 2024-09-12T16:15:57.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00094493699999999997, 2024-09-12T16:15:57.839 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:15:57.839 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:15:57.839 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:57.839 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:15:57.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:15:57.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.619188+0000", 2024-09-12T16:15:57.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:15:57.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.619188+0000", 2024-09-12T16:15:57.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:15:57.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.619188+0000", 2024-09-12T16:15:57.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1799999999999995e-07 2024-09-12T16:15:57.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:15:57.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.619245+0000", 2024-09-12T16:15:57.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7290999999999997e-05 2024-09-12T16:15:57.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:15:57.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.619254+0000", 2024-09-12T16:15:57.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5110000000000003e-06 2024-09-12T16:15:57.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:15:57.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.619258+0000", 2024-09-12T16:15:57.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6370000000000001e-06 2024-09-12T16:15:57.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:15:57.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.619297+0000", 2024-09-12T16:15:57.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9697999999999998e-05 2024-09-12T16:15:57.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:15:57.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.619317+0000", 2024-09-12T16:15:57.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0072e-05 2024-09-12T16:15:57.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:15:57.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.620105+0000", 2024-09-12T16:15:57.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00078811599999999995 2024-09-12T16:15:57.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:15:57.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.620133+0000", 2024-09-12T16:15:57.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7093999999999998e-05 2024-09-12T16:15:57.843 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.843 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:15:57.843 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.843 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4180.0:89 1.0 e15/13 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'63, mlcod=14'60)", 2024-09-12T16:15:57.843 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:15:42.842979+0000", 2024-09-12T16:15:57.843 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.920347326, 2024-09-12T16:15:57.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00089609900000000003, 2024-09-12T16:15:57.843 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:15:57.843 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:15:57.843 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:57.843 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:15:57.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:15:57.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.842979+0000", 2024-09-12T16:15:57.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:15:57.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.842979+0000", 2024-09-12T16:15:57.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:15:57.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.842980+0000", 2024-09-12T16:15:57.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7599999999999997e-07 2024-09-12T16:15:57.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:15:57.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.842984+0000", 2024-09-12T16:15:57.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4299999999999999e-06 2024-09-12T16:15:57.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:15:57.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.842994+0000", 2024-09-12T16:15:57.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5030000000000003e-06 2024-09-12T16:15:57.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:15:57.846 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.842998+0000", 2024-09-12T16:15:57.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9870000000000001e-06 2024-09-12T16:15:57.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.846 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:15:57.846 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.843040+0000", 2024-09-12T16:15:57.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2391000000000001e-05 2024-09-12T16:15:57.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.846 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:15:57.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.843060+0000", 2024-09-12T16:15:57.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0071000000000001e-05 2024-09-12T16:15:57.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:15:57.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.843836+0000", 2024-09-12T16:15:57.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00077609900000000004 2024-09-12T16:15:57.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:15:57.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.843875+0000", 2024-09-12T16:15:57.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9042000000000003e-05 2024-09-12T16:15:57.847 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.848 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:15:57.848 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.848 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4180.0:90 1.0 e15/13 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'64, mlcod=14'60)", 2024-09-12T16:15:57.848 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:15:42.843402+0000", 2024-09-12T16:15:57.848 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.919924704, 2024-09-12T16:15:57.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010024560000000001, 2024-09-12T16:15:57.848 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:15:57.848 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:15:57.848 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:57.848 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:15:57.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:15:57.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.843402+0000", 2024-09-12T16:15:57.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:15:57.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.843402+0000", 2024-09-12T16:15:57.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:15:57.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.843402+0000", 2024-09-12T16:15:57.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.75e-07 2024-09-12T16:15:57.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:15:57.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.843467+0000", 2024-09-12T16:15:57.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4939999999999998e-05 2024-09-12T16:15:57.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:15:57.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.843479+0000", 2024-09-12T16:15:57.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1905999999999999e-05 2024-09-12T16:15:57.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:15:57.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.843485+0000", 2024-09-12T16:15:57.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0889999999999996e-06 2024-09-12T16:15:57.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:15:57.851 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.843524+0000", 2024-09-12T16:15:57.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8985e-05 2024-09-12T16:15:57.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:15:57.851 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.843536+0000", 2024-09-12T16:15:57.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1715999999999999e-05 2024-09-12T16:15:57.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:15:57.851 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.844381+0000", 2024-09-12T16:15:57.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00084508399999999996 2024-09-12T16:15:57.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:15:57.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.844404+0000", 2024-09-12T16:15:57.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3061000000000002e-05 2024-09-12T16:15:57.852 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.852 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:15:57.852 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.852 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4180.0:93 1.0 e15/13 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'67, mlcod=15'64)", 2024-09-12T16:15:57.853 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:15:42.845375+0000", 2024-09-12T16:15:57.853 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.9179517, 2024-09-12T16:15:57.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00094220899999999995, 2024-09-12T16:15:57.853 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:15:57.853 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:15:57.853 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:57.853 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:15:57.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:15:57.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.845375+0000", 2024-09-12T16:15:57.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:15:57.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.845375+0000", 2024-09-12T16:15:57.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:57.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:15:57.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.845375+0000", 2024-09-12T16:15:57.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3200000000000005e-07 2024-09-12T16:15:57.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:15:57.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.845430+0000", 2024-09-12T16:15:57.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5050999999999999e-05 2024-09-12T16:15:57.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:15:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.845439+0000", 2024-09-12T16:15:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0049999999999993e-06 2024-09-12T16:15:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:15:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.845444+0000", 2024-09-12T16:15:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2490000000000003e-06 2024-09-12T16:15:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:15:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.845476+0000", 2024-09-12T16:15:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1964000000000001e-05 2024-09-12T16:15:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:15:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.845488+0000", 2024-09-12T16:15:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2329e-05 2024-09-12T16:15:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:15:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.846289+0000", 2024-09-12T16:15:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00080097000000000002 2024-09-12T16:15:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:15:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:42.846317+0000", 2024-09-12T16:15:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8109000000000001e-05 2024-09-12T16:15:57.857 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.857 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:15:57.857 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.857 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:57.857 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:15:57.857 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:15:57.858 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:15:57.859 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:15:57.857+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:15:57.959 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:15:57.958+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:15:58.007 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:15:58.007 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:15:58.007 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:15:58.007 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:15:58.010 INFO:teuthology.orchestra.run.smithi017.stdout:moved 0 / 82 (0%) 2024-09-12T16:15:58.010 INFO:teuthology.orchestra.run.smithi017.stdout:avg 13.6667 2024-09-12T16:15:58.010 INFO:teuthology.orchestra.run.smithi017.stdout:stddev 1.79505 -> 1.79505 (expected baseline 3.37474) 2024-09-12T16:15:58.010 INFO:teuthology.orchestra.run.smithi017.stdout:min osd.0 with 12 -> 12 pgs (0.878049 -> 0.878049 * mean) 2024-09-12T16:15:58.010 INFO:teuthology.orchestra.run.smithi017.stdout:max osd.3 with 17 -> 17 pgs (1.2439 -> 1.2439 * mean) 2024-09-12T16:15:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:15:58.010 INFO:teuthology.orchestra.run.smithi017.stdout:oload 110 2024-09-12T16:15:58.011 INFO:teuthology.orchestra.run.smithi017.stdout:max_change 0.05 2024-09-12T16:15:58.011 INFO:teuthology.orchestra.run.smithi017.stdout:max_change_osds 4 2024-09-12T16:15:58.011 INFO:teuthology.orchestra.run.smithi017.stdout:average_utilization 0.0003 2024-09-12T16:15:58.011 INFO:teuthology.orchestra.run.smithi017.stdout:overload_utilization 0.0004 2024-09-12T16:15:58.011 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 weight 0.8933 -> 0.8434 2024-09-12T16:15:58.018 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:15:58.023 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T16:15:58.068 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:15:58.066+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:15:58.162 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:15:58.161+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:15:58.174 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:15:58.174 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:15:58.174 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:15:58.174 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:15:58.174 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:15:58.183 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:15:58.263 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:15:58.262+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:15:58.290 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:15:58.291 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:15:58.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:15:58.291 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:15:58.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.291 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4236.0:5 2.2 e18/16 2:5cea7035:::rbd_info:head v 18'1, mlcod=0'0)", 2024-09-12T16:15:58.291 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:15:47.818262+0000", 2024-09-12T16:15:58.291 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.472469675999999, 2024-09-12T16:15:58.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00086372900000000004, 2024-09-12T16:15:58.291 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:15:58.291 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:15:58.291 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:58.292 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:15:58.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:15:58.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:47.818262+0000", 2024-09-12T16:15:58.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:58.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:58.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:15:58.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:47.818262+0000", 2024-09-12T16:15:58.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:58.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:58.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:15:58.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:47.818262+0000", 2024-09-12T16:15:58.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.39e-07 2024-09-12T16:15:58.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:58.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:15:58.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:47.818267+0000", 2024-09-12T16:15:58.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4249999999999997e-06 2024-09-12T16:15:58.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:58.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:15:58.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:47.818283+0000", 2024-09-12T16:15:58.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5846e-05 2024-09-12T16:15:58.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:58.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:15:58.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:47.818297+0000", 2024-09-12T16:15:58.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3284e-05 2024-09-12T16:15:58.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:58.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:15:58.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:47.818371+0000", 2024-09-12T16:15:58.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4653000000000005e-05 2024-09-12T16:15:58.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:58.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:15:58.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:47.818407+0000", 2024-09-12T16:15:58.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5777e-05 2024-09-12T16:15:58.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:58.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:15:58.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:47.819082+0000", 2024-09-12T16:15:58.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00067511299999999997 2024-09-12T16:15:58.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:58.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:15:58.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:47.819125+0000", 2024-09-12T16:15:58.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3291999999999998e-05 2024-09-12T16:15:58.295 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:58.295 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:15:58.296 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:58.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:58.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.296 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4236.0:7 2.2 e19/16 2:5cea7035:::rbd_info:head v 19'2, mlcod=0'0)", 2024-09-12T16:15:58.296 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:15:48.825882+0000", 2024-09-12T16:15:58.296 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.4648491680000006, 2024-09-12T16:15:58.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00084013700000000002, 2024-09-12T16:15:58.296 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:15:58.296 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:15:58.296 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:58.296 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:15:58.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:15:58.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:48.825882+0000", 2024-09-12T16:15:58.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:58.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:58.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:15:58.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:48.825882+0000", 2024-09-12T16:15:58.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:58.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:58.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:15:58.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:48.825882+0000", 2024-09-12T16:15:58.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8799999999999999e-07 2024-09-12T16:15:58.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:58.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:15:58.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:48.825890+0000", 2024-09-12T16:15:58.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9880000000000004e-06 2024-09-12T16:15:58.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:58.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:15:58.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:48.825903+0000", 2024-09-12T16:15:58.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.221e-05 2024-09-12T16:15:58.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:58.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:15:58.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:48.825911+0000", 2024-09-12T16:15:58.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.619e-06 2024-09-12T16:15:58.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:58.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:15:58.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:48.825982+0000", 2024-09-12T16:15:58.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0363000000000004e-05 2024-09-12T16:15:58.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:58.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:15:58.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:48.826014+0000", 2024-09-12T16:15:58.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2722000000000003e-05 2024-09-12T16:15:58.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:58.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:15:58.300 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:48.826683+0000", 2024-09-12T16:15:58.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00066872199999999996 2024-09-12T16:15:58.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:58.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:15:58.300 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:48.826722+0000", 2024-09-12T16:15:58.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9325e-05 2024-09-12T16:15:58.300 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:58.300 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:15:58.300 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:58.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:58.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.301 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4437.0:7 3.1a e23/21 3:5cea7035:::rbd_info:head v 23'1, mlcod=0'0)", 2024-09-12T16:15:58.301 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:15:58.014484+0000", 2024-09-12T16:15:58.301 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.27624715500000002, 2024-09-12T16:15:58.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011506960000000001, 2024-09-12T16:15:58.301 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:15:58.301 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:15:58.301 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:58.301 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:15:58.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:15:58.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:58.014484+0000", 2024-09-12T16:15:58.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:58.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:58.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:15:58.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:58.014484+0000", 2024-09-12T16:15:58.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:58.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:58.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:15:58.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:58.014484+0000", 2024-09-12T16:15:58.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0800000000000001e-07 2024-09-12T16:15:58.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:58.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:15:58.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:58.014489+0000", 2024-09-12T16:15:58.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8250000000000004e-06 2024-09-12T16:15:58.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:58.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:15:58.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:58.014507+0000", 2024-09-12T16:15:58.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7614000000000001e-05 2024-09-12T16:15:58.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:58.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:15:58.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:58.014517+0000", 2024-09-12T16:15:58.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.026e-05 2024-09-12T16:15:58.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:58.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:15:58.304 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:58.014590+0000", 2024-09-12T16:15:58.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3134999999999997e-05 2024-09-12T16:15:58.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:58.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.304 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:15:58.304 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:58.014617+0000", 2024-09-12T16:15:58.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6299e-05 2024-09-12T16:15:58.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:58.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.304 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:15:58.304 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:58.015581+0000", 2024-09-12T16:15:58.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00096431000000000002 2024-09-12T16:15:58.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:58.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:15:58.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:58.015635+0000", 2024-09-12T16:15:58.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4045000000000002e-05 2024-09-12T16:15:58.305 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:58.305 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:15:58.305 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:58.305 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:58.305 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:15:58.305 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:15:58.306 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:15:58.363 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:15:58.363+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:15:58.413 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:15:58.414 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:15:58.414 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:15:58.414 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:15:58.422 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:15:58.464 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:15:58.463+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:15:58.566 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:15:58.565+0000 7f002d431640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32213) UID: 0 2024-09-12T16:15:58.570 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:15:58.570 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:15:58.570 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:15:58.570 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:15:58.570 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:15:58.578 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:15:58.667 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:15:58.666+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:15:58.685 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:15:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:15:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:15:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:15:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4236.0:1 2.3 e17/16 2:c4c92e5a:::rbd_trash:head v 17'1, mlcod=0'0)", 2024-09-12T16:15:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:15:46.820186+0000", 2024-09-12T16:15:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 11.865063075, 2024-09-12T16:15:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00096864800000000001, 2024-09-12T16:15:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:15:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:15:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:15:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:15:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:46.820186+0000", 2024-09-12T16:15:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:15:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:46.820186+0000", 2024-09-12T16:15:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:15:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:15:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:46.820186+0000", 2024-09-12T16:15:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5700000000000002e-07 2024-09-12T16:15:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:15:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:46.820193+0000", 2024-09-12T16:15:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4960000000000001e-06 2024-09-12T16:15:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:15:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:46.820209+0000", 2024-09-12T16:15:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6572e-05 2024-09-12T16:15:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:15:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:46.820221+0000", 2024-09-12T16:15:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1555e-05 2024-09-12T16:15:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:15:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:46.820304+0000", 2024-09-12T16:15:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2736000000000002e-05 2024-09-12T16:15:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:15:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:46.820334+0000", 2024-09-12T16:15:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9923000000000001e-05 2024-09-12T16:15:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:15:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:46.821106+0000", 2024-09-12T16:15:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00077252199999999999 2024-09-12T16:15:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:15:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:15:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:15:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:15:46.821154+0000", 2024-09-12T16:15:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8186999999999998e-05 2024-09-12T16:15:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:15:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:15:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:15:58.691 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:15:58.694 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:15:58.767 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:15:58.767+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:15:58.814 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:15:58.814 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:15:58.814 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:15:58.814 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:15:58.823 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:15:58.868 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:15:58.867+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:15:58.931 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:15:58.931 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:15:58.931 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:15:58.931 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:15:58.931 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:15:58.939 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:15:58.980 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:15:58.979+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:15:59.011 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2024-09-12T16:15:59.069 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:15:59.068+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:15:59.093 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:15:59.093 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:15:59.093 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:15:59.093 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:15:59.093 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.093 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:15:59.093 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:15:59.094 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 17.326511222000001, 2024-09-12T16:15:59.094 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55645454900000002, 2024-09-12T16:15:59.094 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:15:59.094 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:15:59.094 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:59.094 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:15:59.094 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:15:59.094 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:15:59.094 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1 2024-09-12T16:15:59.094 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.094 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:15:59.094 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.095 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:15:59.095 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:15:59.095 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.095 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.095 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.095 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:15:59.095 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:15:59.095 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.095 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.095 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.095 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:15:59.096 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764440+0000", 2024-09-12T16:15:59.096 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6249999999999999e-06 2024-09-12T16:15:59.096 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.096 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.096 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:15:59.096 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764447+0000", 2024-09-12T16:15:59.096 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4939999999999997e-06 2024-09-12T16:15:59.096 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.096 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.096 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:15:59.096 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764459+0000", 2024-09-12T16:15:59.096 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1517e-05 2024-09-12T16:15:59.096 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.096 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.097 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:15:59.097 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764468+0000", 2024-09-12T16:15:59.097 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7690000000000002e-06 2024-09-12T16:15:59.097 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.097 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.097 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:15:59.097 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764539+0000", 2024-09-12T16:15:59.097 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1103e-05 2024-09-12T16:15:59.097 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.097 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.097 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:15:59.097 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764551+0000", 2024-09-12T16:15:59.098 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2687999999999999e-05 2024-09-12T16:15:59.098 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.098 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.098 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:15:59.098 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319497+0000", 2024-09-12T16:15:59.098 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55494560500000001 2024-09-12T16:15:59.098 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.098 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.098 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:15:59.098 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319688+0000", 2024-09-12T16:15:59.098 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019105599999999999 2024-09-12T16:15:59.098 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.098 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.099 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:15:59.099 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319842+0000", 2024-09-12T16:15:59.099 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015377699999999999 2024-09-12T16:15:59.099 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.099 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.099 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:15:59.099 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320473+0000", 2024-09-12T16:15:59.099 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00063117100000000003 2024-09-12T16:15:59.099 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.099 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.099 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:15:59.099 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320825+0000", 2024-09-12T16:15:59.100 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00035202500000000001 2024-09-12T16:15:59.100 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.100 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.100 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:15:59.100 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320867+0000", 2024-09-12T16:15:59.100 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2005000000000002e-05 2024-09-12T16:15:59.100 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.100 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.100 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:15:59.100 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320893+0000", 2024-09-12T16:15:59.100 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5714000000000001e-05 2024-09-12T16:15:59.100 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.101 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:15:59.101 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.101 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.101 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.101 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:15:59.101 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:42.427987+0000", 2024-09-12T16:15:59.101 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 16.662962796999999, 2024-09-12T16:15:59.101 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040397089999999998, 2024-09-12T16:15:59.101 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:15:59.101 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:15:59.101 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:59.101 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:15:59.102 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:15:59.102 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:15:59.102 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 43 2024-09-12T16:15:59.102 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.102 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:15:59.102 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.102 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:15:59.102 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.427987+0000", 2024-09-12T16:15:59.102 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.102 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.102 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.102 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:15:59.102 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.427987+0000", 2024-09-12T16:15:59.102 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.103 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.103 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.103 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:15:59.103 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.427988+0000", 2024-09-12T16:15:59.103 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.78e-07 2024-09-12T16:15:59.103 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.103 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.103 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:15:59.103 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.427995+0000", 2024-09-12T16:15:59.103 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8110000000000003e-06 2024-09-12T16:15:59.103 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.103 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.103 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:15:59.103 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428019+0000", 2024-09-12T16:15:59.104 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3597000000000001e-05 2024-09-12T16:15:59.104 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.104 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.104 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:15:59.104 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428028+0000", 2024-09-12T16:15:59.104 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8720000000000008e-06 2024-09-12T16:15:59.104 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.104 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.104 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:15:59.104 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.430092+0000", 2024-09-12T16:15:59.104 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0020641790000000002 2024-09-12T16:15:59.104 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.104 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.105 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:15:59.105 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.430149+0000", 2024-09-12T16:15:59.105 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7157999999999997e-05 2024-09-12T16:15:59.105 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.105 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.105 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:15:59.105 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.430245+0000", 2024-09-12T16:15:59.105 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5933000000000005e-05 2024-09-12T16:15:59.105 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.105 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.105 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:15:59.105 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.431935+0000", 2024-09-12T16:15:59.105 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0016902379999999999 2024-09-12T16:15:59.105 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.106 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.106 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:15:59.106 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.431944+0000", 2024-09-12T16:15:59.106 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6200000000000005e-06 2024-09-12T16:15:59.106 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.106 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.106 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:15:59.106 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.431977+0000", 2024-09-12T16:15:59.106 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3132000000000001e-05 2024-09-12T16:15:59.106 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.106 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.106 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:15:59.106 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.432026+0000", 2024-09-12T16:15:59.107 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9291e-05 2024-09-12T16:15:59.107 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.107 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:15:59.107 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.107 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.107 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.107 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:15:59.107 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:42.428081+0000", 2024-09-12T16:15:59.107 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 16.662868378999999, 2024-09-12T16:15:59.107 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0054084609999999998, 2024-09-12T16:15:59.107 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:15:59.107 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:15:59.107 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:59.107 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:15:59.108 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:15:59.108 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:15:59.108 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 44 2024-09-12T16:15:59.108 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.108 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:15:59.108 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.108 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:15:59.108 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428081+0000", 2024-09-12T16:15:59.108 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.108 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.108 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.108 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:15:59.108 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428081+0000", 2024-09-12T16:15:59.109 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.109 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.109 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.109 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:15:59.109 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428082+0000", 2024-09-12T16:15:59.109 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8700000000000005e-07 2024-09-12T16:15:59.109 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.109 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.109 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:15:59.109 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428144+0000", 2024-09-12T16:15:59.109 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1651999999999999e-05 2024-09-12T16:15:59.109 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.109 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.110 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:15:59.110 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428154+0000", 2024-09-12T16:15:59.110 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0210000000000001e-05 2024-09-12T16:15:59.110 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.110 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.110 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:15:59.110 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428161+0000", 2024-09-12T16:15:59.110 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1389999999999998e-06 2024-09-12T16:15:59.110 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.110 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.110 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:15:59.110 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.430708+0000", 2024-09-12T16:15:59.110 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025475070000000001 2024-09-12T16:15:59.111 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.111 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.111 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:15:59.111 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.430770+0000", 2024-09-12T16:15:59.111 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1649999999999994e-05 2024-09-12T16:15:59.111 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.111 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.111 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:15:59.111 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.430869+0000", 2024-09-12T16:15:59.111 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8952999999999999e-05 2024-09-12T16:15:59.111 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.111 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.111 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:15:59.111 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.433318+0000", 2024-09-12T16:15:59.112 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0024487010000000002 2024-09-12T16:15:59.112 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.112 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.112 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:15:59.112 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.433385+0000", 2024-09-12T16:15:59.112 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7395000000000001e-05 2024-09-12T16:15:59.112 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.112 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.112 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:15:59.112 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.433446+0000", 2024-09-12T16:15:59.112 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0822000000000001e-05 2024-09-12T16:15:59.112 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.112 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.113 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:15:59.113 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.433490+0000", 2024-09-12T16:15:59.113 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3645e-05 2024-09-12T16:15:59.113 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.113 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:15:59.113 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.113 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.113 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.113 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:15:59.113 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:42.428181+0000", 2024-09-12T16:15:59.113 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 16.662768046, 2024-09-12T16:15:59.113 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0054705659999999996, 2024-09-12T16:15:59.113 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:15:59.114 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:15:59.114 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:59.114 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:15:59.114 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:15:59.114 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:15:59.114 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 45 2024-09-12T16:15:59.114 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.114 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:15:59.114 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.114 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:15:59.114 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428181+0000", 2024-09-12T16:15:59.114 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.114 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.114 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.115 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:15:59.115 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428181+0000", 2024-09-12T16:15:59.115 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.115 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.115 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.115 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:15:59.115 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428182+0000", 2024-09-12T16:15:59.115 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6099999999999999e-07 2024-09-12T16:15:59.115 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.115 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.115 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:15:59.115 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428189+0000", 2024-09-12T16:15:59.115 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9609999999999999e-06 2024-09-12T16:15:59.115 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.116 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.116 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:15:59.116 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428197+0000", 2024-09-12T16:15:59.116 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9780000000000005e-06 2024-09-12T16:15:59.116 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.116 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.116 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:15:59.116 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428204+0000", 2024-09-12T16:15:59.116 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0129999999999996e-06 2024-09-12T16:15:59.116 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.116 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.116 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:15:59.116 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.431400+0000", 2024-09-12T16:15:59.117 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0031957930000000002 2024-09-12T16:15:59.117 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.117 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.117 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:15:59.117 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.431478+0000", 2024-09-12T16:15:59.117 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8326999999999997e-05 2024-09-12T16:15:59.117 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.117 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.117 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:15:59.117 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.431581+0000", 2024-09-12T16:15:59.117 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010281300000000001 2024-09-12T16:15:59.117 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.117 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.117 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:15:59.118 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.433550+0000", 2024-09-12T16:15:59.118 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0019689109999999998 2024-09-12T16:15:59.118 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.118 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.118 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:15:59.118 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.433558+0000", 2024-09-12T16:15:59.118 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0690000000000002e-06 2024-09-12T16:15:59.118 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.118 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.118 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:15:59.118 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.433589+0000", 2024-09-12T16:15:59.118 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1006000000000001e-05 2024-09-12T16:15:59.118 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.118 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.119 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:15:59.119 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.433652+0000", 2024-09-12T16:15:59.119 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2834000000000002e-05 2024-09-12T16:15:59.119 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.119 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:15:59.119 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.119 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.119 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.119 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:15:59.119 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:42.428221+0000", 2024-09-12T16:15:59.119 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 16.662728261000002, 2024-09-12T16:15:59.119 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0055536559999999997, 2024-09-12T16:15:59.119 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:15:59.119 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:15:59.120 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:59.120 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:15:59.120 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:15:59.120 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:15:59.120 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 46 2024-09-12T16:15:59.120 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.120 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:15:59.120 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.120 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:15:59.120 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428221+0000", 2024-09-12T16:15:59.120 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.120 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.120 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.121 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:15:59.121 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428221+0000", 2024-09-12T16:15:59.121 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.121 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.121 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.121 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:15:59.121 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428222+0000", 2024-09-12T16:15:59.121 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6300000000000005e-07 2024-09-12T16:15:59.121 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.121 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.121 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:15:59.121 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428226+0000", 2024-09-12T16:15:59.121 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5669999999999996e-06 2024-09-12T16:15:59.122 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.122 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.122 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:15:59.122 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428250+0000", 2024-09-12T16:15:59.122 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3819e-05 2024-09-12T16:15:59.122 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.122 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.122 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:15:59.122 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428257+0000", 2024-09-12T16:15:59.122 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8369999999999999e-06 2024-09-12T16:15:59.122 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.122 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.122 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:15:59.123 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.432083+0000", 2024-09-12T16:15:59.123 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0038262259999999998 2024-09-12T16:15:59.123 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.123 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.123 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:15:59.123 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.432180+0000", 2024-09-12T16:15:59.123 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6251999999999999e-05 2024-09-12T16:15:59.123 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.123 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.123 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:15:59.123 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.432340+0000", 2024-09-12T16:15:59.123 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016079899999999999 2024-09-12T16:15:59.123 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.124 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.124 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:15:59.124 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.433664+0000", 2024-09-12T16:15:59.124 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0013232820000000001 2024-09-12T16:15:59.124 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.124 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.124 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:15:59.124 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.433713+0000", 2024-09-12T16:15:59.124 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9623000000000002e-05 2024-09-12T16:15:59.124 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.124 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.125 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:15:59.125 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.433747+0000", 2024-09-12T16:15:59.125 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3955999999999998e-05 2024-09-12T16:15:59.125 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.125 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.125 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:15:59.125 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.433775+0000", 2024-09-12T16:15:59.125 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7631999999999999e-05 2024-09-12T16:15:59.125 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.125 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:15:59.125 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.125 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.125 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.126 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:15:59.126 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:42.428272+0000", 2024-09-12T16:15:59.126 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 16.662677602999999, 2024-09-12T16:15:59.126 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0061179980000000004, 2024-09-12T16:15:59.126 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:15:59.126 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:15:59.126 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:59.126 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:15:59.126 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:15:59.126 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:15:59.126 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 47 2024-09-12T16:15:59.126 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.126 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:15:59.127 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.127 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:15:59.127 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428272+0000", 2024-09-12T16:15:59.127 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.127 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.127 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.127 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:15:59.127 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428272+0000", 2024-09-12T16:15:59.127 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.127 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.127 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.127 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:15:59.127 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428273+0000", 2024-09-12T16:15:59.127 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6000000000000003e-07 2024-09-12T16:15:59.128 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.128 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.128 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:15:59.128 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428360+0000", 2024-09-12T16:15:59.128 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7633000000000006e-05 2024-09-12T16:15:59.128 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.128 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.128 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:15:59.128 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428372+0000", 2024-09-12T16:15:59.129 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.217e-05 2024-09-12T16:15:59.129 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.129 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.129 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:15:59.129 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428380+0000", 2024-09-12T16:15:59.129 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7200000000000006e-06 2024-09-12T16:15:59.129 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.129 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.129 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:15:59.129 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.432723+0000", 2024-09-12T16:15:59.129 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0043429870000000004 2024-09-12T16:15:59.130 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.130 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.130 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:15:59.130 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.432778+0000", 2024-09-12T16:15:59.130 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4629999999999997e-05 2024-09-12T16:15:59.130 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.130 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.130 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:15:59.130 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.432877+0000", 2024-09-12T16:15:59.130 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8978e-05 2024-09-12T16:15:59.130 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.130 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.130 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:15:59.131 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.434227+0000", 2024-09-12T16:15:59.131 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001350106 2024-09-12T16:15:59.131 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.131 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.131 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:15:59.131 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.434283+0000", 2024-09-12T16:15:59.131 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6274999999999999e-05 2024-09-12T16:15:59.131 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.132 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.132 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:15:59.132 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.434343+0000", 2024-09-12T16:15:59.132 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0185000000000001e-05 2024-09-12T16:15:59.132 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.132 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.132 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:15:59.132 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.434390+0000", 2024-09-12T16:15:59.132 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6554000000000002e-05 2024-09-12T16:15:59.132 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.132 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:15:59.132 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.132 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.133 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.133 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:15:59.133 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:42.428397+0000", 2024-09-12T16:15:59.133 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 16.662552676000001, 2024-09-12T16:15:59.133 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.007481339, 2024-09-12T16:15:59.133 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:15:59.133 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:15:59.133 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:59.133 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:15:59.133 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:15:59.133 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:15:59.133 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 48 2024-09-12T16:15:59.134 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.134 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:15:59.134 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.134 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:15:59.134 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428397+0000", 2024-09-12T16:15:59.134 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.134 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.134 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.134 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:15:59.134 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428397+0000", 2024-09-12T16:15:59.134 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.134 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.134 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.135 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:15:59.135 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428398+0000", 2024-09-12T16:15:59.135 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.85e-07 2024-09-12T16:15:59.135 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.135 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.135 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:15:59.135 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428403+0000", 2024-09-12T16:15:59.135 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3639999999999998e-06 2024-09-12T16:15:59.135 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.135 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.135 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:15:59.135 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428411+0000", 2024-09-12T16:15:59.135 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6380000000000004e-06 2024-09-12T16:15:59.135 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.136 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.136 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:15:59.136 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428417+0000", 2024-09-12T16:15:59.136 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0800000000000002e-06 2024-09-12T16:15:59.136 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.136 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.136 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:15:59.136 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.433813+0000", 2024-09-12T16:15:59.136 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0053964 2024-09-12T16:15:59.136 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.136 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.136 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:15:59.136 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.433869+0000", 2024-09-12T16:15:59.137 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5534000000000001e-05 2024-09-12T16:15:59.137 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.137 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.137 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:15:59.137 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.433956+0000", 2024-09-12T16:15:59.137 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7193000000000004e-05 2024-09-12T16:15:59.137 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.137 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.137 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:15:59.137 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.435795+0000", 2024-09-12T16:15:59.137 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0018395989999999999 2024-09-12T16:15:59.137 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.137 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.137 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:15:59.138 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.435804+0000", 2024-09-12T16:15:59.138 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.276e-06 2024-09-12T16:15:59.138 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.138 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.138 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:15:59.138 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.435833+0000", 2024-09-12T16:15:59.138 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.889e-05 2024-09-12T16:15:59.138 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.138 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.138 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:15:59.138 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.435878+0000", 2024-09-12T16:15:59.138 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5580000000000001e-05 2024-09-12T16:15:59.139 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.139 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:15:59.139 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.139 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.139 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.139 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:15:59.139 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:42.428428+0000", 2024-09-12T16:15:59.139 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 16.662521705, 2024-09-12T16:15:59.139 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0080741010000000002, 2024-09-12T16:15:59.139 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:15:59.139 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:15:59.139 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:59.139 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:15:59.139 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:15:59.140 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:15:59.140 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 49 2024-09-12T16:15:59.140 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.140 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:15:59.140 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.140 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:15:59.140 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428428+0000", 2024-09-12T16:15:59.140 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.140 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.140 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.140 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:15:59.140 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428428+0000", 2024-09-12T16:15:59.141 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.141 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.141 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.141 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:15:59.141 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428428+0000", 2024-09-12T16:15:59.141 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9800000000000003e-07 2024-09-12T16:15:59.141 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.141 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.141 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:15:59.141 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428440+0000", 2024-09-12T16:15:59.141 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1780000000000001e-05 2024-09-12T16:15:59.141 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.141 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.142 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:15:59.142 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428448+0000", 2024-09-12T16:15:59.142 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1540000000000002e-06 2024-09-12T16:15:59.142 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.142 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.142 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:15:59.142 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428456+0000", 2024-09-12T16:15:59.142 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.824e-06 2024-09-12T16:15:59.142 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.142 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.142 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:15:59.142 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.434444+0000", 2024-09-12T16:15:59.142 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0059881789999999997 2024-09-12T16:15:59.143 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.143 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.143 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:15:59.143 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.434509+0000", 2024-09-12T16:15:59.143 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4295999999999996e-05 2024-09-12T16:15:59.143 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.143 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.143 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:15:59.143 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.434601+0000", 2024-09-12T16:15:59.143 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2231000000000005e-05 2024-09-12T16:15:59.143 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.143 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.144 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:15:59.144 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.435946+0000", 2024-09-12T16:15:59.144 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0013446619999999999 2024-09-12T16:15:59.144 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.144 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.144 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:15:59.144 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.436427+0000", 2024-09-12T16:15:59.144 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00048182900000000002 2024-09-12T16:15:59.144 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.144 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.144 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:15:59.144 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.436457+0000", 2024-09-12T16:15:59.145 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9365000000000001e-05 2024-09-12T16:15:59.145 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.145 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.145 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:15:59.145 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.436502+0000", 2024-09-12T16:15:59.145 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5083000000000002e-05 2024-09-12T16:15:59.145 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.145 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:15:59.145 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.145 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.145 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.145 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:15:59.145 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:42.428468+0000", 2024-09-12T16:15:59.146 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 16.662481392, 2024-09-12T16:15:59.146 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0087364260000000003, 2024-09-12T16:15:59.146 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:15:59.146 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:15:59.146 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:59.146 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:15:59.146 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:15:59.146 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:15:59.146 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 50 2024-09-12T16:15:59.146 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.146 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:15:59.146 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.146 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:15:59.147 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428468+0000", 2024-09-12T16:15:59.147 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.147 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.147 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.147 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:15:59.147 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428468+0000", 2024-09-12T16:15:59.147 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.147 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.147 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.147 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:15:59.147 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428469+0000", 2024-09-12T16:15:59.147 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2300000000000001e-07 2024-09-12T16:15:59.147 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.148 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.148 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:15:59.148 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428546+0000", 2024-09-12T16:15:59.148 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7200999999999995e-05 2024-09-12T16:15:59.148 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.148 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.148 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:15:59.148 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428570+0000", 2024-09-12T16:15:59.148 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4093000000000001e-05 2024-09-12T16:15:59.148 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.148 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.148 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:15:59.148 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428577+0000", 2024-09-12T16:15:59.149 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9809999999999997e-06 2024-09-12T16:15:59.149 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.149 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.149 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:15:59.149 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.434919+0000", 2024-09-12T16:15:59.149 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0063415820000000001 2024-09-12T16:15:59.149 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.149 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.149 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:15:59.149 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.435019+0000", 2024-09-12T16:15:59.149 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010060699999999999 2024-09-12T16:15:59.149 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.149 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.149 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:15:59.150 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.435169+0000", 2024-09-12T16:15:59.150 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000149839 2024-09-12T16:15:59.150 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.150 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.150 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:15:59.150 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.437125+0000", 2024-09-12T16:15:59.150 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0019556539999999998 2024-09-12T16:15:59.150 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.150 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.150 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:15:59.150 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.437133+0000", 2024-09-12T16:15:59.150 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2199999999999992e-06 2024-09-12T16:15:59.150 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.150 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.150 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:15:59.151 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.437163+0000", 2024-09-12T16:15:59.151 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0479000000000001e-05 2024-09-12T16:15:59.151 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.151 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.151 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:15:59.151 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.437205+0000", 2024-09-12T16:15:59.151 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1146999999999998e-05 2024-09-12T16:15:59.151 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.151 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:15:59.151 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.151 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.151 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.151 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:15:59.152 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:42.428593+0000", 2024-09-12T16:15:59.152 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 16.662356509999999, 2024-09-12T16:15:59.152 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.008754342, 2024-09-12T16:15:59.152 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:15:59.152 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:15:59.152 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:59.152 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:15:59.152 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:15:59.152 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:15:59.152 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 51 2024-09-12T16:15:59.152 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.152 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:15:59.153 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.153 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:15:59.153 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428593+0000", 2024-09-12T16:15:59.153 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.153 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.153 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.153 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:15:59.153 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428593+0000", 2024-09-12T16:15:59.153 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.153 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.153 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.153 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:15:59.153 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428594+0000", 2024-09-12T16:15:59.154 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9599999999999998e-07 2024-09-12T16:15:59.154 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.154 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.154 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:15:59.154 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428599+0000", 2024-09-12T16:15:59.154 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1619999999999999e-06 2024-09-12T16:15:59.154 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.154 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.154 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:15:59.154 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428608+0000", 2024-09-12T16:15:59.154 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2790000000000004e-06 2024-09-12T16:15:59.154 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.155 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.155 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:15:59.155 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428614+0000", 2024-09-12T16:15:59.155 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1099999999999999e-06 2024-09-12T16:15:59.155 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.155 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.155 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:15:59.155 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.435992+0000", 2024-09-12T16:15:59.155 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.007377822 2024-09-12T16:15:59.155 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.155 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.155 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:15:59.155 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.436046+0000", 2024-09-12T16:15:59.156 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4282e-05 2024-09-12T16:15:59.156 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.156 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.156 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:15:59.156 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.436148+0000", 2024-09-12T16:15:59.156 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010180599999999999 2024-09-12T16:15:59.156 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.156 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.156 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:15:59.156 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.437260+0000", 2024-09-12T16:15:59.156 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011116489999999999 2024-09-12T16:15:59.156 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.156 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.157 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:15:59.157 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.437280+0000", 2024-09-12T16:15:59.157 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0098e-05 2024-09-12T16:15:59.157 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.157 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.157 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:15:59.157 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.437310+0000", 2024-09-12T16:15:59.157 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.968e-05 2024-09-12T16:15:59.157 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.157 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.157 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:15:59.157 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.437347+0000", 2024-09-12T16:15:59.157 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7657999999999998e-05 2024-09-12T16:15:59.158 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.158 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:15:59.158 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.158 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.158 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.158 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:15:59.158 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:42.428626+0000", 2024-09-12T16:15:59.158 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 16.662323936, 2024-09-12T16:15:59.158 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0089345699999999993, 2024-09-12T16:15:59.158 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:15:59.158 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:15:59.158 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:59.158 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:15:59.158 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:15:59.159 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:15:59.159 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 52 2024-09-12T16:15:59.159 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.159 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:15:59.159 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.159 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:15:59.159 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428626+0000", 2024-09-12T16:15:59.159 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.159 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.159 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.159 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:15:59.159 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428626+0000", 2024-09-12T16:15:59.159 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.159 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.160 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.160 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:15:59.160 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428626+0000", 2024-09-12T16:15:59.160 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3200000000000005e-07 2024-09-12T16:15:59.160 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.160 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.160 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:15:59.160 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428631+0000", 2024-09-12T16:15:59.160 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5990000000000004e-06 2024-09-12T16:15:59.160 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.160 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.160 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:15:59.161 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428638+0000", 2024-09-12T16:15:59.161 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7139999999999993e-06 2024-09-12T16:15:59.161 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.161 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.161 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:15:59.161 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.428644+0000", 2024-09-12T16:15:59.161 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8599999999999998e-06 2024-09-12T16:15:59.161 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.161 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.161 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:15:59.161 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.436555+0000", 2024-09-12T16:15:59.161 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0079101989999999997 2024-09-12T16:15:59.161 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.162 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.162 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:15:59.162 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.436647+0000", 2024-09-12T16:15:59.162 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.221e-05 2024-09-12T16:15:59.162 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.162 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.162 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:15:59.162 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.436807+0000", 2024-09-12T16:15:59.162 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016051499999999999 2024-09-12T16:15:59.162 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.162 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.162 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:15:59.163 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.437358+0000", 2024-09-12T16:15:59.163 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000550948 2024-09-12T16:15:59.163 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.163 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.163 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:15:59.163 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.437456+0000", 2024-09-12T16:15:59.163 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7597999999999996e-05 2024-09-12T16:15:59.163 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.163 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.163 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:15:59.163 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.437514+0000", 2024-09-12T16:15:59.163 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8149999999999997e-05 2024-09-12T16:15:59.163 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.164 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.164 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:15:59.164 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.437560+0000", 2024-09-12T16:15:59.164 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6144999999999999e-05 2024-09-12T16:15:59.164 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.164 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:15:59.164 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.164 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.164 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.164 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:15:59.164 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:42.609713+0000", 2024-09-12T16:15:59.164 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 16.481236832, 2024-09-12T16:15:59.164 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047688339999999996, 2024-09-12T16:15:59.165 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:15:59.165 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:15:59.165 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:59.165 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:15:59.165 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:15:59.165 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:15:59.165 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 69 2024-09-12T16:15:59.165 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.165 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:15:59.165 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.165 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:15:59.165 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.609713+0000", 2024-09-12T16:15:59.165 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.165 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.165 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.166 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:15:59.166 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.609713+0000", 2024-09-12T16:15:59.166 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.166 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.166 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.166 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:15:59.166 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.609713+0000", 2024-09-12T16:15:59.166 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.68e-07 2024-09-12T16:15:59.166 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.166 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.166 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:15:59.166 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.609784+0000", 2024-09-12T16:15:59.166 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0889999999999994e-05 2024-09-12T16:15:59.167 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.167 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.167 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:15:59.167 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.609794+0000", 2024-09-12T16:15:59.167 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8109999999999997e-06 2024-09-12T16:15:59.167 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.167 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.167 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:15:59.167 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.609800+0000", 2024-09-12T16:15:59.167 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2029999999999997e-06 2024-09-12T16:15:59.167 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.167 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.167 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:15:59.167 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.612133+0000", 2024-09-12T16:15:59.167 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0023330920000000002 2024-09-12T16:15:59.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.168 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.168 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:15:59.168 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.612182+0000", 2024-09-12T16:15:59.168 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9079000000000002e-05 2024-09-12T16:15:59.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.168 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.168 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:15:59.168 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.612328+0000", 2024-09-12T16:15:59.168 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014520900000000001 2024-09-12T16:15:59.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.168 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.168 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:15:59.168 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.614341+0000", 2024-09-12T16:15:59.168 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0020132959999999999 2024-09-12T16:15:59.169 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.169 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.169 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:15:59.169 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.614383+0000", 2024-09-12T16:15:59.169 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1981999999999999e-05 2024-09-12T16:15:59.169 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.169 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.169 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:15:59.169 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.614439+0000", 2024-09-12T16:15:59.169 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6069000000000001e-05 2024-09-12T16:15:59.169 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.169 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.169 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:15:59.170 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.614481+0000", 2024-09-12T16:15:59.170 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2534999999999998e-05 2024-09-12T16:15:59.170 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.170 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:15:59.170 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.170 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.170 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.170 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:15:59.170 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:42.609821+0000", 2024-09-12T16:15:59.170 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 16.481128903999998, 2024-09-12T16:15:59.170 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0054964599999999999, 2024-09-12T16:15:59.170 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:15:59.170 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:15:59.170 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:59.170 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:15:59.171 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:15:59.171 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:15:59.171 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 70 2024-09-12T16:15:59.171 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.171 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:15:59.171 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.171 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:15:59.171 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.609821+0000", 2024-09-12T16:15:59.171 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.171 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.171 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.171 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:15:59.171 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.609821+0000", 2024-09-12T16:15:59.171 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.171 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.172 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.172 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:15:59.172 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.609821+0000", 2024-09-12T16:15:59.172 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2200000000000003e-07 2024-09-12T16:15:59.172 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.172 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.172 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:15:59.172 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.609826+0000", 2024-09-12T16:15:59.172 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0499999999999999e-06 2024-09-12T16:15:59.172 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.172 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.172 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:15:59.172 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.609834+0000", 2024-09-12T16:15:59.173 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5549999999999997e-06 2024-09-12T16:15:59.173 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.173 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.173 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:15:59.173 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.609840+0000", 2024-09-12T16:15:59.173 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5960000000000003e-06 2024-09-12T16:15:59.173 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.173 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.173 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:15:59.173 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.613316+0000", 2024-09-12T16:15:59.173 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0034769089999999998 2024-09-12T16:15:59.173 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.173 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.173 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:15:59.174 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.613407+0000", 2024-09-12T16:15:59.174 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0934999999999996e-05 2024-09-12T16:15:59.174 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.174 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.174 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:15:59.174 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.613545+0000", 2024-09-12T16:15:59.174 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013755199999999999 2024-09-12T16:15:59.174 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.174 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.174 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:15:59.174 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.615178+0000", 2024-09-12T16:15:59.174 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001633502 2024-09-12T16:15:59.175 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.175 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.175 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:15:59.175 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.615219+0000", 2024-09-12T16:15:59.175 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0309999999999999e-05 2024-09-12T16:15:59.175 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.175 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.175 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:15:59.175 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.615275+0000", 2024-09-12T16:15:59.175 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6373999999999999e-05 2024-09-12T16:15:59.175 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.175 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.175 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:15:59.176 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.615317+0000", 2024-09-12T16:15:59.176 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1854999999999998e-05 2024-09-12T16:15:59.176 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.176 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:15:59.176 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.176 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.176 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.176 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:15:59.176 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:42.609851+0000", 2024-09-12T16:15:59.176 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 16.481098793000001, 2024-09-12T16:15:59.176 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.005608689, 2024-09-12T16:15:59.177 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:15:59.177 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:15:59.177 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:59.177 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:15:59.177 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:15:59.177 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:15:59.177 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 71 2024-09-12T16:15:59.177 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.177 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:15:59.177 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.177 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:15:59.177 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.609851+0000", 2024-09-12T16:15:59.177 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.177 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.178 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.178 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:15:59.178 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.609851+0000", 2024-09-12T16:15:59.178 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.178 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.178 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.178 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:15:59.178 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.609851+0000", 2024-09-12T16:15:59.178 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0800000000000004e-07 2024-09-12T16:15:59.178 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.178 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.178 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:15:59.178 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.609855+0000", 2024-09-12T16:15:59.179 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1030000000000004e-06 2024-09-12T16:15:59.179 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.179 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.179 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:15:59.179 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.609863+0000", 2024-09-12T16:15:59.179 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6170000000000001e-06 2024-09-12T16:15:59.179 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.179 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.179 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:15:59.179 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.609869+0000", 2024-09-12T16:15:59.180 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5620000000000003e-06 2024-09-12T16:15:59.180 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.180 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.180 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:15:59.180 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.613933+0000", 2024-09-12T16:15:59.180 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040648979999999999 2024-09-12T16:15:59.180 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.180 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.180 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:15:59.180 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.613982+0000", 2024-09-12T16:15:59.180 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8628000000000003e-05 2024-09-12T16:15:59.180 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.181 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.181 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:15:59.181 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.614060+0000", 2024-09-12T16:15:59.181 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7985999999999995e-05 2024-09-12T16:15:59.181 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.181 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.181 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:15:59.181 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.615375+0000", 2024-09-12T16:15:59.181 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00131449 2024-09-12T16:15:59.181 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.181 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.181 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:15:59.182 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.615383+0000", 2024-09-12T16:15:59.182 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2099999999999993e-06 2024-09-12T16:15:59.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.182 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.182 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:15:59.182 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.615409+0000", 2024-09-12T16:15:59.182 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6636999999999999e-05 2024-09-12T16:15:59.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.182 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.182 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:15:59.182 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.615459+0000", 2024-09-12T16:15:59.182 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9950000000000001e-05 2024-09-12T16:15:59.182 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.183 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:15:59.183 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.183 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.183 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.183 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:15:59.183 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:42.609879+0000", 2024-09-12T16:15:59.183 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 16.481070837000001, 2024-09-12T16:15:59.183 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0068137170000000004, 2024-09-12T16:15:59.183 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:15:59.183 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:15:59.183 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:59.183 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:15:59.183 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:15:59.183 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:15:59.184 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 72 2024-09-12T16:15:59.184 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.184 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:15:59.184 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.184 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:15:59.184 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.609879+0000", 2024-09-12T16:15:59.184 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.184 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.184 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.184 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:15:59.184 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.609879+0000", 2024-09-12T16:15:59.184 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.184 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.185 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.185 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:15:59.185 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.609879+0000", 2024-09-12T16:15:59.185 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5400000000000002e-07 2024-09-12T16:15:59.185 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.185 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.185 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:15:59.185 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.609972+0000", 2024-09-12T16:15:59.185 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3158000000000005e-05 2024-09-12T16:15:59.185 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.185 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.185 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:15:59.185 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.609982+0000", 2024-09-12T16:15:59.185 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7089999999999997e-06 2024-09-12T16:15:59.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.186 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.186 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:15:59.186 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.609991+0000", 2024-09-12T16:15:59.186 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7020000000000007e-06 2024-09-12T16:15:59.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.186 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.186 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:15:59.186 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.614524+0000", 2024-09-12T16:15:59.186 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0045337859999999997 2024-09-12T16:15:59.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.186 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.186 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:15:59.187 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.614576+0000", 2024-09-12T16:15:59.187 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1233000000000002e-05 2024-09-12T16:15:59.187 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.187 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.187 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:15:59.187 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.614663+0000", 2024-09-12T16:15:59.187 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7476000000000001e-05 2024-09-12T16:15:59.187 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.187 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.187 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:15:59.187 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.616569+0000", 2024-09-12T16:15:59.187 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001905723 2024-09-12T16:15:59.187 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.187 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.188 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:15:59.188 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.616624+0000", 2024-09-12T16:15:59.188 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5444e-05 2024-09-12T16:15:59.188 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.188 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.188 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:15:59.188 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.616652+0000", 2024-09-12T16:15:59.188 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7355000000000002e-05 2024-09-12T16:15:59.188 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.188 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.188 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:15:59.188 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.616692+0000", 2024-09-12T16:15:59.189 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0676999999999997e-05 2024-09-12T16:15:59.189 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.189 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:15:59.189 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.189 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.189 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.189 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:15:59.189 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:42.610004+0000", 2024-09-12T16:15:59.189 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 16.480945226999999, 2024-09-12T16:15:59.189 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0067564649999999997, 2024-09-12T16:15:59.189 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:15:59.189 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:15:59.189 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:59.190 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:15:59.190 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:15:59.190 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:15:59.190 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 73 2024-09-12T16:15:59.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.190 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:15:59.190 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.190 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:15:59.190 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.610004+0000", 2024-09-12T16:15:59.190 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.190 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.190 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:15:59.191 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.610004+0000", 2024-09-12T16:15:59.191 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.191 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.191 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.191 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:15:59.191 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.610005+0000", 2024-09-12T16:15:59.191 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9299999999999997e-07 2024-09-12T16:15:59.191 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.191 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.191 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:15:59.191 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.610010+0000", 2024-09-12T16:15:59.191 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9740000000000001e-06 2024-09-12T16:15:59.191 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.192 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.192 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:15:59.192 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.610016+0000", 2024-09-12T16:15:59.192 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.584e-06 2024-09-12T16:15:59.192 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.192 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.192 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:15:59.192 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.610022+0000", 2024-09-12T16:15:59.192 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4659999999999998e-06 2024-09-12T16:15:59.192 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.192 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.192 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:15:59.192 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.615502+0000", 2024-09-12T16:15:59.193 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0054795709999999999 2024-09-12T16:15:59.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.193 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.193 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:15:59.193 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.615587+0000", 2024-09-12T16:15:59.193 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5439999999999995e-05 2024-09-12T16:15:59.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.193 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.193 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:15:59.193 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.615723+0000", 2024-09-12T16:15:59.193 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013559999999999999 2024-09-12T16:15:59.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.194 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.194 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:15:59.194 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.616617+0000", 2024-09-12T16:15:59.194 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00089434099999999999 2024-09-12T16:15:59.194 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.194 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.194 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:15:59.194 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.616701+0000", 2024-09-12T16:15:59.194 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4339999999999995e-05 2024-09-12T16:15:59.194 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.194 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.194 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:15:59.194 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.616737+0000", 2024-09-12T16:15:59.194 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5623000000000001e-05 2024-09-12T16:15:59.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:15:59.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.616761+0000", 2024-09-12T16:15:59.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3833e-05 2024-09-12T16:15:59.195 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.195 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:15:59.195 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.195 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:15:59.195 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:42.610032+0000", 2024-09-12T16:15:59.195 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 16.480917066, 2024-09-12T16:15:59.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0082664290000000005, 2024-09-12T16:15:59.196 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:15:59.196 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:15:59.196 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:59.196 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:15:59.196 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:15:59.196 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:15:59.196 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 74 2024-09-12T16:15:59.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.196 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:15:59.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.196 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:15:59.196 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.610032+0000", 2024-09-12T16:15:59.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.197 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.197 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:15:59.197 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.610032+0000", 2024-09-12T16:15:59.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.197 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.197 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:15:59.197 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.610033+0000", 2024-09-12T16:15:59.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2200000000000003e-07 2024-09-12T16:15:59.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.197 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.197 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:15:59.197 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.610039+0000", 2024-09-12T16:15:59.198 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6149999999999996e-06 2024-09-12T16:15:59.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.198 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.198 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:15:59.198 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.610050+0000", 2024-09-12T16:15:59.198 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.116e-05 2024-09-12T16:15:59.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.198 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.198 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:15:59.198 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.610055+0000", 2024-09-12T16:15:59.198 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3940000000000004e-06 2024-09-12T16:15:59.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.198 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:15:59.199 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.616109+0000", 2024-09-12T16:15:59.199 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0060534660000000004 2024-09-12T16:15:59.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:15:59.199 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.616157+0000", 2024-09-12T16:15:59.199 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7861999999999997e-05 2024-09-12T16:15:59.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:15:59.199 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.616240+0000", 2024-09-12T16:15:59.199 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3844999999999994e-05 2024-09-12T16:15:59.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:15:59.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.618218+0000", 2024-09-12T16:15:59.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0019779509999999999 2024-09-12T16:15:59.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:15:59.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.618229+0000", 2024-09-12T16:15:59.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.027e-05 2024-09-12T16:15:59.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:15:59.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.618274+0000", 2024-09-12T16:15:59.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4931000000000001e-05 2024-09-12T16:15:59.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.201 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.201 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:15:59.201 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.618299+0000", 2024-09-12T16:15:59.201 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5213000000000001e-05 2024-09-12T16:15:59.201 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.201 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:15:59.201 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.201 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.201 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:15:59.201 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:42.610065+0000", 2024-09-12T16:15:59.202 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 16.480884765999999, 2024-09-12T16:15:59.202 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0083828170000000007, 2024-09-12T16:15:59.202 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:15:59.202 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:15:59.202 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:59.202 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:15:59.202 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:15:59.202 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:15:59.202 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 75 2024-09-12T16:15:59.202 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.202 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:15:59.202 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.202 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:15:59.202 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.610065+0000", 2024-09-12T16:15:59.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:15:59.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.610065+0000", 2024-09-12T16:15:59.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:15:59.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.610065+0000", 2024-09-12T16:15:59.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2799999999999996e-07 2024-09-12T16:15:59.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.204 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:15:59.204 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.610170+0000", 2024-09-12T16:15:59.204 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000104456 2024-09-12T16:15:59.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.204 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.204 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:15:59.204 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.610181+0000", 2024-09-12T16:15:59.204 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1770000000000001e-05 2024-09-12T16:15:59.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.204 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.204 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:15:59.204 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.610188+0000", 2024-09-12T16:15:59.204 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3350000000000003e-06 2024-09-12T16:15:59.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.205 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:15:59.205 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.616801+0000", 2024-09-12T16:15:59.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00661328 2024-09-12T16:15:59.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.205 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:15:59.205 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.616884+0000", 2024-09-12T16:15:59.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2785000000000001e-05 2024-09-12T16:15:59.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.205 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:15:59.205 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.617015+0000", 2024-09-12T16:15:59.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013128700000000001 2024-09-12T16:15:59.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.206 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.206 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:15:59.206 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.618304+0000", 2024-09-12T16:15:59.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001288948 2024-09-12T16:15:59.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.206 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.206 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:15:59.206 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.618350+0000", 2024-09-12T16:15:59.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6298999999999998e-05 2024-09-12T16:15:59.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.206 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.206 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:15:59.206 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.618405+0000", 2024-09-12T16:15:59.207 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4293999999999999e-05 2024-09-12T16:15:59.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.207 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:15:59.207 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.618448+0000", 2024-09-12T16:15:59.207 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2834999999999999e-05 2024-09-12T16:15:59.207 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.207 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:15:59.207 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.207 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:15:59.207 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:42.610201+0000", 2024-09-12T16:15:59.207 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 16.480748642999998, 2024-09-12T16:15:59.207 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0084022049999999994, 2024-09-12T16:15:59.207 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:15:59.208 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:15:59.208 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:59.208 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:15:59.208 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:15:59.208 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:15:59.208 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 76 2024-09-12T16:15:59.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.208 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:15:59.208 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.208 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:15:59.208 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.610201+0000", 2024-09-12T16:15:59.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.208 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.208 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:15:59.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.610201+0000", 2024-09-12T16:15:59.209 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:15:59.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.610202+0000", 2024-09-12T16:15:59.209 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3900000000000004e-07 2024-09-12T16:15:59.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:15:59.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.610208+0000", 2024-09-12T16:15:59.209 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.533e-06 2024-09-12T16:15:59.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.210 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:15:59.210 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.610216+0000", 2024-09-12T16:15:59.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3189999999999997e-06 2024-09-12T16:15:59.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.210 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.210 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:15:59.210 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.610224+0000", 2024-09-12T16:15:59.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7620000000000001e-06 2024-09-12T16:15:59.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.210 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.210 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:15:59.210 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.617642+0000", 2024-09-12T16:15:59.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0074172320000000002 2024-09-12T16:15:59.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.211 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:15:59.211 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.617726+0000", 2024-09-12T16:15:59.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4079000000000006e-05 2024-09-12T16:15:59.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.211 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:15:59.211 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.617857+0000", 2024-09-12T16:15:59.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013157199999999999 2024-09-12T16:15:59.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.211 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:15:59.211 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.618468+0000", 2024-09-12T16:15:59.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00061043399999999998 2024-09-12T16:15:59.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:15:59.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.618547+0000", 2024-09-12T16:15:59.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9284999999999997e-05 2024-09-12T16:15:59.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:15:59.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.618576+0000", 2024-09-12T16:15:59.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9218999999999999e-05 2024-09-12T16:15:59.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:15:59.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.618603+0000", 2024-09-12T16:15:59.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6931e-05 2024-09-12T16:15:59.213 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.213 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:15:59.213 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.213 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:94 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-12T16:15:59.213 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:42.842462+0000", 2024-09-12T16:15:59.213 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 16.248487885999999, 2024-09-12T16:15:59.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0042129849999999998, 2024-09-12T16:15:59.213 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:15:59.213 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:15:59.213 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:15:59.214 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:15:59.214 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:15:59.214 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:15:59.214 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 94 2024-09-12T16:15:59.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.214 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:15:59.214 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.214 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:15:59.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.842462+0000", 2024-09-12T16:15:59.214 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.214 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.214 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:15:59.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.842462+0000", 2024-09-12T16:15:59.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:15:59.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.215 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:15:59.215 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.842462+0000", 2024-09-12T16:15:59.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.39e-07 2024-09-12T16:15:59.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.215 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:15:59.215 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.842464+0000", 2024-09-12T16:15:59.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3470000000000001e-06 2024-09-12T16:15:59.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.215 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:15:59.216 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.842467+0000", 2024-09-12T16:15:59.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1820000000000002e-06 2024-09-12T16:15:59.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.216 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:15:59.216 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.842470+0000", 2024-09-12T16:15:59.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4119999999999999e-06 2024-09-12T16:15:59.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.216 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:15:59.216 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.845663+0000", 2024-09-12T16:15:59.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003192753 2024-09-12T16:15:59.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:15:59.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.845704+0000", 2024-09-12T16:15:59.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1125999999999999e-05 2024-09-12T16:15:59.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:15:59.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.845772+0000", 2024-09-12T16:15:59.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7980999999999998e-05 2024-09-12T16:15:59.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:15:59.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.846268+0000", 2024-09-12T16:15:59.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00049632400000000003 2024-09-12T16:15:59.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:15:59.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.846610+0000", 2024-09-12T16:15:59.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034173299999999999 2024-09-12T16:15:59.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:15:59.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.846638+0000", 2024-09-12T16:15:59.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8266e-05 2024-09-12T16:15:59.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:15:59.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:15:59.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:15:59.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.846675+0000", 2024-09-12T16:15:59.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6522e-05 2024-09-12T16:15:59.219 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.219 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:15:59.219 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.219 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:15:59.219 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:15:59.219 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:15:59.221 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:15:59.221 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:15:59.219+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:15:59.322 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:15:59.321+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:15:59.369 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:15:59.370 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:15:59.370 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:15:59.370 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:15:59.378 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:15:59.422 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:15:59.421+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:15:59.428 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T16:15:59.485 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:15:59.485 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:15:59.485 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:15:59.485 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:15:59.485 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:15:59.494 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:15:59.535 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:15:59.534+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:15:59.558 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:15:59.558 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:15:59.575 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:15:59.575 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:15:59.591 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:15:59.591 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:15:59.608 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:15:59.608 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:15:59.624 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:15:59.623+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:15:59.624 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:15:59.625 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:15:59.641 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:15:59.641 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:15:59.641 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:15:59.641 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:15:59.649 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:15:59.725 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:15:59.724+0000 7f002d431640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32213) UID: 0 2024-09-12T16:15:59.757 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:15:59.757 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:15:59.766 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:15:59.826 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:15:59.825+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:15:59.913 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:15:59.913 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:15:59.921 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:15:59.927 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:15:59.926+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:00.028 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:00.027+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:00.028 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:00.028 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:00.037 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:16:00.129 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:00.128+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:00.146 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:00.147 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:00.155 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:16:00.239 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:00.238+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:00.301 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:00.302 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:00.311 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:16:00.352 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:00.351+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:00.431 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:00.430+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:00.458 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:00.458 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:00.467 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:16:00.532 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:00.532+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:00.614 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:00.615 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:00.623 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:16:00.634 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:00.632+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:00.730 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:00.731 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:00.735 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:00.734+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:00.739 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:16:00.836 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:00.835+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:00.848 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:00.848 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:00.859 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:16:00.873 INFO:teuthology.orchestra.run.smithi204.stdout:skipping zero size read 2024-09-12T16:16:00.873 INFO:teuthology.orchestra.run.smithi204.stdout:skipping zero size read 2024-09-12T16:16:00.873 INFO:teuthology.orchestra.run.smithi204.stdout:skipping zero size read 2024-09-12T16:16:00.882 INFO:teuthology.orchestra.run.smithi204.stdout:5 write 0xd16c00 thru 0xd2376c (0xcb6d bytes) 2024-09-12T16:16:00.908 INFO:teuthology.orchestra.run.smithi204.stdout:6 write 0xab45000 thru 0xab4f8d6 (0xa8d7 bytes) 2024-09-12T16:16:00.911 INFO:teuthology.orchestra.run.smithi204.stdout:7 write 0x8ee800 thru 0x8f1434 (0x2c35 bytes) 2024-09-12T16:16:00.911 INFO:teuthology.orchestra.run.smithi204.stdout:8 read 0x9e00000 thru 0x9e00aab (0xaac bytes) 2024-09-12T16:16:00.911 INFO:teuthology.orchestra.run.smithi204.stdout:10 read 0x3c0ae00 thru 0x3c13cf7 (0x8ef8 bytes) 2024-09-12T16:16:00.911 INFO:teuthology.orchestra.run.smithi204.stdout:11 read 0x986ee00 thru 0x9871e06 (0x3007 bytes) 2024-09-12T16:16:00.928 INFO:teuthology.orchestra.run.smithi204.stdout:12 write 0xcfee000 thru 0xcff303b (0x503c bytes) 2024-09-12T16:16:00.929 INFO:teuthology.orchestra.run.smithi204.stdout:truncating to largest ever: 0x92bfe00 2024-09-12T16:16:00.933 INFO:teuthology.orchestra.run.smithi204.stdout:13 trunc from 0xcff3200 to 0x92bfe00 2024-09-12T16:16:00.937 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:00.936+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:00.964 INFO:teuthology.orchestra.run.smithi204.stdout:15 write 0xc602000 thru 0xc60594a (0x394b bytes) 2024-09-12T16:16:00.965 INFO:teuthology.orchestra.run.smithi204.stdout:16 read 0x2792200 thru 0x279f13c (0xcf3d bytes) 2024-09-12T16:16:00.980 INFO:teuthology.orchestra.run.smithi204.stdout:17 trunc from 0xc605a00 to 0x283600 2024-09-12T16:16:01.008 INFO:teuthology.orchestra.run.smithi204.stdout:18 trunc from 0x283600 to 0x82e4a00 2024-09-12T16:16:01.018 INFO:teuthology.orchestra.run.smithi204.stdout:20 punch from 0x54edc00 to 0x54f4400, (0x6800 bytes) 2024-09-12T16:16:01.020 INFO:teuthology.orchestra.run.smithi204.stdout:21 write 0x355d800 thru 0x356a5ee (0xcdef bytes) 2024-09-12T16:16:01.020 INFO:teuthology.orchestra.run.smithi204.stdout:23 read 0x1918400 thru 0x191b3f2 (0x2ff3 bytes) 2024-09-12T16:16:01.020 INFO:teuthology.orchestra.run.smithi204.stdout:26 punch from 0x4818e00 to 0x481d000, (0x4200 bytes) 2024-09-12T16:16:01.021 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:01.021 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:01.024 INFO:teuthology.orchestra.run.smithi204.stdout:33 trunc from 0x82e4a00 to 0x4aafa00 2024-09-12T16:16:01.029 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T16:16:01.032 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:16:01.038 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:01.037+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:01.040 INFO:teuthology.orchestra.run.smithi204.stdout:34 punch from 0x1c6e800 to 0x1c79600, (0xae00 bytes) 2024-09-12T16:16:01.055 INFO:teuthology.orchestra.run.smithi204.stdout:35 write 0x796f200 thru 0x797780b (0x860c bytes) 2024-09-12T16:16:01.055 INFO:teuthology.orchestra.run.smithi204.stdout:36 read 0x6dece00 thru 0x6dfb806 (0xea07 bytes) 2024-09-12T16:16:01.074 INFO:teuthology.orchestra.run.smithi204.stdout:37 write 0xb815600 thru 0xb818d6b (0x376c bytes) 2024-09-12T16:16:01.076 INFO:teuthology.orchestra.run.smithi204.stdout:38 punch from 0x83b6600 to 0x83bc200, (0x5c00 bytes) 2024-09-12T16:16:01.076 INFO:teuthology.orchestra.run.smithi204.stdout:41 punch from 0x6259200 to 0x625a400, (0x1200 bytes) 2024-09-12T16:16:01.076 INFO:teuthology.orchestra.run.smithi204.stdout:42 read 0x29e7000 thru 0x29ecf0e (0x5f0f bytes) 2024-09-12T16:16:01.076 INFO:teuthology.orchestra.run.smithi204.stdout:43 read 0x2728400 thru 0x2730c89 (0x888a bytes) 2024-09-12T16:16:01.076 INFO:teuthology.orchestra.run.smithi204.stdout:44 punch from 0x20eae00 to 0x20f3000, (0x8200 bytes) 2024-09-12T16:16:01.076 INFO:teuthology.orchestra.run.smithi204.stdout:46 write 0x6c9da00 thru 0x6c9e1b1 (0x7b2 bytes) 2024-09-12T16:16:01.076 INFO:teuthology.orchestra.run.smithi204.stdout:47 write 0x4a33a00 thru 0x4a41579 (0xdb7a bytes) 2024-09-12T16:16:01.077 INFO:teuthology.orchestra.run.smithi204.stdout:49 read 0x20c00 thru 0x27c89 (0x708a bytes) 2024-09-12T16:16:01.077 INFO:teuthology.orchestra.run.smithi204.stdout:50 write 0x3100c00 thru 0x3106944 (0x5d45 bytes) 2024-09-12T16:16:01.077 INFO:teuthology.orchestra.run.smithi204.stdout:53 write 0x75c9200 thru 0x75c9728 (0x529 bytes) 2024-09-12T16:16:01.077 INFO:teuthology.orchestra.run.smithi204.stdout:54 punch from 0x72a800 to 0x730400, (0x5c00 bytes) 2024-09-12T16:16:01.078 INFO:teuthology.orchestra.run.smithi204.stdout:55 write 0x82e5000 thru 0x82ebba3 (0x6ba4 bytes) 2024-09-12T16:16:01.078 INFO:teuthology.orchestra.run.smithi204.stdout:56 read 0xa78f000 thru 0xa793e04 (0x4e05 bytes) 2024-09-12T16:16:01.078 INFO:teuthology.orchestra.run.smithi204.stdout:57 read 0x117c600 thru 0x1189e0d (0xd80e bytes) 2024-09-12T16:16:01.078 INFO:teuthology.orchestra.run.smithi204.stdout:58 punch from 0x6f78200 to 0x6f86800, (0xe600 bytes) 2024-09-12T16:16:01.079 INFO:teuthology.orchestra.run.smithi204.stdout:62 read 0x6960000 thru 0x696d835 (0xd836 bytes) 2024-09-12T16:16:01.081 INFO:teuthology.orchestra.run.smithi204.stdout:64 trunc from 0xb818e00 to 0x88a8000 2024-09-12T16:16:01.102 INFO:teuthology.orchestra.run.smithi204.stdout:65 write 0x5da5c00 thru 0x5daaf11 (0x5312 bytes) 2024-09-12T16:16:01.102 INFO:teuthology.orchestra.run.smithi204.stdout:66 punch from 0x60c7200 to 0x60d3000, (0xbe00 bytes) 2024-09-12T16:16:01.103 INFO:teuthology.orchestra.run.smithi204.stdout:67 write 0x44af200 thru 0x44b661c (0x741d bytes) 2024-09-12T16:16:01.106 INFO:teuthology.orchestra.run.smithi204.stdout:69 trunc from 0x88a8000 to 0x61db600 2024-09-12T16:16:01.138 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:01.137+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:01.140 INFO:teuthology.orchestra.run.smithi204.stdout:72 write 0xa864c00 thru 0xa86e15f (0x9560 bytes) 2024-09-12T16:16:01.141 INFO:teuthology.orchestra.run.smithi204.stdout:74 write 0x8fdb600 thru 0x8fe528f (0x9c90 bytes) 2024-09-12T16:16:01.141 INFO:teuthology.orchestra.run.smithi204.stdout:79 read 0xa2dc800 thru 0xa2e0325 (0x3b26 bytes) 2024-09-12T16:16:01.141 INFO:teuthology.orchestra.run.smithi204.stdout:80 punch from 0x2012400 to 0x2014600, (0x2200 bytes) 2024-09-12T16:16:01.142 INFO:teuthology.orchestra.run.smithi204.stdout:81 read 0x8751c00 thru 0x875abee (0x8fef bytes) 2024-09-12T16:16:01.142 INFO:teuthology.orchestra.run.smithi204.stdout:85 read 0x7a20a00 thru 0x7a262a1 (0x58a2 bytes) 2024-09-12T16:16:01.142 INFO:teuthology.orchestra.run.smithi204.stdout:87 read 0x805d400 thru 0x8061093 (0x3c94 bytes) 2024-09-12T16:16:01.142 INFO:teuthology.orchestra.run.smithi204.stdout:88 punch from 0x8197a00 to 0x819f600, (0x7c00 bytes) 2024-09-12T16:16:01.142 INFO:teuthology.orchestra.run.smithi204.stdout:89 punch from 0x6c90600 to 0x6c97c00, (0x7600 bytes) 2024-09-12T16:16:01.142 INFO:teuthology.orchestra.run.smithi204.stdout:90 read 0x41c400 thru 0x422a0c (0x660d bytes) 2024-09-12T16:16:01.161 INFO:teuthology.orchestra.run.smithi204.stdout:92 write 0xd694400 thru 0xd69470a (0x30b bytes) 2024-09-12T16:16:01.161 INFO:teuthology.orchestra.run.smithi204.stdout:95 punch from 0x72da400 to 0x72e4200, (0x9e00 bytes) 2024-09-12T16:16:01.161 INFO:teuthology.orchestra.run.smithi204.stdout:96 punch from 0x397b000 to 0x3985000, (0xa000 bytes) 2024-09-12T16:16:01.161 INFO:teuthology.orchestra.run.smithi204.stdout:97 punch from 0x9dbfc00 to 0x9dc1a00, (0x1e00 bytes) 2024-09-12T16:16:01.162 INFO:teuthology.orchestra.run.smithi204.stdout:99 write 0x64ecc00 thru 0x64f4809 (0x7c0a bytes) 2024-09-12T16:16:01.162 INFO:teuthology.orchestra.run.smithi204.stdout:103 read 0x3623e00 thru 0x3628f4a (0x514b bytes) 2024-09-12T16:16:01.162 INFO:teuthology.orchestra.run.smithi204.stdout:105 write 0x8424600 thru 0x842aac7 (0x64c8 bytes) 2024-09-12T16:16:01.174 INFO:teuthology.orchestra.run.smithi204.stdout:106 trunc from 0xd694800 to 0x21ac000 2024-09-12T16:16:01.201 INFO:teuthology.orchestra.run.smithi204.stdout:truncating to largest ever: 0xdb26800 2024-09-12T16:16:01.207 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:01.207 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:01.215 INFO:teuthology.orchestra.run.smithi204.stdout:107 trunc from 0x21ac000 to 0xdb26800 2024-09-12T16:16:01.217 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:16:01.224 INFO:teuthology.orchestra.run.smithi204.stdout:109 read 0x4844a00 thru 0x484b991 (0x6f92 bytes) 2024-09-12T16:16:01.235 INFO:teuthology.orchestra.run.smithi204.stdout:112 trunc from 0xdb26800 to 0x6d0b400 2024-09-12T16:16:01.239 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:16:01.238+0000 7f002d431640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32213) UID: 0 2024-09-12T16:16:01.244 INFO:teuthology.orchestra.run.smithi204.stdout:113 read 0x66b1400 thru 0x66bf957 (0xe558 bytes) 2024-09-12T16:16:01.246 INFO:teuthology.orchestra.run.smithi204.stdout:115 punch from 0x4741600 to 0x474ac00, (0x9600 bytes) 2024-09-12T16:16:01.246 INFO:teuthology.orchestra.run.smithi204.stdout:116 read 0x803e00 thru 0x80e870 (0xaa71 bytes) 2024-09-12T16:16:01.247 INFO:teuthology.orchestra.run.smithi204.stdout:117 punch from 0x6980200 to 0x6988e00, (0x8c00 bytes) 2024-09-12T16:16:01.247 INFO:teuthology.orchestra.run.smithi204.stdout:119 write 0x13d1e00 thru 0x13dc7ba (0xa9bb bytes) 2024-09-12T16:16:01.247 INFO:teuthology.orchestra.run.smithi204.stdout:122 write 0x20dbe00 thru 0x20e1213 (0x5414 bytes) 2024-09-12T16:16:01.247 INFO:teuthology.orchestra.run.smithi204.stdout:123 punch from 0x3aa0800 to 0x3ab0600, (0xfe00 bytes) 2024-09-12T16:16:01.248 INFO:teuthology.orchestra.run.smithi204.stdout:124 punch from 0x5b7fc00 to 0x5b8b000, (0xb400 bytes) 2024-09-12T16:16:01.255 INFO:teuthology.orchestra.run.smithi204.stdout:125 trunc from 0x6d0b400 to 0xf8d400 2024-09-12T16:16:01.291 INFO:teuthology.orchestra.run.smithi204.stdout:127 write 0x8d82c00 thru 0x8d8e390 (0xb791 bytes) 2024-09-12T16:16:01.293 INFO:teuthology.orchestra.run.smithi204.stdout:129 punch from 0x1682000 to 0x168ae00, (0x8e00 bytes) 2024-09-12T16:16:01.293 INFO:teuthology.orchestra.run.smithi204.stdout:133 read 0x6f2ae00 thru 0x6f360f9 (0xb2fa bytes) 2024-09-12T16:16:01.293 INFO:teuthology.orchestra.run.smithi204.stdout:135 read 0x4fe0000 thru 0x4fe4e0e (0x4e0f bytes) 2024-09-12T16:16:01.293 INFO:teuthology.orchestra.run.smithi204.stdout:136 write 0x2c66800 thru 0x2c6a179 (0x397a bytes) 2024-09-12T16:16:01.293 INFO:teuthology.orchestra.run.smithi204.stdout:138 read 0x65e9a00 thru 0x65f0be0 (0x71e1 bytes) 2024-09-12T16:16:01.293 INFO:teuthology.orchestra.run.smithi204.stdout:140 write 0x1896a00 thru 0x18a1153 (0xa754 bytes) 2024-09-12T16:16:01.293 INFO:teuthology.orchestra.run.smithi204.stdout:147 read 0x615fa00 thru 0x616096d (0xf6e bytes) 2024-09-12T16:16:01.297 INFO:teuthology.orchestra.run.smithi204.stdout:149 trunc from 0x8d8e400 to 0x6012200 2024-09-12T16:16:01.314 INFO:teuthology.orchestra.run.smithi204.stdout:150 write 0x3daa000 thru 0x3db5afc (0xbafd bytes) 2024-09-12T16:16:01.314 INFO:teuthology.orchestra.run.smithi204.stdout:152 read 0x2544a00 thru 0x2549f2f (0x5530 bytes) 2024-09-12T16:16:01.327 INFO:teuthology.orchestra.run.smithi204.stdout:154 write 0x74dfe00 thru 0x74ef6ce (0xf8cf bytes) 2024-09-12T16:16:01.328 INFO:teuthology.orchestra.run.smithi204.stdout:156 punch from 0x62bc400 to 0x62caa00, (0xe600 bytes) 2024-09-12T16:16:01.330 INFO:teuthology.orchestra.run.smithi204.stdout:157 trunc from 0x74ef800 to 0x87a9000 2024-09-12T16:16:01.339 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:01.338+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:01.341 INFO:teuthology.orchestra.run.smithi204.stdout:159 read 0x6883800 thru 0x688a7e8 (0x6fe9 bytes) 2024-09-12T16:16:01.341 INFO:teuthology.orchestra.run.smithi204.stdout:162 punch from 0x71fbc00 to 0x71fd800, (0x1c00 bytes) 2024-09-12T16:16:01.341 INFO:teuthology.orchestra.run.smithi204.stdout:163 read 0x3c13400 thru 0x3c17068 (0x3c69 bytes) 2024-09-12T16:16:01.342 INFO:teuthology.orchestra.run.smithi204.stdout:166 write 0xf11000 thru 0xf2097a (0xf97b bytes) 2024-09-12T16:16:01.361 INFO:teuthology.orchestra.run.smithi204.stdout:167 write 0xd519000 thru 0xd526246 (0xd247 bytes) 2024-09-12T16:16:01.361 INFO:teuthology.orchestra.run.smithi204.stdout:168 read 0x3e4800 thru 0x3e6d61 (0x2562 bytes) 2024-09-12T16:16:01.361 INFO:teuthology.orchestra.run.smithi204.stdout:169 write 0x6dda600 thru 0x6de8caa (0xe6ab bytes) 2024-09-12T16:16:01.362 INFO:teuthology.orchestra.run.smithi204.stdout:170 clone 1 order 19 su 8192 sc 13 2024-09-12T16:16:01.411 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:01.411 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:01.420 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:16:01.440 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:01.439+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:01.528 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:01.528 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:01.537 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:16:01.580 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:16:01.579+0000 7f002d431640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32213) UID: 0 2024-09-12T16:16:01.642 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:01.641+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:01.643 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:01.643 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:01.652 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:16:01.652 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T16:16:01.743 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:01.743+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:01.777 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:16:01.777 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:16:01.794 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:16:01.794 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:16:01.800 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:01.800 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:01.809 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:16:01.810 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:16:01.810 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:16:01.827 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:16:01.827 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:16:01.844 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:16:01.844 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:16:01.853 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:01.852+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:01.862 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:16:01.863 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:16:01.918 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:01.918 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:16:01.918 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:16:01.918 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:01.926 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:16:01.967 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:01.966+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:02.017 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-12T16:16:02.046 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:02.045+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:02.080 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:02.080 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:16:02.080 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:16:02.080 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:16:02.080 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:02.087 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:16:02.171 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:02.170+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:02.238 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:02.238 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:16:02.238 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:16:02.238 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:16:02.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.239 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:7 3.1a 3:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T16:16:02.239 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:58.011748+0000", 2024-09-12T16:16:02.239 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.224639496, 2024-09-12T16:16:02.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040699289999999999, 2024-09-12T16:16:02.239 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.239 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.239 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:02.239 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:02.239 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:16:02.239 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:02.239 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 7 2024-09-12T16:16:02.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.239 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.240 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.240 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.240 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:58.011748+0000", 2024-09-12T16:16:02.240 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.240 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.240 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.240 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.240 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:58.011748+0000", 2024-09-12T16:16:02.240 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.240 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.240 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.240 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.240 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:58.011750+0000", 2024-09-12T16:16:02.241 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9130000000000001e-06 2024-09-12T16:16:02.241 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.241 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.241 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.241 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:58.011763+0000", 2024-09-12T16:16:02.241 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2689e-05 2024-09-12T16:16:02.241 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.241 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.241 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.241 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:58.011783+0000", 2024-09-12T16:16:02.241 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9460999999999999e-05 2024-09-12T16:16:02.241 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.241 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.242 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.242 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:58.011793+0000", 2024-09-12T16:16:02.242 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0149999999999999e-05 2024-09-12T16:16:02.242 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.242 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.242 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.242 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:58.011863+0000", 2024-09-12T16:16:02.242 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0199999999999999e-05 2024-09-12T16:16:02.242 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.242 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.242 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op must wait for map", 2024-09-12T16:16:02.242 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:58.011868+0000", 2024-09-12T16:16:02.243 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9640000000000002e-06 2024-09-12T16:16:02.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.243 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.243 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:58.014052+0000", 2024-09-12T16:16:02.243 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0021844009999999999 2024-09-12T16:16:02.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.243 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.243 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:58.014150+0000", 2024-09-12T16:16:02.243 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7886000000000004e-05 2024-09-12T16:16:02.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.244 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T16:16:02.244 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:58.014269+0000", 2024-09-12T16:16:02.244 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118954 2024-09-12T16:16:02.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.244 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.244 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:02.244 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:58.015138+0000", 2024-09-12T16:16:02.244 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00086849200000000001 2024-09-12T16:16:02.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.244 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.244 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:02.244 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:58.015750+0000", 2024-09-12T16:16:02.245 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000612412 2024-09-12T16:16:02.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.245 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.245 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:02.245 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:58.015788+0000", 2024-09-12T16:16:02.245 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8036e-05 2024-09-12T16:16:02.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.245 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.245 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.245 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:58.015818+0000", 2024-09-12T16:16:02.245 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0371000000000001e-05 2024-09-12T16:16:02.245 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.245 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.246 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.246 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.246 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.246 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop_reply(client.4437.0:7 3.1a e22/21 ondisk, result = 0)", 2024-09-12T16:16:02.246 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:58.015660+0000", 2024-09-12T16:16:02.246 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.2207284410000003, 2024-09-12T16:16:02.246 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000166336, 2024-09-12T16:16:02.246 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.246 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.246 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:02.246 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.247 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.247 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:58.015660+0000", 2024-09-12T16:16:02.247 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.247 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.247 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:58.015660+0000", 2024-09-12T16:16:02.247 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.247 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.247 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:58.015661+0000", 2024-09-12T16:16:02.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7600000000000006e-07 2024-09-12T16:16:02.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.248 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.248 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.248 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:58.015666+0000", 2024-09-12T16:16:02.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1250000000000001e-06 2024-09-12T16:16:02.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.248 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.248 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.248 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:58.015678+0000", 2024-09-12T16:16:02.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2333e-05 2024-09-12T16:16:02.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.249 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.249 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:58.015685+0000", 2024-09-12T16:16:02.249 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2509999999999997e-06 2024-09-12T16:16:02.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.249 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.249 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:58.015739+0000", 2024-09-12T16:16:02.249 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3693000000000002e-05 2024-09-12T16:16:02.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.249 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.250 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:58.015747+0000", 2024-09-12T16:16:02.250 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6249999999999998e-06 2024-09-12T16:16:02.250 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.250 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.250 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.250 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:58.015826+0000", 2024-09-12T16:16:02.250 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9332999999999994e-05 2024-09-12T16:16:02.250 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.250 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.250 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.250 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.250 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.250 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:9 3.1a 3:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T16:16:02.251 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:59.015734+0000", 2024-09-12T16:16:02.251 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 3.2206539429999999, 2024-09-12T16:16:02.251 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0014536869999999999, 2024-09-12T16:16:02.251 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.251 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.251 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:02.251 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:02.251 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:16:02.251 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:02.251 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 9 2024-09-12T16:16:02.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.251 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.251 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.252 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.015734+0000", 2024-09-12T16:16:02.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.252 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.015734+0000", 2024-09-12T16:16:02.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.252 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.015735+0000", 2024-09-12T16:16:02.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2550000000000001e-06 2024-09-12T16:16:02.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.015742+0000", 2024-09-12T16:16:02.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5679999999999996e-06 2024-09-12T16:16:02.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.015754+0000", 2024-09-12T16:16:02.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1688999999999999e-05 2024-09-12T16:16:02.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.015761+0000", 2024-09-12T16:16:02.254 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6739999999999997e-06 2024-09-12T16:16:02.254 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.254 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.254 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.254 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.015814+0000", 2024-09-12T16:16:02.254 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2927999999999999e-05 2024-09-12T16:16:02.254 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.254 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.254 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.254 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.015886+0000", 2024-09-12T16:16:02.254 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2076000000000006e-05 2024-09-12T16:16:02.254 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.254 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.254 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T16:16:02.255 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.015969+0000", 2024-09-12T16:16:02.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3045000000000002e-05 2024-09-12T16:16:02.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.255 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:02.255 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.016545+0000", 2024-09-12T16:16:02.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00057578000000000002 2024-09-12T16:16:02.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.255 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:02.255 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.017134+0000", 2024-09-12T16:16:02.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00058846300000000001 2024-09-12T16:16:02.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.256 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:02.256 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.017163+0000", 2024-09-12T16:16:02.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9105e-05 2024-09-12T16:16:02.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.256 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.256 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.017188+0000", 2024-09-12T16:16:02.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5103999999999999e-05 2024-09-12T16:16:02.256 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.256 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.256 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.257 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4437.0:10 3.1c e24/21 3:3831950c:::rbd_directory:head v 24'1, mlcod=0'0)", 2024-09-12T16:16:02.257 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:59.021423+0000", 2024-09-12T16:16:02.257 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 3.2149653680000001, 2024-09-12T16:16:02.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001103078, 2024-09-12T16:16:02.257 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.257 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.257 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:02.257 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.257 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.021423+0000", 2024-09-12T16:16:02.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.258 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.021423+0000", 2024-09-12T16:16:02.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.258 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.021423+0000", 2024-09-12T16:16:02.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5199999999999998e-07 2024-09-12T16:16:02.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.259 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.259 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.021427+0000", 2024-09-12T16:16:02.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0280000000000002e-06 2024-09-12T16:16:02.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.259 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.259 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.021440+0000", 2024-09-12T16:16:02.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2554999999999999e-05 2024-09-12T16:16:02.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.260 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.260 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.021448+0000", 2024-09-12T16:16:02.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6440000000000006e-06 2024-09-12T16:16:02.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.260 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.260 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.021518+0000", 2024-09-12T16:16:02.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9383999999999998e-05 2024-09-12T16:16:02.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.260 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.260 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.021540+0000", 2024-09-12T16:16:02.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2076e-05 2024-09-12T16:16:02.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.261 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:02.261 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.022482+0000", 2024-09-12T16:16:02.261 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000941999 2024-09-12T16:16:02.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.261 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.261 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.022526+0000", 2024-09-12T16:16:02.261 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4039999999999998e-05 2024-09-12T16:16:02.261 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.261 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.262 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.262 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:23 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e24)", 2024-09-12T16:16:02.262 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:59.039294+0000", 2024-09-12T16:16:02.262 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 3.1970943460000001, 2024-09-12T16:16:02.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000215594, 2024-09-12T16:16:02.262 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.262 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.262 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:02.262 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:02.262 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:16:02.263 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:02.263 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 23 2024-09-12T16:16:02.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.263 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.263 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.263 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.263 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.039294+0000", 2024-09-12T16:16:02.263 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.263 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.263 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.263 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.039294+0000", 2024-09-12T16:16:02.264 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.264 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.264 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.039295+0000", 2024-09-12T16:16:02.264 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5460000000000001e-06 2024-09-12T16:16:02.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.264 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.264 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.039302+0000", 2024-09-12T16:16:02.264 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8979999999999999e-06 2024-09-12T16:16:02.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.039318+0000", 2024-09-12T16:16:02.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.543e-05 2024-09-12T16:16:02.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.039325+0000", 2024-09-12T16:16:02.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1679999999999998e-06 2024-09-12T16:16:02.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.039378+0000", 2024-09-12T16:16:02.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3751000000000001e-05 2024-09-12T16:16:02.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.039439+0000", 2024-09-12T16:16:02.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0999000000000003e-05 2024-09-12T16:16:02.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.039509+0000", 2024-09-12T16:16:02.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9801999999999993e-05 2024-09-12T16:16:02.266 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.266 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.266 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.267 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4418.0:10 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e24)", 2024-09-12T16:16:02.267 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:59.174340+0000", 2024-09-12T16:16:02.267 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 3.0620478150000001, 2024-09-12T16:16:02.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019511600000000001, 2024-09-12T16:16:02.267 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.267 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.267 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:02.267 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:02.267 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4418", 2024-09-12T16:16:02.268 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1538062916", 2024-09-12T16:16:02.268 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 10 2024-09-12T16:16:02.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.268 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.268 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.268 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.268 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.174340+0000", 2024-09-12T16:16:02.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.268 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.268 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.268 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.174340+0000", 2024-09-12T16:16:02.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.269 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.269 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.269 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.174341+0000", 2024-09-12T16:16:02.269 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.207e-06 2024-09-12T16:16:02.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.269 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.269 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.269 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.174351+0000", 2024-09-12T16:16:02.269 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9869999999999994e-06 2024-09-12T16:16:02.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.269 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.269 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.269 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.174359+0000", 2024-09-12T16:16:02.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0530000000000007e-06 2024-09-12T16:16:02.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.270 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.270 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.174365+0000", 2024-09-12T16:16:02.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7760000000000003e-06 2024-09-12T16:16:02.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.270 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.270 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.174416+0000", 2024-09-12T16:16:02.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0334999999999998e-05 2024-09-12T16:16:02.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.270 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.270 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.174468+0000", 2024-09-12T16:16:02.271 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2593000000000003e-05 2024-09-12T16:16:02.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.271 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.271 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.174535+0000", 2024-09-12T16:16:02.271 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7164999999999998e-05 2024-09-12T16:16:02.271 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.271 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.271 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.271 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4418.0:13 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e24)", 2024-09-12T16:16:02.271 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:59.202073+0000", 2024-09-12T16:16:02.271 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 3.0343145030000001, 2024-09-12T16:16:02.271 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017859899999999999, 2024-09-12T16:16:02.272 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.272 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.272 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:02.272 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:02.272 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4418", 2024-09-12T16:16:02.272 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1538062916", 2024-09-12T16:16:02.272 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 13 2024-09-12T16:16:02.272 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.272 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.272 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.272 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.272 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.202073+0000", 2024-09-12T16:16:02.272 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.272 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.273 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.273 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.202073+0000", 2024-09-12T16:16:02.273 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.273 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.273 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.202074+0000", 2024-09-12T16:16:02.273 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9500000000000001e-07 2024-09-12T16:16:02.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.273 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.273 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.202078+0000", 2024-09-12T16:16:02.274 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1899999999999997e-06 2024-09-12T16:16:02.274 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.274 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.274 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.274 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.202089+0000", 2024-09-12T16:16:02.274 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.083e-05 2024-09-12T16:16:02.274 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.274 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.274 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.274 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.202094+0000", 2024-09-12T16:16:02.274 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0950000000000003e-06 2024-09-12T16:16:02.274 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.274 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.275 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.275 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.202135+0000", 2024-09-12T16:16:02.275 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0890999999999999e-05 2024-09-12T16:16:02.275 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.275 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.275 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.275 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.202183+0000", 2024-09-12T16:16:02.275 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7836000000000001e-05 2024-09-12T16:16:02.275 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.275 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.275 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.275 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:59.202252+0000", 2024-09-12T16:16:02.275 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8961999999999995e-05 2024-09-12T16:16:02.275 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.276 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.276 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.276 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.276 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.276 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4418.0:849 3.a e25/21 3:53bb1081:::rbd_object_map.1155cf5be90e.0000000000000003:head v 25'1, mlcod=0'0)", 2024-09-12T16:16:02.276 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.020522+0000", 2024-09-12T16:16:02.276 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.215866323, 2024-09-12T16:16:02.276 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0010106220000000001, 2024-09-12T16:16:02.276 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.276 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.276 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:02.276 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.276 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.276 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.277 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.020522+0000", 2024-09-12T16:16:02.277 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.277 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.277 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.277 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.020522+0000", 2024-09-12T16:16:02.277 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.277 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.277 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.277 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.020522+0000", 2024-09-12T16:16:02.277 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2399999999999999e-07 2024-09-12T16:16:02.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.277 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.278 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.278 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.020526+0000", 2024-09-12T16:16:02.278 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0380000000000001e-06 2024-09-12T16:16:02.278 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.278 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.278 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.278 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.020547+0000", 2024-09-12T16:16:02.278 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0917999999999999e-05 2024-09-12T16:16:02.278 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.278 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.278 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.278 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.020555+0000", 2024-09-12T16:16:02.278 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3739999999999998e-06 2024-09-12T16:16:02.278 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.279 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.279 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.279 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.020631+0000", 2024-09-12T16:16:02.279 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6099000000000004e-05 2024-09-12T16:16:02.279 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.279 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.279 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.279 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.020656+0000", 2024-09-12T16:16:02.279 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4916999999999999e-05 2024-09-12T16:16:02.279 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.279 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.279 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:02.279 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.021499+0000", 2024-09-12T16:16:02.280 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00084316600000000001 2024-09-12T16:16:02.280 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.280 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.280 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.280 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.021532+0000", 2024-09-12T16:16:02.280 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2886000000000003e-05 2024-09-12T16:16:02.280 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.280 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.280 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.280 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.280 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.280 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4418.0:860 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:02.280 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.026864+0000", 2024-09-12T16:16:02.281 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.209524443, 2024-09-12T16:16:02.281 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000285655, 2024-09-12T16:16:02.281 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.281 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.281 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:02.281 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:02.281 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4418", 2024-09-12T16:16:02.281 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1538062916", 2024-09-12T16:16:02.281 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 860 2024-09-12T16:16:02.281 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.281 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.282 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.282 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.282 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.026864+0000", 2024-09-12T16:16:02.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.282 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.282 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.282 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.026864+0000", 2024-09-12T16:16:02.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.283 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.283 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.283 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.026865+0000", 2024-09-12T16:16:02.283 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3340000000000001e-06 2024-09-12T16:16:02.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.283 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.283 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.283 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.026870+0000", 2024-09-12T16:16:02.283 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4099999999999999e-06 2024-09-12T16:16:02.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.283 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.283 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.283 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.026882+0000", 2024-09-12T16:16:02.284 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1956999999999999e-05 2024-09-12T16:16:02.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.284 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.284 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.284 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.026888+0000", 2024-09-12T16:16:02.284 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.66e-06 2024-09-12T16:16:02.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.284 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.284 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.284 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.026946+0000", 2024-09-12T16:16:02.284 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8270999999999998e-05 2024-09-12T16:16:02.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.285 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.285 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.285 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.027036+0000", 2024-09-12T16:16:02.285 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0274999999999999e-05 2024-09-12T16:16:02.285 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.285 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.285 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.285 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.027149+0000", 2024-09-12T16:16:02.285 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000112748 2024-09-12T16:16:02.285 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.285 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.285 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.286 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.286 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.286 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:388 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:02.286 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.028681+0000", 2024-09-12T16:16:02.286 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.207706737, 2024-09-12T16:16:02.286 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026501600000000003, 2024-09-12T16:16:02.286 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.286 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.286 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:02.286 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:02.286 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:16:02.286 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:02.286 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 388 2024-09-12T16:16:02.286 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.287 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.287 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.287 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.287 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.028681+0000", 2024-09-12T16:16:02.287 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.287 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.287 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.287 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.287 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.028681+0000", 2024-09-12T16:16:02.287 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.287 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.288 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.288 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.288 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.028682+0000", 2024-09-12T16:16:02.288 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2099999999999995e-07 2024-09-12T16:16:02.288 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.288 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.288 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.288 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.028688+0000", 2024-09-12T16:16:02.288 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7790000000000001e-06 2024-09-12T16:16:02.288 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.288 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.288 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.288 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.028699+0000", 2024-09-12T16:16:02.289 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1418e-05 2024-09-12T16:16:02.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.289 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.289 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.289 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.028704+0000", 2024-09-12T16:16:02.289 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9790000000000001e-06 2024-09-12T16:16:02.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.289 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.289 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.289 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.028760+0000", 2024-09-12T16:16:02.289 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5411999999999997e-05 2024-09-12T16:16:02.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.289 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.290 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.290 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.028841+0000", 2024-09-12T16:16:02.290 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1437e-05 2024-09-12T16:16:02.290 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.290 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.290 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.290 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.028946+0000", 2024-09-12T16:16:02.290 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010507 2024-09-12T16:16:02.290 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.290 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.290 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.290 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.290 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.290 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4418.0:866 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:02.291 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.029923+0000", 2024-09-12T16:16:02.291 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.20646487599999999, 2024-09-12T16:16:02.291 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00024461699999999998, 2024-09-12T16:16:02.291 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.291 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.291 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:02.291 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:02.291 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4418", 2024-09-12T16:16:02.291 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1538062916", 2024-09-12T16:16:02.291 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 866 2024-09-12T16:16:02.291 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.291 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.291 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.292 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.292 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.029923+0000", 2024-09-12T16:16:02.292 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.292 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.292 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.292 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.292 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.029923+0000", 2024-09-12T16:16:02.292 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.292 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.292 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.292 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.292 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.029924+0000", 2024-09-12T16:16:02.292 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7300000000000005e-07 2024-09-12T16:16:02.293 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.293 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.293 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.293 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.029928+0000", 2024-09-12T16:16:02.293 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9829999999999998e-06 2024-09-12T16:16:02.293 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.293 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.293 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.293 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.029939+0000", 2024-09-12T16:16:02.293 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0958000000000001e-05 2024-09-12T16:16:02.293 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.294 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.294 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.294 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.029944+0000", 2024-09-12T16:16:02.294 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9250000000000003e-06 2024-09-12T16:16:02.294 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.294 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.294 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.294 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.029989+0000", 2024-09-12T16:16:02.294 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5586e-05 2024-09-12T16:16:02.294 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.294 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.294 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.295 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.030067+0000", 2024-09-12T16:16:02.295 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7403000000000004e-05 2024-09-12T16:16:02.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.295 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.295 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.295 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.030168+0000", 2024-09-12T16:16:02.295 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000100989 2024-09-12T16:16:02.295 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.295 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.295 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.295 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.295 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4418.0:873 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:02.296 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.033897+0000", 2024-09-12T16:16:02.296 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.20249071399999999, 2024-09-12T16:16:02.296 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025505299999999999, 2024-09-12T16:16:02.296 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.296 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.296 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:02.296 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:02.296 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4418", 2024-09-12T16:16:02.296 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1538062916", 2024-09-12T16:16:02.296 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 873 2024-09-12T16:16:02.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.296 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.296 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.296 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.297 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.033897+0000", 2024-09-12T16:16:02.297 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.297 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.297 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.297 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.297 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.033897+0000", 2024-09-12T16:16:02.297 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.297 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.297 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.297 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.297 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.033898+0000", 2024-09-12T16:16:02.297 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9999999999999995e-07 2024-09-12T16:16:02.297 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.298 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.298 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.298 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.033903+0000", 2024-09-12T16:16:02.298 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6789999999999996e-06 2024-09-12T16:16:02.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.298 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.298 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.298 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.033914+0000", 2024-09-12T16:16:02.298 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0793e-05 2024-09-12T16:16:02.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.298 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.298 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.298 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.033921+0000", 2024-09-12T16:16:02.298 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2490000000000004e-06 2024-09-12T16:16:02.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.299 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.299 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.299 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.033975+0000", 2024-09-12T16:16:02.299 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3989000000000001e-05 2024-09-12T16:16:02.299 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.299 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.299 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.299 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.034060+0000", 2024-09-12T16:16:02.299 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5216999999999994e-05 2024-09-12T16:16:02.299 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.299 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.299 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.300 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.034152+0000", 2024-09-12T16:16:02.300 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2126000000000005e-05 2024-09-12T16:16:02.300 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.300 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.300 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.300 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.300 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.300 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:395 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:02.300 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.037350+0000", 2024-09-12T16:16:02.300 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.19903838700000001, 2024-09-12T16:16:02.300 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00027380500000000001, 2024-09-12T16:16:02.300 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.300 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.301 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:02.301 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:02.301 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:16:02.301 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:02.301 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 395 2024-09-12T16:16:02.301 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.301 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.301 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.301 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.301 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.037350+0000", 2024-09-12T16:16:02.302 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.302 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.302 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.302 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.037350+0000", 2024-09-12T16:16:02.302 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.302 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.302 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.302 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.037350+0000", 2024-09-12T16:16:02.302 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4099999999999997e-07 2024-09-12T16:16:02.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.302 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.302 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.302 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.037355+0000", 2024-09-12T16:16:02.303 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9200000000000003e-06 2024-09-12T16:16:02.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.303 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.303 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.303 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.037367+0000", 2024-09-12T16:16:02.303 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1583000000000001e-05 2024-09-12T16:16:02.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.303 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.303 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.303 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.037372+0000", 2024-09-12T16:16:02.303 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2179999999999998e-06 2024-09-12T16:16:02.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.303 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.303 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.303 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.037429+0000", 2024-09-12T16:16:02.304 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6918e-05 2024-09-12T16:16:02.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.304 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.304 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.304 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.037511+0000", 2024-09-12T16:16:02.304 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1997999999999997e-05 2024-09-12T16:16:02.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.304 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.304 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.304 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.037623+0000", 2024-09-12T16:16:02.304 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000112327 2024-09-12T16:16:02.304 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.304 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.305 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.305 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.305 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:404 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:02.305 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.044151+0000", 2024-09-12T16:16:02.305 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.19223690399999999, 2024-09-12T16:16:02.305 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00029427499999999998, 2024-09-12T16:16:02.305 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.305 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.305 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:02.305 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:02.305 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:16:02.305 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:02.306 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 404 2024-09-12T16:16:02.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.306 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.306 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.306 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.306 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.044151+0000", 2024-09-12T16:16:02.306 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.306 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.306 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.306 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.044151+0000", 2024-09-12T16:16:02.306 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.306 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.307 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.307 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.044152+0000", 2024-09-12T16:16:02.307 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4200000000000004e-07 2024-09-12T16:16:02.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.307 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.307 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.307 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.044166+0000", 2024-09-12T16:16:02.307 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3936e-05 2024-09-12T16:16:02.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.307 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.308 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.044181+0000", 2024-09-12T16:16:02.308 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4551e-05 2024-09-12T16:16:02.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.308 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.044187+0000", 2024-09-12T16:16:02.308 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4320000000000004e-06 2024-09-12T16:16:02.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.308 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.044259+0000", 2024-09-12T16:16:02.308 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2114999999999996e-05 2024-09-12T16:16:02.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.044339+0000", 2024-09-12T16:16:02.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0037999999999995e-05 2024-09-12T16:16:02.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.044445+0000", 2024-09-12T16:16:02.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000106261 2024-09-12T16:16:02.309 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.309 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.309 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.310 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.310 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:411 3.1a 3:5cea7035:::rbd_info:head [read 0~19] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:02.310 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.048775+0000", 2024-09-12T16:16:02.310 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.187613427, 2024-09-12T16:16:02.310 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00032741500000000001, 2024-09-12T16:16:02.310 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.310 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.310 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:02.310 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:02.310 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:16:02.310 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:02.310 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 411 2024-09-12T16:16:02.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.311 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.311 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.311 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.311 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.048775+0000", 2024-09-12T16:16:02.311 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.311 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.311 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.311 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.311 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.048775+0000", 2024-09-12T16:16:02.311 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.311 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.311 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.311 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.311 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.048775+0000", 2024-09-12T16:16:02.312 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2799999999999995e-07 2024-09-12T16:16:02.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.312 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.312 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.312 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.048779+0000", 2024-09-12T16:16:02.312 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8720000000000004e-06 2024-09-12T16:16:02.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.312 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.312 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.312 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.048790+0000", 2024-09-12T16:16:02.312 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0988999999999999e-05 2024-09-12T16:16:02.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.312 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.312 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.312 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.048795+0000", 2024-09-12T16:16:02.313 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.101e-06 2024-09-12T16:16:02.313 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.313 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.313 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.313 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.048850+0000", 2024-09-12T16:16:02.313 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4839000000000001e-05 2024-09-12T16:16:02.313 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.313 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.313 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.313 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.048930+0000", 2024-09-12T16:16:02.313 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0251000000000001e-05 2024-09-12T16:16:02.313 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.313 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.313 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.313 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.049102+0000", 2024-09-12T16:16:02.314 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000171535 2024-09-12T16:16:02.314 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.314 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.314 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.314 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.314 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.314 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4437.0:412 3.1c e25/21 3:3831950c:::rbd_directory:head v 25'6, mlcod=24'4)", 2024-09-12T16:16:02.314 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.049753+0000", 2024-09-12T16:16:02.314 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.18663542499999999, 2024-09-12T16:16:02.314 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00064015700000000003, 2024-09-12T16:16:02.314 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.314 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.314 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:02.315 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.315 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.315 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.315 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.049753+0000", 2024-09-12T16:16:02.315 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.315 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.315 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.315 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.315 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.049753+0000", 2024-09-12T16:16:02.315 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.315 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.315 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.315 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.315 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.049753+0000", 2024-09-12T16:16:02.315 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6399999999999998e-07 2024-09-12T16:16:02.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.316 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.316 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.049759+0000", 2024-09-12T16:16:02.316 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.241e-06 2024-09-12T16:16:02.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.316 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.316 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.049768+0000", 2024-09-12T16:16:02.316 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9740000000000008e-06 2024-09-12T16:16:02.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.316 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.316 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.049775+0000", 2024-09-12T16:16:02.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5459999999999997e-06 2024-09-12T16:16:02.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.317 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.317 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.049819+0000", 2024-09-12T16:16:02.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4783000000000001e-05 2024-09-12T16:16:02.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.317 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.317 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.049840+0000", 2024-09-12T16:16:02.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0744999999999999e-05 2024-09-12T16:16:02.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.318 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:02.318 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.050358+0000", 2024-09-12T16:16:02.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00051782100000000001 2024-09-12T16:16:02.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.318 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.318 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.050393+0000", 2024-09-12T16:16:02.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4683e-05 2024-09-12T16:16:02.318 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.318 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.319 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.319 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.319 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:427 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:02.319 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.065790+0000", 2024-09-12T16:16:02.319 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.17059823299999999, 2024-09-12T16:16:02.319 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00031449499999999998, 2024-09-12T16:16:02.319 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.319 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.319 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:02.319 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:02.319 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:16:02.319 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:02.320 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 427 2024-09-12T16:16:02.320 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.320 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.320 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.320 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.320 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.065790+0000", 2024-09-12T16:16:02.320 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.320 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.320 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.320 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.320 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.065790+0000", 2024-09-12T16:16:02.320 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.320 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.321 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.321 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.321 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.065791+0000", 2024-09-12T16:16:02.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2610000000000001e-06 2024-09-12T16:16:02.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.321 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.321 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.321 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.065796+0000", 2024-09-12T16:16:02.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8210000000000001e-06 2024-09-12T16:16:02.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.321 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.321 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.321 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.065809+0000", 2024-09-12T16:16:02.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3249e-05 2024-09-12T16:16:02.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.322 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.065815+0000", 2024-09-12T16:16:02.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6960000000000002e-06 2024-09-12T16:16:02.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.322 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.065883+0000", 2024-09-12T16:16:02.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8379000000000004e-05 2024-09-12T16:16:02.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.323 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.065979+0000", 2024-09-12T16:16:02.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6341999999999993e-05 2024-09-12T16:16:02.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.323 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.323 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.066104+0000", 2024-09-12T16:16:02.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000124747 2024-09-12T16:16:02.323 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.323 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.323 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.323 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4437.0:431 3.a e25/21 3:535385f0:::rbd_children:head v 25'2, mlcod=0'0)", 2024-09-12T16:16:02.323 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.069453+0000", 2024-09-12T16:16:02.324 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.16693522099999999, 2024-09-12T16:16:02.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00073497999999999999, 2024-09-12T16:16:02.324 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.324 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.324 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:02.324 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.324 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.324 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.324 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.069453+0000", 2024-09-12T16:16:02.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.324 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.324 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.325 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.069453+0000", 2024-09-12T16:16:02.325 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.325 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.325 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.325 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.325 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.069454+0000", 2024-09-12T16:16:02.325 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0809999999999999e-06 2024-09-12T16:16:02.325 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.325 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.325 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.325 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.069461+0000", 2024-09-12T16:16:02.325 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0380000000000002e-06 2024-09-12T16:16:02.325 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.325 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.326 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.326 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.069474+0000", 2024-09-12T16:16:02.326 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3200999999999999e-05 2024-09-12T16:16:02.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.326 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.326 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.326 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.069481+0000", 2024-09-12T16:16:02.326 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.165e-06 2024-09-12T16:16:02.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.326 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.326 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.326 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.069525+0000", 2024-09-12T16:16:02.326 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3415999999999999e-05 2024-09-12T16:16:02.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.327 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.327 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.327 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.069546+0000", 2024-09-12T16:16:02.327 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1169e-05 2024-09-12T16:16:02.327 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.327 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.327 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:02.327 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.070143+0000", 2024-09-12T16:16:02.327 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00059714700000000002 2024-09-12T16:16:02.327 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.327 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.327 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.327 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.070188+0000", 2024-09-12T16:16:02.327 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4762999999999998e-05 2024-09-12T16:16:02.327 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.328 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.328 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.328 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.328 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.328 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:435 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:02.328 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.072817+0000", 2024-09-12T16:16:02.328 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.16357088, 2024-09-12T16:16:02.328 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000160056, 2024-09-12T16:16:02.328 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.328 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.328 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:02.328 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:02.328 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:16:02.328 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:02.329 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 435 2024-09-12T16:16:02.329 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.329 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.329 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.329 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.329 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.072817+0000", 2024-09-12T16:16:02.329 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.329 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.329 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.329 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.329 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.072817+0000", 2024-09-12T16:16:02.330 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.330 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.330 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.072818+0000", 2024-09-12T16:16:02.330 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0720000000000001e-06 2024-09-12T16:16:02.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.330 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.330 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.072822+0000", 2024-09-12T16:16:02.330 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0570000000000003e-06 2024-09-12T16:16:02.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.331 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.072833+0000", 2024-09-12T16:16:02.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0852e-05 2024-09-12T16:16:02.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.331 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.072838+0000", 2024-09-12T16:16:02.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3700000000000003e-06 2024-09-12T16:16:02.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.331 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.072876+0000", 2024-09-12T16:16:02.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7780000000000001e-05 2024-09-12T16:16:02.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.072921+0000", 2024-09-12T16:16:02.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4459000000000002e-05 2024-09-12T16:16:02.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.072977+0000", 2024-09-12T16:16:02.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6465999999999998e-05 2024-09-12T16:16:02.332 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.332 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.332 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.333 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:443 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:02.333 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.078416+0000", 2024-09-12T16:16:02.333 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.15797150200000001, 2024-09-12T16:16:02.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017101799999999999, 2024-09-12T16:16:02.333 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.333 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.333 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:02.333 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:02.333 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:16:02.333 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:02.333 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 443 2024-09-12T16:16:02.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.333 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.334 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.334 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.334 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.078416+0000", 2024-09-12T16:16:02.334 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.334 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.334 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.334 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.078416+0000", 2024-09-12T16:16:02.334 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.334 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.334 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.334 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.078417+0000", 2024-09-12T16:16:02.335 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6099999999999999e-07 2024-09-12T16:16:02.335 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.335 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.335 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.335 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.078422+0000", 2024-09-12T16:16:02.335 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6469999999999997e-06 2024-09-12T16:16:02.335 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.335 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.335 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.335 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.078434+0000", 2024-09-12T16:16:02.335 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1629e-05 2024-09-12T16:16:02.335 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.335 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.335 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.336 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.078439+0000", 2024-09-12T16:16:02.336 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2850000000000002e-06 2024-09-12T16:16:02.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.336 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.336 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.336 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.078482+0000", 2024-09-12T16:16:02.336 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2843999999999998e-05 2024-09-12T16:16:02.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.337 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.078530+0000", 2024-09-12T16:16:02.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7833000000000001e-05 2024-09-12T16:16:02.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.337 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.078587+0000", 2024-09-12T16:16:02.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7918999999999999e-05 2024-09-12T16:16:02.337 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.337 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.337 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.337 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.338 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.338 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:02.340 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:16:02.340 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:02.338+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:02.341 INFO:teuthology.orchestra.run.smithi204.stdout:174 read 0x6b8a000 thru 0x6b8fe8c (0x5e8d bytes) 2024-09-12T16:16:02.341 INFO:teuthology.orchestra.run.smithi204.stdout:176 read 0x1b98600 thru 0x1ba0b49 (0x854a bytes) 2024-09-12T16:16:02.341 INFO:teuthology.orchestra.run.smithi204.stdout:177 read 0x4df4000 thru 0x4e00602 (0xc603 bytes) 2024-09-12T16:16:02.341 INFO:teuthology.orchestra.run.smithi204.stdout:178 read 0x1e5e600 thru 0x1e67876 (0x9277 bytes) 2024-09-12T16:16:02.341 INFO:teuthology.orchestra.run.smithi204.stdout:179 punch from 0xd258200 to 0xd25d600, (0x5400 bytes) 2024-09-12T16:16:02.341 INFO:teuthology.orchestra.run.smithi204.stdout:181 read 0x8eede00 thru 0x8ef764d (0x984e bytes) 2024-09-12T16:16:02.341 INFO:teuthology.orchestra.run.smithi204.stdout:182 write 0x66ed800 thru 0x66f920a (0xba0b bytes) 2024-09-12T16:16:02.341 INFO:teuthology.orchestra.run.smithi204.stdout:183 punch from 0xc276400 to 0xc27e600, (0x8200 bytes) 2024-09-12T16:16:02.371 INFO:teuthology.orchestra.run.smithi204.stdout:184 punch from 0x8e3e800 to 0x8e42a00, (0x4200 bytes) 2024-09-12T16:16:02.376 INFO:teuthology.orchestra.run.smithi204.stdout:185 write 0x8244e00 thru 0x8252350 (0xd551 bytes) 2024-09-12T16:16:02.401 INFO:teuthology.orchestra.run.smithi204.stdout:186 write 0xdc92600 thru 0xdca24cd (0xfece bytes) 2024-09-12T16:16:02.420 INFO:teuthology.orchestra.run.smithi204.stdout:187 trunc from 0xdca2600 to 0x246800 2024-09-12T16:16:02.440 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:02.439+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:02.499 INFO:teuthology.orchestra.run.smithi204.stdout:189 trunc from 0x246800 to 0x1acc800 2024-09-12T16:16:02.504 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:02.504 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:16:02.504 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:16:02.504 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:02.509 INFO:teuthology.orchestra.run.smithi204.stdout:190 trunc from 0x1acc800 to 0x2553a00 2024-09-12T16:16:02.513 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:16:02.519 INFO:teuthology.orchestra.run.smithi204.stdout:195 read 0x4c1000 thru 0x4c218f (0x1190 bytes) 2024-09-12T16:16:02.520 INFO:teuthology.orchestra.run.smithi204.stdout:196 read 0xae4a00 thru 0xaf2345 (0xd946 bytes) 2024-09-12T16:16:02.521 INFO:teuthology.orchestra.run.smithi204.stdout:198 punch from 0x1ddc800 to 0x1deb200, (0xea00 bytes) 2024-09-12T16:16:02.541 INFO:teuthology.orchestra.run.smithi204.stdout:199 write 0x4abb200 thru 0x4ac8e58 (0xdc59 bytes) 2024-09-12T16:16:02.557 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:02.556+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:02.572 INFO:teuthology.orchestra.run.smithi204.stdout:200 write 0xe5e8400 thru 0xe5f1e45 (0x9a46 bytes) 2024-09-12T16:16:02.573 INFO:teuthology.orchestra.run.smithi204.stdout:201 punch from 0x94e9c00 to 0x94f3200, (0x9600 bytes) 2024-09-12T16:16:02.575 INFO:teuthology.orchestra.run.smithi204.stdout:202 write 0x643d400 thru 0x64414f5 (0x40f6 bytes) 2024-09-12T16:16:02.575 INFO:teuthology.orchestra.run.smithi204.stdout:203 write 0x2dc2000 thru 0x2dcd0ff (0xb100 bytes) 2024-09-12T16:16:02.575 INFO:teuthology.orchestra.run.smithi204.stdout:206 read 0x5e4c000 thru 0x5e51ffd (0x5ffe bytes) 2024-09-12T16:16:02.575 INFO:teuthology.orchestra.run.smithi204.stdout:207 read 0xb993000 thru 0xb996d53 (0x3d54 bytes) 2024-09-12T16:16:02.575 INFO:teuthology.orchestra.run.smithi204.stdout:210 punch from 0x8503a00 to 0x8511c00, (0xe200 bytes) 2024-09-12T16:16:02.576 INFO:teuthology.orchestra.run.smithi204.stdout:214 read 0x1ffea00 thru 0x200be24 (0xd425 bytes) 2024-09-12T16:16:02.602 INFO:teuthology.orchestra.run.smithi204.stdout:215 write 0xc7d9200 thru 0xc7dd570 (0x4371 bytes) 2024-09-12T16:16:02.602 INFO:teuthology.orchestra.run.smithi204.stdout:216 read 0x4e2f200 thru 0x4e2fed7 (0xcd8 bytes) 2024-09-12T16:16:02.602 INFO:teuthology.orchestra.run.smithi204.stdout:217 read 0x2dff600 thru 0x2e0b3e1 (0xbde2 bytes) 2024-09-12T16:16:02.603 INFO:teuthology.orchestra.run.smithi204.stdout:218 punch from 0x7caba00 to 0x7cb2200, (0x6800 bytes) 2024-09-12T16:16:02.603 INFO:teuthology.orchestra.run.smithi204.stdout:219 read 0x2786000 thru 0x27952c3 (0xf2c4 bytes) 2024-09-12T16:16:02.603 INFO:teuthology.orchestra.run.smithi204.stdout:223 punch from 0x3ee5600 to 0x3ee7400, (0x1e00 bytes) 2024-09-12T16:16:02.603 INFO:teuthology.orchestra.run.smithi204.stdout:225 write 0xdb09000 thru 0xdb10823 (0x7824 bytes) 2024-09-12T16:16:02.615 INFO:teuthology.orchestra.run.smithi204.stdout:226 trunc from 0xe5f2000 to 0x4cd6e00 2024-09-12T16:16:02.642 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:02.641+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:02.652 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:02.652 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:16:02.652 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:16:02.652 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:16:02.652 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:02.661 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:16:02.684 INFO:teuthology.orchestra.run.smithi204.stdout:227 write 0xdd57c00 thru 0xdd60d97 (0x9198 bytes) 2024-09-12T16:16:02.687 INFO:teuthology.orchestra.run.smithi204.stdout:229 trunc from 0xdd60e00 to 0xbbc1400 2024-09-12T16:16:02.708 INFO:teuthology.orchestra.run.smithi204.stdout:231 write 0x4871e00 thru 0x48809b8 (0xebb9 bytes) 2024-09-12T16:16:02.710 INFO:teuthology.orchestra.run.smithi204.stdout:232 read 0x33e6a00 thru 0x33f0175 (0x9776 bytes) 2024-09-12T16:16:02.710 INFO:teuthology.orchestra.run.smithi204.stdout:233 write 0x88a5000 thru 0x88b37e9 (0xe7ea bytes) 2024-09-12T16:16:02.710 INFO:teuthology.orchestra.run.smithi204.stdout:234 punch from 0x4c39000 to 0x4c3ce00, (0x3e00 bytes) 2024-09-12T16:16:02.711 INFO:teuthology.orchestra.run.smithi204.stdout:236 write 0xb7b2e00 thru 0xb7c0cb0 (0xdeb1 bytes) 2024-09-12T16:16:02.711 INFO:teuthology.orchestra.run.smithi204.stdout:238 read 0x55ada00 thru 0x55bd0bb (0xf6bc bytes) 2024-09-12T16:16:02.714 INFO:teuthology.orchestra.run.smithi204.stdout:241 trunc from 0xbbc1400 to 0x8800a00 2024-09-12T16:16:02.743 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:02.742+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:02.762 INFO:teuthology.orchestra.run.smithi204.stdout:243 read 0x3f8da00 thru 0x3f9ce70 (0xf471 bytes) 2024-09-12T16:16:02.762 INFO:teuthology.orchestra.run.smithi204.stdout:244 read 0x53cf600 thru 0x53d94fc (0x9efd bytes) 2024-09-12T16:16:02.763 INFO:teuthology.orchestra.run.smithi204.stdout:246 write 0x2508a00 thru 0x251387c (0xae7d bytes) 2024-09-12T16:16:02.763 INFO:teuthology.orchestra.run.smithi204.stdout:247 punch from 0x5adbc00 to 0x5adf400, (0x3800 bytes) 2024-09-12T16:16:02.790 INFO:teuthology.orchestra.run.smithi204.stdout:248 write 0x8ac0c00 thru 0x8acb66d (0xaa6e bytes) 2024-09-12T16:16:02.790 INFO:teuthology.orchestra.run.smithi204.stdout:truncating to largest ever: 0xde30400 2024-09-12T16:16:02.796 INFO:teuthology.orchestra.run.smithi204.stdout:249 trunc from 0x8acb800 to 0xde30400 2024-09-12T16:16:02.813 INFO:teuthology.orchestra.run.smithi204.stdout:250 read 0x15cb400 thru 0x15d2e87 (0x7a88 bytes) 2024-09-12T16:16:02.814 INFO:teuthology.orchestra.run.smithi204.stdout:251 punch from 0xb36ce00 to 0xb378e00, (0xc000 bytes) 2024-09-12T16:16:02.815 INFO:teuthology.orchestra.run.smithi204.stdout:253 read 0x5dec800 thru 0x5df3306 (0x6b07 bytes) 2024-09-12T16:16:02.815 INFO:teuthology.orchestra.run.smithi204.stdout:254 write 0x703c800 thru 0x7043804 (0x7005 bytes) 2024-09-12T16:16:02.815 INFO:teuthology.orchestra.run.smithi204.stdout:255 write 0xd50c200 thru 0xd516e58 (0xac59 bytes) 2024-09-12T16:16:02.815 INFO:teuthology.orchestra.run.smithi204.stdout:256 write 0x5459e00 thru 0x5460168 (0x6369 bytes) 2024-09-12T16:16:02.815 INFO:teuthology.orchestra.run.smithi204.stdout:257 punch from 0xa003a00 to 0xa00ea00, (0xb000 bytes) 2024-09-12T16:16:02.816 INFO:teuthology.orchestra.run.smithi204.stdout:258 write 0x5dad400 thru 0x5dbbacf (0xe6d0 bytes) 2024-09-12T16:16:02.816 INFO:teuthology.orchestra.run.smithi204.stdout:259 write 0xb53b400 thru 0xb54a87f (0xf480 bytes) 2024-09-12T16:16:02.816 INFO:teuthology.orchestra.run.smithi204.stdout:260 write 0x7df9e00 thru 0x7dfe597 (0x4798 bytes) 2024-09-12T16:16:02.816 INFO:teuthology.orchestra.run.smithi204.stdout:261 punch from 0x43bda00 to 0x43cd400, (0xfa00 bytes) 2024-09-12T16:16:02.817 INFO:teuthology.orchestra.run.smithi204.stdout:262 read 0xa924800 thru 0xa933893 (0xf094 bytes) 2024-09-12T16:16:02.817 INFO:teuthology.orchestra.run.smithi204.stdout:266 trunc from 0xde30400 to 0xd67f400 2024-09-12T16:16:02.844 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:02.843+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:02.850 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:02.850 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:16:02.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:16:02.850 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:16:02.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.850 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:1192 3.16 3:6ce079da:::rbd_object_map.11557ed36bb5:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:02.851 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.575707+0000", 2024-09-12T16:16:02.851 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.271751776, 2024-09-12T16:16:02.851 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022149974999999999, 2024-09-12T16:16:02.851 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.851 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.851 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:02.851 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:02.851 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:02.851 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:02.851 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1192 2024-09-12T16:16:02.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.851 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.852 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.852 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.852 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.575707+0000", 2024-09-12T16:16:02.852 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.852 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.852 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.852 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.575707+0000", 2024-09-12T16:16:02.852 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.852 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.852 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.852 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.575708+0000", 2024-09-12T16:16:02.853 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8800000000000003e-07 2024-09-12T16:16:02.853 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.853 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.853 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.853 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.575710+0000", 2024-09-12T16:16:02.853 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.649e-06 2024-09-12T16:16:02.853 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.853 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.853 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.853 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.575717+0000", 2024-09-12T16:16:02.853 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8070000000000002e-06 2024-09-12T16:16:02.853 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.853 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.854 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.854 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.575723+0000", 2024-09-12T16:16:02.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3900000000000001e-06 2024-09-12T16:16:02.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.854 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.854 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.854 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.593122+0000", 2024-09-12T16:16:02.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017399830000000002 2024-09-12T16:16:02.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.854 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.854 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.854 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.593209+0000", 2024-09-12T16:16:02.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6759000000000001e-05 2024-09-12T16:16:02.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T16:16:02.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.593648+0000", 2024-09-12T16:16:02.855 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000438419 2024-09-12T16:16:02.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:02.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.596124+0000", 2024-09-12T16:16:02.855 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0024762389999999999 2024-09-12T16:16:02.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:02.856 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.597751+0000", 2024-09-12T16:16:02.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0016270080000000001 2024-09-12T16:16:02.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.856 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:02.856 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.597806+0000", 2024-09-12T16:16:02.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5458999999999999e-05 2024-09-12T16:16:02.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.856 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.856 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.597857+0000", 2024-09-12T16:16:02.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0927000000000002e-05 2024-09-12T16:16:02.857 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.857 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.857 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.857 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.857 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:1193 3.16 3:6ce079da:::rbd_object_map.11557ed36bb5:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:02.857 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.575854+0000", 2024-09-12T16:16:02.857 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.271605349, 2024-09-12T16:16:02.857 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022166318000000001, 2024-09-12T16:16:02.857 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.857 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.857 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:02.857 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:02.858 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:02.858 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:02.858 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1193 2024-09-12T16:16:02.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.858 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.858 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.858 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.858 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.575854+0000", 2024-09-12T16:16:02.858 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.858 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.858 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.858 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.575854+0000", 2024-09-12T16:16:02.858 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.859 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.859 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.575855+0000", 2024-09-12T16:16:02.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9800000000000003e-07 2024-09-12T16:16:02.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.859 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.859 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.575859+0000", 2024-09-12T16:16:02.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4490000000000001e-06 2024-09-12T16:16:02.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.859 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.860 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.575869+0000", 2024-09-12T16:16:02.860 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0005e-05 2024-09-12T16:16:02.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.860 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.860 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.860 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.575875+0000", 2024-09-12T16:16:02.860 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1349999999999997e-06 2024-09-12T16:16:02.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.860 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.860 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.860 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.594445+0000", 2024-09-12T16:16:02.860 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018570072999999999 2024-09-12T16:16:02.861 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.861 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.861 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.861 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.594550+0000", 2024-09-12T16:16:02.861 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000104416 2024-09-12T16:16:02.861 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.861 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.861 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T16:16:02.861 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.594949+0000", 2024-09-12T16:16:02.861 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00039926000000000002 2024-09-12T16:16:02.861 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.861 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.861 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:02.862 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.597917+0000", 2024-09-12T16:16:02.862 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029685319999999999 2024-09-12T16:16:02.862 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.862 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.862 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:02.862 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.597970+0000", 2024-09-12T16:16:02.862 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2646999999999999e-05 2024-09-12T16:16:02.862 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.862 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.862 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:02.862 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.597997+0000", 2024-09-12T16:16:02.862 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7206e-05 2024-09-12T16:16:02.862 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.862 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.863 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.863 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.598020+0000", 2024-09-12T16:16:02.863 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2796999999999999e-05 2024-09-12T16:16:02.863 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.863 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.863 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.863 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.863 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.863 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:1194 3.16 3:6ce079da:::rbd_object_map.11557ed36bb5:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:02.863 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.575890+0000", 2024-09-12T16:16:02.863 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.27156925399999998, 2024-09-12T16:16:02.863 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022191084999999999, 2024-09-12T16:16:02.863 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.864 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.864 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:02.864 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:02.864 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:02.864 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:02.864 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1194 2024-09-12T16:16:02.864 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.864 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.864 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.864 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.864 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.575890+0000", 2024-09-12T16:16:02.864 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.864 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.864 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.865 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.865 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.575890+0000", 2024-09-12T16:16:02.865 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.865 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.865 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.865 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.575890+0000", 2024-09-12T16:16:02.865 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9699999999999996e-07 2024-09-12T16:16:02.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.865 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.865 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.865 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.575895+0000", 2024-09-12T16:16:02.866 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7469999999999996e-06 2024-09-12T16:16:02.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.866 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.866 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.866 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.575910+0000", 2024-09-12T16:16:02.866 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5208000000000001e-05 2024-09-12T16:16:02.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.866 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.866 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.866 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.575917+0000", 2024-09-12T16:16:02.866 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4849999999999997e-06 2024-09-12T16:16:02.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.866 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.867 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.867 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.595277+0000", 2024-09-12T16:16:02.867 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019360357000000002 2024-09-12T16:16:02.867 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.867 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.867 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.867 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.595360+0000", 2024-09-12T16:16:02.867 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3251999999999995e-05 2024-09-12T16:16:02.867 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.867 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.867 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T16:16:02.867 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.595729+0000", 2024-09-12T16:16:02.867 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000368902 2024-09-12T16:16:02.867 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.868 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.868 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:02.868 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.597962+0000", 2024-09-12T16:16:02.868 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002233091 2024-09-12T16:16:02.868 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.868 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.868 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:02.868 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.598030+0000", 2024-09-12T16:16:02.868 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8027000000000004e-05 2024-09-12T16:16:02.868 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.868 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.868 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:02.869 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.598058+0000", 2024-09-12T16:16:02.869 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8014999999999999e-05 2024-09-12T16:16:02.869 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.869 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.869 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.869 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.598081+0000", 2024-09-12T16:16:02.869 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2504e-05 2024-09-12T16:16:02.869 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.869 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.869 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.869 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.869 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.869 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:1195 3.16 3:6ce079da:::rbd_object_map.11557ed36bb5:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:02.870 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.575933+0000", 2024-09-12T16:16:02.870 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.271526504, 2024-09-12T16:16:02.870 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022244665, 2024-09-12T16:16:02.870 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.870 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.870 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:02.870 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:02.870 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:02.870 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:02.870 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1195 2024-09-12T16:16:02.870 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.870 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.871 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.871 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.871 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.575933+0000", 2024-09-12T16:16:02.871 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.871 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.871 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.871 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.871 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.575933+0000", 2024-09-12T16:16:02.871 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.871 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.871 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.871 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.871 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.575933+0000", 2024-09-12T16:16:02.872 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5700000000000002e-07 2024-09-12T16:16:02.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.872 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.872 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.872 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.575937+0000", 2024-09-12T16:16:02.872 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5489999999999998e-06 2024-09-12T16:16:02.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.872 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.872 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.872 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.575945+0000", 2024-09-12T16:16:02.872 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4419999999999998e-06 2024-09-12T16:16:02.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.873 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.873 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.873 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.575951+0000", 2024-09-12T16:16:02.873 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4940000000000003e-06 2024-09-12T16:16:02.873 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.873 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.873 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.873 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.596166+0000", 2024-09-12T16:16:02.873 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020214737 2024-09-12T16:16:02.873 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.873 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.873 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.873 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.596220+0000", 2024-09-12T16:16:02.874 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4487999999999997e-05 2024-09-12T16:16:02.874 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.874 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.874 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T16:16:02.874 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.596553+0000", 2024-09-12T16:16:02.874 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00033320000000000002 2024-09-12T16:16:02.874 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.874 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.874 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:02.874 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.598088+0000", 2024-09-12T16:16:02.874 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015347309999999999 2024-09-12T16:16:02.874 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.874 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.874 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:02.875 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.598128+0000", 2024-09-12T16:16:02.875 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9952e-05 2024-09-12T16:16:02.875 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.875 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.875 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:02.875 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.598156+0000", 2024-09-12T16:16:02.875 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7693000000000001e-05 2024-09-12T16:16:02.875 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.875 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.875 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.875 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.598177+0000", 2024-09-12T16:16:02.875 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1622000000000001e-05 2024-09-12T16:16:02.875 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.876 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.876 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.876 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.876 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.876 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:1196 3.16 3:6ce079da:::rbd_object_map.11557ed36bb5:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:02.876 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.575963+0000", 2024-09-12T16:16:02.876 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.27149564199999998, 2024-09-12T16:16:02.876 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.024156183000000001, 2024-09-12T16:16:02.876 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.876 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.876 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:02.876 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:02.876 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:02.877 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:02.877 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1196 2024-09-12T16:16:02.877 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.877 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.877 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.877 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.877 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.575963+0000", 2024-09-12T16:16:02.877 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.877 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.877 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.877 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.877 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.575963+0000", 2024-09-12T16:16:02.877 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.877 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.878 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.878 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.878 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.575964+0000", 2024-09-12T16:16:02.878 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9599999999999999e-07 2024-09-12T16:16:02.878 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.878 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.878 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.878 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.575967+0000", 2024-09-12T16:16:02.878 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3280000000000002e-06 2024-09-12T16:16:02.878 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.878 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.878 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.878 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.575977+0000", 2024-09-12T16:16:02.878 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.013e-05 2024-09-12T16:16:02.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.879 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.879 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.879 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.575983+0000", 2024-09-12T16:16:02.879 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4330000000000003e-06 2024-09-12T16:16:02.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.879 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.879 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.879 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.596971+0000", 2024-09-12T16:16:02.879 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020988198999999999 2024-09-12T16:16:02.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.879 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.880 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.880 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.597040+0000", 2024-09-12T16:16:02.880 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9197999999999997e-05 2024-09-12T16:16:02.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.880 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.880 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T16:16:02.880 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.597391+0000", 2024-09-12T16:16:02.880 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00035087699999999998 2024-09-12T16:16:02.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.880 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.880 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:02.880 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.598976+0000", 2024-09-12T16:16:02.880 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001584968 2024-09-12T16:16:02.881 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.881 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.881 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:02.881 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.600048+0000", 2024-09-12T16:16:02.881 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001071778 2024-09-12T16:16:02.881 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.881 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.881 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:02.881 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.600080+0000", 2024-09-12T16:16:02.881 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1909000000000002e-05 2024-09-12T16:16:02.881 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.881 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.882 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.882 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.600120+0000", 2024-09-12T16:16:02.882 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9767000000000001e-05 2024-09-12T16:16:02.882 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.882 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.882 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.882 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.882 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.882 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:1197 3.16 3:6ce079da:::rbd_object_map.11557ed36bb5:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:02.882 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.575999+0000", 2024-09-12T16:16:02.882 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.271460217, 2024-09-12T16:16:02.882 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.025887434000000001, 2024-09-12T16:16:02.882 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.883 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.883 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:02.883 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:02.883 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:02.883 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:02.883 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1197 2024-09-12T16:16:02.883 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.883 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.883 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.883 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.883 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.575999+0000", 2024-09-12T16:16:02.883 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.884 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.884 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.884 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.884 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.575999+0000", 2024-09-12T16:16:02.884 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.884 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.884 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.884 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.884 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.575999+0000", 2024-09-12T16:16:02.884 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.82e-07 2024-09-12T16:16:02.884 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.884 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.884 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.885 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.576003+0000", 2024-09-12T16:16:02.885 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.286e-06 2024-09-12T16:16:02.885 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.885 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.885 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.885 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.576011+0000", 2024-09-12T16:16:02.885 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5010000000000004e-06 2024-09-12T16:16:02.885 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.885 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.885 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.885 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.576016+0000", 2024-09-12T16:16:02.885 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2510000000000002e-06 2024-09-12T16:16:02.885 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.886 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.886 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.886 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.598217+0000", 2024-09-12T16:16:02.886 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022200316000000001 2024-09-12T16:16:02.886 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.886 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.886 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.886 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.598293+0000", 2024-09-12T16:16:02.886 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6582999999999995e-05 2024-09-12T16:16:02.886 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.886 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.886 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T16:16:02.886 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.598570+0000", 2024-09-12T16:16:02.887 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000276545 2024-09-12T16:16:02.887 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.887 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.887 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:02.887 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.601822+0000", 2024-09-12T16:16:02.887 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0032517420000000002 2024-09-12T16:16:02.887 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.887 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.887 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:02.887 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.601833+0000", 2024-09-12T16:16:02.887 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1759999999999999e-05 2024-09-12T16:16:02.887 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.887 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.888 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:02.888 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.601864+0000", 2024-09-12T16:16:02.888 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0071000000000001e-05 2024-09-12T16:16:02.888 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.888 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.888 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.888 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.601886+0000", 2024-09-12T16:16:02.888 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2796999999999999e-05 2024-09-12T16:16:02.888 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.888 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.888 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.888 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.888 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.888 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:1198 3.16 3:6ce079da:::rbd_object_map.11557ed36bb5:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:02.889 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.576027+0000", 2024-09-12T16:16:02.889 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.27143244900000002, 2024-09-12T16:16:02.889 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.025965951000000001, 2024-09-12T16:16:02.889 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.889 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.889 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:02.889 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:02.889 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:02.889 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:02.889 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1198 2024-09-12T16:16:02.889 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.889 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.890 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.890 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.890 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.576027+0000", 2024-09-12T16:16:02.890 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.890 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.890 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.890 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.890 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.576027+0000", 2024-09-12T16:16:02.890 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.890 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.890 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.890 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.890 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.576027+0000", 2024-09-12T16:16:02.891 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2599999999999998e-07 2024-09-12T16:16:02.891 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.891 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.891 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.891 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.576030+0000", 2024-09-12T16:16:02.891 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.593e-06 2024-09-12T16:16:02.891 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.891 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.891 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.891 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.576036+0000", 2024-09-12T16:16:02.891 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6969999999999996e-06 2024-09-12T16:16:02.891 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.891 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.892 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.892 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.576043+0000", 2024-09-12T16:16:02.892 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6699999999999997e-06 2024-09-12T16:16:02.892 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.892 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.892 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.892 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.599025+0000", 2024-09-12T16:16:02.892 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022982096 2024-09-12T16:16:02.892 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.892 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.892 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.892 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.599127+0000", 2024-09-12T16:16:02.892 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102478 2024-09-12T16:16:02.892 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.893 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.893 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T16:16:02.893 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.599620+0000", 2024-09-12T16:16:02.893 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00049200299999999997 2024-09-12T16:16:02.893 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.893 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.893 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:02.893 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.601895+0000", 2024-09-12T16:16:02.893 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002275876 2024-09-12T16:16:02.893 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.893 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.893 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:02.893 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.601930+0000", 2024-09-12T16:16:02.893 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4965000000000002e-05 2024-09-12T16:16:02.894 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.894 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.894 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:02.894 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.601972+0000", 2024-09-12T16:16:02.894 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1366999999999999e-05 2024-09-12T16:16:02.894 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.894 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.894 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.894 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.601993+0000", 2024-09-12T16:16:02.894 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.088e-05 2024-09-12T16:16:02.894 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.894 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.894 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.895 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.895 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.895 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:1199 3.16 3:6ce079da:::rbd_object_map.11557ed36bb5:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:02.895 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.576059+0000", 2024-09-12T16:16:02.895 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.27140009599999998, 2024-09-12T16:16:02.895 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.026071978999999999, 2024-09-12T16:16:02.895 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.895 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.895 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:02.895 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:02.895 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:02.895 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:02.895 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1199 2024-09-12T16:16:02.895 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.896 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.896 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.896 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.896 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.576059+0000", 2024-09-12T16:16:02.896 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.896 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.896 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.896 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.896 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.576059+0000", 2024-09-12T16:16:02.896 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.896 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.896 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.896 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.897 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.576060+0000", 2024-09-12T16:16:02.897 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2e-07 2024-09-12T16:16:02.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.897 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.897 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.897 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.576063+0000", 2024-09-12T16:16:02.897 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3979999999999999e-06 2024-09-12T16:16:02.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.897 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.897 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.897 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.576070+0000", 2024-09-12T16:16:02.897 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1339999999999998e-06 2024-09-12T16:16:02.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.897 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.898 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.898 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.576075+0000", 2024-09-12T16:16:02.898 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2159999999999997e-06 2024-09-12T16:16:02.898 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.898 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.898 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.898 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.600180+0000", 2024-09-12T16:16:02.898 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.024104347000000002 2024-09-12T16:16:02.898 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.898 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.898 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.898 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.600243+0000", 2024-09-12T16:16:02.898 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3100000000000002e-05 2024-09-12T16:16:02.899 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.899 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.899 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T16:16:02.899 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.600596+0000", 2024-09-12T16:16:02.899 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00035293199999999997 2024-09-12T16:16:02.899 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.899 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.899 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:02.899 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.602058+0000", 2024-09-12T16:16:02.899 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0014626940000000001 2024-09-12T16:16:02.899 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.899 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.900 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:02.900 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.602069+0000", 2024-09-12T16:16:02.900 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0597999999999999e-05 2024-09-12T16:16:02.900 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.900 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.900 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:02.900 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.602097+0000", 2024-09-12T16:16:02.900 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8017e-05 2024-09-12T16:16:02.900 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.900 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.900 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.901 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.602131+0000", 2024-09-12T16:16:02.901 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4023000000000003e-05 2024-09-12T16:16:02.901 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.901 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.901 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.901 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.901 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:1200 3.16 3:6ce079da:::rbd_object_map.11557ed36bb5:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:02.901 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.576089+0000", 2024-09-12T16:16:02.901 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.27137012599999999, 2024-09-12T16:16:02.901 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.026597379000000001, 2024-09-12T16:16:02.902 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.902 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.902 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:02.902 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:02.902 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:02.902 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:02.902 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1200 2024-09-12T16:16:02.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.902 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.902 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.902 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.902 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.576089+0000", 2024-09-12T16:16:02.902 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.903 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.903 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.903 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.903 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.576089+0000", 2024-09-12T16:16:02.903 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.903 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.903 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.903 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.903 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.576089+0000", 2024-09-12T16:16:02.903 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9100000000000004e-07 2024-09-12T16:16:02.903 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.903 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.903 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.904 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.576094+0000", 2024-09-12T16:16:02.904 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2189999999999998e-06 2024-09-12T16:16:02.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.904 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.904 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.904 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.576102+0000", 2024-09-12T16:16:02.904 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4859999999999997e-06 2024-09-12T16:16:02.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.904 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.904 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.904 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.576109+0000", 2024-09-12T16:16:02.904 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5749999999999997e-06 2024-09-12T16:16:02.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.905 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.905 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.905 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.600951+0000", 2024-09-12T16:16:02.905 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.024842729000000001 2024-09-12T16:16:02.905 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.905 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.905 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.905 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.601006+0000", 2024-09-12T16:16:02.905 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4203999999999998e-05 2024-09-12T16:16:02.905 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.905 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.905 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T16:16:02.905 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.601417+0000", 2024-09-12T16:16:02.906 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00041131000000000002 2024-09-12T16:16:02.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.906 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.906 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:02.906 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.602390+0000", 2024-09-12T16:16:02.906 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00097346800000000001 2024-09-12T16:16:02.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.906 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.906 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:02.906 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.602586+0000", 2024-09-12T16:16:02.906 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019588299999999999 2024-09-12T16:16:02.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.906 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.906 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:02.907 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.602643+0000", 2024-09-12T16:16:02.907 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6341000000000001e-05 2024-09-12T16:16:02.907 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.907 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.907 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.907 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.602686+0000", 2024-09-12T16:16:02.907 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3673e-05 2024-09-12T16:16:02.907 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.907 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.907 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.907 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.907 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.907 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:1204 3.16 3:68cdbeeb:::rbd_data.11557ed36bb5.0000000000000037:head [read 483328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:02.908 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.576250+0000", 2024-09-12T16:16:02.908 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.27120916299999998, 2024-09-12T16:16:02.908 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.02611368, 2024-09-12T16:16:02.908 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.908 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.908 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:02.908 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:02.908 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:02.908 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:02.908 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1204 2024-09-12T16:16:02.908 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.908 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.908 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.909 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.909 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.576250+0000", 2024-09-12T16:16:02.909 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.909 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.909 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.909 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.909 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.576250+0000", 2024-09-12T16:16:02.909 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.909 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.909 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.909 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.909 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.576250+0000", 2024-09-12T16:16:02.909 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5999999999999999e-07 2024-09-12T16:16:02.910 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.910 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.910 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.910 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.576253+0000", 2024-09-12T16:16:02.910 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4590000000000001e-06 2024-09-12T16:16:02.910 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.910 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.910 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.910 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.576259+0000", 2024-09-12T16:16:02.910 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6239999999999996e-06 2024-09-12T16:16:02.910 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.910 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.910 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.911 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.576265+0000", 2024-09-12T16:16:02.911 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5079999999999996e-06 2024-09-12T16:16:02.911 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.911 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.911 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.911 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.602179+0000", 2024-09-12T16:16:02.911 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.025913571999999999 2024-09-12T16:16:02.911 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.911 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.911 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.911 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.602256+0000", 2024-09-12T16:16:02.911 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7618000000000001e-05 2024-09-12T16:16:02.911 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.912 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.912 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.912 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.602364+0000", 2024-09-12T16:16:02.912 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000107439 2024-09-12T16:16:02.912 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.912 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.912 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.912 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.912 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:2248 3.16 3:6ce079da:::rbd_object_map.11557ed36bb5:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:02.912 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.816031+0000", 2024-09-12T16:16:02.912 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.031427912000000002, 2024-09-12T16:16:02.912 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021465702, 2024-09-12T16:16:02.913 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.913 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.913 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:02.913 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:02.913 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:02.913 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:02.913 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2248 2024-09-12T16:16:02.913 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.913 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.913 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.913 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.913 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816031+0000", 2024-09-12T16:16:02.913 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.914 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.914 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816031+0000", 2024-09-12T16:16:02.914 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.914 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.914 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816031+0000", 2024-09-12T16:16:02.914 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5699999999999999e-07 2024-09-12T16:16:02.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.914 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.915 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816033+0000", 2024-09-12T16:16:02.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3060000000000001e-06 2024-09-12T16:16:02.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.915 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.915 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816036+0000", 2024-09-12T16:16:02.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0369999999999999e-06 2024-09-12T16:16:02.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.915 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.915 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816038+0000", 2024-09-12T16:16:02.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.593e-06 2024-09-12T16:16:02.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.916 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.916 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.835454+0000", 2024-09-12T16:16:02.916 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019415847999999999 2024-09-12T16:16:02.916 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.916 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.916 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.916 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.835531+0000", 2024-09-12T16:16:02.916 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6542e-05 2024-09-12T16:16:02.916 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.916 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.916 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T16:16:02.916 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.835779+0000", 2024-09-12T16:16:02.916 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00024819700000000002 2024-09-12T16:16:02.917 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.917 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.917 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:02.917 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.837333+0000", 2024-09-12T16:16:02.917 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00155415 2024-09-12T16:16:02.917 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.917 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.917 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:02.917 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.837392+0000", 2024-09-12T16:16:02.917 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9147999999999997e-05 2024-09-12T16:16:02.917 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.917 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.917 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:02.917 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.837452+0000", 2024-09-12T16:16:02.918 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0078000000000003e-05 2024-09-12T16:16:02.918 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.918 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.918 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.918 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.837497+0000", 2024-09-12T16:16:02.918 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4545999999999997e-05 2024-09-12T16:16:02.918 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.918 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.918 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.918 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.918 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.918 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:2249 3.16 3:6ce079da:::rbd_object_map.11557ed36bb5:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:02.918 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.816044+0000", 2024-09-12T16:16:02.918 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.031415525, 2024-09-12T16:16:02.919 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022758699, 2024-09-12T16:16:02.919 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.919 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.919 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:02.919 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:02.919 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:02.919 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:02.919 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2249 2024-09-12T16:16:02.919 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.919 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.919 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.919 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.919 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816044+0000", 2024-09-12T16:16:02.919 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.920 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.920 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.920 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.920 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816044+0000", 2024-09-12T16:16:02.920 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.920 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.920 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.920 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.920 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816044+0000", 2024-09-12T16:16:02.920 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6399999999999998e-07 2024-09-12T16:16:02.920 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.920 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.920 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.920 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816045+0000", 2024-09-12T16:16:02.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.637e-06 2024-09-12T16:16:02.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816049+0000", 2024-09-12T16:16:02.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3720000000000001e-06 2024-09-12T16:16:02.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816051+0000", 2024-09-12T16:16:02.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.553e-06 2024-09-12T16:16:02.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.922 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.836188+0000", 2024-09-12T16:16:02.922 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020136372999999999 2024-09-12T16:16:02.922 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.922 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.922 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.922 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.836287+0000", 2024-09-12T16:16:02.922 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9222000000000006e-05 2024-09-12T16:16:02.922 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.922 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.922 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T16:16:02.922 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.836592+0000", 2024-09-12T16:16:02.922 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000305273 2024-09-12T16:16:02.922 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.922 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.922 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:02.923 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.838607+0000", 2024-09-12T16:16:02.923 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0020143819999999999 2024-09-12T16:16:02.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.923 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.923 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:02.923 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.838653+0000", 2024-09-12T16:16:02.923 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6214000000000002e-05 2024-09-12T16:16:02.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.923 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.923 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:02.923 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.838754+0000", 2024-09-12T16:16:02.923 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000100989 2024-09-12T16:16:02.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.923 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.924 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.924 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.838802+0000", 2024-09-12T16:16:02.924 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8420000000000001e-05 2024-09-12T16:16:02.924 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.924 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.924 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.924 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.924 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.924 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:2250 3.16 3:6ce079da:::rbd_object_map.11557ed36bb5:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:02.924 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.816123+0000", 2024-09-12T16:16:02.924 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.031336510999999997, 2024-09-12T16:16:02.924 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.024673976, 2024-09-12T16:16:02.924 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.924 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.925 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:02.925 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:02.925 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:02.925 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:02.925 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2250 2024-09-12T16:16:02.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.925 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.925 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.925 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.925 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816123+0000", 2024-09-12T16:16:02.925 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.925 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.926 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.926 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816123+0000", 2024-09-12T16:16:02.926 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.926 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.926 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.926 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816123+0000", 2024-09-12T16:16:02.926 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5400000000000001e-07 2024-09-12T16:16:02.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.926 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.926 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.926 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816126+0000", 2024-09-12T16:16:02.926 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1729999999999999e-06 2024-09-12T16:16:02.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.927 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.927 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.927 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816132+0000", 2024-09-12T16:16:02.927 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9970000000000004e-06 2024-09-12T16:16:02.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.927 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.927 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.927 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816136+0000", 2024-09-12T16:16:02.927 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5659999999999998e-06 2024-09-12T16:16:02.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.927 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.927 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.928 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.837548+0000", 2024-09-12T16:16:02.928 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021412289000000001 2024-09-12T16:16:02.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.928 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.928 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.928 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.837639+0000", 2024-09-12T16:16:02.928 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1063999999999994e-05 2024-09-12T16:16:02.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.928 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.928 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T16:16:02.928 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.838017+0000", 2024-09-12T16:16:02.928 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00037737799999999999 2024-09-12T16:16:02.929 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.929 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.929 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:02.929 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.840666+0000", 2024-09-12T16:16:02.929 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002649059 2024-09-12T16:16:02.929 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.929 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.929 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:02.929 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.840683+0000", 2024-09-12T16:16:02.929 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6909999999999999e-05 2024-09-12T16:16:02.929 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.929 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.929 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:02.930 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.840751+0000", 2024-09-12T16:16:02.930 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7997000000000006e-05 2024-09-12T16:16:02.930 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.930 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.930 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.930 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.840797+0000", 2024-09-12T16:16:02.930 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5989000000000003e-05 2024-09-12T16:16:02.930 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.930 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.930 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.930 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.930 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.930 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:2251 3.16 3:6ce079da:::rbd_object_map.11557ed36bb5:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:02.930 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.816157+0000", 2024-09-12T16:16:02.931 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.031301922000000003, 2024-09-12T16:16:02.931 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.025459326000000001, 2024-09-12T16:16:02.931 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.931 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.931 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:02.931 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:02.931 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:02.931 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:02.931 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2251 2024-09-12T16:16:02.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.931 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.931 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.931 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.931 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816157+0000", 2024-09-12T16:16:02.932 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.932 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.932 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.932 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816157+0000", 2024-09-12T16:16:02.932 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.932 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.932 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.932 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816158+0000", 2024-09-12T16:16:02.932 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6699999999999999e-07 2024-09-12T16:16:02.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.933 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.933 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.933 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816160+0000", 2024-09-12T16:16:02.933 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.841e-06 2024-09-12T16:16:02.933 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.933 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.933 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.933 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816165+0000", 2024-09-12T16:16:02.933 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6890000000000003e-06 2024-09-12T16:16:02.933 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.933 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.933 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.933 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816168+0000", 2024-09-12T16:16:02.934 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2430000000000001e-06 2024-09-12T16:16:02.934 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.934 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.934 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.934 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.838849+0000", 2024-09-12T16:16:02.934 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022680549000000001 2024-09-12T16:16:02.934 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.934 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.934 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.934 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.838963+0000", 2024-09-12T16:16:02.934 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011422299999999999 2024-09-12T16:16:02.934 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.934 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.934 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T16:16:02.934 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.839355+0000", 2024-09-12T16:16:02.935 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00039152000000000002 2024-09-12T16:16:02.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.935 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.935 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:02.935 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.840852+0000", 2024-09-12T16:16:02.935 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0014970929999999999 2024-09-12T16:16:02.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.935 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.935 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:02.935 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.841533+0000", 2024-09-12T16:16:02.935 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00068079800000000004 2024-09-12T16:16:02.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.935 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.935 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:02.936 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.841592+0000", 2024-09-12T16:16:02.936 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9066e-05 2024-09-12T16:16:02.936 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.936 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.936 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.936 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.841616+0000", 2024-09-12T16:16:02.936 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4837e-05 2024-09-12T16:16:02.936 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.936 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.936 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.936 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.936 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.936 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:2252 3.16 3:6ce079da:::rbd_object_map.11557ed36bb5:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:02.937 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.816173+0000", 2024-09-12T16:16:02.937 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.031285867000000002, 2024-09-12T16:16:02.937 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.026246246000000001, 2024-09-12T16:16:02.937 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.937 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.937 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:02.937 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:02.937 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:02.937 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:02.937 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2252 2024-09-12T16:16:02.937 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.937 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.937 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.938 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.938 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816173+0000", 2024-09-12T16:16:02.938 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.938 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.938 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.938 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.938 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816173+0000", 2024-09-12T16:16:02.938 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.938 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.938 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.938 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.938 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816174+0000", 2024-09-12T16:16:02.938 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8299999999999998e-07 2024-09-12T16:16:02.939 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.939 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.939 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.939 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816175+0000", 2024-09-12T16:16:02.939 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.48e-06 2024-09-12T16:16:02.939 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.939 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.939 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.939 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816178+0000", 2024-09-12T16:16:02.939 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.32e-06 2024-09-12T16:16:02.939 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.939 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.939 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.940 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816181+0000", 2024-09-12T16:16:02.940 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.508e-06 2024-09-12T16:16:02.940 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.940 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.940 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.940 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.839882+0000", 2024-09-12T16:16:02.940 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023701256 2024-09-12T16:16:02.940 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.940 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.940 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.940 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.839972+0000", 2024-09-12T16:16:02.940 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0431000000000002e-05 2024-09-12T16:16:02.941 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.941 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.941 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T16:16:02.941 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.840282+0000", 2024-09-12T16:16:02.941 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00030919500000000001 2024-09-12T16:16:02.941 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.941 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.941 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:02.941 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.842308+0000", 2024-09-12T16:16:02.941 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0020264290000000002 2024-09-12T16:16:02.941 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.941 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.941 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:02.942 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.842350+0000", 2024-09-12T16:16:02.942 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1653999999999998e-05 2024-09-12T16:16:02.942 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.942 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.942 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:02.942 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.842380+0000", 2024-09-12T16:16:02.942 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0514999999999998e-05 2024-09-12T16:16:02.942 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.942 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.942 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.942 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.842419+0000", 2024-09-12T16:16:02.942 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9174999999999997e-05 2024-09-12T16:16:02.942 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.943 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.943 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.943 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.943 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.943 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:2253 3.16 3:6ce079da:::rbd_object_map.11557ed36bb5:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:02.943 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.816187+0000", 2024-09-12T16:16:02.943 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.031272283999999997, 2024-09-12T16:16:02.943 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.026340486, 2024-09-12T16:16:02.943 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.943 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.943 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:02.943 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:02.944 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:02.944 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:02.944 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2253 2024-09-12T16:16:02.944 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.944 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.944 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.944 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.944 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816187+0000", 2024-09-12T16:16:02.944 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.944 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.944 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.944 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.944 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816187+0000", 2024-09-12T16:16:02.945 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.945 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.945 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.945 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.945 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816187+0000", 2024-09-12T16:16:02.945 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1e-07 2024-09-12T16:16:02.945 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.945 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.945 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.945 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816189+0000", 2024-09-12T16:16:02.945 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9700000000000002e-06 2024-09-12T16:16:02.945 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.945 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.946 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.946 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816193+0000", 2024-09-12T16:16:02.946 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5659999999999998e-06 2024-09-12T16:16:02.946 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.946 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.946 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.946 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816195+0000", 2024-09-12T16:16:02.946 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7369999999999998e-06 2024-09-12T16:16:02.946 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.946 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.946 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.946 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.840896+0000", 2024-09-12T16:16:02.946 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.024700784 2024-09-12T16:16:02.947 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.947 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.947 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.947 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.840945+0000", 2024-09-12T16:16:02.947 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9320000000000002e-05 2024-09-12T16:16:02.947 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.947 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.947 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T16:16:02.947 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.841169+0000", 2024-09-12T16:16:02.947 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000223534 2024-09-12T16:16:02.947 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.947 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.947 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:02.948 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.842467+0000", 2024-09-12T16:16:02.948 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001297814 2024-09-12T16:16:02.948 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.948 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.948 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:02.948 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.842475+0000", 2024-09-12T16:16:02.948 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5280000000000003e-06 2024-09-12T16:16:02.948 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.948 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.948 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:02.948 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.842503+0000", 2024-09-12T16:16:02.948 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7759999999999998e-05 2024-09-12T16:16:02.948 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.949 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.949 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.949 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.842527+0000", 2024-09-12T16:16:02.949 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4162999999999999e-05 2024-09-12T16:16:02.949 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.949 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.949 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.949 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.949 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.949 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:2254 3.16 3:6ce079da:::rbd_object_map.11557ed36bb5:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:02.949 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.816202+0000", 2024-09-12T16:16:02.949 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.031256622999999997, 2024-09-12T16:16:02.949 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.028369726000000001, 2024-09-12T16:16:02.949 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.950 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.950 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:02.950 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:02.950 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:02.950 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:02.950 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2254 2024-09-12T16:16:02.950 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.950 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.950 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.950 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.950 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816202+0000", 2024-09-12T16:16:02.950 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.950 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.950 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.950 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.950 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816202+0000", 2024-09-12T16:16:02.951 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.951 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.951 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.951 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.951 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816203+0000", 2024-09-12T16:16:02.951 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9799999999999999e-07 2024-09-12T16:16:02.951 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.951 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.951 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.951 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816205+0000", 2024-09-12T16:16:02.951 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.832e-06 2024-09-12T16:16:02.951 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.951 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.952 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.952 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816208+0000", 2024-09-12T16:16:02.952 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7359999999999999e-06 2024-09-12T16:16:02.952 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.952 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.952 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.952 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816211+0000", 2024-09-12T16:16:02.952 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9349999999999999e-06 2024-09-12T16:16:02.952 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.952 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.952 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.952 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.841655+0000", 2024-09-12T16:16:02.953 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.025443845999999999 2024-09-12T16:16:02.953 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.953 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.953 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.953 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.841706+0000", 2024-09-12T16:16:02.953 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0439000000000003e-05 2024-09-12T16:16:02.953 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.953 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.953 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T16:16:02.953 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.841970+0000", 2024-09-12T16:16:02.953 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026400799999999998 2024-09-12T16:16:02.953 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.953 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.954 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:02.954 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.844401+0000", 2024-09-12T16:16:02.954 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002431173 2024-09-12T16:16:02.954 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.954 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.954 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:02.954 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.844477+0000", 2024-09-12T16:16:02.954 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5815999999999994e-05 2024-09-12T16:16:02.954 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.954 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.954 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:02.954 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.844530+0000", 2024-09-12T16:16:02.954 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3594999999999998e-05 2024-09-12T16:16:02.955 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.955 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.955 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.955 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.844572+0000", 2024-09-12T16:16:02.955 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2048000000000001e-05 2024-09-12T16:16:02.955 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.955 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.955 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.955 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.955 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.955 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:2255 3.16 3:6ce079da:::rbd_object_map.11557ed36bb5:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:02.955 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.816217+0000", 2024-09-12T16:16:02.955 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.031242427999999999, 2024-09-12T16:16:02.955 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.028425022000000001, 2024-09-12T16:16:02.956 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.956 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.956 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:02.956 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:02.956 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:02.956 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:02.956 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2255 2024-09-12T16:16:02.956 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.956 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.956 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.956 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.956 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816217+0000", 2024-09-12T16:16:02.956 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.956 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.957 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.957 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.957 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816217+0000", 2024-09-12T16:16:02.957 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.957 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.957 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.957 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.957 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816217+0000", 2024-09-12T16:16:02.957 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6100000000000002e-07 2024-09-12T16:16:02.957 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.957 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.957 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.957 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816219+0000", 2024-09-12T16:16:02.958 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8050000000000001e-06 2024-09-12T16:16:02.958 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.958 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.958 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.958 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816222+0000", 2024-09-12T16:16:02.958 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5090000000000002e-06 2024-09-12T16:16:02.958 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.958 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.958 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.958 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816225+0000", 2024-09-12T16:16:02.958 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.706e-06 2024-09-12T16:16:02.958 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.958 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.959 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.959 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.842571+0000", 2024-09-12T16:16:02.959 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.026345964999999999 2024-09-12T16:16:02.959 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.959 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.959 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.959 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.842648+0000", 2024-09-12T16:16:02.959 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7509999999999995e-05 2024-09-12T16:16:02.959 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.959 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.959 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T16:16:02.959 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.842983+0000", 2024-09-12T16:16:02.959 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00033479899999999999 2024-09-12T16:16:02.959 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.960 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.960 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:02.960 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.844466+0000", 2024-09-12T16:16:02.960 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001482581 2024-09-12T16:16:02.960 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.960 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.960 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:02.960 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.844583+0000", 2024-09-12T16:16:02.960 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000117311 2024-09-12T16:16:02.960 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.960 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.960 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:02.960 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.844610+0000", 2024-09-12T16:16:02.961 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6517e-05 2024-09-12T16:16:02.961 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.961 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.961 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.961 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.844642+0000", 2024-09-12T16:16:02.961 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2057999999999997e-05 2024-09-12T16:16:02.961 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.961 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.961 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.961 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.961 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.961 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:2256 3.16 3:6ce079da:::rbd_object_map.11557ed36bb5:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:02.961 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.816240+0000", 2024-09-12T16:16:02.962 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.031219123000000001, 2024-09-12T16:16:02.962 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.030227787999999998, 2024-09-12T16:16:02.962 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.962 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.962 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:02.962 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:02.962 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:02.962 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:02.962 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2256 2024-09-12T16:16:02.962 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.962 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.962 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.962 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.962 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816240+0000", 2024-09-12T16:16:02.963 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.963 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.963 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.963 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.963 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816240+0000", 2024-09-12T16:16:02.963 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.963 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.963 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.963 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.963 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816241+0000", 2024-09-12T16:16:02.963 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4899999999999995e-07 2024-09-12T16:16:02.963 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.964 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.964 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.964 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816244+0000", 2024-09-12T16:16:02.964 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0570000000000001e-06 2024-09-12T16:16:02.964 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.964 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.964 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.964 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816256+0000", 2024-09-12T16:16:02.964 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2109999999999999e-05 2024-09-12T16:16:02.964 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.964 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.964 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.964 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816264+0000", 2024-09-12T16:16:02.964 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.388e-06 2024-09-12T16:16:02.965 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.965 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.965 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.965 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.843537+0000", 2024-09-12T16:16:02.965 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.027272484 2024-09-12T16:16:02.965 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.965 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.965 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.965 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.843622+0000", 2024-09-12T16:16:02.965 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5592000000000003e-05 2024-09-12T16:16:02.965 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.965 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.965 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T16:16:02.965 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.844019+0000", 2024-09-12T16:16:02.966 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00039687000000000001 2024-09-12T16:16:02.966 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.966 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.966 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:02.966 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.846303+0000", 2024-09-12T16:16:02.966 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0022835780000000001 2024-09-12T16:16:02.966 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.966 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.966 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:02.966 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.846391+0000", 2024-09-12T16:16:02.966 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8121000000000006e-05 2024-09-12T16:16:02.966 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.966 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.967 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:02.967 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.846429+0000", 2024-09-12T16:16:02.967 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8349999999999997e-05 2024-09-12T16:16:02.967 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.967 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.967 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.967 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.846468+0000", 2024-09-12T16:16:02.967 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8689000000000002e-05 2024-09-12T16:16:02.967 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.967 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.967 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.967 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.967 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.968 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:2257 3.16 3:6ce079da:::rbd_object_map.11557ed36bb5:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:02.968 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.816860+0000", 2024-09-12T16:16:02.968 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.030599288999999998, 2024-09-12T16:16:02.968 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.029676971999999999, 2024-09-12T16:16:02.968 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:02.968 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:02.968 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:02.968 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:02.968 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:02.968 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:02.968 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2257 2024-09-12T16:16:02.968 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.968 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:02.969 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.969 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:02.969 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816860+0000", 2024-09-12T16:16:02.969 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.969 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.969 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.969 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:02.969 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816860+0000", 2024-09-12T16:16:02.969 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:02.969 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.969 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.969 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:02.969 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816861+0000", 2024-09-12T16:16:02.969 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7399999999999991e-07 2024-09-12T16:16:02.970 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.970 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.970 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:02.970 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816870+0000", 2024-09-12T16:16:02.970 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3559999999999999e-06 2024-09-12T16:16:02.970 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.970 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.970 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:02.970 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816882+0000", 2024-09-12T16:16:02.970 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1681e-05 2024-09-12T16:16:02.970 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.970 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.970 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:02.970 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.816889+0000", 2024-09-12T16:16:02.971 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3479999999999998e-06 2024-09-12T16:16:02.971 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.971 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.971 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:02.971 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.844686+0000", 2024-09-12T16:16:02.971 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.027796367999999998 2024-09-12T16:16:02.971 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.971 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.971 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:02.971 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.844749+0000", 2024-09-12T16:16:02.971 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3003000000000006e-05 2024-09-12T16:16:02.971 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.971 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.971 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T16:16:02.972 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.845019+0000", 2024-09-12T16:16:02.972 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00027024500000000001 2024-09-12T16:16:02.972 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.972 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.972 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:02.972 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.846375+0000", 2024-09-12T16:16:02.972 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001356297 2024-09-12T16:16:02.972 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.972 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.972 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:02.972 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.846479+0000", 2024-09-12T16:16:02.972 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000103568 2024-09-12T16:16:02.972 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.973 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.973 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:02.973 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.846504+0000", 2024-09-12T16:16:02.973 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5735999999999999e-05 2024-09-12T16:16:02.973 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:02.973 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:02.973 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:02.973 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.846537+0000", 2024-09-12T16:16:02.973 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2396e-05 2024-09-12T16:16:02.973 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.973 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.973 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.973 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:02.974 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:02.974 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:02.975 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:02.974+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:02.976 INFO:teuthology.orchestra.run.smithi204.stdout:267 trunc from 0xd67f400 to 0x94b2a00 2024-09-12T16:16:02.976 INFO:teuthology.orchestra.run.smithi204.stdout:270 trunc from 0x94b2a00 to 0x943cc00 2024-09-12T16:16:02.976 INFO:teuthology.orchestra.run.smithi204.stdout:272 punch from 0xb71600 to 0xb7fa00, (0xe400 bytes) 2024-09-12T16:16:02.976 INFO:teuthology.orchestra.run.smithi204.stdout:273 write 0x9f36600 thru 0x9f42e35 (0xc836 bytes) 2024-09-12T16:16:02.976 INFO:teuthology.orchestra.run.smithi204.stdout:277 write 0x655d600 thru 0x656d52a (0xff2b bytes) 2024-09-12T16:16:02.976 INFO:teuthology.orchestra.run.smithi204.stdout:280 flatten 2024-09-12T16:16:02.976 INFO:teuthology.orchestra.run.smithi204.stdout:281 punch from 0x464200 to 0x469400, (0x5200 bytes) 2024-09-12T16:16:02.977 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:16:02.978 INFO:teuthology.orchestra.run.smithi204.stdout:282 write 0xd255c00 thru 0xd25f02c (0x942d bytes) 2024-09-12T16:16:02.979 INFO:teuthology.orchestra.run.smithi204.stdout:283 punch from 0x4b6c600 to 0x4b72800, (0x6200 bytes) 2024-09-12T16:16:02.980 INFO:teuthology.orchestra.run.smithi204.stdout:284 read 0x46eee00 thru 0x46f51bb (0x63bc bytes) 2024-09-12T16:16:02.986 INFO:teuthology.orchestra.run.smithi204.stdout:288 read 0x94b3800 thru 0x94b9e2f (0x6630 bytes) 2024-09-12T16:16:02.986 INFO:teuthology.orchestra.run.smithi204.stdout:295 write 0x4afc800 thru 0x4b0431d (0x7b1e bytes) 2024-09-12T16:16:02.986 INFO:teuthology.orchestra.run.smithi204.stdout:296 read 0xace6e00 thru 0xacf5ef1 (0xf0f2 bytes) 2024-09-12T16:16:03.002 INFO:teuthology.orchestra.run.smithi204.stdout:301 write 0xd545200 thru 0xd54a3e2 (0x51e3 bytes) 2024-09-12T16:16:03.005 INFO:teuthology.orchestra.run.smithi204.stdout:305 punch from 0x3ca2800 to 0x3cb0200, (0xda00 bytes) 2024-09-12T16:16:03.005 INFO:teuthology.orchestra.run.smithi204.stdout:306 punch from 0x9999000 to 0x999c600, (0x3600 bytes) 2024-09-12T16:16:03.007 INFO:teuthology.orchestra.run.smithi204.stdout:307 write 0x6952400 thru 0x6959ee7 (0x7ae8 bytes) 2024-09-12T16:16:03.007 INFO:teuthology.orchestra.run.smithi204.stdout:308 write 0x7d00400 thru 0x7d02d08 (0x2909 bytes) 2024-09-12T16:16:03.007 INFO:teuthology.orchestra.run.smithi204.stdout:310 trunc from 0xd54a400 to 0xcbcb000 2024-09-12T16:16:03.026 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-12T16:16:03.026 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T16:16:03.026 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-12T16:16:03.026 INFO:tasks.thrashosds.thrasher:Setting osd 5 primary_affinity to 0.089277 2024-09-12T16:16:03.026 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 0.08927662601610431 2024-09-12T16:16:03.039 INFO:teuthology.orchestra.run.smithi204.stdout:312 write 0x91b6200 thru 0x91c23eb (0xc1ec bytes) 2024-09-12T16:16:03.053 INFO:teuthology.orchestra.run.smithi204.stdout:313 trunc from 0xcbcb000 to 0x1d67600 2024-09-12T16:16:03.076 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:03.075+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:03.122 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:03.123 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:03.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.123 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:933 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.123 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.102434+0000", 2024-09-12T16:16:03.123 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.012216428999999999, 2024-09-12T16:16:03.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012235042999999999, 2024-09-12T16:16:03.123 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.123 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.123 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.123 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.123 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.123 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.123 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 933 2024-09-12T16:16:03.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.124 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.124 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.124 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102434+0000", 2024-09-12T16:16:03.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.124 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.124 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102434+0000", 2024-09-12T16:16:03.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.125 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102435+0000", 2024-09-12T16:16:03.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.61e-07 2024-09-12T16:16:03.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.125 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102438+0000", 2024-09-12T16:16:03.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4570000000000001e-06 2024-09-12T16:16:03.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.125 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102446+0000", 2024-09-12T16:16:03.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4999999999999999e-06 2024-09-12T16:16:03.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.126 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.126 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102451+0000", 2024-09-12T16:16:03.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1819999999999999e-06 2024-09-12T16:16:03.126 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.126 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.126 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.126 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3509 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.126 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.109116+0000", 2024-09-12T16:16:03.127 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0055340379999999998, 2024-09-12T16:16:03.127 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055850680000000003, 2024-09-12T16:16:03.127 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.127 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.127 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.127 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.127 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.127 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.127 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3509 2024-09-12T16:16:03.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.127 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.127 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.127 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109116+0000", 2024-09-12T16:16:03.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.128 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109116+0000", 2024-09-12T16:16:03.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.128 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109117+0000", 2024-09-12T16:16:03.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2600000000000002e-07 2024-09-12T16:16:03.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.129 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.129 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109120+0000", 2024-09-12T16:16:03.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1939999999999998e-06 2024-09-12T16:16:03.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.129 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.129 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109127+0000", 2024-09-12T16:16:03.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4889999999999998e-06 2024-09-12T16:16:03.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.129 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.129 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109133+0000", 2024-09-12T16:16:03.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5400000000000003e-06 2024-09-12T16:16:03.129 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.130 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.130 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.130 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3528 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.130 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.112206+0000", 2024-09-12T16:16:03.130 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0024442370000000001, 2024-09-12T16:16:03.130 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0025198759999999999, 2024-09-12T16:16:03.130 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.130 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.130 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.130 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.130 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.131 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.131 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3528 2024-09-12T16:16:03.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.131 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.131 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.131 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.112206+0000", 2024-09-12T16:16:03.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.131 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.131 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.112206+0000", 2024-09-12T16:16:03.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.112207+0000", 2024-09-12T16:16:03.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.111e-06 2024-09-12T16:16:03.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.112212+0000", 2024-09-12T16:16:03.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4580000000000003e-06 2024-09-12T16:16:03.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.112222+0000", 2024-09-12T16:16:03.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0657e-05 2024-09-12T16:16:03.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.133 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.133 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.112229+0000", 2024-09-12T16:16:03.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0450000000000003e-06 2024-09-12T16:16:03.133 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.133 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.133 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.133 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3458 3.6 3:629d5e70:::rbd_header.11557ed36bb5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.133 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.092897+0000", 2024-09-12T16:16:03.134 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.021753654000000001, 2024-09-12T16:16:03.134 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021863290000000001, 2024-09-12T16:16:03.134 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.134 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.134 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:03.134 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.134 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.134 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.134 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3458 2024-09-12T16:16:03.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.134 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.134 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.135 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.092897+0000", 2024-09-12T16:16:03.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.135 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.135 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.092897+0000", 2024-09-12T16:16:03.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.135 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.135 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.092897+0000", 2024-09-12T16:16:03.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2399999999999997e-07 2024-09-12T16:16:03.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.092901+0000", 2024-09-12T16:16:03.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.092e-06 2024-09-12T16:16:03.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.092912+0000", 2024-09-12T16:16:03.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1011e-05 2024-09-12T16:16:03.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.092923+0000", 2024-09-12T16:16:03.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0722e-05 2024-09-12T16:16:03.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.137 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:03.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.114676+0000", 2024-09-12T16:16:03.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021752694999999999 2024-09-12T16:16:03.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.137 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:03.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.114709+0000", 2024-09-12T16:16:03.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2926999999999998e-05 2024-09-12T16:16:03.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.137 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:03.138 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.114760+0000", 2024-09-12T16:16:03.138 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1019000000000001e-05 2024-09-12T16:16:03.138 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.138 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.138 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.138 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3473 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.138 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.098664+0000", 2024-09-12T16:16:03.138 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.015985875, 2024-09-12T16:16:03.138 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016138653999999999, 2024-09-12T16:16:03.138 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.138 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.138 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.139 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.139 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.139 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.139 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3473 2024-09-12T16:16:03.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.139 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.139 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.139 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.098664+0000", 2024-09-12T16:16:03.139 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.139 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.139 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.098664+0000", 2024-09-12T16:16:03.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.098665+0000", 2024-09-12T16:16:03.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2500000000000005e-07 2024-09-12T16:16:03.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.098669+0000", 2024-09-12T16:16:03.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9369999999999997e-06 2024-09-12T16:16:03.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.141 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.098677+0000", 2024-09-12T16:16:03.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5769999999999996e-06 2024-09-12T16:16:03.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.141 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.098681+0000", 2024-09-12T16:16:03.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.51e-06 2024-09-12T16:16:03.141 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.141 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.141 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.142 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3489 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.142 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.102783+0000", 2024-09-12T16:16:03.142 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.011867252999999999, 2024-09-12T16:16:03.142 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012043596, 2024-09-12T16:16:03.142 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.142 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.142 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.142 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.142 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.142 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.142 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3489 2024-09-12T16:16:03.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.142 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.143 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.143 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102783+0000", 2024-09-12T16:16:03.143 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.143 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.143 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.143 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102783+0000", 2024-09-12T16:16:03.143 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.143 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.143 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.143 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102784+0000", 2024-09-12T16:16:03.143 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7899999999999998e-07 2024-09-12T16:16:03.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.144 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.144 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102786+0000", 2024-09-12T16:16:03.144 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.655e-06 2024-09-12T16:16:03.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.144 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.144 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102792+0000", 2024-09-12T16:16:03.144 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4079999999999997e-06 2024-09-12T16:16:03.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.144 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.144 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102795+0000", 2024-09-12T16:16:03.145 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3569999999999998e-06 2024-09-12T16:16:03.145 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.145 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.145 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.145 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3510 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.145 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.109149+0000", 2024-09-12T16:16:03.145 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.00550082, 2024-09-12T16:16:03.145 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0057000870000000004, 2024-09-12T16:16:03.145 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.145 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.145 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.145 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.146 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.146 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.146 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3510 2024-09-12T16:16:03.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.146 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.146 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.146 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109149+0000", 2024-09-12T16:16:03.146 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.146 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.147 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109149+0000", 2024-09-12T16:16:03.147 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.147 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.147 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.147 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109150+0000", 2024-09-12T16:16:03.147 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1900000000000002e-07 2024-09-12T16:16:03.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.147 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.147 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.147 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109153+0000", 2024-09-12T16:16:03.147 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9730000000000002e-06 2024-09-12T16:16:03.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.147 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.147 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.148 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109161+0000", 2024-09-12T16:16:03.148 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5769999999999996e-06 2024-09-12T16:16:03.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.148 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.148 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.148 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109166+0000", 2024-09-12T16:16:03.148 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8869999999999997e-06 2024-09-12T16:16:03.148 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.148 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.148 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.148 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.149 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3529 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.149 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.112341+0000", 2024-09-12T16:16:03.149 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0023092130000000001, 2024-09-12T16:16:03.149 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0025422650000000001, 2024-09-12T16:16:03.149 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.149 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.149 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.149 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.149 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.149 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.149 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3529 2024-09-12T16:16:03.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.149 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.149 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.150 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.150 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.112341+0000", 2024-09-12T16:16:03.150 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.150 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.150 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.112341+0000", 2024-09-12T16:16:03.150 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.150 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.150 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.112342+0000", 2024-09-12T16:16:03.151 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7300000000000005e-07 2024-09-12T16:16:03.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.151 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.151 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.151 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.112346+0000", 2024-09-12T16:16:03.151 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.019e-06 2024-09-12T16:16:03.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.151 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.151 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.151 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.112356+0000", 2024-09-12T16:16:03.151 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.004e-05 2024-09-12T16:16:03.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.151 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.151 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.152 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.112363+0000", 2024-09-12T16:16:03.152 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6730000000000003e-06 2024-09-12T16:16:03.152 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.152 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.152 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.152 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.152 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:918 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.152 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.098696+0000", 2024-09-12T16:16:03.152 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.015954204999999999, 2024-09-12T16:16:03.152 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016213610999999999, 2024-09-12T16:16:03.152 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.152 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.153 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.153 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.153 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.153 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.153 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 918 2024-09-12T16:16:03.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.153 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.153 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.153 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.153 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.098696+0000", 2024-09-12T16:16:03.153 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.153 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.154 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.154 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.098696+0000", 2024-09-12T16:16:03.154 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.154 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.154 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.154 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.098697+0000", 2024-09-12T16:16:03.154 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7399999999999991e-07 2024-09-12T16:16:03.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.154 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.154 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.154 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.098701+0000", 2024-09-12T16:16:03.154 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2810000000000002e-06 2024-09-12T16:16:03.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.155 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.155 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.155 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.098710+0000", 2024-09-12T16:16:03.155 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9949999999999994e-06 2024-09-12T16:16:03.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.155 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.155 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.155 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.098717+0000", 2024-09-12T16:16:03.155 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3459999999999999e-06 2024-09-12T16:16:03.155 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.155 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.155 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.156 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.156 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:934 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.156 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.102797+0000", 2024-09-12T16:16:03.156 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.011853183999999999, 2024-09-12T16:16:03.156 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012143676000000001, 2024-09-12T16:16:03.156 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.156 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.156 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.156 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.156 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.156 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.156 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 934 2024-09-12T16:16:03.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.156 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.157 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.157 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.157 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102797+0000", 2024-09-12T16:16:03.157 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.157 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.157 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.157 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102797+0000", 2024-09-12T16:16:03.157 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.157 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.157 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.158 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102798+0000", 2024-09-12T16:16:03.158 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8199999999999999e-07 2024-09-12T16:16:03.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.158 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.158 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102801+0000", 2024-09-12T16:16:03.158 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.49e-06 2024-09-12T16:16:03.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.158 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.158 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102808+0000", 2024-09-12T16:16:03.158 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0940000000000002e-06 2024-09-12T16:16:03.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.158 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.159 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102812+0000", 2024-09-12T16:16:03.159 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.997e-06 2024-09-12T16:16:03.159 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.159 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.159 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.159 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.159 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3511 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.159 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.109176+0000", 2024-09-12T16:16:03.159 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0054739300000000001, 2024-09-12T16:16:03.159 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0057972910000000004, 2024-09-12T16:16:03.159 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.159 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.160 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.160 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.160 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.160 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.160 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3511 2024-09-12T16:16:03.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.160 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.160 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.160 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109176+0000", 2024-09-12T16:16:03.160 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.161 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.161 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109176+0000", 2024-09-12T16:16:03.161 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.161 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.161 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109177+0000", 2024-09-12T16:16:03.161 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3699999999999999e-07 2024-09-12T16:16:03.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.161 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.161 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109180+0000", 2024-09-12T16:16:03.161 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7700000000000002e-06 2024-09-12T16:16:03.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109187+0000", 2024-09-12T16:16:03.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6800000000000004e-06 2024-09-12T16:16:03.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109192+0000", 2024-09-12T16:16:03.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2410000000000003e-06 2024-09-12T16:16:03.162 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.162 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.162 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.162 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:964 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.163 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.112353+0000", 2024-09-12T16:16:03.163 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0022976469999999999, 2024-09-12T16:16:03.163 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0026472230000000002, 2024-09-12T16:16:03.163 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.163 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.163 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.163 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.163 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.163 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.163 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 964 2024-09-12T16:16:03.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.163 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.164 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.112353+0000", 2024-09-12T16:16:03.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.164 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.164 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.164 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.112353+0000", 2024-09-12T16:16:03.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.164 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.164 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.164 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.112353+0000", 2024-09-12T16:16:03.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0999999999999997e-07 2024-09-12T16:16:03.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.165 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.165 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.165 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.112357+0000", 2024-09-12T16:16:03.165 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.597e-06 2024-09-12T16:16:03.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.165 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.165 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.165 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.112365+0000", 2024-09-12T16:16:03.165 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8229999999999995e-06 2024-09-12T16:16:03.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.165 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.165 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.165 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.112369+0000", 2024-09-12T16:16:03.165 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1899999999999997e-06 2024-09-12T16:16:03.165 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.166 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.166 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.166 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.166 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3474 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.166 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.098852+0000", 2024-09-12T16:16:03.166 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.015798401, 2024-09-12T16:16:03.166 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016171215999999999, 2024-09-12T16:16:03.166 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.166 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.166 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.166 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.166 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.166 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.166 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3474 2024-09-12T16:16:03.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.167 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.167 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.167 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.167 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.098852+0000", 2024-09-12T16:16:03.167 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.167 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.167 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.167 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.098852+0000", 2024-09-12T16:16:03.167 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.168 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.168 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.168 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.098853+0000", 2024-09-12T16:16:03.168 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6099999999999999e-07 2024-09-12T16:16:03.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.168 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.168 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.168 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.098857+0000", 2024-09-12T16:16:03.168 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0080000000000004e-06 2024-09-12T16:16:03.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.168 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.168 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.168 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.098865+0000", 2024-09-12T16:16:03.169 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3080000000000008e-06 2024-09-12T16:16:03.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.169 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.169 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.098871+0000", 2024-09-12T16:16:03.169 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0079999999999999e-06 2024-09-12T16:16:03.169 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.169 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.169 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.169 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3490 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.169 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.103981+0000", 2024-09-12T16:16:03.169 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.010669411, 2024-09-12T16:16:03.169 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011065652, 2024-09-12T16:16:03.170 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.170 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.170 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.170 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.170 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.170 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.170 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3490 2024-09-12T16:16:03.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.170 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.170 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.170 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.103981+0000", 2024-09-12T16:16:03.170 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.171 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.171 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.171 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.103981+0000", 2024-09-12T16:16:03.171 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.171 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.171 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.171 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.103981+0000", 2024-09-12T16:16:03.171 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2600000000000002e-07 2024-09-12T16:16:03.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.171 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.171 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.171 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.103986+0000", 2024-09-12T16:16:03.171 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5449999999999997e-06 2024-09-12T16:16:03.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.172 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.172 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.103995+0000", 2024-09-12T16:16:03.172 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2699999999999993e-06 2024-09-12T16:16:03.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.172 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.172 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.104002+0000", 2024-09-12T16:16:03.172 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6209999999999998e-06 2024-09-12T16:16:03.172 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.172 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.172 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.173 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:951 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.173 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.109173+0000", 2024-09-12T16:16:03.173 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0054776579999999998, 2024-09-12T16:16:03.173 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059052419999999998, 2024-09-12T16:16:03.173 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.173 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.173 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.173 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.173 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.173 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.173 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 951 2024-09-12T16:16:03.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.173 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.174 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.174 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109173+0000", 2024-09-12T16:16:03.174 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.174 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.174 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109173+0000", 2024-09-12T16:16:03.174 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.174 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.174 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109173+0000", 2024-09-12T16:16:03.174 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1800000000000004e-07 2024-09-12T16:16:03.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.175 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.175 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109180+0000", 2024-09-12T16:16:03.175 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3400000000000003e-06 2024-09-12T16:16:03.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.175 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.175 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109188+0000", 2024-09-12T16:16:03.175 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6160000000000002e-06 2024-09-12T16:16:03.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.175 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.175 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109195+0000", 2024-09-12T16:16:03.176 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5769999999999999e-06 2024-09-12T16:16:03.176 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.176 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.176 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.176 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.176 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3530 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.176 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.112494+0000", 2024-09-12T16:16:03.176 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0021564520000000001, 2024-09-12T16:16:03.176 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0026170939999999999, 2024-09-12T16:16:03.176 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.176 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.176 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.176 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.177 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.177 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.177 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3530 2024-09-12T16:16:03.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.177 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.177 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.177 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.112494+0000", 2024-09-12T16:16:03.177 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.177 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.177 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.112494+0000", 2024-09-12T16:16:03.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.178 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.178 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.112495+0000", 2024-09-12T16:16:03.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4900000000000004e-07 2024-09-12T16:16:03.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.178 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.178 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.112499+0000", 2024-09-12T16:16:03.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4479999999999996e-06 2024-09-12T16:16:03.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.178 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.178 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.112513+0000", 2024-09-12T16:16:03.179 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3856000000000001e-05 2024-09-12T16:16:03.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.179 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.179 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.112520+0000", 2024-09-12T16:16:03.179 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9739999999999996e-06 2024-09-12T16:16:03.179 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.179 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.179 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.179 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:919 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.179 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.098873+0000", 2024-09-12T16:16:03.179 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.015777253000000001, 2024-09-12T16:16:03.179 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016265410000000001, 2024-09-12T16:16:03.179 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.180 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.180 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.180 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.180 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.180 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.180 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 919 2024-09-12T16:16:03.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.180 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.180 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.180 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.098873+0000", 2024-09-12T16:16:03.180 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.181 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.181 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.098873+0000", 2024-09-12T16:16:03.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.181 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.181 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.098874+0000", 2024-09-12T16:16:03.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8700000000000005e-07 2024-09-12T16:16:03.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.181 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.181 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.098877+0000", 2024-09-12T16:16:03.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.613e-06 2024-09-12T16:16:03.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.182 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.182 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.182 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.098884+0000", 2024-09-12T16:16:03.182 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0450000000000003e-06 2024-09-12T16:16:03.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.182 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.182 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.182 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.098889+0000", 2024-09-12T16:16:03.182 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.155e-06 2024-09-12T16:16:03.182 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.182 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.182 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.183 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.183 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3512 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.183 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.109199+0000", 2024-09-12T16:16:03.183 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0054510080000000002, 2024-09-12T16:16:03.183 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059657879999999996, 2024-09-12T16:16:03.183 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.183 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.183 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.183 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.183 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.183 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.183 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3512 2024-09-12T16:16:03.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.184 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.184 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.184 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.184 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109199+0000", 2024-09-12T16:16:03.184 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.184 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.184 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.184 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109199+0000", 2024-09-12T16:16:03.184 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.184 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.184 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.185 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109200+0000", 2024-09-12T16:16:03.185 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9399999999999995e-07 2024-09-12T16:16:03.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.185 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.185 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.185 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109210+0000", 2024-09-12T16:16:03.185 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0575e-05 2024-09-12T16:16:03.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.185 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.185 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.185 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109218+0000", 2024-09-12T16:16:03.185 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6909999999999997e-06 2024-09-12T16:16:03.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.185 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.186 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.186 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109224+0000", 2024-09-12T16:16:03.186 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0870000000000003e-06 2024-09-12T16:16:03.186 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.186 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.186 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.186 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.186 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:965 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.186 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.112508+0000", 2024-09-12T16:16:03.186 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.002142059, 2024-09-12T16:16:03.186 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0026805650000000002, 2024-09-12T16:16:03.186 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.186 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.186 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.187 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.187 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.187 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.187 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 965 2024-09-12T16:16:03.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.187 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.187 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.187 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.187 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.112508+0000", 2024-09-12T16:16:03.187 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.187 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.187 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.187 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.112508+0000", 2024-09-12T16:16:03.187 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.188 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.188 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.188 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.112509+0000", 2024-09-12T16:16:03.188 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.057e-06 2024-09-12T16:16:03.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.188 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.188 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.188 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.112513+0000", 2024-09-12T16:16:03.188 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1300000000000003e-06 2024-09-12T16:16:03.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.188 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.188 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.189 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.112522+0000", 2024-09-12T16:16:03.189 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9789999999999999e-06 2024-09-12T16:16:03.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.189 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.189 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.189 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.112529+0000", 2024-09-12T16:16:03.189 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1080000000000004e-06 2024-09-12T16:16:03.189 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.189 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.189 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.189 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.189 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3475 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.189 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.099469+0000", 2024-09-12T16:16:03.190 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.015181009000000001, 2024-09-12T16:16:03.190 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015753443999999998, 2024-09-12T16:16:03.190 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.190 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.190 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.190 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.190 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.190 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.190 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3475 2024-09-12T16:16:03.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.190 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.190 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.190 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.190 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.099469+0000", 2024-09-12T16:16:03.190 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.191 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.191 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.099469+0000", 2024-09-12T16:16:03.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.191 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.191 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.099470+0000", 2024-09-12T16:16:03.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.37e-07 2024-09-12T16:16:03.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.191 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.192 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.099473+0000", 2024-09-12T16:16:03.192 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.591e-06 2024-09-12T16:16:03.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.192 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.192 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.099481+0000", 2024-09-12T16:16:03.192 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2479999999999999e-06 2024-09-12T16:16:03.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.192 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.192 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.099485+0000", 2024-09-12T16:16:03.192 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2019999999999997e-06 2024-09-12T16:16:03.192 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.192 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.192 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.193 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:935 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.193 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.104055+0000", 2024-09-12T16:16:03.193 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.010595274, 2024-09-12T16:16:03.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011191853, 2024-09-12T16:16:03.193 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.193 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.193 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.193 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.193 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.193 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.193 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 935 2024-09-12T16:16:03.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.194 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.104055+0000", 2024-09-12T16:16:03.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.104055+0000", 2024-09-12T16:16:03.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.104056+0000", 2024-09-12T16:16:03.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6899999999999996e-07 2024-09-12T16:16:03.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.104060+0000", 2024-09-12T16:16:03.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.946e-06 2024-09-12T16:16:03.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.104070+0000", 2024-09-12T16:16:03.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0275000000000001e-05 2024-09-12T16:16:03.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.196 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.196 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.104077+0000", 2024-09-12T16:16:03.196 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4730000000000003e-06 2024-09-12T16:16:03.196 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.196 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.196 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.196 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3513 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.196 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.109233+0000", 2024-09-12T16:16:03.196 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0054168719999999997, 2024-09-12T16:16:03.196 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0060364520000000003, 2024-09-12T16:16:03.197 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.197 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.197 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.197 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.197 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.197 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.197 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3513 2024-09-12T16:16:03.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.197 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.197 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109233+0000", 2024-09-12T16:16:03.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109233+0000", 2024-09-12T16:16:03.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109234+0000", 2024-09-12T16:16:03.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0200000000000002e-07 2024-09-12T16:16:03.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109240+0000", 2024-09-12T16:16:03.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7899999999999996e-06 2024-09-12T16:16:03.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109246+0000", 2024-09-12T16:16:03.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6880000000000002e-06 2024-09-12T16:16:03.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109252+0000", 2024-09-12T16:16:03.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1529999999999996e-06 2024-09-12T16:16:03.199 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.199 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.199 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.199 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:966 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.199 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.113253+0000", 2024-09-12T16:16:03.200 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0013968979999999999, 2024-09-12T16:16:03.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020389760000000001, 2024-09-12T16:16:03.200 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.200 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.200 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.200 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.200 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.200 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.200 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 966 2024-09-12T16:16:03.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.200 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.200 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.200 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.201 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.113253+0000", 2024-09-12T16:16:03.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.201 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.201 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.113253+0000", 2024-09-12T16:16:03.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.201 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.201 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.113254+0000", 2024-09-12T16:16:03.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8199999999999999e-07 2024-09-12T16:16:03.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.202 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.202 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.113257+0000", 2024-09-12T16:16:03.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3349999999999998e-06 2024-09-12T16:16:03.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.202 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.202 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.113268+0000", 2024-09-12T16:16:03.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0234000000000001e-05 2024-09-12T16:16:03.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.202 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.202 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.113274+0000", 2024-09-12T16:16:03.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5599999999999999e-06 2024-09-12T16:16:03.202 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.202 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.203 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.203 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:920 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.203 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.099489+0000", 2024-09-12T16:16:03.203 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.015161101999999999, 2024-09-12T16:16:03.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015826955, 2024-09-12T16:16:03.203 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.203 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.203 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.203 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.203 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.203 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.203 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 920 2024-09-12T16:16:03.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.204 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.099489+0000", 2024-09-12T16:16:03.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.099489+0000", 2024-09-12T16:16:03.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.099490+0000", 2024-09-12T16:16:03.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0410000000000001e-06 2024-09-12T16:16:03.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.099495+0000", 2024-09-12T16:16:03.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7929999999999997e-06 2024-09-12T16:16:03.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.099504+0000", 2024-09-12T16:16:03.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7960000000000001e-06 2024-09-12T16:16:03.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.099511+0000", 2024-09-12T16:16:03.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7929999999999998e-06 2024-09-12T16:16:03.206 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.206 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.206 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.206 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3491 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.206 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.104236+0000", 2024-09-12T16:16:03.206 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.010413886000000001, 2024-09-12T16:16:03.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011115577, 2024-09-12T16:16:03.206 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.206 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.207 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.207 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.207 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.207 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.207 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3491 2024-09-12T16:16:03.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.207 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.104236+0000", 2024-09-12T16:16:03.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.104236+0000", 2024-09-12T16:16:03.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.104237+0000", 2024-09-12T16:16:03.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.23e-07 2024-09-12T16:16:03.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.104241+0000", 2024-09-12T16:16:03.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2459999999999997e-06 2024-09-12T16:16:03.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.104251+0000", 2024-09-12T16:16:03.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0023999999999999e-05 2024-09-12T16:16:03.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.104258+0000", 2024-09-12T16:16:03.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4189999999999999e-06 2024-09-12T16:16:03.209 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.209 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.209 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.209 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3514 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.210 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.109259+0000", 2024-09-12T16:16:03.210 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0053908430000000002, 2024-09-12T16:16:03.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0061172739999999998, 2024-09-12T16:16:03.210 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.210 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.210 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.210 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.210 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.210 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.210 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3514 2024-09-12T16:16:03.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.210 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109259+0000", 2024-09-12T16:16:03.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109259+0000", 2024-09-12T16:16:03.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109260+0000", 2024-09-12T16:16:03.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1399999999999997e-07 2024-09-12T16:16:03.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109262+0000", 2024-09-12T16:16:03.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6350000000000002e-06 2024-09-12T16:16:03.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109269+0000", 2024-09-12T16:16:03.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5919999999999997e-06 2024-09-12T16:16:03.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109274+0000", 2024-09-12T16:16:03.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1789999999999999e-06 2024-09-12T16:16:03.213 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.213 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.213 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.213 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3531 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.213 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.113269+0000", 2024-09-12T16:16:03.213 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.001381497, 2024-09-12T16:16:03.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0021306480000000002, 2024-09-12T16:16:03.213 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.213 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.213 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.213 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.213 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.213 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.214 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3531 2024-09-12T16:16:03.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.214 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.214 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.113269+0000", 2024-09-12T16:16:03.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.214 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.113269+0000", 2024-09-12T16:16:03.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.113269+0000", 2024-09-12T16:16:03.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8999999999999996e-07 2024-09-12T16:16:03.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.113273+0000", 2024-09-12T16:16:03.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.031e-06 2024-09-12T16:16:03.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.113281+0000", 2024-09-12T16:16:03.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6979999999999998e-06 2024-09-12T16:16:03.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.113287+0000", 2024-09-12T16:16:03.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7259999999999999e-06 2024-09-12T16:16:03.216 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.216 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.216 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.216 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3476 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.216 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.099756+0000", 2024-09-12T16:16:03.216 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.014894332999999999, 2024-09-12T16:16:03.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015666341, 2024-09-12T16:16:03.217 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.217 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.217 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.217 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.217 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.217 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.217 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3476 2024-09-12T16:16:03.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.217 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.099756+0000", 2024-09-12T16:16:03.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.099756+0000", 2024-09-12T16:16:03.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.099757+0000", 2024-09-12T16:16:03.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2699999999999999e-07 2024-09-12T16:16:03.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.099760+0000", 2024-09-12T16:16:03.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6710000000000001e-06 2024-09-12T16:16:03.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.099767+0000", 2024-09-12T16:16:03.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1620000000000002e-06 2024-09-12T16:16:03.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.099772+0000", 2024-09-12T16:16:03.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1710000000000004e-06 2024-09-12T16:16:03.220 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.220 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.220 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.220 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:936 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.220 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.104265+0000", 2024-09-12T16:16:03.220 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.010385365000000001, 2024-09-12T16:16:03.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011194585999999999, 2024-09-12T16:16:03.220 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.220 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.220 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.220 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.220 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.221 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.221 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 936 2024-09-12T16:16:03.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.221 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.104265+0000", 2024-09-12T16:16:03.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.104265+0000", 2024-09-12T16:16:03.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.104266+0000", 2024-09-12T16:16:03.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0699999999999996e-07 2024-09-12T16:16:03.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.104269+0000", 2024-09-12T16:16:03.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8550000000000004e-06 2024-09-12T16:16:03.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.104277+0000", 2024-09-12T16:16:03.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3309999999999998e-06 2024-09-12T16:16:03.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.223 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.104282+0000", 2024-09-12T16:16:03.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9259999999999999e-06 2024-09-12T16:16:03.223 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.223 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.223 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.223 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3515 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.223 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.109281+0000", 2024-09-12T16:16:03.223 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0053691679999999997, 2024-09-12T16:16:03.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0062098659999999997, 2024-09-12T16:16:03.224 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.224 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.224 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.224 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.224 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.224 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.224 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3515 2024-09-12T16:16:03.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.224 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109281+0000", 2024-09-12T16:16:03.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109281+0000", 2024-09-12T16:16:03.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109282+0000", 2024-09-12T16:16:03.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1399999999999997e-07 2024-09-12T16:16:03.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109284+0000", 2024-09-12T16:16:03.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4030000000000001e-06 2024-09-12T16:16:03.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109291+0000", 2024-09-12T16:16:03.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4279999999999999e-06 2024-09-12T16:16:03.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109297+0000", 2024-09-12T16:16:03.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1030000000000001e-06 2024-09-12T16:16:03.226 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.226 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.227 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.227 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3532 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.227 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.113389+0000", 2024-09-12T16:16:03.227 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0012610290000000001, 2024-09-12T16:16:03.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0021276820000000001, 2024-09-12T16:16:03.227 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.227 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.227 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.227 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.227 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.227 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.227 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3532 2024-09-12T16:16:03.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.228 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.113389+0000", 2024-09-12T16:16:03.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.113389+0000", 2024-09-12T16:16:03.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.113390+0000", 2024-09-12T16:16:03.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7800000000000001e-07 2024-09-12T16:16:03.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.113393+0000", 2024-09-12T16:16:03.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6090000000000001e-06 2024-09-12T16:16:03.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.113403+0000", 2024-09-12T16:16:03.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3049999999999998e-06 2024-09-12T16:16:03.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.113409+0000", 2024-09-12T16:16:03.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9560000000000002e-06 2024-09-12T16:16:03.230 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.230 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.230 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.230 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:921 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.230 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.099770+0000", 2024-09-12T16:16:03.230 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.014880414999999999, 2024-09-12T16:16:03.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015771696000000002, 2024-09-12T16:16:03.230 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.230 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.230 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.230 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.230 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.230 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.231 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 921 2024-09-12T16:16:03.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.231 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.099770+0000", 2024-09-12T16:16:03.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.099770+0000", 2024-09-12T16:16:03.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.099771+0000", 2024-09-12T16:16:03.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.093e-06 2024-09-12T16:16:03.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.099775+0000", 2024-09-12T16:16:03.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6110000000000004e-06 2024-09-12T16:16:03.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.099784+0000", 2024-09-12T16:16:03.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7180000000000002e-06 2024-09-12T16:16:03.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.099791+0000", 2024-09-12T16:16:03.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4309999999999999e-06 2024-09-12T16:16:03.233 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.233 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.233 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.233 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3516 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.233 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.109665+0000", 2024-09-12T16:16:03.233 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.004985588, 2024-09-12T16:16:03.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.005908071, 2024-09-12T16:16:03.234 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.234 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.234 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.234 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.234 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.234 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.234 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3516 2024-09-12T16:16:03.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.234 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109665+0000", 2024-09-12T16:16:03.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109665+0000", 2024-09-12T16:16:03.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109666+0000", 2024-09-12T16:16:03.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4600000000000003e-07 2024-09-12T16:16:03.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109670+0000", 2024-09-12T16:16:03.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3150000000000002e-06 2024-09-12T16:16:03.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109681+0000", 2024-09-12T16:16:03.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1415e-05 2024-09-12T16:16:03.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109688+0000", 2024-09-12T16:16:03.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0480000000000001e-06 2024-09-12T16:16:03.237 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.237 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.237 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.237 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:967 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.237 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.113407+0000", 2024-09-12T16:16:03.237 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.001243028, 2024-09-12T16:16:03.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0021955149999999999, 2024-09-12T16:16:03.237 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.237 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.237 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.237 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.238 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.238 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.238 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 967 2024-09-12T16:16:03.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.238 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.238 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.113407+0000", 2024-09-12T16:16:03.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.238 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.113407+0000", 2024-09-12T16:16:03.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.113408+0000", 2024-09-12T16:16:03.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2600000000000002e-07 2024-09-12T16:16:03.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.113412+0000", 2024-09-12T16:16:03.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.89e-06 2024-09-12T16:16:03.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.113420+0000", 2024-09-12T16:16:03.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9149999999999996e-06 2024-09-12T16:16:03.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.113426+0000", 2024-09-12T16:16:03.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0329999999999997e-06 2024-09-12T16:16:03.240 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.240 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.240 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.240 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3477 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.241 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.100413+0000", 2024-09-12T16:16:03.241 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.014237497, 2024-09-12T16:16:03.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015225635, 2024-09-12T16:16:03.241 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.241 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.241 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.241 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.241 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.241 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.241 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3477 2024-09-12T16:16:03.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.241 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100413+0000", 2024-09-12T16:16:03.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100413+0000", 2024-09-12T16:16:03.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100414+0000", 2024-09-12T16:16:03.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7000000000000003e-07 2024-09-12T16:16:03.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100418+0000", 2024-09-12T16:16:03.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4279999999999998e-06 2024-09-12T16:16:03.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100428+0000", 2024-09-12T16:16:03.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7610000000000002e-06 2024-09-12T16:16:03.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100435+0000", 2024-09-12T16:16:03.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7830000000000001e-06 2024-09-12T16:16:03.244 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.244 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.244 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.244 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3492 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.244 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.105210+0000", 2024-09-12T16:16:03.244 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0094406049999999995, 2024-09-12T16:16:03.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010453951, 2024-09-12T16:16:03.244 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.244 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.244 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.245 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.245 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.245 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.245 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3492 2024-09-12T16:16:03.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.245 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105210+0000", 2024-09-12T16:16:03.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105210+0000", 2024-09-12T16:16:03.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105210+0000", 2024-09-12T16:16:03.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2399999999999997e-07 2024-09-12T16:16:03.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105214+0000", 2024-09-12T16:16:03.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9809999999999997e-06 2024-09-12T16:16:03.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105222+0000", 2024-09-12T16:16:03.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6249999999999998e-06 2024-09-12T16:16:03.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105226+0000", 2024-09-12T16:16:03.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2089999999999999e-06 2024-09-12T16:16:03.247 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.247 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.247 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.248 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:952 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.248 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.109682+0000", 2024-09-12T16:16:03.248 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.004968147, 2024-09-12T16:16:03.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0060166280000000004, 2024-09-12T16:16:03.248 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.248 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.248 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.248 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.248 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.248 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.248 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 952 2024-09-12T16:16:03.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.249 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109682+0000", 2024-09-12T16:16:03.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109682+0000", 2024-09-12T16:16:03.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109683+0000", 2024-09-12T16:16:03.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9100000000000003e-07 2024-09-12T16:16:03.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.250 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109687+0000", 2024-09-12T16:16:03.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9389999999999999e-06 2024-09-12T16:16:03.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.250 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109694+0000", 2024-09-12T16:16:03.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2119999999999997e-06 2024-09-12T16:16:03.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109698+0000", 2024-09-12T16:16:03.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1579999999999998e-06 2024-09-12T16:16:03.251 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.251 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.251 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.251 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3533 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.251 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.113640+0000", 2024-09-12T16:16:03.251 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0010098749999999999, 2024-09-12T16:16:03.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020819599999999999, 2024-09-12T16:16:03.251 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.252 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.252 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.252 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.252 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.252 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.252 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3533 2024-09-12T16:16:03.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.252 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.113640+0000", 2024-09-12T16:16:03.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.113640+0000", 2024-09-12T16:16:03.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.113641+0000", 2024-09-12T16:16:03.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9999999999999997e-07 2024-09-12T16:16:03.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.113644+0000", 2024-09-12T16:16:03.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.304e-06 2024-09-12T16:16:03.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.113651+0000", 2024-09-12T16:16:03.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9160000000000004e-06 2024-09-12T16:16:03.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.113656+0000", 2024-09-12T16:16:03.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7389999999999999e-06 2024-09-12T16:16:03.254 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.254 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.254 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.255 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:922 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.255 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.100472+0000", 2024-09-12T16:16:03.255 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.014178392, 2024-09-12T16:16:03.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.01527335, 2024-09-12T16:16:03.255 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.255 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.255 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.255 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.255 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.255 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.255 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 922 2024-09-12T16:16:03.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.256 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100472+0000", 2024-09-12T16:16:03.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100472+0000", 2024-09-12T16:16:03.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100473+0000", 2024-09-12T16:16:03.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1699999999999997e-07 2024-09-12T16:16:03.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100476+0000", 2024-09-12T16:16:03.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6990000000000001e-06 2024-09-12T16:16:03.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100483+0000", 2024-09-12T16:16:03.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.17e-06 2024-09-12T16:16:03.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100487+0000", 2024-09-12T16:16:03.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0559999999999998e-06 2024-09-12T16:16:03.258 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.258 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.258 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.258 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:937 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.258 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.105232+0000", 2024-09-12T16:16:03.258 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0094182699999999994, 2024-09-12T16:16:03.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010536349, 2024-09-12T16:16:03.259 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.259 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.259 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.259 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.259 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.259 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.259 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 937 2024-09-12T16:16:03.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.259 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105232+0000", 2024-09-12T16:16:03.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105232+0000", 2024-09-12T16:16:03.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105233+0000", 2024-09-12T16:16:03.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.037e-06 2024-09-12T16:16:03.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105238+0000", 2024-09-12T16:16:03.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6789999999999996e-06 2024-09-12T16:16:03.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105247+0000", 2024-09-12T16:16:03.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2920000000000001e-06 2024-09-12T16:16:03.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105254+0000", 2024-09-12T16:16:03.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6619999999999999e-06 2024-09-12T16:16:03.261 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.261 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.261 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.262 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3517 3.6 3.e7ab946 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.262 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.109707+0000", 2024-09-12T16:16:03.262 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0049431170000000003, 2024-09-12T16:16:03.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0060842520000000001, 2024-09-12T16:16:03.262 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.262 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.262 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.262 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.262 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.262 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.262 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3517 2024-09-12T16:16:03.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.263 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109707+0000", 2024-09-12T16:16:03.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109707+0000", 2024-09-12T16:16:03.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109708+0000", 2024-09-12T16:16:03.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9500000000000001e-07 2024-09-12T16:16:03.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109712+0000", 2024-09-12T16:16:03.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5750000000000001e-06 2024-09-12T16:16:03.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109720+0000", 2024-09-12T16:16:03.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1980000000000001e-06 2024-09-12T16:16:03.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109726+0000", 2024-09-12T16:16:03.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1240000000000002e-06 2024-09-12T16:16:03.265 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.265 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.265 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.265 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:968 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.265 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.113668+0000", 2024-09-12T16:16:03.265 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.00098249199999999996, 2024-09-12T16:16:03.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0021520319999999999, 2024-09-12T16:16:03.265 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.265 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.266 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.266 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.266 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.266 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.266 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 968 2024-09-12T16:16:03.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.266 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.113668+0000", 2024-09-12T16:16:03.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.113668+0000", 2024-09-12T16:16:03.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.113668+0000", 2024-09-12T16:16:03.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1600000000000001e-07 2024-09-12T16:16:03.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.113672+0000", 2024-09-12T16:16:03.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7720000000000001e-06 2024-09-12T16:16:03.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.113678+0000", 2024-09-12T16:16:03.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3339999999999998e-06 2024-09-12T16:16:03.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.113682+0000", 2024-09-12T16:16:03.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6279999999999998e-06 2024-09-12T16:16:03.268 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.268 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.268 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.268 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3478 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.268 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.100574+0000", 2024-09-12T16:16:03.268 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.014076040999999999, 2024-09-12T16:16:03.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015276346, 2024-09-12T16:16:03.269 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.269 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.269 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.269 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.269 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.269 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.269 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3478 2024-09-12T16:16:03.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.269 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100574+0000", 2024-09-12T16:16:03.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100574+0000", 2024-09-12T16:16:03.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100575+0000", 2024-09-12T16:16:03.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2399999999999997e-07 2024-09-12T16:16:03.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100579+0000", 2024-09-12T16:16:03.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6710000000000001e-06 2024-09-12T16:16:03.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100587+0000", 2024-09-12T16:16:03.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9080000000000001e-06 2024-09-12T16:16:03.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100591+0000", 2024-09-12T16:16:03.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0369999999999996e-06 2024-09-12T16:16:03.271 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.271 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.271 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.272 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3494 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.272 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.105557+0000", 2024-09-12T16:16:03.272 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0090935679999999998, 2024-09-12T16:16:03.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010317227, 2024-09-12T16:16:03.272 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.272 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.272 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.272 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.272 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.272 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.272 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3494 2024-09-12T16:16:03.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.273 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105557+0000", 2024-09-12T16:16:03.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105557+0000", 2024-09-12T16:16:03.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105557+0000", 2024-09-12T16:16:03.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6499999999999999e-07 2024-09-12T16:16:03.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105561+0000", 2024-09-12T16:16:03.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.456e-06 2024-09-12T16:16:03.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105568+0000", 2024-09-12T16:16:03.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5630000000000003e-06 2024-09-12T16:16:03.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105572+0000", 2024-09-12T16:16:03.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1710000000000004e-06 2024-09-12T16:16:03.275 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.275 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.275 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.275 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:953 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.275 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.109828+0000", 2024-09-12T16:16:03.275 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0048224829999999998, 2024-09-12T16:16:03.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.006070977, 2024-09-12T16:16:03.276 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.276 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.276 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.276 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.276 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.276 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.276 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 953 2024-09-12T16:16:03.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.276 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109828+0000", 2024-09-12T16:16:03.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109828+0000", 2024-09-12T16:16:03.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109828+0000", 2024-09-12T16:16:03.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8700000000000005e-07 2024-09-12T16:16:03.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109833+0000", 2024-09-12T16:16:03.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3259999999999997e-06 2024-09-12T16:16:03.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109842+0000", 2024-09-12T16:16:03.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7450000000000001e-06 2024-09-12T16:16:03.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109848+0000", 2024-09-12T16:16:03.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3609999999999997e-06 2024-09-12T16:16:03.278 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.279 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.279 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.279 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:908 3.6 3:629d5e70:::rbd_header.11557ed36bb5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.279 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.094466+0000", 2024-09-12T16:16:03.279 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.020184079000000001, 2024-09-12T16:16:03.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021474713999999999, 2024-09-12T16:16:03.279 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.279 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.279 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:03.279 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.279 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.279 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.280 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 908 2024-09-12T16:16:03.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.280 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.094466+0000", 2024-09-12T16:16:03.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.094466+0000", 2024-09-12T16:16:03.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.094467+0000", 2024-09-12T16:16:03.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6000000000000002e-07 2024-09-12T16:16:03.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.094471+0000", 2024-09-12T16:16:03.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3749999999999996e-06 2024-09-12T16:16:03.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.094480+0000", 2024-09-12T16:16:03.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7490000000000004e-06 2024-09-12T16:16:03.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.094487+0000", 2024-09-12T16:16:03.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6139999999999997e-06 2024-09-12T16:16:03.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:03.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.115845+0000", 2024-09-12T16:16:03.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021358391000000001 2024-09-12T16:16:03.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:03.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.115878+0000", 2024-09-12T16:16:03.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2836000000000002e-05 2024-09-12T16:16:03.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:03.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.115941+0000", 2024-09-12T16:16:03.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2889e-05 2024-09-12T16:16:03.283 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.283 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.283 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.283 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:923 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.283 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.100601+0000", 2024-09-12T16:16:03.283 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.014049272999999999, 2024-09-12T16:16:03.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015373405, 2024-09-12T16:16:03.284 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.284 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.284 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.284 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.284 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.284 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.284 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 923 2024-09-12T16:16:03.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.284 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100601+0000", 2024-09-12T16:16:03.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100601+0000", 2024-09-12T16:16:03.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100602+0000", 2024-09-12T16:16:03.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.029e-06 2024-09-12T16:16:03.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100608+0000", 2024-09-12T16:16:03.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7529999999999998e-06 2024-09-12T16:16:03.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100616+0000", 2024-09-12T16:16:03.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5420000000000005e-06 2024-09-12T16:16:03.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100622+0000", 2024-09-12T16:16:03.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1589999999999998e-06 2024-09-12T16:16:03.286 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.286 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.287 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.287 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:938 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.287 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.105563+0000", 2024-09-12T16:16:03.287 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0090868489999999993, 2024-09-12T16:16:03.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010434238, 2024-09-12T16:16:03.287 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.287 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.287 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.287 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.287 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.287 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.287 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 938 2024-09-12T16:16:03.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.288 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105563+0000", 2024-09-12T16:16:03.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105563+0000", 2024-09-12T16:16:03.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105564+0000", 2024-09-12T16:16:03.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0699999999999999e-06 2024-09-12T16:16:03.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105569+0000", 2024-09-12T16:16:03.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4000000000000002e-06 2024-09-12T16:16:03.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105577+0000", 2024-09-12T16:16:03.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3299999999999999e-06 2024-09-12T16:16:03.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105583+0000", 2024-09-12T16:16:03.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0349999999999998e-06 2024-09-12T16:16:03.290 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.290 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.290 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.290 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3518 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.290 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.109837+0000", 2024-09-12T16:16:03.290 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0048129560000000002, 2024-09-12T16:16:03.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0061831999999999998, 2024-09-12T16:16:03.290 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.290 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.291 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.291 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.291 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.291 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.291 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3518 2024-09-12T16:16:03.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.291 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109837+0000", 2024-09-12T16:16:03.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109837+0000", 2024-09-12T16:16:03.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109838+0000", 2024-09-12T16:16:03.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.111e-06 2024-09-12T16:16:03.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109842+0000", 2024-09-12T16:16:03.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1289999999999998e-06 2024-09-12T16:16:03.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109853+0000", 2024-09-12T16:16:03.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0159999999999999e-05 2024-09-12T16:16:03.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109859+0000", 2024-09-12T16:16:03.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7020000000000004e-06 2024-09-12T16:16:03.293 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.293 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.293 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.293 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3464 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.293 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.094615+0000", 2024-09-12T16:16:03.294 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.020035516999999999, 2024-09-12T16:16:03.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021430703999999998, 2024-09-12T16:16:03.294 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.294 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.294 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.294 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.294 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.294 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.294 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3464 2024-09-12T16:16:03.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.294 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.094615+0000", 2024-09-12T16:16:03.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.094615+0000", 2024-09-12T16:16:03.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.094616+0000", 2024-09-12T16:16:03.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4099999999999997e-07 2024-09-12T16:16:03.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.094620+0000", 2024-09-12T16:16:03.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2390000000000004e-06 2024-09-12T16:16:03.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.094629+0000", 2024-09-12T16:16:03.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0389999999999993e-06 2024-09-12T16:16:03.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.094636+0000", 2024-09-12T16:16:03.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.486e-06 2024-09-12T16:16:03.296 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.296 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.297 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.297 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3479 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.297 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.100753+0000", 2024-09-12T16:16:03.297 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.013896830000000001, 2024-09-12T16:16:03.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015315145, 2024-09-12T16:16:03.297 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.297 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.297 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.297 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.297 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.297 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.298 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3479 2024-09-12T16:16:03.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.298 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100753+0000", 2024-09-12T16:16:03.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100753+0000", 2024-09-12T16:16:03.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100754+0000", 2024-09-12T16:16:03.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.47e-07 2024-09-12T16:16:03.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100758+0000", 2024-09-12T16:16:03.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0489999999999997e-06 2024-09-12T16:16:03.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100772+0000", 2024-09-12T16:16:03.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3743e-05 2024-09-12T16:16:03.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.300 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100780+0000", 2024-09-12T16:16:03.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1119999999999996e-06 2024-09-12T16:16:03.300 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.300 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.300 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.300 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3495 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.300 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.105782+0000", 2024-09-12T16:16:03.300 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0088684499999999999, 2024-09-12T16:16:03.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010310688, 2024-09-12T16:16:03.301 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.301 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.301 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.301 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.301 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.301 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.301 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3495 2024-09-12T16:16:03.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.301 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105782+0000", 2024-09-12T16:16:03.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105782+0000", 2024-09-12T16:16:03.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105782+0000", 2024-09-12T16:16:03.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6400000000000001e-07 2024-09-12T16:16:03.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105786+0000", 2024-09-12T16:16:03.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4060000000000001e-06 2024-09-12T16:16:03.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105793+0000", 2024-09-12T16:16:03.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5730000000000002e-06 2024-09-12T16:16:03.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105797+0000", 2024-09-12T16:16:03.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9060000000000004e-06 2024-09-12T16:16:03.303 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.303 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.303 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.303 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3519 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.303 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.109980+0000", 2024-09-12T16:16:03.303 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0046697780000000003, 2024-09-12T16:16:03.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0061351019999999999, 2024-09-12T16:16:03.304 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.304 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.304 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.304 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.304 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.304 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.304 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3519 2024-09-12T16:16:03.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.304 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.304 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.304 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109980+0000", 2024-09-12T16:16:03.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109980+0000", 2024-09-12T16:16:03.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109981+0000", 2024-09-12T16:16:03.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8599999999999997e-07 2024-09-12T16:16:03.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109986+0000", 2024-09-12T16:16:03.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4900000000000002e-06 2024-09-12T16:16:03.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109996+0000", 2024-09-12T16:16:03.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0176999999999999e-05 2024-09-12T16:16:03.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110003+0000", 2024-09-12T16:16:03.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.596e-06 2024-09-12T16:16:03.306 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.307 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.307 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.307 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:924 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.307 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.100763+0000", 2024-09-12T16:16:03.307 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.013887213000000001, 2024-09-12T16:16:03.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.01537619, 2024-09-12T16:16:03.307 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.307 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.307 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.307 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.307 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.307 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.308 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 924 2024-09-12T16:16:03.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.308 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100763+0000", 2024-09-12T16:16:03.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100763+0000", 2024-09-12T16:16:03.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100764+0000", 2024-09-12T16:16:03.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2200000000000003e-07 2024-09-12T16:16:03.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100767+0000", 2024-09-12T16:16:03.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3610000000000001e-06 2024-09-12T16:16:03.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100774+0000", 2024-09-12T16:16:03.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.968e-06 2024-09-12T16:16:03.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100779+0000", 2024-09-12T16:16:03.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8420000000000004e-06 2024-09-12T16:16:03.310 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.310 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.310 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.310 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:939 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.310 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.105800+0000", 2024-09-12T16:16:03.310 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0088504259999999998, 2024-09-12T16:16:03.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010381670000000001, 2024-09-12T16:16:03.310 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.310 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.311 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.311 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.311 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.311 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.311 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 939 2024-09-12T16:16:03.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.311 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105800+0000", 2024-09-12T16:16:03.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105800+0000", 2024-09-12T16:16:03.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105801+0000", 2024-09-12T16:16:03.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8400000000000002e-07 2024-09-12T16:16:03.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105805+0000", 2024-09-12T16:16:03.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3000000000000003e-06 2024-09-12T16:16:03.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105814+0000", 2024-09-12T16:16:03.313 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8249999999999994e-06 2024-09-12T16:16:03.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.313 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.313 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105820+0000", 2024-09-12T16:16:03.313 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5039999999999999e-06 2024-09-12T16:16:03.313 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.313 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.313 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.313 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:954 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.314 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.109997+0000", 2024-09-12T16:16:03.314 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0046530399999999998, 2024-09-12T16:16:03.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0062098520000000001, 2024-09-12T16:16:03.314 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.314 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.314 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.314 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.314 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.314 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.314 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 954 2024-09-12T16:16:03.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.314 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109997+0000", 2024-09-12T16:16:03.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109997+0000", 2024-09-12T16:16:03.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109998+0000", 2024-09-12T16:16:03.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9500000000000001e-07 2024-09-12T16:16:03.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110002+0000", 2024-09-12T16:16:03.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6669999999999998e-06 2024-09-12T16:16:03.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110009+0000", 2024-09-12T16:16:03.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9829999999999999e-06 2024-09-12T16:16:03.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110013+0000", 2024-09-12T16:16:03.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0600000000000001e-06 2024-09-12T16:16:03.317 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.317 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.317 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.317 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3465 3.6 3:629d5e70:::rbd_header.11557ed36bb5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.317 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.094858+0000", 2024-09-12T16:16:03.317 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.019792245, 2024-09-12T16:16:03.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021375471, 2024-09-12T16:16:03.317 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.317 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.317 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:16:03.317 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.317 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.318 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.318 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3465 2024-09-12T16:16:03.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.318 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.318 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.094858+0000", 2024-09-12T16:16:03.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.318 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.094858+0000", 2024-09-12T16:16:03.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.094859+0000", 2024-09-12T16:16:03.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.051e-06 2024-09-12T16:16:03.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.094863+0000", 2024-09-12T16:16:03.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7960000000000002e-06 2024-09-12T16:16:03.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.094872+0000", 2024-09-12T16:16:03.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7620000000000001e-06 2024-09-12T16:16:03.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.094878+0000", 2024-09-12T16:16:03.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2500000000000003e-06 2024-09-12T16:16:03.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:03.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.116200+0000", 2024-09-12T16:16:03.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021322648999999999 2024-09-12T16:16:03.320 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.320 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.320 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.321 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3480 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.321 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.100928+0000", 2024-09-12T16:16:03.321 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.013722541, 2024-09-12T16:16:03.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015333055, 2024-09-12T16:16:03.321 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.321 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.321 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.321 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.321 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.321 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.321 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3480 2024-09-12T16:16:03.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.322 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.322 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.322 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100928+0000", 2024-09-12T16:16:03.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.322 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.322 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100928+0000", 2024-09-12T16:16:03.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.322 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.322 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100929+0000", 2024-09-12T16:16:03.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0839999999999999e-06 2024-09-12T16:16:03.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100932+0000", 2024-09-12T16:16:03.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1650000000000002e-06 2024-09-12T16:16:03.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100939+0000", 2024-09-12T16:16:03.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.525e-06 2024-09-12T16:16:03.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100943+0000", 2024-09-12T16:16:03.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0820000000000001e-06 2024-09-12T16:16:03.324 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.324 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.324 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.324 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3496 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.324 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.105952+0000", 2024-09-12T16:16:03.324 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0086980430000000008, 2024-09-12T16:16:03.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010331865000000001, 2024-09-12T16:16:03.324 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.324 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.324 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.324 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.325 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.325 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.325 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3496 2024-09-12T16:16:03.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.325 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.325 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.325 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105952+0000", 2024-09-12T16:16:03.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.325 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.325 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105952+0000", 2024-09-12T16:16:03.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.326 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105953+0000", 2024-09-12T16:16:03.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0100000000000004e-07 2024-09-12T16:16:03.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.326 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105957+0000", 2024-09-12T16:16:03.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0539999999999996e-06 2024-09-12T16:16:03.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.326 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105965+0000", 2024-09-12T16:16:03.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2470000000000008e-06 2024-09-12T16:16:03.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105972+0000", 2024-09-12T16:16:03.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3790000000000003e-06 2024-09-12T16:16:03.327 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.327 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.327 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.327 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3520 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.327 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.110244+0000", 2024-09-12T16:16:03.328 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0044057430000000002, 2024-09-12T16:16:03.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0060716939999999999, 2024-09-12T16:16:03.328 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.328 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.328 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.328 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.328 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.328 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.328 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3520 2024-09-12T16:16:03.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.328 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110244+0000", 2024-09-12T16:16:03.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110244+0000", 2024-09-12T16:16:03.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110245+0000", 2024-09-12T16:16:03.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5000000000000001e-07 2024-09-12T16:16:03.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110249+0000", 2024-09-12T16:16:03.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0720000000000001e-06 2024-09-12T16:16:03.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110260+0000", 2024-09-12T16:16:03.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0706999999999999e-05 2024-09-12T16:16:03.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110267+0000", 2024-09-12T16:16:03.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5950000000000004e-06 2024-09-12T16:16:03.330 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.330 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.330 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.331 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:910 3.6 3:629d5e70:::rbd_header.11557ed36bb5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.331 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.094930+0000", 2024-09-12T16:16:03.331 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.019720438, 2024-09-12T16:16:03.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021416259, 2024-09-12T16:16:03.331 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.331 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.331 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:16:03.331 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.331 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.331 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.331 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 910 2024-09-12T16:16:03.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.331 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.094930+0000", 2024-09-12T16:16:03.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.094930+0000", 2024-09-12T16:16:03.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.094931+0000", 2024-09-12T16:16:03.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7300000000000004e-07 2024-09-12T16:16:03.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.094935+0000", 2024-09-12T16:16:03.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0389999999999998e-06 2024-09-12T16:16:03.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.094946+0000", 2024-09-12T16:16:03.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1056999999999999e-05 2024-09-12T16:16:03.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.094953+0000", 2024-09-12T16:16:03.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9949999999999999e-06 2024-09-12T16:16:03.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:03.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.116324+0000", 2024-09-12T16:16:03.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021371134999999999 2024-09-12T16:16:03.334 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.334 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.334 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.334 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:925 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.334 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.100951+0000", 2024-09-12T16:16:03.335 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.013698946, 2024-09-12T16:16:03.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015422358000000001, 2024-09-12T16:16:03.335 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.335 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.335 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.335 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.335 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.335 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.335 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 925 2024-09-12T16:16:03.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.335 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100951+0000", 2024-09-12T16:16:03.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100951+0000", 2024-09-12T16:16:03.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100952+0000", 2024-09-12T16:16:03.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.33e-07 2024-09-12T16:16:03.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100956+0000", 2024-09-12T16:16:03.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2230000000000001e-06 2024-09-12T16:16:03.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100967+0000", 2024-09-12T16:16:03.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0375e-05 2024-09-12T16:16:03.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.100977+0000", 2024-09-12T16:16:03.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.781e-06 2024-09-12T16:16:03.337 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.337 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.338 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.338 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:940 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.338 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.105962+0000", 2024-09-12T16:16:03.338 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0086880380000000004, 2024-09-12T16:16:03.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.01043476, 2024-09-12T16:16:03.338 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.338 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.338 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.338 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.339 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.339 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.339 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 940 2024-09-12T16:16:03.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.339 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105962+0000", 2024-09-12T16:16:03.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.340 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105962+0000", 2024-09-12T16:16:03.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.340 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105963+0000", 2024-09-12T16:16:03.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2900000000000002e-07 2024-09-12T16:16:03.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.340 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105967+0000", 2024-09-12T16:16:03.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7969999999999998e-06 2024-09-12T16:16:03.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.341 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105974+0000", 2024-09-12T16:16:03.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0190000000000001e-06 2024-09-12T16:16:03.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.341 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.105978+0000", 2024-09-12T16:16:03.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9840000000000003e-06 2024-09-12T16:16:03.341 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.341 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.341 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.342 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:955 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.342 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.110255+0000", 2024-09-12T16:16:03.342 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0043950919999999997, 2024-09-12T16:16:03.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0061752910000000003, 2024-09-12T16:16:03.342 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.342 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.342 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.342 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.342 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.342 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.342 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 955 2024-09-12T16:16:03.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.342 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110255+0000", 2024-09-12T16:16:03.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110255+0000", 2024-09-12T16:16:03.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110256+0000", 2024-09-12T16:16:03.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0299999999999998e-07 2024-09-12T16:16:03.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110259+0000", 2024-09-12T16:16:03.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.411e-06 2024-09-12T16:16:03.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110267+0000", 2024-09-12T16:16:03.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6399999999999997e-06 2024-09-12T16:16:03.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.345 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110271+0000", 2024-09-12T16:16:03.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.216e-06 2024-09-12T16:16:03.345 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.345 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.345 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.345 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3466 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.345 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.095069+0000", 2024-09-12T16:16:03.345 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.019581629999999999, 2024-09-12T16:16:03.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021388051000000002, 2024-09-12T16:16:03.345 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.346 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.346 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:16:03.346 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.346 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.346 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.346 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3466 2024-09-12T16:16:03.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.346 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.095069+0000", 2024-09-12T16:16:03.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.347 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.095069+0000", 2024-09-12T16:16:03.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.347 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.095069+0000", 2024-09-12T16:16:03.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7899999999999997e-07 2024-09-12T16:16:03.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.347 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.095074+0000", 2024-09-12T16:16:03.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2429999999999999e-06 2024-09-12T16:16:03.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.095091+0000", 2024-09-12T16:16:03.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6949999999999999e-05 2024-09-12T16:16:03.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.095098+0000", 2024-09-12T16:16:03.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2289999999999997e-06 2024-09-12T16:16:03.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:03.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.116456+0000", 2024-09-12T16:16:03.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021357686000000001 2024-09-12T16:16:03.349 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.349 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.349 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.349 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3481 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.349 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.101104+0000", 2024-09-12T16:16:03.349 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.013546617, 2024-09-12T16:16:03.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.01537901, 2024-09-12T16:16:03.349 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.349 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.349 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.350 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.350 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.350 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.350 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3481 2024-09-12T16:16:03.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.350 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.350 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.350 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101104+0000", 2024-09-12T16:16:03.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.350 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.350 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101104+0000", 2024-09-12T16:16:03.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101104+0000", 2024-09-12T16:16:03.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4e-07 2024-09-12T16:16:03.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101108+0000", 2024-09-12T16:16:03.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8800000000000001e-06 2024-09-12T16:16:03.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101116+0000", 2024-09-12T16:16:03.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0020000000000006e-06 2024-09-12T16:16:03.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101122+0000", 2024-09-12T16:16:03.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9769999999999997e-06 2024-09-12T16:16:03.352 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.352 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.352 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.352 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3497 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.352 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.106790+0000", 2024-09-12T16:16:03.353 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0078605410000000004, 2024-09-12T16:16:03.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0097162930000000008, 2024-09-12T16:16:03.353 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.353 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.353 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.353 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.353 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.353 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.353 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3497 2024-09-12T16:16:03.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.353 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.106790+0000", 2024-09-12T16:16:03.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.106790+0000", 2024-09-12T16:16:03.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.106790+0000", 2024-09-12T16:16:03.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2900000000000003e-07 2024-09-12T16:16:03.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.106794+0000", 2024-09-12T16:16:03.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4759999999999998e-06 2024-09-12T16:16:03.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.106802+0000", 2024-09-12T16:16:03.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4239999999999993e-06 2024-09-12T16:16:03.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.106806+0000", 2024-09-12T16:16:03.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1509999999999997e-06 2024-09-12T16:16:03.355 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.355 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.356 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.356 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3521 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.356 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.110402+0000", 2024-09-12T16:16:03.356 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0042485609999999997, 2024-09-12T16:16:03.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0061276719999999998, 2024-09-12T16:16:03.356 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.356 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.356 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.356 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.356 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.356 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.357 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3521 2024-09-12T16:16:03.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.357 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.357 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.357 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110402+0000", 2024-09-12T16:16:03.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.357 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.357 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110402+0000", 2024-09-12T16:16:03.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110403+0000", 2024-09-12T16:16:03.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0500000000000002e-07 2024-09-12T16:16:03.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110407+0000", 2024-09-12T16:16:03.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9859999999999996e-06 2024-09-12T16:16:03.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110418+0000", 2024-09-12T16:16:03.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1129e-05 2024-09-12T16:16:03.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110425+0000", 2024-09-12T16:16:03.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9469999999999997e-06 2024-09-12T16:16:03.359 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.359 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.359 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.359 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:911 3.6 3:629d5e70:::rbd_header.11557ed36bb5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.359 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.095094+0000", 2024-09-12T16:16:03.359 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.019556641999999999, 2024-09-12T16:16:03.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021493178000000002, 2024-09-12T16:16:03.359 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.360 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.360 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:16:03.360 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.360 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.360 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.360 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 911 2024-09-12T16:16:03.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.360 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.095094+0000", 2024-09-12T16:16:03.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.095094+0000", 2024-09-12T16:16:03.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.095094+0000", 2024-09-12T16:16:03.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2500000000000005e-07 2024-09-12T16:16:03.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.095098+0000", 2024-09-12T16:16:03.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4470000000000002e-06 2024-09-12T16:16:03.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.095105+0000", 2024-09-12T16:16:03.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8029999999999999e-06 2024-09-12T16:16:03.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.095108+0000", 2024-09-12T16:16:03.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9580000000000001e-06 2024-09-12T16:16:03.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:03.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.116568+0000", 2024-09-12T16:16:03.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021459801000000001 2024-09-12T16:16:03.363 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.363 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.363 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.363 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:926 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.363 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.101128+0000", 2024-09-12T16:16:03.363 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.013522614000000001, 2024-09-12T16:16:03.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.01548741, 2024-09-12T16:16:03.363 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.363 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.363 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.364 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.364 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.364 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.364 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 926 2024-09-12T16:16:03.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.364 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.364 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101128+0000", 2024-09-12T16:16:03.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101128+0000", 2024-09-12T16:16:03.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101128+0000", 2024-09-12T16:16:03.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5099999999999999e-07 2024-09-12T16:16:03.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101132+0000", 2024-09-12T16:16:03.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6270000000000002e-06 2024-09-12T16:16:03.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101139+0000", 2024-09-12T16:16:03.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0230000000000004e-06 2024-09-12T16:16:03.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101143+0000", 2024-09-12T16:16:03.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8600000000000003e-06 2024-09-12T16:16:03.366 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.366 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.366 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.367 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:941 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.367 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.106848+0000", 2024-09-12T16:16:03.367 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0078023989999999998, 2024-09-12T16:16:03.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0097907910000000001, 2024-09-12T16:16:03.367 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.367 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.367 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.367 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.367 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.367 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.367 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 941 2024-09-12T16:16:03.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.368 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.368 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.368 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.106848+0000", 2024-09-12T16:16:03.368 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.368 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.368 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.106848+0000", 2024-09-12T16:16:03.368 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.368 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.368 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.106849+0000", 2024-09-12T16:16:03.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6899999999999996e-07 2024-09-12T16:16:03.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.106853+0000", 2024-09-12T16:16:03.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6480000000000002e-06 2024-09-12T16:16:03.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.106862+0000", 2024-09-12T16:16:03.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8939999999999999e-06 2024-09-12T16:16:03.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.106869+0000", 2024-09-12T16:16:03.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.759e-06 2024-09-12T16:16:03.370 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.370 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.370 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.370 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:956 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.370 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.110415+0000", 2024-09-12T16:16:03.370 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0042351120000000001, 2024-09-12T16:16:03.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0062571240000000002, 2024-09-12T16:16:03.370 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.370 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.370 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.370 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.371 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.371 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.371 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 956 2024-09-12T16:16:03.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.371 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110415+0000", 2024-09-12T16:16:03.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110415+0000", 2024-09-12T16:16:03.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110416+0000", 2024-09-12T16:16:03.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2020000000000001e-06 2024-09-12T16:16:03.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110421+0000", 2024-09-12T16:16:03.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2869999999999998e-06 2024-09-12T16:16:03.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110429+0000", 2024-09-12T16:16:03.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6600000000000001e-06 2024-09-12T16:16:03.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110436+0000", 2024-09-12T16:16:03.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5729999999999996e-06 2024-09-12T16:16:03.373 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.373 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.373 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.374 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3467 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.374 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.096423+0000", 2024-09-12T16:16:03.374 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.018227520000000001, 2024-09-12T16:16:03.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020274776000000001, 2024-09-12T16:16:03.374 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.374 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.374 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:16:03.374 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.374 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.374 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.374 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3467 2024-09-12T16:16:03.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.375 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.375 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.096423+0000", 2024-09-12T16:16:03.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.375 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.096423+0000", 2024-09-12T16:16:03.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.096424+0000", 2024-09-12T16:16:03.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9100000000000002e-07 2024-09-12T16:16:03.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.376 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.096428+0000", 2024-09-12T16:16:03.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3900000000000003e-06 2024-09-12T16:16:03.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.376 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.096441+0000", 2024-09-12T16:16:03.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2645e-05 2024-09-12T16:16:03.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.096448+0000", 2024-09-12T16:16:03.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7549999999999994e-06 2024-09-12T16:16:03.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:03.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.116694+0000", 2024-09-12T16:16:03.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020246070000000001 2024-09-12T16:16:03.377 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.377 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.377 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.378 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3482 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.378 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.101271+0000", 2024-09-12T16:16:03.378 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.013379576000000001, 2024-09-12T16:16:03.378 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015453797, 2024-09-12T16:16:03.378 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.378 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.378 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.378 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.378 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.378 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.378 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3482 2024-09-12T16:16:03.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.379 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.379 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.379 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101271+0000", 2024-09-12T16:16:03.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.379 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.379 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101271+0000", 2024-09-12T16:16:03.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.379 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101271+0000", 2024-09-12T16:16:03.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9800000000000003e-07 2024-09-12T16:16:03.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101275+0000", 2024-09-12T16:16:03.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2679999999999999e-06 2024-09-12T16:16:03.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101281+0000", 2024-09-12T16:16:03.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7920000000000004e-06 2024-09-12T16:16:03.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101285+0000", 2024-09-12T16:16:03.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8809999999999998e-06 2024-09-12T16:16:03.381 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.381 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.381 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.381 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3498 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.381 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.106949+0000", 2024-09-12T16:16:03.381 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0077010580000000002, 2024-09-12T16:16:03.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0097984679999999994, 2024-09-12T16:16:03.381 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.381 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.381 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.381 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.382 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.382 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.382 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3498 2024-09-12T16:16:03.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.382 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.106949+0000", 2024-09-12T16:16:03.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.106949+0000", 2024-09-12T16:16:03.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.106950+0000", 2024-09-12T16:16:03.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4600000000000004e-07 2024-09-12T16:16:03.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.106954+0000", 2024-09-12T16:16:03.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9249999999999997e-06 2024-09-12T16:16:03.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.106963+0000", 2024-09-12T16:16:03.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7159999999999992e-06 2024-09-12T16:16:03.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.106969+0000", 2024-09-12T16:16:03.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0480000000000004e-06 2024-09-12T16:16:03.384 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.384 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.384 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.384 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3522 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.385 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.110571+0000", 2024-09-12T16:16:03.385 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0040794020000000002, 2024-09-12T16:16:03.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0061997969999999999, 2024-09-12T16:16:03.385 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.385 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.385 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.385 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.385 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.385 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.385 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3522 2024-09-12T16:16:03.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.385 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.385 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110571+0000", 2024-09-12T16:16:03.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.386 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110571+0000", 2024-09-12T16:16:03.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.386 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110572+0000", 2024-09-12T16:16:03.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7000000000000003e-07 2024-09-12T16:16:03.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.387 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.387 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110576+0000", 2024-09-12T16:16:03.387 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0600000000000001e-06 2024-09-12T16:16:03.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.387 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.387 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110586+0000", 2024-09-12T16:16:03.387 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0095000000000001e-05 2024-09-12T16:16:03.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.387 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.387 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110592+0000", 2024-09-12T16:16:03.387 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6719999999999998e-06 2024-09-12T16:16:03.387 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.388 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.388 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.388 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:912 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.388 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.096439+0000", 2024-09-12T16:16:03.388 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.018211077999999999, 2024-09-12T16:16:03.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020366598, 2024-09-12T16:16:03.388 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.388 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.388 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:16:03.388 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.388 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.389 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.389 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 912 2024-09-12T16:16:03.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.389 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.389 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.389 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.096439+0000", 2024-09-12T16:16:03.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.389 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.389 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.096439+0000", 2024-09-12T16:16:03.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.096440+0000", 2024-09-12T16:16:03.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.344e-06 2024-09-12T16:16:03.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.096447+0000", 2024-09-12T16:16:03.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1720000000000004e-06 2024-09-12T16:16:03.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.096458+0000", 2024-09-12T16:16:03.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0953e-05 2024-09-12T16:16:03.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.096465+0000", 2024-09-12T16:16:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1779999999999997e-06 2024-09-12T16:16:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.116800+0000", 2024-09-12T16:16:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020335064999999999 2024-09-12T16:16:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:927 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.101293+0000", 2024-09-12T16:16:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.013356788, 2024-09-12T16:16:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015539656000000001, 2024-09-12T16:16:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 927 2024-09-12T16:16:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101293+0000", 2024-09-12T16:16:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101293+0000", 2024-09-12T16:16:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101294+0000", 2024-09-12T16:16:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0130000000000001e-06 2024-09-12T16:16:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101299+0000", 2024-09-12T16:16:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1049999999999997e-06 2024-09-12T16:16:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101307+0000", 2024-09-12T16:16:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4950000000000008e-06 2024-09-12T16:16:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101313+0000", 2024-09-12T16:16:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3319999999999997e-06 2024-09-12T16:16:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:942 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.106991+0000", 2024-09-12T16:16:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0076590829999999997, 2024-09-12T16:16:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0098650170000000002, 2024-09-12T16:16:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 942 2024-09-12T16:16:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.106991+0000", 2024-09-12T16:16:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.106991+0000", 2024-09-12T16:16:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.106992+0000", 2024-09-12T16:16:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3300000000000001e-07 2024-09-12T16:16:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.106995+0000", 2024-09-12T16:16:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4189999999999998e-06 2024-09-12T16:16:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.107002+0000", 2024-09-12T16:16:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8480000000000003e-06 2024-09-12T16:16:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.107008+0000", 2024-09-12T16:16:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9050000000000002e-06 2024-09-12T16:16:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:957 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.110579+0000", 2024-09-12T16:16:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0040714770000000004, 2024-09-12T16:16:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0063104509999999999, 2024-09-12T16:16:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 957 2024-09-12T16:16:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110579+0000", 2024-09-12T16:16:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110579+0000", 2024-09-12T16:16:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110579+0000", 2024-09-12T16:16:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1999999999999999e-07 2024-09-12T16:16:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110582+0000", 2024-09-12T16:16:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0740000000000001e-06 2024-09-12T16:16:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110590+0000", 2024-09-12T16:16:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.542e-06 2024-09-12T16:16:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110594+0000", 2024-09-12T16:16:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1489999999999996e-06 2024-09-12T16:16:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:913 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.096961+0000", 2024-09-12T16:16:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.017689606, 2024-09-12T16:16:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.019955213999999999, 2024-09-12T16:16:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:16:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 913 2024-09-12T16:16:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.096961+0000", 2024-09-12T16:16:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.096961+0000", 2024-09-12T16:16:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.096962+0000", 2024-09-12T16:16:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.108e-06 2024-09-12T16:16:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.096967+0000", 2024-09-12T16:16:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0209999999999999e-06 2024-09-12T16:16:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.096990+0000", 2024-09-12T16:16:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2938e-05 2024-09-12T16:16:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.096997+0000", 2024-09-12T16:16:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7139999999999993e-06 2024-09-12T16:16:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.116915+0000", 2024-09-12T16:16:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.019917781999999998 2024-09-12T16:16:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.468 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.468 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.468 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3483 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.468 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.101444+0000", 2024-09-12T16:16:03.468 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.013205731, 2024-09-12T16:16:03.468 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015516518999999999, 2024-09-12T16:16:03.468 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.468 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.468 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.468 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3483 2024-09-12T16:16:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101444+0000", 2024-09-12T16:16:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101444+0000", 2024-09-12T16:16:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101445+0000", 2024-09-12T16:16:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3600000000000002e-07 2024-09-12T16:16:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101449+0000", 2024-09-12T16:16:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6969999999999999e-06 2024-09-12T16:16:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101457+0000", 2024-09-12T16:16:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0020000000000006e-06 2024-09-12T16:16:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101463+0000", 2024-09-12T16:16:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8390000000000003e-06 2024-09-12T16:16:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:943 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.107197+0000", 2024-09-12T16:16:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0074536710000000003, 2024-09-12T16:16:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0097878440000000004, 2024-09-12T16:16:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 943 2024-09-12T16:16:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.107197+0000", 2024-09-12T16:16:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.107197+0000", 2024-09-12T16:16:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.107197+0000", 2024-09-12T16:16:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1800000000000004e-07 2024-09-12T16:16:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.107246+0000", 2024-09-12T16:16:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8464000000000002e-05 2024-09-12T16:16:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.107368+0000", 2024-09-12T16:16:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012255400000000001 2024-09-12T16:16:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.107375+0000", 2024-09-12T16:16:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9500000000000004e-06 2024-09-12T16:16:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3523 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.110715+0000", 2024-09-12T16:16:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0039347339999999996, 2024-09-12T16:16:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0062928569999999998, 2024-09-12T16:16:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3523 2024-09-12T16:16:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110715+0000", 2024-09-12T16:16:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110715+0000", 2024-09-12T16:16:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110716+0000", 2024-09-12T16:16:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2500000000000004e-07 2024-09-12T16:16:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110720+0000", 2024-09-12T16:16:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0300000000000004e-06 2024-09-12T16:16:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110730+0000", 2024-09-12T16:16:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8539999999999992e-06 2024-09-12T16:16:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110737+0000", 2024-09-12T16:16:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6880000000000002e-06 2024-09-12T16:16:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3468 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.096998+0000", 2024-09-12T16:16:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.017652246, 2024-09-12T16:16:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020034331999999998, 2024-09-12T16:16:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3468 2024-09-12T16:16:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.096998+0000", 2024-09-12T16:16:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.096998+0000", 2024-09-12T16:16:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.096999+0000", 2024-09-12T16:16:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2299999999999999e-07 2024-09-12T16:16:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.097004+0000", 2024-09-12T16:16:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9579999999999998e-06 2024-09-12T16:16:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.097015+0000", 2024-09-12T16:16:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1071e-05 2024-09-12T16:16:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.097022+0000", 2024-09-12T16:16:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1899999999999998e-06 2024-09-12T16:16:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:928 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.101462+0000", 2024-09-12T16:16:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0131878, 2024-09-12T16:16:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015594692, 2024-09-12T16:16:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 928 2024-09-12T16:16:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101462+0000", 2024-09-12T16:16:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.484 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.484 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101462+0000", 2024-09-12T16:16:03.484 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.484 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.484 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101463+0000", 2024-09-12T16:16:03.484 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4099999999999997e-07 2024-09-12T16:16:03.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101467+0000", 2024-09-12T16:16:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4829999999999999e-06 2024-09-12T16:16:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101474+0000", 2024-09-12T16:16:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8310000000000003e-06 2024-09-12T16:16:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101477+0000", 2024-09-12T16:16:03.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8349999999999997e-06 2024-09-12T16:16:03.486 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.486 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.486 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.486 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:944 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.486 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.107942+0000", 2024-09-12T16:16:03.486 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0067079790000000002, 2024-09-12T16:16:03.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0091379119999999998, 2024-09-12T16:16:03.486 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.486 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.486 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.487 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.487 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.487 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.487 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 944 2024-09-12T16:16:03.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.487 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.487 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.487 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.107942+0000", 2024-09-12T16:16:03.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.488 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.488 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.107942+0000", 2024-09-12T16:16:03.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.488 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.488 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.107943+0000", 2024-09-12T16:16:03.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.012e-06 2024-09-12T16:16:03.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.488 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.488 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108094+0000", 2024-09-12T16:16:03.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015036699999999999 2024-09-12T16:16:03.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.489 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.489 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108106+0000", 2024-09-12T16:16:03.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2785999999999999e-05 2024-09-12T16:16:03.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.489 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.489 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108114+0000", 2024-09-12T16:16:03.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2620000000000001e-06 2024-09-12T16:16:03.489 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.489 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.489 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.490 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:958 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.490 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.110726+0000", 2024-09-12T16:16:03.490 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0039238270000000004, 2024-09-12T16:16:03.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0063769630000000002, 2024-09-12T16:16:03.490 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.490 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.490 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.490 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.490 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.490 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.491 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 958 2024-09-12T16:16:03.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.491 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.491 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110726+0000", 2024-09-12T16:16:03.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.491 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110726+0000", 2024-09-12T16:16:03.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.492 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.492 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110727+0000", 2024-09-12T16:16:03.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0550000000000001e-06 2024-09-12T16:16:03.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.492 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.492 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110732+0000", 2024-09-12T16:16:03.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3059999999999999e-06 2024-09-12T16:16:03.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.492 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.492 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110740+0000", 2024-09-12T16:16:03.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7269999999999996e-06 2024-09-12T16:16:03.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.493 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.493 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.110748+0000", 2024-09-12T16:16:03.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9810000000000003e-06 2024-09-12T16:16:03.493 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.493 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.493 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.493 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3484 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.493 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.101608+0000", 2024-09-12T16:16:03.494 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.013041746999999999, 2024-09-12T16:16:03.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015525529, 2024-09-12T16:16:03.494 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.494 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.494 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.494 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.494 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.494 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.494 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3484 2024-09-12T16:16:03.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.494 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.494 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101608+0000", 2024-09-12T16:16:03.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.495 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101608+0000", 2024-09-12T16:16:03.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.495 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101609+0000", 2024-09-12T16:16:03.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5700000000000002e-07 2024-09-12T16:16:03.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.496 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.496 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101612+0000", 2024-09-12T16:16:03.496 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2830000000000002e-06 2024-09-12T16:16:03.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.496 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.496 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101619+0000", 2024-09-12T16:16:03.496 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6069999999999996e-06 2024-09-12T16:16:03.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.496 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.496 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101623+0000", 2024-09-12T16:16:03.497 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8410000000000002e-06 2024-09-12T16:16:03.497 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.497 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.497 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.497 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:945 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.497 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.108128+0000", 2024-09-12T16:16:03.497 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0065225389999999999, 2024-09-12T16:16:03.497 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0090382729999999994, 2024-09-12T16:16:03.497 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.497 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.497 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.497 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.498 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.498 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.498 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 945 2024-09-12T16:16:03.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.498 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108128+0000", 2024-09-12T16:16:03.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108128+0000", 2024-09-12T16:16:03.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108128+0000", 2024-09-12T16:16:03.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4e-07 2024-09-12T16:16:03.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108132+0000", 2024-09-12T16:16:03.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6770000000000001e-06 2024-09-12T16:16:03.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108143+0000", 2024-09-12T16:16:03.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0591000000000001e-05 2024-09-12T16:16:03.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108147+0000", 2024-09-12T16:16:03.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3209999999999998e-06 2024-09-12T16:16:03.500 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.500 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.500 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.500 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:959 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.500 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.111177+0000", 2024-09-12T16:16:03.500 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0034730770000000002, 2024-09-12T16:16:03.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0060125899999999999, 2024-09-12T16:16:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 959 2024-09-12T16:16:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111177+0000", 2024-09-12T16:16:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.502 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.502 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111177+0000", 2024-09-12T16:16:03.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.502 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.502 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111178+0000", 2024-09-12T16:16:03.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1699999999999997e-07 2024-09-12T16:16:03.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.502 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.502 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111182+0000", 2024-09-12T16:16:03.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4179999999999999e-06 2024-09-12T16:16:03.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111192+0000", 2024-09-12T16:16:03.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0083e-05 2024-09-12T16:16:03.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111199+0000", 2024-09-12T16:16:03.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6980000000000001e-06 2024-09-12T16:16:03.503 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.503 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.503 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.504 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3469 3.6 3:629d5e70:::rbd_header.11557ed36bb5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.504 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.097297+0000", 2024-09-12T16:16:03.504 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.017352981999999999, 2024-09-12T16:16:03.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.019917575999999999, 2024-09-12T16:16:03.504 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.504 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.504 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:03.504 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.504 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.504 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.504 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3469 2024-09-12T16:16:03.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.505 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.505 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.505 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.097297+0000", 2024-09-12T16:16:03.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.505 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.505 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.097297+0000", 2024-09-12T16:16:03.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.506 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.506 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.097298+0000", 2024-09-12T16:16:03.506 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0399999999999995e-07 2024-09-12T16:16:03.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.506 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.506 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.097302+0000", 2024-09-12T16:16:03.506 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7349999999999998e-06 2024-09-12T16:16:03.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.506 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.506 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.097309+0000", 2024-09-12T16:16:03.506 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9129999999999997e-06 2024-09-12T16:16:03.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.507 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.507 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.097313+0000", 2024-09-12T16:16:03.507 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.014e-06 2024-09-12T16:16:03.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.507 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:03.507 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.117171+0000", 2024-09-12T16:16:03.507 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.019858658000000001 2024-09-12T16:16:03.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.507 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:03.507 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.117212+0000", 2024-09-12T16:16:03.507 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1241e-05 2024-09-12T16:16:03.508 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.508 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.508 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.508 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:929 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.508 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.101644+0000", 2024-09-12T16:16:03.508 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.013006228999999999, 2024-09-12T16:16:03.508 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015598752, 2024-09-12T16:16:03.508 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.508 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.508 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.508 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.509 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.509 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.509 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 929 2024-09-12T16:16:03.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.509 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.509 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.509 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101644+0000", 2024-09-12T16:16:03.509 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.509 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.510 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101644+0000", 2024-09-12T16:16:03.510 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.510 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.510 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101645+0000", 2024-09-12T16:16:03.510 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9599999999999998e-07 2024-09-12T16:16:03.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.510 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.510 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101649+0000", 2024-09-12T16:16:03.510 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1250000000000003e-06 2024-09-12T16:16:03.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.511 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.511 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101657+0000", 2024-09-12T16:16:03.511 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4060000000000005e-06 2024-09-12T16:16:03.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.511 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.511 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101664+0000", 2024-09-12T16:16:03.511 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2729999999999999e-06 2024-09-12T16:16:03.511 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.511 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.511 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.511 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:946 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.512 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.108308+0000", 2024-09-12T16:16:03.512 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0063423209999999997, 2024-09-12T16:16:03.512 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0089691070000000005, 2024-09-12T16:16:03.512 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.512 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.512 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.512 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.512 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.512 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.512 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 946 2024-09-12T16:16:03.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.513 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.513 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.513 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108308+0000", 2024-09-12T16:16:03.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.513 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.513 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108308+0000", 2024-09-12T16:16:03.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.514 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108309+0000", 2024-09-12T16:16:03.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2160000000000001e-06 2024-09-12T16:16:03.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.514 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108316+0000", 2024-09-12T16:16:03.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0809999999999996e-06 2024-09-12T16:16:03.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.514 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108359+0000", 2024-09-12T16:16:03.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2401999999999998e-05 2024-09-12T16:16:03.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.515 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.515 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108368+0000", 2024-09-12T16:16:03.515 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3549999999999994e-06 2024-09-12T16:16:03.515 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.515 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.515 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.515 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3524 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.515 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.111213+0000", 2024-09-12T16:16:03.515 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0034368710000000002, 2024-09-12T16:16:03.515 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.006089957, 2024-09-12T16:16:03.516 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.516 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.516 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.516 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.516 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.516 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.516 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3524 2024-09-12T16:16:03.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.516 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.516 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.517 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111213+0000", 2024-09-12T16:16:03.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.517 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.517 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111213+0000", 2024-09-12T16:16:03.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.517 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.517 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111214+0000", 2024-09-12T16:16:03.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9099999999999991e-07 2024-09-12T16:16:03.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111219+0000", 2024-09-12T16:16:03.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4700000000000004e-06 2024-09-12T16:16:03.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111230+0000", 2024-09-12T16:16:03.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1161e-05 2024-09-12T16:16:03.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111238+0000", 2024-09-12T16:16:03.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6960000000000005e-06 2024-09-12T16:16:03.519 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.519 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.519 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.519 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:914 3.6 3:629d5e70:::rbd_header.11557ed36bb5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.519 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.097355+0000", 2024-09-12T16:16:03.519 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.017294807999999998, 2024-09-12T16:16:03.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.019974489000000002, 2024-09-12T16:16:03.519 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.519 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.519 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:03.520 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.520 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.520 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.520 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 914 2024-09-12T16:16:03.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.520 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.520 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.520 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.097355+0000", 2024-09-12T16:16:03.520 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.520 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.521 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.097355+0000", 2024-09-12T16:16:03.521 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.521 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.521 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.521 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.097356+0000", 2024-09-12T16:16:03.521 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4099999999999999e-07 2024-09-12T16:16:03.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.521 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.521 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.521 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.097358+0000", 2024-09-12T16:16:03.521 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.621e-06 2024-09-12T16:16:03.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.522 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.522 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.097363+0000", 2024-09-12T16:16:03.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7480000000000001e-06 2024-09-12T16:16:03.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.522 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.522 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.097366+0000", 2024-09-12T16:16:03.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.27e-06 2024-09-12T16:16:03.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.522 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:03.522 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.117277+0000", 2024-09-12T16:16:03.523 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.019910318999999999 2024-09-12T16:16:03.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.523 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:03.523 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.117310+0000", 2024-09-12T16:16:03.523 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3198999999999998e-05 2024-09-12T16:16:03.523 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.523 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.523 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.523 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3485 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.524 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.101784+0000", 2024-09-12T16:16:03.524 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.012866219999999999, 2024-09-12T16:16:03.524 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015584723999999999, 2024-09-12T16:16:03.524 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.524 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.524 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.524 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.524 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.524 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.524 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3485 2024-09-12T16:16:03.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.524 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.524 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.525 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.525 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101784+0000", 2024-09-12T16:16:03.525 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.525 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.525 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101784+0000", 2024-09-12T16:16:03.525 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.525 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.525 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101785+0000", 2024-09-12T16:16:03.526 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7899999999999997e-07 2024-09-12T16:16:03.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.526 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.526 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101788+0000", 2024-09-12T16:16:03.526 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6559999999999998e-06 2024-09-12T16:16:03.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.526 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.526 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101797+0000", 2024-09-12T16:16:03.526 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2239999999999995e-06 2024-09-12T16:16:03.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.527 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.527 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101803+0000", 2024-09-12T16:16:03.527 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1299999999999998e-06 2024-09-12T16:16:03.527 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.527 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.527 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.527 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:947 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.527 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.108403+0000", 2024-09-12T16:16:03.527 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0062466809999999996, 2024-09-12T16:16:03.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0089895940000000001, 2024-09-12T16:16:03.528 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.528 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.528 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.528 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.528 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.528 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.528 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 947 2024-09-12T16:16:03.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.528 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.528 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.529 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108403+0000", 2024-09-12T16:16:03.529 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.529 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.529 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108403+0000", 2024-09-12T16:16:03.529 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.529 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.529 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108404+0000", 2024-09-12T16:16:03.529 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5700000000000002e-07 2024-09-12T16:16:03.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.530 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.530 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108409+0000", 2024-09-12T16:16:03.530 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3970000000000004e-06 2024-09-12T16:16:03.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.530 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.530 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108418+0000", 2024-09-12T16:16:03.530 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4129999999999995e-06 2024-09-12T16:16:03.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.530 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.530 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108424+0000", 2024-09-12T16:16:03.530 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8699999999999997e-06 2024-09-12T16:16:03.531 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.531 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.531 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.531 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.531 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:960 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.531 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.111345+0000", 2024-09-12T16:16:03.531 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0033052950000000002, 2024-09-12T16:16:03.531 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0060710449999999997, 2024-09-12T16:16:03.531 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.531 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.531 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.531 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.532 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.532 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.532 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 960 2024-09-12T16:16:03.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.532 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.532 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.532 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111345+0000", 2024-09-12T16:16:03.532 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.532 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.533 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111345+0000", 2024-09-12T16:16:03.533 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.533 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.533 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111346+0000", 2024-09-12T16:16:03.533 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6599999999999996e-07 2024-09-12T16:16:03.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.533 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.533 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111349+0000", 2024-09-12T16:16:03.533 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5599999999999998e-06 2024-09-12T16:16:03.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.534 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.534 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111356+0000", 2024-09-12T16:16:03.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9439999999999999e-06 2024-09-12T16:16:03.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.534 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.534 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111360+0000", 2024-09-12T16:16:03.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0509999999999998e-06 2024-09-12T16:16:03.534 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.534 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.534 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.535 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3470 3.6 3:629d5e70:::rbd_header.11557ed36bb5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.535 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.097466+0000", 2024-09-12T16:16:03.535 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.017184573000000002, 2024-09-12T16:16:03.535 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.019976315000000001, 2024-09-12T16:16:03.535 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.535 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.535 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:03.535 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.535 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.535 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.535 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3470 2024-09-12T16:16:03.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.536 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.536 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.536 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.536 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.097466+0000", 2024-09-12T16:16:03.536 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.536 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.536 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.536 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.097466+0000", 2024-09-12T16:16:03.536 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.536 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.536 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.536 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.097466+0000", 2024-09-12T16:16:03.537 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7400000000000003e-07 2024-09-12T16:16:03.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.537 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.537 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.097469+0000", 2024-09-12T16:16:03.537 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1200000000000002e-06 2024-09-12T16:16:03.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.537 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.537 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.097478+0000", 2024-09-12T16:16:03.537 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2220000000000002e-06 2024-09-12T16:16:03.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.538 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.538 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.538 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.097483+0000", 2024-09-12T16:16:03.538 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7849999999999997e-06 2024-09-12T16:16:03.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.538 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.538 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:03.538 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.117389+0000", 2024-09-12T16:16:03.538 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.019905636000000001 2024-09-12T16:16:03.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.538 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.538 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:03.539 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.117433+0000", 2024-09-12T16:16:03.539 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4406999999999997e-05 2024-09-12T16:16:03.539 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.539 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.539 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.539 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.539 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:930 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.539 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.101798+0000", 2024-09-12T16:16:03.539 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.01285232, 2024-09-12T16:16:03.539 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015673304999999998, 2024-09-12T16:16:03.539 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.539 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.540 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.540 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.540 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.540 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.540 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 930 2024-09-12T16:16:03.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.540 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.540 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.540 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101798+0000", 2024-09-12T16:16:03.540 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.541 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.541 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101798+0000", 2024-09-12T16:16:03.541 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.541 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.541 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101799+0000", 2024-09-12T16:16:03.541 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9800000000000003e-07 2024-09-12T16:16:03.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.541 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.541 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101802+0000", 2024-09-12T16:16:03.541 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.021e-06 2024-09-12T16:16:03.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.542 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.542 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101808+0000", 2024-09-12T16:16:03.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8290000000000002e-06 2024-09-12T16:16:03.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.542 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.542 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.101812+0000", 2024-09-12T16:16:03.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0130000000000004e-06 2024-09-12T16:16:03.543 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.543 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.543 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.543 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:948 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.543 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.108433+0000", 2024-09-12T16:16:03.543 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0062172850000000003, 2024-09-12T16:16:03.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0090679780000000008, 2024-09-12T16:16:03.543 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.543 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.543 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.544 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.544 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.544 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.544 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 948 2024-09-12T16:16:03.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.544 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.544 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.544 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108433+0000", 2024-09-12T16:16:03.544 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.545 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.545 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108433+0000", 2024-09-12T16:16:03.545 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.545 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.545 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108433+0000", 2024-09-12T16:16:03.545 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2e-07 2024-09-12T16:16:03.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.545 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.545 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108436+0000", 2024-09-12T16:16:03.545 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.942e-06 2024-09-12T16:16:03.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.546 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.546 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108443+0000", 2024-09-12T16:16:03.546 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0979999999999996e-06 2024-09-12T16:16:03.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.546 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.546 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108449+0000", 2024-09-12T16:16:03.546 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2179999999999998e-06 2024-09-12T16:16:03.546 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.547 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.547 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.547 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.547 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3525 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.547 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.111359+0000", 2024-09-12T16:16:03.547 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0032914680000000001, 2024-09-12T16:16:03.547 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0061701250000000003, 2024-09-12T16:16:03.547 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.547 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.547 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.547 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.547 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.548 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.548 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3525 2024-09-12T16:16:03.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.548 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.548 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.548 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111359+0000", 2024-09-12T16:16:03.548 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.548 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.548 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111359+0000", 2024-09-12T16:16:03.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.549 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.549 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111360+0000", 2024-09-12T16:16:03.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2529999999999999e-06 2024-09-12T16:16:03.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.549 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.549 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111364+0000", 2024-09-12T16:16:03.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2139999999999998e-06 2024-09-12T16:16:03.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.550 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.550 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111374+0000", 2024-09-12T16:16:03.550 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0030999999999999e-05 2024-09-12T16:16:03.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.550 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.550 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111381+0000", 2024-09-12T16:16:03.550 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6420000000000001e-06 2024-09-12T16:16:03.550 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.550 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.550 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.551 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.551 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:915 3.6 3:629d5e70:::rbd_header.11557ed36bb5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.551 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.097498+0000", 2024-09-12T16:16:03.551 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.017152374000000001, 2024-09-12T16:16:03.551 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020057325000000001, 2024-09-12T16:16:03.551 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.551 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.551 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:03.551 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.551 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.551 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.551 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 915 2024-09-12T16:16:03.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.552 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.552 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.552 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.097498+0000", 2024-09-12T16:16:03.552 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.552 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.552 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.097498+0000", 2024-09-12T16:16:03.552 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.552 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.553 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.097498+0000", 2024-09-12T16:16:03.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8999999999999996e-07 2024-09-12T16:16:03.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.553 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.553 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.097503+0000", 2024-09-12T16:16:03.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4510000000000002e-06 2024-09-12T16:16:03.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.553 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.553 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.097513+0000", 2024-09-12T16:16:03.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8539999999999992e-06 2024-09-12T16:16:03.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.554 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.554 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.097517+0000", 2024-09-12T16:16:03.554 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0080000000000004e-06 2024-09-12T16:16:03.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.554 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:03.554 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.117515+0000", 2024-09-12T16:16:03.554 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.019998460999999999 2024-09-12T16:16:03.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.555 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:03.555 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.117548+0000", 2024-09-12T16:16:03.555 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2960999999999998e-05 2024-09-12T16:16:03.555 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.555 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.555 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.555 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.555 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3486 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.555 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.102105+0000", 2024-09-12T16:16:03.556 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.012544728, 2024-09-12T16:16:03.556 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015477945999999999, 2024-09-12T16:16:03.556 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.556 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.556 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.556 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.556 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.556 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.556 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3486 2024-09-12T16:16:03.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.556 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102105+0000", 2024-09-12T16:16:03.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102105+0000", 2024-09-12T16:16:03.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102106+0000", 2024-09-12T16:16:03.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6499999999999998e-07 2024-09-12T16:16:03.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.558 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.558 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102111+0000", 2024-09-12T16:16:03.558 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3209999999999998e-06 2024-09-12T16:16:03.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.558 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.558 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102120+0000", 2024-09-12T16:16:03.558 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1099999999999992e-06 2024-09-12T16:16:03.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.558 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.559 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102126+0000", 2024-09-12T16:16:03.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6100000000000002e-06 2024-09-12T16:16:03.559 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.559 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.559 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.559 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:949 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.559 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.108622+0000", 2024-09-12T16:16:03.559 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0060283029999999996, 2024-09-12T16:16:03.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0089947299999999994, 2024-09-12T16:16:03.559 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.560 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.560 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.560 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.560 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.560 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.560 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 949 2024-09-12T16:16:03.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.560 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.560 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.560 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108622+0000", 2024-09-12T16:16:03.560 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.561 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108622+0000", 2024-09-12T16:16:03.561 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.561 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108623+0000", 2024-09-12T16:16:03.561 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5700000000000001e-07 2024-09-12T16:16:03.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.561 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108628+0000", 2024-09-12T16:16:03.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0019999999999997e-06 2024-09-12T16:16:03.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108639+0000", 2024-09-12T16:16:03.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0858e-05 2024-09-12T16:16:03.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108645+0000", 2024-09-12T16:16:03.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5100000000000004e-06 2024-09-12T16:16:03.562 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.562 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.562 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.563 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3526 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.563 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.111489+0000", 2024-09-12T16:16:03.563 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0031610729999999999, 2024-09-12T16:16:03.563 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0061514029999999997, 2024-09-12T16:16:03.563 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.563 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.563 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.563 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.563 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.563 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.563 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3526 2024-09-12T16:16:03.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.564 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.564 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.564 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.564 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111489+0000", 2024-09-12T16:16:03.564 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.564 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.564 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.564 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111489+0000", 2024-09-12T16:16:03.564 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.564 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.565 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.565 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111490+0000", 2024-09-12T16:16:03.565 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5199999999999995e-07 2024-09-12T16:16:03.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.565 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.565 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.565 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111494+0000", 2024-09-12T16:16:03.565 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.031e-06 2024-09-12T16:16:03.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.565 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.565 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.565 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111504+0000", 2024-09-12T16:16:03.565 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6940000000000007e-06 2024-09-12T16:16:03.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.566 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.566 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111510+0000", 2024-09-12T16:16:03.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3820000000000001e-06 2024-09-12T16:16:03.566 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.566 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.566 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.566 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3471 3.6 3:629d5e70:::rbd_header.11557ed36bb5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.566 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.097675+0000", 2024-09-12T16:16:03.566 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.016975628999999999, 2024-09-12T16:16:03.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.01999196, 2024-09-12T16:16:03.566 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.567 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.567 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:16:03.567 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.567 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.567 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.567 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3471 2024-09-12T16:16:03.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.567 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.567 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.097675+0000", 2024-09-12T16:16:03.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.568 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.568 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.097675+0000", 2024-09-12T16:16:03.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.568 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.568 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.097675+0000", 2024-09-12T16:16:03.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9500000000000002e-07 2024-09-12T16:16:03.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.568 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.568 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.097679+0000", 2024-09-12T16:16:03.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3519999999999998e-06 2024-09-12T16:16:03.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.569 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.569 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.097688+0000", 2024-09-12T16:16:03.569 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5920000000000007e-06 2024-09-12T16:16:03.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.569 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.569 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.097694+0000", 2024-09-12T16:16:03.569 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9399999999999999e-06 2024-09-12T16:16:03.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.569 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:03.570 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.117629+0000", 2024-09-12T16:16:03.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.019935211000000001 2024-09-12T16:16:03.570 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.570 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.570 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.570 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:931 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.570 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.102110+0000", 2024-09-12T16:16:03.570 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.012540074999999999, 2024-09-12T16:16:03.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015583122, 2024-09-12T16:16:03.570 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.570 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.570 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.571 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.571 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.571 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.571 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 931 2024-09-12T16:16:03.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.571 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.571 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102110+0000", 2024-09-12T16:16:03.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.571 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102110+0000", 2024-09-12T16:16:03.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.572 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.572 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102111+0000", 2024-09-12T16:16:03.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7199999999999998e-07 2024-09-12T16:16:03.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.572 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.572 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102114+0000", 2024-09-12T16:16:03.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.365e-06 2024-09-12T16:16:03.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.572 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.573 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102121+0000", 2024-09-12T16:16:03.573 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8839999999999997e-06 2024-09-12T16:16:03.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.573 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.573 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102126+0000", 2024-09-12T16:16:03.573 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3810000000000001e-06 2024-09-12T16:16:03.573 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.573 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.573 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.573 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3507 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.573 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.107150+0000", 2024-09-12T16:16:03.574 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0075004090000000004, 2024-09-12T16:16:03.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010566900000000001, 2024-09-12T16:16:03.574 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.574 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.574 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.574 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.574 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.574 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.574 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3507 2024-09-12T16:16:03.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.574 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.574 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.107150+0000", 2024-09-12T16:16:03.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.107150+0000", 2024-09-12T16:16:03.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.107151+0000", 2024-09-12T16:16:03.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0699999999999996e-07 2024-09-12T16:16:03.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.576 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.576 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108617+0000", 2024-09-12T16:16:03.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014664369999999999 2024-09-12T16:16:03.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.576 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.576 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108705+0000", 2024-09-12T16:16:03.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7695000000000007e-05 2024-09-12T16:16:03.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.577 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.577 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108794+0000", 2024-09-12T16:16:03.577 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.92e-05 2024-09-12T16:16:03.577 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.577 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.577 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.577 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:961 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.577 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.111502+0000", 2024-09-12T16:16:03.577 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.003147684, 2024-09-12T16:16:03.577 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0062413759999999999, 2024-09-12T16:16:03.577 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.578 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.578 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.578 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.578 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.578 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.578 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 961 2024-09-12T16:16:03.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.578 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.578 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.578 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111502+0000", 2024-09-12T16:16:03.578 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.579 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.579 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111502+0000", 2024-09-12T16:16:03.579 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.579 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.579 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111504+0000", 2024-09-12T16:16:03.579 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.088e-06 2024-09-12T16:16:03.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.579 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.579 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111508+0000", 2024-09-12T16:16:03.579 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1899999999999997e-06 2024-09-12T16:16:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111516+0000", 2024-09-12T16:16:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7220000000000005e-06 2024-09-12T16:16:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111523+0000", 2024-09-12T16:16:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5810000000000002e-06 2024-09-12T16:16:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.581 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:916 3.6 3:629d5e70:::rbd_header.11557ed36bb5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.581 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.097687+0000", 2024-09-12T16:16:03.581 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.016963283999999999, 2024-09-12T16:16:03.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020090782000000001, 2024-09-12T16:16:03.581 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.581 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.581 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:16:03.581 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.581 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.581 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.581 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 916 2024-09-12T16:16:03.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.581 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.581 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.582 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.582 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.097687+0000", 2024-09-12T16:16:03.582 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.582 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.582 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.097687+0000", 2024-09-12T16:16:03.582 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.582 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.582 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.097688+0000", 2024-09-12T16:16:03.582 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6000000000000003e-07 2024-09-12T16:16:03.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.583 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.583 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.097691+0000", 2024-09-12T16:16:03.583 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5219999999999999e-06 2024-09-12T16:16:03.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.583 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.583 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.097698+0000", 2024-09-12T16:16:03.583 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1559999999999998e-06 2024-09-12T16:16:03.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.583 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.583 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.097703+0000", 2024-09-12T16:16:03.583 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8539999999999996e-06 2024-09-12T16:16:03.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.584 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.584 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:03.584 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.117761+0000", 2024-09-12T16:16:03.584 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020057947999999999 2024-09-12T16:16:03.584 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.584 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.584 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.584 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.584 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3487 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.584 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.102241+0000", 2024-09-12T16:16:03.584 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.012409468, 2024-09-12T16:16:03.585 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015563113999999999, 2024-09-12T16:16:03.585 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.585 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.585 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.585 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.585 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.585 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.585 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3487 2024-09-12T16:16:03.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.585 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.585 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.585 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.585 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102241+0000", 2024-09-12T16:16:03.586 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.586 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.586 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102241+0000", 2024-09-12T16:16:03.586 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.586 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.586 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102241+0000", 2024-09-12T16:16:03.586 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4300000000000002e-07 2024-09-12T16:16:03.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.587 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.587 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102245+0000", 2024-09-12T16:16:03.587 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1729999999999999e-06 2024-09-12T16:16:03.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.587 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.587 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102251+0000", 2024-09-12T16:16:03.587 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6640000000000001e-06 2024-09-12T16:16:03.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.587 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.588 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102255+0000", 2024-09-12T16:16:03.588 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9219999999999999e-06 2024-09-12T16:16:03.588 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.588 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.588 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.588 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.588 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3527 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.588 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.111648+0000", 2024-09-12T16:16:03.588 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0030017329999999999, 2024-09-12T16:16:03.588 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.006178294, 2024-09-12T16:16:03.588 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.589 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.589 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.589 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.589 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.589 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.589 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3527 2024-09-12T16:16:03.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.589 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.589 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.589 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111648+0000", 2024-09-12T16:16:03.589 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.590 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.590 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.590 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111648+0000", 2024-09-12T16:16:03.590 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.590 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.590 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.590 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.590 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111649+0000", 2024-09-12T16:16:03.590 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.16e-07 2024-09-12T16:16:03.590 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.590 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.590 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.590 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111653+0000", 2024-09-12T16:16:03.591 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1019999999999999e-06 2024-09-12T16:16:03.591 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.591 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.591 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.591 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111665+0000", 2024-09-12T16:16:03.591 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1168e-05 2024-09-12T16:16:03.591 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.591 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.591 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.591 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111672+0000", 2024-09-12T16:16:03.591 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4950000000000002e-06 2024-09-12T16:16:03.591 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.592 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.592 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.592 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.592 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.592 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3472 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.592 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.098415+0000", 2024-09-12T16:16:03.592 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.016235233000000002, 2024-09-12T16:16:03.592 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.019447560999999999, 2024-09-12T16:16:03.592 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.592 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.592 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.592 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.592 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.593 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.593 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3472 2024-09-12T16:16:03.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.593 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.593 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.593 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.593 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.098415+0000", 2024-09-12T16:16:03.593 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.593 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.593 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.593 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.098415+0000", 2024-09-12T16:16:03.593 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.594 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.594 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.594 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.098416+0000", 2024-09-12T16:16:03.594 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7700000000000004e-07 2024-09-12T16:16:03.594 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.594 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.594 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.594 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.098420+0000", 2024-09-12T16:16:03.594 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1479999999999999e-06 2024-09-12T16:16:03.594 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.594 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.594 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.594 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.098428+0000", 2024-09-12T16:16:03.595 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3979999999999999e-06 2024-09-12T16:16:03.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.595 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.595 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.595 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.098435+0000", 2024-09-12T16:16:03.595 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.703e-06 2024-09-12T16:16:03.595 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.595 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.595 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.595 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.595 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:932 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.595 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.102259+0000", 2024-09-12T16:16:03.596 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.012390933999999999, 2024-09-12T16:16:03.596 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015627822, 2024-09-12T16:16:03.596 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.596 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.596 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.596 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.596 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.596 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.596 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 932 2024-09-12T16:16:03.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.596 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.596 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.597 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.597 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102259+0000", 2024-09-12T16:16:03.597 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.597 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.597 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.597 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102259+0000", 2024-09-12T16:16:03.597 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.597 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.597 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.597 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102260+0000", 2024-09-12T16:16:03.597 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.018e-06 2024-09-12T16:16:03.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.598 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.598 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102264+0000", 2024-09-12T16:16:03.598 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0380000000000001e-06 2024-09-12T16:16:03.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.598 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.598 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102273+0000", 2024-09-12T16:16:03.598 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8990000000000007e-06 2024-09-12T16:16:03.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.598 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.598 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102279+0000", 2024-09-12T16:16:03.599 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.105e-06 2024-09-12T16:16:03.599 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.599 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.599 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.599 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.599 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:950 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.599 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.108965+0000", 2024-09-12T16:16:03.599 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0056848089999999999, 2024-09-12T16:16:03.599 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0089447889999999999, 2024-09-12T16:16:03.599 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.599 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.599 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.599 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.599 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.600 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.600 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 950 2024-09-12T16:16:03.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.600 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.600 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.600 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.600 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108965+0000", 2024-09-12T16:16:03.600 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.600 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.601 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.601 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108965+0000", 2024-09-12T16:16:03.601 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.601 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.601 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.601 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108966+0000", 2024-09-12T16:16:03.601 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.099e-06 2024-09-12T16:16:03.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.601 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.601 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.601 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108971+0000", 2024-09-12T16:16:03.602 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.78e-06 2024-09-12T16:16:03.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.602 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.602 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.602 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108983+0000", 2024-09-12T16:16:03.602 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1741e-05 2024-09-12T16:16:03.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.602 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.602 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.602 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.108991+0000", 2024-09-12T16:16:03.602 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8210000000000002e-06 2024-09-12T16:16:03.602 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.603 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.603 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.603 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.603 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:962 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.603 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.111660+0000", 2024-09-12T16:16:03.603 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0029901929999999999, 2024-09-12T16:16:03.603 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0062786400000000003, 2024-09-12T16:16:03.603 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.603 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.603 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.603 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.603 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.604 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.604 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 962 2024-09-12T16:16:03.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.604 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.604 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.604 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.604 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111660+0000", 2024-09-12T16:16:03.604 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.604 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.604 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.604 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111660+0000", 2024-09-12T16:16:03.605 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.605 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.605 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111661+0000", 2024-09-12T16:16:03.605 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8700000000000005e-07 2024-09-12T16:16:03.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.605 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.605 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111664+0000", 2024-09-12T16:16:03.605 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6289999999999999e-06 2024-09-12T16:16:03.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.605 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111673+0000", 2024-09-12T16:16:03.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3960000000000006e-06 2024-09-12T16:16:03.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.606 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.111677+0000", 2024-09-12T16:16:03.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0790000000000002e-06 2024-09-12T16:16:03.606 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.606 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.606 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.607 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:917 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.607 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.098482+0000", 2024-09-12T16:16:03.607 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.016167757000000001, 2024-09-12T16:16:03.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.019480681, 2024-09-12T16:16:03.607 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.607 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.607 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.607 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.607 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.607 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.607 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 917 2024-09-12T16:16:03.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.608 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.608 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.608 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.098482+0000", 2024-09-12T16:16:03.608 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.608 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.608 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.098482+0000", 2024-09-12T16:16:03.608 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.609 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.609 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.098483+0000", 2024-09-12T16:16:03.609 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1800000000000005e-07 2024-09-12T16:16:03.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.609 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.609 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.609 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.098487+0000", 2024-09-12T16:16:03.609 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1309999999999999e-06 2024-09-12T16:16:03.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.609 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.610 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.610 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.098498+0000", 2024-09-12T16:16:03.610 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0958000000000001e-05 2024-09-12T16:16:03.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.610 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.610 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.098504+0000", 2024-09-12T16:16:03.610 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2580000000000001e-06 2024-09-12T16:16:03.610 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.610 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.610 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.611 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3488 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.611 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.102416+0000", 2024-09-12T16:16:03.611 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.012234066, 2024-09-12T16:16:03.611 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015577540000000001, 2024-09-12T16:16:03.611 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.611 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.611 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.611 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.611 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.611 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.611 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3488 2024-09-12T16:16:03.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.612 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.612 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.612 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102416+0000", 2024-09-12T16:16:03.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.612 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.612 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102416+0000", 2024-09-12T16:16:03.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.613 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.613 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102417+0000", 2024-09-12T16:16:03.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3600000000000003e-07 2024-09-12T16:16:03.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.613 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.613 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102420+0000", 2024-09-12T16:16:03.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0230000000000001e-06 2024-09-12T16:16:03.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.613 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.613 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102427+0000", 2024-09-12T16:16:03.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4019999999999996e-06 2024-09-12T16:16:03.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.614 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.102431+0000", 2024-09-12T16:16:03.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.698e-06 2024-09-12T16:16:03.614 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.614 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.614 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.614 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:3508 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.614 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.109079+0000", 2024-09-12T16:16:03.615 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0055707320000000001, 2024-09-12T16:16:03.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0089422379999999999, 2024-09-12T16:16:03.615 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.615 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.615 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.615 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.615 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.615 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.615 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3508 2024-09-12T16:16:03.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.615 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109079+0000", 2024-09-12T16:16:03.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109079+0000", 2024-09-12T16:16:03.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109080+0000", 2024-09-12T16:16:03.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6899999999999996e-07 2024-09-12T16:16:03.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.617 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109085+0000", 2024-09-12T16:16:03.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2649999999999998e-06 2024-09-12T16:16:03.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.617 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109096+0000", 2024-09-12T16:16:03.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1637999999999999e-05 2024-09-12T16:16:03.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.617 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.109104+0000", 2024-09-12T16:16:03.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4989999999999997e-06 2024-09-12T16:16:03.618 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.618 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.618 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.618 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:963 3.6 3.e7ab946 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T16:16:03.618 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:03.112200+0000", 2024-09-12T16:16:03.618 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0024497820000000002, 2024-09-12T16:16:03.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0058445600000000004, 2024-09-12T16:16:03.618 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.618 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.618 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:03.618 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.618 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:16:03.619 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:03.619 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 963 2024-09-12T16:16:03.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.619 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.112200+0000", 2024-09-12T16:16:03.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.112200+0000", 2024-09-12T16:16:03.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.112201+0000", 2024-09-12T16:16:03.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2399999999999997e-07 2024-09-12T16:16:03.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.112206+0000", 2024-09-12T16:16:03.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6890000000000003e-06 2024-09-12T16:16:03.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.112215+0000", 2024-09-12T16:16:03.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1509999999999993e-06 2024-09-12T16:16:03.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:03.112221+0000", 2024-09-12T16:16:03.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2620000000000004e-06 2024-09-12T16:16:03.621 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.621 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.621 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.621 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.621 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-12T16:16:03.621 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 122 2024-09-12T16:16:03.621 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:03.623 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:16:03.627 INFO:teuthology.orchestra.run.smithi204.stdout:315 read 0x51e400 thru 0x525bae (0x77af bytes) 2024-09-12T16:16:03.627 INFO:teuthology.orchestra.run.smithi204.stdout:318 trunc from 0x1d67600 to 0x273f200 2024-09-12T16:16:03.627 INFO:teuthology.orchestra.run.smithi204.stdout:319 write 0x4db4e00 thru 0x4db5a8f (0xc90 bytes) 2024-09-12T16:16:03.627 INFO:teuthology.orchestra.run.smithi204.stdout:323 read 0x3f19c00 thru 0x3f1e2f1 (0x46f2 bytes) 2024-09-12T16:16:03.627 INFO:teuthology.orchestra.run.smithi204.stdout:324 read 0x320de00 thru 0x3219959 (0xbb5a bytes) 2024-09-12T16:16:03.627 INFO:teuthology.orchestra.run.smithi204.stdout:325 read 0x3919200 thru 0x391d0be (0x3ebf bytes) 2024-09-12T16:16:03.627 INFO:teuthology.orchestra.run.smithi204.stdout:327 read 0x30ba00 thru 0x31841e (0xca1f bytes) 2024-09-12T16:16:03.627 INFO:teuthology.orchestra.run.smithi204.stdout:330 read 0x1550600 thru 0x1552b40 (0x2541 bytes) 2024-09-12T16:16:03.627 INFO:teuthology.orchestra.run.smithi204.stdout:332 write 0xd800200 thru 0xd803736 (0x3537 bytes) 2024-09-12T16:16:03.627 INFO:teuthology.orchestra.run.smithi204.stdout:336 write 0xb2fd200 thru 0xb30c227 (0xf028 bytes) 2024-09-12T16:16:03.627 INFO:teuthology.orchestra.run.smithi204.stdout:337 punch from 0x4803800 to 0x4805e00, (0x2600 bytes) 2024-09-12T16:16:03.627 INFO:teuthology.orchestra.run.smithi204.stdout:338 punch from 0x23e8400 to 0x23ef000, (0x6c00 bytes) 2024-09-12T16:16:03.627 INFO:teuthology.orchestra.run.smithi204.stdout:341 read 0x817d200 thru 0x8184b94 (0x7995 bytes) 2024-09-12T16:16:03.627 INFO:teuthology.orchestra.run.smithi204.stdout:342 read 0xb716600 thru 0xb721687 (0xb088 bytes) 2024-09-12T16:16:03.628 INFO:teuthology.orchestra.run.smithi204.stdout:344 read 0x9cf1800 thru 0x9cf2c15 (0x1416 bytes) 2024-09-12T16:16:03.628 INFO:teuthology.orchestra.run.smithi204.stdout:346 write 0x2749600 thru 0x274bd3c (0x273d bytes) 2024-09-12T16:16:03.628 INFO:teuthology.orchestra.run.smithi204.stdout:348 write 0x7545600 thru 0x754c2c1 (0x6cc2 bytes) 2024-09-12T16:16:03.628 INFO:teuthology.orchestra.run.smithi204.stdout:352 trunc from 0xd803800 to 0x2754800 2024-09-12T16:16:03.628 INFO:teuthology.orchestra.run.smithi204.stdout:355 read 0x170ca00 thru 0x17171b6 (0xa7b7 bytes) 2024-09-12T16:16:03.628 INFO:teuthology.orchestra.run.smithi204.stdout:357 punch from 0x1c51400 to 0x1c54a00, (0x3600 bytes) 2024-09-12T16:16:03.628 INFO:teuthology.orchestra.run.smithi204.stdout:359 write 0x558c400 thru 0x559825c (0xbe5d bytes) 2024-09-12T16:16:03.628 INFO:teuthology.orchestra.run.smithi204.stdout:361 trunc from 0x5598400 to 0x6e5de00 2024-09-12T16:16:03.628 INFO:teuthology.orchestra.run.smithi204.stdout:363 write 0x9970a00 thru 0x9972a68 (0x2069 bytes) 2024-09-12T16:16:03.628 INFO:teuthology.orchestra.run.smithi204.stdout:364 punch from 0x5d200 to 0x64800, (0x7600 bytes) 2024-09-12T16:16:03.628 INFO:teuthology.orchestra.run.smithi204.stdout:365 read 0x8687a00 thru 0x8696e48 (0xf449 bytes) 2024-09-12T16:16:03.628 INFO:teuthology.orchestra.run.smithi204.stdout:366 write 0x852e000 thru 0x853666e (0x866f bytes) 2024-09-12T16:16:03.629 INFO:teuthology.orchestra.run.smithi204.stdout:367 trunc from 0x9972c00 to 0x6190200 2024-09-12T16:16:03.629 INFO:teuthology.orchestra.run.smithi204.stdout:368 punch from 0x1368600 to 0x1370800, (0x8200 bytes) 2024-09-12T16:16:03.629 INFO:teuthology.orchestra.run.smithi204.stdout:370 punch from 0x2df5000 to 0x2df9800, (0x4800 bytes) 2024-09-12T16:16:03.629 INFO:teuthology.orchestra.run.smithi204.stdout:372 write 0x7404200 thru 0x740cf8a (0x8d8b bytes) 2024-09-12T16:16:03.629 INFO:teuthology.orchestra.run.smithi204.stdout:truncating to largest ever: 0xdecf200 2024-09-12T16:16:03.629 INFO:teuthology.orchestra.run.smithi204.stdout:374 trunc from 0x740d000 to 0xdecf200 2024-09-12T16:16:03.629 INFO:teuthology.orchestra.run.smithi204.stdout:375 read 0x1514e00 thru 0x15238f3 (0xeaf4 bytes) 2024-09-12T16:16:03.629 INFO:teuthology.orchestra.run.smithi204.stdout:376 trunc from 0xdecf200 to 0xbd81600 2024-09-12T16:16:03.629 INFO:teuthology.orchestra.run.smithi204.stdout:377 punch from 0x93e9e00 to 0x93ea200, (0x400 bytes) 2024-09-12T16:16:03.629 INFO:teuthology.orchestra.run.smithi204.stdout:378 punch from 0x2c28600 to 0x2c32400, (0x9e00 bytes) 2024-09-12T16:16:03.629 INFO:teuthology.orchestra.run.smithi204.stdout:379 punch from 0x437e800 to 0x4387c00, (0x9400 bytes) 2024-09-12T16:16:03.629 INFO:teuthology.orchestra.run.smithi204.stdout:380 read 0x26d3000 thru 0x26d3383 (0x384 bytes) 2024-09-12T16:16:03.629 INFO:teuthology.orchestra.run.smithi204.stdout:383 punch from 0xb1d0800 to 0xb1d7c00, (0x7400 bytes) 2024-09-12T16:16:03.629 INFO:teuthology.orchestra.run.smithi204.stdout:384 clone 2 order 23 su 65536 sc 3 2024-09-12T16:16:03.630 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:03.622+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:03.723 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:03.722+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:03.737 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:03.737 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:03.737 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:16:03.737 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:16:03.738 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:03.746 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:16:03.830 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:03.829+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:03.875 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T16:16:03.894 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:03.894 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:16:03.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:16:03.894 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:03.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.895 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:803 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 1957888~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:03.895 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.448374+0000", 2024-09-12T16:16:03.895 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4445609290000001, 2024-09-12T16:16:03.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033721793999999999, 2024-09-12T16:16:03.895 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.895 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.895 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:03.895 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.895 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.895 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.895 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 803 2024-09-12T16:16:03.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.896 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.896 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.896 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448374+0000", 2024-09-12T16:16:03.896 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.896 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.896 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448374+0000", 2024-09-12T16:16:03.896 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.897 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.897 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448375+0000", 2024-09-12T16:16:03.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.68e-07 2024-09-12T16:16:03.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.897 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.897 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448377+0000", 2024-09-12T16:16:03.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.691e-06 2024-09-12T16:16:03.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.897 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.897 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448382+0000", 2024-09-12T16:16:03.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6180000000000003e-06 2024-09-12T16:16:03.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448387+0000", 2024-09-12T16:16:03.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8019999999999999e-06 2024-09-12T16:16:03.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:03.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.481994+0000", 2024-09-12T16:16:03.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033606893999999998 2024-09-12T16:16:03.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:03.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482038+0000", 2024-09-12T16:16:03.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3680000000000002e-05 2024-09-12T16:16:03.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:03.899 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482096+0000", 2024-09-12T16:16:03.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8541000000000001e-05 2024-09-12T16:16:03.899 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.899 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.899 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.899 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:804 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2064384~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:03.899 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.448393+0000", 2024-09-12T16:16:03.900 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4445420979999999, 2024-09-12T16:16:03.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033822146999999997, 2024-09-12T16:16:03.900 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.900 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.900 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:03.900 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.900 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.900 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.900 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 804 2024-09-12T16:16:03.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.900 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.901 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.901 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448393+0000", 2024-09-12T16:16:03.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.901 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.901 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448393+0000", 2024-09-12T16:16:03.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.901 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.901 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448605+0000", 2024-09-12T16:16:03.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021201600000000001 2024-09-12T16:16:03.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448608+0000", 2024-09-12T16:16:03.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6299999999999998e-06 2024-09-12T16:16:03.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448615+0000", 2024-09-12T16:16:03.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6200000000000001e-06 2024-09-12T16:16:03.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448620+0000", 2024-09-12T16:16:03.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5829999999999997e-06 2024-09-12T16:16:03.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:03.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482119+0000", 2024-09-12T16:16:03.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033499292999999999 2024-09-12T16:16:03.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:03.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482161+0000", 2024-09-12T16:16:03.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1270999999999998e-05 2024-09-12T16:16:03.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:03.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482215+0000", 2024-09-12T16:16:03.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4734000000000001e-05 2024-09-12T16:16:03.904 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.904 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.904 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.904 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:805 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2170880~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:03.904 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.448628+0000", 2024-09-12T16:16:03.904 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.444307429, 2024-09-12T16:16:03.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033705087000000002, 2024-09-12T16:16:03.905 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.905 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.905 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:03.905 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.905 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.905 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.905 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 805 2024-09-12T16:16:03.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.905 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.905 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.905 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448628+0000", 2024-09-12T16:16:03.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.906 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.906 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448628+0000", 2024-09-12T16:16:03.906 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.906 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.906 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448628+0000", 2024-09-12T16:16:03.906 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8000000000000002e-07 2024-09-12T16:16:03.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.906 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.906 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448633+0000", 2024-09-12T16:16:03.906 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5879999999999999e-06 2024-09-12T16:16:03.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448637+0000", 2024-09-12T16:16:03.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8369999999999999e-06 2024-09-12T16:16:03.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448640+0000", 2024-09-12T16:16:03.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.853e-06 2024-09-12T16:16:03.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:03.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482240+0000", 2024-09-12T16:16:03.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033599992000000002 2024-09-12T16:16:03.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:03.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482280+0000", 2024-09-12T16:16:03.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0048e-05 2024-09-12T16:16:03.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:03.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482333+0000", 2024-09-12T16:16:03.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3489000000000002e-05 2024-09-12T16:16:03.908 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.908 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.909 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.909 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:806 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2277376~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:03.909 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.448644+0000", 2024-09-12T16:16:03.909 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.444291905, 2024-09-12T16:16:03.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033807825, 2024-09-12T16:16:03.909 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.909 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.909 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:03.909 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.909 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.909 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.910 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 806 2024-09-12T16:16:03.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.910 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.910 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448644+0000", 2024-09-12T16:16:03.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.910 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448644+0000", 2024-09-12T16:16:03.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448923+0000", 2024-09-12T16:16:03.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00027954 2024-09-12T16:16:03.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448927+0000", 2024-09-12T16:16:03.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0430000000000001e-06 2024-09-12T16:16:03.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448936+0000", 2024-09-12T16:16:03.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9460000000000004e-06 2024-09-12T16:16:03.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448943+0000", 2024-09-12T16:16:03.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4710000000000004e-06 2024-09-12T16:16:03.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:03.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482355+0000", 2024-09-12T16:16:03.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033412874000000002 2024-09-12T16:16:03.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.913 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:03.913 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482396+0000", 2024-09-12T16:16:03.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.104e-05 2024-09-12T16:16:03.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.913 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:03.913 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482451+0000", 2024-09-12T16:16:03.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4911000000000003e-05 2024-09-12T16:16:03.913 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.913 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.913 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.914 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:809 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2596864~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:03.914 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.448990+0000", 2024-09-12T16:16:03.914 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4439453179999999, 2024-09-12T16:16:03.914 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033801342999999998, 2024-09-12T16:16:03.914 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.914 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.914 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:03.914 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.914 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.914 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.914 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 809 2024-09-12T16:16:03.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.915 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.915 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.915 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448990+0000", 2024-09-12T16:16:03.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.915 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.915 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448990+0000", 2024-09-12T16:16:03.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.915 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448990+0000", 2024-09-12T16:16:03.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5199999999999998e-07 2024-09-12T16:16:03.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448998+0000", 2024-09-12T16:16:03.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.17e-06 2024-09-12T16:16:03.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449002+0000", 2024-09-12T16:16:03.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0969999999999999e-06 2024-09-12T16:16:03.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449004+0000", 2024-09-12T16:16:03.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6649999999999999e-06 2024-09-12T16:16:03.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:03.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482702+0000", 2024-09-12T16:16:03.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033697908999999998 2024-09-12T16:16:03.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:03.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482740+0000", 2024-09-12T16:16:03.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7834999999999999e-05 2024-09-12T16:16:03.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:03.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482791+0000", 2024-09-12T16:16:03.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1415000000000002e-05 2024-09-12T16:16:03.918 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.918 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.918 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.919 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:810 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 49152~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:03.919 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.449008+0000", 2024-09-12T16:16:03.919 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.443927164, 2024-09-12T16:16:03.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033898167, 2024-09-12T16:16:03.919 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.919 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.919 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:03.919 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.919 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.919 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.919 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 810 2024-09-12T16:16:03.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.920 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449008+0000", 2024-09-12T16:16:03.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449008+0000", 2024-09-12T16:16:03.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449277+0000", 2024-09-12T16:16:03.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026909600000000003 2024-09-12T16:16:03.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449280+0000", 2024-09-12T16:16:03.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.061e-06 2024-09-12T16:16:03.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449288+0000", 2024-09-12T16:16:03.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7500000000000003e-06 2024-09-12T16:16:03.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449292+0000", 2024-09-12T16:16:03.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9570000000000004e-06 2024-09-12T16:16:03.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:03.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482814+0000", 2024-09-12T16:16:03.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033522248999999997 2024-09-12T16:16:03.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:03.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482854+0000", 2024-09-12T16:16:03.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9947999999999998e-05 2024-09-12T16:16:03.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:03.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482906+0000", 2024-09-12T16:16:03.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2105999999999999e-05 2024-09-12T16:16:03.923 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.923 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.923 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.923 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:811 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 155648~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:03.923 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.449300+0000", 2024-09-12T16:16:03.923 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.443635722, 2024-09-12T16:16:03.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033729174000000001, 2024-09-12T16:16:03.923 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.924 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.924 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:03.924 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.924 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.924 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.924 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 811 2024-09-12T16:16:03.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.924 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.924 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.924 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449300+0000", 2024-09-12T16:16:03.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449300+0000", 2024-09-12T16:16:03.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449300+0000", 2024-09-12T16:16:03.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9200000000000002e-07 2024-09-12T16:16:03.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449301+0000", 2024-09-12T16:16:03.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3009999999999999e-06 2024-09-12T16:16:03.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449306+0000", 2024-09-12T16:16:03.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4399999999999998e-06 2024-09-12T16:16:03.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449308+0000", 2024-09-12T16:16:03.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.553e-06 2024-09-12T16:16:03.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:03.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482935+0000", 2024-09-12T16:16:03.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033626243 2024-09-12T16:16:03.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:03.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482976+0000", 2024-09-12T16:16:03.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1505999999999999e-05 2024-09-12T16:16:03.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:03.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483029+0000", 2024-09-12T16:16:03.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2839e-05 2024-09-12T16:16:03.927 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.928 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.928 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.928 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:812 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 262144~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:03.928 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.449312+0000", 2024-09-12T16:16:03.928 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4436234960000001, 2024-09-12T16:16:03.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033833931999999997, 2024-09-12T16:16:03.928 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.928 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.928 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:03.928 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.928 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.928 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.929 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 812 2024-09-12T16:16:03.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.929 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.929 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.929 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449312+0000", 2024-09-12T16:16:03.929 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.929 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.929 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449312+0000", 2024-09-12T16:16:03.929 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449312+0000", 2024-09-12T16:16:03.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2999999999999999e-07 2024-09-12T16:16:03.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449313+0000", 2024-09-12T16:16:03.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0690000000000001e-06 2024-09-12T16:16:03.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449316+0000", 2024-09-12T16:16:03.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.168e-06 2024-09-12T16:16:03.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.931 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449320+0000", 2024-09-12T16:16:03.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1999999999999999e-06 2024-09-12T16:16:03.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:03.931 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483051+0000", 2024-09-12T16:16:03.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033731864 2024-09-12T16:16:03.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.932 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:03.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483092+0000", 2024-09-12T16:16:03.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0927999999999998e-05 2024-09-12T16:16:03.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.932 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:03.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483146+0000", 2024-09-12T16:16:03.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3473000000000001e-05 2024-09-12T16:16:03.932 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.932 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.932 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.933 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:813 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 368640~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:03.933 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.449324+0000", 2024-09-12T16:16:03.933 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.443611338, 2024-09-12T16:16:03.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033939061, 2024-09-12T16:16:03.933 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.933 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.933 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:03.933 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.933 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.933 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.933 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 813 2024-09-12T16:16:03.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.933 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449324+0000", 2024-09-12T16:16:03.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449324+0000", 2024-09-12T16:16:03.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449325+0000", 2024-09-12T16:16:03.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7100000000000001e-07 2024-09-12T16:16:03.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.935 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.935 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449326+0000", 2024-09-12T16:16:03.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6759999999999999e-06 2024-09-12T16:16:03.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.935 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.935 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449331+0000", 2024-09-12T16:16:03.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9910000000000002e-06 2024-09-12T16:16:03.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.936 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.936 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449336+0000", 2024-09-12T16:16:03.936 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7230000000000004e-06 2024-09-12T16:16:03.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.936 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:03.936 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483169+0000", 2024-09-12T16:16:03.936 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033832889999999997 2024-09-12T16:16:03.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.936 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:03.936 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483211+0000", 2024-09-12T16:16:03.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1780000000000003e-05 2024-09-12T16:16:03.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:03.937 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483263+0000", 2024-09-12T16:16:03.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2330000000000002e-05 2024-09-12T16:16:03.937 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.937 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.937 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.937 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:814 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 475136~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:03.937 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.449344+0000", 2024-09-12T16:16:03.937 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4435910279999999, 2024-09-12T16:16:03.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034031447999999999, 2024-09-12T16:16:03.938 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.938 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.938 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:03.938 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.938 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.938 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.938 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 814 2024-09-12T16:16:03.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.938 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449344+0000", 2024-09-12T16:16:03.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449344+0000", 2024-09-12T16:16:03.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449345+0000", 2024-09-12T16:16:03.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3099999999999998e-07 2024-09-12T16:16:03.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.940 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449347+0000", 2024-09-12T16:16:03.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.872e-06 2024-09-12T16:16:03.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.940 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449352+0000", 2024-09-12T16:16:03.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7980000000000002e-06 2024-09-12T16:16:03.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449357+0000", 2024-09-12T16:16:03.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4399999999999998e-06 2024-09-12T16:16:03.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.941 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:03.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483286+0000", 2024-09-12T16:16:03.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033928697000000001 2024-09-12T16:16:03.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.941 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:03.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483325+0000", 2024-09-12T16:16:03.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8943999999999998e-05 2024-09-12T16:16:03.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.942 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:03.942 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483376+0000", 2024-09-12T16:16:03.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1266e-05 2024-09-12T16:16:03.942 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.942 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.942 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.942 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:815 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 581632~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:03.942 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.449363+0000", 2024-09-12T16:16:03.942 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4435719490000001, 2024-09-12T16:16:03.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034127672999999997, 2024-09-12T16:16:03.942 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.943 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.943 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:03.943 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.943 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.943 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.943 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 815 2024-09-12T16:16:03.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.943 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.943 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449363+0000", 2024-09-12T16:16:03.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449363+0000", 2024-09-12T16:16:03.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449392+0000", 2024-09-12T16:16:03.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8322000000000001e-05 2024-09-12T16:16:03.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449395+0000", 2024-09-12T16:16:03.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.971e-06 2024-09-12T16:16:03.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449402+0000", 2024-09-12T16:16:03.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3089999999999998e-06 2024-09-12T16:16:03.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449408+0000", 2024-09-12T16:16:03.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7769999999999999e-06 2024-09-12T16:16:03.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:03.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483399+0000", 2024-09-12T16:16:03.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033990764999999999 2024-09-12T16:16:03.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:03.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483437+0000", 2024-09-12T16:16:03.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8182999999999997e-05 2024-09-12T16:16:03.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:03.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483491+0000", 2024-09-12T16:16:03.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4345999999999998e-05 2024-09-12T16:16:03.946 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.947 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.947 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.947 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:816 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 688128~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:03.947 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.449417+0000", 2024-09-12T16:16:03.947 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4435186760000001, 2024-09-12T16:16:03.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034188187000000002, 2024-09-12T16:16:03.947 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.947 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.947 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:03.947 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.947 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.947 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.948 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 816 2024-09-12T16:16:03.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.948 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449417+0000", 2024-09-12T16:16:03.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449417+0000", 2024-09-12T16:16:03.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.949 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.453927+0000", 2024-09-12T16:16:03.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0045100280000000001 2024-09-12T16:16:03.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.949 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.453932+0000", 2024-09-12T16:16:03.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.916e-06 2024-09-12T16:16:03.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.949 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.453940+0000", 2024-09-12T16:16:03.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3720000000000005e-06 2024-09-12T16:16:03.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.453956+0000", 2024-09-12T16:16:03.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6181999999999999e-05 2024-09-12T16:16:03.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:03.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483515+0000", 2024-09-12T16:16:03.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.029558261999999998 2024-09-12T16:16:03.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:03.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483553+0000", 2024-09-12T16:16:03.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8677999999999998e-05 2024-09-12T16:16:03.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.951 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:03.951 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483605+0000", 2024-09-12T16:16:03.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1749000000000002e-05 2024-09-12T16:16:03.951 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.951 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.951 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.951 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:852 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 1867776~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:03.951 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.454401+0000", 2024-09-12T16:16:03.951 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.438534204, 2024-09-12T16:16:03.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033782697, 2024-09-12T16:16:03.952 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.952 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.952 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:03.952 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.952 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.952 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.952 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 852 2024-09-12T16:16:03.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.952 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454401+0000", 2024-09-12T16:16:03.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454401+0000", 2024-09-12T16:16:03.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454402+0000", 2024-09-12T16:16:03.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.58e-07 2024-09-12T16:16:03.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454403+0000", 2024-09-12T16:16:03.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.079e-06 2024-09-12T16:16:03.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454406+0000", 2024-09-12T16:16:03.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3890000000000001e-06 2024-09-12T16:16:03.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454416+0000", 2024-09-12T16:16:03.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8719999999999997e-06 2024-09-12T16:16:03.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:03.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.487993+0000", 2024-09-12T16:16:03.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033577184000000003 2024-09-12T16:16:03.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:03.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488075+0000", 2024-09-12T16:16:03.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2169000000000006e-05 2024-09-12T16:16:03.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:03.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488184+0000", 2024-09-12T16:16:03.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108646 2024-09-12T16:16:03.956 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.956 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.956 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.956 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:853 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 1974272~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:03.956 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.454420+0000", 2024-09-12T16:16:03.956 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.438515778, 2024-09-12T16:16:03.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033941592, 2024-09-12T16:16:03.957 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.957 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.957 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:03.957 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.957 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.957 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.957 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 853 2024-09-12T16:16:03.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.957 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454420+0000", 2024-09-12T16:16:03.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454420+0000", 2024-09-12T16:16:03.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454420+0000", 2024-09-12T16:16:03.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8799999999999998e-07 2024-09-12T16:16:03.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454428+0000", 2024-09-12T16:16:03.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0660000000000004e-06 2024-09-12T16:16:03.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454431+0000", 2024-09-12T16:16:03.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3780000000000001e-06 2024-09-12T16:16:03.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454434+0000", 2024-09-12T16:16:03.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4959999999999999e-06 2024-09-12T16:16:03.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:03.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488218+0000", 2024-09-12T16:16:03.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033783794999999998 2024-09-12T16:16:03.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:03.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488280+0000", 2024-09-12T16:16:03.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2361999999999997e-05 2024-09-12T16:16:03.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:03.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488361+0000", 2024-09-12T16:16:03.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1206999999999997e-05 2024-09-12T16:16:03.961 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.961 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.961 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.961 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:854 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2080768~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:03.961 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.454437+0000", 2024-09-12T16:16:03.962 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.438497986, 2024-09-12T16:16:03.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034057872000000003, 2024-09-12T16:16:03.962 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.962 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.962 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:03.962 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.962 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.962 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.962 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 854 2024-09-12T16:16:03.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.962 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454437+0000", 2024-09-12T16:16:03.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.963 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454437+0000", 2024-09-12T16:16:03.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.963 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454438+0000", 2024-09-12T16:16:03.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2700000000000001e-07 2024-09-12T16:16:03.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454439+0000", 2024-09-12T16:16:03.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.029e-06 2024-09-12T16:16:03.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454442+0000", 2024-09-12T16:16:03.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8320000000000002e-06 2024-09-12T16:16:03.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454444+0000", 2024-09-12T16:16:03.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4449999999999999e-06 2024-09-12T16:16:03.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:03.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488393+0000", 2024-09-12T16:16:03.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033948878000000002 2024-09-12T16:16:03.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:03.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488434+0000", 2024-09-12T16:16:03.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1641999999999999e-05 2024-09-12T16:16:03.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:03.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488495+0000", 2024-09-12T16:16:03.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0819000000000002e-05 2024-09-12T16:16:03.966 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.966 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.966 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.966 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:855 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2187264~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:03.966 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.454447+0000", 2024-09-12T16:16:03.966 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4384886800000001, 2024-09-12T16:16:03.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034166180999999997, 2024-09-12T16:16:03.966 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.966 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.966 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:03.966 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.967 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.967 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.967 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 855 2024-09-12T16:16:03.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.967 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454447+0000", 2024-09-12T16:16:03.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454447+0000", 2024-09-12T16:16:03.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454447+0000", 2024-09-12T16:16:03.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1e-07 2024-09-12T16:16:03.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454448+0000", 2024-09-12T16:16:03.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0299999999999997e-07 2024-09-12T16:16:03.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454451+0000", 2024-09-12T16:16:03.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8499999999999998e-06 2024-09-12T16:16:03.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454453+0000", 2024-09-12T16:16:03.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2520000000000002e-06 2024-09-12T16:16:03.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:03.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488520+0000", 2024-09-12T16:16:03.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034066804999999999 2024-09-12T16:16:03.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:03.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488562+0000", 2024-09-12T16:16:03.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2400000000000001e-05 2024-09-12T16:16:03.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:03.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488613+0000", 2024-09-12T16:16:03.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0760999999999997e-05 2024-09-12T16:16:03.970 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.970 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.970 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.970 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:856 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2293760~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:03.970 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.454456+0000", 2024-09-12T16:16:03.971 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4384796739999999, 2024-09-12T16:16:03.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034275297000000003, 2024-09-12T16:16:03.971 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.971 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.971 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:03.971 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.971 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.971 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.971 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 856 2024-09-12T16:16:03.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.971 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454456+0000", 2024-09-12T16:16:03.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454456+0000", 2024-09-12T16:16:03.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454456+0000", 2024-09-12T16:16:03.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.11e-07 2024-09-12T16:16:03.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454457+0000", 2024-09-12T16:16:03.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6799999999999999e-07 2024-09-12T16:16:03.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454460+0000", 2024-09-12T16:16:03.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.858e-06 2024-09-12T16:16:03.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454463+0000", 2024-09-12T16:16:03.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9670000000000001e-06 2024-09-12T16:16:03.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:03.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488637+0000", 2024-09-12T16:16:03.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034174300999999997 2024-09-12T16:16:03.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:03.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488678+0000", 2024-09-12T16:16:03.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0732999999999998e-05 2024-09-12T16:16:03.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:03.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488731+0000", 2024-09-12T16:16:03.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3359000000000002e-05 2024-09-12T16:16:03.975 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.975 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.975 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.975 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:857 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2400256~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:03.975 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.454466+0000", 2024-09-12T16:16:03.975 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4384698490000001, 2024-09-12T16:16:03.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034382506, 2024-09-12T16:16:03.976 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.976 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.976 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:03.976 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.976 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.976 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.976 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 857 2024-09-12T16:16:03.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.976 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454466+0000", 2024-09-12T16:16:03.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454466+0000", 2024-09-12T16:16:03.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454466+0000", 2024-09-12T16:16:03.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:16:03.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454467+0000", 2024-09-12T16:16:03.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5300000000000002e-07 2024-09-12T16:16:03.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454470+0000", 2024-09-12T16:16:03.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7970000000000001e-06 2024-09-12T16:16:03.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454472+0000", 2024-09-12T16:16:03.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3089999999999998e-06 2024-09-12T16:16:03.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:03.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488754+0000", 2024-09-12T16:16:03.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034282436999999999 2024-09-12T16:16:03.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:03.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488795+0000", 2024-09-12T16:16:03.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0880999999999997e-05 2024-09-12T16:16:03.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:03.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488848+0000", 2024-09-12T16:16:03.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2917000000000002e-05 2024-09-12T16:16:03.979 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.980 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.980 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.980 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:858 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2506752~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:03.980 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.454475+0000", 2024-09-12T16:16:03.980 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4384606280000001, 2024-09-12T16:16:03.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034498824999999997, 2024-09-12T16:16:03.980 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.980 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.980 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:03.980 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.981 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.981 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.981 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 858 2024-09-12T16:16:03.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.981 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454475+0000", 2024-09-12T16:16:03.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454475+0000", 2024-09-12T16:16:03.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454475+0000", 2024-09-12T16:16:03.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2000000000000001e-07 2024-09-12T16:16:03.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454476+0000", 2024-09-12T16:16:03.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5799999999999998e-07 2024-09-12T16:16:03.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454480+0000", 2024-09-12T16:16:03.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5750000000000001e-06 2024-09-12T16:16:03.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454482+0000", 2024-09-12T16:16:03.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3300000000000001e-06 2024-09-12T16:16:03.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:03.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488870+0000", 2024-09-12T16:16:03.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034388152999999998 2024-09-12T16:16:03.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:03.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488909+0000", 2024-09-12T16:16:03.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8574e-05 2024-09-12T16:16:03.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:03.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488974+0000", 2024-09-12T16:16:03.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5015e-05 2024-09-12T16:16:03.984 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.984 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.984 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.985 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:859 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2613248~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:03.985 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.454485+0000", 2024-09-12T16:16:03.985 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4384505380000001, 2024-09-12T16:16:03.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034601403000000003, 2024-09-12T16:16:03.985 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:03.985 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:03.985 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:03.985 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:03.985 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:03.985 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:03.985 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 859 2024-09-12T16:16:03.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.986 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:03.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:03.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454485+0000", 2024-09-12T16:16:03.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:03.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454485+0000", 2024-09-12T16:16:03.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:03.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:03.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454485+0000", 2024-09-12T16:16:03.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.35e-07 2024-09-12T16:16:03.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:03.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454486+0000", 2024-09-12T16:16:03.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7399999999999991e-07 2024-09-12T16:16:03.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:03.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454489+0000", 2024-09-12T16:16:03.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7690000000000001e-06 2024-09-12T16:16:03.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:03.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454491+0000", 2024-09-12T16:16:03.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2520000000000002e-06 2024-09-12T16:16:03.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:03.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488990+0000", 2024-09-12T16:16:03.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034499019999999998 2024-09-12T16:16:03.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:03.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.489031+0000", 2024-09-12T16:16:03.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0648000000000001e-05 2024-09-12T16:16:03.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:03.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:03.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:03.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.489086+0000", 2024-09-12T16:16:03.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5504999999999998e-05 2024-09-12T16:16:03.989 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.989 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.989 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.989 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:03.989 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:03.989 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:03.991 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:16:03.991 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:03.989+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:03.997 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:16:03.997 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:16:04.015 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:16:04.015 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:16:04.023 INFO:teuthology.orchestra.run.smithi017.stderr:set osd.5 primary-affinity to 0.0892766 (858502) 2024-09-12T16:16:04.033 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T16:16:04.037 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:16:04.037 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:16:04.056 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:16:04.057 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:16:04.074 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:16:04.074 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:16:04.091 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:04.091+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:04.107 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:16:04.107 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:16:04.110 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:04.110 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:04.120 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:16:04.204 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:04.203+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:04.268 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:04.268 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:04.277 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:16:04.293 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:04.293+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:04.394 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:04.394+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:04.423 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:04.424 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:04.432 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:16:04.495 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:04.495+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:04.538 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:04.539 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:04.547 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:16:04.596 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:04.595+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:04.693 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:04.693 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:04.697 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:04.696+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:04.702 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:16:04.797 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:04.797+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:04.808 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:04.808 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:04.817 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:16:04.898 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:04.897+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:04.937 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:04.937 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:04.946 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:16:05.024 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2024-09-12T16:16:05.030 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:05.029+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:05.100 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:05.099+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:05.102 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:05.102 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:05.111 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:16:05.201 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:16:05.199+0000 7f002d431640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32213) UID: 0 2024-09-12T16:16:05.261 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:05.261 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:05.270 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:16:05.301 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:05.301+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:05.402 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:05.401+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:05.404 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #0, image image_client.0 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent1 2024-09-12T16:16:05.423 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:05.423 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:05.432 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:16:05.516 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:05.515+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:05.583 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:05.583 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:05.592 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:16:05.604 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:05.603+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:05.704 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:05.704+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:05.746 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:05.747 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:05.755 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:16:05.806 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:05.804+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:05.863 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:05.863 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:05.871 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:16:05.912 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:16:05.911+0000 7f002d431640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32213) UID: 0 2024-09-12T16:16:05.936 INFO:teuthology.orchestra.run.smithi204.stdout:385 punch from 0x9a1c800 to 0x9a28400, (0xbc00 bytes) 2024-09-12T16:16:05.951 INFO:teuthology.orchestra.run.smithi204.stdout:387 write 0x32c7800 thru 0x32cd4fe (0x5cff bytes) 2024-09-12T16:16:05.951 INFO:teuthology.orchestra.run.smithi204.stdout:388 write 0xb5d0800 thru 0xb5d98d8 (0x90d9 bytes) 2024-09-12T16:16:05.976 INFO:teuthology.orchestra.run.smithi204.stdout:389 write 0xd0f1a00 thru 0xd1003b7 (0xe9b8 bytes) 2024-09-12T16:16:05.977 INFO:teuthology.orchestra.run.smithi204.stdout:391 punch from 0xcd1f000 to 0xcd28e00, (0x9e00 bytes) 2024-09-12T16:16:05.979 INFO:teuthology.orchestra.run.smithi204.stdout:392 read 0xad16e00 thru 0xad186c1 (0x18c2 bytes) 2024-09-12T16:16:05.979 INFO:teuthology.orchestra.run.smithi204.stdout:393 trunc from 0xd100400 to 0xcbafc00 2024-09-12T16:16:05.990 INFO:teuthology.orchestra.run.smithi204.stdout:394 write 0x9eb7200 thru 0x9ebbf18 (0x4d19 bytes) 2024-09-12T16:16:05.997 INFO:teuthology.orchestra.run.smithi204.stdout:397 punch from 0x3577c00 to 0x357f400, (0x7800 bytes) 2024-09-12T16:16:06.003 INFO:teuthology.orchestra.run.smithi204.stdout:398 read 0x4635400 thru 0x463ed91 (0x9992 bytes) 2024-09-12T16:16:06.007 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:06.006+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:06.013 INFO:teuthology.orchestra.run.smithi204.stdout:400 trunc from 0xcbafc00 to 0xb524c00 2024-09-12T16:16:06.033 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:06.034 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:06.041 INFO:teuthology.orchestra.run.smithi204.stdout:402 write 0x33eca00 thru 0x33f6662 (0x9c63 bytes) 2024-09-12T16:16:06.043 INFO:teuthology.orchestra.run.smithi204.stdout:403 read 0x7fb3a00 thru 0x7fbd9b6 (0x9fb7 bytes) 2024-09-12T16:16:06.043 INFO:teuthology.orchestra.run.smithi204.stdout:404 punch from 0x902ec00 to 0x9031a00, (0x2e00 bytes) 2024-09-12T16:16:06.044 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:16:06.049 INFO:teuthology.orchestra.run.smithi204.stdout:405 read 0x391ce00 thru 0x391ce69 (0x6a bytes) 2024-09-12T16:16:06.049 INFO:teuthology.orchestra.run.smithi204.stdout:406 write 0x7c11000 thru 0x7c11a08 (0xa09 bytes) 2024-09-12T16:16:06.049 INFO:teuthology.orchestra.run.smithi204.stdout:409 punch from 0x309be00 to 0x309ca00, (0xc00 bytes) 2024-09-12T16:16:06.050 INFO:teuthology.orchestra.run.smithi204.stdout:412 read 0x61b9400 thru 0x61c3b78 (0xa779 bytes) 2024-09-12T16:16:06.053 INFO:teuthology.orchestra.run.smithi204.stdout:413 trunc from 0xb524c00 to 0xd4d9000 2024-09-12T16:16:06.064 INFO:teuthology.orchestra.run.smithi204.stdout:414 write 0xa75c00 thru 0xa77f42 (0x2343 bytes) 2024-09-12T16:16:06.066 INFO:teuthology.orchestra.run.smithi204.stdout:415 read 0x1ab7400 thru 0x1ab809f (0xca0 bytes) 2024-09-12T16:16:06.067 INFO:teuthology.orchestra.run.smithi204.stdout:417 punch from 0x1a5f800 to 0x1a6e000, (0xe800 bytes) 2024-09-12T16:16:06.091 INFO:teuthology.orchestra.run.smithi204.stdout:418 punch from 0xca18000 to 0xca19800, (0x1800 bytes) 2024-09-12T16:16:06.091 INFO:teuthology.orchestra.run.smithi204.stdout:421 write 0x571a200 thru 0x571a37c (0x17d bytes) 2024-09-12T16:16:06.096 INFO:teuthology.orchestra.run.smithi204.stdout:423 write 0x19d4200 thru 0x19df74c (0xb54d bytes) 2024-09-12T16:16:06.096 INFO:teuthology.orchestra.run.smithi204.stdout:424 write 0xab2d200 thru 0xab32633 (0x5434 bytes) 2024-09-12T16:16:06.108 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:16:06.107+0000 7f002d431640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32213) UID: 0 2024-09-12T16:16:06.120 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T16:16:06.132 INFO:teuthology.orchestra.run.smithi204.stdout:427 write 0xe4afa00 thru 0xe4b0d63 (0x1364 bytes) 2024-09-12T16:16:06.133 INFO:teuthology.orchestra.run.smithi204.stdout:428 read 0xd619200 thru 0xd626042 (0xce43 bytes) 2024-09-12T16:16:06.134 INFO:teuthology.orchestra.run.smithi204.stdout:429 read 0xabbae00 thru 0xabc344c (0x864d bytes) 2024-09-12T16:16:06.147 INFO:teuthology.orchestra.run.smithi204.stdout:430 trunc from 0xe4b0e00 to 0x38b8c00 2024-09-12T16:16:06.180 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:06.180 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:06.180 INFO:teuthology.orchestra.run.smithi204.stdout:truncating to largest ever: 0xe823e00 2024-09-12T16:16:06.189 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:16:06.194 INFO:teuthology.orchestra.run.smithi204.stdout:432 trunc from 0x38b8c00 to 0xe823e00 2024-09-12T16:16:06.202 INFO:teuthology.orchestra.run.smithi204.stdout:433 read 0x594d600 thru 0x595178c (0x418d bytes) 2024-09-12T16:16:06.209 INFO:teuthology.orchestra.run.smithi204.stdout:434 read 0xbed7400 thru 0xbed998a (0x258b bytes) 2024-09-12T16:16:06.213 INFO:teuthology.orchestra.run.smithi204.stdout:436 trunc from 0xe823e00 to 0xacc2800 2024-09-12T16:16:06.229 INFO:teuthology.orchestra.run.smithi204.stdout:437 trunc from 0xacc2800 to 0x60d5a00 2024-09-12T16:16:06.230 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:06.229+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:06.241 INFO:teuthology.orchestra.run.smithi204.stdout:438 read 0x323b200 thru 0x323bf69 (0xd6a bytes) 2024-09-12T16:16:06.248 INFO:teuthology.orchestra.run.smithi204.stdout:440 read 0x3a5d800 thru 0x3a61cf7 (0x44f8 bytes) 2024-09-12T16:16:06.248 INFO:teuthology.orchestra.run.smithi204.stdout:441 punch from 0x52e2400 to 0x52e5e00, (0x3a00 bytes) 2024-09-12T16:16:06.262 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:16:06.262 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:16:06.264 INFO:teuthology.orchestra.run.smithi204.stdout:442 write 0x877b200 thru 0x87848a3 (0x96a4 bytes) 2024-09-12T16:16:06.264 INFO:teuthology.orchestra.run.smithi204.stdout:444 read 0x963c00 thru 0x966b76 (0x2f77 bytes) 2024-09-12T16:16:06.265 INFO:teuthology.orchestra.run.smithi204.stdout:447 trunc from 0x8784a00 to 0x7f0d200 2024-09-12T16:16:06.280 INFO:teuthology.orchestra.run.smithi204.stdout:451 punch from 0x24a7c00 to 0x24b1000, (0x9400 bytes) 2024-09-12T16:16:06.283 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:16:06.283 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:16:06.285 INFO:teuthology.orchestra.run.smithi204.stdout:truncating to largest ever: 0xeb0f200 2024-09-12T16:16:06.292 INFO:teuthology.orchestra.run.smithi204.stdout:454 trunc from 0x7f0d200 to 0xeb0f200 2024-09-12T16:16:06.304 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:16:06.305 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:16:06.305 INFO:teuthology.orchestra.run.smithi204.stdout:455 read 0x9b17000 thru 0x9b2484d (0xd84e bytes) 2024-09-12T16:16:06.306 INFO:teuthology.orchestra.run.smithi204.stdout:457 read 0xd2f9200 thru 0xd30695b (0xd75c bytes) 2024-09-12T16:16:06.306 INFO:teuthology.orchestra.run.smithi204.stdout:458 read 0x437800 thru 0x43794f (0x150 bytes) 2024-09-12T16:16:06.306 INFO:teuthology.orchestra.run.smithi204.stdout:460 write 0x4157200 thru 0x41630ac (0xbead bytes) 2024-09-12T16:16:06.306 INFO:teuthology.orchestra.run.smithi204.stdout:463 read 0x2cf9400 thru 0x2d04871 (0xb472 bytes) 2024-09-12T16:16:06.310 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:06.309+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:06.313 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:06.313 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:06.313 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:16:06.313 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:06.321 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:16:06.321 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:16:06.322 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:16:06.323 INFO:teuthology.orchestra.run.smithi204.stdout:464 trunc from 0xeb0f200 to 0x1f6000 2024-09-12T16:16:06.349 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:16:06.349 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:16:06.372 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:16:06.373 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:16:06.385 INFO:teuthology.orchestra.run.smithi204.stdout:465 read 0x94400 thru 0x9bc2d (0x782e bytes) 2024-09-12T16:16:06.388 INFO:teuthology.orchestra.run.smithi204.stdout:468 read 0x19a200 thru 0x1a7c90 (0xda91 bytes) 2024-09-12T16:16:06.397 INFO:teuthology.orchestra.run.smithi204.stdout:470 write 0x11c6c00 thru 0x11cfbfb (0x8ffc bytes) 2024-09-12T16:16:06.399 INFO:teuthology.orchestra.run.smithi204.stdout:471 read 0x3db600 thru 0x3e4329 (0x8d2a bytes) 2024-09-12T16:16:06.399 INFO:teuthology.orchestra.run.smithi204.stdout:472 read 0x9d9c00 thru 0x9dfbb3 (0x5fb4 bytes) 2024-09-12T16:16:06.399 INFO:teuthology.orchestra.run.smithi204.stdout:473 read 0x1156600 thru 0x115d1f3 (0x6bf4 bytes) 2024-09-12T16:16:06.400 INFO:teuthology.orchestra.run.smithi204.stdout:474 read 0x323800 thru 0x32c4f5 (0x8cf6 bytes) 2024-09-12T16:16:06.400 INFO:teuthology.orchestra.run.smithi204.stdout:476 read 0xf8fa00 thru 0xf90c32 (0x1233 bytes) 2024-09-12T16:16:06.400 INFO:teuthology.orchestra.run.smithi204.stdout:477 punch from 0x101c800 to 0x1024800, (0x8000 bytes) 2024-09-12T16:16:06.401 INFO:teuthology.orchestra.run.smithi204.stdout:479 read 0xa32000 thru 0xa32632 (0x633 bytes) 2024-09-12T16:16:06.415 INFO:teuthology.orchestra.run.smithi204.stdout:480 trunc from 0x11cfc00 to 0xd818400 2024-09-12T16:16:06.426 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:06.425+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:06.437 INFO:teuthology.orchestra.run.smithi204.stdout:481 trunc from 0xd818400 to 0x1ba8600 2024-09-12T16:16:06.445 INFO:teuthology.orchestra.run.smithi204.stdout:482 read 0x10de400 thru 0x10e0143 (0x1d44 bytes) 2024-09-12T16:16:06.447 INFO:teuthology.orchestra.run.smithi204.stdout:483 punch from 0x175c00 to 0x17e000, (0x8400 bytes) 2024-09-12T16:16:06.453 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:06.454 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:06.454 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:16:06.454 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:16:06.454 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:06.455 INFO:teuthology.orchestra.run.smithi204.stdout:484 trunc from 0x1ba8600 to 0x61bcc00 2024-09-12T16:16:06.465 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:16:06.465 INFO:teuthology.orchestra.run.smithi204.stdout:486 punch from 0x3739c00 to 0x3748200, (0xe600 bytes) 2024-09-12T16:16:06.466 INFO:teuthology.orchestra.run.smithi204.stdout:488 read 0x15b3a00 thru 0x15b5f8c (0x258d bytes) 2024-09-12T16:16:06.466 INFO:teuthology.orchestra.run.smithi204.stdout:489 read 0x22eba00 thru 0x22f73ed (0xb9ee bytes) 2024-09-12T16:16:06.467 INFO:teuthology.orchestra.run.smithi204.stdout:492 read 0x5761600 thru 0x576da57 (0xc458 bytes) 2024-09-12T16:16:06.480 INFO:teuthology.orchestra.run.smithi204.stdout:493 write 0xb216800 thru 0xb21b0e2 (0x48e3 bytes) 2024-09-12T16:16:06.481 INFO:teuthology.orchestra.run.smithi204.stdout:496 read 0x49f8a00 thru 0x4a031b3 (0xa7b4 bytes) 2024-09-12T16:16:06.485 INFO:teuthology.orchestra.run.smithi204.stdout:497 trunc from 0xb21b200 to 0x8175200 2024-09-12T16:16:06.503 INFO:teuthology.orchestra.run.smithi204.stdout:498 read 0x32b7e00 thru 0x32c4ccc (0xcecd bytes) 2024-09-12T16:16:06.516 INFO:teuthology.orchestra.run.smithi204.stdout:499 write 0x8a8e000 thru 0x8a9406d (0x606e bytes) 2024-09-12T16:16:06.517 INFO:teuthology.orchestra.run.smithi204.stdout:504 write 0x164be00 thru 0x164c069 (0x26a bytes) 2024-09-12T16:16:06.535 INFO:teuthology.orchestra.run.smithi204.stdout:506 write 0xcd8ee00 thru 0xcd9256d (0x376e bytes) 2024-09-12T16:16:06.536 INFO:teuthology.orchestra.run.smithi204.stdout:507 read 0x9109000 thru 0x9112c09 (0x9c0a bytes) 2024-09-12T16:16:06.536 INFO:teuthology.orchestra.run.smithi204.stdout:508 write 0x2633400 thru 0x26427fd (0xf3fe bytes) 2024-09-12T16:16:06.536 INFO:teuthology.orchestra.run.smithi204.stdout:509 write 0xb834e00 thru 0xb83b3d9 (0x65da bytes) 2024-09-12T16:16:06.536 INFO:teuthology.orchestra.run.smithi204.stdout:510 write 0x7e2dc00 thru 0x7e33713 (0x5b14 bytes) 2024-09-12T16:16:06.536 INFO:teuthology.orchestra.run.smithi204.stdout:511 write 0x2a93400 thru 0x2a9f9f4 (0xc5f5 bytes) 2024-09-12T16:16:06.537 INFO:teuthology.orchestra.run.smithi204.stdout:514 punch from 0x7e65a00 to 0x7e71400, (0xba00 bytes) 2024-09-12T16:16:06.545 INFO:teuthology.orchestra.run.smithi204.stdout:515 trunc from 0xcd92600 to 0x5d21400 2024-09-12T16:16:06.553 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:06.552+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:06.569 INFO:teuthology.orchestra.run.smithi204.stdout:517 write 0x7966000 thru 0x7969341 (0x3342 bytes) 2024-09-12T16:16:06.570 INFO:teuthology.orchestra.run.smithi204.stdout:518 punch from 0x3aec600 to 0x3af6600, (0xa000 bytes) 2024-09-12T16:16:06.572 INFO:teuthology.orchestra.run.smithi204.stdout:521 write 0x7776a00 thru 0x7779c7d (0x327e bytes) 2024-09-12T16:16:06.572 INFO:teuthology.orchestra.run.smithi204.stdout:524 write 0x1e2a000 thru 0x1e310d8 (0x70d9 bytes) 2024-09-12T16:16:06.573 INFO:teuthology.orchestra.run.smithi204.stdout:525 read 0x12c8400 thru 0x12ce760 (0x6361 bytes) 2024-09-12T16:16:06.585 INFO:teuthology.orchestra.run.smithi204.stdout:526 write 0x8501800 thru 0x850f068 (0xd869 bytes) 2024-09-12T16:16:06.587 INFO:teuthology.orchestra.run.smithi204.stdout:531 read 0x15e6600 thru 0x15e82b3 (0x1cb4 bytes) 2024-09-12T16:16:06.592 INFO:teuthology.orchestra.run.smithi204.stdout:533 trunc from 0x850f200 to 0xcd51600 2024-09-12T16:16:06.602 INFO:teuthology.orchestra.run.smithi204.stdout:537 clone 3 order 21 su 262144 sc 12 2024-09-12T16:16:06.612 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:06.611+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:06.629 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:06.629 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:16:06.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:16:06.630 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:06.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.630 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:803 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 1957888~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:06.630 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.448374+0000", 2024-09-12T16:16:06.630 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.1797283890000001, 2024-09-12T16:16:06.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033721793999999999, 2024-09-12T16:16:06.630 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:06.630 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:06.630 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:06.630 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:06.630 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:06.630 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:06.630 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 803 2024-09-12T16:16:06.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.631 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:06.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:06.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448374+0000", 2024-09-12T16:16:06.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:06.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448374+0000", 2024-09-12T16:16:06.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:06.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448375+0000", 2024-09-12T16:16:06.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.68e-07 2024-09-12T16:16:06.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:06.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448377+0000", 2024-09-12T16:16:06.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.691e-06 2024-09-12T16:16:06.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:06.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448382+0000", 2024-09-12T16:16:06.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6180000000000003e-06 2024-09-12T16:16:06.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:06.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448387+0000", 2024-09-12T16:16:06.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8019999999999999e-06 2024-09-12T16:16:06.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:06.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.481994+0000", 2024-09-12T16:16:06.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033606893999999998 2024-09-12T16:16:06.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:06.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482038+0000", 2024-09-12T16:16:06.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3680000000000002e-05 2024-09-12T16:16:06.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:06.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482096+0000", 2024-09-12T16:16:06.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8541000000000001e-05 2024-09-12T16:16:06.634 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.634 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:06.634 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.635 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:804 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2064384~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:06.635 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.448393+0000", 2024-09-12T16:16:06.635 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.1797095579999999, 2024-09-12T16:16:06.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033822146999999997, 2024-09-12T16:16:06.635 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:06.635 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:06.635 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:06.635 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:06.635 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:06.635 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:06.635 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 804 2024-09-12T16:16:06.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.635 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:06.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:06.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448393+0000", 2024-09-12T16:16:06.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:06.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448393+0000", 2024-09-12T16:16:06.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:06.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448605+0000", 2024-09-12T16:16:06.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021201600000000001 2024-09-12T16:16:06.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:06.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448608+0000", 2024-09-12T16:16:06.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6299999999999998e-06 2024-09-12T16:16:06.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:06.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448615+0000", 2024-09-12T16:16:06.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6200000000000001e-06 2024-09-12T16:16:06.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:06.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448620+0000", 2024-09-12T16:16:06.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5829999999999997e-06 2024-09-12T16:16:06.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:06.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482119+0000", 2024-09-12T16:16:06.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033499292999999999 2024-09-12T16:16:06.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:06.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482161+0000", 2024-09-12T16:16:06.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1270999999999998e-05 2024-09-12T16:16:06.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:06.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482215+0000", 2024-09-12T16:16:06.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4734000000000001e-05 2024-09-12T16:16:06.639 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.639 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:06.639 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.639 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:805 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2170880~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:06.639 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.448628+0000", 2024-09-12T16:16:06.639 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.1794748889999997, 2024-09-12T16:16:06.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033705087000000002, 2024-09-12T16:16:06.639 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:06.639 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:06.640 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:06.640 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:06.640 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:06.640 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:06.640 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 805 2024-09-12T16:16:06.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.640 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:06.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:06.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448628+0000", 2024-09-12T16:16:06.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:06.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448628+0000", 2024-09-12T16:16:06.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:06.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448628+0000", 2024-09-12T16:16:06.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8000000000000002e-07 2024-09-12T16:16:06.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:06.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448633+0000", 2024-09-12T16:16:06.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5879999999999999e-06 2024-09-12T16:16:06.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448637+0000", 2024-09-12T16:16:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8369999999999999e-06 2024-09-12T16:16:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448640+0000", 2024-09-12T16:16:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.853e-06 2024-09-12T16:16:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482240+0000", 2024-09-12T16:16:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033599992000000002 2024-09-12T16:16:06.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:06.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482280+0000", 2024-09-12T16:16:06.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0048e-05 2024-09-12T16:16:06.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:06.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482333+0000", 2024-09-12T16:16:06.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3489000000000002e-05 2024-09-12T16:16:06.643 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.644 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:06.644 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.644 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:806 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2277376~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:06.644 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.448644+0000", 2024-09-12T16:16:06.644 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.1794593649999996, 2024-09-12T16:16:06.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033807825, 2024-09-12T16:16:06.644 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:06.644 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:06.644 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:06.644 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:06.645 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:06.645 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:06.645 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 806 2024-09-12T16:16:06.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.645 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:06.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:06.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448644+0000", 2024-09-12T16:16:06.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:06.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448644+0000", 2024-09-12T16:16:06.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448923+0000", 2024-09-12T16:16:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00027954 2024-09-12T16:16:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448927+0000", 2024-09-12T16:16:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0430000000000001e-06 2024-09-12T16:16:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448936+0000", 2024-09-12T16:16:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9460000000000004e-06 2024-09-12T16:16:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448943+0000", 2024-09-12T16:16:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4710000000000004e-06 2024-09-12T16:16:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482355+0000", 2024-09-12T16:16:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033412874000000002 2024-09-12T16:16:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:06.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482396+0000", 2024-09-12T16:16:06.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.104e-05 2024-09-12T16:16:06.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:06.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482451+0000", 2024-09-12T16:16:06.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4911000000000003e-05 2024-09-12T16:16:06.648 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.648 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:06.648 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.649 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:809 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2596864~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:06.649 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.448990+0000", 2024-09-12T16:16:06.649 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.1791127780000004, 2024-09-12T16:16:06.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033801342999999998, 2024-09-12T16:16:06.649 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:06.649 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:06.649 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:06.649 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:06.649 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:06.649 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 809 2024-09-12T16:16:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448990+0000", 2024-09-12T16:16:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448990+0000", 2024-09-12T16:16:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448990+0000", 2024-09-12T16:16:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5199999999999998e-07 2024-09-12T16:16:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448998+0000", 2024-09-12T16:16:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.17e-06 2024-09-12T16:16:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449002+0000", 2024-09-12T16:16:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0969999999999999e-06 2024-09-12T16:16:06.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:06.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449004+0000", 2024-09-12T16:16:06.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6649999999999999e-06 2024-09-12T16:16:06.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:06.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482702+0000", 2024-09-12T16:16:06.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033697908999999998 2024-09-12T16:16:06.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482740+0000", 2024-09-12T16:16:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7834999999999999e-05 2024-09-12T16:16:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482791+0000", 2024-09-12T16:16:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1415000000000002e-05 2024-09-12T16:16:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:810 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 49152~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.449008+0000", 2024-09-12T16:16:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.1790946240000002, 2024-09-12T16:16:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033898167, 2024-09-12T16:16:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 810 2024-09-12T16:16:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449008+0000", 2024-09-12T16:16:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449008+0000", 2024-09-12T16:16:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449277+0000", 2024-09-12T16:16:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026909600000000003 2024-09-12T16:16:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449280+0000", 2024-09-12T16:16:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.061e-06 2024-09-12T16:16:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449288+0000", 2024-09-12T16:16:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7500000000000003e-06 2024-09-12T16:16:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449292+0000", 2024-09-12T16:16:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9570000000000004e-06 2024-09-12T16:16:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482814+0000", 2024-09-12T16:16:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033522248999999997 2024-09-12T16:16:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482854+0000", 2024-09-12T16:16:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9947999999999998e-05 2024-09-12T16:16:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482906+0000", 2024-09-12T16:16:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2105999999999999e-05 2024-09-12T16:16:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:811 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 155648~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.449300+0000", 2024-09-12T16:16:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.1788031820000002, 2024-09-12T16:16:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033729174000000001, 2024-09-12T16:16:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 811 2024-09-12T16:16:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449300+0000", 2024-09-12T16:16:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449300+0000", 2024-09-12T16:16:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449300+0000", 2024-09-12T16:16:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9200000000000002e-07 2024-09-12T16:16:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449301+0000", 2024-09-12T16:16:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3009999999999999e-06 2024-09-12T16:16:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449306+0000", 2024-09-12T16:16:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4399999999999998e-06 2024-09-12T16:16:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449308+0000", 2024-09-12T16:16:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.553e-06 2024-09-12T16:16:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482935+0000", 2024-09-12T16:16:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033626243 2024-09-12T16:16:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482976+0000", 2024-09-12T16:16:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1505999999999999e-05 2024-09-12T16:16:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483029+0000", 2024-09-12T16:16:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2839e-05 2024-09-12T16:16:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:812 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 262144~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.449312+0000", 2024-09-12T16:16:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.1787909560000003, 2024-09-12T16:16:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033833931999999997, 2024-09-12T16:16:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 812 2024-09-12T16:16:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449312+0000", 2024-09-12T16:16:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449312+0000", 2024-09-12T16:16:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449312+0000", 2024-09-12T16:16:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2999999999999999e-07 2024-09-12T16:16:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449313+0000", 2024-09-12T16:16:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0690000000000001e-06 2024-09-12T16:16:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449316+0000", 2024-09-12T16:16:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.168e-06 2024-09-12T16:16:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449320+0000", 2024-09-12T16:16:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1999999999999999e-06 2024-09-12T16:16:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483051+0000", 2024-09-12T16:16:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033731864 2024-09-12T16:16:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483092+0000", 2024-09-12T16:16:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0927999999999998e-05 2024-09-12T16:16:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483146+0000", 2024-09-12T16:16:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3473000000000001e-05 2024-09-12T16:16:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:813 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 368640~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.449324+0000", 2024-09-12T16:16:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.1787787979999997, 2024-09-12T16:16:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033939061, 2024-09-12T16:16:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 813 2024-09-12T16:16:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449324+0000", 2024-09-12T16:16:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449324+0000", 2024-09-12T16:16:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449325+0000", 2024-09-12T16:16:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7100000000000001e-07 2024-09-12T16:16:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449326+0000", 2024-09-12T16:16:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6759999999999999e-06 2024-09-12T16:16:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449331+0000", 2024-09-12T16:16:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9910000000000002e-06 2024-09-12T16:16:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449336+0000", 2024-09-12T16:16:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7230000000000004e-06 2024-09-12T16:16:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483169+0000", 2024-09-12T16:16:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033832889999999997 2024-09-12T16:16:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483211+0000", 2024-09-12T16:16:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1780000000000003e-05 2024-09-12T16:16:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483263+0000", 2024-09-12T16:16:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2330000000000002e-05 2024-09-12T16:16:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:814 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 475136~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.449344+0000", 2024-09-12T16:16:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.1787584879999997, 2024-09-12T16:16:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034031447999999999, 2024-09-12T16:16:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 814 2024-09-12T16:16:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449344+0000", 2024-09-12T16:16:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449344+0000", 2024-09-12T16:16:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449345+0000", 2024-09-12T16:16:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3099999999999998e-07 2024-09-12T16:16:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449347+0000", 2024-09-12T16:16:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.872e-06 2024-09-12T16:16:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449352+0000", 2024-09-12T16:16:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7980000000000002e-06 2024-09-12T16:16:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449357+0000", 2024-09-12T16:16:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4399999999999998e-06 2024-09-12T16:16:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483286+0000", 2024-09-12T16:16:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033928697000000001 2024-09-12T16:16:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483325+0000", 2024-09-12T16:16:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8943999999999998e-05 2024-09-12T16:16:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483376+0000", 2024-09-12T16:16:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1266e-05 2024-09-12T16:16:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:815 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 581632~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.449363+0000", 2024-09-12T16:16:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.1787394090000003, 2024-09-12T16:16:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034127672999999997, 2024-09-12T16:16:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 815 2024-09-12T16:16:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449363+0000", 2024-09-12T16:16:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449363+0000", 2024-09-12T16:16:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449392+0000", 2024-09-12T16:16:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8322000000000001e-05 2024-09-12T16:16:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449395+0000", 2024-09-12T16:16:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.971e-06 2024-09-12T16:16:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449402+0000", 2024-09-12T16:16:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3089999999999998e-06 2024-09-12T16:16:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449408+0000", 2024-09-12T16:16:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7769999999999999e-06 2024-09-12T16:16:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483399+0000", 2024-09-12T16:16:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033990764999999999 2024-09-12T16:16:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483437+0000", 2024-09-12T16:16:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8182999999999997e-05 2024-09-12T16:16:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483491+0000", 2024-09-12T16:16:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4345999999999998e-05 2024-09-12T16:16:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:816 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 688128~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.449417+0000", 2024-09-12T16:16:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.1786861359999996, 2024-09-12T16:16:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034188187000000002, 2024-09-12T16:16:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 816 2024-09-12T16:16:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449417+0000", 2024-09-12T16:16:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449417+0000", 2024-09-12T16:16:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.453927+0000", 2024-09-12T16:16:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0045100280000000001 2024-09-12T16:16:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.453932+0000", 2024-09-12T16:16:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.916e-06 2024-09-12T16:16:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.453940+0000", 2024-09-12T16:16:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3720000000000005e-06 2024-09-12T16:16:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.453956+0000", 2024-09-12T16:16:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6181999999999999e-05 2024-09-12T16:16:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483515+0000", 2024-09-12T16:16:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.029558261999999998 2024-09-12T16:16:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483553+0000", 2024-09-12T16:16:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8677999999999998e-05 2024-09-12T16:16:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483605+0000", 2024-09-12T16:16:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1749000000000002e-05 2024-09-12T16:16:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:852 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 1867776~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.454401+0000", 2024-09-12T16:16:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.1737016640000002, 2024-09-12T16:16:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033782697, 2024-09-12T16:16:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 852 2024-09-12T16:16:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454401+0000", 2024-09-12T16:16:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454401+0000", 2024-09-12T16:16:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454402+0000", 2024-09-12T16:16:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.58e-07 2024-09-12T16:16:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454403+0000", 2024-09-12T16:16:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.079e-06 2024-09-12T16:16:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454406+0000", 2024-09-12T16:16:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3890000000000001e-06 2024-09-12T16:16:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454416+0000", 2024-09-12T16:16:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8719999999999997e-06 2024-09-12T16:16:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.487993+0000", 2024-09-12T16:16:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033577184000000003 2024-09-12T16:16:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488075+0000", 2024-09-12T16:16:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2169000000000006e-05 2024-09-12T16:16:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488184+0000", 2024-09-12T16:16:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108646 2024-09-12T16:16:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:853 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 1974272~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.454420+0000", 2024-09-12T16:16:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.1736832379999997, 2024-09-12T16:16:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033941592, 2024-09-12T16:16:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 853 2024-09-12T16:16:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454420+0000", 2024-09-12T16:16:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454420+0000", 2024-09-12T16:16:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454420+0000", 2024-09-12T16:16:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8799999999999998e-07 2024-09-12T16:16:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454428+0000", 2024-09-12T16:16:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0660000000000004e-06 2024-09-12T16:16:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454431+0000", 2024-09-12T16:16:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3780000000000001e-06 2024-09-12T16:16:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454434+0000", 2024-09-12T16:16:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4959999999999999e-06 2024-09-12T16:16:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488218+0000", 2024-09-12T16:16:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033783794999999998 2024-09-12T16:16:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488280+0000", 2024-09-12T16:16:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2361999999999997e-05 2024-09-12T16:16:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488361+0000", 2024-09-12T16:16:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1206999999999997e-05 2024-09-12T16:16:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:854 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2080768~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.454437+0000", 2024-09-12T16:16:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.1736654460000002, 2024-09-12T16:16:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034057872000000003, 2024-09-12T16:16:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 854 2024-09-12T16:16:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454437+0000", 2024-09-12T16:16:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454437+0000", 2024-09-12T16:16:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454438+0000", 2024-09-12T16:16:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2700000000000001e-07 2024-09-12T16:16:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454439+0000", 2024-09-12T16:16:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.029e-06 2024-09-12T16:16:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454442+0000", 2024-09-12T16:16:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8320000000000002e-06 2024-09-12T16:16:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454444+0000", 2024-09-12T16:16:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4449999999999999e-06 2024-09-12T16:16:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488393+0000", 2024-09-12T16:16:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033948878000000002 2024-09-12T16:16:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488434+0000", 2024-09-12T16:16:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1641999999999999e-05 2024-09-12T16:16:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488495+0000", 2024-09-12T16:16:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0819000000000002e-05 2024-09-12T16:16:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.700 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:855 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2187264~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:06.700 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.454447+0000", 2024-09-12T16:16:06.700 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.1736561400000003, 2024-09-12T16:16:06.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034166180999999997, 2024-09-12T16:16:06.700 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:06.700 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:06.700 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:06.700 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:06.700 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:06.700 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:06.700 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 855 2024-09-12T16:16:06.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.700 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:06.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:06.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454447+0000", 2024-09-12T16:16:06.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:06.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454447+0000", 2024-09-12T16:16:06.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:06.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454447+0000", 2024-09-12T16:16:06.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1e-07 2024-09-12T16:16:06.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:06.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454448+0000", 2024-09-12T16:16:06.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0299999999999997e-07 2024-09-12T16:16:06.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:06.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454451+0000", 2024-09-12T16:16:06.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8499999999999998e-06 2024-09-12T16:16:06.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:06.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454453+0000", 2024-09-12T16:16:06.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2520000000000002e-06 2024-09-12T16:16:06.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:06.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488520+0000", 2024-09-12T16:16:06.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034066804999999999 2024-09-12T16:16:06.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:06.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488562+0000", 2024-09-12T16:16:06.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2400000000000001e-05 2024-09-12T16:16:06.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488613+0000", 2024-09-12T16:16:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0760999999999997e-05 2024-09-12T16:16:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:856 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2293760~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.454456+0000", 2024-09-12T16:16:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.1736471340000003, 2024-09-12T16:16:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034275297000000003, 2024-09-12T16:16:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 856 2024-09-12T16:16:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454456+0000", 2024-09-12T16:16:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454456+0000", 2024-09-12T16:16:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454456+0000", 2024-09-12T16:16:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.11e-07 2024-09-12T16:16:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454457+0000", 2024-09-12T16:16:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6799999999999999e-07 2024-09-12T16:16:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454460+0000", 2024-09-12T16:16:06.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.858e-06 2024-09-12T16:16:06.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:06.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454463+0000", 2024-09-12T16:16:06.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9670000000000001e-06 2024-09-12T16:16:06.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:06.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488637+0000", 2024-09-12T16:16:06.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034174300999999997 2024-09-12T16:16:06.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:06.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488678+0000", 2024-09-12T16:16:06.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0732999999999998e-05 2024-09-12T16:16:06.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:06.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488731+0000", 2024-09-12T16:16:06.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3359000000000002e-05 2024-09-12T16:16:06.712 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.712 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:06.712 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.712 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:857 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2400256~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:06.712 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.454466+0000", 2024-09-12T16:16:06.712 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.1736373090000001, 2024-09-12T16:16:06.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034382506, 2024-09-12T16:16:06.712 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:06.712 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 857 2024-09-12T16:16:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454466+0000", 2024-09-12T16:16:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:06.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454466+0000", 2024-09-12T16:16:06.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:06.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454466+0000", 2024-09-12T16:16:06.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:16:06.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:06.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454467+0000", 2024-09-12T16:16:06.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5300000000000002e-07 2024-09-12T16:16:06.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454470+0000", 2024-09-12T16:16:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7970000000000001e-06 2024-09-12T16:16:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454472+0000", 2024-09-12T16:16:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3089999999999998e-06 2024-09-12T16:16:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488754+0000", 2024-09-12T16:16:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034282436999999999 2024-09-12T16:16:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488795+0000", 2024-09-12T16:16:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0880999999999997e-05 2024-09-12T16:16:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488848+0000", 2024-09-12T16:16:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2917000000000002e-05 2024-09-12T16:16:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:858 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2506752~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.454475+0000", 2024-09-12T16:16:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.1736280880000001, 2024-09-12T16:16:06.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034498824999999997, 2024-09-12T16:16:06.717 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:06.717 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:06.717 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:06.717 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:06.717 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:06.717 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:06.717 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 858 2024-09-12T16:16:06.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.717 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:06.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:06.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454475+0000", 2024-09-12T16:16:06.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:06.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454475+0000", 2024-09-12T16:16:06.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:06.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454475+0000", 2024-09-12T16:16:06.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2000000000000001e-07 2024-09-12T16:16:06.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454476+0000", 2024-09-12T16:16:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5799999999999998e-07 2024-09-12T16:16:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454480+0000", 2024-09-12T16:16:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5750000000000001e-06 2024-09-12T16:16:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454482+0000", 2024-09-12T16:16:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3300000000000001e-06 2024-09-12T16:16:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:06.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488870+0000", 2024-09-12T16:16:06.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034388152999999998 2024-09-12T16:16:06.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:06.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488909+0000", 2024-09-12T16:16:06.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8574e-05 2024-09-12T16:16:06.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:06.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488974+0000", 2024-09-12T16:16:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5015e-05 2024-09-12T16:16:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:859 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2613248~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.454485+0000", 2024-09-12T16:16:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.1736179980000001, 2024-09-12T16:16:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034601403000000003, 2024-09-12T16:16:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:06.722 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:06.722 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:06.722 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 859 2024-09-12T16:16:06.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.722 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:06.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:06.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454485+0000", 2024-09-12T16:16:06.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:06.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454485+0000", 2024-09-12T16:16:06.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:06.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:06.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454485+0000", 2024-09-12T16:16:06.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.35e-07 2024-09-12T16:16:06.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:06.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454486+0000", 2024-09-12T16:16:06.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7399999999999991e-07 2024-09-12T16:16:06.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:06.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454489+0000", 2024-09-12T16:16:06.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7690000000000001e-06 2024-09-12T16:16:06.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:06.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454491+0000", 2024-09-12T16:16:06.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2520000000000002e-06 2024-09-12T16:16:06.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:06.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488990+0000", 2024-09-12T16:16:06.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034499019999999998 2024-09-12T16:16:06.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:06.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.489031+0000", 2024-09-12T16:16:06.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0648000000000001e-05 2024-09-12T16:16:06.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:06.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:06.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:06.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.489086+0000", 2024-09-12T16:16:06.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5504999999999998e-05 2024-09-12T16:16:06.725 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.725 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:06.725 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.725 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:06.725 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:06.725 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:06.727 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:16:06.728 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:16:06.726+0000 7f002d431640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32213) UID: 0 2024-09-12T16:16:06.827 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:06.827+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:06.875 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:06.875 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:06.875 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:16:06.875 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:06.883 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:16:06.928 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:16:06.927+0000 7f002d431640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32213) UID: 0 2024-09-12T16:16:07.029 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:16:07.028+0000 7f002d431640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32213) UID: 0 2024-09-12T16:16:07.030 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:07.030 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:07.030 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:16:07.030 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:16:07.030 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:07.039 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:16:07.044 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T16:16:07.106 INFO:teuthology.orchestra.run.smithi204.stdout:truncating image image_client.0-clone2 from 0xcd51600 (overlap 0x1f6000) to 0x0 2024-09-12T16:16:07.130 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:16:07.129+0000 7f002d431640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32213) UID: 0 2024-09-12T16:16:07.160 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:07.160 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:16:07.160 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:16:07.160 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:07.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.161 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4001 3.2 3:4226db47:::rbd_data.11557ed36bb5.0000000000000009:4 [read 466944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.161 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.340512+0000", 2024-09-12T16:16:07.161 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.81799555199999996, 2024-09-12T16:16:07.161 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039861540000000004, 2024-09-12T16:16:07.161 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.161 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.161 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:07.161 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.161 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.161 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.161 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4001 2024-09-12T16:16:07.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.161 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340512+0000", 2024-09-12T16:16:07.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340512+0000", 2024-09-12T16:16:07.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340513+0000", 2024-09-12T16:16:07.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9799999999999999e-07 2024-09-12T16:16:07.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.163 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340515+0000", 2024-09-12T16:16:07.163 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2520000000000002e-06 2024-09-12T16:16:07.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.163 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340521+0000", 2024-09-12T16:16:07.163 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3280000000000002e-06 2024-09-12T16:16:07.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.163 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340526+0000", 2024-09-12T16:16:07.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.994e-06 2024-09-12T16:16:07.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.164 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.164 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.164 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.344364+0000", 2024-09-12T16:16:07.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003838213 2024-09-12T16:16:07.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.164 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.164 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:07.164 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.344432+0000", 2024-09-12T16:16:07.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7156999999999994e-05 2024-09-12T16:16:07.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.164 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.164 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.165 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.344498+0000", 2024-09-12T16:16:07.165 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6811999999999997e-05 2024-09-12T16:16:07.165 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.165 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.165 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.165 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.165 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4491 3.4 3:21b1252f:::rbd_data.11557ed36bb5.0000000000000006:4 [read 458752~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.165 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.345908+0000", 2024-09-12T16:16:07.165 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.812600082, 2024-09-12T16:16:07.165 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039825889999999999, 2024-09-12T16:16:07.165 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.165 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.165 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:07.166 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.166 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.166 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.166 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4491 2024-09-12T16:16:07.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.166 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.166 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.166 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.166 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345908+0000", 2024-09-12T16:16:07.166 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.167 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.167 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.167 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345908+0000", 2024-09-12T16:16:07.167 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.167 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.167 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.167 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345908+0000", 2024-09-12T16:16:07.167 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3500000000000002e-07 2024-09-12T16:16:07.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.167 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.167 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.168 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345910+0000", 2024-09-12T16:16:07.168 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.903e-06 2024-09-12T16:16:07.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.168 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.168 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.168 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345917+0000", 2024-09-12T16:16:07.168 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5470000000000002e-06 2024-09-12T16:16:07.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.168 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.168 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.168 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345930+0000", 2024-09-12T16:16:07.168 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3519e-05 2024-09-12T16:16:07.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.169 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.169 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.349734+0000", 2024-09-12T16:16:07.169 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0038039889999999998 2024-09-12T16:16:07.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.169 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:07.169 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.349824+0000", 2024-09-12T16:16:07.169 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9561000000000005e-05 2024-09-12T16:16:07.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.169 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.169 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.349890+0000", 2024-09-12T16:16:07.170 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6635000000000002e-05 2024-09-12T16:16:07.170 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.170 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.170 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.170 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4492 3.4 3:21b1252f:::rbd_data.11557ed36bb5.0000000000000006:4 [read 516096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.170 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.345938+0000", 2024-09-12T16:16:07.170 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.81256970699999997, 2024-09-12T16:16:07.170 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0041578220000000003, 2024-09-12T16:16:07.170 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.170 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.170 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:07.170 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.170 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.171 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.171 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4492 2024-09-12T16:16:07.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.171 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.171 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.171 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.171 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345938+0000", 2024-09-12T16:16:07.171 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.171 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.171 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.171 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345938+0000", 2024-09-12T16:16:07.171 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.172 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.172 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345939+0000", 2024-09-12T16:16:07.172 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8999999999999997e-07 2024-09-12T16:16:07.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.172 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.172 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345941+0000", 2024-09-12T16:16:07.172 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2630000000000002e-06 2024-09-12T16:16:07.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.172 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.172 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345948+0000", 2024-09-12T16:16:07.172 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7089999999999996e-06 2024-09-12T16:16:07.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.173 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.173 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345952+0000", 2024-09-12T16:16:07.173 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9130000000000002e-06 2024-09-12T16:16:07.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.173 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.173 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.349956+0000", 2024-09-12T16:16:07.173 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0040032679999999999 2024-09-12T16:16:07.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.173 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:07.173 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.350026+0000", 2024-09-12T16:16:07.174 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9964999999999998e-05 2024-09-12T16:16:07.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.174 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.174 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.350096+0000", 2024-09-12T16:16:07.174 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0214000000000002e-05 2024-09-12T16:16:07.174 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.174 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.174 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.174 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4543 3.2 3:4226db47:::rbd_data.11557ed36bb5.0000000000000009:4 [read 122880~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.174 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.346099+0000", 2024-09-12T16:16:07.175 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.81240917300000004, 2024-09-12T16:16:07.175 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042476359999999999, 2024-09-12T16:16:07.175 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.175 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.175 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:07.175 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.175 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.175 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.175 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4543 2024-09-12T16:16:07.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.175 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.175 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.176 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346099+0000", 2024-09-12T16:16:07.176 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.176 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.176 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.176 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346099+0000", 2024-09-12T16:16:07.176 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.176 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.176 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.176 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346099+0000", 2024-09-12T16:16:07.176 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3799999999999998e-07 2024-09-12T16:16:07.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.176 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.177 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.177 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346101+0000", 2024-09-12T16:16:07.177 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1409999999999999e-06 2024-09-12T16:16:07.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.177 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.177 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346108+0000", 2024-09-12T16:16:07.177 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8580000000000002e-06 2024-09-12T16:16:07.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.177 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.177 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346113+0000", 2024-09-12T16:16:07.177 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2499999999999997e-06 2024-09-12T16:16:07.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.178 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.178 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.350187+0000", 2024-09-12T16:16:07.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0040739010000000004 2024-09-12T16:16:07.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.178 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:07.178 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.350256+0000", 2024-09-12T16:16:07.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8851999999999997e-05 2024-09-12T16:16:07.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.178 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.178 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.350346+0000", 2024-09-12T16:16:07.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0196000000000002e-05 2024-09-12T16:16:07.178 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.179 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.179 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.179 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4544 3.2 3:4226db47:::rbd_data.11557ed36bb5.0000000000000009:4 [read 139264~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.179 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.346120+0000", 2024-09-12T16:16:07.179 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.81238773900000005, 2024-09-12T16:16:07.179 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0048442449999999996, 2024-09-12T16:16:07.179 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.179 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.179 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:07.179 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.179 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.179 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.180 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4544 2024-09-12T16:16:07.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.180 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.180 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.180 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346120+0000", 2024-09-12T16:16:07.180 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.180 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.180 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346120+0000", 2024-09-12T16:16:07.180 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.181 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.181 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346120+0000", 2024-09-12T16:16:07.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.34e-07 2024-09-12T16:16:07.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.181 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.181 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346123+0000", 2024-09-12T16:16:07.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0480000000000001e-06 2024-09-12T16:16:07.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.181 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.181 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346129+0000", 2024-09-12T16:16:07.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7479999999999996e-06 2024-09-12T16:16:07.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.182 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.182 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.182 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346134+0000", 2024-09-12T16:16:07.182 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2059999999999998e-06 2024-09-12T16:16:07.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.182 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.182 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.182 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.350397+0000", 2024-09-12T16:16:07.182 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042630089999999999 2024-09-12T16:16:07.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.182 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.182 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:07.182 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.350866+0000", 2024-09-12T16:16:07.183 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046892400000000001 2024-09-12T16:16:07.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.183 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.183 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.183 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.350964+0000", 2024-09-12T16:16:07.183 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7875999999999996e-05 2024-09-12T16:16:07.183 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.183 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.183 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.183 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.183 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4545 3.2 3:4226db47:::rbd_data.11557ed36bb5.0000000000000009:4 [read 196608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.183 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.346141+0000", 2024-09-12T16:16:07.183 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.81236671900000001, 2024-09-12T16:16:07.184 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0049908660000000001, 2024-09-12T16:16:07.184 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.184 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.184 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:07.184 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.184 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.184 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.184 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4545 2024-09-12T16:16:07.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.184 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.184 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.184 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.184 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346141+0000", 2024-09-12T16:16:07.184 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.185 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.185 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.185 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346141+0000", 2024-09-12T16:16:07.185 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.185 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.185 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.185 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346141+0000", 2024-09-12T16:16:07.185 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2899999999999999e-07 2024-09-12T16:16:07.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.185 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.185 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.185 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346143+0000", 2024-09-12T16:16:07.185 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0150000000000002e-06 2024-09-12T16:16:07.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.186 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.186 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.186 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346150+0000", 2024-09-12T16:16:07.186 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3720000000000001e-06 2024-09-12T16:16:07.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.186 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.186 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.186 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346155+0000", 2024-09-12T16:16:07.186 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8330000000000001e-06 2024-09-12T16:16:07.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.186 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.186 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.186 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.350994+0000", 2024-09-12T16:16:07.186 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0048390719999999998 2024-09-12T16:16:07.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.187 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.187 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:07.187 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351060+0000", 2024-09-12T16:16:07.187 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6315999999999993e-05 2024-09-12T16:16:07.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.187 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.187 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.187 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351132+0000", 2024-09-12T16:16:07.187 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1829000000000006e-05 2024-09-12T16:16:07.187 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.187 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.187 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.187 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.188 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4546 3.2 3:4226db47:::rbd_data.11557ed36bb5.0000000000000009:4 [read 212992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.188 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.346161+0000", 2024-09-12T16:16:07.188 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.81234693899999999, 2024-09-12T16:16:07.188 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0051440929999999998, 2024-09-12T16:16:07.188 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.188 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.188 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:07.188 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.188 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.188 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.188 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4546 2024-09-12T16:16:07.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.188 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.188 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.189 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.189 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346161+0000", 2024-09-12T16:16:07.189 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.189 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.189 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.189 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346161+0000", 2024-09-12T16:16:07.189 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.189 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.189 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.189 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346161+0000", 2024-09-12T16:16:07.189 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5900000000000003e-07 2024-09-12T16:16:07.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.190 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.190 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.190 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346163+0000", 2024-09-12T16:16:07.190 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9439999999999999e-06 2024-09-12T16:16:07.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.190 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.190 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.190 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346170+0000", 2024-09-12T16:16:07.190 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4500000000000001e-06 2024-09-12T16:16:07.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.190 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.190 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.190 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346175+0000", 2024-09-12T16:16:07.190 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0379999999999999e-06 2024-09-12T16:16:07.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.191 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.191 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351164+0000", 2024-09-12T16:16:07.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0049889510000000001 2024-09-12T16:16:07.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.191 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:07.191 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351238+0000", 2024-09-12T16:16:07.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4171000000000005e-05 2024-09-12T16:16:07.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.191 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.191 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351305+0000", 2024-09-12T16:16:07.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7180000000000004e-05 2024-09-12T16:16:07.191 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.192 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.192 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.192 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4547 3.2 3:4226db47:::rbd_data.11557ed36bb5.0000000000000009:4 [read 229376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.192 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.346181+0000", 2024-09-12T16:16:07.192 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.81232649000000001, 2024-09-12T16:16:07.192 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0052982769999999997, 2024-09-12T16:16:07.192 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.192 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.192 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:07.192 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.192 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.192 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.192 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4547 2024-09-12T16:16:07.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.193 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.193 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.193 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346181+0000", 2024-09-12T16:16:07.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.193 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.193 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346181+0000", 2024-09-12T16:16:07.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.193 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.193 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346182+0000", 2024-09-12T16:16:07.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.13e-07 2024-09-12T16:16:07.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346184+0000", 2024-09-12T16:16:07.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.007e-06 2024-09-12T16:16:07.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346190+0000", 2024-09-12T16:16:07.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1109999999999996e-06 2024-09-12T16:16:07.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346195+0000", 2024-09-12T16:16:07.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8829999999999997e-06 2024-09-12T16:16:07.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351334+0000", 2024-09-12T16:16:07.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0051395599999999996 2024-09-12T16:16:07.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:07.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351404+0000", 2024-09-12T16:16:07.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9939999999999998e-05 2024-09-12T16:16:07.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351480+0000", 2024-09-12T16:16:07.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5263000000000001e-05 2024-09-12T16:16:07.195 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.196 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.196 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.196 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4548 3.2 3:4226db47:::rbd_data.11557ed36bb5.0000000000000009:4 [read 245760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.196 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.346202+0000", 2024-09-12T16:16:07.196 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.81230623599999996, 2024-09-12T16:16:07.196 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0054491959999999999, 2024-09-12T16:16:07.196 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.196 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.196 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:07.196 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.196 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.196 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.197 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4548 2024-09-12T16:16:07.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.197 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.197 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346202+0000", 2024-09-12T16:16:07.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.197 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346202+0000", 2024-09-12T16:16:07.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346202+0000", 2024-09-12T16:16:07.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5199999999999997e-07 2024-09-12T16:16:07.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346204+0000", 2024-09-12T16:16:07.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0540000000000002e-06 2024-09-12T16:16:07.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346211+0000", 2024-09-12T16:16:07.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5359999999999998e-06 2024-09-12T16:16:07.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346216+0000", 2024-09-12T16:16:07.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1050000000000003e-06 2024-09-12T16:16:07.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351512+0000", 2024-09-12T16:16:07.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.005296701 2024-09-12T16:16:07.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:07.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351582+0000", 2024-09-12T16:16:07.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9431999999999995e-05 2024-09-12T16:16:07.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351651+0000", 2024-09-12T16:16:07.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8816e-05 2024-09-12T16:16:07.200 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.200 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.200 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.200 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.200 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4549 3.2 3:4226db47:::rbd_data.11557ed36bb5.0000000000000009:4 [read 286720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.200 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.346222+0000", 2024-09-12T16:16:07.200 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.81228531699999995, 2024-09-12T16:16:07.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0056133670000000002, 2024-09-12T16:16:07.200 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.200 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.200 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:07.200 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.201 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.201 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.201 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4549 2024-09-12T16:16:07.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.201 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.201 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.201 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346222+0000", 2024-09-12T16:16:07.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.201 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.201 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346222+0000", 2024-09-12T16:16:07.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.202 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.202 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346223+0000", 2024-09-12T16:16:07.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.58e-07 2024-09-12T16:16:07.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.202 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.202 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346225+0000", 2024-09-12T16:16:07.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1490000000000001e-06 2024-09-12T16:16:07.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.202 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.202 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346232+0000", 2024-09-12T16:16:07.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4799999999999998e-06 2024-09-12T16:16:07.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.203 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346237+0000", 2024-09-12T16:16:07.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2039999999999996e-06 2024-09-12T16:16:07.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.203 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351684+0000", 2024-09-12T16:16:07.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0054473569999999999 2024-09-12T16:16:07.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:07.203 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351761+0000", 2024-09-12T16:16:07.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7016999999999998e-05 2024-09-12T16:16:07.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351836+0000", 2024-09-12T16:16:07.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4702000000000004e-05 2024-09-12T16:16:07.204 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.204 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.204 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.204 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4550 3.2 3:4226db47:::rbd_data.11557ed36bb5.0000000000000009:4 [read 303104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.204 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.346243+0000", 2024-09-12T16:16:07.204 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.81226429899999997, 2024-09-12T16:16:07.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0057759839999999996, 2024-09-12T16:16:07.205 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.205 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.205 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:07.205 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.205 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.205 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.205 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4550 2024-09-12T16:16:07.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.205 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346243+0000", 2024-09-12T16:16:07.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346243+0000", 2024-09-12T16:16:07.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346244+0000", 2024-09-12T16:16:07.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6399999999999998e-07 2024-09-12T16:16:07.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346246+0000", 2024-09-12T16:16:07.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.928e-06 2024-09-12T16:16:07.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346252+0000", 2024-09-12T16:16:07.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4779999999999996e-06 2024-09-12T16:16:07.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346258+0000", 2024-09-12T16:16:07.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3029999999999999e-06 2024-09-12T16:16:07.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351865+0000", 2024-09-12T16:16:07.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0056075930000000001 2024-09-12T16:16:07.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:07.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351944+0000", 2024-09-12T16:16:07.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8733000000000007e-05 2024-09-12T16:16:07.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.352019+0000", 2024-09-12T16:16:07.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5585000000000002e-05 2024-09-12T16:16:07.208 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.208 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.209 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.209 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4551 3.2 3:4226db47:::rbd_data.11557ed36bb5.0000000000000009:4 [read 319488~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.209 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.346264+0000", 2024-09-12T16:16:07.209 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.81224366400000003, 2024-09-12T16:16:07.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059405739999999997, 2024-09-12T16:16:07.209 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.209 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.209 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:07.209 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.209 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.209 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.210 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4551 2024-09-12T16:16:07.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.210 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346264+0000", 2024-09-12T16:16:07.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346264+0000", 2024-09-12T16:16:07.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346264+0000", 2024-09-12T16:16:07.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:16:07.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346274+0000", 2024-09-12T16:16:07.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4280000000000002e-06 2024-09-12T16:16:07.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346281+0000", 2024-09-12T16:16:07.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1779999999999997e-06 2024-09-12T16:16:07.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346287+0000", 2024-09-12T16:16:07.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.02e-06 2024-09-12T16:16:07.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.352050+0000", 2024-09-12T16:16:07.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0057629400000000002 2024-09-12T16:16:07.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:07.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.352121+0000", 2024-09-12T16:16:07.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0529000000000002e-05 2024-09-12T16:16:07.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.352205+0000", 2024-09-12T16:16:07.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4089000000000001e-05 2024-09-12T16:16:07.213 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.213 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.213 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.213 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4552 3.2 3:4226db47:::rbd_data.11557ed36bb5.0000000000000009:4 [read 335872~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.213 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.346295+0000", 2024-09-12T16:16:07.213 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.812212877, 2024-09-12T16:16:07.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0060855909999999996, 2024-09-12T16:16:07.214 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.214 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.214 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:07.214 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.214 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.214 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.214 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4552 2024-09-12T16:16:07.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.214 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.214 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346295+0000", 2024-09-12T16:16:07.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346295+0000", 2024-09-12T16:16:07.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346295+0000", 2024-09-12T16:16:07.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.89e-07 2024-09-12T16:16:07.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346305+0000", 2024-09-12T16:16:07.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.628e-06 2024-09-12T16:16:07.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346312+0000", 2024-09-12T16:16:07.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.34e-06 2024-09-12T16:16:07.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346318+0000", 2024-09-12T16:16:07.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7860000000000002e-06 2024-09-12T16:16:07.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.352235+0000", 2024-09-12T16:16:07.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059167040000000001 2024-09-12T16:16:07.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:07.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.352309+0000", 2024-09-12T16:16:07.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4064000000000001e-05 2024-09-12T16:16:07.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.352380+0000", 2024-09-12T16:16:07.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1580000000000002e-05 2024-09-12T16:16:07.217 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.217 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.217 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.218 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4553 3.2 3:4226db47:::rbd_data.11557ed36bb5.0000000000000009:4 [read 393216~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.218 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.346325+0000", 2024-09-12T16:16:07.218 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.81218236799999999, 2024-09-12T16:16:07.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0062363920000000003, 2024-09-12T16:16:07.218 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.218 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.218 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:07.218 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.218 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.218 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.218 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4553 2024-09-12T16:16:07.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.219 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346325+0000", 2024-09-12T16:16:07.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346325+0000", 2024-09-12T16:16:07.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346326+0000", 2024-09-12T16:16:07.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1800000000000001e-07 2024-09-12T16:16:07.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.220 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.220 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346328+0000", 2024-09-12T16:16:07.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.295e-06 2024-09-12T16:16:07.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.220 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.220 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346334+0000", 2024-09-12T16:16:07.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2990000000000002e-06 2024-09-12T16:16:07.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346340+0000", 2024-09-12T16:16:07.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3680000000000001e-06 2024-09-12T16:16:07.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.352413+0000", 2024-09-12T16:16:07.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0060730489999999996 2024-09-12T16:16:07.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:07.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.352486+0000", 2024-09-12T16:16:07.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2960999999999995e-05 2024-09-12T16:16:07.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.352562+0000", 2024-09-12T16:16:07.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6001999999999995e-05 2024-09-12T16:16:07.222 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.222 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.222 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.222 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4554 3.2 3:4226db47:::rbd_data.11557ed36bb5.0000000000000009:4 [read 409600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.222 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.346346+0000", 2024-09-12T16:16:07.222 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.81216133899999998, 2024-09-12T16:16:07.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0063978189999999999, 2024-09-12T16:16:07.222 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.222 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.223 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:07.223 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.223 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.223 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.223 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4554 2024-09-12T16:16:07.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.223 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.223 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346346+0000", 2024-09-12T16:16:07.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346346+0000", 2024-09-12T16:16:07.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346347+0000", 2024-09-12T16:16:07.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0400000000000002e-07 2024-09-12T16:16:07.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346349+0000", 2024-09-12T16:16:07.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9039999999999999e-06 2024-09-12T16:16:07.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346355+0000", 2024-09-12T16:16:07.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3810000000000004e-06 2024-09-12T16:16:07.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346360+0000", 2024-09-12T16:16:07.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1100000000000002e-06 2024-09-12T16:16:07.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.352592+0000", 2024-09-12T16:16:07.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0062318670000000003 2024-09-12T16:16:07.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:07.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.352666+0000", 2024-09-12T16:16:07.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3996000000000001e-05 2024-09-12T16:16:07.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.352744+0000", 2024-09-12T16:16:07.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8157000000000004e-05 2024-09-12T16:16:07.226 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.226 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.226 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.227 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4555 3.2 3:4226db47:::rbd_data.11557ed36bb5.0000000000000009:4 [read 425984~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.227 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.346367+0000", 2024-09-12T16:16:07.227 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.81214106699999999, 2024-09-12T16:16:07.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.006548875, 2024-09-12T16:16:07.227 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.227 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.227 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:07.227 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.227 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.227 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.227 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4555 2024-09-12T16:16:07.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.227 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346367+0000", 2024-09-12T16:16:07.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346367+0000", 2024-09-12T16:16:07.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346367+0000", 2024-09-12T16:16:07.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7e-07 2024-09-12T16:16:07.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346369+0000", 2024-09-12T16:16:07.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8199999999999999e-06 2024-09-12T16:16:07.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346375+0000", 2024-09-12T16:16:07.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3489999999999997e-06 2024-09-12T16:16:07.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346381+0000", 2024-09-12T16:16:07.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3929999999999999e-06 2024-09-12T16:16:07.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.352774+0000", 2024-09-12T16:16:07.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0063935370000000004 2024-09-12T16:16:07.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:07.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.352847+0000", 2024-09-12T16:16:07.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2478000000000006e-05 2024-09-12T16:16:07.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.352916+0000", 2024-09-12T16:16:07.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8827999999999999e-05 2024-09-12T16:16:07.230 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.231 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.231 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.231 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4556 3.2 3:4226db47:::rbd_data.11557ed36bb5.0000000000000009:4 [read 442368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.231 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.346388+0000", 2024-09-12T16:16:07.231 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.81212019899999999, 2024-09-12T16:16:07.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.006701388, 2024-09-12T16:16:07.231 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.231 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.231 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:07.231 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.231 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.231 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.232 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4556 2024-09-12T16:16:07.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.232 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346388+0000", 2024-09-12T16:16:07.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346388+0000", 2024-09-12T16:16:07.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346388+0000", 2024-09-12T16:16:07.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6800000000000001e-07 2024-09-12T16:16:07.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346390+0000", 2024-09-12T16:16:07.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.951e-06 2024-09-12T16:16:07.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346397+0000", 2024-09-12T16:16:07.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5710000000000003e-06 2024-09-12T16:16:07.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346402+0000", 2024-09-12T16:16:07.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3000000000000001e-06 2024-09-12T16:16:07.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.352951+0000", 2024-09-12T16:16:07.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0065491710000000003 2024-09-12T16:16:07.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:07.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.353015+0000", 2024-09-12T16:16:07.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4147999999999996e-05 2024-09-12T16:16:07.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.353089+0000", 2024-09-12T16:16:07.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3779e-05 2024-09-12T16:16:07.235 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.235 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.235 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.235 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4557 3.2 3:4226db47:::rbd_data.11557ed36bb5.0000000000000009:4 [read 483328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.235 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.346409+0000", 2024-09-12T16:16:07.235 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.81209863999999998, 2024-09-12T16:16:07.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0068655269999999997, 2024-09-12T16:16:07.235 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.236 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.236 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:07.236 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.236 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.236 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.236 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4557 2024-09-12T16:16:07.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.236 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346409+0000", 2024-09-12T16:16:07.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.237 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346409+0000", 2024-09-12T16:16:07.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.237 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346410+0000", 2024-09-12T16:16:07.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9799999999999999e-07 2024-09-12T16:16:07.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.237 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346414+0000", 2024-09-12T16:16:07.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0520000000000003e-06 2024-09-12T16:16:07.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.238 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346420+0000", 2024-09-12T16:16:07.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4500000000000001e-06 2024-09-12T16:16:07.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.238 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346425+0000", 2024-09-12T16:16:07.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.865e-06 2024-09-12T16:16:07.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.238 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.353119+0000", 2024-09-12T16:16:07.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0066938259999999999 2024-09-12T16:16:07.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:07.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.353193+0000", 2024-09-12T16:16:07.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4746000000000006e-05 2024-09-12T16:16:07.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.353275+0000", 2024-09-12T16:16:07.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.119e-05 2024-09-12T16:16:07.239 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.239 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.239 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.239 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4558 3.2 3:4226db47:::rbd_data.11557ed36bb5.0000000000000009:4 [read 499712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.239 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.346432+0000", 2024-09-12T16:16:07.240 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.81207605800000005, 2024-09-12T16:16:07.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0070281110000000001, 2024-09-12T16:16:07.240 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.240 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.240 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:07.240 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.240 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.240 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.240 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4558 2024-09-12T16:16:07.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.240 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346432+0000", 2024-09-12T16:16:07.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346432+0000", 2024-09-12T16:16:07.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346432+0000", 2024-09-12T16:16:07.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2300000000000002e-07 2024-09-12T16:16:07.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346434+0000", 2024-09-12T16:16:07.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9379999999999999e-06 2024-09-12T16:16:07.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346440+0000", 2024-09-12T16:16:07.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3249999999999996e-06 2024-09-12T16:16:07.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346445+0000", 2024-09-12T16:16:07.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9930000000000003e-06 2024-09-12T16:16:07.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.353304+0000", 2024-09-12T16:16:07.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0068585149999999999 2024-09-12T16:16:07.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:07.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.353380+0000", 2024-09-12T16:16:07.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6198999999999993e-05 2024-09-12T16:16:07.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.353460+0000", 2024-09-12T16:16:07.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9717999999999998e-05 2024-09-12T16:16:07.243 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.243 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.244 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.244 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4559 3.2 3:4226db47:::rbd_data.11557ed36bb5.0000000000000009:4 [read 516096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.244 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.346452+0000", 2024-09-12T16:16:07.244 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.81205576099999999, 2024-09-12T16:16:07.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0071908420000000002, 2024-09-12T16:16:07.244 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.244 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.244 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:07.244 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.244 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.244 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.244 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4559 2024-09-12T16:16:07.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.245 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346452+0000", 2024-09-12T16:16:07.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346452+0000", 2024-09-12T16:16:07.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346452+0000", 2024-09-12T16:16:07.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7899999999999999e-07 2024-09-12T16:16:07.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346454+0000", 2024-09-12T16:16:07.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9190000000000002e-06 2024-09-12T16:16:07.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346461+0000", 2024-09-12T16:16:07.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2770000000000002e-06 2024-09-12T16:16:07.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.346466+0000", 2024-09-12T16:16:07.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0459999999999996e-06 2024-09-12T16:16:07.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.353488+0000", 2024-09-12T16:16:07.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0070222870000000003 2024-09-12T16:16:07.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:07.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.353566+0000", 2024-09-12T16:16:07.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8203999999999999e-05 2024-09-12T16:16:07.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.353643+0000", 2024-09-12T16:16:07.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6730000000000006e-05 2024-09-12T16:16:07.248 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.248 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.248 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.248 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.248 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.248 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:07.249 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:16:07.248+0000 7f002d431640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32213) UID: 0 2024-09-12T16:16:07.250 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:16:07.346 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #1, image image_client.0-clone1 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent2 2024-09-12T16:16:07.349 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:07.349+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:07.363 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:07.363 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:07.363 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:16:07.363 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:07.372 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:16:07.458 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:07.457+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:07.551 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:16:07.550+0000 7f002d431640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32213) UID: 0 2024-09-12T16:16:07.577 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:07.578 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:07.578 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:16:07.578 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:16:07.578 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:07.589 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:16:07.652 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:07.651+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:07.753 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:07.751+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:07.791 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:07.791 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:16:07.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:16:07.791 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:07.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.791 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:3892 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 393216~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.791 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.336379+0000", 2024-09-12T16:16:07.791 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4526406220000001, 2024-09-12T16:16:07.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003178686, 2024-09-12T16:16:07.791 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.791 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.792 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:07.792 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.792 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.792 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.792 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3892 2024-09-12T16:16:07.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.792 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.792 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336379+0000", 2024-09-12T16:16:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336379+0000", 2024-09-12T16:16:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336379+0000", 2024-09-12T16:16:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2100000000000001e-07 2024-09-12T16:16:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336380+0000", 2024-09-12T16:16:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0640000000000001e-06 2024-09-12T16:16:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336383+0000", 2024-09-12T16:16:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0120000000000001e-06 2024-09-12T16:16:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336386+0000", 2024-09-12T16:16:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3499999999999999e-06 2024-09-12T16:16:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.339424+0000", 2024-09-12T16:16:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003038514 2024-09-12T16:16:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.339494+0000", 2024-09-12T16:16:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0049999999999995e-05 2024-09-12T16:16:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.339558+0000", 2024-09-12T16:16:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3474999999999998e-05 2024-09-12T16:16:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:3893 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 409600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.336389+0000", 2024-09-12T16:16:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4526308530000001, 2024-09-12T16:16:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0045550920000000002, 2024-09-12T16:16:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3893 2024-09-12T16:16:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336389+0000", 2024-09-12T16:16:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336389+0000", 2024-09-12T16:16:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336389+0000", 2024-09-12T16:16:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1799999999999999e-07 2024-09-12T16:16:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336390+0000", 2024-09-12T16:16:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.082e-06 2024-09-12T16:16:07.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336393+0000", 2024-09-12T16:16:07.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9849999999999998e-06 2024-09-12T16:16:07.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336395+0000", 2024-09-12T16:16:07.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3460000000000001e-06 2024-09-12T16:16:07.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.800 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.339585+0000", 2024-09-12T16:16:07.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031895449999999998 2024-09-12T16:16:07.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:07.800 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340868+0000", 2024-09-12T16:16:07.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012825009999999999 2024-09-12T16:16:07.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.800 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340944+0000", 2024-09-12T16:16:07.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6415000000000006e-05 2024-09-12T16:16:07.800 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:3894 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 466944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.336399+0000", 2024-09-12T16:16:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4526210370000001, 2024-09-12T16:16:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0047051489999999996, 2024-09-12T16:16:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3894 2024-09-12T16:16:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336399+0000", 2024-09-12T16:16:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336399+0000", 2024-09-12T16:16:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336399+0000", 2024-09-12T16:16:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.34e-07 2024-09-12T16:16:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336400+0000", 2024-09-12T16:16:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.029e-06 2024-09-12T16:16:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336403+0000", 2024-09-12T16:16:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.078e-06 2024-09-12T16:16:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336405+0000", 2024-09-12T16:16:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.34e-06 2024-09-12T16:16:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340975+0000", 2024-09-12T16:16:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.004569348 2024-09-12T16:16:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341043+0000", 2024-09-12T16:16:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8202999999999997e-05 2024-09-12T16:16:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341104+0000", 2024-09-12T16:16:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0917e-05 2024-09-12T16:16:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.806 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:3895 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 483328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.806 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.336409+0000", 2024-09-12T16:16:07.806 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.452611122, 2024-09-12T16:16:07.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0048548549999999999, 2024-09-12T16:16:07.806 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.806 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.806 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:07.806 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.806 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.806 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.806 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3895 2024-09-12T16:16:07.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.806 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336409+0000", 2024-09-12T16:16:07.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336409+0000", 2024-09-12T16:16:07.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336409+0000", 2024-09-12T16:16:07.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2499999999999999e-07 2024-09-12T16:16:07.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336410+0000", 2024-09-12T16:16:07.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0139999999999999e-06 2024-09-12T16:16:07.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336413+0000", 2024-09-12T16:16:07.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.038e-06 2024-09-12T16:16:07.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336415+0000", 2024-09-12T16:16:07.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2680000000000001e-06 2024-09-12T16:16:07.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341132+0000", 2024-09-12T16:16:07.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0047171560000000001 2024-09-12T16:16:07.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:07.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341200+0000", 2024-09-12T16:16:07.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7910000000000005e-05 2024-09-12T16:16:07.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.810 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341263+0000", 2024-09-12T16:16:07.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3244000000000006e-05 2024-09-12T16:16:07.810 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.810 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.810 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.810 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:3896 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 499712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.336421+0000", 2024-09-12T16:16:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.452599032, 2024-09-12T16:16:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0050030539999999998, 2024-09-12T16:16:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3896 2024-09-12T16:16:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336421+0000", 2024-09-12T16:16:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336421+0000", 2024-09-12T16:16:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336421+0000", 2024-09-12T16:16:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8700000000000001e-07 2024-09-12T16:16:07.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336423+0000", 2024-09-12T16:16:07.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.753e-06 2024-09-12T16:16:07.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336428+0000", 2024-09-12T16:16:07.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6149999999999996e-06 2024-09-12T16:16:07.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336433+0000", 2024-09-12T16:16:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5909999999999998e-06 2024-09-12T16:16:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341292+0000", 2024-09-12T16:16:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0048587470000000001 2024-09-12T16:16:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341358+0000", 2024-09-12T16:16:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6218999999999997e-05 2024-09-12T16:16:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.815 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.815 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341424+0000", 2024-09-12T16:16:07.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5741999999999995e-05 2024-09-12T16:16:07.815 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.815 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.815 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.815 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:3897 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 516096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.815 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.336440+0000", 2024-09-12T16:16:07.815 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4525799779999999, 2024-09-12T16:16:07.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.005179187, 2024-09-12T16:16:07.815 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.815 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.816 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:07.816 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.816 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.816 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.816 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3897 2024-09-12T16:16:07.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.816 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.816 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.816 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336440+0000", 2024-09-12T16:16:07.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.816 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336440+0000", 2024-09-12T16:16:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336440+0000", 2024-09-12T16:16:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7e-07 2024-09-12T16:16:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336442+0000", 2024-09-12T16:16:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1959999999999998e-06 2024-09-12T16:16:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336449+0000", 2024-09-12T16:16:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8179999999999998e-06 2024-09-12T16:16:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336454+0000", 2024-09-12T16:16:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1760000000000001e-06 2024-09-12T16:16:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341482+0000", 2024-09-12T16:16:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0050273460000000002 2024-09-12T16:16:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:07.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341552+0000", 2024-09-12T16:16:07.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0297999999999997e-05 2024-09-12T16:16:07.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341619+0000", 2024-09-12T16:16:07.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6983000000000006e-05 2024-09-12T16:16:07.819 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.819 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.819 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4125 3.5 3:a241af90:::rbd_data.11557ed36bb5.000000000000000f:4 [read 401408~6656] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.337967+0000", 2024-09-12T16:16:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.451053151, 2024-09-12T16:16:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003989467, 2024-09-12T16:16:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4125 2024-09-12T16:16:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.821 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.821 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337967+0000", 2024-09-12T16:16:07.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.821 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.821 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337967+0000", 2024-09-12T16:16:07.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.821 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.821 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337967+0000", 2024-09-12T16:16:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0900000000000002e-07 2024-09-12T16:16:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337975+0000", 2024-09-12T16:16:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6909999999999997e-06 2024-09-12T16:16:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337984+0000", 2024-09-12T16:16:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2720000000000003e-06 2024-09-12T16:16:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337990+0000", 2024-09-12T16:16:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3380000000000001e-06 2024-09-12T16:16:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340872+0000", 2024-09-12T16:16:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002882225 2024-09-12T16:16:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340944+0000", 2024-09-12T16:16:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1219999999999999e-05 2024-09-12T16:16:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341956+0000", 2024-09-12T16:16:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001012312 2024-09-12T16:16:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4126 3.5 3:a241af90:::rbd_data.11557ed36bb5.000000000000000f:4 [read 442368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.337999+0000", 2024-09-12T16:16:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4510203530000001, 2024-09-12T16:16:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0041510729999999999, 2024-09-12T16:16:07.825 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.825 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.825 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:07.825 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.825 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.825 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.825 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4126 2024-09-12T16:16:07.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.825 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.825 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337999+0000", 2024-09-12T16:16:07.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337999+0000", 2024-09-12T16:16:07.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338000+0000", 2024-09-12T16:16:07.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4000000000000002e-07 2024-09-12T16:16:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338002+0000", 2024-09-12T16:16:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.154e-06 2024-09-12T16:16:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338009+0000", 2024-09-12T16:16:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9059999999999996e-06 2024-09-12T16:16:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338014+0000", 2024-09-12T16:16:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7650000000000001e-06 2024-09-12T16:16:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342002+0000", 2024-09-12T16:16:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039884680000000002 2024-09-12T16:16:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342076+0000", 2024-09-12T16:16:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4023999999999995e-05 2024-09-12T16:16:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342150+0000", 2024-09-12T16:16:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4215999999999996e-05 2024-09-12T16:16:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4127 3.5 3:a241af90:::rbd_data.11557ed36bb5.000000000000000f:4 [read 458752~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.338021+0000", 2024-09-12T16:16:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.450998757, 2024-09-12T16:16:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042934399999999999, 2024-09-12T16:16:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4127 2024-09-12T16:16:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338021+0000", 2024-09-12T16:16:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338021+0000", 2024-09-12T16:16:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338021+0000", 2024-09-12T16:16:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9800000000000004e-07 2024-09-12T16:16:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338024+0000", 2024-09-12T16:16:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2809999999999998e-06 2024-09-12T16:16:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338031+0000", 2024-09-12T16:16:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1269999999999997e-06 2024-09-12T16:16:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338036+0000", 2024-09-12T16:16:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0329999999999999e-06 2024-09-12T16:16:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342181+0000", 2024-09-12T16:16:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.004144699 2024-09-12T16:16:07.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:07.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342247+0000", 2024-09-12T16:16:07.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6149000000000007e-05 2024-09-12T16:16:07.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342314+0000", 2024-09-12T16:16:07.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7652999999999998e-05 2024-09-12T16:16:07.833 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.833 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.833 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4128 3.5 3:a241af90:::rbd_data.11557ed36bb5.000000000000000f:4 [read 475136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.338043+0000", 2024-09-12T16:16:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.450976609, 2024-09-12T16:16:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0044450189999999997, 2024-09-12T16:16:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4128 2024-09-12T16:16:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338043+0000", 2024-09-12T16:16:07.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338043+0000", 2024-09-12T16:16:07.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338044+0000", 2024-09-12T16:16:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2599999999999998e-07 2024-09-12T16:16:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338046+0000", 2024-09-12T16:16:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9850000000000001e-06 2024-09-12T16:16:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338052+0000", 2024-09-12T16:16:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7410000000000003e-06 2024-09-12T16:16:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338058+0000", 2024-09-12T16:16:07.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5729999999999998e-06 2024-09-12T16:16:07.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342343+0000", 2024-09-12T16:16:07.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042855970000000004 2024-09-12T16:16:07.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:07.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342411+0000", 2024-09-12T16:16:07.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7619000000000004e-05 2024-09-12T16:16:07.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342488+0000", 2024-09-12T16:16:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7077999999999996e-05 2024-09-12T16:16:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4129 3.5 3:a241af90:::rbd_data.11557ed36bb5.000000000000000f:4 [read 491520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.338065+0000", 2024-09-12T16:16:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4509543039999999, 2024-09-12T16:16:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.004581819, 2024-09-12T16:16:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4129 2024-09-12T16:16:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338065+0000", 2024-09-12T16:16:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338065+0000", 2024-09-12T16:16:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338066+0000", 2024-09-12T16:16:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-07 2024-09-12T16:16:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338068+0000", 2024-09-12T16:16:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4820000000000001e-06 2024-09-12T16:16:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338075+0000", 2024-09-12T16:16:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.08e-06 2024-09-12T16:16:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338081+0000", 2024-09-12T16:16:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2939999999999996e-06 2024-09-12T16:16:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342515+0000", 2024-09-12T16:16:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0044338720000000002 2024-09-12T16:16:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342582+0000", 2024-09-12T16:16:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6962e-05 2024-09-12T16:16:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342647+0000", 2024-09-12T16:16:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5643999999999997e-05 2024-09-12T16:16:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4449 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 458752~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.345020+0000", 2024-09-12T16:16:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4439998549999999, 2024-09-12T16:16:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032276219999999999, 2024-09-12T16:16:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.844 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.844 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4449 2024-09-12T16:16:07.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.844 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345020+0000", 2024-09-12T16:16:07.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345020+0000", 2024-09-12T16:16:07.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345020+0000", 2024-09-12T16:16:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1900000000000003e-07 2024-09-12T16:16:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345024+0000", 2024-09-12T16:16:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7529999999999999e-06 2024-09-12T16:16:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345031+0000", 2024-09-12T16:16:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.985e-06 2024-09-12T16:16:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345037+0000", 2024-09-12T16:16:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1530000000000002e-06 2024-09-12T16:16:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.348115+0000", 2024-09-12T16:16:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030777479999999999 2024-09-12T16:16:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.348181+0000", 2024-09-12T16:16:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5832000000000003e-05 2024-09-12T16:16:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.348247+0000", 2024-09-12T16:16:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6631999999999995e-05 2024-09-12T16:16:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4450 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 475136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.345047+0000", 2024-09-12T16:16:07.848 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.443972958, 2024-09-12T16:16:07.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003358088, 2024-09-12T16:16:07.848 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.848 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.848 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:07.848 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.848 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.848 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.848 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4450 2024-09-12T16:16:07.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.848 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345047+0000", 2024-09-12T16:16:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345047+0000", 2024-09-12T16:16:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345047+0000", 2024-09-12T16:16:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2599999999999998e-07 2024-09-12T16:16:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345049+0000", 2024-09-12T16:16:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1040000000000001e-06 2024-09-12T16:16:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345056+0000", 2024-09-12T16:16:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6220000000000003e-06 2024-09-12T16:16:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.851 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345061+0000", 2024-09-12T16:16:07.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0710000000000002e-06 2024-09-12T16:16:07.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.851 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.348273+0000", 2024-09-12T16:16:07.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032119649999999998 2024-09-12T16:16:07.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:07.851 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.348340+0000", 2024-09-12T16:16:07.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7115999999999999e-05 2024-09-12T16:16:07.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.348405+0000", 2024-09-12T16:16:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4783999999999995e-05 2024-09-12T16:16:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4854 3.1e 3.e05fe63e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.351284+0000", 2024-09-12T16:16:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4377358410000001, 2024-09-12T16:16:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032203269999999998, 2024-09-12T16:16:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.853 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.853 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:16:07.853 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.853 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.853 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.853 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4854 2024-09-12T16:16:07.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.853 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351284+0000", 2024-09-12T16:16:07.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351284+0000", 2024-09-12T16:16:07.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351284+0000", 2024-09-12T16:16:07.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2799999999999996e-07 2024-09-12T16:16:07.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351287+0000", 2024-09-12T16:16:07.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.165e-06 2024-09-12T16:16:07.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.855 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.855 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351294+0000", 2024-09-12T16:16:07.855 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8739999999999995e-06 2024-09-12T16:16:07.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.855 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.855 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351300+0000", 2024-09-12T16:16:07.855 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2000000000000002e-06 2024-09-12T16:16:07.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.855 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.855 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354496+0000", 2024-09-12T16:16:07.855 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031967760000000001 2024-09-12T16:16:07.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.856 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.856 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354504+0000", 2024-09-12T16:16:07.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7840000000000004e-06 2024-09-12T16:16:07.856 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.856 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.856 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.856 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4855 3.1e 3.e05fe63e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.856 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.351309+0000", 2024-09-12T16:16:07.856 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.437710982, 2024-09-12T16:16:07.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032253500000000001, 2024-09-12T16:16:07.857 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.857 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.857 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:16:07.857 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.857 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.857 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.857 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4855 2024-09-12T16:16:07.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.857 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.857 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351309+0000", 2024-09-12T16:16:07.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351309+0000", 2024-09-12T16:16:07.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351309+0000", 2024-09-12T16:16:07.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1500000000000005e-07 2024-09-12T16:16:07.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351311+0000", 2024-09-12T16:16:07.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0829999999999998e-06 2024-09-12T16:16:07.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.859 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351318+0000", 2024-09-12T16:16:07.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1829999999999999e-06 2024-09-12T16:16:07.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.859 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351323+0000", 2024-09-12T16:16:07.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6300000000000003e-06 2024-09-12T16:16:07.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354527+0000", 2024-09-12T16:16:07.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032038689999999998 2024-09-12T16:16:07.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.860 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354534+0000", 2024-09-12T16:16:07.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0700000000000001e-06 2024-09-12T16:16:07.860 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.860 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.860 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.860 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4856 3.1e 3.e05fe63e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.861 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.351329+0000", 2024-09-12T16:16:07.861 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4376905209999999, 2024-09-12T16:16:07.861 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032355190000000001, 2024-09-12T16:16:07.861 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.861 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.861 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:16:07.861 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.861 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.861 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.861 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4856 2024-09-12T16:16:07.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.861 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351329+0000", 2024-09-12T16:16:07.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351329+0000", 2024-09-12T16:16:07.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351330+0000", 2024-09-12T16:16:07.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5400000000000002e-07 2024-09-12T16:16:07.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351331+0000", 2024-09-12T16:16:07.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.81e-06 2024-09-12T16:16:07.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351337+0000", 2024-09-12T16:16:07.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7830000000000004e-06 2024-09-12T16:16:07.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351342+0000", 2024-09-12T16:16:07.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.69e-06 2024-09-12T16:16:07.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.864 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.864 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354558+0000", 2024-09-12T16:16:07.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032158500000000001 2024-09-12T16:16:07.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.864 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.864 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354565+0000", 2024-09-12T16:16:07.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0319999999999998e-06 2024-09-12T16:16:07.864 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.864 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.864 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.865 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4857 3.1e 3.e05fe63e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.865 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.351348+0000", 2024-09-12T16:16:07.865 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4376719920000001, 2024-09-12T16:16:07.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032465969999999999, 2024-09-12T16:16:07.865 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.865 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.865 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:16:07.865 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.865 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.865 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.865 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4857 2024-09-12T16:16:07.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.866 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351348+0000", 2024-09-12T16:16:07.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351348+0000", 2024-09-12T16:16:07.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351348+0000", 2024-09-12T16:16:07.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3599999999999999e-07 2024-09-12T16:16:07.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351354+0000", 2024-09-12T16:16:07.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8880000000000002e-06 2024-09-12T16:16:07.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351361+0000", 2024-09-12T16:16:07.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1849999999999998e-06 2024-09-12T16:16:07.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.868 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.868 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351366+0000", 2024-09-12T16:16:07.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9740000000000001e-06 2024-09-12T16:16:07.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.868 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.868 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354588+0000", 2024-09-12T16:16:07.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032216200000000001 2024-09-12T16:16:07.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.868 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.869 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354594+0000", 2024-09-12T16:16:07.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5939999999999999e-06 2024-09-12T16:16:07.869 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.869 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.869 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.869 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4858 3.1e 3.e05fe63e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.869 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.351373+0000", 2024-09-12T16:16:07.869 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.437647055, 2024-09-12T16:16:07.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032503800000000002, 2024-09-12T16:16:07.869 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.869 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.869 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:16:07.870 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.870 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.870 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.870 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4858 2024-09-12T16:16:07.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.870 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.870 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351373+0000", 2024-09-12T16:16:07.870 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351373+0000", 2024-09-12T16:16:07.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351373+0000", 2024-09-12T16:16:07.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5999999999999999e-07 2024-09-12T16:16:07.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351376+0000", 2024-09-12T16:16:07.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6170000000000001e-06 2024-09-12T16:16:07.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351381+0000", 2024-09-12T16:16:07.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8209999999999998e-06 2024-09-12T16:16:07.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351386+0000", 2024-09-12T16:16:07.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6190000000000002e-06 2024-09-12T16:16:07.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354616+0000", 2024-09-12T16:16:07.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032299809999999998 2024-09-12T16:16:07.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354623+0000", 2024-09-12T16:16:07.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9820000000000002e-06 2024-09-12T16:16:07.873 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.873 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.873 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.873 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4859 3.1e 3.e05fe63e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.873 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.351392+0000", 2024-09-12T16:16:07.873 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4376277980000001, 2024-09-12T16:16:07.874 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003261983, 2024-09-12T16:16:07.874 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.874 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.874 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:16:07.874 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.874 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.874 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.874 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4859 2024-09-12T16:16:07.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.874 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.874 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.874 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351392+0000", 2024-09-12T16:16:07.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.875 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351392+0000", 2024-09-12T16:16:07.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.875 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351392+0000", 2024-09-12T16:16:07.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4999999999999998e-07 2024-09-12T16:16:07.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.876 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.876 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351394+0000", 2024-09-12T16:16:07.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.669e-06 2024-09-12T16:16:07.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.876 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.876 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351400+0000", 2024-09-12T16:16:07.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7049999999999996e-06 2024-09-12T16:16:07.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.876 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.876 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351404+0000", 2024-09-12T16:16:07.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7249999999999997e-06 2024-09-12T16:16:07.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.877 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.877 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354646+0000", 2024-09-12T16:16:07.877 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032411499999999999 2024-09-12T16:16:07.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.877 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.877 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354654+0000", 2024-09-12T16:16:07.877 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3839999999999997e-06 2024-09-12T16:16:07.877 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.877 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.877 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.878 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4859 3.1e 3:7c67fa07:::rbd_data.11557ed36bb5.000000000000001d:4 [read 516096~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:07.878 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.356681+0000", 2024-09-12T16:16:07.878 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4323382330000001, 2024-09-12T16:16:07.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033342200000000002, 2024-09-12T16:16:07.878 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:07.878 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:07.878 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:07.878 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:07.878 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:07.878 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:07.878 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4859 2024-09-12T16:16:07.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.878 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:07.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.878 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:07.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.356681+0000", 2024-09-12T16:16:07.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.879 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:07.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.356681+0000", 2024-09-12T16:16:07.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:07.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.879 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:07.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.356682+0000", 2024-09-12T16:16:07.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.34e-07 2024-09-12T16:16:07.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.879 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:07.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.356689+0000", 2024-09-12T16:16:07.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3540000000000002e-06 2024-09-12T16:16:07.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:07.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.356697+0000", 2024-09-12T16:16:07.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.038e-06 2024-09-12T16:16:07.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:07.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.356703+0000", 2024-09-12T16:16:07.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7690000000000002e-06 2024-09-12T16:16:07.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.881 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:07.881 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.359724+0000", 2024-09-12T16:16:07.881 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030212529999999998 2024-09-12T16:16:07.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.881 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:07.881 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.359807+0000", 2024-09-12T16:16:07.881 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2956999999999999e-05 2024-09-12T16:16:07.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:07.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:07.881 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:07.881 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.360016+0000", 2024-09-12T16:16:07.881 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020841499999999999 2024-09-12T16:16:07.881 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.881 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.882 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.882 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:07.882 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:07.882 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:07.883 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:16:07.884 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:07.882+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:07.984 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:07.983+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:08.035 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:08.035 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:16:08.035 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:16:08.035 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:08.040 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2024-09-12T16:16:08.044 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:16:08.087 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:08.086+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:08.153 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:08.154 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:16:08.154 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:16:08.154 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:16:08.154 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:08.162 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:16:08.203 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:08.202+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:08.215 INFO:teuthology.orchestra.run.smithi204.stdout:538 write 0xa243000 thru 0xa24c3d4 (0x93d5 bytes) 2024-09-12T16:16:08.216 INFO:teuthology.orchestra.run.smithi204.stdout:539 read 0xa217800 thru 0xa2184b2 (0xcb3 bytes) 2024-09-12T16:16:08.217 INFO:teuthology.orchestra.run.smithi204.stdout:541 read 0x1240000 thru 0x1245194 (0x5195 bytes) 2024-09-12T16:16:08.218 INFO:teuthology.orchestra.run.smithi204.stdout:542 punch from 0xab31c00 to 0xab3a600, (0x8a00 bytes) 2024-09-12T16:16:08.230 INFO:teuthology.orchestra.run.smithi204.stdout:545 write 0xa63bc00 thru 0xa647cba (0xc0bb bytes) 2024-09-12T16:16:08.230 INFO:teuthology.orchestra.run.smithi204.stdout:547 write 0x9497800 thru 0x949f735 (0x7f36 bytes) 2024-09-12T16:16:08.230 INFO:teuthology.orchestra.run.smithi204.stdout:549 read 0xb60a200 thru 0xb61794d (0xd74e bytes) 2024-09-12T16:16:08.230 INFO:teuthology.orchestra.run.smithi204.stdout:550 read 0x2d74200 thru 0x2d8048a (0xc28b bytes) 2024-09-12T16:16:08.230 INFO:teuthology.orchestra.run.smithi204.stdout:551 read 0x8a6b400 thru 0x8a711cd (0x5dce bytes) 2024-09-12T16:16:08.231 INFO:teuthology.orchestra.run.smithi204.stdout:554 write 0x14ef000 thru 0x14fa2ab (0xb2ac bytes) 2024-09-12T16:16:08.231 INFO:teuthology.orchestra.run.smithi204.stdout:555 write 0x3659e00 thru 0x3660b5f (0x6d60 bytes) 2024-09-12T16:16:08.232 INFO:teuthology.orchestra.run.smithi204.stdout:556 read 0x2bbba00 thru 0x2bc54de (0x9adf bytes) 2024-09-12T16:16:08.232 INFO:teuthology.orchestra.run.smithi204.stdout:557 punch from 0x8b31a00 to 0x8b39200, (0x7800 bytes) 2024-09-12T16:16:08.245 INFO:teuthology.orchestra.run.smithi204.stdout:558 punch from 0x64fb200 to 0x6508c00, (0xda00 bytes) 2024-09-12T16:16:08.252 INFO:teuthology.orchestra.run.smithi204.stdout:559 read 0xf07e00 thru 0xf0df6c (0x616d bytes) 2024-09-12T16:16:08.265 INFO:teuthology.orchestra.run.smithi204.stdout:561 trunc from 0xcd51600 to 0x2359400 2024-09-12T16:16:08.286 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:08.285+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:08.303 INFO:teuthology.orchestra.run.smithi204.stdout:562 trunc from 0x2359400 to 0x85a00 2024-09-12T16:16:08.327 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:08.327 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:16:08.328 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:16:08.328 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:16:08.328 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.328 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:16:08.328 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:16:08.328 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 26.561628079999998, 2024-09-12T16:16:08.328 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55645454900000002, 2024-09-12T16:16:08.328 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:08.328 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:08.328 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:08.328 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:08.328 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:16:08.329 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:16:08.329 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1 2024-09-12T16:16:08.329 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.329 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:08.329 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.329 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:08.329 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:16:08.329 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.329 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.329 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.329 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:08.329 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:16:08.329 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.330 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:08.330 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764440+0000", 2024-09-12T16:16:08.330 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6249999999999999e-06 2024-09-12T16:16:08.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.330 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:08.330 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764447+0000", 2024-09-12T16:16:08.330 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4939999999999997e-06 2024-09-12T16:16:08.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.330 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:08.330 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764459+0000", 2024-09-12T16:16:08.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1517e-05 2024-09-12T16:16:08.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:08.331 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764468+0000", 2024-09-12T16:16:08.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7690000000000002e-06 2024-09-12T16:16:08.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:08.331 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764539+0000", 2024-09-12T16:16:08.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1103e-05 2024-09-12T16:16:08.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:16:08.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764551+0000", 2024-09-12T16:16:08.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2687999999999999e-05 2024-09-12T16:16:08.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:08.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319497+0000", 2024-09-12T16:16:08.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55494560500000001 2024-09-12T16:16:08.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:08.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319688+0000", 2024-09-12T16:16:08.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019105599999999999 2024-09-12T16:16:08.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:16:08.333 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319842+0000", 2024-09-12T16:16:08.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015377699999999999 2024-09-12T16:16:08.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:08.333 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320473+0000", 2024-09-12T16:16:08.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00063117100000000003 2024-09-12T16:16:08.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:08.333 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320825+0000", 2024-09-12T16:16:08.334 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00035202500000000001 2024-09-12T16:16:08.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.334 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.334 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:08.334 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320867+0000", 2024-09-12T16:16:08.334 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2005000000000002e-05 2024-09-12T16:16:08.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.334 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.334 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:08.334 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320893+0000", 2024-09-12T16:16:08.334 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5714000000000001e-05 2024-09-12T16:16:08.334 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.334 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:08.334 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.335 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.335 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.335 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:272 3.13 3:cf84a54d:::rbd_data.1155cf5be90e.0000000000000018:3 [read 2195456~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:08.335 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.336886+0000", 2024-09-12T16:16:08.335 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.9891801510000002, 2024-09-12T16:16:08.335 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021654322, 2024-09-12T16:16:08.335 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:08.335 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:08.335 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:08.335 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:08.335 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:08.335 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:08.335 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 272 2024-09-12T16:16:08.335 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.336 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:08.336 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.336 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:08.336 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336886+0000", 2024-09-12T16:16:08.336 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.336 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.336 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:08.336 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336886+0000", 2024-09-12T16:16:08.336 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.336 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.336 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:08.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336886+0000", 2024-09-12T16:16:08.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.11e-07 2024-09-12T16:16:08.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.337 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:08.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336887+0000", 2024-09-12T16:16:08.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8899999999999998e-07 2024-09-12T16:16:08.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.337 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:08.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336891+0000", 2024-09-12T16:16:08.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9600000000000002e-06 2024-09-12T16:16:08.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.338 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:08.338 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336893+0000", 2024-09-12T16:16:08.338 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1330000000000002e-06 2024-09-12T16:16:08.338 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.338 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.338 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:08.338 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.358370+0000", 2024-09-12T16:16:08.338 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021476512 2024-09-12T16:16:08.338 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.338 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.338 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:08.338 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.358449+0000", 2024-09-12T16:16:08.338 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8577000000000003e-05 2024-09-12T16:16:08.339 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.339 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.339 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:08.339 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.358540+0000", 2024-09-12T16:16:08.339 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1940000000000004e-05 2024-09-12T16:16:08.339 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.339 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:08.339 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.339 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.339 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.339 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:273 3.13 3:cf84a54d:::rbd_data.1155cf5be90e.0000000000000018:3 [read 2301952~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:08.339 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.336896+0000", 2024-09-12T16:16:08.339 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.9891698460000002, 2024-09-12T16:16:08.340 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021839559000000001, 2024-09-12T16:16:08.340 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:08.340 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:08.340 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:08.340 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:08.340 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:08.340 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:08.340 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 273 2024-09-12T16:16:08.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.340 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:08.340 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.340 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:08.340 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336896+0000", 2024-09-12T16:16:08.340 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.341 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.341 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:08.341 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336896+0000", 2024-09-12T16:16:08.341 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.341 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.341 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:08.341 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336897+0000", 2024-09-12T16:16:08.341 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2999999999999999e-07 2024-09-12T16:16:08.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.341 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.341 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:08.342 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336898+0000", 2024-09-12T16:16:08.342 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4499999999999995e-07 2024-09-12T16:16:08.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.342 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.342 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:08.342 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336901+0000", 2024-09-12T16:16:08.342 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9119999999999998e-06 2024-09-12T16:16:08.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.342 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.342 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:08.342 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336903+0000", 2024-09-12T16:16:08.342 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3020000000000002e-06 2024-09-12T16:16:08.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.342 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.343 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:08.343 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.358578+0000", 2024-09-12T16:16:08.343 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021674795 2024-09-12T16:16:08.343 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.343 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.343 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:08.343 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.358652+0000", 2024-09-12T16:16:08.343 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4450999999999996e-05 2024-09-12T16:16:08.343 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.343 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.343 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:08.343 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.358736+0000", 2024-09-12T16:16:08.343 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3924000000000005e-05 2024-09-12T16:16:08.343 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.344 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:08.344 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.344 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.344 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:274 3.13 3:cf84a54d:::rbd_data.1155cf5be90e.0000000000000018:3 [read 2408448~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:08.344 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.336920+0000", 2024-09-12T16:16:08.344 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.9891458669999995, 2024-09-12T16:16:08.344 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022050357, 2024-09-12T16:16:08.344 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:08.344 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:08.344 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:08.344 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:08.344 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:08.345 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:08.345 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 274 2024-09-12T16:16:08.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.345 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:08.345 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.345 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:08.345 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336920+0000", 2024-09-12T16:16:08.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.345 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.345 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:08.345 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336920+0000", 2024-09-12T16:16:08.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.346 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:08.346 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336921+0000", 2024-09-12T16:16:08.346 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.32e-07 2024-09-12T16:16:08.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.346 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:08.346 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336923+0000", 2024-09-12T16:16:08.346 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.823e-06 2024-09-12T16:16:08.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.346 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:08.346 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336926+0000", 2024-09-12T16:16:08.346 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.574e-06 2024-09-12T16:16:08.347 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.347 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.347 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:08.347 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336929+0000", 2024-09-12T16:16:08.347 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.559e-06 2024-09-12T16:16:08.347 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.347 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.347 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:08.347 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.358779+0000", 2024-09-12T16:16:08.347 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021850141 2024-09-12T16:16:08.347 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.347 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.347 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:08.347 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.358859+0000", 2024-09-12T16:16:08.348 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0234999999999993e-05 2024-09-12T16:16:08.348 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.348 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.348 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:08.348 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.358971+0000", 2024-09-12T16:16:08.348 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000111593 2024-09-12T16:16:08.348 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.348 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:08.348 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.348 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.348 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.348 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:275 3.13 3:cf84a54d:::rbd_data.1155cf5be90e.0000000000000018:3 [read 2514944~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:08.348 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.336932+0000", 2024-09-12T16:16:08.348 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.9891342459999999, 2024-09-12T16:16:08.349 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022216863999999999, 2024-09-12T16:16:08.349 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:08.349 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:08.349 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:08.349 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:08.349 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:08.349 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:08.349 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 275 2024-09-12T16:16:08.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.349 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:08.349 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.349 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:08.349 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336932+0000", 2024-09-12T16:16:08.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:08.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336932+0000", 2024-09-12T16:16:08.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:08.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336932+0000", 2024-09-12T16:16:08.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9700000000000003e-07 2024-09-12T16:16:08.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:08.351 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336933+0000", 2024-09-12T16:16:08.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9199999999999999e-07 2024-09-12T16:16:08.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.351 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:08.351 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336937+0000", 2024-09-12T16:16:08.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9299999999999996e-06 2024-09-12T16:16:08.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.351 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:08.351 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336944+0000", 2024-09-12T16:16:08.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6209999999999998e-06 2024-09-12T16:16:08.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.352 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:08.352 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.359007+0000", 2024-09-12T16:16:08.352 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022062799000000001 2024-09-12T16:16:08.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.352 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.352 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:08.352 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.359068+0000", 2024-09-12T16:16:08.352 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1156999999999997e-05 2024-09-12T16:16:08.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.352 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.352 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:08.352 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.359149+0000", 2024-09-12T16:16:08.352 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1068000000000004e-05 2024-09-12T16:16:08.352 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.353 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:08.353 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.353 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.353 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:276 3.13 3:cf84a54d:::rbd_data.1155cf5be90e.0000000000000018:3 [read 2621440~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:08.353 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.336948+0000", 2024-09-12T16:16:08.353 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.9891181480000002, 2024-09-12T16:16:08.353 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022437803999999999, 2024-09-12T16:16:08.353 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:08.353 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:08.353 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:08.353 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:08.353 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:08.353 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:08.354 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 276 2024-09-12T16:16:08.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.354 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:08.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.354 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:08.354 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336948+0000", 2024-09-12T16:16:08.354 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.354 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:08.354 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336948+0000", 2024-09-12T16:16:08.354 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.355 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.355 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:08.355 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336948+0000", 2024-09-12T16:16:08.355 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2999999999999999e-07 2024-09-12T16:16:08.355 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.355 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.355 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:08.355 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336949+0000", 2024-09-12T16:16:08.355 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.029e-06 2024-09-12T16:16:08.355 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.355 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.355 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:08.355 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336953+0000", 2024-09-12T16:16:08.356 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5719999999999999e-06 2024-09-12T16:16:08.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.356 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.356 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:08.356 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336955+0000", 2024-09-12T16:16:08.356 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3640000000000002e-06 2024-09-12T16:16:08.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.356 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.356 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:08.356 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.359196+0000", 2024-09-12T16:16:08.356 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.02224046 2024-09-12T16:16:08.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.357 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.357 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:08.357 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.359282+0000", 2024-09-12T16:16:08.357 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6315000000000003e-05 2024-09-12T16:16:08.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.357 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.357 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:08.357 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.359386+0000", 2024-09-12T16:16:08.357 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000103834 2024-09-12T16:16:08.357 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.357 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:08.357 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.357 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.358 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:277 3.13 3:cf84a54d:::rbd_data.1155cf5be90e.0000000000000018:3 [read 2727936~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:08.358 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.336958+0000", 2024-09-12T16:16:08.358 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.9891078960000002, 2024-09-12T16:16:08.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022572719000000002, 2024-09-12T16:16:08.358 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:08.358 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:08.358 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:08.358 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:08.358 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:08.358 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:08.358 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 277 2024-09-12T16:16:08.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.358 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:08.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.359 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:08.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336958+0000", 2024-09-12T16:16:08.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.359 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:08.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336958+0000", 2024-09-12T16:16:08.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.359 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:08.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336959+0000", 2024-09-12T16:16:08.360 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1400000000000001e-07 2024-09-12T16:16:08.360 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.360 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.360 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:08.360 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336960+0000", 2024-09-12T16:16:08.360 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5600000000000004e-07 2024-09-12T16:16:08.360 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.360 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.360 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:08.360 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336967+0000", 2024-09-12T16:16:08.360 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9430000000000003e-06 2024-09-12T16:16:08.360 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.360 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.360 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:08.361 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336969+0000", 2024-09-12T16:16:08.361 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6019999999999998e-06 2024-09-12T16:16:08.361 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.361 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.361 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:08.361 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.359421+0000", 2024-09-12T16:16:08.361 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022451665999999999 2024-09-12T16:16:08.361 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.361 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.361 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:08.361 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.359465+0000", 2024-09-12T16:16:08.361 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3906000000000003e-05 2024-09-12T16:16:08.361 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.361 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.362 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:08.362 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.359531+0000", 2024-09-12T16:16:08.362 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6432000000000004e-05 2024-09-12T16:16:08.362 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.362 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:08.362 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.362 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.362 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.362 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:278 3.13 3:cf84a54d:::rbd_data.1155cf5be90e.0000000000000018:3 [read 2834432~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:08.362 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.336974+0000", 2024-09-12T16:16:08.362 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.9890926709999999, 2024-09-12T16:16:08.362 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022778666999999999, 2024-09-12T16:16:08.362 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:08.363 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:08.363 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:08.363 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:08.363 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:08.363 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:08.363 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 278 2024-09-12T16:16:08.363 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.363 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:08.363 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.363 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:08.363 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336974+0000", 2024-09-12T16:16:08.363 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.363 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.363 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.364 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:08.364 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336974+0000", 2024-09-12T16:16:08.364 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.364 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.364 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.364 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:08.364 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336974+0000", 2024-09-12T16:16:08.364 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.23e-07 2024-09-12T16:16:08.364 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.364 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.364 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:08.364 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336980+0000", 2024-09-12T16:16:08.364 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2600000000000002e-06 2024-09-12T16:16:08.364 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.365 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.365 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:08.365 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336983+0000", 2024-09-12T16:16:08.365 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3289999999999998e-06 2024-09-12T16:16:08.365 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.365 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.365 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:08.365 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336986+0000", 2024-09-12T16:16:08.365 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5770000000000001e-06 2024-09-12T16:16:08.365 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.365 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.365 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:08.366 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.359569+0000", 2024-09-12T16:16:08.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022583230999999999 2024-09-12T16:16:08.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.366 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.366 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:08.366 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.359650+0000", 2024-09-12T16:16:08.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1099000000000004e-05 2024-09-12T16:16:08.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.366 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.366 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:08.366 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.359752+0000", 2024-09-12T16:16:08.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010194799999999999 2024-09-12T16:16:08.366 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.366 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:08.367 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.367 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.367 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:279 3.13 3:cf84a54d:::rbd_data.1155cf5be90e.0000000000000018:3 [read 2940928~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:08.367 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.336990+0000", 2024-09-12T16:16:08.367 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.9890767110000001, 2024-09-12T16:16:08.367 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022909026999999998, 2024-09-12T16:16:08.367 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:08.367 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:08.367 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:08.367 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:08.367 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:08.367 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:08.368 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 279 2024-09-12T16:16:08.368 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.368 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:08.368 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.368 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:08.368 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336990+0000", 2024-09-12T16:16:08.368 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.368 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.368 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.368 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:08.368 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336990+0000", 2024-09-12T16:16:08.368 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.368 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.369 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.369 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:08.369 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336990+0000", 2024-09-12T16:16:08.369 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4299999999999999e-07 2024-09-12T16:16:08.369 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.369 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.369 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:08.369 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336994+0000", 2024-09-12T16:16:08.369 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4839999999999998e-06 2024-09-12T16:16:08.369 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.369 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.369 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:08.369 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336998+0000", 2024-09-12T16:16:08.369 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1669999999999999e-06 2024-09-12T16:16:08.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.370 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.370 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:08.370 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337000+0000", 2024-09-12T16:16:08.370 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.486e-06 2024-09-12T16:16:08.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.370 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.370 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:08.370 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.359794+0000", 2024-09-12T16:16:08.370 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022793798000000001 2024-09-12T16:16:08.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.370 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.370 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:08.371 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.359849+0000", 2024-09-12T16:16:08.371 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5269999999999998e-05 2024-09-12T16:16:08.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.371 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.371 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:08.371 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.359899+0000", 2024-09-12T16:16:08.371 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9579000000000001e-05 2024-09-12T16:16:08.371 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.371 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:08.371 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.371 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.371 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:280 3.13 3:cf84a54d:::rbd_data.1155cf5be90e.0000000000000018:3 [read 3047424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:08.371 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.337003+0000", 2024-09-12T16:16:08.372 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.9890628899999996, 2024-09-12T16:16:08.372 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023012187, 2024-09-12T16:16:08.372 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:08.372 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:08.372 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:08.372 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:08.372 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:08.372 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:08.372 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 280 2024-09-12T16:16:08.372 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.372 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:08.372 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.372 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:08.372 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337003+0000", 2024-09-12T16:16:08.373 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.373 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.373 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.373 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:08.373 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337003+0000", 2024-09-12T16:16:08.373 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.373 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.373 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.373 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:08.373 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337004+0000", 2024-09-12T16:16:08.373 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3200000000000001e-07 2024-09-12T16:16:08.373 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.374 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.374 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:08.374 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337005+0000", 2024-09-12T16:16:08.374 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0470000000000001e-06 2024-09-12T16:16:08.374 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.374 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.374 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:08.374 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337008+0000", 2024-09-12T16:16:08.374 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9100000000000001e-06 2024-09-12T16:16:08.374 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.375 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.375 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:08.375 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337014+0000", 2024-09-12T16:16:08.375 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7689999999999999e-06 2024-09-12T16:16:08.375 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.375 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.375 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:08.375 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.359937+0000", 2024-09-12T16:16:08.375 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022922109999999999 2024-09-12T16:16:08.375 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.375 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.375 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:08.375 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.359975+0000", 2024-09-12T16:16:08.376 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8141e-05 2024-09-12T16:16:08.376 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.376 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.376 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:08.376 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360016+0000", 2024-09-12T16:16:08.376 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0978e-05 2024-09-12T16:16:08.376 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.376 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:08.376 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.376 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.376 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.376 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:281 3.13 3:cf84a54d:::rbd_data.1155cf5be90e.0000000000000018:3 [read 3153920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:08.377 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.337026+0000", 2024-09-12T16:16:08.377 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.9890402529999998, 2024-09-12T16:16:08.377 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023094103000000001, 2024-09-12T16:16:08.377 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:08.377 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:08.377 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:08.377 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:08.377 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:08.377 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:08.377 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 281 2024-09-12T16:16:08.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.377 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:08.377 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.377 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:08.378 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337026+0000", 2024-09-12T16:16:08.378 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.378 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.378 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.378 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:08.378 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337026+0000", 2024-09-12T16:16:08.378 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.378 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.378 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.378 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:08.378 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337027+0000", 2024-09-12T16:16:08.378 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2899999999999999e-07 2024-09-12T16:16:08.379 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.379 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.379 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:08.379 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337028+0000", 2024-09-12T16:16:08.379 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4139999999999999e-06 2024-09-12T16:16:08.379 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.379 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.379 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:08.379 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337031+0000", 2024-09-12T16:16:08.379 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.428e-06 2024-09-12T16:16:08.379 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.379 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.379 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:08.379 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337034+0000", 2024-09-12T16:16:08.380 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.548e-06 2024-09-12T16:16:08.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.380 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.380 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:08.380 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360043+0000", 2024-09-12T16:16:08.380 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023008832999999999 2024-09-12T16:16:08.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.380 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.380 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:08.380 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360080+0000", 2024-09-12T16:16:08.380 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6906999999999997e-05 2024-09-12T16:16:08.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.381 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.381 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:08.381 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360120+0000", 2024-09-12T16:16:08.381 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0543999999999997e-05 2024-09-12T16:16:08.381 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.381 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:08.381 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.381 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.381 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.381 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:282 3.13 3:cf84a54d:::rbd_data.1155cf5be90e.0000000000000018:3 [read 3260416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:08.381 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.337039+0000", 2024-09-12T16:16:08.381 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.9890274379999999, 2024-09-12T16:16:08.381 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023186377000000001, 2024-09-12T16:16:08.381 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:08.382 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:08.382 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:08.382 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:08.382 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:08.382 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:08.382 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 282 2024-09-12T16:16:08.382 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.382 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:08.382 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.382 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:08.382 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337039+0000", 2024-09-12T16:16:08.382 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.382 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.382 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.383 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:08.383 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337039+0000", 2024-09-12T16:16:08.383 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.383 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.383 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:08.383 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337039+0000", 2024-09-12T16:16:08.383 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2300000000000002e-07 2024-09-12T16:16:08.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.383 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.383 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:08.383 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337040+0000", 2024-09-12T16:16:08.383 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9699999999999994e-07 2024-09-12T16:16:08.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.384 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:08.384 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337043+0000", 2024-09-12T16:16:08.384 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9739999999999998e-06 2024-09-12T16:16:08.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.384 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:08.384 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337045+0000", 2024-09-12T16:16:08.384 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.283e-06 2024-09-12T16:16:08.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.384 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:08.384 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360148+0000", 2024-09-12T16:16:08.385 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023102139000000001 2024-09-12T16:16:08.385 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.385 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.385 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:08.385 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360184+0000", 2024-09-12T16:16:08.385 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6777999999999999e-05 2024-09-12T16:16:08.385 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.385 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.385 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:08.385 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360225+0000", 2024-09-12T16:16:08.385 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0883000000000001e-05 2024-09-12T16:16:08.385 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.385 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:08.386 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.386 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.386 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:283 3.13 3:cf84a54d:::rbd_data.1155cf5be90e.0000000000000018:3 [read 3366912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:08.386 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.337048+0000", 2024-09-12T16:16:08.386 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.9890179190000001, 2024-09-12T16:16:08.386 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023293523, 2024-09-12T16:16:08.386 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:08.386 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:08.386 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:08.386 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:08.386 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:08.386 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:08.386 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 283 2024-09-12T16:16:08.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.387 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:08.387 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.387 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:08.387 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337048+0000", 2024-09-12T16:16:08.387 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.387 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.387 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:08.387 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337048+0000", 2024-09-12T16:16:08.387 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.387 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:08.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337049+0000", 2024-09-12T16:16:08.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0900000000000001e-07 2024-09-12T16:16:08.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.388 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:08.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337054+0000", 2024-09-12T16:16:08.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9980000000000003e-06 2024-09-12T16:16:08.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.388 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:08.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337061+0000", 2024-09-12T16:16:08.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1380000000000001e-06 2024-09-12T16:16:08.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.389 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.389 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:08.389 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337064+0000", 2024-09-12T16:16:08.389 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.331e-06 2024-09-12T16:16:08.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.389 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.389 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:08.389 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360259+0000", 2024-09-12T16:16:08.389 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023194889 2024-09-12T16:16:08.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.389 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.389 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:08.389 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360300+0000", 2024-09-12T16:16:08.390 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0967000000000003e-05 2024-09-12T16:16:08.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.390 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.390 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:08.390 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360342+0000", 2024-09-12T16:16:08.390 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1990999999999998e-05 2024-09-12T16:16:08.390 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.390 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:08.390 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.390 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.390 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:284 3.13 3:cf84a54d:::rbd_data.1155cf5be90e.0000000000000018:3 [read 3473408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:08.390 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.337068+0000", 2024-09-12T16:16:08.390 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.9889983889999998, 2024-09-12T16:16:08.391 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023383406999999998, 2024-09-12T16:16:08.391 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:08.391 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:08.391 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:08.391 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:08.391 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:08.391 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:08.391 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 284 2024-09-12T16:16:08.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.391 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:08.391 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.391 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:08.391 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337068+0000", 2024-09-12T16:16:08.391 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.392 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.392 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:08.392 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337068+0000", 2024-09-12T16:16:08.392 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.392 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.392 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:08.392 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337068+0000", 2024-09-12T16:16:08.392 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5600000000000002e-07 2024-09-12T16:16:08.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.392 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.392 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:08.393 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337069+0000", 2024-09-12T16:16:08.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.02e-06 2024-09-12T16:16:08.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.393 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:08.393 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337072+0000", 2024-09-12T16:16:08.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1190000000000001e-06 2024-09-12T16:16:08.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.393 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:08.393 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337079+0000", 2024-09-12T16:16:08.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3049999999999998e-06 2024-09-12T16:16:08.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:08.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360371+0000", 2024-09-12T16:16:08.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023292622999999998 2024-09-12T16:16:08.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:08.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360410+0000", 2024-09-12T16:16:08.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.862e-05 2024-09-12T16:16:08.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:08.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360451+0000", 2024-09-12T16:16:08.395 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1464000000000001e-05 2024-09-12T16:16:08.395 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.395 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:08.395 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.395 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.395 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.395 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:285 3.13 3:cf84a54d:::rbd_data.1155cf5be90e.0000000000000018:3 [read 3579904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:08.395 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.337082+0000", 2024-09-12T16:16:08.395 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.9889843850000002, 2024-09-12T16:16:08.395 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.02350087, 2024-09-12T16:16:08.395 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:08.395 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:08.395 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:08.395 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:08.396 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:08.396 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:08.396 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 285 2024-09-12T16:16:08.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.396 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:08.396 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.396 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:08.396 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337082+0000", 2024-09-12T16:16:08.396 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.396 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.396 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:08.396 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337082+0000", 2024-09-12T16:16:08.397 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.397 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.397 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:08.397 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337082+0000", 2024-09-12T16:16:08.397 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4600000000000001e-07 2024-09-12T16:16:08.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.397 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.397 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:08.397 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337083+0000", 2024-09-12T16:16:08.397 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0100000000000001e-06 2024-09-12T16:16:08.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.397 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.397 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:08.398 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337086+0000", 2024-09-12T16:16:08.398 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0189999999999998e-06 2024-09-12T16:16:08.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.398 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:08.398 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337088+0000", 2024-09-12T16:16:08.398 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2759999999999999e-06 2024-09-12T16:16:08.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.398 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:08.398 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360481+0000", 2024-09-12T16:16:08.398 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023392857 2024-09-12T16:16:08.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.399 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.399 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:08.399 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360527+0000", 2024-09-12T16:16:08.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5624999999999998e-05 2024-09-12T16:16:08.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.399 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.399 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:08.399 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360583+0000", 2024-09-12T16:16:08.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5837000000000001e-05 2024-09-12T16:16:08.399 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.399 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:08.399 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.399 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.400 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:286 3.13 3:cf84a54d:::rbd_data.1155cf5be90e.0000000000000018:3 [read 3686400~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:08.400 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.337091+0000", 2024-09-12T16:16:08.400 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.9889749339999998, 2024-09-12T16:16:08.400 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023618453000000001, 2024-09-12T16:16:08.400 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:08.400 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:08.400 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:08.400 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:08.400 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:08.400 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:08.400 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 286 2024-09-12T16:16:08.400 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.400 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:08.401 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.401 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:08.401 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337091+0000", 2024-09-12T16:16:08.401 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.401 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.401 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:08.401 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337091+0000", 2024-09-12T16:16:08.401 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.401 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.401 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:08.401 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337092+0000", 2024-09-12T16:16:08.402 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0900000000000001e-07 2024-09-12T16:16:08.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.402 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:08.402 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337093+0000", 2024-09-12T16:16:08.402 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2600000000000001e-07 2024-09-12T16:16:08.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.402 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:08.402 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337095+0000", 2024-09-12T16:16:08.402 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8279999999999999e-06 2024-09-12T16:16:08.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.403 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:08.403 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337098+0000", 2024-09-12T16:16:08.403 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2390000000000001e-06 2024-09-12T16:16:08.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.403 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.403 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:08.403 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360618+0000", 2024-09-12T16:16:08.403 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023520077 2024-09-12T16:16:08.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.403 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.403 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:08.403 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360667+0000", 2024-09-12T16:16:08.403 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9008000000000002e-05 2024-09-12T16:16:08.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.404 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.404 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:08.404 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360710+0000", 2024-09-12T16:16:08.404 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3166e-05 2024-09-12T16:16:08.404 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.404 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:08.404 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.404 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.404 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.404 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:287 3.13 3:cf84a54d:::rbd_data.1155cf5be90e.0000000000000018:3 [read 3792896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:08.404 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.337100+0000", 2024-09-12T16:16:08.404 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.988965834, 2024-09-12T16:16:08.404 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023723867999999999, 2024-09-12T16:16:08.405 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:08.405 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:08.405 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:08.405 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:08.405 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:08.405 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:08.405 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 287 2024-09-12T16:16:08.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.405 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:08.405 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.405 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:08.405 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337100+0000", 2024-09-12T16:16:08.405 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:08.406 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337100+0000", 2024-09-12T16:16:08.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:08.406 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337101+0000", 2024-09-12T16:16:08.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3300000000000001e-07 2024-09-12T16:16:08.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:08.406 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337102+0000", 2024-09-12T16:16:08.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0500000000000002e-07 2024-09-12T16:16:08.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.407 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:08.407 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337104+0000", 2024-09-12T16:16:08.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8329999999999998e-06 2024-09-12T16:16:08.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.407 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:08.407 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337107+0000", 2024-09-12T16:16:08.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3819999999999998e-06 2024-09-12T16:16:08.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.408 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:08.408 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360740+0000", 2024-09-12T16:16:08.408 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023632980000000001 2024-09-12T16:16:08.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.408 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.408 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:08.408 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360782+0000", 2024-09-12T16:16:08.408 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2502000000000001e-05 2024-09-12T16:16:08.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.408 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.408 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:08.408 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360824+0000", 2024-09-12T16:16:08.408 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2033000000000002e-05 2024-09-12T16:16:08.409 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.409 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:08.409 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.409 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.409 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.409 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:288 3.13 3:cf84a54d:::rbd_data.1155cf5be90e.0000000000000018:3 [read 3899392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:08.409 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.337125+0000", 2024-09-12T16:16:08.409 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.9889415210000001, 2024-09-12T16:16:08.409 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023816223000000001, 2024-09-12T16:16:08.409 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:08.409 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:08.409 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:08.409 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:08.410 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:08.410 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:08.410 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 288 2024-09-12T16:16:08.410 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.410 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:08.410 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.410 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:08.410 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337125+0000", 2024-09-12T16:16:08.410 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.410 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.410 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.410 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:08.410 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337125+0000", 2024-09-12T16:16:08.410 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.410 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.411 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.411 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:08.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337125+0000", 2024-09-12T16:16:08.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0900000000000002e-07 2024-09-12T16:16:08.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.411 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.411 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:08.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337126+0000", 2024-09-12T16:16:08.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2100000000000001e-06 2024-09-12T16:16:08.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.411 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.411 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:08.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337130+0000", 2024-09-12T16:16:08.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3459999999999998e-06 2024-09-12T16:16:08.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.412 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:08.412 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337133+0000", 2024-09-12T16:16:08.412 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1410000000000001e-06 2024-09-12T16:16:08.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.412 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:08.412 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360858+0000", 2024-09-12T16:16:08.412 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023725370999999999 2024-09-12T16:16:08.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.412 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:08.413 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360899+0000", 2024-09-12T16:16:08.413 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0828000000000003e-05 2024-09-12T16:16:08.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.413 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:08.413 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360941+0000", 2024-09-12T16:16:08.413 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1918000000000001e-05 2024-09-12T16:16:08.413 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.413 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:08.413 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.413 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:289 3.13 3:cf84a54d:::rbd_data.1155cf5be90e.0000000000000018:3 [read 4005888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:08.414 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.337136+0000", 2024-09-12T16:16:08.414 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.9889301210000001, 2024-09-12T16:16:08.414 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023916468, 2024-09-12T16:16:08.414 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:08.414 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:08.414 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:08.414 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:08.414 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:08.414 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:08.414 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 289 2024-09-12T16:16:08.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.415 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:08.415 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.415 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:08.415 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337136+0000", 2024-09-12T16:16:08.415 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.415 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.415 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:08.415 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337136+0000", 2024-09-12T16:16:08.415 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.415 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.415 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:08.416 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337137+0000", 2024-09-12T16:16:08.416 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0899999999999997e-07 2024-09-12T16:16:08.416 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.416 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.416 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:08.416 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337142+0000", 2024-09-12T16:16:08.416 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1549999999999998e-06 2024-09-12T16:16:08.416 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.416 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.416 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:08.416 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337149+0000", 2024-09-12T16:16:08.416 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8730000000000001e-06 2024-09-12T16:16:08.416 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.417 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.417 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:08.417 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337151+0000", 2024-09-12T16:16:08.417 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6910000000000002e-06 2024-09-12T16:16:08.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.417 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.417 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:08.417 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360971+0000", 2024-09-12T16:16:08.417 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023819395 2024-09-12T16:16:08.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.417 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.417 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:08.417 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.361011+0000", 2024-09-12T16:16:08.418 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0571000000000002e-05 2024-09-12T16:16:08.418 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.418 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.418 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:08.418 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.361053+0000", 2024-09-12T16:16:08.418 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1474000000000003e-05 2024-09-12T16:16:08.418 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.418 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:08.418 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.418 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.418 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.418 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:290 3.13 3:cf84a54d:::rbd_data.1155cf5be90e.0000000000000018:3 [read 4112384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:08.418 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.337155+0000", 2024-09-12T16:16:08.418 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.9889112039999999, 2024-09-12T16:16:08.419 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023997344, 2024-09-12T16:16:08.419 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:08.419 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:08.419 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:08.419 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:08.419 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:08.419 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:08.419 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 290 2024-09-12T16:16:08.419 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.419 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:08.419 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.419 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:08.419 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337155+0000", 2024-09-12T16:16:08.419 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.420 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.420 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:08.420 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337155+0000", 2024-09-12T16:16:08.420 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:08.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.420 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.420 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:08.420 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337155+0000", 2024-09-12T16:16:08.420 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4999999999999999e-07 2024-09-12T16:16:08.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.420 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.420 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:08.420 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337156+0000", 2024-09-12T16:16:08.421 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.127e-06 2024-09-12T16:16:08.421 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.421 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.421 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:08.421 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337160+0000", 2024-09-12T16:16:08.421 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0469999999999998e-06 2024-09-12T16:16:08.421 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.421 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.421 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:08.421 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337162+0000", 2024-09-12T16:16:08.421 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.328e-06 2024-09-12T16:16:08.421 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.421 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.422 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:08.422 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.361073+0000", 2024-09-12T16:16:08.422 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023911000000000002 2024-09-12T16:16:08.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.422 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.422 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:08.422 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.361111+0000", 2024-09-12T16:16:08.422 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7642000000000003e-05 2024-09-12T16:16:08.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:08.422 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:08.422 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:08.422 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.361152+0000", 2024-09-12T16:16:08.422 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1950000000000003e-05 2024-09-12T16:16:08.422 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.423 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:08.423 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.423 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:08.423 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:08.423 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:08.423 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T16:16:08.426 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:16:08.426 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:08.423+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:08.428 INFO:teuthology.orchestra.run.smithi204.stdout:563 punch from 0x51600 to 0x60800, (0xf200 bytes) 2024-09-12T16:16:08.428 INFO:teuthology.orchestra.run.smithi204.stdout:564 read 0x5ea00 thru 0x62277 (0x3878 bytes) 2024-09-12T16:16:08.428 INFO:teuthology.orchestra.run.smithi204.stdout:565 punch from 0x1aa00 to 0x1d400, (0x2a00 bytes) 2024-09-12T16:16:08.428 INFO:teuthology.orchestra.run.smithi204.stdout:569 trunc from 0x85a00 to 0xcb84c00 2024-09-12T16:16:08.428 INFO:teuthology.orchestra.run.smithi204.stdout:571 write 0xb067c00 thru 0xb075707 (0xdb08 bytes) 2024-09-12T16:16:08.428 INFO:teuthology.orchestra.run.smithi204.stdout:572 write 0xcb88800 thru 0xcb8e074 (0x5875 bytes) 2024-09-12T16:16:08.428 INFO:teuthology.orchestra.run.smithi204.stdout:573 punch from 0x4c2b200 to 0x4c30400, (0x5200 bytes) 2024-09-12T16:16:08.428 INFO:teuthology.orchestra.run.smithi204.stdout:574 read 0x97f0600 thru 0x97f960f (0x9010 bytes) 2024-09-12T16:16:08.428 INFO:teuthology.orchestra.run.smithi204.stdout:575 write 0xbb6a800 thru 0xbb6f173 (0x4974 bytes) 2024-09-12T16:16:08.428 INFO:teuthology.orchestra.run.smithi204.stdout:576 punch from 0x712ea00 to 0x713b000, (0xc600 bytes) 2024-09-12T16:16:08.428 INFO:teuthology.orchestra.run.smithi204.stdout:578 read 0x9bd9200 thru 0x9bdc422 (0x3223 bytes) 2024-09-12T16:16:08.429 INFO:teuthology.orchestra.run.smithi204.stdout:580 write 0x9c4c200 thru 0x9c54c7c (0x8a7d bytes) 2024-09-12T16:16:08.429 INFO:teuthology.orchestra.run.smithi204.stdout:581 write 0xb3cca00 thru 0xb3ce28e (0x188f bytes) 2024-09-12T16:16:08.429 INFO:teuthology.orchestra.run.smithi204.stdout:582 write 0x5501800 thru 0x550a301 (0x8b02 bytes) 2024-09-12T16:16:08.429 INFO:teuthology.orchestra.run.smithi204.stdout:583 read 0x12b2c00 thru 0x12bba41 (0x8e42 bytes) 2024-09-12T16:16:08.429 INFO:teuthology.orchestra.run.smithi204.stdout:584 read 0x6e68e00 thru 0x6e6fa47 (0x6c48 bytes) 2024-09-12T16:16:08.429 INFO:teuthology.orchestra.run.smithi204.stdout:585 write 0x4e65400 thru 0x4e66399 (0xf9a bytes) 2024-09-12T16:16:08.429 INFO:teuthology.orchestra.run.smithi204.stdout:586 trunc from 0xcb8e200 to 0xa4df000 2024-09-12T16:16:08.429 INFO:teuthology.orchestra.run.smithi204.stdout:588 write 0x50f7200 thru 0x50f7a83 (0x884 bytes) 2024-09-12T16:16:08.429 INFO:teuthology.orchestra.run.smithi204.stdout:589 write 0x810ea00 thru 0x811bfad (0xd5ae bytes) 2024-09-12T16:16:08.429 INFO:teuthology.orchestra.run.smithi204.stdout:591 trunc from 0xa4df000 to 0xcc01a00 2024-09-12T16:16:08.429 INFO:teuthology.orchestra.run.smithi204.stdout:592 trunc from 0xcc01a00 to 0xab03200 2024-09-12T16:16:08.430 INFO:teuthology.orchestra.run.smithi204.stdout:593 trunc from 0xab03200 to 0x84a1200 2024-09-12T16:16:08.446 INFO:teuthology.orchestra.run.smithi204.stdout:594 punch from 0x2eb8000 to 0x2ebce00, (0x4e00 bytes) 2024-09-12T16:16:08.451 INFO:teuthology.orchestra.run.smithi204.stdout:595 read 0x7426200 thru 0x7429f2b (0x3d2c bytes) 2024-09-12T16:16:08.455 INFO:teuthology.orchestra.run.smithi204.stdout:596 trunc from 0x84a1200 to 0x5643400 2024-09-12T16:16:08.469 INFO:teuthology.orchestra.run.smithi204.stdout:597 write 0x4083400 thru 0x4085074 (0x1c75 bytes) 2024-09-12T16:16:08.471 INFO:teuthology.orchestra.run.smithi204.stdout:600 read 0x1413000 thru 0x1419053 (0x6054 bytes) 2024-09-12T16:16:08.471 INFO:teuthology.orchestra.run.smithi204.stdout:603 write 0x1c17800 thru 0x1c1c317 (0x4b18 bytes) 2024-09-12T16:16:08.471 INFO:teuthology.orchestra.run.smithi204.stdout:605 punch from 0x41aac00 to 0x41b7600, (0xca00 bytes) 2024-09-12T16:16:08.486 INFO:teuthology.orchestra.run.smithi204.stdout:606 write 0x9cb0400 thru 0x9cb89ec (0x85ed bytes) 2024-09-12T16:16:08.487 INFO:teuthology.orchestra.run.smithi204.stdout:607 read 0x2106600 thru 0x2107356 (0xd57 bytes) 2024-09-12T16:16:08.501 INFO:teuthology.orchestra.run.smithi204.stdout:610 write 0x9cd4a00 thru 0x9cdd627 (0x8c28 bytes) 2024-09-12T16:16:08.508 INFO:teuthology.orchestra.run.smithi204.stdout:611 write 0x65f2800 thru 0x65f77b8 (0x4fb9 bytes) 2024-09-12T16:16:08.509 INFO:teuthology.orchestra.run.smithi204.stdout:612 read 0x16de800 thru 0x16e2b00 (0x4301 bytes) 2024-09-12T16:16:08.509 INFO:teuthology.orchestra.run.smithi204.stdout:613 write 0x670c00 thru 0x678f42 (0x8343 bytes) 2024-09-12T16:16:08.509 INFO:teuthology.orchestra.run.smithi204.stdout:616 write 0x3b2ec00 thru 0x3b393fa (0xa7fb bytes) 2024-09-12T16:16:08.509 INFO:teuthology.orchestra.run.smithi204.stdout:617 read 0x6c64000 thru 0x6c71b86 (0xdb87 bytes) 2024-09-12T16:16:08.509 INFO:teuthology.orchestra.run.smithi204.stdout:618 read 0x883fe00 thru 0x8843082 (0x3283 bytes) 2024-09-12T16:16:08.510 INFO:teuthology.orchestra.run.smithi204.stdout:620 punch from 0x6350400 to 0x6358600, (0x8200 bytes) 2024-09-12T16:16:08.518 INFO:teuthology.orchestra.run.smithi204.stdout:621 trunc from 0x9cdd800 to 0x22a1600 2024-09-12T16:16:08.526 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:08.524+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:08.542 INFO:teuthology.orchestra.run.smithi204.stdout:622 punch from 0xc5d800 to 0xc63400, (0x5c00 bytes) 2024-09-12T16:16:08.543 INFO:teuthology.orchestra.run.smithi204.stdout:623 read 0xa4f600 thru 0xa505f5 (0xff6 bytes) 2024-09-12T16:16:08.543 INFO:teuthology.orchestra.run.smithi204.stdout:625 read 0x17cb600 thru 0x17d9f85 (0xe986 bytes) 2024-09-12T16:16:08.543 INFO:teuthology.orchestra.run.smithi204.stdout:626 read 0x16ca200 thru 0x16d83b0 (0xe1b1 bytes) 2024-09-12T16:16:08.543 INFO:teuthology.orchestra.run.smithi204.stdout:627 clone 4 order 24 su 4194304 sc 6 2024-09-12T16:16:08.561 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:16:08.561 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:16:08.577 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:16:08.577 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:16:08.579 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:08.579 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:16:08.579 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:16:08.579 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:08.587 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:16:08.594 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:16:08.594 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:16:08.611 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:16:08.611 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:16:08.628 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:16:08.628 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:16:08.629 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:16:08.628+0000 7f002d431640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32213) UID: 0 2024-09-12T16:16:08.644 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:16:08.644 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:16:08.727 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:08.727+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:08.735 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:08.735 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:08.743 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:16:08.828 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:08.827+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:08.850 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:08.850 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:08.859 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:16:08.929 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:08.929+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:08.965 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:08.965 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:08.974 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:16:09.030 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:09.029+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:09.042 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-12T16:16:09.042 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T16:16:09.043 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-12T16:16:09.043 INFO:tasks.thrashosds.thrasher:Setting osd 2 primary_affinity to 0.000000 2024-09-12T16:16:09.043 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 0 2024-09-12T16:16:09.082 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:09.082 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:09.091 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:16:09.122 INFO:teuthology.orchestra.run.smithi204.stdout:flattening image image_client.0-clone3 2024-09-12T16:16:09.130 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:09.130+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:09.201 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:09.201 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:09.210 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:16:09.254 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:09.253+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:09.324 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:09.325 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:09.332 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:09.331+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:09.333 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:16:09.379 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #2, image image_client.0-clone2 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent3 2024-09-12T16:16:09.433 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:09.432+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:09.449 INFO:teuthology.orchestra.run.smithi204.stdout:630 write 0xb969c00 thru 0xb96a21e (0x61f bytes) 2024-09-12T16:16:09.450 INFO:teuthology.orchestra.run.smithi204.stdout:632 read 0x237c600 thru 0x2385685 (0x9086 bytes) 2024-09-12T16:16:09.450 INFO:teuthology.orchestra.run.smithi204.stdout:633 write 0x6075600 thru 0x607a287 (0x4c88 bytes) 2024-09-12T16:16:09.450 INFO:teuthology.orchestra.run.smithi204.stdout:635 write 0xdae00 thru 0xe486f (0x9a70 bytes) 2024-09-12T16:16:09.451 INFO:teuthology.orchestra.run.smithi204.stdout:636 write 0x7ba800 thru 0x7c6a7d (0xc27e bytes) 2024-09-12T16:16:09.454 INFO:teuthology.orchestra.run.smithi204.stdout:637 read 0xb1efa00 thru 0xb1f0273 (0x874 bytes) 2024-09-12T16:16:09.455 INFO:teuthology.orchestra.run.smithi204.stdout:638 punch from 0x4040e00 to 0x4050800, (0xfa00 bytes) 2024-09-12T16:16:09.455 INFO:teuthology.orchestra.run.smithi204.stdout:640 punch from 0x9c600 to 0xaac00, (0xe600 bytes) 2024-09-12T16:16:09.455 INFO:teuthology.orchestra.run.smithi204.stdout:641 read 0x39f9400 thru 0x39ff542 (0x6143 bytes) 2024-09-12T16:16:09.455 INFO:teuthology.orchestra.run.smithi204.stdout:643 read 0x2ddb200 thru 0x2ddbb55 (0x956 bytes) 2024-09-12T16:16:09.455 INFO:teuthology.orchestra.run.smithi204.stdout:644 write 0x8d85c00 thru 0x8d910fc (0xb4fd bytes) 2024-09-12T16:16:09.455 INFO:teuthology.orchestra.run.smithi204.stdout:646 punch from 0x65e9200 to 0x65efe00, (0x6c00 bytes) 2024-09-12T16:16:09.455 INFO:teuthology.orchestra.run.smithi204.stdout:647 clone 5 order 20 su 32768 sc 2 2024-09-12T16:16:09.484 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:09.485 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:09.493 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:16:09.534 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:16:09.533+0000 7f002d431640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32213) UID: 0 2024-09-12T16:16:09.600 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:09.600 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:09.609 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:16:09.635 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:16:09.634+0000 7f002d431640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32213) UID: 0 2024-09-12T16:16:09.716 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:09.716 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:09.724 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:16:09.768 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:09.767+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:09.831 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:09.831 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:09.836 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:09.835+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:09.839 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:16:09.937 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:09.937+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:09.987 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:09.987 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:09.996 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:16:10.038 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:10.037+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:10.048 INFO:teuthology.orchestra.run.smithi017.stderr:set osd.2 primary-affinity to 0 (802) 2024-09-12T16:16:10.054 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T16:16:10.139 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:16:10.138+0000 7f002d431640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32213) UID: 0 2024-09-12T16:16:10.148 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:10.149 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:10.158 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:16:10.239 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:10.239+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:10.267 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:10.267 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:10.276 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:16:10.340 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:16:10.339+0000 7f002d431640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32213) UID: 0 2024-09-12T16:16:10.382 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:10.382 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:10.393 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:16:10.441 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:10.440+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:10.511 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:10.511 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:10.521 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:16:10.542 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:10.541+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:10.629 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:10.629 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:10.638 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:16:10.643 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:10.642+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:10.655 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T16:16:10.744 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:10.743+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:10.745 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:10.746 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:10.754 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:16:10.779 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:16:10.780 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:16:10.797 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:16:10.797 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:16:10.813 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:16:10.813 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:16:10.830 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:16:10.830 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:16:10.846 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:10.845+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:10.847 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:16:10.847 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:16:10.864 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:16:10.864 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:16:10.901 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:10.901 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:16:10.901 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:16:10.902 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:10.910 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:16:10.954 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:10.953+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:11.016 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:11.017 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:16:11.017 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:16:11.017 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:16:11.017 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:11.025 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:16:11.046 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2024-09-12T16:16:11.066 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:11.065+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:11.122 INFO:teuthology.orchestra.run.smithi204.stdout:truncating image image_client.0-clone4 from 0xb96a400 (overlap 0x22a1600) to 0x1f2ac00 2024-09-12T16:16:11.148 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:11.148+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:11.179 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:11.179 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:16:11.179 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:16:11.180 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:16:11.180 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.180 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:410 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 4980736~10240] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:11.180 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276382+0000", 2024-09-12T16:16:11.180 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.9017289370000001, 2024-09-12T16:16:11.180 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012018983, 2024-09-12T16:16:11.180 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.180 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.180 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:11.180 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.180 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:11.180 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:11.180 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 410 2024-09-12T16:16:11.181 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.181 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.181 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.181 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.181 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276382+0000", 2024-09-12T16:16:11.181 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.181 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.181 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.181 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.181 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276382+0000", 2024-09-12T16:16:11.181 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.181 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.182 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.182 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.182 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276382+0000", 2024-09-12T16:16:11.182 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.03e-07 2024-09-12T16:16:11.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.182 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.182 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.182 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276383+0000", 2024-09-12T16:16:11.182 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.037e-06 2024-09-12T16:16:11.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.182 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.182 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.182 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276386+0000", 2024-09-12T16:16:11.183 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1140000000000002e-06 2024-09-12T16:16:11.183 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.183 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.183 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.183 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276389+0000", 2024-09-12T16:16:11.183 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5040000000000001e-06 2024-09-12T16:16:11.183 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.183 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.183 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.183 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.288177+0000", 2024-09-12T16:16:11.183 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011788495 2024-09-12T16:16:11.183 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.183 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.184 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.184 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.288227+0000", 2024-09-12T16:16:11.184 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.956e-05 2024-09-12T16:16:11.184 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.184 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.184 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.184 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.288401+0000", 2024-09-12T16:16:11.184 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017406999999999999 2024-09-12T16:16:11.184 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.184 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.184 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.184 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.185 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.185 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:411 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 6029312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:11.185 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276392+0000", 2024-09-12T16:16:11.185 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.901718963, 2024-09-12T16:16:11.185 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012131591000000001, 2024-09-12T16:16:11.185 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.185 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.185 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:11.185 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.185 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:11.185 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:11.185 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 411 2024-09-12T16:16:11.185 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.186 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.186 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.186 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.186 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276392+0000", 2024-09-12T16:16:11.186 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.186 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.186 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.186 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276392+0000", 2024-09-12T16:16:11.186 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.186 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.186 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.186 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276392+0000", 2024-09-12T16:16:11.187 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0599999999999999e-07 2024-09-12T16:16:11.187 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.187 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.187 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.187 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276393+0000", 2024-09-12T16:16:11.187 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0330000000000001e-06 2024-09-12T16:16:11.187 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.187 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.187 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.187 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276396+0000", 2024-09-12T16:16:11.187 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9610000000000001e-06 2024-09-12T16:16:11.187 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.187 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.187 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.188 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276399+0000", 2024-09-12T16:16:11.188 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5660000000000001e-06 2024-09-12T16:16:11.188 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.188 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.188 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.188 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.288417+0000", 2024-09-12T16:16:11.188 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012018722000000001 2024-09-12T16:16:11.188 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.188 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.188 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.188 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.288472+0000", 2024-09-12T16:16:11.188 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4286000000000002e-05 2024-09-12T16:16:11.189 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.189 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.189 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.189 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.288523+0000", 2024-09-12T16:16:11.189 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1817000000000002e-05 2024-09-12T16:16:11.189 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.189 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.189 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.189 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.189 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.189 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:412 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 7077888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:11.189 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276403+0000", 2024-09-12T16:16:11.189 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.901707719, 2024-09-12T16:16:11.190 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012256773, 2024-09-12T16:16:11.190 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.190 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.190 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:11.190 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.190 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:11.190 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:11.190 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 412 2024-09-12T16:16:11.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.190 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.190 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.190 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.190 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276403+0000", 2024-09-12T16:16:11.190 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.191 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.191 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.191 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.191 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276403+0000", 2024-09-12T16:16:11.191 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.191 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.191 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.191 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.191 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276403+0000", 2024-09-12T16:16:11.191 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1e-07 2024-09-12T16:16:11.191 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.191 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.191 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.192 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276405+0000", 2024-09-12T16:16:11.192 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3260000000000001e-06 2024-09-12T16:16:11.192 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.192 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.192 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.192 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276408+0000", 2024-09-12T16:16:11.192 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7249999999999999e-06 2024-09-12T16:16:11.192 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.192 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.192 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.192 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276411+0000", 2024-09-12T16:16:11.192 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4480000000000001e-06 2024-09-12T16:16:11.192 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.193 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.193 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.193 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.288551+0000", 2024-09-12T16:16:11.193 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012140275000000001 2024-09-12T16:16:11.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.193 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.193 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.193 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.288605+0000", 2024-09-12T16:16:11.193 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3956999999999999e-05 2024-09-12T16:16:11.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.193 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.193 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.193 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.288660+0000", 2024-09-12T16:16:11.193 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4832e-05 2024-09-12T16:16:11.194 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.194 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.194 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.194 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.194 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.194 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:413 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 8126464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:11.194 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276414+0000", 2024-09-12T16:16:11.194 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.9016967390000001, 2024-09-12T16:16:11.194 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012366298, 2024-09-12T16:16:11.194 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.194 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.194 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:11.194 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.195 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:11.195 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:11.195 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 413 2024-09-12T16:16:11.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.195 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276414+0000", 2024-09-12T16:16:11.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276414+0000", 2024-09-12T16:16:11.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.196 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.196 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276414+0000", 2024-09-12T16:16:11.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3300000000000001e-07 2024-09-12T16:16:11.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.196 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.196 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276415+0000", 2024-09-12T16:16:11.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1000000000000001e-06 2024-09-12T16:16:11.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.197 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.197 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276419+0000", 2024-09-12T16:16:11.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.659e-06 2024-09-12T16:16:11.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.197 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.197 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.197 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276422+0000", 2024-09-12T16:16:11.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.43e-06 2024-09-12T16:16:11.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.197 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.197 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.197 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.288675+0000", 2024-09-12T16:16:11.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012253811999999999 2024-09-12T16:16:11.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.198 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.198 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.198 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.288713+0000", 2024-09-12T16:16:11.198 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7347e-05 2024-09-12T16:16:11.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.198 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.198 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.198 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.288780+0000", 2024-09-12T16:16:11.198 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7717000000000002e-05 2024-09-12T16:16:11.198 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.198 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.198 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.199 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:422 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 917504~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:11.199 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276425+0000", 2024-09-12T16:16:11.199 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.9016861660000002, 2024-09-12T16:16:11.199 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012485105, 2024-09-12T16:16:11.199 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.199 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.199 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:11.199 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.199 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:11.199 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:11.199 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 422 2024-09-12T16:16:11.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.199 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276425+0000", 2024-09-12T16:16:11.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276425+0000", 2024-09-12T16:16:11.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276425+0000", 2024-09-12T16:16:11.201 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.23e-07 2024-09-12T16:16:11.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.201 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.201 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.201 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276426+0000", 2024-09-12T16:16:11.201 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.083e-06 2024-09-12T16:16:11.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.201 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.201 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.201 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276429+0000", 2024-09-12T16:16:11.201 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9519999999999999e-06 2024-09-12T16:16:11.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.201 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.202 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.202 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276431+0000", 2024-09-12T16:16:11.202 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4499999999999998e-06 2024-09-12T16:16:11.202 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.202 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.202 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.202 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.288809+0000", 2024-09-12T16:16:11.202 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012377505 2024-09-12T16:16:11.202 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.202 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.202 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.202 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.288853+0000", 2024-09-12T16:16:11.202 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3816000000000002e-05 2024-09-12T16:16:11.202 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.288910+0000", 2024-09-12T16:16:11.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7076e-05 2024-09-12T16:16:11.203 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.203 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.203 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.203 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:423 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 1966080~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:11.203 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276434+0000", 2024-09-12T16:16:11.203 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.9016763399999999, 2024-09-12T16:16:11.204 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012594595, 2024-09-12T16:16:11.204 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.204 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.204 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:11.204 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.204 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:11.204 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:11.204 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 423 2024-09-12T16:16:11.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.204 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.204 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.204 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.204 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276434+0000", 2024-09-12T16:16:11.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.205 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.205 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276434+0000", 2024-09-12T16:16:11.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.205 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.205 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276435+0000", 2024-09-12T16:16:11.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7099999999999997e-07 2024-09-12T16:16:11.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.206 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.206 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276436+0000", 2024-09-12T16:16:11.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.192e-06 2024-09-12T16:16:11.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.206 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.206 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.206 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276439+0000", 2024-09-12T16:16:11.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0489999999999999e-06 2024-09-12T16:16:11.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.206 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.206 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.206 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276442+0000", 2024-09-12T16:16:11.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4980000000000001e-06 2024-09-12T16:16:11.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.207 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.207 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.288925+0000", 2024-09-12T16:16:11.207 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012482926 2024-09-12T16:16:11.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.207 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.207 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.288966+0000", 2024-09-12T16:16:11.207 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1349e-05 2024-09-12T16:16:11.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.208 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.208 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289029+0000", 2024-09-12T16:16:11.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.321e-05 2024-09-12T16:16:11.208 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.208 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.208 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.208 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.208 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:424 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 3014656~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:11.208 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276457+0000", 2024-09-12T16:16:11.208 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.9016540060000002, 2024-09-12T16:16:11.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012696107, 2024-09-12T16:16:11.208 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.208 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.209 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:11.209 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.209 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:11.209 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:11.209 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 424 2024-09-12T16:16:11.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.209 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276457+0000", 2024-09-12T16:16:11.209 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.210 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.210 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276457+0000", 2024-09-12T16:16:11.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.210 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.210 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.210 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276457+0000", 2024-09-12T16:16:11.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7000000000000001e-07 2024-09-12T16:16:11.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.210 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.210 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.210 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276459+0000", 2024-09-12T16:16:11.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.48e-06 2024-09-12T16:16:11.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.211 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.211 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276463+0000", 2024-09-12T16:16:11.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9809999999999997e-06 2024-09-12T16:16:11.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.211 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.211 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276465+0000", 2024-09-12T16:16:11.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.576e-06 2024-09-12T16:16:11.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.211 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.211 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289055+0000", 2024-09-12T16:16:11.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012589622 2024-09-12T16:16:11.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289096+0000", 2024-09-12T16:16:11.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1319000000000002e-05 2024-09-12T16:16:11.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289153+0000", 2024-09-12T16:16:11.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6858999999999999e-05 2024-09-12T16:16:11.212 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.212 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.212 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.213 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:425 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 4063232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:11.213 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276468+0000", 2024-09-12T16:16:11.213 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.9016423840000001, 2024-09-12T16:16:11.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012839615, 2024-09-12T16:16:11.213 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.213 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.213 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:11.213 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.213 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:11.213 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:11.213 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 425 2024-09-12T16:16:11.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.213 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.214 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.214 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276468+0000", 2024-09-12T16:16:11.214 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.214 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.214 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276468+0000", 2024-09-12T16:16:11.214 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.214 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.214 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276469+0000", 2024-09-12T16:16:11.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0900000000000001e-07 2024-09-12T16:16:11.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.215 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.215 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276470+0000", 2024-09-12T16:16:11.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.141e-06 2024-09-12T16:16:11.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.215 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.215 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276473+0000", 2024-09-12T16:16:11.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.915e-06 2024-09-12T16:16:11.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.215 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.215 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276475+0000", 2024-09-12T16:16:11.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4600000000000002e-06 2024-09-12T16:16:11.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.216 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.216 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289185+0000", 2024-09-12T16:16:11.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012709644000000001 2024-09-12T16:16:11.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.216 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.216 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289251+0000", 2024-09-12T16:16:11.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6056000000000006e-05 2024-09-12T16:16:11.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289308+0000", 2024-09-12T16:16:11.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.719e-05 2024-09-12T16:16:11.217 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.217 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.217 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.217 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:426 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 5111808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:11.217 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276478+0000", 2024-09-12T16:16:11.217 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.9016325300000001, 2024-09-12T16:16:11.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012963234000000001, 2024-09-12T16:16:11.217 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.217 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.218 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:11.218 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.218 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:11.218 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:11.218 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 426 2024-09-12T16:16:11.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.218 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276478+0000", 2024-09-12T16:16:11.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276478+0000", 2024-09-12T16:16:11.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276479+0000", 2024-09-12T16:16:11.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.72e-07 2024-09-12T16:16:11.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276480+0000", 2024-09-12T16:16:11.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.049e-06 2024-09-12T16:16:11.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.220 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.220 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.220 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276483+0000", 2024-09-12T16:16:11.220 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0539999999999999e-06 2024-09-12T16:16:11.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.220 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.220 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.220 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276487+0000", 2024-09-12T16:16:11.220 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3170000000000003e-06 2024-09-12T16:16:11.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.220 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.220 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.220 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289339+0000", 2024-09-12T16:16:11.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012852397999999999 2024-09-12T16:16:11.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.221 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.221 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.221 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289383+0000", 2024-09-12T16:16:11.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3846e-05 2024-09-12T16:16:11.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.221 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.221 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.221 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289442+0000", 2024-09-12T16:16:11.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8298000000000003e-05 2024-09-12T16:16:11.221 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.221 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.222 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.222 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:427 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 6160384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:11.222 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276490+0000", 2024-09-12T16:16:11.222 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.9016204970000001, 2024-09-12T16:16:11.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013114918, 2024-09-12T16:16:11.222 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.222 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.222 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:11.222 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.222 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:11.222 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:11.223 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 427 2024-09-12T16:16:11.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.223 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276490+0000", 2024-09-12T16:16:11.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276490+0000", 2024-09-12T16:16:11.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276491+0000", 2024-09-12T16:16:11.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2000000000000001e-07 2024-09-12T16:16:11.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276492+0000", 2024-09-12T16:16:11.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1060000000000001e-06 2024-09-12T16:16:11.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276496+0000", 2024-09-12T16:16:11.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.313e-06 2024-09-12T16:16:11.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276499+0000", 2024-09-12T16:16:11.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5280000000000002e-06 2024-09-12T16:16:11.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289468+0000", 2024-09-12T16:16:11.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012969100000000001 2024-09-12T16:16:11.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289509+0000", 2024-09-12T16:16:11.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1455000000000002e-05 2024-09-12T16:16:11.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289605+0000", 2024-09-12T16:16:11.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6195999999999999e-05 2024-09-12T16:16:11.226 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.226 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.226 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.226 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:428 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 7208960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:11.226 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276502+0000", 2024-09-12T16:16:11.227 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.9016092269999998, 2024-09-12T16:16:11.227 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013220071999999999, 2024-09-12T16:16:11.227 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.227 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.227 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:11.227 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.227 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:11.227 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:11.227 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 428 2024-09-12T16:16:11.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.227 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.227 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.227 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.228 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276502+0000", 2024-09-12T16:16:11.228 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.228 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.228 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276502+0000", 2024-09-12T16:16:11.228 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.228 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.228 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276502+0000", 2024-09-12T16:16:11.228 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.11e-07 2024-09-12T16:16:11.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276509+0000", 2024-09-12T16:16:11.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2899999999999997e-06 2024-09-12T16:16:11.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276513+0000", 2024-09-12T16:16:11.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6679999999999999e-06 2024-09-12T16:16:11.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276515+0000", 2024-09-12T16:16:11.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6620000000000001e-06 2024-09-12T16:16:11.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289632+0000", 2024-09-12T16:16:11.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013116777 2024-09-12T16:16:11.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289672+0000", 2024-09-12T16:16:11.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0086000000000002e-05 2024-09-12T16:16:11.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289722+0000", 2024-09-12T16:16:11.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9378000000000001e-05 2024-09-12T16:16:11.231 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.231 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.231 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.231 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.231 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:429 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 8257536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:11.231 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276520+0000", 2024-09-12T16:16:11.231 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.9015907890000001, 2024-09-12T16:16:11.231 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013323707000000001, 2024-09-12T16:16:11.231 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.231 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.231 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:11.232 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.232 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:11.232 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:11.232 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 429 2024-09-12T16:16:11.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.232 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.232 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276520+0000", 2024-09-12T16:16:11.232 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.232 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276520+0000", 2024-09-12T16:16:11.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.233 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.233 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276520+0000", 2024-09-12T16:16:11.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4400000000000001e-07 2024-09-12T16:16:11.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.233 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.233 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276522+0000", 2024-09-12T16:16:11.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2470000000000001e-06 2024-09-12T16:16:11.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.233 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.234 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276525+0000", 2024-09-12T16:16:11.234 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.072e-06 2024-09-12T16:16:11.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.234 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.234 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.234 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276527+0000", 2024-09-12T16:16:11.234 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4990000000000001e-06 2024-09-12T16:16:11.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.234 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.234 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.234 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289748+0000", 2024-09-12T16:16:11.234 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013220786999999999 2024-09-12T16:16:11.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.234 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.235 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.235 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289787+0000", 2024-09-12T16:16:11.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9487999999999999e-05 2024-09-12T16:16:11.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.235 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.235 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.235 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289844+0000", 2024-09-12T16:16:11.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6369999999999997e-05 2024-09-12T16:16:11.235 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.235 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.235 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.235 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.235 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:438 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 983040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:11.236 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276530+0000", 2024-09-12T16:16:11.236 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.901580531, 2024-09-12T16:16:11.236 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01344703, 2024-09-12T16:16:11.236 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.236 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.236 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:11.236 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.236 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:11.236 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:11.236 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 438 2024-09-12T16:16:11.236 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.236 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.236 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.237 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.237 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276530+0000", 2024-09-12T16:16:11.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.237 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.237 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.237 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276530+0000", 2024-09-12T16:16:11.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.237 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.237 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.237 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276531+0000", 2024-09-12T16:16:11.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2100000000000001e-07 2024-09-12T16:16:11.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.238 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.238 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276532+0000", 2024-09-12T16:16:11.238 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.031e-06 2024-09-12T16:16:11.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.238 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.238 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276535+0000", 2024-09-12T16:16:11.238 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9689999999999999e-06 2024-09-12T16:16:11.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.238 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.238 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276537+0000", 2024-09-12T16:16:11.238 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4899999999999999e-06 2024-09-12T16:16:11.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.239 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.239 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289873+0000", 2024-09-12T16:16:11.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01333559 2024-09-12T16:16:11.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.239 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.239 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289917+0000", 2024-09-12T16:16:11.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4357999999999998e-05 2024-09-12T16:16:11.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.239 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.240 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289977+0000", 2024-09-12T16:16:11.240 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0371000000000002e-05 2024-09-12T16:16:11.240 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.240 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.240 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.240 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.240 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.240 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:439 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 2031616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:11.240 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276540+0000", 2024-09-12T16:16:11.240 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.9015707690000001, 2024-09-12T16:16:11.240 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013579582, 2024-09-12T16:16:11.240 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.240 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.240 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:11.241 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.241 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:11.241 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:11.241 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 439 2024-09-12T16:16:11.241 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.241 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.241 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.241 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.241 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276540+0000", 2024-09-12T16:16:11.241 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.241 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.241 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.241 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.241 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276540+0000", 2024-09-12T16:16:11.242 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.242 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.242 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.242 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.242 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276540+0000", 2024-09-12T16:16:11.242 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0800000000000001e-07 2024-09-12T16:16:11.242 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.242 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.242 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.242 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276541+0000", 2024-09-12T16:16:11.242 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7499999999999998e-07 2024-09-12T16:16:11.242 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.242 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.243 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.243 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276544+0000", 2024-09-12T16:16:11.243 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.914e-06 2024-09-12T16:16:11.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.243 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.243 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276547+0000", 2024-09-12T16:16:11.243 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2949999999999998e-06 2024-09-12T16:16:11.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.243 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.243 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.290008+0000", 2024-09-12T16:16:11.243 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013460877 2024-09-12T16:16:11.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.244 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.244 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.290051+0000", 2024-09-12T16:16:11.244 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2202e-05 2024-09-12T16:16:11.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.244 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.244 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.244 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.290120+0000", 2024-09-12T16:16:11.244 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9110999999999996e-05 2024-09-12T16:16:11.244 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.244 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.244 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.245 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.245 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:440 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 3080192~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:11.245 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276551+0000", 2024-09-12T16:16:11.245 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.9015603130000001, 2024-09-12T16:16:11.245 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013714561, 2024-09-12T16:16:11.245 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.245 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.245 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:11.245 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.245 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:11.245 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:11.245 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 440 2024-09-12T16:16:11.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.246 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.246 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.246 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.246 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276551+0000", 2024-09-12T16:16:11.246 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.246 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.246 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.246 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.246 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276551+0000", 2024-09-12T16:16:11.246 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.246 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.246 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.246 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.247 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276551+0000", 2024-09-12T16:16:11.247 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1400000000000001e-07 2024-09-12T16:16:11.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.247 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.247 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276552+0000", 2024-09-12T16:16:11.247 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0130000000000001e-06 2024-09-12T16:16:11.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.247 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.247 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276559+0000", 2024-09-12T16:16:11.247 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0369999999999997e-06 2024-09-12T16:16:11.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.248 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.248 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.248 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276561+0000", 2024-09-12T16:16:11.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6429999999999999e-06 2024-09-12T16:16:11.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.248 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.248 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.248 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.290156+0000", 2024-09-12T16:16:11.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013594119999999999 2024-09-12T16:16:11.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.248 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.248 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.248 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.290197+0000", 2024-09-12T16:16:11.249 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1658e-05 2024-09-12T16:16:11.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.249 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.249 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.290265+0000", 2024-09-12T16:16:11.249 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7875999999999999e-05 2024-09-12T16:16:11.249 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.249 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.249 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.249 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:441 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 4128768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:11.249 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276567+0000", 2024-09-12T16:16:11.249 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.901543888, 2024-09-12T16:16:11.249 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013845537, 2024-09-12T16:16:11.249 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.250 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.250 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:11.250 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.250 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:11.250 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:11.250 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 441 2024-09-12T16:16:11.250 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.250 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.250 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.250 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.250 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276567+0000", 2024-09-12T16:16:11.250 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.250 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.251 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.251 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.251 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276567+0000", 2024-09-12T16:16:11.251 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.251 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.251 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.251 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276567+0000", 2024-09-12T16:16:11.251 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3099999999999999e-07 2024-09-12T16:16:11.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.251 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.251 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.251 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276568+0000", 2024-09-12T16:16:11.251 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.186e-06 2024-09-12T16:16:11.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.252 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276572+0000", 2024-09-12T16:16:11.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2629999999999999e-06 2024-09-12T16:16:11.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.252 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276574+0000", 2024-09-12T16:16:11.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.43e-06 2024-09-12T16:16:11.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.252 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.290296+0000", 2024-09-12T16:16:11.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013721880000000001 2024-09-12T16:16:11.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.290352+0000", 2024-09-12T16:16:11.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6305999999999999e-05 2024-09-12T16:16:11.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.290412+0000", 2024-09-12T16:16:11.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0241000000000001e-05 2024-09-12T16:16:11.253 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.253 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.253 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.254 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.254 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.254 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:442 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 5177344~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:11.254 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276578+0000", 2024-09-12T16:16:11.254 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.9015328679999999, 2024-09-12T16:16:11.254 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014027972999999999, 2024-09-12T16:16:11.254 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.254 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.254 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:11.254 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.254 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:11.254 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:11.254 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 442 2024-09-12T16:16:11.254 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.254 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.255 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.255 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276578+0000", 2024-09-12T16:16:11.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.255 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.255 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276578+0000", 2024-09-12T16:16:11.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.255 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.255 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276578+0000", 2024-09-12T16:16:11.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.22e-07 2024-09-12T16:16:11.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.256 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.256 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276579+0000", 2024-09-12T16:16:11.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0759999999999999e-06 2024-09-12T16:16:11.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.256 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.256 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276585+0000", 2024-09-12T16:16:11.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2619999999999998e-06 2024-09-12T16:16:11.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.256 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.257 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276587+0000", 2024-09-12T16:16:11.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7369999999999998e-06 2024-09-12T16:16:11.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.257 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.257 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.290446+0000", 2024-09-12T16:16:11.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013858606000000001 2024-09-12T16:16:11.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.257 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.257 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.290513+0000", 2024-09-12T16:16:11.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6939000000000004e-05 2024-09-12T16:16:11.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.258 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.290606+0000", 2024-09-12T16:16:11.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3131e-05 2024-09-12T16:16:11.258 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.258 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.258 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.258 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:443 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 6225920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:11.258 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276591+0000", 2024-09-12T16:16:11.258 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.9015202479999997, 2024-09-12T16:16:11.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014239524999999999, 2024-09-12T16:16:11.259 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.259 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.259 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:11.259 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.259 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:11.259 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:11.259 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 443 2024-09-12T16:16:11.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.259 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.259 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.259 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276591+0000", 2024-09-12T16:16:11.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.260 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.260 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276591+0000", 2024-09-12T16:16:11.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.260 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.260 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276591+0000", 2024-09-12T16:16:11.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1e-07 2024-09-12T16:16:11.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.260 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.261 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276592+0000", 2024-09-12T16:16:11.261 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.141e-06 2024-09-12T16:16:11.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.261 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.261 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276595+0000", 2024-09-12T16:16:11.261 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1839999999999999e-06 2024-09-12T16:16:11.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.261 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.261 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276598+0000", 2024-09-12T16:16:11.261 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1530000000000001e-06 2024-09-12T16:16:11.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.290648+0000", 2024-09-12T16:16:11.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014049756 2024-09-12T16:16:11.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.290751+0000", 2024-09-12T16:16:11.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000103256 2024-09-12T16:16:11.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.290830+0000", 2024-09-12T16:16:11.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8825000000000005e-05 2024-09-12T16:16:11.262 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.263 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.263 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.263 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.263 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:444 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 7274496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:11.263 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276601+0000", 2024-09-12T16:16:11.263 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.9015095190000002, 2024-09-12T16:16:11.263 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014467034, 2024-09-12T16:16:11.263 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.263 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.263 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:11.263 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.263 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:11.264 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:11.264 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 444 2024-09-12T16:16:11.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.264 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.264 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.264 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276601+0000", 2024-09-12T16:16:11.264 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.264 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.264 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276601+0000", 2024-09-12T16:16:11.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276602+0000", 2024-09-12T16:16:11.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1500000000000001e-07 2024-09-12T16:16:11.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276603+0000", 2024-09-12T16:16:11.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9199999999999999e-07 2024-09-12T16:16:11.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276606+0000", 2024-09-12T16:16:11.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.022e-06 2024-09-12T16:16:11.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276608+0000", 2024-09-12T16:16:11.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.447e-06 2024-09-12T16:16:11.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.290874+0000", 2024-09-12T16:16:11.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014265631000000001 2024-09-12T16:16:11.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.267 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.267 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.290963+0000", 2024-09-12T16:16:11.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9178000000000006e-05 2024-09-12T16:16:11.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.267 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.267 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.291068+0000", 2024-09-12T16:16:11.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000105549 2024-09-12T16:16:11.267 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.267 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.267 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.268 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.268 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:445 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 8323072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:11.268 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276613+0000", 2024-09-12T16:16:11.268 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.9014977339999999, 2024-09-12T16:16:11.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014755542, 2024-09-12T16:16:11.268 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.268 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.268 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:11.268 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.268 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:11.268 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:11.268 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 445 2024-09-12T16:16:11.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.269 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.269 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.269 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.269 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276613+0000", 2024-09-12T16:16:11.269 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.269 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.269 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.269 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276613+0000", 2024-09-12T16:16:11.269 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.269 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.270 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.270 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276613+0000", 2024-09-12T16:16:11.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.23e-07 2024-09-12T16:16:11.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.270 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.270 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276614+0000", 2024-09-12T16:16:11.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.071e-06 2024-09-12T16:16:11.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.270 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.270 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276618+0000", 2024-09-12T16:16:11.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.146e-06 2024-09-12T16:16:11.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.271 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.271 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276620+0000", 2024-09-12T16:16:11.271 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5110000000000002e-06 2024-09-12T16:16:11.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.271 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.271 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.291097+0000", 2024-09-12T16:16:11.271 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014476487 2024-09-12T16:16:11.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.271 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.271 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.291270+0000", 2024-09-12T16:16:11.272 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000173547 2024-09-12T16:16:11.272 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.272 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.272 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.272 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.291369+0000", 2024-09-12T16:16:11.272 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8556999999999998e-05 2024-09-12T16:16:11.272 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.272 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.272 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.272 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.272 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.272 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:11.274 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:16:11.274 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:11.273+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:11.374 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:11.373+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:11.384 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:11.384 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:16:11.384 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:16:11.384 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:11.393 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:16:11.473 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #3, image image_client.0-clone3 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent4 2024-09-12T16:16:11.477 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:11.476+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:11.544 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:11.544 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:16:11.544 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:16:11.545 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:16:11.545 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:11.553 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:16:11.594 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:11.593+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:11.612 INFO:teuthology.orchestra.run.smithi204.stdout:648 write 0xada1a00 thru 0xadad9bf (0xbfc0 bytes) 2024-09-12T16:16:11.614 INFO:teuthology.orchestra.run.smithi204.stdout:649 punch from 0x6755c00 to 0x6757800, (0x1c00 bytes) 2024-09-12T16:16:11.642 INFO:teuthology.orchestra.run.smithi204.stdout:650 write 0x59c9a00 thru 0x59ccb2c (0x312d bytes) 2024-09-12T16:16:11.652 INFO:teuthology.orchestra.run.smithi204.stdout:653 trunc from 0xb96a400 to 0x4184600 2024-09-12T16:16:11.677 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:11.675+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:11.694 INFO:teuthology.orchestra.run.smithi204.stdout:656 trunc from 0x4184600 to 0x7246800 2024-09-12T16:16:11.707 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:11.707 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:16:11.707 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:16:11.707 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:16:11.707 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.707 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:2262 3.16 3:6ce079da:::rbd_object_map.11557ed36bb5:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:11.707 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.817014+0000", 2024-09-12T16:16:11.708 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.8882392420000009, 2024-09-12T16:16:11.708 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.035009666000000002, 2024-09-12T16:16:11.708 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.708 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.708 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:11.708 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.708 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:11.708 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:11.708 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2262 2024-09-12T16:16:11.708 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.708 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.708 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.709 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.709 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817014+0000", 2024-09-12T16:16:11.709 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.709 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.709 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.709 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.709 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817014+0000", 2024-09-12T16:16:11.709 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.709 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.709 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.709 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.709 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817015+0000", 2024-09-12T16:16:11.709 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5999999999999999e-07 2024-09-12T16:16:11.709 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.710 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.710 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.710 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817017+0000", 2024-09-12T16:16:11.710 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8880000000000001e-06 2024-09-12T16:16:11.710 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.710 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.710 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.710 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817027+0000", 2024-09-12T16:16:11.710 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6819999999999998e-06 2024-09-12T16:16:11.710 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.710 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.710 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.710 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817033+0000", 2024-09-12T16:16:11.710 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4829999999999999e-06 2024-09-12T16:16:11.711 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.711 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.711 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.711 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.849264+0000", 2024-09-12T16:16:11.711 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.032231532 2024-09-12T16:16:11.711 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.711 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.711 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.711 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.849324+0000", 2024-09-12T16:16:11.711 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9512000000000002e-05 2024-09-12T16:16:11.711 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.711 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.711 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T16:16:11.711 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.849719+0000", 2024-09-12T16:16:11.712 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00039496799999999999 2024-09-12T16:16:11.712 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.712 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.712 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:11.712 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.851917+0000", 2024-09-12T16:16:11.712 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0021980150000000002 2024-09-12T16:16:11.712 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.712 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.712 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:11.712 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.851932+0000", 2024-09-12T16:16:11.712 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4941e-05 2024-09-12T16:16:11.712 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.712 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.713 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:11.713 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.851986+0000", 2024-09-12T16:16:11.713 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4703000000000001e-05 2024-09-12T16:16:11.713 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.713 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.713 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.713 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.852024+0000", 2024-09-12T16:16:11.713 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7481999999999998e-05 2024-09-12T16:16:11.713 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.713 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.713 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.713 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.714 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.714 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:2263 3.16 3:6ce079da:::rbd_object_map.11557ed36bb5:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:11.714 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.817049+0000", 2024-09-12T16:16:11.714 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.8882045929999993, 2024-09-12T16:16:11.714 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.035867028000000002, 2024-09-12T16:16:11.714 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.714 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.714 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:11.714 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.714 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:11.714 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:11.714 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2263 2024-09-12T16:16:11.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.715 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.715 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.715 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.715 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817049+0000", 2024-09-12T16:16:11.715 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.715 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.715 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.715 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817049+0000", 2024-09-12T16:16:11.715 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.715 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.715 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.715 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817049+0000", 2024-09-12T16:16:11.716 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5799999999999999e-07 2024-09-12T16:16:11.716 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.716 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.716 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.716 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817053+0000", 2024-09-12T16:16:11.716 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5039999999999998e-06 2024-09-12T16:16:11.716 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.716 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.716 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.716 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817072+0000", 2024-09-12T16:16:11.716 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9561000000000001e-05 2024-09-12T16:16:11.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.717 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.717 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.717 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817079+0000", 2024-09-12T16:16:11.717 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7800000000000003e-06 2024-09-12T16:16:11.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.717 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.717 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.717 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.850356+0000", 2024-09-12T16:16:11.717 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.033276528999999999 2024-09-12T16:16:11.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.717 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.717 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.717 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.850444+0000", 2024-09-12T16:16:11.718 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7947000000000003e-05 2024-09-12T16:16:11.718 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.718 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.718 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T16:16:11.718 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.850680+0000", 2024-09-12T16:16:11.718 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000236302 2024-09-12T16:16:11.718 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.718 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.718 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:11.718 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.852068+0000", 2024-09-12T16:16:11.718 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001388336 2024-09-12T16:16:11.718 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.718 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.718 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:11.718 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.852821+0000", 2024-09-12T16:16:11.719 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00075305399999999996 2024-09-12T16:16:11.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.719 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.719 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:11.719 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.852873+0000", 2024-09-12T16:16:11.719 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2000999999999999e-05 2024-09-12T16:16:11.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.719 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.719 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.719 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.852916+0000", 2024-09-12T16:16:11.719 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2456000000000001e-05 2024-09-12T16:16:11.719 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.719 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.719 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.720 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.720 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:2264 3.16 3:6ce079da:::rbd_object_map.11557ed36bb5:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:11.720 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.817089+0000", 2024-09-12T16:16:11.720 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.8881643720000003, 2024-09-12T16:16:11.720 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.036769317000000003, 2024-09-12T16:16:11.720 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.720 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.720 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:11.720 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.720 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:11.720 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:11.720 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2264 2024-09-12T16:16:11.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.721 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.721 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.721 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.721 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817089+0000", 2024-09-12T16:16:11.721 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.721 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.721 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.721 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.721 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817089+0000", 2024-09-12T16:16:11.721 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.721 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.721 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.721 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.721 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817090+0000", 2024-09-12T16:16:11.722 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8100000000000003e-07 2024-09-12T16:16:11.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.722 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.722 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.722 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817093+0000", 2024-09-12T16:16:11.722 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2849999999999999e-06 2024-09-12T16:16:11.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.722 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.722 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.722 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817099+0000", 2024-09-12T16:16:11.722 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4790000000000001e-06 2024-09-12T16:16:11.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.722 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.722 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.723 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817104+0000", 2024-09-12T16:16:11.723 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8899999999999998e-06 2024-09-12T16:16:11.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.723 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.723 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.723 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.851172+0000", 2024-09-12T16:16:11.723 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.034068076000000003 2024-09-12T16:16:11.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.723 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.723 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.723 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.851223+0000", 2024-09-12T16:16:11.723 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0640999999999998e-05 2024-09-12T16:16:11.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.724 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.724 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T16:16:11.724 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.851502+0000", 2024-09-12T16:16:11.724 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00027943500000000002 2024-09-12T16:16:11.724 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.724 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.724 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:11.724 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.853751+0000", 2024-09-12T16:16:11.724 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002248295 2024-09-12T16:16:11.724 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.724 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.724 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:11.724 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.853764+0000", 2024-09-12T16:16:11.725 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3715e-05 2024-09-12T16:16:11.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.725 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.725 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:11.725 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.853817+0000", 2024-09-12T16:16:11.725 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2235999999999999e-05 2024-09-12T16:16:11.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.725 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.725 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.725 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.853858+0000", 2024-09-12T16:16:11.725 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1684000000000003e-05 2024-09-12T16:16:11.725 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.725 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.726 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.726 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.726 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.726 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:2265 3.16 3:6ce079da:::rbd_object_map.11557ed36bb5:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:11.726 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.817112+0000", 2024-09-12T16:16:11.726 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.8881416210000008, 2024-09-12T16:16:11.726 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.037547654, 2024-09-12T16:16:11.726 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.726 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.726 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:11.726 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.726 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:11.726 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:11.726 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2265 2024-09-12T16:16:11.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.727 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.727 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817112+0000", 2024-09-12T16:16:11.727 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.727 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817112+0000", 2024-09-12T16:16:11.727 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.727 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817112+0000", 2024-09-12T16:16:11.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7300000000000001e-07 2024-09-12T16:16:11.728 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.728 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.728 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.728 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817115+0000", 2024-09-12T16:16:11.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5299999999999999e-06 2024-09-12T16:16:11.728 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.728 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.728 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.728 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817121+0000", 2024-09-12T16:16:11.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2639999999999997e-06 2024-09-12T16:16:11.728 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.728 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.728 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.728 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817126+0000", 2024-09-12T16:16:11.729 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1229999999999999e-06 2024-09-12T16:16:11.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.729 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.729 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.729 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.852113+0000", 2024-09-12T16:16:11.729 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.034987055000000003 2024-09-12T16:16:11.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.729 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.729 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.729 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.852196+0000", 2024-09-12T16:16:11.729 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2453999999999994e-05 2024-09-12T16:16:11.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.729 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.729 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T16:16:11.729 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.852422+0000", 2024-09-12T16:16:11.730 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022657100000000001 2024-09-12T16:16:11.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.730 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:11.730 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.853912+0000", 2024-09-12T16:16:11.730 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001490257 2024-09-12T16:16:11.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.730 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:11.730 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.854566+0000", 2024-09-12T16:16:11.730 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00065383699999999999 2024-09-12T16:16:11.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.731 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:11.731 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.854616+0000", 2024-09-12T16:16:11.731 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0155999999999999e-05 2024-09-12T16:16:11.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.731 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.731 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.854659+0000", 2024-09-12T16:16:11.731 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2933999999999999e-05 2024-09-12T16:16:11.731 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.731 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.731 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.732 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:2266 3.16 3:6ce079da:::rbd_object_map.11557ed36bb5:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:11.732 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.817133+0000", 2024-09-12T16:16:11.732 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.8881199980000005, 2024-09-12T16:16:11.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.038574828999999998, 2024-09-12T16:16:11.732 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.732 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.732 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:11.732 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.732 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:11.732 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:11.732 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2266 2024-09-12T16:16:11.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.732 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.733 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.733 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817133+0000", 2024-09-12T16:16:11.733 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.733 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.733 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.733 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817133+0000", 2024-09-12T16:16:11.733 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.733 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.733 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.733 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817134+0000", 2024-09-12T16:16:11.733 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4499999999999997e-07 2024-09-12T16:16:11.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.733 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.734 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.734 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817138+0000", 2024-09-12T16:16:11.734 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.087e-06 2024-09-12T16:16:11.734 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.734 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.734 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.734 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817144+0000", 2024-09-12T16:16:11.734 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.494e-06 2024-09-12T16:16:11.734 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.734 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.734 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.734 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817150+0000", 2024-09-12T16:16:11.734 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.259e-06 2024-09-12T16:16:11.735 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.735 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.735 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.735 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.852965+0000", 2024-09-12T16:16:11.735 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.035814997000000001 2024-09-12T16:16:11.735 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.735 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.735 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.735 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.853067+0000", 2024-09-12T16:16:11.735 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010289 2024-09-12T16:16:11.735 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.735 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.736 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T16:16:11.736 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.853404+0000", 2024-09-12T16:16:11.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00033614300000000001 2024-09-12T16:16:11.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.736 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.736 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:11.736 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.855588+0000", 2024-09-12T16:16:11.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002184072 2024-09-12T16:16:11.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.736 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.736 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:11.736 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.855604+0000", 2024-09-12T16:16:11.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6648999999999999e-05 2024-09-12T16:16:11.737 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.737 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.737 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:11.737 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.855663+0000", 2024-09-12T16:16:11.737 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8202000000000003e-05 2024-09-12T16:16:11.737 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.737 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.737 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.737 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.855708+0000", 2024-09-12T16:16:11.737 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5590999999999998e-05 2024-09-12T16:16:11.737 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.737 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.738 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.738 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.738 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:2267 3.16 3:6ce079da:::rbd_object_map.11557ed36bb5:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:11.738 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.817157+0000", 2024-09-12T16:16:11.738 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.8880963430000008, 2024-09-12T16:16:11.738 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.039717074999999998, 2024-09-12T16:16:11.738 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.738 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.738 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:11.739 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.739 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:11.739 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:11.739 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2267 2024-09-12T16:16:11.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.739 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817157+0000", 2024-09-12T16:16:11.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.740 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817157+0000", 2024-09-12T16:16:11.740 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.740 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.740 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.740 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817157+0000", 2024-09-12T16:16:11.740 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5400000000000002e-07 2024-09-12T16:16:11.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.740 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.740 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.740 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817160+0000", 2024-09-12T16:16:11.740 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.243e-06 2024-09-12T16:16:11.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.741 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.741 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.741 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817166+0000", 2024-09-12T16:16:11.741 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5409999999999997e-06 2024-09-12T16:16:11.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.741 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.741 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.741 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817171+0000", 2024-09-12T16:16:11.741 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8969999999999999e-06 2024-09-12T16:16:11.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.741 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.741 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.742 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.853960+0000", 2024-09-12T16:16:11.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.036788866000000003 2024-09-12T16:16:11.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.742 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.742 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.854017+0000", 2024-09-12T16:16:11.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6836000000000003e-05 2024-09-12T16:16:11.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.742 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T16:16:11.742 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.854226+0000", 2024-09-12T16:16:11.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000209225 2024-09-12T16:16:11.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:11.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.855774+0000", 2024-09-12T16:16:11.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015480520000000001 2024-09-12T16:16:11.743 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:11.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.856775+0000", 2024-09-12T16:16:11.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0010004770000000001 2024-09-12T16:16:11.743 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:11.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.856828+0000", 2024-09-12T16:16:11.744 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3604999999999999e-05 2024-09-12T16:16:11.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.744 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.744 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.856874+0000", 2024-09-12T16:16:11.744 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5878999999999999e-05 2024-09-12T16:16:11.744 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.744 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.744 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.744 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:2268 3.16 3:6ce079da:::rbd_object_map.11557ed36bb5:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:11.745 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.817178+0000", 2024-09-12T16:16:11.745 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.8880751759999992, 2024-09-12T16:16:11.745 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.041541964000000001, 2024-09-12T16:16:11.745 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.745 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.745 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:11.745 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.745 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:11.745 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:11.745 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2268 2024-09-12T16:16:11.745 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.745 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.745 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.745 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.745 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817178+0000", 2024-09-12T16:16:11.746 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.746 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.746 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.746 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817178+0000", 2024-09-12T16:16:11.746 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.746 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.746 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.746 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817179+0000", 2024-09-12T16:16:11.746 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.51e-07 2024-09-12T16:16:11.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.746 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.746 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.747 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817181+0000", 2024-09-12T16:16:11.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.351e-06 2024-09-12T16:16:11.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.747 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817187+0000", 2024-09-12T16:16:11.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.409e-06 2024-09-12T16:16:11.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.747 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817192+0000", 2024-09-12T16:16:11.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7790000000000003e-06 2024-09-12T16:16:11.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.748 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.854710+0000", 2024-09-12T16:16:11.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.037518181999999997 2024-09-12T16:16:11.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.748 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.748 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.854804+0000", 2024-09-12T16:16:11.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3448000000000004e-05 2024-09-12T16:16:11.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.748 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T16:16:11.748 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.855250+0000", 2024-09-12T16:16:11.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00044597700000000002 2024-09-12T16:16:11.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.749 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:11.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.858565+0000", 2024-09-12T16:16:11.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033147680000000001 2024-09-12T16:16:11.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.749 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.749 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:11.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.858620+0000", 2024-09-12T16:16:11.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5287000000000001e-05 2024-09-12T16:16:11.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.749 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.749 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:11.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.858677+0000", 2024-09-12T16:16:11.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7268999999999997e-05 2024-09-12T16:16:11.750 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.750 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.750 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.750 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.858720+0000", 2024-09-12T16:16:11.750 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3043000000000001e-05 2024-09-12T16:16:11.750 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.750 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.750 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.750 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.750 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.750 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:2269 3.16 3:6ce079da:::rbd_object_map.11557ed36bb5:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:11.750 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.817199+0000", 2024-09-12T16:16:11.750 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.8880543129999996, 2024-09-12T16:16:11.750 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.041689596000000002, 2024-09-12T16:16:11.750 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.751 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.751 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:11.751 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.751 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:11.751 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:11.751 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2269 2024-09-12T16:16:11.751 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.751 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.751 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.751 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.751 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817199+0000", 2024-09-12T16:16:11.751 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.751 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.752 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.752 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.752 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817199+0000", 2024-09-12T16:16:11.752 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.752 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.752 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.752 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817199+0000", 2024-09-12T16:16:11.752 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6400000000000003e-07 2024-09-12T16:16:11.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.752 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.752 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.752 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817202+0000", 2024-09-12T16:16:11.752 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7460000000000001e-06 2024-09-12T16:16:11.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.753 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.753 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.753 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817211+0000", 2024-09-12T16:16:11.753 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4840000000000004e-06 2024-09-12T16:16:11.753 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.753 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.753 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.753 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817216+0000", 2024-09-12T16:16:11.753 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.322e-06 2024-09-12T16:16:11.753 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.753 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.753 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.753 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.855839+0000", 2024-09-12T16:16:11.754 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.038622511999999998 2024-09-12T16:16:11.754 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.754 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.754 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.754 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.855924+0000", 2024-09-12T16:16:11.754 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5395999999999994e-05 2024-09-12T16:16:11.754 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.754 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.754 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T16:16:11.754 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.856337+0000", 2024-09-12T16:16:11.754 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000412951 2024-09-12T16:16:11.754 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.754 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.754 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:11.755 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.858788+0000", 2024-09-12T16:16:11.755 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0024507270000000002 2024-09-12T16:16:11.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.755 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.755 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:11.755 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.858804+0000", 2024-09-12T16:16:11.755 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6782999999999998e-05 2024-09-12T16:16:11.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.755 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.755 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:11.755 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.858852+0000", 2024-09-12T16:16:11.755 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7861000000000001e-05 2024-09-12T16:16:11.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.755 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.756 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.756 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.858889+0000", 2024-09-12T16:16:11.756 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6350000000000003e-05 2024-09-12T16:16:11.756 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.756 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.756 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.756 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.756 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.756 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:2270 3.16 3:6ce079da:::rbd_object_map.11557ed36bb5:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:11.756 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.817244+0000", 2024-09-12T16:16:11.756 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.8880096460000004, 2024-09-12T16:16:11.756 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.043778987999999998, 2024-09-12T16:16:11.756 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.756 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.756 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:11.757 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.757 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:11.757 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:11.757 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2270 2024-09-12T16:16:11.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.757 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.757 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.757 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.757 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817244+0000", 2024-09-12T16:16:11.757 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.757 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.757 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.757 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817244+0000", 2024-09-12T16:16:11.758 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.758 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.758 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.758 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817250+0000", 2024-09-12T16:16:11.758 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4320000000000004e-06 2024-09-12T16:16:11.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.758 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.758 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.758 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817254+0000", 2024-09-12T16:16:11.758 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.104e-06 2024-09-12T16:16:11.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.758 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.758 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.758 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817265+0000", 2024-09-12T16:16:11.759 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1122e-05 2024-09-12T16:16:11.759 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.759 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.759 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.759 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817271+0000", 2024-09-12T16:16:11.759 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1120000000000001e-06 2024-09-12T16:16:11.759 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.759 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.759 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.759 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.856933+0000", 2024-09-12T16:16:11.759 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.039661487000000002 2024-09-12T16:16:11.759 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.759 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.760 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.760 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.856996+0000", 2024-09-12T16:16:11.760 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2885000000000005e-05 2024-09-12T16:16:11.760 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.760 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.760 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T16:16:11.760 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.857278+0000", 2024-09-12T16:16:11.760 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028242300000000002 2024-09-12T16:16:11.760 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.760 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.760 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:11.760 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.858899+0000", 2024-09-12T16:16:11.760 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0016209449999999999 2024-09-12T16:16:11.760 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.760 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.761 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:11.761 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.860955+0000", 2024-09-12T16:16:11.761 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0020554470000000002 2024-09-12T16:16:11.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.761 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.761 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:11.761 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.860986+0000", 2024-09-12T16:16:11.761 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0908999999999998e-05 2024-09-12T16:16:11.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.761 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.761 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.761 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.861023+0000", 2024-09-12T16:16:11.761 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7122000000000001e-05 2024-09-12T16:16:11.761 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.761 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.762 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.762 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.762 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:2272 3.16 3:6ce079da:::rbd_object_map.11557ed36bb5:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:11.762 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.817288+0000", 2024-09-12T16:16:11.762 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.8879658060000004, 2024-09-12T16:16:11.762 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.043899120999999999, 2024-09-12T16:16:11.762 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.762 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.762 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:11.762 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.762 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:11.762 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:11.763 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2272 2024-09-12T16:16:11.763 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.763 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.763 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.763 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.763 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817288+0000", 2024-09-12T16:16:11.763 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.763 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.763 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.763 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.763 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817288+0000", 2024-09-12T16:16:11.763 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.764 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.764 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.764 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.764 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817288+0000", 2024-09-12T16:16:11.764 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5599999999999995e-07 2024-09-12T16:16:11.764 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.764 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.764 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.764 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817292+0000", 2024-09-12T16:16:11.764 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3540000000000002e-06 2024-09-12T16:16:11.764 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.764 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.764 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.765 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817311+0000", 2024-09-12T16:16:11.765 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8227999999999999e-05 2024-09-12T16:16:11.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.765 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.765 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.765 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817328+0000", 2024-09-12T16:16:11.765 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7731999999999999e-05 2024-09-12T16:16:11.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.765 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.765 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.765 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.857640+0000", 2024-09-12T16:16:11.765 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.040311324000000003 2024-09-12T16:16:11.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.765 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.766 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.857737+0000", 2024-09-12T16:16:11.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7565999999999994e-05 2024-09-12T16:16:11.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.766 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T16:16:11.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.858116+0000", 2024-09-12T16:16:11.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00037868299999999999 2024-09-12T16:16:11.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.766 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:11.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.860912+0000", 2024-09-12T16:16:11.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002795545 2024-09-12T16:16:11.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.767 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.767 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:11.767 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.861088+0000", 2024-09-12T16:16:11.767 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000176119 2024-09-12T16:16:11.767 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.767 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.767 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:11.767 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.861148+0000", 2024-09-12T16:16:11.767 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0186000000000003e-05 2024-09-12T16:16:11.767 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.767 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.767 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.767 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.861187+0000", 2024-09-12T16:16:11.767 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8828000000000002e-05 2024-09-12T16:16:11.767 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.767 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.768 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.768 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.768 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.768 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:2273 3.16 3:6ce079da:::rbd_object_map.11557ed36bb5:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:11.768 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.817339+0000", 2024-09-12T16:16:11.768 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.8879143910000007, 2024-09-12T16:16:11.768 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.043976157000000002, 2024-09-12T16:16:11.768 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.768 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.768 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:11.768 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.768 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:11.768 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:11.768 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2273 2024-09-12T16:16:11.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.769 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.769 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.769 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817339+0000", 2024-09-12T16:16:11.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.769 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.769 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817339+0000", 2024-09-12T16:16:11.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.769 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.770 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817340+0000", 2024-09-12T16:16:11.770 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5199999999999996e-07 2024-09-12T16:16:11.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.770 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.770 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817349+0000", 2024-09-12T16:16:11.770 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4199999999999996e-06 2024-09-12T16:16:11.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.770 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.770 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817357+0000", 2024-09-12T16:16:11.770 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9610000000000005e-06 2024-09-12T16:16:11.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.771 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.771 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817364+0000", 2024-09-12T16:16:11.771 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.922e-06 2024-09-12T16:16:11.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.771 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.771 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.771 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.858943+0000", 2024-09-12T16:16:11.771 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.041579402000000001 2024-09-12T16:16:11.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.771 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.771 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.771 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.859050+0000", 2024-09-12T16:16:11.771 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000106704 2024-09-12T16:16:11.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.771 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.771 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T16:16:11.772 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.859443+0000", 2024-09-12T16:16:11.772 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00039335299999999999 2024-09-12T16:16:11.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.772 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:11.772 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.861036+0000", 2024-09-12T16:16:11.772 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015924859999999999 2024-09-12T16:16:11.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.772 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:11.772 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.861259+0000", 2024-09-12T16:16:11.772 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022272599999999999 2024-09-12T16:16:11.773 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.773 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.773 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:11.773 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.861291+0000", 2024-09-12T16:16:11.773 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2422999999999998e-05 2024-09-12T16:16:11.773 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.773 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.773 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.773 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.861315+0000", 2024-09-12T16:16:11.773 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4108e-05 2024-09-12T16:16:11.773 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.773 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.774 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.774 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.774 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:2274 3.16 3:6ce079da:::rbd_object_map.11557ed36bb5:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:11.774 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.817389+0000", 2024-09-12T16:16:11.774 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.8878645279999997, 2024-09-12T16:16:11.774 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.046536910000000001, 2024-09-12T16:16:11.774 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.774 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.774 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:11.774 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.775 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:11.775 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:11.775 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2274 2024-09-12T16:16:11.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.775 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.775 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.775 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817389+0000", 2024-09-12T16:16:11.775 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.775 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.775 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817389+0000", 2024-09-12T16:16:11.775 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.776 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.776 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817390+0000", 2024-09-12T16:16:11.776 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6599999999999995e-07 2024-09-12T16:16:11.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.776 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.776 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817400+0000", 2024-09-12T16:16:11.776 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0443e-05 2024-09-12T16:16:11.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.776 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.777 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817410+0000", 2024-09-12T16:16:11.777 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0254999999999999e-05 2024-09-12T16:16:11.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.777 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.777 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.777 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817418+0000", 2024-09-12T16:16:11.777 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.926e-06 2024-09-12T16:16:11.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.777 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.777 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.777 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.859969+0000", 2024-09-12T16:16:11.777 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.042550771000000001 2024-09-12T16:16:11.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.778 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.778 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.860082+0000", 2024-09-12T16:16:11.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011271 2024-09-12T16:16:11.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.778 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T16:16:11.778 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.860480+0000", 2024-09-12T16:16:11.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00039875099999999998 2024-09-12T16:16:11.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.778 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:11.778 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.862341+0000", 2024-09-12T16:16:11.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001860883 2024-09-12T16:16:11.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:11.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.863869+0000", 2024-09-12T16:16:11.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001527982 2024-09-12T16:16:11.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:11.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.863900+0000", 2024-09-12T16:16:11.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0309999999999999e-05 2024-09-12T16:16:11.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.863926+0000", 2024-09-12T16:16:11.780 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6112999999999999e-05 2024-09-12T16:16:11.780 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.780 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.780 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.780 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.780 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:2275 3.16 3:6ce079da:::rbd_object_map.11557ed36bb5:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:11.780 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.817428+0000", 2024-09-12T16:16:11.780 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.8878255520000007, 2024-09-12T16:16:11.780 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.046719465000000002, 2024-09-12T16:16:11.780 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.780 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.780 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:11.780 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.781 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:11.781 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:11.781 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2275 2024-09-12T16:16:11.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.781 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.781 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.781 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.781 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817428+0000", 2024-09-12T16:16:11.781 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.781 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.781 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.781 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817428+0000", 2024-09-12T16:16:11.781 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.782 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.782 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.782 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817428+0000", 2024-09-12T16:16:11.782 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4000000000000002e-07 2024-09-12T16:16:11.782 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.782 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.782 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.782 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817431+0000", 2024-09-12T16:16:11.782 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8619999999999999e-06 2024-09-12T16:16:11.782 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.782 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.782 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.782 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817445+0000", 2024-09-12T16:16:11.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4268e-05 2024-09-12T16:16:11.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.783 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.783 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817451+0000", 2024-09-12T16:16:11.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5589999999999996e-06 2024-09-12T16:16:11.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.783 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.783 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.861367+0000", 2024-09-12T16:16:11.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.043916076999999998 2024-09-12T16:16:11.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.784 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.784 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.861450+0000", 2024-09-12T16:16:11.784 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3227999999999997e-05 2024-09-12T16:16:11.784 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.784 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.784 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T16:16:11.784 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.861853+0000", 2024-09-12T16:16:11.784 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00040318899999999998 2024-09-12T16:16:11.784 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.784 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.784 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:11.784 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.863972+0000", 2024-09-12T16:16:11.785 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0021184670000000002 2024-09-12T16:16:11.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.785 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.785 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:11.785 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.864051+0000", 2024-09-12T16:16:11.785 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8738000000000004e-05 2024-09-12T16:16:11.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.785 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.785 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:11.785 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.864103+0000", 2024-09-12T16:16:11.785 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1839999999999998e-05 2024-09-12T16:16:11.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.785 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.785 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.786 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.864147+0000", 2024-09-12T16:16:11.786 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4697000000000003e-05 2024-09-12T16:16:11.786 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.786 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.786 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.786 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.786 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:2276 3.16 3:6ce079da:::rbd_object_map.11557ed36bb5:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:11.786 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.817461+0000", 2024-09-12T16:16:11.786 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.8877920879999994, 2024-09-12T16:16:11.786 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.046788652999999999, 2024-09-12T16:16:11.786 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.786 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.786 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:11.786 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.787 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:11.787 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:11.787 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2276 2024-09-12T16:16:11.787 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.787 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.787 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.787 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.787 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817461+0000", 2024-09-12T16:16:11.787 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.787 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.787 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.787 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.787 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817461+0000", 2024-09-12T16:16:11.787 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.787 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.787 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.788 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.788 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817462+0000", 2024-09-12T16:16:11.788 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4499999999999997e-07 2024-09-12T16:16:11.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.788 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.788 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.788 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817470+0000", 2024-09-12T16:16:11.788 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3650000000000004e-06 2024-09-12T16:16:11.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.788 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.788 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.788 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817480+0000", 2024-09-12T16:16:11.788 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0325e-05 2024-09-12T16:16:11.789 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.789 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.789 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.789 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817486+0000", 2024-09-12T16:16:11.789 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7950000000000004e-06 2024-09-12T16:16:11.789 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.789 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.789 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.789 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.862379+0000", 2024-09-12T16:16:11.789 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.044892730999999998 2024-09-12T16:16:11.789 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.789 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.789 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.789 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.862477+0000", 2024-09-12T16:16:11.789 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7750000000000004e-05 2024-09-12T16:16:11.789 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.790 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.790 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T16:16:11.790 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.862824+0000", 2024-09-12T16:16:11.790 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034715800000000003 2024-09-12T16:16:11.790 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.790 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.790 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:11.790 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.864042+0000", 2024-09-12T16:16:11.790 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001217706 2024-09-12T16:16:11.790 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.790 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.790 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:11.790 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.864158+0000", 2024-09-12T16:16:11.790 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000116742 2024-09-12T16:16:11.790 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.791 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.791 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:11.791 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.864207+0000", 2024-09-12T16:16:11.791 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8834e-05 2024-09-12T16:16:11.791 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.791 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.791 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.791 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.864250+0000", 2024-09-12T16:16:11.791 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2701999999999999e-05 2024-09-12T16:16:11.791 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.791 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.791 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.791 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.791 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.791 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:2277 3.16 3:6ce079da:::rbd_object_map.11557ed36bb5:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:11.791 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.817498+0000", 2024-09-12T16:16:11.791 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.8877556440000003, 2024-09-12T16:16:11.792 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.048660503000000001, 2024-09-12T16:16:11.792 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.792 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.792 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:11.792 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.792 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:11.792 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:11.792 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2277 2024-09-12T16:16:11.792 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.792 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.792 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.792 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.792 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817498+0000", 2024-09-12T16:16:11.793 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.793 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.793 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.793 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.793 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817498+0000", 2024-09-12T16:16:11.793 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.793 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.793 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.793 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.793 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817498+0000", 2024-09-12T16:16:11.793 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9399999999999995e-07 2024-09-12T16:16:11.793 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.793 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.794 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.794 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817501+0000", 2024-09-12T16:16:11.794 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.785e-06 2024-09-12T16:16:11.794 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.794 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.794 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.794 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817510+0000", 2024-09-12T16:16:11.794 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6340000000000007e-06 2024-09-12T16:16:11.794 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.794 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.794 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.794 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817515+0000", 2024-09-12T16:16:11.794 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2290000000000002e-06 2024-09-12T16:16:11.794 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.795 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.795 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.795 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.863247+0000", 2024-09-12T16:16:11.795 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.045732228 2024-09-12T16:16:11.795 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.795 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.795 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.795 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.863299+0000", 2024-09-12T16:16:11.795 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2240000000000001e-05 2024-09-12T16:16:11.795 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.795 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.795 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T16:16:11.795 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.863600+0000", 2024-09-12T16:16:11.796 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000301052 2024-09-12T16:16:11.796 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.796 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.796 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:11.796 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.865991+0000", 2024-09-12T16:16:11.796 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0023901640000000002 2024-09-12T16:16:11.796 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.796 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.796 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:11.796 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.866051+0000", 2024-09-12T16:16:11.796 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0426e-05 2024-09-12T16:16:11.796 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.796 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.796 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:11.796 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.866116+0000", 2024-09-12T16:16:11.797 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4809999999999998e-05 2024-09-12T16:16:11.797 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.797 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.797 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.797 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.866158+0000", 2024-09-12T16:16:11.797 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2441000000000002e-05 2024-09-12T16:16:11.797 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.797 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.797 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.797 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.797 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.797 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:2278 3.16 3:6ce079da:::rbd_object_map.11557ed36bb5:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:11.797 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.817523+0000", 2024-09-12T16:16:11.798 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.8877299890000003, 2024-09-12T16:16:11.798 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.048795499999999999, 2024-09-12T16:16:11.798 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.798 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.798 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:11.798 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.798 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:11.798 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:11.798 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2278 2024-09-12T16:16:11.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.798 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.798 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.798 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.798 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817523+0000", 2024-09-12T16:16:11.799 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.799 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.799 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.799 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.799 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817523+0000", 2024-09-12T16:16:11.799 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.799 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.799 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.799 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.799 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817524+0000", 2024-09-12T16:16:11.799 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.89e-07 2024-09-12T16:16:11.799 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.799 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.800 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.800 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817527+0000", 2024-09-12T16:16:11.800 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9660000000000001e-06 2024-09-12T16:16:11.800 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.800 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.800 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.800 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817534+0000", 2024-09-12T16:16:11.800 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1740000000000003e-06 2024-09-12T16:16:11.800 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.800 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.800 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.800 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817540+0000", 2024-09-12T16:16:11.801 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8699999999999997e-06 2024-09-12T16:16:11.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.801 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.801 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.801 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.864307+0000", 2024-09-12T16:16:11.801 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.046767637000000001 2024-09-12T16:16:11.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.801 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.801 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.801 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.864366+0000", 2024-09-12T16:16:11.801 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8087999999999997e-05 2024-09-12T16:16:11.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.802 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.802 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T16:16:11.802 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.864709+0000", 2024-09-12T16:16:11.802 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034296899999999999 2024-09-12T16:16:11.802 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.802 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.802 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:11.802 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.866249+0000", 2024-09-12T16:16:11.802 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015406020000000001 2024-09-12T16:16:11.802 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.802 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.802 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:11.802 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.866262+0000", 2024-09-12T16:16:11.802 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2867000000000001e-05 2024-09-12T16:16:11.803 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.803 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.803 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:11.803 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.866295+0000", 2024-09-12T16:16:11.803 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2821000000000003e-05 2024-09-12T16:16:11.803 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.803 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.803 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.803 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.866319+0000", 2024-09-12T16:16:11.803 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4017000000000001e-05 2024-09-12T16:16:11.803 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.803 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.803 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.803 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.803 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.804 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:2279 3.16 3:6ce079da:::rbd_object_map.11557ed36bb5:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:11.804 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.817557+0000", 2024-09-12T16:16:11.804 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.8876962749999997, 2024-09-12T16:16:11.804 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.050527971999999997, 2024-09-12T16:16:11.804 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.804 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.804 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:11.804 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.804 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:11.804 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:11.804 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2279 2024-09-12T16:16:11.804 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.805 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.805 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.805 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.805 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817557+0000", 2024-09-12T16:16:11.805 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.805 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.805 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.805 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.805 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817557+0000", 2024-09-12T16:16:11.805 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.805 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.805 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.805 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.806 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817558+0000", 2024-09-12T16:16:11.806 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4899999999999995e-07 2024-09-12T16:16:11.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.806 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.806 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.806 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817561+0000", 2024-09-12T16:16:11.806 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.196e-06 2024-09-12T16:16:11.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.806 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.806 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.806 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817572+0000", 2024-09-12T16:16:11.806 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0917999999999999e-05 2024-09-12T16:16:11.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.806 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.807 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.807 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817577+0000", 2024-09-12T16:16:11.807 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6169999999999998e-06 2024-09-12T16:16:11.807 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.807 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.807 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.807 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.865210+0000", 2024-09-12T16:16:11.807 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.047632438999999999 2024-09-12T16:16:11.807 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.807 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.807 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.807 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.865321+0000", 2024-09-12T16:16:11.807 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011129 2024-09-12T16:16:11.807 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.808 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.808 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T16:16:11.808 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.865712+0000", 2024-09-12T16:16:11.808 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00039137999999999998 2024-09-12T16:16:11.808 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.808 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.808 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:11.808 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.867991+0000", 2024-09-12T16:16:11.808 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002278862 2024-09-12T16:16:11.808 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.808 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.808 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:11.808 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.868031+0000", 2024-09-12T16:16:11.809 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9662000000000001e-05 2024-09-12T16:16:11.809 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.809 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.809 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:11.809 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.868061+0000", 2024-09-12T16:16:11.809 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9978999999999999e-05 2024-09-12T16:16:11.809 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.809 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.809 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.809 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.868085+0000", 2024-09-12T16:16:11.809 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.408e-05 2024-09-12T16:16:11.809 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.809 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.809 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.810 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.810 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.810 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:2280 3.16 3:6ce079da:::rbd_object_map.11557ed36bb5:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:11.810 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.817586+0000", 2024-09-12T16:16:11.810 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.887667403, 2024-09-12T16:16:11.810 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.050698707000000003, 2024-09-12T16:16:11.810 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.810 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.810 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:11.810 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.810 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:11.810 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:11.810 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2280 2024-09-12T16:16:11.810 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.811 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.811 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.811 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.811 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817586+0000", 2024-09-12T16:16:11.811 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.811 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.811 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.811 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.811 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817586+0000", 2024-09-12T16:16:11.811 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.811 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.811 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.811 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.812 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817586+0000", 2024-09-12T16:16:11.812 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3700000000000001e-07 2024-09-12T16:16:11.812 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.812 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.812 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.812 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817589+0000", 2024-09-12T16:16:11.812 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8820000000000001e-06 2024-09-12T16:16:11.812 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.812 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.812 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.812 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817613+0000", 2024-09-12T16:16:11.812 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3762999999999999e-05 2024-09-12T16:16:11.812 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.813 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.813 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.813 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817624+0000", 2024-09-12T16:16:11.813 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1003e-05 2024-09-12T16:16:11.813 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.813 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.813 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.813 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.866357+0000", 2024-09-12T16:16:11.813 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.048732945999999999 2024-09-12T16:16:11.813 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.813 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.813 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.813 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.866423+0000", 2024-09-12T16:16:11.813 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5590000000000001e-05 2024-09-12T16:16:11.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.814 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.814 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T16:16:11.814 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.866775+0000", 2024-09-12T16:16:11.814 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00035212200000000001 2024-09-12T16:16:11.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.814 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.814 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:11.814 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.868143+0000", 2024-09-12T16:16:11.814 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0013688330000000001 2024-09-12T16:16:11.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.814 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.814 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:11.815 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.868161+0000", 2024-09-12T16:16:11.815 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.702e-05 2024-09-12T16:16:11.815 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.815 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.815 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:11.815 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.868246+0000", 2024-09-12T16:16:11.815 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5002999999999999e-05 2024-09-12T16:16:11.815 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.815 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.815 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.815 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.868285+0000", 2024-09-12T16:16:11.815 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9107999999999999e-05 2024-09-12T16:16:11.815 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.816 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.816 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.816 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.816 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.816 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:2281 3.16 3:6ce079da:::rbd_object_map.11557ed36bb5:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:11.816 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.817639+0000", 2024-09-12T16:16:11.816 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.8876141620000002, 2024-09-12T16:16:11.816 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.051363823000000003, 2024-09-12T16:16:11.816 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.816 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.816 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:11.816 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.816 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:11.816 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:11.817 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2281 2024-09-12T16:16:11.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.817 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.817 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.817 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.817 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817639+0000", 2024-09-12T16:16:11.817 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.817 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.817 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.817 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817639+0000", 2024-09-12T16:16:11.817 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.817 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.818 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.818 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817640+0000", 2024-09-12T16:16:11.818 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0400000000000005e-07 2024-09-12T16:16:11.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.818 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.818 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.818 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817645+0000", 2024-09-12T16:16:11.818 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5650000000000003e-06 2024-09-12T16:16:11.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.818 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.818 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.818 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817654+0000", 2024-09-12T16:16:11.818 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3039999999999994e-06 2024-09-12T16:16:11.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.819 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.819 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.819 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.817660+0000", 2024-09-12T16:16:11.819 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0220000000000001e-06 2024-09-12T16:16:11.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.819 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.819 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.819 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.867200+0000", 2024-09-12T16:16:11.819 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.049539908000000001 2024-09-12T16:16:11.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.819 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.819 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.819 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.867264+0000", 2024-09-12T16:16:11.819 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3801999999999997e-05 2024-09-12T16:16:11.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.820 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.820 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T16:16:11.820 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.867577+0000", 2024-09-12T16:16:11.820 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00031353700000000002 2024-09-12T16:16:11.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.820 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.820 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:11.820 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.868890+0000", 2024-09-12T16:16:11.820 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001312482 2024-09-12T16:16:11.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.820 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.820 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:11.820 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.868902+0000", 2024-09-12T16:16:11.821 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2177e-05 2024-09-12T16:16:11.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.821 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.821 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:11.821 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.868962+0000", 2024-09-12T16:16:11.821 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0056000000000002e-05 2024-09-12T16:16:11.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.821 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.821 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.821 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.869003+0000", 2024-09-12T16:16:11.821 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1165999999999999e-05 2024-09-12T16:16:11.821 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.821 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.821 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.822 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.822 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:2293 3.e 3:74ea3dd8:::rbd_data.11557ed36bb5.000000000000000c:head [read 32768~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:11.822 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.821532+0000", 2024-09-12T16:16:11.822 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.8837215530000009, 2024-09-12T16:16:11.822 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.046810866, 2024-09-12T16:16:11.822 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:11.822 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:11.822 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:11.822 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:11.822 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:11.822 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:11.822 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2293 2024-09-12T16:16:11.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.823 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:11.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.823 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:11.823 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.821532+0000", 2024-09-12T16:16:11.823 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.823 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:11.823 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.821532+0000", 2024-09-12T16:16:11.823 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:11.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.823 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:11.823 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.821533+0000", 2024-09-12T16:16:11.823 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8899999999999998e-07 2024-09-12T16:16:11.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.824 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.824 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:11.824 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.821536+0000", 2024-09-12T16:16:11.824 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8909999999999997e-06 2024-09-12T16:16:11.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.824 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.824 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:11.824 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.821547+0000", 2024-09-12T16:16:11.824 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.058e-05 2024-09-12T16:16:11.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.824 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.824 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:11.825 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.821554+0000", 2024-09-12T16:16:11.825 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7410000000000003e-06 2024-09-12T16:16:11.825 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.825 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.825 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:11.825 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.868121+0000", 2024-09-12T16:16:11.825 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.046567247999999999 2024-09-12T16:16:11.825 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.825 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.825 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:11.825 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.868235+0000", 2024-09-12T16:16:11.825 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000114164 2024-09-12T16:16:11.825 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:11.825 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:11.825 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:11.826 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.868343+0000", 2024-09-12T16:16:11.826 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000107453 2024-09-12T16:16:11.826 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.826 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.826 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.826 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:11.826 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:11.826 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:11.828 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:11.826+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:11.829 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:16:11.829 INFO:teuthology.orchestra.run.smithi204.stdout:658 write 0x8c81400 thru 0x8c85907 (0x4508 bytes) 2024-09-12T16:16:11.829 INFO:teuthology.orchestra.run.smithi204.stdout:659 write 0xd882400 thru 0xd89054c (0xe14d bytes) 2024-09-12T16:16:11.829 INFO:teuthology.orchestra.run.smithi204.stdout:661 read 0xd2fc600 thru 0xd305b80 (0x9581 bytes) 2024-09-12T16:16:11.829 INFO:teuthology.orchestra.run.smithi204.stdout:663 read 0xcade200 thru 0xcae0a19 (0x281a bytes) 2024-09-12T16:16:11.829 INFO:teuthology.orchestra.run.smithi204.stdout:667 write 0x337e00 thru 0x343b98 (0xbd99 bytes) 2024-09-12T16:16:11.829 INFO:teuthology.orchestra.run.smithi204.stdout:668 trunc from 0xd890600 to 0x2e6a400 2024-09-12T16:16:11.830 INFO:teuthology.orchestra.run.smithi204.stdout:670 write 0xaa66e00 thru 0xaa6bc69 (0x4e6a bytes) 2024-09-12T16:16:11.830 INFO:teuthology.orchestra.run.smithi204.stdout:671 write 0x9780000 thru 0x978648b (0x648c bytes) 2024-09-12T16:16:11.833 INFO:teuthology.orchestra.run.smithi204.stdout:672 write 0xe5f6a00 thru 0xe5fdcff (0x7300 bytes) 2024-09-12T16:16:11.833 INFO:teuthology.orchestra.run.smithi204.stdout:673 write 0xce67600 thru 0xce6e935 (0x7336 bytes) 2024-09-12T16:16:11.833 INFO:teuthology.orchestra.run.smithi204.stdout:674 punch from 0xa635600 to 0xa636200, (0xc00 bytes) 2024-09-12T16:16:11.837 INFO:teuthology.orchestra.run.smithi204.stdout:675 write 0x76b7e00 thru 0x76bd268 (0x5469 bytes) 2024-09-12T16:16:11.837 INFO:teuthology.orchestra.run.smithi204.stdout:676 punch from 0x66b5200 to 0x66bc600, (0x7400 bytes) 2024-09-12T16:16:11.837 INFO:teuthology.orchestra.run.smithi204.stdout:677 punch from 0x623b400 to 0x624a400, (0xf000 bytes) 2024-09-12T16:16:11.837 INFO:teuthology.orchestra.run.smithi204.stdout:678 punch from 0x7d21600 to 0x7d2b600, (0xa000 bytes) 2024-09-12T16:16:11.837 INFO:teuthology.orchestra.run.smithi204.stdout:679 write 0x1281400 thru 0x128f34e (0xdf4f bytes) 2024-09-12T16:16:11.838 INFO:teuthology.orchestra.run.smithi204.stdout:681 read 0xc22d400 thru 0xc22ed46 (0x1947 bytes) 2024-09-12T16:16:11.854 INFO:teuthology.orchestra.run.smithi204.stdout:682 trunc from 0xe5fde00 to 0x426800 2024-09-12T16:16:11.912 INFO:teuthology.orchestra.run.smithi204.stdout:685 trunc from 0x426800 to 0xa1f1000 2024-09-12T16:16:11.920 INFO:teuthology.orchestra.run.smithi204.stdout:689 read 0x72a0a00 thru 0x72aa167 (0x9768 bytes) 2024-09-12T16:16:11.928 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:16:11.927+0000 7f002d431640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32213) UID: 0 2024-09-12T16:16:11.929 INFO:teuthology.orchestra.run.smithi204.stdout:691 trunc from 0xa1f1000 to 0x4180e00 2024-09-12T16:16:11.939 INFO:teuthology.orchestra.run.smithi204.stdout:693 read 0x87bc00 thru 0x87d0af (0x14b0 bytes) 2024-09-12T16:16:11.940 INFO:teuthology.orchestra.run.smithi204.stdout:694 read 0x3df3c00 thru 0x3e0081f (0xcc20 bytes) 2024-09-12T16:16:11.947 INFO:teuthology.orchestra.run.smithi204.stdout:695 trunc from 0x4180e00 to 0x9ce7600 2024-09-12T16:16:11.952 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:11.952 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:11.952 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:16:11.952 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:11.958 INFO:teuthology.orchestra.run.smithi204.stdout:696 trunc from 0x9ce7600 to 0xbede200 2024-09-12T16:16:11.962 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:16:11.982 INFO:teuthology.orchestra.run.smithi204.stdout:697 write 0xe38fc00 thru 0xe39ae23 (0xb224 bytes) 2024-09-12T16:16:11.990 INFO:teuthology.orchestra.run.smithi204.stdout:702 write 0x91afc00 thru 0x91b5d41 (0x6142 bytes) 2024-09-12T16:16:11.990 INFO:teuthology.orchestra.run.smithi204.stdout:705 write 0x377ca00 thru 0x37826c9 (0x5cca bytes) 2024-09-12T16:16:11.990 INFO:teuthology.orchestra.run.smithi204.stdout:706 write 0x8d7f000 thru 0x8d8213e (0x313f bytes) 2024-09-12T16:16:11.990 INFO:teuthology.orchestra.run.smithi204.stdout:708 write 0xb7b2000 thru 0xb7b4c11 (0x2c12 bytes) 2024-09-12T16:16:11.990 INFO:teuthology.orchestra.run.smithi204.stdout:709 write 0x61fc000 thru 0x620a2eb (0xe2ec bytes) 2024-09-12T16:16:11.990 INFO:teuthology.orchestra.run.smithi204.stdout:711 read 0x28ce600 thru 0x28d1130 (0x2b31 bytes) 2024-09-12T16:16:11.990 INFO:teuthology.orchestra.run.smithi204.stdout:714 read 0x17d3000 thru 0x17dee77 (0xbe78 bytes) 2024-09-12T16:16:11.990 INFO:teuthology.orchestra.run.smithi204.stdout:715 read 0x6fa9600 thru 0x6fb7bb7 (0xe5b8 bytes) 2024-09-12T16:16:11.990 INFO:teuthology.orchestra.run.smithi204.stdout:717 read 0x40f4a00 thru 0x40fe768 (0x9d69 bytes) 2024-09-12T16:16:11.997 INFO:teuthology.orchestra.run.smithi204.stdout:719 trunc from 0xe39b000 to 0x81e4000 2024-09-12T16:16:12.026 INFO:teuthology.orchestra.run.smithi204.stdout:720 trunc from 0x81e4000 to 0xbe56c00 2024-09-12T16:16:12.029 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:16:12.027+0000 7f002d431640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32213) UID: 0 2024-09-12T16:16:12.041 INFO:teuthology.orchestra.run.smithi204.stdout:721 punch from 0x6504c00 to 0x6510800, (0xbc00 bytes) 2024-09-12T16:16:12.049 INFO:teuthology.orchestra.run.smithi204.stdout:722 read 0xb630800 thru 0xb6356b7 (0x4eb8 bytes) 2024-09-12T16:16:12.049 INFO:teuthology.orchestra.run.smithi204.stdout:726 trunc from 0xbe56c00 to 0xbd2c200 2024-09-12T16:16:12.062 INFO:teuthology.orchestra.run.smithi204.stdout:729 read 0x39f3c00 thru 0x39f5b94 (0x1f95 bytes) 2024-09-12T16:16:12.063 INFO:teuthology.orchestra.run.smithi204.stdout:731 read 0x22fde00 thru 0x22ff094 (0x1295 bytes) 2024-09-12T16:16:12.063 INFO:teuthology.orchestra.run.smithi204.stdout:732 read 0x7832000 thru 0x7835037 (0x3038 bytes) 2024-09-12T16:16:12.067 INFO:teuthology.orchestra.run.smithi204.stdout:735 write 0xb15d000 thru 0xb15d74e (0x74f bytes) 2024-09-12T16:16:12.067 INFO:teuthology.orchestra.run.smithi204.stdout:736 read 0x8aae800 thru 0x8ab5d39 (0x753a bytes) 2024-09-12T16:16:12.067 INFO:teuthology.orchestra.run.smithi204.stdout:738 write 0x744400 thru 0x74a714 (0x6315 bytes) 2024-09-12T16:16:12.074 INFO:teuthology.orchestra.run.smithi204.stdout:739 trunc from 0xbd2c200 to 0x1e8b800 2024-09-12T16:16:12.081 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:12.081 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:12.081 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:16:12.081 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:16:12.081 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:12.090 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:16:12.093 INFO:teuthology.orchestra.run.smithi204.stdout:740 punch from 0x166d400 to 0x167d200, (0xfe00 bytes) 2024-09-12T16:16:12.102 INFO:teuthology.orchestra.run.smithi204.stdout:742 read 0x987800 thru 0x990d30 (0x9531 bytes) 2024-09-12T16:16:12.118 INFO:teuthology.orchestra.run.smithi204.stdout:744 write 0x7b73400 thru 0x7b8077c (0xd37d bytes) 2024-09-12T16:16:12.119 INFO:teuthology.orchestra.run.smithi204.stdout:746 read 0x4b6d000 thru 0x4b6fa33 (0x2a34 bytes) 2024-09-12T16:16:12.119 INFO:teuthology.orchestra.run.smithi204.stdout:748 write 0x21e1400 thru 0x21e81ab (0x6dac bytes) 2024-09-12T16:16:12.123 INFO:teuthology.orchestra.run.smithi204.stdout:750 punch from 0x2dbae00 to 0x2dc0400, (0x5600 bytes) 2024-09-12T16:16:12.124 INFO:teuthology.orchestra.run.smithi204.stdout:754 trunc from 0x7b80800 to 0x38f1a00 2024-09-12T16:16:12.134 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:12.133+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:12.138 INFO:teuthology.orchestra.run.smithi204.stdout:755 clone 6 order 25 su 16777216 sc 9 2024-09-12T16:16:12.205 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:12.205 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:16:12.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:16:12.205 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:12.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.205 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:803 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 1957888~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:12.206 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.448374+0000", 2024-09-12T16:16:12.206 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.7553068599999992, 2024-09-12T16:16:12.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033721793999999999, 2024-09-12T16:16:12.206 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.206 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.206 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.206 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.206 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:12.206 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:12.206 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 803 2024-09-12T16:16:12.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.206 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448374+0000", 2024-09-12T16:16:12.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448374+0000", 2024-09-12T16:16:12.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448375+0000", 2024-09-12T16:16:12.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.68e-07 2024-09-12T16:16:12.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448377+0000", 2024-09-12T16:16:12.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.691e-06 2024-09-12T16:16:12.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448382+0000", 2024-09-12T16:16:12.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6180000000000003e-06 2024-09-12T16:16:12.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448387+0000", 2024-09-12T16:16:12.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8019999999999999e-06 2024-09-12T16:16:12.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.481994+0000", 2024-09-12T16:16:12.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033606893999999998 2024-09-12T16:16:12.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482038+0000", 2024-09-12T16:16:12.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3680000000000002e-05 2024-09-12T16:16:12.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482096+0000", 2024-09-12T16:16:12.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8541000000000001e-05 2024-09-12T16:16:12.210 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.210 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.210 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.210 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:804 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2064384~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:12.210 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.448393+0000", 2024-09-12T16:16:12.210 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.7552880290000008, 2024-09-12T16:16:12.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033822146999999997, 2024-09-12T16:16:12.210 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.210 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.210 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.211 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.211 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:12.211 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:12.211 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 804 2024-09-12T16:16:12.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.211 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448393+0000", 2024-09-12T16:16:12.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448393+0000", 2024-09-12T16:16:12.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448605+0000", 2024-09-12T16:16:12.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021201600000000001 2024-09-12T16:16:12.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448608+0000", 2024-09-12T16:16:12.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6299999999999998e-06 2024-09-12T16:16:12.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448615+0000", 2024-09-12T16:16:12.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6200000000000001e-06 2024-09-12T16:16:12.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448620+0000", 2024-09-12T16:16:12.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5829999999999997e-06 2024-09-12T16:16:12.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482119+0000", 2024-09-12T16:16:12.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033499292999999999 2024-09-12T16:16:12.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.214 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482161+0000", 2024-09-12T16:16:12.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1270999999999998e-05 2024-09-12T16:16:12.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.214 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482215+0000", 2024-09-12T16:16:12.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4734000000000001e-05 2024-09-12T16:16:12.214 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.214 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.214 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.215 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:805 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2170880~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:12.215 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.448628+0000", 2024-09-12T16:16:12.215 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.7550533599999998, 2024-09-12T16:16:12.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033705087000000002, 2024-09-12T16:16:12.215 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.215 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.215 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.215 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.215 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:12.215 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:12.215 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 805 2024-09-12T16:16:12.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.216 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448628+0000", 2024-09-12T16:16:12.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448628+0000", 2024-09-12T16:16:12.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448628+0000", 2024-09-12T16:16:12.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8000000000000002e-07 2024-09-12T16:16:12.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448633+0000", 2024-09-12T16:16:12.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5879999999999999e-06 2024-09-12T16:16:12.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448637+0000", 2024-09-12T16:16:12.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8369999999999999e-06 2024-09-12T16:16:12.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448640+0000", 2024-09-12T16:16:12.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.853e-06 2024-09-12T16:16:12.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482240+0000", 2024-09-12T16:16:12.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033599992000000002 2024-09-12T16:16:12.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482280+0000", 2024-09-12T16:16:12.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0048e-05 2024-09-12T16:16:12.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482333+0000", 2024-09-12T16:16:12.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3489000000000002e-05 2024-09-12T16:16:12.219 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.219 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.219 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.219 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:806 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2277376~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:12.219 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.448644+0000", 2024-09-12T16:16:12.220 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.7550378359999996, 2024-09-12T16:16:12.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033807825, 2024-09-12T16:16:12.220 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.220 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.220 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.220 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.220 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:12.220 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:12.220 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 806 2024-09-12T16:16:12.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.220 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.220 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448644+0000", 2024-09-12T16:16:12.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448644+0000", 2024-09-12T16:16:12.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448923+0000", 2024-09-12T16:16:12.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00027954 2024-09-12T16:16:12.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448927+0000", 2024-09-12T16:16:12.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0430000000000001e-06 2024-09-12T16:16:12.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448936+0000", 2024-09-12T16:16:12.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9460000000000004e-06 2024-09-12T16:16:12.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448943+0000", 2024-09-12T16:16:12.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4710000000000004e-06 2024-09-12T16:16:12.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.223 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482355+0000", 2024-09-12T16:16:12.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033412874000000002 2024-09-12T16:16:12.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.223 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482396+0000", 2024-09-12T16:16:12.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.104e-05 2024-09-12T16:16:12.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.223 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482451+0000", 2024-09-12T16:16:12.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4911000000000003e-05 2024-09-12T16:16:12.224 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.224 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.224 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.224 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:809 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2596864~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:12.224 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.448990+0000", 2024-09-12T16:16:12.224 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.7546912490000004, 2024-09-12T16:16:12.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033801342999999998, 2024-09-12T16:16:12.224 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.224 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.224 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.225 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.225 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:12.225 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:12.225 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 809 2024-09-12T16:16:12.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.225 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448990+0000", 2024-09-12T16:16:12.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448990+0000", 2024-09-12T16:16:12.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448990+0000", 2024-09-12T16:16:12.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5199999999999998e-07 2024-09-12T16:16:12.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448998+0000", 2024-09-12T16:16:12.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.17e-06 2024-09-12T16:16:12.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449002+0000", 2024-09-12T16:16:12.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0969999999999999e-06 2024-09-12T16:16:12.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449004+0000", 2024-09-12T16:16:12.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6649999999999999e-06 2024-09-12T16:16:12.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482702+0000", 2024-09-12T16:16:12.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033697908999999998 2024-09-12T16:16:12.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482740+0000", 2024-09-12T16:16:12.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7834999999999999e-05 2024-09-12T16:16:12.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482791+0000", 2024-09-12T16:16:12.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1415000000000002e-05 2024-09-12T16:16:12.228 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.228 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.228 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.229 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:810 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 49152~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:12.229 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.449008+0000", 2024-09-12T16:16:12.229 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.7546730949999993, 2024-09-12T16:16:12.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033898167, 2024-09-12T16:16:12.229 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.229 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.229 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.229 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.229 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:12.229 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:12.229 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 810 2024-09-12T16:16:12.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.230 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449008+0000", 2024-09-12T16:16:12.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449008+0000", 2024-09-12T16:16:12.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449277+0000", 2024-09-12T16:16:12.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026909600000000003 2024-09-12T16:16:12.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449280+0000", 2024-09-12T16:16:12.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.061e-06 2024-09-12T16:16:12.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449288+0000", 2024-09-12T16:16:12.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7500000000000003e-06 2024-09-12T16:16:12.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449292+0000", 2024-09-12T16:16:12.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9570000000000004e-06 2024-09-12T16:16:12.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482814+0000", 2024-09-12T16:16:12.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033522248999999997 2024-09-12T16:16:12.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482854+0000", 2024-09-12T16:16:12.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9947999999999998e-05 2024-09-12T16:16:12.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482906+0000", 2024-09-12T16:16:12.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2105999999999999e-05 2024-09-12T16:16:12.233 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.233 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.233 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.233 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:811 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 155648~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:12.233 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.449300+0000", 2024-09-12T16:16:12.233 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.7543816529999994, 2024-09-12T16:16:12.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033729174000000001, 2024-09-12T16:16:12.234 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.234 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.234 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.234 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.234 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:12.234 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:12.234 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 811 2024-09-12T16:16:12.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.234 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449300+0000", 2024-09-12T16:16:12.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449300+0000", 2024-09-12T16:16:12.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449300+0000", 2024-09-12T16:16:12.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9200000000000002e-07 2024-09-12T16:16:12.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449301+0000", 2024-09-12T16:16:12.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3009999999999999e-06 2024-09-12T16:16:12.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449306+0000", 2024-09-12T16:16:12.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4399999999999998e-06 2024-09-12T16:16:12.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449308+0000", 2024-09-12T16:16:12.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.553e-06 2024-09-12T16:16:12.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.237 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482935+0000", 2024-09-12T16:16:12.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033626243 2024-09-12T16:16:12.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.237 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482976+0000", 2024-09-12T16:16:12.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1505999999999999e-05 2024-09-12T16:16:12.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.237 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483029+0000", 2024-09-12T16:16:12.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2839e-05 2024-09-12T16:16:12.238 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.238 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.238 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.238 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:812 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 262144~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:12.238 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.449312+0000", 2024-09-12T16:16:12.238 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.7543694270000003, 2024-09-12T16:16:12.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033833931999999997, 2024-09-12T16:16:12.238 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.238 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.238 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.239 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.239 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:12.239 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:12.239 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 812 2024-09-12T16:16:12.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.239 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449312+0000", 2024-09-12T16:16:12.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449312+0000", 2024-09-12T16:16:12.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449312+0000", 2024-09-12T16:16:12.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2999999999999999e-07 2024-09-12T16:16:12.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449313+0000", 2024-09-12T16:16:12.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0690000000000001e-06 2024-09-12T16:16:12.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449316+0000", 2024-09-12T16:16:12.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.168e-06 2024-09-12T16:16:12.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449320+0000", 2024-09-12T16:16:12.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1999999999999999e-06 2024-09-12T16:16:12.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483051+0000", 2024-09-12T16:16:12.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033731864 2024-09-12T16:16:12.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483092+0000", 2024-09-12T16:16:12.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0927999999999998e-05 2024-09-12T16:16:12.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483146+0000", 2024-09-12T16:16:12.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3473000000000001e-05 2024-09-12T16:16:12.242 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.242 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.242 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.243 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:813 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 368640~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:12.243 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.449324+0000", 2024-09-12T16:16:12.243 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.7543572689999998, 2024-09-12T16:16:12.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033939061, 2024-09-12T16:16:12.243 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.243 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.243 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.243 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.243 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:12.243 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:12.243 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 813 2024-09-12T16:16:12.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.243 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.244 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449324+0000", 2024-09-12T16:16:12.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.244 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449324+0000", 2024-09-12T16:16:12.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.244 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449325+0000", 2024-09-12T16:16:12.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7100000000000001e-07 2024-09-12T16:16:12.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449326+0000", 2024-09-12T16:16:12.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6759999999999999e-06 2024-09-12T16:16:12.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449331+0000", 2024-09-12T16:16:12.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9910000000000002e-06 2024-09-12T16:16:12.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449336+0000", 2024-09-12T16:16:12.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7230000000000004e-06 2024-09-12T16:16:12.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483169+0000", 2024-09-12T16:16:12.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033832889999999997 2024-09-12T16:16:12.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483211+0000", 2024-09-12T16:16:12.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1780000000000003e-05 2024-09-12T16:16:12.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483263+0000", 2024-09-12T16:16:12.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2330000000000002e-05 2024-09-12T16:16:12.247 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.247 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.247 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.247 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:814 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 475136~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:12.247 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.449344+0000", 2024-09-12T16:16:12.247 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.7543369589999998, 2024-09-12T16:16:12.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034031447999999999, 2024-09-12T16:16:12.248 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.248 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.248 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.248 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.248 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:12.248 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:12.248 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 814 2024-09-12T16:16:12.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.248 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449344+0000", 2024-09-12T16:16:12.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449344+0000", 2024-09-12T16:16:12.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449345+0000", 2024-09-12T16:16:12.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3099999999999998e-07 2024-09-12T16:16:12.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449347+0000", 2024-09-12T16:16:12.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.872e-06 2024-09-12T16:16:12.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.250 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449352+0000", 2024-09-12T16:16:12.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7980000000000002e-06 2024-09-12T16:16:12.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.250 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449357+0000", 2024-09-12T16:16:12.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4399999999999998e-06 2024-09-12T16:16:12.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483286+0000", 2024-09-12T16:16:12.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033928697000000001 2024-09-12T16:16:12.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483325+0000", 2024-09-12T16:16:12.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8943999999999998e-05 2024-09-12T16:16:12.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483376+0000", 2024-09-12T16:16:12.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1266e-05 2024-09-12T16:16:12.252 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.252 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.252 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.252 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:815 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 581632~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:12.252 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.449363+0000", 2024-09-12T16:16:12.252 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.7543178800000003, 2024-09-12T16:16:12.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034127672999999997, 2024-09-12T16:16:12.252 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.252 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.252 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.253 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.253 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:12.253 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:12.253 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 815 2024-09-12T16:16:12.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.253 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449363+0000", 2024-09-12T16:16:12.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449363+0000", 2024-09-12T16:16:12.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449392+0000", 2024-09-12T16:16:12.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8322000000000001e-05 2024-09-12T16:16:12.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449395+0000", 2024-09-12T16:16:12.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.971e-06 2024-09-12T16:16:12.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449402+0000", 2024-09-12T16:16:12.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3089999999999998e-06 2024-09-12T16:16:12.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449408+0000", 2024-09-12T16:16:12.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7769999999999999e-06 2024-09-12T16:16:12.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483399+0000", 2024-09-12T16:16:12.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033990764999999999 2024-09-12T16:16:12.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483437+0000", 2024-09-12T16:16:12.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8182999999999997e-05 2024-09-12T16:16:12.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483491+0000", 2024-09-12T16:16:12.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4345999999999998e-05 2024-09-12T16:16:12.256 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.256 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.256 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.257 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:816 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 688128~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:12.257 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.449417+0000", 2024-09-12T16:16:12.257 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.7542646069999996, 2024-09-12T16:16:12.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034188187000000002, 2024-09-12T16:16:12.257 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.257 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.257 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.257 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.257 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:12.258 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:12.258 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 816 2024-09-12T16:16:12.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.258 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449417+0000", 2024-09-12T16:16:12.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449417+0000", 2024-09-12T16:16:12.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.453927+0000", 2024-09-12T16:16:12.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0045100280000000001 2024-09-12T16:16:12.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.453932+0000", 2024-09-12T16:16:12.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.916e-06 2024-09-12T16:16:12.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.453940+0000", 2024-09-12T16:16:12.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3720000000000005e-06 2024-09-12T16:16:12.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.453956+0000", 2024-09-12T16:16:12.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6181999999999999e-05 2024-09-12T16:16:12.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483515+0000", 2024-09-12T16:16:12.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.029558261999999998 2024-09-12T16:16:12.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483553+0000", 2024-09-12T16:16:12.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8677999999999998e-05 2024-09-12T16:16:12.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483605+0000", 2024-09-12T16:16:12.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1749000000000002e-05 2024-09-12T16:16:12.261 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.261 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.261 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.262 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:852 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 1867776~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:12.262 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.454401+0000", 2024-09-12T16:16:12.262 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.7492801349999993, 2024-09-12T16:16:12.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033782697, 2024-09-12T16:16:12.262 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.262 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.262 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.262 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.262 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:12.262 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:12.262 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 852 2024-09-12T16:16:12.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.262 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454401+0000", 2024-09-12T16:16:12.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454401+0000", 2024-09-12T16:16:12.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454402+0000", 2024-09-12T16:16:12.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.58e-07 2024-09-12T16:16:12.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454403+0000", 2024-09-12T16:16:12.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.079e-06 2024-09-12T16:16:12.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454406+0000", 2024-09-12T16:16:12.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3890000000000001e-06 2024-09-12T16:16:12.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454416+0000", 2024-09-12T16:16:12.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8719999999999997e-06 2024-09-12T16:16:12.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.487993+0000", 2024-09-12T16:16:12.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033577184000000003 2024-09-12T16:16:12.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488075+0000", 2024-09-12T16:16:12.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2169000000000006e-05 2024-09-12T16:16:12.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488184+0000", 2024-09-12T16:16:12.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108646 2024-09-12T16:16:12.266 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.266 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.266 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.266 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:853 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 1974272~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:12.266 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.454420+0000", 2024-09-12T16:16:12.266 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.7492617090000007, 2024-09-12T16:16:12.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033941592, 2024-09-12T16:16:12.266 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.267 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.267 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.267 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.267 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:12.267 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:12.267 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 853 2024-09-12T16:16:12.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.267 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454420+0000", 2024-09-12T16:16:12.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454420+0000", 2024-09-12T16:16:12.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454420+0000", 2024-09-12T16:16:12.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8799999999999998e-07 2024-09-12T16:16:12.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454428+0000", 2024-09-12T16:16:12.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0660000000000004e-06 2024-09-12T16:16:12.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454431+0000", 2024-09-12T16:16:12.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3780000000000001e-06 2024-09-12T16:16:12.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454434+0000", 2024-09-12T16:16:12.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4959999999999999e-06 2024-09-12T16:16:12.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488218+0000", 2024-09-12T16:16:12.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033783794999999998 2024-09-12T16:16:12.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488280+0000", 2024-09-12T16:16:12.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2361999999999997e-05 2024-09-12T16:16:12.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488361+0000", 2024-09-12T16:16:12.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1206999999999997e-05 2024-09-12T16:16:12.270 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.270 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.271 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.271 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:854 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2080768~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:12.271 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.454437+0000", 2024-09-12T16:16:12.271 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.7492439169999994, 2024-09-12T16:16:12.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034057872000000003, 2024-09-12T16:16:12.271 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.271 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.271 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.271 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.271 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:12.272 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:12.272 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 854 2024-09-12T16:16:12.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.272 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454437+0000", 2024-09-12T16:16:12.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454437+0000", 2024-09-12T16:16:12.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454438+0000", 2024-09-12T16:16:12.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2700000000000001e-07 2024-09-12T16:16:12.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454439+0000", 2024-09-12T16:16:12.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.029e-06 2024-09-12T16:16:12.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454442+0000", 2024-09-12T16:16:12.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8320000000000002e-06 2024-09-12T16:16:12.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454444+0000", 2024-09-12T16:16:12.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4449999999999999e-06 2024-09-12T16:16:12.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488393+0000", 2024-09-12T16:16:12.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033948878000000002 2024-09-12T16:16:12.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488434+0000", 2024-09-12T16:16:12.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1641999999999999e-05 2024-09-12T16:16:12.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488495+0000", 2024-09-12T16:16:12.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0819000000000002e-05 2024-09-12T16:16:12.276 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.276 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.276 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.276 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:855 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2187264~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:12.276 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.454447+0000", 2024-09-12T16:16:12.276 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.7492346110000003, 2024-09-12T16:16:12.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034166180999999997, 2024-09-12T16:16:12.277 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.277 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.277 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.277 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.277 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:12.277 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:12.277 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 855 2024-09-12T16:16:12.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.277 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454447+0000", 2024-09-12T16:16:12.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454447+0000", 2024-09-12T16:16:12.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454447+0000", 2024-09-12T16:16:12.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1e-07 2024-09-12T16:16:12.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454448+0000", 2024-09-12T16:16:12.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0299999999999997e-07 2024-09-12T16:16:12.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454451+0000", 2024-09-12T16:16:12.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8499999999999998e-06 2024-09-12T16:16:12.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454453+0000", 2024-09-12T16:16:12.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2520000000000002e-06 2024-09-12T16:16:12.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488520+0000", 2024-09-12T16:16:12.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034066804999999999 2024-09-12T16:16:12.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488562+0000", 2024-09-12T16:16:12.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2400000000000001e-05 2024-09-12T16:16:12.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488613+0000", 2024-09-12T16:16:12.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0760999999999997e-05 2024-09-12T16:16:12.281 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.281 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.281 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.281 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:856 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2293760~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:12.281 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.454456+0000", 2024-09-12T16:16:12.281 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.7492256049999995, 2024-09-12T16:16:12.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034275297000000003, 2024-09-12T16:16:12.281 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.281 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.282 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.282 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.282 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:12.282 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:12.282 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 856 2024-09-12T16:16:12.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.282 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454456+0000", 2024-09-12T16:16:12.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454456+0000", 2024-09-12T16:16:12.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454456+0000", 2024-09-12T16:16:12.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.11e-07 2024-09-12T16:16:12.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454457+0000", 2024-09-12T16:16:12.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6799999999999999e-07 2024-09-12T16:16:12.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454460+0000", 2024-09-12T16:16:12.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.858e-06 2024-09-12T16:16:12.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454463+0000", 2024-09-12T16:16:12.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9670000000000001e-06 2024-09-12T16:16:12.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488637+0000", 2024-09-12T16:16:12.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034174300999999997 2024-09-12T16:16:12.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488678+0000", 2024-09-12T16:16:12.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0732999999999998e-05 2024-09-12T16:16:12.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488731+0000", 2024-09-12T16:16:12.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3359000000000002e-05 2024-09-12T16:16:12.286 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.286 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.286 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.286 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:857 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2400256~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:12.286 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.454466+0000", 2024-09-12T16:16:12.286 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.7492157800000001, 2024-09-12T16:16:12.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034382506, 2024-09-12T16:16:12.286 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.286 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.286 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.287 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.287 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:12.287 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:12.287 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 857 2024-09-12T16:16:12.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.287 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454466+0000", 2024-09-12T16:16:12.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454466+0000", 2024-09-12T16:16:12.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454466+0000", 2024-09-12T16:16:12.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:16:12.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454467+0000", 2024-09-12T16:16:12.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5300000000000002e-07 2024-09-12T16:16:12.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454470+0000", 2024-09-12T16:16:12.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7970000000000001e-06 2024-09-12T16:16:12.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454472+0000", 2024-09-12T16:16:12.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3089999999999998e-06 2024-09-12T16:16:12.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488754+0000", 2024-09-12T16:16:12.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034282436999999999 2024-09-12T16:16:12.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488795+0000", 2024-09-12T16:16:12.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0880999999999997e-05 2024-09-12T16:16:12.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488848+0000", 2024-09-12T16:16:12.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2917000000000002e-05 2024-09-12T16:16:12.290 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.290 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.290 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.290 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:858 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2506752~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:12.291 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.454475+0000", 2024-09-12T16:16:12.291 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.7492065589999992, 2024-09-12T16:16:12.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034498824999999997, 2024-09-12T16:16:12.291 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.291 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.291 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.291 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.291 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:12.291 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:12.291 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 858 2024-09-12T16:16:12.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.291 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454475+0000", 2024-09-12T16:16:12.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454475+0000", 2024-09-12T16:16:12.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454475+0000", 2024-09-12T16:16:12.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2000000000000001e-07 2024-09-12T16:16:12.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454476+0000", 2024-09-12T16:16:12.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5799999999999998e-07 2024-09-12T16:16:12.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454480+0000", 2024-09-12T16:16:12.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5750000000000001e-06 2024-09-12T16:16:12.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454482+0000", 2024-09-12T16:16:12.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3300000000000001e-06 2024-09-12T16:16:12.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488870+0000", 2024-09-12T16:16:12.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034388152999999998 2024-09-12T16:16:12.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488909+0000", 2024-09-12T16:16:12.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8574e-05 2024-09-12T16:16:12.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488974+0000", 2024-09-12T16:16:12.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5015e-05 2024-09-12T16:16:12.295 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.295 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.295 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.295 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:859 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2613248~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:12.295 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.454485+0000", 2024-09-12T16:16:12.295 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.7491964689999993, 2024-09-12T16:16:12.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034601403000000003, 2024-09-12T16:16:12.295 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.295 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.295 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.296 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.296 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:12.296 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:12.296 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 859 2024-09-12T16:16:12.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.296 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454485+0000", 2024-09-12T16:16:12.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454485+0000", 2024-09-12T16:16:12.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454485+0000", 2024-09-12T16:16:12.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.35e-07 2024-09-12T16:16:12.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454486+0000", 2024-09-12T16:16:12.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7399999999999991e-07 2024-09-12T16:16:12.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454489+0000", 2024-09-12T16:16:12.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7690000000000001e-06 2024-09-12T16:16:12.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454491+0000", 2024-09-12T16:16:12.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2520000000000002e-06 2024-09-12T16:16:12.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488990+0000", 2024-09-12T16:16:12.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034499019999999998 2024-09-12T16:16:12.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.489031+0000", 2024-09-12T16:16:12.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0648000000000001e-05 2024-09-12T16:16:12.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.489086+0000", 2024-09-12T16:16:12.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5504999999999998e-05 2024-09-12T16:16:12.299 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.299 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.299 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.300 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.300 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.300 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:12.301 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:16:12.302 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:16:12.300+0000 7f002d431640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32213) UID: 0 2024-09-12T16:16:12.402 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:12.401+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:12.450 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:12.450 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:12.450 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:16:12.450 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:12.459 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:16:12.503 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:12.502+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:12.566 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:12.567 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:12.567 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:16:12.567 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:16:12.567 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:12.575 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:16:12.603 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:12.603+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:12.704 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:12.703+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:12.723 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:12.723 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:16:12.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:16:12.723 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:12.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.723 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:418 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 4980736~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:12.724 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276193+0000", 2024-09-12T16:16:12.724 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.4458194970000005, 2024-09-12T16:16:12.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010247098, 2024-09-12T16:16:12.724 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.724 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.724 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.724 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.724 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:12.724 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:12.724 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 418 2024-09-12T16:16:12.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.724 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276193+0000", 2024-09-12T16:16:12.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276193+0000", 2024-09-12T16:16:12.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276193+0000", 2024-09-12T16:16:12.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1799999999999999e-07 2024-09-12T16:16:12.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276195+0000", 2024-09-12T16:16:12.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1370000000000001e-06 2024-09-12T16:16:12.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276197+0000", 2024-09-12T16:16:12.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8550000000000002e-06 2024-09-12T16:16:12.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276200+0000", 2024-09-12T16:16:12.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5220000000000002e-06 2024-09-12T16:16:12.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.286337+0000", 2024-09-12T16:16:12.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010136776 2024-09-12T16:16:12.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.286388+0000", 2024-09-12T16:16:12.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1575e-05 2024-09-12T16:16:12.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.286440+0000", 2024-09-12T16:16:12.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2015000000000003e-05 2024-09-12T16:16:12.728 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.728 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.728 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.728 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:419 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 6029312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:12.728 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276206+0000", 2024-09-12T16:16:12.728 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.445807083, 2024-09-12T16:16:12.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010367929, 2024-09-12T16:16:12.729 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.729 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.729 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.729 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.729 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:12.729 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:12.729 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 419 2024-09-12T16:16:12.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.729 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276206+0000", 2024-09-12T16:16:12.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276206+0000", 2024-09-12T16:16:12.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276206+0000", 2024-09-12T16:16:12.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0699999999999999e-07 2024-09-12T16:16:12.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276207+0000", 2024-09-12T16:16:12.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2270000000000001e-06 2024-09-12T16:16:12.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276210+0000", 2024-09-12T16:16:12.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9950000000000001e-06 2024-09-12T16:16:12.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276212+0000", 2024-09-12T16:16:12.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4559999999999999e-06 2024-09-12T16:16:12.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.286469+0000", 2024-09-12T16:16:12.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010256149000000001 2024-09-12T16:16:12.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.286508+0000", 2024-09-12T16:16:12.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9113000000000003e-05 2024-09-12T16:16:12.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.286574+0000", 2024-09-12T16:16:12.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5782000000000001e-05 2024-09-12T16:16:12.733 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.733 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.733 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.733 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:420 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 7077888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:12.733 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276217+0000", 2024-09-12T16:16:12.733 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.4457961489999995, 2024-09-12T16:16:12.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010474682000000001, 2024-09-12T16:16:12.733 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.733 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.733 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.733 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.734 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:12.734 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:12.734 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 420 2024-09-12T16:16:12.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.734 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276217+0000", 2024-09-12T16:16:12.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276217+0000", 2024-09-12T16:16:12.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276217+0000", 2024-09-12T16:16:12.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.11e-07 2024-09-12T16:16:12.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276218+0000", 2024-09-12T16:16:12.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.08e-06 2024-09-12T16:16:12.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276223+0000", 2024-09-12T16:16:12.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4149999999999998e-06 2024-09-12T16:16:12.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276226+0000", 2024-09-12T16:16:12.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.554e-06 2024-09-12T16:16:12.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.286603+0000", 2024-09-12T16:16:12.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010376928000000001 2024-09-12T16:16:12.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.286642+0000", 2024-09-12T16:16:12.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9583999999999999e-05 2024-09-12T16:16:12.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.286691+0000", 2024-09-12T16:16:12.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8909999999999998e-05 2024-09-12T16:16:12.737 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.737 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.737 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.738 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:421 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 8126464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:12.738 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276229+0000", 2024-09-12T16:16:12.738 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.4457835350000003, 2024-09-12T16:16:12.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010582829, 2024-09-12T16:16:12.738 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.738 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.738 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.738 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.738 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:12.738 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:12.738 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 421 2024-09-12T16:16:12.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.738 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276229+0000", 2024-09-12T16:16:12.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276229+0000", 2024-09-12T16:16:12.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276229+0000", 2024-09-12T16:16:12.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0900000000000001e-07 2024-09-12T16:16:12.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276231+0000", 2024-09-12T16:16:12.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1680000000000001e-06 2024-09-12T16:16:12.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276233+0000", 2024-09-12T16:16:12.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8619999999999999e-06 2024-09-12T16:16:12.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276236+0000", 2024-09-12T16:16:12.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6199999999999999e-06 2024-09-12T16:16:12.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.286719+0000", 2024-09-12T16:16:12.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.01048295 2024-09-12T16:16:12.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.286761+0000", 2024-09-12T16:16:12.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1943999999999997e-05 2024-09-12T16:16:12.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.286812+0000", 2024-09-12T16:16:12.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1075999999999997e-05 2024-09-12T16:16:12.742 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.742 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.742 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.742 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:430 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 851968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:12.742 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276293+0000", 2024-09-12T16:16:12.742 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.4457194199999996, 2024-09-12T16:16:12.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010647286000000001, 2024-09-12T16:16:12.742 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.742 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.743 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.743 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.743 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:12.743 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:12.743 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 430 2024-09-12T16:16:12.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.743 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276293+0000", 2024-09-12T16:16:12.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276293+0000", 2024-09-12T16:16:12.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276294+0000", 2024-09-12T16:16:12.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4499999999999997e-07 2024-09-12T16:16:12.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276296+0000", 2024-09-12T16:16:12.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5620000000000002e-06 2024-09-12T16:16:12.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276303+0000", 2024-09-12T16:16:12.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6239999999999996e-06 2024-09-12T16:16:12.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276308+0000", 2024-09-12T16:16:12.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2909999999999998e-06 2024-09-12T16:16:12.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.286840+0000", 2024-09-12T16:16:12.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010531611999999999 2024-09-12T16:16:12.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.286879+0000", 2024-09-12T16:16:12.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8998999999999997e-05 2024-09-12T16:16:12.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.286941+0000", 2024-09-12T16:16:12.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1653000000000001e-05 2024-09-12T16:16:12.747 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.747 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.747 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.747 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:431 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:12.747 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276319+0000", 2024-09-12T16:16:12.747 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.4456938690000003, 2024-09-12T16:16:12.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010738599999999999, 2024-09-12T16:16:12.747 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.747 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.747 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.747 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.747 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:12.747 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:12.748 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 431 2024-09-12T16:16:12.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.748 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276319+0000", 2024-09-12T16:16:12.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276319+0000", 2024-09-12T16:16:12.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276319+0000", 2024-09-12T16:16:12.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2500000000000001e-07 2024-09-12T16:16:12.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276321+0000", 2024-09-12T16:16:12.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0209999999999998e-06 2024-09-12T16:16:12.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276325+0000", 2024-09-12T16:16:12.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8530000000000002e-06 2024-09-12T16:16:12.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276328+0000", 2024-09-12T16:16:12.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8720000000000002e-06 2024-09-12T16:16:12.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.286968+0000", 2024-09-12T16:16:12.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010640313 2024-09-12T16:16:12.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287007+0000", 2024-09-12T16:16:12.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9217000000000001e-05 2024-09-12T16:16:12.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.751 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.751 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287057+0000", 2024-09-12T16:16:12.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9999e-05 2024-09-12T16:16:12.751 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.751 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.751 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.751 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:432 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 2949120~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:12.751 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276363+0000", 2024-09-12T16:16:12.751 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.4456500070000002, 2024-09-12T16:16:12.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010810155, 2024-09-12T16:16:12.752 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.752 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.752 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.752 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.752 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:12.752 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:12.752 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 432 2024-09-12T16:16:12.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.752 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276363+0000", 2024-09-12T16:16:12.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276363+0000", 2024-09-12T16:16:12.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276363+0000", 2024-09-12T16:16:12.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2e-07 2024-09-12T16:16:12.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276365+0000", 2024-09-12T16:16:12.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2869999999999999e-06 2024-09-12T16:16:12.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276375+0000", 2024-09-12T16:16:12.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2909999999999996e-06 2024-09-12T16:16:12.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276380+0000", 2024-09-12T16:16:12.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0819999999999998e-06 2024-09-12T16:16:12.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.755 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.755 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287084+0000", 2024-09-12T16:16:12.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010704049 2024-09-12T16:16:12.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.755 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.755 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287124+0000", 2024-09-12T16:16:12.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0308000000000001e-05 2024-09-12T16:16:12.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.755 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.755 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287173+0000", 2024-09-12T16:16:12.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8717999999999997e-05 2024-09-12T16:16:12.755 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.756 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.756 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.756 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:433 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 3997696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:12.756 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276387+0000", 2024-09-12T16:16:12.756 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.4456255450000004, 2024-09-12T16:16:12.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010899934999999999, 2024-09-12T16:16:12.756 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.756 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.756 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.756 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.756 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:12.757 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:12.757 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 433 2024-09-12T16:16:12.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.757 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276387+0000", 2024-09-12T16:16:12.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276387+0000", 2024-09-12T16:16:12.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276388+0000", 2024-09-12T16:16:12.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7899999999999999e-07 2024-09-12T16:16:12.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276389+0000", 2024-09-12T16:16:12.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4190000000000001e-06 2024-09-12T16:16:12.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276392+0000", 2024-09-12T16:16:12.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4400000000000001e-06 2024-09-12T16:16:12.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.759 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.759 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276395+0000", 2024-09-12T16:16:12.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0929999999999999e-06 2024-09-12T16:16:12.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.759 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.759 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287199+0000", 2024-09-12T16:16:12.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010803557 2024-09-12T16:16:12.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.759 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.760 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287238+0000", 2024-09-12T16:16:12.760 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8958999999999997e-05 2024-09-12T16:16:12.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.760 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.760 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287287+0000", 2024-09-12T16:16:12.760 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9088000000000002e-05 2024-09-12T16:16:12.760 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.760 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.760 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.760 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:434 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 5046272~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:12.761 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276399+0000", 2024-09-12T16:16:12.761 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.4456139979999998, 2024-09-12T16:16:12.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011014375999999999, 2024-09-12T16:16:12.761 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.761 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.761 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.761 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.761 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:12.761 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:12.761 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 434 2024-09-12T16:16:12.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.761 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276399+0000", 2024-09-12T16:16:12.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276399+0000", 2024-09-12T16:16:12.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276399+0000", 2024-09-12T16:16:12.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9400000000000001e-07 2024-09-12T16:16:12.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.763 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276400+0000", 2024-09-12T16:16:12.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.156e-06 2024-09-12T16:16:12.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.763 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276403+0000", 2024-09-12T16:16:12.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.841e-06 2024-09-12T16:16:12.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.763 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276405+0000", 2024-09-12T16:16:12.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.481e-06 2024-09-12T16:16:12.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287316+0000", 2024-09-12T16:16:12.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010910087000000001 2024-09-12T16:16:12.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287355+0000", 2024-09-12T16:16:12.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8995000000000002e-05 2024-09-12T16:16:12.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287413+0000", 2024-09-12T16:16:12.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8522e-05 2024-09-12T16:16:12.765 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.765 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.765 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.765 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:435 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 6094848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:12.765 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276413+0000", 2024-09-12T16:16:12.765 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.4455994800000003, 2024-09-12T16:16:12.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011132998, 2024-09-12T16:16:12.765 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.765 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.765 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.766 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.766 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:12.766 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:12.766 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 435 2024-09-12T16:16:12.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.766 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276413+0000", 2024-09-12T16:16:12.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276413+0000", 2024-09-12T16:16:12.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276413+0000", 2024-09-12T16:16:12.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9499999999999998e-07 2024-09-12T16:16:12.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276415+0000", 2024-09-12T16:16:12.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3960000000000001e-06 2024-09-12T16:16:12.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276419+0000", 2024-09-12T16:16:12.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.963e-06 2024-09-12T16:16:12.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.768 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.768 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276421+0000", 2024-09-12T16:16:12.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6350000000000002e-06 2024-09-12T16:16:12.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.768 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.768 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287444+0000", 2024-09-12T16:16:12.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.01102299 2024-09-12T16:16:12.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287488+0000", 2024-09-12T16:16:12.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3040000000000001e-05 2024-09-12T16:16:12.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287546+0000", 2024-09-12T16:16:12.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8678999999999998e-05 2024-09-12T16:16:12.769 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.769 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.769 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.769 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:436 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 7143424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:12.769 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276426+0000", 2024-09-12T16:16:12.770 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.44558696, 2024-09-12T16:16:12.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011380603, 2024-09-12T16:16:12.770 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.770 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.770 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.770 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.770 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:12.770 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:12.770 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 436 2024-09-12T16:16:12.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.770 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.770 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.770 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276426+0000", 2024-09-12T16:16:12.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276426+0000", 2024-09-12T16:16:12.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276426+0000", 2024-09-12T16:16:12.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1400000000000001e-07 2024-09-12T16:16:12.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276427+0000", 2024-09-12T16:16:12.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1659999999999999e-06 2024-09-12T16:16:12.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.772 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.772 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276430+0000", 2024-09-12T16:16:12.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.915e-06 2024-09-12T16:16:12.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.772 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.772 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276432+0000", 2024-09-12T16:16:12.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3199999999999998e-06 2024-09-12T16:16:12.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287595+0000", 2024-09-12T16:16:12.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011163103000000001 2024-09-12T16:16:12.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287688+0000", 2024-09-12T16:16:12.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2839999999999999e-05 2024-09-12T16:16:12.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287806+0000", 2024-09-12T16:16:12.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118045 2024-09-12T16:16:12.774 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.774 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.774 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.774 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:437 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 8192000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:12.774 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276436+0000", 2024-09-12T16:16:12.774 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.4455763309999998, 2024-09-12T16:16:12.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011546832999999999, 2024-09-12T16:16:12.774 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.774 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.774 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.774 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.775 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:12.775 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:12.775 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 437 2024-09-12T16:16:12.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.775 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.775 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276436+0000", 2024-09-12T16:16:12.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.775 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276436+0000", 2024-09-12T16:16:12.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.776 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.776 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276437+0000", 2024-09-12T16:16:12.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.05e-07 2024-09-12T16:16:12.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.776 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.776 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276438+0000", 2024-09-12T16:16:12.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1689999999999999e-06 2024-09-12T16:16:12.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.776 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.777 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276441+0000", 2024-09-12T16:16:12.777 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.852e-06 2024-09-12T16:16:12.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.777 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.777 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276443+0000", 2024-09-12T16:16:12.777 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3740000000000001e-06 2024-09-12T16:16:12.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.777 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.777 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287850+0000", 2024-09-12T16:16:12.777 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011406665 2024-09-12T16:16:12.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.778 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287895+0000", 2024-09-12T16:16:12.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4994000000000003e-05 2024-09-12T16:16:12.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.778 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287983+0000", 2024-09-12T16:16:12.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8573999999999996e-05 2024-09-12T16:16:12.778 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.778 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.778 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.779 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:446 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 917504~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:12.779 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276541+0000", 2024-09-12T16:16:12.779 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.4454721389999996, 2024-09-12T16:16:12.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011604257999999999, 2024-09-12T16:16:12.779 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.779 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.779 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.779 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.779 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:12.779 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:12.779 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 446 2024-09-12T16:16:12.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.779 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.780 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.780 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276541+0000", 2024-09-12T16:16:12.780 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.780 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.780 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276541+0000", 2024-09-12T16:16:12.780 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.780 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.780 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276541+0000", 2024-09-12T16:16:12.780 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1699999999999998e-07 2024-09-12T16:16:12.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.781 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276543+0000", 2024-09-12T16:16:12.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.193e-06 2024-09-12T16:16:12.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.781 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276554+0000", 2024-09-12T16:16:12.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0379e-05 2024-09-12T16:16:12.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.781 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276559+0000", 2024-09-12T16:16:12.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5289999999999999e-06 2024-09-12T16:16:12.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.288037+0000", 2024-09-12T16:16:12.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011477533999999999 2024-09-12T16:16:12.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.288088+0000", 2024-09-12T16:16:12.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1303e-05 2024-09-12T16:16:12.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.288145+0000", 2024-09-12T16:16:12.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6802999999999998e-05 2024-09-12T16:16:12.783 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.783 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.783 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.783 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:447 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 1966080~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:12.783 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276571+0000", 2024-09-12T16:16:12.783 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.445441486, 2024-09-12T16:16:12.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011748434, 2024-09-12T16:16:12.783 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.784 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.784 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.784 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.784 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:12.784 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:12.784 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 447 2024-09-12T16:16:12.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.784 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.784 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.784 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276571+0000", 2024-09-12T16:16:12.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.785 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.785 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276571+0000", 2024-09-12T16:16:12.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.785 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.785 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276571+0000", 2024-09-12T16:16:12.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0600000000000001e-07 2024-09-12T16:16:12.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.786 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.786 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276573+0000", 2024-09-12T16:16:12.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.694e-06 2024-09-12T16:16:12.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.786 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.786 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276578+0000", 2024-09-12T16:16:12.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5340000000000001e-06 2024-09-12T16:16:12.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.786 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.786 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276582+0000", 2024-09-12T16:16:12.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7740000000000004e-06 2024-09-12T16:16:12.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.288195+0000", 2024-09-12T16:16:12.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011612496999999999 2024-09-12T16:16:12.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.288247+0000", 2024-09-12T16:16:12.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2352000000000003e-05 2024-09-12T16:16:12.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.288320+0000", 2024-09-12T16:16:12.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2276999999999999e-05 2024-09-12T16:16:12.788 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.788 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.788 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.788 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:448 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 3014656~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:12.788 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276588+0000", 2024-09-12T16:16:12.788 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.4454246980000001, 2024-09-12T16:16:12.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011932223, 2024-09-12T16:16:12.788 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.788 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.788 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.788 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.788 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:12.788 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:12.788 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 448 2024-09-12T16:16:12.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.789 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276588+0000", 2024-09-12T16:16:12.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276588+0000", 2024-09-12T16:16:12.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.790 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276588+0000", 2024-09-12T16:16:12.790 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4600000000000001e-07 2024-09-12T16:16:12.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.790 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.790 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276590+0000", 2024-09-12T16:16:12.790 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.42e-06 2024-09-12T16:16:12.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.790 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.790 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276594+0000", 2024-09-12T16:16:12.790 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5759999999999999e-06 2024-09-12T16:16:12.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276599+0000", 2024-09-12T16:16:12.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5299999999999998e-06 2024-09-12T16:16:12.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.288340+0000", 2024-09-12T16:16:12.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011741458 2024-09-12T16:16:12.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.288425+0000", 2024-09-12T16:16:12.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4349000000000002e-05 2024-09-12T16:16:12.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.792 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.792 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.288520+0000", 2024-09-12T16:16:12.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5643999999999994e-05 2024-09-12T16:16:12.792 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.792 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.792 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.792 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:449 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 4063232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:12.792 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276609+0000", 2024-09-12T16:16:12.792 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.4454034800000004, 2024-09-12T16:16:12.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012090162999999999, 2024-09-12T16:16:12.792 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.792 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.793 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.793 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.793 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:12.793 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:12.793 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 449 2024-09-12T16:16:12.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.793 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.793 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.793 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276609+0000", 2024-09-12T16:16:12.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.794 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276609+0000", 2024-09-12T16:16:12.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.794 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276610+0000", 2024-09-12T16:16:12.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6800000000000001e-07 2024-09-12T16:16:12.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.794 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276611+0000", 2024-09-12T16:16:12.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.432e-06 2024-09-12T16:16:12.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276615+0000", 2024-09-12T16:16:12.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5480000000000002e-06 2024-09-12T16:16:12.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276618+0000", 2024-09-12T16:16:12.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3809999999999999e-06 2024-09-12T16:16:12.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.288536+0000", 2024-09-12T16:16:12.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011917911999999999 2024-09-12T16:16:12.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.288603+0000", 2024-09-12T16:16:12.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7108999999999997e-05 2024-09-12T16:16:12.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.288699+0000", 2024-09-12T16:16:12.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6413e-05 2024-09-12T16:16:12.796 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.796 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.796 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.797 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:450 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 5111808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:12.797 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276626+0000", 2024-09-12T16:16:12.797 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.445386998, 2024-09-12T16:16:12.797 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012328182, 2024-09-12T16:16:12.797 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.797 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.797 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.797 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.797 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:12.797 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:12.797 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 450 2024-09-12T16:16:12.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.798 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.798 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.798 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276626+0000", 2024-09-12T16:16:12.798 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.798 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.798 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276626+0000", 2024-09-12T16:16:12.798 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.798 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276626+0000", 2024-09-12T16:16:12.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1800000000000002e-07 2024-09-12T16:16:12.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276628+0000", 2024-09-12T16:16:12.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.513e-06 2024-09-12T16:16:12.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276631+0000", 2024-09-12T16:16:12.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3249999999999999e-06 2024-09-12T16:16:12.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.800 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276633+0000", 2024-09-12T16:16:12.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6599999999999999e-06 2024-09-12T16:16:12.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.800 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.288746+0000", 2024-09-12T16:16:12.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012112497999999999 2024-09-12T16:16:12.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.288838+0000", 2024-09-12T16:16:12.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2293000000000006e-05 2024-09-12T16:16:12.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.288954+0000", 2024-09-12T16:16:12.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000115575 2024-09-12T16:16:12.801 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.801 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.801 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.802 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:451 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 6160384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:12.802 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276637+0000", 2024-09-12T16:16:12.802 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.4453754969999997, 2024-09-12T16:16:12.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012558026999999999, 2024-09-12T16:16:12.802 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.802 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.802 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.802 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.802 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:12.802 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:12.802 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 451 2024-09-12T16:16:12.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.802 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276637+0000", 2024-09-12T16:16:12.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276637+0000", 2024-09-12T16:16:12.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276637+0000", 2024-09-12T16:16:12.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1500000000000001e-07 2024-09-12T16:16:12.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276639+0000", 2024-09-12T16:16:12.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1260000000000001e-06 2024-09-12T16:16:12.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276641+0000", 2024-09-12T16:16:12.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8049999999999998e-06 2024-09-12T16:16:12.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276644+0000", 2024-09-12T16:16:12.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6800000000000002e-06 2024-09-12T16:16:12.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.805 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.288986+0000", 2024-09-12T16:16:12.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012341859 2024-09-12T16:16:12.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.805 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.289076+0000", 2024-09-12T16:16:12.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0477999999999997e-05 2024-09-12T16:16:12.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.289195+0000", 2024-09-12T16:16:12.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011886400000000001 2024-09-12T16:16:12.806 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.806 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.806 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.806 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:452 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 7208960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:12.806 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276647+0000", 2024-09-12T16:16:12.806 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.4453656669999999, 2024-09-12T16:16:12.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012777827, 2024-09-12T16:16:12.806 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.806 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.806 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.806 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.807 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:12.807 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:12.807 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 452 2024-09-12T16:16:12.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.807 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276647+0000", 2024-09-12T16:16:12.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276647+0000", 2024-09-12T16:16:12.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276647+0000", 2024-09-12T16:16:12.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0900000000000001e-07 2024-09-12T16:16:12.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276648+0000", 2024-09-12T16:16:12.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.001e-06 2024-09-12T16:16:12.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276651+0000", 2024-09-12T16:16:12.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7879999999999998e-06 2024-09-12T16:16:12.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276653+0000", 2024-09-12T16:16:12.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4109999999999999e-06 2024-09-12T16:16:12.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.289230+0000", 2024-09-12T16:16:12.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012576828 2024-09-12T16:16:12.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.810 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.289318+0000", 2024-09-12T16:16:12.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7471000000000003e-05 2024-09-12T16:16:12.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.810 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.289425+0000", 2024-09-12T16:16:12.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000107119 2024-09-12T16:16:12.810 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.810 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.810 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.810 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:453 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 8257536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:12.810 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276656+0000", 2024-09-12T16:16:12.811 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.4453562919999996, 2024-09-12T16:16:12.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012957371000000001, 2024-09-12T16:16:12.811 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:12.811 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:12.811 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:12.811 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:12.811 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:12.811 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:12.811 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 453 2024-09-12T16:16:12.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.811 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:12.811 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.811 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:12.811 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276656+0000", 2024-09-12T16:16:12.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:12.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276656+0000", 2024-09-12T16:16:12.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:12.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:12.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276657+0000", 2024-09-12T16:16:12.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0900000000000001e-07 2024-09-12T16:16:12.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:12.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276658+0000", 2024-09-12T16:16:12.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.085e-06 2024-09-12T16:16:12.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:12.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276661+0000", 2024-09-12T16:16:12.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8569999999999999e-06 2024-09-12T16:16:12.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:12.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276663+0000", 2024-09-12T16:16:12.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3520000000000001e-06 2024-09-12T16:16:12.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:12.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.289464+0000", 2024-09-12T16:16:12.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012800908 2024-09-12T16:16:12.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:12.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.289538+0000", 2024-09-12T16:16:12.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3849000000000004e-05 2024-09-12T16:16:12.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:12.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:12.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:12.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.289614+0000", 2024-09-12T16:16:12.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6111000000000004e-05 2024-09-12T16:16:12.814 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.814 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.814 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.815 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:12.815 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:12.815 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:12.816 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:16:12.817 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:16:12.815+0000 7f002d431640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32213) UID: 0 2024-09-12T16:16:12.875 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T16:16:12.916 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:12.915+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:12.967 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:12.968 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:12.968 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:16:12.968 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:12.977 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:16:13.021 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:13.020+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:13.025 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:16:13.026 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:16:13.064 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T16:16:13.090 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:13.091 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:13.091 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:16:13.091 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:16:13.091 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:13.100 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:16:13.141 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:13.140+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:13.144 INFO:teuthology.orchestra.run.smithi204.stdout:leaving image image_client.0-clone5 intact 2024-09-12T16:16:13.219 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:13.218+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:13.253 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:13.253 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:16:13.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:16:13.254 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:13.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.254 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:3893 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 409600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:13.254 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.336389+0000", 2024-09-12T16:16:13.254 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.91571742, 2024-09-12T16:16:13.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0045550920000000002, 2024-09-12T16:16:13.254 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:13.254 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:13.254 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:13.254 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:13.254 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:13.254 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:13.255 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3893 2024-09-12T16:16:13.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.255 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:13.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:13.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336389+0000", 2024-09-12T16:16:13.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:13.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336389+0000", 2024-09-12T16:16:13.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:13.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336389+0000", 2024-09-12T16:16:13.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1799999999999999e-07 2024-09-12T16:16:13.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:13.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336390+0000", 2024-09-12T16:16:13.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.082e-06 2024-09-12T16:16:13.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:13.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336393+0000", 2024-09-12T16:16:13.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9849999999999998e-06 2024-09-12T16:16:13.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:13.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336395+0000", 2024-09-12T16:16:13.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3460000000000001e-06 2024-09-12T16:16:13.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:13.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.339585+0000", 2024-09-12T16:16:13.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031895449999999998 2024-09-12T16:16:13.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:13.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340868+0000", 2024-09-12T16:16:13.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012825009999999999 2024-09-12T16:16:13.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:13.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340944+0000", 2024-09-12T16:16:13.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6415000000000006e-05 2024-09-12T16:16:13.258 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.258 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:13.258 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.258 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:3894 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 466944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:13.258 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.336399+0000", 2024-09-12T16:16:13.258 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.9157076039999996, 2024-09-12T16:16:13.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0047051489999999996, 2024-09-12T16:16:13.259 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:13.259 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:13.259 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:13.259 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:13.259 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:13.259 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:13.259 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3894 2024-09-12T16:16:13.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.259 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:13.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:13.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336399+0000", 2024-09-12T16:16:13.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:13.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336399+0000", 2024-09-12T16:16:13.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:13.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336399+0000", 2024-09-12T16:16:13.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.34e-07 2024-09-12T16:16:13.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:13.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336400+0000", 2024-09-12T16:16:13.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.029e-06 2024-09-12T16:16:13.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:13.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336403+0000", 2024-09-12T16:16:13.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.078e-06 2024-09-12T16:16:13.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:13.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336405+0000", 2024-09-12T16:16:13.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.34e-06 2024-09-12T16:16:13.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:13.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340975+0000", 2024-09-12T16:16:13.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.004569348 2024-09-12T16:16:13.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:13.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341043+0000", 2024-09-12T16:16:13.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8202999999999997e-05 2024-09-12T16:16:13.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:13.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341104+0000", 2024-09-12T16:16:13.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0917e-05 2024-09-12T16:16:13.263 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.263 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:13.263 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.263 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:3895 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 483328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:13.263 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.336409+0000", 2024-09-12T16:16:13.263 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.9156976889999999, 2024-09-12T16:16:13.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0048548549999999999, 2024-09-12T16:16:13.263 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:13.263 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:13.263 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:13.264 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:13.264 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:13.264 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:13.264 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3895 2024-09-12T16:16:13.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.264 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:13.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:13.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336409+0000", 2024-09-12T16:16:13.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:13.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336409+0000", 2024-09-12T16:16:13.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:13.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336409+0000", 2024-09-12T16:16:13.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2499999999999999e-07 2024-09-12T16:16:13.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:13.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336410+0000", 2024-09-12T16:16:13.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0139999999999999e-06 2024-09-12T16:16:13.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:13.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336413+0000", 2024-09-12T16:16:13.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.038e-06 2024-09-12T16:16:13.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:13.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336415+0000", 2024-09-12T16:16:13.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2680000000000001e-06 2024-09-12T16:16:13.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:13.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341132+0000", 2024-09-12T16:16:13.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0047171560000000001 2024-09-12T16:16:13.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:13.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341200+0000", 2024-09-12T16:16:13.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7910000000000005e-05 2024-09-12T16:16:13.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:13.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341263+0000", 2024-09-12T16:16:13.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3244000000000006e-05 2024-09-12T16:16:13.267 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.267 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:13.267 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.267 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:3896 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 499712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:13.268 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.336421+0000", 2024-09-12T16:16:13.268 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.9156855989999997, 2024-09-12T16:16:13.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0050030539999999998, 2024-09-12T16:16:13.268 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:13.268 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:13.268 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:13.268 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:13.268 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:13.268 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:13.268 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3896 2024-09-12T16:16:13.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.268 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:13.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:13.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336421+0000", 2024-09-12T16:16:13.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:13.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336421+0000", 2024-09-12T16:16:13.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:13.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336421+0000", 2024-09-12T16:16:13.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8700000000000001e-07 2024-09-12T16:16:13.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:13.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336423+0000", 2024-09-12T16:16:13.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.753e-06 2024-09-12T16:16:13.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:13.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336428+0000", 2024-09-12T16:16:13.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6149999999999996e-06 2024-09-12T16:16:13.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:13.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336433+0000", 2024-09-12T16:16:13.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5909999999999998e-06 2024-09-12T16:16:13.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:13.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341292+0000", 2024-09-12T16:16:13.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0048587470000000001 2024-09-12T16:16:13.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:13.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341358+0000", 2024-09-12T16:16:13.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6218999999999997e-05 2024-09-12T16:16:13.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:13.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341424+0000", 2024-09-12T16:16:13.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5741999999999995e-05 2024-09-12T16:16:13.272 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.272 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:13.272 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.272 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:3897 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 516096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:13.272 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.336440+0000", 2024-09-12T16:16:13.272 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.9156665449999997, 2024-09-12T16:16:13.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.005179187, 2024-09-12T16:16:13.273 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:13.273 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:13.273 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:13.273 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:13.273 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:13.273 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:13.273 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3897 2024-09-12T16:16:13.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.273 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:13.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:13.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336440+0000", 2024-09-12T16:16:13.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:13.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336440+0000", 2024-09-12T16:16:13.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:13.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336440+0000", 2024-09-12T16:16:13.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7e-07 2024-09-12T16:16:13.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:13.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336442+0000", 2024-09-12T16:16:13.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1959999999999998e-06 2024-09-12T16:16:13.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:13.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336449+0000", 2024-09-12T16:16:13.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8179999999999998e-06 2024-09-12T16:16:13.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:13.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336454+0000", 2024-09-12T16:16:13.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1760000000000001e-06 2024-09-12T16:16:13.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:13.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341482+0000", 2024-09-12T16:16:13.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0050273460000000002 2024-09-12T16:16:13.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:13.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341552+0000", 2024-09-12T16:16:13.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0297999999999997e-05 2024-09-12T16:16:13.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:13.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341619+0000", 2024-09-12T16:16:13.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6983000000000006e-05 2024-09-12T16:16:13.277 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.277 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:13.277 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.277 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4125 3.5 3:a241af90:::rbd_data.11557ed36bb5.000000000000000f:4 [read 401408~6656] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:13.277 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.337967+0000", 2024-09-12T16:16:13.277 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.9141397180000004, 2024-09-12T16:16:13.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003989467, 2024-09-12T16:16:13.277 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:13.277 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:13.277 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:13.278 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:13.278 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:13.278 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:13.278 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4125 2024-09-12T16:16:13.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.278 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:13.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:13.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337967+0000", 2024-09-12T16:16:13.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:13.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337967+0000", 2024-09-12T16:16:13.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:13.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337967+0000", 2024-09-12T16:16:13.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0900000000000002e-07 2024-09-12T16:16:13.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:13.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337975+0000", 2024-09-12T16:16:13.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6909999999999997e-06 2024-09-12T16:16:13.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:13.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337984+0000", 2024-09-12T16:16:13.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2720000000000003e-06 2024-09-12T16:16:13.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:13.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337990+0000", 2024-09-12T16:16:13.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3380000000000001e-06 2024-09-12T16:16:13.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:13.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340872+0000", 2024-09-12T16:16:13.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002882225 2024-09-12T16:16:13.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:13.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340944+0000", 2024-09-12T16:16:13.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1219999999999999e-05 2024-09-12T16:16:13.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:13.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341956+0000", 2024-09-12T16:16:13.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001012312 2024-09-12T16:16:13.281 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.281 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:13.281 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.282 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4126 3.5 3:a241af90:::rbd_data.11557ed36bb5.000000000000000f:4 [read 442368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:13.282 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.337999+0000", 2024-09-12T16:16:13.282 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.91410692, 2024-09-12T16:16:13.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0041510729999999999, 2024-09-12T16:16:13.282 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:13.282 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:13.282 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:13.282 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:13.282 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:13.282 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:13.282 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4126 2024-09-12T16:16:13.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.282 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:13.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:13.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337999+0000", 2024-09-12T16:16:13.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:13.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337999+0000", 2024-09-12T16:16:13.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:13.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338000+0000", 2024-09-12T16:16:13.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4000000000000002e-07 2024-09-12T16:16:13.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:13.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338002+0000", 2024-09-12T16:16:13.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.154e-06 2024-09-12T16:16:13.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:13.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338009+0000", 2024-09-12T16:16:13.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9059999999999996e-06 2024-09-12T16:16:13.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:13.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338014+0000", 2024-09-12T16:16:13.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7650000000000001e-06 2024-09-12T16:16:13.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:13.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342002+0000", 2024-09-12T16:16:13.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039884680000000002 2024-09-12T16:16:13.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:13.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342076+0000", 2024-09-12T16:16:13.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4023999999999995e-05 2024-09-12T16:16:13.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:13.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342150+0000", 2024-09-12T16:16:13.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4215999999999996e-05 2024-09-12T16:16:13.286 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.286 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:13.286 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.286 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4127 3.5 3:a241af90:::rbd_data.11557ed36bb5.000000000000000f:4 [read 458752~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:13.286 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.338021+0000", 2024-09-12T16:16:13.286 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.9140853240000002, 2024-09-12T16:16:13.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042934399999999999, 2024-09-12T16:16:13.286 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:13.286 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:13.287 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:13.287 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:13.287 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:13.287 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:13.287 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4127 2024-09-12T16:16:13.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.287 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:13.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:13.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338021+0000", 2024-09-12T16:16:13.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:13.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338021+0000", 2024-09-12T16:16:13.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:13.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338021+0000", 2024-09-12T16:16:13.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9800000000000004e-07 2024-09-12T16:16:13.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:13.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338024+0000", 2024-09-12T16:16:13.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2809999999999998e-06 2024-09-12T16:16:13.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:13.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338031+0000", 2024-09-12T16:16:13.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1269999999999997e-06 2024-09-12T16:16:13.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:13.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338036+0000", 2024-09-12T16:16:13.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0329999999999999e-06 2024-09-12T16:16:13.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:13.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342181+0000", 2024-09-12T16:16:13.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.004144699 2024-09-12T16:16:13.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:13.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342247+0000", 2024-09-12T16:16:13.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6149000000000007e-05 2024-09-12T16:16:13.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:13.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342314+0000", 2024-09-12T16:16:13.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7652999999999998e-05 2024-09-12T16:16:13.290 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.290 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:13.290 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.291 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4128 3.5 3:a241af90:::rbd_data.11557ed36bb5.000000000000000f:4 [read 475136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:13.291 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.338043+0000", 2024-09-12T16:16:13.291 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.914063176, 2024-09-12T16:16:13.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0044450189999999997, 2024-09-12T16:16:13.291 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:13.291 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:13.291 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:13.291 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:13.291 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:13.291 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:13.291 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4128 2024-09-12T16:16:13.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.291 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:13.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:13.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338043+0000", 2024-09-12T16:16:13.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:13.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338043+0000", 2024-09-12T16:16:13.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:13.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338044+0000", 2024-09-12T16:16:13.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2599999999999998e-07 2024-09-12T16:16:13.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:13.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338046+0000", 2024-09-12T16:16:13.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9850000000000001e-06 2024-09-12T16:16:13.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:13.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338052+0000", 2024-09-12T16:16:13.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7410000000000003e-06 2024-09-12T16:16:13.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:13.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338058+0000", 2024-09-12T16:16:13.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5729999999999998e-06 2024-09-12T16:16:13.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:13.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342343+0000", 2024-09-12T16:16:13.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042855970000000004 2024-09-12T16:16:13.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:13.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342411+0000", 2024-09-12T16:16:13.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7619000000000004e-05 2024-09-12T16:16:13.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:13.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342488+0000", 2024-09-12T16:16:13.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7077999999999996e-05 2024-09-12T16:16:13.295 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.295 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:13.295 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.295 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4129 3.5 3:a241af90:::rbd_data.11557ed36bb5.000000000000000f:4 [read 491520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:13.295 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.338065+0000", 2024-09-12T16:16:13.295 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.9140408710000001, 2024-09-12T16:16:13.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.004581819, 2024-09-12T16:16:13.295 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:13.295 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:13.295 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:13.296 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:13.296 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:13.296 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:13.296 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4129 2024-09-12T16:16:13.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.296 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:13.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:13.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338065+0000", 2024-09-12T16:16:13.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:13.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338065+0000", 2024-09-12T16:16:13.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:13.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338066+0000", 2024-09-12T16:16:13.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-07 2024-09-12T16:16:13.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:13.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338068+0000", 2024-09-12T16:16:13.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4820000000000001e-06 2024-09-12T16:16:13.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:13.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338075+0000", 2024-09-12T16:16:13.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.08e-06 2024-09-12T16:16:13.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:13.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338081+0000", 2024-09-12T16:16:13.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2939999999999996e-06 2024-09-12T16:16:13.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:13.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342515+0000", 2024-09-12T16:16:13.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0044338720000000002 2024-09-12T16:16:13.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:13.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342582+0000", 2024-09-12T16:16:13.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6962e-05 2024-09-12T16:16:13.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:13.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342647+0000", 2024-09-12T16:16:13.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5643999999999997e-05 2024-09-12T16:16:13.299 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.299 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:13.299 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.300 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4450 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 475136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:13.300 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.345047+0000", 2024-09-12T16:16:13.300 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.9070595250000002, 2024-09-12T16:16:13.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003358088, 2024-09-12T16:16:13.300 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:13.300 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:13.300 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:13.300 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:13.300 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:13.300 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:13.300 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4450 2024-09-12T16:16:13.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.300 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:13.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:13.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345047+0000", 2024-09-12T16:16:13.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:13.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345047+0000", 2024-09-12T16:16:13.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:13.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345047+0000", 2024-09-12T16:16:13.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2599999999999998e-07 2024-09-12T16:16:13.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:13.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345049+0000", 2024-09-12T16:16:13.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1040000000000001e-06 2024-09-12T16:16:13.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:13.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345056+0000", 2024-09-12T16:16:13.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6220000000000003e-06 2024-09-12T16:16:13.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:13.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345061+0000", 2024-09-12T16:16:13.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0710000000000002e-06 2024-09-12T16:16:13.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:13.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.348273+0000", 2024-09-12T16:16:13.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032119649999999998 2024-09-12T16:16:13.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:13.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.348340+0000", 2024-09-12T16:16:13.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7115999999999999e-05 2024-09-12T16:16:13.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.304 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:13.304 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.348405+0000", 2024-09-12T16:16:13.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4783999999999995e-05 2024-09-12T16:16:13.304 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.304 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:13.304 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.304 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4856 3.1e 3.e05fe63e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:13.304 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.351329+0000", 2024-09-12T16:16:13.304 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.9007770879999999, 2024-09-12T16:16:13.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032355190000000001, 2024-09-12T16:16:13.305 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:13.305 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:13.305 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:16:13.305 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:13.305 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:13.305 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:13.305 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4856 2024-09-12T16:16:13.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.305 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:13.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:13.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351329+0000", 2024-09-12T16:16:13.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:13.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351329+0000", 2024-09-12T16:16:13.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:13.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351330+0000", 2024-09-12T16:16:13.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5400000000000002e-07 2024-09-12T16:16:13.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:13.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351331+0000", 2024-09-12T16:16:13.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.81e-06 2024-09-12T16:16:13.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:13.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351337+0000", 2024-09-12T16:16:13.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7830000000000004e-06 2024-09-12T16:16:13.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:13.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351342+0000", 2024-09-12T16:16:13.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.69e-06 2024-09-12T16:16:13.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:13.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354558+0000", 2024-09-12T16:16:13.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032158500000000001 2024-09-12T16:16:13.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:13.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354565+0000", 2024-09-12T16:16:13.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0319999999999998e-06 2024-09-12T16:16:13.308 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.308 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:13.308 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.308 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4857 3.1e 3.e05fe63e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:13.308 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.351348+0000", 2024-09-12T16:16:13.309 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.9007585589999998, 2024-09-12T16:16:13.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032465969999999999, 2024-09-12T16:16:13.309 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:13.309 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:13.309 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:16:13.309 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:13.309 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:13.309 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:13.309 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4857 2024-09-12T16:16:13.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.309 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:13.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:13.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351348+0000", 2024-09-12T16:16:13.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:13.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351348+0000", 2024-09-12T16:16:13.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:13.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351348+0000", 2024-09-12T16:16:13.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3599999999999999e-07 2024-09-12T16:16:13.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:13.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351354+0000", 2024-09-12T16:16:13.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8880000000000002e-06 2024-09-12T16:16:13.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:13.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351361+0000", 2024-09-12T16:16:13.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1849999999999998e-06 2024-09-12T16:16:13.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:13.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351366+0000", 2024-09-12T16:16:13.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9740000000000001e-06 2024-09-12T16:16:13.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:13.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354588+0000", 2024-09-12T16:16:13.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032216200000000001 2024-09-12T16:16:13.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:13.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354594+0000", 2024-09-12T16:16:13.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5939999999999999e-06 2024-09-12T16:16:13.312 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.312 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:13.312 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.313 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4858 3.1e 3.e05fe63e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:13.313 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.351373+0000", 2024-09-12T16:16:13.313 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.9007336219999997, 2024-09-12T16:16:13.313 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032503800000000002, 2024-09-12T16:16:13.313 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:13.313 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:13.313 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:16:13.313 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:13.313 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:13.313 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:13.313 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4858 2024-09-12T16:16:13.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.314 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:13.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:13.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351373+0000", 2024-09-12T16:16:13.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:13.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351373+0000", 2024-09-12T16:16:13.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:13.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351373+0000", 2024-09-12T16:16:13.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5999999999999999e-07 2024-09-12T16:16:13.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:13.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351376+0000", 2024-09-12T16:16:13.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6170000000000001e-06 2024-09-12T16:16:13.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:13.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351381+0000", 2024-09-12T16:16:13.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8209999999999998e-06 2024-09-12T16:16:13.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:13.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351386+0000", 2024-09-12T16:16:13.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6190000000000002e-06 2024-09-12T16:16:13.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:13.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354616+0000", 2024-09-12T16:16:13.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032299809999999998 2024-09-12T16:16:13.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:13.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354623+0000", 2024-09-12T16:16:13.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9820000000000002e-06 2024-09-12T16:16:13.317 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.317 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:13.317 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.317 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4859 3.1e 3.e05fe63e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:13.317 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.351392+0000", 2024-09-12T16:16:13.317 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.9007143649999998, 2024-09-12T16:16:13.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003261983, 2024-09-12T16:16:13.317 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:13.317 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:13.317 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:16:13.317 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:13.318 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:13.318 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:13.318 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4859 2024-09-12T16:16:13.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.318 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:13.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:13.318 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351392+0000", 2024-09-12T16:16:13.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:13.318 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351392+0000", 2024-09-12T16:16:13.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:13.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351392+0000", 2024-09-12T16:16:13.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4999999999999998e-07 2024-09-12T16:16:13.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:13.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351394+0000", 2024-09-12T16:16:13.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.669e-06 2024-09-12T16:16:13.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:13.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351400+0000", 2024-09-12T16:16:13.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7049999999999996e-06 2024-09-12T16:16:13.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:13.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351404+0000", 2024-09-12T16:16:13.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7249999999999997e-06 2024-09-12T16:16:13.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:13.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354646+0000", 2024-09-12T16:16:13.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032411499999999999 2024-09-12T16:16:13.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.321 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:13.321 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354654+0000", 2024-09-12T16:16:13.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3839999999999997e-06 2024-09-12T16:16:13.321 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.321 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:13.321 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.321 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4859 3.1e 3:7c67fa07:::rbd_data.11557ed36bb5.000000000000001d:4 [read 516096~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:13.321 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.356681+0000", 2024-09-12T16:16:13.321 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.8954247999999998, 2024-09-12T16:16:13.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033342200000000002, 2024-09-12T16:16:13.321 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:13.321 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:13.322 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:13.322 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:13.322 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:13.322 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:13.322 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4859 2024-09-12T16:16:13.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.322 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:13.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.322 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:13.322 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.356681+0000", 2024-09-12T16:16:13.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.322 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:13.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.356681+0000", 2024-09-12T16:16:13.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:13.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.356682+0000", 2024-09-12T16:16:13.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.34e-07 2024-09-12T16:16:13.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:13.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.356689+0000", 2024-09-12T16:16:13.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3540000000000002e-06 2024-09-12T16:16:13.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:13.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.356697+0000", 2024-09-12T16:16:13.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.038e-06 2024-09-12T16:16:13.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:13.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.356703+0000", 2024-09-12T16:16:13.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7690000000000002e-06 2024-09-12T16:16:13.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:13.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.359724+0000", 2024-09-12T16:16:13.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030212529999999998 2024-09-12T16:16:13.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.325 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:13.325 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.359807+0000", 2024-09-12T16:16:13.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2956999999999999e-05 2024-09-12T16:16:13.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.325 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:13.325 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.360016+0000", 2024-09-12T16:16:13.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020841499999999999 2024-09-12T16:16:13.325 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.325 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:13.325 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.326 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:611 3.1e 3:781126e5:::rbd_data.11551fa285fd.0000000000000001:5 [sparse-read 4390912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:13.326 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.317383+0000", 2024-09-12T16:16:13.326 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.9347232329999997, 2024-09-12T16:16:13.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034147090000000001, 2024-09-12T16:16:13.326 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:13.326 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:13.326 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:13.326 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:13.326 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:13.326 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:13.326 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 611 2024-09-12T16:16:13.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.327 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:13.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:13.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317383+0000", 2024-09-12T16:16:13.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:13.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317383+0000", 2024-09-12T16:16:13.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:13.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317383+0000", 2024-09-12T16:16:13.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.03e-07 2024-09-12T16:16:13.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:13.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317384+0000", 2024-09-12T16:16:13.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.111e-06 2024-09-12T16:16:13.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:13.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317387+0000", 2024-09-12T16:16:13.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0920000000000002e-06 2024-09-12T16:16:13.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:13.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317391+0000", 2024-09-12T16:16:13.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.191e-06 2024-09-12T16:16:13.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:13.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.320634+0000", 2024-09-12T16:16:13.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032436750000000001 2024-09-12T16:16:13.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:13.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.320721+0000", 2024-09-12T16:16:13.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6682999999999997e-05 2024-09-12T16:16:13.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:13.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.320798+0000", 2024-09-12T16:16:13.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6754000000000004e-05 2024-09-12T16:16:13.330 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.330 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:13.330 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.330 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:612 3.1e 3:781126e5:::rbd_data.11551fa285fd.0000000000000001:5 [sparse-read 5439488~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:13.330 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.317394+0000", 2024-09-12T16:16:13.330 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.934712191, 2024-09-12T16:16:13.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036457799999999999, 2024-09-12T16:16:13.330 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:13.330 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:13.331 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:13.331 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:13.331 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:13.331 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:13.331 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 612 2024-09-12T16:16:13.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.331 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:13.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:13.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317394+0000", 2024-09-12T16:16:13.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:13.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317394+0000", 2024-09-12T16:16:13.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:13.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317394+0000", 2024-09-12T16:16:13.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1400000000000001e-07 2024-09-12T16:16:13.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:13.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317395+0000", 2024-09-12T16:16:13.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.569999999999999e-07 2024-09-12T16:16:13.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:13.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317398+0000", 2024-09-12T16:16:13.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1520000000000001e-06 2024-09-12T16:16:13.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:13.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317401+0000", 2024-09-12T16:16:13.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4660000000000002e-06 2024-09-12T16:16:13.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:13.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.320843+0000", 2024-09-12T16:16:13.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034421130000000001 2024-09-12T16:16:13.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:13.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.320939+0000", 2024-09-12T16:16:13.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5585e-05 2024-09-12T16:16:13.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:13.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321040+0000", 2024-09-12T16:16:13.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010129299999999999 2024-09-12T16:16:13.334 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.334 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:13.335 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.335 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:613 3.1e 3:781126e5:::rbd_data.11551fa285fd.0000000000000001:5 [sparse-read 6488064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:13.335 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.317404+0000", 2024-09-12T16:16:13.335 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.9347021919999996, 2024-09-12T16:16:13.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003785217, 2024-09-12T16:16:13.335 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:13.335 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:13.335 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:13.335 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:13.335 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:13.335 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:13.335 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 613 2024-09-12T16:16:13.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.336 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:13.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:13.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317404+0000", 2024-09-12T16:16:13.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:13.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317404+0000", 2024-09-12T16:16:13.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:13.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317404+0000", 2024-09-12T16:16:13.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2000000000000001e-07 2024-09-12T16:16:13.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:13.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317405+0000", 2024-09-12T16:16:13.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0890000000000001e-06 2024-09-12T16:16:13.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:13.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317408+0000", 2024-09-12T16:16:13.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.061e-06 2024-09-12T16:16:13.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:13.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317411+0000", 2024-09-12T16:16:13.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.52e-06 2024-09-12T16:16:13.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:13.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321069+0000", 2024-09-12T16:16:13.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036582059999999998 2024-09-12T16:16:13.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:13.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321127+0000", 2024-09-12T16:16:13.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7339000000000001e-05 2024-09-12T16:16:13.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:13.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321189+0000", 2024-09-12T16:16:13.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2781999999999996e-05 2024-09-12T16:16:13.339 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.339 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:13.339 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.339 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:614 3.1e 3:781126e5:::rbd_data.11551fa285fd.0000000000000001:5 [sparse-read 7536640~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:13.339 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.317414+0000", 2024-09-12T16:16:13.339 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.9346920169999997, 2024-09-12T16:16:13.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039935709999999996, 2024-09-12T16:16:13.340 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:13.340 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:13.340 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:13.340 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:13.340 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:13.340 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:13.340 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 614 2024-09-12T16:16:13.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.340 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:13.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:13.340 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317414+0000", 2024-09-12T16:16:13.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.341 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:13.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317414+0000", 2024-09-12T16:16:13.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:13.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.341 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:13.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317414+0000", 2024-09-12T16:16:13.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.05e-07 2024-09-12T16:16:13.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.341 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:13.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317418+0000", 2024-09-12T16:16:13.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5329999999999999e-06 2024-09-12T16:16:13.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:13.342 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317423+0000", 2024-09-12T16:16:13.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2780000000000001e-06 2024-09-12T16:16:13.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:13.342 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317428+0000", 2024-09-12T16:16:13.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.763e-06 2024-09-12T16:16:13.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:13.342 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321217+0000", 2024-09-12T16:16:13.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003788816 2024-09-12T16:16:13.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:13.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321307+0000", 2024-09-12T16:16:13.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0142999999999994e-05 2024-09-12T16:16:13.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:13.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:13.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:13.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321408+0000", 2024-09-12T16:16:13.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000100833 2024-09-12T16:16:13.343 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.343 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:13.343 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.344 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:13.344 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:13.344 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:13.345 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:16:13.345 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:16:13.346 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:16:13.346 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:16:13.347 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:16:13.347 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:16:13.347 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:16:13.347 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:16:13.348 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:16:13.348 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:16:13.348 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:16:13.348 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:13.344+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:13.445 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:13.445+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:13.448 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #4, image image_client.0-clone4 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent5 2024-09-12T16:16:13.464 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:13.465 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:13.472 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:16:13.547 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:13.546+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:13.579 INFO:teuthology.orchestra.run.smithi204.stdout:756 read 0xb1b200 thru 0xb1bdfc (0xbfd bytes) 2024-09-12T16:16:13.580 INFO:teuthology.orchestra.run.smithi204.stdout:757 read 0x852400 thru 0x85fc9b (0xd89c bytes) 2024-09-12T16:16:13.580 INFO:teuthology.orchestra.run.smithi204.stdout:762 write 0x1a62400 thru 0x1a718c5 (0xf4c6 bytes) 2024-09-12T16:16:13.581 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:13.581 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:13.582 INFO:teuthology.orchestra.run.smithi204.stdout:764 read 0x2294600 thru 0x22a2737 (0xe138 bytes) 2024-09-12T16:16:13.582 INFO:teuthology.orchestra.run.smithi204.stdout:765 read 0x11a3000 thru 0x11abff6 (0x8ff7 bytes) 2024-09-12T16:16:13.589 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:16:13.590 INFO:teuthology.orchestra.run.smithi204.stdout:766 trunc from 0x38f1a00 to 0xb744600 2024-09-12T16:16:13.608 INFO:teuthology.orchestra.run.smithi204.stdout:768 write 0xb49a000 thru 0xb4a4590 (0xa591 bytes) 2024-09-12T16:16:13.612 INFO:teuthology.orchestra.run.smithi204.stdout:771 read 0x11a8000 thru 0x11a9b57 (0x1b58 bytes) 2024-09-12T16:16:13.612 INFO:teuthology.orchestra.run.smithi204.stdout:772 write 0x122d400 thru 0x1230daa (0x39ab bytes) 2024-09-12T16:16:13.613 INFO:teuthology.orchestra.run.smithi204.stdout:777 write 0xa4a3600 thru 0xa4ac2eb (0x8cec bytes) 2024-09-12T16:16:13.626 INFO:teuthology.orchestra.run.smithi204.stdout:778 write 0xbd1c600 thru 0xbd26254 (0x9c55 bytes) 2024-09-12T16:16:13.628 INFO:teuthology.orchestra.run.smithi204.stdout:781 write 0x9a9ec00 thru 0x9aa958b (0xa98c bytes) 2024-09-12T16:16:13.628 INFO:teuthology.orchestra.run.smithi204.stdout:782 write 0x179d800 thru 0x17a466b (0x6e6c bytes) 2024-09-12T16:16:13.657 INFO:teuthology.orchestra.run.smithi204.stdout:783 write 0xd09da00 thru 0xd0ad922 (0xff23 bytes) 2024-09-12T16:16:13.659 INFO:teuthology.orchestra.run.smithi204.stdout:786 read 0x8ccd800 thru 0x8cdb85b (0xe05c bytes) 2024-09-12T16:16:13.659 INFO:teuthology.orchestra.run.smithi204.stdout:787 trunc from 0xd0ada00 to 0xd339800 2024-09-12T16:16:13.673 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:13.672+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:13.674 INFO:teuthology.orchestra.run.smithi204.stdout:789 read 0x252c400 thru 0x2530e39 (0x4a3a bytes) 2024-09-12T16:16:13.676 INFO:teuthology.orchestra.run.smithi204.stdout:790 read 0x740ca00 thru 0x741876b (0xbd6c bytes) 2024-09-12T16:16:13.676 INFO:teuthology.orchestra.run.smithi204.stdout:791 write 0x87aa800 thru 0x87b3ada (0x92db bytes) 2024-09-12T16:16:13.676 INFO:teuthology.orchestra.run.smithi204.stdout:792 write 0xb64f200 thru 0xb652284 (0x3085 bytes) 2024-09-12T16:16:13.679 INFO:teuthology.orchestra.run.smithi204.stdout:793 write 0x1018800 thru 0x1023b9b (0xb39c bytes) 2024-09-12T16:16:13.679 INFO:teuthology.orchestra.run.smithi204.stdout:797 punch from 0x79d6a00 to 0x79dc000, (0x5600 bytes) 2024-09-12T16:16:13.680 INFO:teuthology.orchestra.run.smithi204.stdout:801 punch from 0x105e800 to 0x1065800, (0x7000 bytes) 2024-09-12T16:16:13.680 INFO:teuthology.orchestra.run.smithi204.stdout:803 write 0x8778a00 thru 0x8781984 (0x8f85 bytes) 2024-09-12T16:16:13.680 INFO:teuthology.orchestra.run.smithi204.stdout:804 read 0x7c75c00 thru 0x7c7ac8f (0x5090 bytes) 2024-09-12T16:16:13.688 INFO:teuthology.orchestra.run.smithi204.stdout:805 trunc from 0xd339800 to 0x3dfe000 2024-09-12T16:16:13.719 INFO:teuthology.orchestra.run.smithi204.stdout:809 write 0x301d800 thru 0x3029338 (0xbb39 bytes) 2024-09-12T16:16:13.729 INFO:teuthology.orchestra.run.smithi204.stdout:810 read 0x32200 thru 0x40f87 (0xed88 bytes) 2024-09-12T16:16:13.729 INFO:teuthology.orchestra.run.smithi204.stdout:812 punch from 0x2948c00 to 0x2956000, (0xd400 bytes) 2024-09-12T16:16:13.730 INFO:teuthology.orchestra.run.smithi204.stdout:813 read 0x168fa00 thru 0x1696123 (0x6724 bytes) 2024-09-12T16:16:13.732 INFO:teuthology.orchestra.run.smithi204.stdout:816 trunc from 0x3dfe000 to 0x2010e00 2024-09-12T16:16:13.745 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:13.746 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:13.749 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:13.749+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:13.754 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:16:13.761 INFO:teuthology.orchestra.run.smithi204.stdout:817 write 0x6108000 thru 0x61112f3 (0x92f4 bytes) 2024-09-12T16:16:13.769 INFO:teuthology.orchestra.run.smithi204.stdout:819 trunc from 0x6111400 to 0x5719e00 2024-09-12T16:16:13.783 INFO:teuthology.orchestra.run.smithi204.stdout:823 read 0x4e24000 thru 0x4e27db2 (0x3db3 bytes) 2024-09-12T16:16:13.785 INFO:teuthology.orchestra.run.smithi204.stdout:826 read 0x1c2c200 thru 0x1c36367 (0xa168 bytes) 2024-09-12T16:16:13.793 INFO:teuthology.orchestra.run.smithi204.stdout:827 trunc from 0x5719e00 to 0x925e600 2024-09-12T16:16:13.801 INFO:teuthology.orchestra.run.smithi204.stdout:829 write 0x2fc7e00 thru 0x2fd2818 (0xaa19 bytes) 2024-09-12T16:16:13.817 INFO:teuthology.orchestra.run.smithi204.stdout:831 trunc from 0x925e600 to 0x4d8800 2024-09-12T16:16:13.838 INFO:teuthology.orchestra.run.smithi204.stdout:832 read 0x220000 thru 0x2238ef (0x38f0 bytes) 2024-09-12T16:16:13.850 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:13.850+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:13.857 INFO:teuthology.orchestra.run.smithi204.stdout:835 trunc from 0x4d8800 to 0xb904c00 2024-09-12T16:16:13.868 INFO:teuthology.orchestra.run.smithi204.stdout:837 trunc from 0xb904c00 to 0x9ea9400 2024-09-12T16:16:13.881 INFO:teuthology.orchestra.run.smithi204.stdout:838 read 0x1b71600 thru 0x1b72c2a (0x162b bytes) 2024-09-12T16:16:13.884 INFO:teuthology.orchestra.run.smithi204.stdout:842 read 0x88fa00 thru 0x891a4d (0x204e bytes) 2024-09-12T16:16:13.884 INFO:teuthology.orchestra.run.smithi204.stdout:843 write 0x891ba00 thru 0x8927e49 (0xc44a bytes) 2024-09-12T16:16:13.886 INFO:teuthology.orchestra.run.smithi204.stdout:844 punch from 0x9a96c00 to 0x9a99000, (0x2400 bytes) 2024-09-12T16:16:13.886 INFO:teuthology.orchestra.run.smithi204.stdout:845 read 0x90f8000 thru 0x91033b2 (0xb3b3 bytes) 2024-09-12T16:16:13.887 INFO:teuthology.orchestra.run.smithi204.stdout:846 punch from 0x6b05600 to 0x6b10e00, (0xb800 bytes) 2024-09-12T16:16:13.887 INFO:teuthology.orchestra.run.smithi204.stdout:848 read 0x25a5a00 thru 0x25ab518 (0x5b19 bytes) 2024-09-12T16:16:13.887 INFO:teuthology.orchestra.run.smithi204.stdout:849 write 0x98f2c00 thru 0x98f37cf (0xbd0 bytes) 2024-09-12T16:16:13.898 INFO:teuthology.orchestra.run.smithi204.stdout:851 write 0xa073400 thru 0xa07ea20 (0xb621 bytes) 2024-09-12T16:16:13.899 INFO:teuthology.orchestra.run.smithi204.stdout:852 write 0x8924800 thru 0x8928cd4 (0x44d5 bytes) 2024-09-12T16:16:13.900 INFO:teuthology.orchestra.run.smithi204.stdout:855 write 0xabce00 thru 0xabd101 (0x302 bytes) 2024-09-12T16:16:13.905 INFO:teuthology.orchestra.run.smithi204.stdout:857 trunc from 0xa07ec00 to 0xda1be00 2024-09-12T16:16:13.905 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:13.906 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:13.916 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:16:13.929 INFO:teuthology.orchestra.run.smithi204.stdout:858 trunc from 0xda1be00 to 0x7075e00 2024-09-12T16:16:13.951 INFO:teuthology.orchestra.run.smithi204.stdout:859 write 0x61af800 thru 0x61b0785 (0xf86 bytes) 2024-09-12T16:16:13.951 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:13.950+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:13.970 INFO:teuthology.orchestra.run.smithi204.stdout:862 write 0x8c93400 thru 0x8ca0906 (0xd507 bytes) 2024-09-12T16:16:13.970 INFO:teuthology.orchestra.run.smithi204.stdout:865 punch from 0x4030400 to 0x4037800, (0x7400 bytes) 2024-09-12T16:16:13.970 INFO:teuthology.orchestra.run.smithi204.stdout:866 read 0x9a3800 thru 0x9b1b2c (0xe32d bytes) 2024-09-12T16:16:13.971 INFO:teuthology.orchestra.run.smithi204.stdout:867 read 0x5b86c00 thru 0x5b8ceaa (0x62ab bytes) 2024-09-12T16:16:13.986 INFO:teuthology.orchestra.run.smithi204.stdout:869 write 0xee5c400 thru 0xee611fc (0x4dfd bytes) 2024-09-12T16:16:13.987 INFO:teuthology.orchestra.run.smithi204.stdout:870 read 0x68f6200 thru 0x6902b48 (0xc949 bytes) 2024-09-12T16:16:13.988 INFO:teuthology.orchestra.run.smithi204.stdout:871 punch from 0x72fec00 to 0x7306c00, (0x8000 bytes) 2024-09-12T16:16:14.005 INFO:teuthology.orchestra.run.smithi204.stdout:872 trunc from 0xee61200 to 0xe2f600 2024-09-12T16:16:14.029 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:14.029 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:14.038 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:16:14.041 INFO:teuthology.orchestra.run.smithi204.stdout:876 read 0xcba800 thru 0xcc19a8 (0x71a9 bytes) 2024-09-12T16:16:14.044 INFO:teuthology.orchestra.run.smithi204.stdout:877 read 0x2d2e00 thru 0x2d75c9 (0x47ca bytes) 2024-09-12T16:16:14.044 INFO:teuthology.orchestra.run.smithi204.stdout:878 read 0x461e00 thru 0x46dc02 (0xbe03 bytes) 2024-09-12T16:16:14.045 INFO:teuthology.orchestra.run.smithi204.stdout:879 read 0x81ce00 thru 0x81d8eb (0xaec bytes) 2024-09-12T16:16:14.053 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:14.052+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:14.062 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-12T16:16:14.069 INFO:teuthology.orchestra.run.smithi204.stdout:880 write 0x8ce4c00 thru 0x8ceeb4f (0x9f50 bytes) 2024-09-12T16:16:14.070 INFO:teuthology.orchestra.run.smithi204.stdout:882 read 0x2806200 thru 0x280ec70 (0x8a71 bytes) 2024-09-12T16:16:14.070 INFO:teuthology.orchestra.run.smithi204.stdout:883 read 0x39f5200 thru 0x39fdabc (0x88bd bytes) 2024-09-12T16:16:14.070 INFO:teuthology.orchestra.run.smithi204.stdout:885 read 0x3af8200 thru 0x3b03e28 (0xbc29 bytes) 2024-09-12T16:16:14.070 INFO:teuthology.orchestra.run.smithi204.stdout:889 read 0x10dc400 thru 0x10e9d65 (0xd966 bytes) 2024-09-12T16:16:14.070 INFO:teuthology.orchestra.run.smithi204.stdout:890 punch from 0x898bc00 to 0x8992e00, (0x7200 bytes) 2024-09-12T16:16:14.071 INFO:teuthology.orchestra.run.smithi204.stdout:891 write 0x499e800 thru 0x499f8ea (0x10eb bytes) 2024-09-12T16:16:14.071 INFO:teuthology.orchestra.run.smithi204.stdout:892 read 0x1005c00 thru 0x100aab9 (0x4eba bytes) 2024-09-12T16:16:14.071 INFO:teuthology.orchestra.run.smithi204.stdout:893 write 0x80200 thru 0x84a36 (0x4837 bytes) 2024-09-12T16:16:14.075 INFO:teuthology.orchestra.run.smithi204.stdout:894 trunc from 0x8ceec00 to 0xc1d6a00 2024-09-12T16:16:14.086 INFO:teuthology.orchestra.run.smithi204.stdout:895 write 0x7894e00 thru 0x78a3897 (0xea98 bytes) 2024-09-12T16:16:14.089 INFO:teuthology.orchestra.run.smithi204.stdout:898 punch from 0x6870200 to 0x6870600, (0x400 bytes) 2024-09-12T16:16:14.089 INFO:teuthology.orchestra.run.smithi204.stdout:899 read 0x46bdc00 thru 0x46bf7a4 (0x1ba5 bytes) 2024-09-12T16:16:14.092 INFO:teuthology.orchestra.run.smithi204.stdout:902 read 0x9ffc600 thru 0x9fff514 (0x2f15 bytes) 2024-09-12T16:16:14.092 INFO:teuthology.orchestra.run.smithi204.stdout:903 punch from 0x238ec00 to 0x239da00, (0xee00 bytes) 2024-09-12T16:16:14.092 INFO:teuthology.orchestra.run.smithi204.stdout:905 write 0x3600000 thru 0x3604e7c (0x4e7d bytes) 2024-09-12T16:16:14.092 INFO:teuthology.orchestra.run.smithi204.stdout:907 write 0x9965600 thru 0x9972aad (0xd4ae bytes) 2024-09-12T16:16:14.092 INFO:teuthology.orchestra.run.smithi204.stdout:908 read 0x50d8a00 thru 0x50d948c (0xa8d bytes) 2024-09-12T16:16:14.092 INFO:teuthology.orchestra.run.smithi204.stdout:910 write 0xa330200 thru 0xa33bca1 (0xbaa2 bytes) 2024-09-12T16:16:14.092 INFO:teuthology.orchestra.run.smithi204.stdout:914 write 0x2a66e00 thru 0x2a67cc9 (0xeca bytes) 2024-09-12T16:16:14.092 INFO:teuthology.orchestra.run.smithi204.stdout:917 read 0x153d400 thru 0x1545eb5 (0x8ab6 bytes) 2024-09-12T16:16:14.103 INFO:teuthology.orchestra.run.smithi204.stdout:918 write 0xd331200 thru 0xd33f9fe (0xe7ff bytes) 2024-09-12T16:16:14.105 INFO:teuthology.orchestra.run.smithi204.stdout:921 punch from 0x34f1400 to 0x34fc000, (0xac00 bytes) 2024-09-12T16:16:14.106 INFO:teuthology.orchestra.run.smithi204.stdout:923 write 0x3f14000 thru 0x3f18c71 (0x4c72 bytes) 2024-09-12T16:16:14.107 INFO:teuthology.orchestra.run.smithi204.stdout:926 punch from 0x41fc00 to 0x420e00, (0x1200 bytes) 2024-09-12T16:16:14.123 INFO:teuthology.orchestra.run.smithi204.stdout:928 write 0xd742800 thru 0xd752389 (0xfb8a bytes) 2024-09-12T16:16:14.123 INFO:teuthology.orchestra.run.smithi204.stdout:929 write 0x27cde00 thru 0x27dc88b (0xea8c bytes) 2024-09-12T16:16:14.123 INFO:teuthology.orchestra.run.smithi204.stdout:930 write 0x8eaa00 thru 0x8fa4ce (0xfacf bytes) 2024-09-12T16:16:14.124 INFO:teuthology.orchestra.run.smithi204.stdout:931 read 0xa29e400 thru 0xa2a55b3 (0x71b4 bytes) 2024-09-12T16:16:14.124 INFO:teuthology.orchestra.run.smithi204.stdout:932 clone 7 order 18 su 1024 sc 4 2024-09-12T16:16:14.152 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:14.153 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:14.153 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:14.152+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:14.161 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:16:14.254 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:14.254+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:14.269 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:14.269 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:14.278 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:16:14.356 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:14.355+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:14.385 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:14.385 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:14.393 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:16:14.456 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:14.455+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:14.500 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:14.501 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:14.509 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:16:14.557 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:14.556+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:14.621 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:14.621 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:14.630 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:16:14.671 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:14.670+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:14.759 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:16:14.759+0000 7f002d431640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32213) UID: 0 2024-09-12T16:16:14.777 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:14.777 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:14.786 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:16:14.860 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:16:14.859+0000 7f002d431640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32213) UID: 0 2024-09-12T16:16:14.892 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:14.892 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:14.901 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:16:14.961 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:14.960+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:15.008 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:15.008 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:15.017 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:16:15.061 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:15.060+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:15.065 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-12T16:16:15.065 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T16:16:15.065 INFO:tasks.thrashosds.thrasher:Killing osd 5, live_osds are [0, 1, 2, 3, 4, 5] 2024-09-12T16:16:15.065 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T16:16:15.065 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T16:16:15.096 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T16:16:15.097 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.5 2024-09-12T16:16:15.097 INFO:tasks.thrashosds.thrasher:remote for osd 5 is ubuntu@smithi047.front.sepia.ceph.com 2024-09-12T16:16:15.097 DEBUG:teuthology.orchestra.run.smithi047:> type ceph-objectstore-tool 2024-09-12T16:16:15.127 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:15.127 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:15.135 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:16:15.155 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-12T16:16:15.155 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-5 --journal-path /var/lib/ceph/osd/ceph-5/journal --op list-pgs 2024-09-12T16:16:15.177 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:15.176+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:15.263 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:15.263+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:15.284 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:15.284 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:15.293 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:16:15.354 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T16:16:15.377 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:15.376+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:15.442 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:15.442 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:15.451 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:16:15.496 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:15.495+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:15.520 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:16:15.520 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:16:15.539 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:16:15.539 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:16:15.556 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:16:15.556 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:16:15.565 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:15.564+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:15.573 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:16:15.573 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:16:15.575 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:15.575 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:15.575 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:16:15.575 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:16:15.575 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:15.584 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:16:15.590 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:16:15.590 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:16:15.620 INFO:teuthology.orchestra.run.smithi047.stdout:2.2 2024-09-12T16:16:15.620 INFO:teuthology.orchestra.run.smithi047.stdout:2.3 2024-09-12T16:16:15.620 INFO:teuthology.orchestra.run.smithi047.stdout:3.1d 2024-09-12T16:16:15.620 INFO:teuthology.orchestra.run.smithi047.stdout:3.10 2024-09-12T16:16:15.620 INFO:teuthology.orchestra.run.smithi047.stdout:3.2 2024-09-12T16:16:15.620 INFO:teuthology.orchestra.run.smithi047.stdout:3.c 2024-09-12T16:16:15.620 INFO:teuthology.orchestra.run.smithi047.stdout:3.5 2024-09-12T16:16:15.620 INFO:teuthology.orchestra.run.smithi047.stdout:3.13 2024-09-12T16:16:15.620 INFO:teuthology.orchestra.run.smithi047.stdout:3.16 2024-09-12T16:16:15.620 INFO:teuthology.orchestra.run.smithi047.stdout:3.17 2024-09-12T16:16:15.620 INFO:teuthology.orchestra.run.smithi047.stdout:3.1c 2024-09-12T16:16:15.621 INFO:teuthology.orchestra.run.smithi047.stdout:3.e 2024-09-12T16:16:15.621 INFO:teuthology.orchestra.run.smithi047.stdout:3.f 2024-09-12T16:16:15.666 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:15.666+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:15.698 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:15.698 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:16:15.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:16:15.698 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:15.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.698 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:3893 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 409600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:15.698 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.336389+0000", 2024-09-12T16:16:15.698 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.3603173949999992, 2024-09-12T16:16:15.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0045550920000000002, 2024-09-12T16:16:15.698 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:15.699 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:15.699 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:15.699 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:15.699 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:15.699 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:15.699 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3893 2024-09-12T16:16:15.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.699 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:15.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:15.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336389+0000", 2024-09-12T16:16:15.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:15.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336389+0000", 2024-09-12T16:16:15.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:15.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336389+0000", 2024-09-12T16:16:15.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1799999999999999e-07 2024-09-12T16:16:15.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:15.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336390+0000", 2024-09-12T16:16:15.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.082e-06 2024-09-12T16:16:15.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:15.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336393+0000", 2024-09-12T16:16:15.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9849999999999998e-06 2024-09-12T16:16:15.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:15.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336395+0000", 2024-09-12T16:16:15.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3460000000000001e-06 2024-09-12T16:16:15.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:15.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.339585+0000", 2024-09-12T16:16:15.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031895449999999998 2024-09-12T16:16:15.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:15.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340868+0000", 2024-09-12T16:16:15.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012825009999999999 2024-09-12T16:16:15.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:15.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340944+0000", 2024-09-12T16:16:15.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6415000000000006e-05 2024-09-12T16:16:15.702 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.702 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:15.703 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.703 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:3894 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 466944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:15.703 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.336399+0000", 2024-09-12T16:16:15.703 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.3603075790000005, 2024-09-12T16:16:15.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0047051489999999996, 2024-09-12T16:16:15.703 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:15.703 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:15.703 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:15.703 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:15.703 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:15.703 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:15.704 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3894 2024-09-12T16:16:15.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.704 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:15.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:15.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336399+0000", 2024-09-12T16:16:15.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:15.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336399+0000", 2024-09-12T16:16:15.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:15.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336399+0000", 2024-09-12T16:16:15.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.34e-07 2024-09-12T16:16:15.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:15.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336400+0000", 2024-09-12T16:16:15.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.029e-06 2024-09-12T16:16:15.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:15.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336403+0000", 2024-09-12T16:16:15.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.078e-06 2024-09-12T16:16:15.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:15.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336405+0000", 2024-09-12T16:16:15.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.34e-06 2024-09-12T16:16:15.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:15.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340975+0000", 2024-09-12T16:16:15.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.004569348 2024-09-12T16:16:15.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:15.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341043+0000", 2024-09-12T16:16:15.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8202999999999997e-05 2024-09-12T16:16:15.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:15.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341104+0000", 2024-09-12T16:16:15.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0917e-05 2024-09-12T16:16:15.707 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.707 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:15.707 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.707 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:3895 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 483328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:15.707 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.336409+0000", 2024-09-12T16:16:15.707 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.3602976640000009, 2024-09-12T16:16:15.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0048548549999999999, 2024-09-12T16:16:15.708 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:15.708 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:15.708 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:15.708 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:15.708 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:15.708 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:15.708 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3895 2024-09-12T16:16:15.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.708 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:15.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:15.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336409+0000", 2024-09-12T16:16:15.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:15.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336409+0000", 2024-09-12T16:16:15.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:15.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336409+0000", 2024-09-12T16:16:15.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2499999999999999e-07 2024-09-12T16:16:15.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:15.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336410+0000", 2024-09-12T16:16:15.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0139999999999999e-06 2024-09-12T16:16:15.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:15.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336413+0000", 2024-09-12T16:16:15.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.038e-06 2024-09-12T16:16:15.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:15.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336415+0000", 2024-09-12T16:16:15.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2680000000000001e-06 2024-09-12T16:16:15.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:15.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341132+0000", 2024-09-12T16:16:15.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0047171560000000001 2024-09-12T16:16:15.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:15.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341200+0000", 2024-09-12T16:16:15.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7910000000000005e-05 2024-09-12T16:16:15.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:15.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341263+0000", 2024-09-12T16:16:15.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3244000000000006e-05 2024-09-12T16:16:15.714 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.714 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:15.714 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.715 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:3896 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 499712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:15.715 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.336421+0000", 2024-09-12T16:16:15.715 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.3602855740000006, 2024-09-12T16:16:15.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0050030539999999998, 2024-09-12T16:16:15.715 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:15.715 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:15.715 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:15.715 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:15.715 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:15.715 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:15.715 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3896 2024-09-12T16:16:15.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.716 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:15.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:15.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336421+0000", 2024-09-12T16:16:15.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:15.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336421+0000", 2024-09-12T16:16:15.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:15.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336421+0000", 2024-09-12T16:16:15.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8700000000000001e-07 2024-09-12T16:16:15.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:15.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336423+0000", 2024-09-12T16:16:15.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.753e-06 2024-09-12T16:16:15.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:15.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336428+0000", 2024-09-12T16:16:15.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6149999999999996e-06 2024-09-12T16:16:15.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:15.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336433+0000", 2024-09-12T16:16:15.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5909999999999998e-06 2024-09-12T16:16:15.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:15.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341292+0000", 2024-09-12T16:16:15.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0048587470000000001 2024-09-12T16:16:15.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:15.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341358+0000", 2024-09-12T16:16:15.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6218999999999997e-05 2024-09-12T16:16:15.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:15.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341424+0000", 2024-09-12T16:16:15.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5741999999999995e-05 2024-09-12T16:16:15.719 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.719 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:15.719 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.719 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:3897 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 516096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:15.719 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.336440+0000", 2024-09-12T16:16:15.719 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.3602665199999997, 2024-09-12T16:16:15.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.005179187, 2024-09-12T16:16:15.720 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:15.720 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:15.720 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:15.720 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:15.720 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:15.720 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:15.720 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3897 2024-09-12T16:16:15.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.720 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:15.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:15.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336440+0000", 2024-09-12T16:16:15.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:15.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336440+0000", 2024-09-12T16:16:15.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:15.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336440+0000", 2024-09-12T16:16:15.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7e-07 2024-09-12T16:16:15.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:15.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336442+0000", 2024-09-12T16:16:15.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1959999999999998e-06 2024-09-12T16:16:15.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:15.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336449+0000", 2024-09-12T16:16:15.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8179999999999998e-06 2024-09-12T16:16:15.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:15.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336454+0000", 2024-09-12T16:16:15.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1760000000000001e-06 2024-09-12T16:16:15.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:15.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341482+0000", 2024-09-12T16:16:15.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0050273460000000002 2024-09-12T16:16:15.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:15.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341552+0000", 2024-09-12T16:16:15.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0297999999999997e-05 2024-09-12T16:16:15.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:15.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341619+0000", 2024-09-12T16:16:15.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6983000000000006e-05 2024-09-12T16:16:15.724 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.724 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:15.724 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.724 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4125 3.5 3:a241af90:::rbd_data.11557ed36bb5.000000000000000f:4 [read 401408~6656] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:15.724 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.337967+0000", 2024-09-12T16:16:15.724 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.3587396930000004, 2024-09-12T16:16:15.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003989467, 2024-09-12T16:16:15.724 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:15.724 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:15.724 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:15.724 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:15.725 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:15.725 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:15.725 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4125 2024-09-12T16:16:15.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.725 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:15.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:15.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337967+0000", 2024-09-12T16:16:15.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:15.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337967+0000", 2024-09-12T16:16:15.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:15.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337967+0000", 2024-09-12T16:16:15.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0900000000000002e-07 2024-09-12T16:16:15.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:15.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337975+0000", 2024-09-12T16:16:15.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6909999999999997e-06 2024-09-12T16:16:15.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:15.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337984+0000", 2024-09-12T16:16:15.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2720000000000003e-06 2024-09-12T16:16:15.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:15.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337990+0000", 2024-09-12T16:16:15.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3380000000000001e-06 2024-09-12T16:16:15.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:15.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340872+0000", 2024-09-12T16:16:15.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002882225 2024-09-12T16:16:15.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:15.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340944+0000", 2024-09-12T16:16:15.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1219999999999999e-05 2024-09-12T16:16:15.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:15.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341956+0000", 2024-09-12T16:16:15.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001012312 2024-09-12T16:16:15.728 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.728 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:15.728 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.728 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4126 3.5 3:a241af90:::rbd_data.11557ed36bb5.000000000000000f:4 [read 442368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:15.728 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.337999+0000", 2024-09-12T16:16:15.729 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.3587068949999992, 2024-09-12T16:16:15.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0041510729999999999, 2024-09-12T16:16:15.729 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:15.729 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:15.729 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:15.729 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:15.729 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:15.729 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:15.729 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4126 2024-09-12T16:16:15.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.729 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:15.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:15.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337999+0000", 2024-09-12T16:16:15.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:15.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337999+0000", 2024-09-12T16:16:15.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:15.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338000+0000", 2024-09-12T16:16:15.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4000000000000002e-07 2024-09-12T16:16:15.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:15.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338002+0000", 2024-09-12T16:16:15.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.154e-06 2024-09-12T16:16:15.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:15.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338009+0000", 2024-09-12T16:16:15.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9059999999999996e-06 2024-09-12T16:16:15.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:15.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338014+0000", 2024-09-12T16:16:15.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7650000000000001e-06 2024-09-12T16:16:15.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:15.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342002+0000", 2024-09-12T16:16:15.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039884680000000002 2024-09-12T16:16:15.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:15.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342076+0000", 2024-09-12T16:16:15.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4023999999999995e-05 2024-09-12T16:16:15.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:15.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342150+0000", 2024-09-12T16:16:15.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4215999999999996e-05 2024-09-12T16:16:15.732 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.732 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:15.733 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.733 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4127 3.5 3:a241af90:::rbd_data.11557ed36bb5.000000000000000f:4 [read 458752~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:15.733 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.338021+0000", 2024-09-12T16:16:15.733 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.3586852989999993, 2024-09-12T16:16:15.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042934399999999999, 2024-09-12T16:16:15.733 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:15.733 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:15.733 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:15.733 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:15.733 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:15.733 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:15.733 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4127 2024-09-12T16:16:15.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.734 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:15.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:15.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338021+0000", 2024-09-12T16:16:15.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:15.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338021+0000", 2024-09-12T16:16:15.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:15.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338021+0000", 2024-09-12T16:16:15.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9800000000000004e-07 2024-09-12T16:16:15.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:15.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338024+0000", 2024-09-12T16:16:15.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2809999999999998e-06 2024-09-12T16:16:15.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:15.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338031+0000", 2024-09-12T16:16:15.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1269999999999997e-06 2024-09-12T16:16:15.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:15.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338036+0000", 2024-09-12T16:16:15.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0329999999999999e-06 2024-09-12T16:16:15.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:15.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342181+0000", 2024-09-12T16:16:15.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.004144699 2024-09-12T16:16:15.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:15.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342247+0000", 2024-09-12T16:16:15.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6149000000000007e-05 2024-09-12T16:16:15.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:15.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342314+0000", 2024-09-12T16:16:15.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7652999999999998e-05 2024-09-12T16:16:15.737 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.737 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:15.737 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.737 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4128 3.5 3:a241af90:::rbd_data.11557ed36bb5.000000000000000f:4 [read 475136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:15.737 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.338043+0000", 2024-09-12T16:16:15.737 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.358663151, 2024-09-12T16:16:15.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0044450189999999997, 2024-09-12T16:16:15.737 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:15.738 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:15.738 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:15.738 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:15.738 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:15.738 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:15.738 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4128 2024-09-12T16:16:15.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.738 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:15.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:15.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338043+0000", 2024-09-12T16:16:15.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:15.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338043+0000", 2024-09-12T16:16:15.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:15.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338044+0000", 2024-09-12T16:16:15.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2599999999999998e-07 2024-09-12T16:16:15.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:15.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338046+0000", 2024-09-12T16:16:15.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9850000000000001e-06 2024-09-12T16:16:15.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:15.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338052+0000", 2024-09-12T16:16:15.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7410000000000003e-06 2024-09-12T16:16:15.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:15.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338058+0000", 2024-09-12T16:16:15.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5729999999999998e-06 2024-09-12T16:16:15.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:15.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342343+0000", 2024-09-12T16:16:15.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042855970000000004 2024-09-12T16:16:15.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:15.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342411+0000", 2024-09-12T16:16:15.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7619000000000004e-05 2024-09-12T16:16:15.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:15.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342488+0000", 2024-09-12T16:16:15.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7077999999999996e-05 2024-09-12T16:16:15.741 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.741 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:15.741 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.742 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4129 3.5 3:a241af90:::rbd_data.11557ed36bb5.000000000000000f:4 [read 491520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:15.742 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.338065+0000", 2024-09-12T16:16:15.742 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.3586408460000001, 2024-09-12T16:16:15.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.004581819, 2024-09-12T16:16:15.742 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:15.742 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:15.742 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:15.742 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:15.742 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:15.742 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:15.742 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4129 2024-09-12T16:16:15.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.742 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:15.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:15.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338065+0000", 2024-09-12T16:16:15.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:15.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338065+0000", 2024-09-12T16:16:15.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:15.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338066+0000", 2024-09-12T16:16:15.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-07 2024-09-12T16:16:15.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:15.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338068+0000", 2024-09-12T16:16:15.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4820000000000001e-06 2024-09-12T16:16:15.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:15.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338075+0000", 2024-09-12T16:16:15.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.08e-06 2024-09-12T16:16:15.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:15.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338081+0000", 2024-09-12T16:16:15.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2939999999999996e-06 2024-09-12T16:16:15.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:15.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342515+0000", 2024-09-12T16:16:15.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0044338720000000002 2024-09-12T16:16:15.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:15.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342582+0000", 2024-09-12T16:16:15.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6962e-05 2024-09-12T16:16:15.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:15.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342647+0000", 2024-09-12T16:16:15.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5643999999999997e-05 2024-09-12T16:16:15.746 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.746 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:15.746 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.746 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4450 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 475136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:15.746 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.345047+0000", 2024-09-12T16:16:15.746 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.3516595000000002, 2024-09-12T16:16:15.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003358088, 2024-09-12T16:16:15.746 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:15.746 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:15.747 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:15.747 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:15.747 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:15.747 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:15.747 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4450 2024-09-12T16:16:15.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.747 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:15.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:15.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345047+0000", 2024-09-12T16:16:15.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:15.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345047+0000", 2024-09-12T16:16:15.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:15.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345047+0000", 2024-09-12T16:16:15.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2599999999999998e-07 2024-09-12T16:16:15.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:15.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345049+0000", 2024-09-12T16:16:15.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1040000000000001e-06 2024-09-12T16:16:15.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:15.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345056+0000", 2024-09-12T16:16:15.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6220000000000003e-06 2024-09-12T16:16:15.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:15.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345061+0000", 2024-09-12T16:16:15.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0710000000000002e-06 2024-09-12T16:16:15.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:15.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.348273+0000", 2024-09-12T16:16:15.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032119649999999998 2024-09-12T16:16:15.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:15.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.348340+0000", 2024-09-12T16:16:15.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7115999999999999e-05 2024-09-12T16:16:15.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:15.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.348405+0000", 2024-09-12T16:16:15.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4783999999999995e-05 2024-09-12T16:16:15.750 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.750 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:15.750 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.751 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4856 3.1e 3.e05fe63e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:15.751 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.351329+0000", 2024-09-12T16:16:15.751 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.3453770630000008, 2024-09-12T16:16:15.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032355190000000001, 2024-09-12T16:16:15.751 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:15.751 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:15.751 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:16:15.751 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:15.751 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:15.751 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:15.751 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4856 2024-09-12T16:16:15.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.752 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:15.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:15.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351329+0000", 2024-09-12T16:16:15.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:15.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351329+0000", 2024-09-12T16:16:15.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:15.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351330+0000", 2024-09-12T16:16:15.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5400000000000002e-07 2024-09-12T16:16:15.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:15.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351331+0000", 2024-09-12T16:16:15.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.81e-06 2024-09-12T16:16:15.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:15.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351337+0000", 2024-09-12T16:16:15.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7830000000000004e-06 2024-09-12T16:16:15.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:15.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351342+0000", 2024-09-12T16:16:15.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.69e-06 2024-09-12T16:16:15.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:15.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354558+0000", 2024-09-12T16:16:15.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032158500000000001 2024-09-12T16:16:15.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:15.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354565+0000", 2024-09-12T16:16:15.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0319999999999998e-06 2024-09-12T16:16:15.754 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.754 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:15.755 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.755 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4857 3.1e 3.e05fe63e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:15.755 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.351348+0000", 2024-09-12T16:16:15.755 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.3453585340000007, 2024-09-12T16:16:15.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032465969999999999, 2024-09-12T16:16:15.755 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:15.755 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:15.755 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:16:15.755 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:15.755 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:15.755 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:15.755 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4857 2024-09-12T16:16:15.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.756 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:15.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.756 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:15.756 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351348+0000", 2024-09-12T16:16:15.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.756 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:15.756 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351348+0000", 2024-09-12T16:16:15.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.756 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:15.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351348+0000", 2024-09-12T16:16:15.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3599999999999999e-07 2024-09-12T16:16:15.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:15.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351354+0000", 2024-09-12T16:16:15.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8880000000000002e-06 2024-09-12T16:16:15.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:15.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351361+0000", 2024-09-12T16:16:15.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1849999999999998e-06 2024-09-12T16:16:15.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:15.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351366+0000", 2024-09-12T16:16:15.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9740000000000001e-06 2024-09-12T16:16:15.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:15.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354588+0000", 2024-09-12T16:16:15.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032216200000000001 2024-09-12T16:16:15.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:15.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354594+0000", 2024-09-12T16:16:15.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5939999999999999e-06 2024-09-12T16:16:15.759 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.759 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:15.759 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.759 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4858 3.1e 3.e05fe63e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:15.759 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.351373+0000", 2024-09-12T16:16:15.759 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.3453335969999998, 2024-09-12T16:16:15.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032503800000000002, 2024-09-12T16:16:15.759 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:15.759 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:15.759 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:16:15.759 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:15.759 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:15.760 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:15.760 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4858 2024-09-12T16:16:15.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.760 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:15.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.760 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:15.760 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351373+0000", 2024-09-12T16:16:15.760 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.760 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:15.760 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351373+0000", 2024-09-12T16:16:15.760 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:15.761 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351373+0000", 2024-09-12T16:16:15.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5999999999999999e-07 2024-09-12T16:16:15.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:15.761 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351376+0000", 2024-09-12T16:16:15.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6170000000000001e-06 2024-09-12T16:16:15.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:15.761 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351381+0000", 2024-09-12T16:16:15.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8209999999999998e-06 2024-09-12T16:16:15.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:15.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351386+0000", 2024-09-12T16:16:15.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6190000000000002e-06 2024-09-12T16:16:15.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:15.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354616+0000", 2024-09-12T16:16:15.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032299809999999998 2024-09-12T16:16:15.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:15.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354623+0000", 2024-09-12T16:16:15.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9820000000000002e-06 2024-09-12T16:16:15.763 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.763 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:15.763 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.763 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4859 3.1e 3.e05fe63e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:15.763 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.351392+0000", 2024-09-12T16:16:15.763 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.3453143399999998, 2024-09-12T16:16:15.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003261983, 2024-09-12T16:16:15.763 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:15.763 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:15.763 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:16:15.763 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:15.764 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:15.764 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:15.764 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4859 2024-09-12T16:16:15.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.764 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:15.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:15.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351392+0000", 2024-09-12T16:16:15.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:15.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351392+0000", 2024-09-12T16:16:15.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:15.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351392+0000", 2024-09-12T16:16:15.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4999999999999998e-07 2024-09-12T16:16:15.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:15.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351394+0000", 2024-09-12T16:16:15.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.669e-06 2024-09-12T16:16:15.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:15.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351400+0000", 2024-09-12T16:16:15.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7049999999999996e-06 2024-09-12T16:16:15.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:15.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351404+0000", 2024-09-12T16:16:15.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7249999999999997e-06 2024-09-12T16:16:15.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:15.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354646+0000", 2024-09-12T16:16:15.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032411499999999999 2024-09-12T16:16:15.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:15.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354654+0000", 2024-09-12T16:16:15.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3839999999999997e-06 2024-09-12T16:16:15.767 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.767 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:15.767 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.767 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4859 3.1e 3:7c67fa07:::rbd_data.11557ed36bb5.000000000000001d:4 [read 516096~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:15.767 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.356681+0000", 2024-09-12T16:16:15.767 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.3400247749999998, 2024-09-12T16:16:15.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033342200000000002, 2024-09-12T16:16:15.767 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:15.767 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:15.768 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:15.768 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:15.768 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:15.768 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:15.768 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4859 2024-09-12T16:16:15.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.768 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:15.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.768 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:15.768 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.356681+0000", 2024-09-12T16:16:15.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:15.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.356681+0000", 2024-09-12T16:16:15.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:15.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.356682+0000", 2024-09-12T16:16:15.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.34e-07 2024-09-12T16:16:15.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:15.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.356689+0000", 2024-09-12T16:16:15.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3540000000000002e-06 2024-09-12T16:16:15.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.770 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:15.770 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.356697+0000", 2024-09-12T16:16:15.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.038e-06 2024-09-12T16:16:15.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.770 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:15.770 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.356703+0000", 2024-09-12T16:16:15.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7690000000000002e-06 2024-09-12T16:16:15.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.770 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:15.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.359724+0000", 2024-09-12T16:16:15.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030212529999999998 2024-09-12T16:16:15.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:15.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.359807+0000", 2024-09-12T16:16:15.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2956999999999999e-05 2024-09-12T16:16:15.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:15.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.360016+0000", 2024-09-12T16:16:15.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020841499999999999 2024-09-12T16:16:15.771 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.771 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:15.771 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.772 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:611 3.1e 3:781126e5:::rbd_data.11551fa285fd.0000000000000001:5 [sparse-read 4390912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:15.772 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.317383+0000", 2024-09-12T16:16:15.772 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.3793232079999997, 2024-09-12T16:16:15.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034147090000000001, 2024-09-12T16:16:15.772 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:15.772 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:15.772 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:15.772 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:15.772 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:15.772 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:15.772 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 611 2024-09-12T16:16:15.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.773 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:15.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:15.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317383+0000", 2024-09-12T16:16:15.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:15.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317383+0000", 2024-09-12T16:16:15.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:15.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317383+0000", 2024-09-12T16:16:15.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.03e-07 2024-09-12T16:16:15.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:15.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317384+0000", 2024-09-12T16:16:15.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.111e-06 2024-09-12T16:16:15.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:15.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317387+0000", 2024-09-12T16:16:15.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0920000000000002e-06 2024-09-12T16:16:15.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.775 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:15.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317391+0000", 2024-09-12T16:16:15.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.191e-06 2024-09-12T16:16:15.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.775 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:15.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.320634+0000", 2024-09-12T16:16:15.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032436750000000001 2024-09-12T16:16:15.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.775 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:15.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.320721+0000", 2024-09-12T16:16:15.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6682999999999997e-05 2024-09-12T16:16:15.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.776 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:15.776 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.320798+0000", 2024-09-12T16:16:15.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6754000000000004e-05 2024-09-12T16:16:15.776 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.776 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:15.776 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.776 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:612 3.1e 3:781126e5:::rbd_data.11551fa285fd.0000000000000001:5 [sparse-read 5439488~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:15.776 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.317394+0000", 2024-09-12T16:16:15.776 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.3793121660000001, 2024-09-12T16:16:15.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036457799999999999, 2024-09-12T16:16:15.776 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:15.777 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:15.777 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:15.777 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:15.777 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:15.777 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:15.777 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 612 2024-09-12T16:16:15.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.777 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:15.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.777 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:15.777 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317394+0000", 2024-09-12T16:16:15.777 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:15.778 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317394+0000", 2024-09-12T16:16:15.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:15.778 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317394+0000", 2024-09-12T16:16:15.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1400000000000001e-07 2024-09-12T16:16:15.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:15.778 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317395+0000", 2024-09-12T16:16:15.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.569999999999999e-07 2024-09-12T16:16:15.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.779 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:15.779 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317398+0000", 2024-09-12T16:16:15.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1520000000000001e-06 2024-09-12T16:16:15.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.779 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:15.779 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317401+0000", 2024-09-12T16:16:15.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4660000000000002e-06 2024-09-12T16:16:15.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.779 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:15.779 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.320843+0000", 2024-09-12T16:16:15.780 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034421130000000001 2024-09-12T16:16:15.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.780 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:15.780 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.320939+0000", 2024-09-12T16:16:15.780 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5585e-05 2024-09-12T16:16:15.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.780 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:15.780 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321040+0000", 2024-09-12T16:16:15.780 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010129299999999999 2024-09-12T16:16:15.780 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.780 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:15.781 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.781 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:613 3.1e 3:781126e5:::rbd_data.11551fa285fd.0000000000000001:5 [sparse-read 6488064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:15.781 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.317404+0000", 2024-09-12T16:16:15.781 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.3793021669999996, 2024-09-12T16:16:15.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003785217, 2024-09-12T16:16:15.781 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:15.781 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:15.781 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:15.781 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:15.781 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:15.781 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:15.781 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 613 2024-09-12T16:16:15.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.782 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:15.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:15.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317404+0000", 2024-09-12T16:16:15.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:15.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317404+0000", 2024-09-12T16:16:15.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:15.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317404+0000", 2024-09-12T16:16:15.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2000000000000001e-07 2024-09-12T16:16:15.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:15.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317405+0000", 2024-09-12T16:16:15.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0890000000000001e-06 2024-09-12T16:16:15.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:15.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317408+0000", 2024-09-12T16:16:15.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.061e-06 2024-09-12T16:16:15.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:15.784 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317411+0000", 2024-09-12T16:16:15.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.52e-06 2024-09-12T16:16:15.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.784 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:15.784 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321069+0000", 2024-09-12T16:16:15.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036582059999999998 2024-09-12T16:16:15.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.784 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:15.784 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321127+0000", 2024-09-12T16:16:15.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7339000000000001e-05 2024-09-12T16:16:15.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.785 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:15.785 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321189+0000", 2024-09-12T16:16:15.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2781999999999996e-05 2024-09-12T16:16:15.785 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.785 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:15.785 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.785 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:614 3.1e 3:781126e5:::rbd_data.11551fa285fd.0000000000000001:5 [sparse-read 7536640~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:15.785 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.317414+0000", 2024-09-12T16:16:15.785 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.3792919919999997, 2024-09-12T16:16:15.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039935709999999996, 2024-09-12T16:16:15.785 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:15.786 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:15.786 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:15.786 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:15.786 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:15.786 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:15.786 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 614 2024-09-12T16:16:15.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.786 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:15.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.786 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:15.786 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317414+0000", 2024-09-12T16:16:15.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:15.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317414+0000", 2024-09-12T16:16:15.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:15.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:15.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317414+0000", 2024-09-12T16:16:15.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.05e-07 2024-09-12T16:16:15.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:15.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317418+0000", 2024-09-12T16:16:15.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5329999999999999e-06 2024-09-12T16:16:15.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:15.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317423+0000", 2024-09-12T16:16:15.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2780000000000001e-06 2024-09-12T16:16:15.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:15.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317428+0000", 2024-09-12T16:16:15.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.763e-06 2024-09-12T16:16:15.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:15.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321217+0000", 2024-09-12T16:16:15.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003788816 2024-09-12T16:16:15.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:15.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321307+0000", 2024-09-12T16:16:15.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0142999999999994e-05 2024-09-12T16:16:15.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:15.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:15.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:15.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321408+0000", 2024-09-12T16:16:15.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000100833 2024-09-12T16:16:15.789 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.789 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:15.789 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.789 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:15.789 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:15.790 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:15.791 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:16:15.791 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:15.790+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:15.892 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:15.891+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:15.893 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-5 --journal-path /var/lib/ceph/osd/ceph-5/journal --op export --pgid 3.1d --file /var/log/ceph/exp.3.1d.5 2024-09-12T16:16:15.908 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:15.908 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:16:15.908 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:16:15.909 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:15.918 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:16:16.002 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:16.002+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:16.065 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:16.065 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:16:16.065 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:16:16.065 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:16:16.065 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:16.075 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:16:16.078 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T16:16:16.116 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:16.116+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:16.194 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:16.193+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:16.224 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:16.224 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:16:16.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:16:16.224 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:16:16.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.225 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:16:16.225 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:16:16.225 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 34.458235529, 2024-09-12T16:16:16.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55645454900000002, 2024-09-12T16:16:16.225 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.225 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.225 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:16.225 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.225 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:16:16.225 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:16:16.225 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1 2024-09-12T16:16:16.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.226 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:16:16.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:16:16.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764440+0000", 2024-09-12T16:16:16.227 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6249999999999999e-06 2024-09-12T16:16:16.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.227 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.227 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.227 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764447+0000", 2024-09-12T16:16:16.227 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4939999999999997e-06 2024-09-12T16:16:16.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.227 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.227 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.227 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764459+0000", 2024-09-12T16:16:16.227 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1517e-05 2024-09-12T16:16:16.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.227 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.227 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.228 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764468+0000", 2024-09-12T16:16:16.228 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7690000000000002e-06 2024-09-12T16:16:16.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.228 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.228 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764539+0000", 2024-09-12T16:16:16.228 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1103e-05 2024-09-12T16:16:16.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.228 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:16:16.228 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764551+0000", 2024-09-12T16:16:16.228 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2687999999999999e-05 2024-09-12T16:16:16.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319497+0000", 2024-09-12T16:16:16.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55494560500000001 2024-09-12T16:16:16.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319688+0000", 2024-09-12T16:16:16.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019105599999999999 2024-09-12T16:16:16.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:16:16.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319842+0000", 2024-09-12T16:16:16.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015377699999999999 2024-09-12T16:16:16.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:16.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320473+0000", 2024-09-12T16:16:16.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00063117100000000003 2024-09-12T16:16:16.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:16.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320825+0000", 2024-09-12T16:16:16.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00035202500000000001 2024-09-12T16:16:16.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:16.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320867+0000", 2024-09-12T16:16:16.231 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2005000000000002e-05 2024-09-12T16:16:16.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.231 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.231 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.231 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320893+0000", 2024-09-12T16:16:16.231 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5714000000000001e-05 2024-09-12T16:16:16.231 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.231 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.231 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.231 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.231 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:272 3.13 3:cf84a54d:::rbd_data.1155cf5be90e.0000000000000018:3 [read 2195456~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:16.231 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.336886+0000", 2024-09-12T16:16:16.232 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 13.8857876, 2024-09-12T16:16:16.232 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021654322, 2024-09-12T16:16:16.232 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.232 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.232 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:16.232 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.232 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:16.232 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:16.232 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 272 2024-09-12T16:16:16.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.232 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.232 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336886+0000", 2024-09-12T16:16:16.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.233 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.233 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336886+0000", 2024-09-12T16:16:16.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.233 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.233 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336886+0000", 2024-09-12T16:16:16.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.11e-07 2024-09-12T16:16:16.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.233 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.234 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336887+0000", 2024-09-12T16:16:16.234 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8899999999999998e-07 2024-09-12T16:16:16.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.234 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.234 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.234 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336891+0000", 2024-09-12T16:16:16.234 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9600000000000002e-06 2024-09-12T16:16:16.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.234 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.234 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.234 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336893+0000", 2024-09-12T16:16:16.234 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1330000000000002e-06 2024-09-12T16:16:16.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.234 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.235 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.235 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.358370+0000", 2024-09-12T16:16:16.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021476512 2024-09-12T16:16:16.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.235 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.235 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.235 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.358449+0000", 2024-09-12T16:16:16.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8577000000000003e-05 2024-09-12T16:16:16.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.235 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.235 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.235 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.358540+0000", 2024-09-12T16:16:16.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1940000000000004e-05 2024-09-12T16:16:16.235 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.236 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.236 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.236 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.236 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.236 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:273 3.13 3:cf84a54d:::rbd_data.1155cf5be90e.0000000000000018:3 [read 2301952~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:16.236 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.336896+0000", 2024-09-12T16:16:16.236 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 13.885777295, 2024-09-12T16:16:16.236 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021839559000000001, 2024-09-12T16:16:16.236 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.236 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.236 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:16.236 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.236 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:16.236 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:16.237 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 273 2024-09-12T16:16:16.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.237 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.237 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.237 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.237 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336896+0000", 2024-09-12T16:16:16.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.237 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.237 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.237 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336896+0000", 2024-09-12T16:16:16.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.238 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.238 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336897+0000", 2024-09-12T16:16:16.238 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2999999999999999e-07 2024-09-12T16:16:16.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.238 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.238 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336898+0000", 2024-09-12T16:16:16.238 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4499999999999995e-07 2024-09-12T16:16:16.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.238 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.239 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336901+0000", 2024-09-12T16:16:16.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9119999999999998e-06 2024-09-12T16:16:16.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.239 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.239 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336903+0000", 2024-09-12T16:16:16.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3020000000000002e-06 2024-09-12T16:16:16.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.239 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.239 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.358578+0000", 2024-09-12T16:16:16.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021674795 2024-09-12T16:16:16.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.240 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.240 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.358652+0000", 2024-09-12T16:16:16.240 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4450999999999996e-05 2024-09-12T16:16:16.240 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.240 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.240 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.240 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.358736+0000", 2024-09-12T16:16:16.240 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3924000000000005e-05 2024-09-12T16:16:16.241 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.241 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.241 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.241 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.241 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.241 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:274 3.13 3:cf84a54d:::rbd_data.1155cf5be90e.0000000000000018:3 [read 2408448~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:16.241 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.336920+0000", 2024-09-12T16:16:16.241 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 13.885753316000001, 2024-09-12T16:16:16.241 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022050357, 2024-09-12T16:16:16.241 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.241 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.241 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:16.241 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.241 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:16.242 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:16.242 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 274 2024-09-12T16:16:16.242 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.242 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.242 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.242 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.242 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336920+0000", 2024-09-12T16:16:16.242 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.243 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.243 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336920+0000", 2024-09-12T16:16:16.243 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.243 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.243 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336921+0000", 2024-09-12T16:16:16.243 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.32e-07 2024-09-12T16:16:16.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.244 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.244 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.244 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336923+0000", 2024-09-12T16:16:16.244 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.823e-06 2024-09-12T16:16:16.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.244 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.244 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.244 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336926+0000", 2024-09-12T16:16:16.245 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.574e-06 2024-09-12T16:16:16.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.245 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.245 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.245 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336929+0000", 2024-09-12T16:16:16.246 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.559e-06 2024-09-12T16:16:16.246 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.246 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.246 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.246 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.358779+0000", 2024-09-12T16:16:16.246 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021850141 2024-09-12T16:16:16.246 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.246 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.246 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.246 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.358859+0000", 2024-09-12T16:16:16.247 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0234999999999993e-05 2024-09-12T16:16:16.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.247 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.247 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.358971+0000", 2024-09-12T16:16:16.247 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000111593 2024-09-12T16:16:16.247 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.247 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.247 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.247 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:275 3.13 3:cf84a54d:::rbd_data.1155cf5be90e.0000000000000018:3 [read 2514944~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:16.247 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.336932+0000", 2024-09-12T16:16:16.248 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 13.885741695, 2024-09-12T16:16:16.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022216863999999999, 2024-09-12T16:16:16.248 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.248 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.248 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:16.248 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.248 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:16.248 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:16.248 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 275 2024-09-12T16:16:16.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.248 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.248 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.248 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.248 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336932+0000", 2024-09-12T16:16:16.249 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.249 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.249 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336932+0000", 2024-09-12T16:16:16.249 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.249 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.249 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336932+0000", 2024-09-12T16:16:16.249 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9700000000000003e-07 2024-09-12T16:16:16.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.249 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.250 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336933+0000", 2024-09-12T16:16:16.250 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9199999999999999e-07 2024-09-12T16:16:16.250 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.250 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.250 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.250 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336937+0000", 2024-09-12T16:16:16.250 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9299999999999996e-06 2024-09-12T16:16:16.250 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.250 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.250 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.250 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336944+0000", 2024-09-12T16:16:16.251 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6209999999999998e-06 2024-09-12T16:16:16.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.251 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.251 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.251 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.359007+0000", 2024-09-12T16:16:16.251 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022062799000000001 2024-09-12T16:16:16.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.251 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.251 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.251 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.359068+0000", 2024-09-12T16:16:16.251 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1156999999999997e-05 2024-09-12T16:16:16.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.251 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.251 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.252 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.359149+0000", 2024-09-12T16:16:16.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1068000000000004e-05 2024-09-12T16:16:16.252 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.252 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.252 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.252 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:276 3.13 3:cf84a54d:::rbd_data.1155cf5be90e.0000000000000018:3 [read 2621440~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:16.252 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.336948+0000", 2024-09-12T16:16:16.252 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 13.885725597, 2024-09-12T16:16:16.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022437803999999999, 2024-09-12T16:16:16.252 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.252 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.253 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:16.253 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.253 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:16.253 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:16.253 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 276 2024-09-12T16:16:16.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.253 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336948+0000", 2024-09-12T16:16:16.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.254 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336948+0000", 2024-09-12T16:16:16.254 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.254 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.254 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.254 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.254 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336948+0000", 2024-09-12T16:16:16.254 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2999999999999999e-07 2024-09-12T16:16:16.254 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.254 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.254 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.254 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336949+0000", 2024-09-12T16:16:16.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.029e-06 2024-09-12T16:16:16.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.255 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.255 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336953+0000", 2024-09-12T16:16:16.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5719999999999999e-06 2024-09-12T16:16:16.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.255 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.255 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336955+0000", 2024-09-12T16:16:16.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3640000000000002e-06 2024-09-12T16:16:16.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.255 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.256 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.359196+0000", 2024-09-12T16:16:16.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.02224046 2024-09-12T16:16:16.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.256 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.256 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.359282+0000", 2024-09-12T16:16:16.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6315000000000003e-05 2024-09-12T16:16:16.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.256 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.256 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.359386+0000", 2024-09-12T16:16:16.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000103834 2024-09-12T16:16:16.256 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.256 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.257 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.257 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:277 3.13 3:cf84a54d:::rbd_data.1155cf5be90e.0000000000000018:3 [read 2727936~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:16.257 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.336958+0000", 2024-09-12T16:16:16.257 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 13.885715344999999, 2024-09-12T16:16:16.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022572719000000002, 2024-09-12T16:16:16.257 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.257 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.257 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:16.257 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.257 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:16.257 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:16.257 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 277 2024-09-12T16:16:16.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.258 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.258 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336958+0000", 2024-09-12T16:16:16.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.258 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336958+0000", 2024-09-12T16:16:16.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.259 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.259 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336959+0000", 2024-09-12T16:16:16.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1400000000000001e-07 2024-09-12T16:16:16.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.259 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.259 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336960+0000", 2024-09-12T16:16:16.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5600000000000004e-07 2024-09-12T16:16:16.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.259 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.259 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336967+0000", 2024-09-12T16:16:16.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9430000000000003e-06 2024-09-12T16:16:16.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.260 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.260 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336969+0000", 2024-09-12T16:16:16.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6019999999999998e-06 2024-09-12T16:16:16.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.260 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.260 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.359421+0000", 2024-09-12T16:16:16.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022451665999999999 2024-09-12T16:16:16.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.260 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.260 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.359465+0000", 2024-09-12T16:16:16.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3906000000000003e-05 2024-09-12T16:16:16.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.261 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.261 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.359531+0000", 2024-09-12T16:16:16.261 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6432000000000004e-05 2024-09-12T16:16:16.261 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.261 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.261 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.261 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:278 3.13 3:cf84a54d:::rbd_data.1155cf5be90e.0000000000000018:3 [read 2834432~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:16.261 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.336974+0000", 2024-09-12T16:16:16.261 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 13.885700119999999, 2024-09-12T16:16:16.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022778666999999999, 2024-09-12T16:16:16.262 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.262 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.262 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:16.262 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.262 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:16.262 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:16.262 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 278 2024-09-12T16:16:16.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.262 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336974+0000", 2024-09-12T16:16:16.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.263 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.263 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.263 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336974+0000", 2024-09-12T16:16:16.263 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.263 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.263 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.263 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336974+0000", 2024-09-12T16:16:16.263 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.23e-07 2024-09-12T16:16:16.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.263 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.264 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.264 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336980+0000", 2024-09-12T16:16:16.264 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2600000000000002e-06 2024-09-12T16:16:16.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.264 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.264 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336983+0000", 2024-09-12T16:16:16.264 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3289999999999998e-06 2024-09-12T16:16:16.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.264 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.264 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336986+0000", 2024-09-12T16:16:16.264 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5770000000000001e-06 2024-09-12T16:16:16.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.359569+0000", 2024-09-12T16:16:16.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022583230999999999 2024-09-12T16:16:16.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.359650+0000", 2024-09-12T16:16:16.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1099000000000004e-05 2024-09-12T16:16:16.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.359752+0000", 2024-09-12T16:16:16.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010194799999999999 2024-09-12T16:16:16.266 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.266 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.266 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.266 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:279 3.13 3:cf84a54d:::rbd_data.1155cf5be90e.0000000000000018:3 [read 2940928~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:16.266 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.336990+0000", 2024-09-12T16:16:16.266 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 13.88568416, 2024-09-12T16:16:16.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022909026999999998, 2024-09-12T16:16:16.266 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.266 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.266 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:16.266 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.267 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:16.267 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:16.267 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 279 2024-09-12T16:16:16.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.267 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.267 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.267 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336990+0000", 2024-09-12T16:16:16.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.268 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.268 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336990+0000", 2024-09-12T16:16:16.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.268 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.268 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.268 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336990+0000", 2024-09-12T16:16:16.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4299999999999999e-07 2024-09-12T16:16:16.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.268 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.268 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.268 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336994+0000", 2024-09-12T16:16:16.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4839999999999998e-06 2024-09-12T16:16:16.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.269 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.269 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.269 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.336998+0000", 2024-09-12T16:16:16.269 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1669999999999999e-06 2024-09-12T16:16:16.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.269 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.269 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.269 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337000+0000", 2024-09-12T16:16:16.269 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.486e-06 2024-09-12T16:16:16.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.269 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.269 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.269 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.359794+0000", 2024-09-12T16:16:16.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022793798000000001 2024-09-12T16:16:16.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.270 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.270 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.359849+0000", 2024-09-12T16:16:16.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5269999999999998e-05 2024-09-12T16:16:16.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.270 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.271 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.359899+0000", 2024-09-12T16:16:16.271 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9579000000000001e-05 2024-09-12T16:16:16.271 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.271 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.271 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.271 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:280 3.13 3:cf84a54d:::rbd_data.1155cf5be90e.0000000000000018:3 [read 3047424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:16.271 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.337003+0000", 2024-09-12T16:16:16.271 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 13.885670339000001, 2024-09-12T16:16:16.271 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023012187, 2024-09-12T16:16:16.271 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.272 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.272 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:16.272 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.272 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:16.272 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:16.272 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 280 2024-09-12T16:16:16.272 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.272 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.272 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.272 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.272 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337003+0000", 2024-09-12T16:16:16.272 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.272 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.273 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.273 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337003+0000", 2024-09-12T16:16:16.273 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.273 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.273 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337004+0000", 2024-09-12T16:16:16.273 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3200000000000001e-07 2024-09-12T16:16:16.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.273 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.274 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337005+0000", 2024-09-12T16:16:16.274 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0470000000000001e-06 2024-09-12T16:16:16.274 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.274 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.274 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.274 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337008+0000", 2024-09-12T16:16:16.274 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9100000000000001e-06 2024-09-12T16:16:16.274 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.274 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.274 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.274 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337014+0000", 2024-09-12T16:16:16.274 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7689999999999999e-06 2024-09-12T16:16:16.274 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.275 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.275 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.275 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.359937+0000", 2024-09-12T16:16:16.275 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022922109999999999 2024-09-12T16:16:16.275 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.275 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.275 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.275 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.359975+0000", 2024-09-12T16:16:16.275 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8141e-05 2024-09-12T16:16:16.275 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.275 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.275 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.275 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360016+0000", 2024-09-12T16:16:16.275 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0978e-05 2024-09-12T16:16:16.276 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.276 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.276 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.276 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.276 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.276 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:281 3.13 3:cf84a54d:::rbd_data.1155cf5be90e.0000000000000018:3 [read 3153920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:16.276 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.337026+0000", 2024-09-12T16:16:16.276 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 13.885647702, 2024-09-12T16:16:16.276 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023094103000000001, 2024-09-12T16:16:16.276 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.276 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.276 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:16.276 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.277 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:16.277 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:16.277 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 281 2024-09-12T16:16:16.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.277 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.277 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.277 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.277 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337026+0000", 2024-09-12T16:16:16.277 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.277 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.277 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.278 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337026+0000", 2024-09-12T16:16:16.278 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.278 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.278 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.278 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.278 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337027+0000", 2024-09-12T16:16:16.278 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2899999999999999e-07 2024-09-12T16:16:16.278 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.278 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.278 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.278 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337028+0000", 2024-09-12T16:16:16.278 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4139999999999999e-06 2024-09-12T16:16:16.278 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.279 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.279 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.279 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337031+0000", 2024-09-12T16:16:16.279 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.428e-06 2024-09-12T16:16:16.279 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.279 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.279 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.279 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337034+0000", 2024-09-12T16:16:16.279 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.548e-06 2024-09-12T16:16:16.279 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.279 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.279 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.279 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360043+0000", 2024-09-12T16:16:16.279 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023008832999999999 2024-09-12T16:16:16.280 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.280 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.280 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.280 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360080+0000", 2024-09-12T16:16:16.280 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6906999999999997e-05 2024-09-12T16:16:16.280 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.280 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.280 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.280 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360120+0000", 2024-09-12T16:16:16.280 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0543999999999997e-05 2024-09-12T16:16:16.280 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.280 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.280 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.280 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.281 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.281 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:282 3.13 3:cf84a54d:::rbd_data.1155cf5be90e.0000000000000018:3 [read 3260416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:16.281 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.337039+0000", 2024-09-12T16:16:16.281 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 13.885634887, 2024-09-12T16:16:16.281 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023186377000000001, 2024-09-12T16:16:16.281 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.281 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.281 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:16.281 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.281 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:16.281 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:16.281 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 282 2024-09-12T16:16:16.281 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.281 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.282 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.282 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.282 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337039+0000", 2024-09-12T16:16:16.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.282 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.282 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.282 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337039+0000", 2024-09-12T16:16:16.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.282 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.282 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.282 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337039+0000", 2024-09-12T16:16:16.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2300000000000002e-07 2024-09-12T16:16:16.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.283 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.283 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.283 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337040+0000", 2024-09-12T16:16:16.283 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9699999999999994e-07 2024-09-12T16:16:16.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.283 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.283 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.283 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337043+0000", 2024-09-12T16:16:16.283 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9739999999999998e-06 2024-09-12T16:16:16.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.283 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.283 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.283 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337045+0000", 2024-09-12T16:16:16.284 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.283e-06 2024-09-12T16:16:16.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.284 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.284 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.284 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360148+0000", 2024-09-12T16:16:16.284 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023102139000000001 2024-09-12T16:16:16.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.284 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.284 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.284 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360184+0000", 2024-09-12T16:16:16.284 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6777999999999999e-05 2024-09-12T16:16:16.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.284 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.284 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.285 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360225+0000", 2024-09-12T16:16:16.285 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0883000000000001e-05 2024-09-12T16:16:16.285 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.285 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.285 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.285 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.286 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.286 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:283 3.13 3:cf84a54d:::rbd_data.1155cf5be90e.0000000000000018:3 [read 3366912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:16.286 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.337048+0000", 2024-09-12T16:16:16.286 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 13.885625367999999, 2024-09-12T16:16:16.286 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023293523, 2024-09-12T16:16:16.286 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.286 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.286 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:16.286 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.286 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:16.286 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:16.286 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 283 2024-09-12T16:16:16.286 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.286 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.287 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.287 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.287 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337048+0000", 2024-09-12T16:16:16.287 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.287 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.287 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.287 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.287 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337048+0000", 2024-09-12T16:16:16.287 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.287 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.287 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.287 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.288 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337049+0000", 2024-09-12T16:16:16.288 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0900000000000001e-07 2024-09-12T16:16:16.288 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.288 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.288 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.288 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337054+0000", 2024-09-12T16:16:16.288 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9980000000000003e-06 2024-09-12T16:16:16.288 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.288 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.289 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.289 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337061+0000", 2024-09-12T16:16:16.289 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1380000000000001e-06 2024-09-12T16:16:16.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.289 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.289 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.289 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337064+0000", 2024-09-12T16:16:16.289 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.331e-06 2024-09-12T16:16:16.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.289 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.289 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.289 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360259+0000", 2024-09-12T16:16:16.289 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023194889 2024-09-12T16:16:16.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.290 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.290 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.290 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360300+0000", 2024-09-12T16:16:16.290 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0967000000000003e-05 2024-09-12T16:16:16.290 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.290 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.290 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.290 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360342+0000", 2024-09-12T16:16:16.290 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1990999999999998e-05 2024-09-12T16:16:16.290 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.290 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.290 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.290 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.291 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.291 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:284 3.13 3:cf84a54d:::rbd_data.1155cf5be90e.0000000000000018:3 [read 3473408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:16.291 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.337068+0000", 2024-09-12T16:16:16.291 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 13.885605838, 2024-09-12T16:16:16.291 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023383406999999998, 2024-09-12T16:16:16.291 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.291 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.291 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:16.291 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.291 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:16.291 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:16.292 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 284 2024-09-12T16:16:16.292 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.292 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.292 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.292 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.292 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337068+0000", 2024-09-12T16:16:16.292 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.292 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.292 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.292 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.292 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337068+0000", 2024-09-12T16:16:16.292 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.293 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.293 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.293 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.293 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337068+0000", 2024-09-12T16:16:16.293 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5600000000000002e-07 2024-09-12T16:16:16.293 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.293 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.293 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.293 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337069+0000", 2024-09-12T16:16:16.293 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.02e-06 2024-09-12T16:16:16.293 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.293 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.293 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.294 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337072+0000", 2024-09-12T16:16:16.294 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1190000000000001e-06 2024-09-12T16:16:16.294 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.294 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.294 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.294 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337079+0000", 2024-09-12T16:16:16.294 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3049999999999998e-06 2024-09-12T16:16:16.294 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.294 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.294 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.294 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360371+0000", 2024-09-12T16:16:16.294 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023292622999999998 2024-09-12T16:16:16.294 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.295 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.295 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.295 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360410+0000", 2024-09-12T16:16:16.295 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.862e-05 2024-09-12T16:16:16.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.295 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.295 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.295 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360451+0000", 2024-09-12T16:16:16.295 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1464000000000001e-05 2024-09-12T16:16:16.295 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.295 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.295 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.295 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.295 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:285 3.13 3:cf84a54d:::rbd_data.1155cf5be90e.0000000000000018:3 [read 3579904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:16.296 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.337082+0000", 2024-09-12T16:16:16.296 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 13.885591834, 2024-09-12T16:16:16.296 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.02350087, 2024-09-12T16:16:16.296 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.296 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.296 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:16.296 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.296 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:16.296 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:16.296 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 285 2024-09-12T16:16:16.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.296 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.297 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.297 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.297 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337082+0000", 2024-09-12T16:16:16.297 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.297 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.297 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.297 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.297 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337082+0000", 2024-09-12T16:16:16.297 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.297 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.297 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.297 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.297 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337082+0000", 2024-09-12T16:16:16.297 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4600000000000001e-07 2024-09-12T16:16:16.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.298 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.298 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.298 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337083+0000", 2024-09-12T16:16:16.298 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0100000000000001e-06 2024-09-12T16:16:16.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.298 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.298 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.298 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337086+0000", 2024-09-12T16:16:16.298 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0189999999999998e-06 2024-09-12T16:16:16.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.299 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.299 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.299 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337088+0000", 2024-09-12T16:16:16.299 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2759999999999999e-06 2024-09-12T16:16:16.299 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.299 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.299 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.299 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360481+0000", 2024-09-12T16:16:16.299 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023392857 2024-09-12T16:16:16.299 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.299 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.299 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.299 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360527+0000", 2024-09-12T16:16:16.299 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5624999999999998e-05 2024-09-12T16:16:16.299 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.300 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.300 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.300 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360583+0000", 2024-09-12T16:16:16.300 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5837000000000001e-05 2024-09-12T16:16:16.300 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.300 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.300 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.300 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.300 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.300 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:286 3.13 3:cf84a54d:::rbd_data.1155cf5be90e.0000000000000018:3 [read 3686400~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:16.301 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.337091+0000", 2024-09-12T16:16:16.301 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 13.885582382999999, 2024-09-12T16:16:16.301 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023618453000000001, 2024-09-12T16:16:16.301 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.301 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.301 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:16.301 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.301 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:16.301 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:16.301 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 286 2024-09-12T16:16:16.301 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.301 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.301 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.301 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.302 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337091+0000", 2024-09-12T16:16:16.302 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.302 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.302 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.302 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337091+0000", 2024-09-12T16:16:16.302 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.302 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.302 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.302 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337092+0000", 2024-09-12T16:16:16.302 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0900000000000001e-07 2024-09-12T16:16:16.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.303 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.303 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.303 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337093+0000", 2024-09-12T16:16:16.303 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2600000000000001e-07 2024-09-12T16:16:16.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.303 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.303 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.304 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337095+0000", 2024-09-12T16:16:16.304 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8279999999999999e-06 2024-09-12T16:16:16.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.304 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.304 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.304 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337098+0000", 2024-09-12T16:16:16.304 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2390000000000001e-06 2024-09-12T16:16:16.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.304 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.304 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.304 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360618+0000", 2024-09-12T16:16:16.304 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023520077 2024-09-12T16:16:16.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.305 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.305 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.305 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360667+0000", 2024-09-12T16:16:16.305 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9008000000000002e-05 2024-09-12T16:16:16.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.305 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.305 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.305 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360710+0000", 2024-09-12T16:16:16.305 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3166e-05 2024-09-12T16:16:16.305 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.305 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.305 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.305 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.306 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:287 3.13 3:cf84a54d:::rbd_data.1155cf5be90e.0000000000000018:3 [read 3792896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:16.306 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.337100+0000", 2024-09-12T16:16:16.306 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 13.885573282999999, 2024-09-12T16:16:16.306 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023723867999999999, 2024-09-12T16:16:16.306 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.306 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.306 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:16.306 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.306 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:16.306 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:16.306 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 287 2024-09-12T16:16:16.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.306 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.306 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.307 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.307 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337100+0000", 2024-09-12T16:16:16.307 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.307 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.307 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.307 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337100+0000", 2024-09-12T16:16:16.307 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.307 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.307 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.307 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337101+0000", 2024-09-12T16:16:16.307 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3300000000000001e-07 2024-09-12T16:16:16.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.308 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337102+0000", 2024-09-12T16:16:16.308 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0500000000000002e-07 2024-09-12T16:16:16.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.308 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337104+0000", 2024-09-12T16:16:16.308 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8329999999999998e-06 2024-09-12T16:16:16.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.308 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337107+0000", 2024-09-12T16:16:16.308 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3819999999999998e-06 2024-09-12T16:16:16.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360740+0000", 2024-09-12T16:16:16.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023632980000000001 2024-09-12T16:16:16.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360782+0000", 2024-09-12T16:16:16.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2502000000000001e-05 2024-09-12T16:16:16.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.310 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360824+0000", 2024-09-12T16:16:16.310 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2033000000000002e-05 2024-09-12T16:16:16.310 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.310 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.310 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.310 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.310 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:288 3.13 3:cf84a54d:::rbd_data.1155cf5be90e.0000000000000018:3 [read 3899392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:16.310 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.337125+0000", 2024-09-12T16:16:16.310 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 13.88554897, 2024-09-12T16:16:16.310 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023816223000000001, 2024-09-12T16:16:16.310 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.310 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.311 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:16.311 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.311 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:16.311 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:16.311 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 288 2024-09-12T16:16:16.311 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.311 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.311 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.311 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.311 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337125+0000", 2024-09-12T16:16:16.311 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.311 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.311 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.312 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.312 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337125+0000", 2024-09-12T16:16:16.312 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.312 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.312 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.312 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337125+0000", 2024-09-12T16:16:16.312 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0900000000000002e-07 2024-09-12T16:16:16.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.312 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.312 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.312 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337126+0000", 2024-09-12T16:16:16.312 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2100000000000001e-06 2024-09-12T16:16:16.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.313 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.313 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.313 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337130+0000", 2024-09-12T16:16:16.313 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3459999999999998e-06 2024-09-12T16:16:16.313 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.313 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.313 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.313 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337133+0000", 2024-09-12T16:16:16.313 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1410000000000001e-06 2024-09-12T16:16:16.313 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.313 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.313 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.313 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360858+0000", 2024-09-12T16:16:16.313 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023725370999999999 2024-09-12T16:16:16.314 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.314 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.314 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.314 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360899+0000", 2024-09-12T16:16:16.314 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0828000000000003e-05 2024-09-12T16:16:16.314 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.314 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.314 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.314 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360941+0000", 2024-09-12T16:16:16.314 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1918000000000001e-05 2024-09-12T16:16:16.314 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.314 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.314 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.315 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.315 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.315 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:289 3.13 3:cf84a54d:::rbd_data.1155cf5be90e.0000000000000018:3 [read 4005888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:16.315 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.337136+0000", 2024-09-12T16:16:16.315 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 13.88553757, 2024-09-12T16:16:16.315 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023916468, 2024-09-12T16:16:16.315 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.315 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.315 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:16.315 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.315 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:16.315 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:16.315 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 289 2024-09-12T16:16:16.315 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.316 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.316 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.316 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337136+0000", 2024-09-12T16:16:16.316 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.316 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.316 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337136+0000", 2024-09-12T16:16:16.316 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.316 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.316 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337137+0000", 2024-09-12T16:16:16.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0899999999999997e-07 2024-09-12T16:16:16.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.317 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.317 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337142+0000", 2024-09-12T16:16:16.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1549999999999998e-06 2024-09-12T16:16:16.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.317 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.317 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337149+0000", 2024-09-12T16:16:16.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8730000000000001e-06 2024-09-12T16:16:16.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.318 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.318 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337151+0000", 2024-09-12T16:16:16.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6910000000000002e-06 2024-09-12T16:16:16.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.318 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.318 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.360971+0000", 2024-09-12T16:16:16.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023819395 2024-09-12T16:16:16.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.318 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.318 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.361011+0000", 2024-09-12T16:16:16.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0571000000000002e-05 2024-09-12T16:16:16.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.319 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.319 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.319 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.361053+0000", 2024-09-12T16:16:16.319 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1474000000000003e-05 2024-09-12T16:16:16.319 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.319 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.319 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.319 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.319 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4442.0:290 3.13 3:cf84a54d:::rbd_data.1155cf5be90e.0000000000000018:3 [read 4112384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:16.319 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:02.337155+0000", 2024-09-12T16:16:16.319 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 13.885518653, 2024-09-12T16:16:16.320 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023997344, 2024-09-12T16:16:16.320 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.320 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.320 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:16.320 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.320 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4442", 2024-09-12T16:16:16.320 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:16.320 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 290 2024-09-12T16:16:16.320 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.320 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.320 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.320 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.320 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337155+0000", 2024-09-12T16:16:16.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.321 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.321 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.321 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337155+0000", 2024-09-12T16:16:16.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.321 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.321 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.321 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337155+0000", 2024-09-12T16:16:16.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4999999999999999e-07 2024-09-12T16:16:16.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.321 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.321 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.322 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337156+0000", 2024-09-12T16:16:16.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.127e-06 2024-09-12T16:16:16.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.322 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337160+0000", 2024-09-12T16:16:16.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0469999999999998e-06 2024-09-12T16:16:16.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.323 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.337162+0000", 2024-09-12T16:16:16.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.328e-06 2024-09-12T16:16:16.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.323 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.323 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.361073+0000", 2024-09-12T16:16:16.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023911000000000002 2024-09-12T16:16:16.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.324 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.324 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.324 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.361111+0000", 2024-09-12T16:16:16.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7642000000000003e-05 2024-09-12T16:16:16.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.324 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.325 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.325 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:02.361152+0000", 2024-09-12T16:16:16.325 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1950000000000003e-05 2024-09-12T16:16:16.325 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.325 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.325 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.325 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.325 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.325 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:16.327 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:16:16.327 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:16.326+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:16.330 INFO:teuthology.orchestra.run.smithi047.stderr:Exporting 3.1d info 3.1d( v 33'59 (0'0,33'59] local-lis/les=27/28 n=10 ec=21/21 lis/c=27/27 les/c/f=28/28/0 sis=27) 2024-09-12T16:16:16.330 INFO:teuthology.orchestra.run.smithi047.stderr:Read #3:b81e017c:::rbd_data.11551fa285fd.000000000000000c:5# 2024-09-12T16:16:16.336 INFO:teuthology.orchestra.run.smithi047.stderr:Read #3:b81e017c:::rbd_data.11551fa285fd.000000000000000c:head# 2024-09-12T16:16:16.336 INFO:teuthology.orchestra.run.smithi047.stderr:Read #3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5# 2024-09-12T16:16:16.340 INFO:teuthology.orchestra.run.smithi047.stderr:Read #3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:head# 2024-09-12T16:16:16.340 INFO:teuthology.orchestra.run.smithi047.stderr:Read #3:badfac2e:::rbd_data.1155cf5be90e.000000000000001d:head# 2024-09-12T16:16:16.341 INFO:teuthology.orchestra.run.smithi047.stderr:Read #3:bbcb2eee:::rbd_data.11557ed36bb5.000000000000004b:head# 2024-09-12T16:16:16.341 INFO:teuthology.orchestra.run.smithi047.stderr:Read #3:bc99b8b6:::rbd_data.11551fa285fd.0000000000000008:5# 2024-09-12T16:16:16.343 INFO:teuthology.orchestra.run.smithi047.stderr:Read #3:bc99b8b6:::rbd_data.11551fa285fd.0000000000000008:head# 2024-09-12T16:16:16.343 INFO:teuthology.orchestra.run.smithi047.stderr:Read #3:bd04f1e3:::rbd_data.11557ed36bb5.000000000000016b:head# 2024-09-12T16:16:16.343 INFO:teuthology.orchestra.run.smithi047.stderr:Read #3:bfbdd201:::rbd_data.11557ed36bb5.0000000000000007:head# 2024-09-12T16:16:16.343 INFO:teuthology.orchestra.run.smithi047.stderr:Export successful 2024-09-12T16:16:16.428 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:16.427+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:16.436 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:16.437 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:16:16.437 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:16:16.437 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:16.445 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:16:16.528 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:16.528+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:16.593 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:16.593 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:16:16.593 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:16:16.593 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:16:16.593 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:16.601 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:16:16.618 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-5 --journal-path /var/lib/ceph/osd/ceph-5/journal --force --op remove --pgid 3.1d 2024-09-12T16:16:16.629 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:16.628+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:16.711 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:16.711 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:16:16.712 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:16:16.712 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:16:16.712 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.712 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:410 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 4980736~10240] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:16.712 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276382+0000", 2024-09-12T16:16:16.712 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.4336758849999995, 2024-09-12T16:16:16.712 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012018983, 2024-09-12T16:16:16.712 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.712 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.712 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:16.713 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.713 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:16.713 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:16.713 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 410 2024-09-12T16:16:16.713 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.713 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.713 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.713 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.713 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276382+0000", 2024-09-12T16:16:16.713 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.713 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.713 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.714 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.714 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276382+0000", 2024-09-12T16:16:16.714 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.714 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.714 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.714 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276382+0000", 2024-09-12T16:16:16.714 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.03e-07 2024-09-12T16:16:16.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.714 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.714 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.714 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276383+0000", 2024-09-12T16:16:16.715 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.037e-06 2024-09-12T16:16:16.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.715 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.715 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.715 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276386+0000", 2024-09-12T16:16:16.715 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1140000000000002e-06 2024-09-12T16:16:16.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.715 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.715 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.715 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276389+0000", 2024-09-12T16:16:16.715 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5040000000000001e-06 2024-09-12T16:16:16.716 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.716 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.716 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.716 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.288177+0000", 2024-09-12T16:16:16.716 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011788495 2024-09-12T16:16:16.716 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.716 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.716 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.716 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.288227+0000", 2024-09-12T16:16:16.716 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.956e-05 2024-09-12T16:16:16.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.717 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.717 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.717 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.288401+0000", 2024-09-12T16:16:16.717 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017406999999999999 2024-09-12T16:16:16.717 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.717 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.717 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.717 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.717 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:411 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 6029312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:16.718 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276392+0000", 2024-09-12T16:16:16.718 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.4336659110000003, 2024-09-12T16:16:16.718 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012131591000000001, 2024-09-12T16:16:16.718 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.718 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.718 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:16.718 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.718 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:16.718 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:16.718 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 411 2024-09-12T16:16:16.718 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.719 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.719 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.719 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.719 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276392+0000", 2024-09-12T16:16:16.719 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.719 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.719 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.719 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276392+0000", 2024-09-12T16:16:16.719 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.719 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.720 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.720 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276392+0000", 2024-09-12T16:16:16.720 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0599999999999999e-07 2024-09-12T16:16:16.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.720 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.720 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.720 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276393+0000", 2024-09-12T16:16:16.720 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0330000000000001e-06 2024-09-12T16:16:16.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.720 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.720 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.721 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276396+0000", 2024-09-12T16:16:16.721 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9610000000000001e-06 2024-09-12T16:16:16.721 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.721 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.721 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.721 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276399+0000", 2024-09-12T16:16:16.721 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5660000000000001e-06 2024-09-12T16:16:16.721 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.721 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.721 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.721 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.288417+0000", 2024-09-12T16:16:16.721 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012018722000000001 2024-09-12T16:16:16.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.722 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.722 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.722 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.288472+0000", 2024-09-12T16:16:16.722 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4286000000000002e-05 2024-09-12T16:16:16.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.722 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.722 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.722 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.288523+0000", 2024-09-12T16:16:16.722 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1817000000000002e-05 2024-09-12T16:16:16.722 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.722 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.723 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.723 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.723 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:412 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 7077888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:16.723 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276403+0000", 2024-09-12T16:16:16.723 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.4336546670000008, 2024-09-12T16:16:16.723 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012256773, 2024-09-12T16:16:16.723 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.723 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.723 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:16.723 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.723 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:16.724 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:16.724 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 412 2024-09-12T16:16:16.724 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.724 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.724 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.724 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.724 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276403+0000", 2024-09-12T16:16:16.724 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.724 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.724 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.724 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.724 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276403+0000", 2024-09-12T16:16:16.725 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.725 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.725 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.725 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276403+0000", 2024-09-12T16:16:16.725 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1e-07 2024-09-12T16:16:16.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.725 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.725 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.725 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276405+0000", 2024-09-12T16:16:16.725 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3260000000000001e-06 2024-09-12T16:16:16.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.726 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.726 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.726 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276408+0000", 2024-09-12T16:16:16.726 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7249999999999999e-06 2024-09-12T16:16:16.726 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.726 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.726 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.726 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276411+0000", 2024-09-12T16:16:16.726 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4480000000000001e-06 2024-09-12T16:16:16.726 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.726 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.726 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.288551+0000", 2024-09-12T16:16:16.727 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012140275000000001 2024-09-12T16:16:16.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.727 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.288605+0000", 2024-09-12T16:16:16.727 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3956999999999999e-05 2024-09-12T16:16:16.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.727 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.288660+0000", 2024-09-12T16:16:16.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4832e-05 2024-09-12T16:16:16.728 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.728 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.728 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.728 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.728 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.728 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:413 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 8126464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:16.728 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276414+0000", 2024-09-12T16:16:16.728 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.433643687, 2024-09-12T16:16:16.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012366298, 2024-09-12T16:16:16.728 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.729 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.729 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:16.729 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.729 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:16.729 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:16.729 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 413 2024-09-12T16:16:16.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.729 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.729 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.729 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.729 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276414+0000", 2024-09-12T16:16:16.729 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.730 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.730 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276414+0000", 2024-09-12T16:16:16.730 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.730 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.730 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276414+0000", 2024-09-12T16:16:16.730 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3300000000000001e-07 2024-09-12T16:16:16.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.731 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.731 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276415+0000", 2024-09-12T16:16:16.731 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1000000000000001e-06 2024-09-12T16:16:16.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.731 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.731 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276419+0000", 2024-09-12T16:16:16.731 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.659e-06 2024-09-12T16:16:16.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.731 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276422+0000", 2024-09-12T16:16:16.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.43e-06 2024-09-12T16:16:16.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.288675+0000", 2024-09-12T16:16:16.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012253811999999999 2024-09-12T16:16:16.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.288713+0000", 2024-09-12T16:16:16.733 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7347e-05 2024-09-12T16:16:16.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.733 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.733 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.736 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.288780+0000", 2024-09-12T16:16:16.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7717000000000002e-05 2024-09-12T16:16:16.736 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.736 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.736 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.736 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.736 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:422 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 917504~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:16.737 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276425+0000", 2024-09-12T16:16:16.737 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.4336331139999992, 2024-09-12T16:16:16.737 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012485105, 2024-09-12T16:16:16.737 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.737 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.737 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:16.737 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.737 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:16.737 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:16.737 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 422 2024-09-12T16:16:16.737 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.737 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.737 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.737 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.738 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276425+0000", 2024-09-12T16:16:16.738 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.738 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.738 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.738 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276425+0000", 2024-09-12T16:16:16.738 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.738 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.738 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.738 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276425+0000", 2024-09-12T16:16:16.738 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.23e-07 2024-09-12T16:16:16.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.738 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276426+0000", 2024-09-12T16:16:16.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.083e-06 2024-09-12T16:16:16.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276429+0000", 2024-09-12T16:16:16.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9519999999999999e-06 2024-09-12T16:16:16.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276431+0000", 2024-09-12T16:16:16.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4499999999999998e-06 2024-09-12T16:16:16.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.740 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.740 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.740 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.288809+0000", 2024-09-12T16:16:16.740 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012377505 2024-09-12T16:16:16.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.740 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.740 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.740 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.288853+0000", 2024-09-12T16:16:16.740 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3816000000000002e-05 2024-09-12T16:16:16.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.740 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.740 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.740 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.288910+0000", 2024-09-12T16:16:16.740 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7076e-05 2024-09-12T16:16:16.741 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.741 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.741 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.741 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.741 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:423 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 1966080~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:16.741 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276434+0000", 2024-09-12T16:16:16.741 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.4336232879999997, 2024-09-12T16:16:16.741 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012594595, 2024-09-12T16:16:16.741 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.741 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.741 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:16.741 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.741 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:16.742 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:16.742 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 423 2024-09-12T16:16:16.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.742 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.742 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.742 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276434+0000", 2024-09-12T16:16:16.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276434+0000", 2024-09-12T16:16:16.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.743 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276435+0000", 2024-09-12T16:16:16.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7099999999999997e-07 2024-09-12T16:16:16.743 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276436+0000", 2024-09-12T16:16:16.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.192e-06 2024-09-12T16:16:16.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.744 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.744 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276439+0000", 2024-09-12T16:16:16.744 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0489999999999999e-06 2024-09-12T16:16:16.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.744 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.744 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276442+0000", 2024-09-12T16:16:16.744 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4980000000000001e-06 2024-09-12T16:16:16.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.744 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.744 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.288925+0000", 2024-09-12T16:16:16.745 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012482926 2024-09-12T16:16:16.745 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.745 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.745 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.745 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.288966+0000", 2024-09-12T16:16:16.745 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1349e-05 2024-09-12T16:16:16.745 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.745 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.745 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.745 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289029+0000", 2024-09-12T16:16:16.745 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.321e-05 2024-09-12T16:16:16.745 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.745 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.746 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.746 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.746 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:424 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 3014656~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:16.746 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276457+0000", 2024-09-12T16:16:16.746 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.4336009539999992, 2024-09-12T16:16:16.746 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012696107, 2024-09-12T16:16:16.746 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.746 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.746 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:16.746 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.746 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:16.746 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:16.746 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 424 2024-09-12T16:16:16.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.747 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.747 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276457+0000", 2024-09-12T16:16:16.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.747 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276457+0000", 2024-09-12T16:16:16.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.748 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276457+0000", 2024-09-12T16:16:16.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7000000000000001e-07 2024-09-12T16:16:16.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.748 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.748 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276459+0000", 2024-09-12T16:16:16.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.48e-06 2024-09-12T16:16:16.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.748 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.748 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276463+0000", 2024-09-12T16:16:16.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9809999999999997e-06 2024-09-12T16:16:16.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.748 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276465+0000", 2024-09-12T16:16:16.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.576e-06 2024-09-12T16:16:16.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.749 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.749 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289055+0000", 2024-09-12T16:16:16.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012589622 2024-09-12T16:16:16.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.749 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.749 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289096+0000", 2024-09-12T16:16:16.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1319000000000002e-05 2024-09-12T16:16:16.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.749 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.750 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.750 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289153+0000", 2024-09-12T16:16:16.750 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6858999999999999e-05 2024-09-12T16:16:16.750 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.750 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.750 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.750 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.750 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.750 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:425 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 4063232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:16.750 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276468+0000", 2024-09-12T16:16:16.750 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.4335893320000004, 2024-09-12T16:16:16.750 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012839615, 2024-09-12T16:16:16.750 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.750 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.750 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:16.751 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.751 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:16.751 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:16.751 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 425 2024-09-12T16:16:16.751 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.751 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.751 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.751 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.751 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276468+0000", 2024-09-12T16:16:16.751 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.751 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.751 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.751 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.751 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276468+0000", 2024-09-12T16:16:16.752 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.752 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.752 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.752 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276469+0000", 2024-09-12T16:16:16.752 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0900000000000001e-07 2024-09-12T16:16:16.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.752 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.752 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.752 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276470+0000", 2024-09-12T16:16:16.752 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.141e-06 2024-09-12T16:16:16.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.752 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.752 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.753 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276473+0000", 2024-09-12T16:16:16.753 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.915e-06 2024-09-12T16:16:16.753 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.753 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.753 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.753 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276475+0000", 2024-09-12T16:16:16.753 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4600000000000002e-06 2024-09-12T16:16:16.753 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.753 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.753 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.753 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289185+0000", 2024-09-12T16:16:16.753 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012709644000000001 2024-09-12T16:16:16.753 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.753 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.754 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.754 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289251+0000", 2024-09-12T16:16:16.754 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6056000000000006e-05 2024-09-12T16:16:16.754 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.754 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.754 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.754 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289308+0000", 2024-09-12T16:16:16.754 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.719e-05 2024-09-12T16:16:16.754 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.754 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.754 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.754 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.754 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.754 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:426 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 5111808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:16.755 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276478+0000", 2024-09-12T16:16:16.755 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.4335794780000004, 2024-09-12T16:16:16.755 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012963234000000001, 2024-09-12T16:16:16.755 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.755 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.755 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:16.755 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.755 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:16.755 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:16.755 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 426 2024-09-12T16:16:16.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.755 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.755 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.756 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.756 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276478+0000", 2024-09-12T16:16:16.756 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.756 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.756 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.756 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.756 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276478+0000", 2024-09-12T16:16:16.756 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.756 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.756 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.756 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.756 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276479+0000", 2024-09-12T16:16:16.756 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.72e-07 2024-09-12T16:16:16.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.757 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.757 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.757 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276480+0000", 2024-09-12T16:16:16.757 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.049e-06 2024-09-12T16:16:16.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.757 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.757 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.757 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276483+0000", 2024-09-12T16:16:16.757 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0539999999999999e-06 2024-09-12T16:16:16.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.757 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.757 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.758 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276487+0000", 2024-09-12T16:16:16.758 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3170000000000003e-06 2024-09-12T16:16:16.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.758 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.758 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.758 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289339+0000", 2024-09-12T16:16:16.758 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012852397999999999 2024-09-12T16:16:16.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.758 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.758 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.758 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289383+0000", 2024-09-12T16:16:16.758 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3846e-05 2024-09-12T16:16:16.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.758 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.759 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.759 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289442+0000", 2024-09-12T16:16:16.759 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8298000000000003e-05 2024-09-12T16:16:16.759 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.759 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.759 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.759 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.759 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.759 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:427 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 6160384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:16.759 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276490+0000", 2024-09-12T16:16:16.759 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.4335674449999996, 2024-09-12T16:16:16.759 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013114918, 2024-09-12T16:16:16.759 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.759 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.760 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:16.760 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.760 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:16.760 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:16.760 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 427 2024-09-12T16:16:16.760 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.760 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.760 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.760 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.760 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276490+0000", 2024-09-12T16:16:16.760 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.760 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.760 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.760 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.761 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276490+0000", 2024-09-12T16:16:16.761 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.761 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.761 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.761 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276491+0000", 2024-09-12T16:16:16.761 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2000000000000001e-07 2024-09-12T16:16:16.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.761 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.761 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.761 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276492+0000", 2024-09-12T16:16:16.761 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1060000000000001e-06 2024-09-12T16:16:16.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.762 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.762 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.762 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276496+0000", 2024-09-12T16:16:16.762 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.313e-06 2024-09-12T16:16:16.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.762 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.762 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.762 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276499+0000", 2024-09-12T16:16:16.762 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5280000000000002e-06 2024-09-12T16:16:16.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.762 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.762 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.762 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289468+0000", 2024-09-12T16:16:16.762 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012969100000000001 2024-09-12T16:16:16.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.763 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.763 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.763 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289509+0000", 2024-09-12T16:16:16.763 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1455000000000002e-05 2024-09-12T16:16:16.763 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.763 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.763 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.763 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289605+0000", 2024-09-12T16:16:16.763 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6195999999999999e-05 2024-09-12T16:16:16.763 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.763 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.763 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.763 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.763 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.764 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:428 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 7208960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:16.764 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276502+0000", 2024-09-12T16:16:16.764 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.4335561749999997, 2024-09-12T16:16:16.764 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013220071999999999, 2024-09-12T16:16:16.764 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.764 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.764 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:16.764 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.764 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:16.764 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:16.764 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 428 2024-09-12T16:16:16.764 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.764 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.764 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.765 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.765 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276502+0000", 2024-09-12T16:16:16.765 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.765 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.765 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.765 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276502+0000", 2024-09-12T16:16:16.765 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.765 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.765 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.765 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276502+0000", 2024-09-12T16:16:16.765 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.11e-07 2024-09-12T16:16:16.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.766 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276509+0000", 2024-09-12T16:16:16.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2899999999999997e-06 2024-09-12T16:16:16.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.766 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276513+0000", 2024-09-12T16:16:16.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6679999999999999e-06 2024-09-12T16:16:16.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.766 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276515+0000", 2024-09-12T16:16:16.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6620000000000001e-06 2024-09-12T16:16:16.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.767 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.767 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.767 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289632+0000", 2024-09-12T16:16:16.767 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013116777 2024-09-12T16:16:16.767 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.767 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.767 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.767 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289672+0000", 2024-09-12T16:16:16.767 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0086000000000002e-05 2024-09-12T16:16:16.767 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.767 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.767 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.767 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289722+0000", 2024-09-12T16:16:16.767 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9378000000000001e-05 2024-09-12T16:16:16.768 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.768 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.768 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.768 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.768 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.768 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:429 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 8257536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:16.768 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276520+0000", 2024-09-12T16:16:16.768 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.433537737, 2024-09-12T16:16:16.768 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013323707000000001, 2024-09-12T16:16:16.768 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.768 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.768 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:16.768 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.769 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:16.769 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:16.769 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 429 2024-09-12T16:16:16.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.769 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.769 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.769 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276520+0000", 2024-09-12T16:16:16.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.769 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.769 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276520+0000", 2024-09-12T16:16:16.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.770 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.770 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276520+0000", 2024-09-12T16:16:16.770 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4400000000000001e-07 2024-09-12T16:16:16.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.770 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.770 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276522+0000", 2024-09-12T16:16:16.770 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2470000000000001e-06 2024-09-12T16:16:16.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.770 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.770 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276525+0000", 2024-09-12T16:16:16.771 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.072e-06 2024-09-12T16:16:16.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.771 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.771 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.771 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276527+0000", 2024-09-12T16:16:16.771 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4990000000000001e-06 2024-09-12T16:16:16.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.771 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.771 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.771 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289748+0000", 2024-09-12T16:16:16.771 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013220786999999999 2024-09-12T16:16:16.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.771 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.771 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.772 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289787+0000", 2024-09-12T16:16:16.772 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9487999999999999e-05 2024-09-12T16:16:16.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.772 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.772 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289844+0000", 2024-09-12T16:16:16.772 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6369999999999997e-05 2024-09-12T16:16:16.772 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.772 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.772 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.772 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:438 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 983040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:16.773 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276530+0000", 2024-09-12T16:16:16.773 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.4335274790000003, 2024-09-12T16:16:16.773 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01344703, 2024-09-12T16:16:16.773 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.773 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.773 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:16.773 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.773 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:16.773 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:16.773 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 438 2024-09-12T16:16:16.773 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.773 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.773 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.773 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.774 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276530+0000", 2024-09-12T16:16:16.774 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.774 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.774 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.774 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276530+0000", 2024-09-12T16:16:16.774 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.774 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.774 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.774 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276531+0000", 2024-09-12T16:16:16.774 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2100000000000001e-07 2024-09-12T16:16:16.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.774 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.774 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.775 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276532+0000", 2024-09-12T16:16:16.775 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.031e-06 2024-09-12T16:16:16.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.775 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.775 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276535+0000", 2024-09-12T16:16:16.775 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9689999999999999e-06 2024-09-12T16:16:16.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.775 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.775 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276537+0000", 2024-09-12T16:16:16.775 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4899999999999999e-06 2024-09-12T16:16:16.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.776 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.776 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289873+0000", 2024-09-12T16:16:16.776 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01333559 2024-09-12T16:16:16.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.776 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.776 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289917+0000", 2024-09-12T16:16:16.776 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4357999999999998e-05 2024-09-12T16:16:16.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.776 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.776 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.289977+0000", 2024-09-12T16:16:16.776 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0371000000000002e-05 2024-09-12T16:16:16.777 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.777 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.777 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.777 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.777 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:439 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 2031616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:16.777 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276540+0000", 2024-09-12T16:16:16.777 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.4335177170000009, 2024-09-12T16:16:16.777 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013579582, 2024-09-12T16:16:16.777 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.777 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.777 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:16.777 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.777 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:16.778 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:16.778 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 439 2024-09-12T16:16:16.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.778 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.778 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.778 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276540+0000", 2024-09-12T16:16:16.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.778 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.778 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276540+0000", 2024-09-12T16:16:16.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276540+0000", 2024-09-12T16:16:16.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0800000000000001e-07 2024-09-12T16:16:16.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276541+0000", 2024-09-12T16:16:16.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7499999999999998e-07 2024-09-12T16:16:16.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276544+0000", 2024-09-12T16:16:16.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.914e-06 2024-09-12T16:16:16.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.780 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.780 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.780 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276547+0000", 2024-09-12T16:16:16.780 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2949999999999998e-06 2024-09-12T16:16:16.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.780 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.780 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.780 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.290008+0000", 2024-09-12T16:16:16.780 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013460877 2024-09-12T16:16:16.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.780 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.780 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.780 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.290051+0000", 2024-09-12T16:16:16.781 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2202e-05 2024-09-12T16:16:16.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.781 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.781 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.781 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.290120+0000", 2024-09-12T16:16:16.781 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9110999999999996e-05 2024-09-12T16:16:16.781 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.781 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.781 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.781 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.781 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:440 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 3080192~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:16.781 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276551+0000", 2024-09-12T16:16:16.781 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.4335072610000008, 2024-09-12T16:16:16.782 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013714561, 2024-09-12T16:16:16.782 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.782 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.782 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:16.782 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.782 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:16.782 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:16.782 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 440 2024-09-12T16:16:16.782 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.782 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.782 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.782 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.782 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276551+0000", 2024-09-12T16:16:16.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.783 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.783 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276551+0000", 2024-09-12T16:16:16.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.783 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.783 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276551+0000", 2024-09-12T16:16:16.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1400000000000001e-07 2024-09-12T16:16:16.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.783 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.784 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276552+0000", 2024-09-12T16:16:16.784 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0130000000000001e-06 2024-09-12T16:16:16.784 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.784 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.784 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.784 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276559+0000", 2024-09-12T16:16:16.784 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0369999999999997e-06 2024-09-12T16:16:16.784 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.784 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.784 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.784 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276561+0000", 2024-09-12T16:16:16.784 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6429999999999999e-06 2024-09-12T16:16:16.784 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.784 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.785 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.785 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.290156+0000", 2024-09-12T16:16:16.785 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013594119999999999 2024-09-12T16:16:16.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.785 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.785 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.785 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.290197+0000", 2024-09-12T16:16:16.785 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1658e-05 2024-09-12T16:16:16.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.785 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.785 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.785 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.290265+0000", 2024-09-12T16:16:16.785 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7875999999999999e-05 2024-09-12T16:16:16.785 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.786 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.786 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.786 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.786 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:441 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 4128768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:16.786 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276567+0000", 2024-09-12T16:16:16.786 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.4334908360000007, 2024-09-12T16:16:16.786 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013845537, 2024-09-12T16:16:16.786 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.786 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.786 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:16.786 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.786 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:16.786 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:16.787 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 441 2024-09-12T16:16:16.787 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.787 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.787 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.787 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.787 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276567+0000", 2024-09-12T16:16:16.787 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.787 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.787 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.787 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.787 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276567+0000", 2024-09-12T16:16:16.787 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.787 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.787 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.788 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.788 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276567+0000", 2024-09-12T16:16:16.788 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3099999999999999e-07 2024-09-12T16:16:16.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.788 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.788 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.788 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276568+0000", 2024-09-12T16:16:16.788 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.186e-06 2024-09-12T16:16:16.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.788 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.788 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.788 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276572+0000", 2024-09-12T16:16:16.788 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2629999999999999e-06 2024-09-12T16:16:16.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.789 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.789 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.789 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276574+0000", 2024-09-12T16:16:16.789 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.43e-06 2024-09-12T16:16:16.789 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.789 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.789 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.789 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.290296+0000", 2024-09-12T16:16:16.789 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013721880000000001 2024-09-12T16:16:16.789 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.789 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.789 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.789 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.290352+0000", 2024-09-12T16:16:16.790 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6305999999999999e-05 2024-09-12T16:16:16.790 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.790 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.790 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.790 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.290412+0000", 2024-09-12T16:16:16.790 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0241000000000001e-05 2024-09-12T16:16:16.790 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.790 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.790 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.790 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.790 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.790 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:442 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 5177344~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:16.790 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276578+0000", 2024-09-12T16:16:16.790 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.4334798160000002, 2024-09-12T16:16:16.791 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014027972999999999, 2024-09-12T16:16:16.791 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.791 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.791 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:16.791 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.791 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:16.791 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:16.791 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 442 2024-09-12T16:16:16.791 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.791 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.791 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.791 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.791 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276578+0000", 2024-09-12T16:16:16.791 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.792 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.792 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.792 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.792 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276578+0000", 2024-09-12T16:16:16.792 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.792 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.792 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.792 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.792 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276578+0000", 2024-09-12T16:16:16.792 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.22e-07 2024-09-12T16:16:16.792 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.792 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.792 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.792 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276579+0000", 2024-09-12T16:16:16.793 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0759999999999999e-06 2024-09-12T16:16:16.793 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.793 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.793 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.793 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276585+0000", 2024-09-12T16:16:16.793 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2619999999999998e-06 2024-09-12T16:16:16.793 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.793 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.793 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.793 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276587+0000", 2024-09-12T16:16:16.793 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7369999999999998e-06 2024-09-12T16:16:16.793 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.793 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.793 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.794 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.290446+0000", 2024-09-12T16:16:16.794 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013858606000000001 2024-09-12T16:16:16.794 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.794 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.794 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.794 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.290513+0000", 2024-09-12T16:16:16.794 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6939000000000004e-05 2024-09-12T16:16:16.794 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.794 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.794 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.794 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.290606+0000", 2024-09-12T16:16:16.794 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3131e-05 2024-09-12T16:16:16.794 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.794 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.795 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.795 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.795 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.795 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:443 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 6225920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:16.795 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276591+0000", 2024-09-12T16:16:16.795 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.4334671960000005, 2024-09-12T16:16:16.795 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014239524999999999, 2024-09-12T16:16:16.795 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.795 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.795 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:16.795 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.795 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:16.795 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:16.796 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 443 2024-09-12T16:16:16.796 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.796 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.796 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.796 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.796 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276591+0000", 2024-09-12T16:16:16.796 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.796 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.796 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.796 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.796 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276591+0000", 2024-09-12T16:16:16.796 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.796 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.797 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.797 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.797 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276591+0000", 2024-09-12T16:16:16.797 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1e-07 2024-09-12T16:16:16.797 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.797 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.797 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.797 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276592+0000", 2024-09-12T16:16:16.797 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.141e-06 2024-09-12T16:16:16.797 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.797 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.797 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.797 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276595+0000", 2024-09-12T16:16:16.798 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1839999999999999e-06 2024-09-12T16:16:16.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.798 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.798 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.798 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276598+0000", 2024-09-12T16:16:16.798 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1530000000000001e-06 2024-09-12T16:16:16.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.798 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.798 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.798 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.290648+0000", 2024-09-12T16:16:16.798 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014049756 2024-09-12T16:16:16.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.798 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.798 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.798 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.290751+0000", 2024-09-12T16:16:16.799 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000103256 2024-09-12T16:16:16.799 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.799 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.799 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.799 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.290830+0000", 2024-09-12T16:16:16.799 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8825000000000005e-05 2024-09-12T16:16:16.799 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.799 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.799 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.799 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.799 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.799 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:444 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 7274496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:16.799 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276601+0000", 2024-09-12T16:16:16.800 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.4334564669999992, 2024-09-12T16:16:16.800 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014467034, 2024-09-12T16:16:16.800 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.800 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.800 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:16.800 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.800 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:16.800 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:16.800 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 444 2024-09-12T16:16:16.800 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.800 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.800 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.800 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.800 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276601+0000", 2024-09-12T16:16:16.801 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.801 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.801 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.801 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276601+0000", 2024-09-12T16:16:16.801 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.801 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.801 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.801 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276602+0000", 2024-09-12T16:16:16.801 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1500000000000001e-07 2024-09-12T16:16:16.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.801 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.802 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.802 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276603+0000", 2024-09-12T16:16:16.802 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9199999999999999e-07 2024-09-12T16:16:16.802 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.802 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.802 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.802 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276606+0000", 2024-09-12T16:16:16.802 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.022e-06 2024-09-12T16:16:16.802 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.802 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.802 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.802 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276608+0000", 2024-09-12T16:16:16.802 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.447e-06 2024-09-12T16:16:16.802 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.802 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.803 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.803 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.290874+0000", 2024-09-12T16:16:16.803 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014265631000000001 2024-09-12T16:16:16.803 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.803 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.803 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.803 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.290963+0000", 2024-09-12T16:16:16.803 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9178000000000006e-05 2024-09-12T16:16:16.803 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.803 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.803 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.803 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.291068+0000", 2024-09-12T16:16:16.803 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000105549 2024-09-12T16:16:16.804 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.804 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.804 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.804 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.804 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.804 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4581.0:445 3.1d 3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5 [sparse-read 8323072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:16.804 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:08.276613+0000", 2024-09-12T16:16:16.804 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.4334446819999993, 2024-09-12T16:16:16.804 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014755542, 2024-09-12T16:16:16.804 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:16.804 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:16.804 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:16.804 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:16.805 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4581", 2024-09-12T16:16:16.805 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:16.805 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 445 2024-09-12T16:16:16.805 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.805 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:16.805 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.805 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:16.805 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276613+0000", 2024-09-12T16:16:16.805 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.805 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.805 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.805 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:16.805 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276613+0000", 2024-09-12T16:16:16.805 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:16.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.806 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.806 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:16.806 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276613+0000", 2024-09-12T16:16:16.806 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.23e-07 2024-09-12T16:16:16.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.806 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.806 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:16.806 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276614+0000", 2024-09-12T16:16:16.806 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.071e-06 2024-09-12T16:16:16.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.806 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.806 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:16.806 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276618+0000", 2024-09-12T16:16:16.807 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.146e-06 2024-09-12T16:16:16.807 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.807 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.807 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:16.807 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.276620+0000", 2024-09-12T16:16:16.807 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5110000000000002e-06 2024-09-12T16:16:16.807 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.807 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.807 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:16.807 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.291097+0000", 2024-09-12T16:16:16.807 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014476487 2024-09-12T16:16:16.807 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.807 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.807 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:16.807 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.291270+0000", 2024-09-12T16:16:16.808 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000173547 2024-09-12T16:16:16.808 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:16.808 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:16.808 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:16.808 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:08.291369+0000", 2024-09-12T16:16:16.808 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8556999999999998e-05 2024-09-12T16:16:16.808 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.808 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.808 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.808 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:16.808 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:16.808 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:16.810 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:16:16.810 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:16.809+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:16.911 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:16.910+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:16.923 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:16.923 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:16.923 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:16:16.923 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:16.931 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:16:17.012 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:17.011+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:17.038 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:17.038 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:17.038 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:16:17.038 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:16:17.038 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:17.046 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:16:17.073 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2024-09-12T16:16:17.113 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:17.113+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:17.163 INFO:teuthology.orchestra.run.smithi204.stdout:truncating image image_client.0-clone6 from 0xd752400 (overlap 0x4d8800) to 0x45c600 2024-09-12T16:16:17.192 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:17.193 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:16:17.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:16:17.193 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:17.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.193 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:803 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 1957888~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:17.193 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.448374+0000", 2024-09-12T16:16:17.193 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.742680517, 2024-09-12T16:16:17.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033721793999999999, 2024-09-12T16:16:17.193 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.193 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.193 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.193 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.193 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:17.194 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:17.194 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 803 2024-09-12T16:16:17.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.194 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448374+0000", 2024-09-12T16:16:17.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448374+0000", 2024-09-12T16:16:17.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448375+0000", 2024-09-12T16:16:17.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.68e-07 2024-09-12T16:16:17.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448377+0000", 2024-09-12T16:16:17.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.691e-06 2024-09-12T16:16:17.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448382+0000", 2024-09-12T16:16:17.196 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6180000000000003e-06 2024-09-12T16:16:17.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.196 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.196 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448387+0000", 2024-09-12T16:16:17.196 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8019999999999999e-06 2024-09-12T16:16:17.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.196 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.196 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.481994+0000", 2024-09-12T16:16:17.196 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033606893999999998 2024-09-12T16:16:17.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.197 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482038+0000", 2024-09-12T16:16:17.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3680000000000002e-05 2024-09-12T16:16:17.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.197 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482096+0000", 2024-09-12T16:16:17.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8541000000000001e-05 2024-09-12T16:16:17.197 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.197 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.197 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.198 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:804 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2064384~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:17.198 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.448393+0000", 2024-09-12T16:16:17.198 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.742661686, 2024-09-12T16:16:17.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033822146999999997, 2024-09-12T16:16:17.198 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.198 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.198 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.198 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.198 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:17.198 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:17.198 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 804 2024-09-12T16:16:17.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.198 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448393+0000", 2024-09-12T16:16:17.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448393+0000", 2024-09-12T16:16:17.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448605+0000", 2024-09-12T16:16:17.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021201600000000001 2024-09-12T16:16:17.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.200 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.200 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448608+0000", 2024-09-12T16:16:17.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6299999999999998e-06 2024-09-12T16:16:17.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.200 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.200 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.200 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448615+0000", 2024-09-12T16:16:17.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6200000000000001e-06 2024-09-12T16:16:17.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.200 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.200 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.200 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448620+0000", 2024-09-12T16:16:17.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5829999999999997e-06 2024-09-12T16:16:17.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.201 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.201 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482119+0000", 2024-09-12T16:16:17.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033499292999999999 2024-09-12T16:16:17.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.201 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.201 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482161+0000", 2024-09-12T16:16:17.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1270999999999998e-05 2024-09-12T16:16:17.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.201 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.201 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482215+0000", 2024-09-12T16:16:17.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4734000000000001e-05 2024-09-12T16:16:17.202 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.202 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.202 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.202 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:805 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2170880~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:17.202 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.448628+0000", 2024-09-12T16:16:17.202 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.742427017000001, 2024-09-12T16:16:17.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033705087000000002, 2024-09-12T16:16:17.202 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.202 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.202 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.202 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.202 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:17.203 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:17.203 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 805 2024-09-12T16:16:17.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.203 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.203 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448628+0000", 2024-09-12T16:16:17.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.203 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448628+0000", 2024-09-12T16:16:17.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448628+0000", 2024-09-12T16:16:17.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8000000000000002e-07 2024-09-12T16:16:17.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448633+0000", 2024-09-12T16:16:17.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5879999999999999e-06 2024-09-12T16:16:17.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448637+0000", 2024-09-12T16:16:17.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8369999999999999e-06 2024-09-12T16:16:17.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448640+0000", 2024-09-12T16:16:17.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.853e-06 2024-09-12T16:16:17.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482240+0000", 2024-09-12T16:16:17.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033599992000000002 2024-09-12T16:16:17.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482280+0000", 2024-09-12T16:16:17.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0048e-05 2024-09-12T16:16:17.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482333+0000", 2024-09-12T16:16:17.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3489000000000002e-05 2024-09-12T16:16:17.206 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.206 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.206 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.206 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:806 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2277376~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:17.206 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.448644+0000", 2024-09-12T16:16:17.206 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.742411493000001, 2024-09-12T16:16:17.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033807825, 2024-09-12T16:16:17.207 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.207 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.207 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.207 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.207 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:17.207 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:17.207 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 806 2024-09-12T16:16:17.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.207 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448644+0000", 2024-09-12T16:16:17.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448644+0000", 2024-09-12T16:16:17.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448923+0000", 2024-09-12T16:16:17.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00027954 2024-09-12T16:16:17.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448927+0000", 2024-09-12T16:16:17.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0430000000000001e-06 2024-09-12T16:16:17.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448936+0000", 2024-09-12T16:16:17.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9460000000000004e-06 2024-09-12T16:16:17.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448943+0000", 2024-09-12T16:16:17.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4710000000000004e-06 2024-09-12T16:16:17.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482355+0000", 2024-09-12T16:16:17.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033412874000000002 2024-09-12T16:16:17.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482396+0000", 2024-09-12T16:16:17.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.104e-05 2024-09-12T16:16:17.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482451+0000", 2024-09-12T16:16:17.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4911000000000003e-05 2024-09-12T16:16:17.211 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.211 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.211 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.211 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:809 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2596864~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:17.211 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.448990+0000", 2024-09-12T16:16:17.211 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.742064906, 2024-09-12T16:16:17.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033801342999999998, 2024-09-12T16:16:17.211 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.211 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.211 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.211 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.212 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:17.212 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:17.212 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 809 2024-09-12T16:16:17.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.212 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448990+0000", 2024-09-12T16:16:17.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448990+0000", 2024-09-12T16:16:17.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448990+0000", 2024-09-12T16:16:17.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5199999999999998e-07 2024-09-12T16:16:17.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.448998+0000", 2024-09-12T16:16:17.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.17e-06 2024-09-12T16:16:17.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449002+0000", 2024-09-12T16:16:17.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0969999999999999e-06 2024-09-12T16:16:17.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.214 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449004+0000", 2024-09-12T16:16:17.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6649999999999999e-06 2024-09-12T16:16:17.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.214 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482702+0000", 2024-09-12T16:16:17.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033697908999999998 2024-09-12T16:16:17.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482740+0000", 2024-09-12T16:16:17.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7834999999999999e-05 2024-09-12T16:16:17.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482791+0000", 2024-09-12T16:16:17.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1415000000000002e-05 2024-09-12T16:16:17.215 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.215 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.215 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.216 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:810 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 49152~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:17.216 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.449008+0000", 2024-09-12T16:16:17.216 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.742046752, 2024-09-12T16:16:17.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033898167, 2024-09-12T16:16:17.216 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.216 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.216 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.216 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.216 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:17.216 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:17.216 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 810 2024-09-12T16:16:17.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.216 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449008+0000", 2024-09-12T16:16:17.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449008+0000", 2024-09-12T16:16:17.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449277+0000", 2024-09-12T16:16:17.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026909600000000003 2024-09-12T16:16:17.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449280+0000", 2024-09-12T16:16:17.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.061e-06 2024-09-12T16:16:17.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449288+0000", 2024-09-12T16:16:17.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7500000000000003e-06 2024-09-12T16:16:17.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449292+0000", 2024-09-12T16:16:17.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9570000000000004e-06 2024-09-12T16:16:17.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482814+0000", 2024-09-12T16:16:17.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033522248999999997 2024-09-12T16:16:17.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482854+0000", 2024-09-12T16:16:17.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9947999999999998e-05 2024-09-12T16:16:17.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482906+0000", 2024-09-12T16:16:17.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2105999999999999e-05 2024-09-12T16:16:17.220 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.220 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.220 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.220 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:811 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 155648~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:17.220 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.449300+0000", 2024-09-12T16:16:17.220 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.74175531, 2024-09-12T16:16:17.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033729174000000001, 2024-09-12T16:16:17.220 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.220 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.220 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.220 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.220 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:17.221 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:17.221 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 811 2024-09-12T16:16:17.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.221 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449300+0000", 2024-09-12T16:16:17.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449300+0000", 2024-09-12T16:16:17.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449300+0000", 2024-09-12T16:16:17.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9200000000000002e-07 2024-09-12T16:16:17.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449301+0000", 2024-09-12T16:16:17.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3009999999999999e-06 2024-09-12T16:16:17.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449306+0000", 2024-09-12T16:16:17.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4399999999999998e-06 2024-09-12T16:16:17.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.223 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449308+0000", 2024-09-12T16:16:17.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.553e-06 2024-09-12T16:16:17.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.223 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482935+0000", 2024-09-12T16:16:17.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033626243 2024-09-12T16:16:17.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.223 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.482976+0000", 2024-09-12T16:16:17.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1505999999999999e-05 2024-09-12T16:16:17.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483029+0000", 2024-09-12T16:16:17.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2839e-05 2024-09-12T16:16:17.224 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.224 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.224 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.224 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:812 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 262144~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:17.224 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.449312+0000", 2024-09-12T16:16:17.224 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.741743083999999, 2024-09-12T16:16:17.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033833931999999997, 2024-09-12T16:16:17.224 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.225 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.225 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.225 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.225 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:17.225 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:17.225 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 812 2024-09-12T16:16:17.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.225 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449312+0000", 2024-09-12T16:16:17.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449312+0000", 2024-09-12T16:16:17.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449312+0000", 2024-09-12T16:16:17.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2999999999999999e-07 2024-09-12T16:16:17.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449313+0000", 2024-09-12T16:16:17.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0690000000000001e-06 2024-09-12T16:16:17.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449316+0000", 2024-09-12T16:16:17.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.168e-06 2024-09-12T16:16:17.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449320+0000", 2024-09-12T16:16:17.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1999999999999999e-06 2024-09-12T16:16:17.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483051+0000", 2024-09-12T16:16:17.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033731864 2024-09-12T16:16:17.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483092+0000", 2024-09-12T16:16:17.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0927999999999998e-05 2024-09-12T16:16:17.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483146+0000", 2024-09-12T16:16:17.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3473000000000001e-05 2024-09-12T16:16:17.228 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.228 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.228 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.228 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:813 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 368640~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:17.229 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.449324+0000", 2024-09-12T16:16:17.229 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.741730926000001, 2024-09-12T16:16:17.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033939061, 2024-09-12T16:16:17.229 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.229 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.229 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.229 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.229 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:17.229 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:17.229 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 813 2024-09-12T16:16:17.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.229 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449324+0000", 2024-09-12T16:16:17.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449324+0000", 2024-09-12T16:16:17.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449325+0000", 2024-09-12T16:16:17.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7100000000000001e-07 2024-09-12T16:16:17.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449326+0000", 2024-09-12T16:16:17.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6759999999999999e-06 2024-09-12T16:16:17.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449331+0000", 2024-09-12T16:16:17.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9910000000000002e-06 2024-09-12T16:16:17.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449336+0000", 2024-09-12T16:16:17.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7230000000000004e-06 2024-09-12T16:16:17.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483169+0000", 2024-09-12T16:16:17.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033832889999999997 2024-09-12T16:16:17.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483211+0000", 2024-09-12T16:16:17.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1780000000000003e-05 2024-09-12T16:16:17.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483263+0000", 2024-09-12T16:16:17.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2330000000000002e-05 2024-09-12T16:16:17.232 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.232 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.232 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.233 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:814 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 475136~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:17.233 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.449344+0000", 2024-09-12T16:16:17.233 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.741710616000001, 2024-09-12T16:16:17.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034031447999999999, 2024-09-12T16:16:17.233 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.233 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.233 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.233 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.233 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:17.233 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:17.233 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 814 2024-09-12T16:16:17.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.233 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449344+0000", 2024-09-12T16:16:17.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449344+0000", 2024-09-12T16:16:17.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449345+0000", 2024-09-12T16:16:17.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3099999999999998e-07 2024-09-12T16:16:17.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449347+0000", 2024-09-12T16:16:17.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.872e-06 2024-09-12T16:16:17.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449352+0000", 2024-09-12T16:16:17.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7980000000000002e-06 2024-09-12T16:16:17.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449357+0000", 2024-09-12T16:16:17.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4399999999999998e-06 2024-09-12T16:16:17.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483286+0000", 2024-09-12T16:16:17.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033928697000000001 2024-09-12T16:16:17.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483325+0000", 2024-09-12T16:16:17.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8943999999999998e-05 2024-09-12T16:16:17.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.237 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483376+0000", 2024-09-12T16:16:17.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1266e-05 2024-09-12T16:16:17.237 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.237 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.237 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.237 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:815 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 581632~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:17.237 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.449363+0000", 2024-09-12T16:16:17.237 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.741691536999999, 2024-09-12T16:16:17.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034127672999999997, 2024-09-12T16:16:17.237 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.237 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.238 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.238 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.238 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:17.238 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:17.238 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 815 2024-09-12T16:16:17.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.238 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.238 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449363+0000", 2024-09-12T16:16:17.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449363+0000", 2024-09-12T16:16:17.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449392+0000", 2024-09-12T16:16:17.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8322000000000001e-05 2024-09-12T16:16:17.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449395+0000", 2024-09-12T16:16:17.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.971e-06 2024-09-12T16:16:17.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449402+0000", 2024-09-12T16:16:17.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3089999999999998e-06 2024-09-12T16:16:17.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449408+0000", 2024-09-12T16:16:17.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7769999999999999e-06 2024-09-12T16:16:17.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483399+0000", 2024-09-12T16:16:17.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033990764999999999 2024-09-12T16:16:17.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483437+0000", 2024-09-12T16:16:17.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8182999999999997e-05 2024-09-12T16:16:17.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483491+0000", 2024-09-12T16:16:17.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4345999999999998e-05 2024-09-12T16:16:17.241 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.241 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.241 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.242 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:816 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 688128~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:17.242 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.449417+0000", 2024-09-12T16:16:17.242 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.741638264000001, 2024-09-12T16:16:17.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034188187000000002, 2024-09-12T16:16:17.242 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.242 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.242 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.242 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.242 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:17.242 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:17.242 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 816 2024-09-12T16:16:17.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.243 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449417+0000", 2024-09-12T16:16:17.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.449417+0000", 2024-09-12T16:16:17.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.453927+0000", 2024-09-12T16:16:17.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0045100280000000001 2024-09-12T16:16:17.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.244 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.453932+0000", 2024-09-12T16:16:17.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.916e-06 2024-09-12T16:16:17.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.453940+0000", 2024-09-12T16:16:17.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3720000000000005e-06 2024-09-12T16:16:17.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.453956+0000", 2024-09-12T16:16:17.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6181999999999999e-05 2024-09-12T16:16:17.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483515+0000", 2024-09-12T16:16:17.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.029558261999999998 2024-09-12T16:16:17.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483553+0000", 2024-09-12T16:16:17.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8677999999999998e-05 2024-09-12T16:16:17.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.483605+0000", 2024-09-12T16:16:17.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1749000000000002e-05 2024-09-12T16:16:17.246 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.246 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.246 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.247 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:852 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 1867776~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:17.247 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.454401+0000", 2024-09-12T16:16:17.247 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.736653792, 2024-09-12T16:16:17.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033782697, 2024-09-12T16:16:17.247 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.247 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.247 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.247 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.247 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:17.247 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:17.247 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 852 2024-09-12T16:16:17.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.248 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454401+0000", 2024-09-12T16:16:17.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454401+0000", 2024-09-12T16:16:17.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454402+0000", 2024-09-12T16:16:17.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.58e-07 2024-09-12T16:16:17.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454403+0000", 2024-09-12T16:16:17.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.079e-06 2024-09-12T16:16:17.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454406+0000", 2024-09-12T16:16:17.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3890000000000001e-06 2024-09-12T16:16:17.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.250 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454416+0000", 2024-09-12T16:16:17.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8719999999999997e-06 2024-09-12T16:16:17.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.250 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.487993+0000", 2024-09-12T16:16:17.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033577184000000003 2024-09-12T16:16:17.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.250 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488075+0000", 2024-09-12T16:16:17.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2169000000000006e-05 2024-09-12T16:16:17.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488184+0000", 2024-09-12T16:16:17.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108646 2024-09-12T16:16:17.251 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.251 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.251 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.251 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:853 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 1974272~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:17.251 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.454420+0000", 2024-09-12T16:16:17.251 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.736635366, 2024-09-12T16:16:17.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033941592, 2024-09-12T16:16:17.251 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.251 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.251 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.252 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.252 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:17.252 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:17.252 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 853 2024-09-12T16:16:17.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.252 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454420+0000", 2024-09-12T16:16:17.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454420+0000", 2024-09-12T16:16:17.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454420+0000", 2024-09-12T16:16:17.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8799999999999998e-07 2024-09-12T16:16:17.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454428+0000", 2024-09-12T16:16:17.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0660000000000004e-06 2024-09-12T16:16:17.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454431+0000", 2024-09-12T16:16:17.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3780000000000001e-06 2024-09-12T16:16:17.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454434+0000", 2024-09-12T16:16:17.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4959999999999999e-06 2024-09-12T16:16:17.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488218+0000", 2024-09-12T16:16:17.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033783794999999998 2024-09-12T16:16:17.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488280+0000", 2024-09-12T16:16:17.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2361999999999997e-05 2024-09-12T16:16:17.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488361+0000", 2024-09-12T16:16:17.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1206999999999997e-05 2024-09-12T16:16:17.255 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.255 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.255 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.256 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:854 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2080768~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:17.256 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.454437+0000", 2024-09-12T16:16:17.256 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.736617574, 2024-09-12T16:16:17.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034057872000000003, 2024-09-12T16:16:17.256 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.256 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.256 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.256 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.256 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:17.256 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:17.256 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 854 2024-09-12T16:16:17.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.257 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454437+0000", 2024-09-12T16:16:17.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454437+0000", 2024-09-12T16:16:17.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454438+0000", 2024-09-12T16:16:17.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2700000000000001e-07 2024-09-12T16:16:17.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454439+0000", 2024-09-12T16:16:17.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.029e-06 2024-09-12T16:16:17.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454442+0000", 2024-09-12T16:16:17.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8320000000000002e-06 2024-09-12T16:16:17.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454444+0000", 2024-09-12T16:16:17.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4449999999999999e-06 2024-09-12T16:16:17.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488393+0000", 2024-09-12T16:16:17.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033948878000000002 2024-09-12T16:16:17.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488434+0000", 2024-09-12T16:16:17.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1641999999999999e-05 2024-09-12T16:16:17.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488495+0000", 2024-09-12T16:16:17.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0819000000000002e-05 2024-09-12T16:16:17.260 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.260 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.260 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.260 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:855 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2187264~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:17.260 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.454447+0000", 2024-09-12T16:16:17.261 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.736608267999999, 2024-09-12T16:16:17.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034166180999999997, 2024-09-12T16:16:17.261 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.261 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.261 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.261 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.261 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:17.261 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:17.261 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 855 2024-09-12T16:16:17.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.261 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454447+0000", 2024-09-12T16:16:17.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454447+0000", 2024-09-12T16:16:17.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454447+0000", 2024-09-12T16:16:17.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1e-07 2024-09-12T16:16:17.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454448+0000", 2024-09-12T16:16:17.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0299999999999997e-07 2024-09-12T16:16:17.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454451+0000", 2024-09-12T16:16:17.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8499999999999998e-06 2024-09-12T16:16:17.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454453+0000", 2024-09-12T16:16:17.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2520000000000002e-06 2024-09-12T16:16:17.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488520+0000", 2024-09-12T16:16:17.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034066804999999999 2024-09-12T16:16:17.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488562+0000", 2024-09-12T16:16:17.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2400000000000001e-05 2024-09-12T16:16:17.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488613+0000", 2024-09-12T16:16:17.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0760999999999997e-05 2024-09-12T16:16:17.264 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.264 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.265 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.265 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:856 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2293760~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:17.265 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.454456+0000", 2024-09-12T16:16:17.265 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.736599262, 2024-09-12T16:16:17.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034275297000000003, 2024-09-12T16:16:17.265 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.265 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.265 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.265 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.265 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:17.265 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:17.266 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 856 2024-09-12T16:16:17.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.266 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454456+0000", 2024-09-12T16:16:17.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454456+0000", 2024-09-12T16:16:17.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454456+0000", 2024-09-12T16:16:17.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.11e-07 2024-09-12T16:16:17.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454457+0000", 2024-09-12T16:16:17.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6799999999999999e-07 2024-09-12T16:16:17.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454460+0000", 2024-09-12T16:16:17.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.858e-06 2024-09-12T16:16:17.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454463+0000", 2024-09-12T16:16:17.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9670000000000001e-06 2024-09-12T16:16:17.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488637+0000", 2024-09-12T16:16:17.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034174300999999997 2024-09-12T16:16:17.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488678+0000", 2024-09-12T16:16:17.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0732999999999998e-05 2024-09-12T16:16:17.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488731+0000", 2024-09-12T16:16:17.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3359000000000002e-05 2024-09-12T16:16:17.269 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.269 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.269 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.269 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:857 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2400256~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:17.269 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.454466+0000", 2024-09-12T16:16:17.269 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.736589436999999, 2024-09-12T16:16:17.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034382506, 2024-09-12T16:16:17.269 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.269 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.269 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.270 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.270 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:17.270 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:17.270 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 857 2024-09-12T16:16:17.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.270 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454466+0000", 2024-09-12T16:16:17.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454466+0000", 2024-09-12T16:16:17.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454466+0000", 2024-09-12T16:16:17.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:16:17.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454467+0000", 2024-09-12T16:16:17.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5300000000000002e-07 2024-09-12T16:16:17.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454470+0000", 2024-09-12T16:16:17.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7970000000000001e-06 2024-09-12T16:16:17.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454472+0000", 2024-09-12T16:16:17.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3089999999999998e-06 2024-09-12T16:16:17.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488754+0000", 2024-09-12T16:16:17.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034282436999999999 2024-09-12T16:16:17.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488795+0000", 2024-09-12T16:16:17.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0880999999999997e-05 2024-09-12T16:16:17.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488848+0000", 2024-09-12T16:16:17.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2917000000000002e-05 2024-09-12T16:16:17.273 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.273 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.273 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.273 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:858 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2506752~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:17.273 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.454475+0000", 2024-09-12T16:16:17.273 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.736580216, 2024-09-12T16:16:17.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034498824999999997, 2024-09-12T16:16:17.274 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.274 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.274 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.274 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.274 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:17.274 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:17.274 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 858 2024-09-12T16:16:17.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.274 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454475+0000", 2024-09-12T16:16:17.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454475+0000", 2024-09-12T16:16:17.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454475+0000", 2024-09-12T16:16:17.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2000000000000001e-07 2024-09-12T16:16:17.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454476+0000", 2024-09-12T16:16:17.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5799999999999998e-07 2024-09-12T16:16:17.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454480+0000", 2024-09-12T16:16:17.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5750000000000001e-06 2024-09-12T16:16:17.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454482+0000", 2024-09-12T16:16:17.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3300000000000001e-06 2024-09-12T16:16:17.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488870+0000", 2024-09-12T16:16:17.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034388152999999998 2024-09-12T16:16:17.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488909+0000", 2024-09-12T16:16:17.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8574e-05 2024-09-12T16:16:17.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488974+0000", 2024-09-12T16:16:17.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5015e-05 2024-09-12T16:16:17.277 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.277 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.277 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.278 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4442.0:859 3.1 3:877e8d29:::rbd_data.1155cf5be90e.0000000000000001:3 [read 2613248~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-12T16:16:17.278 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:02.454485+0000", 2024-09-12T16:16:17.278 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.736570126, 2024-09-12T16:16:17.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034601403000000003, 2024-09-12T16:16:17.278 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.278 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.278 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.278 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.278 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4442", 2024-09-12T16:16:17.278 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1368408036", 2024-09-12T16:16:17.278 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 859 2024-09-12T16:16:17.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.278 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454485+0000", 2024-09-12T16:16:17.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454485+0000", 2024-09-12T16:16:17.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454485+0000", 2024-09-12T16:16:17.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.35e-07 2024-09-12T16:16:17.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454486+0000", 2024-09-12T16:16:17.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7399999999999991e-07 2024-09-12T16:16:17.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454489+0000", 2024-09-12T16:16:17.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7690000000000001e-06 2024-09-12T16:16:17.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.454491+0000", 2024-09-12T16:16:17.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2520000000000002e-06 2024-09-12T16:16:17.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.488990+0000", 2024-09-12T16:16:17.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034499019999999998 2024-09-12T16:16:17.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.489031+0000", 2024-09-12T16:16:17.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0648000000000001e-05 2024-09-12T16:16:17.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:02.489086+0000", 2024-09-12T16:16:17.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5504999999999998e-05 2024-09-12T16:16:17.282 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.282 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.282 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.282 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.282 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.282 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:17.284 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:16:17.284 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:17.282+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:17.384 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:17.384+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:17.439 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:17.439 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:17.439 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:16:17.439 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:17.448 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:16:17.484 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:17.484+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:17.525 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #5, image image_client.0-clone5 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent6 2024-09-12T16:16:17.571 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:17.571 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:17.571 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:16:17.571 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:16:17.571 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:17.583 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:16:17.585 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:17.584+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:17.686 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:17.685+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:17.715 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:17.715 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:16:17.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:16:17.715 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:17.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.716 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:418 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 4980736~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:17.716 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276193+0000", 2024-09-12T16:16:17.716 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.4378152190000009, 2024-09-12T16:16:17.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010247098, 2024-09-12T16:16:17.716 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.716 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.716 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.716 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.716 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:17.716 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:17.716 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 418 2024-09-12T16:16:17.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.717 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276193+0000", 2024-09-12T16:16:17.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276193+0000", 2024-09-12T16:16:17.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276193+0000", 2024-09-12T16:16:17.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1799999999999999e-07 2024-09-12T16:16:17.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276195+0000", 2024-09-12T16:16:17.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1370000000000001e-06 2024-09-12T16:16:17.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276197+0000", 2024-09-12T16:16:17.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8550000000000002e-06 2024-09-12T16:16:17.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276200+0000", 2024-09-12T16:16:17.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5220000000000002e-06 2024-09-12T16:16:17.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.286337+0000", 2024-09-12T16:16:17.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010136776 2024-09-12T16:16:17.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.286388+0000", 2024-09-12T16:16:17.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1575e-05 2024-09-12T16:16:17.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.286440+0000", 2024-09-12T16:16:17.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2015000000000003e-05 2024-09-12T16:16:17.720 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.720 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.720 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.721 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:419 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 6029312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:17.721 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276206+0000", 2024-09-12T16:16:17.721 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.4378028050000005, 2024-09-12T16:16:17.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010367929, 2024-09-12T16:16:17.721 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.721 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.721 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.721 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.721 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:17.721 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:17.721 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 419 2024-09-12T16:16:17.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.722 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276206+0000", 2024-09-12T16:16:17.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276206+0000", 2024-09-12T16:16:17.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276206+0000", 2024-09-12T16:16:17.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0699999999999999e-07 2024-09-12T16:16:17.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276207+0000", 2024-09-12T16:16:17.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2270000000000001e-06 2024-09-12T16:16:17.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276210+0000", 2024-09-12T16:16:17.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9950000000000001e-06 2024-09-12T16:16:17.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276212+0000", 2024-09-12T16:16:17.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4559999999999999e-06 2024-09-12T16:16:17.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.286469+0000", 2024-09-12T16:16:17.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010256149000000001 2024-09-12T16:16:17.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.286508+0000", 2024-09-12T16:16:17.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9113000000000003e-05 2024-09-12T16:16:17.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.286574+0000", 2024-09-12T16:16:17.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5782000000000001e-05 2024-09-12T16:16:17.725 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.725 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.725 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.726 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:420 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 7077888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:17.726 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276217+0000", 2024-09-12T16:16:17.726 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.4377918709999999, 2024-09-12T16:16:17.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010474682000000001, 2024-09-12T16:16:17.726 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.726 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.726 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.726 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.726 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:17.726 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:17.726 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 420 2024-09-12T16:16:17.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.727 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276217+0000", 2024-09-12T16:16:17.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276217+0000", 2024-09-12T16:16:17.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276217+0000", 2024-09-12T16:16:17.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.11e-07 2024-09-12T16:16:17.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276218+0000", 2024-09-12T16:16:17.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.08e-06 2024-09-12T16:16:17.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276223+0000", 2024-09-12T16:16:17.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4149999999999998e-06 2024-09-12T16:16:17.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276226+0000", 2024-09-12T16:16:17.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.554e-06 2024-09-12T16:16:17.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.286603+0000", 2024-09-12T16:16:17.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010376928000000001 2024-09-12T16:16:17.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.286642+0000", 2024-09-12T16:16:17.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9583999999999999e-05 2024-09-12T16:16:17.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.286691+0000", 2024-09-12T16:16:17.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8909999999999998e-05 2024-09-12T16:16:17.730 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.730 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.730 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.731 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:421 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 8126464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:17.731 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276229+0000", 2024-09-12T16:16:17.731 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.4377792570000008, 2024-09-12T16:16:17.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010582829, 2024-09-12T16:16:17.731 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.731 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.731 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.731 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.731 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:17.731 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:17.731 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 421 2024-09-12T16:16:17.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.732 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276229+0000", 2024-09-12T16:16:17.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276229+0000", 2024-09-12T16:16:17.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.733 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276229+0000", 2024-09-12T16:16:17.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0900000000000001e-07 2024-09-12T16:16:17.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.733 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.733 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276231+0000", 2024-09-12T16:16:17.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1680000000000001e-06 2024-09-12T16:16:17.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.733 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.733 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276233+0000", 2024-09-12T16:16:17.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8619999999999999e-06 2024-09-12T16:16:17.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276236+0000", 2024-09-12T16:16:17.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6199999999999999e-06 2024-09-12T16:16:17.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.286719+0000", 2024-09-12T16:16:17.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.01048295 2024-09-12T16:16:17.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.286761+0000", 2024-09-12T16:16:17.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1943999999999997e-05 2024-09-12T16:16:17.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.286812+0000", 2024-09-12T16:16:17.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1075999999999997e-05 2024-09-12T16:16:17.735 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.735 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.735 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.736 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:430 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 851968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:17.736 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276293+0000", 2024-09-12T16:16:17.736 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.4377151420000001, 2024-09-12T16:16:17.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010647286000000001, 2024-09-12T16:16:17.736 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.736 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.736 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.736 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.736 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:17.736 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:17.736 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 430 2024-09-12T16:16:17.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.737 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276293+0000", 2024-09-12T16:16:17.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276293+0000", 2024-09-12T16:16:17.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276294+0000", 2024-09-12T16:16:17.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4499999999999997e-07 2024-09-12T16:16:17.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276296+0000", 2024-09-12T16:16:17.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5620000000000002e-06 2024-09-12T16:16:17.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276303+0000", 2024-09-12T16:16:17.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6239999999999996e-06 2024-09-12T16:16:17.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276308+0000", 2024-09-12T16:16:17.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2909999999999998e-06 2024-09-12T16:16:17.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.286840+0000", 2024-09-12T16:16:17.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010531611999999999 2024-09-12T16:16:17.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.286879+0000", 2024-09-12T16:16:17.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8998999999999997e-05 2024-09-12T16:16:17.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.286941+0000", 2024-09-12T16:16:17.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1653000000000001e-05 2024-09-12T16:16:17.740 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.740 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.740 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.740 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:431 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:17.741 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276319+0000", 2024-09-12T16:16:17.741 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.4376895909999998, 2024-09-12T16:16:17.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010738599999999999, 2024-09-12T16:16:17.741 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.741 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.741 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.741 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.741 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:17.741 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:17.741 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 431 2024-09-12T16:16:17.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.741 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276319+0000", 2024-09-12T16:16:17.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276319+0000", 2024-09-12T16:16:17.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276319+0000", 2024-09-12T16:16:17.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2500000000000001e-07 2024-09-12T16:16:17.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276321+0000", 2024-09-12T16:16:17.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0209999999999998e-06 2024-09-12T16:16:17.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276325+0000", 2024-09-12T16:16:17.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8530000000000002e-06 2024-09-12T16:16:17.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276328+0000", 2024-09-12T16:16:17.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8720000000000002e-06 2024-09-12T16:16:17.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.286968+0000", 2024-09-12T16:16:17.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010640313 2024-09-12T16:16:17.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287007+0000", 2024-09-12T16:16:17.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9217000000000001e-05 2024-09-12T16:16:17.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287057+0000", 2024-09-12T16:16:17.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9999e-05 2024-09-12T16:16:17.745 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.745 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.745 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.745 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:432 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 2949120~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:17.745 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276363+0000", 2024-09-12T16:16:17.746 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.4376457289999998, 2024-09-12T16:16:17.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010810155, 2024-09-12T16:16:17.746 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.746 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.746 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.746 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.746 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:17.746 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:17.746 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 432 2024-09-12T16:16:17.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.747 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276363+0000", 2024-09-12T16:16:17.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276363+0000", 2024-09-12T16:16:17.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276363+0000", 2024-09-12T16:16:17.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2e-07 2024-09-12T16:16:17.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276365+0000", 2024-09-12T16:16:17.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2869999999999999e-06 2024-09-12T16:16:17.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276375+0000", 2024-09-12T16:16:17.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2909999999999996e-06 2024-09-12T16:16:17.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276380+0000", 2024-09-12T16:16:17.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0819999999999998e-06 2024-09-12T16:16:17.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287084+0000", 2024-09-12T16:16:17.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010704049 2024-09-12T16:16:17.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287124+0000", 2024-09-12T16:16:17.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0308000000000001e-05 2024-09-12T16:16:17.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287173+0000", 2024-09-12T16:16:17.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8717999999999997e-05 2024-09-12T16:16:17.750 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.750 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.750 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.751 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:433 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 3997696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:17.751 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276387+0000", 2024-09-12T16:16:17.751 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.4376212670000008, 2024-09-12T16:16:17.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010899934999999999, 2024-09-12T16:16:17.751 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.751 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.751 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.751 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.751 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:17.751 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:17.752 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 433 2024-09-12T16:16:17.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.752 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276387+0000", 2024-09-12T16:16:17.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276387+0000", 2024-09-12T16:16:17.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276388+0000", 2024-09-12T16:16:17.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7899999999999999e-07 2024-09-12T16:16:17.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276389+0000", 2024-09-12T16:16:17.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4190000000000001e-06 2024-09-12T16:16:17.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276392+0000", 2024-09-12T16:16:17.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4400000000000001e-06 2024-09-12T16:16:17.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276395+0000", 2024-09-12T16:16:17.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0929999999999999e-06 2024-09-12T16:16:17.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287199+0000", 2024-09-12T16:16:17.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010803557 2024-09-12T16:16:17.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.755 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.755 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287238+0000", 2024-09-12T16:16:17.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8958999999999997e-05 2024-09-12T16:16:17.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.755 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.755 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287287+0000", 2024-09-12T16:16:17.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9088000000000002e-05 2024-09-12T16:16:17.755 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.755 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.756 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.756 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:434 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 5046272~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:17.756 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276399+0000", 2024-09-12T16:16:17.756 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.4376097199999993, 2024-09-12T16:16:17.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011014375999999999, 2024-09-12T16:16:17.756 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.756 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.756 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.756 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.756 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:17.757 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:17.757 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 434 2024-09-12T16:16:17.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.757 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276399+0000", 2024-09-12T16:16:17.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276399+0000", 2024-09-12T16:16:17.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276399+0000", 2024-09-12T16:16:17.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9400000000000001e-07 2024-09-12T16:16:17.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276400+0000", 2024-09-12T16:16:17.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.156e-06 2024-09-12T16:16:17.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.759 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.759 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276403+0000", 2024-09-12T16:16:17.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.841e-06 2024-09-12T16:16:17.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.759 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.759 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276405+0000", 2024-09-12T16:16:17.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.481e-06 2024-09-12T16:16:17.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.759 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.759 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287316+0000", 2024-09-12T16:16:17.760 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010910087000000001 2024-09-12T16:16:17.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.760 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.760 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287355+0000", 2024-09-12T16:16:17.760 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8995000000000002e-05 2024-09-12T16:16:17.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.760 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.760 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287413+0000", 2024-09-12T16:16:17.760 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8522e-05 2024-09-12T16:16:17.761 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.761 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.761 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.761 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:435 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 6094848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:17.761 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276413+0000", 2024-09-12T16:16:17.761 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.4375952020000007, 2024-09-12T16:16:17.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011132998, 2024-09-12T16:16:17.761 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.761 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.761 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.762 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.762 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:17.762 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:17.762 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 435 2024-09-12T16:16:17.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.762 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276413+0000", 2024-09-12T16:16:17.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276413+0000", 2024-09-12T16:16:17.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.763 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276413+0000", 2024-09-12T16:16:17.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9499999999999998e-07 2024-09-12T16:16:17.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.763 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276415+0000", 2024-09-12T16:16:17.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3960000000000001e-06 2024-09-12T16:16:17.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276419+0000", 2024-09-12T16:16:17.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.963e-06 2024-09-12T16:16:17.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276421+0000", 2024-09-12T16:16:17.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6350000000000002e-06 2024-09-12T16:16:17.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287444+0000", 2024-09-12T16:16:17.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.01102299 2024-09-12T16:16:17.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287488+0000", 2024-09-12T16:16:17.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3040000000000001e-05 2024-09-12T16:16:17.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287546+0000", 2024-09-12T16:16:17.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8678999999999998e-05 2024-09-12T16:16:17.765 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.766 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.766 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.766 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:436 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 7143424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:17.766 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276426+0000", 2024-09-12T16:16:17.766 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.4375826820000004, 2024-09-12T16:16:17.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011380603, 2024-09-12T16:16:17.766 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.766 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.766 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.766 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.766 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:17.767 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:17.767 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 436 2024-09-12T16:16:17.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.767 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276426+0000", 2024-09-12T16:16:17.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276426+0000", 2024-09-12T16:16:17.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.768 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.768 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276426+0000", 2024-09-12T16:16:17.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1400000000000001e-07 2024-09-12T16:16:17.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.768 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.768 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276427+0000", 2024-09-12T16:16:17.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1659999999999999e-06 2024-09-12T16:16:17.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276430+0000", 2024-09-12T16:16:17.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.915e-06 2024-09-12T16:16:17.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276432+0000", 2024-09-12T16:16:17.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3199999999999998e-06 2024-09-12T16:16:17.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287595+0000", 2024-09-12T16:16:17.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011163103000000001 2024-09-12T16:16:17.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.770 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.770 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287688+0000", 2024-09-12T16:16:17.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2839999999999999e-05 2024-09-12T16:16:17.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.770 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.770 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287806+0000", 2024-09-12T16:16:17.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118045 2024-09-12T16:16:17.770 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.770 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.770 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.771 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:437 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 8192000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:17.771 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276436+0000", 2024-09-12T16:16:17.771 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.4375720530000002, 2024-09-12T16:16:17.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011546832999999999, 2024-09-12T16:16:17.771 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.771 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.771 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.771 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.771 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:17.771 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:17.771 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 437 2024-09-12T16:16:17.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.771 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.772 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276436+0000", 2024-09-12T16:16:17.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.772 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.772 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276436+0000", 2024-09-12T16:16:17.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.772 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.772 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276437+0000", 2024-09-12T16:16:17.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.05e-07 2024-09-12T16:16:17.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276438+0000", 2024-09-12T16:16:17.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1689999999999999e-06 2024-09-12T16:16:17.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276441+0000", 2024-09-12T16:16:17.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.852e-06 2024-09-12T16:16:17.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276443+0000", 2024-09-12T16:16:17.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3740000000000001e-06 2024-09-12T16:16:17.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287850+0000", 2024-09-12T16:16:17.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011406665 2024-09-12T16:16:17.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287895+0000", 2024-09-12T16:16:17.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4994000000000003e-05 2024-09-12T16:16:17.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.287983+0000", 2024-09-12T16:16:17.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8573999999999996e-05 2024-09-12T16:16:17.774 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.774 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.775 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.775 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:446 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 917504~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:17.775 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276541+0000", 2024-09-12T16:16:17.775 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.437467861, 2024-09-12T16:16:17.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011604257999999999, 2024-09-12T16:16:17.775 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.775 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.775 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.775 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.775 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:17.775 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:17.776 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 446 2024-09-12T16:16:17.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.776 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.776 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.776 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276541+0000", 2024-09-12T16:16:17.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.776 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.776 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276541+0000", 2024-09-12T16:16:17.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.777 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.777 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276541+0000", 2024-09-12T16:16:17.777 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1699999999999998e-07 2024-09-12T16:16:17.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.777 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.777 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276543+0000", 2024-09-12T16:16:17.777 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.193e-06 2024-09-12T16:16:17.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.777 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.777 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276554+0000", 2024-09-12T16:16:17.777 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0379e-05 2024-09-12T16:16:17.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.778 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276559+0000", 2024-09-12T16:16:17.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5289999999999999e-06 2024-09-12T16:16:17.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.778 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.288037+0000", 2024-09-12T16:16:17.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011477533999999999 2024-09-12T16:16:17.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.778 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.288088+0000", 2024-09-12T16:16:17.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1303e-05 2024-09-12T16:16:17.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.779 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.779 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.288145+0000", 2024-09-12T16:16:17.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6802999999999998e-05 2024-09-12T16:16:17.779 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.779 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.779 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.779 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:447 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 1966080~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:17.779 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276571+0000", 2024-09-12T16:16:17.780 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.4374372080000004, 2024-09-12T16:16:17.780 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011748434, 2024-09-12T16:16:17.780 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.780 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.780 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.780 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.780 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:17.780 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:17.780 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 447 2024-09-12T16:16:17.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.780 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.780 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276571+0000", 2024-09-12T16:16:17.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.781 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276571+0000", 2024-09-12T16:16:17.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.781 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276571+0000", 2024-09-12T16:16:17.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0600000000000001e-07 2024-09-12T16:16:17.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.781 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276573+0000", 2024-09-12T16:16:17.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.694e-06 2024-09-12T16:16:17.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276578+0000", 2024-09-12T16:16:17.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5340000000000001e-06 2024-09-12T16:16:17.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276582+0000", 2024-09-12T16:16:17.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7740000000000004e-06 2024-09-12T16:16:17.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.288195+0000", 2024-09-12T16:16:17.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011612496999999999 2024-09-12T16:16:17.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.288247+0000", 2024-09-12T16:16:17.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2352000000000003e-05 2024-09-12T16:16:17.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.288320+0000", 2024-09-12T16:16:17.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2276999999999999e-05 2024-09-12T16:16:17.783 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.783 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.784 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.784 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:448 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 3014656~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:17.784 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276588+0000", 2024-09-12T16:16:17.784 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.4374204200000005, 2024-09-12T16:16:17.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011932223, 2024-09-12T16:16:17.784 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.784 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.784 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.784 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.784 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:17.784 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:17.784 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 448 2024-09-12T16:16:17.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.785 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.785 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.785 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276588+0000", 2024-09-12T16:16:17.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.785 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.785 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276588+0000", 2024-09-12T16:16:17.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.785 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.786 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276588+0000", 2024-09-12T16:16:17.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4600000000000001e-07 2024-09-12T16:16:17.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.786 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.786 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276590+0000", 2024-09-12T16:16:17.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.42e-06 2024-09-12T16:16:17.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.786 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.786 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276594+0000", 2024-09-12T16:16:17.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5759999999999999e-06 2024-09-12T16:16:17.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276599+0000", 2024-09-12T16:16:17.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5299999999999998e-06 2024-09-12T16:16:17.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.288340+0000", 2024-09-12T16:16:17.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011741458 2024-09-12T16:16:17.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.288425+0000", 2024-09-12T16:16:17.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4349000000000002e-05 2024-09-12T16:16:17.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.288520+0000", 2024-09-12T16:16:17.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5643999999999994e-05 2024-09-12T16:16:17.788 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.788 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.788 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.788 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:449 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 4063232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:17.788 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276609+0000", 2024-09-12T16:16:17.788 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.4373992019999999, 2024-09-12T16:16:17.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012090162999999999, 2024-09-12T16:16:17.788 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.789 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.789 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.789 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.789 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:17.789 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:17.789 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 449 2024-09-12T16:16:17.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.789 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276609+0000", 2024-09-12T16:16:17.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.790 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.790 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276609+0000", 2024-09-12T16:16:17.790 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.790 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.790 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276610+0000", 2024-09-12T16:16:17.790 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6800000000000001e-07 2024-09-12T16:16:17.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.790 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.790 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276611+0000", 2024-09-12T16:16:17.790 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.432e-06 2024-09-12T16:16:17.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276615+0000", 2024-09-12T16:16:17.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5480000000000002e-06 2024-09-12T16:16:17.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276618+0000", 2024-09-12T16:16:17.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3809999999999999e-06 2024-09-12T16:16:17.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.288536+0000", 2024-09-12T16:16:17.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011917911999999999 2024-09-12T16:16:17.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.792 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.792 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.288603+0000", 2024-09-12T16:16:17.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7108999999999997e-05 2024-09-12T16:16:17.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.792 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.792 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.288699+0000", 2024-09-12T16:16:17.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6413e-05 2024-09-12T16:16:17.792 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.792 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.792 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.793 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:450 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 5111808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:17.793 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276626+0000", 2024-09-12T16:16:17.793 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.4373827200000004, 2024-09-12T16:16:17.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012328182, 2024-09-12T16:16:17.793 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.793 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.793 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.793 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.793 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:17.793 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:17.793 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 450 2024-09-12T16:16:17.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.793 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.794 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276626+0000", 2024-09-12T16:16:17.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.794 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276626+0000", 2024-09-12T16:16:17.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.794 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276626+0000", 2024-09-12T16:16:17.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1800000000000002e-07 2024-09-12T16:16:17.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276628+0000", 2024-09-12T16:16:17.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.513e-06 2024-09-12T16:16:17.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276631+0000", 2024-09-12T16:16:17.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3249999999999999e-06 2024-09-12T16:16:17.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276633+0000", 2024-09-12T16:16:17.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6599999999999999e-06 2024-09-12T16:16:17.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.288746+0000", 2024-09-12T16:16:17.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012112497999999999 2024-09-12T16:16:17.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.288838+0000", 2024-09-12T16:16:17.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2293000000000006e-05 2024-09-12T16:16:17.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.288954+0000", 2024-09-12T16:16:17.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000115575 2024-09-12T16:16:17.797 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.797 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.797 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.797 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:451 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 6160384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:17.797 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276637+0000", 2024-09-12T16:16:17.797 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.4373712189999992, 2024-09-12T16:16:17.797 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012558026999999999, 2024-09-12T16:16:17.797 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.797 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.797 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.797 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.797 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:17.798 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:17.798 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 451 2024-09-12T16:16:17.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.798 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.798 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.798 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276637+0000", 2024-09-12T16:16:17.798 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.798 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.798 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276637+0000", 2024-09-12T16:16:17.798 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276637+0000", 2024-09-12T16:16:17.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1500000000000001e-07 2024-09-12T16:16:17.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276639+0000", 2024-09-12T16:16:17.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1260000000000001e-06 2024-09-12T16:16:17.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276641+0000", 2024-09-12T16:16:17.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8049999999999998e-06 2024-09-12T16:16:17.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.800 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276644+0000", 2024-09-12T16:16:17.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6800000000000002e-06 2024-09-12T16:16:17.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.800 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.288986+0000", 2024-09-12T16:16:17.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012341859 2024-09-12T16:16:17.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.800 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.289076+0000", 2024-09-12T16:16:17.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0477999999999997e-05 2024-09-12T16:16:17.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.289195+0000", 2024-09-12T16:16:17.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011886400000000001 2024-09-12T16:16:17.801 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.801 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.801 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.801 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:452 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 7208960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:17.801 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276647+0000", 2024-09-12T16:16:17.801 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.4373613889999994, 2024-09-12T16:16:17.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012777827, 2024-09-12T16:16:17.801 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.801 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.802 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.802 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.802 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:17.802 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:17.802 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 452 2024-09-12T16:16:17.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.802 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276647+0000", 2024-09-12T16:16:17.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276647+0000", 2024-09-12T16:16:17.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276647+0000", 2024-09-12T16:16:17.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0900000000000001e-07 2024-09-12T16:16:17.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276648+0000", 2024-09-12T16:16:17.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.001e-06 2024-09-12T16:16:17.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276651+0000", 2024-09-12T16:16:17.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7879999999999998e-06 2024-09-12T16:16:17.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276653+0000", 2024-09-12T16:16:17.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4109999999999999e-06 2024-09-12T16:16:17.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.289230+0000", 2024-09-12T16:16:17.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012576828 2024-09-12T16:16:17.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.289318+0000", 2024-09-12T16:16:17.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7471000000000003e-05 2024-09-12T16:16:17.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.805 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.289425+0000", 2024-09-12T16:16:17.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000107119 2024-09-12T16:16:17.805 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.805 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.805 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.805 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:453 3.0 3:079233a8:::rbd_data.11551fa285fd.0000000000000005:5 [sparse-read 8257536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:17.805 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.276656+0000", 2024-09-12T16:16:17.805 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.437352014, 2024-09-12T16:16:17.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012957371000000001, 2024-09-12T16:16:17.806 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:17.806 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:17.806 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:17.806 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:17.806 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:17.806 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:17.806 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 453 2024-09-12T16:16:17.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.806 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:17.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:17.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276656+0000", 2024-09-12T16:16:17.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:17.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276656+0000", 2024-09-12T16:16:17.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:17.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:17.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276657+0000", 2024-09-12T16:16:17.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0900000000000001e-07 2024-09-12T16:16:17.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:17.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276658+0000", 2024-09-12T16:16:17.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.085e-06 2024-09-12T16:16:17.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:17.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276661+0000", 2024-09-12T16:16:17.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8569999999999999e-06 2024-09-12T16:16:17.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:17.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.276663+0000", 2024-09-12T16:16:17.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3520000000000001e-06 2024-09-12T16:16:17.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:17.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.289464+0000", 2024-09-12T16:16:17.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012800908 2024-09-12T16:16:17.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:17.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.289538+0000", 2024-09-12T16:16:17.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3849000000000004e-05 2024-09-12T16:16:17.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:17.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:17.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:17.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.289614+0000", 2024-09-12T16:16:17.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6111000000000004e-05 2024-09-12T16:16:17.809 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.809 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.809 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.809 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:17.809 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:17.809 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:17.810 INFO:teuthology.orchestra.run.smithi204.stdout:933 write 0x6b97200 thru 0x6b99ae9 (0x28ea bytes) 2024-09-12T16:16:17.811 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:16:17.811 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:17.810+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:17.812 INFO:teuthology.orchestra.run.smithi204.stdout:934 trunc from 0xd752400 to 0xc4b5600 2024-09-12T16:16:17.911 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:17.911+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:17.970 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:17.970 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:17.970 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:16:17.970 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:17.978 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:16:18.020 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:18.019+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:18.113 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:18.113+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:18.129 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:18.129 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:18.129 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:16:18.129 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:16:18.129 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:18.129 INFO:teuthology.orchestra.run.smithi204.stdout:935 punch from 0x4eb3200 to 0x4ebae00, (0x7c00 bytes) 2024-09-12T16:16:18.139 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:16:18.141 INFO:teuthology.orchestra.run.smithi204.stdout:936 read 0x7f96400 thru 0x7fa561a (0xf21b bytes) 2024-09-12T16:16:18.165 INFO:teuthology.orchestra.run.smithi204.stdout:938 trunc from 0xc4b5600 to 0x17d3400 2024-09-12T16:16:18.166 INFO:teuthology.orchestra.run.smithi047.stdout: marking collection for removal 2024-09-12T16:16:18.166 INFO:teuthology.orchestra.run.smithi047.stdout:setting '_remove' omap key 2024-09-12T16:16:18.167 INFO:teuthology.orchestra.run.smithi047.stdout:finish_remove_pgs 3.1d_head removing 3.1d 2024-09-12T16:16:18.168 INFO:teuthology.orchestra.run.smithi047.stdout:Remove successful 2024-09-12T16:16:18.214 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:18.214+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:18.252 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:18.252 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:16:18.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:16:18.252 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:18.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.253 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:3893 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 409600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:18.253 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.336389+0000", 2024-09-12T16:16:18.253 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 11.91454732, 2024-09-12T16:16:18.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0045550920000000002, 2024-09-12T16:16:18.253 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:18.253 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:18.253 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:18.253 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:18.253 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:18.253 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:18.253 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3893 2024-09-12T16:16:18.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.253 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:18.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:18.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336389+0000", 2024-09-12T16:16:18.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:18.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336389+0000", 2024-09-12T16:16:18.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:18.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336389+0000", 2024-09-12T16:16:18.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1799999999999999e-07 2024-09-12T16:16:18.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:18.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336390+0000", 2024-09-12T16:16:18.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.082e-06 2024-09-12T16:16:18.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:18.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336393+0000", 2024-09-12T16:16:18.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9849999999999998e-06 2024-09-12T16:16:18.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336395+0000", 2024-09-12T16:16:18.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3460000000000001e-06 2024-09-12T16:16:18.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:18.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.339585+0000", 2024-09-12T16:16:18.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031895449999999998 2024-09-12T16:16:18.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:18.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340868+0000", 2024-09-12T16:16:18.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012825009999999999 2024-09-12T16:16:18.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:18.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340944+0000", 2024-09-12T16:16:18.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6415000000000006e-05 2024-09-12T16:16:18.257 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.257 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:18.257 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.257 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:3894 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 466944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:18.257 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.336399+0000", 2024-09-12T16:16:18.257 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 11.914537504, 2024-09-12T16:16:18.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0047051489999999996, 2024-09-12T16:16:18.257 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:18.257 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:18.257 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:18.257 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:18.257 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:18.258 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:18.258 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3894 2024-09-12T16:16:18.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.258 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:18.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:18.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336399+0000", 2024-09-12T16:16:18.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:18.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336399+0000", 2024-09-12T16:16:18.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:18.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336399+0000", 2024-09-12T16:16:18.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.34e-07 2024-09-12T16:16:18.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:18.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336400+0000", 2024-09-12T16:16:18.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.029e-06 2024-09-12T16:16:18.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:18.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336403+0000", 2024-09-12T16:16:18.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.078e-06 2024-09-12T16:16:18.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336405+0000", 2024-09-12T16:16:18.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.34e-06 2024-09-12T16:16:18.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:18.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340975+0000", 2024-09-12T16:16:18.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.004569348 2024-09-12T16:16:18.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:18.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341043+0000", 2024-09-12T16:16:18.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8202999999999997e-05 2024-09-12T16:16:18.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:18.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341104+0000", 2024-09-12T16:16:18.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0917e-05 2024-09-12T16:16:18.261 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.261 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:18.261 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.261 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:3895 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 483328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:18.261 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.336409+0000", 2024-09-12T16:16:18.262 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 11.914527589, 2024-09-12T16:16:18.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0048548549999999999, 2024-09-12T16:16:18.262 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:18.262 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:18.262 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:18.262 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:18.262 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:18.262 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:18.262 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3895 2024-09-12T16:16:18.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.262 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:18.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:18.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336409+0000", 2024-09-12T16:16:18.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:18.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336409+0000", 2024-09-12T16:16:18.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:18.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336409+0000", 2024-09-12T16:16:18.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2499999999999999e-07 2024-09-12T16:16:18.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:18.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336410+0000", 2024-09-12T16:16:18.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0139999999999999e-06 2024-09-12T16:16:18.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:18.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336413+0000", 2024-09-12T16:16:18.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.038e-06 2024-09-12T16:16:18.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336415+0000", 2024-09-12T16:16:18.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2680000000000001e-06 2024-09-12T16:16:18.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:18.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341132+0000", 2024-09-12T16:16:18.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0047171560000000001 2024-09-12T16:16:18.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:18.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341200+0000", 2024-09-12T16:16:18.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7910000000000005e-05 2024-09-12T16:16:18.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:18.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341263+0000", 2024-09-12T16:16:18.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3244000000000006e-05 2024-09-12T16:16:18.265 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.265 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:18.266 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.266 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:3896 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 499712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:18.266 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.336421+0000", 2024-09-12T16:16:18.266 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 11.914515499, 2024-09-12T16:16:18.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0050030539999999998, 2024-09-12T16:16:18.266 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:18.266 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:18.266 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:18.266 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:18.266 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:18.266 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:18.266 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3896 2024-09-12T16:16:18.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.267 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:18.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:18.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336421+0000", 2024-09-12T16:16:18.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:18.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336421+0000", 2024-09-12T16:16:18.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:18.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336421+0000", 2024-09-12T16:16:18.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8700000000000001e-07 2024-09-12T16:16:18.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:18.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336423+0000", 2024-09-12T16:16:18.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.753e-06 2024-09-12T16:16:18.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:18.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336428+0000", 2024-09-12T16:16:18.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6149999999999996e-06 2024-09-12T16:16:18.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336433+0000", 2024-09-12T16:16:18.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5909999999999998e-06 2024-09-12T16:16:18.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:18.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341292+0000", 2024-09-12T16:16:18.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0048587470000000001 2024-09-12T16:16:18.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:18.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341358+0000", 2024-09-12T16:16:18.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6218999999999997e-05 2024-09-12T16:16:18.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:18.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341424+0000", 2024-09-12T16:16:18.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5741999999999995e-05 2024-09-12T16:16:18.270 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.270 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:18.270 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.270 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:3897 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 516096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:18.270 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.336440+0000", 2024-09-12T16:16:18.270 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 11.914496444999999, 2024-09-12T16:16:18.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.005179187, 2024-09-12T16:16:18.270 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:18.270 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:18.270 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:18.270 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:18.270 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:18.271 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:18.271 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3897 2024-09-12T16:16:18.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.271 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:18.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:18.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336440+0000", 2024-09-12T16:16:18.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:18.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336440+0000", 2024-09-12T16:16:18.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:18.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336440+0000", 2024-09-12T16:16:18.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7e-07 2024-09-12T16:16:18.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:18.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336442+0000", 2024-09-12T16:16:18.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1959999999999998e-06 2024-09-12T16:16:18.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:18.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336449+0000", 2024-09-12T16:16:18.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8179999999999998e-06 2024-09-12T16:16:18.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336454+0000", 2024-09-12T16:16:18.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1760000000000001e-06 2024-09-12T16:16:18.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:18.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341482+0000", 2024-09-12T16:16:18.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0050273460000000002 2024-09-12T16:16:18.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:18.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341552+0000", 2024-09-12T16:16:18.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0297999999999997e-05 2024-09-12T16:16:18.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:18.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341619+0000", 2024-09-12T16:16:18.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6983000000000006e-05 2024-09-12T16:16:18.274 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.274 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:18.274 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.274 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4125 3.5 3:a241af90:::rbd_data.11557ed36bb5.000000000000000f:4 [read 401408~6656] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:18.274 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.337967+0000", 2024-09-12T16:16:18.274 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 11.912969618, 2024-09-12T16:16:18.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003989467, 2024-09-12T16:16:18.274 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:18.275 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:18.275 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:18.275 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:18.275 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:18.275 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:18.275 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4125 2024-09-12T16:16:18.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.275 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:18.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:18.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337967+0000", 2024-09-12T16:16:18.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:18.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337967+0000", 2024-09-12T16:16:18.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:18.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337967+0000", 2024-09-12T16:16:18.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0900000000000002e-07 2024-09-12T16:16:18.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:18.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337975+0000", 2024-09-12T16:16:18.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6909999999999997e-06 2024-09-12T16:16:18.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:18.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337984+0000", 2024-09-12T16:16:18.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2720000000000003e-06 2024-09-12T16:16:18.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337990+0000", 2024-09-12T16:16:18.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3380000000000001e-06 2024-09-12T16:16:18.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:18.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340872+0000", 2024-09-12T16:16:18.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002882225 2024-09-12T16:16:18.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:18.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340944+0000", 2024-09-12T16:16:18.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1219999999999999e-05 2024-09-12T16:16:18.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:18.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341956+0000", 2024-09-12T16:16:18.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001012312 2024-09-12T16:16:18.278 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.278 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:18.278 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.278 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4126 3.5 3:a241af90:::rbd_data.11557ed36bb5.000000000000000f:4 [read 442368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:18.279 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.337999+0000", 2024-09-12T16:16:18.279 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 11.912936820000001, 2024-09-12T16:16:18.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0041510729999999999, 2024-09-12T16:16:18.279 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:18.279 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:18.279 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:18.279 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:18.279 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:18.279 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:18.279 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4126 2024-09-12T16:16:18.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.279 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:18.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:18.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337999+0000", 2024-09-12T16:16:18.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:18.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337999+0000", 2024-09-12T16:16:18.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:18.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338000+0000", 2024-09-12T16:16:18.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4000000000000002e-07 2024-09-12T16:16:18.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:18.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338002+0000", 2024-09-12T16:16:18.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.154e-06 2024-09-12T16:16:18.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:18.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338009+0000", 2024-09-12T16:16:18.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9059999999999996e-06 2024-09-12T16:16:18.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338014+0000", 2024-09-12T16:16:18.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7650000000000001e-06 2024-09-12T16:16:18.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:18.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342002+0000", 2024-09-12T16:16:18.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039884680000000002 2024-09-12T16:16:18.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:18.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342076+0000", 2024-09-12T16:16:18.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4023999999999995e-05 2024-09-12T16:16:18.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:18.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342150+0000", 2024-09-12T16:16:18.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4215999999999996e-05 2024-09-12T16:16:18.283 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.283 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:18.283 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.283 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4127 3.5 3:a241af90:::rbd_data.11557ed36bb5.000000000000000f:4 [read 458752~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:18.283 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.338021+0000", 2024-09-12T16:16:18.283 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 11.912915224000001, 2024-09-12T16:16:18.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042934399999999999, 2024-09-12T16:16:18.283 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:18.283 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:18.283 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:18.283 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:18.283 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:18.284 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:18.284 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4127 2024-09-12T16:16:18.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.284 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:18.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:18.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338021+0000", 2024-09-12T16:16:18.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:18.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338021+0000", 2024-09-12T16:16:18.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:18.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338021+0000", 2024-09-12T16:16:18.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9800000000000004e-07 2024-09-12T16:16:18.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:18.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338024+0000", 2024-09-12T16:16:18.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2809999999999998e-06 2024-09-12T16:16:18.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:18.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338031+0000", 2024-09-12T16:16:18.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1269999999999997e-06 2024-09-12T16:16:18.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338036+0000", 2024-09-12T16:16:18.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0329999999999999e-06 2024-09-12T16:16:18.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:18.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342181+0000", 2024-09-12T16:16:18.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.004144699 2024-09-12T16:16:18.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:18.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342247+0000", 2024-09-12T16:16:18.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6149000000000007e-05 2024-09-12T16:16:18.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:18.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342314+0000", 2024-09-12T16:16:18.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7652999999999998e-05 2024-09-12T16:16:18.287 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.287 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:18.287 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.287 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4128 3.5 3:a241af90:::rbd_data.11557ed36bb5.000000000000000f:4 [read 475136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:18.287 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.338043+0000", 2024-09-12T16:16:18.287 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 11.912893076, 2024-09-12T16:16:18.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0044450189999999997, 2024-09-12T16:16:18.288 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:18.288 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:18.288 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:18.288 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:18.288 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:18.288 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:18.288 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4128 2024-09-12T16:16:18.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.288 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:18.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:18.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338043+0000", 2024-09-12T16:16:18.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:18.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338043+0000", 2024-09-12T16:16:18.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:18.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338044+0000", 2024-09-12T16:16:18.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2599999999999998e-07 2024-09-12T16:16:18.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:18.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338046+0000", 2024-09-12T16:16:18.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9850000000000001e-06 2024-09-12T16:16:18.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:18.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338052+0000", 2024-09-12T16:16:18.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7410000000000003e-06 2024-09-12T16:16:18.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338058+0000", 2024-09-12T16:16:18.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5729999999999998e-06 2024-09-12T16:16:18.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:18.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342343+0000", 2024-09-12T16:16:18.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042855970000000004 2024-09-12T16:16:18.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:18.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342411+0000", 2024-09-12T16:16:18.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7619000000000004e-05 2024-09-12T16:16:18.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:18.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342488+0000", 2024-09-12T16:16:18.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7077999999999996e-05 2024-09-12T16:16:18.291 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.292 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:18.292 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.292 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4129 3.5 3:a241af90:::rbd_data.11557ed36bb5.000000000000000f:4 [read 491520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:18.292 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.338065+0000", 2024-09-12T16:16:18.292 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 11.912870771, 2024-09-12T16:16:18.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.004581819, 2024-09-12T16:16:18.292 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:18.292 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:18.292 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:18.292 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:18.292 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:18.293 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:18.293 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4129 2024-09-12T16:16:18.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.293 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:18.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:18.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338065+0000", 2024-09-12T16:16:18.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:18.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338065+0000", 2024-09-12T16:16:18.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:18.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338066+0000", 2024-09-12T16:16:18.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-07 2024-09-12T16:16:18.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:18.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338068+0000", 2024-09-12T16:16:18.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4820000000000001e-06 2024-09-12T16:16:18.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:18.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338075+0000", 2024-09-12T16:16:18.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.08e-06 2024-09-12T16:16:18.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338081+0000", 2024-09-12T16:16:18.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2939999999999996e-06 2024-09-12T16:16:18.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:18.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342515+0000", 2024-09-12T16:16:18.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0044338720000000002 2024-09-12T16:16:18.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:18.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342582+0000", 2024-09-12T16:16:18.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6962e-05 2024-09-12T16:16:18.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:18.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342647+0000", 2024-09-12T16:16:18.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5643999999999997e-05 2024-09-12T16:16:18.296 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.296 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:18.296 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.296 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4450 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 475136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:18.297 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.345047+0000", 2024-09-12T16:16:18.297 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 11.905889425, 2024-09-12T16:16:18.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003358088, 2024-09-12T16:16:18.297 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:18.297 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:18.297 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:18.297 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:18.297 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:18.297 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:18.297 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4450 2024-09-12T16:16:18.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.297 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:18.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:18.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345047+0000", 2024-09-12T16:16:18.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:18.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345047+0000", 2024-09-12T16:16:18.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:18.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345047+0000", 2024-09-12T16:16:18.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2599999999999998e-07 2024-09-12T16:16:18.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:18.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345049+0000", 2024-09-12T16:16:18.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1040000000000001e-06 2024-09-12T16:16:18.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:18.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345056+0000", 2024-09-12T16:16:18.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6220000000000003e-06 2024-09-12T16:16:18.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345061+0000", 2024-09-12T16:16:18.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0710000000000002e-06 2024-09-12T16:16:18.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:18.300 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.348273+0000", 2024-09-12T16:16:18.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032119649999999998 2024-09-12T16:16:18.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:18.300 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.348340+0000", 2024-09-12T16:16:18.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7115999999999999e-05 2024-09-12T16:16:18.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:18.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.348405+0000", 2024-09-12T16:16:18.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4783999999999995e-05 2024-09-12T16:16:18.301 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.301 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:18.301 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.301 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4856 3.1e 3.e05fe63e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:18.301 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.351329+0000", 2024-09-12T16:16:18.301 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 11.899606988, 2024-09-12T16:16:18.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032355190000000001, 2024-09-12T16:16:18.301 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:18.302 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:18.302 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:16:18.302 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:18.302 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:18.302 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:18.302 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4856 2024-09-12T16:16:18.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.302 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:18.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:18.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351329+0000", 2024-09-12T16:16:18.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:18.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351329+0000", 2024-09-12T16:16:18.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:18.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351330+0000", 2024-09-12T16:16:18.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5400000000000002e-07 2024-09-12T16:16:18.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:18.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351331+0000", 2024-09-12T16:16:18.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.81e-06 2024-09-12T16:16:18.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.304 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:18.304 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351337+0000", 2024-09-12T16:16:18.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7830000000000004e-06 2024-09-12T16:16:18.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.304 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.304 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351342+0000", 2024-09-12T16:16:18.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.69e-06 2024-09-12T16:16:18.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.304 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:18.304 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354558+0000", 2024-09-12T16:16:18.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032158500000000001 2024-09-12T16:16:18.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:18.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354565+0000", 2024-09-12T16:16:18.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0319999999999998e-06 2024-09-12T16:16:18.305 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.305 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:18.305 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.305 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4857 3.1e 3.e05fe63e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:18.305 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.351348+0000", 2024-09-12T16:16:18.305 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 11.899588459, 2024-09-12T16:16:18.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032465969999999999, 2024-09-12T16:16:18.306 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:18.306 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:18.306 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:16:18.306 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:18.306 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:18.306 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:18.306 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4857 2024-09-12T16:16:18.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.306 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:18.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:18.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351348+0000", 2024-09-12T16:16:18.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:18.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351348+0000", 2024-09-12T16:16:18.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:18.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351348+0000", 2024-09-12T16:16:18.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3599999999999999e-07 2024-09-12T16:16:18.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:18.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351354+0000", 2024-09-12T16:16:18.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8880000000000002e-06 2024-09-12T16:16:18.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:18.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351361+0000", 2024-09-12T16:16:18.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1849999999999998e-06 2024-09-12T16:16:18.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351366+0000", 2024-09-12T16:16:18.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9740000000000001e-06 2024-09-12T16:16:18.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:18.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354588+0000", 2024-09-12T16:16:18.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032216200000000001 2024-09-12T16:16:18.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:18.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354594+0000", 2024-09-12T16:16:18.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5939999999999999e-06 2024-09-12T16:16:18.309 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.309 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:18.309 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.309 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4858 3.1e 3.e05fe63e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:18.309 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.351373+0000", 2024-09-12T16:16:18.309 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 11.899563521999999, 2024-09-12T16:16:18.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032503800000000002, 2024-09-12T16:16:18.310 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:18.310 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:18.310 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:16:18.310 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:18.310 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:18.310 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:18.310 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4858 2024-09-12T16:16:18.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.310 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:18.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:18.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351373+0000", 2024-09-12T16:16:18.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:18.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351373+0000", 2024-09-12T16:16:18.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:18.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351373+0000", 2024-09-12T16:16:18.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5999999999999999e-07 2024-09-12T16:16:18.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:18.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351376+0000", 2024-09-12T16:16:18.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6170000000000001e-06 2024-09-12T16:16:18.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:18.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351381+0000", 2024-09-12T16:16:18.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8209999999999998e-06 2024-09-12T16:16:18.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351386+0000", 2024-09-12T16:16:18.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6190000000000002e-06 2024-09-12T16:16:18.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.313 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:18.313 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354616+0000", 2024-09-12T16:16:18.313 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032299809999999998 2024-09-12T16:16:18.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.313 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:18.313 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354623+0000", 2024-09-12T16:16:18.313 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9820000000000002e-06 2024-09-12T16:16:18.313 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.313 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:18.313 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.313 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4859 3.1e 3.e05fe63e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:18.314 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.351392+0000", 2024-09-12T16:16:18.314 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 11.899544264999999, 2024-09-12T16:16:18.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003261983, 2024-09-12T16:16:18.314 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:18.314 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:18.314 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:16:18.314 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:18.314 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:18.314 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:18.314 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4859 2024-09-12T16:16:18.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.314 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:18.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:18.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351392+0000", 2024-09-12T16:16:18.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:18.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351392+0000", 2024-09-12T16:16:18.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:18.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351392+0000", 2024-09-12T16:16:18.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4999999999999998e-07 2024-09-12T16:16:18.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:18.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351394+0000", 2024-09-12T16:16:18.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.669e-06 2024-09-12T16:16:18.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:18.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351400+0000", 2024-09-12T16:16:18.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7049999999999996e-06 2024-09-12T16:16:18.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351404+0000", 2024-09-12T16:16:18.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7249999999999997e-06 2024-09-12T16:16:18.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.317 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:18.317 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354646+0000", 2024-09-12T16:16:18.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032411499999999999 2024-09-12T16:16:18.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.317 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:18.317 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354654+0000", 2024-09-12T16:16:18.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3839999999999997e-06 2024-09-12T16:16:18.317 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.317 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:18.317 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.318 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4859 3.1e 3:7c67fa07:::rbd_data.11557ed36bb5.000000000000001d:4 [read 516096~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:18.318 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.356681+0000", 2024-09-12T16:16:18.318 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 11.894254699999999, 2024-09-12T16:16:18.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033342200000000002, 2024-09-12T16:16:18.318 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:18.318 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:18.318 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:18.318 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:18.318 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:18.318 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:18.318 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4859 2024-09-12T16:16:18.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.318 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:18.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:18.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.356681+0000", 2024-09-12T16:16:18.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:18.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.356681+0000", 2024-09-12T16:16:18.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:18.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.356682+0000", 2024-09-12T16:16:18.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.34e-07 2024-09-12T16:16:18.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:18.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.356689+0000", 2024-09-12T16:16:18.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3540000000000002e-06 2024-09-12T16:16:18.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:18.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.356697+0000", 2024-09-12T16:16:18.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.038e-06 2024-09-12T16:16:18.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.356703+0000", 2024-09-12T16:16:18.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7690000000000002e-06 2024-09-12T16:16:18.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:18.321 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.359724+0000", 2024-09-12T16:16:18.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030212529999999998 2024-09-12T16:16:18.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.321 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:18.321 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.359807+0000", 2024-09-12T16:16:18.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2956999999999999e-05 2024-09-12T16:16:18.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.321 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:18.321 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.360016+0000", 2024-09-12T16:16:18.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020841499999999999 2024-09-12T16:16:18.321 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.322 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:18.322 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.322 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:611 3.1e 3:781126e5:::rbd_data.11551fa285fd.0000000000000001:5 [sparse-read 4390912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:18.322 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.317383+0000", 2024-09-12T16:16:18.322 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.9335531330000002, 2024-09-12T16:16:18.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034147090000000001, 2024-09-12T16:16:18.322 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:18.322 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:18.322 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:18.322 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:18.322 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:18.322 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:18.323 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 611 2024-09-12T16:16:18.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.323 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:18.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:18.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317383+0000", 2024-09-12T16:16:18.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:18.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317383+0000", 2024-09-12T16:16:18.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:18.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317383+0000", 2024-09-12T16:16:18.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.03e-07 2024-09-12T16:16:18.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:18.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317384+0000", 2024-09-12T16:16:18.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.111e-06 2024-09-12T16:16:18.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:18.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317387+0000", 2024-09-12T16:16:18.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0920000000000002e-06 2024-09-12T16:16:18.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.325 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.325 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317391+0000", 2024-09-12T16:16:18.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.191e-06 2024-09-12T16:16:18.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.325 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:18.325 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.320634+0000", 2024-09-12T16:16:18.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032436750000000001 2024-09-12T16:16:18.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.325 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:18.325 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.320721+0000", 2024-09-12T16:16:18.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6682999999999997e-05 2024-09-12T16:16:18.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.326 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:18.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.320798+0000", 2024-09-12T16:16:18.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6754000000000004e-05 2024-09-12T16:16:18.326 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.326 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:18.326 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.326 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:612 3.1e 3:781126e5:::rbd_data.11551fa285fd.0000000000000001:5 [sparse-read 5439488~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:18.326 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.317394+0000", 2024-09-12T16:16:18.326 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.9335420909999996, 2024-09-12T16:16:18.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036457799999999999, 2024-09-12T16:16:18.326 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:18.327 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:18.327 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:18.327 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:18.327 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:18.327 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:18.327 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 612 2024-09-12T16:16:18.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.327 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:18.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:18.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317394+0000", 2024-09-12T16:16:18.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:18.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317394+0000", 2024-09-12T16:16:18.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:18.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317394+0000", 2024-09-12T16:16:18.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1400000000000001e-07 2024-09-12T16:16:18.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:18.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317395+0000", 2024-09-12T16:16:18.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.569999999999999e-07 2024-09-12T16:16:18.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:18.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317398+0000", 2024-09-12T16:16:18.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1520000000000001e-06 2024-09-12T16:16:18.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317401+0000", 2024-09-12T16:16:18.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4660000000000002e-06 2024-09-12T16:16:18.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:18.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.320843+0000", 2024-09-12T16:16:18.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034421130000000001 2024-09-12T16:16:18.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:18.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.320939+0000", 2024-09-12T16:16:18.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5585e-05 2024-09-12T16:16:18.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:18.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321040+0000", 2024-09-12T16:16:18.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010129299999999999 2024-09-12T16:16:18.330 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.330 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:18.330 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.330 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:613 3.1e 3:781126e5:::rbd_data.11551fa285fd.0000000000000001:5 [sparse-read 6488064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:18.330 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.317404+0000", 2024-09-12T16:16:18.331 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.9335320920000001, 2024-09-12T16:16:18.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003785217, 2024-09-12T16:16:18.331 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:18.331 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:18.331 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:18.331 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:18.331 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:18.331 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:18.331 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 613 2024-09-12T16:16:18.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.331 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:18.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:18.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317404+0000", 2024-09-12T16:16:18.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:18.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317404+0000", 2024-09-12T16:16:18.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:18.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317404+0000", 2024-09-12T16:16:18.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2000000000000001e-07 2024-09-12T16:16:18.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:18.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317405+0000", 2024-09-12T16:16:18.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0890000000000001e-06 2024-09-12T16:16:18.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:18.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317408+0000", 2024-09-12T16:16:18.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.061e-06 2024-09-12T16:16:18.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317411+0000", 2024-09-12T16:16:18.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.52e-06 2024-09-12T16:16:18.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:18.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321069+0000", 2024-09-12T16:16:18.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036582059999999998 2024-09-12T16:16:18.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:18.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321127+0000", 2024-09-12T16:16:18.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7339000000000001e-05 2024-09-12T16:16:18.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:18.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321189+0000", 2024-09-12T16:16:18.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2781999999999996e-05 2024-09-12T16:16:18.335 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.335 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:18.335 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.335 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:614 3.1e 3:781126e5:::rbd_data.11551fa285fd.0000000000000001:5 [sparse-read 7536640~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:18.335 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.317414+0000", 2024-09-12T16:16:18.335 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.9335219170000002, 2024-09-12T16:16:18.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039935709999999996, 2024-09-12T16:16:18.335 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:18.335 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:18.335 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:18.335 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:18.335 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:18.335 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:18.336 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 614 2024-09-12T16:16:18.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.336 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:18.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:18.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317414+0000", 2024-09-12T16:16:18.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:18.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317414+0000", 2024-09-12T16:16:18.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:18.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:18.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317414+0000", 2024-09-12T16:16:18.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.05e-07 2024-09-12T16:16:18.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:18.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317418+0000", 2024-09-12T16:16:18.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5329999999999999e-06 2024-09-12T16:16:18.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:18.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317423+0000", 2024-09-12T16:16:18.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2780000000000001e-06 2024-09-12T16:16:18.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317428+0000", 2024-09-12T16:16:18.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.763e-06 2024-09-12T16:16:18.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:18.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321217+0000", 2024-09-12T16:16:18.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003788816 2024-09-12T16:16:18.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:18.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321307+0000", 2024-09-12T16:16:18.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0142999999999994e-05 2024-09-12T16:16:18.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:18.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:18.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:18.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321408+0000", 2024-09-12T16:16:18.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000100833 2024-09-12T16:16:18.339 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.339 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:18.339 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.339 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:18.339 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:18.339 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:18.341 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:16:18.341 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:18.339+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:18.442 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:18.441+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:18.514 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:18.515 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:16:18.515 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.515 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6008 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.515 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.479529+0000", 2024-09-12T16:16:18.515 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.025806521999999998, 2024-09-12T16:16:18.515 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.025822033000000001, 2024-09-12T16:16:18.515 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.515 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.515 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.515 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.515 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.516 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.516 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6008 2024-09-12T16:16:18.516 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.516 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.516 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.516 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.516 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479529+0000", 2024-09-12T16:16:18.516 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.516 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.516 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.516 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.516 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479529+0000", 2024-09-12T16:16:18.516 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.516 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.516 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.517 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.517 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479529+0000", 2024-09-12T16:16:18.517 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1299999999999999e-07 2024-09-12T16:16:18.517 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.517 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.517 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.517 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479530+0000", 2024-09-12T16:16:18.517 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0219999999999999e-06 2024-09-12T16:16:18.517 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.517 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.517 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.517 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479533+0000", 2024-09-12T16:16:18.517 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.796e-06 2024-09-12T16:16:18.517 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.518 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.518 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.518 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479535+0000", 2024-09-12T16:16:18.518 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4040000000000002e-06 2024-09-12T16:16:18.518 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.518 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.518 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.518 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.518 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.518 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6040 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.518 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.479894+0000", 2024-09-12T16:16:18.518 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.025441937000000001, 2024-09-12T16:16:18.518 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.02550227, 2024-09-12T16:16:18.518 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.519 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.519 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.519 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.519 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.519 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.519 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6040 2024-09-12T16:16:18.519 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.519 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.519 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.519 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.519 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479894+0000", 2024-09-12T16:16:18.519 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.519 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.520 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.520 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.520 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479894+0000", 2024-09-12T16:16:18.520 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.520 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.520 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.520 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.520 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479894+0000", 2024-09-12T16:16:18.520 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0900000000000001e-07 2024-09-12T16:16:18.520 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.520 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.520 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.520 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479895+0000", 2024-09-12T16:16:18.521 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1399999999999995e-07 2024-09-12T16:16:18.521 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.521 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.521 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.521 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479897+0000", 2024-09-12T16:16:18.521 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7599999999999998e-06 2024-09-12T16:16:18.521 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.521 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.521 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.521 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479901+0000", 2024-09-12T16:16:18.521 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4350000000000001e-06 2024-09-12T16:16:18.521 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.521 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.521 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.522 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.522 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.522 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6072 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.522 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485645+0000", 2024-09-12T16:16:18.522 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019690851999999998, 2024-09-12T16:16:18.522 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019779362000000002, 2024-09-12T16:16:18.522 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.522 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.522 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.522 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.522 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.522 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.522 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6072 2024-09-12T16:16:18.522 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.523 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.523 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.523 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.523 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485645+0000", 2024-09-12T16:16:18.523 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.523 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.523 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.523 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.523 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485645+0000", 2024-09-12T16:16:18.523 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.523 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.523 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.523 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.523 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485645+0000", 2024-09-12T16:16:18.524 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1e-07 2024-09-12T16:16:18.524 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.524 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.524 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.524 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485646+0000", 2024-09-12T16:16:18.524 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5999999999999991e-07 2024-09-12T16:16:18.524 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.524 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.524 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.524 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485650+0000", 2024-09-12T16:16:18.524 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9940000000000002e-06 2024-09-12T16:16:18.524 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.524 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.524 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.525 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485652+0000", 2024-09-12T16:16:18.525 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4169999999999999e-06 2024-09-12T16:16:18.525 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.525 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.525 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.525 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.525 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.525 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6104 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.525 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491419+0000", 2024-09-12T16:16:18.525 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013916655999999999, 2024-09-12T16:16:18.525 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014028778, 2024-09-12T16:16:18.525 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.525 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.525 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.526 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.526 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.526 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.526 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6104 2024-09-12T16:16:18.526 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.526 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.526 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.526 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.526 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491419+0000", 2024-09-12T16:16:18.526 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.526 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.526 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.526 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.526 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491419+0000", 2024-09-12T16:16:18.526 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.527 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.527 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.527 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.527 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491419+0000", 2024-09-12T16:16:18.527 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1e-07 2024-09-12T16:16:18.527 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.527 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.527 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.527 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491420+0000", 2024-09-12T16:16:18.527 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9099999999999991e-07 2024-09-12T16:16:18.527 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.527 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.527 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.527 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491423+0000", 2024-09-12T16:16:18.527 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7989999999999998e-06 2024-09-12T16:16:18.528 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.528 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.528 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.528 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491425+0000", 2024-09-12T16:16:18.528 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4159999999999998e-06 2024-09-12T16:16:18.528 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.528 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.528 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.528 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.528 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.528 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6136 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.528 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491762+0000", 2024-09-12T16:16:18.528 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013573421, 2024-09-12T16:16:18.529 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013710303, 2024-09-12T16:16:18.529 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.529 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.529 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.529 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.529 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.529 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.529 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6136 2024-09-12T16:16:18.529 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.529 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.529 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.529 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.529 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491762+0000", 2024-09-12T16:16:18.529 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.530 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.530 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.530 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.530 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491762+0000", 2024-09-12T16:16:18.530 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.530 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.530 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.530 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.530 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491762+0000", 2024-09-12T16:16:18.530 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:16:18.530 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.530 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.530 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.530 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491763+0000", 2024-09-12T16:16:18.530 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9699999999999994e-07 2024-09-12T16:16:18.531 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.531 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.531 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.531 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491766+0000", 2024-09-12T16:16:18.531 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.802e-06 2024-09-12T16:16:18.531 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.531 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.531 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.531 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491768+0000", 2024-09-12T16:16:18.531 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3209999999999999e-06 2024-09-12T16:16:18.531 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.531 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.531 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.531 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.531 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.532 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6009 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.532 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.479538+0000", 2024-09-12T16:16:18.532 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.02579704, 2024-09-12T16:16:18.532 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.025959072, 2024-09-12T16:16:18.532 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.532 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.532 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.532 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.532 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.532 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.532 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6009 2024-09-12T16:16:18.532 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.532 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.532 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.533 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.533 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479538+0000", 2024-09-12T16:16:18.533 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.533 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.533 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.533 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.533 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479538+0000", 2024-09-12T16:16:18.533 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.533 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.533 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.533 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.533 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479539+0000", 2024-09-12T16:16:18.533 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0200000000000001e-07 2024-09-12T16:16:18.533 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.533 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.534 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.534 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479540+0000", 2024-09-12T16:16:18.534 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0780000000000001e-06 2024-09-12T16:16:18.534 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.534 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.534 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.534 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479543+0000", 2024-09-12T16:16:18.534 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7520000000000001e-06 2024-09-12T16:16:18.534 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.534 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.534 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.534 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479545+0000", 2024-09-12T16:16:18.534 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3190000000000002e-06 2024-09-12T16:16:18.534 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.534 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.535 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.535 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.535 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.535 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6041 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.535 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.479904+0000", 2024-09-12T16:16:18.535 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.025431518, 2024-09-12T16:16:18.535 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.025617108, 2024-09-12T16:16:18.535 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.535 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.535 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.535 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.535 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.535 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.535 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6041 2024-09-12T16:16:18.535 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.536 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.536 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.536 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.536 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479904+0000", 2024-09-12T16:16:18.536 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.536 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.536 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.536 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.536 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479904+0000", 2024-09-12T16:16:18.536 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.536 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.536 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.536 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.536 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479904+0000", 2024-09-12T16:16:18.536 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1799999999999999e-07 2024-09-12T16:16:18.537 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.537 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.537 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.537 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479905+0000", 2024-09-12T16:16:18.537 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6899999999999996e-07 2024-09-12T16:16:18.537 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.537 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.537 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.537 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479908+0000", 2024-09-12T16:16:18.537 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.785e-06 2024-09-12T16:16:18.537 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.537 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.537 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.537 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479910+0000", 2024-09-12T16:16:18.537 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4609999999999998e-06 2024-09-12T16:16:18.538 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.538 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.538 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.538 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.538 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.538 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6073 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.538 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485655+0000", 2024-09-12T16:16:18.538 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019680201000000001, 2024-09-12T16:16:18.538 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019889720999999999, 2024-09-12T16:16:18.538 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.538 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.538 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.538 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.538 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.538 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.539 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6073 2024-09-12T16:16:18.539 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.539 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.539 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.539 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.539 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485655+0000", 2024-09-12T16:16:18.539 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.539 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.539 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.539 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.539 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485655+0000", 2024-09-12T16:16:18.539 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.539 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.539 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.539 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.540 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485656+0000", 2024-09-12T16:16:18.540 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9799999999999999e-07 2024-09-12T16:16:18.540 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.540 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.540 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.540 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485657+0000", 2024-09-12T16:16:18.540 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0160000000000001e-06 2024-09-12T16:16:18.540 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.540 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.540 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.540 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485659+0000", 2024-09-12T16:16:18.540 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8159999999999998e-06 2024-09-12T16:16:18.540 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.540 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.540 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.541 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485662+0000", 2024-09-12T16:16:18.541 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3860000000000001e-06 2024-09-12T16:16:18.541 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.541 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.541 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.541 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.541 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.541 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6105 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.541 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491428+0000", 2024-09-12T16:16:18.541 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013907322999999999, 2024-09-12T16:16:18.541 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014139885, 2024-09-12T16:16:18.541 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.541 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.541 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.541 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.542 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.542 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.542 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6105 2024-09-12T16:16:18.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.542 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.542 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.542 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.542 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491428+0000", 2024-09-12T16:16:18.542 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.542 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.542 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.542 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491428+0000", 2024-09-12T16:16:18.542 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.543 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.543 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.543 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491428+0000", 2024-09-12T16:16:18.543 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1e-07 2024-09-12T16:16:18.543 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.543 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.543 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.543 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491429+0000", 2024-09-12T16:16:18.543 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8100000000000001e-07 2024-09-12T16:16:18.543 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.543 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.543 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.543 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491432+0000", 2024-09-12T16:16:18.543 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.836e-06 2024-09-12T16:16:18.544 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.544 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.544 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.544 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491435+0000", 2024-09-12T16:16:18.544 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.447e-06 2024-09-12T16:16:18.544 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.544 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.544 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.544 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.544 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.544 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6137 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.544 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491771+0000", 2024-09-12T16:16:18.544 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013564252000000001, 2024-09-12T16:16:18.544 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013823683999999999, 2024-09-12T16:16:18.544 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.545 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.545 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.545 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.545 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.545 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.545 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6137 2024-09-12T16:16:18.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.545 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.545 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.545 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.545 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491771+0000", 2024-09-12T16:16:18.545 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.545 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.546 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.546 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491771+0000", 2024-09-12T16:16:18.546 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.546 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.546 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.546 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.546 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491771+0000", 2024-09-12T16:16:18.546 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0599999999999999e-07 2024-09-12T16:16:18.546 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.546 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.546 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.546 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491776+0000", 2024-09-12T16:16:18.546 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8250000000000004e-06 2024-09-12T16:16:18.547 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.547 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.547 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.547 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491780+0000", 2024-09-12T16:16:18.547 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2109999999999998e-06 2024-09-12T16:16:18.547 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.547 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.547 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.547 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491782+0000", 2024-09-12T16:16:18.547 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.531e-06 2024-09-12T16:16:18.547 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.547 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.547 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.547 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.548 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.548 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6010 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.548 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.479548+0000", 2024-09-12T16:16:18.548 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.025787708999999999, 2024-09-12T16:16:18.548 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.026071878, 2024-09-12T16:16:18.548 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.548 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.548 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.548 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.548 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.548 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.549 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6010 2024-09-12T16:16:18.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.549 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.549 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.549 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.549 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479548+0000", 2024-09-12T16:16:18.549 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.549 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.549 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.550 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479548+0000", 2024-09-12T16:16:18.550 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.550 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.550 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479548+0000", 2024-09-12T16:16:18.550 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4200000000000002e-07 2024-09-12T16:16:18.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.550 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.550 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479549+0000", 2024-09-12T16:16:18.550 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.018e-06 2024-09-12T16:16:18.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.551 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.551 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479552+0000", 2024-09-12T16:16:18.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7769999999999998e-06 2024-09-12T16:16:18.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.551 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.551 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479554+0000", 2024-09-12T16:16:18.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.368e-06 2024-09-12T16:16:18.551 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.551 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.551 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.552 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.552 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6042 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.552 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.479914+0000", 2024-09-12T16:16:18.552 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.025421019999999999, 2024-09-12T16:16:18.552 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.025728678000000001, 2024-09-12T16:16:18.552 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.552 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.552 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.552 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.552 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.552 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.552 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6042 2024-09-12T16:16:18.552 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.553 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.553 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.553 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479914+0000", 2024-09-12T16:16:18.553 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.553 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.553 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.553 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479914+0000", 2024-09-12T16:16:18.553 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.553 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.553 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.553 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485274+0000", 2024-09-12T16:16:18.553 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0053596290000000003 2024-09-12T16:16:18.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.554 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.554 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.554 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485280+0000", 2024-09-12T16:16:18.554 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5809999999999996e-06 2024-09-12T16:16:18.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.554 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.554 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.554 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485287+0000", 2024-09-12T16:16:18.554 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3300000000000001e-06 2024-09-12T16:16:18.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.554 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.554 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.554 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485291+0000", 2024-09-12T16:16:18.554 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8099999999999999e-06 2024-09-12T16:16:18.555 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.555 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.555 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.555 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.555 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.555 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6074 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.555 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485665+0000", 2024-09-12T16:16:18.555 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019670804, 2024-09-12T16:16:18.555 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020002301, 2024-09-12T16:16:18.555 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.555 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.555 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.555 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.555 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.555 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.555 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6074 2024-09-12T16:16:18.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.556 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.556 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.556 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.556 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485665+0000", 2024-09-12T16:16:18.556 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.556 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.556 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.556 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485665+0000", 2024-09-12T16:16:18.556 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.556 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.557 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.557 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485665+0000", 2024-09-12T16:16:18.557 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.29e-07 2024-09-12T16:16:18.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.557 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.557 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.557 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485666+0000", 2024-09-12T16:16:18.557 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.78e-07 2024-09-12T16:16:18.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.557 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.557 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.557 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485669+0000", 2024-09-12T16:16:18.557 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7300000000000001e-06 2024-09-12T16:16:18.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.557 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.558 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.558 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485671+0000", 2024-09-12T16:16:18.558 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3700000000000002e-06 2024-09-12T16:16:18.558 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.558 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.558 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.558 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.558 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.558 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6106 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.558 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491438+0000", 2024-09-12T16:16:18.558 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013897853, 2024-09-12T16:16:18.558 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014253200000000001, 2024-09-12T16:16:18.558 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.558 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.559 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.559 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.559 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.559 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.559 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6106 2024-09-12T16:16:18.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.559 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.559 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.559 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.559 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491438+0000", 2024-09-12T16:16:18.559 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.559 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.559 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.560 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491438+0000", 2024-09-12T16:16:18.560 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.560 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.560 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.560 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491438+0000", 2024-09-12T16:16:18.560 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:16:18.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.560 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.560 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.560 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491439+0000", 2024-09-12T16:16:18.560 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.049e-06 2024-09-12T16:16:18.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.561 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.561 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491442+0000", 2024-09-12T16:16:18.561 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.779e-06 2024-09-12T16:16:18.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.561 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.561 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491444+0000", 2024-09-12T16:16:18.561 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3630000000000001e-06 2024-09-12T16:16:18.561 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.561 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.561 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.562 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6138 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.562 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491785+0000", 2024-09-12T16:16:18.562 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013550049999999999, 2024-09-12T16:16:18.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013929199, 2024-09-12T16:16:18.562 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.562 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.562 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.562 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.562 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.562 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.562 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6138 2024-09-12T16:16:18.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.562 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.562 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.562 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.563 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491785+0000", 2024-09-12T16:16:18.563 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.563 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.563 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.563 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491785+0000", 2024-09-12T16:16:18.563 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.563 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.563 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.563 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497246+0000", 2024-09-12T16:16:18.563 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0054600899999999999 2024-09-12T16:16:18.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.563 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.563 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.564 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497251+0000", 2024-09-12T16:16:18.564 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0289999999999996e-06 2024-09-12T16:16:18.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.564 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.564 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.564 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497260+0000", 2024-09-12T16:16:18.564 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3880000000000006e-06 2024-09-12T16:16:18.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.564 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.564 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.564 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497267+0000", 2024-09-12T16:16:18.564 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6429999999999998e-06 2024-09-12T16:16:18.564 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.564 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.565 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.565 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.565 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6011 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.565 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.479573+0000", 2024-09-12T16:16:18.565 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.02576233, 2024-09-12T16:16:18.565 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.026164771999999999, 2024-09-12T16:16:18.565 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.565 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.565 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.565 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.565 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.565 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.565 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6011 2024-09-12T16:16:18.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.566 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.566 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.566 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479573+0000", 2024-09-12T16:16:18.566 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.566 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.566 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479573+0000", 2024-09-12T16:16:18.566 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.566 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.567 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479574+0000", 2024-09-12T16:16:18.567 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.39e-07 2024-09-12T16:16:18.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.567 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.567 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.567 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479575+0000", 2024-09-12T16:16:18.567 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.207e-06 2024-09-12T16:16:18.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.567 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.567 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.567 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479578+0000", 2024-09-12T16:16:18.567 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.495e-06 2024-09-12T16:16:18.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.567 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.567 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.568 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479581+0000", 2024-09-12T16:16:18.568 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6709999999999999e-06 2024-09-12T16:16:18.568 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.568 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.568 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.568 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.568 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6043 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.568 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485298+0000", 2024-09-12T16:16:18.568 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.020037197999999999, 2024-09-12T16:16:18.568 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020463230999999998, 2024-09-12T16:16:18.568 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.568 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.569 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.569 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.569 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.569 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.569 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6043 2024-09-12T16:16:18.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.569 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.569 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.569 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485298+0000", 2024-09-12T16:16:18.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.569 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.569 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485298+0000", 2024-09-12T16:16:18.570 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.570 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.570 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485299+0000", 2024-09-12T16:16:18.570 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.39e-07 2024-09-12T16:16:18.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.570 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.570 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485300+0000", 2024-09-12T16:16:18.570 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2410000000000001e-06 2024-09-12T16:16:18.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.571 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.571 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485303+0000", 2024-09-12T16:16:18.571 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1990000000000002e-06 2024-09-12T16:16:18.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.571 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.571 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.571 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485306+0000", 2024-09-12T16:16:18.571 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5720000000000001e-06 2024-09-12T16:16:18.571 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.571 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.571 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.571 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.571 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6075 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.572 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485674+0000", 2024-09-12T16:16:18.572 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019661563999999999, 2024-09-12T16:16:18.572 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020114657000000001, 2024-09-12T16:16:18.572 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.572 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.572 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.572 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.572 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.572 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.572 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6075 2024-09-12T16:16:18.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.572 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.572 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.572 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.572 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485674+0000", 2024-09-12T16:16:18.573 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.573 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.573 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485674+0000", 2024-09-12T16:16:18.573 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.573 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.573 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485674+0000", 2024-09-12T16:16:18.573 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1500000000000001e-07 2024-09-12T16:16:18.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.573 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.574 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485675+0000", 2024-09-12T16:16:18.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0049999999999999e-06 2024-09-12T16:16:18.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.574 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485678+0000", 2024-09-12T16:16:18.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.852e-06 2024-09-12T16:16:18.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.574 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485680+0000", 2024-09-12T16:16:18.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4329999999999998e-06 2024-09-12T16:16:18.574 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.574 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.574 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.575 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.575 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6107 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.575 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491447+0000", 2024-09-12T16:16:18.575 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013888541000000001, 2024-09-12T16:16:18.575 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014365018, 2024-09-12T16:16:18.575 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.575 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.575 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.575 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.575 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.575 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.575 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6107 2024-09-12T16:16:18.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.576 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.576 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.576 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.576 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491447+0000", 2024-09-12T16:16:18.576 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.576 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.576 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.576 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491447+0000", 2024-09-12T16:16:18.576 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.576 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.576 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.576 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491447+0000", 2024-09-12T16:16:18.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.11e-07 2024-09-12T16:16:18.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.577 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491448+0000", 2024-09-12T16:16:18.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7000000000000003e-07 2024-09-12T16:16:18.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.577 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491451+0000", 2024-09-12T16:16:18.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7300000000000001e-06 2024-09-12T16:16:18.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.577 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.578 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491453+0000", 2024-09-12T16:16:18.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3659999999999999e-06 2024-09-12T16:16:18.578 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.578 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.578 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.578 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6139 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.578 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.497277+0000", 2024-09-12T16:16:18.578 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0080587690000000003, 2024-09-12T16:16:18.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0085594590000000002, 2024-09-12T16:16:18.578 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.578 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.578 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.579 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.579 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.579 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.579 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6139 2024-09-12T16:16:18.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.579 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.579 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497277+0000", 2024-09-12T16:16:18.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.579 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497277+0000", 2024-09-12T16:16:18.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.580 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.580 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.580 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497277+0000", 2024-09-12T16:16:18.580 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0400000000000002e-07 2024-09-12T16:16:18.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.580 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.580 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.580 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497279+0000", 2024-09-12T16:16:18.580 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.716e-06 2024-09-12T16:16:18.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.580 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.580 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.580 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497283+0000", 2024-09-12T16:16:18.581 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8979999999999998e-06 2024-09-12T16:16:18.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497286+0000", 2024-09-12T16:16:18.581 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8949999999999998e-06 2024-09-12T16:16:18.581 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.581 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.581 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.581 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6012 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.581 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.479584+0000", 2024-09-12T16:16:18.581 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.02575115, 2024-09-12T16:16:18.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.026275120999999999, 2024-09-12T16:16:18.582 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.582 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.582 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.582 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.582 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.582 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.582 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6012 2024-09-12T16:16:18.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.582 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479584+0000", 2024-09-12T16:16:18.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479584+0000", 2024-09-12T16:16:18.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479585+0000", 2024-09-12T16:16:18.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0100000000000001e-07 2024-09-12T16:16:18.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479586+0000", 2024-09-12T16:16:18.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1349999999999999e-06 2024-09-12T16:16:18.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.584 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.584 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.584 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479590+0000", 2024-09-12T16:16:18.584 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1659999999999996e-06 2024-09-12T16:16:18.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.584 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.584 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.584 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479592+0000", 2024-09-12T16:16:18.584 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4040000000000002e-06 2024-09-12T16:16:18.584 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.584 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.584 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.585 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.585 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6044 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.585 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485309+0000", 2024-09-12T16:16:18.585 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.020026384000000001, 2024-09-12T16:16:18.585 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.02057347, 2024-09-12T16:16:18.585 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.585 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.585 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.585 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.585 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.585 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.585 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6044 2024-09-12T16:16:18.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.585 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.585 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485309+0000", 2024-09-12T16:16:18.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485309+0000", 2024-09-12T16:16:18.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485309+0000", 2024-09-12T16:16:18.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8999999999999998e-07 2024-09-12T16:16:18.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485310+0000", 2024-09-12T16:16:18.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.077e-06 2024-09-12T16:16:18.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485313+0000", 2024-09-12T16:16:18.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.83e-06 2024-09-12T16:16:18.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485316+0000", 2024-09-12T16:16:18.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6709999999999999e-06 2024-09-12T16:16:18.588 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.588 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.588 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.588 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6076 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.588 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485683+0000", 2024-09-12T16:16:18.588 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019652112999999999, 2024-09-12T16:16:18.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020222792999999999, 2024-09-12T16:16:18.588 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.588 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.588 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.589 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.589 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.589 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.589 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6076 2024-09-12T16:16:18.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.589 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.589 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.589 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485683+0000", 2024-09-12T16:16:18.589 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.589 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.589 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485683+0000", 2024-09-12T16:16:18.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485684+0000", 2024-09-12T16:16:18.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.16e-07 2024-09-12T16:16:18.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485685+0000", 2024-09-12T16:16:18.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.004e-06 2024-09-12T16:16:18.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485687+0000", 2024-09-12T16:16:18.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8090000000000001e-06 2024-09-12T16:16:18.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485690+0000", 2024-09-12T16:16:18.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.379e-06 2024-09-12T16:16:18.591 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.591 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.591 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.591 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6108 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.592 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491456+0000", 2024-09-12T16:16:18.592 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013879356000000001, 2024-09-12T16:16:18.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014473757, 2024-09-12T16:16:18.592 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.592 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.592 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.592 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.592 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.592 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.592 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6108 2024-09-12T16:16:18.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.592 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491456+0000", 2024-09-12T16:16:18.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.593 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.593 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491456+0000", 2024-09-12T16:16:18.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.593 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.593 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491456+0000", 2024-09-12T16:16:18.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1899999999999999e-07 2024-09-12T16:16:18.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.593 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.594 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491457+0000", 2024-09-12T16:16:18.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.035e-06 2024-09-12T16:16:18.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.594 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.594 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.594 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491460+0000", 2024-09-12T16:16:18.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.729e-06 2024-09-12T16:16:18.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.594 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.594 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.594 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491462+0000", 2024-09-12T16:16:18.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2900000000000001e-06 2024-09-12T16:16:18.594 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.594 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.594 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.595 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6140 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.595 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.497290+0000", 2024-09-12T16:16:18.595 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0080458049999999996, 2024-09-12T16:16:18.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0086630979999999993, 2024-09-12T16:16:18.595 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.595 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.595 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.595 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.595 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.595 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.595 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6140 2024-09-12T16:16:18.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.595 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.596 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.596 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.596 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497290+0000", 2024-09-12T16:16:18.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.596 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.596 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.596 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497290+0000", 2024-09-12T16:16:18.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.596 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.596 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.596 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497290+0000", 2024-09-12T16:16:18.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.34e-07 2024-09-12T16:16:18.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497291+0000", 2024-09-12T16:16:18.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.339e-06 2024-09-12T16:16:18.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497294+0000", 2024-09-12T16:16:18.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0460000000000001e-06 2024-09-12T16:16:18.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497297+0000", 2024-09-12T16:16:18.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4609999999999998e-06 2024-09-12T16:16:18.598 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.598 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.598 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.598 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.598 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6013 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.598 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.479595+0000", 2024-09-12T16:16:18.598 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.025740032999999999, 2024-09-12T16:16:18.598 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.026383031000000001, 2024-09-12T16:16:18.598 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.598 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.598 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.598 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.598 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.599 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.599 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6013 2024-09-12T16:16:18.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.599 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479595+0000", 2024-09-12T16:16:18.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479595+0000", 2024-09-12T16:16:18.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479596+0000", 2024-09-12T16:16:18.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.23e-07 2024-09-12T16:16:18.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479597+0000", 2024-09-12T16:16:18.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0780000000000001e-06 2024-09-12T16:16:18.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479600+0000", 2024-09-12T16:16:18.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8909999999999999e-06 2024-09-12T16:16:18.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479602+0000", 2024-09-12T16:16:18.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3800000000000001e-06 2024-09-12T16:16:18.601 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.601 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.601 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.601 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6045 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.601 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485319+0000", 2024-09-12T16:16:18.601 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.020016459, 2024-09-12T16:16:18.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020682955999999999, 2024-09-12T16:16:18.602 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.602 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.602 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.602 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.602 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.602 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.602 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6045 2024-09-12T16:16:18.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.602 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.602 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.602 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485319+0000", 2024-09-12T16:16:18.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.603 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.603 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485319+0000", 2024-09-12T16:16:18.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.603 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.603 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.603 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485319+0000", 2024-09-12T16:16:18.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1e-07 2024-09-12T16:16:18.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.603 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.603 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.603 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485320+0000", 2024-09-12T16:16:18.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.054e-06 2024-09-12T16:16:18.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.603 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.604 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.604 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485323+0000", 2024-09-12T16:16:18.604 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8100000000000002e-06 2024-09-12T16:16:18.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.604 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.604 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485326+0000", 2024-09-12T16:16:18.604 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.52e-06 2024-09-12T16:16:18.604 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.604 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.604 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.604 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6077 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.605 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485693+0000", 2024-09-12T16:16:18.605 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019642825999999999, 2024-09-12T16:16:18.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020332517000000001, 2024-09-12T16:16:18.605 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.605 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.605 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.605 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.605 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.605 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.605 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6077 2024-09-12T16:16:18.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.605 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.605 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485693+0000", 2024-09-12T16:16:18.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485693+0000", 2024-09-12T16:16:18.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485693+0000", 2024-09-12T16:16:18.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.17e-07 2024-09-12T16:16:18.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485694+0000", 2024-09-12T16:16:18.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7300000000000004e-07 2024-09-12T16:16:18.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485697+0000", 2024-09-12T16:16:18.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7190000000000001e-06 2024-09-12T16:16:18.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485699+0000", 2024-09-12T16:16:18.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.384e-06 2024-09-12T16:16:18.607 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.607 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.607 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.608 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6109 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.608 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491465+0000", 2024-09-12T16:16:18.608 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013870271, 2024-09-12T16:16:18.608 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014585234000000001, 2024-09-12T16:16:18.608 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.608 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.608 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.608 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.608 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.608 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.608 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6109 2024-09-12T16:16:18.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.609 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491465+0000", 2024-09-12T16:16:18.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491465+0000", 2024-09-12T16:16:18.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.610 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491465+0000", 2024-09-12T16:16:18.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1400000000000001e-07 2024-09-12T16:16:18.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.610 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.610 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491467+0000", 2024-09-12T16:16:18.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.052e-06 2024-09-12T16:16:18.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.610 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.610 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491469+0000", 2024-09-12T16:16:18.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.791e-06 2024-09-12T16:16:18.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.610 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491472+0000", 2024-09-12T16:16:18.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3640000000000002e-06 2024-09-12T16:16:18.611 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.611 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.611 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.611 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6141 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.611 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.497301+0000", 2024-09-12T16:16:18.611 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0080340489999999997, 2024-09-12T16:16:18.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0087726809999999992, 2024-09-12T16:16:18.611 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.611 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.611 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.611 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.612 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.612 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.612 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6141 2024-09-12T16:16:18.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.612 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497301+0000", 2024-09-12T16:16:18.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497301+0000", 2024-09-12T16:16:18.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.613 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.613 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.613 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497302+0000", 2024-09-12T16:16:18.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3999999999999998e-07 2024-09-12T16:16:18.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.613 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.613 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.613 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497303+0000", 2024-09-12T16:16:18.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.254e-06 2024-09-12T16:16:18.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.613 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.613 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.613 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497306+0000", 2024-09-12T16:16:18.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0599999999999999e-06 2024-09-12T16:16:18.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.614 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.614 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497309+0000", 2024-09-12T16:16:18.614 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5210000000000001e-06 2024-09-12T16:16:18.614 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.614 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.614 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.614 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6014 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.614 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.479605+0000", 2024-09-12T16:16:18.614 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.02573056, 2024-09-12T16:16:18.614 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.026492522000000001, 2024-09-12T16:16:18.614 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.615 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.615 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.615 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.615 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.615 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.615 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6014 2024-09-12T16:16:18.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.615 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.615 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.615 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.615 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479605+0000", 2024-09-12T16:16:18.615 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.615 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.616 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.616 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479605+0000", 2024-09-12T16:16:18.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.616 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.616 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479605+0000", 2024-09-12T16:16:18.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0900000000000001e-07 2024-09-12T16:16:18.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.616 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.616 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479606+0000", 2024-09-12T16:16:18.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0109999999999999e-06 2024-09-12T16:16:18.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.617 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479610+0000", 2024-09-12T16:16:18.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9219999999999999e-06 2024-09-12T16:16:18.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.617 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479613+0000", 2024-09-12T16:16:18.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4559999999999999e-06 2024-09-12T16:16:18.617 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.617 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.617 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.618 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6046 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.618 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485329+0000", 2024-09-12T16:16:18.618 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.020006886000000002, 2024-09-12T16:16:18.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020792340999999999, 2024-09-12T16:16:18.618 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.618 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.618 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.618 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.618 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.618 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.618 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6046 2024-09-12T16:16:18.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.618 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.619 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.619 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.619 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485329+0000", 2024-09-12T16:16:18.619 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.619 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.619 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.619 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485329+0000", 2024-09-12T16:16:18.619 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.619 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.619 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.619 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485329+0000", 2024-09-12T16:16:18.619 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0599999999999999e-07 2024-09-12T16:16:18.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.620 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485330+0000", 2024-09-12T16:16:18.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1829999999999999e-06 2024-09-12T16:16:18.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.620 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485333+0000", 2024-09-12T16:16:18.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7949999999999999e-06 2024-09-12T16:16:18.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.620 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485335+0000", 2024-09-12T16:16:18.621 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.441e-06 2024-09-12T16:16:18.621 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.621 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.621 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.621 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6078 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.621 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485703+0000", 2024-09-12T16:16:18.621 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019632944999999999, 2024-09-12T16:16:18.621 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020442195999999999, 2024-09-12T16:16:18.621 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.621 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.621 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.622 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.622 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.622 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.622 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6078 2024-09-12T16:16:18.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.622 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.622 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.622 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.622 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485703+0000", 2024-09-12T16:16:18.622 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.622 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.623 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.623 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485703+0000", 2024-09-12T16:16:18.623 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.623 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.623 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485703+0000", 2024-09-12T16:16:18.623 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0800000000000001e-07 2024-09-12T16:16:18.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.623 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.623 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485706+0000", 2024-09-12T16:16:18.623 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.27e-06 2024-09-12T16:16:18.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.624 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485709+0000", 2024-09-12T16:16:18.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0029999999999999e-06 2024-09-12T16:16:18.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.624 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485712+0000", 2024-09-12T16:16:18.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4609999999999998e-06 2024-09-12T16:16:18.624 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.624 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.624 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.625 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.625 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.625 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6110 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.625 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491475+0000", 2024-09-12T16:16:18.625 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013861002000000001, 2024-09-12T16:16:18.625 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014693555000000001, 2024-09-12T16:16:18.625 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.625 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.625 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.625 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.625 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.625 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.625 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6110 2024-09-12T16:16:18.625 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.625 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.626 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.626 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.626 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491475+0000", 2024-09-12T16:16:18.626 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.626 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.626 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.626 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491475+0000", 2024-09-12T16:16:18.626 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.626 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.626 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.626 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491475+0000", 2024-09-12T16:16:18.626 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.41e-07 2024-09-12T16:16:18.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.626 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.627 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.627 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491476+0000", 2024-09-12T16:16:18.627 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7499999999999998e-07 2024-09-12T16:16:18.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.627 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.627 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.627 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491478+0000", 2024-09-12T16:16:18.627 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7719999999999999e-06 2024-09-12T16:16:18.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.627 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.627 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.627 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491482+0000", 2024-09-12T16:16:18.627 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8600000000000003e-06 2024-09-12T16:16:18.627 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.627 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.628 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.628 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.628 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.628 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6142 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.628 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.497312+0000", 2024-09-12T16:16:18.628 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0080237510000000008, 2024-09-12T16:16:18.628 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0088792139999999999, 2024-09-12T16:16:18.628 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.628 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.628 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.628 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.628 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.628 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.628 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6142 2024-09-12T16:16:18.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.629 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.629 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497312+0000", 2024-09-12T16:16:18.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.629 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497312+0000", 2024-09-12T16:16:18.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.629 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497312+0000", 2024-09-12T16:16:18.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2999999999999999e-07 2024-09-12T16:16:18.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.630 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.630 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.630 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497313+0000", 2024-09-12T16:16:18.630 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2020000000000001e-06 2024-09-12T16:16:18.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.630 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.630 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.630 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497316+0000", 2024-09-12T16:16:18.630 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8660000000000002e-06 2024-09-12T16:16:18.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.630 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.630 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.630 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497320+0000", 2024-09-12T16:16:18.631 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8e-06 2024-09-12T16:16:18.631 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.631 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.631 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.631 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.631 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.631 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6015 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.631 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.479616+0000", 2024-09-12T16:16:18.631 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.025719822, 2024-09-12T16:16:18.631 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.026632660999999998, 2024-09-12T16:16:18.631 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.631 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.631 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.631 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.632 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.632 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.632 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6015 2024-09-12T16:16:18.632 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.632 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.632 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.632 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.632 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479616+0000", 2024-09-12T16:16:18.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.632 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.632 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.632 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.632 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479616+0000", 2024-09-12T16:16:18.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.633 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.633 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.633 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479616+0000", 2024-09-12T16:16:18.633 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1400000000000001e-07 2024-09-12T16:16:18.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.633 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.633 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.633 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479617+0000", 2024-09-12T16:16:18.633 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0950000000000001e-06 2024-09-12T16:16:18.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.633 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.633 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.634 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479620+0000", 2024-09-12T16:16:18.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8480000000000001e-06 2024-09-12T16:16:18.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.634 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.634 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.634 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479622+0000", 2024-09-12T16:16:18.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3460000000000001e-06 2024-09-12T16:16:18.634 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.634 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.634 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.634 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.634 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6047 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.634 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485338+0000", 2024-09-12T16:16:18.634 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019997241999999998, 2024-09-12T16:16:18.635 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020934023999999999, 2024-09-12T16:16:18.635 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.635 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.635 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.635 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.635 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.635 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.635 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6047 2024-09-12T16:16:18.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.635 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.635 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.635 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.635 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485338+0000", 2024-09-12T16:16:18.635 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.636 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.636 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.636 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485338+0000", 2024-09-12T16:16:18.636 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.636 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.636 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.636 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485338+0000", 2024-09-12T16:16:18.636 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1400000000000001e-07 2024-09-12T16:16:18.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.636 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.636 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.636 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485339+0000", 2024-09-12T16:16:18.636 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9000000000000005e-07 2024-09-12T16:16:18.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.637 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.637 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.637 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485342+0000", 2024-09-12T16:16:18.637 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7300000000000001e-06 2024-09-12T16:16:18.637 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.637 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.637 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.637 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485345+0000", 2024-09-12T16:16:18.637 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4679999999999999e-06 2024-09-12T16:16:18.637 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.637 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.637 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.637 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.637 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.637 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6079 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.638 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485715+0000", 2024-09-12T16:16:18.638 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019620598999999999, 2024-09-12T16:16:18.638 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020585922999999999, 2024-09-12T16:16:18.638 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.638 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.638 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.638 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.638 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.638 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.638 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6079 2024-09-12T16:16:18.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.638 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.638 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.638 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.638 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485715+0000", 2024-09-12T16:16:18.639 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.639 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.639 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.639 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485715+0000", 2024-09-12T16:16:18.639 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.639 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.639 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.639 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485715+0000", 2024-09-12T16:16:18.639 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1400000000000001e-07 2024-09-12T16:16:18.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.639 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.639 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.639 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485716+0000", 2024-09-12T16:16:18.640 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.035e-06 2024-09-12T16:16:18.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.640 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.640 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.640 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485719+0000", 2024-09-12T16:16:18.640 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7829999999999999e-06 2024-09-12T16:16:18.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.640 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.640 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.640 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485721+0000", 2024-09-12T16:16:18.640 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4080000000000001e-06 2024-09-12T16:16:18.640 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.640 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.640 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.641 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.641 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6111 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.641 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491488+0000", 2024-09-12T16:16:18.641 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.01384749, 2024-09-12T16:16:18.641 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014838283000000001, 2024-09-12T16:16:18.641 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.641 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.641 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.641 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.641 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.641 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.641 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6111 2024-09-12T16:16:18.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.641 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.642 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.642 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.642 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491488+0000", 2024-09-12T16:16:18.642 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.642 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.642 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.642 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.642 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491488+0000", 2024-09-12T16:16:18.642 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.642 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.642 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.642 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.642 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491488+0000", 2024-09-12T16:16:18.643 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6499999999999999e-07 2024-09-12T16:16:18.643 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.643 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.643 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.643 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491490+0000", 2024-09-12T16:16:18.643 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7549999999999999e-06 2024-09-12T16:16:18.643 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.643 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.643 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.643 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491496+0000", 2024-09-12T16:16:18.643 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4589999999999997e-06 2024-09-12T16:16:18.643 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.643 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.644 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.644 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491500+0000", 2024-09-12T16:16:18.644 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6800000000000001e-06 2024-09-12T16:16:18.644 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.644 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.644 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.644 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.644 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6143 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.644 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.497323+0000", 2024-09-12T16:16:18.644 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0080123550000000005, 2024-09-12T16:16:18.644 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0090369500000000002, 2024-09-12T16:16:18.644 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.645 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.645 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.645 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.645 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.645 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.645 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6143 2024-09-12T16:16:18.645 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.645 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.645 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.645 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.645 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497323+0000", 2024-09-12T16:16:18.645 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.645 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.645 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.646 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.646 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497323+0000", 2024-09-12T16:16:18.646 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.646 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.646 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.646 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.646 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497323+0000", 2024-09-12T16:16:18.646 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2600000000000001e-07 2024-09-12T16:16:18.646 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.646 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.646 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.646 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497325+0000", 2024-09-12T16:16:18.646 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1689999999999999e-06 2024-09-12T16:16:18.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.647 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.647 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.647 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497327+0000", 2024-09-12T16:16:18.647 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9040000000000001e-06 2024-09-12T16:16:18.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.647 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.647 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.647 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497331+0000", 2024-09-12T16:16:18.647 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4020000000000002e-06 2024-09-12T16:16:18.647 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.647 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.647 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.648 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.648 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6016 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.648 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.479625+0000", 2024-09-12T16:16:18.648 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.025710295000000001, 2024-09-12T16:16:18.648 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.026758837000000001, 2024-09-12T16:16:18.648 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.648 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.648 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.648 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.648 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.648 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.648 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6016 2024-09-12T16:16:18.648 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.649 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.649 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.649 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.649 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479625+0000", 2024-09-12T16:16:18.649 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.649 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.649 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.649 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.649 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479625+0000", 2024-09-12T16:16:18.649 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.650 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.650 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.650 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479625+0000", 2024-09-12T16:16:18.650 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:16:18.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.650 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.650 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.650 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479626+0000", 2024-09-12T16:16:18.650 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0640000000000001e-06 2024-09-12T16:16:18.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.650 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.650 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.650 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479629+0000", 2024-09-12T16:16:18.650 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7700000000000002e-06 2024-09-12T16:16:18.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.651 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.651 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.651 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479632+0000", 2024-09-12T16:16:18.651 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.39e-06 2024-09-12T16:16:18.651 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.651 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.651 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.651 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.651 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6048 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.651 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485348+0000", 2024-09-12T16:16:18.651 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019987917000000001, 2024-09-12T16:16:18.652 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021062945, 2024-09-12T16:16:18.652 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.652 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.652 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.652 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.652 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.652 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.652 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6048 2024-09-12T16:16:18.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.652 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.652 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.652 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.652 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485348+0000", 2024-09-12T16:16:18.653 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.653 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.653 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.653 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.653 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485348+0000", 2024-09-12T16:16:18.653 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.653 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.653 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.653 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.653 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485348+0000", 2024-09-12T16:16:18.653 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:16:18.653 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.653 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.653 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.654 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485349+0000", 2024-09-12T16:16:18.654 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.066e-06 2024-09-12T16:16:18.654 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.654 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.654 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.654 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485352+0000", 2024-09-12T16:16:18.654 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7539999999999998e-06 2024-09-12T16:16:18.654 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.654 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.654 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.654 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485354+0000", 2024-09-12T16:16:18.654 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3089999999999998e-06 2024-09-12T16:16:18.654 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.654 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.654 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.655 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.655 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.655 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6080 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.655 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485724+0000", 2024-09-12T16:16:18.655 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019611244999999999, 2024-09-12T16:16:18.655 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020709699000000002, 2024-09-12T16:16:18.655 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.655 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.655 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.655 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.655 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.655 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.655 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6080 2024-09-12T16:16:18.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.656 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.656 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.656 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.656 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485724+0000", 2024-09-12T16:16:18.656 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.656 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.656 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.656 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485724+0000", 2024-09-12T16:16:18.656 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.657 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.657 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.657 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485724+0000", 2024-09-12T16:16:18.657 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.17e-07 2024-09-12T16:16:18.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.657 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.657 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.657 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485725+0000", 2024-09-12T16:16:18.657 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.850000000000001e-07 2024-09-12T16:16:18.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.657 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.657 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.657 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485728+0000", 2024-09-12T16:16:18.658 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7870000000000002e-06 2024-09-12T16:16:18.658 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.658 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.658 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.658 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485731+0000", 2024-09-12T16:16:18.658 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.373e-06 2024-09-12T16:16:18.658 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.658 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.658 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.658 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.658 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.658 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6112 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.658 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491504+0000", 2024-09-12T16:16:18.659 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013831055, 2024-09-12T16:16:18.659 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014954146, 2024-09-12T16:16:18.659 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.659 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.659 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.659 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.659 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.659 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.659 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6112 2024-09-12T16:16:18.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.659 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.659 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.659 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.659 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491504+0000", 2024-09-12T16:16:18.659 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.660 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.660 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.660 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.660 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491504+0000", 2024-09-12T16:16:18.660 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.660 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.660 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.660 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.660 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491505+0000", 2024-09-12T16:16:18.660 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4400000000000001e-07 2024-09-12T16:16:18.660 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.660 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.660 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.660 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491506+0000", 2024-09-12T16:16:18.660 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.203e-06 2024-09-12T16:16:18.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.661 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.661 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.661 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491509+0000", 2024-09-12T16:16:18.661 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0419999999999998e-06 2024-09-12T16:16:18.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.661 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.661 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.661 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491511+0000", 2024-09-12T16:16:18.661 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4609999999999998e-06 2024-09-12T16:16:18.661 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.661 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.661 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.662 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.662 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6144 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.662 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.497334+0000", 2024-09-12T16:16:18.662 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0080014839999999997, 2024-09-12T16:16:18.662 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0091475259999999996, 2024-09-12T16:16:18.662 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.662 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.662 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.662 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.662 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.662 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.662 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6144 2024-09-12T16:16:18.662 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.662 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.663 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.663 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.663 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497334+0000", 2024-09-12T16:16:18.663 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.663 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.663 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.663 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.663 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497334+0000", 2024-09-12T16:16:18.663 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.663 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.663 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.663 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.663 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497334+0000", 2024-09-12T16:16:18.663 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.17e-07 2024-09-12T16:16:18.664 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.664 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.664 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.664 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497335+0000", 2024-09-12T16:16:18.664 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.111e-06 2024-09-12T16:16:18.664 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.664 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.664 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.664 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497338+0000", 2024-09-12T16:16:18.664 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.869e-06 2024-09-12T16:16:18.664 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.664 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.664 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.664 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497341+0000", 2024-09-12T16:16:18.664 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0369999999999999e-06 2024-09-12T16:16:18.665 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.665 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.665 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.665 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.665 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.665 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6017 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.665 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.479635+0000", 2024-09-12T16:16:18.665 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.025700830000000001, 2024-09-12T16:16:18.665 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.026874572999999999, 2024-09-12T16:16:18.665 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.665 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.665 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.665 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.665 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.665 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.666 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6017 2024-09-12T16:16:18.666 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.666 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.666 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.666 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.666 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479635+0000", 2024-09-12T16:16:18.666 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.666 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.666 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.666 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.666 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479635+0000", 2024-09-12T16:16:18.666 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.666 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.666 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.667 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.667 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479635+0000", 2024-09-12T16:16:18.667 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2000000000000001e-07 2024-09-12T16:16:18.667 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.667 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.667 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.667 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479636+0000", 2024-09-12T16:16:18.667 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0470000000000001e-06 2024-09-12T16:16:18.667 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.667 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.667 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.667 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479639+0000", 2024-09-12T16:16:18.667 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3840000000000001e-06 2024-09-12T16:16:18.667 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.667 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.668 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.668 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479642+0000", 2024-09-12T16:16:18.668 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4739999999999999e-06 2024-09-12T16:16:18.668 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.668 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.668 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.668 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.668 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.668 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6049 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.668 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485357+0000", 2024-09-12T16:16:18.668 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.01997869, 2024-09-12T16:16:18.668 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021175937999999998, 2024-09-12T16:16:18.668 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.668 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.668 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.669 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.669 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.669 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.669 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6049 2024-09-12T16:16:18.669 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.669 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.669 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.669 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.669 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485357+0000", 2024-09-12T16:16:18.669 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.669 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.669 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.669 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.669 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485357+0000", 2024-09-12T16:16:18.669 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.670 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.670 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.670 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.670 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485357+0000", 2024-09-12T16:16:18.670 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1299999999999999e-07 2024-09-12T16:16:18.670 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.670 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.670 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.670 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485358+0000", 2024-09-12T16:16:18.670 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3900000000000003e-07 2024-09-12T16:16:18.670 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.670 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.670 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.671 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485361+0000", 2024-09-12T16:16:18.671 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6790000000000001e-06 2024-09-12T16:16:18.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.671 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.671 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.671 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485363+0000", 2024-09-12T16:16:18.671 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3879999999999998e-06 2024-09-12T16:16:18.671 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.671 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.671 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.671 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.671 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6081 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.671 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485734+0000", 2024-09-12T16:16:18.672 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019601949, 2024-09-12T16:16:18.672 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020824116, 2024-09-12T16:16:18.672 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.672 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.672 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.672 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.672 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.672 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.672 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6081 2024-09-12T16:16:18.672 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.672 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.672 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.672 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.672 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485734+0000", 2024-09-12T16:16:18.673 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.673 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.673 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.673 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.673 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485734+0000", 2024-09-12T16:16:18.673 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.673 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.673 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.673 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.673 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485734+0000", 2024-09-12T16:16:18.673 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2100000000000002e-07 2024-09-12T16:16:18.673 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.673 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.673 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.673 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485735+0000", 2024-09-12T16:16:18.674 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.879999999999999e-07 2024-09-12T16:16:18.674 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.674 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.674 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.674 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485738+0000", 2024-09-12T16:16:18.674 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7350000000000001e-06 2024-09-12T16:16:18.674 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.674 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.674 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.674 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485740+0000", 2024-09-12T16:16:18.674 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.289e-06 2024-09-12T16:16:18.674 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.674 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.674 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.674 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.675 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.675 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6113 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.675 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491514+0000", 2024-09-12T16:16:18.675 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013821118, 2024-09-12T16:16:18.675 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015066503, 2024-09-12T16:16:18.675 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.675 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.675 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.675 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.675 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.675 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.675 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6113 2024-09-12T16:16:18.675 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.675 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.675 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.675 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.676 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491514+0000", 2024-09-12T16:16:18.676 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.676 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.676 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.676 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.676 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491514+0000", 2024-09-12T16:16:18.676 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.676 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.676 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.676 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.676 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491515+0000", 2024-09-12T16:16:18.676 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.84e-07 2024-09-12T16:16:18.676 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.676 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.677 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.677 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491519+0000", 2024-09-12T16:16:18.677 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0790000000000002e-06 2024-09-12T16:16:18.677 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.677 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.677 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.677 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491522+0000", 2024-09-12T16:16:18.677 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4809999999999998e-06 2024-09-12T16:16:18.677 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.677 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.677 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.677 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491525+0000", 2024-09-12T16:16:18.677 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4609999999999998e-06 2024-09-12T16:16:18.677 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.678 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.678 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.678 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.678 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.678 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6145 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.678 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.497344+0000", 2024-09-12T16:16:18.678 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0079911500000000007, 2024-09-12T16:16:18.678 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0092610780000000007, 2024-09-12T16:16:18.678 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.678 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.678 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.678 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.678 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.678 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.679 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6145 2024-09-12T16:16:18.679 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.679 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.679 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.679 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.679 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497344+0000", 2024-09-12T16:16:18.679 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.679 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.679 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.679 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.679 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497344+0000", 2024-09-12T16:16:18.679 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.679 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.679 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.680 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.680 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497345+0000", 2024-09-12T16:16:18.680 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3300000000000001e-07 2024-09-12T16:16:18.680 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.680 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.680 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.680 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497346+0000", 2024-09-12T16:16:18.680 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.195e-06 2024-09-12T16:16:18.680 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.680 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.680 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.680 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497351+0000", 2024-09-12T16:16:18.680 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2889999999999997e-06 2024-09-12T16:16:18.680 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.681 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.681 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.681 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497355+0000", 2024-09-12T16:16:18.681 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.878e-06 2024-09-12T16:16:18.681 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.681 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.681 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.681 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.681 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.681 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6018 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.681 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.479645+0000", 2024-09-12T16:16:18.681 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.025690671000000002, 2024-09-12T16:16:18.681 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.026984898, 2024-09-12T16:16:18.681 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.682 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.682 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.682 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.682 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.682 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.682 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6018 2024-09-12T16:16:18.682 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.682 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.682 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.682 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.682 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479645+0000", 2024-09-12T16:16:18.682 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.682 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.682 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.682 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.683 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479645+0000", 2024-09-12T16:16:18.683 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.683 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.683 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.683 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.683 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479645+0000", 2024-09-12T16:16:18.683 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.11e-07 2024-09-12T16:16:18.683 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.683 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.683 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.683 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479649+0000", 2024-09-12T16:16:18.683 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5480000000000002e-06 2024-09-12T16:16:18.683 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.683 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.683 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.684 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479652+0000", 2024-09-12T16:16:18.684 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9629999999999998e-06 2024-09-12T16:16:18.684 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.684 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.684 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.684 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479654+0000", 2024-09-12T16:16:18.684 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.463e-06 2024-09-12T16:16:18.684 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.684 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.684 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.684 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.684 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.684 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6050 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.684 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485366+0000", 2024-09-12T16:16:18.685 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019969555999999999, 2024-09-12T16:16:18.685 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.02128793, 2024-09-12T16:16:18.685 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.685 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.685 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.685 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.685 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.685 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.685 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6050 2024-09-12T16:16:18.685 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.685 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.685 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.685 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.685 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485366+0000", 2024-09-12T16:16:18.686 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.686 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.686 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.686 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.686 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485366+0000", 2024-09-12T16:16:18.686 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.686 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.686 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.686 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.686 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485366+0000", 2024-09-12T16:16:18.686 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.16e-07 2024-09-12T16:16:18.686 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.686 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.686 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.686 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485367+0000", 2024-09-12T16:16:18.687 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.052e-06 2024-09-12T16:16:18.687 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.687 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.687 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.687 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485370+0000", 2024-09-12T16:16:18.687 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7609999999999999e-06 2024-09-12T16:16:18.687 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.687 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.687 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.687 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485373+0000", 2024-09-12T16:16:18.687 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9979999999999999e-06 2024-09-12T16:16:18.687 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.687 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.688 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.688 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.688 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.688 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6082 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.688 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485757+0000", 2024-09-12T16:16:18.688 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019578753000000001, 2024-09-12T16:16:18.688 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020921862999999999, 2024-09-12T16:16:18.688 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.688 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.688 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.688 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.688 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.688 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.688 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6082 2024-09-12T16:16:18.689 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.689 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.689 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.689 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.689 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485757+0000", 2024-09-12T16:16:18.689 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.689 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.689 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.689 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.689 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485757+0000", 2024-09-12T16:16:18.689 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.689 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.689 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.689 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.689 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485757+0000", 2024-09-12T16:16:18.690 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9299999999999999e-07 2024-09-12T16:16:18.690 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.690 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.690 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.690 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485758+0000", 2024-09-12T16:16:18.690 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1000000000000001e-06 2024-09-12T16:16:18.690 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.690 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.690 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.690 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485762+0000", 2024-09-12T16:16:18.690 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4000000000000001e-06 2024-09-12T16:16:18.690 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.690 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.690 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.690 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485764+0000", 2024-09-12T16:16:18.691 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5900000000000002e-06 2024-09-12T16:16:18.691 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.691 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.691 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.691 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.691 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.691 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6114 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.691 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491528+0000", 2024-09-12T16:16:18.691 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013807396, 2024-09-12T16:16:18.691 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015173659000000001, 2024-09-12T16:16:18.691 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.691 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.691 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.691 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.692 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.692 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.692 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6114 2024-09-12T16:16:18.692 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.692 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.692 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.692 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.692 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491528+0000", 2024-09-12T16:16:18.692 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.692 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.692 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.692 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.692 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491528+0000", 2024-09-12T16:16:18.693 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.693 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.693 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.693 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.693 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491528+0000", 2024-09-12T16:16:18.693 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.23e-07 2024-09-12T16:16:18.693 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.693 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.693 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.693 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491529+0000", 2024-09-12T16:16:18.693 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.026e-06 2024-09-12T16:16:18.693 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.694 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.694 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.694 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491532+0000", 2024-09-12T16:16:18.694 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7839999999999999e-06 2024-09-12T16:16:18.694 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.694 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.694 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.694 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491535+0000", 2024-09-12T16:16:18.694 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4480000000000001e-06 2024-09-12T16:16:18.694 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.694 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.694 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.694 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.694 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.694 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6146 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.695 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.497371+0000", 2024-09-12T16:16:18.695 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0079642949999999997, 2024-09-12T16:16:18.695 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0093550200000000003, 2024-09-12T16:16:18.695 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.695 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.695 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.695 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.695 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.695 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.695 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6146 2024-09-12T16:16:18.695 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.695 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.695 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.695 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.696 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497371+0000", 2024-09-12T16:16:18.696 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.696 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.696 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.696 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.696 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497371+0000", 2024-09-12T16:16:18.696 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.696 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.696 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.696 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.696 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497372+0000", 2024-09-12T16:16:18.696 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2300000000000001e-07 2024-09-12T16:16:18.696 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.696 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.696 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.697 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497374+0000", 2024-09-12T16:16:18.697 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2369999999999999e-06 2024-09-12T16:16:18.697 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.697 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.697 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.697 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497380+0000", 2024-09-12T16:16:18.697 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3879999999999997e-06 2024-09-12T16:16:18.697 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.697 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.697 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.697 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497386+0000", 2024-09-12T16:16:18.697 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1830000000000002e-06 2024-09-12T16:16:18.697 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.697 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.698 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.698 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.698 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.698 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6019 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.698 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.479657+0000", 2024-09-12T16:16:18.698 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.025678212999999998, 2024-09-12T16:16:18.698 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.027093316999999999, 2024-09-12T16:16:18.698 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.698 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.698 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.698 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.698 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.698 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.699 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6019 2024-09-12T16:16:18.699 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.699 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.699 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.699 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.699 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479657+0000", 2024-09-12T16:16:18.699 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.699 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.699 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.699 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.699 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479657+0000", 2024-09-12T16:16:18.699 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.699 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.700 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.700 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.700 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479658+0000", 2024-09-12T16:16:18.700 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3699999999999999e-07 2024-09-12T16:16:18.700 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.700 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.700 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.700 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479659+0000", 2024-09-12T16:16:18.700 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0559999999999999e-06 2024-09-12T16:16:18.700 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.700 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.700 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.700 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479661+0000", 2024-09-12T16:16:18.701 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.756e-06 2024-09-12T16:16:18.701 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.701 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.701 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.701 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479664+0000", 2024-09-12T16:16:18.701 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.543e-06 2024-09-12T16:16:18.701 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.701 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.701 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.701 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.701 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.701 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6051 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.701 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485376+0000", 2024-09-12T16:16:18.701 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019959340999999999, 2024-09-12T16:16:18.702 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021400058, 2024-09-12T16:16:18.702 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.702 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.702 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.702 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.702 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.702 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.702 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6051 2024-09-12T16:16:18.702 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.702 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.702 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.702 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.702 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485376+0000", 2024-09-12T16:16:18.703 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.703 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.703 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.703 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.703 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485376+0000", 2024-09-12T16:16:18.703 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.703 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.703 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.703 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.703 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485376+0000", 2024-09-12T16:16:18.703 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1500000000000001e-07 2024-09-12T16:16:18.703 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.703 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.703 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.704 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485377+0000", 2024-09-12T16:16:18.704 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0139999999999999e-06 2024-09-12T16:16:18.704 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.704 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.704 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.704 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485380+0000", 2024-09-12T16:16:18.704 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7140000000000002e-06 2024-09-12T16:16:18.704 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.704 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.704 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.704 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485383+0000", 2024-09-12T16:16:18.704 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5380000000000001e-06 2024-09-12T16:16:18.704 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.704 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.704 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.705 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.705 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.705 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6083 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.705 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485767+0000", 2024-09-12T16:16:18.705 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019568018999999999, 2024-09-12T16:16:18.705 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021031726000000001, 2024-09-12T16:16:18.705 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.705 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.705 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.705 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.705 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.705 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.705 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6083 2024-09-12T16:16:18.705 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.705 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.706 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.706 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.706 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485767+0000", 2024-09-12T16:16:18.706 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.706 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.706 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.706 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.706 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485767+0000", 2024-09-12T16:16:18.706 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.706 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.706 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.706 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.706 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485768+0000", 2024-09-12T16:16:18.706 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0400000000000002e-07 2024-09-12T16:16:18.706 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.707 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.707 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.707 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485769+0000", 2024-09-12T16:16:18.707 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.004e-06 2024-09-12T16:16:18.707 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.707 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.707 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.707 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485772+0000", 2024-09-12T16:16:18.707 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.836e-06 2024-09-12T16:16:18.707 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.707 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.707 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.707 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485774+0000", 2024-09-12T16:16:18.707 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2869999999999999e-06 2024-09-12T16:16:18.708 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.708 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.708 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.708 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.708 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.708 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6115 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.708 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491538+0000", 2024-09-12T16:16:18.708 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013797963, 2024-09-12T16:16:18.708 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015286040000000001, 2024-09-12T16:16:18.708 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.708 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.708 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.708 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.708 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.709 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.709 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6115 2024-09-12T16:16:18.709 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.709 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.709 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.709 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.709 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491538+0000", 2024-09-12T16:16:18.709 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.709 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.709 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.709 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.709 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491538+0000", 2024-09-12T16:16:18.709 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.709 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.709 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.710 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.710 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491538+0000", 2024-09-12T16:16:18.710 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2600000000000001e-07 2024-09-12T16:16:18.710 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.710 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.710 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.710 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491539+0000", 2024-09-12T16:16:18.710 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0020000000000001e-06 2024-09-12T16:16:18.710 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.710 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.710 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.710 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491542+0000", 2024-09-12T16:16:18.710 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.807e-06 2024-09-12T16:16:18.711 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.711 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.711 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.711 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491544+0000", 2024-09-12T16:16:18.711 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2359999999999999e-06 2024-09-12T16:16:18.711 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.711 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.711 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.711 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.711 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.711 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6147 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.711 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.497393+0000", 2024-09-12T16:16:18.711 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0079421460000000006, 2024-09-12T16:16:18.711 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0094543479999999996, 2024-09-12T16:16:18.711 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.712 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.712 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.712 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.712 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.712 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.712 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6147 2024-09-12T16:16:18.712 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.712 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.712 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.712 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.712 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497393+0000", 2024-09-12T16:16:18.712 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.712 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.712 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.712 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.713 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497393+0000", 2024-09-12T16:16:18.713 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.713 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.713 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.713 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.713 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497394+0000", 2024-09-12T16:16:18.713 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.34e-07 2024-09-12T16:16:18.713 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.713 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.713 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.713 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497396+0000", 2024-09-12T16:16:18.713 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0279999999999999e-06 2024-09-12T16:16:18.713 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.713 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.714 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.714 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497402+0000", 2024-09-12T16:16:18.714 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8329999999999999e-06 2024-09-12T16:16:18.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.714 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.714 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.714 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497407+0000", 2024-09-12T16:16:18.714 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.074e-06 2024-09-12T16:16:18.714 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.714 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.714 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.714 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.714 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6020 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.715 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.479684+0000", 2024-09-12T16:16:18.715 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.025651631000000001, 2024-09-12T16:16:18.715 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.027188631000000001, 2024-09-12T16:16:18.715 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.715 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.715 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.715 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.715 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.715 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.715 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6020 2024-09-12T16:16:18.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.715 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.715 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.715 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.715 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479684+0000", 2024-09-12T16:16:18.716 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.716 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.716 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.716 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.716 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479684+0000", 2024-09-12T16:16:18.716 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.716 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.716 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.716 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.716 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479684+0000", 2024-09-12T16:16:18.716 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0899999999999997e-07 2024-09-12T16:16:18.716 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.716 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.716 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.716 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479685+0000", 2024-09-12T16:16:18.717 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1799999999999999e-06 2024-09-12T16:16:18.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.717 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.717 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.717 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479689+0000", 2024-09-12T16:16:18.717 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3110000000000001e-06 2024-09-12T16:16:18.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.717 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.717 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.717 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479691+0000", 2024-09-12T16:16:18.717 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5809999999999999e-06 2024-09-12T16:16:18.717 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.717 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.717 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.718 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.718 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6052 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.718 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485386+0000", 2024-09-12T16:16:18.718 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019949937000000001, 2024-09-12T16:16:18.718 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021510178000000001, 2024-09-12T16:16:18.718 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.718 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.718 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.718 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.718 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.718 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.718 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6052 2024-09-12T16:16:18.718 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.719 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.719 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.719 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.719 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485386+0000", 2024-09-12T16:16:18.719 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.719 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.719 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.719 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485386+0000", 2024-09-12T16:16:18.719 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.719 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.719 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.719 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485386+0000", 2024-09-12T16:16:18.719 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5800000000000001e-07 2024-09-12T16:16:18.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.720 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.720 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.720 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485387+0000", 2024-09-12T16:16:18.720 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.037e-06 2024-09-12T16:16:18.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.720 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.720 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.720 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485390+0000", 2024-09-12T16:16:18.720 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.74e-06 2024-09-12T16:16:18.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.720 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.720 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.720 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485392+0000", 2024-09-12T16:16:18.720 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3800000000000001e-06 2024-09-12T16:16:18.721 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.721 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.721 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.721 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.721 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.721 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6084 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.721 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485777+0000", 2024-09-12T16:16:18.721 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019558661000000001, 2024-09-12T16:16:18.721 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021143881999999999, 2024-09-12T16:16:18.721 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.721 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.721 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.721 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.721 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.721 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.722 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6084 2024-09-12T16:16:18.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.722 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.722 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.722 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.722 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485777+0000", 2024-09-12T16:16:18.722 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.722 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.722 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.722 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485777+0000", 2024-09-12T16:16:18.722 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.722 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.723 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.723 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485777+0000", 2024-09-12T16:16:18.723 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0699999999999999e-07 2024-09-12T16:16:18.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.723 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.723 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.723 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485778+0000", 2024-09-12T16:16:18.723 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0130000000000001e-06 2024-09-12T16:16:18.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.723 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.723 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.723 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485781+0000", 2024-09-12T16:16:18.723 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8739999999999999e-06 2024-09-12T16:16:18.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.724 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.724 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.724 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485785+0000", 2024-09-12T16:16:18.724 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.58e-06 2024-09-12T16:16:18.724 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.724 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.724 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.724 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.724 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.724 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6116 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.724 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491547+0000", 2024-09-12T16:16:18.724 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013788775, 2024-09-12T16:16:18.724 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015398403999999999, 2024-09-12T16:16:18.725 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.725 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.725 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.725 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.725 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.725 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.725 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6116 2024-09-12T16:16:18.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.725 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.725 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.725 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.725 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491547+0000", 2024-09-12T16:16:18.725 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.725 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.726 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.726 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491547+0000", 2024-09-12T16:16:18.726 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.726 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.726 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.726 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.726 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491547+0000", 2024-09-12T16:16:18.726 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1299999999999999e-07 2024-09-12T16:16:18.726 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.726 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.726 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.726 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491548+0000", 2024-09-12T16:16:18.726 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.04e-06 2024-09-12T16:16:18.726 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.726 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.727 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491551+0000", 2024-09-12T16:16:18.727 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8339999999999999e-06 2024-09-12T16:16:18.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.727 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491555+0000", 2024-09-12T16:16:18.727 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.709e-06 2024-09-12T16:16:18.727 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.727 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.727 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.727 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6148 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.727 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.497413+0000", 2024-09-12T16:16:18.728 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0079223839999999993, 2024-09-12T16:16:18.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0095584639999999992, 2024-09-12T16:16:18.728 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.728 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.728 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.728 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.728 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.728 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.728 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6148 2024-09-12T16:16:18.728 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.728 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.728 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.728 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.728 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497413+0000", 2024-09-12T16:16:18.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.729 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.729 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.729 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497413+0000", 2024-09-12T16:16:18.729 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.729 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.729 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.729 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497414+0000", 2024-09-12T16:16:18.729 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9900000000000001e-07 2024-09-12T16:16:18.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.729 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.729 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.729 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497415+0000", 2024-09-12T16:16:18.729 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.871e-06 2024-09-12T16:16:18.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.730 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.730 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497421+0000", 2024-09-12T16:16:18.730 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0569999999999998e-06 2024-09-12T16:16:18.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.730 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.730 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497426+0000", 2024-09-12T16:16:18.730 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7439999999999998e-06 2024-09-12T16:16:18.730 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.730 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.730 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.731 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6021 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.731 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.479695+0000", 2024-09-12T16:16:18.731 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.025640875, 2024-09-12T16:16:18.731 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.027301232000000002, 2024-09-12T16:16:18.731 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.731 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.731 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.731 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.731 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.731 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.731 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6021 2024-09-12T16:16:18.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.731 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.731 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479695+0000", 2024-09-12T16:16:18.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479695+0000", 2024-09-12T16:16:18.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479695+0000", 2024-09-12T16:16:18.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9299999999999999e-07 2024-09-12T16:16:18.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.733 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479696+0000", 2024-09-12T16:16:18.733 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9900000000000009e-07 2024-09-12T16:16:18.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.733 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.733 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.733 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479699+0000", 2024-09-12T16:16:18.733 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8279999999999999e-06 2024-09-12T16:16:18.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.733 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.733 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.733 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479701+0000", 2024-09-12T16:16:18.733 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4789999999999999e-06 2024-09-12T16:16:18.733 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.733 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.734 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.734 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.734 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.734 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6053 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.734 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485415+0000", 2024-09-12T16:16:18.734 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019921000000000001, 2024-09-12T16:16:18.734 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021605966000000001, 2024-09-12T16:16:18.734 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.734 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.734 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.734 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.734 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.734 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.734 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6053 2024-09-12T16:16:18.735 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.735 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.735 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.735 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.735 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485415+0000", 2024-09-12T16:16:18.735 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.735 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.735 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.735 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.735 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485415+0000", 2024-09-12T16:16:18.735 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.735 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.735 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.735 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.735 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485415+0000", 2024-09-12T16:16:18.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5699999999999998e-07 2024-09-12T16:16:18.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.736 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.736 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.736 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485416+0000", 2024-09-12T16:16:18.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.395e-06 2024-09-12T16:16:18.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.736 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.736 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.736 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485420+0000", 2024-09-12T16:16:18.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2990000000000001e-06 2024-09-12T16:16:18.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.736 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.736 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.737 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485422+0000", 2024-09-12T16:16:18.737 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4609999999999998e-06 2024-09-12T16:16:18.737 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.737 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.737 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.737 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.737 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.737 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6085 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.737 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485788+0000", 2024-09-12T16:16:18.737 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019547993999999999, 2024-09-12T16:16:18.737 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021257249999999998, 2024-09-12T16:16:18.737 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.737 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.737 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.738 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.738 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.738 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.738 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6085 2024-09-12T16:16:18.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.738 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.738 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.738 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.738 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485788+0000", 2024-09-12T16:16:18.738 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.738 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.738 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.738 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485788+0000", 2024-09-12T16:16:18.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485788+0000", 2024-09-12T16:16:18.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0699999999999999e-07 2024-09-12T16:16:18.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485789+0000", 2024-09-12T16:16:18.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7900000000000007e-07 2024-09-12T16:16:18.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485791+0000", 2024-09-12T16:16:18.740 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7719999999999999e-06 2024-09-12T16:16:18.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.740 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.740 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.740 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485794+0000", 2024-09-12T16:16:18.740 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3609999999999999e-06 2024-09-12T16:16:18.740 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.740 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.740 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.740 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.740 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6117 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.740 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491558+0000", 2024-09-12T16:16:18.741 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013777216, 2024-09-12T16:16:18.741 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015509350999999999, 2024-09-12T16:16:18.741 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.741 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.741 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.741 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.741 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.741 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.741 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6117 2024-09-12T16:16:18.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.741 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.741 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.741 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.741 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491558+0000", 2024-09-12T16:16:18.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.742 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.742 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491558+0000", 2024-09-12T16:16:18.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.742 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.742 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491559+0000", 2024-09-12T16:16:18.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.22e-07 2024-09-12T16:16:18.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.742 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491560+0000", 2024-09-12T16:16:18.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0270000000000001e-06 2024-09-12T16:16:18.743 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491562+0000", 2024-09-12T16:16:18.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9110000000000002e-06 2024-09-12T16:16:18.743 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491566+0000", 2024-09-12T16:16:18.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5609999999999999e-06 2024-09-12T16:16:18.743 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.744 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.744 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.744 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6149 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.744 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.497432+0000", 2024-09-12T16:16:18.744 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0079031050000000005, 2024-09-12T16:16:18.744 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0097162710000000003, 2024-09-12T16:16:18.744 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.744 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.744 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.744 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.744 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.745 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.745 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6149 2024-09-12T16:16:18.745 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.745 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.745 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.745 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.745 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497432+0000", 2024-09-12T16:16:18.745 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.745 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.745 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.745 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.745 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497432+0000", 2024-09-12T16:16:18.746 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.746 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.746 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.746 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497433+0000", 2024-09-12T16:16:18.746 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9799999999999999e-07 2024-09-12T16:16:18.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.746 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.746 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.746 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497440+0000", 2024-09-12T16:16:18.746 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4739999999999999e-06 2024-09-12T16:16:18.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.747 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497447+0000", 2024-09-12T16:16:18.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5390000000000004e-06 2024-09-12T16:16:18.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.747 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497452+0000", 2024-09-12T16:16:18.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0289999999999996e-06 2024-09-12T16:16:18.747 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.747 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.747 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.748 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6022 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.748 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.479704+0000", 2024-09-12T16:16:18.748 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.025631276000000001, 2024-09-12T16:16:18.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.027467993, 2024-09-12T16:16:18.748 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.748 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.748 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.748 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.748 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.748 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.748 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6022 2024-09-12T16:16:18.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.748 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.749 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479704+0000", 2024-09-12T16:16:18.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.749 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.749 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479704+0000", 2024-09-12T16:16:18.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.749 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.749 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479705+0000", 2024-09-12T16:16:18.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9299999999999999e-07 2024-09-12T16:16:18.750 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.750 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.750 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.750 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479706+0000", 2024-09-12T16:16:18.809 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.001e-06 2024-09-12T16:16:18.809 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.809 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.809 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.810 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479708+0000", 2024-09-12T16:16:18.810 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7300000000000001e-06 2024-09-12T16:16:18.810 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.810 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.810 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.810 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479711+0000", 2024-09-12T16:16:18.810 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4399999999999999e-06 2024-09-12T16:16:18.810 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.810 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.810 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.810 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.810 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.810 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6054 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.811 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485425+0000", 2024-09-12T16:16:18.811 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019910058000000001, 2024-09-12T16:16:18.811 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021771907, 2024-09-12T16:16:18.811 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.811 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.811 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.811 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.811 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.811 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.811 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6054 2024-09-12T16:16:18.811 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.811 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.812 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.812 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.812 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485425+0000", 2024-09-12T16:16:18.812 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.812 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.812 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.812 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.812 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485425+0000", 2024-09-12T16:16:18.812 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.812 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.812 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.812 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.812 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485426+0000", 2024-09-12T16:16:18.813 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9799999999999999e-07 2024-09-12T16:16:18.813 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.813 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.813 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.813 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485429+0000", 2024-09-12T16:16:18.813 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6820000000000001e-06 2024-09-12T16:16:18.813 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.813 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.813 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.813 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485432+0000", 2024-09-12T16:16:18.813 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9299999999999999e-06 2024-09-12T16:16:18.813 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.813 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.813 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.814 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485435+0000", 2024-09-12T16:16:18.814 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4660000000000002e-06 2024-09-12T16:16:18.814 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.814 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.814 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.814 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.814 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6086 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.814 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485797+0000", 2024-09-12T16:16:18.814 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019538649000000002, 2024-09-12T16:16:18.814 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021423762999999998, 2024-09-12T16:16:18.814 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.814 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.814 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.814 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.815 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.815 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.815 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6086 2024-09-12T16:16:18.815 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.815 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.815 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.815 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.815 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485797+0000", 2024-09-12T16:16:18.815 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.815 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.815 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.815 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.815 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485797+0000", 2024-09-12T16:16:18.815 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.816 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.816 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.816 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.816 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485797+0000", 2024-09-12T16:16:18.816 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.03e-07 2024-09-12T16:16:18.816 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.816 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.816 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.816 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485798+0000", 2024-09-12T16:16:18.816 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0580000000000001e-06 2024-09-12T16:16:18.816 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.816 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.816 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.816 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485801+0000", 2024-09-12T16:16:18.817 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7269999999999999e-06 2024-09-12T16:16:18.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.817 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.817 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.817 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485803+0000", 2024-09-12T16:16:18.817 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3719999999999999e-06 2024-09-12T16:16:18.817 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.817 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.817 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.817 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.817 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6118 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.817 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491569+0000", 2024-09-12T16:16:18.817 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013766475, 2024-09-12T16:16:18.818 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015682120000000001, 2024-09-12T16:16:18.818 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.818 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.818 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.818 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.818 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.818 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.818 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6118 2024-09-12T16:16:18.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.818 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.818 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.818 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.818 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491569+0000", 2024-09-12T16:16:18.819 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.819 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.819 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.819 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491569+0000", 2024-09-12T16:16:18.819 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.819 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.819 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.819 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491569+0000", 2024-09-12T16:16:18.819 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.23e-07 2024-09-12T16:16:18.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.819 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.819 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.819 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491570+0000", 2024-09-12T16:16:18.820 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0189999999999999e-06 2024-09-12T16:16:18.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.820 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.820 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.820 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491573+0000", 2024-09-12T16:16:18.820 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.835e-06 2024-09-12T16:16:18.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.820 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.820 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.820 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491575+0000", 2024-09-12T16:16:18.820 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2790000000000001e-06 2024-09-12T16:16:18.820 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.820 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.820 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.821 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.821 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6150 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.821 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.497459+0000", 2024-09-12T16:16:18.821 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0078761149999999995, 2024-09-12T16:16:18.821 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0098151969999999995, 2024-09-12T16:16:18.821 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.821 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.821 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.821 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.821 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.821 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.821 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6150 2024-09-12T16:16:18.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.822 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.822 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.822 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.822 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497459+0000", 2024-09-12T16:16:18.822 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.822 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.822 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.822 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497459+0000", 2024-09-12T16:16:18.822 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.822 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.822 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.822 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497460+0000", 2024-09-12T16:16:18.822 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9200000000000001e-07 2024-09-12T16:16:18.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.823 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.823 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497462+0000", 2024-09-12T16:16:18.823 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.995e-06 2024-09-12T16:16:18.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.823 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.823 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497468+0000", 2024-09-12T16:16:18.823 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1330000000000004e-06 2024-09-12T16:16:18.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.823 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.823 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497473+0000", 2024-09-12T16:16:18.824 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8119999999999998e-06 2024-09-12T16:16:18.824 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.824 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.824 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.824 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.824 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6023 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.824 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.479714+0000", 2024-09-12T16:16:18.824 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.025621675999999999, 2024-09-12T16:16:18.824 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.027585592999999999, 2024-09-12T16:16:18.824 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.824 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.824 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.824 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.825 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.825 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.825 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6023 2024-09-12T16:16:18.825 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.825 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.825 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.825 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.825 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479714+0000", 2024-09-12T16:16:18.825 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.825 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.825 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.825 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.825 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479714+0000", 2024-09-12T16:16:18.825 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.825 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.826 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.826 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.826 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479714+0000", 2024-09-12T16:16:18.826 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8099999999999999e-07 2024-09-12T16:16:18.826 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.826 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.826 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.826 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479715+0000", 2024-09-12T16:16:18.826 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0449999999999999e-06 2024-09-12T16:16:18.826 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.826 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.826 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.826 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479718+0000", 2024-09-12T16:16:18.826 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7470000000000001e-06 2024-09-12T16:16:18.827 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.827 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.827 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.827 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479720+0000", 2024-09-12T16:16:18.827 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4980000000000001e-06 2024-09-12T16:16:18.827 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.827 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.827 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.827 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.827 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.827 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6055 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.827 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485438+0000", 2024-09-12T16:16:18.827 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019897479999999999, 2024-09-12T16:16:18.828 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021884636999999998, 2024-09-12T16:16:18.828 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.828 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.828 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.828 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.828 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.828 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.828 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6055 2024-09-12T16:16:18.828 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.828 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.828 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.828 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.828 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485438+0000", 2024-09-12T16:16:18.828 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.828 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.829 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.829 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.829 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485438+0000", 2024-09-12T16:16:18.829 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.829 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.829 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.829 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.829 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485438+0000", 2024-09-12T16:16:18.829 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2000000000000001e-07 2024-09-12T16:16:18.829 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.829 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.829 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.829 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485439+0000", 2024-09-12T16:16:18.829 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9199999999999999e-07 2024-09-12T16:16:18.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.830 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.830 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.830 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485442+0000", 2024-09-12T16:16:18.830 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7369999999999998e-06 2024-09-12T16:16:18.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.830 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.830 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.830 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485446+0000", 2024-09-12T16:16:18.830 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.664e-06 2024-09-12T16:16:18.830 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.830 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.830 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.830 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.831 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6087 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.831 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485806+0000", 2024-09-12T16:16:18.831 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019529317000000001, 2024-09-12T16:16:18.831 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021541198000000001, 2024-09-12T16:16:18.831 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.831 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.831 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.831 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.831 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.831 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.831 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6087 2024-09-12T16:16:18.831 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.831 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.832 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.832 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.832 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485806+0000", 2024-09-12T16:16:18.832 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.832 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.832 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.832 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.832 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485806+0000", 2024-09-12T16:16:18.832 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.832 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.832 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.832 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.832 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485806+0000", 2024-09-12T16:16:18.832 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.29e-07 2024-09-12T16:16:18.833 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.833 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.833 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.833 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485807+0000", 2024-09-12T16:16:18.833 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.04e-06 2024-09-12T16:16:18.833 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.833 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.833 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.833 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485810+0000", 2024-09-12T16:16:18.833 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7970000000000001e-06 2024-09-12T16:16:18.833 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.833 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.833 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.833 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485814+0000", 2024-09-12T16:16:18.834 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4759999999999998e-06 2024-09-12T16:16:18.834 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.834 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.834 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.834 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.834 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.834 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6119 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.834 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491578+0000", 2024-09-12T16:16:18.834 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013757213000000001, 2024-09-12T16:16:18.834 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015792094, 2024-09-12T16:16:18.834 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.834 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.834 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.834 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.835 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.835 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.835 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6119 2024-09-12T16:16:18.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.835 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.835 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.835 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.835 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491578+0000", 2024-09-12T16:16:18.835 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.835 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.835 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.835 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491578+0000", 2024-09-12T16:16:18.835 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.836 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.836 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.836 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491579+0000", 2024-09-12T16:16:18.836 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1e-07 2024-09-12T16:16:18.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.836 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.836 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.836 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491579+0000", 2024-09-12T16:16:18.836 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.850000000000001e-07 2024-09-12T16:16:18.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.836 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.836 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.836 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491582+0000", 2024-09-12T16:16:18.836 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7999999999999999e-06 2024-09-12T16:16:18.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.837 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.837 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.837 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491585+0000", 2024-09-12T16:16:18.837 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3329999999999999e-06 2024-09-12T16:16:18.837 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.837 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.837 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.837 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.837 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.837 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6151 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.837 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.497479+0000", 2024-09-12T16:16:18.837 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0078563969999999993, 2024-09-12T16:16:18.837 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0099177799999999993, 2024-09-12T16:16:18.837 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.837 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.838 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.838 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.838 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.838 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.838 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6151 2024-09-12T16:16:18.838 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.838 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.838 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.838 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.838 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497479+0000", 2024-09-12T16:16:18.838 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.838 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.839 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.839 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.839 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497479+0000", 2024-09-12T16:16:18.839 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.839 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.839 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.839 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.839 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497479+0000", 2024-09-12T16:16:18.839 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4799999999999999e-07 2024-09-12T16:16:18.839 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.839 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.839 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.839 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497481+0000", 2024-09-12T16:16:18.839 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.773e-06 2024-09-12T16:16:18.839 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.840 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.840 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.840 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497487+0000", 2024-09-12T16:16:18.840 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5470000000000004e-06 2024-09-12T16:16:18.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.840 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.840 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.840 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497493+0000", 2024-09-12T16:16:18.840 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1460000000000001e-06 2024-09-12T16:16:18.840 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.840 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.840 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.840 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.841 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6024 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.841 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.479723+0000", 2024-09-12T16:16:18.841 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.025612231999999999, 2024-09-12T16:16:18.841 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.027697032, 2024-09-12T16:16:18.841 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.841 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.841 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.841 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.841 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.841 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.841 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6024 2024-09-12T16:16:18.841 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.841 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.841 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.842 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.842 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479723+0000", 2024-09-12T16:16:18.842 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.842 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.842 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.842 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.842 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479723+0000", 2024-09-12T16:16:18.842 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.842 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.842 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.842 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.842 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479724+0000", 2024-09-12T16:16:18.842 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.36e-07 2024-09-12T16:16:18.842 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.842 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.843 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.843 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479725+0000", 2024-09-12T16:16:18.843 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0899999999999999e-06 2024-09-12T16:16:18.843 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.843 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.843 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.843 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479727+0000", 2024-09-12T16:16:18.843 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7800000000000001e-06 2024-09-12T16:16:18.843 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.843 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.843 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.843 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479730+0000", 2024-09-12T16:16:18.843 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.323e-06 2024-09-12T16:16:18.843 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.844 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.844 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.844 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.844 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.844 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6056 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.844 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485449+0000", 2024-09-12T16:16:18.844 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019886648999999999, 2024-09-12T16:16:18.844 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021996252000000001, 2024-09-12T16:16:18.844 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.844 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.844 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.844 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.844 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.844 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.845 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6056 2024-09-12T16:16:18.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.845 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.845 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.845 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.845 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485449+0000", 2024-09-12T16:16:18.845 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.845 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.845 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.845 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485449+0000", 2024-09-12T16:16:18.845 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.846 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.846 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.846 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485449+0000", 2024-09-12T16:16:18.846 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.11e-07 2024-09-12T16:16:18.846 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.846 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.846 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.846 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485450+0000", 2024-09-12T16:16:18.846 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0470000000000001e-06 2024-09-12T16:16:18.846 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.846 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.846 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.846 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485453+0000", 2024-09-12T16:16:18.847 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8590000000000001e-06 2024-09-12T16:16:18.847 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.847 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.847 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.847 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485455+0000", 2024-09-12T16:16:18.847 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.418e-06 2024-09-12T16:16:18.847 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.847 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.847 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.847 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.847 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.847 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6088 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.847 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485817+0000", 2024-09-12T16:16:18.847 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019518746, 2024-09-12T16:16:18.848 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0216516, 2024-09-12T16:16:18.848 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.848 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.848 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.848 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.848 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.848 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.848 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6088 2024-09-12T16:16:18.848 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.848 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.848 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.848 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.849 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485817+0000", 2024-09-12T16:16:18.849 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.849 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.849 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485817+0000", 2024-09-12T16:16:18.849 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.849 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.849 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485817+0000", 2024-09-12T16:16:18.849 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.16e-07 2024-09-12T16:16:18.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485818+0000", 2024-09-12T16:16:18.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0219999999999999e-06 2024-09-12T16:16:18.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485821+0000", 2024-09-12T16:16:18.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8619999999999999e-06 2024-09-12T16:16:18.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485823+0000", 2024-09-12T16:16:18.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4439999999999998e-06 2024-09-12T16:16:18.851 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.851 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.851 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.851 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.851 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6120 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.851 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491588+0000", 2024-09-12T16:16:18.851 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013747758000000001, 2024-09-12T16:16:18.851 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015903387000000001, 2024-09-12T16:16:18.851 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.851 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.851 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.851 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.851 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.851 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.852 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6120 2024-09-12T16:16:18.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.852 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.852 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.852 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.852 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491588+0000", 2024-09-12T16:16:18.852 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.852 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.852 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.852 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491588+0000", 2024-09-12T16:16:18.852 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.852 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.852 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.853 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491588+0000", 2024-09-12T16:16:18.853 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5199999999999998e-07 2024-09-12T16:16:18.853 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.853 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.853 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.853 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491589+0000", 2024-09-12T16:16:18.853 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2900000000000002e-07 2024-09-12T16:16:18.853 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.853 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.853 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.853 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491592+0000", 2024-09-12T16:16:18.853 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7590000000000002e-06 2024-09-12T16:16:18.853 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.854 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.854 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.854 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491594+0000", 2024-09-12T16:16:18.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.334e-06 2024-09-12T16:16:18.854 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.854 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.854 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.854 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.854 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6152 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.854 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.497500+0000", 2024-09-12T16:16:18.854 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0078357570000000005, 2024-09-12T16:16:18.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010015764999999999, 2024-09-12T16:16:18.854 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.855 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.855 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.855 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.855 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.855 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.855 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6152 2024-09-12T16:16:18.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.855 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497500+0000", 2024-09-12T16:16:18.855 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.856 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.856 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497500+0000", 2024-09-12T16:16:18.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.856 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.856 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497500+0000", 2024-09-12T16:16:18.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.77e-07 2024-09-12T16:16:18.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.856 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.856 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497502+0000", 2024-09-12T16:16:18.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.063e-06 2024-09-12T16:16:18.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.857 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.857 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.857 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497508+0000", 2024-09-12T16:16:18.857 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0390000000000001e-06 2024-09-12T16:16:18.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.857 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.857 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.857 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497513+0000", 2024-09-12T16:16:18.857 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6539999999999998e-06 2024-09-12T16:16:18.857 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.857 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.857 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.857 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.858 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6025 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.858 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.479733+0000", 2024-09-12T16:16:18.858 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.025602901000000001, 2024-09-12T16:16:18.858 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.027806010999999999, 2024-09-12T16:16:18.858 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.858 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.858 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.858 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.858 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.858 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.858 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6025 2024-09-12T16:16:18.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.858 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.859 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.859 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479733+0000", 2024-09-12T16:16:18.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.859 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.859 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479733+0000", 2024-09-12T16:16:18.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.859 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.859 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479733+0000", 2024-09-12T16:16:18.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.16e-07 2024-09-12T16:16:18.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.860 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.860 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.860 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479734+0000", 2024-09-12T16:16:18.860 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4300000000000001e-07 2024-09-12T16:16:18.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.860 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.860 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.860 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479737+0000", 2024-09-12T16:16:18.860 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7609999999999999e-06 2024-09-12T16:16:18.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.860 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.860 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.860 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479739+0000", 2024-09-12T16:16:18.861 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6189999999999998e-06 2024-09-12T16:16:18.861 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.861 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.861 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.861 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.861 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.861 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6057 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.861 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485458+0000", 2024-09-12T16:16:18.861 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019877067000000002, 2024-09-12T16:16:18.861 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022105137, 2024-09-12T16:16:18.861 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.861 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.861 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.861 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.862 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.862 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.862 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6057 2024-09-12T16:16:18.862 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.862 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.862 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.862 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.862 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485458+0000", 2024-09-12T16:16:18.862 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.862 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.862 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.862 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.862 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485458+0000", 2024-09-12T16:16:18.862 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.863 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.863 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.863 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.863 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485459+0000", 2024-09-12T16:16:18.863 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1299999999999999e-07 2024-09-12T16:16:18.863 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.863 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.863 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.863 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485460+0000", 2024-09-12T16:16:18.863 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.850000000000001e-07 2024-09-12T16:16:18.863 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.863 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.863 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.863 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485464+0000", 2024-09-12T16:16:18.864 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8990000000000003e-06 2024-09-12T16:16:18.864 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.864 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.864 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.864 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485466+0000", 2024-09-12T16:16:18.864 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4159999999999998e-06 2024-09-12T16:16:18.864 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.864 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.864 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.864 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.864 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.864 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6089 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.864 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485826+0000", 2024-09-12T16:16:18.865 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019509287, 2024-09-12T16:16:18.865 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021760953999999999, 2024-09-12T16:16:18.865 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.865 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.865 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.865 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.865 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.865 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.865 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6089 2024-09-12T16:16:18.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.865 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.865 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.865 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.865 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485826+0000", 2024-09-12T16:16:18.866 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.866 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.866 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.866 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485826+0000", 2024-09-12T16:16:18.866 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.866 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.866 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.866 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491237+0000", 2024-09-12T16:16:18.866 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0054110360000000001 2024-09-12T16:16:18.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.866 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.867 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.867 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491240+0000", 2024-09-12T16:16:18.867 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7300000000000001e-06 2024-09-12T16:16:18.867 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.867 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.867 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.867 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491247+0000", 2024-09-12T16:16:18.867 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.703e-06 2024-09-12T16:16:18.867 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.867 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.867 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.867 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491251+0000", 2024-09-12T16:16:18.867 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9600000000000002e-06 2024-09-12T16:16:18.868 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.868 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.868 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.868 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.868 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.868 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6121 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.868 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491597+0000", 2024-09-12T16:16:18.868 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013738462999999999, 2024-09-12T16:16:18.868 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016014562, 2024-09-12T16:16:18.868 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.868 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.868 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.868 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.868 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.869 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.869 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6121 2024-09-12T16:16:18.869 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.869 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.869 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.869 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.869 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491597+0000", 2024-09-12T16:16:18.869 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.869 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.869 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.869 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.869 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491597+0000", 2024-09-12T16:16:18.869 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.870 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.870 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.870 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.870 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491597+0000", 2024-09-12T16:16:18.870 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1500000000000001e-07 2024-09-12T16:16:18.870 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.870 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.870 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.870 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491598+0000", 2024-09-12T16:16:18.870 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0049999999999999e-06 2024-09-12T16:16:18.870 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.870 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.870 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.870 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491601+0000", 2024-09-12T16:16:18.871 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.779e-06 2024-09-12T16:16:18.871 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.871 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.871 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.871 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491603+0000", 2024-09-12T16:16:18.871 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.351e-06 2024-09-12T16:16:18.871 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.871 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.871 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.871 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.871 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.871 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6153 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.871 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.497520+0000", 2024-09-12T16:16:18.872 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0078159660000000006, 2024-09-12T16:16:18.872 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010115034, 2024-09-12T16:16:18.872 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.872 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.872 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.872 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.872 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.872 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.872 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6153 2024-09-12T16:16:18.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.872 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.872 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.872 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.873 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497520+0000", 2024-09-12T16:16:18.873 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.873 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.873 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.873 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.873 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497520+0000", 2024-09-12T16:16:18.873 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.873 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.873 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.873 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.873 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497520+0000", 2024-09-12T16:16:18.873 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8799999999999998e-07 2024-09-12T16:16:18.873 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.873 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.874 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.874 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497522+0000", 2024-09-12T16:16:18.874 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0279999999999999e-06 2024-09-12T16:16:18.874 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.874 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.874 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.874 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497534+0000", 2024-09-12T16:16:18.874 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2312e-05 2024-09-12T16:16:18.874 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.874 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.874 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.874 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497539+0000", 2024-09-12T16:16:18.874 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0479999999999998e-06 2024-09-12T16:16:18.874 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.875 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.875 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.875 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.875 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.875 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6026 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.875 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.479742+0000", 2024-09-12T16:16:18.875 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.025593392999999999, 2024-09-12T16:16:18.875 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.027918875999999999, 2024-09-12T16:16:18.875 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.875 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.875 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.875 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.875 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.875 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.876 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6026 2024-09-12T16:16:18.876 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.876 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.876 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.876 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.876 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479742+0000", 2024-09-12T16:16:18.876 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.876 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.876 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.876 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.876 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479742+0000", 2024-09-12T16:16:18.876 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.876 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.877 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.877 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.877 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479742+0000", 2024-09-12T16:16:18.877 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3999999999999998e-07 2024-09-12T16:16:18.877 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.877 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.877 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.877 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479744+0000", 2024-09-12T16:16:18.877 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1659999999999999e-06 2024-09-12T16:16:18.877 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.877 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.877 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.877 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479746+0000", 2024-09-12T16:16:18.877 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7310000000000002e-06 2024-09-12T16:16:18.878 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.878 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.878 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.878 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479749+0000", 2024-09-12T16:16:18.878 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3910000000000001e-06 2024-09-12T16:16:18.878 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.878 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.878 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.878 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.878 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.878 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6058 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.878 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485469+0000", 2024-09-12T16:16:18.878 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019866333999999999, 2024-09-12T16:16:18.878 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022215016000000001, 2024-09-12T16:16:18.879 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.879 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.879 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.879 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.879 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.879 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.879 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6058 2024-09-12T16:16:18.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.879 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.879 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.879 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.879 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485469+0000", 2024-09-12T16:16:18.879 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.880 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.880 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.880 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485469+0000", 2024-09-12T16:16:18.880 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.880 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.880 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.880 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485469+0000", 2024-09-12T16:16:18.880 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1e-07 2024-09-12T16:16:18.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.880 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.880 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.881 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485471+0000", 2024-09-12T16:16:18.881 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2410000000000001e-06 2024-09-12T16:16:18.881 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.881 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.881 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.881 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485473+0000", 2024-09-12T16:16:18.881 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8590000000000001e-06 2024-09-12T16:16:18.881 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.881 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.881 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.881 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485476+0000", 2024-09-12T16:16:18.881 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4200000000000001e-06 2024-09-12T16:16:18.882 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.882 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.882 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.882 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.882 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.882 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6090 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.882 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491258+0000", 2024-09-12T16:16:18.882 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014077651, 2024-09-12T16:16:18.882 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016451360000000002, 2024-09-12T16:16:18.882 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.882 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.882 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.882 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.882 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.883 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.883 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6090 2024-09-12T16:16:18.883 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.883 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.883 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.883 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.883 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491258+0000", 2024-09-12T16:16:18.883 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.883 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.883 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.883 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.883 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491258+0000", 2024-09-12T16:16:18.883 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.884 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.884 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.884 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.884 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491258+0000", 2024-09-12T16:16:18.884 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3999999999999997e-07 2024-09-12T16:16:18.884 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.884 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.884 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.884 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491263+0000", 2024-09-12T16:16:18.884 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3730000000000003e-06 2024-09-12T16:16:18.884 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.884 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.884 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.884 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491266+0000", 2024-09-12T16:16:18.885 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8099999999999999e-06 2024-09-12T16:16:18.885 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.885 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.885 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.885 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491269+0000", 2024-09-12T16:16:18.885 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6390000000000001e-06 2024-09-12T16:16:18.885 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.885 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.885 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.885 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.885 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.885 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6122 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.885 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491606+0000", 2024-09-12T16:16:18.885 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013729243, 2024-09-12T16:16:18.886 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016125938999999999, 2024-09-12T16:16:18.886 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.886 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.886 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.886 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.886 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.886 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.886 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6122 2024-09-12T16:16:18.886 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.886 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.886 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.886 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.886 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491606+0000", 2024-09-12T16:16:18.886 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.886 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.887 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.887 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.887 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491606+0000", 2024-09-12T16:16:18.887 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.887 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.887 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.887 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.887 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491606+0000", 2024-09-12T16:16:18.887 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2399999999999999e-07 2024-09-12T16:16:18.887 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.887 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.887 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.887 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491608+0000", 2024-09-12T16:16:18.888 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0839999999999999e-06 2024-09-12T16:16:18.888 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.888 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.888 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.888 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491610+0000", 2024-09-12T16:16:18.888 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7609999999999999e-06 2024-09-12T16:16:18.888 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.888 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.888 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.888 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491613+0000", 2024-09-12T16:16:18.888 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3740000000000001e-06 2024-09-12T16:16:18.888 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.889 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.889 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.889 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.889 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.889 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6154 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.889 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.497563+0000", 2024-09-12T16:16:18.889 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0077725270000000004, 2024-09-12T16:16:18.889 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010193658, 2024-09-12T16:16:18.889 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.889 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.889 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.889 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.889 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.889 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.890 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6154 2024-09-12T16:16:18.890 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.890 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.890 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.890 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.890 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497563+0000", 2024-09-12T16:16:18.890 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.890 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.890 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.890 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.890 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497563+0000", 2024-09-12T16:16:18.890 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.890 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.890 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.890 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.891 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497563+0000", 2024-09-12T16:16:18.891 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3700000000000001e-07 2024-09-12T16:16:18.891 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.891 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.891 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.891 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497565+0000", 2024-09-12T16:16:18.891 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0600000000000002e-06 2024-09-12T16:16:18.891 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.891 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.891 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.891 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497570+0000", 2024-09-12T16:16:18.891 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7430000000000002e-06 2024-09-12T16:16:18.891 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.891 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.892 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.892 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497573+0000", 2024-09-12T16:16:18.892 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.016e-06 2024-09-12T16:16:18.892 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.892 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.892 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.892 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.892 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.892 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6027 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.892 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.479752+0000", 2024-09-12T16:16:18.892 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.025583887, 2024-09-12T16:16:18.892 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.028029424000000001, 2024-09-12T16:16:18.892 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.892 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.892 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.893 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.893 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.893 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.893 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6027 2024-09-12T16:16:18.893 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.893 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.893 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.893 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.893 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479752+0000", 2024-09-12T16:16:18.893 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.893 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.893 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.893 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.894 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479752+0000", 2024-09-12T16:16:18.894 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.894 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.894 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.894 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.894 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479752+0000", 2024-09-12T16:16:18.894 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1500000000000001e-07 2024-09-12T16:16:18.894 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.894 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.894 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.894 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479753+0000", 2024-09-12T16:16:18.894 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.11e-06 2024-09-12T16:16:18.894 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.894 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.894 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.895 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479756+0000", 2024-09-12T16:16:18.895 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8380000000000002e-06 2024-09-12T16:16:18.895 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.895 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.895 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.895 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479758+0000", 2024-09-12T16:16:18.895 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5059999999999998e-06 2024-09-12T16:16:18.895 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.895 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.895 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.895 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.895 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.895 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6059 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.895 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485479+0000", 2024-09-12T16:16:18.895 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019856678999999999, 2024-09-12T16:16:18.896 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022326964000000001, 2024-09-12T16:16:18.896 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.896 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.896 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.896 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.896 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.896 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.896 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6059 2024-09-12T16:16:18.896 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.896 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.896 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.896 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.896 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485479+0000", 2024-09-12T16:16:18.896 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.897 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.897 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.897 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485479+0000", 2024-09-12T16:16:18.897 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.897 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.897 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.897 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485479+0000", 2024-09-12T16:16:18.897 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1500000000000001e-07 2024-09-12T16:16:18.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.897 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.897 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.897 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485480+0000", 2024-09-12T16:16:18.897 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2139999999999999e-06 2024-09-12T16:16:18.898 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.898 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.898 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.898 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485483+0000", 2024-09-12T16:16:18.898 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8200000000000001e-06 2024-09-12T16:16:18.898 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.898 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.898 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.898 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485486+0000", 2024-09-12T16:16:18.898 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4590000000000001e-06 2024-09-12T16:16:18.898 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.898 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.898 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.898 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.899 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.899 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6091 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.899 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491273+0000", 2024-09-12T16:16:18.899 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014062666, 2024-09-12T16:16:18.899 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016556879, 2024-09-12T16:16:18.899 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.899 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.899 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.899 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.899 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.899 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.899 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6091 2024-09-12T16:16:18.899 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.899 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.900 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.900 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.900 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491273+0000", 2024-09-12T16:16:18.900 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.900 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.900 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.900 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.900 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491273+0000", 2024-09-12T16:16:18.900 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.900 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.900 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.900 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.900 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491273+0000", 2024-09-12T16:16:18.900 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2000000000000001e-07 2024-09-12T16:16:18.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.901 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.901 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.901 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491274+0000", 2024-09-12T16:16:18.901 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1489999999999999e-06 2024-09-12T16:16:18.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.901 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.901 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.901 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491277+0000", 2024-09-12T16:16:18.901 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8770000000000002e-06 2024-09-12T16:16:18.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.901 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.901 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.901 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491280+0000", 2024-09-12T16:16:18.902 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4389999999999999e-06 2024-09-12T16:16:18.902 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.902 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.902 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.902 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.902 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6123 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.902 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491615+0000", 2024-09-12T16:16:18.902 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013720026999999999, 2024-09-12T16:16:18.902 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016238968999999999, 2024-09-12T16:16:18.902 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.902 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.902 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.903 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.903 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.903 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.903 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6123 2024-09-12T16:16:18.903 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.903 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.903 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.903 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.903 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491615+0000", 2024-09-12T16:16:18.903 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.903 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.903 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.903 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.903 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491615+0000", 2024-09-12T16:16:18.904 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.904 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.904 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.904 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491616+0000", 2024-09-12T16:16:18.904 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2999999999999999e-07 2024-09-12T16:16:18.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.904 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.904 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.904 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491617+0000", 2024-09-12T16:16:18.904 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.074e-06 2024-09-12T16:16:18.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.904 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.904 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.905 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491620+0000", 2024-09-12T16:16:18.905 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8650000000000001e-06 2024-09-12T16:16:18.905 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.905 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.905 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.905 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491622+0000", 2024-09-12T16:16:18.905 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4310000000000001e-06 2024-09-12T16:16:18.905 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.905 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.905 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.905 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.905 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.905 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6155 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.905 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.497578+0000", 2024-09-12T16:16:18.906 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0077575300000000003, 2024-09-12T16:16:18.906 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010299529, 2024-09-12T16:16:18.906 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.906 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.906 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.906 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.906 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.906 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.906 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6155 2024-09-12T16:16:18.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.906 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.906 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.906 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.906 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497578+0000", 2024-09-12T16:16:18.906 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.907 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.907 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.907 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497578+0000", 2024-09-12T16:16:18.907 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.907 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.907 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.907 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.907 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497578+0000", 2024-09-12T16:16:18.907 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9400000000000001e-07 2024-09-12T16:16:18.907 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.907 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.907 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.907 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497580+0000", 2024-09-12T16:16:18.907 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.308e-06 2024-09-12T16:16:18.907 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.908 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.908 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.908 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497583+0000", 2024-09-12T16:16:18.908 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7330000000000001e-06 2024-09-12T16:16:18.908 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.908 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.908 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.908 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497587+0000", 2024-09-12T16:16:18.908 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7950000000000001e-06 2024-09-12T16:16:18.908 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.908 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.908 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.908 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.909 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.909 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6028 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.909 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.479761+0000", 2024-09-12T16:16:18.909 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.025574236, 2024-09-12T16:16:18.909 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.028139357, 2024-09-12T16:16:18.909 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.909 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.909 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.909 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.909 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.909 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.909 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6028 2024-09-12T16:16:18.909 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.909 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.910 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.910 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.910 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479761+0000", 2024-09-12T16:16:18.910 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.910 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.910 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.910 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.910 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479761+0000", 2024-09-12T16:16:18.910 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.910 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.910 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.910 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.910 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479761+0000", 2024-09-12T16:16:18.910 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1e-07 2024-09-12T16:16:18.911 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.911 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.911 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.911 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479762+0000", 2024-09-12T16:16:18.911 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6899999999999996e-07 2024-09-12T16:16:18.911 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.911 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.911 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.911 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479765+0000", 2024-09-12T16:16:18.911 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7549999999999999e-06 2024-09-12T16:16:18.911 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.911 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.911 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.912 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479768+0000", 2024-09-12T16:16:18.912 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4080000000000001e-06 2024-09-12T16:16:18.912 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.912 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.912 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.912 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.912 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6060 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.912 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485489+0000", 2024-09-12T16:16:18.912 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019847005000000001, 2024-09-12T16:16:18.912 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022437026999999998, 2024-09-12T16:16:18.912 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.912 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.912 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.913 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.913 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.913 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.913 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6060 2024-09-12T16:16:18.913 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.913 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.913 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.913 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.913 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485489+0000", 2024-09-12T16:16:18.913 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.913 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.913 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.913 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.914 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485489+0000", 2024-09-12T16:16:18.914 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.914 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.914 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485489+0000", 2024-09-12T16:16:18.914 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1299999999999999e-07 2024-09-12T16:16:18.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.914 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.914 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485490+0000", 2024-09-12T16:16:18.914 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.012e-06 2024-09-12T16:16:18.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.915 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.915 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485494+0000", 2024-09-12T16:16:18.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8299999999999998e-06 2024-09-12T16:16:18.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.915 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.915 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485496+0000", 2024-09-12T16:16:18.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3779999999999999e-06 2024-09-12T16:16:18.915 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.915 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.915 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.915 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6092 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.916 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491283+0000", 2024-09-12T16:16:18.916 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014052762, 2024-09-12T16:16:18.916 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016665922, 2024-09-12T16:16:18.916 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.916 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.916 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.916 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.916 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.916 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.916 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6092 2024-09-12T16:16:18.916 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.916 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.916 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.916 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.917 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491283+0000", 2024-09-12T16:16:18.917 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.917 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.917 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.917 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.917 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491283+0000", 2024-09-12T16:16:18.917 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.917 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.917 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.917 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.917 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491283+0000", 2024-09-12T16:16:18.917 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9499999999999998e-07 2024-09-12T16:16:18.917 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.917 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.917 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.918 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491284+0000", 2024-09-12T16:16:18.918 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.099e-06 2024-09-12T16:16:18.918 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.918 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.918 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.918 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491287+0000", 2024-09-12T16:16:18.918 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8210000000000002e-06 2024-09-12T16:16:18.918 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.918 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.918 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.918 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491289+0000", 2024-09-12T16:16:18.918 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3479999999999998e-06 2024-09-12T16:16:18.918 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.918 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.918 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.919 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.919 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.919 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6124 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.919 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491625+0000", 2024-09-12T16:16:18.919 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.01371056, 2024-09-12T16:16:18.919 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016348233, 2024-09-12T16:16:18.919 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.919 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.919 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.919 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.919 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.919 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.919 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6124 2024-09-12T16:16:18.919 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.919 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.920 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.920 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.920 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491625+0000", 2024-09-12T16:16:18.920 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.920 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.920 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.920 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.920 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491625+0000", 2024-09-12T16:16:18.920 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.920 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.920 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.920 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.920 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491625+0000", 2024-09-12T16:16:18.920 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9200000000000002e-07 2024-09-12T16:16:18.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491626+0000", 2024-09-12T16:16:18.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0189999999999999e-06 2024-09-12T16:16:18.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491629+0000", 2024-09-12T16:16:18.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8140000000000001e-06 2024-09-12T16:16:18.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491631+0000", 2024-09-12T16:16:18.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3860000000000001e-06 2024-09-12T16:16:18.921 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.922 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.922 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.922 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.922 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.922 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6156 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.922 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.497591+0000", 2024-09-12T16:16:18.922 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0077443959999999997, 2024-09-12T16:16:18.922 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010404877999999999, 2024-09-12T16:16:18.922 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.922 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.922 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.922 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.922 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.922 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.923 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6156 2024-09-12T16:16:18.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.923 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.923 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.923 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.923 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497591+0000", 2024-09-12T16:16:18.923 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.923 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.923 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.923 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497591+0000", 2024-09-12T16:16:18.923 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.923 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.924 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.924 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497591+0000", 2024-09-12T16:16:18.924 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2499999999999999e-07 2024-09-12T16:16:18.924 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.924 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.924 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.924 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497592+0000", 2024-09-12T16:16:18.924 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.063e-06 2024-09-12T16:16:18.924 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.924 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.924 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.924 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497595+0000", 2024-09-12T16:16:18.924 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9270000000000001e-06 2024-09-12T16:16:18.924 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.925 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.925 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.925 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497598+0000", 2024-09-12T16:16:18.925 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.419e-06 2024-09-12T16:16:18.925 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.925 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.925 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.925 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.925 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6029 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.925 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.479771+0000", 2024-09-12T16:16:18.925 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.025564891999999999, 2024-09-12T16:16:18.925 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.028254909000000002, 2024-09-12T16:16:18.925 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.925 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.926 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.926 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.926 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.926 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.926 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6029 2024-09-12T16:16:18.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.926 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.926 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.926 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.926 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479771+0000", 2024-09-12T16:16:18.926 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.926 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.926 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.926 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479771+0000", 2024-09-12T16:16:18.926 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.927 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.927 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.927 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479771+0000", 2024-09-12T16:16:18.927 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3699999999999999e-07 2024-09-12T16:16:18.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.927 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.927 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.927 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479772+0000", 2024-09-12T16:16:18.927 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5799999999999998e-07 2024-09-12T16:16:18.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.927 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.927 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.927 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479775+0000", 2024-09-12T16:16:18.927 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7650000000000002e-06 2024-09-12T16:16:18.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.928 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.928 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.928 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479777+0000", 2024-09-12T16:16:18.928 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4159999999999998e-06 2024-09-12T16:16:18.928 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.928 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.928 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.928 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.928 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6061 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.928 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485499+0000", 2024-09-12T16:16:18.928 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019836488999999999, 2024-09-12T16:16:18.928 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022550488, 2024-09-12T16:16:18.928 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.929 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.929 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.929 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.929 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.929 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.929 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6061 2024-09-12T16:16:18.929 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.929 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.929 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.929 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.929 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485499+0000", 2024-09-12T16:16:18.929 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.929 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.929 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.929 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.929 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485499+0000", 2024-09-12T16:16:18.930 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.930 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.930 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.930 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.930 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485499+0000", 2024-09-12T16:16:18.930 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4400000000000001e-07 2024-09-12T16:16:18.930 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.930 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.930 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.930 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485500+0000", 2024-09-12T16:16:18.930 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.026e-06 2024-09-12T16:16:18.930 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.931 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.931 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.931 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485503+0000", 2024-09-12T16:16:18.931 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7659999999999999e-06 2024-09-12T16:16:18.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.931 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.931 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.931 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485505+0000", 2024-09-12T16:16:18.931 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4040000000000002e-06 2024-09-12T16:16:18.931 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.931 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.931 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.931 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.931 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6093 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.932 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491295+0000", 2024-09-12T16:16:18.932 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014040825999999999, 2024-09-12T16:16:18.932 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016779314, 2024-09-12T16:16:18.932 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.932 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.932 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.932 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.932 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.932 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.932 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6093 2024-09-12T16:16:18.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.932 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.932 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.932 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.933 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491295+0000", 2024-09-12T16:16:18.933 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.933 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.933 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.933 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.933 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491295+0000", 2024-09-12T16:16:18.933 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.933 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.933 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.933 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.933 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491295+0000", 2024-09-12T16:16:18.933 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.29e-07 2024-09-12T16:16:18.933 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.933 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.934 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.934 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491296+0000", 2024-09-12T16:16:18.934 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9800000000000002e-07 2024-09-12T16:16:18.934 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.934 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.934 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.934 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491299+0000", 2024-09-12T16:16:18.934 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9560000000000002e-06 2024-09-12T16:16:18.934 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.934 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.934 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.934 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491301+0000", 2024-09-12T16:16:18.934 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4549999999999998e-06 2024-09-12T16:16:18.935 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.935 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.935 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.935 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.935 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6125 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.935 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491634+0000", 2024-09-12T16:16:18.935 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013701269, 2024-09-12T16:16:18.935 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016463005999999999, 2024-09-12T16:16:18.935 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.935 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.935 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.935 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.935 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.936 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.936 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6125 2024-09-12T16:16:18.936 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.936 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.936 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.936 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.936 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491634+0000", 2024-09-12T16:16:18.936 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.936 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.936 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.936 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.936 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491634+0000", 2024-09-12T16:16:18.936 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.936 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.936 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.937 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.937 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491634+0000", 2024-09-12T16:16:18.937 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1e-07 2024-09-12T16:16:18.937 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.937 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.937 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.937 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491638+0000", 2024-09-12T16:16:18.937 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.174e-06 2024-09-12T16:16:18.937 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.937 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.937 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.937 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491641+0000", 2024-09-12T16:16:18.937 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.551e-06 2024-09-12T16:16:18.937 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.937 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.938 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.938 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491644+0000", 2024-09-12T16:16:18.938 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3860000000000001e-06 2024-09-12T16:16:18.938 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.938 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.938 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.938 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.938 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.938 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6157 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.938 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.497601+0000", 2024-09-12T16:16:18.938 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0077345089999999997, 2024-09-12T16:16:18.938 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010520467, 2024-09-12T16:16:18.938 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.938 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.938 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.939 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.939 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.939 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.939 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6157 2024-09-12T16:16:18.939 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.939 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.939 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.939 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.939 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497601+0000", 2024-09-12T16:16:18.939 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.939 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.939 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.939 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.939 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497601+0000", 2024-09-12T16:16:18.939 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.940 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.940 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.940 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.940 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497601+0000", 2024-09-12T16:16:18.940 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:16:18.940 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.940 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.940 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.940 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497602+0000", 2024-09-12T16:16:18.940 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.099e-06 2024-09-12T16:16:18.940 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.940 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.940 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.940 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497605+0000", 2024-09-12T16:16:18.941 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7989999999999998e-06 2024-09-12T16:16:18.941 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.941 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.941 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.941 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497608+0000", 2024-09-12T16:16:18.941 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4820000000000001e-06 2024-09-12T16:16:18.941 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.941 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.941 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.941 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.941 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.941 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6030 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.941 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.479794+0000", 2024-09-12T16:16:18.941 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.025541727, 2024-09-12T16:16:18.942 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.028350817, 2024-09-12T16:16:18.942 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.942 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.942 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.942 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.942 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.942 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.942 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6030 2024-09-12T16:16:18.942 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.942 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.942 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.942 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.942 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479794+0000", 2024-09-12T16:16:18.942 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.943 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.943 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.943 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.943 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479794+0000", 2024-09-12T16:16:18.943 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.943 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.943 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.943 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.943 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479794+0000", 2024-09-12T16:16:18.943 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2300000000000002e-07 2024-09-12T16:16:18.943 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.943 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.943 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.943 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479798+0000", 2024-09-12T16:16:18.943 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6169999999999998e-06 2024-09-12T16:16:18.944 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.944 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.944 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.944 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479801+0000", 2024-09-12T16:16:18.944 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5480000000000002e-06 2024-09-12T16:16:18.944 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.944 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.944 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.944 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479804+0000", 2024-09-12T16:16:18.944 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6419999999999999e-06 2024-09-12T16:16:18.944 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.944 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.944 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.944 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.945 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.945 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6062 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.945 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485526+0000", 2024-09-12T16:16:18.945 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019809251, 2024-09-12T16:16:18.945 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022642958000000001, 2024-09-12T16:16:18.945 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.945 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.945 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.945 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.945 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.945 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.945 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6062 2024-09-12T16:16:18.945 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.945 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.946 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.946 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.946 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485526+0000", 2024-09-12T16:16:18.946 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.946 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.946 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.946 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.946 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485526+0000", 2024-09-12T16:16:18.946 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.946 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.946 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.946 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.946 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485527+0000", 2024-09-12T16:16:18.946 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1600000000000002e-07 2024-09-12T16:16:18.946 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.947 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.947 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.947 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485528+0000", 2024-09-12T16:16:18.947 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2100000000000001e-06 2024-09-12T16:16:18.947 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.947 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.947 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.947 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485531+0000", 2024-09-12T16:16:18.947 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4029999999999999e-06 2024-09-12T16:16:18.947 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.947 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.947 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.947 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485534+0000", 2024-09-12T16:16:18.948 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0690000000000002e-06 2024-09-12T16:16:18.948 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.948 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.948 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.948 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.948 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.948 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6094 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.948 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491304+0000", 2024-09-12T16:16:18.948 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014031137000000001, 2024-09-12T16:16:18.948 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016890794000000001, 2024-09-12T16:16:18.948 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.948 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.948 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.948 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.949 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.949 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.949 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6094 2024-09-12T16:16:18.949 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.949 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.949 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.949 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.949 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491304+0000", 2024-09-12T16:16:18.949 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.949 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.949 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.949 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.949 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491304+0000", 2024-09-12T16:16:18.950 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.950 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.950 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.950 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.950 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491305+0000", 2024-09-12T16:16:18.950 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2999999999999999e-07 2024-09-12T16:16:18.950 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.950 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.950 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.950 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491306+0000", 2024-09-12T16:16:18.950 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0559999999999999e-06 2024-09-12T16:16:18.950 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.950 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.950 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.951 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491308+0000", 2024-09-12T16:16:18.951 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8289999999999999e-06 2024-09-12T16:16:18.951 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.951 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.951 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.951 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491311+0000", 2024-09-12T16:16:18.951 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3410000000000001e-06 2024-09-12T16:16:18.951 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.951 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.951 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.951 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.951 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.951 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6126 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.951 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491647+0000", 2024-09-12T16:16:18.951 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013688696, 2024-09-12T16:16:18.952 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016572863, 2024-09-12T16:16:18.952 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.952 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.952 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.952 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.952 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.952 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.952 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6126 2024-09-12T16:16:18.952 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.952 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.952 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.952 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.952 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491647+0000", 2024-09-12T16:16:18.952 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.953 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.953 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.953 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.953 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491647+0000", 2024-09-12T16:16:18.953 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.953 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.953 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.953 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.953 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491647+0000", 2024-09-12T16:16:18.953 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3699999999999999e-07 2024-09-12T16:16:18.953 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.953 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.953 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.953 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491648+0000", 2024-09-12T16:16:18.953 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5999999999999991e-07 2024-09-12T16:16:18.954 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.954 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.954 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.954 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491651+0000", 2024-09-12T16:16:18.954 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8310000000000001e-06 2024-09-12T16:16:18.954 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.954 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.954 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.954 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491653+0000", 2024-09-12T16:16:18.954 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3319999999999999e-06 2024-09-12T16:16:18.954 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.954 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.954 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.954 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.954 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.955 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6158 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.955 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.497611+0000", 2024-09-12T16:16:18.955 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0077248050000000004, 2024-09-12T16:16:18.955 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010641088999999999, 2024-09-12T16:16:18.955 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.955 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.955 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.955 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.955 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.955 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.955 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6158 2024-09-12T16:16:18.955 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.955 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.955 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.955 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.956 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497611+0000", 2024-09-12T16:16:18.956 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.956 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.956 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.956 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.956 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497611+0000", 2024-09-12T16:16:18.956 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.956 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.956 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.956 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.956 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497611+0000", 2024-09-12T16:16:18.956 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.17e-07 2024-09-12T16:16:18.956 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.957 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.957 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.957 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497612+0000", 2024-09-12T16:16:18.957 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0979999999999999e-06 2024-09-12T16:16:18.957 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.957 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.957 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.957 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497615+0000", 2024-09-12T16:16:18.957 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4199999999999999e-06 2024-09-12T16:16:18.957 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.957 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.957 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.957 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497618+0000", 2024-09-12T16:16:18.958 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.419e-06 2024-09-12T16:16:18.958 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.958 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.958 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.958 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.958 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.958 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6031 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.958 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.479808+0000", 2024-09-12T16:16:18.958 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.025527792000000001, 2024-09-12T16:16:18.958 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.028470382999999998, 2024-09-12T16:16:18.958 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.958 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.958 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.958 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.958 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.959 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.959 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6031 2024-09-12T16:16:18.959 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.959 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.959 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.959 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.959 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479808+0000", 2024-09-12T16:16:18.959 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.959 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.959 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.959 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.959 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479808+0000", 2024-09-12T16:16:18.959 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.959 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.959 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.960 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.960 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479808+0000", 2024-09-12T16:16:18.960 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9700000000000003e-07 2024-09-12T16:16:18.960 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.960 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.960 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.960 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479809+0000", 2024-09-12T16:16:18.960 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.128e-06 2024-09-12T16:16:18.960 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.960 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.960 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.960 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479812+0000", 2024-09-12T16:16:18.960 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7700000000000002e-06 2024-09-12T16:16:18.960 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.961 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.961 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.961 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479814+0000", 2024-09-12T16:16:18.961 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3190000000000002e-06 2024-09-12T16:16:18.961 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.961 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.961 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.961 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.961 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.961 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6063 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.961 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485538+0000", 2024-09-12T16:16:18.961 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019797720000000001, 2024-09-12T16:16:18.961 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022764010000000001, 2024-09-12T16:16:18.961 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.962 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.962 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.962 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.962 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.962 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.962 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6063 2024-09-12T16:16:18.962 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.962 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.962 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.962 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.962 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485538+0000", 2024-09-12T16:16:18.962 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.962 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.962 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.962 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.962 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485538+0000", 2024-09-12T16:16:18.963 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.963 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.963 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.963 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.963 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485538+0000", 2024-09-12T16:16:18.963 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0800000000000001e-07 2024-09-12T16:16:18.963 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.963 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.963 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.963 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485539+0000", 2024-09-12T16:16:18.963 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2800000000000005e-07 2024-09-12T16:16:18.963 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.963 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.963 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.964 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485542+0000", 2024-09-12T16:16:18.964 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7819999999999998e-06 2024-09-12T16:16:18.964 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.964 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.964 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.964 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485544+0000", 2024-09-12T16:16:18.964 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2419999999999999e-06 2024-09-12T16:16:18.964 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.964 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.964 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.964 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.964 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.964 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6095 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.964 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491314+0000", 2024-09-12T16:16:18.964 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014021597, 2024-09-12T16:16:18.965 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017010771000000001, 2024-09-12T16:16:18.965 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.965 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.965 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.965 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.965 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.965 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.965 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6095 2024-09-12T16:16:18.965 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.965 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.965 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.965 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.965 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491314+0000", 2024-09-12T16:16:18.965 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.965 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.966 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.966 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.966 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491314+0000", 2024-09-12T16:16:18.966 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.966 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.966 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.966 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.966 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491314+0000", 2024-09-12T16:16:18.966 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1e-07 2024-09-12T16:16:18.966 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.966 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.966 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.966 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491315+0000", 2024-09-12T16:16:18.966 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0079999999999999e-06 2024-09-12T16:16:18.966 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.967 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.967 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.967 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491318+0000", 2024-09-12T16:16:18.967 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7460000000000001e-06 2024-09-12T16:16:18.967 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.967 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.967 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.967 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491321+0000", 2024-09-12T16:16:18.967 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9100000000000001e-06 2024-09-12T16:16:18.967 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.967 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.967 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.967 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.967 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.967 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6127 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.968 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491656+0000", 2024-09-12T16:16:18.968 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013679505999999999, 2024-09-12T16:16:18.968 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016693335, 2024-09-12T16:16:18.968 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.968 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.968 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.968 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.968 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.968 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.968 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6127 2024-09-12T16:16:18.968 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.968 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.968 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.969 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.969 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491656+0000", 2024-09-12T16:16:18.969 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.969 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.969 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.969 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.969 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491656+0000", 2024-09-12T16:16:18.969 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.969 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.969 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.969 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.969 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491656+0000", 2024-09-12T16:16:18.969 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1799999999999999e-07 2024-09-12T16:16:18.969 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.970 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.970 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.970 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491657+0000", 2024-09-12T16:16:18.970 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5199999999999995e-07 2024-09-12T16:16:18.970 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.970 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.970 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.970 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491660+0000", 2024-09-12T16:16:18.970 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7819999999999998e-06 2024-09-12T16:16:18.970 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.970 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.970 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.970 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491662+0000", 2024-09-12T16:16:18.970 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3130000000000001e-06 2024-09-12T16:16:18.970 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.971 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.971 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.971 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.971 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.971 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6159 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.971 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.497621+0000", 2024-09-12T16:16:18.971 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0077145360000000001, 2024-09-12T16:16:18.971 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010752670000000001, 2024-09-12T16:16:18.971 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.971 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.971 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.971 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.971 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.972 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.972 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6159 2024-09-12T16:16:18.972 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.972 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.972 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.972 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.972 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497621+0000", 2024-09-12T16:16:18.972 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.972 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.972 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.972 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.972 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497621+0000", 2024-09-12T16:16:18.972 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.972 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.973 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.973 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.973 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497621+0000", 2024-09-12T16:16:18.973 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9999999999999999e-07 2024-09-12T16:16:18.973 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.973 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.973 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.973 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497622+0000", 2024-09-12T16:16:18.973 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.04e-06 2024-09-12T16:16:18.973 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.973 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.973 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.973 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497625+0000", 2024-09-12T16:16:18.974 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7480000000000002e-06 2024-09-12T16:16:18.974 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.974 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.974 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.974 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.497627+0000", 2024-09-12T16:16:18.974 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4899999999999999e-06 2024-09-12T16:16:18.974 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.974 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.974 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.974 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.974 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.974 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6032 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.974 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.479817+0000", 2024-09-12T16:16:18.974 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.025518347, 2024-09-12T16:16:18.974 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.028581929999999998, 2024-09-12T16:16:18.975 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.975 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.975 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.975 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.975 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.975 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.975 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6032 2024-09-12T16:16:18.975 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.975 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.975 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.975 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.975 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479817+0000", 2024-09-12T16:16:18.975 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.976 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.976 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.976 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.976 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479817+0000", 2024-09-12T16:16:18.976 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.976 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.976 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.976 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.976 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479817+0000", 2024-09-12T16:16:18.976 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2399999999999999e-07 2024-09-12T16:16:18.976 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.976 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.976 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.976 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479818+0000", 2024-09-12T16:16:18.977 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.017e-06 2024-09-12T16:16:18.977 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.977 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.977 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.977 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479821+0000", 2024-09-12T16:16:18.977 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7709999999999998e-06 2024-09-12T16:16:18.977 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.977 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.977 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.977 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479823+0000", 2024-09-12T16:16:18.977 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1710000000000001e-06 2024-09-12T16:16:18.977 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.977 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.978 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.978 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.978 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.978 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6064 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.978 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485547+0000", 2024-09-12T16:16:18.978 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019788551000000001, 2024-09-12T16:16:18.978 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022875065, 2024-09-12T16:16:18.978 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.978 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.978 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.978 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.978 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.978 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.978 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6064 2024-09-12T16:16:18.978 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.979 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.979 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.979 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.979 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485547+0000", 2024-09-12T16:16:18.979 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.979 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.979 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.979 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.979 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485547+0000", 2024-09-12T16:16:18.979 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.979 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.979 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.979 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.980 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485547+0000", 2024-09-12T16:16:18.980 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1500000000000001e-07 2024-09-12T16:16:18.980 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.980 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.980 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.980 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485548+0000", 2024-09-12T16:16:18.980 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0070000000000001e-06 2024-09-12T16:16:18.980 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.980 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.980 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.980 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485552+0000", 2024-09-12T16:16:18.980 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9990000000000002e-06 2024-09-12T16:16:18.980 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.980 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.981 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.981 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485555+0000", 2024-09-12T16:16:18.981 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4150000000000002e-06 2024-09-12T16:16:18.981 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.981 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.981 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.981 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.981 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.981 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6096 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.981 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491324+0000", 2024-09-12T16:16:18.981 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014011054, 2024-09-12T16:16:18.981 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017122083999999999, 2024-09-12T16:16:18.981 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.982 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.982 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.982 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.982 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.982 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.982 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6096 2024-09-12T16:16:18.982 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.982 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.982 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.982 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.982 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491324+0000", 2024-09-12T16:16:18.982 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.982 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.982 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.982 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.983 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491324+0000", 2024-09-12T16:16:18.983 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.983 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.983 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.983 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491325+0000", 2024-09-12T16:16:18.983 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1400000000000001e-07 2024-09-12T16:16:18.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.983 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.983 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.983 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491326+0000", 2024-09-12T16:16:18.983 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0020000000000001e-06 2024-09-12T16:16:18.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.983 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.983 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.984 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491328+0000", 2024-09-12T16:16:18.984 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.824e-06 2024-09-12T16:16:18.984 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.984 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.984 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.984 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491331+0000", 2024-09-12T16:16:18.984 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4119999999999999e-06 2024-09-12T16:16:18.984 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.984 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.984 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.984 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.984 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.984 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6128 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.984 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491665+0000", 2024-09-12T16:16:18.985 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013670385, 2024-09-12T16:16:18.985 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016805197000000001, 2024-09-12T16:16:18.985 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.985 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.985 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.985 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.985 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.985 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.985 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6128 2024-09-12T16:16:18.985 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.985 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.985 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.985 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.985 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491665+0000", 2024-09-12T16:16:18.986 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.986 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.986 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.986 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.986 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491665+0000", 2024-09-12T16:16:18.986 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.986 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.986 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.986 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.986 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491665+0000", 2024-09-12T16:16:18.986 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0800000000000001e-07 2024-09-12T16:16:18.986 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.986 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.986 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.986 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491666+0000", 2024-09-12T16:16:18.987 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6200000000000006e-07 2024-09-12T16:16:18.987 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.987 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.987 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.987 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491669+0000", 2024-09-12T16:16:18.987 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.756e-06 2024-09-12T16:16:18.987 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.987 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.987 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.987 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491671+0000", 2024-09-12T16:16:18.987 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3580000000000001e-06 2024-09-12T16:16:18.987 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.987 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.987 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.987 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.988 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.988 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6033 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.988 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.479826+0000", 2024-09-12T16:16:18.988 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.025509159, 2024-09-12T16:16:18.988 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.028669937, 2024-09-12T16:16:18.988 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.988 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.988 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.988 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.988 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.988 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.988 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6033 2024-09-12T16:16:18.989 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.989 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.989 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.989 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.989 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479826+0000", 2024-09-12T16:16:18.989 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.989 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.989 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.989 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.989 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479826+0000", 2024-09-12T16:16:18.989 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.989 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.989 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.989 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.989 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479827+0000", 2024-09-12T16:16:18.990 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.16e-07 2024-09-12T16:16:18.990 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.990 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.990 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.990 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479828+0000", 2024-09-12T16:16:18.990 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.06e-06 2024-09-12T16:16:18.990 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.990 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.990 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.990 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479830+0000", 2024-09-12T16:16:18.990 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8590000000000001e-06 2024-09-12T16:16:18.990 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.990 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.990 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.990 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479833+0000", 2024-09-12T16:16:18.991 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3439999999999999e-06 2024-09-12T16:16:18.991 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.991 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.991 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.991 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.991 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.991 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6065 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.991 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485558+0000", 2024-09-12T16:16:18.991 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019777838999999998, 2024-09-12T16:16:18.991 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022962044000000001, 2024-09-12T16:16:18.991 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.991 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.991 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.991 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.991 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.992 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.992 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6065 2024-09-12T16:16:18.992 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.992 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.992 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.992 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.992 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485558+0000", 2024-09-12T16:16:18.992 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.992 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.992 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.992 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.992 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485558+0000", 2024-09-12T16:16:18.992 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.992 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.992 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.993 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.993 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485558+0000", 2024-09-12T16:16:18.993 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1e-07 2024-09-12T16:16:18.993 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.993 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.993 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.993 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485559+0000", 2024-09-12T16:16:18.993 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8299999999999995e-07 2024-09-12T16:16:18.993 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.993 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.993 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.993 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485562+0000", 2024-09-12T16:16:18.993 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8210000000000002e-06 2024-09-12T16:16:18.993 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.994 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.994 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.994 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485565+0000", 2024-09-12T16:16:18.994 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0750000000000002e-06 2024-09-12T16:16:18.994 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.994 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.994 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.994 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.994 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.994 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6097 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.994 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491334+0000", 2024-09-12T16:16:18.994 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014001611000000001, 2024-09-12T16:16:18.994 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017210553, 2024-09-12T16:16:18.994 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.994 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.995 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.995 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.995 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.995 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.995 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6097 2024-09-12T16:16:18.995 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.995 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.995 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.995 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.995 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491334+0000", 2024-09-12T16:16:18.995 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.995 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.995 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.995 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.995 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491334+0000", 2024-09-12T16:16:18.996 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.996 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.996 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.996 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.996 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491334+0000", 2024-09-12T16:16:18.996 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0699999999999999e-07 2024-09-12T16:16:18.996 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.996 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.996 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.996 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491335+0000", 2024-09-12T16:16:18.996 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0359999999999999e-06 2024-09-12T16:16:18.996 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.996 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.996 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:18.997 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491338+0000", 2024-09-12T16:16:18.997 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7379999999999999e-06 2024-09-12T16:16:18.997 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.997 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.997 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:18.997 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491340+0000", 2024-09-12T16:16:18.997 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.401e-06 2024-09-12T16:16:18.997 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.997 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:18.997 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:18.997 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.997 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.997 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6129 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:18.997 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491674+0000", 2024-09-12T16:16:18.997 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.01366122, 2024-09-12T16:16:18.998 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016893227, 2024-09-12T16:16:18.998 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:18.998 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:18.998 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:18.998 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:18.998 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:18.998 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:18.998 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6129 2024-09-12T16:16:18.998 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.998 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:18.998 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.998 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:18.998 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491674+0000", 2024-09-12T16:16:18.998 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.998 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.998 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.999 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:18.999 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491674+0000", 2024-09-12T16:16:18.999 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:18.999 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.999 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.999 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:18.999 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491674+0000", 2024-09-12T16:16:18.999 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.05e-07 2024-09-12T16:16:18.999 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.999 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.999 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:18.999 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491675+0000", 2024-09-12T16:16:18.999 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7600000000000006e-07 2024-09-12T16:16:18.999 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:18.999 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:18.999 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.000 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491678+0000", 2024-09-12T16:16:19.000 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.779e-06 2024-09-12T16:16:19.000 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.000 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.000 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.000 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491682+0000", 2024-09-12T16:16:19.000 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5429999999999998e-06 2024-09-12T16:16:19.000 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.000 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.000 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.000 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.000 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.000 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6034 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.000 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.479836+0000", 2024-09-12T16:16:19.001 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0254998, 2024-09-12T16:16:19.001 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.028756995, 2024-09-12T16:16:19.001 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.001 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.001 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.001 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.001 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.001 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.001 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6034 2024-09-12T16:16:19.001 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.001 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.001 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.001 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.002 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479836+0000", 2024-09-12T16:16:19.002 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.002 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.002 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.002 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.002 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479836+0000", 2024-09-12T16:16:19.002 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.002 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.002 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.002 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.002 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479836+0000", 2024-09-12T16:16:19.002 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1500000000000001e-07 2024-09-12T16:16:19.002 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.003 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.003 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.003 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479837+0000", 2024-09-12T16:16:19.003 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3799999999999996e-07 2024-09-12T16:16:19.003 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.003 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.003 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.003 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479840+0000", 2024-09-12T16:16:19.003 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7199999999999998e-06 2024-09-12T16:16:19.003 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.003 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.003 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.003 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479842+0000", 2024-09-12T16:16:19.003 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3410000000000001e-06 2024-09-12T16:16:19.003 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.004 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.004 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.004 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.004 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.004 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6066 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.004 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485568+0000", 2024-09-12T16:16:19.004 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.01976777, 2024-09-12T16:16:19.004 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023048184999999999, 2024-09-12T16:16:19.004 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.004 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.004 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.004 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.004 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.005 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.005 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6066 2024-09-12T16:16:19.005 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.005 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.005 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.005 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.005 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485568+0000", 2024-09-12T16:16:19.005 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.005 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.005 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.005 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.005 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485568+0000", 2024-09-12T16:16:19.005 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.005 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.006 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.006 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.006 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485568+0000", 2024-09-12T16:16:19.006 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.17e-07 2024-09-12T16:16:19.006 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.006 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.006 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.006 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485573+0000", 2024-09-12T16:16:19.006 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7929999999999997e-06 2024-09-12T16:16:19.006 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.006 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.006 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.006 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485576+0000", 2024-09-12T16:16:19.006 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.557e-06 2024-09-12T16:16:19.006 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.007 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.007 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.007 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485579+0000", 2024-09-12T16:16:19.007 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5009999999999999e-06 2024-09-12T16:16:19.007 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.007 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.007 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.007 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.007 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.007 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6098 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.007 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491343+0000", 2024-09-12T16:16:19.007 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013992232, 2024-09-12T16:16:19.007 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017298279, 2024-09-12T16:16:19.007 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.008 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.008 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.008 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.008 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.008 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.008 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6098 2024-09-12T16:16:19.008 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.008 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.008 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.008 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.008 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491343+0000", 2024-09-12T16:16:19.008 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.008 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.008 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.008 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.009 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491343+0000", 2024-09-12T16:16:19.009 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.009 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.009 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.009 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.009 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491343+0000", 2024-09-12T16:16:19.009 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1400000000000001e-07 2024-09-12T16:16:19.009 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.009 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.009 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.009 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491345+0000", 2024-09-12T16:16:19.009 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.057e-06 2024-09-12T16:16:19.009 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.010 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.010 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.010 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491347+0000", 2024-09-12T16:16:19.010 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.892e-06 2024-09-12T16:16:19.010 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.010 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.010 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.010 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491350+0000", 2024-09-12T16:16:19.010 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.305e-06 2024-09-12T16:16:19.010 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.010 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.010 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.010 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.010 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.010 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6130 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.011 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491685+0000", 2024-09-12T16:16:19.011 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013650058, 2024-09-12T16:16:19.011 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016979467000000002, 2024-09-12T16:16:19.011 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.011 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.011 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.011 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.011 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.011 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.011 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6130 2024-09-12T16:16:19.011 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.011 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.011 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.011 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.012 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491685+0000", 2024-09-12T16:16:19.012 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.012 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.012 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.012 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.012 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491685+0000", 2024-09-12T16:16:19.012 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.012 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.012 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.012 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.012 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491686+0000", 2024-09-12T16:16:19.012 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:16:19.012 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.012 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.012 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.013 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491687+0000", 2024-09-12T16:16:19.013 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0160000000000001e-06 2024-09-12T16:16:19.013 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.013 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.013 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.013 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491689+0000", 2024-09-12T16:16:19.013 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7889999999999999e-06 2024-09-12T16:16:19.013 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.013 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.013 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.013 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491692+0000", 2024-09-12T16:16:19.013 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2259999999999999e-06 2024-09-12T16:16:19.013 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.014 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.014 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.014 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.014 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.014 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6035 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.014 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.479845+0000", 2024-09-12T16:16:19.014 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.025490672999999998, 2024-09-12T16:16:19.014 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.028844418, 2024-09-12T16:16:19.014 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.014 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.014 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.014 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.014 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.015 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.015 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6035 2024-09-12T16:16:19.015 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.015 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.015 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.015 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.015 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479845+0000", 2024-09-12T16:16:19.015 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.015 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.015 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.015 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.015 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479845+0000", 2024-09-12T16:16:19.015 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.015 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.015 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.015 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.016 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479845+0000", 2024-09-12T16:16:19.016 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2000000000000001e-07 2024-09-12T16:16:19.016 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.016 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.016 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.016 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479846+0000", 2024-09-12T16:16:19.016 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.850000000000001e-07 2024-09-12T16:16:19.016 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.016 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.016 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.016 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479849+0000", 2024-09-12T16:16:19.016 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7580000000000001e-06 2024-09-12T16:16:19.016 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.016 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.016 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.017 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479851+0000", 2024-09-12T16:16:19.017 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4030000000000001e-06 2024-09-12T16:16:19.017 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.017 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.017 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.017 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.017 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.017 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6067 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.017 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485583+0000", 2024-09-12T16:16:19.017 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019752352000000001, 2024-09-12T16:16:19.017 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023131049000000001, 2024-09-12T16:16:19.017 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.017 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.017 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.018 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.018 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.018 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.018 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6067 2024-09-12T16:16:19.018 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.018 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.018 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.018 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.018 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485583+0000", 2024-09-12T16:16:19.018 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.018 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.018 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.018 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.018 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485583+0000", 2024-09-12T16:16:19.018 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.019 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.019 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.019 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.019 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485583+0000", 2024-09-12T16:16:19.019 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1899999999999999e-07 2024-09-12T16:16:19.019 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.019 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.019 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.019 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485584+0000", 2024-09-12T16:16:19.019 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0610000000000001e-06 2024-09-12T16:16:19.019 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.019 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.019 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.019 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485587+0000", 2024-09-12T16:16:19.019 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8119999999999999e-06 2024-09-12T16:16:19.019 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.020 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.020 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.020 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485590+0000", 2024-09-12T16:16:19.020 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.463e-06 2024-09-12T16:16:19.020 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.020 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.020 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.020 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.020 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.020 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6099 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.020 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491353+0000", 2024-09-12T16:16:19.020 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013982718999999999, 2024-09-12T16:16:19.020 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017385603999999999, 2024-09-12T16:16:19.020 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.020 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.021 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.021 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.021 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.021 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.021 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6099 2024-09-12T16:16:19.021 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.021 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.021 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.021 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.021 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491353+0000", 2024-09-12T16:16:19.021 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.021 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.021 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.021 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.022 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491353+0000", 2024-09-12T16:16:19.022 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.022 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.022 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.022 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.022 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491353+0000", 2024-09-12T16:16:19.022 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1799999999999999e-07 2024-09-12T16:16:19.022 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.022 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.022 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.022 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491354+0000", 2024-09-12T16:16:19.022 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0020000000000001e-06 2024-09-12T16:16:19.022 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.022 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.022 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.023 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491357+0000", 2024-09-12T16:16:19.023 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8009999999999999e-06 2024-09-12T16:16:19.023 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.023 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.023 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.023 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491359+0000", 2024-09-12T16:16:19.023 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3479999999999998e-06 2024-09-12T16:16:19.023 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.023 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.023 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.023 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.023 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.023 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6131 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.023 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491695+0000", 2024-09-12T16:16:19.023 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013640856999999999, 2024-09-12T16:16:19.024 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017068301000000001, 2024-09-12T16:16:19.024 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.024 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.024 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.024 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.024 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.024 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.024 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6131 2024-09-12T16:16:19.024 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.024 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.024 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.024 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.024 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491695+0000", 2024-09-12T16:16:19.025 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.025 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.025 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.025 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.025 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491695+0000", 2024-09-12T16:16:19.025 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.025 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.025 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.025 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.025 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491695+0000", 2024-09-12T16:16:19.025 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3699999999999999e-07 2024-09-12T16:16:19.025 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.025 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.025 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.026 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491696+0000", 2024-09-12T16:16:19.026 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0589999999999999e-06 2024-09-12T16:16:19.026 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.026 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.026 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.026 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491699+0000", 2024-09-12T16:16:19.026 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8509999999999999e-06 2024-09-12T16:16:19.026 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.026 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.026 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.026 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491701+0000", 2024-09-12T16:16:19.026 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3750000000000001e-06 2024-09-12T16:16:19.026 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.026 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.026 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.027 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.027 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.027 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6036 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.027 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.479855+0000", 2024-09-12T16:16:19.027 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.025480684999999999, 2024-09-12T16:16:19.027 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.028932009000000002, 2024-09-12T16:16:19.027 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.027 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.027 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.027 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.027 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.027 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.027 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6036 2024-09-12T16:16:19.027 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.027 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.028 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.028 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.028 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479855+0000", 2024-09-12T16:16:19.028 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.028 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.028 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.028 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.028 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479855+0000", 2024-09-12T16:16:19.028 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.028 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.028 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.028 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.028 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479855+0000", 2024-09-12T16:16:19.028 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0900000000000001e-07 2024-09-12T16:16:19.028 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.029 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.029 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.029 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479856+0000", 2024-09-12T16:16:19.029 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4300000000000001e-07 2024-09-12T16:16:19.029 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.029 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.029 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.029 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479859+0000", 2024-09-12T16:16:19.029 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.813e-06 2024-09-12T16:16:19.029 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.029 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.029 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.029 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479861+0000", 2024-09-12T16:16:19.029 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4320000000000002e-06 2024-09-12T16:16:19.030 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.030 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.030 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.030 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.030 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.030 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6068 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.030 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485593+0000", 2024-09-12T16:16:19.030 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019742704, 2024-09-12T16:16:19.030 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023326866000000002, 2024-09-12T16:16:19.030 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.030 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.030 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.030 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.030 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.030 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.031 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6068 2024-09-12T16:16:19.031 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.031 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.031 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.031 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.031 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485593+0000", 2024-09-12T16:16:19.031 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.031 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.031 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.031 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.031 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485593+0000", 2024-09-12T16:16:19.031 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.031 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.031 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.031 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.032 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485593+0000", 2024-09-12T16:16:19.032 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0699999999999999e-07 2024-09-12T16:16:19.032 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.032 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.032 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.032 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485594+0000", 2024-09-12T16:16:19.032 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0160000000000001e-06 2024-09-12T16:16:19.032 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.032 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.032 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.032 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485597+0000", 2024-09-12T16:16:19.032 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.791e-06 2024-09-12T16:16:19.032 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.032 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.032 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.033 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485599+0000", 2024-09-12T16:16:19.033 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.317e-06 2024-09-12T16:16:19.033 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.033 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.033 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.033 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.033 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.033 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6100 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.033 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491376+0000", 2024-09-12T16:16:19.033 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013959998, 2024-09-12T16:16:19.033 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017568176000000001, 2024-09-12T16:16:19.033 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.033 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.033 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.034 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.034 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.034 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.034 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6100 2024-09-12T16:16:19.034 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.034 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.034 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.034 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.034 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491376+0000", 2024-09-12T16:16:19.034 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.034 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.034 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.034 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.035 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491376+0000", 2024-09-12T16:16:19.035 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.035 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.035 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.035 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.035 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491376+0000", 2024-09-12T16:16:19.035 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0600000000000001e-07 2024-09-12T16:16:19.035 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.035 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.035 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.035 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491377+0000", 2024-09-12T16:16:19.035 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3999999999999999e-06 2024-09-12T16:16:19.035 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.035 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.036 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.036 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491381+0000", 2024-09-12T16:16:19.036 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3689999999999998e-06 2024-09-12T16:16:19.036 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.036 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.036 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.036 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491383+0000", 2024-09-12T16:16:19.036 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5229999999999998e-06 2024-09-12T16:16:19.036 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.036 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.036 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.036 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.036 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.037 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6132 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.037 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491722+0000", 2024-09-12T16:16:19.037 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013613257, 2024-09-12T16:16:19.037 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017246239999999999, 2024-09-12T16:16:19.037 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.037 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.037 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.037 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.037 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.037 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.037 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6132 2024-09-12T16:16:19.037 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.037 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.038 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.038 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.038 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491722+0000", 2024-09-12T16:16:19.038 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.038 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.038 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.038 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.038 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491722+0000", 2024-09-12T16:16:19.038 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.038 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.038 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.038 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.038 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491723+0000", 2024-09-12T16:16:19.039 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.22e-07 2024-09-12T16:16:19.039 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.039 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.039 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.039 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491724+0000", 2024-09-12T16:16:19.039 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.155e-06 2024-09-12T16:16:19.039 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.039 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.039 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.039 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491727+0000", 2024-09-12T16:16:19.039 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4699999999999998e-06 2024-09-12T16:16:19.039 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.039 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.039 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.039 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491730+0000", 2024-09-12T16:16:19.040 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.481e-06 2024-09-12T16:16:19.040 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.040 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.040 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.040 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.040 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.040 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6037 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.040 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.479864+0000", 2024-09-12T16:16:19.040 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.025471278, 2024-09-12T16:16:19.040 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.029127634999999999, 2024-09-12T16:16:19.040 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.040 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.040 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.040 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.040 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.041 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.041 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6037 2024-09-12T16:16:19.041 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.041 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.041 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.041 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.041 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479864+0000", 2024-09-12T16:16:19.041 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.041 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.041 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.041 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.041 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479864+0000", 2024-09-12T16:16:19.041 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.042 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.042 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.042 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.042 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479864+0000", 2024-09-12T16:16:19.042 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.28e-07 2024-09-12T16:16:19.042 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.042 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.042 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.042 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479866+0000", 2024-09-12T16:16:19.042 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.043e-06 2024-09-12T16:16:19.042 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.042 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.042 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.042 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479868+0000", 2024-09-12T16:16:19.042 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.74e-06 2024-09-12T16:16:19.043 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.043 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.043 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.043 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479871+0000", 2024-09-12T16:16:19.043 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.497e-06 2024-09-12T16:16:19.043 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.043 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.043 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.043 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.043 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.043 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6069 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.043 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485603+0000", 2024-09-12T16:16:19.043 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019732187000000002, 2024-09-12T16:16:19.043 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023413604000000001, 2024-09-12T16:16:19.043 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.044 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.044 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.044 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.044 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.044 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.044 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6069 2024-09-12T16:16:19.044 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.044 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.044 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.044 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.044 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485603+0000", 2024-09-12T16:16:19.044 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.044 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.045 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.045 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.045 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485603+0000", 2024-09-12T16:16:19.045 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.045 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.045 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.045 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.045 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485604+0000", 2024-09-12T16:16:19.045 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.03e-07 2024-09-12T16:16:19.045 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.045 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.045 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.045 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485605+0000", 2024-09-12T16:16:19.045 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0219999999999999e-06 2024-09-12T16:16:19.046 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.046 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.046 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.046 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485607+0000", 2024-09-12T16:16:19.046 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7819999999999998e-06 2024-09-12T16:16:19.046 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.046 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.046 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.046 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485610+0000", 2024-09-12T16:16:19.046 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.543e-06 2024-09-12T16:16:19.046 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.046 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.046 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.046 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.047 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.047 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6101 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.047 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491387+0000", 2024-09-12T16:16:19.047 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013948764000000001, 2024-09-12T16:16:19.047 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017653421999999998, 2024-09-12T16:16:19.047 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.047 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.047 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.047 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.047 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.047 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.047 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6101 2024-09-12T16:16:19.047 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.047 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.048 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.048 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.048 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491387+0000", 2024-09-12T16:16:19.048 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.048 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.048 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.048 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.048 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491387+0000", 2024-09-12T16:16:19.048 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.048 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.048 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.048 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.048 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491387+0000", 2024-09-12T16:16:19.048 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2100000000000001e-07 2024-09-12T16:16:19.049 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.049 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.049 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.049 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491388+0000", 2024-09-12T16:16:19.049 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0380000000000001e-06 2024-09-12T16:16:19.049 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.049 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.049 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.049 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491391+0000", 2024-09-12T16:16:19.049 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.847e-06 2024-09-12T16:16:19.049 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.049 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.049 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.049 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491393+0000", 2024-09-12T16:16:19.050 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5979999999999999e-06 2024-09-12T16:16:19.050 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.050 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.050 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.050 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.050 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.050 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6133 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.050 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491733+0000", 2024-09-12T16:16:19.050 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013602506, 2024-09-12T16:16:19.050 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017331880000000001, 2024-09-12T16:16:19.050 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.050 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.050 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.050 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.051 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.051 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.051 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6133 2024-09-12T16:16:19.051 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.051 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.051 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.051 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.051 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491733+0000", 2024-09-12T16:16:19.051 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.051 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.051 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.051 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.051 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491733+0000", 2024-09-12T16:16:19.051 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.052 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.052 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.052 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.052 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491733+0000", 2024-09-12T16:16:19.052 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9499999999999998e-07 2024-09-12T16:16:19.052 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.052 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.052 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.052 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491734+0000", 2024-09-12T16:16:19.052 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0240000000000001e-06 2024-09-12T16:16:19.052 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.052 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.052 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.052 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491738+0000", 2024-09-12T16:16:19.052 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.625e-06 2024-09-12T16:16:19.053 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.053 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.053 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.053 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491740+0000", 2024-09-12T16:16:19.053 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4260000000000002e-06 2024-09-12T16:16:19.053 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.053 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.053 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.053 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.053 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.053 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6038 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.053 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.479874+0000", 2024-09-12T16:16:19.053 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.025461890000000001, 2024-09-12T16:16:19.053 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.029214716000000002, 2024-09-12T16:16:19.053 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.054 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.054 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.054 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.054 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.054 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.054 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6038 2024-09-12T16:16:19.054 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.054 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.054 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.054 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.054 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479874+0000", 2024-09-12T16:16:19.054 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.054 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.054 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.055 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.055 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479874+0000", 2024-09-12T16:16:19.055 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.055 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.055 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.055 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.055 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479874+0000", 2024-09-12T16:16:19.055 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1299999999999999e-07 2024-09-12T16:16:19.055 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.055 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.055 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.055 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479875+0000", 2024-09-12T16:16:19.055 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0070000000000001e-06 2024-09-12T16:16:19.055 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.055 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.056 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.056 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479878+0000", 2024-09-12T16:16:19.056 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7350000000000001e-06 2024-09-12T16:16:19.056 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.056 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.056 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.056 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479881+0000", 2024-09-12T16:16:19.056 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0800000000000002e-06 2024-09-12T16:16:19.056 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.056 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.056 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.056 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.057 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.057 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6070 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.057 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485613+0000", 2024-09-12T16:16:19.057 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019722580999999999, 2024-09-12T16:16:19.057 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023501186, 2024-09-12T16:16:19.057 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.057 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.057 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.057 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.057 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.057 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.057 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6070 2024-09-12T16:16:19.057 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.057 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.058 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.058 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.058 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485613+0000", 2024-09-12T16:16:19.058 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.058 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.058 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.058 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.058 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485613+0000", 2024-09-12T16:16:19.058 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.058 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.058 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.058 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.058 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485613+0000", 2024-09-12T16:16:19.059 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3799999999999999e-07 2024-09-12T16:16:19.059 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.059 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.059 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.059 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485614+0000", 2024-09-12T16:16:19.059 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.049e-06 2024-09-12T16:16:19.059 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.059 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.059 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.059 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485617+0000", 2024-09-12T16:16:19.059 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7690000000000001e-06 2024-09-12T16:16:19.059 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.059 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.059 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.060 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485619+0000", 2024-09-12T16:16:19.060 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3539999999999998e-06 2024-09-12T16:16:19.060 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.060 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.060 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.060 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.060 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.060 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6102 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.060 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491399+0000", 2024-09-12T16:16:19.060 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013936585, 2024-09-12T16:16:19.060 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017738518000000002, 2024-09-12T16:16:19.060 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.060 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.061 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.061 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.061 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.061 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.061 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6102 2024-09-12T16:16:19.061 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.061 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.061 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.061 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.061 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491399+0000", 2024-09-12T16:16:19.061 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.061 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.061 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.062 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.062 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491399+0000", 2024-09-12T16:16:19.062 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.062 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.062 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.062 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.062 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491399+0000", 2024-09-12T16:16:19.062 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1300000000000001e-07 2024-09-12T16:16:19.062 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.062 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.062 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.062 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491401+0000", 2024-09-12T16:16:19.062 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2890000000000001e-06 2024-09-12T16:16:19.062 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.062 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.063 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.063 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491404+0000", 2024-09-12T16:16:19.063 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.473e-06 2024-09-12T16:16:19.063 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.063 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.063 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.063 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491406+0000", 2024-09-12T16:16:19.063 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.407e-06 2024-09-12T16:16:19.063 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.063 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.063 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.063 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.063 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.063 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6134 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.064 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491743+0000", 2024-09-12T16:16:19.064 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013592086, 2024-09-12T16:16:19.064 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017418902999999999, 2024-09-12T16:16:19.064 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.064 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.064 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.064 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.064 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.064 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.064 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6134 2024-09-12T16:16:19.064 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.064 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.064 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.065 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.065 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491743+0000", 2024-09-12T16:16:19.065 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.065 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.065 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.065 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.065 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491743+0000", 2024-09-12T16:16:19.065 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.065 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.065 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.065 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.065 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491744+0000", 2024-09-12T16:16:19.065 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.29e-07 2024-09-12T16:16:19.066 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.066 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.066 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.066 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491745+0000", 2024-09-12T16:16:19.066 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0449999999999999e-06 2024-09-12T16:16:19.066 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.066 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.066 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.066 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491748+0000", 2024-09-12T16:16:19.066 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8710000000000001e-06 2024-09-12T16:16:19.066 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.066 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.066 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.066 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491750+0000", 2024-09-12T16:16:19.067 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3350000000000001e-06 2024-09-12T16:16:19.067 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.067 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.067 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.067 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.067 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.067 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6039 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.067 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.479884+0000", 2024-09-12T16:16:19.067 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.025451624999999999, 2024-09-12T16:16:19.067 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.02930168, 2024-09-12T16:16:19.067 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.067 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.067 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.067 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.068 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.068 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.068 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6039 2024-09-12T16:16:19.068 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.068 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.068 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.068 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.068 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479884+0000", 2024-09-12T16:16:19.068 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.068 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.068 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.068 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.068 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479884+0000", 2024-09-12T16:16:19.069 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.069 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.069 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.069 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.069 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479884+0000", 2024-09-12T16:16:19.069 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4700000000000002e-07 2024-09-12T16:16:19.069 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.069 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.069 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.069 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479885+0000", 2024-09-12T16:16:19.069 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.082e-06 2024-09-12T16:16:19.069 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.069 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.069 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.070 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479888+0000", 2024-09-12T16:16:19.070 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7810000000000001e-06 2024-09-12T16:16:19.070 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.070 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.070 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.070 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.479891+0000", 2024-09-12T16:16:19.070 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4370000000000001e-06 2024-09-12T16:16:19.070 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.070 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.070 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.070 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.070 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.070 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6071 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.070 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.485634+0000", 2024-09-12T16:16:19.071 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.019701983999999999, 2024-09-12T16:16:19.071 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023577112000000001, 2024-09-12T16:16:19.071 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.071 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.071 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.071 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.071 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.071 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.071 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6071 2024-09-12T16:16:19.071 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.071 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.071 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.071 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.072 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485634+0000", 2024-09-12T16:16:19.072 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.072 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.072 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.072 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.072 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485634+0000", 2024-09-12T16:16:19.072 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.072 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.072 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.072 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.072 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485634+0000", 2024-09-12T16:16:19.072 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4299999999999999e-07 2024-09-12T16:16:19.072 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.072 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.073 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.073 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485635+0000", 2024-09-12T16:16:19.073 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3239999999999999e-06 2024-09-12T16:16:19.073 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.073 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.073 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.073 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485639+0000", 2024-09-12T16:16:19.073 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3809999999999999e-06 2024-09-12T16:16:19.073 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.073 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.073 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.073 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.485641+0000", 2024-09-12T16:16:19.073 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6309999999999999e-06 2024-09-12T16:16:19.074 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.074 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.074 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.074 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.074 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.074 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6103 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.074 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491410+0000", 2024-09-12T16:16:19.074 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013925781, 2024-09-12T16:16:19.074 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017831303999999999, 2024-09-12T16:16:19.074 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.074 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.074 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.074 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.074 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.075 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.075 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6103 2024-09-12T16:16:19.075 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.075 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.075 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.075 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.075 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491410+0000", 2024-09-12T16:16:19.075 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.075 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.075 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.075 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.075 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491410+0000", 2024-09-12T16:16:19.075 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.075 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.076 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.076 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.076 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491410+0000", 2024-09-12T16:16:19.076 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1e-07 2024-09-12T16:16:19.076 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.076 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.076 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.076 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491411+0000", 2024-09-12T16:16:19.076 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5600000000000004e-07 2024-09-12T16:16:19.076 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.076 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.076 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.076 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491414+0000", 2024-09-12T16:16:19.076 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7650000000000002e-06 2024-09-12T16:16:19.077 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.077 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.077 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.077 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491416+0000", 2024-09-12T16:16:19.077 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2879999999999999e-06 2024-09-12T16:16:19.077 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.077 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.077 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.077 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.077 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.077 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:6135 3.a 3.f4af7eca (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.077 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:18.491753+0000", 2024-09-12T16:16:19.077 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013582781, 2024-09-12T16:16:19.078 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017513184000000001, 2024-09-12T16:16:19.078 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.078 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.078 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.078 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.078 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.078 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.078 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6135 2024-09-12T16:16:19.078 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.078 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.078 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.078 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.078 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491753+0000", 2024-09-12T16:16:19.078 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.079 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.079 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.079 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.079 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491753+0000", 2024-09-12T16:16:19.079 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.079 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.079 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.079 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.079 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491753+0000", 2024-09-12T16:16:19.079 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1799999999999999e-07 2024-09-12T16:16:19.079 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.079 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.079 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.079 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491754+0000", 2024-09-12T16:16:19.080 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.012e-06 2024-09-12T16:16:19.080 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.080 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.080 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.080 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491757+0000", 2024-09-12T16:16:19.080 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.762e-06 2024-09-12T16:16:19.080 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.080 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.080 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.080 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:18.491759+0000", 2024-09-12T16:16:19.080 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3199999999999998e-06 2024-09-12T16:16:19.080 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.080 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.080 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.081 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.081 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-12T16:16:19.081 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 152 2024-09-12T16:16:19.081 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:19.083 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:16:19.085 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --data-path /var/lib/ceph/osd/ceph-5 --journal-path /var/lib/ceph/osd/ceph-5/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.3.1d.5 2024-09-12T16:16:19.085 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:19.082+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:19.088 INFO:teuthology.orchestra.run.smithi204.stdout:939 read 0x127c600 thru 0x127d68a (0x108b bytes) 2024-09-12T16:16:19.088 INFO:teuthology.orchestra.run.smithi204.stdout:941 read 0x12fce00 thru 0x12ffa2d (0x2c2e bytes) 2024-09-12T16:16:19.088 INFO:teuthology.orchestra.run.smithi204.stdout:942 trunc from 0x17d3400 to 0xa9c8000 2024-09-12T16:16:19.088 INFO:teuthology.orchestra.run.smithi204.stdout:945 write 0x41f2200 thru 0x41fd633 (0xb434 bytes) 2024-09-12T16:16:19.088 INFO:teuthology.orchestra.run.smithi204.stdout:946 read 0x2331400 thru 0x23398c1 (0x84c2 bytes) 2024-09-12T16:16:19.088 INFO:teuthology.orchestra.run.smithi204.stdout:947 trunc from 0xa9c8000 to 0xaf1a800 2024-09-12T16:16:19.088 INFO:teuthology.orchestra.run.smithi204.stdout:948 read 0x5603800 thru 0x560c18b (0x898c bytes) 2024-09-12T16:16:19.088 INFO:teuthology.orchestra.run.smithi204.stdout:955 punch from 0x1ff0000 to 0x1ff7000, (0x7000 bytes) 2024-09-12T16:16:19.088 INFO:teuthology.orchestra.run.smithi204.stdout:956 read 0x3c85c00 thru 0x3c8b9bb (0x5dbc bytes) 2024-09-12T16:16:19.088 INFO:teuthology.orchestra.run.smithi204.stdout:957 write 0xb3ac000 thru 0xb3af4ce (0x34cf bytes) 2024-09-12T16:16:19.088 INFO:teuthology.orchestra.run.smithi204.stdout:959 read 0x8d74800 thru 0x8d7ba91 (0x7292 bytes) 2024-09-12T16:16:19.089 INFO:teuthology.orchestra.run.smithi204.stdout:960 punch from 0x7017e00 to 0x701b200, (0x3400 bytes) 2024-09-12T16:16:19.089 INFO:teuthology.orchestra.run.smithi204.stdout:961 read 0x5947e00 thru 0x5954517 (0xc718 bytes) 2024-09-12T16:16:19.089 INFO:teuthology.orchestra.run.smithi204.stdout:962 write 0xad2de00 thru 0xad2f127 (0x1328 bytes) 2024-09-12T16:16:19.089 INFO:teuthology.orchestra.run.smithi204.stdout:963 write 0x7f61e00 thru 0x7f6c4c2 (0xa6c3 bytes) 2024-09-12T16:16:19.089 INFO:teuthology.orchestra.run.smithi204.stdout:964 write 0x5778a00 thru 0x57847d3 (0xbdd4 bytes) 2024-09-12T16:16:19.089 INFO:teuthology.orchestra.run.smithi204.stdout:965 punch from 0x88a4c00 to 0x88b3800, (0xec00 bytes) 2024-09-12T16:16:19.089 INFO:teuthology.orchestra.run.smithi204.stdout:966 read 0x4320000 thru 0x432f1a7 (0xf1a8 bytes) 2024-09-12T16:16:19.089 INFO:teuthology.orchestra.run.smithi204.stdout:968 write 0x83a2000 thru 0x83aa59c (0x859d bytes) 2024-09-12T16:16:19.089 INFO:teuthology.orchestra.run.smithi204.stdout:971 write 0x33e7400 thru 0x33f6d7a (0xf97b bytes) 2024-09-12T16:16:19.089 INFO:teuthology.orchestra.run.smithi204.stdout:974 trunc from 0xb3af600 to 0xb084000 2024-09-12T16:16:19.089 INFO:teuthology.orchestra.run.smithi204.stdout:976 write 0x3686200 thru 0x368b2a4 (0x50a5 bytes) 2024-09-12T16:16:19.089 INFO:teuthology.orchestra.run.smithi204.stdout:979 write 0x5f66c00 thru 0x5f6bce7 (0x50e8 bytes) 2024-09-12T16:16:19.089 INFO:teuthology.orchestra.run.smithi204.stdout:980 read 0x8caae00 thru 0x8cb4052 (0x9253 bytes) 2024-09-12T16:16:19.090 INFO:teuthology.orchestra.run.smithi204.stdout:981 write 0x9af1000 thru 0x9b00570 (0xf571 bytes) 2024-09-12T16:16:19.090 INFO:teuthology.orchestra.run.smithi204.stdout:983 trunc from 0xb084000 to 0xb5a0800 2024-09-12T16:16:19.090 INFO:teuthology.orchestra.run.smithi204.stdout:984 trunc from 0xb5a0800 to 0x55a8200 2024-09-12T16:16:19.090 INFO:teuthology.orchestra.run.smithi204.stdout:986 read 0x5432a00 thru 0x543e5e1 (0xbbe2 bytes) 2024-09-12T16:16:19.090 INFO:teuthology.orchestra.run.smithi204.stdout:988 write 0xccb8c00 thru 0xccc79c6 (0xedc7 bytes) 2024-09-12T16:16:19.090 INFO:teuthology.orchestra.run.smithi204.stdout:990 write 0x8399000 thru 0x83a055b (0x755c bytes) 2024-09-12T16:16:19.090 INFO:teuthology.orchestra.run.smithi204.stdout:991 trunc from 0xccc7a00 to 0xcf5f400 2024-09-12T16:16:19.090 INFO:teuthology.orchestra.run.smithi204.stdout:997 write 0x2712000 thru 0x271e8be (0xc8bf bytes) 2024-09-12T16:16:19.090 INFO:teuthology.orchestra.run.smithi204.stdout:998 read 0x2941a00 thru 0x294bfe6 (0xa5e7 bytes) 2024-09-12T16:16:19.090 INFO:teuthology.orchestra.run.smithi204.stdout:999 read 0xbd6b000 thru 0xbd736ee (0x86ef bytes) 2024-09-12T16:16:19.090 INFO:teuthology.orchestra.run.smithi204.stdout:1003 read 0x63f0e00 thru 0x63fd923 (0xcb24 bytes) 2024-09-12T16:16:19.090 INFO:teuthology.orchestra.run.smithi204.stdout:1007 read 0x307a600 thru 0x3086e5a (0xc85b bytes) 2024-09-12T16:16:19.090 INFO:teuthology.orchestra.run.smithi204.stdout:1010 read 0xa9fcc00 thru 0xaa0403e (0x743f bytes) 2024-09-12T16:16:19.090 INFO:teuthology.orchestra.run.smithi204.stdout:1014 trunc from 0xcf5f400 to 0xa0df600 2024-09-12T16:16:19.090 INFO:teuthology.orchestra.run.smithi204.stdout:1019 write 0x98a8800 thru 0x98ad128 (0x4929 bytes) 2024-09-12T16:16:19.091 INFO:teuthology.orchestra.run.smithi204.stdout:1020 trunc from 0xa0df600 to 0x8af5400 2024-09-12T16:16:19.091 INFO:teuthology.orchestra.run.smithi204.stdout:1022 read 0x61a2c00 thru 0x61a79f8 (0x4df9 bytes) 2024-09-12T16:16:19.091 INFO:teuthology.orchestra.run.smithi204.stdout:1023 read 0x918000 thru 0x920275 (0x8276 bytes) 2024-09-12T16:16:19.091 INFO:teuthology.orchestra.run.smithi204.stdout:1024 write 0x907b000 thru 0x908482d (0x982e bytes) 2024-09-12T16:16:19.091 INFO:teuthology.orchestra.run.smithi204.stdout:1026 write 0x55d1600 thru 0x55dfc02 (0xe603 bytes) 2024-09-12T16:16:19.091 INFO:teuthology.orchestra.run.smithi204.stdout:1027 trunc from 0x9084a00 to 0xbf73800 2024-09-12T16:16:19.092 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T16:16:19.114 INFO:teuthology.orchestra.run.smithi204.stdout:1028 write 0xdc50e00 thru 0xdc5b55b (0xa75c bytes) 2024-09-12T16:16:19.118 INFO:teuthology.orchestra.run.smithi204.stdout:1029 trunc from 0xdc5b600 to 0xb1e4e00 2024-09-12T16:16:19.163 INFO:teuthology.orchestra.run.smithi204.stdout:1033 punch from 0x13d4e00 to 0x13e1a00, (0xcc00 bytes) 2024-09-12T16:16:19.175 INFO:teuthology.orchestra.run.smithi204.stdout:1039 write 0x5c2d000 thru 0x5c3844d (0xb44e bytes) 2024-09-12T16:16:19.182 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:19.182+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:19.201 INFO:teuthology.orchestra.run.smithi204.stdout:1041 read 0x7a68a00 thru 0x7a73996 (0xaf97 bytes) 2024-09-12T16:16:19.202 INFO:teuthology.orchestra.run.smithi204.stdout:1043 read 0xa008e00 thru 0xa010091 (0x7292 bytes) 2024-09-12T16:16:19.202 INFO:teuthology.orchestra.run.smithi204.stdout:1045 write 0x8d27000 thru 0x8d2cc9b (0x5c9c bytes) 2024-09-12T16:16:19.212 INFO:teuthology.orchestra.run.smithi204.stdout:1048 trunc from 0xb1e4e00 to 0x259ac00 2024-09-12T16:16:19.275 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:19.275 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:16:19.275 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:16:19.275 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:16:19.275 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:19.283 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:19.283+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:19.286 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:16:19.384 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:19.383+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:19.418 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:19.418 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:16:19.418 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:16:19.418 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:16:19.418 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.419 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:16:19.419 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:16:19.419 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 37.652573537999999, 2024-09-12T16:16:19.419 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55645454900000002, 2024-09-12T16:16:19.419 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.419 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.419 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:19.419 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.419 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:16:19.419 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:16:19.419 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1 2024-09-12T16:16:19.419 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.419 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.419 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.419 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.420 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:16:19.420 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.420 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.420 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.420 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:16:19.420 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.420 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.420 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.420 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764440+0000", 2024-09-12T16:16:19.420 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6249999999999999e-06 2024-09-12T16:16:19.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.420 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.420 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.421 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764447+0000", 2024-09-12T16:16:19.421 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4939999999999997e-06 2024-09-12T16:16:19.421 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.421 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.421 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.421 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764459+0000", 2024-09-12T16:16:19.421 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1517e-05 2024-09-12T16:16:19.421 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.421 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.421 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.421 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764468+0000", 2024-09-12T16:16:19.421 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7690000000000002e-06 2024-09-12T16:16:19.421 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.421 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.422 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:19.422 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764539+0000", 2024-09-12T16:16:19.422 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1103e-05 2024-09-12T16:16:19.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.422 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.422 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:16:19.422 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764551+0000", 2024-09-12T16:16:19.422 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2687999999999999e-05 2024-09-12T16:16:19.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.422 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.422 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:19.422 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319497+0000", 2024-09-12T16:16:19.422 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55494560500000001 2024-09-12T16:16:19.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.423 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.423 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:19.423 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319688+0000", 2024-09-12T16:16:19.423 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019105599999999999 2024-09-12T16:16:19.423 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.423 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.423 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:16:19.423 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319842+0000", 2024-09-12T16:16:19.423 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015377699999999999 2024-09-12T16:16:19.423 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.423 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.423 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:19.423 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320473+0000", 2024-09-12T16:16:19.423 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00063117100000000003 2024-09-12T16:16:19.424 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.424 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.424 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:19.424 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320825+0000", 2024-09-12T16:16:19.424 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00035202500000000001 2024-09-12T16:16:19.424 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.424 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.424 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:19.424 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320867+0000", 2024-09-12T16:16:19.424 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2005000000000002e-05 2024-09-12T16:16:19.424 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.424 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.424 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:19.424 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320893+0000", 2024-09-12T16:16:19.424 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5714000000000001e-05 2024-09-12T16:16:19.425 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.425 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.425 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.425 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.425 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.425 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:10816 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 3912704~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.425 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.241028+0000", 2024-09-12T16:16:19.425 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.17598375499999999, 2024-09-12T16:16:19.425 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.048596261000000002, 2024-09-12T16:16:19.425 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.425 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.426 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:19.426 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.426 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.426 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.426 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 10816 2024-09-12T16:16:19.426 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.426 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.426 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.426 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.426 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.241028+0000", 2024-09-12T16:16:19.426 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.426 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.426 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.426 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.427 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.241028+0000", 2024-09-12T16:16:19.427 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.427 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.427 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.427 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.427 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.246337+0000", 2024-09-12T16:16:19.427 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0053086540000000003 2024-09-12T16:16:19.427 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.427 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.427 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.427 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.246342+0000", 2024-09-12T16:16:19.427 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1850000000000003e-06 2024-09-12T16:16:19.427 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.427 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.427 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.428 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.246352+0000", 2024-09-12T16:16:19.428 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0229e-05 2024-09-12T16:16:19.428 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.428 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.428 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.428 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.246359+0000", 2024-09-12T16:16:19.428 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3939999999999998e-06 2024-09-12T16:16:19.428 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.428 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.428 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:19.428 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.289431+0000", 2024-09-12T16:16:19.428 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.043071150000000002 2024-09-12T16:16:19.428 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.428 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.428 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:19.429 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.289520+0000", 2024-09-12T16:16:19.429 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9432999999999996e-05 2024-09-12T16:16:19.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.429 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.429 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:19.429 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.289624+0000", 2024-09-12T16:16:19.429 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010421600000000001 2024-09-12T16:16:19.429 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.429 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.429 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.429 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.429 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:10850 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 4051968~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.430 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.247096+0000", 2024-09-12T16:16:19.430 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.16991627500000001, 2024-09-12T16:16:19.430 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.048568210000000001, 2024-09-12T16:16:19.430 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.430 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.430 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:19.430 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.430 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.430 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.430 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 10850 2024-09-12T16:16:19.430 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.430 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.430 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.430 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.431 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.247096+0000", 2024-09-12T16:16:19.431 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.431 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.431 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.431 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.431 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.247096+0000", 2024-09-12T16:16:19.431 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.431 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.431 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.431 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.431 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.247096+0000", 2024-09-12T16:16:19.431 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3900000000000001e-07 2024-09-12T16:16:19.431 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.431 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.432 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.432 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.247099+0000", 2024-09-12T16:16:19.432 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.625e-06 2024-09-12T16:16:19.432 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.432 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.432 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.432 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.247103+0000", 2024-09-12T16:16:19.432 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.18e-06 2024-09-12T16:16:19.432 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.432 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.432 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.432 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.247105+0000", 2024-09-12T16:16:19.432 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6919999999999998e-06 2024-09-12T16:16:19.433 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.433 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.433 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:19.433 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.295566+0000", 2024-09-12T16:16:19.433 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.048460255000000001 2024-09-12T16:16:19.433 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.433 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.433 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:19.433 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.295614+0000", 2024-09-12T16:16:19.433 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8953999999999999e-05 2024-09-12T16:16:19.433 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.433 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.433 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:19.433 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.295664+0000", 2024-09-12T16:16:19.433 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9264999999999997e-05 2024-09-12T16:16:19.434 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.434 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.434 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.434 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.434 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.434 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:10851 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 4056064~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.434 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.247109+0000", 2024-09-12T16:16:19.434 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.16990297800000001, 2024-09-12T16:16:19.434 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.048774294000000003, 2024-09-12T16:16:19.434 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.434 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.434 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:19.434 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.434 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.435 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.435 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 10851 2024-09-12T16:16:19.435 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.435 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.435 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.435 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.435 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.247109+0000", 2024-09-12T16:16:19.435 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.435 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.435 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.435 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.435 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.247109+0000", 2024-09-12T16:16:19.435 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.435 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.435 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.436 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.436 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.252246+0000", 2024-09-12T16:16:19.436 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0051370929999999997 2024-09-12T16:16:19.436 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.436 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.436 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.436 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.252250+0000", 2024-09-12T16:16:19.436 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2440000000000004e-06 2024-09-12T16:16:19.436 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.436 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.436 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.436 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.252262+0000", 2024-09-12T16:16:19.436 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1449e-05 2024-09-12T16:16:19.436 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.437 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.437 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.437 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.252270+0000", 2024-09-12T16:16:19.437 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5399999999999996e-06 2024-09-12T16:16:19.437 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.437 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.437 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:19.437 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.295702+0000", 2024-09-12T16:16:19.437 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.043432031000000003 2024-09-12T16:16:19.437 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.437 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.437 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:19.437 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.295786+0000", 2024-09-12T16:16:19.437 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3778999999999999e-05 2024-09-12T16:16:19.437 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.438 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.438 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:19.438 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.295883+0000", 2024-09-12T16:16:19.438 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7157999999999994e-05 2024-09-12T16:16:19.438 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.438 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.438 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.438 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.438 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.438 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:10882 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 4183040~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.438 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.252893+0000", 2024-09-12T16:16:19.438 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.16411901000000001, 2024-09-12T16:16:19.438 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.048522306000000001, 2024-09-12T16:16:19.438 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.438 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.439 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:19.439 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.439 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.439 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.439 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 10882 2024-09-12T16:16:19.439 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.439 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.439 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.439 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.439 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.252893+0000", 2024-09-12T16:16:19.439 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.439 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.439 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.439 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.440 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.252893+0000", 2024-09-12T16:16:19.440 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.440 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.440 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.440 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.440 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.252893+0000", 2024-09-12T16:16:19.440 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8500000000000002e-07 2024-09-12T16:16:19.440 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.440 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.440 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.440 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.252895+0000", 2024-09-12T16:16:19.440 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.888e-06 2024-09-12T16:16:19.440 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.440 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.440 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.441 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.252901+0000", 2024-09-12T16:16:19.441 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9689999999999999e-06 2024-09-12T16:16:19.441 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.441 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.441 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.441 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.252906+0000", 2024-09-12T16:16:19.441 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8239999999999999e-06 2024-09-12T16:16:19.441 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.441 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.441 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:19.441 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.301206+0000", 2024-09-12T16:16:19.441 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.048300614999999998 2024-09-12T16:16:19.441 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.441 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.441 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:19.442 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.301304+0000", 2024-09-12T16:16:19.442 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7652000000000006e-05 2024-09-12T16:16:19.442 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.442 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.442 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:19.442 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.301415+0000", 2024-09-12T16:16:19.442 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000110973 2024-09-12T16:16:19.442 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.442 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.442 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.442 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.442 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.442 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:10883 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 4187136~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.442 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.252913+0000", 2024-09-12T16:16:19.442 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.16409839800000001, 2024-09-12T16:16:19.443 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.048660121000000001, 2024-09-12T16:16:19.443 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.443 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.443 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:19.443 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.443 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.443 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.443 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 10883 2024-09-12T16:16:19.443 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.443 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.443 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.443 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.443 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.252913+0000", 2024-09-12T16:16:19.443 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.443 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.443 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.444 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.444 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.252913+0000", 2024-09-12T16:16:19.444 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.444 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.444 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.444 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.444 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.252914+0000", 2024-09-12T16:16:19.444 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0900000000000002e-07 2024-09-12T16:16:19.444 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.444 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.444 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.444 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.252916+0000", 2024-09-12T16:16:19.444 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.092e-06 2024-09-12T16:16:19.444 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.444 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.445 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.445 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.252922+0000", 2024-09-12T16:16:19.445 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3080000000000004e-06 2024-09-12T16:16:19.445 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.445 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.445 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.445 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.252927+0000", 2024-09-12T16:16:19.445 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9139999999999999e-06 2024-09-12T16:16:19.445 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.445 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.445 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:19.445 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.301447+0000", 2024-09-12T16:16:19.445 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.048519884999999999 2024-09-12T16:16:19.445 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.445 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.446 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:19.446 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.301509+0000", 2024-09-12T16:16:19.446 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1791000000000005e-05 2024-09-12T16:16:19.446 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.446 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.446 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:19.446 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.301574+0000", 2024-09-12T16:16:19.446 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4721999999999995e-05 2024-09-12T16:16:19.446 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.446 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.446 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.446 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.446 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.446 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:10884 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 4191232~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.446 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.252934+0000", 2024-09-12T16:16:19.447 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.164077941, 2024-09-12T16:16:19.447 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.048899364000000001, 2024-09-12T16:16:19.447 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.447 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.447 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:19.447 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.447 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.447 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.447 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 10884 2024-09-12T16:16:19.447 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.447 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.447 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.447 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.447 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.252934+0000", 2024-09-12T16:16:19.448 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.448 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.448 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.448 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.448 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.252934+0000", 2024-09-12T16:16:19.448 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.448 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.448 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.448 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.448 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.252934+0000", 2024-09-12T16:16:19.448 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7399999999999999e-07 2024-09-12T16:16:19.448 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.448 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.448 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.449 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.252936+0000", 2024-09-12T16:16:19.449 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7090000000000001e-06 2024-09-12T16:16:19.449 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.449 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.449 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.449 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.252942+0000", 2024-09-12T16:16:19.449 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7470000000000002e-06 2024-09-12T16:16:19.449 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.449 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.449 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.449 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.252947+0000", 2024-09-12T16:16:19.449 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8369999999999996e-06 2024-09-12T16:16:19.449 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.449 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.449 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:19.450 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.301642+0000", 2024-09-12T16:16:19.450 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.048695515000000002 2024-09-12T16:16:19.450 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.450 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.450 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:19.450 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.301736+0000", 2024-09-12T16:16:19.450 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4005999999999994e-05 2024-09-12T16:16:19.450 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.450 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.450 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:19.450 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.301833+0000", 2024-09-12T16:16:19.450 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7176000000000006e-05 2024-09-12T16:16:19.450 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.450 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.450 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.451 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.451 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.451 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:10885 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 3147776~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.451 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.252953+0000", 2024-09-12T16:16:19.451 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.16405882899999999, 2024-09-12T16:16:19.451 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.049113365999999999, 2024-09-12T16:16:19.451 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.451 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.451 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:19.451 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.451 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.451 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.451 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 10885 2024-09-12T16:16:19.451 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.451 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.452 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.452 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.452 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.252953+0000", 2024-09-12T16:16:19.452 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.452 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.452 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.452 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.452 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.252953+0000", 2024-09-12T16:16:19.452 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.452 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.452 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.452 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.453 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.253009+0000", 2024-09-12T16:16:19.453 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5587999999999997e-05 2024-09-12T16:16:19.453 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.453 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.453 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.453 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.253012+0000", 2024-09-12T16:16:19.453 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6990000000000001e-06 2024-09-12T16:16:19.453 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.453 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.453 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.453 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.253029+0000", 2024-09-12T16:16:19.453 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7203000000000001e-05 2024-09-12T16:16:19.453 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.454 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.454 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.454 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.253034+0000", 2024-09-12T16:16:19.454 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6299999999999997e-06 2024-09-12T16:16:19.454 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.454 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.454 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:19.454 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.301879+0000", 2024-09-12T16:16:19.454 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.048844551999999999 2024-09-12T16:16:19.454 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.454 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.454 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:19.454 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.301961+0000", 2024-09-12T16:16:19.454 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2732999999999995e-05 2024-09-12T16:16:19.454 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.455 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.455 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:19.455 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.302066+0000", 2024-09-12T16:16:19.455 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000104961 2024-09-12T16:16:19.455 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.455 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.455 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.455 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.455 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.455 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:10886 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 3151872~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.455 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.253043+0000", 2024-09-12T16:16:19.455 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.163968422, 2024-09-12T16:16:19.455 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.049270967999999998, 2024-09-12T16:16:19.455 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.456 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.456 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:19.456 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.456 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.456 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.456 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 10886 2024-09-12T16:16:19.456 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.456 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.456 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.456 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.456 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.253043+0000", 2024-09-12T16:16:19.456 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.456 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.456 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.457 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.457 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.253043+0000", 2024-09-12T16:16:19.457 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.457 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.457 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.457 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.457 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.258391+0000", 2024-09-12T16:16:19.457 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0053472820000000001 2024-09-12T16:16:19.457 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.457 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.457 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.457 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.258400+0000", 2024-09-12T16:16:19.457 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3579999999999992e-06 2024-09-12T16:16:19.457 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.458 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.458 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.458 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.258408+0000", 2024-09-12T16:16:19.458 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0800000000000006e-06 2024-09-12T16:16:19.458 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.458 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.458 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.458 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.258417+0000", 2024-09-12T16:16:19.458 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9649999999999997e-06 2024-09-12T16:16:19.458 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.458 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.458 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:19.458 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.302113+0000", 2024-09-12T16:16:19.458 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.043696236999999999 2024-09-12T16:16:19.458 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.459 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.459 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:19.459 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.302207+0000", 2024-09-12T16:16:19.459 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3591000000000006e-05 2024-09-12T16:16:19.459 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.459 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.459 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:19.459 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.302314+0000", 2024-09-12T16:16:19.459 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010745499999999999 2024-09-12T16:16:19.459 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.459 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.459 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.459 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.459 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.459 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:10912 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 3258368~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.460 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.258824+0000", 2024-09-12T16:16:19.460 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.158187676, 2024-09-12T16:16:19.460 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.048714844, 2024-09-12T16:16:19.460 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.460 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.460 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:19.460 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.460 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.460 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.460 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 10912 2024-09-12T16:16:19.460 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.460 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.460 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.460 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.461 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.258824+0000", 2024-09-12T16:16:19.461 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.461 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.461 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.461 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.461 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.258824+0000", 2024-09-12T16:16:19.461 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.461 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.461 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.461 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.461 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.258824+0000", 2024-09-12T16:16:19.461 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4600000000000001e-07 2024-09-12T16:16:19.461 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.461 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.462 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.462 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.258825+0000", 2024-09-12T16:16:19.462 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0419999999999999e-06 2024-09-12T16:16:19.462 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.462 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.462 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.462 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.258828+0000", 2024-09-12T16:16:19.462 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8399999999999999e-06 2024-09-12T16:16:19.462 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.462 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.462 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.462 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.258831+0000", 2024-09-12T16:16:19.462 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.14e-06 2024-09-12T16:16:19.462 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.463 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.463 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:19.463 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.307335+0000", 2024-09-12T16:16:19.463 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.048504042999999997 2024-09-12T16:16:19.463 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.463 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.463 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:19.463 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.307434+0000", 2024-09-12T16:16:19.463 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8988999999999997e-05 2024-09-12T16:16:19.463 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.463 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.463 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:19.463 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.307539+0000", 2024-09-12T16:16:19.463 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010454399999999999 2024-09-12T16:16:19.464 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.464 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.464 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.464 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.464 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.464 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:10913 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 3262464~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.464 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.258860+0000", 2024-09-12T16:16:19.464 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.15815143600000001, 2024-09-12T16:16:19.464 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.048920399000000003, 2024-09-12T16:16:19.464 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.464 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.464 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:19.464 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.465 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.465 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.465 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 10913 2024-09-12T16:16:19.465 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.465 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.465 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.465 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.465 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.258860+0000", 2024-09-12T16:16:19.465 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.465 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.465 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.465 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.465 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.258860+0000", 2024-09-12T16:16:19.465 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.466 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.466 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.466 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.466 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.258861+0000", 2024-09-12T16:16:19.466 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4899999999999995e-07 2024-09-12T16:16:19.466 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.466 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.466 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.466 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.258863+0000", 2024-09-12T16:16:19.466 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1409999999999999e-06 2024-09-12T16:16:19.466 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.466 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.466 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.466 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.258870+0000", 2024-09-12T16:16:19.467 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6850000000000004e-06 2024-09-12T16:16:19.467 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.467 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.467 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.467 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.258875+0000", 2024-09-12T16:16:19.467 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9899999999999997e-06 2024-09-12T16:16:19.467 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.467 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.467 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:19.467 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.307594+0000", 2024-09-12T16:16:19.467 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.048719269000000003 2024-09-12T16:16:19.467 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.467 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.467 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:19.467 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.307679+0000", 2024-09-12T16:16:19.467 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4976999999999996e-05 2024-09-12T16:16:19.468 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.468 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.468 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:19.468 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.307781+0000", 2024-09-12T16:16:19.468 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101788 2024-09-12T16:16:19.468 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.468 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.468 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.468 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.468 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.468 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:10914 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 3266560~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.468 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.258886+0000", 2024-09-12T16:16:19.468 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.15812541099999999, 2024-09-12T16:16:19.468 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.049096037000000002, 2024-09-12T16:16:19.469 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.469 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.469 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:19.469 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.469 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.469 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.469 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 10914 2024-09-12T16:16:19.469 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.469 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.469 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.469 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.469 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.258886+0000", 2024-09-12T16:16:19.469 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.469 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.469 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.470 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.470 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.258886+0000", 2024-09-12T16:16:19.470 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.470 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.470 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.470 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.470 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.258887+0000", 2024-09-12T16:16:19.470 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9299999999999998e-07 2024-09-12T16:16:19.470 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.470 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.470 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.470 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.258889+0000", 2024-09-12T16:16:19.470 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1320000000000001e-06 2024-09-12T16:16:19.470 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.471 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.471 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.471 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.258896+0000", 2024-09-12T16:16:19.471 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6660000000000002e-06 2024-09-12T16:16:19.471 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.471 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.471 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.471 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.258902+0000", 2024-09-12T16:16:19.471 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6810000000000001e-06 2024-09-12T16:16:19.471 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.471 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.471 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:19.471 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.307819+0000", 2024-09-12T16:16:19.471 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.048916495999999997 2024-09-12T16:16:19.472 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.472 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.472 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:19.472 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.307908+0000", 2024-09-12T16:16:19.472 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8673999999999998e-05 2024-09-12T16:16:19.472 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.472 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.472 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:19.472 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.307982+0000", 2024-09-12T16:16:19.472 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4795000000000005e-05 2024-09-12T16:16:19.472 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.472 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.472 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.473 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.473 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.473 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:10915 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 3270656~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.473 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.258911+0000", 2024-09-12T16:16:19.473 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.15810046899999999, 2024-09-12T16:16:19.473 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.049307836000000001, 2024-09-12T16:16:19.473 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.473 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.473 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:19.473 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.473 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.473 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.473 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 10915 2024-09-12T16:16:19.473 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.474 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.474 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.474 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.474 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.258911+0000", 2024-09-12T16:16:19.474 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.474 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.474 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.474 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.474 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.258911+0000", 2024-09-12T16:16:19.474 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.474 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.474 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.474 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.474 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.258912+0000", 2024-09-12T16:16:19.475 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9700000000000002e-07 2024-09-12T16:16:19.475 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.475 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.475 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.475 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.258914+0000", 2024-09-12T16:16:19.475 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1239999999999999e-06 2024-09-12T16:16:19.475 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.475 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.475 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.475 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.258922+0000", 2024-09-12T16:16:19.475 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1459999999999996e-06 2024-09-12T16:16:19.475 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.475 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.475 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.475 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.258928+0000", 2024-09-12T16:16:19.476 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4799999999999998e-06 2024-09-12T16:16:19.476 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.476 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.476 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:19.476 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.308025+0000", 2024-09-12T16:16:19.476 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.049096528 2024-09-12T16:16:19.476 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.476 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.476 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:19.476 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.308117+0000", 2024-09-12T16:16:19.476 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2079999999999999e-05 2024-09-12T16:16:19.476 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.476 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.476 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:19.477 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.308219+0000", 2024-09-12T16:16:19.477 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102081 2024-09-12T16:16:19.477 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.477 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.477 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.477 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.477 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.477 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:10916 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 3274752~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.477 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.258936+0000", 2024-09-12T16:16:19.477 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.15807616199999999, 2024-09-12T16:16:19.477 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.049449134999999998, 2024-09-12T16:16:19.477 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.477 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.477 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:19.478 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.478 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.478 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.478 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 10916 2024-09-12T16:16:19.478 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.478 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.478 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.478 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.478 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.258936+0000", 2024-09-12T16:16:19.478 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.478 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.478 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.478 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.478 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.258936+0000", 2024-09-12T16:16:19.479 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.479 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.479 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.479 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.479 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.258936+0000", 2024-09-12T16:16:19.479 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8400000000000005e-07 2024-09-12T16:16:19.479 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.479 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.479 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.479 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.258938+0000", 2024-09-12T16:16:19.479 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9860000000000001e-06 2024-09-12T16:16:19.479 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.479 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.479 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.479 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.258945+0000", 2024-09-12T16:16:19.480 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9550000000000003e-06 2024-09-12T16:16:19.480 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.480 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.480 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.480 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.258950+0000", 2024-09-12T16:16:19.480 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7060000000000003e-06 2024-09-12T16:16:19.480 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.480 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.480 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:19.480 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.308276+0000", 2024-09-12T16:16:19.480 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.049326145000000002 2024-09-12T16:16:19.480 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.480 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.480 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:19.480 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.308325+0000", 2024-09-12T16:16:19.481 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9085000000000002e-05 2024-09-12T16:16:19.481 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.481 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.481 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:19.481 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.308385+0000", 2024-09-12T16:16:19.481 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9774000000000001e-05 2024-09-12T16:16:19.481 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.481 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.481 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.481 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.481 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.481 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:10917 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 3278848~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.481 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.258963+0000", 2024-09-12T16:16:19.481 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.15804911199999999, 2024-09-12T16:16:19.481 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.049549804000000003, 2024-09-12T16:16:19.482 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.482 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.482 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:19.482 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.482 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.482 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.482 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 10917 2024-09-12T16:16:19.482 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.482 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.482 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.482 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.482 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.258963+0000", 2024-09-12T16:16:19.482 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.482 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.482 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.482 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.483 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.258963+0000", 2024-09-12T16:16:19.483 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.483 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.483 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.483 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.483 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.264266+0000", 2024-09-12T16:16:19.483 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.005303561 2024-09-12T16:16:19.483 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.483 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.483 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.483 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.264272+0000", 2024-09-12T16:16:19.483 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4750000000000001e-06 2024-09-12T16:16:19.483 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.483 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.483 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.483 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.264283+0000", 2024-09-12T16:16:19.484 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1361e-05 2024-09-12T16:16:19.484 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.484 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.484 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.484 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.264293+0000", 2024-09-12T16:16:19.484 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0152e-05 2024-09-12T16:16:19.484 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.484 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.484 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:19.484 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.308412+0000", 2024-09-12T16:16:19.484 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.044118415000000001 2024-09-12T16:16:19.484 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.484 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.484 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:19.485 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.308456+0000", 2024-09-12T16:16:19.485 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4218999999999998e-05 2024-09-12T16:16:19.485 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.485 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.485 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:19.485 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.308512+0000", 2024-09-12T16:16:19.485 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6620999999999999e-05 2024-09-12T16:16:19.485 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.485 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.485 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.485 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.485 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.486 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:10944 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 3389440~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.486 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.264941+0000", 2024-09-12T16:16:19.486 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.15207058200000001, 2024-09-12T16:16:19.486 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.048588771000000003, 2024-09-12T16:16:19.486 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.486 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.486 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:19.486 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.486 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.486 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.486 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 10944 2024-09-12T16:16:19.486 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.486 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.486 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.487 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.487 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.264941+0000", 2024-09-12T16:16:19.487 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.487 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.487 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.487 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.487 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.264941+0000", 2024-09-12T16:16:19.487 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.487 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.487 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.487 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.487 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.264942+0000", 2024-09-12T16:16:19.487 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.72e-07 2024-09-12T16:16:19.487 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.487 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.488 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.488 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.264944+0000", 2024-09-12T16:16:19.488 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0049999999999999e-06 2024-09-12T16:16:19.488 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.488 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.488 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.488 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.264949+0000", 2024-09-12T16:16:19.488 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.604e-06 2024-09-12T16:16:19.488 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.488 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.488 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.488 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.264956+0000", 2024-09-12T16:16:19.488 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1280000000000002e-06 2024-09-12T16:16:19.488 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.488 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.489 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:19.489 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.313334+0000", 2024-09-12T16:16:19.489 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.048377791000000003 2024-09-12T16:16:19.489 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.489 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.489 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:19.489 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.313419+0000", 2024-09-12T16:16:19.489 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4839000000000005e-05 2024-09-12T16:16:19.489 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.489 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.489 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:19.489 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.313530+0000", 2024-09-12T16:16:19.489 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000111032 2024-09-12T16:16:19.489 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.490 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.490 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.490 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.490 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.490 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:10945 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 3393536~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.490 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.264963+0000", 2024-09-12T16:16:19.490 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.152048506, 2024-09-12T16:16:19.490 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.048778307, 2024-09-12T16:16:19.490 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.490 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.490 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:19.490 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.490 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.490 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.490 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 10945 2024-09-12T16:16:19.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.491 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.491 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.491 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.491 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.264963+0000", 2024-09-12T16:16:19.491 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.491 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.491 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.491 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.264963+0000", 2024-09-12T16:16:19.491 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.491 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.491 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.491 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.264964+0000", 2024-09-12T16:16:19.491 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1199999999999998e-07 2024-09-12T16:16:19.492 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.492 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.492 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.492 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.264966+0000", 2024-09-12T16:16:19.492 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0889999999999998e-06 2024-09-12T16:16:19.492 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.492 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.492 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.492 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.264971+0000", 2024-09-12T16:16:19.492 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5520000000000004e-06 2024-09-12T16:16:19.492 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.492 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.492 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.492 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.264976+0000", 2024-09-12T16:16:19.493 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7609999999999998e-06 2024-09-12T16:16:19.493 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.493 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.493 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:19.493 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.313578+0000", 2024-09-12T16:16:19.493 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.048602364000000002 2024-09-12T16:16:19.493 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.493 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.493 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:19.493 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.313656+0000", 2024-09-12T16:16:19.493 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7991000000000006e-05 2024-09-12T16:16:19.493 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.493 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.493 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:19.493 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.313742+0000", 2024-09-12T16:16:19.494 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5137999999999997e-05 2024-09-12T16:16:19.494 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.494 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.494 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.494 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.494 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.494 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:10946 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 3397632~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.494 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.264983+0000", 2024-09-12T16:16:19.494 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.152028785, 2024-09-12T16:16:19.494 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.048990503999999997, 2024-09-12T16:16:19.494 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.494 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.494 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:19.494 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.494 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.495 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.495 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 10946 2024-09-12T16:16:19.495 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.495 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.495 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.495 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.495 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.264983+0000", 2024-09-12T16:16:19.495 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.495 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.495 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.495 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.495 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.264983+0000", 2024-09-12T16:16:19.495 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.495 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.495 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.496 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.496 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.264983+0000", 2024-09-12T16:16:19.496 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9999999999999998e-07 2024-09-12T16:16:19.496 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.496 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.496 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.496 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.264994+0000", 2024-09-12T16:16:19.496 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0455000000000001e-05 2024-09-12T16:16:19.496 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.496 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.496 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.496 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.265001+0000", 2024-09-12T16:16:19.496 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8369999999999999e-06 2024-09-12T16:16:19.496 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.496 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.497 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.497 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.265006+0000", 2024-09-12T16:16:19.497 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3179999999999997e-06 2024-09-12T16:16:19.497 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.497 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.497 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:19.497 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.313778+0000", 2024-09-12T16:16:19.497 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.048772000000000003 2024-09-12T16:16:19.497 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.497 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.497 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:19.497 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.313869+0000", 2024-09-12T16:16:19.497 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0737999999999998e-05 2024-09-12T16:16:19.497 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.497 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.498 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:19.498 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.313974+0000", 2024-09-12T16:16:19.498 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000104756 2024-09-12T16:16:19.498 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.498 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.498 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.498 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.498 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.498 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:10947 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 3401728~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.498 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.265041+0000", 2024-09-12T16:16:19.498 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.15197054400000001, 2024-09-12T16:16:19.498 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0491522, 2024-09-12T16:16:19.498 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.499 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.499 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:19.499 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.499 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.499 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.499 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 10947 2024-09-12T16:16:19.499 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.499 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.499 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.499 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.499 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.265041+0000", 2024-09-12T16:16:19.499 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.499 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.499 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.499 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.500 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.265041+0000", 2024-09-12T16:16:19.500 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.500 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.500 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.500 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.500 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.265042+0000", 2024-09-12T16:16:19.500 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8800000000000002e-07 2024-09-12T16:16:19.500 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.500 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.500 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.500 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.265044+0000", 2024-09-12T16:16:19.500 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4430000000000002e-06 2024-09-12T16:16:19.500 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.500 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.501 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.501 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.265051+0000", 2024-09-12T16:16:19.501 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.815e-06 2024-09-12T16:16:19.501 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.501 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.501 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.501 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.265056+0000", 2024-09-12T16:16:19.501 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2630000000000003e-06 2024-09-12T16:16:19.501 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.501 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.501 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:19.501 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.314014+0000", 2024-09-12T16:16:19.501 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.048957649999999998 2024-09-12T16:16:19.501 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.502 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.502 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:19.502 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.314097+0000", 2024-09-12T16:16:19.502 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2569000000000002e-05 2024-09-12T16:16:19.502 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.502 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.502 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:19.502 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.314193+0000", 2024-09-12T16:16:19.502 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6872000000000004e-05 2024-09-12T16:16:19.502 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.502 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.502 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.502 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.502 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.502 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:10948 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 3405824~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.503 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.265064+0000", 2024-09-12T16:16:19.503 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.15194772200000001, 2024-09-12T16:16:19.503 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.049278402999999998, 2024-09-12T16:16:19.503 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.503 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.503 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:19.503 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.503 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.503 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.503 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 10948 2024-09-12T16:16:19.503 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.503 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.503 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.503 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.504 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.265064+0000", 2024-09-12T16:16:19.504 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.504 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.504 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.504 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.504 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.265064+0000", 2024-09-12T16:16:19.504 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.504 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.504 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.504 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.504 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.270433+0000", 2024-09-12T16:16:19.504 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0053689089999999998 2024-09-12T16:16:19.504 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.504 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.505 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.505 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.270437+0000", 2024-09-12T16:16:19.505 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9480000000000001e-06 2024-09-12T16:16:19.505 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.505 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.505 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.505 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.270445+0000", 2024-09-12T16:16:19.505 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4719999999999995e-06 2024-09-12T16:16:19.505 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.505 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.505 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.505 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.270450+0000", 2024-09-12T16:16:19.505 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8720000000000001e-06 2024-09-12T16:16:19.506 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.506 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.506 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:19.506 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.314223+0000", 2024-09-12T16:16:19.506 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.04377313 2024-09-12T16:16:19.506 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.506 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.506 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:19.506 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.314282+0000", 2024-09-12T16:16:19.506 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9002000000000002e-05 2024-09-12T16:16:19.506 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.506 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.506 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:19.506 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.314342+0000", 2024-09-12T16:16:19.506 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0069999999999999e-05 2024-09-12T16:16:19.507 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.507 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.507 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.507 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.507 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.507 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:19.508 INFO:teuthology.orchestra.run.smithi204.stdout:1050 write 0x5c17200 thru 0x5c23d24 (0xcb25 bytes) 2024-09-12T16:16:19.508 INFO:teuthology.orchestra.run.smithi204.stdout:1051 write 0xa94dc00 thru 0xa95a90e (0xcd0f bytes) 2024-09-12T16:16:19.508 INFO:teuthology.orchestra.run.smithi204.stdout:1057 write 0xb6ee00 thru 0xb77f86 (0x9187 bytes) 2024-09-12T16:16:19.509 INFO:teuthology.orchestra.run.smithi204.stdout:1059 punch from 0x1448400 to 0x144e200, (0x5e00 bytes) 2024-09-12T16:16:19.509 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:16:19.509 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:19.508+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:19.573 INFO:teuthology.orchestra.run.smithi204.stdout:1061 write 0x105fc00 thru 0x1063fc4 (0x43c5 bytes) 2024-09-12T16:16:19.608 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:19.608+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:19.682 INFO:teuthology.orchestra.run.smithi204.stdout:1063 read 0x2ef4600 thru 0x2effbdb (0xb5dc bytes) 2024-09-12T16:16:19.682 INFO:teuthology.orchestra.run.smithi204.stdout:1064 read 0xc8400 thru 0xd6653 (0xe254 bytes) 2024-09-12T16:16:19.707 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:19.708 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:16:19.708 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.708 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14769 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.708 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.686861+0000", 2024-09-12T16:16:19.708 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.015404301, 2024-09-12T16:16:19.708 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015418171, 2024-09-12T16:16:19.708 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.708 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.708 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.708 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.708 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.708 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.708 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14769 2024-09-12T16:16:19.708 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.709 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.709 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.709 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.709 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686861+0000", 2024-09-12T16:16:19.709 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.709 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.709 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.709 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.709 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686861+0000", 2024-09-12T16:16:19.709 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.709 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.709 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.709 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.709 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686861+0000", 2024-09-12T16:16:19.710 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1799999999999999e-07 2024-09-12T16:16:19.710 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.710 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.710 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.710 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686863+0000", 2024-09-12T16:16:19.710 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.319e-06 2024-09-12T16:16:19.710 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.710 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.710 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.710 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686866+0000", 2024-09-12T16:16:19.710 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9179999999999998e-06 2024-09-12T16:16:19.710 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.710 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.710 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.711 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686868+0000", 2024-09-12T16:16:19.711 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5009999999999999e-06 2024-09-12T16:16:19.711 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.711 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.711 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.711 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.711 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.711 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14801 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.711 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687384+0000", 2024-09-12T16:16:19.711 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014881685, 2024-09-12T16:16:19.711 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014933066, 2024-09-12T16:16:19.711 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.711 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.711 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.711 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.712 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.712 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.712 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14801 2024-09-12T16:16:19.712 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.712 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.712 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.712 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.712 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687384+0000", 2024-09-12T16:16:19.712 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.712 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.712 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.712 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.712 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687384+0000", 2024-09-12T16:16:19.712 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.712 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.713 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.713 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.713 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687384+0000", 2024-09-12T16:16:19.713 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2399999999999999e-07 2024-09-12T16:16:19.713 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.713 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.713 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.713 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687385+0000", 2024-09-12T16:16:19.713 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.155e-06 2024-09-12T16:16:19.713 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.713 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.713 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.713 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687388+0000", 2024-09-12T16:16:19.713 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0529999999999998e-06 2024-09-12T16:16:19.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.714 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.714 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.714 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687391+0000", 2024-09-12T16:16:19.714 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6699999999999998e-06 2024-09-12T16:16:19.714 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.714 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.714 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.714 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.714 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14834 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.714 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687939+0000", 2024-09-12T16:16:19.714 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014326946, 2024-09-12T16:16:19.714 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01440609, 2024-09-12T16:16:19.715 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.715 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.715 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.715 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.715 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.715 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.715 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14834 2024-09-12T16:16:19.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.715 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.715 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.715 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.715 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687939+0000", 2024-09-12T16:16:19.715 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.715 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.716 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.716 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687939+0000", 2024-09-12T16:16:19.716 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.716 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.716 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.716 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.716 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687939+0000", 2024-09-12T16:16:19.716 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0800000000000001e-07 2024-09-12T16:16:19.716 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.716 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.716 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.716 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687940+0000", 2024-09-12T16:16:19.716 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8599999999999996e-07 2024-09-12T16:16:19.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.717 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.717 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.717 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687943+0000", 2024-09-12T16:16:19.717 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1070000000000001e-06 2024-09-12T16:16:19.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.717 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.717 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.717 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687946+0000", 2024-09-12T16:16:19.717 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6010000000000002e-06 2024-09-12T16:16:19.717 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.717 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.717 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.717 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.718 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14770 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.718 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.686871+0000", 2024-09-12T16:16:19.718 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.01539432, 2024-09-12T16:16:19.718 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015502118, 2024-09-12T16:16:19.718 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.718 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.718 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.718 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.718 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.718 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.718 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14770 2024-09-12T16:16:19.718 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.718 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.718 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.718 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.719 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686871+0000", 2024-09-12T16:16:19.719 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.719 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.719 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.719 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686871+0000", 2024-09-12T16:16:19.719 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.719 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.719 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.719 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686871+0000", 2024-09-12T16:16:19.719 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0900000000000001e-07 2024-09-12T16:16:19.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.719 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.720 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.720 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686873+0000", 2024-09-12T16:16:19.720 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.099e-06 2024-09-12T16:16:19.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.720 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.720 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.720 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686875+0000", 2024-09-12T16:16:19.720 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9000000000000002e-06 2024-09-12T16:16:19.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.720 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.720 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.720 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686878+0000", 2024-09-12T16:16:19.720 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5519999999999999e-06 2024-09-12T16:16:19.720 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.720 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.721 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.721 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.721 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.721 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14803 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.721 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687412+0000", 2024-09-12T16:16:19.721 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014853791999999999, 2024-09-12T16:16:19.721 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014988303, 2024-09-12T16:16:19.721 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.721 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.721 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.721 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.721 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.721 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.721 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14803 2024-09-12T16:16:19.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.722 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.722 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.722 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.722 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687412+0000", 2024-09-12T16:16:19.722 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.722 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.722 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.722 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687412+0000", 2024-09-12T16:16:19.722 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.722 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.723 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.723 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687412+0000", 2024-09-12T16:16:19.723 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.77e-07 2024-09-12T16:16:19.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.723 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.723 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.723 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687414+0000", 2024-09-12T16:16:19.723 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3799999999999999e-06 2024-09-12T16:16:19.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.723 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.723 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.723 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687420+0000", 2024-09-12T16:16:19.723 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5180000000000001e-06 2024-09-12T16:16:19.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.723 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.724 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.724 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687423+0000", 2024-09-12T16:16:19.724 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9249999999999999e-06 2024-09-12T16:16:19.724 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.724 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.724 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.724 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.724 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.724 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14835 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.724 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687968+0000", 2024-09-12T16:16:19.724 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014297078, 2024-09-12T16:16:19.724 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014458847, 2024-09-12T16:16:19.724 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.724 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.724 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.725 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.725 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.725 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.725 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14835 2024-09-12T16:16:19.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.725 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.725 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.725 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.725 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687968+0000", 2024-09-12T16:16:19.725 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.725 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.725 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.725 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687968+0000", 2024-09-12T16:16:19.725 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.726 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.726 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.726 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.726 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687969+0000", 2024-09-12T16:16:19.726 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7500000000000001e-07 2024-09-12T16:16:19.726 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.726 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.726 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.726 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687970+0000", 2024-09-12T16:16:19.726 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5349999999999999e-06 2024-09-12T16:16:19.726 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.727 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687977+0000", 2024-09-12T16:16:19.727 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4840000000000001e-06 2024-09-12T16:16:19.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.727 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687980+0000", 2024-09-12T16:16:19.727 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9979999999999999e-06 2024-09-12T16:16:19.727 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.727 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.727 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.728 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.728 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14771 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.728 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.686881+0000", 2024-09-12T16:16:19.728 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.015384445, 2024-09-12T16:16:19.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015586012, 2024-09-12T16:16:19.728 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.728 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.728 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.728 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.728 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.728 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.728 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14771 2024-09-12T16:16:19.728 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.728 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.729 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.729 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.729 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686881+0000", 2024-09-12T16:16:19.729 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.729 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.729 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.729 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686881+0000", 2024-09-12T16:16:19.729 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.729 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.729 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.729 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686881+0000", 2024-09-12T16:16:19.729 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.11e-07 2024-09-12T16:16:19.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.730 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.730 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686882+0000", 2024-09-12T16:16:19.730 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.113e-06 2024-09-12T16:16:19.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.730 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.730 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686885+0000", 2024-09-12T16:16:19.730 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.909e-06 2024-09-12T16:16:19.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.730 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.730 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686888+0000", 2024-09-12T16:16:19.730 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4930000000000001e-06 2024-09-12T16:16:19.730 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.731 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.731 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.731 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14804 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.731 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687426+0000", 2024-09-12T16:16:19.731 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014839074000000001, 2024-09-12T16:16:19.731 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015066243999999999, 2024-09-12T16:16:19.731 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.731 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.731 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.731 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.731 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.731 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.731 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14804 2024-09-12T16:16:19.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.732 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687426+0000", 2024-09-12T16:16:19.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687426+0000", 2024-09-12T16:16:19.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.733 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687427+0000", 2024-09-12T16:16:19.733 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3699999999999999e-07 2024-09-12T16:16:19.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.733 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.733 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.733 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687430+0000", 2024-09-12T16:16:19.733 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6559999999999998e-06 2024-09-12T16:16:19.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.733 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.733 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.733 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687434+0000", 2024-09-12T16:16:19.733 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4750000000000002e-06 2024-09-12T16:16:19.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.733 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.734 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.734 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687437+0000", 2024-09-12T16:16:19.734 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.661e-06 2024-09-12T16:16:19.734 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.734 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.734 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.734 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.734 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.734 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14836 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.734 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687983+0000", 2024-09-12T16:16:19.734 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014282115, 2024-09-12T16:16:19.734 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014537346, 2024-09-12T16:16:19.734 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.734 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.735 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.735 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.735 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.735 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.735 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14836 2024-09-12T16:16:19.735 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.735 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.735 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.735 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.735 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687983+0000", 2024-09-12T16:16:19.735 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.735 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.735 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.735 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.735 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687983+0000", 2024-09-12T16:16:19.735 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.736 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.736 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.736 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687984+0000", 2024-09-12T16:16:19.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3799999999999999e-07 2024-09-12T16:16:19.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.736 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.736 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.736 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687985+0000", 2024-09-12T16:16:19.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.184e-06 2024-09-12T16:16:19.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.736 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.736 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.736 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687988+0000", 2024-09-12T16:16:19.737 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0979999999999998e-06 2024-09-12T16:16:19.737 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.737 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.737 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.737 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687991+0000", 2024-09-12T16:16:19.737 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5780000000000001e-06 2024-09-12T16:16:19.737 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.737 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.737 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.737 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.737 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.737 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14772 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.737 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.686902+0000", 2024-09-12T16:16:19.737 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.015363155999999999, 2024-09-12T16:16:19.737 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015643206, 2024-09-12T16:16:19.737 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.738 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.738 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.738 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.738 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.738 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.738 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14772 2024-09-12T16:16:19.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.738 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.738 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.738 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.738 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686902+0000", 2024-09-12T16:16:19.738 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.738 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.738 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686902+0000", 2024-09-12T16:16:19.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686903+0000", 2024-09-12T16:16:19.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1899999999999998e-07 2024-09-12T16:16:19.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686904+0000", 2024-09-12T16:16:19.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.505e-06 2024-09-12T16:16:19.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.740 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686909+0000", 2024-09-12T16:16:19.740 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6650000000000002e-06 2024-09-12T16:16:19.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.740 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.740 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.740 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686913+0000", 2024-09-12T16:16:19.740 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8e-06 2024-09-12T16:16:19.740 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.740 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.740 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.740 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.740 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14805 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.740 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687440+0000", 2024-09-12T16:16:19.741 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014825263999999999, 2024-09-12T16:16:19.741 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01513079, 2024-09-12T16:16:19.741 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.741 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.741 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.741 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.741 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.741 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.741 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14805 2024-09-12T16:16:19.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.741 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.741 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.741 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.741 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687440+0000", 2024-09-12T16:16:19.741 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.742 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.742 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687440+0000", 2024-09-12T16:16:19.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.742 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.742 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687441+0000", 2024-09-12T16:16:19.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0100000000000001e-07 2024-09-12T16:16:19.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.742 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.742 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687442+0000", 2024-09-12T16:16:19.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.062e-06 2024-09-12T16:16:19.743 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687445+0000", 2024-09-12T16:16:19.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0400000000000001e-06 2024-09-12T16:16:19.743 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687447+0000", 2024-09-12T16:16:19.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5979999999999999e-06 2024-09-12T16:16:19.743 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.743 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.743 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.743 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.744 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14837 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.744 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.688013+0000", 2024-09-12T16:16:19.744 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014252116, 2024-09-12T16:16:19.744 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014594635, 2024-09-12T16:16:19.744 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.744 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.744 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.744 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.744 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.744 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.744 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14837 2024-09-12T16:16:19.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.744 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.745 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.745 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688013+0000", 2024-09-12T16:16:19.745 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.745 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.745 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.745 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.745 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688013+0000", 2024-09-12T16:16:19.745 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.745 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.745 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.745 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.745 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688014+0000", 2024-09-12T16:16:19.745 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7000000000000001e-07 2024-09-12T16:16:19.745 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.746 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.746 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.746 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688015+0000", 2024-09-12T16:16:19.746 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4929999999999999e-06 2024-09-12T16:16:19.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.746 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.746 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.746 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688019+0000", 2024-09-12T16:16:19.746 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3689999999999998e-06 2024-09-12T16:16:19.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.746 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.746 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.746 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688021+0000", 2024-09-12T16:16:19.746 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.706e-06 2024-09-12T16:16:19.747 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.747 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.747 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.747 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14773 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.747 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.686916+0000", 2024-09-12T16:16:19.747 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.015349224, 2024-09-12T16:16:19.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015717017, 2024-09-12T16:16:19.747 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.747 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.747 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.747 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.747 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.748 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.748 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14773 2024-09-12T16:16:19.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.748 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.748 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.748 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686916+0000", 2024-09-12T16:16:19.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.748 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.748 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686916+0000", 2024-09-12T16:16:19.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.749 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.749 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686917+0000", 2024-09-12T16:16:19.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:16:19.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.749 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.749 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686918+0000", 2024-09-12T16:16:19.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.209e-06 2024-09-12T16:16:19.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.749 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.749 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686921+0000", 2024-09-12T16:16:19.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.146e-06 2024-09-12T16:16:19.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.750 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.750 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.750 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686923+0000", 2024-09-12T16:16:19.750 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4940000000000002e-06 2024-09-12T16:16:19.750 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.750 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.750 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.750 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.750 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.750 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14806 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.750 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687450+0000", 2024-09-12T16:16:19.750 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014815126, 2024-09-12T16:16:19.750 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015205840999999999, 2024-09-12T16:16:19.750 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.751 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.751 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.751 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.751 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.751 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.751 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14806 2024-09-12T16:16:19.751 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.751 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.751 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.751 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.751 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687450+0000", 2024-09-12T16:16:19.751 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.751 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.751 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.751 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.751 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687450+0000", 2024-09-12T16:16:19.752 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.752 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.752 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.752 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687451+0000", 2024-09-12T16:16:19.752 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:16:19.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.752 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.752 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.752 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687452+0000", 2024-09-12T16:16:19.752 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.13e-06 2024-09-12T16:16:19.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.752 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.752 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.753 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687455+0000", 2024-09-12T16:16:19.753 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9179999999999998e-06 2024-09-12T16:16:19.753 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.753 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.753 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.753 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687457+0000", 2024-09-12T16:16:19.753 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.593e-06 2024-09-12T16:16:19.753 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.753 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.753 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.753 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.753 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.753 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14838 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.754 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.688025+0000", 2024-09-12T16:16:19.754 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014240905, 2024-09-12T16:16:19.754 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014654288, 2024-09-12T16:16:19.754 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.754 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.754 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.754 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.754 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.754 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.754 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14838 2024-09-12T16:16:19.754 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.754 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.754 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.754 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.754 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688025+0000", 2024-09-12T16:16:19.755 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.755 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.755 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.755 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688025+0000", 2024-09-12T16:16:19.755 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.755 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.755 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.755 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688025+0000", 2024-09-12T16:16:19.755 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.11e-07 2024-09-12T16:16:19.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.755 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.755 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.756 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688026+0000", 2024-09-12T16:16:19.756 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0499999999999999e-06 2024-09-12T16:16:19.756 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.756 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.756 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.756 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688029+0000", 2024-09-12T16:16:19.756 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.084e-06 2024-09-12T16:16:19.756 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.756 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.756 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.756 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688032+0000", 2024-09-12T16:16:19.756 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5859999999999999e-06 2024-09-12T16:16:19.756 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.756 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.756 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.757 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.757 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14774 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.757 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.686927+0000", 2024-09-12T16:16:19.757 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.015339045000000001, 2024-09-12T16:16:19.757 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015774995999999999, 2024-09-12T16:16:19.757 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.757 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.757 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.757 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.757 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.757 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.757 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14774 2024-09-12T16:16:19.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.758 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.758 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.758 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.758 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686927+0000", 2024-09-12T16:16:19.758 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.758 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.758 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.758 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686927+0000", 2024-09-12T16:16:19.758 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.758 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.758 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.758 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686927+0000", 2024-09-12T16:16:19.759 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0900000000000001e-07 2024-09-12T16:16:19.759 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.759 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.759 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.759 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686928+0000", 2024-09-12T16:16:19.759 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0389999999999999e-06 2024-09-12T16:16:19.759 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.759 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.759 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.759 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686931+0000", 2024-09-12T16:16:19.759 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.004e-06 2024-09-12T16:16:19.759 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.759 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.759 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.759 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686933+0000", 2024-09-12T16:16:19.760 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5110000000000002e-06 2024-09-12T16:16:19.760 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.760 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.760 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.760 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.760 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.760 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14807 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.760 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687479+0000", 2024-09-12T16:16:19.760 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014786504000000001, 2024-09-12T16:16:19.760 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015245498999999999, 2024-09-12T16:16:19.760 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.760 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.760 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.760 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.760 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.761 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.761 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14807 2024-09-12T16:16:19.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.761 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.761 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.761 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.761 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687479+0000", 2024-09-12T16:16:19.761 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.761 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.761 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.761 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687479+0000", 2024-09-12T16:16:19.761 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.762 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.762 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.762 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687479+0000", 2024-09-12T16:16:19.762 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8099999999999998e-07 2024-09-12T16:16:19.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.762 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.762 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.762 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687481+0000", 2024-09-12T16:16:19.762 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4249999999999999e-06 2024-09-12T16:16:19.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.762 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.762 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.762 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687484+0000", 2024-09-12T16:16:19.762 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4209999999999999e-06 2024-09-12T16:16:19.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.763 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.763 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.763 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687488+0000", 2024-09-12T16:16:19.763 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5939999999999998e-06 2024-09-12T16:16:19.763 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.763 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.763 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.763 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.763 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.763 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14839 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.763 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.688052+0000", 2024-09-12T16:16:19.763 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014213115, 2024-09-12T16:16:19.763 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014697391000000001, 2024-09-12T16:16:19.763 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.763 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.764 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.764 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.764 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.764 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.764 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14839 2024-09-12T16:16:19.764 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.764 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.764 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.764 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.764 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688052+0000", 2024-09-12T16:16:19.764 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.764 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.764 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.764 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.765 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688052+0000", 2024-09-12T16:16:19.765 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.765 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.765 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.765 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688053+0000", 2024-09-12T16:16:19.765 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3799999999999998e-07 2024-09-12T16:16:19.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.765 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.765 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.765 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688054+0000", 2024-09-12T16:16:19.765 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.384e-06 2024-09-12T16:16:19.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.765 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.766 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688061+0000", 2024-09-12T16:16:19.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7000000000000002e-06 2024-09-12T16:16:19.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.766 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688064+0000", 2024-09-12T16:16:19.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7970000000000001e-06 2024-09-12T16:16:19.766 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.766 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.766 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.766 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14775 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.767 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.686956+0000", 2024-09-12T16:16:19.767 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.015309161999999999, 2024-09-12T16:16:19.767 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015818603000000001, 2024-09-12T16:16:19.767 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.767 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.767 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.767 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.767 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.767 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.767 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14775 2024-09-12T16:16:19.767 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.767 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.767 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.768 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.768 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686956+0000", 2024-09-12T16:16:19.768 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.768 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.768 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.768 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.768 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686956+0000", 2024-09-12T16:16:19.768 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.768 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.768 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.768 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.768 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686957+0000", 2024-09-12T16:16:19.768 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2500000000000001e-07 2024-09-12T16:16:19.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.769 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.769 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686958+0000", 2024-09-12T16:16:19.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4720000000000001e-06 2024-09-12T16:16:19.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.769 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.769 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686962+0000", 2024-09-12T16:16:19.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4920000000000002e-06 2024-09-12T16:16:19.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.769 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.769 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686964+0000", 2024-09-12T16:16:19.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5890000000000001e-06 2024-09-12T16:16:19.770 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.770 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.770 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.770 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14808 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.770 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687508+0000", 2024-09-12T16:16:19.770 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014757309, 2024-09-12T16:16:19.770 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015294663999999999, 2024-09-12T16:16:19.770 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.770 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.770 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.770 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.770 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.771 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.771 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14808 2024-09-12T16:16:19.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.771 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.771 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.771 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.771 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687508+0000", 2024-09-12T16:16:19.771 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.771 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.771 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.771 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687508+0000", 2024-09-12T16:16:19.771 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.772 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.772 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687509+0000", 2024-09-12T16:16:19.772 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.27e-07 2024-09-12T16:16:19.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.772 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.772 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687510+0000", 2024-09-12T16:16:19.772 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.375e-06 2024-09-12T16:16:19.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.772 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.772 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687517+0000", 2024-09-12T16:16:19.773 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1330000000000001e-06 2024-09-12T16:16:19.773 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.773 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.773 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.773 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687520+0000", 2024-09-12T16:16:19.773 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8569999999999999e-06 2024-09-12T16:16:19.773 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.773 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.773 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.773 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.773 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.773 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14840 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.773 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.688067+0000", 2024-09-12T16:16:19.773 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014198478, 2024-09-12T16:16:19.774 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014767700999999999, 2024-09-12T16:16:19.774 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.774 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.774 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.774 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.774 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.774 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.774 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14840 2024-09-12T16:16:19.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.774 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.774 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.774 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.774 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688067+0000", 2024-09-12T16:16:19.774 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.775 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.775 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688067+0000", 2024-09-12T16:16:19.775 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.775 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.775 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688067+0000", 2024-09-12T16:16:19.775 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4299999999999999e-07 2024-09-12T16:16:19.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.775 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.775 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688071+0000", 2024-09-12T16:16:19.775 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3780000000000001e-06 2024-09-12T16:16:19.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.776 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.776 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688074+0000", 2024-09-12T16:16:19.776 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3900000000000002e-06 2024-09-12T16:16:19.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.776 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.776 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688077+0000", 2024-09-12T16:16:19.776 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7769999999999998e-06 2024-09-12T16:16:19.776 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.776 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.776 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.776 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14776 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.777 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.686968+0000", 2024-09-12T16:16:19.777 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.015297618000000001, 2024-09-12T16:16:19.777 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015896008999999999, 2024-09-12T16:16:19.777 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.777 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.777 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.777 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.777 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.777 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.777 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14776 2024-09-12T16:16:19.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.777 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.777 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.777 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.778 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686968+0000", 2024-09-12T16:16:19.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.778 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.778 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686968+0000", 2024-09-12T16:16:19.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.778 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.778 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686968+0000", 2024-09-12T16:16:19.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:16:19.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686969+0000", 2024-09-12T16:16:19.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.161e-06 2024-09-12T16:16:19.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686972+0000", 2024-09-12T16:16:19.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0240000000000002e-06 2024-09-12T16:16:19.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686975+0000", 2024-09-12T16:16:19.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5339999999999998e-06 2024-09-12T16:16:19.779 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.779 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.780 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.780 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.780 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14809 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.780 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687524+0000", 2024-09-12T16:16:19.780 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014741977999999999, 2024-09-12T16:16:19.780 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015363678, 2024-09-12T16:16:19.780 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.780 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.780 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.780 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.780 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.781 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.781 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14809 2024-09-12T16:16:19.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.781 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.781 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.781 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.781 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687524+0000", 2024-09-12T16:16:19.781 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.781 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.781 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.781 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687524+0000", 2024-09-12T16:16:19.781 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.781 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.782 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.782 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687524+0000", 2024-09-12T16:16:19.782 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4900000000000002e-07 2024-09-12T16:16:19.782 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.782 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.782 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.782 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687525+0000", 2024-09-12T16:16:19.782 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4360000000000001e-06 2024-09-12T16:16:19.782 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.782 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.782 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.782 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687528+0000", 2024-09-12T16:16:19.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1580000000000001e-06 2024-09-12T16:16:19.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.783 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.783 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687531+0000", 2024-09-12T16:16:19.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6620000000000001e-06 2024-09-12T16:16:19.783 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.783 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.783 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.783 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14841 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.783 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.688080+0000", 2024-09-12T16:16:19.783 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014185287, 2024-09-12T16:16:19.784 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014829447000000001, 2024-09-12T16:16:19.784 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.784 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.784 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.784 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.784 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.784 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.784 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14841 2024-09-12T16:16:19.784 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.784 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.784 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.784 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.784 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688080+0000", 2024-09-12T16:16:19.784 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.784 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.785 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.785 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.785 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688080+0000", 2024-09-12T16:16:19.785 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.785 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.785 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.785 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688081+0000", 2024-09-12T16:16:19.785 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5699999999999998e-07 2024-09-12T16:16:19.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.785 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.785 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.785 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688082+0000", 2024-09-12T16:16:19.785 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1739999999999999e-06 2024-09-12T16:16:19.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.786 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.786 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.786 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688085+0000", 2024-09-12T16:16:19.786 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.016e-06 2024-09-12T16:16:19.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.786 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.786 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.786 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688087+0000", 2024-09-12T16:16:19.786 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.514e-06 2024-09-12T16:16:19.786 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.786 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.786 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.787 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.787 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14777 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.787 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.686997+0000", 2024-09-12T16:16:19.787 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.015268873000000001, 2024-09-12T16:16:19.787 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015947129000000001, 2024-09-12T16:16:19.787 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.787 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.787 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.787 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.787 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.787 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.787 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14777 2024-09-12T16:16:19.787 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.787 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.787 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.787 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.788 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686997+0000", 2024-09-12T16:16:19.788 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.788 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.788 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.788 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686997+0000", 2024-09-12T16:16:19.788 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.788 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.788 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.788 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686997+0000", 2024-09-12T16:16:19.788 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:16:19.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.788 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.788 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.789 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.686998+0000", 2024-09-12T16:16:19.789 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4100000000000001e-06 2024-09-12T16:16:19.789 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.789 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.789 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.789 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687006+0000", 2024-09-12T16:16:19.789 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4379999999999998e-06 2024-09-12T16:16:19.789 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.789 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.789 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.789 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687009+0000", 2024-09-12T16:16:19.789 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7719999999999999e-06 2024-09-12T16:16:19.789 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.789 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.789 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.790 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.790 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.790 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14810 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.790 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687534+0000", 2024-09-12T16:16:19.790 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014731225000000001, 2024-09-12T16:16:19.790 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015437951, 2024-09-12T16:16:19.790 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.790 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.790 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.790 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.790 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.790 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.790 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14810 2024-09-12T16:16:19.790 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.790 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.790 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.791 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.791 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687534+0000", 2024-09-12T16:16:19.791 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.791 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.791 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.791 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.791 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687534+0000", 2024-09-12T16:16:19.791 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.791 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.791 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.791 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.791 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687535+0000", 2024-09-12T16:16:19.791 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.72e-07 2024-09-12T16:16:19.791 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.791 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.792 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.792 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687536+0000", 2024-09-12T16:16:19.792 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.64e-07 2024-09-12T16:16:19.792 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.792 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.792 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.792 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687539+0000", 2024-09-12T16:16:19.792 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9960000000000002e-06 2024-09-12T16:16:19.792 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.792 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.792 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.792 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687541+0000", 2024-09-12T16:16:19.792 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6290000000000002e-06 2024-09-12T16:16:19.792 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.792 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.793 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.793 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.793 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.793 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14842 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.793 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.688090+0000", 2024-09-12T16:16:19.793 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014175310999999999, 2024-09-12T16:16:19.793 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014905112, 2024-09-12T16:16:19.793 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.793 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.793 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.793 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.793 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.793 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.793 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14842 2024-09-12T16:16:19.794 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.794 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.794 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.794 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.794 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688090+0000", 2024-09-12T16:16:19.794 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.794 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.794 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.794 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.794 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688090+0000", 2024-09-12T16:16:19.794 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.794 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.794 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.794 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.794 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688090+0000", 2024-09-12T16:16:19.795 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.05e-07 2024-09-12T16:16:19.795 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.795 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.795 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.795 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688092+0000", 2024-09-12T16:16:19.795 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.102e-06 2024-09-12T16:16:19.795 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.795 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.795 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.795 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688095+0000", 2024-09-12T16:16:19.795 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0170000000000001e-06 2024-09-12T16:16:19.795 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.795 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.795 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.796 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688097+0000", 2024-09-12T16:16:19.796 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7089999999999998e-06 2024-09-12T16:16:19.796 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.796 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.796 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.796 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.796 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.796 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14778 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.796 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687012+0000", 2024-09-12T16:16:19.796 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.015253085, 2024-09-12T16:16:19.796 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016007306999999998, 2024-09-12T16:16:19.796 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.796 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.796 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.797 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.797 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.797 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.797 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14778 2024-09-12T16:16:19.797 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.797 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.797 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.797 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.797 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687012+0000", 2024-09-12T16:16:19.797 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.797 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.797 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.797 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.797 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687012+0000", 2024-09-12T16:16:19.798 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.798 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.798 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.798 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687013+0000", 2024-09-12T16:16:19.798 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4699999999999998e-07 2024-09-12T16:16:19.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.798 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.798 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.798 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687014+0000", 2024-09-12T16:16:19.798 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.186e-06 2024-09-12T16:16:19.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.798 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.798 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.798 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687017+0000", 2024-09-12T16:16:19.798 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2160000000000002e-06 2024-09-12T16:16:19.799 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.799 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.799 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.799 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687020+0000", 2024-09-12T16:16:19.799 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3929999999999998e-06 2024-09-12T16:16:19.799 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.799 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.799 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.799 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.799 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.799 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14811 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.799 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687550+0000", 2024-09-12T16:16:19.799 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014715476, 2024-09-12T16:16:19.799 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015492631999999999, 2024-09-12T16:16:19.799 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.800 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.800 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.800 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.800 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.800 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.800 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14811 2024-09-12T16:16:19.800 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.800 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.800 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.800 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.800 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687550+0000", 2024-09-12T16:16:19.800 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.800 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.800 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.800 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.801 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687550+0000", 2024-09-12T16:16:19.801 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.801 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.801 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.801 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687550+0000", 2024-09-12T16:16:19.801 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5600000000000002e-07 2024-09-12T16:16:19.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.801 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.801 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.801 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687552+0000", 2024-09-12T16:16:19.801 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.356e-06 2024-09-12T16:16:19.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.801 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.801 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.802 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687558+0000", 2024-09-12T16:16:19.802 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4239999999999998e-06 2024-09-12T16:16:19.802 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.802 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.802 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.802 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687561+0000", 2024-09-12T16:16:19.802 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7839999999999999e-06 2024-09-12T16:16:19.802 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.802 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.802 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.802 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.802 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.802 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14843 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.802 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.688100+0000", 2024-09-12T16:16:19.802 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014165394, 2024-09-12T16:16:19.803 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014966332000000001, 2024-09-12T16:16:19.803 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.803 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.803 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.803 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.803 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.803 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.803 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14843 2024-09-12T16:16:19.803 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.803 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.803 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.803 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.803 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688100+0000", 2024-09-12T16:16:19.803 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.804 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.804 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.804 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.804 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688100+0000", 2024-09-12T16:16:19.804 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.804 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.804 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.804 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.804 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688100+0000", 2024-09-12T16:16:19.804 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2499999999999999e-07 2024-09-12T16:16:19.804 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.804 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.804 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.805 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688101+0000", 2024-09-12T16:16:19.805 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0419999999999999e-06 2024-09-12T16:16:19.805 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.805 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.805 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.805 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688104+0000", 2024-09-12T16:16:19.805 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0110000000000001e-06 2024-09-12T16:16:19.805 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.805 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.805 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.805 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688107+0000", 2024-09-12T16:16:19.805 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.587e-06 2024-09-12T16:16:19.805 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.806 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.806 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.806 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.806 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14779 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.806 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687024+0000", 2024-09-12T16:16:19.806 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.015241335, 2024-09-12T16:16:19.806 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016069027999999999, 2024-09-12T16:16:19.806 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.806 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.806 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.806 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.806 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.806 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.807 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14779 2024-09-12T16:16:19.807 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.807 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.807 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.807 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.807 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687024+0000", 2024-09-12T16:16:19.807 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.807 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.807 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.807 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.807 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687024+0000", 2024-09-12T16:16:19.807 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.807 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.807 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.808 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.808 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687025+0000", 2024-09-12T16:16:19.808 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5699999999999998e-07 2024-09-12T16:16:19.808 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.808 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.808 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.808 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687030+0000", 2024-09-12T16:16:19.808 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6210000000000001e-06 2024-09-12T16:16:19.808 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.808 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.808 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.808 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687034+0000", 2024-09-12T16:16:19.808 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5700000000000001e-06 2024-09-12T16:16:19.809 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.809 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.809 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.809 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687038+0000", 2024-09-12T16:16:19.809 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6739999999999996e-06 2024-09-12T16:16:19.809 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.809 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.809 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.809 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.809 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.809 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14812 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.809 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687565+0000", 2024-09-12T16:16:19.809 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014700927000000001, 2024-09-12T16:16:19.809 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015551432, 2024-09-12T16:16:19.809 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.810 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.810 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.810 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.810 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.810 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.810 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14812 2024-09-12T16:16:19.810 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.810 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.810 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.810 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.810 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687565+0000", 2024-09-12T16:16:19.810 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.810 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.810 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.810 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.810 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687565+0000", 2024-09-12T16:16:19.811 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.811 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.811 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.811 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.811 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687565+0000", 2024-09-12T16:16:19.811 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3299999999999998e-07 2024-09-12T16:16:19.811 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.811 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.811 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.811 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687566+0000", 2024-09-12T16:16:19.811 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.161e-06 2024-09-12T16:16:19.811 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.811 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.811 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.811 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687569+0000", 2024-09-12T16:16:19.812 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1480000000000002e-06 2024-09-12T16:16:19.812 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.812 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.812 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.812 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687572+0000", 2024-09-12T16:16:19.812 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6060000000000001e-06 2024-09-12T16:16:19.812 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.812 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.812 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.812 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.812 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.812 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14844 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.812 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.688112+0000", 2024-09-12T16:16:19.812 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014153275, 2024-09-12T16:16:19.812 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015032897999999999, 2024-09-12T16:16:19.813 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.813 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.813 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.813 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.813 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.813 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.813 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14844 2024-09-12T16:16:19.813 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.813 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.813 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.813 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.813 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688112+0000", 2024-09-12T16:16:19.813 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.813 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.813 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.813 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.814 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688112+0000", 2024-09-12T16:16:19.814 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.814 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.814 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.814 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688113+0000", 2024-09-12T16:16:19.814 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.41e-07 2024-09-12T16:16:19.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.814 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.814 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.814 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688114+0000", 2024-09-12T16:16:19.814 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0950000000000001e-06 2024-09-12T16:16:19.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.814 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.815 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.815 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688117+0000", 2024-09-12T16:16:19.815 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0290000000000001e-06 2024-09-12T16:16:19.815 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.815 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.815 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.815 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688119+0000", 2024-09-12T16:16:19.815 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6089999999999999e-06 2024-09-12T16:16:19.815 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.815 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.815 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.815 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.815 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.815 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14780 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.815 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687042+0000", 2024-09-12T16:16:19.816 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.015223239, 2024-09-12T16:16:19.816 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016135467000000001, 2024-09-12T16:16:19.816 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.816 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.816 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.816 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.816 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.816 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.816 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14780 2024-09-12T16:16:19.816 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.816 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.816 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.816 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.816 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687042+0000", 2024-09-12T16:16:19.816 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.817 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.817 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.817 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687042+0000", 2024-09-12T16:16:19.817 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.817 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.817 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.817 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687043+0000", 2024-09-12T16:16:19.817 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2999999999999999e-07 2024-09-12T16:16:19.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.817 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.817 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.817 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687044+0000", 2024-09-12T16:16:19.817 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1310000000000001e-06 2024-09-12T16:16:19.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.818 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.818 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.818 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687047+0000", 2024-09-12T16:16:19.818 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2540000000000001e-06 2024-09-12T16:16:19.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.818 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.818 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.818 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687049+0000", 2024-09-12T16:16:19.818 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3649999999999998e-06 2024-09-12T16:16:19.818 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.818 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.818 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.818 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.818 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14813 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.819 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687575+0000", 2024-09-12T16:16:19.819 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014690473000000001, 2024-09-12T16:16:19.819 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015630747, 2024-09-12T16:16:19.819 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.819 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.819 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.819 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.819 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.819 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.819 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14813 2024-09-12T16:16:19.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.819 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.819 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.819 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.820 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687575+0000", 2024-09-12T16:16:19.820 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.820 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.820 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.820 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687575+0000", 2024-09-12T16:16:19.820 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.820 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.820 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.820 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687575+0000", 2024-09-12T16:16:19.820 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.46e-07 2024-09-12T16:16:19.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.820 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.820 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.821 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687576+0000", 2024-09-12T16:16:19.821 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.004e-06 2024-09-12T16:16:19.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.821 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.821 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.821 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687580+0000", 2024-09-12T16:16:19.821 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1149999999999998e-06 2024-09-12T16:16:19.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.821 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.821 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.821 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687582+0000", 2024-09-12T16:16:19.821 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6809999999999998e-06 2024-09-12T16:16:19.821 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.821 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.821 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.822 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.822 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14845 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.822 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.688134+0000", 2024-09-12T16:16:19.822 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014131207999999999, 2024-09-12T16:16:19.822 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015110602000000001, 2024-09-12T16:16:19.822 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.822 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.822 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.822 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.822 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.822 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.822 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14845 2024-09-12T16:16:19.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.823 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.823 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.823 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688134+0000", 2024-09-12T16:16:19.823 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.823 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.823 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688134+0000", 2024-09-12T16:16:19.823 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.823 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.823 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688135+0000", 2024-09-12T16:16:19.824 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.72e-07 2024-09-12T16:16:19.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.824 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.824 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.824 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688136+0000", 2024-09-12T16:16:19.824 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3880000000000001e-06 2024-09-12T16:16:19.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.824 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.824 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.824 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688139+0000", 2024-09-12T16:16:19.824 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4520000000000002e-06 2024-09-12T16:16:19.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.825 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.825 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.825 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688142+0000", 2024-09-12T16:16:19.825 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7460000000000001e-06 2024-09-12T16:16:19.825 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.825 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.825 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.825 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.825 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.825 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14781 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.825 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687052+0000", 2024-09-12T16:16:19.825 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.015213067, 2024-09-12T16:16:19.825 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016216258000000001, 2024-09-12T16:16:19.825 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.826 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.826 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.826 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.826 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.826 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.826 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14781 2024-09-12T16:16:19.826 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.826 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.826 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.826 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.826 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687052+0000", 2024-09-12T16:16:19.826 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.826 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.827 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.827 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.827 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687052+0000", 2024-09-12T16:16:19.827 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.827 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.827 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.827 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.827 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687053+0000", 2024-09-12T16:16:19.827 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0800000000000001e-07 2024-09-12T16:16:19.827 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.827 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.827 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.827 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687054+0000", 2024-09-12T16:16:19.827 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.119e-06 2024-09-12T16:16:19.828 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.828 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.828 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.828 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687057+0000", 2024-09-12T16:16:19.828 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9739999999999998e-06 2024-09-12T16:16:19.828 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.828 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.828 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.828 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687060+0000", 2024-09-12T16:16:19.828 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6959999999999998e-06 2024-09-12T16:16:19.828 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.828 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.828 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.828 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.828 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.829 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14814 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.829 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687587+0000", 2024-09-12T16:16:19.829 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014678395, 2024-09-12T16:16:19.829 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015719488, 2024-09-12T16:16:19.829 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.829 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.829 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.829 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.829 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.829 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.829 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14814 2024-09-12T16:16:19.829 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.829 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.829 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.829 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.830 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687587+0000", 2024-09-12T16:16:19.830 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.830 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.830 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.830 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687587+0000", 2024-09-12T16:16:19.830 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.830 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.830 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.830 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687587+0000", 2024-09-12T16:16:19.830 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2100000000000001e-07 2024-09-12T16:16:19.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.831 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.831 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.831 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687589+0000", 2024-09-12T16:16:19.831 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.207e-06 2024-09-12T16:16:19.831 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.831 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.831 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.831 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687592+0000", 2024-09-12T16:16:19.831 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8469999999999998e-06 2024-09-12T16:16:19.831 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.831 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.831 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.831 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687595+0000", 2024-09-12T16:16:19.831 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.543e-06 2024-09-12T16:16:19.831 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.832 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.832 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.832 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.832 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.832 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14846 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.832 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.688163+0000", 2024-09-12T16:16:19.832 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014102552000000001, 2024-09-12T16:16:19.832 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015168146, 2024-09-12T16:16:19.832 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.832 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.832 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.832 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.832 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.832 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.833 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14846 2024-09-12T16:16:19.833 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.833 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.833 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.833 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.833 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688163+0000", 2024-09-12T16:16:19.833 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.833 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.833 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.833 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.833 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688163+0000", 2024-09-12T16:16:19.833 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.833 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.834 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.834 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.834 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688163+0000", 2024-09-12T16:16:19.834 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5400000000000002e-07 2024-09-12T16:16:19.834 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.834 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.834 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.834 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688165+0000", 2024-09-12T16:16:19.834 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.638e-06 2024-09-12T16:16:19.834 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.834 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.834 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.834 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688168+0000", 2024-09-12T16:16:19.834 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4130000000000002e-06 2024-09-12T16:16:19.834 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.834 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.835 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.835 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688171+0000", 2024-09-12T16:16:19.835 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.711e-06 2024-09-12T16:16:19.835 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.835 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.835 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.835 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.835 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14782 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.835 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687064+0000", 2024-09-12T16:16:19.835 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.015201773999999999, 2024-09-12T16:16:19.835 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016290697, 2024-09-12T16:16:19.835 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.835 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.835 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.836 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.836 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.836 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.836 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14782 2024-09-12T16:16:19.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.836 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.836 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.836 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.836 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687064+0000", 2024-09-12T16:16:19.836 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.836 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.836 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.836 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687064+0000", 2024-09-12T16:16:19.836 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.837 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.837 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.837 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.837 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687064+0000", 2024-09-12T16:16:19.837 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.58e-07 2024-09-12T16:16:19.837 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.837 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.837 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.837 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687065+0000", 2024-09-12T16:16:19.837 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0920000000000001e-06 2024-09-12T16:16:19.837 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.837 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.837 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.837 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687068+0000", 2024-09-12T16:16:19.837 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.937e-06 2024-09-12T16:16:19.838 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.838 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.838 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.838 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687071+0000", 2024-09-12T16:16:19.838 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.441e-06 2024-09-12T16:16:19.838 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.838 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.838 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.838 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.838 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.838 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14815 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.838 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687598+0000", 2024-09-12T16:16:19.838 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014667479000000001, 2024-09-12T16:16:19.838 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015779372999999999, 2024-09-12T16:16:19.838 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.839 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.839 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.839 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.839 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.839 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.839 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14815 2024-09-12T16:16:19.839 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.839 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.839 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.839 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.839 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687598+0000", 2024-09-12T16:16:19.839 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.839 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.839 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.839 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.840 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687598+0000", 2024-09-12T16:16:19.840 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.840 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.840 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.840 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687598+0000", 2024-09-12T16:16:19.840 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0900000000000001e-07 2024-09-12T16:16:19.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.840 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.840 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.840 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687599+0000", 2024-09-12T16:16:19.840 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.95e-07 2024-09-12T16:16:19.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.840 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.841 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.841 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687602+0000", 2024-09-12T16:16:19.841 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9639999999999999e-06 2024-09-12T16:16:19.841 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.841 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.841 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.841 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687605+0000", 2024-09-12T16:16:19.841 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7669999999999999e-06 2024-09-12T16:16:19.841 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.841 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.841 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.841 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.841 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.841 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14847 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.841 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.688174+0000", 2024-09-12T16:16:19.841 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014091137, 2024-09-12T16:16:19.842 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015225918, 2024-09-12T16:16:19.842 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.842 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.842 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.842 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.842 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.842 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.842 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14847 2024-09-12T16:16:19.842 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.842 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.842 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.842 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.842 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688174+0000", 2024-09-12T16:16:19.842 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.843 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.843 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.843 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.843 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688174+0000", 2024-09-12T16:16:19.843 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.843 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.843 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.843 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.843 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688175+0000", 2024-09-12T16:16:19.843 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1e-07 2024-09-12T16:16:19.843 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.843 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.843 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.843 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688176+0000", 2024-09-12T16:16:19.843 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1510000000000001e-06 2024-09-12T16:16:19.844 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.844 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.844 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.844 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688179+0000", 2024-09-12T16:16:19.844 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0199999999999999e-06 2024-09-12T16:16:19.844 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.844 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.844 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.844 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688181+0000", 2024-09-12T16:16:19.844 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5689999999999999e-06 2024-09-12T16:16:19.844 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.844 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.844 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.844 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.845 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.845 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14783 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.845 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687079+0000", 2024-09-12T16:16:19.845 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.015187028, 2024-09-12T16:16:19.845 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016344897000000001, 2024-09-12T16:16:19.845 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.845 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.845 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.845 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.845 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.845 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.845 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14783 2024-09-12T16:16:19.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.845 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.846 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.846 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.846 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687079+0000", 2024-09-12T16:16:19.846 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.846 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.846 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.846 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.846 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687079+0000", 2024-09-12T16:16:19.846 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.846 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.846 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.846 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.846 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687079+0000", 2024-09-12T16:16:19.846 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3999999999999998e-07 2024-09-12T16:16:19.847 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.847 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.847 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.847 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687080+0000", 2024-09-12T16:16:19.847 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2890000000000001e-06 2024-09-12T16:16:19.847 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.847 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.847 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.847 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687087+0000", 2024-09-12T16:16:19.847 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8050000000000001e-06 2024-09-12T16:16:19.847 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.847 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.847 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.847 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687090+0000", 2024-09-12T16:16:19.848 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7860000000000001e-06 2024-09-12T16:16:19.848 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.848 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.848 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.848 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.848 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.848 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14816 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.848 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687630+0000", 2024-09-12T16:16:19.848 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014636021000000001, 2024-09-12T16:16:19.848 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015816642999999998, 2024-09-12T16:16:19.848 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.848 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.848 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.848 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.849 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.849 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.849 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14816 2024-09-12T16:16:19.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.849 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.849 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.849 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687630+0000", 2024-09-12T16:16:19.849 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.849 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.849 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687630+0000", 2024-09-12T16:16:19.849 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687630+0000", 2024-09-12T16:16:19.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3300000000000003e-07 2024-09-12T16:16:19.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687634+0000", 2024-09-12T16:16:19.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1819999999999999e-06 2024-09-12T16:16:19.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687638+0000", 2024-09-12T16:16:19.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9940000000000002e-06 2024-09-12T16:16:19.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.851 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.851 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687641+0000", 2024-09-12T16:16:19.851 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8159999999999998e-06 2024-09-12T16:16:19.851 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.851 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.851 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.851 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.851 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14848 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.851 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.688204+0000", 2024-09-12T16:16:19.851 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014061416, 2024-09-12T16:16:19.851 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015264745, 2024-09-12T16:16:19.851 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.851 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.852 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.852 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.852 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.852 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.852 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14848 2024-09-12T16:16:19.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.852 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.852 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.852 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.852 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688204+0000", 2024-09-12T16:16:19.852 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.852 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.852 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.852 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688204+0000", 2024-09-12T16:16:19.853 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.853 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.853 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.853 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.853 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688205+0000", 2024-09-12T16:16:19.853 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8500000000000002e-07 2024-09-12T16:16:19.853 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.853 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.853 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.853 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688206+0000", 2024-09-12T16:16:19.853 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4109999999999999e-06 2024-09-12T16:16:19.853 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.853 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.853 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.853 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688209+0000", 2024-09-12T16:16:19.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3170000000000002e-06 2024-09-12T16:16:19.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.854 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.854 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.854 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688212+0000", 2024-09-12T16:16:19.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7769999999999998e-06 2024-09-12T16:16:19.854 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.854 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.854 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.854 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.854 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14784 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.854 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687093+0000", 2024-09-12T16:16:19.854 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.015172265000000001, 2024-09-12T16:16:19.855 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016401694000000001, 2024-09-12T16:16:19.855 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.855 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.855 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.855 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.855 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.855 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.855 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14784 2024-09-12T16:16:19.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.855 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687093+0000", 2024-09-12T16:16:19.855 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.856 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.856 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687093+0000", 2024-09-12T16:16:19.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.856 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.856 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687094+0000", 2024-09-12T16:16:19.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4600000000000001e-07 2024-09-12T16:16:19.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.856 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.856 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687095+0000", 2024-09-12T16:16:19.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.223e-06 2024-09-12T16:16:19.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.857 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.857 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.857 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687098+0000", 2024-09-12T16:16:19.857 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1860000000000001e-06 2024-09-12T16:16:19.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.857 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.857 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.857 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687100+0000", 2024-09-12T16:16:19.857 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3949999999999999e-06 2024-09-12T16:16:19.857 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.857 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.857 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.857 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.858 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14817 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.858 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687645+0000", 2024-09-12T16:16:19.858 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014620821000000001, 2024-09-12T16:16:19.858 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015884941999999999, 2024-09-12T16:16:19.858 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.858 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.858 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.858 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.858 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.858 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.858 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14817 2024-09-12T16:16:19.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.858 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.858 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.858 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.859 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687645+0000", 2024-09-12T16:16:19.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.859 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.859 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687645+0000", 2024-09-12T16:16:19.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.859 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.859 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687645+0000", 2024-09-12T16:16:19.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4299999999999999e-07 2024-09-12T16:16:19.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.860 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.860 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687646+0000", 2024-09-12T16:16:19.860 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1009999999999999e-06 2024-09-12T16:16:19.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.860 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.860 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.860 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687649+0000", 2024-09-12T16:16:19.860 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1259999999999998e-06 2024-09-12T16:16:19.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.860 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.860 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.860 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687652+0000", 2024-09-12T16:16:19.860 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.83e-06 2024-09-12T16:16:19.860 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.860 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.861 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.861 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.861 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.861 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14849 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.861 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.688216+0000", 2024-09-12T16:16:19.861 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014049976, 2024-09-12T16:16:19.861 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015343011, 2024-09-12T16:16:19.861 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.861 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.861 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.861 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.861 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.861 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.861 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14849 2024-09-12T16:16:19.861 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.862 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.862 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.862 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.862 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688216+0000", 2024-09-12T16:16:19.862 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.862 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.862 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.862 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.862 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688216+0000", 2024-09-12T16:16:19.862 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.862 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.862 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.862 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.862 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688216+0000", 2024-09-12T16:16:19.862 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6600000000000002e-07 2024-09-12T16:16:19.863 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.863 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.863 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.863 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688217+0000", 2024-09-12T16:16:19.863 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1090000000000001e-06 2024-09-12T16:16:19.863 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.863 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.863 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.863 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688220+0000", 2024-09-12T16:16:19.863 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9919999999999999e-06 2024-09-12T16:16:19.863 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.863 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.863 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.863 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688223+0000", 2024-09-12T16:16:19.863 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5670000000000002e-06 2024-09-12T16:16:19.864 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.864 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.864 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.864 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.864 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.864 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14785 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.864 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687104+0000", 2024-09-12T16:16:19.864 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.015161854000000001, 2024-09-12T16:16:19.864 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016480733000000001, 2024-09-12T16:16:19.864 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.864 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.864 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.864 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.864 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.864 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.865 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14785 2024-09-12T16:16:19.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.865 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.865 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.865 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.865 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687104+0000", 2024-09-12T16:16:19.865 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.865 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.865 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.865 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687104+0000", 2024-09-12T16:16:19.865 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.866 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.866 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.866 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687104+0000", 2024-09-12T16:16:19.866 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.58e-07 2024-09-12T16:16:19.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.866 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.866 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.866 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687105+0000", 2024-09-12T16:16:19.866 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0550000000000001e-06 2024-09-12T16:16:19.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.866 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.866 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.866 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687108+0000", 2024-09-12T16:16:19.867 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9830000000000001e-06 2024-09-12T16:16:19.867 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.867 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.867 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.867 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687110+0000", 2024-09-12T16:16:19.867 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2879999999999999e-06 2024-09-12T16:16:19.867 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.867 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.867 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.867 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.867 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.867 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14818 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.867 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687655+0000", 2024-09-12T16:16:19.867 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014610297, 2024-09-12T16:16:19.868 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015951746999999999, 2024-09-12T16:16:19.868 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.868 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.868 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.868 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.868 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.868 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.868 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14818 2024-09-12T16:16:19.868 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.868 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.868 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.868 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.868 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687655+0000", 2024-09-12T16:16:19.869 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.869 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.869 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.869 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.869 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687655+0000", 2024-09-12T16:16:19.869 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.869 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.869 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.869 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.869 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687655+0000", 2024-09-12T16:16:19.869 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2000000000000001e-07 2024-09-12T16:16:19.869 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.869 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.869 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.869 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687657+0000", 2024-09-12T16:16:19.870 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.046e-06 2024-09-12T16:16:19.870 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.870 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.870 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.870 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687659+0000", 2024-09-12T16:16:19.870 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.914e-06 2024-09-12T16:16:19.870 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.870 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.870 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.870 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687662+0000", 2024-09-12T16:16:19.870 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5280000000000002e-06 2024-09-12T16:16:19.870 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.870 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.870 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.870 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.871 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.871 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14850 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.871 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.688233+0000", 2024-09-12T16:16:19.871 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014032451, 2024-09-12T16:16:19.871 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015410317, 2024-09-12T16:16:19.871 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.871 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.871 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.871 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.871 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.871 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.871 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14850 2024-09-12T16:16:19.871 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.871 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.872 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.872 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.872 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688233+0000", 2024-09-12T16:16:19.872 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.872 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.872 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.872 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688233+0000", 2024-09-12T16:16:19.872 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.872 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.872 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.872 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688233+0000", 2024-09-12T16:16:19.872 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.41e-07 2024-09-12T16:16:19.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.873 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.873 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.873 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688235+0000", 2024-09-12T16:16:19.873 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.562e-06 2024-09-12T16:16:19.873 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.873 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.873 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.873 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688239+0000", 2024-09-12T16:16:19.873 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8689999999999997e-06 2024-09-12T16:16:19.873 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.873 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.873 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.873 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688242+0000", 2024-09-12T16:16:19.874 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.569e-06 2024-09-12T16:16:19.874 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.874 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.874 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.874 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.874 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.874 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14786 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.874 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687120+0000", 2024-09-12T16:16:19.874 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.015145509999999999, 2024-09-12T16:16:19.874 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016547602000000002, 2024-09-12T16:16:19.874 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.874 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.874 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.875 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.875 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.875 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.875 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14786 2024-09-12T16:16:19.875 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.875 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.875 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.875 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.875 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687120+0000", 2024-09-12T16:16:19.875 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.875 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.875 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.875 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.875 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687120+0000", 2024-09-12T16:16:19.875 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.876 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.876 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.876 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.876 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687120+0000", 2024-09-12T16:16:19.876 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.72e-07 2024-09-12T16:16:19.876 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.876 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.876 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.876 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687122+0000", 2024-09-12T16:16:19.876 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.35e-06 2024-09-12T16:16:19.876 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.876 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.876 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.876 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687125+0000", 2024-09-12T16:16:19.876 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3589999999999999e-06 2024-09-12T16:16:19.877 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.877 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.877 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.877 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687128+0000", 2024-09-12T16:16:19.877 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.514e-06 2024-09-12T16:16:19.877 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.877 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.877 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.877 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.877 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.877 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14819 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.877 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687669+0000", 2024-09-12T16:16:19.877 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014596131, 2024-09-12T16:16:19.877 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016021157000000001, 2024-09-12T16:16:19.877 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.877 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.878 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.878 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.878 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.878 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.878 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14819 2024-09-12T16:16:19.878 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.878 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.878 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.878 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.878 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687669+0000", 2024-09-12T16:16:19.878 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.878 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.878 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.878 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.878 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687669+0000", 2024-09-12T16:16:19.879 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.879 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.879 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.879 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687670+0000", 2024-09-12T16:16:19.879 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.34e-07 2024-09-12T16:16:19.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.879 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.879 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.879 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687671+0000", 2024-09-12T16:16:19.879 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1620000000000001e-06 2024-09-12T16:16:19.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.879 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.880 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.880 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687674+0000", 2024-09-12T16:16:19.880 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4290000000000001e-06 2024-09-12T16:16:19.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.880 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.880 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.880 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687677+0000", 2024-09-12T16:16:19.880 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.678e-06 2024-09-12T16:16:19.880 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.880 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.880 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.880 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.880 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14851 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.880 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.688246+0000", 2024-09-12T16:16:19.881 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014019218999999999, 2024-09-12T16:16:19.881 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015466723999999999, 2024-09-12T16:16:19.881 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.881 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.881 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.881 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.881 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.881 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.881 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14851 2024-09-12T16:16:19.881 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.881 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.881 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.881 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.881 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688246+0000", 2024-09-12T16:16:19.882 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.882 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.882 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.882 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.882 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688246+0000", 2024-09-12T16:16:19.882 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.882 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.882 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.882 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.882 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688247+0000", 2024-09-12T16:16:19.882 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0900000000000001e-07 2024-09-12T16:16:19.882 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.882 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.882 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.882 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688248+0000", 2024-09-12T16:16:19.883 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1629999999999999e-06 2024-09-12T16:16:19.883 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.883 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.883 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.883 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688251+0000", 2024-09-12T16:16:19.883 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7139999999999999e-06 2024-09-12T16:16:19.883 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.883 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.883 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.883 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688254+0000", 2024-09-12T16:16:19.883 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5610000000000001e-06 2024-09-12T16:16:19.883 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.883 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.883 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.883 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.884 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.884 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14787 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.884 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687131+0000", 2024-09-12T16:16:19.884 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.015134584, 2024-09-12T16:16:19.884 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016604849000000001, 2024-09-12T16:16:19.884 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.884 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.884 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.884 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.884 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.884 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.884 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14787 2024-09-12T16:16:19.884 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.884 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.885 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.885 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.885 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687131+0000", 2024-09-12T16:16:19.885 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.885 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.885 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.885 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.885 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687131+0000", 2024-09-12T16:16:19.885 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.885 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.885 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.885 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.885 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687131+0000", 2024-09-12T16:16:19.885 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1e-07 2024-09-12T16:16:19.885 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.886 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.886 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.886 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687132+0000", 2024-09-12T16:16:19.886 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.006e-06 2024-09-12T16:16:19.886 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.886 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.886 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.886 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687135+0000", 2024-09-12T16:16:19.886 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0630000000000002e-06 2024-09-12T16:16:19.886 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.886 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.886 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.886 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687138+0000", 2024-09-12T16:16:19.886 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4399999999999999e-06 2024-09-12T16:16:19.887 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.887 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.887 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.887 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.887 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.887 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14820 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.887 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687680+0000", 2024-09-12T16:16:19.887 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.01458516, 2024-09-12T16:16:19.887 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016078041000000001, 2024-09-12T16:16:19.887 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.887 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.887 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.887 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.887 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.887 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.887 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14820 2024-09-12T16:16:19.888 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.888 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.888 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.888 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.888 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687680+0000", 2024-09-12T16:16:19.888 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.888 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.888 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.888 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.888 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687680+0000", 2024-09-12T16:16:19.888 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.888 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.888 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.888 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.889 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687681+0000", 2024-09-12T16:16:19.889 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1400000000000001e-07 2024-09-12T16:16:19.889 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.889 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.889 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.889 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687682+0000", 2024-09-12T16:16:19.889 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.114e-06 2024-09-12T16:16:19.889 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.889 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.889 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.889 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687685+0000", 2024-09-12T16:16:19.889 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.016e-06 2024-09-12T16:16:19.889 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.889 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.889 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.890 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687687+0000", 2024-09-12T16:16:19.890 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7480000000000002e-06 2024-09-12T16:16:19.890 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.890 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.890 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.890 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.890 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.890 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14852 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.890 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.688279+0000", 2024-09-12T16:16:19.890 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013986669, 2024-09-12T16:16:19.890 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015502751, 2024-09-12T16:16:19.890 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.890 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.890 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.890 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.890 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.891 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.891 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14852 2024-09-12T16:16:19.891 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.891 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.891 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.891 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.891 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688279+0000", 2024-09-12T16:16:19.891 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.891 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.891 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.891 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.891 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688279+0000", 2024-09-12T16:16:19.891 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.891 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.891 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.892 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.892 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688279+0000", 2024-09-12T16:16:19.892 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7500000000000001e-07 2024-09-12T16:16:19.892 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.892 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.892 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.892 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688284+0000", 2024-09-12T16:16:19.892 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3440000000000003e-06 2024-09-12T16:16:19.892 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.892 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.892 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.892 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688288+0000", 2024-09-12T16:16:19.892 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0550000000000001e-06 2024-09-12T16:16:19.892 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.892 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.893 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.893 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688291+0000", 2024-09-12T16:16:19.893 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8629999999999999e-06 2024-09-12T16:16:19.893 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.893 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.893 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.893 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.893 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.893 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14788 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.893 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687159+0000", 2024-09-12T16:16:19.893 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.015106661, 2024-09-12T16:16:19.893 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016645367000000001, 2024-09-12T16:16:19.893 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.893 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.894 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.894 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.894 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.894 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.894 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14788 2024-09-12T16:16:19.894 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.894 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.894 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.894 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.894 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687159+0000", 2024-09-12T16:16:19.894 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.894 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.894 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.894 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.894 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687159+0000", 2024-09-12T16:16:19.895 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.895 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.895 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.895 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.895 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687159+0000", 2024-09-12T16:16:19.895 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9299999999999999e-07 2024-09-12T16:16:19.895 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.895 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.895 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.895 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687161+0000", 2024-09-12T16:16:19.895 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.35e-06 2024-09-12T16:16:19.895 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.895 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.895 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.895 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687165+0000", 2024-09-12T16:16:19.895 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.549e-06 2024-09-12T16:16:19.896 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.896 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.896 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.896 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687168+0000", 2024-09-12T16:16:19.896 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5110000000000002e-06 2024-09-12T16:16:19.896 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.896 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.896 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.896 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.896 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.896 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14821 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.896 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687710+0000", 2024-09-12T16:16:19.896 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014555841, 2024-09-12T16:16:19.896 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01611717, 2024-09-12T16:16:19.897 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.897 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.897 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.897 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.897 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.897 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.897 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14821 2024-09-12T16:16:19.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.897 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.897 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.897 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.897 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687710+0000", 2024-09-12T16:16:19.897 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.898 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.898 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.898 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687710+0000", 2024-09-12T16:16:19.898 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.898 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.898 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.898 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.898 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687710+0000", 2024-09-12T16:16:19.898 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0499999999999999e-07 2024-09-12T16:16:19.898 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.898 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.898 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.898 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687712+0000", 2024-09-12T16:16:19.898 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4389999999999999e-06 2024-09-12T16:16:19.899 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.899 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.899 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.899 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687716+0000", 2024-09-12T16:16:19.899 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5639999999999998e-06 2024-09-12T16:16:19.899 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.899 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.899 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.899 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687719+0000", 2024-09-12T16:16:19.899 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7010000000000001e-06 2024-09-12T16:16:19.899 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.899 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.899 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.899 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.900 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.900 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14853 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.900 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.688294+0000", 2024-09-12T16:16:19.900 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013971119000000001, 2024-09-12T16:16:19.900 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01556825, 2024-09-12T16:16:19.900 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.900 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.900 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.900 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.900 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.900 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.900 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14853 2024-09-12T16:16:19.900 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.900 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.901 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.901 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.901 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688294+0000", 2024-09-12T16:16:19.901 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.901 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.901 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.901 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688294+0000", 2024-09-12T16:16:19.901 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.901 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.901 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.901 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688295+0000", 2024-09-12T16:16:19.901 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6800000000000001e-07 2024-09-12T16:16:19.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.902 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.902 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.902 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688296+0000", 2024-09-12T16:16:19.902 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1820000000000001e-06 2024-09-12T16:16:19.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.902 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.902 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.902 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688300+0000", 2024-09-12T16:16:19.902 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7570000000000002e-06 2024-09-12T16:16:19.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.902 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.902 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.902 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688302+0000", 2024-09-12T16:16:19.902 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.65e-06 2024-09-12T16:16:19.902 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.903 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.903 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.903 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.903 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.903 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14789 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.903 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687171+0000", 2024-09-12T16:16:19.903 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.015094260999999999, 2024-09-12T16:16:19.903 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016719772000000001, 2024-09-12T16:16:19.903 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.903 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.903 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.903 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.903 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.904 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.904 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14789 2024-09-12T16:16:19.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.904 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.904 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.904 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.904 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687171+0000", 2024-09-12T16:16:19.904 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.904 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.904 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.904 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687171+0000", 2024-09-12T16:16:19.904 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.905 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.905 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.905 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.905 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687172+0000", 2024-09-12T16:16:19.905 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2000000000000001e-07 2024-09-12T16:16:19.905 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.905 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.905 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.905 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687173+0000", 2024-09-12T16:16:19.905 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.062e-06 2024-09-12T16:16:19.905 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.905 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.905 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.905 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687176+0000", 2024-09-12T16:16:19.906 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0400000000000001e-06 2024-09-12T16:16:19.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.906 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.906 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.906 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687178+0000", 2024-09-12T16:16:19.906 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.413e-06 2024-09-12T16:16:19.906 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.906 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.906 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.906 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.906 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14822 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.907 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687722+0000", 2024-09-12T16:16:19.907 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014543281, 2024-09-12T16:16:19.907 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016192082999999999, 2024-09-12T16:16:19.907 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.907 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.907 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.907 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.907 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.907 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.907 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14822 2024-09-12T16:16:19.907 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.907 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.907 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.908 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.908 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687722+0000", 2024-09-12T16:16:19.908 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.908 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.908 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.908 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.908 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687722+0000", 2024-09-12T16:16:19.908 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.908 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.908 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.908 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.908 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687723+0000", 2024-09-12T16:16:19.908 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4299999999999999e-07 2024-09-12T16:16:19.908 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.909 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.909 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.909 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687724+0000", 2024-09-12T16:16:19.909 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1880000000000001e-06 2024-09-12T16:16:19.909 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.909 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.909 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.909 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687727+0000", 2024-09-12T16:16:19.909 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.027e-06 2024-09-12T16:16:19.909 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.909 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.909 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.909 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687729+0000", 2024-09-12T16:16:19.909 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5560000000000002e-06 2024-09-12T16:16:19.910 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.910 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.910 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.910 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.910 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.910 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14854 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.910 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.688306+0000", 2024-09-12T16:16:19.910 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.01395995, 2024-09-12T16:16:19.910 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015631280000000001, 2024-09-12T16:16:19.910 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.910 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.910 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.910 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.910 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.910 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.911 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14854 2024-09-12T16:16:19.911 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.911 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.911 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.911 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.911 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688306+0000", 2024-09-12T16:16:19.911 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.911 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.911 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.911 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.911 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688306+0000", 2024-09-12T16:16:19.911 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.911 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.911 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.911 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.911 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688306+0000", 2024-09-12T16:16:19.912 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3999999999999998e-07 2024-09-12T16:16:19.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.912 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.912 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.912 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688307+0000", 2024-09-12T16:16:19.912 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1119999999999999e-06 2024-09-12T16:16:19.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.912 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.912 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.912 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688310+0000", 2024-09-12T16:16:19.912 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9040000000000001e-06 2024-09-12T16:16:19.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.912 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.912 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.912 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688312+0000", 2024-09-12T16:16:19.913 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6220000000000001e-06 2024-09-12T16:16:19.913 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.913 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.913 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.913 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.913 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.913 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14790 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.913 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687199+0000", 2024-09-12T16:16:19.913 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.015066292, 2024-09-12T16:16:19.913 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016762334, 2024-09-12T16:16:19.913 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.913 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.913 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.913 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.913 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.914 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.914 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14790 2024-09-12T16:16:19.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.914 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.914 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.914 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687199+0000", 2024-09-12T16:16:19.914 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.914 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.914 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687199+0000", 2024-09-12T16:16:19.914 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.914 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.915 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687200+0000", 2024-09-12T16:16:19.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4499999999999998e-07 2024-09-12T16:16:19.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.915 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.915 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687201+0000", 2024-09-12T16:16:19.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.364e-06 2024-09-12T16:16:19.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.915 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.915 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687205+0000", 2024-09-12T16:16:19.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5159999999999996e-06 2024-09-12T16:16:19.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.915 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.916 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687208+0000", 2024-09-12T16:16:19.916 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5349999999999999e-06 2024-09-12T16:16:19.916 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.916 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.916 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.916 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.916 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.916 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14823 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.916 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687754+0000", 2024-09-12T16:16:19.916 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014511603, 2024-09-12T16:16:19.916 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016241154000000001, 2024-09-12T16:16:19.916 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.916 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.916 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.917 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.917 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.917 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.917 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14823 2024-09-12T16:16:19.917 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.917 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.917 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.917 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.917 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687754+0000", 2024-09-12T16:16:19.917 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.917 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.917 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.917 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.917 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687754+0000", 2024-09-12T16:16:19.917 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.918 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.918 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.918 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.918 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687754+0000", 2024-09-12T16:16:19.918 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0899999999999997e-07 2024-09-12T16:16:19.918 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.918 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.918 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.918 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687756+0000", 2024-09-12T16:16:19.918 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3850000000000001e-06 2024-09-12T16:16:19.918 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.918 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.918 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.918 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687762+0000", 2024-09-12T16:16:19.918 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2360000000000001e-06 2024-09-12T16:16:19.919 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.919 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.919 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.919 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687765+0000", 2024-09-12T16:16:19.919 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7199999999999998e-06 2024-09-12T16:16:19.919 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.919 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.919 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.919 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.919 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.919 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14855 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.919 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.688321+0000", 2024-09-12T16:16:19.919 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013944254, 2024-09-12T16:16:19.919 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015697132999999999, 2024-09-12T16:16:19.919 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.920 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.920 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.920 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.920 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.920 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.920 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14855 2024-09-12T16:16:19.920 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.920 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.920 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.920 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.920 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688321+0000", 2024-09-12T16:16:19.920 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.920 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688321+0000", 2024-09-12T16:16:19.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688322+0000", 2024-09-12T16:16:19.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6899999999999999e-07 2024-09-12T16:16:19.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688323+0000", 2024-09-12T16:16:19.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5e-06 2024-09-12T16:16:19.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.922 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.922 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.922 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688326+0000", 2024-09-12T16:16:19.922 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3419999999999999e-06 2024-09-12T16:16:19.922 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.922 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.922 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.922 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688329+0000", 2024-09-12T16:16:19.922 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.667e-06 2024-09-12T16:16:19.922 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.922 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.922 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.922 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.922 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.922 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14791 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.923 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687213+0000", 2024-09-12T16:16:19.923 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.01505301, 2024-09-12T16:16:19.923 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01682844, 2024-09-12T16:16:19.923 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.923 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.923 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.923 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.923 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.923 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.923 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14791 2024-09-12T16:16:19.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.923 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.923 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.924 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.924 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687213+0000", 2024-09-12T16:16:19.924 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.924 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.924 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.924 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.924 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687213+0000", 2024-09-12T16:16:19.924 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.924 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.924 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.924 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.924 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687213+0000", 2024-09-12T16:16:19.924 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1e-07 2024-09-12T16:16:19.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.925 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.925 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.925 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687216+0000", 2024-09-12T16:16:19.925 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1669999999999999e-06 2024-09-12T16:16:19.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.925 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.925 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.925 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687219+0000", 2024-09-12T16:16:19.925 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2940000000000001e-06 2024-09-12T16:16:19.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.925 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.925 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.925 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687222+0000", 2024-09-12T16:16:19.925 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.481e-06 2024-09-12T16:16:19.926 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.926 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.926 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.926 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.926 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14824 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.926 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687768+0000", 2024-09-12T16:16:19.926 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014497441999999999, 2024-09-12T16:16:19.926 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016295566000000001, 2024-09-12T16:16:19.926 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.926 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.926 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.926 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.926 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.927 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.927 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14824 2024-09-12T16:16:19.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.927 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.927 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.927 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.927 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687768+0000", 2024-09-12T16:16:19.927 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.928 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.928 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.928 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687768+0000", 2024-09-12T16:16:19.928 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.928 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.928 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.928 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687768+0000", 2024-09-12T16:16:19.928 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4900000000000002e-07 2024-09-12T16:16:19.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.928 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.928 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.928 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687770+0000", 2024-09-12T16:16:19.929 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2219999999999999e-06 2024-09-12T16:16:19.929 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.929 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.929 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.929 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687773+0000", 2024-09-12T16:16:19.929 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1709999999999998e-06 2024-09-12T16:16:19.929 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.929 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.929 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.929 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687775+0000", 2024-09-12T16:16:19.929 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6079999999999998e-06 2024-09-12T16:16:19.929 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.929 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.930 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.930 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.930 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.930 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14856 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.930 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.688333+0000", 2024-09-12T16:16:19.930 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013933031, 2024-09-12T16:16:19.930 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015753649000000002, 2024-09-12T16:16:19.930 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.930 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.930 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.930 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.930 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.930 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.930 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14856 2024-09-12T16:16:19.930 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.931 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.931 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.931 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.931 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688333+0000", 2024-09-12T16:16:19.931 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.931 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.931 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.931 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688333+0000", 2024-09-12T16:16:19.931 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.931 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.931 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.931 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688333+0000", 2024-09-12T16:16:19.931 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1e-07 2024-09-12T16:16:19.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.932 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.932 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.932 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688334+0000", 2024-09-12T16:16:19.932 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.155e-06 2024-09-12T16:16:19.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.932 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.932 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.932 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688337+0000", 2024-09-12T16:16:19.932 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0709999999999999e-06 2024-09-12T16:16:19.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.932 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.932 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.932 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688340+0000", 2024-09-12T16:16:19.932 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5919999999999999e-06 2024-09-12T16:16:19.933 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.933 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.933 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.933 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.933 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.933 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14792 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.933 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687225+0000", 2024-09-12T16:16:19.933 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.015040266, 2024-09-12T16:16:19.933 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016903298000000001, 2024-09-12T16:16:19.933 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.933 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.933 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.933 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.933 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.933 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.934 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14792 2024-09-12T16:16:19.934 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.934 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.934 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.934 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.934 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687225+0000", 2024-09-12T16:16:19.934 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.934 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.934 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.934 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.934 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687225+0000", 2024-09-12T16:16:19.934 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.934 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.934 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.934 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.935 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687226+0000", 2024-09-12T16:16:19.935 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5400000000000002e-07 2024-09-12T16:16:19.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.935 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.935 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.935 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687227+0000", 2024-09-12T16:16:19.935 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1060000000000001e-06 2024-09-12T16:16:19.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.935 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.935 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.935 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687233+0000", 2024-09-12T16:16:19.935 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6290000000000004e-06 2024-09-12T16:16:19.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.935 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.935 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.936 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687237+0000", 2024-09-12T16:16:19.936 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2150000000000001e-06 2024-09-12T16:16:19.936 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.936 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.936 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.936 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.936 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.936 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14825 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.936 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687780+0000", 2024-09-12T16:16:19.936 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014485711, 2024-09-12T16:16:19.936 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016371789000000001, 2024-09-12T16:16:19.936 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.936 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.936 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.937 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.937 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.937 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.937 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14825 2024-09-12T16:16:19.937 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.937 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.937 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.937 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.937 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687780+0000", 2024-09-12T16:16:19.937 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.937 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.937 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.937 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.937 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687780+0000", 2024-09-12T16:16:19.937 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.938 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.938 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.938 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.938 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687780+0000", 2024-09-12T16:16:19.938 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6100000000000002e-07 2024-09-12T16:16:19.938 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.938 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.938 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.938 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687781+0000", 2024-09-12T16:16:19.938 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.082e-06 2024-09-12T16:16:19.938 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.938 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.938 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.938 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687784+0000", 2024-09-12T16:16:19.938 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0900000000000001e-06 2024-09-12T16:16:19.939 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.939 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.939 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.939 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687787+0000", 2024-09-12T16:16:19.939 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6280000000000001e-06 2024-09-12T16:16:19.939 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.939 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.939 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.939 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.939 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.939 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14857 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.939 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.688362+0000", 2024-09-12T16:16:19.939 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013903074, 2024-09-12T16:16:19.939 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015814766000000001, 2024-09-12T16:16:19.939 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.939 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.940 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.940 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.940 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.940 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.940 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14857 2024-09-12T16:16:19.940 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.940 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.940 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.940 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.940 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688362+0000", 2024-09-12T16:16:19.940 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.940 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.940 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.940 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.941 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688362+0000", 2024-09-12T16:16:19.941 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.941 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.941 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.941 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.941 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688363+0000", 2024-09-12T16:16:19.941 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.39e-07 2024-09-12T16:16:19.941 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.941 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.941 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.941 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688364+0000", 2024-09-12T16:16:19.941 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4619999999999999e-06 2024-09-12T16:16:19.941 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.941 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.941 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.942 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688371+0000", 2024-09-12T16:16:19.942 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6229999999999999e-06 2024-09-12T16:16:19.942 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.942 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.942 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.942 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688374+0000", 2024-09-12T16:16:19.942 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7099999999999999e-06 2024-09-12T16:16:19.942 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.942 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.942 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.942 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.942 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.942 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14793 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.942 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687240+0000", 2024-09-12T16:16:19.942 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.015025062, 2024-09-12T16:16:19.943 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016969627000000001, 2024-09-12T16:16:19.943 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.943 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.943 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.943 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.943 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.943 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.943 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14793 2024-09-12T16:16:19.943 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.943 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.943 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.943 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.943 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687240+0000", 2024-09-12T16:16:19.943 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.944 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.944 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.944 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.944 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687240+0000", 2024-09-12T16:16:19.944 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.944 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.944 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.944 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.944 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687241+0000", 2024-09-12T16:16:19.944 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.41e-07 2024-09-12T16:16:19.944 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.944 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.944 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.944 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687242+0000", 2024-09-12T16:16:19.945 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1629999999999999e-06 2024-09-12T16:16:19.945 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.945 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.945 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.945 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687245+0000", 2024-09-12T16:16:19.945 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2279999999999998e-06 2024-09-12T16:16:19.945 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.945 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.945 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.945 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687248+0000", 2024-09-12T16:16:19.945 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5780000000000001e-06 2024-09-12T16:16:19.945 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.945 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.945 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.946 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.946 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.946 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14826 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.946 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687797+0000", 2024-09-12T16:16:19.946 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014468289, 2024-09-12T16:16:19.946 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01645141, 2024-09-12T16:16:19.946 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.946 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.946 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.946 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.946 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.946 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.946 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14826 2024-09-12T16:16:19.946 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.947 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.947 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.947 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.947 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687797+0000", 2024-09-12T16:16:19.947 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.947 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.947 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.947 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.947 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687797+0000", 2024-09-12T16:16:19.947 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.947 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.947 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.947 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.947 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687798+0000", 2024-09-12T16:16:19.948 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5400000000000002e-07 2024-09-12T16:16:19.948 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.948 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.948 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.948 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687799+0000", 2024-09-12T16:16:19.948 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.421e-06 2024-09-12T16:16:19.948 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.948 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.948 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.948 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687806+0000", 2024-09-12T16:16:19.948 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8419999999999999e-06 2024-09-12T16:16:19.948 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.948 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.948 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.949 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687809+0000", 2024-09-12T16:16:19.949 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0199999999999999e-06 2024-09-12T16:16:19.949 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.949 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.949 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.949 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.949 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.949 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14858 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.949 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.688378+0000", 2024-09-12T16:16:19.949 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013887801, 2024-09-12T16:16:19.949 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015895954, 2024-09-12T16:16:19.949 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.949 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.949 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.949 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.950 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.950 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.950 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14858 2024-09-12T16:16:19.950 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.950 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.950 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.950 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.950 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688378+0000", 2024-09-12T16:16:19.950 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.950 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.950 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.950 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.950 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688378+0000", 2024-09-12T16:16:19.951 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.951 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.951 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.951 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.951 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688378+0000", 2024-09-12T16:16:19.951 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3999999999999998e-07 2024-09-12T16:16:19.951 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.951 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.951 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.951 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688379+0000", 2024-09-12T16:16:19.951 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2810000000000001e-06 2024-09-12T16:16:19.951 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.951 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.951 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.952 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688382+0000", 2024-09-12T16:16:19.952 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1530000000000001e-06 2024-09-12T16:16:19.952 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.952 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.952 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.952 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688385+0000", 2024-09-12T16:16:19.952 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.531e-06 2024-09-12T16:16:19.952 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.952 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.952 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.952 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.952 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.952 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14794 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.952 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687251+0000", 2024-09-12T16:16:19.952 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.015014827, 2024-09-12T16:16:19.953 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017045650999999998, 2024-09-12T16:16:19.953 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.953 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.953 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.953 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.953 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.953 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.953 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14794 2024-09-12T16:16:19.953 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.953 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.953 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.953 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.953 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687251+0000", 2024-09-12T16:16:19.953 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.953 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.954 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.954 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.954 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687251+0000", 2024-09-12T16:16:19.954 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.954 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.954 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.954 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.954 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687251+0000", 2024-09-12T16:16:19.954 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.23e-07 2024-09-12T16:16:19.954 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.954 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.954 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.954 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687252+0000", 2024-09-12T16:16:19.954 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0759999999999999e-06 2024-09-12T16:16:19.955 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.955 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.955 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.955 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687255+0000", 2024-09-12T16:16:19.955 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.92e-06 2024-09-12T16:16:19.955 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.955 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.955 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.955 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687258+0000", 2024-09-12T16:16:19.955 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6089999999999999e-06 2024-09-12T16:16:19.955 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.955 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.955 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.955 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.956 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.956 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14827 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.956 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687812+0000", 2024-09-12T16:16:19.956 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014453161000000001, 2024-09-12T16:16:19.956 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016520834000000002, 2024-09-12T16:16:19.956 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.956 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.956 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.956 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.956 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.956 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.956 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14827 2024-09-12T16:16:19.956 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.956 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.957 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.957 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.957 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687812+0000", 2024-09-12T16:16:19.957 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.957 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.957 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.957 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.957 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687812+0000", 2024-09-12T16:16:19.957 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.957 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.957 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.957 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.957 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687813+0000", 2024-09-12T16:16:19.958 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3799999999999999e-07 2024-09-12T16:16:19.958 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.958 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.958 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.958 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687814+0000", 2024-09-12T16:16:19.958 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3209999999999999e-06 2024-09-12T16:16:19.958 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.958 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.958 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.958 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687817+0000", 2024-09-12T16:16:19.958 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.208e-06 2024-09-12T16:16:19.958 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.958 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.958 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.959 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687821+0000", 2024-09-12T16:16:19.959 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4300000000000002e-06 2024-09-12T16:16:19.959 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.959 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.959 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.959 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.959 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.959 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14859 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.959 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.688406+0000", 2024-09-12T16:16:19.959 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013859925, 2024-09-12T16:16:19.959 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015951993000000001, 2024-09-12T16:16:19.959 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.959 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.959 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.960 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.960 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.960 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.960 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14859 2024-09-12T16:16:19.960 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.960 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.960 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.960 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.960 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688406+0000", 2024-09-12T16:16:19.960 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.960 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.960 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.960 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.960 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688406+0000", 2024-09-12T16:16:19.961 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.961 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.961 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.961 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.961 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688406+0000", 2024-09-12T16:16:19.961 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2500000000000001e-07 2024-09-12T16:16:19.961 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.961 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.961 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.961 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688407+0000", 2024-09-12T16:16:19.961 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4589999999999999e-06 2024-09-12T16:16:19.961 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.961 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.961 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.962 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688412+0000", 2024-09-12T16:16:19.962 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5090000000000004e-06 2024-09-12T16:16:19.962 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.962 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.962 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.962 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688415+0000", 2024-09-12T16:16:19.962 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.678e-06 2024-09-12T16:16:19.962 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.962 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.962 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.962 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.962 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.962 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14795 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.962 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687272+0000", 2024-09-12T16:16:19.963 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014993151999999999, 2024-09-12T16:16:19.963 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017108153000000001, 2024-09-12T16:16:19.963 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.963 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.963 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.963 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.963 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.963 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.963 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14795 2024-09-12T16:16:19.963 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.963 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.963 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.963 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.963 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687272+0000", 2024-09-12T16:16:19.963 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.964 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.964 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.964 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.964 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687272+0000", 2024-09-12T16:16:19.964 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.964 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.964 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.964 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.964 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687273+0000", 2024-09-12T16:16:19.964 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0900000000000002e-07 2024-09-12T16:16:19.964 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.964 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.964 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.964 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687274+0000", 2024-09-12T16:16:19.965 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5090000000000001e-06 2024-09-12T16:16:19.965 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.965 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.965 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.965 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687279+0000", 2024-09-12T16:16:19.965 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5920000000000002e-06 2024-09-12T16:16:19.965 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.965 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.965 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.965 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687282+0000", 2024-09-12T16:16:19.965 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6910000000000002e-06 2024-09-12T16:16:19.965 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.965 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.965 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.965 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.966 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.966 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14828 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.966 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687841+0000", 2024-09-12T16:16:19.966 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014424396000000001, 2024-09-12T16:16:19.966 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016562332999999999, 2024-09-12T16:16:19.966 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.966 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.966 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.966 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.966 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.966 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.966 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14828 2024-09-12T16:16:19.966 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.966 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.966 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.967 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.967 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687841+0000", 2024-09-12T16:16:19.967 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.967 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.967 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.967 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.967 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687841+0000", 2024-09-12T16:16:19.967 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.967 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.967 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.967 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.967 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687841+0000", 2024-09-12T16:16:19.967 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2099999999999998e-07 2024-09-12T16:16:19.968 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.968 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.968 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.968 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687845+0000", 2024-09-12T16:16:19.968 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4240000000000002e-06 2024-09-12T16:16:19.968 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.968 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.968 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.968 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687849+0000", 2024-09-12T16:16:19.968 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.065e-06 2024-09-12T16:16:19.968 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.968 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.968 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.969 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687853+0000", 2024-09-12T16:16:19.969 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7929999999999999e-06 2024-09-12T16:16:19.969 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.969 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.969 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.969 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.969 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.969 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14860 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.969 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.688418+0000", 2024-09-12T16:16:19.969 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013847610999999999, 2024-09-12T16:16:19.969 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016008703999999999, 2024-09-12T16:16:19.969 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.969 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.970 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.970 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.970 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.970 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.970 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14860 2024-09-12T16:16:19.970 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.970 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.970 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.970 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.970 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688418+0000", 2024-09-12T16:16:19.970 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.970 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.970 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.970 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.970 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688418+0000", 2024-09-12T16:16:19.971 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.971 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.971 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.971 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.971 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688418+0000", 2024-09-12T16:16:19.971 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0800000000000001e-07 2024-09-12T16:16:19.971 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.971 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.971 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.971 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688419+0000", 2024-09-12T16:16:19.971 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1820000000000001e-06 2024-09-12T16:16:19.971 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.971 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.971 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.972 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688422+0000", 2024-09-12T16:16:19.972 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.083e-06 2024-09-12T16:16:19.972 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.972 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.972 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.972 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688425+0000", 2024-09-12T16:16:19.972 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6110000000000001e-06 2024-09-12T16:16:19.972 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.972 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.972 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.972 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.972 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.972 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14796 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.972 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687285+0000", 2024-09-12T16:16:19.972 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014980369, 2024-09-12T16:16:19.973 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017166238, 2024-09-12T16:16:19.973 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.973 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.973 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.973 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.973 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.973 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.973 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14796 2024-09-12T16:16:19.973 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.973 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.973 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.973 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.973 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687285+0000", 2024-09-12T16:16:19.973 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.974 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.974 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.974 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.974 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687285+0000", 2024-09-12T16:16:19.974 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.974 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.974 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.974 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.974 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687285+0000", 2024-09-12T16:16:19.974 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1500000000000001e-07 2024-09-12T16:16:19.974 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.974 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.974 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.975 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687287+0000", 2024-09-12T16:16:19.975 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1119999999999999e-06 2024-09-12T16:16:19.975 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.975 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.975 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.975 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687290+0000", 2024-09-12T16:16:19.975 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0290000000000001e-06 2024-09-12T16:16:19.975 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.975 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.975 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.975 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687292+0000", 2024-09-12T16:16:19.975 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.694e-06 2024-09-12T16:16:19.975 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.975 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.976 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.976 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.976 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.976 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14829 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.976 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687857+0000", 2024-09-12T16:16:19.976 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014409039, 2024-09-12T16:16:19.976 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016618006000000001, 2024-09-12T16:16:19.976 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.976 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.976 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.976 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.976 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.976 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.976 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14829 2024-09-12T16:16:19.976 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.977 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.977 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.977 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.977 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687857+0000", 2024-09-12T16:16:19.977 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.977 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.977 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.977 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.977 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687857+0000", 2024-09-12T16:16:19.977 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.977 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.977 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.977 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.977 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687857+0000", 2024-09-12T16:16:19.977 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4400000000000001e-07 2024-09-12T16:16:19.978 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.978 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.978 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.978 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687858+0000", 2024-09-12T16:16:19.978 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.08e-06 2024-09-12T16:16:19.978 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.978 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.978 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.978 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687861+0000", 2024-09-12T16:16:19.978 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0130000000000002e-06 2024-09-12T16:16:19.978 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.978 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.978 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.978 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687864+0000", 2024-09-12T16:16:19.978 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6469999999999998e-06 2024-09-12T16:16:19.979 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.979 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.979 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.979 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.979 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.979 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14861 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.979 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.688447+0000", 2024-09-12T16:16:19.979 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013818565, 2024-09-12T16:16:19.979 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016050482000000001, 2024-09-12T16:16:19.979 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.979 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.979 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.979 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.979 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.979 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.980 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14861 2024-09-12T16:16:19.980 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.980 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.980 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.980 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.980 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688447+0000", 2024-09-12T16:16:19.980 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.980 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.980 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.980 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.980 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688447+0000", 2024-09-12T16:16:19.980 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.980 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.980 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.980 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.981 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688447+0000", 2024-09-12T16:16:19.981 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6800000000000001e-07 2024-09-12T16:16:19.981 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.981 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.981 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.981 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688449+0000", 2024-09-12T16:16:19.981 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4640000000000001e-06 2024-09-12T16:16:19.981 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.981 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.981 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.981 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688456+0000", 2024-09-12T16:16:19.981 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6760000000000001e-06 2024-09-12T16:16:19.981 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.981 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.982 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.982 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688458+0000", 2024-09-12T16:16:19.982 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7889999999999999e-06 2024-09-12T16:16:19.982 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.982 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.982 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.982 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.982 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.982 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14797 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.982 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687295+0000", 2024-09-12T16:16:19.982 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014970181000000001, 2024-09-12T16:16:19.982 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017225035, 2024-09-12T16:16:19.982 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.982 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.982 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.982 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.983 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.983 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.983 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14797 2024-09-12T16:16:19.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.983 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.983 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.983 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.983 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687295+0000", 2024-09-12T16:16:19.983 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.983 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.983 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.983 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687295+0000", 2024-09-12T16:16:19.984 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.984 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.984 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.984 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.984 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687296+0000", 2024-09-12T16:16:19.984 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.17e-07 2024-09-12T16:16:19.984 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.984 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.984 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.984 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687297+0000", 2024-09-12T16:16:19.984 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0809999999999999e-06 2024-09-12T16:16:19.984 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.984 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.984 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.985 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687300+0000", 2024-09-12T16:16:19.985 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0730000000000001e-06 2024-09-12T16:16:19.985 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.985 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.985 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.985 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687302+0000", 2024-09-12T16:16:19.985 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.65e-06 2024-09-12T16:16:19.985 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.985 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.985 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.985 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.985 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.985 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14830 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.986 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687867+0000", 2024-09-12T16:16:19.986 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014398815000000001, 2024-09-12T16:16:19.986 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016690104000000001, 2024-09-12T16:16:19.986 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.986 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.986 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.986 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.986 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.986 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.986 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14830 2024-09-12T16:16:19.986 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.986 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.986 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.987 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.987 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687867+0000", 2024-09-12T16:16:19.987 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.987 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.987 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.987 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.987 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687867+0000", 2024-09-12T16:16:19.987 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.987 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.987 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.987 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.987 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687867+0000", 2024-09-12T16:16:19.987 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.35e-07 2024-09-12T16:16:19.987 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.987 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.988 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.988 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687868+0000", 2024-09-12T16:16:19.988 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.95e-07 2024-09-12T16:16:19.988 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.988 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.988 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.988 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687871+0000", 2024-09-12T16:16:19.988 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9340000000000002e-06 2024-09-12T16:16:19.988 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.988 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.988 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.988 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687873+0000", 2024-09-12T16:16:19.988 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.435e-06 2024-09-12T16:16:19.988 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.989 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.989 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.989 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.989 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.989 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14862 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.989 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.688462+0000", 2024-09-12T16:16:19.989 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013803698, 2024-09-12T16:16:19.989 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016120323999999998, 2024-09-12T16:16:19.989 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.989 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.989 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.989 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.989 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.989 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.989 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14862 2024-09-12T16:16:19.990 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.990 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.990 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.990 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.990 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688462+0000", 2024-09-12T16:16:19.990 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.990 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.990 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.990 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.990 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688462+0000", 2024-09-12T16:16:19.990 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.990 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.990 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.991 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.991 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688462+0000", 2024-09-12T16:16:19.991 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.36e-07 2024-09-12T16:16:19.991 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.991 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.991 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.991 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688463+0000", 2024-09-12T16:16:19.991 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3549999999999999e-06 2024-09-12T16:16:19.991 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.991 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.991 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.991 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688467+0000", 2024-09-12T16:16:19.991 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1590000000000002e-06 2024-09-12T16:16:19.991 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.991 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.992 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.992 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.688469+0000", 2024-09-12T16:16:19.992 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7149999999999998e-06 2024-09-12T16:16:19.992 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.992 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.992 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.992 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.992 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.992 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14798 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.992 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687327+0000", 2024-09-12T16:16:19.992 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014938211, 2024-09-12T16:16:19.992 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017281938, 2024-09-12T16:16:19.992 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.992 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.992 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.993 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.993 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.993 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.993 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14798 2024-09-12T16:16:19.993 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.993 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.993 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.993 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.993 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687327+0000", 2024-09-12T16:16:19.993 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.993 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.993 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.993 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.993 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687327+0000", 2024-09-12T16:16:19.994 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.994 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.994 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.994 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.994 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687328+0000", 2024-09-12T16:16:19.994 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8799999999999998e-07 2024-09-12T16:16:19.994 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.994 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.994 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.994 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687329+0000", 2024-09-12T16:16:19.994 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4640000000000001e-06 2024-09-12T16:16:19.994 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.995 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.995 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.995 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687336+0000", 2024-09-12T16:16:19.995 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9e-06 2024-09-12T16:16:19.995 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.995 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.995 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.995 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687339+0000", 2024-09-12T16:16:19.995 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7470000000000001e-06 2024-09-12T16:16:19.995 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.995 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.995 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.995 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.996 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.996 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14831 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.996 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687883+0000", 2024-09-12T16:16:19.996 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014382481000000001, 2024-09-12T16:16:19.996 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016748688000000001, 2024-09-12T16:16:19.996 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.996 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.996 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.996 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.996 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.996 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.996 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14831 2024-09-12T16:16:19.996 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.996 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:19.996 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.997 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:19.997 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687883+0000", 2024-09-12T16:16:19.997 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.997 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.997 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.997 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:19.997 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687883+0000", 2024-09-12T16:16:19.997 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:19.997 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.997 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.997 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:19.997 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687883+0000", 2024-09-12T16:16:19.997 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7099999999999998e-07 2024-09-12T16:16:19.997 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.997 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.998 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:19.998 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687885+0000", 2024-09-12T16:16:19.998 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3480000000000001e-06 2024-09-12T16:16:19.998 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.998 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.998 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:19.998 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687891+0000", 2024-09-12T16:16:19.998 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7819999999999996e-06 2024-09-12T16:16:19.998 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.998 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.998 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:19.998 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687895+0000", 2024-09-12T16:16:19.998 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0879999999999999e-06 2024-09-12T16:16:19.998 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.998 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:19.998 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:19.999 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:19.999 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:19.999 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14799 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:19.999 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687342+0000", 2024-09-12T16:16:19.999 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014923133999999999, 2024-09-12T16:16:19.999 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017314725999999999, 2024-09-12T16:16:19.999 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:19.999 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:19.999 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:19.999 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:19.999 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:19.999 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:19.999 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14799 2024-09-12T16:16:19.999 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.000 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:20.000 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.000 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:20.000 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687342+0000", 2024-09-12T16:16:20.000 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.000 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.000 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.000 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:20.000 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687342+0000", 2024-09-12T16:16:20.000 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.000 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.000 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.000 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:20.000 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687343+0000", 2024-09-12T16:16:20.001 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2999999999999999e-07 2024-09-12T16:16:20.001 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.001 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.001 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:20.001 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687344+0000", 2024-09-12T16:16:20.001 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1829999999999999e-06 2024-09-12T16:16:20.001 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.001 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.001 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:20.001 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687347+0000", 2024-09-12T16:16:20.001 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.179e-06 2024-09-12T16:16:20.001 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.001 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.001 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.002 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687350+0000", 2024-09-12T16:16:20.002 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7319999999999998e-06 2024-09-12T16:16:20.002 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.002 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:20.002 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.002 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.002 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.002 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14832 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.002 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687898+0000", 2024-09-12T16:16:20.002 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014367323, 2024-09-12T16:16:20.002 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016792853999999999, 2024-09-12T16:16:20.002 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:20.002 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:20.002 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:20.002 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:20.003 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:20.003 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.003 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14832 2024-09-12T16:16:20.003 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.003 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:20.003 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.003 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:20.003 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687898+0000", 2024-09-12T16:16:20.003 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.003 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.003 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.003 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:20.003 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687898+0000", 2024-09-12T16:16:20.003 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.003 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.004 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.004 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:20.004 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687898+0000", 2024-09-12T16:16:20.004 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5899999999999998e-07 2024-09-12T16:16:20.004 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.004 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.004 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:20.004 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687900+0000", 2024-09-12T16:16:20.004 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1880000000000001e-06 2024-09-12T16:16:20.004 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.004 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.004 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:20.004 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687903+0000", 2024-09-12T16:16:20.004 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.145e-06 2024-09-12T16:16:20.004 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.005 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.005 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.005 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687906+0000", 2024-09-12T16:16:20.005 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7779999999999999e-06 2024-09-12T16:16:20.005 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.005 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:20.005 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.005 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.005 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.005 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14800 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.005 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687371+0000", 2024-09-12T16:16:20.005 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014894262, 2024-09-12T16:16:20.005 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017343026000000001, 2024-09-12T16:16:20.005 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:20.005 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:20.006 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:20.006 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:20.006 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:20.006 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.006 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14800 2024-09-12T16:16:20.006 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.006 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:20.006 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.006 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:20.006 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687371+0000", 2024-09-12T16:16:20.006 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.006 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.006 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.007 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:20.007 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687371+0000", 2024-09-12T16:16:20.007 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.007 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.007 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.007 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:20.007 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687372+0000", 2024-09-12T16:16:20.007 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2800000000000002e-07 2024-09-12T16:16:20.007 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.007 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.007 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:20.007 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687373+0000", 2024-09-12T16:16:20.007 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.435e-06 2024-09-12T16:16:20.007 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.007 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.007 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:20.008 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687378+0000", 2024-09-12T16:16:20.008 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4680000000000003e-06 2024-09-12T16:16:20.008 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.008 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.008 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.008 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687380+0000", 2024-09-12T16:16:20.008 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6469999999999998e-06 2024-09-12T16:16:20.008 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.008 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:20.008 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.008 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.008 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.009 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14833 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.009 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.687928+0000", 2024-09-12T16:16:20.009 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014338047, 2024-09-12T16:16:20.009 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016809614, 2024-09-12T16:16:20.009 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:20.009 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:20.009 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:20.009 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:20.009 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:20.009 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.009 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14833 2024-09-12T16:16:20.009 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.009 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:20.010 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.010 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:20.010 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687928+0000", 2024-09-12T16:16:20.010 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.010 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.010 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.010 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:20.010 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687928+0000", 2024-09-12T16:16:20.010 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.010 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.010 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.010 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:20.010 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687928+0000", 2024-09-12T16:16:20.010 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7000000000000001e-07 2024-09-12T16:16:20.010 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.011 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.011 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:20.011 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687929+0000", 2024-09-12T16:16:20.011 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3999999999999999e-06 2024-09-12T16:16:20.011 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.011 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.011 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:20.011 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687933+0000", 2024-09-12T16:16:20.011 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3620000000000002e-06 2024-09-12T16:16:20.011 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.011 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.011 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.011 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.687935+0000", 2024-09-12T16:16:20.011 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6979999999999998e-06 2024-09-12T16:16:20.011 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.012 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:20.012 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.012 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.012 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-12T16:16:20.012 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 93 2024-09-12T16:16:20.012 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:20.014 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:16:20.014 INFO:teuthology.orchestra.run.smithi204.stdout:1065 write 0x661b800 thru 0x6627347 (0xbb48 bytes) 2024-09-12T16:16:20.014 INFO:teuthology.orchestra.run.smithi204.stdout:1066 write 0xc377200 thru 0xc3810c0 (0x9ec1 bytes) 2024-09-12T16:16:20.014 INFO:teuthology.orchestra.run.smithi204.stdout:1067 punch from 0x93b8c00 to 0x93c6200, (0xd600 bytes) 2024-09-12T16:16:20.014 INFO:teuthology.orchestra.run.smithi204.stdout:1069 write 0xc064000 thru 0xc06c6a0 (0x86a1 bytes) 2024-09-12T16:16:20.014 INFO:teuthology.orchestra.run.smithi204.stdout:1070 punch from 0x25fdc00 to 0x2609e00, (0xc200 bytes) 2024-09-12T16:16:20.015 INFO:teuthology.orchestra.run.smithi204.stdout:1072 write 0x3c56600 thru 0x3c587d3 (0x21d4 bytes) 2024-09-12T16:16:20.015 INFO:teuthology.orchestra.run.smithi204.stdout:1073 punch from 0xaa5e00 to 0xab1600, (0xb800 bytes) 2024-09-12T16:16:20.015 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:20.013+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:20.074 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2024-09-12T16:16:20.131 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:20.130+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:20.179 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:20.179 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:16:20.179 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:16:20.179 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:16:20.179 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:20.188 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:16:20.232 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:20.232+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:20.316 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:20.316 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:16:20.316 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:16:20.316 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:16:20.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.316 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:13486 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 12250112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.316 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.594833+0000", 2024-09-12T16:16:20.316 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.718889153, 2024-09-12T16:16:20.316 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.048943856000000001, 2024-09-12T16:16:20.316 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:20.317 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:20.317 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:20.317 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:20.317 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:20.317 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.317 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 13486 2024-09-12T16:16:20.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.317 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:20.317 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:20.317 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.594833+0000", 2024-09-12T16:16:20.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.318 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:20.318 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.594833+0000", 2024-09-12T16:16:20.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.318 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:20.318 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.594833+0000", 2024-09-12T16:16:20.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.29e-07 2024-09-12T16:16:20.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.318 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:20.319 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.594834+0000", 2024-09-12T16:16:20.319 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.032e-06 2024-09-12T16:16:20.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.319 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.319 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:20.319 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.594838+0000", 2024-09-12T16:16:20.319 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7589999999999999e-06 2024-09-12T16:16:20.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.319 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.319 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.319 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.594841+0000", 2024-09-12T16:16:20.319 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.52e-06 2024-09-12T16:16:20.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.320 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.320 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:20.320 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.643649+0000", 2024-09-12T16:16:20.320 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.048808598000000002 2024-09-12T16:16:20.320 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.320 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.320 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:20.320 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.643694+0000", 2024-09-12T16:16:20.320 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4623999999999998e-05 2024-09-12T16:16:20.320 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.320 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.320 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:20.320 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.643777+0000", 2024-09-12T16:16:20.320 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3094000000000001e-05 2024-09-12T16:16:20.321 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.321 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:20.321 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.321 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.321 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:13487 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 12254208~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.321 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.594844+0000", 2024-09-12T16:16:20.321 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.71887854200000001, 2024-09-12T16:16:20.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.049156696999999999, 2024-09-12T16:16:20.321 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:20.321 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:20.321 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:20.321 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:20.321 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:20.322 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.322 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 13487 2024-09-12T16:16:20.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.322 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:20.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:20.322 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.594844+0000", 2024-09-12T16:16:20.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:20.322 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.594844+0000", 2024-09-12T16:16:20.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.323 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:20.323 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.600303+0000", 2024-09-12T16:16:20.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0054587359999999996 2024-09-12T16:16:20.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.323 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:20.323 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.600308+0000", 2024-09-12T16:16:20.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8130000000000001e-06 2024-09-12T16:16:20.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.323 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:20.323 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.600322+0000", 2024-09-12T16:16:20.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3200000000000001e-05 2024-09-12T16:16:20.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.324 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.324 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.600329+0000", 2024-09-12T16:16:20.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.858e-06 2024-09-12T16:16:20.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.324 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.324 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:20.324 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.643821+0000", 2024-09-12T16:16:20.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.043491067000000001 2024-09-12T16:16:20.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.324 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.324 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:20.324 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.643903+0000", 2024-09-12T16:16:20.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2702999999999997e-05 2024-09-12T16:16:20.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.324 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.325 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:20.325 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.644001+0000", 2024-09-12T16:16:20.325 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7319999999999997e-05 2024-09-12T16:16:20.325 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.325 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:20.325 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.325 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.325 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.325 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:13516 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 12372992~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.325 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.600983+0000", 2024-09-12T16:16:20.325 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.71273899500000004, 2024-09-12T16:16:20.325 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.048806363999999998, 2024-09-12T16:16:20.325 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:20.325 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:20.326 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:20.326 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:20.326 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:20.326 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.326 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 13516 2024-09-12T16:16:20.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.326 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:20.326 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.326 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:20.326 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.600983+0000", 2024-09-12T16:16:20.326 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.326 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.327 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:20.327 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.600983+0000", 2024-09-12T16:16:20.327 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.327 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.327 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.327 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:20.327 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.600984+0000", 2024-09-12T16:16:20.327 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0499999999999999e-07 2024-09-12T16:16:20.327 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.327 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.327 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:20.327 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.600986+0000", 2024-09-12T16:16:20.327 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1210000000000001e-06 2024-09-12T16:16:20.327 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.328 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.328 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:20.328 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.600993+0000", 2024-09-12T16:16:20.328 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2880000000000004e-06 2024-09-12T16:16:20.328 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.328 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.328 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.328 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.600998+0000", 2024-09-12T16:16:20.328 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2460000000000003e-06 2024-09-12T16:16:20.328 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.329 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.329 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:20.329 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.649689+0000", 2024-09-12T16:16:20.329 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.048690781000000002 2024-09-12T16:16:20.329 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.329 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.329 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:20.329 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.649734+0000", 2024-09-12T16:16:20.329 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4279000000000001e-05 2024-09-12T16:16:20.329 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.329 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.329 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:20.329 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.649790+0000", 2024-09-12T16:16:20.329 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6243999999999999e-05 2024-09-12T16:16:20.329 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.330 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:20.330 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.330 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:13517 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 12377088~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.330 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.601005+0000", 2024-09-12T16:16:20.330 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.71271701099999996, 2024-09-12T16:16:20.330 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.049015766000000002, 2024-09-12T16:16:20.330 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:20.330 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:20.330 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:20.330 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:20.330 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:20.330 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.331 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 13517 2024-09-12T16:16:20.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.331 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:20.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:20.331 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.601005+0000", 2024-09-12T16:16:20.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:20.331 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.601005+0000", 2024-09-12T16:16:20.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:20.331 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.601006+0000", 2024-09-12T16:16:20.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6600000000000002e-07 2024-09-12T16:16:20.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:20.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.601008+0000", 2024-09-12T16:16:20.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0439999999999998e-06 2024-09-12T16:16:20.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:20.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.601014+0000", 2024-09-12T16:16:20.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2840000000000003e-06 2024-09-12T16:16:20.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.601019+0000", 2024-09-12T16:16:20.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1510000000000003e-06 2024-09-12T16:16:20.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:20.333 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.649835+0000", 2024-09-12T16:16:20.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.048815378 2024-09-12T16:16:20.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:20.333 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.649927+0000", 2024-09-12T16:16:20.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2738999999999994e-05 2024-09-12T16:16:20.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:20.333 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.650021+0000", 2024-09-12T16:16:20.334 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3803999999999998e-05 2024-09-12T16:16:20.334 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.334 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:20.334 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.334 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.334 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:13518 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 12381184~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.334 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.601026+0000", 2024-09-12T16:16:20.334 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.71269674100000002, 2024-09-12T16:16:20.334 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.049134393999999998, 2024-09-12T16:16:20.334 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:20.334 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:20.334 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:20.334 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:20.334 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:20.335 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.335 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 13518 2024-09-12T16:16:20.335 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.335 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:20.335 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.335 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:20.335 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.601026+0000", 2024-09-12T16:16:20.335 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.335 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.335 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.335 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:20.335 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.601026+0000", 2024-09-12T16:16:20.335 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.335 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.335 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.336 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:20.336 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.601026+0000", 2024-09-12T16:16:20.336 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.46e-07 2024-09-12T16:16:20.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.336 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.336 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:20.336 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.601028+0000", 2024-09-12T16:16:20.336 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0150000000000002e-06 2024-09-12T16:16:20.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.336 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.336 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:20.336 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.601034+0000", 2024-09-12T16:16:20.336 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8930000000000002e-06 2024-09-12T16:16:20.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.336 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.337 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.601039+0000", 2024-09-12T16:16:20.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9649999999999999e-06 2024-09-12T16:16:20.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.337 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:20.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.650057+0000", 2024-09-12T16:16:20.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.049017655 2024-09-12T16:16:20.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.337 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:20.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.650103+0000", 2024-09-12T16:16:20.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6431000000000003e-05 2024-09-12T16:16:20.338 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.338 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.338 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:20.338 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.650160+0000", 2024-09-12T16:16:20.338 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7089000000000002e-05 2024-09-12T16:16:20.338 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.338 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:20.338 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.338 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.338 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.338 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:13519 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 12385280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.338 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.601074+0000", 2024-09-12T16:16:20.338 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.71264844100000002, 2024-09-12T16:16:20.338 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.049319764000000002, 2024-09-12T16:16:20.339 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:20.339 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:20.339 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:20.339 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:20.339 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:20.339 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.339 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 13519 2024-09-12T16:16:20.339 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.339 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:20.339 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.339 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:20.339 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.601074+0000", 2024-09-12T16:16:20.339 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.340 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.340 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:20.340 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.601074+0000", 2024-09-12T16:16:20.340 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.340 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.340 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:20.340 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.601075+0000", 2024-09-12T16:16:20.340 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4900000000000005e-07 2024-09-12T16:16:20.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.340 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.340 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:20.340 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.601078+0000", 2024-09-12T16:16:20.341 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0359999999999998e-06 2024-09-12T16:16:20.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.341 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.341 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:20.341 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.601096+0000", 2024-09-12T16:16:20.341 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8283000000000001e-05 2024-09-12T16:16:20.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.341 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.341 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.341 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.601102+0000", 2024-09-12T16:16:20.341 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7359999999999998e-06 2024-09-12T16:16:20.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.341 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.341 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:20.341 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.650200+0000", 2024-09-12T16:16:20.342 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.049098454999999999 2024-09-12T16:16:20.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.342 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.342 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:20.342 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.650297+0000", 2024-09-12T16:16:20.342 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6487e-05 2024-09-12T16:16:20.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.342 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.342 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:20.342 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.650394+0000", 2024-09-12T16:16:20.342 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6917999999999996e-05 2024-09-12T16:16:20.342 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.342 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:20.342 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.343 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.343 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:13520 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 12389376~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.343 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.601111+0000", 2024-09-12T16:16:20.343 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.71261157399999997, 2024-09-12T16:16:20.343 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.049489254000000003, 2024-09-12T16:16:20.343 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:20.343 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:20.343 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:20.343 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:20.343 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:20.343 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.343 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 13520 2024-09-12T16:16:20.343 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.343 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:20.344 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.344 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:20.344 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.601111+0000", 2024-09-12T16:16:20.344 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.344 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.344 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:20.344 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.601111+0000", 2024-09-12T16:16:20.344 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.344 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.344 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:20.344 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.601111+0000", 2024-09-12T16:16:20.344 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4400000000000001e-07 2024-09-12T16:16:20.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.345 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.345 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:20.345 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.601114+0000", 2024-09-12T16:16:20.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3130000000000001e-06 2024-09-12T16:16:20.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.345 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.345 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:20.345 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.601121+0000", 2024-09-12T16:16:20.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9859999999999997e-06 2024-09-12T16:16:20.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.345 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.345 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.345 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.601125+0000", 2024-09-12T16:16:20.346 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8110000000000002e-06 2024-09-12T16:16:20.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.346 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:20.346 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.650424+0000", 2024-09-12T16:16:20.346 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.049298851999999997 2024-09-12T16:16:20.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.346 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:20.346 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.650507+0000", 2024-09-12T16:16:20.346 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2307999999999999e-05 2024-09-12T16:16:20.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.347 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:20.347 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.650600+0000", 2024-09-12T16:16:20.347 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3540000000000002e-05 2024-09-12T16:16:20.347 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.347 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:20.347 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.347 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.347 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.347 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:13521 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 12393472~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.347 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.601132+0000", 2024-09-12T16:16:20.347 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.712590002, 2024-09-12T16:16:20.347 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.049718447999999998, 2024-09-12T16:16:20.347 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:20.347 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:20.347 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:20.348 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:20.348 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:20.348 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.348 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 13521 2024-09-12T16:16:20.348 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.348 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:20.348 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.348 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:20.348 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.601132+0000", 2024-09-12T16:16:20.348 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.348 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.348 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.348 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:20.348 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.601132+0000", 2024-09-12T16:16:20.348 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.349 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.349 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:20.349 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.601133+0000", 2024-09-12T16:16:20.349 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2e-07 2024-09-12T16:16:20.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.349 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.349 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:20.349 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.601135+0000", 2024-09-12T16:16:20.349 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3029999999999998e-06 2024-09-12T16:16:20.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.349 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.349 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:20.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.601142+0000", 2024-09-12T16:16:20.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9099999999999999e-06 2024-09-12T16:16:20.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.601147+0000", 2024-09-12T16:16:20.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8940000000000001e-06 2024-09-12T16:16:20.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:20.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.650647+0000", 2024-09-12T16:16:20.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.049500447000000003 2024-09-12T16:16:20.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:20.351 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.650743+0000", 2024-09-12T16:16:20.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5734000000000002e-05 2024-09-12T16:16:20.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.351 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:20.351 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.650851+0000", 2024-09-12T16:16:20.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010774 2024-09-12T16:16:20.351 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.351 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:20.351 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.351 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:13522 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 12397568~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.351 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.601154+0000", 2024-09-12T16:16:20.351 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.712568541, 2024-09-12T16:16:20.352 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.049921379000000002, 2024-09-12T16:16:20.352 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:20.352 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:20.352 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:20.352 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:20.352 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:20.352 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.352 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 13522 2024-09-12T16:16:20.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.352 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:20.352 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.352 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:20.352 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.601154+0000", 2024-09-12T16:16:20.353 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.353 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.353 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:20.353 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.601154+0000", 2024-09-12T16:16:20.353 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.353 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.353 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:20.353 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606243+0000", 2024-09-12T16:16:20.353 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050888349999999999 2024-09-12T16:16:20.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.353 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.353 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:20.354 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606247+0000", 2024-09-12T16:16:20.354 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.673e-06 2024-09-12T16:16:20.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.354 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:20.354 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606257+0000", 2024-09-12T16:16:20.354 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6679999999999996e-06 2024-09-12T16:16:20.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.354 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.354 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606262+0000", 2024-09-12T16:16:20.354 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2730000000000002e-06 2024-09-12T16:16:20.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.354 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:20.355 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.650900+0000", 2024-09-12T16:16:20.355 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.044637337999999999 2024-09-12T16:16:20.355 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.355 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.355 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:20.355 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.650981+0000", 2024-09-12T16:16:20.355 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1100000000000006e-05 2024-09-12T16:16:20.355 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.355 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.355 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:20.355 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.651075+0000", 2024-09-12T16:16:20.355 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4492000000000003e-05 2024-09-12T16:16:20.355 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.355 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:20.356 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.356 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.356 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:13548 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 12504064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.356 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.606621+0000", 2024-09-12T16:16:20.356 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.70710170299999997, 2024-09-12T16:16:20.356 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.049014757999999999, 2024-09-12T16:16:20.356 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:20.356 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:20.356 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:20.356 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:20.356 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:20.356 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.356 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 13548 2024-09-12T16:16:20.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.357 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:20.357 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.357 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:20.357 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606621+0000", 2024-09-12T16:16:20.357 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.357 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.357 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:20.357 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606621+0000", 2024-09-12T16:16:20.357 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.357 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.357 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:20.357 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606621+0000", 2024-09-12T16:16:20.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2099999999999998e-07 2024-09-12T16:16:20.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.358 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.358 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:20.358 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606623+0000", 2024-09-12T16:16:20.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6130000000000001e-06 2024-09-12T16:16:20.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.358 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.358 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:20.358 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606626+0000", 2024-09-12T16:16:20.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4690000000000002e-06 2024-09-12T16:16:20.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.358 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.358 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.358 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606629+0000", 2024-09-12T16:16:20.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8959999999999999e-06 2024-09-12T16:16:20.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.359 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:20.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.655444+0000", 2024-09-12T16:16:20.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.048815198999999997 2024-09-12T16:16:20.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.359 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:20.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.655541+0000", 2024-09-12T16:16:20.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7152999999999996e-05 2024-09-12T16:16:20.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.359 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:20.360 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.655635+0000", 2024-09-12T16:16:20.360 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4106999999999999e-05 2024-09-12T16:16:20.360 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.360 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:20.360 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.360 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.360 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.360 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:13549 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 12508160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.360 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.606632+0000", 2024-09-12T16:16:20.360 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.70709007499999998, 2024-09-12T16:16:20.360 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.049140040000000003, 2024-09-12T16:16:20.360 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:20.360 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:20.360 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:20.360 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:20.361 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:20.361 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.361 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 13549 2024-09-12T16:16:20.361 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.361 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:20.361 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.361 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:20.361 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606632+0000", 2024-09-12T16:16:20.361 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.361 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.361 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.361 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:20.361 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606632+0000", 2024-09-12T16:16:20.361 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.362 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.362 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.362 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:20.362 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606633+0000", 2024-09-12T16:16:20.362 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.04e-07 2024-09-12T16:16:20.362 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.362 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.362 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:20.362 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606634+0000", 2024-09-12T16:16:20.362 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.195e-06 2024-09-12T16:16:20.362 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.362 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.362 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:20.362 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606637+0000", 2024-09-12T16:16:20.362 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8609999999999998e-06 2024-09-12T16:16:20.362 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.363 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.363 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.363 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606639+0000", 2024-09-12T16:16:20.363 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5129999999999999e-06 2024-09-12T16:16:20.363 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.363 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.363 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:20.363 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.655667+0000", 2024-09-12T16:16:20.363 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.049027460000000002 2024-09-12T16:16:20.363 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.363 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.363 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:20.363 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.655716+0000", 2024-09-12T16:16:20.363 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9005000000000003e-05 2024-09-12T16:16:20.364 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.364 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.364 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:20.364 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.655772+0000", 2024-09-12T16:16:20.364 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6802000000000003e-05 2024-09-12T16:16:20.364 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.364 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:20.364 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.364 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.364 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.364 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:13550 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 12512256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.364 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.606642+0000", 2024-09-12T16:16:20.364 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.70708035599999997, 2024-09-12T16:16:20.364 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.049346474000000001, 2024-09-12T16:16:20.365 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:20.365 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:20.365 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:20.365 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:20.365 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:20.365 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.365 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 13550 2024-09-12T16:16:20.365 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.365 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:20.365 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.365 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:20.365 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606642+0000", 2024-09-12T16:16:20.365 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.365 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.365 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.366 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:20.366 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606642+0000", 2024-09-12T16:16:20.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.366 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.366 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:20.366 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606642+0000", 2024-09-12T16:16:20.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.05e-07 2024-09-12T16:16:20.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.366 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.366 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:20.366 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606643+0000", 2024-09-12T16:16:20.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1310000000000001e-06 2024-09-12T16:16:20.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.367 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.367 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:20.367 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606646+0000", 2024-09-12T16:16:20.367 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8480000000000001e-06 2024-09-12T16:16:20.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.367 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.367 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.367 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606649+0000", 2024-09-12T16:16:20.367 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4849999999999999e-06 2024-09-12T16:16:20.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.367 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.367 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:20.367 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.655814+0000", 2024-09-12T16:16:20.367 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.049165340000000002 2024-09-12T16:16:20.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.368 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.368 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:20.368 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.655886+0000", 2024-09-12T16:16:20.368 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1958999999999993e-05 2024-09-12T16:16:20.368 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.368 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.368 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:20.368 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.655989+0000", 2024-09-12T16:16:20.368 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102506 2024-09-12T16:16:20.368 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.368 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:20.368 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.368 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.368 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.369 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:13551 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 12516352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.369 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.606652+0000", 2024-09-12T16:16:20.369 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.70707079699999997, 2024-09-12T16:16:20.369 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.049477341000000001, 2024-09-12T16:16:20.369 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:20.369 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:20.369 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:20.369 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:20.369 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:20.369 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.369 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 13551 2024-09-12T16:16:20.369 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.369 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:20.370 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.370 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:20.370 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606652+0000", 2024-09-12T16:16:20.370 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.370 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.370 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:20.370 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606652+0000", 2024-09-12T16:16:20.370 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.370 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.370 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:20.370 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606652+0000", 2024-09-12T16:16:20.370 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1400000000000001e-07 2024-09-12T16:16:20.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.371 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.371 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:20.371 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606655+0000", 2024-09-12T16:16:20.371 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.959e-06 2024-09-12T16:16:20.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.371 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.371 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:20.371 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606658+0000", 2024-09-12T16:16:20.371 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0010000000000002e-06 2024-09-12T16:16:20.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.371 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.371 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.371 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606660+0000", 2024-09-12T16:16:20.372 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.571e-06 2024-09-12T16:16:20.372 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.372 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.372 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:20.372 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.656022+0000", 2024-09-12T16:16:20.372 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.049361611999999999 2024-09-12T16:16:20.372 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.372 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.372 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:20.372 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.656071+0000", 2024-09-12T16:16:20.372 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8797000000000001e-05 2024-09-12T16:16:20.372 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.372 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.372 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:20.373 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.656129+0000", 2024-09-12T16:16:20.373 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8186999999999997e-05 2024-09-12T16:16:20.373 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.373 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:20.373 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.373 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.373 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.373 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:13552 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 12520448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.373 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.606663+0000", 2024-09-12T16:16:20.373 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.70705892699999995, 2024-09-12T16:16:20.373 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.049605269, 2024-09-12T16:16:20.373 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:20.373 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:20.374 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:20.374 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:20.374 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:20.374 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.374 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 13552 2024-09-12T16:16:20.374 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.374 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:20.374 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.374 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:20.374 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606663+0000", 2024-09-12T16:16:20.374 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.374 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.374 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.374 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:20.375 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606663+0000", 2024-09-12T16:16:20.375 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.375 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.375 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.375 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:20.375 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606664+0000", 2024-09-12T16:16:20.375 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:16:20.375 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.375 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.375 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:20.375 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606665+0000", 2024-09-12T16:16:20.375 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.032e-06 2024-09-12T16:16:20.375 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.375 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.376 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:20.376 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606668+0000", 2024-09-12T16:16:20.376 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8779999999999998e-06 2024-09-12T16:16:20.376 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.376 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.376 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.376 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606670+0000", 2024-09-12T16:16:20.376 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4789999999999999e-06 2024-09-12T16:16:20.376 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.376 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.376 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:20.376 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.656161+0000", 2024-09-12T16:16:20.376 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.049491399999999998 2024-09-12T16:16:20.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.377 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.377 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:20.377 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.656204+0000", 2024-09-12T16:16:20.377 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2381e-05 2024-09-12T16:16:20.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.377 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.377 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:20.377 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.656269+0000", 2024-09-12T16:16:20.377 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4887000000000004e-05 2024-09-12T16:16:20.377 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.377 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:20.377 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.378 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.378 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:13553 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 12524544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.378 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.606673+0000", 2024-09-12T16:16:20.378 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.70704931000000004, 2024-09-12T16:16:20.378 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.049844856, 2024-09-12T16:16:20.378 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:20.378 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:20.378 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:20.378 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:20.378 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:20.378 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.378 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 13553 2024-09-12T16:16:20.378 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.378 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:20.379 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.379 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:20.379 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606673+0000", 2024-09-12T16:16:20.379 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.379 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.379 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.379 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:20.379 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606673+0000", 2024-09-12T16:16:20.379 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.379 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.379 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.379 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:20.379 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606673+0000", 2024-09-12T16:16:20.379 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4699999999999998e-07 2024-09-12T16:16:20.379 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.380 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.380 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:20.380 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606674+0000", 2024-09-12T16:16:20.380 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.091e-06 2024-09-12T16:16:20.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.380 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.380 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:20.380 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606677+0000", 2024-09-12T16:16:20.380 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.886e-06 2024-09-12T16:16:20.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.380 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.380 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.380 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606680+0000", 2024-09-12T16:16:20.380 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.43e-06 2024-09-12T16:16:20.381 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.381 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.381 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:20.381 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.656318+0000", 2024-09-12T16:16:20.381 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.049638005999999998 2024-09-12T16:16:20.381 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.381 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.381 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:20.381 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.656409+0000", 2024-09-12T16:16:20.381 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1502000000000006e-05 2024-09-12T16:16:20.381 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.381 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.381 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:20.381 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.656518+0000", 2024-09-12T16:16:20.382 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000108694 2024-09-12T16:16:20.382 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.382 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:20.382 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.382 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.382 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.382 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:13554 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 12528640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.382 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.606683+0000", 2024-09-12T16:16:20.382 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.70703967099999998, 2024-09-12T16:16:20.382 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.049975384999999997, 2024-09-12T16:16:20.382 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:20.382 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:20.382 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:20.382 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:20.382 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:20.382 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.383 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 13554 2024-09-12T16:16:20.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.383 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:20.383 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.383 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:20.383 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606683+0000", 2024-09-12T16:16:20.383 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.383 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.383 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:20.383 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.606683+0000", 2024-09-12T16:16:20.383 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.383 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.384 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:20.384 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.609975+0000", 2024-09-12T16:16:20.384 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0032919059999999998 2024-09-12T16:16:20.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.384 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:20.384 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.609983+0000", 2024-09-12T16:16:20.384 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8370000000000003e-06 2024-09-12T16:16:20.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.384 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:20.384 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.609999+0000", 2024-09-12T16:16:20.385 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5216e-05 2024-09-12T16:16:20.385 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.385 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.385 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.385 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.610006+0000", 2024-09-12T16:16:20.385 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1069999999999999e-06 2024-09-12T16:16:20.385 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.385 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.385 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:20.385 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.656554+0000", 2024-09-12T16:16:20.385 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.046548586000000003 2024-09-12T16:16:20.385 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.385 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.385 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:20.386 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.656600+0000", 2024-09-12T16:16:20.386 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5776999999999999e-05 2024-09-12T16:16:20.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.386 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.386 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:20.386 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.656658+0000", 2024-09-12T16:16:20.386 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7955999999999999e-05 2024-09-12T16:16:20.386 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.386 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:20.386 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.386 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.386 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:13566 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 12577792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.386 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.610164+0000", 2024-09-12T16:16:20.387 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.70355862800000002, 2024-09-12T16:16:20.387 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.048880538000000001, 2024-09-12T16:16:20.387 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:20.387 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:20.387 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:20.387 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:20.387 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:20.387 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.387 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 13566 2024-09-12T16:16:20.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.387 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:20.387 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.387 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:20.387 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.610164+0000", 2024-09-12T16:16:20.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.388 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:20.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.610164+0000", 2024-09-12T16:16:20.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.388 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:20.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.610164+0000", 2024-09-12T16:16:20.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.04e-07 2024-09-12T16:16:20.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.388 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:20.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.610169+0000", 2024-09-12T16:16:20.389 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7890000000000002e-06 2024-09-12T16:16:20.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.389 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.389 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:20.389 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.610172+0000", 2024-09-12T16:16:20.389 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2559999999999998e-06 2024-09-12T16:16:20.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.389 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.389 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.389 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.610175+0000", 2024-09-12T16:16:20.389 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.531e-06 2024-09-12T16:16:20.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.389 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.389 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:20.389 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.658869+0000", 2024-09-12T16:16:20.390 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.048694226 2024-09-12T16:16:20.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.390 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.390 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:20.390 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.658953+0000", 2024-09-12T16:16:20.390 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3813999999999994e-05 2024-09-12T16:16:20.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.390 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.390 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:20.390 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.659044+0000", 2024-09-12T16:16:20.390 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1718000000000005e-05 2024-09-12T16:16:20.390 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.390 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:20.390 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.391 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.391 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:13567 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 12581888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.391 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.610178+0000", 2024-09-12T16:16:20.391 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.70354451500000004, 2024-09-12T16:16:20.391 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.049103562000000003, 2024-09-12T16:16:20.391 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:20.391 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:20.391 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:20.391 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:20.391 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:20.391 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.391 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 13567 2024-09-12T16:16:20.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.392 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:20.392 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.392 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:20.392 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.610178+0000", 2024-09-12T16:16:20.392 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.392 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.392 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:20.392 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.610178+0000", 2024-09-12T16:16:20.392 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.392 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.392 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:20.392 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.610178+0000", 2024-09-12T16:16:20.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3900000000000001e-07 2024-09-12T16:16:20.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.393 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:20.393 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.610179+0000", 2024-09-12T16:16:20.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1379999999999999e-06 2024-09-12T16:16:20.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.393 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:20.393 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.610183+0000", 2024-09-12T16:16:20.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6109999999999998e-06 2024-09-12T16:16:20.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.393 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.393 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.610187+0000", 2024-09-12T16:16:20.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2379999999999999e-06 2024-09-12T16:16:20.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:20.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.659087+0000", 2024-09-12T16:16:20.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.048899757000000002 2024-09-12T16:16:20.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:20.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.659173+0000", 2024-09-12T16:16:20.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6547999999999999e-05 2024-09-12T16:16:20.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:20.395 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.659281+0000", 2024-09-12T16:16:20.395 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000108031 2024-09-12T16:16:20.395 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.395 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:20.395 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.395 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.395 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.395 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:13568 3.9 3:9782eddf:::rbd_data.1155c495979c.00000000000002a4:head [set-alloc-hint object_size 262144 write_size 262144,write 79872~13312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.395 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.610193+0000", 2024-09-12T16:16:20.395 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.70352945700000002, 2024-09-12T16:16:20.395 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.051199260000000003, 2024-09-12T16:16:20.395 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:20.395 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:20.395 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:20.396 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:20.396 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:20.396 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.396 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 13568 2024-09-12T16:16:20.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.396 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:20.396 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.396 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:20.396 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.610193+0000", 2024-09-12T16:16:20.396 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.396 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.396 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:20.397 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.610193+0000", 2024-09-12T16:16:20.397 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.397 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.397 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:20.397 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.610193+0000", 2024-09-12T16:16:20.397 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3099999999999998e-07 2024-09-12T16:16:20.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.397 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.397 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:20.397 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.610222+0000", 2024-09-12T16:16:20.397 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8130999999999999e-05 2024-09-12T16:16:20.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.398 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:20.398 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.610229+0000", 2024-09-12T16:16:20.398 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5469999999999999e-06 2024-09-12T16:16:20.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.398 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.398 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.610243+0000", 2024-09-12T16:16:20.398 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4151000000000001e-05 2024-09-12T16:16:20.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.398 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:20.398 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.659324+0000", 2024-09-12T16:16:20.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.049080708000000001 2024-09-12T16:16:20.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.399 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.399 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:20.399 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.659456+0000", 2024-09-12T16:16:20.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013240499999999999 2024-09-12T16:16:20.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.399 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.399 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T16:16:20.399 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.659615+0000", 2024-09-12T16:16:20.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015876400000000001 2024-09-12T16:16:20.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.399 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.399 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:20.400 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.661263+0000", 2024-09-12T16:16:20.400 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0016480690000000001 2024-09-12T16:16:20.400 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.400 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.400 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:20.400 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.661277+0000", 2024-09-12T16:16:20.400 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3331e-05 2024-09-12T16:16:20.400 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.400 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.400 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:20.400 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.661326+0000", 2024-09-12T16:16:20.400 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9444000000000003e-05 2024-09-12T16:16:20.400 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.401 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.401 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:20.401 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.661392+0000", 2024-09-12T16:16:20.401 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6179000000000005e-05 2024-09-12T16:16:20.401 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.401 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:20.401 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.401 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.401 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14599 3.9 3:9782eddf:::rbd_data.1155c495979c.00000000000002a4:head [read 65536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.401 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.612366+0000", 2024-09-12T16:16:20.401 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.70135650999999999, 2024-09-12T16:16:20.401 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.049241008000000003, 2024-09-12T16:16:20.401 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:20.402 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:20.402 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:20.402 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:20.402 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:20.402 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.402 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14599 2024-09-12T16:16:20.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.402 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:20.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.402 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:20.402 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.612366+0000", 2024-09-12T16:16:20.402 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.403 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.403 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:20.403 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.612366+0000", 2024-09-12T16:16:20.403 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:20.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.403 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.403 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:20.403 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.612367+0000", 2024-09-12T16:16:20.403 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7899999999999998e-07 2024-09-12T16:16:20.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.403 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.403 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:20.403 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.612370+0000", 2024-09-12T16:16:20.403 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9679999999999998e-06 2024-09-12T16:16:20.404 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.404 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.404 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:20.404 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.612377+0000", 2024-09-12T16:16:20.404 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6650000000000003e-06 2024-09-12T16:16:20.404 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.404 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.404 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.404 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.612424+0000", 2024-09-12T16:16:20.404 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7289000000000001e-05 2024-09-12T16:16:20.404 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.404 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.405 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:20.405 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.660264+0000", 2024-09-12T16:16:20.405 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.047839831999999999 2024-09-12T16:16:20.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.405 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.405 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for rw locks", 2024-09-12T16:16:20.405 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.660336+0000", 2024-09-12T16:16:20.405 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1958999999999993e-05 2024-09-12T16:16:20.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.405 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.405 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:20.405 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.661441+0000", 2024-09-12T16:16:20.405 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011045359999999999 2024-09-12T16:16:20.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:20.406 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.661508+0000", 2024-09-12T16:16:20.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7111000000000002e-05 2024-09-12T16:16:20.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:20.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:20.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:20.406 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.661607+0000", 2024-09-12T16:16:20.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8968999999999994e-05 2024-09-12T16:16:20.406 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.406 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:20.406 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.406 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:20.407 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:20.407 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:20.407 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:20.315+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:20.408 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:16:20.409 INFO:teuthology.orchestra.run.smithi204.stdout:1074 write 0xdd49a00 thru 0xdd51f0d (0x850e bytes) 2024-09-12T16:16:20.409 INFO:teuthology.orchestra.run.smithi204.stdout:1076 write 0x6297a00 thru 0x62a297f (0xaf80 bytes) 2024-09-12T16:16:20.409 INFO:teuthology.orchestra.run.smithi204.stdout:1077 trunc from 0xdd52000 to 0x2a99200 2024-09-12T16:16:20.429 INFO:teuthology.orchestra.run.smithi204.stdout:1078 write 0x1595c00 thru 0x159a6fd (0x4afe bytes) 2024-09-12T16:16:20.436 INFO:teuthology.orchestra.run.smithi204.stdout:1083 flatten 2024-09-12T16:16:20.452 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:20.451+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:20.485 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-12T16:16:20.488 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T16:16:20.488 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T16:16:20.517 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:20.517+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:20.519 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:20.519 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:20.519 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:16:20.520 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:20.528 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:16:20.618 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:20.618+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:20.675 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:20.675 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:20.675 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:16:20.675 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:16:20.675 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:20.684 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:16:20.725 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:20.724+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:20.820 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:20.820+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:20.832 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:20.833 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:16:20.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:16:20.833 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:20.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.833 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3703 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14803968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.833 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139513+0000", 2024-09-12T16:16:20.833 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.6917779049999999, 2024-09-12T16:16:20.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053248794000000002, 2024-09-12T16:16:20.833 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:20.833 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:20.833 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:20.833 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:20.834 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:20.834 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.834 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3703 2024-09-12T16:16:20.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.834 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:20.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:20.834 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139513+0000", 2024-09-12T16:16:20.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:20.834 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139513+0000", 2024-09-12T16:16:20.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:20.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139639+0000", 2024-09-12T16:16:20.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012673299999999999 2024-09-12T16:16:20.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:20.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139642+0000", 2024-09-12T16:16:20.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4820000000000001e-06 2024-09-12T16:16:20.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:20.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139647+0000", 2024-09-12T16:16:20.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8040000000000001e-06 2024-09-12T16:16:20.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139650+0000", 2024-09-12T16:16:20.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.529e-06 2024-09-12T16:16:20.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:20.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192537+0000", 2024-09-12T16:16:20.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052886503000000001 2024-09-12T16:16:20.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:20.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192627+0000", 2024-09-12T16:16:20.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0183e-05 2024-09-12T16:16:20.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:20.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192761+0000", 2024-09-12T16:16:20.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013456000000000001 2024-09-12T16:16:20.837 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.837 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:20.837 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.838 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3704 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14808064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.838 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139656+0000", 2024-09-12T16:16:20.838 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.6916339890000001, 2024-09-12T16:16:20.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053247502000000002, 2024-09-12T16:16:20.838 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:20.838 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:20.838 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:20.838 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:20.838 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:20.838 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.838 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3704 2024-09-12T16:16:20.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.839 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:20.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:20.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139656+0000", 2024-09-12T16:16:20.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:20.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139656+0000", 2024-09-12T16:16:20.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:20.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139790+0000", 2024-09-12T16:16:20.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000133471 2024-09-12T16:16:20.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:20.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139792+0000", 2024-09-12T16:16:20.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.968e-06 2024-09-12T16:16:20.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:20.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139796+0000", 2024-09-12T16:16:20.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2660000000000003e-06 2024-09-12T16:16:20.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139799+0000", 2024-09-12T16:16:20.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2839999999999998e-06 2024-09-12T16:16:20.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:20.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192790+0000", 2024-09-12T16:16:20.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052990388999999999 2024-09-12T16:16:20.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:20.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192835+0000", 2024-09-12T16:16:20.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5101000000000001e-05 2024-09-12T16:16:20.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:20.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192904+0000", 2024-09-12T16:16:20.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9023000000000006e-05 2024-09-12T16:16:20.842 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.842 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:20.842 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.842 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3705 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14812160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.842 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:16:20.842 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.691485653, 2024-09-12T16:16:20.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053368831999999998, 2024-09-12T16:16:20.842 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:20.843 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:20.843 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:20.843 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:20.843 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:20.843 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.843 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3705 2024-09-12T16:16:20.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.843 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:20.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:20.843 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:16:20.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:20.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:16:20.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:20.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139932+0000", 2024-09-12T16:16:20.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012762099999999999 2024-09-12T16:16:20.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:20.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139935+0000", 2024-09-12T16:16:20.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.119e-06 2024-09-12T16:16:20.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:20.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139939+0000", 2024-09-12T16:16:20.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7999999999999998e-06 2024-09-12T16:16:20.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139953+0000", 2024-09-12T16:16:20.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3923999999999999e-05 2024-09-12T16:16:20.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:20.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192946+0000", 2024-09-12T16:16:20.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052992971 2024-09-12T16:16:20.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.846 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:20.846 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193035+0000", 2024-09-12T16:16:20.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9040000000000001e-05 2024-09-12T16:16:20.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.846 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:20.846 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193174+0000", 2024-09-12T16:16:20.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138357 2024-09-12T16:16:20.846 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.846 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:20.846 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.847 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3706 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14816256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.847 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:16:20.847 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.691330663, 2024-09-12T16:16:20.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053341723000000001, 2024-09-12T16:16:20.847 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:20.847 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:20.847 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:20.847 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:20.847 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:20.847 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.847 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3706 2024-09-12T16:16:20.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.848 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:20.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:20.848 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:16:20.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:20.848 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:16:20.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:20.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140090+0000", 2024-09-12T16:16:20.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013020100000000001 2024-09-12T16:16:20.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:20.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140097+0000", 2024-09-12T16:16:20.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0709999999999997e-06 2024-09-12T16:16:20.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:20.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140103+0000", 2024-09-12T16:16:20.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5450000000000003e-06 2024-09-12T16:16:20.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140106+0000", 2024-09-12T16:16:20.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3739999999999998e-06 2024-09-12T16:16:20.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:20.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193190+0000", 2024-09-12T16:16:20.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053084131999999999 2024-09-12T16:16:20.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:20.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193232+0000", 2024-09-12T16:16:20.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1517000000000002e-05 2024-09-12T16:16:20.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:20.851 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193302+0000", 2024-09-12T16:16:20.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9882999999999995e-05 2024-09-12T16:16:20.851 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.851 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:20.851 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.851 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3707 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14820352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.851 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:16:20.851 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.6911786740000001, 2024-09-12T16:16:20.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053452771000000003, 2024-09-12T16:16:20.851 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:20.851 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:20.852 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:20.852 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:20.852 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:20.852 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.852 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3707 2024-09-12T16:16:20.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.852 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:20.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:20.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:16:20.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:20.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:16:20.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:20.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140219+0000", 2024-09-12T16:16:20.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106902 2024-09-12T16:16:20.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:20.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140225+0000", 2024-09-12T16:16:20.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3199999999999996e-06 2024-09-12T16:16:20.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:20.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140230+0000", 2024-09-12T16:16:20.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8969999999999999e-06 2024-09-12T16:16:20.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140233+0000", 2024-09-12T16:16:20.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2119999999999999e-06 2024-09-12T16:16:20.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:20.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193339+0000", 2024-09-12T16:16:20.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053105556999999998 2024-09-12T16:16:20.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.855 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:20.855 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193431+0000", 2024-09-12T16:16:20.855 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1837999999999997e-05 2024-09-12T16:16:20.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.855 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:20.855 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193565+0000", 2024-09-12T16:16:20.855 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013404500000000001 2024-09-12T16:16:20.855 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.855 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:20.855 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.856 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3708 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14824448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.856 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:16:20.856 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.691049832, 2024-09-12T16:16:20.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053468190999999998, 2024-09-12T16:16:20.856 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:20.856 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:20.856 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:20.856 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:20.856 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:20.856 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.856 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3708 2024-09-12T16:16:20.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.857 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:20.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:20.857 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:16:20.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:20.857 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:16:20.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:20.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140351+0000", 2024-09-12T16:16:20.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110096 2024-09-12T16:16:20.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:20.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140358+0000", 2024-09-12T16:16:20.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.306e-06 2024-09-12T16:16:20.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:20.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140368+0000", 2024-09-12T16:16:20.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0225e-05 2024-09-12T16:16:20.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.859 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140372+0000", 2024-09-12T16:16:20.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6169999999999998e-06 2024-09-12T16:16:20.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:20.859 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193594+0000", 2024-09-12T16:16:20.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053222419999999999 2024-09-12T16:16:20.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:20.859 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193640+0000", 2024-09-12T16:16:20.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.587e-05 2024-09-12T16:16:20.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.860 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:20.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193709+0000", 2024-09-12T16:16:20.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8657000000000004e-05 2024-09-12T16:16:20.860 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.860 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:20.860 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.860 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3709 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14828544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.860 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:16:20.860 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.690912864, 2024-09-12T16:16:20.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594033999999999, 2024-09-12T16:16:20.861 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:20.861 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:20.861 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:20.861 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:20.861 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:20.861 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.861 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3709 2024-09-12T16:16:20.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.861 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:20.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.861 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:20.861 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:16:20.861 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:20.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:16:20.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:20.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140499+0000", 2024-09-12T16:16:20.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121019 2024-09-12T16:16:20.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:20.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140501+0000", 2024-09-12T16:16:20.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2369999999999999e-06 2024-09-12T16:16:20.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:20.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140506+0000", 2024-09-12T16:16:20.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.639e-06 2024-09-12T16:16:20.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140509+0000", 2024-09-12T16:16:20.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3419999999999999e-06 2024-09-12T16:16:20.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.864 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:20.864 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193743+0000", 2024-09-12T16:16:20.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053234311999999999 2024-09-12T16:16:20.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.864 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:20.864 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193833+0000", 2024-09-12T16:16:20.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9883999999999995e-05 2024-09-12T16:16:20.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.864 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:20.864 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193972+0000", 2024-09-12T16:16:20.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138601 2024-09-12T16:16:20.865 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.865 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:20.865 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.865 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3710 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14832640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.865 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:16:20.865 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.6907755180000001, 2024-09-12T16:16:20.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053607324999999997, 2024-09-12T16:16:20.865 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:20.865 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:20.865 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:20.865 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:20.865 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:20.866 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.866 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3710 2024-09-12T16:16:20.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.866 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:20.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:20.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:16:20.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:20.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:16:20.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:20.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140664+0000", 2024-09-12T16:16:20.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014918700000000001 2024-09-12T16:16:20.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:20.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140674+0000", 2024-09-12T16:16:20.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8379999999999997e-06 2024-09-12T16:16:20.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:20.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140694+0000", 2024-09-12T16:16:20.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0145000000000001e-05 2024-09-12T16:16:20.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.868 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.868 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140703+0000", 2024-09-12T16:16:20.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5150000000000006e-06 2024-09-12T16:16:20.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.868 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:20.868 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194006+0000", 2024-09-12T16:16:20.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053303370000000003 2024-09-12T16:16:20.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.868 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:20.869 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194051+0000", 2024-09-12T16:16:20.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5012000000000002e-05 2024-09-12T16:16:20.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.869 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:20.869 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194122+0000", 2024-09-12T16:16:20.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1258000000000001e-05 2024-09-12T16:16:20.869 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.869 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:20.869 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.869 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3711 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14836736~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.870 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:16:20.870 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.6905740700000003, 2024-09-12T16:16:20.870 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053670799999999998, 2024-09-12T16:16:20.870 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:20.870 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:20.870 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:20.870 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:20.870 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:20.870 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.870 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3711 2024-09-12T16:16:20.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.870 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:20.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:20.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:16:20.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:20.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:16:20.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:20.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140782+0000", 2024-09-12T16:16:20.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5549999999999994e-05 2024-09-12T16:16:20.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:20.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140786+0000", 2024-09-12T16:16:20.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.89e-06 2024-09-12T16:16:20.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:20.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140796+0000", 2024-09-12T16:16:20.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0057e-05 2024-09-12T16:16:20.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140819+0000", 2024-09-12T16:16:20.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3005000000000001e-05 2024-09-12T16:16:20.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:20.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194159+0000", 2024-09-12T16:16:20.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053340324000000001 2024-09-12T16:16:20.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:20.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194248+0000", 2024-09-12T16:16:20.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9209000000000006e-05 2024-09-12T16:16:20.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.874 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:20.874 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194387+0000", 2024-09-12T16:16:20.874 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138765 2024-09-12T16:16:20.874 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.874 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:20.874 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.874 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3712 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14840832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.874 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:16:20.874 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.6904596119999997, 2024-09-12T16:16:20.874 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053699068000000003, 2024-09-12T16:16:20.874 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:20.874 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:20.875 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:20.875 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:20.875 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:20.875 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.875 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3712 2024-09-12T16:16:20.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.875 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:20.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:20.875 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:16:20.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:20.876 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:16:20.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.876 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:20.876 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140900+0000", 2024-09-12T16:16:20.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9014e-05 2024-09-12T16:16:20.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.876 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:20.876 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140904+0000", 2024-09-12T16:16:20.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0940000000000001e-06 2024-09-12T16:16:20.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.877 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:20.877 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140933+0000", 2024-09-12T16:16:20.877 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8996000000000002e-05 2024-09-12T16:16:20.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.877 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.877 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140945+0000", 2024-09-12T16:16:20.877 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1909000000000001e-05 2024-09-12T16:16:20.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.877 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:20.877 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194415+0000", 2024-09-12T16:16:20.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053470403 2024-09-12T16:16:20.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.878 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:20.878 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194460+0000", 2024-09-12T16:16:20.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5145000000000002e-05 2024-09-12T16:16:20.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.878 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:20.878 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194530+0000", 2024-09-12T16:16:20.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9506999999999997e-05 2024-09-12T16:16:20.878 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.878 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:20.878 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.879 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3713 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14844928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.879 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:16:20.879 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.6903265520000001, 2024-09-12T16:16:20.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053821236000000001, 2024-09-12T16:16:20.879 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:20.879 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:20.879 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:20.879 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:20.879 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:20.879 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.879 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3713 2024-09-12T16:16:20.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.880 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:20.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:20.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:16:20.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:20.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:16:20.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:20.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141078+0000", 2024-09-12T16:16:20.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114162 2024-09-12T16:16:20.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.881 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:20.881 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141090+0000", 2024-09-12T16:16:20.881 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.19e-05 2024-09-12T16:16:20.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.881 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:20.881 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141100+0000", 2024-09-12T16:16:20.881 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0447e-05 2024-09-12T16:16:20.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.881 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.882 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141108+0000", 2024-09-12T16:16:20.882 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7190000000000001e-06 2024-09-12T16:16:20.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.882 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:20.882 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194564+0000", 2024-09-12T16:16:20.882 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053455729 2024-09-12T16:16:20.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.882 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:20.882 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194652+0000", 2024-09-12T16:16:20.882 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8288999999999994e-05 2024-09-12T16:16:20.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.882 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:20.883 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194785+0000", 2024-09-12T16:16:20.883 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013299000000000001 2024-09-12T16:16:20.883 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.883 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:20.883 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.883 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3714 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14849024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.883 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:16:20.883 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.6901706230000002, 2024-09-12T16:16:20.883 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053816382000000003, 2024-09-12T16:16:20.883 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:20.883 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:20.884 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:20.884 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:20.884 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:20.884 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.884 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3714 2024-09-12T16:16:20.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.884 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:20.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.884 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:20.884 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:16:20.884 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.885 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:20.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:16:20.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.885 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:20.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141182+0000", 2024-09-12T16:16:20.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1805999999999997e-05 2024-09-12T16:16:20.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.885 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:20.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141185+0000", 2024-09-12T16:16:20.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5930000000000002e-06 2024-09-12T16:16:20.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.886 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:20.886 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141194+0000", 2024-09-12T16:16:20.886 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5760000000000006e-06 2024-09-12T16:16:20.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.886 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.886 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141222+0000", 2024-09-12T16:16:20.886 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8034999999999998e-05 2024-09-12T16:16:20.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.886 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:20.886 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194817+0000", 2024-09-12T16:16:20.886 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594887000000001 2024-09-12T16:16:20.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.887 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:20.887 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194860+0000", 2024-09-12T16:16:20.887 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3714999999999997e-05 2024-09-12T16:16:20.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.887 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:20.887 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194936+0000", 2024-09-12T16:16:20.887 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5770000000000001e-05 2024-09-12T16:16:20.887 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.887 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:20.887 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.888 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3715 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14853120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.888 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:16:20.888 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.6900469660000002, 2024-09-12T16:16:20.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053962307000000001, 2024-09-12T16:16:20.888 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:20.888 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:20.888 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:20.888 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:20.888 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:20.888 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.888 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3715 2024-09-12T16:16:20.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.888 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:20.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.888 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:20.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:16:20.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:20.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:16:20.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:20.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141417+0000", 2024-09-12T16:16:20.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017384099999999999 2024-09-12T16:16:20.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:20.890 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141422+0000", 2024-09-12T16:16:20.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7310000000000001e-06 2024-09-12T16:16:20.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.890 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:20.890 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141434+0000", 2024-09-12T16:16:20.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2058e-05 2024-09-12T16:16:20.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.890 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.890 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141442+0000", 2024-09-12T16:16:20.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7610000000000007e-06 2024-09-12T16:16:20.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.891 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:20.891 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194973+0000", 2024-09-12T16:16:20.891 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053530618000000002 2024-09-12T16:16:20.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.891 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:20.891 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195063+0000", 2024-09-12T16:16:20.891 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0927000000000005e-05 2024-09-12T16:16:20.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.891 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:20.891 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195206+0000", 2024-09-12T16:16:20.891 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142371 2024-09-12T16:16:20.891 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.891 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:20.892 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.892 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3716 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14857216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.892 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:16:20.892 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.6898371160000001, 2024-09-12T16:16:20.892 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053916360000000003, 2024-09-12T16:16:20.892 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:20.892 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:20.892 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:20.892 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:20.892 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:20.892 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.892 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3716 2024-09-12T16:16:20.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.893 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:20.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.893 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:20.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:16:20.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.893 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:20.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:16:20.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.893 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:20.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142933+0000", 2024-09-12T16:16:20.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014796290000000001 2024-09-12T16:16:20.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.894 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:20.894 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142937+0000", 2024-09-12T16:16:20.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5760000000000002e-06 2024-09-12T16:16:20.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.894 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:20.894 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142946+0000", 2024-09-12T16:16:20.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0380000000000005e-06 2024-09-12T16:16:20.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.894 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.894 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142951+0000", 2024-09-12T16:16:20.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9749999999999998e-06 2024-09-12T16:16:20.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.895 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:20.895 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195246+0000", 2024-09-12T16:16:20.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052295358 2024-09-12T16:16:20.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.895 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:20.895 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195299+0000", 2024-09-12T16:16:20.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2976999999999998e-05 2024-09-12T16:16:20.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.895 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:20.896 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195370+0000", 2024-09-12T16:16:20.896 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0807000000000002e-05 2024-09-12T16:16:20.896 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.896 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:20.896 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.896 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3721 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14877696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.896 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:16:20.896 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.688263665, 2024-09-12T16:16:20.896 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053422994000000001, 2024-09-12T16:16:20.896 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:20.896 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:20.897 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:20.897 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:20.897 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:20.897 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.897 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3721 2024-09-12T16:16:20.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.897 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:20.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.897 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:20.897 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:16:20.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.897 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:20.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:16:20.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:20.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:16:20.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:16:20.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:20.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143028+0000", 2024-09-12T16:16:20.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7399999999999991e-07 2024-09-12T16:16:20.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:20.899 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143031+0000", 2024-09-12T16:16:20.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7599999999999998e-06 2024-09-12T16:16:20.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.899 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143034+0000", 2024-09-12T16:16:20.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9780000000000001e-06 2024-09-12T16:16:20.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:20.899 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196220+0000", 2024-09-12T16:16:20.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053186341999999998 2024-09-12T16:16:20.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.900 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:20.900 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196313+0000", 2024-09-12T16:16:20.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2676000000000005e-05 2024-09-12T16:16:20.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.900 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:20.900 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196450+0000", 2024-09-12T16:16:20.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137052 2024-09-12T16:16:20.900 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.900 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:20.900 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.901 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3722 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14881792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.901 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:16:20.901 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.688253773, 2024-09-12T16:16:20.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053556835999999997, 2024-09-12T16:16:20.901 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:20.901 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:20.901 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:20.901 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:20.901 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:20.901 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.901 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3722 2024-09-12T16:16:20.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.901 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:20.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:20.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:16:20.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:20.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:16:20.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:20.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:16:20.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.11e-07 2024-09-12T16:16:20.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:20.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143038+0000", 2024-09-12T16:16:20.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2399999999999996e-07 2024-09-12T16:16:20.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:20.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143041+0000", 2024-09-12T16:16:20.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8030000000000001e-06 2024-09-12T16:16:20.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143043+0000", 2024-09-12T16:16:20.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3140000000000002e-06 2024-09-12T16:16:20.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:20.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196481+0000", 2024-09-12T16:16:20.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053437601000000001 2024-09-12T16:16:20.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:20.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196525+0000", 2024-09-12T16:16:20.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4280000000000003e-05 2024-09-12T16:16:20.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:20.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196594+0000", 2024-09-12T16:16:20.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8702999999999996e-05 2024-09-12T16:16:20.905 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.905 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:20.905 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.905 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3723 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14885888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.905 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:16:20.905 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.6882445910000001, 2024-09-12T16:16:20.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053815546999999998, 2024-09-12T16:16:20.905 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:20.905 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:20.905 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:20.905 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:20.905 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:20.906 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.906 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3723 2024-09-12T16:16:20.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.906 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:20.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.906 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:20.906 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:16:20.906 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.906 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:20.906 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:16:20.906 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:20.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148994+0000", 2024-09-12T16:16:20.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059481330000000004 2024-09-12T16:16:20.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:20.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148999+0000", 2024-09-12T16:16:20.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7140000000000001e-06 2024-09-12T16:16:20.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:20.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149008+0000", 2024-09-12T16:16:20.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4350000000000003e-06 2024-09-12T16:16:20.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149021+0000", 2024-09-12T16:16:20.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2514000000000001e-05 2024-09-12T16:16:20.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:20.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196630+0000", 2024-09-12T16:16:20.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047609758000000002 2024-09-12T16:16:20.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:20.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196724+0000", 2024-09-12T16:16:20.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3522000000000003e-05 2024-09-12T16:16:20.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:20.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196861+0000", 2024-09-12T16:16:20.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013747100000000001 2024-09-12T16:16:20.909 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.909 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:20.909 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.909 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4438 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15719424~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.909 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:16:20.910 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.5433638140000001, 2024-09-12T16:16:20.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367981000000002, 2024-09-12T16:16:20.910 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:20.910 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:20.910 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:20.910 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:20.910 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:20.910 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.910 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4438 2024-09-12T16:16:20.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.910 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:20.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:20.910 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:16:20.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:20.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:16:20.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:20.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:16:20.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3e-07 2024-09-12T16:16:20.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:20.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287930+0000", 2024-09-12T16:16:20.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-12T16:16:20.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:20.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287937+0000", 2024-09-12T16:16:20.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.08e-06 2024-09-12T16:16:20.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287943+0000", 2024-09-12T16:16:20.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5709999999999997e-06 2024-09-12T16:16:20.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:20.913 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341068+0000", 2024-09-12T16:16:20.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053125101000000001 2024-09-12T16:16:20.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.913 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:20.913 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341154+0000", 2024-09-12T16:16:20.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6100999999999994e-05 2024-09-12T16:16:20.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.913 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:20.913 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341295+0000", 2024-09-12T16:16:20.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014087999999999999 2024-09-12T16:16:20.913 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.913 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:20.913 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.914 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4439 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15723520~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.914 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:16:20.914 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.5433396539999999, 2024-09-12T16:16:20.914 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053526799, 2024-09-12T16:16:20.914 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:20.914 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:20.914 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:20.914 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:20.914 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:20.914 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.914 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4439 2024-09-12T16:16:20.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.914 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:20.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.915 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:20.915 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:16:20.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.915 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:20.915 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:16:20.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.915 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:20.915 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:16:20.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-07 2024-09-12T16:16:20.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:20.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287953+0000", 2024-09-12T16:16:20.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1349999999999999e-06 2024-09-12T16:16:20.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:20.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287960+0000", 2024-09-12T16:16:20.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-12T16:16:20.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287965+0000", 2024-09-12T16:16:20.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1580000000000004e-06 2024-09-12T16:16:20.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:20.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341332+0000", 2024-09-12T16:16:20.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367009 2024-09-12T16:16:20.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:20.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341402+0000", 2024-09-12T16:16:20.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9759999999999996e-05 2024-09-12T16:16:20.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:20.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341478+0000", 2024-09-12T16:16:20.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5412000000000002e-05 2024-09-12T16:16:20.918 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.918 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:20.918 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.918 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4440 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15727616~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:20.918 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:16:20.918 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.54331855, 2024-09-12T16:16:20.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053761601999999999, 2024-09-12T16:16:20.918 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:20.918 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:20.918 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:20.919 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:20.919 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:20.919 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:20.919 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4440 2024-09-12T16:16:20.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.919 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:20.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.919 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:20.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:16:20.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.919 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:20.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:16:20.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:20.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:20.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:16:20.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:16:20.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:20.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287974+0000", 2024-09-12T16:16:20.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0540000000000002e-06 2024-09-12T16:16:20.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:20.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287980+0000", 2024-09-12T16:16:20.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9440000000000002e-06 2024-09-12T16:16:20.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:20.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287987+0000", 2024-09-12T16:16:20.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5889999999999999e-06 2024-09-12T16:16:20.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:20.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341502+0000", 2024-09-12T16:16:20.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053515199999999999 2024-09-12T16:16:20.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:20.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341595+0000", 2024-09-12T16:16:20.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3097000000000007e-05 2024-09-12T16:16:20.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:20.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:20.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:20.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341734+0000", 2024-09-12T16:16:20.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013832800000000001 2024-09-12T16:16:20.922 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.922 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:20.922 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.922 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:20.922 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:20.922 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:20.924 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:16:20.924 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:20.923+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:21.024 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:21.024+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:21.040 INFO:teuthology.orchestra.run.smithi047.stdout:get_pg_num_history pg_num_history pg_num_history(e35 pg_nums {1={13=1},2={16=8},3={21=32}} deleted_pools ) 2024-09-12T16:16:21.040 INFO:teuthology.orchestra.run.smithi047.stdout:Importing pgid 3.1d 2024-09-12T16:16:21.040 INFO:teuthology.orchestra.run.smithi047.stdout:Write #3:b81e017c:::rbd_data.11551fa285fd.000000000000000c:5# 2024-09-12T16:16:21.059 INFO:teuthology.orchestra.run.smithi047.stdout:Write #3:b81e017c:::rbd_data.11551fa285fd.000000000000000c:head# 2024-09-12T16:16:21.059 INFO:teuthology.orchestra.run.smithi047.stdout:snapset 5=[]:{5=[5]} 2024-09-12T16:16:21.060 INFO:teuthology.orchestra.run.smithi047.stdout:Write #3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:5# 2024-09-12T16:16:21.069 INFO:teuthology.orchestra.run.smithi047.stdout:Write #3:b971b3eb:::rbd_data.11551fa285fd.0000000000000003:head# 2024-09-12T16:16:21.069 INFO:teuthology.orchestra.run.smithi047.stdout:snapset 5=[]:{5=[5]} 2024-09-12T16:16:21.070 INFO:teuthology.orchestra.run.smithi047.stdout:Write #3:badfac2e:::rbd_data.1155cf5be90e.000000000000001d:head# 2024-09-12T16:16:21.070 INFO:teuthology.orchestra.run.smithi047.stdout:snapset 0=[]:{} 2024-09-12T16:16:21.072 INFO:teuthology.orchestra.run.smithi047.stdout:Write #3:bbcb2eee:::rbd_data.11557ed36bb5.000000000000004b:head# 2024-09-12T16:16:21.072 INFO:teuthology.orchestra.run.smithi047.stdout:snapset 0=[]:{} 2024-09-12T16:16:21.072 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:21.072 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:21.072 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:16:21.072 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:21.073 INFO:teuthology.orchestra.run.smithi047.stdout:Write #3:bc99b8b6:::rbd_data.11551fa285fd.0000000000000008:5# 2024-09-12T16:16:21.076 INFO:teuthology.orchestra.run.smithi047.stdout:Write #3:bc99b8b6:::rbd_data.11551fa285fd.0000000000000008:head# 2024-09-12T16:16:21.076 INFO:teuthology.orchestra.run.smithi047.stdout:snapset 5=[]:{5=[5]} 2024-09-12T16:16:21.077 INFO:teuthology.orchestra.run.smithi047.stdout:Write #3:bd04f1e3:::rbd_data.11557ed36bb5.000000000000016b:head# 2024-09-12T16:16:21.077 INFO:teuthology.orchestra.run.smithi047.stdout:snapset 0=[]:{} 2024-09-12T16:16:21.077 INFO:teuthology.orchestra.run.smithi047.stdout:Write #3:bfbdd201:::rbd_data.11557ed36bb5.0000000000000007:head# 2024-09-12T16:16:21.077 INFO:teuthology.orchestra.run.smithi047.stdout:snapset 0=[]:{} 2024-09-12T16:16:21.078 INFO:teuthology.orchestra.run.smithi047.stdout:write_pg epoch 33 info 3.1d( v 33'59 (0'0,33'59] local-lis/les=27/28 n=10 ec=21/21 lis/c=27/27 les/c/f=28/28/0 sis=27) 2024-09-12T16:16:21.079 INFO:teuthology.orchestra.run.smithi047.stdout:Import successful 2024-09-12T16:16:21.082 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:16:21.125 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:21.125+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:21.189 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:21.189 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:21.189 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:16:21.189 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:16:21.189 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:21.197 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:16:21.241 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:21.240+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:21.306 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:21.306 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:16:21.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:16:21.306 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:21.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.307 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2256 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12192768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:21.307 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.889586+0000", 2024-09-12T16:16:21.307 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.4156536929999999, 2024-09-12T16:16:21.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037086439999999998, 2024-09-12T16:16:21.307 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.307 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.307 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:21.307 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.307 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:21.307 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:21.307 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2256 2024-09-12T16:16:21.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.308 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.889586+0000", 2024-09-12T16:16:21.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.889586+0000", 2024-09-12T16:16:21.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.894952+0000", 2024-09-12T16:16:21.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0053653260000000001 2024-09-12T16:16:21.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.894956+0000", 2024-09-12T16:16:21.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2640000000000002e-06 2024-09-12T16:16:21.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.894966+0000", 2024-09-12T16:16:21.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0607e-05 2024-09-12T16:16:21.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.894982+0000", 2024-09-12T16:16:21.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5528000000000001e-05 2024-09-12T16:16:21.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.926510+0000", 2024-09-12T16:16:21.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.031528325000000003 2024-09-12T16:16:21.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:21.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.926593+0000", 2024-09-12T16:16:21.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2812999999999995e-05 2024-09-12T16:16:21.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.926673+0000", 2024-09-12T16:16:21.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9577000000000001e-05 2024-09-12T16:16:21.311 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.311 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.311 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.311 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2298 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12364800~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:21.311 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.895981+0000", 2024-09-12T16:16:21.311 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.409258522, 2024-09-12T16:16:21.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037134176999999997, 2024-09-12T16:16:21.311 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.311 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.311 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:21.312 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.312 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:21.312 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:21.312 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2298 2024-09-12T16:16:21.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.312 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.895981+0000", 2024-09-12T16:16:21.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.313 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.895981+0000", 2024-09-12T16:16:21.313 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.313 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.313 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.895982+0000", 2024-09-12T16:16:21.313 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6400000000000003e-07 2024-09-12T16:16:21.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.313 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.313 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.895984+0000", 2024-09-12T16:16:21.313 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1500000000000002e-06 2024-09-12T16:16:21.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.895991+0000", 2024-09-12T16:16:21.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8730000000000001e-06 2024-09-12T16:16:21.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.895996+0000", 2024-09-12T16:16:21.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1800000000000004e-06 2024-09-12T16:16:21.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.932938+0000", 2024-09-12T16:16:21.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036941781 2024-09-12T16:16:21.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:21.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933028+0000", 2024-09-12T16:16:21.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0493000000000002e-05 2024-09-12T16:16:21.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933116+0000", 2024-09-12T16:16:21.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7236000000000003e-05 2024-09-12T16:16:21.315 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.315 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.315 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.316 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2299 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12368896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:21.316 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896004+0000", 2024-09-12T16:16:21.316 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.4092358150000002, 2024-09-12T16:16:21.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037218257999999997, 2024-09-12T16:16:21.316 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.316 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.316 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:21.316 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.316 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:21.316 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:21.316 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2299 2024-09-12T16:16:21.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.317 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.317 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.317 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896004+0000", 2024-09-12T16:16:21.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.317 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.317 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896004+0000", 2024-09-12T16:16:21.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.317 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.317 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896005+0000", 2024-09-12T16:16:21.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3700000000000001e-07 2024-09-12T16:16:21.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.318 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896006+0000", 2024-09-12T16:16:21.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9929999999999998e-06 2024-09-12T16:16:21.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.318 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896013+0000", 2024-09-12T16:16:21.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1709999999999999e-06 2024-09-12T16:16:21.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.318 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896017+0000", 2024-09-12T16:16:21.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5050000000000001e-06 2024-09-12T16:16:21.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933142+0000", 2024-09-12T16:16:21.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037125012999999998 2024-09-12T16:16:21.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:21.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933182+0000", 2024-09-12T16:16:21.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9957999999999999e-05 2024-09-12T16:16:21.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933222+0000", 2024-09-12T16:16:21.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0181e-05 2024-09-12T16:16:21.320 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.320 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.320 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.320 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2300 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12372992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:21.320 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:16:21.320 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.409216158, 2024-09-12T16:16:21.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037401246999999999, 2024-09-12T16:16:21.320 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.321 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.321 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:21.321 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.321 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:21.321 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:21.321 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2300 2024-09-12T16:16:21.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.321 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.321 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.321 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:16:21.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.322 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.322 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:16:21.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.322 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.322 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:16:21.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6100000000000002e-07 2024-09-12T16:16:21.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.322 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.322 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896026+0000", 2024-09-12T16:16:21.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9130000000000001e-06 2024-09-12T16:16:21.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896032+0000", 2024-09-12T16:16:21.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7540000000000003e-06 2024-09-12T16:16:21.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896036+0000", 2024-09-12T16:16:21.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5750000000000002e-06 2024-09-12T16:16:21.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933254+0000", 2024-09-12T16:16:21.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037217962 2024-09-12T16:16:21.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:21.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933341+0000", 2024-09-12T16:16:21.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6296000000000002e-05 2024-09-12T16:16:21.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933425+0000", 2024-09-12T16:16:21.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4386000000000001e-05 2024-09-12T16:16:21.324 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.324 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.324 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.325 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2301 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12377088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:21.325 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896043+0000", 2024-09-12T16:16:21.325 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.4091964159999999, 2024-09-12T16:16:21.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037486197999999998, 2024-09-12T16:16:21.325 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.325 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.325 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:21.325 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.325 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:21.325 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:21.325 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2301 2024-09-12T16:16:21.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.325 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.325 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896043+0000", 2024-09-12T16:16:21.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.326 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896043+0000", 2024-09-12T16:16:21.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.326 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896044+0000", 2024-09-12T16:16:21.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.41e-07 2024-09-12T16:16:21.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.326 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896053+0000", 2024-09-12T16:16:21.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8049999999999996e-06 2024-09-12T16:16:21.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896060+0000", 2024-09-12T16:16:21.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.221e-06 2024-09-12T16:16:21.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896065+0000", 2024-09-12T16:16:21.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1109999999999999e-06 2024-09-12T16:16:21.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933452+0000", 2024-09-12T16:16:21.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037386560999999999 2024-09-12T16:16:21.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:21.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933491+0000", 2024-09-12T16:16:21.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9789000000000001e-05 2024-09-12T16:16:21.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933530+0000", 2024-09-12T16:16:21.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.837e-05 2024-09-12T16:16:21.328 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.328 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.328 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.329 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2302 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12381184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:21.329 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:16:21.329 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.4091549759999999, 2024-09-12T16:16:21.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037645284000000001, 2024-09-12T16:16:21.329 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.329 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.329 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:21.329 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.329 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:21.329 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:21.329 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2302 2024-09-12T16:16:21.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.330 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:16:21.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:16:21.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:16:21.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6800000000000001e-07 2024-09-12T16:16:21.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896088+0000", 2024-09-12T16:16:21.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3429999999999998e-06 2024-09-12T16:16:21.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896096+0000", 2024-09-12T16:16:21.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0860000000000002e-06 2024-09-12T16:16:21.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896102+0000", 2024-09-12T16:16:21.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7610000000000004e-06 2024-09-12T16:16:21.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933563+0000", 2024-09-12T16:16:21.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037461019999999998 2024-09-12T16:16:21.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:21.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933648+0000", 2024-09-12T16:16:21.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5468000000000002e-05 2024-09-12T16:16:21.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933730+0000", 2024-09-12T16:16:21.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2138000000000005e-05 2024-09-12T16:16:21.333 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.333 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.333 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.333 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2303 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12385280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:21.333 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:16:21.333 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.4091311740000001, 2024-09-12T16:16:21.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037723083999999997, 2024-09-12T16:16:21.333 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.333 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.333 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:21.333 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.333 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:21.334 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:21.334 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2303 2024-09-12T16:16:21.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.334 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:16:21.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:16:21.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:16:21.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2500000000000001e-07 2024-09-12T16:16:21.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896115+0000", 2024-09-12T16:16:21.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.28e-06 2024-09-12T16:16:21.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896122+0000", 2024-09-12T16:16:21.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4590000000000003e-06 2024-09-12T16:16:21.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896127+0000", 2024-09-12T16:16:21.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0509999999999996e-06 2024-09-12T16:16:21.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933755+0000", 2024-09-12T16:16:21.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037627729999999998 2024-09-12T16:16:21.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:21.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933794+0000", 2024-09-12T16:16:21.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9255000000000003e-05 2024-09-12T16:16:21.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933832+0000", 2024-09-12T16:16:21.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7883999999999998e-05 2024-09-12T16:16:21.337 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.337 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.337 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.337 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2304 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12389376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:21.337 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:16:21.337 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.4091058250000001, 2024-09-12T16:16:21.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037911010000000002, 2024-09-12T16:16:21.337 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.337 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.337 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:21.337 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.338 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:21.338 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:21.338 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2304 2024-09-12T16:16:21.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.338 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:16:21.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:16:21.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:16:21.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9900000000000001e-07 2024-09-12T16:16:21.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896136+0000", 2024-09-12T16:16:21.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.897e-06 2024-09-12T16:16:21.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896142+0000", 2024-09-12T16:16:21.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9290000000000003e-06 2024-09-12T16:16:21.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.340 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896154+0000", 2024-09-12T16:16:21.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.201e-05 2024-09-12T16:16:21.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.340 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933865+0000", 2024-09-12T16:16:21.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037710225 2024-09-12T16:16:21.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:21.340 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933961+0000", 2024-09-12T16:16:21.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6315000000000002e-05 2024-09-12T16:16:21.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.341 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934045+0000", 2024-09-12T16:16:21.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4234999999999996e-05 2024-09-12T16:16:21.341 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.341 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.341 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.341 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2305 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12393472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:21.341 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896175+0000", 2024-09-12T16:16:21.341 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.409064635, 2024-09-12T16:16:21.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037976941, 2024-09-12T16:16:21.342 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.342 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.342 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:21.342 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.342 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:21.342 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:21.342 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2305 2024-09-12T16:16:21.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.342 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.342 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896175+0000", 2024-09-12T16:16:21.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896175+0000", 2024-09-12T16:16:21.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896176+0000", 2024-09-12T16:16:21.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7400000000000003e-07 2024-09-12T16:16:21.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896178+0000", 2024-09-12T16:16:21.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6709999999999999e-06 2024-09-12T16:16:21.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896186+0000", 2024-09-12T16:16:21.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9319999999999996e-06 2024-09-12T16:16:21.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896192+0000", 2024-09-12T16:16:21.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0799999999999996e-06 2024-09-12T16:16:21.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934072+0000", 2024-09-12T16:16:21.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037880888000000001 2024-09-12T16:16:21.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.345 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:21.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934113+0000", 2024-09-12T16:16:21.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0815999999999997e-05 2024-09-12T16:16:21.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.345 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934152+0000", 2024-09-12T16:16:21.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8980000000000003e-05 2024-09-12T16:16:21.345 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.345 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.345 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.346 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2306 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12397568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:21.346 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:16:21.346 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.4090403569999999, 2024-09-12T16:16:21.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038156347, 2024-09-12T16:16:21.346 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.346 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.346 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:21.346 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.346 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:21.346 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:21.346 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2306 2024-09-12T16:16:21.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.346 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.347 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:16:21.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.347 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:16:21.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.347 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:16:21.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.77e-07 2024-09-12T16:16:21.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896202+0000", 2024-09-12T16:16:21.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2359999999999999e-06 2024-09-12T16:16:21.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896208+0000", 2024-09-12T16:16:21.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1430000000000003e-06 2024-09-12T16:16:21.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896213+0000", 2024-09-12T16:16:21.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9339999999999997e-06 2024-09-12T16:16:21.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934188+0000", 2024-09-12T16:16:21.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037974490999999999 2024-09-12T16:16:21.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:21.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934275+0000", 2024-09-12T16:16:21.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7639999999999994e-05 2024-09-12T16:16:21.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.350 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.350 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934356+0000", 2024-09-12T16:16:21.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0525999999999994e-05 2024-09-12T16:16:21.350 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.350 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.350 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.350 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2307 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12401664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:21.350 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:16:21.350 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.4090205849999999, 2024-09-12T16:16:21.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038241450000000003, 2024-09-12T16:16:21.350 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.350 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.350 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:21.351 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.351 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:21.351 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:21.351 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2307 2024-09-12T16:16:21.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.351 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:16:21.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:16:21.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896220+0000", 2024-09-12T16:16:21.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3500000000000002e-07 2024-09-12T16:16:21.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896222+0000", 2024-09-12T16:16:21.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1720000000000001e-06 2024-09-12T16:16:21.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896228+0000", 2024-09-12T16:16:21.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0870000000000003e-06 2024-09-12T16:16:21.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896233+0000", 2024-09-12T16:16:21.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:16:21.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934382+0000", 2024-09-12T16:16:21.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038149566000000003 2024-09-12T16:16:21.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:21.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934422+0000", 2024-09-12T16:16:21.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0015999999999998e-05 2024-09-12T16:16:21.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934461+0000", 2024-09-12T16:16:21.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8423999999999997e-05 2024-09-12T16:16:21.354 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.354 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.354 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.354 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2308 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12405760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:21.354 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:16:21.355 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.409000888, 2024-09-12T16:16:21.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038420745999999999, 2024-09-12T16:16:21.355 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.355 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.355 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:21.355 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.355 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:21.355 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:21.355 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2308 2024-09-12T16:16:21.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.355 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:16:21.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.356 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.356 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:16:21.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.356 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.356 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:16:21.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.58e-07 2024-09-12T16:16:21.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.357 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.357 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896241+0000", 2024-09-12T16:16:21.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7940000000000001e-06 2024-09-12T16:16:21.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.357 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.357 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896247+0000", 2024-09-12T16:16:21.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1460000000000001e-06 2024-09-12T16:16:21.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.357 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.357 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896252+0000", 2024-09-12T16:16:21.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6840000000000004e-06 2024-09-12T16:16:21.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934494+0000", 2024-09-12T16:16:21.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038242362000000002 2024-09-12T16:16:21.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:21.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934579+0000", 2024-09-12T16:16:21.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5044999999999996e-05 2024-09-12T16:16:21.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934660+0000", 2024-09-12T16:16:21.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0357000000000003e-05 2024-09-12T16:16:21.358 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.358 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.359 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.359 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2309 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12409856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:21.359 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:16:21.359 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.4089803079999998, 2024-09-12T16:16:21.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038504629999999998, 2024-09-12T16:16:21.359 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.359 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.359 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:21.359 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.359 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:21.360 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:21.360 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2309 2024-09-12T16:16:21.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.360 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:16:21.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:16:21.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:16:21.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5199999999999998e-07 2024-09-12T16:16:21.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896263+0000", 2024-09-12T16:16:21.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4209999999999999e-06 2024-09-12T16:16:21.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896269+0000", 2024-09-12T16:16:21.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9449999999999998e-06 2024-09-12T16:16:21.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896274+0000", 2024-09-12T16:16:21.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3950000000000003e-06 2024-09-12T16:16:21.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934686+0000", 2024-09-12T16:16:21.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038412333999999999 2024-09-12T16:16:21.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:21.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934727+0000", 2024-09-12T16:16:21.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0649999999999999e-05 2024-09-12T16:16:21.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.363 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934764+0000", 2024-09-12T16:16:21.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7533000000000001e-05 2024-09-12T16:16:21.363 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.363 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.363 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.363 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2310 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12413952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:21.363 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:16:21.363 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.408959436, 2024-09-12T16:16:21.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038694183, 2024-09-12T16:16:21.363 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.363 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.364 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:21.364 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.364 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:21.364 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:21.364 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2310 2024-09-12T16:16:21.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.364 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.364 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:16:21.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:16:21.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896281+0000", 2024-09-12T16:16:21.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1399999999999997e-07 2024-09-12T16:16:21.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896283+0000", 2024-09-12T16:16:21.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9549999999999999e-06 2024-09-12T16:16:21.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896289+0000", 2024-09-12T16:16:21.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8669999999999999e-06 2024-09-12T16:16:21.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896301+0000", 2024-09-12T16:16:21.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1807999999999999e-05 2024-09-12T16:16:21.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934798+0000", 2024-09-12T16:16:21.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038497591999999997 2024-09-12T16:16:21.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:21.367 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934885+0000", 2024-09-12T16:16:21.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7149000000000002e-05 2024-09-12T16:16:21.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.367 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.367 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934975+0000", 2024-09-12T16:16:21.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9297999999999998e-05 2024-09-12T16:16:21.367 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.367 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.367 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.367 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2311 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12418048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:21.367 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:16:21.367 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.4089321799999999, 2024-09-12T16:16:21.368 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038768558000000002, 2024-09-12T16:16:21.368 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.368 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.368 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:21.368 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.368 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:21.368 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:21.368 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2311 2024-09-12T16:16:21.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.368 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.368 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.368 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:16:21.368 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:16:21.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:16:21.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.63e-07 2024-09-12T16:16:21.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896310+0000", 2024-09-12T16:16:21.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1560000000000002e-06 2024-09-12T16:16:21.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896316+0000", 2024-09-12T16:16:21.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0249999999999999e-06 2024-09-12T16:16:21.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896322+0000", 2024-09-12T16:16:21.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6400000000000002e-06 2024-09-12T16:16:21.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934997+0000", 2024-09-12T16:16:21.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038674565000000001 2024-09-12T16:16:21.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:21.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935037+0000", 2024-09-12T16:16:21.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0485999999999998e-05 2024-09-12T16:16:21.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935076+0000", 2024-09-12T16:16:21.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9223e-05 2024-09-12T16:16:21.371 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.371 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.372 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.372 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2312 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12422144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:21.372 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:16:21.372 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.4089114870000001, 2024-09-12T16:16:21.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038856784999999998, 2024-09-12T16:16:21.372 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.372 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.372 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:21.372 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.372 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:21.372 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:21.372 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2312 2024-09-12T16:16:21.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.373 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:16:21.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:16:21.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896329+0000", 2024-09-12T16:16:21.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5499999999999999e-07 2024-09-12T16:16:21.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896337+0000", 2024-09-12T16:16:21.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0819999999999999e-06 2024-09-12T16:16:21.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896343+0000", 2024-09-12T16:16:21.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.263e-06 2024-09-12T16:16:21.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.375 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896348+0000", 2024-09-12T16:16:21.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8860000000000003e-06 2024-09-12T16:16:21.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.375 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935097+0000", 2024-09-12T16:16:21.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038748818999999997 2024-09-12T16:16:21.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:21.375 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935141+0000", 2024-09-12T16:16:21.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4175000000000003e-05 2024-09-12T16:16:21.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.376 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935185+0000", 2024-09-12T16:16:21.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4205000000000001e-05 2024-09-12T16:16:21.376 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.376 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.376 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.376 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2313 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12426240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:21.376 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:16:21.376 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.408885272, 2024-09-12T16:16:21.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038928683999999998, 2024-09-12T16:16:21.376 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.376 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.377 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:21.377 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.377 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:21.377 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:21.377 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2313 2024-09-12T16:16:21.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.377 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:16:21.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.378 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:16:21.378 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.378 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.378 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:16:21.378 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0400000000000002e-07 2024-09-12T16:16:21.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.378 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.378 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896357+0000", 2024-09-12T16:16:21.378 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.097e-06 2024-09-12T16:16:21.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.378 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.379 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896363+0000", 2024-09-12T16:16:21.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5119999999999999e-06 2024-09-12T16:16:21.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.379 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.379 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896374+0000", 2024-09-12T16:16:21.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1381e-05 2024-09-12T16:16:21.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.379 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.379 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935205+0000", 2024-09-12T16:16:21.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038830549999999998 2024-09-12T16:16:21.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.379 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:21.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935244+0000", 2024-09-12T16:16:21.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9520000000000001e-05 2024-09-12T16:16:21.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935283+0000", 2024-09-12T16:16:21.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9220000000000001e-05 2024-09-12T16:16:21.380 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.380 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.380 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.380 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2314 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12430336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:21.380 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:16:21.381 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.4088481019999999, 2024-09-12T16:16:21.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039008137999999998, 2024-09-12T16:16:21.381 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.381 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.381 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:21.381 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.381 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:21.381 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:21.381 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2314 2024-09-12T16:16:21.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.381 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.381 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:16:21.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:16:21.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:16:21.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6499999999999999e-07 2024-09-12T16:16:21.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896395+0000", 2024-09-12T16:16:21.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2960000000000001e-06 2024-09-12T16:16:21.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896402+0000", 2024-09-12T16:16:21.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2280000000000001e-06 2024-09-12T16:16:21.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896407+0000", 2024-09-12T16:16:21.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3630000000000002e-06 2024-09-12T16:16:21.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935302+0000", 2024-09-12T16:16:21.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038895181000000001 2024-09-12T16:16:21.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:21.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935343+0000", 2024-09-12T16:16:21.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0590999999999998e-05 2024-09-12T16:16:21.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935400+0000", 2024-09-12T16:16:21.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7014e-05 2024-09-12T16:16:21.384 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.384 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.384 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.385 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2315 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12434432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:21.385 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:16:21.385 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.4088254510000002, 2024-09-12T16:16:21.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039083892000000002, 2024-09-12T16:16:21.385 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.385 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.385 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:21.385 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.385 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:21.385 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:21.385 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2315 2024-09-12T16:16:21.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.385 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.386 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:16:21.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.386 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:16:21.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.386 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896415+0000", 2024-09-12T16:16:21.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3300000000000002e-07 2024-09-12T16:16:21.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.387 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.387 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896421+0000", 2024-09-12T16:16:21.387 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7579999999999998e-06 2024-09-12T16:16:21.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.387 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.387 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896427+0000", 2024-09-12T16:16:21.387 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3029999999999996e-06 2024-09-12T16:16:21.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.387 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.387 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896432+0000", 2024-09-12T16:16:21.387 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.215e-06 2024-09-12T16:16:21.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935420+0000", 2024-09-12T16:16:21.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038987727 2024-09-12T16:16:21.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:21.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935460+0000", 2024-09-12T16:16:21.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9817999999999997e-05 2024-09-12T16:16:21.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935498+0000", 2024-09-12T16:16:21.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8438e-05 2024-09-12T16:16:21.389 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.389 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.389 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.389 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2316 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12438528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:21.389 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:16:21.389 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.4088007989999998, 2024-09-12T16:16:21.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039160043999999998, 2024-09-12T16:16:21.389 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.389 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.389 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:21.389 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.390 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:21.390 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:21.390 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2316 2024-09-12T16:16:21.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.390 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:16:21.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:16:21.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.391 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.391 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901945+0000", 2024-09-12T16:16:21.391 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055056050000000002 2024-09-12T16:16:21.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.391 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.391 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901950+0000", 2024-09-12T16:16:21.391 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2490000000000001e-06 2024-09-12T16:16:21.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.391 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.391 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901966+0000", 2024-09-12T16:16:21.391 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6325e-05 2024-09-12T16:16:21.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.392 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.392 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901974+0000", 2024-09-12T16:16:21.392 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7570000000000004e-06 2024-09-12T16:16:21.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.392 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.392 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935518+0000", 2024-09-12T16:16:21.392 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033543587999999999 2024-09-12T16:16:21.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.392 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:21.392 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935559+0000", 2024-09-12T16:16:21.393 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1746000000000003e-05 2024-09-12T16:16:21.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.393 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.393 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.393 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935599+0000", 2024-09-12T16:16:21.393 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9774000000000002e-05 2024-09-12T16:16:21.393 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.393 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.393 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.393 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.393 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.393 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:21.395 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:16:21.395 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:21.393+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:21.495 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:21.495+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:21.543 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:21.544 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:21.544 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:16:21.544 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:21.552 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:16:21.604 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f /var/log/ceph/exp.3.1d.5 2024-09-12T16:16:21.636 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:21.635+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:21.699 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:21.699 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:21.699 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:16:21.699 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:16:21.699 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:21.707 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:16:21.714 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:21.714+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:21.798 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:21.797+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:21.856 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:21.856 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:16:21.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:16:21.856 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:21.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.857 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:3893 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 409600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:21.857 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.336389+0000", 2024-09-12T16:16:21.857 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.518541366999999, 2024-09-12T16:16:21.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0045550920000000002, 2024-09-12T16:16:21.857 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.857 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.857 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:21.857 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.857 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:21.857 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:21.857 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3893 2024-09-12T16:16:21.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.857 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336389+0000", 2024-09-12T16:16:21.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336389+0000", 2024-09-12T16:16:21.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336389+0000", 2024-09-12T16:16:21.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1799999999999999e-07 2024-09-12T16:16:21.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.859 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336390+0000", 2024-09-12T16:16:21.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.082e-06 2024-09-12T16:16:21.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.859 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336393+0000", 2024-09-12T16:16:21.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9849999999999998e-06 2024-09-12T16:16:21.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.859 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336395+0000", 2024-09-12T16:16:21.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3460000000000001e-06 2024-09-12T16:16:21.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.860 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.339585+0000", 2024-09-12T16:16:21.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031895449999999998 2024-09-12T16:16:21.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.860 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:21.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340868+0000", 2024-09-12T16:16:21.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012825009999999999 2024-09-12T16:16:21.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.860 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340944+0000", 2024-09-12T16:16:21.861 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6415000000000006e-05 2024-09-12T16:16:21.861 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.861 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.861 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.861 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:3894 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 466944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:21.861 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.336399+0000", 2024-09-12T16:16:21.861 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.518531551000001, 2024-09-12T16:16:21.861 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0047051489999999996, 2024-09-12T16:16:21.862 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.862 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.862 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:21.862 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.862 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:21.862 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:21.862 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3894 2024-09-12T16:16:21.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.862 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336399+0000", 2024-09-12T16:16:21.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336399+0000", 2024-09-12T16:16:21.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336399+0000", 2024-09-12T16:16:21.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.34e-07 2024-09-12T16:16:21.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336400+0000", 2024-09-12T16:16:21.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.029e-06 2024-09-12T16:16:21.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.864 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.864 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336403+0000", 2024-09-12T16:16:21.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.078e-06 2024-09-12T16:16:21.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.864 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.864 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336405+0000", 2024-09-12T16:16:21.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.34e-06 2024-09-12T16:16:21.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.864 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.864 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340975+0000", 2024-09-12T16:16:21.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.004569348 2024-09-12T16:16:21.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:21.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341043+0000", 2024-09-12T16:16:21.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8202999999999997e-05 2024-09-12T16:16:21.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341104+0000", 2024-09-12T16:16:21.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0917e-05 2024-09-12T16:16:21.865 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.865 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.865 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.865 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:3895 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 483328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:21.866 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.336409+0000", 2024-09-12T16:16:21.866 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.518521635999999, 2024-09-12T16:16:21.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0048548549999999999, 2024-09-12T16:16:21.866 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.866 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.866 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:21.866 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.866 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:21.866 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:21.866 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3895 2024-09-12T16:16:21.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.866 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336409+0000", 2024-09-12T16:16:21.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336409+0000", 2024-09-12T16:16:21.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336409+0000", 2024-09-12T16:16:21.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2499999999999999e-07 2024-09-12T16:16:21.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336410+0000", 2024-09-12T16:16:21.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0139999999999999e-06 2024-09-12T16:16:21.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.868 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.868 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336413+0000", 2024-09-12T16:16:21.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.038e-06 2024-09-12T16:16:21.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.868 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.868 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336415+0000", 2024-09-12T16:16:21.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2680000000000001e-06 2024-09-12T16:16:21.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.868 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.868 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341132+0000", 2024-09-12T16:16:21.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0047171560000000001 2024-09-12T16:16:21.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.869 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:21.869 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341200+0000", 2024-09-12T16:16:21.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7910000000000005e-05 2024-09-12T16:16:21.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.869 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.869 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341263+0000", 2024-09-12T16:16:21.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3244000000000006e-05 2024-09-12T16:16:21.869 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.869 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.869 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.870 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:3896 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 499712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:21.870 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.336421+0000", 2024-09-12T16:16:21.870 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.518509546000001, 2024-09-12T16:16:21.870 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0050030539999999998, 2024-09-12T16:16:21.870 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.870 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.870 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:21.870 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.870 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:21.870 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:21.870 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3896 2024-09-12T16:16:21.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.870 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336421+0000", 2024-09-12T16:16:21.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336421+0000", 2024-09-12T16:16:21.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336421+0000", 2024-09-12T16:16:21.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8700000000000001e-07 2024-09-12T16:16:21.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336423+0000", 2024-09-12T16:16:21.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.753e-06 2024-09-12T16:16:21.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336428+0000", 2024-09-12T16:16:21.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6149999999999996e-06 2024-09-12T16:16:21.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336433+0000", 2024-09-12T16:16:21.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5909999999999998e-06 2024-09-12T16:16:21.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341292+0000", 2024-09-12T16:16:21.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0048587470000000001 2024-09-12T16:16:21.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:21.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341358+0000", 2024-09-12T16:16:21.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6218999999999997e-05 2024-09-12T16:16:21.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341424+0000", 2024-09-12T16:16:21.874 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5741999999999995e-05 2024-09-12T16:16:21.874 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.874 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.874 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.874 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:3897 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 516096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:21.874 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.336440+0000", 2024-09-12T16:16:21.874 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.518490492, 2024-09-12T16:16:21.874 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.005179187, 2024-09-12T16:16:21.874 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.874 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.874 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:21.874 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.875 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:21.875 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:21.875 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3897 2024-09-12T16:16:21.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.875 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.875 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336440+0000", 2024-09-12T16:16:21.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.875 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336440+0000", 2024-09-12T16:16:21.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.876 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.876 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336440+0000", 2024-09-12T16:16:21.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7e-07 2024-09-12T16:16:21.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.876 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.876 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336442+0000", 2024-09-12T16:16:21.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1959999999999998e-06 2024-09-12T16:16:21.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.876 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.876 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336449+0000", 2024-09-12T16:16:21.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8179999999999998e-06 2024-09-12T16:16:21.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.877 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.877 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336454+0000", 2024-09-12T16:16:21.877 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1760000000000001e-06 2024-09-12T16:16:21.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.877 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.877 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341482+0000", 2024-09-12T16:16:21.877 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0050273460000000002 2024-09-12T16:16:21.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.877 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:21.877 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341552+0000", 2024-09-12T16:16:21.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0297999999999997e-05 2024-09-12T16:16:21.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.878 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.878 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341619+0000", 2024-09-12T16:16:21.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6983000000000006e-05 2024-09-12T16:16:21.878 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.878 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.878 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.878 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4125 3.5 3:a241af90:::rbd_data.11557ed36bb5.000000000000000f:4 [read 401408~6656] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:21.878 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.337967+0000", 2024-09-12T16:16:21.879 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.516963665, 2024-09-12T16:16:21.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003989467, 2024-09-12T16:16:21.879 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.879 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.879 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:21.879 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.879 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:21.879 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:21.879 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4125 2024-09-12T16:16:21.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.879 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.879 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337967+0000", 2024-09-12T16:16:21.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337967+0000", 2024-09-12T16:16:21.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337967+0000", 2024-09-12T16:16:21.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0900000000000002e-07 2024-09-12T16:16:21.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.881 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337975+0000", 2024-09-12T16:16:21.881 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6909999999999997e-06 2024-09-12T16:16:21.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.881 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.881 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337984+0000", 2024-09-12T16:16:21.881 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2720000000000003e-06 2024-09-12T16:16:21.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.881 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.881 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337990+0000", 2024-09-12T16:16:21.881 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3380000000000001e-06 2024-09-12T16:16:21.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.882 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.882 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340872+0000", 2024-09-12T16:16:21.882 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002882225 2024-09-12T16:16:21.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.882 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:21.882 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340944+0000", 2024-09-12T16:16:21.882 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1219999999999999e-05 2024-09-12T16:16:21.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.882 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.882 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341956+0000", 2024-09-12T16:16:21.882 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001012312 2024-09-12T16:16:21.882 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.883 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.883 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.883 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4126 3.5 3:a241af90:::rbd_data.11557ed36bb5.000000000000000f:4 [read 442368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:21.883 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.337999+0000", 2024-09-12T16:16:21.883 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.516930866999999, 2024-09-12T16:16:21.883 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0041510729999999999, 2024-09-12T16:16:21.883 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.883 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.883 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:21.883 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.883 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:21.884 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:21.884 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4126 2024-09-12T16:16:21.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.884 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.884 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.884 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337999+0000", 2024-09-12T16:16:21.884 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.884 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.884 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337999+0000", 2024-09-12T16:16:21.884 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.885 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338000+0000", 2024-09-12T16:16:21.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4000000000000002e-07 2024-09-12T16:16:21.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.885 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338002+0000", 2024-09-12T16:16:21.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.154e-06 2024-09-12T16:16:21.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.885 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.886 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338009+0000", 2024-09-12T16:16:21.886 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9059999999999996e-06 2024-09-12T16:16:21.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.886 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.886 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338014+0000", 2024-09-12T16:16:21.886 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7650000000000001e-06 2024-09-12T16:16:21.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.886 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.886 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342002+0000", 2024-09-12T16:16:21.886 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039884680000000002 2024-09-12T16:16:21.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.886 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:21.886 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342076+0000", 2024-09-12T16:16:21.887 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4023999999999995e-05 2024-09-12T16:16:21.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.887 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.887 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342150+0000", 2024-09-12T16:16:21.887 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4215999999999996e-05 2024-09-12T16:16:21.887 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.887 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.887 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.887 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4127 3.5 3:a241af90:::rbd_data.11557ed36bb5.000000000000000f:4 [read 458752~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:21.887 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.338021+0000", 2024-09-12T16:16:21.887 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.516909270999999, 2024-09-12T16:16:21.887 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042934399999999999, 2024-09-12T16:16:21.888 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.888 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.888 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:21.888 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.888 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:21.888 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:21.888 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4127 2024-09-12T16:16:21.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.888 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.888 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.888 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338021+0000", 2024-09-12T16:16:21.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338021+0000", 2024-09-12T16:16:21.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338021+0000", 2024-09-12T16:16:21.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9800000000000004e-07 2024-09-12T16:16:21.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338024+0000", 2024-09-12T16:16:21.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2809999999999998e-06 2024-09-12T16:16:21.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.890 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.890 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338031+0000", 2024-09-12T16:16:21.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1269999999999997e-06 2024-09-12T16:16:21.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.890 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.890 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338036+0000", 2024-09-12T16:16:21.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0329999999999999e-06 2024-09-12T16:16:21.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.890 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.890 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342181+0000", 2024-09-12T16:16:21.891 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.004144699 2024-09-12T16:16:21.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.891 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:21.891 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342247+0000", 2024-09-12T16:16:21.891 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6149000000000007e-05 2024-09-12T16:16:21.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.891 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.891 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342314+0000", 2024-09-12T16:16:21.891 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7652999999999998e-05 2024-09-12T16:16:21.891 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.891 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.891 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.892 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4128 3.5 3:a241af90:::rbd_data.11557ed36bb5.000000000000000f:4 [read 475136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:21.892 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.338043+0000", 2024-09-12T16:16:21.892 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.516887123, 2024-09-12T16:16:21.892 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0044450189999999997, 2024-09-12T16:16:21.892 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.892 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.892 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:21.892 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.892 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:21.892 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:21.892 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4128 2024-09-12T16:16:21.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.893 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.893 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338043+0000", 2024-09-12T16:16:21.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.893 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338043+0000", 2024-09-12T16:16:21.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.893 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338044+0000", 2024-09-12T16:16:21.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2599999999999998e-07 2024-09-12T16:16:21.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.894 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.894 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338046+0000", 2024-09-12T16:16:21.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9850000000000001e-06 2024-09-12T16:16:21.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.894 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.894 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338052+0000", 2024-09-12T16:16:21.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7410000000000003e-06 2024-09-12T16:16:21.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.894 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.894 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338058+0000", 2024-09-12T16:16:21.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5729999999999998e-06 2024-09-12T16:16:21.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.895 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.895 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342343+0000", 2024-09-12T16:16:21.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042855970000000004 2024-09-12T16:16:21.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.895 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:21.895 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342411+0000", 2024-09-12T16:16:21.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7619000000000004e-05 2024-09-12T16:16:21.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.895 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.895 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342488+0000", 2024-09-12T16:16:21.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7077999999999996e-05 2024-09-12T16:16:21.896 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.896 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.896 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.896 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4129 3.5 3:a241af90:::rbd_data.11557ed36bb5.000000000000000f:4 [read 491520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:21.896 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.338065+0000", 2024-09-12T16:16:21.896 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.516864818, 2024-09-12T16:16:21.896 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.004581819, 2024-09-12T16:16:21.896 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.896 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.896 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:21.896 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.897 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:21.897 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:21.897 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4129 2024-09-12T16:16:21.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.897 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.897 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.897 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338065+0000", 2024-09-12T16:16:21.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.897 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.897 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338065+0000", 2024-09-12T16:16:21.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338066+0000", 2024-09-12T16:16:21.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-07 2024-09-12T16:16:21.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338068+0000", 2024-09-12T16:16:21.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4820000000000001e-06 2024-09-12T16:16:21.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338075+0000", 2024-09-12T16:16:21.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.08e-06 2024-09-12T16:16:21.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.899 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338081+0000", 2024-09-12T16:16:21.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2939999999999996e-06 2024-09-12T16:16:21.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.899 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342515+0000", 2024-09-12T16:16:21.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0044338720000000002 2024-09-12T16:16:21.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:21.900 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342582+0000", 2024-09-12T16:16:21.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6962e-05 2024-09-12T16:16:21.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.900 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.900 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342647+0000", 2024-09-12T16:16:21.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5643999999999997e-05 2024-09-12T16:16:21.900 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.900 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.900 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.900 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4450 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 475136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:21.901 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.345047+0000", 2024-09-12T16:16:21.901 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.509883472, 2024-09-12T16:16:21.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003358088, 2024-09-12T16:16:21.901 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.901 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.901 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:21.901 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.901 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:21.901 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:21.901 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4450 2024-09-12T16:16:21.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.901 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345047+0000", 2024-09-12T16:16:21.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345047+0000", 2024-09-12T16:16:21.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345047+0000", 2024-09-12T16:16:21.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2599999999999998e-07 2024-09-12T16:16:21.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345049+0000", 2024-09-12T16:16:21.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1040000000000001e-06 2024-09-12T16:16:21.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345056+0000", 2024-09-12T16:16:21.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6220000000000003e-06 2024-09-12T16:16:21.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345061+0000", 2024-09-12T16:16:21.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0710000000000002e-06 2024-09-12T16:16:21.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.348273+0000", 2024-09-12T16:16:21.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032119649999999998 2024-09-12T16:16:21.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:21.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.348340+0000", 2024-09-12T16:16:21.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7115999999999999e-05 2024-09-12T16:16:21.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.348405+0000", 2024-09-12T16:16:21.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4783999999999995e-05 2024-09-12T16:16:21.905 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.905 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.905 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.905 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4856 3.1e 3.e05fe63e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:21.905 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.351329+0000", 2024-09-12T16:16:21.905 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.503601034999999, 2024-09-12T16:16:21.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032355190000000001, 2024-09-12T16:16:21.905 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.905 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.905 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:16:21.906 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.906 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:21.906 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:21.906 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4856 2024-09-12T16:16:21.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.906 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.906 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.906 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351329+0000", 2024-09-12T16:16:21.906 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.906 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.906 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351329+0000", 2024-09-12T16:16:21.906 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351330+0000", 2024-09-12T16:16:21.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5400000000000002e-07 2024-09-12T16:16:21.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351331+0000", 2024-09-12T16:16:21.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.81e-06 2024-09-12T16:16:21.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351337+0000", 2024-09-12T16:16:21.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7830000000000004e-06 2024-09-12T16:16:21.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351342+0000", 2024-09-12T16:16:21.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.69e-06 2024-09-12T16:16:21.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354558+0000", 2024-09-12T16:16:21.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032158500000000001 2024-09-12T16:16:21.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354565+0000", 2024-09-12T16:16:21.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0319999999999998e-06 2024-09-12T16:16:21.909 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.909 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.909 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.909 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4857 3.1e 3.e05fe63e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:21.909 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.351348+0000", 2024-09-12T16:16:21.909 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.503582506000001, 2024-09-12T16:16:21.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032465969999999999, 2024-09-12T16:16:21.909 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.909 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.910 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:16:21.910 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.910 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:21.910 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:21.910 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4857 2024-09-12T16:16:21.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.910 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.910 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351348+0000", 2024-09-12T16:16:21.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.910 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351348+0000", 2024-09-12T16:16:21.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351348+0000", 2024-09-12T16:16:21.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3599999999999999e-07 2024-09-12T16:16:21.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351354+0000", 2024-09-12T16:16:21.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8880000000000002e-06 2024-09-12T16:16:21.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351361+0000", 2024-09-12T16:16:21.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1849999999999998e-06 2024-09-12T16:16:21.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351366+0000", 2024-09-12T16:16:21.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9740000000000001e-06 2024-09-12T16:16:21.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354588+0000", 2024-09-12T16:16:21.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032216200000000001 2024-09-12T16:16:21.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.913 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.913 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354594+0000", 2024-09-12T16:16:21.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5939999999999999e-06 2024-09-12T16:16:21.913 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.913 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.913 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.913 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4858 3.1e 3.e05fe63e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:21.913 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.351373+0000", 2024-09-12T16:16:21.913 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.503557569, 2024-09-12T16:16:21.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032503800000000002, 2024-09-12T16:16:21.913 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.914 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.914 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:16:21.914 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.914 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:21.914 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:21.914 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4858 2024-09-12T16:16:21.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.914 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.914 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.914 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351373+0000", 2024-09-12T16:16:21.914 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.914 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.915 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351373+0000", 2024-09-12T16:16:21.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.915 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.915 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351373+0000", 2024-09-12T16:16:21.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5999999999999999e-07 2024-09-12T16:16:21.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.915 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.915 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351376+0000", 2024-09-12T16:16:21.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6170000000000001e-06 2024-09-12T16:16:21.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351381+0000", 2024-09-12T16:16:21.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8209999999999998e-06 2024-09-12T16:16:21.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351386+0000", 2024-09-12T16:16:21.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6190000000000002e-06 2024-09-12T16:16:21.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354616+0000", 2024-09-12T16:16:21.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032299809999999998 2024-09-12T16:16:21.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354623+0000", 2024-09-12T16:16:21.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9820000000000002e-06 2024-09-12T16:16:21.917 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.917 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.917 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.917 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4859 3.1e 3.e05fe63e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:21.917 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.351392+0000", 2024-09-12T16:16:21.917 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.503538312, 2024-09-12T16:16:21.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003261983, 2024-09-12T16:16:21.917 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.918 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.918 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:16:21.918 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.918 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:21.918 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:21.918 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4859 2024-09-12T16:16:21.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.918 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351392+0000", 2024-09-12T16:16:21.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.919 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351392+0000", 2024-09-12T16:16:21.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.919 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351392+0000", 2024-09-12T16:16:21.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4999999999999998e-07 2024-09-12T16:16:21.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.919 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351394+0000", 2024-09-12T16:16:21.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.669e-06 2024-09-12T16:16:21.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351400+0000", 2024-09-12T16:16:21.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7049999999999996e-06 2024-09-12T16:16:21.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351404+0000", 2024-09-12T16:16:21.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7249999999999997e-06 2024-09-12T16:16:21.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354646+0000", 2024-09-12T16:16:21.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032411499999999999 2024-09-12T16:16:21.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354654+0000", 2024-09-12T16:16:21.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3839999999999997e-06 2024-09-12T16:16:21.921 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.921 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.921 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.921 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4859 3.1e 3:7c67fa07:::rbd_data.11557ed36bb5.000000000000001d:4 [read 516096~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:21.921 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.356681+0000", 2024-09-12T16:16:21.921 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.498248747, 2024-09-12T16:16:21.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033342200000000002, 2024-09-12T16:16:21.922 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.922 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.922 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:21.922 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.922 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:21.922 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:21.922 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4859 2024-09-12T16:16:21.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.922 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.356681+0000", 2024-09-12T16:16:21.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.356681+0000", 2024-09-12T16:16:21.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.356682+0000", 2024-09-12T16:16:21.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.34e-07 2024-09-12T16:16:21.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.356689+0000", 2024-09-12T16:16:21.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3540000000000002e-06 2024-09-12T16:16:21.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.924 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.924 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.356697+0000", 2024-09-12T16:16:21.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.038e-06 2024-09-12T16:16:21.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.924 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.924 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.356703+0000", 2024-09-12T16:16:21.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7690000000000002e-06 2024-09-12T16:16:21.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.924 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.924 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.359724+0000", 2024-09-12T16:16:21.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030212529999999998 2024-09-12T16:16:21.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:21.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.359807+0000", 2024-09-12T16:16:21.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2956999999999999e-05 2024-09-12T16:16:21.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.360016+0000", 2024-09-12T16:16:21.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020841499999999999 2024-09-12T16:16:21.925 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.925 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.925 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.926 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:611 3.1e 3:781126e5:::rbd_data.11551fa285fd.0000000000000001:5 [sparse-read 4390912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:21.926 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.317383+0000", 2024-09-12T16:16:21.926 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.537547180000001, 2024-09-12T16:16:21.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034147090000000001, 2024-09-12T16:16:21.926 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.926 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.926 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:21.926 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.926 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:21.926 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:21.926 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 611 2024-09-12T16:16:21.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.926 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317383+0000", 2024-09-12T16:16:21.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317383+0000", 2024-09-12T16:16:21.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317383+0000", 2024-09-12T16:16:21.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.03e-07 2024-09-12T16:16:21.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.928 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.928 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317384+0000", 2024-09-12T16:16:21.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.111e-06 2024-09-12T16:16:21.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.928 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.928 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317387+0000", 2024-09-12T16:16:21.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0920000000000002e-06 2024-09-12T16:16:21.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.928 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.928 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317391+0000", 2024-09-12T16:16:21.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.191e-06 2024-09-12T16:16:21.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.929 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.929 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.320634+0000", 2024-09-12T16:16:21.929 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032436750000000001 2024-09-12T16:16:21.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.929 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:21.929 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.320721+0000", 2024-09-12T16:16:21.929 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6682999999999997e-05 2024-09-12T16:16:21.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.929 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.929 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.320798+0000", 2024-09-12T16:16:21.929 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6754000000000004e-05 2024-09-12T16:16:21.930 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.930 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.930 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.930 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:612 3.1e 3:781126e5:::rbd_data.11551fa285fd.0000000000000001:5 [sparse-read 5439488~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:21.930 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.317394+0000", 2024-09-12T16:16:21.930 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.537536138, 2024-09-12T16:16:21.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036457799999999999, 2024-09-12T16:16:21.930 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.930 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.930 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:21.930 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.930 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:21.930 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:21.931 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 612 2024-09-12T16:16:21.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.931 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.931 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317394+0000", 2024-09-12T16:16:21.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.931 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317394+0000", 2024-09-12T16:16:21.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317394+0000", 2024-09-12T16:16:21.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1400000000000001e-07 2024-09-12T16:16:21.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.932 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317395+0000", 2024-09-12T16:16:21.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.569999999999999e-07 2024-09-12T16:16:21.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.932 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317398+0000", 2024-09-12T16:16:21.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1520000000000001e-06 2024-09-12T16:16:21.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317401+0000", 2024-09-12T16:16:21.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4660000000000002e-06 2024-09-12T16:16:21.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.320843+0000", 2024-09-12T16:16:21.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034421130000000001 2024-09-12T16:16:21.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:21.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.320939+0000", 2024-09-12T16:16:21.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5585e-05 2024-09-12T16:16:21.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321040+0000", 2024-09-12T16:16:21.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010129299999999999 2024-09-12T16:16:21.934 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.934 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.934 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.934 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:613 3.1e 3:781126e5:::rbd_data.11551fa285fd.0000000000000001:5 [sparse-read 6488064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:21.934 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.317404+0000", 2024-09-12T16:16:21.934 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.537526139000001, 2024-09-12T16:16:21.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003785217, 2024-09-12T16:16:21.935 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.935 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.935 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:21.935 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.935 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:21.935 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:21.935 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 613 2024-09-12T16:16:21.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.935 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.935 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.935 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317404+0000", 2024-09-12T16:16:21.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.936 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.936 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317404+0000", 2024-09-12T16:16:21.936 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.936 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.936 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317404+0000", 2024-09-12T16:16:21.936 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2000000000000001e-07 2024-09-12T16:16:21.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.936 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.936 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317405+0000", 2024-09-12T16:16:21.936 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0890000000000001e-06 2024-09-12T16:16:21.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.937 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317408+0000", 2024-09-12T16:16:21.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.061e-06 2024-09-12T16:16:21.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.937 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317411+0000", 2024-09-12T16:16:21.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.52e-06 2024-09-12T16:16:21.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321069+0000", 2024-09-12T16:16:21.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036582059999999998 2024-09-12T16:16:21.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:21.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321127+0000", 2024-09-12T16:16:21.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7339000000000001e-05 2024-09-12T16:16:21.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321189+0000", 2024-09-12T16:16:21.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2781999999999996e-05 2024-09-12T16:16:21.938 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.938 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.938 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.939 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:614 3.1e 3:781126e5:::rbd_data.11551fa285fd.0000000000000001:5 [sparse-read 7536640~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:21.939 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.317414+0000", 2024-09-12T16:16:21.939 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.537515964000001, 2024-09-12T16:16:21.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039935709999999996, 2024-09-12T16:16:21.939 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:21.939 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:21.939 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:21.939 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:21.939 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:21.939 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:21.939 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 614 2024-09-12T16:16:21.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.940 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:21.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:21.940 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317414+0000", 2024-09-12T16:16:21.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:21.940 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317414+0000", 2024-09-12T16:16:21.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:21.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:21.940 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317414+0000", 2024-09-12T16:16:21.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.05e-07 2024-09-12T16:16:21.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.941 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:21.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317418+0000", 2024-09-12T16:16:21.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5329999999999999e-06 2024-09-12T16:16:21.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.941 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:21.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317423+0000", 2024-09-12T16:16:21.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2780000000000001e-06 2024-09-12T16:16:21.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.941 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:21.942 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317428+0000", 2024-09-12T16:16:21.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.763e-06 2024-09-12T16:16:21.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.942 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:21.942 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321217+0000", 2024-09-12T16:16:21.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003788816 2024-09-12T16:16:21.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.942 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:21.942 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321307+0000", 2024-09-12T16:16:21.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0142999999999994e-05 2024-09-12T16:16:21.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:21.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:21.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:21.943 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321408+0000", 2024-09-12T16:16:21.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000100833 2024-09-12T16:16:21.943 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.943 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.943 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.943 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:21.943 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:21.943 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:21.945 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:16:21.945 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:21.944+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:22.045 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:22.045+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:22.068 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:22.068 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:16:22.068 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:16:22.068 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:22.077 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:16:22.090 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T16:16:22.146 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:22.146+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:22.247 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:22.246+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:22.251 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:22.252 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:16:22.252 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:16:22.252 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:16:22.252 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:22.260 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:16:22.348 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:22.347+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:22.397 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:22.397 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:16:22.397 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:16:22.397 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:16:22.397 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.397 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:16:22.397 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:16:22.397 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 40.630973482000002, 2024-09-12T16:16:22.397 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55645454900000002, 2024-09-12T16:16:22.397 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.397 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.398 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:22.398 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.398 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:16:22.398 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:16:22.398 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1 2024-09-12T16:16:22.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.398 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.398 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.398 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:16:22.398 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.398 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.399 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:16:22.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.399 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.399 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.399 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764440+0000", 2024-09-12T16:16:22.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6249999999999999e-06 2024-09-12T16:16:22.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.399 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.399 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.399 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764447+0000", 2024-09-12T16:16:22.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4939999999999997e-06 2024-09-12T16:16:22.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.399 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.399 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.400 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764459+0000", 2024-09-12T16:16:22.400 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1517e-05 2024-09-12T16:16:22.400 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.400 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.400 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.400 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764468+0000", 2024-09-12T16:16:22.400 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7690000000000002e-06 2024-09-12T16:16:22.400 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.400 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.400 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:22.400 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764539+0000", 2024-09-12T16:16:22.400 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1103e-05 2024-09-12T16:16:22.400 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.401 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.401 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:16:22.401 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764551+0000", 2024-09-12T16:16:22.401 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2687999999999999e-05 2024-09-12T16:16:22.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.401 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.401 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:22.401 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319497+0000", 2024-09-12T16:16:22.401 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55494560500000001 2024-09-12T16:16:22.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.401 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.401 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:22.401 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319688+0000", 2024-09-12T16:16:22.401 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019105599999999999 2024-09-12T16:16:22.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.402 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:16:22.402 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319842+0000", 2024-09-12T16:16:22.402 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015377699999999999 2024-09-12T16:16:22.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.402 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:22.402 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320473+0000", 2024-09-12T16:16:22.402 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00063117100000000003 2024-09-12T16:16:22.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.402 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:22.402 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320825+0000", 2024-09-12T16:16:22.402 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00035202500000000001 2024-09-12T16:16:22.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.403 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.403 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:22.403 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320867+0000", 2024-09-12T16:16:22.403 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2005000000000002e-05 2024-09-12T16:16:22.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.403 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.403 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:22.403 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320893+0000", 2024-09-12T16:16:22.403 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5714000000000001e-05 2024-09-12T16:16:22.403 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.403 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.403 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.403 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.404 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14034 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5035008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:22.404 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:16:22.404 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.8739152489999999, 2024-09-12T16:16:22.404 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053404082999999998, 2024-09-12T16:16:22.404 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.404 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.404 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:22.404 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.404 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.404 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.404 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14034 2024-09-12T16:16:22.404 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.404 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.405 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.405 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.405 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:16:22.405 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.405 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.405 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.405 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:16:22.405 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.405 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.405 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.405 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521740+0000", 2024-09-12T16:16:22.405 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000243976 2024-09-12T16:16:22.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.406 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521745+0000", 2024-09-12T16:16:22.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1280000000000001e-06 2024-09-12T16:16:22.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.406 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521757+0000", 2024-09-12T16:16:22.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2751e-05 2024-09-12T16:16:22.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.406 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521771+0000", 2024-09-12T16:16:22.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3328e-05 2024-09-12T16:16:22.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.407 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:22.407 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574710+0000", 2024-09-12T16:16:22.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052939358999999998 2024-09-12T16:16:22.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.407 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:22.407 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574799+0000", 2024-09-12T16:16:22.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8893000000000004e-05 2024-09-12T16:16:22.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.407 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:22.407 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574901+0000", 2024-09-12T16:16:22.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101648 2024-09-12T16:16:22.408 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.408 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.408 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.408 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.408 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14035 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5039104~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:22.408 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521790+0000", 2024-09-12T16:16:22.408 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.8736220079999999, 2024-09-12T16:16:22.408 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053360027999999997, 2024-09-12T16:16:22.408 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.408 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.408 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:22.408 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.409 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.409 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.409 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14035 2024-09-12T16:16:22.409 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.409 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.409 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.409 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.409 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521790+0000", 2024-09-12T16:16:22.409 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.409 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.409 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.409 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.409 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521790+0000", 2024-09-12T16:16:22.410 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.410 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.410 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.410 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.410 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521927+0000", 2024-09-12T16:16:22.410 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013764699999999999 2024-09-12T16:16:22.410 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.410 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.410 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.410 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521930+0000", 2024-09-12T16:16:22.410 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.084e-06 2024-09-12T16:16:22.410 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.410 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.411 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521938+0000", 2024-09-12T16:16:22.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8280000000000003e-06 2024-09-12T16:16:22.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.411 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.411 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521943+0000", 2024-09-12T16:16:22.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3019999999999996e-06 2024-09-12T16:16:22.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.411 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.411 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:22.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574949+0000", 2024-09-12T16:16:22.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053006596000000003 2024-09-12T16:16:22.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.412 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:22.412 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575042+0000", 2024-09-12T16:16:22.412 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3157000000000003e-05 2024-09-12T16:16:22.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.412 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:22.412 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575150+0000", 2024-09-12T16:16:22.412 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000107414 2024-09-12T16:16:22.412 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.412 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.412 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.413 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14036 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5043200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:22.413 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:16:22.413 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.8734560550000001, 2024-09-12T16:16:22.413 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053426247000000003, 2024-09-12T16:16:22.413 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.413 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.413 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:22.413 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.413 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.413 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.413 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14036 2024-09-12T16:16:22.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.413 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.414 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.414 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.414 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:16:22.414 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.414 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.414 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.414 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:16:22.414 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.414 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.414 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.414 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522208+0000", 2024-09-12T16:16:22.414 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025195300000000002 2024-09-12T16:16:22.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.415 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.415 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.415 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522211+0000", 2024-09-12T16:16:22.415 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2160000000000002e-06 2024-09-12T16:16:22.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.415 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.415 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.415 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522223+0000", 2024-09-12T16:16:22.415 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2044e-05 2024-09-12T16:16:22.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.415 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.415 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.416 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522229+0000", 2024-09-12T16:16:22.416 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8850000000000004e-06 2024-09-12T16:16:22.416 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.416 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.416 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:22.416 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575192+0000", 2024-09-12T16:16:22.416 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052963573 2024-09-12T16:16:22.416 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.416 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.416 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:22.416 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575282+0000", 2024-09-12T16:16:22.416 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9666000000000005e-05 2024-09-12T16:16:22.416 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.416 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.416 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:22.417 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575382+0000", 2024-09-12T16:16:22.417 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9909999999999997e-05 2024-09-12T16:16:22.417 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.417 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.417 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.417 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.417 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14037 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5047296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:22.417 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522245+0000", 2024-09-12T16:16:22.417 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.87316722, 2024-09-12T16:16:22.417 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053384907000000002, 2024-09-12T16:16:22.417 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.417 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.417 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:22.418 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.418 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.418 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.418 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14037 2024-09-12T16:16:22.418 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.418 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.418 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.418 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.418 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522245+0000", 2024-09-12T16:16:22.418 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.418 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.418 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.418 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.419 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522245+0000", 2024-09-12T16:16:22.419 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.419 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.419 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.419 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.419 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522471+0000", 2024-09-12T16:16:22.419 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022601300000000001 2024-09-12T16:16:22.419 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.419 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.419 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.419 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522474+0000", 2024-09-12T16:16:22.419 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3390000000000001e-06 2024-09-12T16:16:22.419 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.419 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.420 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.420 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522482+0000", 2024-09-12T16:16:22.420 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7919999999999993e-06 2024-09-12T16:16:22.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.420 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.420 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.420 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522486+0000", 2024-09-12T16:16:22.420 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5109999999999997e-06 2024-09-12T16:16:22.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.420 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.420 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:22.420 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575433+0000", 2024-09-12T16:16:22.420 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052946673999999999 2024-09-12T16:16:22.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.421 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.421 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:22.421 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575532+0000", 2024-09-12T16:16:22.421 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9128000000000004e-05 2024-09-12T16:16:22.421 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.421 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.421 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:22.421 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575629+0000", 2024-09-12T16:16:22.421 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7449999999999997e-05 2024-09-12T16:16:22.421 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.421 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.421 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.421 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.421 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.421 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14038 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5051392~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:22.422 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:16:22.422 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.8729176819999998, 2024-09-12T16:16:22.422 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053395152000000001, 2024-09-12T16:16:22.422 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.422 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.422 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:22.422 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.422 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.422 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.422 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14038 2024-09-12T16:16:22.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.422 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.422 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.422 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.422 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:16:22.423 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.423 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.423 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.423 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.423 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:16:22.423 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.423 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.423 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.423 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.423 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522601+0000", 2024-09-12T16:16:22.423 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010702899999999999 2024-09-12T16:16:22.423 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.423 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.423 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.424 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522605+0000", 2024-09-12T16:16:22.424 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2379999999999999e-06 2024-09-12T16:16:22.424 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.424 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.424 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.424 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522616+0000", 2024-09-12T16:16:22.424 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1185999999999999e-05 2024-09-12T16:16:22.424 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.424 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.424 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.424 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522624+0000", 2024-09-12T16:16:22.424 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1099999999999997e-06 2024-09-12T16:16:22.424 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.424 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.425 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:22.425 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575677+0000", 2024-09-12T16:16:22.425 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053126999999999 2024-09-12T16:16:22.425 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.425 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.425 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:22.425 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575764+0000", 2024-09-12T16:16:22.425 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7250000000000007e-05 2024-09-12T16:16:22.425 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.425 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.425 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:22.425 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575889+0000", 2024-09-12T16:16:22.425 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012521200000000001 2024-09-12T16:16:22.425 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.425 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.426 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.426 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.426 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.426 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14039 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5055488~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:22.426 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:16:22.426 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.8727762710000002, 2024-09-12T16:16:22.426 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053466207000000002, 2024-09-12T16:16:22.426 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.426 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.426 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:22.426 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.426 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.426 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.426 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14039 2024-09-12T16:16:22.427 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.427 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.427 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.427 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.427 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:16:22.427 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.427 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.427 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.427 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.427 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:16:22.427 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.427 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.427 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.427 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.427 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522899+0000", 2024-09-12T16:16:22.428 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026318199999999999 2024-09-12T16:16:22.428 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.428 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.428 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.428 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522903+0000", 2024-09-12T16:16:22.428 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.929e-06 2024-09-12T16:16:22.428 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.428 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.428 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.428 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522913+0000", 2024-09-12T16:16:22.428 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0162e-05 2024-09-12T16:16:22.428 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.428 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.429 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.429 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522921+0000", 2024-09-12T16:16:22.429 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.14e-06 2024-09-12T16:16:22.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.429 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.429 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:22.429 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575922+0000", 2024-09-12T16:16:22.429 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053000712999999998 2024-09-12T16:16:22.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.429 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.429 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:22.429 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576006+0000", 2024-09-12T16:16:22.429 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4161999999999998e-05 2024-09-12T16:16:22.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.429 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.430 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:22.430 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576102+0000", 2024-09-12T16:16:22.430 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5919000000000001e-05 2024-09-12T16:16:22.430 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.430 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.430 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.430 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.430 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.430 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14040 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5059584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:22.430 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:16:22.430 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.872471376, 2024-09-12T16:16:22.430 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053413258999999998, 2024-09-12T16:16:22.430 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.430 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.430 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:22.431 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.431 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.431 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.431 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14040 2024-09-12T16:16:22.431 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.431 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.431 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.431 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.431 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:16:22.431 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.431 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.431 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.431 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.431 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:16:22.431 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.432 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.432 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.432 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.432 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523059+0000", 2024-09-12T16:16:22.432 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118466 2024-09-12T16:16:22.432 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.432 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.432 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.432 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523062+0000", 2024-09-12T16:16:22.432 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.971e-06 2024-09-12T16:16:22.432 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.432 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.433 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.433 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523069+0000", 2024-09-12T16:16:22.433 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8279999999999997e-06 2024-09-12T16:16:22.433 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.433 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.433 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.433 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523073+0000", 2024-09-12T16:16:22.433 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3019999999999996e-06 2024-09-12T16:16:22.433 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.433 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.433 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:22.433 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576155+0000", 2024-09-12T16:16:22.433 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053081962000000003 2024-09-12T16:16:22.433 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.434 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.434 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:22.434 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576249+0000", 2024-09-12T16:16:22.434 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3914999999999998e-05 2024-09-12T16:16:22.434 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.434 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.434 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:22.434 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576354+0000", 2024-09-12T16:16:22.434 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010481500000000001 2024-09-12T16:16:22.434 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.434 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.434 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.434 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.434 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.434 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14041 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5063680~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:22.434 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:16:22.435 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.872321071, 2024-09-12T16:16:22.435 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053519111000000001, 2024-09-12T16:16:22.435 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.435 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.435 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:22.435 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.435 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.435 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.435 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14041 2024-09-12T16:16:22.435 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.435 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.435 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.435 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.435 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:16:22.435 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.436 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.436 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.436 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.436 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:16:22.436 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.436 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.436 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.436 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.436 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523309+0000", 2024-09-12T16:16:22.436 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000218712 2024-09-12T16:16:22.436 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.436 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.437 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.437 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523313+0000", 2024-09-12T16:16:22.437 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.151e-06 2024-09-12T16:16:22.437 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.437 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.437 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.437 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523320+0000", 2024-09-12T16:16:22.437 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9789999999999993e-06 2024-09-12T16:16:22.437 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.437 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.437 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.437 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523325+0000", 2024-09-12T16:16:22.437 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:16:22.437 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.438 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.438 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:22.438 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576402+0000", 2024-09-12T16:16:22.438 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053076811000000002 2024-09-12T16:16:22.438 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.438 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.438 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:22.438 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576491+0000", 2024-09-12T16:16:22.438 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8578999999999993e-05 2024-09-12T16:16:22.438 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.438 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.438 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:22.438 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576610+0000", 2024-09-12T16:16:22.438 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119129 2024-09-12T16:16:22.438 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.439 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.439 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.439 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.439 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.439 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14042 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5067776~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:22.439 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:16:22.439 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.8720776369999999, 2024-09-12T16:16:22.439 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053510350999999998, 2024-09-12T16:16:22.439 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.439 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.439 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:22.439 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.439 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.439 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.439 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14042 2024-09-12T16:16:22.440 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.440 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.440 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.440 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.440 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:16:22.440 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.440 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.440 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.440 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.440 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:16:22.440 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.440 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.440 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.440 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.441 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523591+0000", 2024-09-12T16:16:22.441 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025710300000000001 2024-09-12T16:16:22.441 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.441 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.441 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.441 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523594+0000", 2024-09-12T16:16:22.441 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2229999999999999e-06 2024-09-12T16:16:22.441 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.441 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.441 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.441 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523602+0000", 2024-09-12T16:16:22.441 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6930000000000007e-06 2024-09-12T16:16:22.441 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.442 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.442 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.442 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523607+0000", 2024-09-12T16:16:22.442 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4789999999999998e-06 2024-09-12T16:16:22.442 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.442 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.442 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:22.442 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576661+0000", 2024-09-12T16:16:22.442 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053973999999997 2024-09-12T16:16:22.442 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.442 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.442 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:22.442 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576745+0000", 2024-09-12T16:16:22.443 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4660000000000006e-05 2024-09-12T16:16:22.443 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.443 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.443 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:22.443 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576844+0000", 2024-09-12T16:16:22.443 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9219e-05 2024-09-12T16:16:22.443 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.443 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.443 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.443 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.443 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.443 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14043 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5071872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:22.443 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:16:22.443 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.8717971580000001, 2024-09-12T16:16:22.444 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053475295999999999, 2024-09-12T16:16:22.444 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.444 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.444 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:22.444 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.444 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.444 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.444 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14043 2024-09-12T16:16:22.444 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.444 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.444 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.444 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.444 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:16:22.444 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.445 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.445 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.445 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.445 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:16:22.445 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.445 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.445 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.445 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.445 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523823+0000", 2024-09-12T16:16:22.445 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020818900000000001 2024-09-12T16:16:22.445 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.445 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.445 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.445 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523826+0000", 2024-09-12T16:16:22.446 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.405e-06 2024-09-12T16:16:22.446 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.446 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.446 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.446 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523834+0000", 2024-09-12T16:16:22.446 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5499999999999997e-06 2024-09-12T16:16:22.446 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.446 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.446 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.446 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523838+0000", 2024-09-12T16:16:22.446 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.408e-06 2024-09-12T16:16:22.446 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.446 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.446 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:22.447 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576904+0000", 2024-09-12T16:16:22.447 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053065687 2024-09-12T16:16:22.447 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.447 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.447 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:22.447 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576991+0000", 2024-09-12T16:16:22.447 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7399999999999997e-05 2024-09-12T16:16:22.447 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.447 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.447 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:22.447 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577090+0000", 2024-09-12T16:16:22.447 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8657000000000001e-05 2024-09-12T16:16:22.447 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.447 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.448 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.448 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.448 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.448 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14044 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5075968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:22.448 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:16:22.448 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.8715656279999999, 2024-09-12T16:16:22.448 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053442659000000003, 2024-09-12T16:16:22.448 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.448 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.448 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:22.448 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.448 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.448 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.448 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14044 2024-09-12T16:16:22.448 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.449 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.449 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.449 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.449 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:16:22.449 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.449 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.449 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.449 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.449 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:16:22.449 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.449 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.449 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.452 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.452 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523985+0000", 2024-09-12T16:16:22.452 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000138522 2024-09-12T16:16:22.452 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.452 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.452 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.452 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523988+0000", 2024-09-12T16:16:22.452 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.788e-06 2024-09-12T16:16:22.453 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.453 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.453 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.453 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523998+0000", 2024-09-12T16:16:22.453 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8470000000000008e-06 2024-09-12T16:16:22.453 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.453 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.453 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.453 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524010+0000", 2024-09-12T16:16:22.453 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1348999999999999e-05 2024-09-12T16:16:22.453 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.453 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.453 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:22.453 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577137+0000", 2024-09-12T16:16:22.453 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053127055999999999 2024-09-12T16:16:22.454 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.454 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.454 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:22.454 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577210+0000", 2024-09-12T16:16:22.454 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3392000000000005e-05 2024-09-12T16:16:22.454 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.454 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.454 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:22.454 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577289+0000", 2024-09-12T16:16:22.454 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8704999999999999e-05 2024-09-12T16:16:22.454 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.454 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.454 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.455 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.455 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.455 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14045 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5080064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:22.455 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:16:22.455 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.8713868069999999, 2024-09-12T16:16:22.455 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053497514000000003, 2024-09-12T16:16:22.455 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.455 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.455 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:22.455 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.455 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.455 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.455 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14045 2024-09-12T16:16:22.455 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.456 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.456 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.456 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.456 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:16:22.456 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.456 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.456 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.456 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.456 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:16:22.456 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.456 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.456 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.456 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.456 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524311+0000", 2024-09-12T16:16:22.457 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028626299999999998 2024-09-12T16:16:22.457 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.457 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.457 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.457 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524315+0000", 2024-09-12T16:16:22.457 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0969999999999999e-06 2024-09-12T16:16:22.457 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.457 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.457 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.457 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524325+0000", 2024-09-12T16:16:22.457 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6330000000000008e-06 2024-09-12T16:16:22.457 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.457 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.457 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.458 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524332+0000", 2024-09-12T16:16:22.458 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8700000000000003e-06 2024-09-12T16:16:22.458 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.458 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.458 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:22.458 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577334+0000", 2024-09-12T16:16:22.458 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053001834999999997 2024-09-12T16:16:22.458 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.458 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.458 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:22.458 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577420+0000", 2024-09-12T16:16:22.458 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6145999999999998e-05 2024-09-12T16:16:22.458 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.458 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.458 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:22.459 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577522+0000", 2024-09-12T16:16:22.459 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010267 2024-09-12T16:16:22.459 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.459 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.459 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.459 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.459 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.459 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14047 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5088256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:22.459 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:16:22.459 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.870901081, 2024-09-12T16:16:22.459 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053433340000000003, 2024-09-12T16:16:22.459 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.459 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.460 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:22.460 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.460 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.460 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.460 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14047 2024-09-12T16:16:22.460 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.460 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.460 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.460 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.460 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:16:22.460 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.460 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.460 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.461 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.461 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:16:22.461 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.461 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.461 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.461 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.461 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524727+0000", 2024-09-12T16:16:22.461 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000216126 2024-09-12T16:16:22.461 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.461 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.461 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.461 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524732+0000", 2024-09-12T16:16:22.461 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1569999999999999e-06 2024-09-12T16:16:22.461 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.462 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.462 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.462 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524742+0000", 2024-09-12T16:16:22.462 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0186999999999999e-05 2024-09-12T16:16:22.462 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.462 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.462 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.462 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524750+0000", 2024-09-12T16:16:22.462 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4279999999999999e-06 2024-09-12T16:16:22.462 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.462 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.462 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:22.462 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577743+0000", 2024-09-12T16:16:22.462 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052993077 2024-09-12T16:16:22.462 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.463 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.463 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:22.463 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577841+0000", 2024-09-12T16:16:22.463 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8369000000000006e-05 2024-09-12T16:16:22.463 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.463 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.463 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:22.463 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577944+0000", 2024-09-12T16:16:22.463 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102996 2024-09-12T16:16:22.464 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.464 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.464 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.464 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.464 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.464 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14048 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5092352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:22.464 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:16:22.464 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.8706494879999997, 2024-09-12T16:16:22.464 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053397515, 2024-09-12T16:16:22.464 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.464 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.464 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:22.464 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.464 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.464 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.465 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14048 2024-09-12T16:16:22.465 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.465 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.465 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.465 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.465 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:16:22.465 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.465 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.465 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.465 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.465 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:16:22.465 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.465 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.465 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.466 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.466 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524957+0000", 2024-09-12T16:16:22.466 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019516999999999999 2024-09-12T16:16:22.466 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.466 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.466 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.466 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524962+0000", 2024-09-12T16:16:22.466 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7709999999999997e-06 2024-09-12T16:16:22.466 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.466 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.466 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.466 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524973+0000", 2024-09-12T16:16:22.466 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1031e-05 2024-09-12T16:16:22.466 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.466 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.467 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.467 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524980+0000", 2024-09-12T16:16:22.467 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6100000000000002e-06 2024-09-12T16:16:22.467 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.467 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.467 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:22.467 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577977+0000", 2024-09-12T16:16:22.467 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052997481999999999 2024-09-12T16:16:22.467 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.467 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.467 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:22.467 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578062+0000", 2024-09-12T16:16:22.467 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4851000000000005e-05 2024-09-12T16:16:22.467 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.468 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.468 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:22.468 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578160+0000", 2024-09-12T16:16:22.468 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7600000000000001e-05 2024-09-12T16:16:22.468 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.468 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.468 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.468 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.468 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.468 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14049 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5096448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:22.468 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:16:22.468 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.8704208599999999, 2024-09-12T16:16:22.468 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053439792, 2024-09-12T16:16:22.469 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.469 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.469 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:22.469 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.469 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.469 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.469 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14049 2024-09-12T16:16:22.469 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.469 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.469 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.469 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.469 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:16:22.469 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.470 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.470 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.470 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.470 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:16:22.470 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.470 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.470 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.470 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.470 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525170+0000", 2024-09-12T16:16:22.470 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017958500000000001 2024-09-12T16:16:22.470 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.470 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.470 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.470 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525174+0000", 2024-09-12T16:16:22.471 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0239999999999999e-06 2024-09-12T16:16:22.471 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.471 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.471 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.471 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525184+0000", 2024-09-12T16:16:22.471 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5950000000000005e-06 2024-09-12T16:16:22.471 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.471 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.471 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.471 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525191+0000", 2024-09-12T16:16:22.471 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8329999999999996e-06 2024-09-12T16:16:22.471 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.471 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.471 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:22.472 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578240+0000", 2024-09-12T16:16:22.472 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053049236 2024-09-12T16:16:22.472 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.472 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.472 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:22.472 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578333+0000", 2024-09-12T16:16:22.472 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2806999999999994e-05 2024-09-12T16:16:22.472 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.472 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.472 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:22.472 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578431+0000", 2024-09-12T16:16:22.472 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7712000000000002e-05 2024-09-12T16:16:22.472 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.472 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.473 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.473 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.473 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.473 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14050 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5100544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:22.473 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.525201+0000", 2024-09-12T16:16:22.473 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.8702103069999998, 2024-09-12T16:16:22.473 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053367398000000003, 2024-09-12T16:16:22.473 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.473 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.473 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:22.473 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.473 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.473 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.474 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14050 2024-09-12T16:16:22.474 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.474 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.474 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.474 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.474 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525201+0000", 2024-09-12T16:16:22.474 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.474 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.474 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.474 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.474 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525201+0000", 2024-09-12T16:16:22.474 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.475 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.475 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.475 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.475 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525449+0000", 2024-09-12T16:16:22.475 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00024803999999999999 2024-09-12T16:16:22.475 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.475 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.475 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.475 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525453+0000", 2024-09-12T16:16:22.475 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.036e-06 2024-09-12T16:16:22.475 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.475 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.475 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.475 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525462+0000", 2024-09-12T16:16:22.476 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6090000000000001e-06 2024-09-12T16:16:22.476 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.476 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.476 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.476 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525472+0000", 2024-09-12T16:16:22.476 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9629999999999993e-06 2024-09-12T16:16:22.476 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.476 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.476 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:22.476 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578469+0000", 2024-09-12T16:16:22.476 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052996877999999997 2024-09-12T16:16:22.476 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.477 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.477 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:22.477 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578514+0000", 2024-09-12T16:16:22.477 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5460000000000002e-05 2024-09-12T16:16:22.477 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.477 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.477 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:22.477 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578569+0000", 2024-09-12T16:16:22.477 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4412e-05 2024-09-12T16:16:22.477 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.477 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.477 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.477 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.477 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.477 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14054 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5116928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:22.478 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.526046+0000", 2024-09-12T16:16:22.478 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.8693655109999998, 2024-09-12T16:16:22.478 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053378408000000002, 2024-09-12T16:16:22.478 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.478 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.478 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:22.478 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.478 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.478 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.478 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14054 2024-09-12T16:16:22.478 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.478 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.478 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.478 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.478 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526046+0000", 2024-09-12T16:16:22.479 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.479 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.479 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.479 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.479 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526046+0000", 2024-09-12T16:16:22.479 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.479 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.479 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.479 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.479 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526228+0000", 2024-09-12T16:16:22.479 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018200200000000001 2024-09-12T16:16:22.479 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.479 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.479 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.479 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526236+0000", 2024-09-12T16:16:22.480 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5109999999999997e-06 2024-09-12T16:16:22.480 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.480 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.480 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.480 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526245+0000", 2024-09-12T16:16:22.480 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9600000000000006e-06 2024-09-12T16:16:22.480 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.480 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.480 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.480 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526251+0000", 2024-09-12T16:16:22.480 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5520000000000001e-06 2024-09-12T16:16:22.480 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.480 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.480 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:22.481 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579226+0000", 2024-09-12T16:16:22.481 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052974343 2024-09-12T16:16:22.481 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.481 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.481 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:22.481 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579324+0000", 2024-09-12T16:16:22.481 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8517000000000006e-05 2024-09-12T16:16:22.481 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.481 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.481 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:22.481 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579425+0000", 2024-09-12T16:16:22.481 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000100523 2024-09-12T16:16:22.481 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.481 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.481 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.482 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.482 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.482 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14055 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5121024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:22.482 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:16:22.482 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.8691501690000001, 2024-09-12T16:16:22.482 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053399038000000003, 2024-09-12T16:16:22.482 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.482 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.482 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:22.482 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.482 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.482 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.482 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14055 2024-09-12T16:16:22.482 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.482 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.483 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.483 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.483 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:16:22.483 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.483 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.483 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.483 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.483 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:16:22.483 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.483 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.483 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.483 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.483 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526403+0000", 2024-09-12T16:16:22.483 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141571 2024-09-12T16:16:22.484 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.484 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.484 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.484 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526406+0000", 2024-09-12T16:16:22.484 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2660000000000002e-06 2024-09-12T16:16:22.484 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.484 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.484 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.484 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526420+0000", 2024-09-12T16:16:22.484 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3949e-05 2024-09-12T16:16:22.484 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.484 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.484 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.484 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526428+0000", 2024-09-12T16:16:22.485 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4250000000000001e-06 2024-09-12T16:16:22.485 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.485 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.485 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:22.485 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579476+0000", 2024-09-12T16:16:22.485 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053048349000000002 2024-09-12T16:16:22.485 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.485 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.485 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:22.485 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579563+0000", 2024-09-12T16:16:22.485 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6502999999999995e-05 2024-09-12T16:16:22.485 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.485 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.485 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:22.486 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579661+0000", 2024-09-12T16:16:22.486 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7974999999999996e-05 2024-09-12T16:16:22.486 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.486 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.486 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.486 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.486 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.486 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14056 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5125120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:22.486 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.526441+0000", 2024-09-12T16:16:22.486 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.8689707279999999, 2024-09-12T16:16:22.486 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053361440000000003, 2024-09-12T16:16:22.486 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.486 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.486 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:22.486 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.487 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.487 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.487 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14056 2024-09-12T16:16:22.487 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.487 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.487 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.487 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.487 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526441+0000", 2024-09-12T16:16:22.487 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.487 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.487 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.487 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.487 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526441+0000", 2024-09-12T16:16:22.487 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.487 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.487 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.488 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.488 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526707+0000", 2024-09-12T16:16:22.488 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026625599999999998 2024-09-12T16:16:22.488 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.488 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.488 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.488 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526711+0000", 2024-09-12T16:16:22.488 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.844e-06 2024-09-12T16:16:22.488 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.488 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.488 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.488 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526720+0000", 2024-09-12T16:16:22.488 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.704e-06 2024-09-12T16:16:22.488 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.488 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.489 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.489 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526726+0000", 2024-09-12T16:16:22.489 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4679999999999997e-06 2024-09-12T16:16:22.489 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.489 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.489 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:22.489 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579700+0000", 2024-09-12T16:16:22.489 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052973428000000003 2024-09-12T16:16:22.489 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.489 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.489 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:22.489 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579745+0000", 2024-09-12T16:16:22.489 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.494e-05 2024-09-12T16:16:22.490 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.490 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.490 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:22.490 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579802+0000", 2024-09-12T16:16:22.490 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7800000000000002e-05 2024-09-12T16:16:22.490 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.490 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.490 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.490 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.490 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.490 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:22.491 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T16:16:22.492 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:16:22.493 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:22.491+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:22.592 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:22.592+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:22.614 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:16:22.615 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:16:22.632 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:16:22.632 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:16:22.648 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:16:22.649 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:16:22.666 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:16:22.666 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:16:22.677 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:22.678 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:16:22.678 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.678 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29939 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.678 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.649840+0000", 2024-09-12T16:16:22.678 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014137561999999999, 2024-09-12T16:16:22.678 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014150510999999999, 2024-09-12T16:16:22.678 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.678 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.678 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.678 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.678 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.678 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.679 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29939 2024-09-12T16:16:22.679 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.679 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.679 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.679 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.679 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.649840+0000", 2024-09-12T16:16:22.679 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.679 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.679 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.679 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.679 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.649840+0000", 2024-09-12T16:16:22.679 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.679 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.679 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.679 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.680 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.649841+0000", 2024-09-12T16:16:22.680 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.06e-07 2024-09-12T16:16:22.680 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.680 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.680 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.680 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.649843+0000", 2024-09-12T16:16:22.680 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1390000000000002e-06 2024-09-12T16:16:22.680 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.680 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.680 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.680 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.649850+0000", 2024-09-12T16:16:22.680 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7499999999999997e-06 2024-09-12T16:16:22.680 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.680 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.681 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.681 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.649855+0000", 2024-09-12T16:16:22.681 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3650000000000003e-06 2024-09-12T16:16:22.681 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.681 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.681 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.681 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.681 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.681 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29971 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.681 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.650795+0000", 2024-09-12T16:16:22.681 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013183185, 2024-09-12T16:16:22.681 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013226813, 2024-09-12T16:16:22.682 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.682 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.682 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.682 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.682 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.682 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.682 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29971 2024-09-12T16:16:22.682 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.682 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.682 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.682 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.682 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650795+0000", 2024-09-12T16:16:22.682 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.682 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.682 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.683 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.683 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650795+0000", 2024-09-12T16:16:22.683 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.683 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.683 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.683 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.683 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650795+0000", 2024-09-12T16:16:22.683 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4900000000000002e-07 2024-09-12T16:16:22.683 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.683 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.683 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.683 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650796+0000", 2024-09-12T16:16:22.683 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4500000000000001e-06 2024-09-12T16:16:22.683 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.683 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.684 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.684 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650800+0000", 2024-09-12T16:16:22.684 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4599999999999999e-06 2024-09-12T16:16:22.684 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.684 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.684 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.684 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650802+0000", 2024-09-12T16:16:22.684 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7190000000000001e-06 2024-09-12T16:16:22.684 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.684 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.684 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.684 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.684 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.685 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30003 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.685 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651504+0000", 2024-09-12T16:16:22.685 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012473362, 2024-09-12T16:16:22.685 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012544931, 2024-09-12T16:16:22.685 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.685 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.685 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.685 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.685 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.685 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.685 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30003 2024-09-12T16:16:22.685 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.685 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.685 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.686 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.686 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651504+0000", 2024-09-12T16:16:22.686 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.686 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.686 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.686 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.686 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651504+0000", 2024-09-12T16:16:22.686 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.686 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.686 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.686 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.686 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651505+0000", 2024-09-12T16:16:22.686 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2300000000000002e-07 2024-09-12T16:16:22.686 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.687 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.687 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.687 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651506+0000", 2024-09-12T16:16:22.687 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3039999999999999e-06 2024-09-12T16:16:22.687 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.687 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.687 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.687 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651509+0000", 2024-09-12T16:16:22.687 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3459999999999998e-06 2024-09-12T16:16:22.687 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.687 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.687 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.687 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651512+0000", 2024-09-12T16:16:22.687 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6599999999999999e-06 2024-09-12T16:16:22.688 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.688 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.688 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.688 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.688 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.688 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30035 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.688 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652289+0000", 2024-09-12T16:16:22.688 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011689055, 2024-09-12T16:16:22.688 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011783678000000001, 2024-09-12T16:16:22.688 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.688 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.688 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.688 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.689 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.689 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.689 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30035 2024-09-12T16:16:22.689 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.689 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.689 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.689 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.689 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652289+0000", 2024-09-12T16:16:22.689 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.689 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.689 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.689 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.689 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652289+0000", 2024-09-12T16:16:22.689 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.690 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.690 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.690 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.690 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652289+0000", 2024-09-12T16:16:22.690 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.32e-07 2024-09-12T16:16:22.690 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.690 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.690 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.690 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652291+0000", 2024-09-12T16:16:22.690 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.44e-06 2024-09-12T16:16:22.690 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.690 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.690 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.691 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652294+0000", 2024-09-12T16:16:22.691 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3699999999999999e-06 2024-09-12T16:16:22.691 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.691 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.691 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.691 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652297+0000", 2024-09-12T16:16:22.691 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7769999999999998e-06 2024-09-12T16:16:22.691 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.691 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.691 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.691 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.691 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.691 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30068 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.691 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652647+0000", 2024-09-12T16:16:22.692 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.01133108, 2024-09-12T16:16:22.692 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011450495999999999, 2024-09-12T16:16:22.692 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.692 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.692 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.692 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.692 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.692 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.692 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30068 2024-09-12T16:16:22.692 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.692 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.692 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.692 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.693 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652647+0000", 2024-09-12T16:16:22.693 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.693 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.693 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.693 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.693 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652647+0000", 2024-09-12T16:16:22.693 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.693 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.693 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.693 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.693 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652647+0000", 2024-09-12T16:16:22.693 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1500000000000001e-07 2024-09-12T16:16:22.693 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.694 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.694 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.694 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652648+0000", 2024-09-12T16:16:22.694 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.051e-06 2024-09-12T16:16:22.694 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.694 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.694 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.694 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652651+0000", 2024-09-12T16:16:22.694 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9809999999999999e-06 2024-09-12T16:16:22.694 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.694 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.694 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.695 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652653+0000", 2024-09-12T16:16:22.695 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5280000000000002e-06 2024-09-12T16:16:22.695 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.695 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.695 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.695 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.695 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.695 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30106 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.695 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.653285+0000", 2024-09-12T16:16:22.695 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.010692685, 2024-09-12T16:16:22.695 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010839140000000001, 2024-09-12T16:16:22.695 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.695 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.696 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.696 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.696 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.696 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.696 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30106 2024-09-12T16:16:22.696 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.696 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.696 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.696 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.696 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653285+0000", 2024-09-12T16:16:22.696 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.696 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.696 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.696 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.697 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653285+0000", 2024-09-12T16:16:22.697 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.697 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.697 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.697 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.697 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658336+0000", 2024-09-12T16:16:22.697 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050504340000000003 2024-09-12T16:16:22.697 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.697 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.697 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.697 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658340+0000", 2024-09-12T16:16:22.697 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4510000000000002e-06 2024-09-12T16:16:22.697 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.698 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.698 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.698 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658349+0000", 2024-09-12T16:16:22.698 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3829999999999998e-06 2024-09-12T16:16:22.698 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.698 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.698 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.698 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658355+0000", 2024-09-12T16:16:22.698 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8119999999999996e-06 2024-09-12T16:16:22.698 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.698 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.698 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.698 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.698 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.699 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30138 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.699 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.659079+0000", 2024-09-12T16:16:22.699 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0048987930000000002, 2024-09-12T16:16:22.699 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050680999999999999, 2024-09-12T16:16:22.699 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.699 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.699 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.699 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.699 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.699 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.699 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30138 2024-09-12T16:16:22.699 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.699 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.699 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.699 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.700 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659079+0000", 2024-09-12T16:16:22.700 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.700 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.700 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.700 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.700 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659079+0000", 2024-09-12T16:16:22.700 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.700 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.700 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.700 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.700 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659079+0000", 2024-09-12T16:16:22.700 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2800000000000003e-07 2024-09-12T16:16:22.700 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.701 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.701 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.701 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659081+0000", 2024-09-12T16:16:22.701 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.641e-06 2024-09-12T16:16:22.701 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.701 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.701 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.701 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659086+0000", 2024-09-12T16:16:22.701 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5340000000000001e-06 2024-09-12T16:16:22.701 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.701 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.701 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.702 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659088+0000", 2024-09-12T16:16:22.702 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.644e-06 2024-09-12T16:16:22.702 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.702 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.702 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.702 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.702 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.702 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29940 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.702 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.649887+0000", 2024-09-12T16:16:22.702 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014090368000000001, 2024-09-12T16:16:22.702 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014282868000000001, 2024-09-12T16:16:22.702 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.702 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.702 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.703 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.703 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.703 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.703 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29940 2024-09-12T16:16:22.703 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.703 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.703 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.703 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.703 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.649887+0000", 2024-09-12T16:16:22.703 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.703 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.703 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.703 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.703 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.649887+0000", 2024-09-12T16:16:22.703 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.704 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.704 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.704 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.704 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.649888+0000", 2024-09-12T16:16:22.704 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9599999999999999e-07 2024-09-12T16:16:22.704 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.704 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.704 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.704 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.649890+0000", 2024-09-12T16:16:22.704 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.17e-06 2024-09-12T16:16:22.704 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.704 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.704 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.704 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.649897+0000", 2024-09-12T16:16:22.705 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.917e-06 2024-09-12T16:16:22.705 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.705 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.705 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.705 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.649904+0000", 2024-09-12T16:16:22.705 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.742e-06 2024-09-12T16:16:22.705 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.705 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.705 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.705 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.705 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.705 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29972 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.705 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.650806+0000", 2024-09-12T16:16:22.705 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013171985000000001, 2024-09-12T16:16:22.706 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013387539, 2024-09-12T16:16:22.706 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.706 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.706 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.706 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.706 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.706 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.706 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29972 2024-09-12T16:16:22.706 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.706 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.706 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.706 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.706 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650806+0000", 2024-09-12T16:16:22.706 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.707 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.707 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.707 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.707 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650806+0000", 2024-09-12T16:16:22.707 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.707 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.707 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.707 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.707 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650806+0000", 2024-09-12T16:16:22.707 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1199999999999999e-07 2024-09-12T16:16:22.707 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.707 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.707 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.707 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650813+0000", 2024-09-12T16:16:22.708 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8800000000000002e-06 2024-09-12T16:16:22.708 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.708 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.708 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.708 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650817+0000", 2024-09-12T16:16:22.708 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0720000000000001e-06 2024-09-12T16:16:22.708 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.708 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.708 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.708 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650820+0000", 2024-09-12T16:16:22.708 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9280000000000002e-06 2024-09-12T16:16:22.708 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.708 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.708 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.708 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.709 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.709 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30004 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.709 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651535+0000", 2024-09-12T16:16:22.709 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012442573, 2024-09-12T16:16:22.709 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012684246, 2024-09-12T16:16:22.709 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.709 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.709 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.709 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.709 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.709 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.709 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30004 2024-09-12T16:16:22.709 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.709 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.709 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.710 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.710 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651535+0000", 2024-09-12T16:16:22.710 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.710 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.710 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.710 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.710 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651535+0000", 2024-09-12T16:16:22.710 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.710 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.710 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.710 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.710 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651536+0000", 2024-09-12T16:16:22.710 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2100000000000002e-07 2024-09-12T16:16:22.711 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.711 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.711 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.711 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651537+0000", 2024-09-12T16:16:22.711 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.403e-06 2024-09-12T16:16:22.711 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.711 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.711 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.711 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651540+0000", 2024-09-12T16:16:22.711 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3670000000000001e-06 2024-09-12T16:16:22.711 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.711 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.711 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.712 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651543+0000", 2024-09-12T16:16:22.712 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.796e-06 2024-09-12T16:16:22.712 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.712 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.712 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.712 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.712 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.712 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30036 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.712 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652300+0000", 2024-09-12T16:16:22.712 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011677662, 2024-09-12T16:16:22.712 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011951893, 2024-09-12T16:16:22.712 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.712 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.712 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.713 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.713 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.713 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.713 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30036 2024-09-12T16:16:22.713 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.713 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.713 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.713 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.713 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652300+0000", 2024-09-12T16:16:22.713 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.713 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.713 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.713 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.713 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652300+0000", 2024-09-12T16:16:22.713 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.714 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.714 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.714 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652300+0000", 2024-09-12T16:16:22.714 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0900000000000001e-07 2024-09-12T16:16:22.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.714 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.714 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.714 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652301+0000", 2024-09-12T16:16:22.714 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.111e-06 2024-09-12T16:16:22.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.714 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.714 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.715 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652304+0000", 2024-09-12T16:16:22.715 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9490000000000001e-06 2024-09-12T16:16:22.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.715 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.715 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.715 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652307+0000", 2024-09-12T16:16:22.715 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5900000000000002e-06 2024-09-12T16:16:22.715 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.715 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.715 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.715 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.715 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30069 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.715 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652656+0000", 2024-09-12T16:16:22.715 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011321369, 2024-09-12T16:16:22.715 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011619002999999999, 2024-09-12T16:16:22.716 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.716 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.716 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.716 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.716 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.716 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.716 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30069 2024-09-12T16:16:22.716 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.716 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.716 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.716 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.716 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652656+0000", 2024-09-12T16:16:22.716 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.716 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.717 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.717 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.717 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652656+0000", 2024-09-12T16:16:22.717 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.717 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.717 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.717 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652657+0000", 2024-09-12T16:16:22.717 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0800000000000001e-07 2024-09-12T16:16:22.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.717 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.717 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.717 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652662+0000", 2024-09-12T16:16:22.717 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0300000000000001e-06 2024-09-12T16:16:22.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.718 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.718 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.718 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652665+0000", 2024-09-12T16:16:22.718 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3469999999999999e-06 2024-09-12T16:16:22.718 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.718 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.718 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.718 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652668+0000", 2024-09-12T16:16:22.718 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5689999999999999e-06 2024-09-12T16:16:22.718 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.718 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.718 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.718 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.718 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.718 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30107 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.719 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.658365+0000", 2024-09-12T16:16:22.719 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0056129500000000002, 2024-09-12T16:16:22.719 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0059355399999999996, 2024-09-12T16:16:22.719 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.719 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.719 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.719 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.719 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.719 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.719 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30107 2024-09-12T16:16:22.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.719 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.719 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.719 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.719 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658365+0000", 2024-09-12T16:16:22.719 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.720 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.720 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.720 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658365+0000", 2024-09-12T16:16:22.720 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.720 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.720 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.720 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658365+0000", 2024-09-12T16:16:22.720 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2100000000000002e-07 2024-09-12T16:16:22.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.720 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.720 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.720 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658367+0000", 2024-09-12T16:16:22.720 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.818e-06 2024-09-12T16:16:22.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.721 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.721 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.721 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658372+0000", 2024-09-12T16:16:22.721 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1000000000000003e-06 2024-09-12T16:16:22.721 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.721 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.721 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.721 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658375+0000", 2024-09-12T16:16:22.721 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.993e-06 2024-09-12T16:16:22.721 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.721 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.721 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.722 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.722 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30139 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.722 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.659092+0000", 2024-09-12T16:16:22.722 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0048862020000000001, 2024-09-12T16:16:22.722 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0052313109999999998, 2024-09-12T16:16:22.722 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.722 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.722 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.722 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.722 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.722 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.722 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30139 2024-09-12T16:16:22.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.723 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.723 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.723 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.723 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659092+0000", 2024-09-12T16:16:22.723 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.723 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.723 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.723 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659092+0000", 2024-09-12T16:16:22.723 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.723 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.724 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.724 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659092+0000", 2024-09-12T16:16:22.724 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3099999999999999e-07 2024-09-12T16:16:22.724 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.724 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.724 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.724 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659093+0000", 2024-09-12T16:16:22.724 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1340000000000001e-06 2024-09-12T16:16:22.724 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.724 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.724 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.724 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659096+0000", 2024-09-12T16:16:22.725 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0149999999999999e-06 2024-09-12T16:16:22.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.725 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.725 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.725 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659099+0000", 2024-09-12T16:16:22.725 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7080000000000002e-06 2024-09-12T16:16:22.725 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.725 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.725 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.725 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.725 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29941 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.725 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.649934+0000", 2024-09-12T16:16:22.726 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.014043659999999999, 2024-09-12T16:16:22.726 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014431279999999999, 2024-09-12T16:16:22.726 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.726 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.726 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.726 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.726 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.726 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.726 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29941 2024-09-12T16:16:22.726 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.726 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.726 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.726 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.649934+0000", 2024-09-12T16:16:22.727 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.727 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.649934+0000", 2024-09-12T16:16:22.727 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.727 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.649935+0000", 2024-09-12T16:16:22.727 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7599999999999997e-07 2024-09-12T16:16:22.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.728 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.728 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.649937+0000", 2024-09-12T16:16:22.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.996e-06 2024-09-12T16:16:22.728 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.728 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.728 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.728 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.649944+0000", 2024-09-12T16:16:22.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8040000000000004e-06 2024-09-12T16:16:22.728 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.728 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.728 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.728 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.649949+0000", 2024-09-12T16:16:22.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2000000000000002e-06 2024-09-12T16:16:22.729 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.729 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.729 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.729 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.729 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29973 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.729 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.650835+0000", 2024-09-12T16:16:22.729 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013142961999999999, 2024-09-12T16:16:22.729 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01355547, 2024-09-12T16:16:22.729 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.729 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.729 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.729 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.730 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.730 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.730 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29973 2024-09-12T16:16:22.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.730 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.730 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.730 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650835+0000", 2024-09-12T16:16:22.730 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.730 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.730 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650835+0000", 2024-09-12T16:16:22.731 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.731 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.731 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650835+0000", 2024-09-12T16:16:22.731 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2800000000000002e-07 2024-09-12T16:16:22.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.731 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.731 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650837+0000", 2024-09-12T16:16:22.731 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.638e-06 2024-09-12T16:16:22.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.731 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.731 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650840+0000", 2024-09-12T16:16:22.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.49e-06 2024-09-12T16:16:22.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650843+0000", 2024-09-12T16:16:22.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.79e-06 2024-09-12T16:16:22.732 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.732 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.732 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.732 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30005 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.732 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651547+0000", 2024-09-12T16:16:22.732 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012431187, 2024-09-12T16:16:22.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012866964999999999, 2024-09-12T16:16:22.733 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.733 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.733 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.733 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.733 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.733 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.733 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30005 2024-09-12T16:16:22.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.733 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.733 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.733 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.733 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651547+0000", 2024-09-12T16:16:22.733 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.734 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.734 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.734 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651547+0000", 2024-09-12T16:16:22.734 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.734 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.734 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.734 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.734 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651547+0000", 2024-09-12T16:16:22.734 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1799999999999999e-07 2024-09-12T16:16:22.734 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.734 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.734 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.734 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651548+0000", 2024-09-12T16:16:22.734 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1370000000000001e-06 2024-09-12T16:16:22.734 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.735 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.735 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.735 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651552+0000", 2024-09-12T16:16:22.735 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.579e-06 2024-09-12T16:16:22.735 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.735 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.735 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.735 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651554+0000", 2024-09-12T16:16:22.735 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.537e-06 2024-09-12T16:16:22.735 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.735 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.735 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.735 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.735 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.736 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30037 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.736 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652310+0000", 2024-09-12T16:16:22.736 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011667838, 2024-09-12T16:16:22.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012129747, 2024-09-12T16:16:22.736 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.736 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.736 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.736 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.736 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.736 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.736 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30037 2024-09-12T16:16:22.737 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.737 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.737 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.737 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.737 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652310+0000", 2024-09-12T16:16:22.737 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.737 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.737 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.737 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.738 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652310+0000", 2024-09-12T16:16:22.738 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.738 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.738 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.738 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652310+0000", 2024-09-12T16:16:22.738 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.72e-07 2024-09-12T16:16:22.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.738 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.738 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.738 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652311+0000", 2024-09-12T16:16:22.738 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.189e-06 2024-09-12T16:16:22.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.738 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652314+0000", 2024-09-12T16:16:22.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9409999999999999e-06 2024-09-12T16:16:22.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652317+0000", 2024-09-12T16:16:22.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4980000000000001e-06 2024-09-12T16:16:22.739 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.739 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.739 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.739 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30070 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.739 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652671+0000", 2024-09-12T16:16:22.740 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011306662, 2024-09-12T16:16:22.740 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011791321, 2024-09-12T16:16:22.740 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.740 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.740 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.740 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.740 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.740 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.740 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30070 2024-09-12T16:16:22.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.740 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.740 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.740 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.740 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652671+0000", 2024-09-12T16:16:22.740 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.741 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.741 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.741 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652671+0000", 2024-09-12T16:16:22.741 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.741 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.741 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.741 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652671+0000", 2024-09-12T16:16:22.741 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.36e-07 2024-09-12T16:16:22.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.741 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.741 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.741 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652672+0000", 2024-09-12T16:16:22.741 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1039999999999999e-06 2024-09-12T16:16:22.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.742 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.742 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652676+0000", 2024-09-12T16:16:22.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6090000000000001e-06 2024-09-12T16:16:22.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.742 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.742 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652679+0000", 2024-09-12T16:16:22.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5639999999999999e-06 2024-09-12T16:16:22.743 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.743 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.743 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.743 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.743 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30108 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.743 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.658380+0000", 2024-09-12T16:16:22.743 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0055981010000000003, 2024-09-12T16:16:22.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.006105259, 2024-09-12T16:16:22.743 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.743 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.743 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.743 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.744 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.744 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.744 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30108 2024-09-12T16:16:22.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.744 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.744 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.744 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658380+0000", 2024-09-12T16:16:22.744 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.744 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.744 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658380+0000", 2024-09-12T16:16:22.744 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.745 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.745 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.745 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658380+0000", 2024-09-12T16:16:22.745 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6199999999999999e-07 2024-09-12T16:16:22.745 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.745 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.745 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.745 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658381+0000", 2024-09-12T16:16:22.745 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.263e-06 2024-09-12T16:16:22.745 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.745 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.745 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.745 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658384+0000", 2024-09-12T16:16:22.745 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.269e-06 2024-09-12T16:16:22.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.746 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.746 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.746 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658387+0000", 2024-09-12T16:16:22.746 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5979999999999999e-06 2024-09-12T16:16:22.746 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.746 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.746 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.746 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.746 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30140 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.746 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.659103+0000", 2024-09-12T16:16:22.746 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0048745569999999998, 2024-09-12T16:16:22.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0054045309999999997, 2024-09-12T16:16:22.747 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.747 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.747 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.747 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.747 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.747 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.747 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30140 2024-09-12T16:16:22.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.747 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.748 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659103+0000", 2024-09-12T16:16:22.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.748 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.748 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659103+0000", 2024-09-12T16:16:22.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.748 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.748 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659103+0000", 2024-09-12T16:16:22.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1299999999999999e-07 2024-09-12T16:16:22.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.749 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.749 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659105+0000", 2024-09-12T16:16:22.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1370000000000001e-06 2024-09-12T16:16:22.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.749 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.749 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659108+0000", 2024-09-12T16:16:22.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1439999999999999e-06 2024-09-12T16:16:22.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.749 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.749 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.750 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659110+0000", 2024-09-12T16:16:22.750 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.632e-06 2024-09-12T16:16:22.750 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.750 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.750 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.750 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.750 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.750 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29942 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.750 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.649979+0000", 2024-09-12T16:16:22.750 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013998358000000001, 2024-09-12T16:16:22.750 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014554694999999999, 2024-09-12T16:16:22.750 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.750 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.750 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.750 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.751 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.751 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.751 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29942 2024-09-12T16:16:22.751 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.751 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.751 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.751 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.751 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.649979+0000", 2024-09-12T16:16:22.751 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.751 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.751 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.751 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.751 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.649979+0000", 2024-09-12T16:16:22.752 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.752 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.752 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.752 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.649980+0000", 2024-09-12T16:16:22.752 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6400000000000002e-07 2024-09-12T16:16:22.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.752 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.752 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.752 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.649982+0000", 2024-09-12T16:16:22.752 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0650000000000001e-06 2024-09-12T16:16:22.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.752 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.752 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.752 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.649989+0000", 2024-09-12T16:16:22.753 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5250000000000002e-06 2024-09-12T16:16:22.753 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.753 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.753 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.753 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.649994+0000", 2024-09-12T16:16:22.753 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.818e-06 2024-09-12T16:16:22.753 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.753 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.753 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.753 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.753 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.753 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29974 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.753 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.650847+0000", 2024-09-12T16:16:22.753 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013131067, 2024-09-12T16:16:22.753 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013710546000000001, 2024-09-12T16:16:22.754 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.754 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.754 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.754 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.754 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.754 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.754 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29974 2024-09-12T16:16:22.754 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.754 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.754 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.754 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.754 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650847+0000", 2024-09-12T16:16:22.754 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.755 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.755 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.755 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650847+0000", 2024-09-12T16:16:22.755 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.755 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.755 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.755 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650847+0000", 2024-09-12T16:16:22.755 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.05e-07 2024-09-12T16:16:22.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.755 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.755 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.755 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650848+0000", 2024-09-12T16:16:22.755 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.128e-06 2024-09-12T16:16:22.756 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.756 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.756 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.756 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650852+0000", 2024-09-12T16:16:22.756 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6480000000000001e-06 2024-09-12T16:16:22.756 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.756 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.756 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.756 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650854+0000", 2024-09-12T16:16:22.756 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5390000000000002e-06 2024-09-12T16:16:22.756 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.757 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.757 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.757 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.757 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30006 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.757 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651582+0000", 2024-09-12T16:16:22.757 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012395322, 2024-09-12T16:16:22.757 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012997554999999999, 2024-09-12T16:16:22.757 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.757 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.757 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.757 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.758 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.758 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.758 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30006 2024-09-12T16:16:22.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.758 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.758 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.758 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.758 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651582+0000", 2024-09-12T16:16:22.758 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.758 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.758 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.758 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651582+0000", 2024-09-12T16:16:22.759 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.759 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.759 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.759 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.759 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651583+0000", 2024-09-12T16:16:22.759 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2300000000000002e-07 2024-09-12T16:16:22.759 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.759 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.759 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.759 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651584+0000", 2024-09-12T16:16:22.759 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.415e-06 2024-09-12T16:16:22.759 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.759 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.759 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.759 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651588+0000", 2024-09-12T16:16:22.760 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4020000000000002e-06 2024-09-12T16:16:22.760 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.760 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.760 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.760 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651590+0000", 2024-09-12T16:16:22.760 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.633e-06 2024-09-12T16:16:22.760 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.760 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.760 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.760 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.760 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.760 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30038 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.760 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652320+0000", 2024-09-12T16:16:22.760 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011657958, 2024-09-12T16:16:22.760 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012282945999999999, 2024-09-12T16:16:22.760 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.761 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.761 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.761 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.761 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.761 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.761 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30038 2024-09-12T16:16:22.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.761 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.761 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.761 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.761 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652320+0000", 2024-09-12T16:16:22.761 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.761 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.761 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.762 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652320+0000", 2024-09-12T16:16:22.762 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.762 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.762 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.762 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652320+0000", 2024-09-12T16:16:22.762 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.04e-07 2024-09-12T16:16:22.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.762 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.762 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.762 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652321+0000", 2024-09-12T16:16:22.762 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.066e-06 2024-09-12T16:16:22.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.762 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.762 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.763 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652324+0000", 2024-09-12T16:16:22.763 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9660000000000001e-06 2024-09-12T16:16:22.763 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.763 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.763 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.763 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652326+0000", 2024-09-12T16:16:22.763 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.419e-06 2024-09-12T16:16:22.763 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.763 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.763 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.763 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.763 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.763 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30071 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.763 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652682+0000", 2024-09-12T16:16:22.763 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011296076, 2024-09-12T16:16:22.763 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011945393, 2024-09-12T16:16:22.764 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.764 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.764 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.764 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.764 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.764 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.764 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30071 2024-09-12T16:16:22.764 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.764 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.765 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.765 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.765 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652682+0000", 2024-09-12T16:16:22.765 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.765 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.765 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.765 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652682+0000", 2024-09-12T16:16:22.765 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.765 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.765 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.765 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652682+0000", 2024-09-12T16:16:22.765 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.11e-07 2024-09-12T16:16:22.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.766 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652683+0000", 2024-09-12T16:16:22.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0720000000000001e-06 2024-09-12T16:16:22.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.766 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652686+0000", 2024-09-12T16:16:22.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9969999999999999e-06 2024-09-12T16:16:22.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.767 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.767 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652689+0000", 2024-09-12T16:16:22.767 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.604e-06 2024-09-12T16:16:22.767 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.767 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.767 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.767 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.767 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.767 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30109 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.767 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.658392+0000", 2024-09-12T16:16:22.767 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0055859580000000002, 2024-09-12T16:16:22.768 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0062580320000000002, 2024-09-12T16:16:22.768 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.768 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.768 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.768 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.768 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.768 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.768 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30109 2024-09-12T16:16:22.768 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.768 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.768 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.768 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.768 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658392+0000", 2024-09-12T16:16:22.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.769 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.769 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658392+0000", 2024-09-12T16:16:22.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.769 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.769 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658392+0000", 2024-09-12T16:16:22.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.28e-07 2024-09-12T16:16:22.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.770 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.770 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658401+0000", 2024-09-12T16:16:22.770 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0019999999999995e-06 2024-09-12T16:16:22.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.770 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.770 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658405+0000", 2024-09-12T16:16:22.770 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.782e-06 2024-09-12T16:16:22.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.770 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.770 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658408+0000", 2024-09-12T16:16:22.770 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9699999999999999e-06 2024-09-12T16:16:22.771 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.771 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.771 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.771 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.771 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30141 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.771 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.659114+0000", 2024-09-12T16:16:22.771 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0048634050000000003, 2024-09-12T16:16:22.771 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0055595360000000003, 2024-09-12T16:16:22.771 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.771 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.771 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.771 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.771 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.772 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.772 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30141 2024-09-12T16:16:22.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.772 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.772 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.772 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659114+0000", 2024-09-12T16:16:22.772 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.772 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.772 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659114+0000", 2024-09-12T16:16:22.773 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.773 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.773 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.773 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.773 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659115+0000", 2024-09-12T16:16:22.773 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9900000000000001e-07 2024-09-12T16:16:22.773 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.773 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.773 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.773 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659117+0000", 2024-09-12T16:16:22.773 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7719999999999999e-06 2024-09-12T16:16:22.773 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.773 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.774 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.774 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659122+0000", 2024-09-12T16:16:22.774 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5310000000000001e-06 2024-09-12T16:16:22.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.774 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.774 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.774 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659129+0000", 2024-09-12T16:16:22.774 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.917e-06 2024-09-12T16:16:22.774 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.774 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.774 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.774 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.775 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29943 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.775 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.650019+0000", 2024-09-12T16:16:22.775 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.01395835, 2024-09-12T16:16:22.775 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014680169999999999, 2024-09-12T16:16:22.775 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.775 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.775 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.775 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.775 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.775 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.775 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29943 2024-09-12T16:16:22.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.775 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.776 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.776 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650019+0000", 2024-09-12T16:16:22.776 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.776 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.776 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650019+0000", 2024-09-12T16:16:22.776 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.776 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.776 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650020+0000", 2024-09-12T16:16:22.776 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7299999999999996e-07 2024-09-12T16:16:22.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.777 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.777 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.777 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650022+0000", 2024-09-12T16:16:22.777 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2249999999999999e-06 2024-09-12T16:16:22.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.777 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.777 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.777 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650029+0000", 2024-09-12T16:16:22.777 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8560000000000001e-06 2024-09-12T16:16:22.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.777 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.777 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.777 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650034+0000", 2024-09-12T16:16:22.777 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3299999999999998e-06 2024-09-12T16:16:22.778 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.778 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.778 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.778 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29975 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.778 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.650882+0000", 2024-09-12T16:16:22.778 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013095775, 2024-09-12T16:16:22.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013840669999999999, 2024-09-12T16:16:22.778 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.778 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.778 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.778 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.778 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.779 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.779 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29975 2024-09-12T16:16:22.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.779 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650882+0000", 2024-09-12T16:16:22.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650882+0000", 2024-09-12T16:16:22.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.780 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.780 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.780 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650882+0000", 2024-09-12T16:16:22.780 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1600000000000002e-07 2024-09-12T16:16:22.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.780 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.780 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.780 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650884+0000", 2024-09-12T16:16:22.780 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4619999999999999e-06 2024-09-12T16:16:22.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.780 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.780 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.781 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650887+0000", 2024-09-12T16:16:22.781 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4709999999999999e-06 2024-09-12T16:16:22.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.781 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.781 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.781 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650890+0000", 2024-09-12T16:16:22.781 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7420000000000002e-06 2024-09-12T16:16:22.781 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.781 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.781 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.781 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.781 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30007 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.782 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651595+0000", 2024-09-12T16:16:22.782 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012383282000000001, 2024-09-12T16:16:22.782 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013150837, 2024-09-12T16:16:22.782 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.782 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.782 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.782 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.782 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.782 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.782 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30007 2024-09-12T16:16:22.782 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.782 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.782 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.782 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.782 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651595+0000", 2024-09-12T16:16:22.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.783 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.783 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651595+0000", 2024-09-12T16:16:22.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.783 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.783 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651595+0000", 2024-09-12T16:16:22.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2499999999999999e-07 2024-09-12T16:16:22.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.783 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.783 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651596+0000", 2024-09-12T16:16:22.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.127e-06 2024-09-12T16:16:22.784 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.784 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.784 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.784 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651599+0000", 2024-09-12T16:16:22.784 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1870000000000001e-06 2024-09-12T16:16:22.784 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.784 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.784 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.784 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651602+0000", 2024-09-12T16:16:22.784 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5660000000000001e-06 2024-09-12T16:16:22.784 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.784 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.784 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.785 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.785 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30039 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.785 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652330+0000", 2024-09-12T16:16:22.785 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011648263000000001, 2024-09-12T16:16:22.785 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012438552, 2024-09-12T16:16:22.785 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.785 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.785 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.785 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.785 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.785 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.785 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30039 2024-09-12T16:16:22.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.786 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.786 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.786 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.786 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652330+0000", 2024-09-12T16:16:22.786 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.786 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.786 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.786 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652330+0000", 2024-09-12T16:16:22.786 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.786 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.786 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.786 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652330+0000", 2024-09-12T16:16:22.786 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2700000000000001e-07 2024-09-12T16:16:22.787 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.787 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.787 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.787 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652331+0000", 2024-09-12T16:16:22.787 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0470000000000001e-06 2024-09-12T16:16:22.787 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.787 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.787 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.787 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652334+0000", 2024-09-12T16:16:22.787 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.971e-06 2024-09-12T16:16:22.787 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.787 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.787 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.788 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652336+0000", 2024-09-12T16:16:22.788 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.441e-06 2024-09-12T16:16:22.788 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.788 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.788 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.788 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.788 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30110 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.788 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.658413+0000", 2024-09-12T16:16:22.788 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.005564907, 2024-09-12T16:16:22.788 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0063790840000000001, 2024-09-12T16:16:22.788 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.788 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.788 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.788 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.788 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.789 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.789 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30110 2024-09-12T16:16:22.789 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.789 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.789 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.789 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.789 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658413+0000", 2024-09-12T16:16:22.789 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.789 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.789 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.789 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.789 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658413+0000", 2024-09-12T16:16:22.789 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.789 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.789 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.790 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.790 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658413+0000", 2024-09-12T16:16:22.790 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.65e-07 2024-09-12T16:16:22.790 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.790 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.790 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.790 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658414+0000", 2024-09-12T16:16:22.790 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1540000000000001e-06 2024-09-12T16:16:22.790 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.790 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.790 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.790 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658418+0000", 2024-09-12T16:16:22.790 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6459999999999999e-06 2024-09-12T16:16:22.790 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.790 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.790 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.791 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658421+0000", 2024-09-12T16:16:22.791 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6620000000000001e-06 2024-09-12T16:16:22.791 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.791 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.791 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.791 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.791 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.791 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30142 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.791 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.659136+0000", 2024-09-12T16:16:22.791 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0048414929999999997, 2024-09-12T16:16:22.791 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0056781260000000004, 2024-09-12T16:16:22.791 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.791 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.791 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.791 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.792 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.792 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.792 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30142 2024-09-12T16:16:22.792 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.792 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.792 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.792 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.792 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659136+0000", 2024-09-12T16:16:22.792 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.792 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.793 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.793 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.793 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659136+0000", 2024-09-12T16:16:22.793 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.793 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.793 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.793 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.793 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659137+0000", 2024-09-12T16:16:22.793 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0499999999999999e-07 2024-09-12T16:16:22.793 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.793 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.793 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.793 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659139+0000", 2024-09-12T16:16:22.793 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9750000000000001e-06 2024-09-12T16:16:22.794 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.794 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.794 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.794 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659145+0000", 2024-09-12T16:16:22.794 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0379999999999996e-06 2024-09-12T16:16:22.794 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.794 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.794 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.794 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659149+0000", 2024-09-12T16:16:22.794 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7110000000000003e-06 2024-09-12T16:16:22.794 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.794 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.794 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.795 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.795 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.795 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29944 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.795 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.650065+0000", 2024-09-12T16:16:22.795 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013912987999999999, 2024-09-12T16:16:22.795 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014772375000000001, 2024-09-12T16:16:22.795 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.795 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.795 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.795 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.795 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.795 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.795 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29944 2024-09-12T16:16:22.795 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.796 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.796 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.796 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.796 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650065+0000", 2024-09-12T16:16:22.796 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.796 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.796 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.796 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.796 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650065+0000", 2024-09-12T16:16:22.796 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.796 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.796 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.796 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.796 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650065+0000", 2024-09-12T16:16:22.797 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.75e-07 2024-09-12T16:16:22.797 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.797 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.797 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.797 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650067+0000", 2024-09-12T16:16:22.797 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0949999999999998e-06 2024-09-12T16:16:22.797 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.797 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.797 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.797 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650074+0000", 2024-09-12T16:16:22.797 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6409999999999996e-06 2024-09-12T16:16:22.797 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.797 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.798 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.798 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650079+0000", 2024-09-12T16:16:22.798 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2059999999999998e-06 2024-09-12T16:16:22.798 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.798 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.798 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.798 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.798 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29976 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.798 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.650895+0000", 2024-09-12T16:16:22.798 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013083038, 2024-09-12T16:16:22.798 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013998665, 2024-09-12T16:16:22.798 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.798 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.798 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.798 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.799 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.799 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.799 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29976 2024-09-12T16:16:22.799 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.799 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.799 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.799 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.799 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650895+0000", 2024-09-12T16:16:22.799 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.799 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.799 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.799 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.799 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650895+0000", 2024-09-12T16:16:22.799 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.799 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.799 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.800 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.800 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650895+0000", 2024-09-12T16:16:22.800 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.03e-07 2024-09-12T16:16:22.800 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.800 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.800 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.800 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650896+0000", 2024-09-12T16:16:22.800 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1990000000000001e-06 2024-09-12T16:16:22.800 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.800 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.800 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.800 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650899+0000", 2024-09-12T16:16:22.800 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.056e-06 2024-09-12T16:16:22.800 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.801 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.801 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.801 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650902+0000", 2024-09-12T16:16:22.801 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.667e-06 2024-09-12T16:16:22.801 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.801 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.801 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.801 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.801 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30008 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.801 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651626+0000", 2024-09-12T16:16:22.801 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012352181, 2024-09-12T16:16:22.801 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013290496000000001, 2024-09-12T16:16:22.801 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.802 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.802 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.802 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.802 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.802 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.802 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30008 2024-09-12T16:16:22.802 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.802 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.802 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.802 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.802 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651626+0000", 2024-09-12T16:16:22.802 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.802 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.802 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.802 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.803 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651626+0000", 2024-09-12T16:16:22.803 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.803 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.803 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.803 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.803 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651626+0000", 2024-09-12T16:16:22.803 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0699999999999998e-07 2024-09-12T16:16:22.803 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.803 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.803 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.803 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651630+0000", 2024-09-12T16:16:22.803 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9129999999999996e-06 2024-09-12T16:16:22.803 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.803 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.803 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.804 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651634+0000", 2024-09-12T16:16:22.804 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9559999999999999e-06 2024-09-12T16:16:22.804 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.804 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.804 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.804 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651637+0000", 2024-09-12T16:16:22.804 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8420000000000001e-06 2024-09-12T16:16:22.804 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.804 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.804 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.804 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.804 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.804 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30040 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.805 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652339+0000", 2024-09-12T16:16:22.805 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011638426, 2024-09-12T16:16:22.805 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012601513, 2024-09-12T16:16:22.805 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.805 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.805 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.805 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.805 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.805 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.805 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30040 2024-09-12T16:16:22.805 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.805 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.805 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.805 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.805 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652339+0000", 2024-09-12T16:16:22.806 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.806 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.806 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.806 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652339+0000", 2024-09-12T16:16:22.806 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.806 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.806 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.806 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652340+0000", 2024-09-12T16:16:22.806 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1400000000000001e-07 2024-09-12T16:16:22.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.806 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.806 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.806 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652341+0000", 2024-09-12T16:16:22.806 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.085e-06 2024-09-12T16:16:22.807 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.807 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.807 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.807 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652344+0000", 2024-09-12T16:16:22.807 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9579999999999999e-06 2024-09-12T16:16:22.807 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.807 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.807 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.807 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652346+0000", 2024-09-12T16:16:22.807 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5019999999999999e-06 2024-09-12T16:16:22.807 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.807 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.807 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.807 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.807 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.808 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30073 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.808 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652707+0000", 2024-09-12T16:16:22.808 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011270476999999999, 2024-09-12T16:16:22.808 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012257093, 2024-09-12T16:16:22.808 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.808 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.808 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.808 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.808 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.808 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.808 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30073 2024-09-12T16:16:22.808 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.808 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.809 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.809 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.809 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652707+0000", 2024-09-12T16:16:22.809 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.809 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.809 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.809 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.809 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652707+0000", 2024-09-12T16:16:22.809 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.809 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.809 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.809 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.810 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652708+0000", 2024-09-12T16:16:22.810 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0199999999999998e-07 2024-09-12T16:16:22.810 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.810 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.810 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.810 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652709+0000", 2024-09-12T16:16:22.810 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.688e-06 2024-09-12T16:16:22.810 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.810 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.810 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.810 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652715+0000", 2024-09-12T16:16:22.810 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.835e-06 2024-09-12T16:16:22.810 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.810 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.811 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.811 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652720+0000", 2024-09-12T16:16:22.811 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.476e-06 2024-09-12T16:16:22.811 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.811 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.811 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.811 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.811 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.811 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30111 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.811 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.658425+0000", 2024-09-12T16:16:22.811 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0055530609999999998, 2024-09-12T16:16:22.811 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0065643079999999996, 2024-09-12T16:16:22.811 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.812 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.812 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.812 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.812 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.812 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.812 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30111 2024-09-12T16:16:22.812 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.812 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.812 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.812 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.812 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658425+0000", 2024-09-12T16:16:22.812 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.812 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.813 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.813 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.813 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658425+0000", 2024-09-12T16:16:22.813 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.813 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.813 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.813 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.813 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658425+0000", 2024-09-12T16:16:22.813 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1299999999999999e-07 2024-09-12T16:16:22.813 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.813 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.813 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.813 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658426+0000", 2024-09-12T16:16:22.813 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.186e-06 2024-09-12T16:16:22.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.814 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.814 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.814 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658429+0000", 2024-09-12T16:16:22.814 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1099999999999999e-06 2024-09-12T16:16:22.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.814 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.814 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.814 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658432+0000", 2024-09-12T16:16:22.814 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8009999999999999e-06 2024-09-12T16:16:22.814 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.814 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.815 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.815 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.815 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.815 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30143 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.815 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.659156+0000", 2024-09-12T16:16:22.815 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0048219650000000001, 2024-09-12T16:16:22.815 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0058560440000000004, 2024-09-12T16:16:22.815 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.815 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.815 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.815 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.815 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.815 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.815 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30143 2024-09-12T16:16:22.816 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.816 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.816 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.816 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.816 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659156+0000", 2024-09-12T16:16:22.816 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.816 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.816 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.816 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.816 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659156+0000", 2024-09-12T16:16:22.816 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.816 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.816 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.817 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.817 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659156+0000", 2024-09-12T16:16:22.817 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1300000000000001e-07 2024-09-12T16:16:22.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.817 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.817 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.817 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659158+0000", 2024-09-12T16:16:22.817 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.939e-06 2024-09-12T16:16:22.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.817 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.817 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.817 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659164+0000", 2024-09-12T16:16:22.817 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8680000000000004e-06 2024-09-12T16:16:22.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.818 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.818 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.818 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659172+0000", 2024-09-12T16:16:22.818 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8869999999999992e-06 2024-09-12T16:16:22.818 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.818 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.818 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.818 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.818 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29945 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.818 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.650111+0000", 2024-09-12T16:16:22.818 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013867200999999999, 2024-09-12T16:16:22.818 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014926178999999999, 2024-09-12T16:16:22.818 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.818 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.819 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.819 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.819 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.819 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.819 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29945 2024-09-12T16:16:22.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.819 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.819 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.819 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.819 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650111+0000", 2024-09-12T16:16:22.819 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.819 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.819 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.819 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650111+0000", 2024-09-12T16:16:22.819 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.820 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.820 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.820 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650111+0000", 2024-09-12T16:16:22.820 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5799999999999999e-07 2024-09-12T16:16:22.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.820 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.820 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.820 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650113+0000", 2024-09-12T16:16:22.820 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.086e-06 2024-09-12T16:16:22.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.820 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.820 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.820 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650121+0000", 2024-09-12T16:16:22.821 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8350000000000004e-06 2024-09-12T16:16:22.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.821 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.821 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.821 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650126+0000", 2024-09-12T16:16:22.821 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.198e-06 2024-09-12T16:16:22.821 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.821 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.821 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.821 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.821 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29977 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.821 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.650928+0000", 2024-09-12T16:16:22.821 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013050213, 2024-09-12T16:16:22.821 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014131940000000001, 2024-09-12T16:16:22.822 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.822 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.822 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.822 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.822 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.822 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.822 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29977 2024-09-12T16:16:22.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.822 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.822 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.822 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.822 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650928+0000", 2024-09-12T16:16:22.822 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.822 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.822 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.823 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650928+0000", 2024-09-12T16:16:22.823 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.823 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.823 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650928+0000", 2024-09-12T16:16:22.823 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1699999999999999e-07 2024-09-12T16:16:22.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.823 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.823 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650929+0000", 2024-09-12T16:16:22.823 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.437e-06 2024-09-12T16:16:22.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.824 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.824 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.824 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650933+0000", 2024-09-12T16:16:22.824 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3440000000000001e-06 2024-09-12T16:16:22.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.824 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.824 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.824 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650935+0000", 2024-09-12T16:16:22.824 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.711e-06 2024-09-12T16:16:22.824 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.824 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.824 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.825 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.825 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30009 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.825 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651663+0000", 2024-09-12T16:16:22.825 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012314541, 2024-09-12T16:16:22.825 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013420978, 2024-09-12T16:16:22.825 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.825 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.825 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.825 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.825 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.825 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.825 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30009 2024-09-12T16:16:22.825 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.826 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.826 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.826 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.826 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651663+0000", 2024-09-12T16:16:22.826 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.826 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.826 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.826 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.826 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651663+0000", 2024-09-12T16:16:22.826 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.826 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.826 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.827 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.827 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651664+0000", 2024-09-12T16:16:22.827 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2899999999999999e-07 2024-09-12T16:16:22.827 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.827 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.827 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.827 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651665+0000", 2024-09-12T16:16:22.827 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.469e-06 2024-09-12T16:16:22.827 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.827 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.827 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.827 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651669+0000", 2024-09-12T16:16:22.827 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3790000000000002e-06 2024-09-12T16:16:22.827 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.828 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.828 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.828 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651671+0000", 2024-09-12T16:16:22.828 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8540000000000001e-06 2024-09-12T16:16:22.828 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.828 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.828 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.828 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.828 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.828 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30041 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.828 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652349+0000", 2024-09-12T16:16:22.828 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011628697, 2024-09-12T16:16:22.829 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012759413000000001, 2024-09-12T16:16:22.829 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.829 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.829 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.829 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.829 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.829 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.829 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30041 2024-09-12T16:16:22.829 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.829 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.829 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.829 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.829 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652349+0000", 2024-09-12T16:16:22.829 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.829 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.830 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.830 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.830 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652349+0000", 2024-09-12T16:16:22.830 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.830 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.830 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.830 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652349+0000", 2024-09-12T16:16:22.830 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3799999999999999e-07 2024-09-12T16:16:22.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.830 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.830 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.830 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652350+0000", 2024-09-12T16:16:22.830 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0869999999999999e-06 2024-09-12T16:16:22.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.830 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.831 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.831 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652353+0000", 2024-09-12T16:16:22.831 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9340000000000002e-06 2024-09-12T16:16:22.831 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.831 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.831 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.831 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652356+0000", 2024-09-12T16:16:22.831 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4949999999999998e-06 2024-09-12T16:16:22.831 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.831 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.831 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.831 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.831 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.831 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30074 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.831 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652727+0000", 2024-09-12T16:16:22.832 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011251272999999999, 2024-09-12T16:16:22.832 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012406697, 2024-09-12T16:16:22.832 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.832 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.832 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.832 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.832 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.832 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.832 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30074 2024-09-12T16:16:22.832 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.832 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.832 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.832 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.833 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652727+0000", 2024-09-12T16:16:22.833 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.833 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.833 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.833 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.833 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652727+0000", 2024-09-12T16:16:22.833 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.833 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.833 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.833 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.833 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652727+0000", 2024-09-12T16:16:22.833 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2000000000000001e-07 2024-09-12T16:16:22.833 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.833 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.834 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.834 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652729+0000", 2024-09-12T16:16:22.834 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.872e-06 2024-09-12T16:16:22.834 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.834 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.834 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.834 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652735+0000", 2024-09-12T16:16:22.834 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8510000000000004e-06 2024-09-12T16:16:22.834 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.834 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.834 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.835 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652737+0000", 2024-09-12T16:16:22.835 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.757e-06 2024-09-12T16:16:22.835 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.835 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.835 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.835 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.835 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30112 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.835 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.658436+0000", 2024-09-12T16:16:22.835 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0055418280000000004, 2024-09-12T16:16:22.835 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0067213510000000004, 2024-09-12T16:16:22.835 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.835 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.835 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.836 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.836 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.836 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.836 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30112 2024-09-12T16:16:22.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.836 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.836 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.836 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.836 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658436+0000", 2024-09-12T16:16:22.836 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.836 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.836 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.836 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658436+0000", 2024-09-12T16:16:22.837 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.837 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.837 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.837 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.837 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658436+0000", 2024-09-12T16:16:22.837 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1e-07 2024-09-12T16:16:22.837 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.837 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.837 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.837 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658437+0000", 2024-09-12T16:16:22.838 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0610000000000001e-06 2024-09-12T16:16:22.838 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.838 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.838 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.838 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658441+0000", 2024-09-12T16:16:22.838 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5650000000000002e-06 2024-09-12T16:16:22.838 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.838 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.838 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.838 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658443+0000", 2024-09-12T16:16:22.838 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.649e-06 2024-09-12T16:16:22.838 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.838 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.838 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.839 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.839 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.839 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30144 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.839 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.659184+0000", 2024-09-12T16:16:22.839 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0047933749999999999, 2024-09-12T16:16:22.839 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0059975209999999996, 2024-09-12T16:16:22.839 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.839 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.839 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.839 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.839 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.839 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.839 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30144 2024-09-12T16:16:22.839 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.839 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.840 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.840 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.840 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659184+0000", 2024-09-12T16:16:22.840 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.840 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.840 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.840 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659184+0000", 2024-09-12T16:16:22.840 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.840 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.840 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.840 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659185+0000", 2024-09-12T16:16:22.841 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3300000000000003e-07 2024-09-12T16:16:22.841 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.841 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.841 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.841 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659187+0000", 2024-09-12T16:16:22.841 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3089999999999998e-06 2024-09-12T16:16:22.841 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.841 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.841 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.841 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659195+0000", 2024-09-12T16:16:22.841 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3769999999999998e-06 2024-09-12T16:16:22.841 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.841 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.841 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.841 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659200+0000", 2024-09-12T16:16:22.842 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3900000000000001e-06 2024-09-12T16:16:22.842 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.842 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.842 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.842 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.842 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.842 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29946 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.842 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.650158+0000", 2024-09-12T16:16:22.842 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013819573999999999, 2024-09-12T16:16:22.842 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015046689, 2024-09-12T16:16:22.842 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.842 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.842 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.842 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.843 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.843 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.843 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29946 2024-09-12T16:16:22.843 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.843 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.843 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.843 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.843 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650158+0000", 2024-09-12T16:16:22.843 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.843 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.843 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.843 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.843 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650158+0000", 2024-09-12T16:16:22.844 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.844 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.844 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.844 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.844 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650159+0000", 2024-09-12T16:16:22.844 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.82e-07 2024-09-12T16:16:22.844 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.844 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.844 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.844 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650161+0000", 2024-09-12T16:16:22.844 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0880000000000002e-06 2024-09-12T16:16:22.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.845 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.845 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.845 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650168+0000", 2024-09-12T16:16:22.845 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.725e-06 2024-09-12T16:16:22.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.845 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.845 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.845 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650174+0000", 2024-09-12T16:16:22.845 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7669999999999998e-06 2024-09-12T16:16:22.845 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.845 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.845 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.846 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.846 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29978 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.846 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.650939+0000", 2024-09-12T16:16:22.846 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013038918, 2024-09-12T16:16:22.846 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014294516, 2024-09-12T16:16:22.846 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.846 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.846 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.846 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.846 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.846 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.846 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29978 2024-09-12T16:16:22.846 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.847 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.847 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.847 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.847 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650939+0000", 2024-09-12T16:16:22.847 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.847 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.847 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.847 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.847 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650939+0000", 2024-09-12T16:16:22.847 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.847 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.847 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.847 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.848 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650939+0000", 2024-09-12T16:16:22.848 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1899999999999999e-07 2024-09-12T16:16:22.848 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.848 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.848 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.848 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650940+0000", 2024-09-12T16:16:22.848 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1000000000000001e-06 2024-09-12T16:16:22.848 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.848 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.848 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.848 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650944+0000", 2024-09-12T16:16:22.848 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.569e-06 2024-09-12T16:16:22.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.849 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.849 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650946+0000", 2024-09-12T16:16:22.849 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6139999999999999e-06 2024-09-12T16:16:22.849 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.849 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.849 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.849 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30010 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.849 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651703+0000", 2024-09-12T16:16:22.849 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012274352000000001, 2024-09-12T16:16:22.849 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013558858999999999, 2024-09-12T16:16:22.850 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.850 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.850 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.850 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.850 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.850 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.850 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30010 2024-09-12T16:16:22.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.850 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651703+0000", 2024-09-12T16:16:22.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.851 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651703+0000", 2024-09-12T16:16:22.851 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.851 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.851 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.851 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651704+0000", 2024-09-12T16:16:22.851 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2599999999999998e-07 2024-09-12T16:16:22.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.851 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.851 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.851 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651705+0000", 2024-09-12T16:16:22.851 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4309999999999999e-06 2024-09-12T16:16:22.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.851 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.851 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.851 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651709+0000", 2024-09-12T16:16:22.852 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3210000000000001e-06 2024-09-12T16:16:22.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.852 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.852 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.852 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651711+0000", 2024-09-12T16:16:22.852 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7149999999999998e-06 2024-09-12T16:16:22.852 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.852 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.852 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.852 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.852 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30042 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.852 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652359+0000", 2024-09-12T16:16:22.852 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011618982999999999, 2024-09-12T16:16:22.853 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012927512, 2024-09-12T16:16:22.853 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.853 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.853 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.853 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.853 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.853 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.853 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30042 2024-09-12T16:16:22.853 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.853 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.853 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.853 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.854 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652359+0000", 2024-09-12T16:16:22.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.854 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.854 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.854 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652359+0000", 2024-09-12T16:16:22.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.854 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.854 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.854 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652359+0000", 2024-09-12T16:16:22.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1e-07 2024-09-12T16:16:22.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652360+0000", 2024-09-12T16:16:22.855 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.04e-06 2024-09-12T16:16:22.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652364+0000", 2024-09-12T16:16:22.855 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2239999999999997e-06 2024-09-12T16:16:22.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652367+0000", 2024-09-12T16:16:22.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5390000000000002e-06 2024-09-12T16:16:22.856 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.856 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.856 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.856 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30075 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.856 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652741+0000", 2024-09-12T16:16:22.856 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011236783, 2024-09-12T16:16:22.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012570385, 2024-09-12T16:16:22.856 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.856 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.856 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.857 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.857 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.857 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.857 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30075 2024-09-12T16:16:22.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.857 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.857 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.857 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.857 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652741+0000", 2024-09-12T16:16:22.857 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.857 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.857 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.858 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652741+0000", 2024-09-12T16:16:22.858 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.858 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.858 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.858 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652741+0000", 2024-09-12T16:16:22.858 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0699999999999998e-07 2024-09-12T16:16:22.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.858 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.858 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.858 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652743+0000", 2024-09-12T16:16:22.858 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.203e-06 2024-09-12T16:16:22.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.859 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.859 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652746+0000", 2024-09-12T16:16:22.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.123e-06 2024-09-12T16:16:22.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.859 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.859 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652748+0000", 2024-09-12T16:16:22.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5129999999999999e-06 2024-09-12T16:16:22.859 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.859 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.859 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.860 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.860 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30113 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.860 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.658447+0000", 2024-09-12T16:16:22.860 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0055306299999999999, 2024-09-12T16:16:22.860 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0068874360000000003, 2024-09-12T16:16:22.860 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.860 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.860 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.860 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.860 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.860 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.860 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30113 2024-09-12T16:16:22.861 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.861 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.861 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.861 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.861 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658447+0000", 2024-09-12T16:16:22.861 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.861 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.861 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.861 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.861 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658447+0000", 2024-09-12T16:16:22.861 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.862 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.862 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.862 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.862 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658448+0000", 2024-09-12T16:16:22.862 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7800000000000002e-07 2024-09-12T16:16:22.862 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.862 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.862 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.862 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658449+0000", 2024-09-12T16:16:22.862 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.621e-06 2024-09-12T16:16:22.862 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.862 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.862 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.862 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658455+0000", 2024-09-12T16:16:22.862 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6069999999999998e-06 2024-09-12T16:16:22.863 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.863 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.863 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.863 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658461+0000", 2024-09-12T16:16:22.863 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2729999999999999e-06 2024-09-12T16:16:22.863 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.863 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.863 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.863 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.863 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.863 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30145 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.863 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.659207+0000", 2024-09-12T16:16:22.863 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0047707069999999999, 2024-09-12T16:16:22.864 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0061518570000000002, 2024-09-12T16:16:22.864 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.864 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.864 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.864 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.864 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.864 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.864 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30145 2024-09-12T16:16:22.864 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.864 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.864 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.865 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.865 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659207+0000", 2024-09-12T16:16:22.865 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.865 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.865 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.865 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659207+0000", 2024-09-12T16:16:22.865 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.865 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.866 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.866 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659208+0000", 2024-09-12T16:16:22.866 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2800000000000002e-07 2024-09-12T16:16:22.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.866 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.866 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.866 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659214+0000", 2024-09-12T16:16:22.866 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8360000000000003e-06 2024-09-12T16:16:22.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.866 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.866 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.866 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659221+0000", 2024-09-12T16:16:22.866 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3269999999999997e-06 2024-09-12T16:16:22.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.867 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.867 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.867 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659237+0000", 2024-09-12T16:16:22.867 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5970000000000001e-05 2024-09-12T16:16:22.867 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.867 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.867 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.867 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.867 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.867 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29947 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.867 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.650206+0000", 2024-09-12T16:16:22.867 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013771584999999999, 2024-09-12T16:16:22.867 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015175902, 2024-09-12T16:16:22.867 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.868 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.868 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.868 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.868 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.868 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.868 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29947 2024-09-12T16:16:22.868 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.868 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.868 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.868 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.868 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650206+0000", 2024-09-12T16:16:22.868 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.868 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.869 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.869 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.869 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650206+0000", 2024-09-12T16:16:22.869 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.869 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.869 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.869 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.869 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650207+0000", 2024-09-12T16:16:22.869 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.82e-07 2024-09-12T16:16:22.869 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.869 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.869 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.870 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650209+0000", 2024-09-12T16:16:22.870 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2010000000000002e-06 2024-09-12T16:16:22.870 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.870 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.870 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.870 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650216+0000", 2024-09-12T16:16:22.870 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4730000000000003e-06 2024-09-12T16:16:22.870 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.870 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.870 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.870 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650222+0000", 2024-09-12T16:16:22.870 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2739999999999998e-06 2024-09-12T16:16:22.870 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.871 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.871 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.871 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.871 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.871 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29979 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.871 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.650974+0000", 2024-09-12T16:16:22.871 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013003750999999999, 2024-09-12T16:16:22.871 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014433987000000001, 2024-09-12T16:16:22.871 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.871 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.871 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.871 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.871 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.871 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.872 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29979 2024-09-12T16:16:22.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.872 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.872 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.872 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.872 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650974+0000", 2024-09-12T16:16:22.872 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.872 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.872 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.872 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650974+0000", 2024-09-12T16:16:22.872 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.872 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.873 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.873 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650974+0000", 2024-09-12T16:16:22.873 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1199999999999998e-07 2024-09-12T16:16:22.873 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.873 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.873 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.873 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650976+0000", 2024-09-12T16:16:22.873 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.418e-06 2024-09-12T16:16:22.873 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.873 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.873 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.873 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650979+0000", 2024-09-12T16:16:22.873 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3739999999999998e-06 2024-09-12T16:16:22.874 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.874 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.874 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.874 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650982+0000", 2024-09-12T16:16:22.874 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7159999999999999e-06 2024-09-12T16:16:22.874 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.874 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.874 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.874 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.874 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.874 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30011 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.874 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651715+0000", 2024-09-12T16:16:22.874 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012263062, 2024-09-12T16:16:22.874 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013716123, 2024-09-12T16:16:22.875 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.875 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.875 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.875 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.875 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.875 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.875 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30011 2024-09-12T16:16:22.875 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.875 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.875 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.875 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.875 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651715+0000", 2024-09-12T16:16:22.876 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.876 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.876 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.876 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.876 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651715+0000", 2024-09-12T16:16:22.876 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.876 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.876 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.876 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.876 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651715+0000", 2024-09-12T16:16:22.876 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1299999999999999e-07 2024-09-12T16:16:22.876 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.876 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.876 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.877 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651716+0000", 2024-09-12T16:16:22.877 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.105e-06 2024-09-12T16:16:22.877 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.877 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.877 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.877 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651719+0000", 2024-09-12T16:16:22.877 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0580000000000002e-06 2024-09-12T16:16:22.877 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.877 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.877 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.877 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651722+0000", 2024-09-12T16:16:22.877 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6359999999999998e-06 2024-09-12T16:16:22.877 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.877 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.878 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.878 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.878 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.878 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30043 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.878 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652370+0000", 2024-09-12T16:16:22.878 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011607308, 2024-09-12T16:16:22.878 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013087078, 2024-09-12T16:16:22.878 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.878 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.878 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.878 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.878 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.878 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.879 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30043 2024-09-12T16:16:22.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.879 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.879 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.879 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.879 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652370+0000", 2024-09-12T16:16:22.879 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.879 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.879 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.879 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652370+0000", 2024-09-12T16:16:22.879 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.879 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.880 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.880 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652371+0000", 2024-09-12T16:16:22.880 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.04e-07 2024-09-12T16:16:22.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.880 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.880 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.880 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652372+0000", 2024-09-12T16:16:22.880 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.097e-06 2024-09-12T16:16:22.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.880 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.880 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.880 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652375+0000", 2024-09-12T16:16:22.880 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0520000000000002e-06 2024-09-12T16:16:22.881 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.881 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.881 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.881 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652377+0000", 2024-09-12T16:16:22.881 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4619999999999999e-06 2024-09-12T16:16:22.881 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.881 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.881 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.881 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.881 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.881 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30077 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.881 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652753+0000", 2024-09-12T16:16:22.881 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011225091, 2024-09-12T16:16:22.881 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012728069999999999, 2024-09-12T16:16:22.882 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.882 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.882 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.882 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.882 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.882 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.882 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30077 2024-09-12T16:16:22.882 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.882 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.882 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.882 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.882 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652753+0000", 2024-09-12T16:16:22.882 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.882 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.883 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.883 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.883 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652753+0000", 2024-09-12T16:16:22.883 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.883 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.883 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.883 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.883 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652753+0000", 2024-09-12T16:16:22.883 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.16e-07 2024-09-12T16:16:22.883 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.883 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.883 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.883 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652754+0000", 2024-09-12T16:16:22.883 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.124e-06 2024-09-12T16:16:22.884 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.884 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.884 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.884 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652757+0000", 2024-09-12T16:16:22.884 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.016e-06 2024-09-12T16:16:22.884 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.884 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.884 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.884 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652760+0000", 2024-09-12T16:16:22.884 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4990000000000001e-06 2024-09-12T16:16:22.884 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.885 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.885 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.885 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.885 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.885 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30114 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.885 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.658474+0000", 2024-09-12T16:16:22.885 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0055039440000000002, 2024-09-12T16:16:22.885 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0070316429999999997, 2024-09-12T16:16:22.885 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.885 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.885 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.885 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.885 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.886 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.886 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30114 2024-09-12T16:16:22.886 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.886 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.886 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.886 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.886 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658474+0000", 2024-09-12T16:16:22.886 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.886 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.886 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.886 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.886 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658474+0000", 2024-09-12T16:16:22.886 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.887 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.887 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.887 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.887 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658474+0000", 2024-09-12T16:16:22.887 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3099999999999998e-07 2024-09-12T16:16:22.887 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.887 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.887 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.887 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658477+0000", 2024-09-12T16:16:22.887 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2759999999999999e-06 2024-09-12T16:16:22.887 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.887 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.888 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.888 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658483+0000", 2024-09-12T16:16:22.888 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4629999999999998e-06 2024-09-12T16:16:22.888 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.888 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.888 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.888 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658491+0000", 2024-09-12T16:16:22.888 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3799999999999994e-06 2024-09-12T16:16:22.888 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.888 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.888 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.888 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.888 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.888 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30146 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.889 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.659246+0000", 2024-09-12T16:16:22.889 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0047318079999999997, 2024-09-12T16:16:22.889 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0062848749999999997, 2024-09-12T16:16:22.889 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.889 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.889 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.889 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.889 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.889 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.889 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30146 2024-09-12T16:16:22.889 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.889 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.889 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.890 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.890 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659246+0000", 2024-09-12T16:16:22.890 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.890 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.890 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.890 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.890 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659246+0000", 2024-09-12T16:16:22.890 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.890 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.890 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.890 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.890 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659246+0000", 2024-09-12T16:16:22.890 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9800000000000004e-07 2024-09-12T16:16:22.891 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.891 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.891 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.891 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659249+0000", 2024-09-12T16:16:22.891 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5519999999999999e-06 2024-09-12T16:16:22.891 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.891 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.891 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.891 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659256+0000", 2024-09-12T16:16:22.891 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9639999999999997e-06 2024-09-12T16:16:22.891 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.891 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.891 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.892 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659261+0000", 2024-09-12T16:16:22.892 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.361e-06 2024-09-12T16:16:22.892 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.892 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.892 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.892 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.892 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.892 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29948 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.892 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.650243+0000", 2024-09-12T16:16:22.892 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013734712, 2024-09-12T16:16:22.892 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015314608, 2024-09-12T16:16:22.892 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.893 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.893 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.893 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.893 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.893 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.893 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29948 2024-09-12T16:16:22.893 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.893 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.893 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.893 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.893 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650243+0000", 2024-09-12T16:16:22.893 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.893 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.894 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.894 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.894 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650243+0000", 2024-09-12T16:16:22.894 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.894 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.894 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.894 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.894 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650244+0000", 2024-09-12T16:16:22.894 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5199999999999997e-07 2024-09-12T16:16:22.894 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.894 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.894 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.894 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650246+0000", 2024-09-12T16:16:22.895 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5490000000000001e-06 2024-09-12T16:16:22.895 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.895 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.895 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.895 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650254+0000", 2024-09-12T16:16:22.895 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5469999999999999e-06 2024-09-12T16:16:22.895 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.895 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.895 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.895 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650259+0000", 2024-09-12T16:16:22.895 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4809999999999997e-06 2024-09-12T16:16:22.895 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.895 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.895 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.896 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.896 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.896 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29980 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.896 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.650985+0000", 2024-09-12T16:16:22.896 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012992409, 2024-09-12T16:16:22.896 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014595537, 2024-09-12T16:16:22.896 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.896 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.896 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.896 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.896 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.896 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.896 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29980 2024-09-12T16:16:22.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.897 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.897 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.897 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.897 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650985+0000", 2024-09-12T16:16:22.897 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.897 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.897 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.897 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650985+0000", 2024-09-12T16:16:22.897 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.897 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.898 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.898 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650986+0000", 2024-09-12T16:16:22.898 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3300000000000001e-07 2024-09-12T16:16:22.898 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.898 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.898 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.898 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650987+0000", 2024-09-12T16:16:22.898 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1069999999999999e-06 2024-09-12T16:16:22.898 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.898 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.898 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.898 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650990+0000", 2024-09-12T16:16:22.898 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.653e-06 2024-09-12T16:16:22.899 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.899 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.899 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.899 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650993+0000", 2024-09-12T16:16:22.899 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6180000000000002e-06 2024-09-12T16:16:22.899 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.899 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.899 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.899 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.899 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.899 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30012 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.899 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651747+0000", 2024-09-12T16:16:22.899 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012230476000000001, 2024-09-12T16:16:22.900 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013858499, 2024-09-12T16:16:22.900 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.900 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.900 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.900 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.900 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.900 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.900 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30012 2024-09-12T16:16:22.900 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.900 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.900 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.900 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.901 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651747+0000", 2024-09-12T16:16:22.901 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.901 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.901 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.901 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651747+0000", 2024-09-12T16:16:22.901 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.901 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.901 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.901 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651748+0000", 2024-09-12T16:16:22.901 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1600000000000002e-07 2024-09-12T16:16:22.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.901 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.902 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.902 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651749+0000", 2024-09-12T16:16:22.902 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4389999999999999e-06 2024-09-12T16:16:22.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.902 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.902 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.902 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651753+0000", 2024-09-12T16:16:22.902 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3189999999999999e-06 2024-09-12T16:16:22.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.902 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.902 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.902 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651755+0000", 2024-09-12T16:16:22.902 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.897e-06 2024-09-12T16:16:22.903 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.903 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.903 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.903 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.903 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.903 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30044 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.903 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652380+0000", 2024-09-12T16:16:22.903 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011597517, 2024-09-12T16:16:22.903 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013249698000000001, 2024-09-12T16:16:22.903 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.903 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.903 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.903 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.903 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.904 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.904 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30044 2024-09-12T16:16:22.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.904 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.904 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.904 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.904 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652380+0000", 2024-09-12T16:16:22.904 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.904 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.904 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.904 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652380+0000", 2024-09-12T16:16:22.904 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.904 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.905 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.905 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652380+0000", 2024-09-12T16:16:22.905 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0900000000000001e-07 2024-09-12T16:16:22.905 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.905 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.905 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.905 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652387+0000", 2024-09-12T16:16:22.905 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7109999999999998e-06 2024-09-12T16:16:22.905 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.905 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.905 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.905 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652391+0000", 2024-09-12T16:16:22.905 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.67e-06 2024-09-12T16:16:22.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.906 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.906 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.906 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652394+0000", 2024-09-12T16:16:22.906 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8669999999999998e-06 2024-09-12T16:16:22.906 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.906 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.906 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.906 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.906 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30079 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.906 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652763+0000", 2024-09-12T16:16:22.906 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011215124, 2024-09-12T16:16:22.907 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012897887, 2024-09-12T16:16:22.907 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.907 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.907 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.907 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.907 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.907 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.907 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30079 2024-09-12T16:16:22.907 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.907 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.907 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.907 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.907 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652763+0000", 2024-09-12T16:16:22.907 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.908 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.908 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.908 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.908 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652763+0000", 2024-09-12T16:16:22.908 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.908 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.908 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.908 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.908 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652763+0000", 2024-09-12T16:16:22.909 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.11e-07 2024-09-12T16:16:22.909 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.909 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.909 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.909 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652764+0000", 2024-09-12T16:16:22.909 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.068e-06 2024-09-12T16:16:22.909 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.909 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.909 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.909 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652767+0000", 2024-09-12T16:16:22.909 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9409999999999999e-06 2024-09-12T16:16:22.909 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.909 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.909 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.909 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652769+0000", 2024-09-12T16:16:22.910 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6000000000000001e-06 2024-09-12T16:16:22.910 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.910 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.910 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.910 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.910 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.910 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30115 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.910 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.658500+0000", 2024-09-12T16:16:22.910 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0054779599999999996, 2024-09-12T16:16:22.910 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0072075129999999996, 2024-09-12T16:16:22.910 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.910 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.910 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.910 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.910 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.911 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.911 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30115 2024-09-12T16:16:22.911 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.911 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.911 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.911 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.911 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658500+0000", 2024-09-12T16:16:22.911 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.911 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.911 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.911 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.911 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658500+0000", 2024-09-12T16:16:22.911 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.911 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.912 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.912 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.912 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658500+0000", 2024-09-12T16:16:22.912 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.39e-07 2024-09-12T16:16:22.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.912 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.912 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.912 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658502+0000", 2024-09-12T16:16:22.912 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1629999999999999e-06 2024-09-12T16:16:22.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.912 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.912 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.912 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658509+0000", 2024-09-12T16:16:22.912 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7549999999999997e-06 2024-09-12T16:16:22.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.913 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.913 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.913 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658515+0000", 2024-09-12T16:16:22.913 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3489999999999999e-06 2024-09-12T16:16:22.913 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.913 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.913 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.913 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.913 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.913 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30147 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.913 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.659272+0000", 2024-09-12T16:16:22.913 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0047053640000000001, 2024-09-12T16:16:22.913 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.006461133, 2024-09-12T16:16:22.913 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.913 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.914 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.914 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.914 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.914 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.914 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30147 2024-09-12T16:16:22.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.914 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.914 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.914 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659272+0000", 2024-09-12T16:16:22.914 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.914 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.914 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659272+0000", 2024-09-12T16:16:22.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.915 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.915 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659273+0000", 2024-09-12T16:16:22.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2800000000000002e-07 2024-09-12T16:16:22.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.915 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.915 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659275+0000", 2024-09-12T16:16:22.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.21e-06 2024-09-12T16:16:22.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.915 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.915 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659284+0000", 2024-09-12T16:16:22.916 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0559999999999994e-06 2024-09-12T16:16:22.916 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.916 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.916 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.916 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659291+0000", 2024-09-12T16:16:22.916 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9460000000000001e-06 2024-09-12T16:16:22.916 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.916 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.916 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.916 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.916 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.916 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29949 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.916 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.650268+0000", 2024-09-12T16:16:22.916 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013709595, 2024-09-12T16:16:22.917 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015555553999999999, 2024-09-12T16:16:22.917 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.917 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.917 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.917 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.917 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.917 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.917 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29949 2024-09-12T16:16:22.917 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.917 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.917 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.917 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.917 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650268+0000", 2024-09-12T16:16:22.917 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.918 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.918 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.918 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.918 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650268+0000", 2024-09-12T16:16:22.918 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.918 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.918 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.918 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.918 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650269+0000", 2024-09-12T16:16:22.918 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4199999999999996e-07 2024-09-12T16:16:22.918 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.918 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.918 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.918 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650279+0000", 2024-09-12T16:16:22.919 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0237999999999999e-05 2024-09-12T16:16:22.919 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.919 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.919 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.919 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650287+0000", 2024-09-12T16:16:22.919 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1389999999999995e-06 2024-09-12T16:16:22.919 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.919 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.919 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.919 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650293+0000", 2024-09-12T16:16:22.919 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4399999999999996e-06 2024-09-12T16:16:22.919 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.919 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.919 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.919 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.920 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.920 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29981 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.920 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651022+0000", 2024-09-12T16:16:22.920 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012955975999999999, 2024-09-12T16:16:22.920 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014827851, 2024-09-12T16:16:22.920 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.920 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.920 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.920 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.920 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.920 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.920 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29981 2024-09-12T16:16:22.920 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.920 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.920 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651022+0000", 2024-09-12T16:16:22.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651022+0000", 2024-09-12T16:16:22.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651022+0000", 2024-09-12T16:16:22.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0400000000000002e-07 2024-09-12T16:16:22.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.922 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.922 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.922 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651024+0000", 2024-09-12T16:16:22.922 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4130000000000001e-06 2024-09-12T16:16:22.922 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.922 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.922 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.922 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651027+0000", 2024-09-12T16:16:22.922 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3289999999999998e-06 2024-09-12T16:16:22.922 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.922 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.922 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.922 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651030+0000", 2024-09-12T16:16:22.922 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.683e-06 2024-09-12T16:16:22.922 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.922 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.923 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.923 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.923 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30013 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.923 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651785+0000", 2024-09-12T16:16:22.923 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012193002999999999, 2024-09-12T16:16:22.923 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014096999000000001, 2024-09-12T16:16:22.923 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.923 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.923 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.923 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.923 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.923 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.923 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30013 2024-09-12T16:16:22.924 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.924 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.924 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.924 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.924 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651785+0000", 2024-09-12T16:16:22.924 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.924 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.924 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.924 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.924 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651785+0000", 2024-09-12T16:16:22.924 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.924 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.924 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.925 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.925 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651785+0000", 2024-09-12T16:16:22.925 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1699999999999999e-07 2024-09-12T16:16:22.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.925 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.925 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.925 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651787+0000", 2024-09-12T16:16:22.925 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5030000000000001e-06 2024-09-12T16:16:22.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.925 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.925 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.925 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651790+0000", 2024-09-12T16:16:22.925 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3850000000000002e-06 2024-09-12T16:16:22.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.926 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.926 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.926 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651793+0000", 2024-09-12T16:16:22.926 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7240000000000001e-06 2024-09-12T16:16:22.926 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.926 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.926 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.926 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.926 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30045 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.926 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652398+0000", 2024-09-12T16:16:22.926 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011579648, 2024-09-12T16:16:22.926 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013521655, 2024-09-12T16:16:22.926 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.927 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.927 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.927 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.927 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.927 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.927 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30045 2024-09-12T16:16:22.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.927 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.927 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.927 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.927 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652398+0000", 2024-09-12T16:16:22.927 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.927 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.928 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.928 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652398+0000", 2024-09-12T16:16:22.928 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.928 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.928 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.928 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652399+0000", 2024-09-12T16:16:22.928 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7300000000000002e-07 2024-09-12T16:16:22.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.928 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.928 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.928 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652400+0000", 2024-09-12T16:16:22.928 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.181e-06 2024-09-12T16:16:22.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.929 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.929 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.929 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652403+0000", 2024-09-12T16:16:22.929 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.145e-06 2024-09-12T16:16:22.929 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.929 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.929 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.929 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652405+0000", 2024-09-12T16:16:22.929 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5160000000000001e-06 2024-09-12T16:16:22.929 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.929 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.929 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.929 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.929 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.929 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30081 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.930 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652773+0000", 2024-09-12T16:16:22.930 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011205207999999999, 2024-09-12T16:16:22.930 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013174346999999999, 2024-09-12T16:16:22.930 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.930 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.930 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.930 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.930 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.930 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.930 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30081 2024-09-12T16:16:22.930 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.930 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.930 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.930 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.931 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652773+0000", 2024-09-12T16:16:22.931 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.931 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.931 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.931 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652773+0000", 2024-09-12T16:16:22.931 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.931 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.931 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.931 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652773+0000", 2024-09-12T16:16:22.931 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2499999999999999e-07 2024-09-12T16:16:22.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.931 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.931 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.932 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652774+0000", 2024-09-12T16:16:22.932 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.091e-06 2024-09-12T16:16:22.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.932 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.932 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.932 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652778+0000", 2024-09-12T16:16:22.932 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6569999999999999e-06 2024-09-12T16:16:22.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.932 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.932 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.932 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652780+0000", 2024-09-12T16:16:22.932 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5129999999999999e-06 2024-09-12T16:16:22.932 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.932 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.932 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.933 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.933 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.933 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30116 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.933 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.658533+0000", 2024-09-12T16:16:22.933 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0054443929999999996, 2024-09-12T16:16:22.933 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0074375719999999999, 2024-09-12T16:16:22.933 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.933 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.933 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.933 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.933 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.933 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.933 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30116 2024-09-12T16:16:22.933 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.933 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.934 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.934 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.934 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658533+0000", 2024-09-12T16:16:22.934 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.934 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.934 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.934 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.934 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658533+0000", 2024-09-12T16:16:22.934 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.934 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.934 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.934 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.934 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658534+0000", 2024-09-12T16:16:22.934 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.39e-07 2024-09-12T16:16:22.934 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.935 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.935 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.935 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658536+0000", 2024-09-12T16:16:22.935 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4210000000000002e-06 2024-09-12T16:16:22.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.935 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.935 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.935 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658545+0000", 2024-09-12T16:16:22.935 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5930000000000006e-06 2024-09-12T16:16:22.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.935 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.935 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.935 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658551+0000", 2024-09-12T16:16:22.935 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3380000000000001e-06 2024-09-12T16:16:22.935 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.936 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.936 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.936 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.936 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.936 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30148 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.936 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.659304+0000", 2024-09-12T16:16:22.936 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0046734749999999999, 2024-09-12T16:16:22.936 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0066938500000000003, 2024-09-12T16:16:22.936 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.936 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.936 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.936 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.936 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.937 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.937 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30148 2024-09-12T16:16:22.937 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.937 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.937 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.937 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.937 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659304+0000", 2024-09-12T16:16:22.937 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.937 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.937 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.937 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.937 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659304+0000", 2024-09-12T16:16:22.937 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.937 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.938 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.938 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.938 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659305+0000", 2024-09-12T16:16:22.938 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8800000000000003e-07 2024-09-12T16:16:22.938 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.938 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.938 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.938 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659307+0000", 2024-09-12T16:16:22.938 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4370000000000001e-06 2024-09-12T16:16:22.938 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.938 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.938 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.938 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659315+0000", 2024-09-12T16:16:22.938 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0700000000000007e-06 2024-09-12T16:16:22.939 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.939 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.939 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.939 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659323+0000", 2024-09-12T16:16:22.939 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2899999999999997e-06 2024-09-12T16:16:22.939 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.939 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.939 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.939 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.939 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.939 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29950 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.939 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.650312+0000", 2024-09-12T16:16:22.939 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013666051, 2024-09-12T16:16:22.939 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015712719999999999, 2024-09-12T16:16:22.939 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.940 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.940 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.940 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.940 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.940 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.940 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29950 2024-09-12T16:16:22.940 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.940 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.940 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.940 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.940 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650312+0000", 2024-09-12T16:16:22.940 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.940 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.940 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.940 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.941 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650312+0000", 2024-09-12T16:16:22.941 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.941 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.941 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.941 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.941 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650312+0000", 2024-09-12T16:16:22.941 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0499999999999999e-07 2024-09-12T16:16:22.941 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.941 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.941 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.941 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650314+0000", 2024-09-12T16:16:22.941 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9819999999999998e-06 2024-09-12T16:16:22.941 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.941 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.941 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.942 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650318+0000", 2024-09-12T16:16:22.942 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0409999999999999e-06 2024-09-12T16:16:22.942 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.942 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.942 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.942 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650322+0000", 2024-09-12T16:16:22.942 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0969999999999999e-06 2024-09-12T16:16:22.942 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.942 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.942 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.942 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.942 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.942 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29982 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.942 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651033+0000", 2024-09-12T16:16:22.942 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012944806999999999, 2024-09-12T16:16:22.943 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015020113999999999, 2024-09-12T16:16:22.943 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.943 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.943 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.943 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.943 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.943 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.943 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29982 2024-09-12T16:16:22.943 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.943 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.943 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.943 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.943 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651033+0000", 2024-09-12T16:16:22.943 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.943 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.943 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.944 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.944 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651033+0000", 2024-09-12T16:16:22.944 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.944 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.944 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.944 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.944 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651033+0000", 2024-09-12T16:16:22.944 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0900000000000001e-07 2024-09-12T16:16:22.944 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.944 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.944 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.944 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651034+0000", 2024-09-12T16:16:22.944 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.122e-06 2024-09-12T16:16:22.944 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.945 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.945 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.945 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651037+0000", 2024-09-12T16:16:22.945 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.988e-06 2024-09-12T16:16:22.945 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.945 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.945 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.945 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651040+0000", 2024-09-12T16:16:22.945 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5780000000000001e-06 2024-09-12T16:16:22.945 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.945 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.945 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.945 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.945 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.946 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30014 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.946 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651798+0000", 2024-09-12T16:16:22.946 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012180254999999999, 2024-09-12T16:16:22.946 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014278823, 2024-09-12T16:16:22.946 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.946 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.946 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.946 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.946 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.946 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.946 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30014 2024-09-12T16:16:22.946 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.946 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.947 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.947 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.947 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651798+0000", 2024-09-12T16:16:22.947 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.947 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.947 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.947 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.947 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651798+0000", 2024-09-12T16:16:22.947 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.947 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.947 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.947 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.947 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651798+0000", 2024-09-12T16:16:22.947 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1899999999999998e-07 2024-09-12T16:16:22.948 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.948 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.948 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.948 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651799+0000", 2024-09-12T16:16:22.948 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1620000000000001e-06 2024-09-12T16:16:22.948 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.948 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.948 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.948 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651802+0000", 2024-09-12T16:16:22.948 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1769999999999998e-06 2024-09-12T16:16:22.948 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.948 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.948 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.949 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651805+0000", 2024-09-12T16:16:22.949 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1039999999999998e-06 2024-09-12T16:16:22.949 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.949 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.949 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.949 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.949 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.949 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30046 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.949 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652409+0000", 2024-09-12T16:16:22.949 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011569299999999999, 2024-09-12T16:16:22.949 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013692652, 2024-09-12T16:16:22.949 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.949 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.950 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.950 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.950 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.950 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.950 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30046 2024-09-12T16:16:22.950 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.950 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.950 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.950 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.950 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652409+0000", 2024-09-12T16:16:22.950 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.950 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.950 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.950 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.950 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652409+0000", 2024-09-12T16:16:22.951 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.951 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.951 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.951 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.951 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652409+0000", 2024-09-12T16:16:22.951 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0999999999999999e-07 2024-09-12T16:16:22.951 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.951 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.951 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.951 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652410+0000", 2024-09-12T16:16:22.951 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.08e-06 2024-09-12T16:16:22.951 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.951 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.951 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.951 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652413+0000", 2024-09-12T16:16:22.952 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.971e-06 2024-09-12T16:16:22.952 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.952 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.952 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.952 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652416+0000", 2024-09-12T16:16:22.952 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5900000000000002e-06 2024-09-12T16:16:22.952 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.952 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.952 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.952 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.952 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.952 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30083 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.952 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652783+0000", 2024-09-12T16:16:22.952 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011194766, 2024-09-12T16:16:22.952 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013343740999999999, 2024-09-12T16:16:22.953 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.953 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.953 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.953 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.953 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.953 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.953 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30083 2024-09-12T16:16:22.953 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.953 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.953 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.953 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.953 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652783+0000", 2024-09-12T16:16:22.953 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.953 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.953 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.953 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.954 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652783+0000", 2024-09-12T16:16:22.954 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.954 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.954 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.954 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.954 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652783+0000", 2024-09-12T16:16:22.954 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3299999999999998e-07 2024-09-12T16:16:22.954 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.954 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.954 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.954 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652784+0000", 2024-09-12T16:16:22.954 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.046e-06 2024-09-12T16:16:22.954 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.954 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.955 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.955 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652787+0000", 2024-09-12T16:16:22.955 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.994e-06 2024-09-12T16:16:22.955 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.955 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.955 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.955 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652790+0000", 2024-09-12T16:16:22.955 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6369999999999999e-06 2024-09-12T16:16:22.955 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.955 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.955 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.955 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.955 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.955 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30117 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.955 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.658565+0000", 2024-09-12T16:16:22.956 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0054127450000000001, 2024-09-12T16:16:22.956 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0075862309999999997, 2024-09-12T16:16:22.956 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.956 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.956 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.956 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.956 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.956 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.956 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30117 2024-09-12T16:16:22.956 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.956 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.956 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.956 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.956 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658565+0000", 2024-09-12T16:16:22.957 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.957 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.957 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.957 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.957 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658565+0000", 2024-09-12T16:16:22.957 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.957 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.957 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.957 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.957 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658565+0000", 2024-09-12T16:16:22.957 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2199999999999999e-07 2024-09-12T16:16:22.957 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.957 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.958 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.958 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658568+0000", 2024-09-12T16:16:22.958 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.283e-06 2024-09-12T16:16:22.958 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.958 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.958 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.958 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658575+0000", 2024-09-12T16:16:22.958 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0679999999999999e-06 2024-09-12T16:16:22.958 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.958 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.958 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.958 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658580+0000", 2024-09-12T16:16:22.958 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1789999999999999e-06 2024-09-12T16:16:22.958 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.958 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.959 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.959 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.959 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.959 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30149 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.959 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.659331+0000", 2024-09-12T16:16:22.959 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0046472869999999999, 2024-09-12T16:16:22.959 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0068440569999999997, 2024-09-12T16:16:22.959 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.959 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.959 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.959 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.959 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.959 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.959 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30149 2024-09-12T16:16:22.959 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.960 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.960 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.960 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.960 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659331+0000", 2024-09-12T16:16:22.960 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.960 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.960 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.960 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.960 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659331+0000", 2024-09-12T16:16:22.960 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.960 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.960 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.960 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.960 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659331+0000", 2024-09-12T16:16:22.960 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4999999999999998e-07 2024-09-12T16:16:22.960 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.961 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.961 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.961 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659333+0000", 2024-09-12T16:16:22.961 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1909999999999999e-06 2024-09-12T16:16:22.961 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.961 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.961 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.961 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659349+0000", 2024-09-12T16:16:22.961 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6093999999999999e-05 2024-09-12T16:16:22.961 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.961 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.961 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.961 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659357+0000", 2024-09-12T16:16:22.961 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6739999999999997e-06 2024-09-12T16:16:22.962 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.962 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.962 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.962 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.962 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.962 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29951 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.962 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.650353+0000", 2024-09-12T16:16:22.962 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013624434, 2024-09-12T16:16:22.962 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015845759000000001, 2024-09-12T16:16:22.962 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.962 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.962 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.962 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.962 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.963 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.963 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29951 2024-09-12T16:16:22.963 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.963 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.963 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.963 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.963 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650353+0000", 2024-09-12T16:16:22.963 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.963 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.963 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.963 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.963 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650353+0000", 2024-09-12T16:16:22.963 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.963 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.963 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.964 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.964 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650354+0000", 2024-09-12T16:16:22.964 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.77e-07 2024-09-12T16:16:22.964 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.964 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.964 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.964 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650372+0000", 2024-09-12T16:16:22.964 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7754999999999999e-05 2024-09-12T16:16:22.964 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.964 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.964 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.964 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650378+0000", 2024-09-12T16:16:22.964 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6930000000000001e-06 2024-09-12T16:16:22.964 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.965 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.965 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.965 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650381+0000", 2024-09-12T16:16:22.965 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1559999999999999e-06 2024-09-12T16:16:22.965 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.965 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.965 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.965 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.965 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.965 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29983 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.965 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651068+0000", 2024-09-12T16:16:22.965 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012910102, 2024-09-12T16:16:22.965 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015156667, 2024-09-12T16:16:22.966 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.966 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.966 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.966 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.966 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.966 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.966 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29983 2024-09-12T16:16:22.966 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.966 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.966 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.966 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.966 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651068+0000", 2024-09-12T16:16:22.966 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.966 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.966 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.966 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.967 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651068+0000", 2024-09-12T16:16:22.967 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.967 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.967 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.967 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.967 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651068+0000", 2024-09-12T16:16:22.967 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1300000000000001e-07 2024-09-12T16:16:22.967 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.967 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.967 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.967 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651070+0000", 2024-09-12T16:16:22.967 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4190000000000001e-06 2024-09-12T16:16:22.967 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.967 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.967 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.967 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651073+0000", 2024-09-12T16:16:22.968 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3380000000000001e-06 2024-09-12T16:16:22.968 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.968 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.968 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.968 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651076+0000", 2024-09-12T16:16:22.968 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6410000000000002e-06 2024-09-12T16:16:22.968 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.968 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.968 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.968 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.968 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.968 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30015 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.968 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651818+0000", 2024-09-12T16:16:22.969 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012159315, 2024-09-12T16:16:22.969 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014436707, 2024-09-12T16:16:22.969 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.969 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.969 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.969 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.969 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.969 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.969 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30015 2024-09-12T16:16:22.969 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.969 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.969 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.969 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.969 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651818+0000", 2024-09-12T16:16:22.970 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.970 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.970 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.970 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.970 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651818+0000", 2024-09-12T16:16:22.970 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.970 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.970 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.970 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.970 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651819+0000", 2024-09-12T16:16:22.970 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1899999999999998e-07 2024-09-12T16:16:22.970 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.970 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.970 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.970 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651820+0000", 2024-09-12T16:16:22.971 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5230000000000001e-06 2024-09-12T16:16:22.971 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.971 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.971 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.971 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651824+0000", 2024-09-12T16:16:22.971 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4479999999999999e-06 2024-09-12T16:16:22.971 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.971 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.971 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.971 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651827+0000", 2024-09-12T16:16:22.971 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2009999999999999e-06 2024-09-12T16:16:22.971 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.971 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.972 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.972 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.972 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.972 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30047 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.972 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652419+0000", 2024-09-12T16:16:22.972 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011559239000000001, 2024-09-12T16:16:22.972 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013862327000000001, 2024-09-12T16:16:22.972 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.972 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.972 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.972 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.972 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.972 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.972 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30047 2024-09-12T16:16:22.973 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.973 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.973 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.973 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.973 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652419+0000", 2024-09-12T16:16:22.973 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.973 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.973 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.973 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.973 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652419+0000", 2024-09-12T16:16:22.973 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.973 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.973 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.974 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.974 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652419+0000", 2024-09-12T16:16:22.974 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8999999999999998e-07 2024-09-12T16:16:22.974 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.974 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.974 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.974 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652420+0000", 2024-09-12T16:16:22.974 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.08e-06 2024-09-12T16:16:22.974 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.974 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.974 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.974 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652423+0000", 2024-09-12T16:16:22.974 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8820000000000001e-06 2024-09-12T16:16:22.974 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.974 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.975 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.975 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652425+0000", 2024-09-12T16:16:22.975 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4779999999999998e-06 2024-09-12T16:16:22.975 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.975 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.975 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.975 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.975 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.975 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30085 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.975 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652812+0000", 2024-09-12T16:16:22.975 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011165707, 2024-09-12T16:16:22.975 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013494468000000001, 2024-09-12T16:16:22.975 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.976 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.976 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.976 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.976 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.976 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.976 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30085 2024-09-12T16:16:22.976 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.976 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.976 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.976 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.976 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652812+0000", 2024-09-12T16:16:22.976 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.976 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.976 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.977 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.977 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652812+0000", 2024-09-12T16:16:22.977 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.977 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.977 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.977 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.977 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652812+0000", 2024-09-12T16:16:22.977 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0400000000000002e-07 2024-09-12T16:16:22.977 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.977 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.977 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.977 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652817+0000", 2024-09-12T16:16:22.977 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2379999999999999e-06 2024-09-12T16:16:22.977 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.977 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.977 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.978 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652821+0000", 2024-09-12T16:16:22.978 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1620000000000001e-06 2024-09-12T16:16:22.978 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.978 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.978 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.978 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652824+0000", 2024-09-12T16:16:22.978 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5310000000000002e-06 2024-09-12T16:16:22.978 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.978 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.978 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.978 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.978 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.978 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30118 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.978 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.658588+0000", 2024-09-12T16:16:22.978 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0053901859999999999, 2024-09-12T16:16:22.979 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0077624010000000004, 2024-09-12T16:16:22.979 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.979 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.979 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.979 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.979 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.979 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.979 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30118 2024-09-12T16:16:22.979 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.979 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.979 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.979 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.979 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658588+0000", 2024-09-12T16:16:22.979 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.979 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.979 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.980 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.980 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658588+0000", 2024-09-12T16:16:22.980 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.980 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.980 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.980 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.980 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658588+0000", 2024-09-12T16:16:22.980 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3000000000000001e-07 2024-09-12T16:16:22.980 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.980 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.980 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.980 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658590+0000", 2024-09-12T16:16:22.980 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0329999999999998e-06 2024-09-12T16:16:22.980 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.981 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.981 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.981 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658598+0000", 2024-09-12T16:16:22.981 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5410000000000003e-06 2024-09-12T16:16:22.981 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.981 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.981 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.981 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658602+0000", 2024-09-12T16:16:22.981 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.69e-06 2024-09-12T16:16:22.981 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.981 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.981 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.981 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.981 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.982 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30150 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.982 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.659365+0000", 2024-09-12T16:16:22.982 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0046125589999999996, 2024-09-12T16:16:22.982 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.007029698, 2024-09-12T16:16:22.982 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.982 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.982 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.982 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.982 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.982 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.982 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30150 2024-09-12T16:16:22.982 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.982 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.982 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.982 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.983 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659365+0000", 2024-09-12T16:16:22.983 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.983 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.983 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.983 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659365+0000", 2024-09-12T16:16:22.983 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.983 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.983 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.983 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659366+0000", 2024-09-12T16:16:22.983 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0200000000000003e-07 2024-09-12T16:16:22.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.983 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.984 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.984 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659368+0000", 2024-09-12T16:16:22.984 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4499999999999998e-06 2024-09-12T16:16:22.984 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.984 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.984 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.984 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659375+0000", 2024-09-12T16:16:22.984 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3810000000000001e-06 2024-09-12T16:16:22.984 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.984 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.984 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.984 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659381+0000", 2024-09-12T16:16:22.984 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3240000000000002e-06 2024-09-12T16:16:22.984 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.985 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.985 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.985 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.985 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.985 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29952 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.985 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.650387+0000", 2024-09-12T16:16:22.985 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013591086, 2024-09-12T16:16:22.985 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016060354999999998, 2024-09-12T16:16:22.985 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.985 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.985 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.985 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.985 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.986 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.986 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29952 2024-09-12T16:16:22.986 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.986 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.986 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.986 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.986 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650387+0000", 2024-09-12T16:16:22.986 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.986 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.986 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.986 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.986 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650387+0000", 2024-09-12T16:16:22.986 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.986 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.986 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.986 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.987 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650387+0000", 2024-09-12T16:16:22.987 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4299999999999999e-07 2024-09-12T16:16:22.987 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.987 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.987 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.987 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650388+0000", 2024-09-12T16:16:22.987 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2500000000000001e-06 2024-09-12T16:16:22.987 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.987 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.987 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.987 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650392+0000", 2024-09-12T16:16:22.987 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2559999999999998e-06 2024-09-12T16:16:22.987 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.987 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.988 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.988 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650394+0000", 2024-09-12T16:16:22.988 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5900000000000002e-06 2024-09-12T16:16:22.988 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.988 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.988 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.988 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.988 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.988 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29984 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.988 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651080+0000", 2024-09-12T16:16:22.988 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012897623, 2024-09-12T16:16:22.988 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015410129, 2024-09-12T16:16:22.988 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.988 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.989 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.989 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.989 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.989 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.989 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29984 2024-09-12T16:16:22.989 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.989 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.989 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.989 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.989 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651080+0000", 2024-09-12T16:16:22.989 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.989 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.989 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.989 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.989 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651080+0000", 2024-09-12T16:16:22.990 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.990 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.990 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.990 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.990 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651080+0000", 2024-09-12T16:16:22.990 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:16:22.990 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.990 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.990 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.990 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651086+0000", 2024-09-12T16:16:22.990 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4469999999999997e-06 2024-09-12T16:16:22.990 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.990 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.990 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.990 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651089+0000", 2024-09-12T16:16:22.991 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.455e-06 2024-09-12T16:16:22.991 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.991 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.991 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.991 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651094+0000", 2024-09-12T16:16:22.991 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6210000000000003e-06 2024-09-12T16:16:22.991 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.991 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.991 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.991 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.991 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.991 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30016 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.991 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651832+0000", 2024-09-12T16:16:22.991 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012146004, 2024-09-12T16:16:22.991 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014705406000000001, 2024-09-12T16:16:22.992 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.992 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.992 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.992 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.992 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.992 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.992 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30016 2024-09-12T16:16:22.992 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.992 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.992 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.992 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.992 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651832+0000", 2024-09-12T16:16:22.992 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.992 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.993 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.993 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.993 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651832+0000", 2024-09-12T16:16:22.993 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.993 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.993 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.993 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.993 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651832+0000", 2024-09-12T16:16:22.993 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1799999999999999e-07 2024-09-12T16:16:22.993 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.993 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.993 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.993 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651833+0000", 2024-09-12T16:16:22.993 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.127e-06 2024-09-12T16:16:22.993 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.994 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.994 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.994 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651837+0000", 2024-09-12T16:16:22.994 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.284e-06 2024-09-12T16:16:22.994 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.994 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.994 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.994 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651840+0000", 2024-09-12T16:16:22.994 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6419999999999999e-06 2024-09-12T16:16:22.994 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.994 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.994 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.994 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.994 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.994 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30048 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.994 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652428+0000", 2024-09-12T16:16:22.995 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011549547, 2024-09-12T16:16:22.995 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014152954000000001, 2024-09-12T16:16:22.995 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.995 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.995 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.995 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.995 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.995 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.995 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30048 2024-09-12T16:16:22.995 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.995 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.995 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.995 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.995 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652428+0000", 2024-09-12T16:16:22.995 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.996 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.996 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.996 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.996 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652428+0000", 2024-09-12T16:16:22.996 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.996 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.996 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.996 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.996 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652428+0000", 2024-09-12T16:16:22.996 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1e-07 2024-09-12T16:16:22.996 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.996 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.996 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:22.996 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652430+0000", 2024-09-12T16:16:22.996 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1119999999999999e-06 2024-09-12T16:16:22.997 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.997 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.997 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:22.997 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652432+0000", 2024-09-12T16:16:22.997 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9179999999999998e-06 2024-09-12T16:16:22.997 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.997 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.997 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:22.997 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652435+0000", 2024-09-12T16:16:22.997 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4219999999999999e-06 2024-09-12T16:16:22.997 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.997 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:22.997 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:22.997 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.997 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.998 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30087 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:22.998 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652829+0000", 2024-09-12T16:16:22.998 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011148318000000001, 2024-09-12T16:16:22.998 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013798993000000001, 2024-09-12T16:16:22.998 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:22.998 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:22.998 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:22.998 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:22.998 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:22.998 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:22.998 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30087 2024-09-12T16:16:22.998 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.998 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:22.998 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.998 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:22.999 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652829+0000", 2024-09-12T16:16:22.999 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.999 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.999 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.999 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:22.999 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652829+0000", 2024-09-12T16:16:22.999 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:22.999 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.999 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.999 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:22.999 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652830+0000", 2024-09-12T16:16:22.999 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0600000000000001e-07 2024-09-12T16:16:22.999 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:22.999 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:22.999 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.000 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652831+0000", 2024-09-12T16:16:23.000 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1429999999999999e-06 2024-09-12T16:16:23.000 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.000 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.000 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.000 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652835+0000", 2024-09-12T16:16:23.000 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6619999999999998e-06 2024-09-12T16:16:23.000 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.000 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.000 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.000 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652837+0000", 2024-09-12T16:16:23.000 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.509e-06 2024-09-12T16:16:23.000 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.000 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.000 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.001 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.001 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.001 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30119 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.001 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.658609+0000", 2024-09-12T16:16:23.001 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0053691930000000004, 2024-09-12T16:16:23.001 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0080643929999999996, 2024-09-12T16:16:23.001 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.001 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.001 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.001 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.001 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.001 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.001 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30119 2024-09-12T16:16:23.001 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.001 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.002 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.002 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.002 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658609+0000", 2024-09-12T16:16:23.002 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.002 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.002 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.002 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.002 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658609+0000", 2024-09-12T16:16:23.002 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.002 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.002 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.002 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.002 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658609+0000", 2024-09-12T16:16:23.002 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9200000000000002e-07 2024-09-12T16:16:23.002 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.002 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.003 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.003 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658611+0000", 2024-09-12T16:16:23.003 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.869e-06 2024-09-12T16:16:23.003 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.003 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.003 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.003 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658619+0000", 2024-09-12T16:16:23.003 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0809999999999994e-06 2024-09-12T16:16:23.003 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.003 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.003 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.003 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658624+0000", 2024-09-12T16:16:23.003 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9010000000000002e-06 2024-09-12T16:16:23.003 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.003 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.004 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.004 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.004 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.004 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30151 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.004 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.659398+0000", 2024-09-12T16:16:23.004 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0045793489999999999, 2024-09-12T16:16:23.004 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0073207200000000002, 2024-09-12T16:16:23.004 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.004 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.004 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.004 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.004 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.004 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.004 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30151 2024-09-12T16:16:23.004 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.005 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.005 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.005 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.005 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659398+0000", 2024-09-12T16:16:23.005 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.005 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.005 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.005 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.005 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659398+0000", 2024-09-12T16:16:23.005 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.005 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.005 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.005 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.005 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659399+0000", 2024-09-12T16:16:23.005 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7e-07 2024-09-12T16:16:23.005 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.006 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.006 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.006 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659401+0000", 2024-09-12T16:16:23.006 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.778e-06 2024-09-12T16:16:23.006 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.006 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.006 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.006 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659409+0000", 2024-09-12T16:16:23.006 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5029999999999997e-06 2024-09-12T16:16:23.006 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.006 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.006 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.006 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659412+0000", 2024-09-12T16:16:23.006 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.371e-06 2024-09-12T16:16:23.006 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.007 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.007 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.007 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.007 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.007 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29953 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.007 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.650420+0000", 2024-09-12T16:16:23.007 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013558245999999999, 2024-09-12T16:16:23.007 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016345545999999999, 2024-09-12T16:16:23.007 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.007 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.007 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.007 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.007 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.008 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.008 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29953 2024-09-12T16:16:23.008 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.008 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.008 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.008 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.008 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650420+0000", 2024-09-12T16:16:23.008 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.008 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.008 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.008 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.008 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650420+0000", 2024-09-12T16:16:23.008 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.008 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.009 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.009 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.009 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650420+0000", 2024-09-12T16:16:23.009 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.32e-07 2024-09-12T16:16:23.009 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.009 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.009 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.009 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650422+0000", 2024-09-12T16:16:23.009 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7770000000000001e-06 2024-09-12T16:16:23.009 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.009 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.009 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.009 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650426+0000", 2024-09-12T16:16:23.009 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9489999999999998e-06 2024-09-12T16:16:23.009 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.009 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.010 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.010 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650428+0000", 2024-09-12T16:16:23.010 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7099999999999999e-06 2024-09-12T16:16:23.010 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.010 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.010 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.010 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.010 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.010 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29985 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.010 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651098+0000", 2024-09-12T16:16:23.010 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012880038999999999, 2024-09-12T16:16:23.010 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015713576, 2024-09-12T16:16:23.010 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.011 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.011 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.011 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.011 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.011 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.011 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29985 2024-09-12T16:16:23.011 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.011 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.011 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.011 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.011 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651098+0000", 2024-09-12T16:16:23.011 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.011 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.012 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.012 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.012 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651098+0000", 2024-09-12T16:16:23.012 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.012 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.012 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.012 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.012 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651098+0000", 2024-09-12T16:16:23.012 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3999999999999997e-07 2024-09-12T16:16:23.012 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.012 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.012 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.012 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651099+0000", 2024-09-12T16:16:23.013 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.206e-06 2024-09-12T16:16:23.013 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.013 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.013 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.013 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651103+0000", 2024-09-12T16:16:23.013 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4230000000000001e-06 2024-09-12T16:16:23.013 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.013 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.013 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.013 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651105+0000", 2024-09-12T16:16:23.013 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6460000000000002e-06 2024-09-12T16:16:23.013 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.014 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.014 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.014 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.014 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.014 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30017 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.014 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651863+0000", 2024-09-12T16:16:23.014 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012114768, 2024-09-12T16:16:23.014 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014992245, 2024-09-12T16:16:23.014 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.014 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.014 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.014 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.014 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.014 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.015 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30017 2024-09-12T16:16:23.015 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.015 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.015 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.015 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.015 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651863+0000", 2024-09-12T16:16:23.015 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.015 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.015 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.015 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.015 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651863+0000", 2024-09-12T16:16:23.015 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.015 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.015 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.016 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.016 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651863+0000", 2024-09-12T16:16:23.016 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1899999999999998e-07 2024-09-12T16:16:23.016 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.016 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.016 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.016 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651865+0000", 2024-09-12T16:16:23.016 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.403e-06 2024-09-12T16:16:23.016 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.016 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.016 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.016 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651868+0000", 2024-09-12T16:16:23.016 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3289999999999998e-06 2024-09-12T16:16:23.016 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.017 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.017 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.017 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651871+0000", 2024-09-12T16:16:23.017 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7089999999999998e-06 2024-09-12T16:16:23.017 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.017 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.017 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.017 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.017 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.017 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30049 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.017 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652439+0000", 2024-09-12T16:16:23.017 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011539236, 2024-09-12T16:16:23.017 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014450727, 2024-09-12T16:16:23.017 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.018 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.018 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.018 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.018 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.018 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.018 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30049 2024-09-12T16:16:23.018 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.018 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.018 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.018 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.018 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652439+0000", 2024-09-12T16:16:23.018 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.018 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.018 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.019 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.019 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652439+0000", 2024-09-12T16:16:23.019 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.019 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.019 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.019 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.019 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652439+0000", 2024-09-12T16:16:23.019 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0599999999999999e-07 2024-09-12T16:16:23.019 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.019 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.019 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.019 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652440+0000", 2024-09-12T16:16:23.019 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0950000000000001e-06 2024-09-12T16:16:23.019 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.020 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.020 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.020 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652443+0000", 2024-09-12T16:16:23.020 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9859999999999999e-06 2024-09-12T16:16:23.020 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.020 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.020 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.020 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652445+0000", 2024-09-12T16:16:23.020 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4499999999999998e-06 2024-09-12T16:16:23.020 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.020 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.020 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.020 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.020 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.021 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30088 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.021 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652840+0000", 2024-09-12T16:16:23.021 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011137617000000001, 2024-09-12T16:16:23.021 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014076447000000001, 2024-09-12T16:16:23.021 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.021 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.021 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.021 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.021 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.021 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.021 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30088 2024-09-12T16:16:23.021 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.021 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.021 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.021 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.022 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652840+0000", 2024-09-12T16:16:23.022 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.022 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.022 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.022 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.022 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652840+0000", 2024-09-12T16:16:23.022 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.022 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.022 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.022 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.022 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652840+0000", 2024-09-12T16:16:23.022 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:16:23.022 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.022 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.022 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.023 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652841+0000", 2024-09-12T16:16:23.023 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.057e-06 2024-09-12T16:16:23.023 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.023 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.023 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.023 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652844+0000", 2024-09-12T16:16:23.023 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0419999999999998e-06 2024-09-12T16:16:23.023 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.023 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.023 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.023 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652847+0000", 2024-09-12T16:16:23.023 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5270000000000001e-06 2024-09-12T16:16:23.023 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.023 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.023 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.024 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.024 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.024 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30120 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.024 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.658632+0000", 2024-09-12T16:16:23.024 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0053460039999999997, 2024-09-12T16:16:23.024 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.008307577, 2024-09-12T16:16:23.024 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.024 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.024 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.024 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.024 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.024 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.024 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30120 2024-09-12T16:16:23.024 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.024 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.025 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.025 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.025 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658632+0000", 2024-09-12T16:16:23.025 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.025 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.025 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.025 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.025 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658632+0000", 2024-09-12T16:16:23.025 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.025 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.025 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.025 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.025 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658632+0000", 2024-09-12T16:16:23.025 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7e-07 2024-09-12T16:16:23.026 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.026 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.026 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.026 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658634+0000", 2024-09-12T16:16:23.026 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.041e-06 2024-09-12T16:16:23.026 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.026 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.026 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.026 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658642+0000", 2024-09-12T16:16:23.026 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9589999999999995e-06 2024-09-12T16:16:23.026 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.026 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.026 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.026 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658650+0000", 2024-09-12T16:16:23.027 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2889999999999998e-06 2024-09-12T16:16:23.027 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.027 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.027 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.027 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.027 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.027 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30152 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.027 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.659417+0000", 2024-09-12T16:16:23.027 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0045606179999999998, 2024-09-12T16:16:23.027 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0075471649999999998, 2024-09-12T16:16:23.027 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.027 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.027 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.027 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.028 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.028 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.028 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30152 2024-09-12T16:16:23.028 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.028 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.028 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.028 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.028 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659417+0000", 2024-09-12T16:16:23.028 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.028 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.028 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.028 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.028 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659417+0000", 2024-09-12T16:16:23.029 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.029 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.029 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.029 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.029 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659417+0000", 2024-09-12T16:16:23.029 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.91e-07 2024-09-12T16:16:23.029 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.029 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.029 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.029 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659419+0000", 2024-09-12T16:16:23.029 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3549999999999999e-06 2024-09-12T16:16:23.029 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.029 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.030 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.030 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659422+0000", 2024-09-12T16:16:23.030 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4400000000000001e-06 2024-09-12T16:16:23.030 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.030 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.030 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.030 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659425+0000", 2024-09-12T16:16:23.030 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6240000000000002e-06 2024-09-12T16:16:23.030 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.030 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.030 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.030 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.030 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.030 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29954 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.030 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.650462+0000", 2024-09-12T16:16:23.031 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013516059, 2024-09-12T16:16:23.031 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016527745, 2024-09-12T16:16:23.031 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.031 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.031 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.031 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.031 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.031 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.031 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29954 2024-09-12T16:16:23.031 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.031 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.031 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.031 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.032 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650462+0000", 2024-09-12T16:16:23.032 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.032 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.032 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.032 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.032 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650462+0000", 2024-09-12T16:16:23.032 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.032 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.032 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.032 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.032 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650462+0000", 2024-09-12T16:16:23.032 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1800000000000001e-07 2024-09-12T16:16:23.032 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.032 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.032 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.033 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650464+0000", 2024-09-12T16:16:23.033 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5200000000000001e-06 2024-09-12T16:16:23.033 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.033 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.033 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.033 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650467+0000", 2024-09-12T16:16:23.033 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5710000000000002e-06 2024-09-12T16:16:23.033 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.033 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.033 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.033 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650470+0000", 2024-09-12T16:16:23.033 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6919999999999998e-06 2024-09-12T16:16:23.033 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.034 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.034 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.034 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.034 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.034 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29986 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.034 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651113+0000", 2024-09-12T16:16:23.034 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012864393, 2024-09-12T16:16:23.034 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015901399, 2024-09-12T16:16:23.034 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.034 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.034 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.034 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.034 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.034 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.034 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29986 2024-09-12T16:16:23.035 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.035 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.035 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.035 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.035 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651113+0000", 2024-09-12T16:16:23.035 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.035 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.035 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.035 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.035 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651113+0000", 2024-09-12T16:16:23.035 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.035 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.035 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.035 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.036 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651114+0000", 2024-09-12T16:16:23.036 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6e-07 2024-09-12T16:16:23.036 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.036 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.036 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.036 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651115+0000", 2024-09-12T16:16:23.036 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.246e-06 2024-09-12T16:16:23.036 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.036 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.036 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.036 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651118+0000", 2024-09-12T16:16:23.036 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4149999999999999e-06 2024-09-12T16:16:23.036 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.036 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.036 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.037 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651121+0000", 2024-09-12T16:16:23.037 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6450000000000001e-06 2024-09-12T16:16:23.037 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.037 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.037 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.037 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.037 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.037 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30018 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.037 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651874+0000", 2024-09-12T16:16:23.037 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012103663000000001, 2024-09-12T16:16:23.037 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015165466000000001, 2024-09-12T16:16:23.037 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.037 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.037 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.038 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.038 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.038 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.038 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30018 2024-09-12T16:16:23.038 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.038 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.038 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.038 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.038 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651874+0000", 2024-09-12T16:16:23.038 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.038 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.038 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.038 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.039 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651874+0000", 2024-09-12T16:16:23.039 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.039 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.039 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.039 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.039 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651874+0000", 2024-09-12T16:16:23.039 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1800000000000002e-07 2024-09-12T16:16:23.039 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.039 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.039 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.039 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651876+0000", 2024-09-12T16:16:23.039 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.096e-06 2024-09-12T16:16:23.040 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.040 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.040 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.040 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651879+0000", 2024-09-12T16:16:23.040 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.004e-06 2024-09-12T16:16:23.040 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.040 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.040 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.040 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651881+0000", 2024-09-12T16:16:23.040 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6010000000000002e-06 2024-09-12T16:16:23.040 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.040 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.040 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.040 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.040 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.041 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30050 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.041 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652448+0000", 2024-09-12T16:16:23.041 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011529456, 2024-09-12T16:16:23.041 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014616387, 2024-09-12T16:16:23.041 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.041 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.041 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.041 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.041 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.041 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.041 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30050 2024-09-12T16:16:23.041 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.041 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.041 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.041 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.042 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652448+0000", 2024-09-12T16:16:23.042 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.042 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.042 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.042 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.042 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652448+0000", 2024-09-12T16:16:23.042 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.042 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.042 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.042 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.042 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652449+0000", 2024-09-12T16:16:23.042 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1500000000000001e-07 2024-09-12T16:16:23.042 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.042 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.042 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.043 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652450+0000", 2024-09-12T16:16:23.043 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.096e-06 2024-09-12T16:16:23.043 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.043 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.043 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.043 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652453+0000", 2024-09-12T16:16:23.043 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9699999999999999e-06 2024-09-12T16:16:23.043 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.043 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.043 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.043 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652455+0000", 2024-09-12T16:16:23.043 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4849999999999999e-06 2024-09-12T16:16:23.043 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.043 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.043 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.044 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.044 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.044 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30089 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.044 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652850+0000", 2024-09-12T16:16:23.044 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011127763000000001, 2024-09-12T16:16:23.044 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014238626000000001, 2024-09-12T16:16:23.044 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.044 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.044 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.044 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.044 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.044 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.044 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30089 2024-09-12T16:16:23.044 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.044 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.045 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.045 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.045 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652850+0000", 2024-09-12T16:16:23.045 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.045 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.045 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.045 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.045 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652850+0000", 2024-09-12T16:16:23.045 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.045 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.045 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.045 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.045 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652850+0000", 2024-09-12T16:16:23.045 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.16e-07 2024-09-12T16:16:23.046 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.046 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.046 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.046 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652851+0000", 2024-09-12T16:16:23.046 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0380000000000001e-06 2024-09-12T16:16:23.046 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.046 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.046 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.046 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652854+0000", 2024-09-12T16:16:23.046 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9960000000000002e-06 2024-09-12T16:16:23.046 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.046 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.046 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.046 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652857+0000", 2024-09-12T16:16:23.046 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3659999999999999e-06 2024-09-12T16:16:23.047 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.047 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.047 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.047 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.047 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.047 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30121 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.047 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.658658+0000", 2024-09-12T16:16:23.047 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0053198059999999998, 2024-09-12T16:16:23.047 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0084747469999999995, 2024-09-12T16:16:23.047 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.047 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.047 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.047 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.048 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.048 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.048 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30121 2024-09-12T16:16:23.048 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.048 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.048 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.048 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.048 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658658+0000", 2024-09-12T16:16:23.048 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.048 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.048 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.048 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.048 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658658+0000", 2024-09-12T16:16:23.049 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.049 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.049 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.049 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.049 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658658+0000", 2024-09-12T16:16:23.049 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1300000000000001e-07 2024-09-12T16:16:23.049 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.049 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.049 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.049 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658669+0000", 2024-09-12T16:16:23.049 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0302000000000001e-05 2024-09-12T16:16:23.049 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.049 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.049 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.050 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658676+0000", 2024-09-12T16:16:23.050 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9269999999999999e-06 2024-09-12T16:16:23.050 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.050 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.050 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.050 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658695+0000", 2024-09-12T16:16:23.050 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9145000000000001e-05 2024-09-12T16:16:23.050 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.050 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.050 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.050 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.050 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.050 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30153 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.050 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.659428+0000", 2024-09-12T16:16:23.051 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0045495290000000001, 2024-09-12T16:16:23.051 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0077386, 2024-09-12T16:16:23.051 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.051 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.051 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.051 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.051 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.051 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.051 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30153 2024-09-12T16:16:23.051 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.051 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.051 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.051 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.051 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659428+0000", 2024-09-12T16:16:23.052 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.052 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.052 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.052 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.052 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659428+0000", 2024-09-12T16:16:23.052 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.052 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.052 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.052 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.052 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665283+0000", 2024-09-12T16:16:23.052 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0058542510000000004 2024-09-12T16:16:23.052 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.052 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.052 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.052 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665286+0000", 2024-09-12T16:16:23.053 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6059999999999999e-06 2024-09-12T16:16:23.053 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.053 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.053 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.053 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665296+0000", 2024-09-12T16:16:23.053 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8130000000000007e-06 2024-09-12T16:16:23.053 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.053 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.053 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.053 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665301+0000", 2024-09-12T16:16:23.053 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.921e-06 2024-09-12T16:16:23.053 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.053 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.053 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.054 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.054 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.054 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29955 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.054 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.650475+0000", 2024-09-12T16:16:23.054 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013503077, 2024-09-12T16:16:23.054 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016731451000000001, 2024-09-12T16:16:23.054 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.054 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.054 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.054 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.054 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.054 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.054 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29955 2024-09-12T16:16:23.054 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.054 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.055 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.055 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.055 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650475+0000", 2024-09-12T16:16:23.055 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.055 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.055 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.055 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.055 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650475+0000", 2024-09-12T16:16:23.055 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.055 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.055 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.055 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.055 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650475+0000", 2024-09-12T16:16:23.055 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2099999999999998e-07 2024-09-12T16:16:23.056 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.056 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.056 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.056 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650476+0000", 2024-09-12T16:16:23.056 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.178e-06 2024-09-12T16:16:23.056 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.056 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.056 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.056 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650480+0000", 2024-09-12T16:16:23.056 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7479999999999999e-06 2024-09-12T16:16:23.056 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.056 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.056 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.057 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650483+0000", 2024-09-12T16:16:23.057 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8509999999999999e-06 2024-09-12T16:16:23.057 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.057 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.057 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.057 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.057 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.057 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29987 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.057 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651154+0000", 2024-09-12T16:16:23.057 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012824109, 2024-09-12T16:16:23.057 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016082638999999999, 2024-09-12T16:16:23.057 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.057 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.057 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.058 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.058 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.058 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.058 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29987 2024-09-12T16:16:23.058 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.058 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.058 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.058 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.058 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651154+0000", 2024-09-12T16:16:23.058 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.058 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.058 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.058 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.058 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651154+0000", 2024-09-12T16:16:23.058 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.059 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.059 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.059 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.059 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651154+0000", 2024-09-12T16:16:23.059 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3000000000000001e-07 2024-09-12T16:16:23.059 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.059 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.059 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.059 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651156+0000", 2024-09-12T16:16:23.059 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4980000000000001e-06 2024-09-12T16:16:23.059 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.059 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.059 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.059 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651159+0000", 2024-09-12T16:16:23.059 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.349e-06 2024-09-12T16:16:23.060 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.060 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.060 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.060 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651162+0000", 2024-09-12T16:16:23.060 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7700000000000002e-06 2024-09-12T16:16:23.060 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.060 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.060 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.060 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.060 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.060 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30019 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.060 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651898+0000", 2024-09-12T16:16:23.060 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012079922999999999, 2024-09-12T16:16:23.060 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015365155, 2024-09-12T16:16:23.061 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.061 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.061 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.061 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.061 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.061 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.061 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30019 2024-09-12T16:16:23.061 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.061 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.061 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.061 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.061 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651898+0000", 2024-09-12T16:16:23.061 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.062 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.064 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.064 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.064 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651898+0000", 2024-09-12T16:16:23.064 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.064 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.064 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.064 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.064 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651898+0000", 2024-09-12T16:16:23.065 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1600000000000002e-07 2024-09-12T16:16:23.065 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.065 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.065 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.065 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651900+0000", 2024-09-12T16:16:23.065 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4300000000000001e-06 2024-09-12T16:16:23.065 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.065 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.065 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.065 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651903+0000", 2024-09-12T16:16:23.065 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2440000000000002e-06 2024-09-12T16:16:23.065 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.065 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.065 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.066 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651906+0000", 2024-09-12T16:16:23.066 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8949999999999998e-06 2024-09-12T16:16:23.066 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.066 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.066 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.066 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.066 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.066 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30051 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.066 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652458+0000", 2024-09-12T16:16:23.066 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011519758999999999, 2024-09-12T16:16:23.066 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014829946, 2024-09-12T16:16:23.066 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.066 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.066 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.067 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.067 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.067 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.067 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30051 2024-09-12T16:16:23.067 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.067 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.067 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.067 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.067 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652458+0000", 2024-09-12T16:16:23.067 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.067 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.067 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.067 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.067 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652458+0000", 2024-09-12T16:16:23.067 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.067 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.068 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.068 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.068 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652458+0000", 2024-09-12T16:16:23.068 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.22e-07 2024-09-12T16:16:23.068 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.068 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.068 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.068 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652459+0000", 2024-09-12T16:16:23.068 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9700000000000005e-07 2024-09-12T16:16:23.068 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.068 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.068 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.069 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652462+0000", 2024-09-12T16:16:23.069 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8880000000000001e-06 2024-09-12T16:16:23.069 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.069 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.069 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.069 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652465+0000", 2024-09-12T16:16:23.069 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2820000000000001e-06 2024-09-12T16:16:23.069 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.069 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.069 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.069 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.069 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.069 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30090 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.069 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652860+0000", 2024-09-12T16:16:23.070 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011118187999999999, 2024-09-12T16:16:23.070 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014452649, 2024-09-12T16:16:23.070 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.070 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.070 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.070 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.070 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.070 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.070 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30090 2024-09-12T16:16:23.070 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.070 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.070 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.070 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.071 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652860+0000", 2024-09-12T16:16:23.071 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.071 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.071 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.071 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.071 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652860+0000", 2024-09-12T16:16:23.071 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.071 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.071 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.071 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.071 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652860+0000", 2024-09-12T16:16:23.071 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0900000000000001e-07 2024-09-12T16:16:23.071 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.071 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.071 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.072 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652861+0000", 2024-09-12T16:16:23.072 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.034e-06 2024-09-12T16:16:23.072 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.072 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.072 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.072 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652864+0000", 2024-09-12T16:16:23.072 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9569999999999998e-06 2024-09-12T16:16:23.072 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.072 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.072 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.072 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652866+0000", 2024-09-12T16:16:23.072 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.492e-06 2024-09-12T16:16:23.073 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.073 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.073 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.073 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.073 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.073 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30122 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.073 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.658714+0000", 2024-09-12T16:16:23.073 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0052641720000000001, 2024-09-12T16:16:23.073 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0086263339999999994, 2024-09-12T16:16:23.073 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.073 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.073 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.073 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.073 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.074 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.074 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30122 2024-09-12T16:16:23.074 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.074 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.074 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.074 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.074 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658714+0000", 2024-09-12T16:16:23.074 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.074 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.074 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.074 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.074 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658714+0000", 2024-09-12T16:16:23.074 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.074 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.074 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.075 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.075 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658714+0000", 2024-09-12T16:16:23.075 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9799999999999999e-07 2024-09-12T16:16:23.075 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.075 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.075 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.075 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658716+0000", 2024-09-12T16:16:23.075 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1749999999999999e-06 2024-09-12T16:16:23.075 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.075 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.075 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.075 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658721+0000", 2024-09-12T16:16:23.075 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6619999999999996e-06 2024-09-12T16:16:23.076 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.076 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.076 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.076 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658726+0000", 2024-09-12T16:16:23.076 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7450000000000003e-06 2024-09-12T16:16:23.076 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.076 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.076 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.076 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.076 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.076 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30154 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.076 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.665319+0000", 2024-09-12T16:16:23.076 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4294967295.9986587, 2024-09-12T16:16:23.076 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0020444259999999998, 2024-09-12T16:16:23.077 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.077 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.077 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.077 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.077 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.077 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.077 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30154 2024-09-12T16:16:23.077 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.077 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.077 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.077 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.077 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665319+0000", 2024-09-12T16:16:23.077 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.078 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.078 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.078 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.078 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665319+0000", 2024-09-12T16:16:23.078 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.078 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.078 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.078 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.078 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665320+0000", 2024-09-12T16:16:23.078 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6199999999999998e-07 2024-09-12T16:16:23.078 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.078 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.078 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.078 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665322+0000", 2024-09-12T16:16:23.079 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6189999999999998e-06 2024-09-12T16:16:23.079 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.079 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.079 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.079 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665330+0000", 2024-09-12T16:16:23.079 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1910000000000003e-06 2024-09-12T16:16:23.079 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.079 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.079 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.079 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665335+0000", 2024-09-12T16:16:23.079 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5860000000000004e-06 2024-09-12T16:16:23.079 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.079 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.079 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.080 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.080 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.080 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29956 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.080 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.650488+0000", 2024-09-12T16:16:23.080 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013490158, 2024-09-12T16:16:23.080 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016902227999999998, 2024-09-12T16:16:23.080 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.080 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.080 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.080 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.080 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.080 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.080 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29956 2024-09-12T16:16:23.081 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.081 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.081 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.081 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.081 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650488+0000", 2024-09-12T16:16:23.081 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.081 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.081 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.081 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.081 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650488+0000", 2024-09-12T16:16:23.081 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.081 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.081 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.081 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.082 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650488+0000", 2024-09-12T16:16:23.082 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4900000000000001e-07 2024-09-12T16:16:23.082 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.082 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.082 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.082 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650489+0000", 2024-09-12T16:16:23.082 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1480000000000001e-06 2024-09-12T16:16:23.082 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.082 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.082 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.082 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650492+0000", 2024-09-12T16:16:23.082 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2200000000000001e-06 2024-09-12T16:16:23.082 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.082 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.083 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.083 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650495+0000", 2024-09-12T16:16:23.083 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.486e-06 2024-09-12T16:16:23.083 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.083 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.083 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.083 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.083 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.083 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29988 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.083 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651165+0000", 2024-09-12T16:16:23.083 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012812743, 2024-09-12T16:16:23.083 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016248271000000002, 2024-09-12T16:16:23.083 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.083 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.084 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.084 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.084 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.084 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.084 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29988 2024-09-12T16:16:23.084 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.084 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.084 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.084 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.084 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651165+0000", 2024-09-12T16:16:23.084 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.084 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.084 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.085 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.085 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651165+0000", 2024-09-12T16:16:23.085 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.085 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.085 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.085 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.085 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651165+0000", 2024-09-12T16:16:23.085 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0800000000000001e-07 2024-09-12T16:16:23.085 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.085 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.085 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.085 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651166+0000", 2024-09-12T16:16:23.085 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.037e-06 2024-09-12T16:16:23.086 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.086 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.086 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.086 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651170+0000", 2024-09-12T16:16:23.086 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.67e-06 2024-09-12T16:16:23.086 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.086 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.086 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.086 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651173+0000", 2024-09-12T16:16:23.086 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.553e-06 2024-09-12T16:16:23.086 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.086 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.086 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.087 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.087 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.087 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30020 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.087 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651936+0000", 2024-09-12T16:16:23.087 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012041787, 2024-09-12T16:16:23.087 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015502405, 2024-09-12T16:16:23.087 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.087 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.087 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.087 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.087 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.087 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.087 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30020 2024-09-12T16:16:23.087 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.088 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.088 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.088 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.088 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651936+0000", 2024-09-12T16:16:23.088 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.088 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.088 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.088 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.088 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651936+0000", 2024-09-12T16:16:23.088 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.088 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.088 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.088 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.089 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651936+0000", 2024-09-12T16:16:23.089 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3700000000000001e-07 2024-09-12T16:16:23.089 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.089 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.089 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.089 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651940+0000", 2024-09-12T16:16:23.089 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6959999999999998e-06 2024-09-12T16:16:23.089 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.089 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.089 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.089 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651944+0000", 2024-09-12T16:16:23.089 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0439999999999997e-06 2024-09-12T16:16:23.089 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.090 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.090 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.090 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651947+0000", 2024-09-12T16:16:23.090 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7219999999999999e-06 2024-09-12T16:16:23.090 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.090 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.090 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.090 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.090 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.090 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30052 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.090 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652469+0000", 2024-09-12T16:16:23.090 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011509245, 2024-09-12T16:16:23.090 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014993408, 2024-09-12T16:16:23.090 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.091 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.091 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.091 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.091 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.091 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.091 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30052 2024-09-12T16:16:23.091 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.091 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.091 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.091 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.091 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652469+0000", 2024-09-12T16:16:23.091 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.091 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.091 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.092 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.092 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652469+0000", 2024-09-12T16:16:23.092 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.092 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.092 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.092 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.092 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652469+0000", 2024-09-12T16:16:23.092 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3799999999999999e-07 2024-09-12T16:16:23.092 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.092 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.092 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.092 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652470+0000", 2024-09-12T16:16:23.092 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0860000000000001e-06 2024-09-12T16:16:23.093 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.093 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.093 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.093 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652473+0000", 2024-09-12T16:16:23.093 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0340000000000001e-06 2024-09-12T16:16:23.093 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.093 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.093 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.093 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652476+0000", 2024-09-12T16:16:23.093 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1420000000000002e-06 2024-09-12T16:16:23.093 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.093 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.093 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.093 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.094 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.094 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30091 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.094 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652869+0000", 2024-09-12T16:16:23.094 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011108498, 2024-09-12T16:16:23.094 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014618763, 2024-09-12T16:16:23.094 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.094 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.094 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.094 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.094 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.094 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.094 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30091 2024-09-12T16:16:23.094 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.095 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.095 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.095 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.095 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652869+0000", 2024-09-12T16:16:23.095 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.095 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.095 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.095 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.095 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652869+0000", 2024-09-12T16:16:23.095 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.095 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.095 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.095 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.095 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652870+0000", 2024-09-12T16:16:23.096 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2999999999999999e-07 2024-09-12T16:16:23.096 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.096 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.096 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.096 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652871+0000", 2024-09-12T16:16:23.096 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.035e-06 2024-09-12T16:16:23.096 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.096 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.096 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.096 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652874+0000", 2024-09-12T16:16:23.096 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9550000000000001e-06 2024-09-12T16:16:23.096 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.096 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.096 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.097 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652876+0000", 2024-09-12T16:16:23.097 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5349999999999999e-06 2024-09-12T16:16:23.097 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.097 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.097 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.097 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.097 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.097 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30123 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.097 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.658731+0000", 2024-09-12T16:16:23.097 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0052470429999999998, 2024-09-12T16:16:23.097 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0087801860000000006, 2024-09-12T16:16:23.097 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.097 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.097 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.098 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.098 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.098 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.098 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30123 2024-09-12T16:16:23.098 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.098 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.098 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.098 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.098 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658731+0000", 2024-09-12T16:16:23.098 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.098 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.098 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.098 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.098 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658731+0000", 2024-09-12T16:16:23.099 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.099 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.099 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.099 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.099 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658731+0000", 2024-09-12T16:16:23.099 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5800000000000001e-07 2024-09-12T16:16:23.099 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.099 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.099 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.099 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658732+0000", 2024-09-12T16:16:23.099 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.316e-06 2024-09-12T16:16:23.099 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.099 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.100 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.100 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658736+0000", 2024-09-12T16:16:23.100 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2930000000000001e-06 2024-09-12T16:16:23.100 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.100 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.100 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.100 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658738+0000", 2024-09-12T16:16:23.100 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7819999999999998e-06 2024-09-12T16:16:23.100 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.100 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.100 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.100 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.100 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.100 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30155 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.101 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.665346+0000", 2024-09-12T16:16:23.101 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4294967295.9986315, 2024-09-12T16:16:23.101 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0021901049999999999, 2024-09-12T16:16:23.101 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.101 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.101 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.101 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.101 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.101 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.101 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30155 2024-09-12T16:16:23.101 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.101 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.101 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.101 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.102 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665346+0000", 2024-09-12T16:16:23.102 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.102 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.102 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.102 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.102 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665346+0000", 2024-09-12T16:16:23.102 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.102 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.102 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.102 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.102 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665347+0000", 2024-09-12T16:16:23.102 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7700000000000005e-07 2024-09-12T16:16:23.102 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.102 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.103 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.103 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665349+0000", 2024-09-12T16:16:23.103 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5519999999999999e-06 2024-09-12T16:16:23.103 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.103 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.103 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.103 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665367+0000", 2024-09-12T16:16:23.103 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7578999999999999e-05 2024-09-12T16:16:23.103 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.103 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.103 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.103 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665376+0000", 2024-09-12T16:16:23.103 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3870000000000001e-06 2024-09-12T16:16:23.103 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.104 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.104 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.104 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.104 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.104 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29957 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.104 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.650508+0000", 2024-09-12T16:16:23.104 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013470289999999999, 2024-09-12T16:16:23.104 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017062125000000001, 2024-09-12T16:16:23.104 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.104 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.104 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.104 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.104 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.104 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.104 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29957 2024-09-12T16:16:23.105 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.105 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.105 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.105 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.105 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650508+0000", 2024-09-12T16:16:23.105 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.105 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.105 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.105 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.105 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650508+0000", 2024-09-12T16:16:23.105 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.105 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.105 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.105 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.105 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650508+0000", 2024-09-12T16:16:23.106 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5899999999999998e-07 2024-09-12T16:16:23.106 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.106 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.106 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.106 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650509+0000", 2024-09-12T16:16:23.106 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.451e-06 2024-09-12T16:16:23.106 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.106 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.106 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.106 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650513+0000", 2024-09-12T16:16:23.106 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4750000000000002e-06 2024-09-12T16:16:23.106 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.106 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.106 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.106 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650515+0000", 2024-09-12T16:16:23.106 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.667e-06 2024-09-12T16:16:23.107 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.107 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.107 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.107 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.107 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.107 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29989 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.107 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651198+0000", 2024-09-12T16:16:23.107 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012779866000000001, 2024-09-12T16:16:23.107 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016400056999999999, 2024-09-12T16:16:23.107 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.107 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.107 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.107 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.107 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.108 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.108 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29989 2024-09-12T16:16:23.108 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.108 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.108 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.108 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.108 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651198+0000", 2024-09-12T16:16:23.108 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.108 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.108 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.108 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.108 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651198+0000", 2024-09-12T16:16:23.108 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.108 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.109 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.109 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.109 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651198+0000", 2024-09-12T16:16:23.109 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.15e-07 2024-09-12T16:16:23.109 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.109 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.109 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.109 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651200+0000", 2024-09-12T16:16:23.109 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.356e-06 2024-09-12T16:16:23.109 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.109 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.109 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.109 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651203+0000", 2024-09-12T16:16:23.109 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3890000000000001e-06 2024-09-12T16:16:23.110 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.110 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.110 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.110 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651206+0000", 2024-09-12T16:16:23.110 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8449999999999999e-06 2024-09-12T16:16:23.110 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.110 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.110 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.110 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.110 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.110 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30021 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.110 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651975+0000", 2024-09-12T16:16:23.110 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012002954999999999, 2024-09-12T16:16:23.110 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015648456000000002, 2024-09-12T16:16:23.110 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.111 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.111 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.111 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.111 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.111 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.111 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30021 2024-09-12T16:16:23.111 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.111 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.111 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.111 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.111 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651975+0000", 2024-09-12T16:16:23.111 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.111 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.111 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.112 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.112 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651975+0000", 2024-09-12T16:16:23.112 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.112 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.112 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.112 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.112 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651975+0000", 2024-09-12T16:16:23.112 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5499999999999998e-07 2024-09-12T16:16:23.112 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.112 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.112 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.112 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651977+0000", 2024-09-12T16:16:23.112 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.483e-06 2024-09-12T16:16:23.112 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.113 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.113 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.113 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651980+0000", 2024-09-12T16:16:23.113 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4400000000000001e-06 2024-09-12T16:16:23.113 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.113 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.113 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.113 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651983+0000", 2024-09-12T16:16:23.113 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6850000000000001e-06 2024-09-12T16:16:23.113 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.113 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.113 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.113 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.114 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.114 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30053 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.114 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652479+0000", 2024-09-12T16:16:23.114 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011498622, 2024-09-12T16:16:23.114 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015176352000000001, 2024-09-12T16:16:23.114 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.114 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.114 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.114 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.114 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.114 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.114 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30053 2024-09-12T16:16:23.114 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.114 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.115 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.115 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.115 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652479+0000", 2024-09-12T16:16:23.115 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.115 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.115 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.115 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.115 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652479+0000", 2024-09-12T16:16:23.115 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.115 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.115 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.115 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.115 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652479+0000", 2024-09-12T16:16:23.115 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.16e-07 2024-09-12T16:16:23.116 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.116 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.116 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.116 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652480+0000", 2024-09-12T16:16:23.116 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9999999999999996e-07 2024-09-12T16:16:23.116 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.116 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.116 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.116 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652483+0000", 2024-09-12T16:16:23.116 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9270000000000001e-06 2024-09-12T16:16:23.116 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.116 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.116 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.116 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652486+0000", 2024-09-12T16:16:23.117 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4700000000000001e-06 2024-09-12T16:16:23.117 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.117 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.117 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.117 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.117 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.117 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30092 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.117 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652879+0000", 2024-09-12T16:16:23.117 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011098703, 2024-09-12T16:16:23.117 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014803524, 2024-09-12T16:16:23.117 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.117 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.117 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.118 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.118 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.118 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.118 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30092 2024-09-12T16:16:23.118 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.118 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.118 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.118 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.118 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652879+0000", 2024-09-12T16:16:23.118 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.118 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.118 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.118 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.118 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652879+0000", 2024-09-12T16:16:23.119 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.119 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.119 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.119 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.119 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652879+0000", 2024-09-12T16:16:23.119 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0599999999999999e-07 2024-09-12T16:16:23.119 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.119 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.119 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.119 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652880+0000", 2024-09-12T16:16:23.119 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1000000000000001e-06 2024-09-12T16:16:23.119 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.119 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.119 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.120 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652883+0000", 2024-09-12T16:16:23.120 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8439999999999998e-06 2024-09-12T16:16:23.120 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.120 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.120 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.120 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652886+0000", 2024-09-12T16:16:23.120 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.385e-06 2024-09-12T16:16:23.120 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.120 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.120 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.120 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.120 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.120 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30124 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.120 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.658742+0000", 2024-09-12T16:16:23.121 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0052360280000000002, 2024-09-12T16:16:23.121 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0089657680000000007, 2024-09-12T16:16:23.121 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.121 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.121 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.121 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.121 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.121 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.121 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30124 2024-09-12T16:16:23.121 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.121 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.121 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.121 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.121 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658742+0000", 2024-09-12T16:16:23.122 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.122 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.122 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.122 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.122 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658742+0000", 2024-09-12T16:16:23.122 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.122 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.122 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.122 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.122 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658742+0000", 2024-09-12T16:16:23.122 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.11e-07 2024-09-12T16:16:23.122 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.122 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.122 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.123 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658743+0000", 2024-09-12T16:16:23.123 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1930000000000001e-06 2024-09-12T16:16:23.123 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.123 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.123 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.123 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658746+0000", 2024-09-12T16:16:23.123 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0259999999999999e-06 2024-09-12T16:16:23.123 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.123 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.123 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.123 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658749+0000", 2024-09-12T16:16:23.123 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6280000000000001e-06 2024-09-12T16:16:23.123 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.123 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.123 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.124 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.124 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.124 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30156 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.124 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.665387+0000", 2024-09-12T16:16:23.124 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4294967295.9985905, 2024-09-12T16:16:23.124 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0023439870000000001, 2024-09-12T16:16:23.124 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.124 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.124 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.124 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.124 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.124 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.124 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30156 2024-09-12T16:16:23.124 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.125 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.125 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.125 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.125 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665387+0000", 2024-09-12T16:16:23.125 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.125 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.125 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.125 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.125 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665387+0000", 2024-09-12T16:16:23.125 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.125 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.125 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.125 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.125 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665388+0000", 2024-09-12T16:16:23.125 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4499999999999997e-07 2024-09-12T16:16:23.126 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.126 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.126 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.126 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665390+0000", 2024-09-12T16:16:23.126 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5969999999999999e-06 2024-09-12T16:16:23.126 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.126 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.126 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.126 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665398+0000", 2024-09-12T16:16:23.126 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7570000000000004e-06 2024-09-12T16:16:23.126 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.126 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.126 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.126 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665403+0000", 2024-09-12T16:16:23.126 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.271e-06 2024-09-12T16:16:23.127 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.127 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.127 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.127 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.127 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.127 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29958 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.127 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.650519+0000", 2024-09-12T16:16:23.127 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013459047, 2024-09-12T16:16:23.127 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017236609999999999, 2024-09-12T16:16:23.127 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.127 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.127 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.128 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.128 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.128 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.128 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29958 2024-09-12T16:16:23.128 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.128 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.128 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.128 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.128 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650519+0000", 2024-09-12T16:16:23.128 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.128 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.128 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.128 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.128 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650519+0000", 2024-09-12T16:16:23.129 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.129 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.129 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.129 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.129 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650519+0000", 2024-09-12T16:16:23.129 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1799999999999999e-07 2024-09-12T16:16:23.129 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.129 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.129 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.129 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650520+0000", 2024-09-12T16:16:23.129 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.11e-06 2024-09-12T16:16:23.129 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.129 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.129 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.129 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650523+0000", 2024-09-12T16:16:23.130 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0819999999999999e-06 2024-09-12T16:16:23.130 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.130 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.130 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.130 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650526+0000", 2024-09-12T16:16:23.130 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4820000000000001e-06 2024-09-12T16:16:23.130 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.130 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.130 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.130 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.130 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.130 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29990 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.130 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651209+0000", 2024-09-12T16:16:23.130 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012768399999999999, 2024-09-12T16:16:23.131 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016571382999999999, 2024-09-12T16:16:23.131 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.131 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.131 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.131 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.131 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.131 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.131 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29990 2024-09-12T16:16:23.131 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.131 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.131 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.131 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.131 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651209+0000", 2024-09-12T16:16:23.131 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.131 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.132 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.132 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.132 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651209+0000", 2024-09-12T16:16:23.132 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.132 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.132 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.132 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.132 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651210+0000", 2024-09-12T16:16:23.132 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.34e-07 2024-09-12T16:16:23.132 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.132 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.132 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.132 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651211+0000", 2024-09-12T16:16:23.133 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.091e-06 2024-09-12T16:16:23.133 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.133 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.133 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.133 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651214+0000", 2024-09-12T16:16:23.133 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0249999999999998e-06 2024-09-12T16:16:23.133 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.133 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.133 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.133 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651216+0000", 2024-09-12T16:16:23.133 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5469999999999999e-06 2024-09-12T16:16:23.133 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.133 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.133 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.133 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.134 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.134 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30022 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.134 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651986+0000", 2024-09-12T16:16:23.134 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011991448, 2024-09-12T16:16:23.134 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015817574000000001, 2024-09-12T16:16:23.134 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.134 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.134 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.134 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.134 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.134 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.134 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30022 2024-09-12T16:16:23.134 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.134 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.134 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.134 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.135 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651986+0000", 2024-09-12T16:16:23.135 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.135 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.135 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.135 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.135 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651986+0000", 2024-09-12T16:16:23.135 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.135 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.135 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.135 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.135 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651987+0000", 2024-09-12T16:16:23.135 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.22e-07 2024-09-12T16:16:23.135 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.135 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.135 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.136 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651988+0000", 2024-09-12T16:16:23.136 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0780000000000001e-06 2024-09-12T16:16:23.136 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.136 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.136 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.136 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651991+0000", 2024-09-12T16:16:23.136 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0599999999999999e-06 2024-09-12T16:16:23.136 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.136 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.136 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.136 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651993+0000", 2024-09-12T16:16:23.136 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4870000000000001e-06 2024-09-12T16:16:23.136 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.137 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.137 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.137 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.137 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.137 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30054 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.137 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652490+0000", 2024-09-12T16:16:23.137 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011487878999999999, 2024-09-12T16:16:23.137 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015339151000000001, 2024-09-12T16:16:23.137 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.137 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.137 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.137 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.137 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.137 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.138 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30054 2024-09-12T16:16:23.138 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.138 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.138 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.138 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.138 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652490+0000", 2024-09-12T16:16:23.138 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.138 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.138 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.138 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.138 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652490+0000", 2024-09-12T16:16:23.138 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.138 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.138 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.139 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.139 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652490+0000", 2024-09-12T16:16:23.139 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3099999999999999e-07 2024-09-12T16:16:23.139 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.139 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.139 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.139 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652491+0000", 2024-09-12T16:16:23.139 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.142e-06 2024-09-12T16:16:23.139 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.139 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.139 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.139 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652494+0000", 2024-09-12T16:16:23.139 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0240000000000002e-06 2024-09-12T16:16:23.140 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.140 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.140 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.140 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652497+0000", 2024-09-12T16:16:23.140 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6429999999999999e-06 2024-09-12T16:16:23.140 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.140 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.140 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.140 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.140 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.140 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30125 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.140 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.658752+0000", 2024-09-12T16:16:23.140 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0052259059999999998, 2024-09-12T16:16:23.140 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0091004160000000001, 2024-09-12T16:16:23.141 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.141 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.141 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.141 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.141 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.141 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.141 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30125 2024-09-12T16:16:23.141 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.141 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.141 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.141 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.141 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658752+0000", 2024-09-12T16:16:23.141 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.141 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.141 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.142 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.142 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658752+0000", 2024-09-12T16:16:23.142 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.142 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.142 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.142 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.142 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658752+0000", 2024-09-12T16:16:23.142 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.11e-07 2024-09-12T16:16:23.142 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.142 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.142 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.142 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658753+0000", 2024-09-12T16:16:23.142 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.102e-06 2024-09-12T16:16:23.142 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.142 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.143 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.143 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658756+0000", 2024-09-12T16:16:23.143 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9869999999999999e-06 2024-09-12T16:16:23.143 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.143 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.143 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.143 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658759+0000", 2024-09-12T16:16:23.143 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4210000000000002e-06 2024-09-12T16:16:23.143 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.143 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.143 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.143 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.143 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.143 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30157 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.143 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.665410+0000", 2024-09-12T16:16:23.143 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4294967295.9985676, 2024-09-12T16:16:23.144 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025929550000000001, 2024-09-12T16:16:23.144 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.144 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.144 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.144 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.144 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.144 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.144 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30157 2024-09-12T16:16:23.144 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.144 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.144 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.144 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.144 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665410+0000", 2024-09-12T16:16:23.144 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.144 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.145 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.145 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.145 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665410+0000", 2024-09-12T16:16:23.145 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.145 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.145 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.145 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.145 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665411+0000", 2024-09-12T16:16:23.145 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.03e-07 2024-09-12T16:16:23.145 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.145 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.145 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.145 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665418+0000", 2024-09-12T16:16:23.146 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4479999999999997e-06 2024-09-12T16:16:23.146 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.146 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.146 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.146 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665432+0000", 2024-09-12T16:16:23.146 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3888e-05 2024-09-12T16:16:23.146 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.146 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.146 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.146 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665438+0000", 2024-09-12T16:16:23.146 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9290000000000003e-06 2024-09-12T16:16:23.146 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.146 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.147 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.147 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.147 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.147 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29959 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.147 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.650553+0000", 2024-09-12T16:16:23.147 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013424457000000001, 2024-09-12T16:16:23.147 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017484530000000002, 2024-09-12T16:16:23.147 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.147 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.147 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.147 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.147 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.147 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.147 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29959 2024-09-12T16:16:23.148 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.148 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.148 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.148 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.148 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650553+0000", 2024-09-12T16:16:23.148 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.148 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.148 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.148 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.148 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650553+0000", 2024-09-12T16:16:23.148 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.148 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.148 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.148 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.149 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650554+0000", 2024-09-12T16:16:23.149 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2599999999999998e-07 2024-09-12T16:16:23.149 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.149 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.149 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.149 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650555+0000", 2024-09-12T16:16:23.149 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4330000000000001e-06 2024-09-12T16:16:23.149 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.149 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.149 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.149 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650559+0000", 2024-09-12T16:16:23.149 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3510000000000002e-06 2024-09-12T16:16:23.149 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.150 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.150 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.150 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650561+0000", 2024-09-12T16:16:23.150 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.728e-06 2024-09-12T16:16:23.150 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.150 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.150 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.150 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.150 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.150 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29991 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.150 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651242+0000", 2024-09-12T16:16:23.150 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012735715999999999, 2024-09-12T16:16:23.150 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016822587, 2024-09-12T16:16:23.150 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.151 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.151 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.151 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.151 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.151 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.151 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29991 2024-09-12T16:16:23.151 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.151 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.151 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.151 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.151 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651242+0000", 2024-09-12T16:16:23.151 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.151 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.151 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.152 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.152 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651242+0000", 2024-09-12T16:16:23.152 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.152 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.152 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.152 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.152 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651243+0000", 2024-09-12T16:16:23.152 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6400000000000003e-07 2024-09-12T16:16:23.152 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.152 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.152 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.152 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651245+0000", 2024-09-12T16:16:23.152 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3410000000000001e-06 2024-09-12T16:16:23.152 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.153 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.153 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.153 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651249+0000", 2024-09-12T16:16:23.153 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3390000000000003e-06 2024-09-12T16:16:23.153 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.153 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.153 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.153 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651252+0000", 2024-09-12T16:16:23.153 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1209999999999998e-06 2024-09-12T16:16:23.153 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.153 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.153 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.153 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.153 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.154 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30023 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.154 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652019+0000", 2024-09-12T16:16:23.154 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011958498999999999, 2024-09-12T16:16:23.154 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016068860000000001, 2024-09-12T16:16:23.154 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.154 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.154 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.154 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.154 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.154 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.154 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30023 2024-09-12T16:16:23.154 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.154 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.154 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.154 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.155 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652019+0000", 2024-09-12T16:16:23.155 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.155 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.155 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.155 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.155 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652019+0000", 2024-09-12T16:16:23.155 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.155 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.155 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.155 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.155 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652020+0000", 2024-09-12T16:16:23.155 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1899999999999998e-07 2024-09-12T16:16:23.155 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.155 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.156 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.156 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652021+0000", 2024-09-12T16:16:23.156 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.44e-06 2024-09-12T16:16:23.156 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.156 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.156 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.156 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652024+0000", 2024-09-12T16:16:23.156 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3019999999999999e-06 2024-09-12T16:16:23.156 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.156 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.156 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.156 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652027+0000", 2024-09-12T16:16:23.156 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7e-06 2024-09-12T16:16:23.157 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.157 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.157 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.157 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.157 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.157 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30055 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.157 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652500+0000", 2024-09-12T16:16:23.157 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011477502000000001, 2024-09-12T16:16:23.157 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015624726, 2024-09-12T16:16:23.157 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.157 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.157 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.157 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.157 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.158 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.158 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30055 2024-09-12T16:16:23.158 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.158 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.158 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.158 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.158 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652500+0000", 2024-09-12T16:16:23.158 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.158 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.158 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.158 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.158 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652500+0000", 2024-09-12T16:16:23.158 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.159 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.159 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.159 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.159 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652501+0000", 2024-09-12T16:16:23.159 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.11e-07 2024-09-12T16:16:23.159 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.159 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.159 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.159 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652502+0000", 2024-09-12T16:16:23.159 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0559999999999999e-06 2024-09-12T16:16:23.159 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.159 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.159 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.159 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652504+0000", 2024-09-12T16:16:23.160 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8779999999999998e-06 2024-09-12T16:16:23.160 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.160 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.160 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.160 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652507+0000", 2024-09-12T16:16:23.160 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5390000000000002e-06 2024-09-12T16:16:23.160 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.160 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.160 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.160 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.160 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.160 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30094 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.160 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652903+0000", 2024-09-12T16:16:23.160 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011075260999999999, 2024-09-12T16:16:23.161 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015248115, 2024-09-12T16:16:23.161 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.161 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.161 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.161 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.161 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.161 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.161 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30094 2024-09-12T16:16:23.161 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.161 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.161 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.161 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.161 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652903+0000", 2024-09-12T16:16:23.161 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.162 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.162 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.162 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.162 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652903+0000", 2024-09-12T16:16:23.162 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.162 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.162 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.162 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.162 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652903+0000", 2024-09-12T16:16:23.162 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0100000000000001e-07 2024-09-12T16:16:23.162 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.162 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.162 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.162 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652905+0000", 2024-09-12T16:16:23.163 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7519999999999999e-06 2024-09-12T16:16:23.163 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.163 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.163 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.163 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652911+0000", 2024-09-12T16:16:23.163 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9769999999999997e-06 2024-09-12T16:16:23.163 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.163 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.163 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.163 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652915+0000", 2024-09-12T16:16:23.163 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.797e-06 2024-09-12T16:16:23.163 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.163 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.163 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.163 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.164 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.164 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30126 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.164 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.658762+0000", 2024-09-12T16:16:23.164 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0052160430000000001, 2024-09-12T16:16:23.164 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0094154129999999992, 2024-09-12T16:16:23.164 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.164 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.164 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.164 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.164 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.164 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.164 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30126 2024-09-12T16:16:23.164 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.165 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.165 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.165 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.165 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658762+0000", 2024-09-12T16:16:23.165 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.165 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.165 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.165 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.165 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658762+0000", 2024-09-12T16:16:23.165 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.165 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.165 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.165 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.165 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658762+0000", 2024-09-12T16:16:23.166 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.28e-07 2024-09-12T16:16:23.166 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.166 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.166 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.166 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658763+0000", 2024-09-12T16:16:23.166 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1370000000000001e-06 2024-09-12T16:16:23.166 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.166 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.166 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.166 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658767+0000", 2024-09-12T16:16:23.166 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.245e-06 2024-09-12T16:16:23.166 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.166 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.166 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.167 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658770+0000", 2024-09-12T16:16:23.167 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.497e-06 2024-09-12T16:16:23.167 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.167 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.167 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.167 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.167 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.167 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30158 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.167 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.665446+0000", 2024-09-12T16:16:23.167 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4294967295.9985313, 2024-09-12T16:16:23.167 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002763036, 2024-09-12T16:16:23.167 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.167 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.167 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.167 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.167 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.168 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.168 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30158 2024-09-12T16:16:23.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.168 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.168 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.168 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.168 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665446+0000", 2024-09-12T16:16:23.168 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.168 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.168 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.168 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665446+0000", 2024-09-12T16:16:23.168 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.168 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.169 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.169 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665447+0000", 2024-09-12T16:16:23.169 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4999999999999998e-07 2024-09-12T16:16:23.169 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.169 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.169 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.169 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665449+0000", 2024-09-12T16:16:23.169 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.295e-06 2024-09-12T16:16:23.169 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.169 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.169 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.169 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665466+0000", 2024-09-12T16:16:23.169 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6467e-05 2024-09-12T16:16:23.170 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.170 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.170 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.170 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665471+0000", 2024-09-12T16:16:23.170 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5269999999999998e-06 2024-09-12T16:16:23.170 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.170 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.170 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.170 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.170 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.170 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29960 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.170 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.650565+0000", 2024-09-12T16:16:23.170 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013413061, 2024-09-12T16:16:23.171 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017685683000000001, 2024-09-12T16:16:23.171 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.171 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.171 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.171 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.171 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.171 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.171 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29960 2024-09-12T16:16:23.171 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.171 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.171 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.171 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.171 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650565+0000", 2024-09-12T16:16:23.171 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.171 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.172 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.172 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.172 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650565+0000", 2024-09-12T16:16:23.172 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.172 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.172 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.172 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.172 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650565+0000", 2024-09-12T16:16:23.172 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2399999999999999e-07 2024-09-12T16:16:23.172 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.172 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.172 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.172 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650566+0000", 2024-09-12T16:16:23.172 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.088e-06 2024-09-12T16:16:23.173 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.173 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.173 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.173 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650569+0000", 2024-09-12T16:16:23.173 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0189999999999998e-06 2024-09-12T16:16:23.173 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.173 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.173 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.173 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650572+0000", 2024-09-12T16:16:23.173 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5330000000000001e-06 2024-09-12T16:16:23.173 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.173 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.173 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.174 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.174 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.174 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29992 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.174 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651288+0000", 2024-09-12T16:16:23.174 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012690302000000001, 2024-09-12T16:16:23.174 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017008253000000001, 2024-09-12T16:16:23.174 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.174 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.174 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.174 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.174 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.174 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.174 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29992 2024-09-12T16:16:23.175 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.175 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.175 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.175 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.175 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651288+0000", 2024-09-12T16:16:23.175 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.175 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.175 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.175 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.175 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651288+0000", 2024-09-12T16:16:23.175 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.175 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.175 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.175 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.175 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651288+0000", 2024-09-12T16:16:23.176 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1899999999999998e-07 2024-09-12T16:16:23.176 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.176 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.176 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.176 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651289+0000", 2024-09-12T16:16:23.176 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.499e-06 2024-09-12T16:16:23.176 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.176 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.176 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.176 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651293+0000", 2024-09-12T16:16:23.176 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.546e-06 2024-09-12T16:16:23.176 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.176 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.177 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.177 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651296+0000", 2024-09-12T16:16:23.177 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7650000000000002e-06 2024-09-12T16:16:23.177 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.177 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.177 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.177 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.177 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.177 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30024 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.177 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652030+0000", 2024-09-12T16:16:23.177 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011947418, 2024-09-12T16:16:23.177 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016309534000000001, 2024-09-12T16:16:23.177 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.177 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.178 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.178 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.178 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.178 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.178 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30024 2024-09-12T16:16:23.178 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.178 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.178 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.178 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.178 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652030+0000", 2024-09-12T16:16:23.178 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.178 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.178 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.178 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.178 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652030+0000", 2024-09-12T16:16:23.179 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.179 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.179 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.179 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.179 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652031+0000", 2024-09-12T16:16:23.179 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0800000000000001e-07 2024-09-12T16:16:23.179 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.179 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.179 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.179 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652032+0000", 2024-09-12T16:16:23.179 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1030000000000001e-06 2024-09-12T16:16:23.179 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.179 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.179 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.180 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652035+0000", 2024-09-12T16:16:23.180 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6160000000000002e-06 2024-09-12T16:16:23.180 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.180 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.180 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.180 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652038+0000", 2024-09-12T16:16:23.180 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4420000000000001e-06 2024-09-12T16:16:23.180 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.180 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.180 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.180 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.180 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.180 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30056 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.181 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652510+0000", 2024-09-12T16:16:23.181 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011468076000000001, 2024-09-12T16:16:23.181 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015855191000000001, 2024-09-12T16:16:23.181 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.181 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.181 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.181 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.181 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.181 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.181 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30056 2024-09-12T16:16:23.181 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.181 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.181 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.181 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.181 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652510+0000", 2024-09-12T16:16:23.182 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.182 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.182 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.182 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652510+0000", 2024-09-12T16:16:23.182 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.182 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.182 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.182 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652510+0000", 2024-09-12T16:16:23.182 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8999999999999998e-07 2024-09-12T16:16:23.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.182 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.182 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.182 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652515+0000", 2024-09-12T16:16:23.183 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7639999999999996e-06 2024-09-12T16:16:23.183 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.183 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.183 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.183 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652518+0000", 2024-09-12T16:16:23.183 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.264e-06 2024-09-12T16:16:23.183 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.183 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.183 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.183 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652521+0000", 2024-09-12T16:16:23.183 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7020000000000001e-06 2024-09-12T16:16:23.183 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.183 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.183 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.183 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.184 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.184 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30095 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.184 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652937+0000", 2024-09-12T16:16:23.184 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011040945, 2024-09-12T16:16:23.184 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015465335, 2024-09-12T16:16:23.184 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.184 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.184 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.184 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.184 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.184 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.184 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30095 2024-09-12T16:16:23.184 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.184 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.185 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.185 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.185 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652937+0000", 2024-09-12T16:16:23.185 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.185 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.185 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.185 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.185 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652937+0000", 2024-09-12T16:16:23.185 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.185 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.185 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.185 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.185 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652937+0000", 2024-09-12T16:16:23.185 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8599999999999998e-07 2024-09-12T16:16:23.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.186 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.186 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.186 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652940+0000", 2024-09-12T16:16:23.186 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3209999999999999e-06 2024-09-12T16:16:23.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.186 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.186 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.186 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652948+0000", 2024-09-12T16:16:23.186 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4270000000000008e-06 2024-09-12T16:16:23.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.186 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.186 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.186 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652954+0000", 2024-09-12T16:16:23.186 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4739999999999996e-06 2024-09-12T16:16:23.187 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.187 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.187 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.187 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.187 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.187 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30127 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.187 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.658773+0000", 2024-09-12T16:16:23.187 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0052048179999999999, 2024-09-12T16:16:23.187 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0096669070000000006, 2024-09-12T16:16:23.187 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.187 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.187 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.187 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.187 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.187 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.188 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30127 2024-09-12T16:16:23.188 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.188 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.188 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.188 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.188 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658773+0000", 2024-09-12T16:16:23.188 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.188 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.188 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.188 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.188 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658773+0000", 2024-09-12T16:16:23.188 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.188 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.189 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.189 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.189 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658773+0000", 2024-09-12T16:16:23.189 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.28e-07 2024-09-12T16:16:23.189 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.189 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.189 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.189 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658774+0000", 2024-09-12T16:16:23.189 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2300000000000001e-06 2024-09-12T16:16:23.189 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.189 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.189 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.189 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658777+0000", 2024-09-12T16:16:23.189 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.033e-06 2024-09-12T16:16:23.189 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.190 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.190 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.190 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658780+0000", 2024-09-12T16:16:23.190 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4700000000000001e-06 2024-09-12T16:16:23.190 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.190 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.190 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.190 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.190 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30159 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.190 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.665479+0000", 2024-09-12T16:16:23.190 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4294967295.9984989, 2024-09-12T16:16:23.190 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029857180000000001, 2024-09-12T16:16:23.190 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.190 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.191 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.191 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.191 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.191 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.191 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30159 2024-09-12T16:16:23.191 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.191 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.191 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.191 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.191 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665479+0000", 2024-09-12T16:16:23.191 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.191 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.191 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.192 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.192 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665479+0000", 2024-09-12T16:16:23.192 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.192 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.192 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.192 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.192 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665480+0000", 2024-09-12T16:16:23.192 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.75e-07 2024-09-12T16:16:23.192 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.192 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.192 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.192 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665482+0000", 2024-09-12T16:16:23.192 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4080000000000001e-06 2024-09-12T16:16:23.192 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.193 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.193 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.193 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665488+0000", 2024-09-12T16:16:23.193 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4760000000000003e-06 2024-09-12T16:16:23.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.193 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.193 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.193 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665493+0000", 2024-09-12T16:16:23.193 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9339999999999997e-06 2024-09-12T16:16:23.193 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.193 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.193 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.193 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.194 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29961 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.194 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.650602+0000", 2024-09-12T16:16:23.194 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013376127, 2024-09-12T16:16:23.194 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017890804999999999, 2024-09-12T16:16:23.194 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.194 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.194 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.194 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.194 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.194 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.194 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29961 2024-09-12T16:16:23.194 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.194 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.194 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650602+0000", 2024-09-12T16:16:23.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650602+0000", 2024-09-12T16:16:23.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650602+0000", 2024-09-12T16:16:23.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2399999999999999e-07 2024-09-12T16:16:23.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.196 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.196 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650604+0000", 2024-09-12T16:16:23.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.592e-06 2024-09-12T16:16:23.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.196 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.196 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650608+0000", 2024-09-12T16:16:23.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9519999999999996e-06 2024-09-12T16:16:23.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.196 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.196 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650610+0000", 2024-09-12T16:16:23.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7980000000000001e-06 2024-09-12T16:16:23.197 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.197 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.197 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.197 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.197 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29993 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.197 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651299+0000", 2024-09-12T16:16:23.197 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012678640999999999, 2024-09-12T16:16:23.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017218005000000002, 2024-09-12T16:16:23.197 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.197 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.197 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.197 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.197 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.197 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.198 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29993 2024-09-12T16:16:23.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.198 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.198 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.198 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.198 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651299+0000", 2024-09-12T16:16:23.198 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.198 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.198 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.198 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651299+0000", 2024-09-12T16:16:23.198 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.198 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.199 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651300+0000", 2024-09-12T16:16:23.199 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0499999999999999e-07 2024-09-12T16:16:23.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.199 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651301+0000", 2024-09-12T16:16:23.199 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.049e-06 2024-09-12T16:16:23.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.199 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651304+0000", 2024-09-12T16:16:23.199 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9639999999999999e-06 2024-09-12T16:16:23.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651306+0000", 2024-09-12T16:16:23.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5519999999999999e-06 2024-09-12T16:16:23.200 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.200 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.200 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.200 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30025 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.200 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652065+0000", 2024-09-12T16:16:23.200 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011912631, 2024-09-12T16:16:23.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016477187000000001, 2024-09-12T16:16:23.200 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.201 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.201 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.201 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.201 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.201 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.201 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30025 2024-09-12T16:16:23.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.201 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.201 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.201 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.201 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652065+0000", 2024-09-12T16:16:23.201 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.202 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.202 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.202 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652065+0000", 2024-09-12T16:16:23.202 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.202 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.202 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.202 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.202 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652066+0000", 2024-09-12T16:16:23.202 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4099999999999999e-07 2024-09-12T16:16:23.202 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.202 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.202 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.202 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652067+0000", 2024-09-12T16:16:23.202 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3990000000000001e-06 2024-09-12T16:16:23.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652070+0000", 2024-09-12T16:16:23.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3009999999999998e-06 2024-09-12T16:16:23.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652073+0000", 2024-09-12T16:16:23.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7319999999999998e-06 2024-09-12T16:16:23.203 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.203 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.203 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.204 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30057 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.204 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652524+0000", 2024-09-12T16:16:23.204 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011453436000000001, 2024-09-12T16:16:23.204 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016041273000000002, 2024-09-12T16:16:23.204 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.204 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.204 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.204 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.204 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.204 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.204 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30057 2024-09-12T16:16:23.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.204 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.205 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.205 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652524+0000", 2024-09-12T16:16:23.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.205 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.205 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652524+0000", 2024-09-12T16:16:23.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.205 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.205 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652525+0000", 2024-09-12T16:16:23.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2600000000000001e-07 2024-09-12T16:16:23.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.206 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.206 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.206 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652526+0000", 2024-09-12T16:16:23.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1310000000000001e-06 2024-09-12T16:16:23.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.206 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.206 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.206 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652529+0000", 2024-09-12T16:16:23.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0520000000000002e-06 2024-09-12T16:16:23.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.206 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.206 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.206 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652531+0000", 2024-09-12T16:16:23.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.475e-06 2024-09-12T16:16:23.206 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.207 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.207 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.207 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30096 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.207 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652961+0000", 2024-09-12T16:16:23.207 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011016798, 2024-09-12T16:16:23.207 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015629661, 2024-09-12T16:16:23.207 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.207 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.207 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.207 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.207 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.207 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.207 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30096 2024-09-12T16:16:23.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.208 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.208 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.208 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.208 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652961+0000", 2024-09-12T16:16:23.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.208 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.208 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.208 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652961+0000", 2024-09-12T16:16:23.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.208 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.208 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.208 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652961+0000", 2024-09-12T16:16:23.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7599999999999997e-07 2024-09-12T16:16:23.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652963+0000", 2024-09-12T16:16:23.209 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.012e-06 2024-09-12T16:16:23.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652970+0000", 2024-09-12T16:16:23.209 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6200000000000001e-06 2024-09-12T16:16:23.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652975+0000", 2024-09-12T16:16:23.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6940000000000003e-06 2024-09-12T16:16:23.210 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.210 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.210 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.210 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.210 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30128 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.210 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.658783+0000", 2024-09-12T16:16:23.210 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0051947649999999996, 2024-09-12T16:16:23.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0098396460000000005, 2024-09-12T16:16:23.210 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.210 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.210 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.210 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.210 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.210 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.211 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30128 2024-09-12T16:16:23.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.211 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.211 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.211 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658783+0000", 2024-09-12T16:16:23.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.211 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.211 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658783+0000", 2024-09-12T16:16:23.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658783+0000", 2024-09-12T16:16:23.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3900000000000001e-07 2024-09-12T16:16:23.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658784+0000", 2024-09-12T16:16:23.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1689999999999999e-06 2024-09-12T16:16:23.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658790+0000", 2024-09-12T16:16:23.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0780000000000003e-06 2024-09-12T16:16:23.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.213 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.213 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658794+0000", 2024-09-12T16:16:23.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6779999999999999e-06 2024-09-12T16:16:23.213 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.213 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.213 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.213 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30160 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.213 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.665501+0000", 2024-09-12T16:16:23.213 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4294967295.9984765, 2024-09-12T16:16:23.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0031481450000000002, 2024-09-12T16:16:23.214 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.214 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.214 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.214 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.214 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.214 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.214 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30160 2024-09-12T16:16:23.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.214 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.214 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.214 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665501+0000", 2024-09-12T16:16:23.214 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.215 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.215 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665501+0000", 2024-09-12T16:16:23.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.215 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.215 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665502+0000", 2024-09-12T16:16:23.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3099999999999998e-07 2024-09-12T16:16:23.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.215 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.215 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665504+0000", 2024-09-12T16:16:23.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0700000000000001e-06 2024-09-12T16:16:23.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.216 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.216 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665511+0000", 2024-09-12T16:16:23.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6750000000000002e-06 2024-09-12T16:16:23.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.216 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.216 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665516+0000", 2024-09-12T16:16:23.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0119999999999996e-06 2024-09-12T16:16:23.216 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.216 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.216 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.217 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29962 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.217 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.650638+0000", 2024-09-12T16:16:23.217 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013339953, 2024-09-12T16:16:23.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018036166999999999, 2024-09-12T16:16:23.217 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.217 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.217 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.217 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.217 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.217 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.217 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29962 2024-09-12T16:16:23.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.217 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650638+0000", 2024-09-12T16:16:23.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650638+0000", 2024-09-12T16:16:23.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650638+0000", 2024-09-12T16:16:23.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2300000000000002e-07 2024-09-12T16:16:23.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650640+0000", 2024-09-12T16:16:23.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7179999999999999e-06 2024-09-12T16:16:23.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650643+0000", 2024-09-12T16:16:23.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.411e-06 2024-09-12T16:16:23.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650646+0000", 2024-09-12T16:16:23.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.683e-06 2024-09-12T16:16:23.219 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.220 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.220 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.220 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.220 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29994 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.220 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651309+0000", 2024-09-12T16:16:23.220 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012668754000000001, 2024-09-12T16:16:23.220 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017390412000000001, 2024-09-12T16:16:23.220 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.220 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.220 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.220 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.220 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.220 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.221 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29994 2024-09-12T16:16:23.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.221 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.221 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.221 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.221 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651309+0000", 2024-09-12T16:16:23.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.221 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.221 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.221 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651309+0000", 2024-09-12T16:16:23.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.221 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.222 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651309+0000", 2024-09-12T16:16:23.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3299999999999998e-07 2024-09-12T16:16:23.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.222 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651311+0000", 2024-09-12T16:16:23.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1540000000000001e-06 2024-09-12T16:16:23.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.222 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651313+0000", 2024-09-12T16:16:23.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8909999999999999e-06 2024-09-12T16:16:23.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651316+0000", 2024-09-12T16:16:23.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.604e-06 2024-09-12T16:16:23.223 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.223 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.223 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.223 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30026 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.223 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652076+0000", 2024-09-12T16:16:23.223 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011901498999999999, 2024-09-12T16:16:23.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016654315999999999, 2024-09-12T16:16:23.223 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.224 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.224 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.224 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.224 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.224 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.224 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30026 2024-09-12T16:16:23.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.224 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652076+0000", 2024-09-12T16:16:23.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652076+0000", 2024-09-12T16:16:23.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652077+0000", 2024-09-12T16:16:23.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1500000000000001e-07 2024-09-12T16:16:23.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652078+0000", 2024-09-12T16:16:23.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.15e-06 2024-09-12T16:16:23.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652081+0000", 2024-09-12T16:16:23.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5650000000000002e-06 2024-09-12T16:16:23.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652084+0000", 2024-09-12T16:16:23.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5270000000000001e-06 2024-09-12T16:16:23.226 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.226 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.226 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.227 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.227 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30058 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.227 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652535+0000", 2024-09-12T16:16:23.227 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011442623000000001, 2024-09-12T16:16:23.227 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016221526, 2024-09-12T16:16:23.227 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.227 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.227 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.227 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.227 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.227 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.227 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30058 2024-09-12T16:16:23.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.227 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.228 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.228 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652535+0000", 2024-09-12T16:16:23.228 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.228 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.228 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652535+0000", 2024-09-12T16:16:23.228 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.228 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.228 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652535+0000", 2024-09-12T16:16:23.228 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0100000000000001e-07 2024-09-12T16:16:23.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652537+0000", 2024-09-12T16:16:23.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2249999999999999e-06 2024-09-12T16:16:23.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652540+0000", 2024-09-12T16:16:23.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0699999999999998e-06 2024-09-12T16:16:23.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652542+0000", 2024-09-12T16:16:23.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6359999999999998e-06 2024-09-12T16:16:23.230 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.230 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.230 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.230 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30129 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.230 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.658812+0000", 2024-09-12T16:16:23.230 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0051659640000000003, 2024-09-12T16:16:23.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0099684739999999997, 2024-09-12T16:16:23.230 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.230 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.230 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.230 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.230 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.230 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.231 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30129 2024-09-12T16:16:23.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.231 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.231 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.231 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.231 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658812+0000", 2024-09-12T16:16:23.231 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.231 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.231 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.231 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658812+0000", 2024-09-12T16:16:23.231 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.231 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.231 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.232 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658812+0000", 2024-09-12T16:16:23.232 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7700000000000004e-07 2024-09-12T16:16:23.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.232 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658815+0000", 2024-09-12T16:16:23.232 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3410000000000001e-06 2024-09-12T16:16:23.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.232 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658822+0000", 2024-09-12T16:16:23.232 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7669999999999998e-06 2024-09-12T16:16:23.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.233 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.233 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658827+0000", 2024-09-12T16:16:23.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1889999999999998e-06 2024-09-12T16:16:23.233 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.233 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.233 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.233 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30161 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.233 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.665545+0000", 2024-09-12T16:16:23.233 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4294967295.9984331, 2024-09-12T16:16:23.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0032603659999999998, 2024-09-12T16:16:23.233 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.234 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.234 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.234 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.234 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.234 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.234 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30161 2024-09-12T16:16:23.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.234 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.234 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.234 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.234 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665545+0000", 2024-09-12T16:16:23.234 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.234 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.234 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.235 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665545+0000", 2024-09-12T16:16:23.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.235 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.235 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.235 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665545+0000", 2024-09-12T16:16:23.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5100000000000001e-07 2024-09-12T16:16:23.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.235 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.235 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.235 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665547+0000", 2024-09-12T16:16:23.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9069999999999999e-06 2024-09-12T16:16:23.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.235 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.236 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.236 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665553+0000", 2024-09-12T16:16:23.236 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5210000000000002e-06 2024-09-12T16:16:23.236 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.236 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.236 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.236 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665556+0000", 2024-09-12T16:16:23.236 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4520000000000002e-06 2024-09-12T16:16:23.236 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.236 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.236 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.236 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.236 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.236 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29963 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.236 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.650651+0000", 2024-09-12T16:16:23.237 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.01332698, 2024-09-12T16:16:23.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018178979000000001, 2024-09-12T16:16:23.237 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.237 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.237 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.237 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.237 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.237 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.237 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29963 2024-09-12T16:16:23.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.237 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.237 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.237 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.237 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650651+0000", 2024-09-12T16:16:23.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.238 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.238 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650651+0000", 2024-09-12T16:16:23.238 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.238 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.238 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650651+0000", 2024-09-12T16:16:23.238 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.05e-07 2024-09-12T16:16:23.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.238 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.238 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650652+0000", 2024-09-12T16:16:23.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2300000000000001e-06 2024-09-12T16:16:23.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.239 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.239 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650655+0000", 2024-09-12T16:16:23.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1350000000000001e-06 2024-09-12T16:16:23.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.239 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.239 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650658+0000", 2024-09-12T16:16:23.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.452e-06 2024-09-12T16:16:23.239 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.239 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.240 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.240 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.240 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.240 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29995 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.240 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651319+0000", 2024-09-12T16:16:23.240 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012658702000000001, 2024-09-12T16:16:23.240 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017535029000000001, 2024-09-12T16:16:23.240 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.240 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.240 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.240 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.240 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.240 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.240 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29995 2024-09-12T16:16:23.241 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.241 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.241 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.241 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.241 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651319+0000", 2024-09-12T16:16:23.241 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.241 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.241 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.241 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.241 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651319+0000", 2024-09-12T16:16:23.241 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.241 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.241 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.242 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.242 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651319+0000", 2024-09-12T16:16:23.242 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9999999999999999e-07 2024-09-12T16:16:23.242 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.242 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.242 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.242 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651320+0000", 2024-09-12T16:16:23.242 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.029e-06 2024-09-12T16:16:23.242 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.242 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.242 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.242 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651323+0000", 2024-09-12T16:16:23.242 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8499999999999998e-06 2024-09-12T16:16:23.242 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.243 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.243 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651326+0000", 2024-09-12T16:16:23.243 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.571e-06 2024-09-12T16:16:23.243 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.243 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.243 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.243 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30027 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.243 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652111+0000", 2024-09-12T16:16:23.243 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011866972999999999, 2024-09-12T16:16:23.243 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016773393000000001, 2024-09-12T16:16:23.243 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.244 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.244 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.244 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.244 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.244 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.244 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30027 2024-09-12T16:16:23.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.244 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.244 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.244 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.244 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652111+0000", 2024-09-12T16:16:23.244 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.244 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.245 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.245 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652111+0000", 2024-09-12T16:16:23.245 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.245 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.245 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.245 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652111+0000", 2024-09-12T16:16:23.245 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1600000000000002e-07 2024-09-12T16:16:23.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.245 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.245 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.245 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652113+0000", 2024-09-12T16:16:23.245 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.364e-06 2024-09-12T16:16:23.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.246 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.246 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.246 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652116+0000", 2024-09-12T16:16:23.246 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6090000000000001e-06 2024-09-12T16:16:23.246 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.246 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.246 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.246 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652119+0000", 2024-09-12T16:16:23.246 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7020000000000001e-06 2024-09-12T16:16:23.246 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.246 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.246 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.246 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.247 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30059 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.247 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652545+0000", 2024-09-12T16:16:23.247 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011432463, 2024-09-12T16:16:23.247 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016371586, 2024-09-12T16:16:23.247 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.247 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.247 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.247 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.247 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.247 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.247 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30059 2024-09-12T16:16:23.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.247 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.248 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.248 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.248 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652545+0000", 2024-09-12T16:16:23.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.248 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.248 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.248 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652545+0000", 2024-09-12T16:16:23.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.248 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.248 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.248 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652546+0000", 2024-09-12T16:16:23.249 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.41e-07 2024-09-12T16:16:23.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.249 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.249 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652547+0000", 2024-09-12T16:16:23.249 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9000000000000005e-07 2024-09-12T16:16:23.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.249 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.249 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652550+0000", 2024-09-12T16:16:23.249 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9620000000000002e-06 2024-09-12T16:16:23.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.250 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.250 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652552+0000", 2024-09-12T16:16:23.250 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5110000000000002e-06 2024-09-12T16:16:23.250 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.250 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.250 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.250 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.250 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.250 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30098 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.250 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.653007+0000", 2024-09-12T16:16:23.250 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.010971165999999999, 2024-09-12T16:16:23.250 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015943762, 2024-09-12T16:16:23.250 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.251 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.251 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.251 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.251 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.251 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.251 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30098 2024-09-12T16:16:23.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.251 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.251 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.251 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.251 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653007+0000", 2024-09-12T16:16:23.251 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.251 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.252 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653007+0000", 2024-09-12T16:16:23.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.252 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653007+0000", 2024-09-12T16:16:23.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1800000000000001e-07 2024-09-12T16:16:23.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.252 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653013+0000", 2024-09-12T16:16:23.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4189999999999999e-06 2024-09-12T16:16:23.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653020+0000", 2024-09-12T16:16:23.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3810000000000004e-06 2024-09-12T16:16:23.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653026+0000", 2024-09-12T16:16:23.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0249999999999999e-06 2024-09-12T16:16:23.253 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.253 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.253 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.253 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30130 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.254 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.658837+0000", 2024-09-12T16:16:23.254 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0051407969999999999, 2024-09-12T16:16:23.254 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010137220000000001, 2024-09-12T16:16:23.254 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.254 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.254 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.254 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.254 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.254 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.254 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30130 2024-09-12T16:16:23.254 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.254 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.254 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.254 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.254 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658837+0000", 2024-09-12T16:16:23.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.255 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.255 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658837+0000", 2024-09-12T16:16:23.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.255 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.255 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658837+0000", 2024-09-12T16:16:23.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7100000000000002e-07 2024-09-12T16:16:23.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.256 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.256 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658840+0000", 2024-09-12T16:16:23.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1880000000000001e-06 2024-09-12T16:16:23.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.256 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.256 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658846+0000", 2024-09-12T16:16:23.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5470000000000002e-06 2024-09-12T16:16:23.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.256 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.256 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658852+0000", 2024-09-12T16:16:23.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.896e-06 2024-09-12T16:16:23.256 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.257 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.257 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.257 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30162 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.257 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.665561+0000", 2024-09-12T16:16:23.257 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4294967295.9984169, 2024-09-12T16:16:23.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0034400720000000002, 2024-09-12T16:16:23.257 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.257 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.257 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.257 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.257 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.258 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.258 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30162 2024-09-12T16:16:23.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.258 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.258 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665561+0000", 2024-09-12T16:16:23.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.258 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665561+0000", 2024-09-12T16:16:23.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.259 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.259 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665561+0000", 2024-09-12T16:16:23.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2399999999999999e-07 2024-09-12T16:16:23.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.259 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.259 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665562+0000", 2024-09-12T16:16:23.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.141e-06 2024-09-12T16:16:23.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.259 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.259 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665566+0000", 2024-09-12T16:16:23.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3900000000000002e-06 2024-09-12T16:16:23.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.260 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.260 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665568+0000", 2024-09-12T16:16:23.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5509999999999998e-06 2024-09-12T16:16:23.260 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.260 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.260 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.260 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29964 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.260 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.650683+0000", 2024-09-12T16:16:23.260 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013294369, 2024-09-12T16:16:23.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01834218, 2024-09-12T16:16:23.261 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.261 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.261 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.261 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.261 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.261 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.261 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29964 2024-09-12T16:16:23.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.261 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.261 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.261 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650683+0000", 2024-09-12T16:16:23.261 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650683+0000", 2024-09-12T16:16:23.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650684+0000", 2024-09-12T16:16:23.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.34e-07 2024-09-12T16:16:23.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650685+0000", 2024-09-12T16:16:23.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3850000000000001e-06 2024-09-12T16:16:23.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.263 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.263 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.263 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650689+0000", 2024-09-12T16:16:23.263 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3510000000000002e-06 2024-09-12T16:16:23.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.263 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.263 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.263 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650691+0000", 2024-09-12T16:16:23.263 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5689999999999999e-06 2024-09-12T16:16:23.263 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.263 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.263 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.264 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29996 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.264 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651348+0000", 2024-09-12T16:16:23.264 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012630295, 2024-09-12T16:16:23.264 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017704177000000001, 2024-09-12T16:16:23.264 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.264 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.264 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.264 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.264 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.264 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.264 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29996 2024-09-12T16:16:23.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.264 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651348+0000", 2024-09-12T16:16:23.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651348+0000", 2024-09-12T16:16:23.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651348+0000", 2024-09-12T16:16:23.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7300000000000002e-07 2024-09-12T16:16:23.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651355+0000", 2024-09-12T16:16:23.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8399999999999997e-06 2024-09-12T16:16:23.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651359+0000", 2024-09-12T16:16:23.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3290000000000004e-06 2024-09-12T16:16:23.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651362+0000", 2024-09-12T16:16:23.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7779999999999999e-06 2024-09-12T16:16:23.267 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.267 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.267 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.267 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30028 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.267 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652122+0000", 2024-09-12T16:16:23.267 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011855475000000001, 2024-09-12T16:16:23.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016952621000000001, 2024-09-12T16:16:23.267 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.267 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.267 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.267 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.267 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.268 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.268 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30028 2024-09-12T16:16:23.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.268 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.268 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.268 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.268 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652122+0000", 2024-09-12T16:16:23.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.268 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.268 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.268 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652122+0000", 2024-09-12T16:16:23.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.268 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.269 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.269 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652123+0000", 2024-09-12T16:16:23.269 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2600000000000001e-07 2024-09-12T16:16:23.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.269 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.269 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.269 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652124+0000", 2024-09-12T16:16:23.269 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.096e-06 2024-09-12T16:16:23.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.269 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.269 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.269 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652127+0000", 2024-09-12T16:16:23.269 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1530000000000001e-06 2024-09-12T16:16:23.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.270 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.270 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652129+0000", 2024-09-12T16:16:23.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.447e-06 2024-09-12T16:16:23.270 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.270 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.270 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.270 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30060 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.270 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652556+0000", 2024-09-12T16:16:23.270 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011422062, 2024-09-12T16:16:23.271 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016544654999999998, 2024-09-12T16:16:23.271 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.271 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.271 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.271 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.271 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.271 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.271 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30060 2024-09-12T16:16:23.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.271 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.271 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.271 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652556+0000", 2024-09-12T16:16:23.271 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.272 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.272 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.272 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.272 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652556+0000", 2024-09-12T16:16:23.272 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.272 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.272 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.272 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.272 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652556+0000", 2024-09-12T16:16:23.272 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:16:23.272 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.272 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.272 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.272 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652557+0000", 2024-09-12T16:16:23.273 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.093e-06 2024-09-12T16:16:23.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.273 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.273 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652560+0000", 2024-09-12T16:16:23.273 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.977e-06 2024-09-12T16:16:23.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.273 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.273 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652563+0000", 2024-09-12T16:16:23.273 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6230000000000001e-06 2024-09-12T16:16:23.273 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.273 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.274 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.274 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.274 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.274 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30099 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.274 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.653033+0000", 2024-09-12T16:16:23.274 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.010944351999999999, 2024-09-12T16:16:23.274 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016090374000000001, 2024-09-12T16:16:23.274 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.274 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.274 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.274 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.274 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.274 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.274 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30099 2024-09-12T16:16:23.275 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.275 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.275 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.275 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.275 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653033+0000", 2024-09-12T16:16:23.275 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.275 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.275 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.275 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.275 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653033+0000", 2024-09-12T16:16:23.275 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.275 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.275 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.276 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.276 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653034+0000", 2024-09-12T16:16:23.276 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4999999999999998e-07 2024-09-12T16:16:23.276 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.276 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.276 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.276 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653036+0000", 2024-09-12T16:16:23.276 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8899999999999999e-06 2024-09-12T16:16:23.276 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.276 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.276 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.276 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653042+0000", 2024-09-12T16:16:23.276 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.212e-06 2024-09-12T16:16:23.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.277 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.277 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.277 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653047+0000", 2024-09-12T16:16:23.277 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6870000000000002e-06 2024-09-12T16:16:23.277 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.277 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.277 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.277 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.277 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30131 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.277 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.658860+0000", 2024-09-12T16:16:23.277 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0051176490000000002, 2024-09-12T16:16:23.278 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010290850000000001, 2024-09-12T16:16:23.278 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.278 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.278 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.278 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.278 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.278 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.278 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30131 2024-09-12T16:16:23.278 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.278 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.278 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.278 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.278 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658860+0000", 2024-09-12T16:16:23.278 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.278 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.279 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.279 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.279 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658860+0000", 2024-09-12T16:16:23.279 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.279 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.279 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.279 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.279 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658861+0000", 2024-09-12T16:16:23.279 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4700000000000002e-07 2024-09-12T16:16:23.279 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.279 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.279 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.279 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658863+0000", 2024-09-12T16:16:23.279 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1799999999999999e-06 2024-09-12T16:16:23.279 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.280 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.280 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.280 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658869+0000", 2024-09-12T16:16:23.280 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5309999999999998e-06 2024-09-12T16:16:23.280 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.280 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.280 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.280 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658878+0000", 2024-09-12T16:16:23.280 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6719999999999993e-06 2024-09-12T16:16:23.280 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.280 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.280 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.280 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.280 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.281 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30163 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.281 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.665571+0000", 2024-09-12T16:16:23.281 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4294967295.9984064, 2024-09-12T16:16:23.281 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003603232, 2024-09-12T16:16:23.281 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.281 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.281 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.281 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.281 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.281 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.281 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30163 2024-09-12T16:16:23.281 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.281 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.281 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.281 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.282 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665571+0000", 2024-09-12T16:16:23.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.282 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.282 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.282 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665571+0000", 2024-09-12T16:16:23.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.282 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.282 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.282 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665572+0000", 2024-09-12T16:16:23.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7599999999999998e-07 2024-09-12T16:16:23.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.282 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.282 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.283 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665573+0000", 2024-09-12T16:16:23.283 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.159e-06 2024-09-12T16:16:23.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.283 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.283 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.283 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665576+0000", 2024-09-12T16:16:23.283 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1410000000000001e-06 2024-09-12T16:16:23.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.283 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.283 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.283 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665579+0000", 2024-09-12T16:16:23.283 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6620000000000001e-06 2024-09-12T16:16:23.283 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.283 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.284 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.284 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.284 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29965 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.284 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.650696+0000", 2024-09-12T16:16:23.284 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.01328205, 2024-09-12T16:16:23.284 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018504842000000001, 2024-09-12T16:16:23.284 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.284 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.284 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.284 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.284 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.284 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.285 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29965 2024-09-12T16:16:23.285 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.285 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.285 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.285 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.285 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650696+0000", 2024-09-12T16:16:23.285 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.285 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.285 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.285 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.285 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650696+0000", 2024-09-12T16:16:23.285 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.285 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.285 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.285 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.286 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650696+0000", 2024-09-12T16:16:23.286 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3000000000000002e-07 2024-09-12T16:16:23.286 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.286 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.286 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.286 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650697+0000", 2024-09-12T16:16:23.286 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.159e-06 2024-09-12T16:16:23.286 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.286 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.286 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.286 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650700+0000", 2024-09-12T16:16:23.286 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.18e-06 2024-09-12T16:16:23.286 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.286 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.287 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.287 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650703+0000", 2024-09-12T16:16:23.287 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5299999999999999e-06 2024-09-12T16:16:23.287 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.287 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.287 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.287 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.287 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.287 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29997 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.287 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651367+0000", 2024-09-12T16:16:23.287 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012610658, 2024-09-12T16:16:23.287 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017856889000000001, 2024-09-12T16:16:23.287 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.287 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.288 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.288 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.288 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.288 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.288 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29997 2024-09-12T16:16:23.288 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.288 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.288 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.288 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.288 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651367+0000", 2024-09-12T16:16:23.288 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.288 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.288 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.289 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.289 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651367+0000", 2024-09-12T16:16:23.289 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.289 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.289 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.289 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651367+0000", 2024-09-12T16:16:23.289 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.22e-07 2024-09-12T16:16:23.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.289 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.289 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.289 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651369+0000", 2024-09-12T16:16:23.289 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2130000000000001e-06 2024-09-12T16:16:23.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.290 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.290 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.290 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651372+0000", 2024-09-12T16:16:23.290 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.145e-06 2024-09-12T16:16:23.290 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.290 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.290 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.290 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651375+0000", 2024-09-12T16:16:23.290 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7039999999999999e-06 2024-09-12T16:16:23.290 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.290 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.290 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.290 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.290 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.291 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30029 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.291 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652158+0000", 2024-09-12T16:16:23.291 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011820155000000001, 2024-09-12T16:16:23.291 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017097742999999999, 2024-09-12T16:16:23.291 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.291 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.291 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.291 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.291 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.291 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.291 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30029 2024-09-12T16:16:23.291 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.291 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.292 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.292 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.292 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652158+0000", 2024-09-12T16:16:23.292 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.292 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.292 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.292 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.292 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652158+0000", 2024-09-12T16:16:23.292 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.292 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.292 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.292 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.292 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652158+0000", 2024-09-12T16:16:23.292 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.03e-07 2024-09-12T16:16:23.293 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.293 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.293 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.293 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652159+0000", 2024-09-12T16:16:23.293 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.403e-06 2024-09-12T16:16:23.293 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.293 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.293 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.293 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652163+0000", 2024-09-12T16:16:23.293 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3139999999999999e-06 2024-09-12T16:16:23.293 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.293 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.293 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.293 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652166+0000", 2024-09-12T16:16:23.294 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7640000000000001e-06 2024-09-12T16:16:23.294 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.294 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.294 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.294 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.294 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.294 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30061 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.294 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652566+0000", 2024-09-12T16:16:23.294 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011412070999999999, 2024-09-12T16:16:23.294 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016715582, 2024-09-12T16:16:23.294 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.294 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.294 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.295 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.295 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.295 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.295 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30061 2024-09-12T16:16:23.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.295 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.295 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.295 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.295 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652566+0000", 2024-09-12T16:16:23.295 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.295 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.295 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.295 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652566+0000", 2024-09-12T16:16:23.295 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.296 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.296 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.296 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652566+0000", 2024-09-12T16:16:23.296 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0900000000000001e-07 2024-09-12T16:16:23.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.296 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.296 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.296 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652567+0000", 2024-09-12T16:16:23.296 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0550000000000001e-06 2024-09-12T16:16:23.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.296 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.296 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.296 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652570+0000", 2024-09-12T16:16:23.296 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9129999999999999e-06 2024-09-12T16:16:23.297 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.297 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.297 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.297 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652572+0000", 2024-09-12T16:16:23.297 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4049999999999998e-06 2024-09-12T16:16:23.297 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.297 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.297 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.297 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.297 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.297 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30100 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.297 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.653053+0000", 2024-09-12T16:16:23.297 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.010924698, 2024-09-12T16:16:23.298 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016251529000000001, 2024-09-12T16:16:23.298 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.298 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.298 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.298 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.298 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.298 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.298 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30100 2024-09-12T16:16:23.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.298 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.298 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.298 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.298 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653053+0000", 2024-09-12T16:16:23.298 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.299 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.299 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.299 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.299 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653053+0000", 2024-09-12T16:16:23.299 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.299 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.299 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.299 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.299 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653054+0000", 2024-09-12T16:16:23.299 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0499999999999999e-07 2024-09-12T16:16:23.299 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.299 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.299 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.299 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653056+0000", 2024-09-12T16:16:23.300 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.12e-06 2024-09-12T16:16:23.300 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.300 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.300 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.300 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653062+0000", 2024-09-12T16:16:23.300 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2689999999999996e-06 2024-09-12T16:16:23.300 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.300 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.300 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.300 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653069+0000", 2024-09-12T16:16:23.300 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6139999999999997e-06 2024-09-12T16:16:23.300 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.300 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.301 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.301 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.301 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.301 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30132 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.301 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.658891+0000", 2024-09-12T16:16:23.301 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0050867380000000004, 2024-09-12T16:16:23.301 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010439271999999999, 2024-09-12T16:16:23.301 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.301 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.301 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.301 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.301 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.301 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.302 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30132 2024-09-12T16:16:23.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.302 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.302 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.302 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.302 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658891+0000", 2024-09-12T16:16:23.302 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.302 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.302 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.302 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658891+0000", 2024-09-12T16:16:23.302 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.302 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.303 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.303 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658892+0000", 2024-09-12T16:16:23.303 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8500000000000002e-07 2024-09-12T16:16:23.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.303 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.303 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.303 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658894+0000", 2024-09-12T16:16:23.303 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.492e-06 2024-09-12T16:16:23.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.303 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.303 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.303 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658901+0000", 2024-09-12T16:16:23.303 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9299999999999997e-06 2024-09-12T16:16:23.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.304 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.304 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.304 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658911+0000", 2024-09-12T16:16:23.304 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9000000000000001e-06 2024-09-12T16:16:23.304 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.304 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.304 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.304 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.304 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30164 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.304 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.665582+0000", 2024-09-12T16:16:23.304 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4294967295.9983959, 2024-09-12T16:16:23.304 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0037743070000000002, 2024-09-12T16:16:23.304 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.304 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.305 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.305 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.305 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.305 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.305 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30164 2024-09-12T16:16:23.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.305 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.305 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.305 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.305 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665582+0000", 2024-09-12T16:16:23.305 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.305 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.305 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.306 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665582+0000", 2024-09-12T16:16:23.306 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.306 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.306 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.306 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665582+0000", 2024-09-12T16:16:23.306 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.04e-07 2024-09-12T16:16:23.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.306 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.306 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.306 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665583+0000", 2024-09-12T16:16:23.306 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0780000000000001e-06 2024-09-12T16:16:23.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.307 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.307 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.307 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665586+0000", 2024-09-12T16:16:23.307 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1049999999999999e-06 2024-09-12T16:16:23.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.307 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.307 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.307 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665589+0000", 2024-09-12T16:16:23.307 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5770000000000001e-06 2024-09-12T16:16:23.307 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.307 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.307 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.308 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29966 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.308 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.650720+0000", 2024-09-12T16:16:23.308 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.01325774, 2024-09-12T16:16:23.308 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018662116999999999, 2024-09-12T16:16:23.308 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.308 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.308 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.308 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.308 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.308 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.308 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29966 2024-09-12T16:16:23.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.308 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650720+0000", 2024-09-12T16:16:23.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650720+0000", 2024-09-12T16:16:23.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650720+0000", 2024-09-12T16:16:23.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1600000000000002e-07 2024-09-12T16:16:23.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.310 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.310 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.310 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650722+0000", 2024-09-12T16:16:23.310 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6479999999999999e-06 2024-09-12T16:16:23.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.310 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.310 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.310 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650726+0000", 2024-09-12T16:16:23.310 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4410000000000002e-06 2024-09-12T16:16:23.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.310 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.310 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.310 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650728+0000", 2024-09-12T16:16:23.310 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5940000000000001e-06 2024-09-12T16:16:23.311 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.311 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.311 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.311 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.311 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.311 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29998 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.311 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651397+0000", 2024-09-12T16:16:23.311 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012580890000000001, 2024-09-12T16:16:23.311 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018010063999999999, 2024-09-12T16:16:23.311 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.311 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.311 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.311 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.311 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.312 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.312 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29998 2024-09-12T16:16:23.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.312 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.312 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.312 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.312 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651397+0000", 2024-09-12T16:16:23.312 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.312 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.312 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.312 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651397+0000", 2024-09-12T16:16:23.312 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.313 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.313 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.313 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.313 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651397+0000", 2024-09-12T16:16:23.313 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.03e-07 2024-09-12T16:16:23.313 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.313 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.313 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.313 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651399+0000", 2024-09-12T16:16:23.313 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.714e-06 2024-09-12T16:16:23.313 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.313 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.313 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.313 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651402+0000", 2024-09-12T16:16:23.314 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.394e-06 2024-09-12T16:16:23.314 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.314 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.314 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.314 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651405+0000", 2024-09-12T16:16:23.314 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.791e-06 2024-09-12T16:16:23.314 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.314 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.314 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.314 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.314 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.314 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30030 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.314 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652169+0000", 2024-09-12T16:16:23.315 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011808982000000001, 2024-09-12T16:16:23.315 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017263269000000001, 2024-09-12T16:16:23.315 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.315 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.315 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.315 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.315 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.315 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.315 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30030 2024-09-12T16:16:23.315 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.315 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.315 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.315 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.315 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652169+0000", 2024-09-12T16:16:23.316 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.316 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.316 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652169+0000", 2024-09-12T16:16:23.316 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.316 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.316 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652169+0000", 2024-09-12T16:16:23.316 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0900000000000001e-07 2024-09-12T16:16:23.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.317 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652170+0000", 2024-09-12T16:16:23.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1030000000000001e-06 2024-09-12T16:16:23.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.317 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.317 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652173+0000", 2024-09-12T16:16:23.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0450000000000001e-06 2024-09-12T16:16:23.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.317 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.317 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652176+0000", 2024-09-12T16:16:23.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4940000000000002e-06 2024-09-12T16:16:23.317 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.317 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.318 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.318 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30062 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.318 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652575+0000", 2024-09-12T16:16:23.318 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011402557000000001, 2024-09-12T16:16:23.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01688189, 2024-09-12T16:16:23.318 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.318 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.318 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.318 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.318 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.318 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.318 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30062 2024-09-12T16:16:23.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.319 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.319 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.319 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.319 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652575+0000", 2024-09-12T16:16:23.319 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.319 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.319 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.319 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652575+0000", 2024-09-12T16:16:23.319 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.319 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.319 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.320 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652575+0000", 2024-09-12T16:16:23.320 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1e-07 2024-09-12T16:16:23.320 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.320 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.320 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.320 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652577+0000", 2024-09-12T16:16:23.320 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.128e-06 2024-09-12T16:16:23.320 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.320 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.320 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.320 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652580+0000", 2024-09-12T16:16:23.320 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0479999999999999e-06 2024-09-12T16:16:23.320 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.320 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.321 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.321 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652582+0000", 2024-09-12T16:16:23.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4169999999999999e-06 2024-09-12T16:16:23.321 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.321 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.321 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.321 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.321 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30133 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.321 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.658922+0000", 2024-09-12T16:16:23.321 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0050554179999999999, 2024-09-12T16:16:23.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010559575999999999, 2024-09-12T16:16:23.321 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.321 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.321 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.322 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.322 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.322 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.322 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30133 2024-09-12T16:16:23.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.322 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.322 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658922+0000", 2024-09-12T16:16:23.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.322 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658922+0000", 2024-09-12T16:16:23.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.323 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.323 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658923+0000", 2024-09-12T16:16:23.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9800000000000004e-07 2024-09-12T16:16:23.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.323 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.323 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658933+0000", 2024-09-12T16:16:23.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0509000000000001e-05 2024-09-12T16:16:23.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.323 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.324 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658942+0000", 2024-09-12T16:16:23.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9809999999999992e-06 2024-09-12T16:16:23.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.324 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.324 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.324 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658948+0000", 2024-09-12T16:16:23.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.383e-06 2024-09-12T16:16:23.324 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.324 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.324 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.324 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.324 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30165 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.324 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.665592+0000", 2024-09-12T16:16:23.325 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4294967295.9983859, 2024-09-12T16:16:23.325 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039133240000000001, 2024-09-12T16:16:23.325 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.325 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.325 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.325 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.325 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.325 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.325 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30165 2024-09-12T16:16:23.325 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.325 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.325 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.325 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.326 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665592+0000", 2024-09-12T16:16:23.326 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.326 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.326 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.326 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665592+0000", 2024-09-12T16:16:23.326 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.326 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.326 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.326 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665592+0000", 2024-09-12T16:16:23.326 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.03e-07 2024-09-12T16:16:23.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.327 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.327 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.327 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665594+0000", 2024-09-12T16:16:23.327 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4300000000000001e-06 2024-09-12T16:16:23.327 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.327 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.327 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.327 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665597+0000", 2024-09-12T16:16:23.327 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0599999999999999e-06 2024-09-12T16:16:23.327 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.327 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.327 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.327 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665599+0000", 2024-09-12T16:16:23.328 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.582e-06 2024-09-12T16:16:23.328 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.328 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.328 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.328 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.328 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.328 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29967 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.328 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.650732+0000", 2024-09-12T16:16:23.328 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013246132000000001, 2024-09-12T16:16:23.328 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018799855000000001, 2024-09-12T16:16:23.328 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.328 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.328 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.329 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.329 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.329 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.329 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29967 2024-09-12T16:16:23.329 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.329 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.329 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.329 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.329 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650732+0000", 2024-09-12T16:16:23.329 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.329 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.329 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.329 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.329 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650732+0000", 2024-09-12T16:16:23.330 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.330 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.330 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650732+0000", 2024-09-12T16:16:23.330 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3000000000000002e-07 2024-09-12T16:16:23.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.330 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.330 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650733+0000", 2024-09-12T16:16:23.330 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.116e-06 2024-09-12T16:16:23.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.330 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.330 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650736+0000", 2024-09-12T16:16:23.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0759999999999999e-06 2024-09-12T16:16:23.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.331 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650739+0000", 2024-09-12T16:16:23.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5679999999999998e-06 2024-09-12T16:16:23.331 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.331 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.331 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.331 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29999 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.331 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651409+0000", 2024-09-12T16:16:23.331 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012569198, 2024-09-12T16:16:23.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018146379000000001, 2024-09-12T16:16:23.332 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.332 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.332 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.332 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.332 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.332 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.332 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29999 2024-09-12T16:16:23.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.332 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651409+0000", 2024-09-12T16:16:23.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.333 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651409+0000", 2024-09-12T16:16:23.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.333 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651409+0000", 2024-09-12T16:16:23.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1899999999999999e-07 2024-09-12T16:16:23.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.334 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651410+0000", 2024-09-12T16:16:23.334 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0759999999999999e-06 2024-09-12T16:16:23.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.334 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.334 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.334 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651413+0000", 2024-09-12T16:16:23.334 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9969999999999999e-06 2024-09-12T16:16:23.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.334 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.334 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.334 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651415+0000", 2024-09-12T16:16:23.334 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3889999999999999e-06 2024-09-12T16:16:23.334 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.334 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.335 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.335 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.335 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.335 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30031 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.335 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652204+0000", 2024-09-12T16:16:23.335 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011774196000000001, 2024-09-12T16:16:23.335 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017376765999999998, 2024-09-12T16:16:23.335 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.335 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.335 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.335 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.335 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.335 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.335 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30031 2024-09-12T16:16:23.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.336 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.336 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.336 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.336 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652204+0000", 2024-09-12T16:16:23.336 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.336 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.336 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.336 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652204+0000", 2024-09-12T16:16:23.336 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.336 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.336 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652204+0000", 2024-09-12T16:16:23.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2399999999999999e-07 2024-09-12T16:16:23.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.337 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652205+0000", 2024-09-12T16:16:23.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.376e-06 2024-09-12T16:16:23.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.337 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652209+0000", 2024-09-12T16:16:23.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.331e-06 2024-09-12T16:16:23.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.337 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.338 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652211+0000", 2024-09-12T16:16:23.338 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6630000000000002e-06 2024-09-12T16:16:23.338 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.338 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.338 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.338 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.338 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.338 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30063 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.338 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652585+0000", 2024-09-12T16:16:23.338 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011392823999999999, 2024-09-12T16:16:23.338 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017018676999999999, 2024-09-12T16:16:23.338 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.338 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.338 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.339 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.339 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.339 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.339 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30063 2024-09-12T16:16:23.339 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.339 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.339 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.339 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.339 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652585+0000", 2024-09-12T16:16:23.339 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.339 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.339 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.339 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.340 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652585+0000", 2024-09-12T16:16:23.340 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.340 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.340 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.340 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652585+0000", 2024-09-12T16:16:23.340 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.36e-07 2024-09-12T16:16:23.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.340 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.340 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.340 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652586+0000", 2024-09-12T16:16:23.340 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9000000000000005e-07 2024-09-12T16:16:23.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.340 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.341 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.341 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652589+0000", 2024-09-12T16:16:23.341 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0350000000000002e-06 2024-09-12T16:16:23.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.341 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.341 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.341 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652592+0000", 2024-09-12T16:16:23.341 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4150000000000002e-06 2024-09-12T16:16:23.341 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.341 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.341 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.341 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.341 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30102 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.342 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.653097+0000", 2024-09-12T16:16:23.342 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.010881261, 2024-09-12T16:16:23.342 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016537679, 2024-09-12T16:16:23.342 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.342 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.342 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.342 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.342 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.342 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.342 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30102 2024-09-12T16:16:23.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.342 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.342 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.342 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.342 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653097+0000", 2024-09-12T16:16:23.343 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.343 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.343 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.343 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.343 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653097+0000", 2024-09-12T16:16:23.343 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.343 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.343 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.343 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.343 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653097+0000", 2024-09-12T16:16:23.343 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9299999999999999e-07 2024-09-12T16:16:23.343 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.343 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.344 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.344 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653099+0000", 2024-09-12T16:16:23.344 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9069999999999999e-06 2024-09-12T16:16:23.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.344 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.344 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.344 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653105+0000", 2024-09-12T16:16:23.344 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0970000000000002e-06 2024-09-12T16:16:23.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.344 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.344 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.344 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653110+0000", 2024-09-12T16:16:23.344 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7829999999999998e-06 2024-09-12T16:16:23.345 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.345 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.345 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.345 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.345 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30134 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.345 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.658966+0000", 2024-09-12T16:16:23.345 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0050117709999999999, 2024-09-12T16:16:23.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010709501999999999, 2024-09-12T16:16:23.345 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.345 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.345 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.345 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.345 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.345 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.346 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30134 2024-09-12T16:16:23.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.346 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.346 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.346 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658966+0000", 2024-09-12T16:16:23.346 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.346 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.346 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658966+0000", 2024-09-12T16:16:23.346 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.347 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.347 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658967+0000", 2024-09-12T16:16:23.347 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.89e-07 2024-09-12T16:16:23.347 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.347 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.347 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.347 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658969+0000", 2024-09-12T16:16:23.347 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3829999999999999e-06 2024-09-12T16:16:23.347 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.347 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.347 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.347 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658977+0000", 2024-09-12T16:16:23.347 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8550000000000002e-06 2024-09-12T16:16:23.347 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.347 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.348 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.348 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658984+0000", 2024-09-12T16:16:23.348 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8730000000000001e-06 2024-09-12T16:16:23.348 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.348 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.348 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.348 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.348 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.348 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30166 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.348 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.665602+0000", 2024-09-12T16:16:23.348 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4294967295.9983754, 2024-09-12T16:16:23.348 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040976290000000002, 2024-09-12T16:16:23.348 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.348 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.349 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.349 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.349 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.349 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.349 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30166 2024-09-12T16:16:23.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.349 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.349 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.349 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.349 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665602+0000", 2024-09-12T16:16:23.349 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.349 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665602+0000", 2024-09-12T16:16:23.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665603+0000", 2024-09-12T16:16:23.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:16:23.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665604+0000", 2024-09-12T16:16:23.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.049e-06 2024-09-12T16:16:23.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.351 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.351 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665608+0000", 2024-09-12T16:16:23.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6090000000000003e-06 2024-09-12T16:16:23.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.351 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.351 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665611+0000", 2024-09-12T16:16:23.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6070000000000002e-06 2024-09-12T16:16:23.351 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.351 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.351 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.351 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29968 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.352 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.650756+0000", 2024-09-12T16:16:23.352 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013221853, 2024-09-12T16:16:23.352 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018971768999999999, 2024-09-12T16:16:23.352 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.352 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.352 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.352 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.352 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.352 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.352 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29968 2024-09-12T16:16:23.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.352 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.352 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.353 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.353 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650756+0000", 2024-09-12T16:16:23.353 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.353 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.353 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.353 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650756+0000", 2024-09-12T16:16:23.353 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.353 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.353 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.353 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650756+0000", 2024-09-12T16:16:23.353 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2199999999999999e-07 2024-09-12T16:16:23.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.354 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.354 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650758+0000", 2024-09-12T16:16:23.354 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4980000000000001e-06 2024-09-12T16:16:23.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.354 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.354 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650761+0000", 2024-09-12T16:16:23.354 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3799999999999998e-06 2024-09-12T16:16:23.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.354 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.354 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650764+0000", 2024-09-12T16:16:23.354 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7410000000000001e-06 2024-09-12T16:16:23.354 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.355 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.355 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.355 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.355 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.355 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30000 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.355 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651442+0000", 2024-09-12T16:16:23.355 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012535335999999999, 2024-09-12T16:16:23.355 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018309314, 2024-09-12T16:16:23.355 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.355 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.355 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.355 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.355 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.355 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.356 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30000 2024-09-12T16:16:23.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.356 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.356 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.356 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.356 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651442+0000", 2024-09-12T16:16:23.356 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.356 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.356 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.356 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651442+0000", 2024-09-12T16:16:23.356 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.356 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.357 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.357 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651443+0000", 2024-09-12T16:16:23.357 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2199999999999999e-07 2024-09-12T16:16:23.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.357 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.357 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.357 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651444+0000", 2024-09-12T16:16:23.357 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.468e-06 2024-09-12T16:16:23.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.357 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.357 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.357 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651448+0000", 2024-09-12T16:16:23.357 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2849999999999999e-06 2024-09-12T16:16:23.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.358 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.358 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.358 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651450+0000", 2024-09-12T16:16:23.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.751e-06 2024-09-12T16:16:23.358 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.358 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.358 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.358 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.358 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30032 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.358 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652215+0000", 2024-09-12T16:16:23.358 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011762956, 2024-09-12T16:16:23.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017562016999999999, 2024-09-12T16:16:23.359 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.359 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.359 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.359 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.359 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.359 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.359 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30032 2024-09-12T16:16:23.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.359 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.359 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652215+0000", 2024-09-12T16:16:23.360 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.360 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.360 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.360 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.360 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652215+0000", 2024-09-12T16:16:23.360 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.360 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.360 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.360 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.360 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652215+0000", 2024-09-12T16:16:23.360 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2600000000000001e-07 2024-09-12T16:16:23.360 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.360 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.361 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.361 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652218+0000", 2024-09-12T16:16:23.361 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3249999999999999e-06 2024-09-12T16:16:23.361 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.361 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.361 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.361 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652222+0000", 2024-09-12T16:16:23.361 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.129e-06 2024-09-12T16:16:23.361 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.361 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.361 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.361 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652224+0000", 2024-09-12T16:16:23.361 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6790000000000001e-06 2024-09-12T16:16:23.361 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.362 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.362 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.362 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.362 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.362 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30064 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.362 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652616+0000", 2024-09-12T16:16:23.362 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011361810999999999, 2024-09-12T16:16:23.362 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017185025999999999, 2024-09-12T16:16:23.362 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.362 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.362 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.362 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.362 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.363 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.363 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30064 2024-09-12T16:16:23.363 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.363 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.363 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.363 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.363 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652616+0000", 2024-09-12T16:16:23.363 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.363 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.363 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.363 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.363 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652616+0000", 2024-09-12T16:16:23.363 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.363 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.364 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.364 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.364 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652616+0000", 2024-09-12T16:16:23.364 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3099999999999998e-07 2024-09-12T16:16:23.364 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.364 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.364 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.364 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652618+0000", 2024-09-12T16:16:23.364 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4360000000000001e-06 2024-09-12T16:16:23.364 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.364 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.364 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.364 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652621+0000", 2024-09-12T16:16:23.364 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4460000000000001e-06 2024-09-12T16:16:23.365 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.365 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.365 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.365 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652624+0000", 2024-09-12T16:16:23.365 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6850000000000001e-06 2024-09-12T16:16:23.365 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.365 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.365 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.365 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.365 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.365 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30103 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.365 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.653128+0000", 2024-09-12T16:16:23.365 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.010849888, 2024-09-12T16:16:23.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016698178000000001, 2024-09-12T16:16:23.366 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.366 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.366 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.366 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.366 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.366 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.366 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30103 2024-09-12T16:16:23.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.366 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.366 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.366 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.366 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653128+0000", 2024-09-12T16:16:23.367 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.367 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.367 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.367 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653128+0000", 2024-09-12T16:16:23.367 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.367 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.367 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.367 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653128+0000", 2024-09-12T16:16:23.367 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5599999999999995e-07 2024-09-12T16:16:23.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.367 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.368 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.368 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653131+0000", 2024-09-12T16:16:23.368 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.181e-06 2024-09-12T16:16:23.368 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.368 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.368 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.368 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653138+0000", 2024-09-12T16:16:23.368 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0360000000000001e-06 2024-09-12T16:16:23.368 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.368 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.368 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.368 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653143+0000", 2024-09-12T16:16:23.368 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3700000000000003e-06 2024-09-12T16:16:23.368 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.368 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.369 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.369 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.369 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.369 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30135 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.369 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.658991+0000", 2024-09-12T16:16:23.369 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.004986501, 2024-09-12T16:16:23.369 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010858117, 2024-09-12T16:16:23.369 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.369 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.369 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.369 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.369 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.369 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.369 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30135 2024-09-12T16:16:23.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.370 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.370 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.370 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.370 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658991+0000", 2024-09-12T16:16:23.370 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.370 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.370 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.370 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658991+0000", 2024-09-12T16:16:23.370 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.370 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.371 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.371 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658992+0000", 2024-09-12T16:16:23.371 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1100000000000001e-07 2024-09-12T16:16:23.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.371 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.371 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.371 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.658994+0000", 2024-09-12T16:16:23.371 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0999999999999998e-06 2024-09-12T16:16:23.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.371 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.371 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.371 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659002+0000", 2024-09-12T16:16:23.371 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6960000000000005e-06 2024-09-12T16:16:23.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.371 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.372 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.372 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659006+0000", 2024-09-12T16:16:23.372 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.933e-06 2024-09-12T16:16:23.372 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.372 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.372 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.372 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.372 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.372 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30167 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.372 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.665614+0000", 2024-09-12T16:16:23.372 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4294967295.9983635, 2024-09-12T16:16:23.372 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0042605029999999997, 2024-09-12T16:16:23.372 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.372 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.373 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.373 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.373 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.373 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.373 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30167 2024-09-12T16:16:23.373 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.373 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.373 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.373 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.373 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665614+0000", 2024-09-12T16:16:23.373 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.373 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.373 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.373 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.374 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665614+0000", 2024-09-12T16:16:23.374 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.374 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.374 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.374 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.374 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665614+0000", 2024-09-12T16:16:23.374 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:16:23.374 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.374 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.374 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.374 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665616+0000", 2024-09-12T16:16:23.374 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.175e-06 2024-09-12T16:16:23.374 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.374 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.374 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.375 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665619+0000", 2024-09-12T16:16:23.375 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0529999999999998e-06 2024-09-12T16:16:23.375 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.375 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.375 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.375 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665621+0000", 2024-09-12T16:16:23.375 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5189999999999999e-06 2024-09-12T16:16:23.375 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.375 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.375 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.375 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.375 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.375 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29969 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.375 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.650767+0000", 2024-09-12T16:16:23.375 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.01321046, 2024-09-12T16:16:23.376 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019131584, 2024-09-12T16:16:23.376 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.376 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.376 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.376 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.376 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.376 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.376 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29969 2024-09-12T16:16:23.376 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.376 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.376 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.376 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.376 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650767+0000", 2024-09-12T16:16:23.376 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.377 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.377 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.377 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650767+0000", 2024-09-12T16:16:23.377 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.377 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.377 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.377 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650768+0000", 2024-09-12T16:16:23.377 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1399999999999998e-07 2024-09-12T16:16:23.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.377 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.377 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.377 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650769+0000", 2024-09-12T16:16:23.378 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1310000000000001e-06 2024-09-12T16:16:23.378 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.378 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.378 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.378 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650772+0000", 2024-09-12T16:16:23.378 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0800000000000002e-06 2024-09-12T16:16:23.378 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.378 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.378 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.378 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650774+0000", 2024-09-12T16:16:23.378 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5509999999999998e-06 2024-09-12T16:16:23.378 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.378 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.378 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.379 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.379 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.379 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30001 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.379 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651454+0000", 2024-09-12T16:16:23.379 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012524106, 2024-09-12T16:16:23.379 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018470488, 2024-09-12T16:16:23.379 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.379 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.379 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.379 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.379 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.379 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.379 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30001 2024-09-12T16:16:23.379 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.380 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.380 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.380 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.380 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651454+0000", 2024-09-12T16:16:23.380 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.380 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.380 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.380 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651454+0000", 2024-09-12T16:16:23.380 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.380 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.380 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.381 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651454+0000", 2024-09-12T16:16:23.381 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.29e-07 2024-09-12T16:16:23.381 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.381 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.381 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.381 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651455+0000", 2024-09-12T16:16:23.381 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0780000000000001e-06 2024-09-12T16:16:23.381 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.381 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.381 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.381 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651458+0000", 2024-09-12T16:16:23.381 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.993e-06 2024-09-12T16:16:23.381 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.381 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.382 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.382 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651460+0000", 2024-09-12T16:16:23.382 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4820000000000001e-06 2024-09-12T16:16:23.382 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.382 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.382 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.382 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.382 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.382 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30033 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.382 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652252+0000", 2024-09-12T16:16:23.382 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011725562, 2024-09-12T16:16:23.382 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017695331000000002, 2024-09-12T16:16:23.382 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.383 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.383 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.383 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.383 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.383 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.383 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30033 2024-09-12T16:16:23.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.383 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.383 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.383 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.383 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652252+0000", 2024-09-12T16:16:23.383 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.383 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.383 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.384 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652252+0000", 2024-09-12T16:16:23.384 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.384 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.384 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652253+0000", 2024-09-12T16:16:23.384 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3599999999999999e-07 2024-09-12T16:16:23.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.384 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.384 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652254+0000", 2024-09-12T16:16:23.384 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.564e-06 2024-09-12T16:16:23.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.385 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.385 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.385 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652258+0000", 2024-09-12T16:16:23.385 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9589999999999997e-06 2024-09-12T16:16:23.385 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.385 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.385 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.385 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652262+0000", 2024-09-12T16:16:23.385 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6679999999999999e-06 2024-09-12T16:16:23.385 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.385 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.385 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.386 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.386 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30065 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.386 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652627+0000", 2024-09-12T16:16:23.386 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011350468000000001, 2024-09-12T16:16:23.386 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017346344, 2024-09-12T16:16:23.386 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.386 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.386 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.386 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.386 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.386 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.386 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30065 2024-09-12T16:16:23.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.387 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.387 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.387 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.387 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652627+0000", 2024-09-12T16:16:23.387 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.387 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.387 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.387 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652627+0000", 2024-09-12T16:16:23.387 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.387 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.387 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.387 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652628+0000", 2024-09-12T16:16:23.387 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0699999999999999e-07 2024-09-12T16:16:23.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.388 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652629+0000", 2024-09-12T16:16:23.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.066e-06 2024-09-12T16:16:23.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.388 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652632+0000", 2024-09-12T16:16:23.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0130000000000002e-06 2024-09-12T16:16:23.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.388 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652634+0000", 2024-09-12T16:16:23.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4439999999999998e-06 2024-09-12T16:16:23.389 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.389 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.389 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.389 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.389 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30104 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.389 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.653151+0000", 2024-09-12T16:16:23.389 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.01082703, 2024-09-12T16:16:23.389 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016849051, 2024-09-12T16:16:23.389 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.389 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.389 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.389 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.389 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.390 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.390 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30104 2024-09-12T16:16:23.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.390 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.390 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.390 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.390 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653151+0000", 2024-09-12T16:16:23.390 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.390 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.390 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.390 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653151+0000", 2024-09-12T16:16:23.390 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.390 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.391 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.391 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653151+0000", 2024-09-12T16:16:23.391 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0800000000000005e-07 2024-09-12T16:16:23.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.391 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.391 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.391 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653153+0000", 2024-09-12T16:16:23.391 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.03e-06 2024-09-12T16:16:23.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.391 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.391 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.391 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653159+0000", 2024-09-12T16:16:23.391 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8969999999999996e-06 2024-09-12T16:16:23.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.392 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.392 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.392 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653166+0000", 2024-09-12T16:16:23.392 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.776e-06 2024-09-12T16:16:23.392 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.392 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.392 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.392 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.392 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30136 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.392 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.659029+0000", 2024-09-12T16:16:23.392 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.004948544, 2024-09-12T16:16:23.392 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010995718, 2024-09-12T16:16:23.393 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.393 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.393 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.393 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.393 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.393 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.393 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30136 2024-09-12T16:16:23.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.393 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.393 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.393 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659029+0000", 2024-09-12T16:16:23.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659029+0000", 2024-09-12T16:16:23.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659030+0000", 2024-09-12T16:16:23.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7399999999999998e-07 2024-09-12T16:16:23.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659032+0000", 2024-09-12T16:16:23.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7180000000000001e-06 2024-09-12T16:16:23.395 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.395 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.395 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.395 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659040+0000", 2024-09-12T16:16:23.395 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3710000000000002e-06 2024-09-12T16:16:23.395 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.395 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.395 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.395 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659046+0000", 2024-09-12T16:16:23.395 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1770000000000003e-06 2024-09-12T16:16:23.395 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.395 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.395 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.395 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.395 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.396 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30168 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.396 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.665624+0000", 2024-09-12T16:16:23.396 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4294967295.9983535, 2024-09-12T16:16:23.396 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0044241899999999997, 2024-09-12T16:16:23.396 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.396 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.396 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.396 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.396 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.396 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.396 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30168 2024-09-12T16:16:23.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.396 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.396 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.397 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.397 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665624+0000", 2024-09-12T16:16:23.397 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.397 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.397 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.397 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665624+0000", 2024-09-12T16:16:23.397 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.397 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.397 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.397 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665624+0000", 2024-09-12T16:16:23.397 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0900000000000001e-07 2024-09-12T16:16:23.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.398 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.398 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665626+0000", 2024-09-12T16:16:23.398 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.04e-06 2024-09-12T16:16:23.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.398 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.398 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665628+0000", 2024-09-12T16:16:23.398 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9830000000000001e-06 2024-09-12T16:16:23.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.398 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.398 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665631+0000", 2024-09-12T16:16:23.398 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.531e-06 2024-09-12T16:16:23.399 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.399 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.399 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.399 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.399 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:29970 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.399 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.650778+0000", 2024-09-12T16:16:23.399 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.013200256, 2024-09-12T16:16:23.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019296504999999999, 2024-09-12T16:16:23.399 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.399 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.399 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.399 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.399 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.399 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.400 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 29970 2024-09-12T16:16:23.400 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.400 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.400 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.400 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.400 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650778+0000", 2024-09-12T16:16:23.400 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.400 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.400 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.400 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.400 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650778+0000", 2024-09-12T16:16:23.400 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.400 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.400 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.400 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.401 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650778+0000", 2024-09-12T16:16:23.401 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7899999999999999e-07 2024-09-12T16:16:23.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.401 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.401 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.401 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650779+0000", 2024-09-12T16:16:23.401 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.066e-06 2024-09-12T16:16:23.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.401 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.401 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.401 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650782+0000", 2024-09-12T16:16:23.401 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9399999999999998e-06 2024-09-12T16:16:23.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.402 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.402 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.650785+0000", 2024-09-12T16:16:23.402 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.599e-06 2024-09-12T16:16:23.402 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.402 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.402 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.402 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30002 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.402 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.651489+0000", 2024-09-12T16:16:23.402 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.012488885, 2024-09-12T16:16:23.402 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018609164000000001, 2024-09-12T16:16:23.402 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.402 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.403 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.403 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.403 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.403 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.403 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30002 2024-09-12T16:16:23.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.403 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.403 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.403 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.403 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651489+0000", 2024-09-12T16:16:23.403 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.403 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.403 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.403 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651489+0000", 2024-09-12T16:16:23.404 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.404 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.404 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.404 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.404 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651489+0000", 2024-09-12T16:16:23.404 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1600000000000002e-07 2024-09-12T16:16:23.404 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.404 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.404 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.404 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651491+0000", 2024-09-12T16:16:23.404 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.412e-06 2024-09-12T16:16:23.404 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.404 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.404 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.405 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651494+0000", 2024-09-12T16:16:23.405 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.365e-06 2024-09-12T16:16:23.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.405 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.405 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.405 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.651497+0000", 2024-09-12T16:16:23.405 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6450000000000001e-06 2024-09-12T16:16:23.405 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.405 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.405 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.405 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.405 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30034 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.405 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652266+0000", 2024-09-12T16:16:23.406 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011711923000000001, 2024-09-12T16:16:23.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017855976999999999, 2024-09-12T16:16:23.406 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.406 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.406 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.406 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.406 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.406 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.406 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30034 2024-09-12T16:16:23.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.406 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.406 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652266+0000", 2024-09-12T16:16:23.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.407 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.407 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652266+0000", 2024-09-12T16:16:23.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.407 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.407 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652266+0000", 2024-09-12T16:16:23.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2800000000000003e-07 2024-09-12T16:16:23.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.407 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.407 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652267+0000", 2024-09-12T16:16:23.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1599999999999999e-06 2024-09-12T16:16:23.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.408 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.408 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.408 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652270+0000", 2024-09-12T16:16:23.408 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0790000000000001e-06 2024-09-12T16:16:23.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.408 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.408 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.408 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652273+0000", 2024-09-12T16:16:23.408 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6120000000000001e-06 2024-09-12T16:16:23.408 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.408 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.408 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.408 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.409 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30066 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.409 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.652637+0000", 2024-09-12T16:16:23.409 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.011340634, 2024-09-12T16:16:23.409 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017509904, 2024-09-12T16:16:23.409 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.409 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.409 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.409 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.409 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.409 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.409 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30066 2024-09-12T16:16:23.409 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.409 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.409 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.409 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.410 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652637+0000", 2024-09-12T16:16:23.410 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.410 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.410 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.410 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.410 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652637+0000", 2024-09-12T16:16:23.410 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.410 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.410 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.410 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.410 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652637+0000", 2024-09-12T16:16:23.410 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6600000000000003e-07 2024-09-12T16:16:23.410 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.410 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.411 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652639+0000", 2024-09-12T16:16:23.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0780000000000001e-06 2024-09-12T16:16:23.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.411 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.411 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652641+0000", 2024-09-12T16:16:23.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.897e-06 2024-09-12T16:16:23.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.411 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.411 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.652644+0000", 2024-09-12T16:16:23.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3190000000000002e-06 2024-09-12T16:16:23.411 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.412 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.412 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.412 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30105 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.412 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.653173+0000", 2024-09-12T16:16:23.412 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.010804920000000001, 2024-09-12T16:16:23.412 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016997422000000002, 2024-09-12T16:16:23.412 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.412 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.412 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.412 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.412 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.412 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.413 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30105 2024-09-12T16:16:23.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.413 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.413 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.413 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653173+0000", 2024-09-12T16:16:23.413 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.413 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.413 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653173+0000", 2024-09-12T16:16:23.414 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.414 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.414 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.414 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653255+0000", 2024-09-12T16:16:23.414 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2019000000000002e-05 2024-09-12T16:16:23.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.414 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.414 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.414 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653258+0000", 2024-09-12T16:16:23.414 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5559999999999999e-06 2024-09-12T16:16:23.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.414 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.414 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.415 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653269+0000", 2024-09-12T16:16:23.415 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.044e-05 2024-09-12T16:16:23.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.415 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.415 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.415 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.653275+0000", 2024-09-12T16:16:23.415 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1279999999999996e-06 2024-09-12T16:16:23.415 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.415 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.415 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.415 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.415 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30137 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.415 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.659060+0000", 2024-09-12T16:16:23.416 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0049177730000000003, 2024-09-12T16:16:23.416 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011135321, 2024-09-12T16:16:23.416 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.416 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.416 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.416 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.416 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.416 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.416 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30137 2024-09-12T16:16:23.416 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.416 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.416 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.416 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.416 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659060+0000", 2024-09-12T16:16:23.417 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.417 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.417 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.417 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659060+0000", 2024-09-12T16:16:23.417 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.417 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.417 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.417 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659061+0000", 2024-09-12T16:16:23.417 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.82e-07 2024-09-12T16:16:23.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.417 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.418 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.418 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659063+0000", 2024-09-12T16:16:23.418 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.08e-06 2024-09-12T16:16:23.418 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.418 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.418 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.418 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659069+0000", 2024-09-12T16:16:23.418 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1580000000000002e-06 2024-09-12T16:16:23.418 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.418 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.418 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.418 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.659073+0000", 2024-09-12T16:16:23.418 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5929999999999999e-06 2024-09-12T16:16:23.418 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.418 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.419 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.419 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.419 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.419 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:30169 3.9 3.8484a4e9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:23.419 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:22.665634+0000", 2024-09-12T16:16:23.419 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4294967295.9983439, 2024-09-12T16:16:23.419 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0045864130000000001, 2024-09-12T16:16:23.419 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:23.419 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:23.419 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:23.419 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:23.419 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:23.419 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:23.419 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 30169 2024-09-12T16:16:23.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.420 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:23.420 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.420 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:23.420 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665634+0000", 2024-09-12T16:16:23.420 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.420 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.420 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:23.420 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665634+0000", 2024-09-12T16:16:23.420 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:23.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.420 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.420 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:23.420 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665634+0000", 2024-09-12T16:16:23.421 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.11e-07 2024-09-12T16:16:23.421 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.421 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.421 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:23.421 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665643+0000", 2024-09-12T16:16:23.421 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6580000000000008e-06 2024-09-12T16:16:23.421 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.421 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.421 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:23.421 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665647+0000", 2024-09-12T16:16:23.421 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.693e-06 2024-09-12T16:16:23.421 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:23.421 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:23.421 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:23.421 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:22.665649+0000", 2024-09-12T16:16:23.422 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7709999999999998e-06 2024-09-12T16:16:23.422 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.422 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:23.422 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.422 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:23.422 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-12T16:16:23.422 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 220 2024-09-12T16:16:23.422 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:23.423 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:16:23.424 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T16:16:23.424 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:16:23.425 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:16:23.425 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-12T16:16:23.425 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T16:16:23.426 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2024-09-12T16:16:23.426 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:23.422+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:23.524 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:23.524+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:23.549 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:23.550 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:23.560 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:16:23.626 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:23.626+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:23.669 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:23.669 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:23.678 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:16:23.726 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:23.726+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:23.754 INFO:teuthology.orchestra.run.smithi204.stdout:1084 write 0xad04600 thru 0xad0fc40 (0xb641 bytes) 2024-09-12T16:16:23.755 INFO:teuthology.orchestra.run.smithi204.stdout:1085 read 0xab92600 thru 0xab9f960 (0xd361 bytes) 2024-09-12T16:16:23.755 INFO:teuthology.orchestra.run.smithi204.stdout:1087 read 0x7765400 thru 0x776bfff (0x6c00 bytes) 2024-09-12T16:16:23.755 INFO:teuthology.orchestra.run.smithi204.stdout:1088 write 0x7fb8200 thru 0x7fb9277 (0x1078 bytes) 2024-09-12T16:16:23.755 INFO:teuthology.orchestra.run.smithi204.stdout:1090 write 0xa488200 thru 0xa48f18b (0x6f8c bytes) 2024-09-12T16:16:23.778 INFO:teuthology.orchestra.run.smithi204.stdout:1091 write 0xe02d200 thru 0xe02eff7 (0x1df8 bytes) 2024-09-12T16:16:23.784 INFO:teuthology.orchestra.run.smithi204.stdout:1094 write 0xdd91800 thru 0xdd9cee5 (0xb6e6 bytes) 2024-09-12T16:16:23.784 INFO:teuthology.orchestra.run.smithi204.stdout:1096 write 0xde1ce00 thru 0xde2531d (0x851e bytes) 2024-09-12T16:16:23.784 INFO:teuthology.orchestra.run.smithi204.stdout:1100 read 0x90bda00 thru 0x90cc651 (0xec52 bytes) 2024-09-12T16:16:23.784 INFO:teuthology.orchestra.run.smithi204.stdout:1101 read 0x6cc8000 thru 0x6cca44f (0x2450 bytes) 2024-09-12T16:16:23.784 INFO:teuthology.orchestra.run.smithi204.stdout:1102 write 0x8c45800 thru 0x8c47506 (0x1d07 bytes) 2024-09-12T16:16:23.803 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:23.803 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:23.811 INFO:teuthology.orchestra.run.smithi204.stdout:1105 write 0xe362800 thru 0xe3689f2 (0x61f3 bytes) 2024-09-12T16:16:23.812 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:16:23.825 INFO:teuthology.orchestra.run.smithi204.stdout:1108 trunc from 0xe368a00 to 0x8fdc800 2024-09-12T16:16:23.856 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:23.855+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:23.864 INFO:teuthology.orchestra.run.smithi204.stdout:1109 trunc from 0x8fdc800 to 0x742bc00 2024-09-12T16:16:23.886 INFO:teuthology.orchestra.run.smithi204.stdout:1110 read 0x5977c00 thru 0x59823bf (0xa7c0 bytes) 2024-09-12T16:16:23.886 INFO:teuthology.orchestra.run.smithi204.stdout:1111 write 0x1763600 thru 0x1766402 (0x2e03 bytes) 2024-09-12T16:16:23.887 INFO:teuthology.orchestra.run.smithi204.stdout:1112 read 0x69d1c00 thru 0x69e0bb7 (0xefb8 bytes) 2024-09-12T16:16:23.887 INFO:teuthology.orchestra.run.smithi204.stdout:1113 read 0x2cbf800 thru 0x2cc0e66 (0x1667 bytes) 2024-09-12T16:16:23.887 INFO:teuthology.orchestra.run.smithi204.stdout:1115 read 0x6728200 thru 0x672f1dc (0x6fdd bytes) 2024-09-12T16:16:23.892 INFO:teuthology.orchestra.run.smithi204.stdout:1116 trunc from 0x742bc00 to 0x2a86c00 2024-09-12T16:16:23.910 INFO:teuthology.orchestra.run.smithi204.stdout:1117 punch from 0x466800 to 0x469000, (0x2800 bytes) 2024-09-12T16:16:23.910 INFO:teuthology.orchestra.run.smithi204.stdout:1119 read 0xf3e400 thru 0xf47341 (0x8f42 bytes) 2024-09-12T16:16:23.919 INFO:teuthology.orchestra.run.smithi204.stdout:1120 trunc from 0x2a86c00 to 0xa3ec800 2024-09-12T16:16:23.928 INFO:teuthology.orchestra.run.smithi204.stdout:1121 punch from 0x6799600 to 0x679e600, (0x5000 bytes) 2024-09-12T16:16:23.928 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:23.928+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:23.933 INFO:teuthology.orchestra.run.smithi204.stdout:1124 trunc from 0xa3ec800 to 0x6c9b400 2024-09-12T16:16:23.935 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:23.935 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:23.945 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:16:23.945 INFO:teuthology.orchestra.run.smithi204.stdout:1126 punch from 0x24b7a00 to 0x24c3000, (0xb600 bytes) 2024-09-12T16:16:23.957 INFO:teuthology.orchestra.run.smithi204.stdout:1129 trunc from 0x6c9b400 to 0x76d600 2024-09-12T16:16:24.001 INFO:teuthology.orchestra.run.smithi204.stdout:1130 read 0x2bb600 thru 0x2c7cb3 (0xc6b4 bytes) 2024-09-12T16:16:24.012 INFO:teuthology.orchestra.run.smithi204.stdout:1131 trunc from 0x76d600 to 0x87dd400 2024-09-12T16:16:24.026 INFO:teuthology.orchestra.run.smithi204.stdout:1133 punch from 0x7e3aa00 to 0x7e48000, (0xd600 bytes) 2024-09-12T16:16:24.026 INFO:teuthology.orchestra.run.smithi204.stdout:1134 write 0x5715200 thru 0x572441b (0xf21c bytes) 2024-09-12T16:16:24.029 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:24.028+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:24.048 INFO:teuthology.orchestra.run.smithi204.stdout:1135 write 0xa66c000 thru 0xa6717c9 (0x57ca bytes) 2024-09-12T16:16:24.048 INFO:teuthology.orchestra.run.smithi204.stdout:1141 read 0x9e78200 thru 0x9e87118 (0xef19 bytes) 2024-09-12T16:16:24.074 INFO:teuthology.orchestra.run.smithi204.stdout:1142 write 0xedf0200 thru 0xedf6ea9 (0x6caa bytes) 2024-09-12T16:16:24.074 INFO:teuthology.orchestra.run.smithi204.stdout:1145 write 0xe7e9400 thru 0xe7eebeb (0x57ec bytes) 2024-09-12T16:16:24.074 INFO:teuthology.orchestra.run.smithi204.stdout:1151 read 0x902aa00 thru 0x9039b51 (0xf152 bytes) 2024-09-12T16:16:24.074 INFO:teuthology.orchestra.run.smithi204.stdout:1152 write 0x5bb7e00 thru 0x5bc35fa (0xb7fb bytes) 2024-09-12T16:16:24.074 INFO:teuthology.orchestra.run.smithi204.stdout:1154 read 0xc4a5000 thru 0xc4b15be (0xc5bf bytes) 2024-09-12T16:16:24.074 INFO:teuthology.orchestra.run.smithi204.stdout:1156 punch from 0x3328600 to 0x332da00, (0x5400 bytes) 2024-09-12T16:16:24.075 INFO:teuthology.orchestra.run.smithi204.stdout:1158 read 0x6e7d000 thru 0x6e85103 (0x8104 bytes) 2024-09-12T16:16:24.075 INFO:teuthology.orchestra.run.smithi204.stdout:1159 read 0xbade200 thru 0xbae82ea (0xa0eb bytes) 2024-09-12T16:16:24.075 INFO:teuthology.orchestra.run.smithi204.stdout:1160 read 0x2c92e00 thru 0x2c9476b (0x196c bytes) 2024-09-12T16:16:24.075 INFO:teuthology.orchestra.run.smithi204.stdout:1162 read 0x42c6000 thru 0x42cea84 (0x8a85 bytes) 2024-09-12T16:16:24.075 INFO:teuthology.orchestra.run.smithi204.stdout:1164 punch from 0xd25a600 to 0xd25d200, (0x2c00 bytes) 2024-09-12T16:16:24.075 INFO:teuthology.orchestra.run.smithi204.stdout:1165 write 0x2a73600 thru 0x2a77103 (0x3b04 bytes) 2024-09-12T16:16:24.075 INFO:teuthology.orchestra.run.smithi204.stdout:1167 write 0x7a45200 thru 0x7a54b55 (0xf956 bytes) 2024-09-12T16:16:24.081 INFO:teuthology.orchestra.run.smithi204.stdout:1169 trunc from 0xedf7000 to 0x981a600 2024-09-12T16:16:24.109 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:24.109 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:24.119 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:16:24.124 INFO:teuthology.orchestra.run.smithi204.stdout:1170 punch from 0x4ad200 to 0x4b7e00, (0xac00 bytes) 2024-09-12T16:16:24.130 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:24.129+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:24.142 INFO:teuthology.orchestra.run.smithi204.stdout:1174 write 0xa6c8800 thru 0xa6c9dca (0x15cb bytes) 2024-09-12T16:16:24.142 INFO:teuthology.orchestra.run.smithi204.stdout:1182 read 0x7d200 thru 0x7fe24 (0x2c25 bytes) 2024-09-12T16:16:24.142 INFO:teuthology.orchestra.run.smithi204.stdout:1185 write 0xa3c1c00 thru 0xa3c710f (0x5510 bytes) 2024-09-12T16:16:24.142 INFO:teuthology.orchestra.run.smithi204.stdout:1186 read 0x45ba000 thru 0x45c1390 (0x7391 bytes) 2024-09-12T16:16:24.142 INFO:teuthology.orchestra.run.smithi204.stdout:1188 write 0x93c1800 thru 0x93c6896 (0x5097 bytes) 2024-09-12T16:16:24.142 INFO:teuthology.orchestra.run.smithi204.stdout:1189 punch from 0x9fb2e00 to 0x9fb8a00, (0x5c00 bytes) 2024-09-12T16:16:24.153 INFO:teuthology.orchestra.run.smithi204.stdout:1190 trunc from 0xa6c9e00 to 0x15fdc00 2024-09-12T16:16:24.198 INFO:teuthology.orchestra.run.smithi204.stdout:1191 trunc from 0x15fdc00 to 0x23acc00 2024-09-12T16:16:24.214 INFO:teuthology.orchestra.run.smithi204.stdout:1192 read 0x1dccc00 thru 0x1dcf13c (0x253d bytes) 2024-09-12T16:16:24.221 INFO:teuthology.orchestra.run.smithi204.stdout:1193 write 0xbad600 thru 0xbb140a (0x3e0b bytes) 2024-09-12T16:16:24.230 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:24.229+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:24.243 INFO:teuthology.orchestra.run.smithi204.stdout:1194 write 0x948f800 thru 0x949e264 (0xea65 bytes) 2024-09-12T16:16:24.270 INFO:teuthology.orchestra.run.smithi204.stdout:1198 write 0xbcd2600 thru 0xbcd716c (0x4b6d bytes) 2024-09-12T16:16:24.270 INFO:teuthology.orchestra.run.smithi204.stdout:1199 write 0x2a0000 thru 0x2a24cd (0x24ce bytes) 2024-09-12T16:16:24.270 INFO:teuthology.orchestra.run.smithi204.stdout:1201 write 0x1f20200 thru 0x1f20d0c (0xb0d bytes) 2024-09-12T16:16:24.271 INFO:teuthology.orchestra.run.smithi204.stdout:1206 read 0x28b1800 thru 0x28b5f9a (0x479b bytes) 2024-09-12T16:16:24.271 INFO:teuthology.orchestra.run.smithi204.stdout:1207 write 0x4df5200 thru 0x4e0273e (0xd53f bytes) 2024-09-12T16:16:24.271 INFO:teuthology.orchestra.run.smithi204.stdout:1208 punch from 0x9a41000 to 0x9a43000, (0x2000 bytes) 2024-09-12T16:16:24.275 INFO:teuthology.orchestra.run.smithi204.stdout:1210 trunc from 0xbcd7200 to 0xcd80e00 2024-09-12T16:16:24.282 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:24.282 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:24.292 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:16:24.315 INFO:teuthology.orchestra.run.smithi204.stdout:1213 write 0xd18ac00 thru 0xd198401 (0xd802 bytes) 2024-09-12T16:16:24.320 INFO:teuthology.orchestra.run.smithi204.stdout:1215 read 0x348d000 thru 0x34961c4 (0x91c5 bytes) 2024-09-12T16:16:24.320 INFO:teuthology.orchestra.run.smithi204.stdout:1217 write 0x92c9600 thru 0x92d82a6 (0xeca7 bytes) 2024-09-12T16:16:24.328 INFO:teuthology.orchestra.run.smithi204.stdout:1222 trunc from 0xd198600 to 0x6f59000 2024-09-12T16:16:24.333 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:24.332+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:24.360 INFO:teuthology.orchestra.run.smithi204.stdout:1223 read 0xffa400 thru 0xfffc96 (0x5897 bytes) 2024-09-12T16:16:24.361 INFO:teuthology.orchestra.run.smithi204.stdout:1224 punch from 0x2880000 to 0x2883c00, (0x3c00 bytes) 2024-09-12T16:16:24.380 INFO:teuthology.orchestra.run.smithi204.stdout:1227 write 0x81d1c00 thru 0x81d2d84 (0x1185 bytes) 2024-09-12T16:16:24.380 INFO:teuthology.orchestra.run.smithi204.stdout:1229 read 0x6132e00 thru 0x61401f3 (0xd3f4 bytes) 2024-09-12T16:16:24.381 INFO:teuthology.orchestra.run.smithi204.stdout:1232 read 0xb60000 thru 0xb68c12 (0x8c13 bytes) 2024-09-12T16:16:24.403 INFO:teuthology.orchestra.run.smithi204.stdout:1233 write 0xa906800 thru 0xa90a296 (0x3a97 bytes) 2024-09-12T16:16:24.403 INFO:teuthology.orchestra.run.smithi204.stdout:1236 write 0xa641400 thru 0xa64f8e5 (0xe4e6 bytes) 2024-09-12T16:16:24.404 INFO:teuthology.orchestra.run.smithi204.stdout:1237 read 0x777cc00 thru 0x7788b32 (0xbf33 bytes) 2024-09-12T16:16:24.404 INFO:teuthology.orchestra.run.smithi204.stdout:1238 read 0x4de9a00 thru 0x4df9679 (0xfc7a bytes) 2024-09-12T16:16:24.404 INFO:teuthology.orchestra.run.smithi204.stdout:1240 write 0x2593a00 thru 0x259c730 (0x8d31 bytes) 2024-09-12T16:16:24.404 INFO:teuthology.orchestra.run.smithi204.stdout:1241 punch from 0x88a4a00 to 0x88aae00, (0x6400 bytes) 2024-09-12T16:16:24.405 INFO:teuthology.orchestra.run.smithi204.stdout:1243 write 0x4345e00 thru 0x434ed71 (0x8f72 bytes) 2024-09-12T16:16:24.405 INFO:teuthology.orchestra.run.smithi204.stdout:1245 read 0x1056400 thru 0x105f999 (0x959a bytes) 2024-09-12T16:16:24.405 INFO:teuthology.orchestra.run.smithi204.stdout:1246 read 0xa695e00 thru 0xa6a4ff0 (0xf1f1 bytes) 2024-09-12T16:16:24.406 INFO:teuthology.orchestra.run.smithi204.stdout:1247 read 0x217c600 thru 0x21815bc (0x4fbd bytes) 2024-09-12T16:16:24.406 INFO:teuthology.orchestra.run.smithi204.stdout:1248 write 0x5a6b000 thru 0x5a76a1a (0xba1b bytes) 2024-09-12T16:16:24.406 INFO:teuthology.orchestra.run.smithi204.stdout:1252 punch from 0x3513000 to 0x351ce00, (0x9e00 bytes) 2024-09-12T16:16:24.407 INFO:teuthology.orchestra.run.smithi204.stdout:1255 punch from 0x444e800 to 0x444fc00, (0x1400 bytes) 2024-09-12T16:16:24.407 INFO:teuthology.orchestra.run.smithi204.stdout:1256 read 0x3918a00 thru 0x391b43c (0x2a3d bytes) 2024-09-12T16:16:24.407 INFO:teuthology.orchestra.run.smithi204.stdout:1257 read 0x4cc0800 thru 0x4ccbc14 (0xb415 bytes) 2024-09-12T16:16:24.407 INFO:teuthology.orchestra.run.smithi204.stdout:1258 write 0x52f1000 thru 0x52f19d7 (0x9d8 bytes) 2024-09-12T16:16:24.407 INFO:teuthology.orchestra.run.smithi204.stdout:1260 read 0x9578400 thru 0x9579aee (0x16ef bytes) 2024-09-12T16:16:24.407 INFO:teuthology.orchestra.run.smithi204.stdout:1262 read 0x596fc00 thru 0x597f3d2 (0xf7d3 bytes) 2024-09-12T16:16:24.408 INFO:teuthology.orchestra.run.smithi204.stdout:1263 trunc from 0xa90a400 to 0x906d200 2024-09-12T16:16:24.431 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:24.431+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:24.453 INFO:teuthology.orchestra.run.smithi204.stdout:1264 read 0x4c36a00 thru 0x4c3ffd6 (0x95d7 bytes) 2024-09-12T16:16:24.455 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:24.455 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:24.458 INFO:teuthology.orchestra.run.smithi204.stdout:1265 read 0x3f35000 thru 0x3f3e6ab (0x96ac bytes) 2024-09-12T16:16:24.458 INFO:teuthology.orchestra.run.smithi204.stdout:1267 punch from 0x857ac00 to 0x8586c00, (0xc000 bytes) 2024-09-12T16:16:24.459 INFO:teuthology.orchestra.run.smithi204.stdout:1269 write 0x3232600 thru 0x32353ac (0x2dad bytes) 2024-09-12T16:16:24.465 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:16:24.465 INFO:teuthology.orchestra.run.smithi204.stdout:1273 trunc from 0x906d200 to 0xd976400 2024-09-12T16:16:24.477 INFO:teuthology.orchestra.run.smithi204.stdout:1274 punch from 0xc57ac00 to 0xc57c000, (0x1400 bytes) 2024-09-12T16:16:24.485 INFO:teuthology.orchestra.run.smithi204.stdout:1276 write 0x4f48e00 thru 0x4f547fa (0xb9fb bytes) 2024-09-12T16:16:24.485 INFO:teuthology.orchestra.run.smithi204.stdout:1278 read 0xb97f800 thru 0xb98a917 (0xb118 bytes) 2024-09-12T16:16:24.485 INFO:teuthology.orchestra.run.smithi204.stdout:1283 punch from 0x5db6800 to 0x5dbc800, (0x6000 bytes) 2024-09-12T16:16:24.500 INFO:teuthology.orchestra.run.smithi204.stdout:1284 trunc from 0xd976400 to 0xe7c400 2024-09-12T16:16:24.549 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:24.548+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:24.612 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:24.612 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:24.620 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:16:24.662 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:24.661+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:24.733 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:24.733+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:24.753 INFO:teuthology.orchestra.run.smithi204.stdout:1285 trunc from 0xe7c400 to 0x2c40200 2024-09-12T16:16:24.772 INFO:teuthology.orchestra.run.smithi204.stdout:1287 read 0x105e00 thru 0x108196 (0x2397 bytes) 2024-09-12T16:16:24.782 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:24.782 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:24.783 INFO:teuthology.orchestra.run.smithi204.stdout:1290 trunc from 0x2c40200 to 0xc816a00 2024-09-12T16:16:24.793 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:16:24.801 INFO:teuthology.orchestra.run.smithi204.stdout:1291 write 0x5d92800 thru 0x5d99c19 (0x741a bytes) 2024-09-12T16:16:24.801 INFO:teuthology.orchestra.run.smithi204.stdout:1295 read 0x1193800 thru 0x119c61f (0x8e20 bytes) 2024-09-12T16:16:24.801 INFO:teuthology.orchestra.run.smithi204.stdout:1298 write 0x94e4800 thru 0x94ec0c6 (0x78c7 bytes) 2024-09-12T16:16:24.801 INFO:teuthology.orchestra.run.smithi204.stdout:1299 read 0x84f9400 thru 0x8507e68 (0xea69 bytes) 2024-09-12T16:16:24.801 INFO:teuthology.orchestra.run.smithi204.stdout:1300 read 0x60f3400 thru 0x60f93ac (0x5fad bytes) 2024-09-12T16:16:24.801 INFO:teuthology.orchestra.run.smithi204.stdout:1302 punch from 0x77a1a00 to 0x77a4a00, (0x3000 bytes) 2024-09-12T16:16:24.801 INFO:teuthology.orchestra.run.smithi204.stdout:1303 punch from 0x93ba400 to 0x93c6200, (0xbe00 bytes) 2024-09-12T16:16:24.803 INFO:teuthology.orchestra.run.smithi204.stdout:1304 trunc from 0xc816a00 to 0xe891200 2024-09-12T16:16:24.826 INFO:teuthology.orchestra.run.smithi204.stdout:1308 read 0x7e8d000 thru 0x7e9a4bb (0xd4bc bytes) 2024-09-12T16:16:24.827 INFO:teuthology.orchestra.run.smithi204.stdout:1310 read 0xcb59c00 thru 0xcb60c6b (0x706c bytes) 2024-09-12T16:16:24.827 INFO:teuthology.orchestra.run.smithi204.stdout:1311 write 0x3f42c00 thru 0x3f4bc92 (0x9093 bytes) 2024-09-12T16:16:24.827 INFO:teuthology.orchestra.run.smithi204.stdout:1312 punch from 0xa71c00 to 0xa7bc00, (0xa000 bytes) 2024-09-12T16:16:24.828 INFO:teuthology.orchestra.run.smithi204.stdout:1313 write 0xb031600 thru 0xb036dd6 (0x57d7 bytes) 2024-09-12T16:16:24.828 INFO:teuthology.orchestra.run.smithi204.stdout:1314 write 0x1a2800 thru 0x1a8318 (0x5b19 bytes) 2024-09-12T16:16:24.828 INFO:teuthology.orchestra.run.smithi204.stdout:1316 write 0x9547400 thru 0x95538fb (0xc4fc bytes) 2024-09-12T16:16:24.831 INFO:teuthology.orchestra.run.smithi204.stdout:1318 trunc from 0xe891200 to 0xb846000 2024-09-12T16:16:24.834 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:24.833+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:24.935 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:24.935+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:24.944 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:24.944 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:24.953 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:16:25.036 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:25.035+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:25.060 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:25.060 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:25.069 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:16:25.119 INFO:teuthology.orchestra.run.smithi204.stdout:1319 write 0xb952000 thru 0xb95cf17 (0xaf18 bytes) 2024-09-12T16:16:25.130 INFO:teuthology.orchestra.run.smithi204.stdout:1321 trunc from 0xb95d000 to 0x84ce400 2024-09-12T16:16:25.137 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:25.136+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:25.156 INFO:teuthology.orchestra.run.smithi204.stdout:1323 write 0x1d77800 thru 0x1d781aa (0x9ab bytes) 2024-09-12T16:16:25.157 INFO:teuthology.orchestra.run.smithi204.stdout:1326 punch from 0x32ccc00 to 0x32d6800, (0x9c00 bytes) 2024-09-12T16:16:25.158 INFO:teuthology.orchestra.run.smithi204.stdout:1327 read 0x380ce00 thru 0x381c6cb (0xf8cc bytes) 2024-09-12T16:16:25.158 INFO:teuthology.orchestra.run.smithi204.stdout:1328 read 0x419d800 thru 0x41a521a (0x7a1b bytes) 2024-09-12T16:16:25.158 INFO:teuthology.orchestra.run.smithi204.stdout:1329 punch from 0x2ef5e00 to 0x2f02c00, (0xce00 bytes) 2024-09-12T16:16:25.159 INFO:teuthology.orchestra.run.smithi204.stdout:1331 write 0x5160600 thru 0x516c3f8 (0xbdf9 bytes) 2024-09-12T16:16:25.159 INFO:teuthology.orchestra.run.smithi204.stdout:1335 punch from 0x591fa00 to 0x592de00, (0xe400 bytes) 2024-09-12T16:16:25.159 INFO:teuthology.orchestra.run.smithi204.stdout:1336 punch from 0x382c200 to 0x382e800, (0x2600 bytes) 2024-09-12T16:16:25.193 INFO:teuthology.orchestra.run.smithi204.stdout:1341 write 0xaeb8a00 thru 0xaec4828 (0xbe29 bytes) 2024-09-12T16:16:25.194 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:25.194 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:25.195 INFO:teuthology.orchestra.run.smithi204.stdout:1342 write 0x587c200 thru 0x58882b1 (0xc0b2 bytes) 2024-09-12T16:16:25.195 INFO:teuthology.orchestra.run.smithi204.stdout:1344 read 0x1fa0000 thru 0x1fa17f2 (0x17f3 bytes) 2024-09-12T16:16:25.195 INFO:teuthology.orchestra.run.smithi204.stdout:1347 write 0x215ae00 thru 0x2161578 (0x6779 bytes) 2024-09-12T16:16:25.195 INFO:teuthology.orchestra.run.smithi204.stdout:1349 read 0x388b800 thru 0x3893c38 (0x8439 bytes) 2024-09-12T16:16:25.203 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:16:25.204 INFO:teuthology.orchestra.run.smithi204.stdout:1351 trunc from 0xaec4a00 to 0x4ebf200 2024-09-12T16:16:25.243 INFO:teuthology.orchestra.run.smithi204.stdout:1353 trunc from 0x4ebf200 to 0x6233800 2024-09-12T16:16:25.248 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:25.248+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:25.256 INFO:teuthology.orchestra.run.smithi204.stdout:1355 punch from 0x72b800 to 0x736400, (0xac00 bytes) 2024-09-12T16:16:25.264 INFO:teuthology.orchestra.run.smithi204.stdout:1356 punch from 0x6d7000 to 0x6dfa00, (0x8a00 bytes) 2024-09-12T16:16:25.264 INFO:teuthology.orchestra.run.smithi204.stdout:1359 read 0x283600 thru 0x28d566 (0x9f67 bytes) 2024-09-12T16:16:25.284 INFO:teuthology.orchestra.run.smithi204.stdout:1360 write 0xe91f400 thru 0xe92a3bc (0xafbd bytes) 2024-09-12T16:16:25.291 INFO:teuthology.orchestra.run.smithi204.stdout:1361 read 0x79e0a00 thru 0x79f03b4 (0xf9b5 bytes) 2024-09-12T16:16:25.291 INFO:teuthology.orchestra.run.smithi204.stdout:1363 read 0x5158c00 thru 0x516189e (0x8c9f bytes) 2024-09-12T16:16:25.291 INFO:teuthology.orchestra.run.smithi204.stdout:1364 read 0x2c27600 thru 0x2c332cd (0xbcce bytes) 2024-09-12T16:16:25.291 INFO:teuthology.orchestra.run.smithi204.stdout:1365 read 0xd331e00 thru 0xd3345d6 (0x27d7 bytes) 2024-09-12T16:16:25.292 INFO:teuthology.orchestra.run.smithi204.stdout:1366 write 0xb99f600 thru 0xb9a9646 (0xa047 bytes) 2024-09-12T16:16:25.292 INFO:teuthology.orchestra.run.smithi204.stdout:1368 punch from 0x25ee400 to 0x25efc00, (0x1800 bytes) 2024-09-12T16:16:25.292 INFO:teuthology.orchestra.run.smithi204.stdout:1369 write 0xd88bc00 thru 0xd88d08d (0x148e bytes) 2024-09-12T16:16:25.292 INFO:teuthology.orchestra.run.smithi204.stdout:1370 write 0xab45e00 thru 0xab48778 (0x2979 bytes) 2024-09-12T16:16:25.292 INFO:teuthology.orchestra.run.smithi204.stdout:1372 read 0xd938a00 thru 0xd946882 (0xde83 bytes) 2024-09-12T16:16:25.296 INFO:teuthology.orchestra.run.smithi204.stdout:1378 trunc from 0xe92a400 to 0xb970800 2024-09-12T16:16:25.328 INFO:teuthology.orchestra.run.smithi204.stdout:1380 write 0xb242800 thru 0xb250d0a (0xe50b bytes) 2024-09-12T16:16:25.330 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:25.330 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:25.338 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:25.338+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:25.341 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:16:25.342 INFO:teuthology.orchestra.run.smithi204.stdout:1381 write 0xbceec00 thru 0xbcfcff5 (0xe3f6 bytes) 2024-09-12T16:16:25.342 INFO:teuthology.orchestra.run.smithi204.stdout:1383 read 0x2bf5400 thru 0x2bfee47 (0x9a48 bytes) 2024-09-12T16:16:25.342 INFO:teuthology.orchestra.run.smithi204.stdout:1384 write 0x5c80a00 thru 0x5c8b8d5 (0xaed6 bytes) 2024-09-12T16:16:25.343 INFO:teuthology.orchestra.run.smithi204.stdout:1386 trunc from 0xbcfd000 to 0xb46a200 2024-09-12T16:16:25.383 INFO:teuthology.orchestra.run.smithi204.stdout:1388 write 0xc341200 thru 0xc347f21 (0x6d22 bytes) 2024-09-12T16:16:25.383 INFO:teuthology.orchestra.run.smithi204.stdout:1391 punch from 0x3827800 to 0x3836e00, (0xf600 bytes) 2024-09-12T16:16:25.384 INFO:teuthology.orchestra.run.smithi204.stdout:1393 write 0x5eb8a00 thru 0x5ec567e (0xcc7f bytes) 2024-09-12T16:16:25.384 INFO:teuthology.orchestra.run.smithi204.stdout:1397 write 0xab7c800 thru 0xab8be54 (0xf655 bytes) 2024-09-12T16:16:25.385 INFO:teuthology.orchestra.run.smithi204.stdout:1399 read 0x6f88c00 thru 0x6f95618 (0xca19 bytes) 2024-09-12T16:16:25.385 INFO:teuthology.orchestra.run.smithi204.stdout:1400 write 0x2bafa00 thru 0x2bbc0a7 (0xc6a8 bytes) 2024-09-12T16:16:25.385 INFO:teuthology.orchestra.run.smithi204.stdout:1403 read 0xa52c800 thru 0xa539314 (0xcb15 bytes) 2024-09-12T16:16:25.385 INFO:teuthology.orchestra.run.smithi204.stdout:1406 write 0x34fa00 thru 0x359f5e (0xa55f bytes) 2024-09-12T16:16:25.386 INFO:teuthology.orchestra.run.smithi204.stdout:1407 write 0x1393e00 thru 0x1395dd5 (0x1fd6 bytes) 2024-09-12T16:16:25.386 INFO:teuthology.orchestra.run.smithi204.stdout:1408 write 0xbf8a400 thru 0xbf971b2 (0xcdb3 bytes) 2024-09-12T16:16:25.386 INFO:teuthology.orchestra.run.smithi204.stdout:1412 write 0x2476a00 thru 0x247f6d5 (0x8cd6 bytes) 2024-09-12T16:16:25.388 INFO:teuthology.orchestra.run.smithi204.stdout:1416 trunc from 0xc348000 to 0xd7c1000 2024-09-12T16:16:25.426 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T16:16:25.427 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T16:16:25.440 INFO:teuthology.orchestra.run.smithi204.stdout:1417 write 0xdba1200 thru 0xdba9ab6 (0x88b7 bytes) 2024-09-12T16:16:25.440 INFO:teuthology.orchestra.run.smithi204.stdout:1421 read 0x209fe00 thru 0x20a8580 (0x8781 bytes) 2024-09-12T16:16:25.440 INFO:teuthology.orchestra.run.smithi204.stdout:1422 trunc from 0xdba9c00 to 0xd2f8000 2024-09-12T16:16:25.462 INFO:teuthology.orchestra.run.smithi204.stdout:1423 write 0xafdda00 thru 0xafec051 (0xe652 bytes) 2024-09-12T16:16:25.468 INFO:teuthology.orchestra.run.smithi204.stdout:1424 trunc from 0xd2f8000 to 0xd9af400 2024-09-12T16:16:25.472 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:25.471+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:25.485 INFO:teuthology.orchestra.run.smithi204.stdout:1425 read 0x70d8e00 thru 0x70e541b (0xc61c bytes) 2024-09-12T16:16:25.486 INFO:teuthology.orchestra.run.smithi204.stdout:1427 write 0x54b1200 thru 0x54bb6e4 (0xa4e5 bytes) 2024-09-12T16:16:25.486 INFO:teuthology.orchestra.run.smithi204.stdout:1432 write 0x1a13800 thru 0x1a21511 (0xdd12 bytes) 2024-09-12T16:16:25.496 INFO:teuthology.orchestra.run.smithi204.stdout:1434 trunc from 0xd9af400 to 0x52fa400 2024-09-12T16:16:25.512 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:25.512 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:25.521 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:16:25.550 INFO:teuthology.orchestra.run.smithi204.stdout:1435 read 0x9dda00 thru 0x9e9350 (0xb951 bytes) 2024-09-12T16:16:25.550 INFO:teuthology.orchestra.run.smithi204.stdout:1437 punch from 0x29bf400 to 0x29bf800, (0x400 bytes) 2024-09-12T16:16:25.551 INFO:teuthology.orchestra.run.smithi204.stdout:1440 read 0x1b51a00 thru 0x1b5cea4 (0xb4a5 bytes) 2024-09-12T16:16:25.551 INFO:teuthology.orchestra.run.smithi204.stdout:1441 punch from 0xaf4e00 to 0xafce00, (0x8000 bytes) 2024-09-12T16:16:25.551 INFO:teuthology.orchestra.run.smithi204.stdout:1443 read 0x361a000 thru 0x36203bd (0x63be bytes) 2024-09-12T16:16:25.552 INFO:teuthology.orchestra.run.smithi204.stdout:1444 read 0xa19200 thru 0xa28681 (0xf482 bytes) 2024-09-12T16:16:25.554 INFO:teuthology.orchestra.run.smithi204.stdout:1445 punch from 0x1d88400 to 0x1d97800, (0xf400 bytes) 2024-09-12T16:16:25.564 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:25.564+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:25.567 INFO:teuthology.orchestra.run.smithi204.stdout:1446 write 0x67c4000 thru 0x67ca175 (0x6176 bytes) 2024-09-12T16:16:25.576 INFO:teuthology.orchestra.run.smithi204.stdout:1447 trunc from 0x67ca200 to 0x96e400 2024-09-12T16:16:25.579 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:16:25.579 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:16:25.609 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:16:25.609 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:16:25.639 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:25.639 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:25.641 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:16:25.641 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:16:25.641 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:25.640+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:25.647 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:16:25.661 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:16:25.661 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:16:25.675 INFO:teuthology.orchestra.run.smithi204.stdout:1448 punch from 0x49a000 to 0x49b000, (0x1000 bytes) 2024-09-12T16:16:25.680 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:16:25.680 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:16:25.680 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-12T16:16:25.683 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T16:16:25.684 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T16:16:25.708 INFO:teuthology.orchestra.run.smithi204.stdout:1449 write 0xd71d200 thru 0xd72ced0 (0xfcd1 bytes) 2024-09-12T16:16:25.708 INFO:teuthology.orchestra.run.smithi204.stdout:1451 read 0xd29d600 thru 0xd2a9566 (0xbf67 bytes) 2024-09-12T16:16:25.709 INFO:teuthology.orchestra.run.smithi204.stdout:1452 write 0x98c9200 thru 0x98d2a41 (0x9842 bytes) 2024-09-12T16:16:25.709 INFO:teuthology.orchestra.run.smithi204.stdout:1454 write 0x8ac0400 thru 0x8ac38d7 (0x34d8 bytes) 2024-09-12T16:16:25.709 INFO:teuthology.orchestra.run.smithi204.stdout:1455 read 0x39b9200 thru 0x39c8063 (0xee64 bytes) 2024-09-12T16:16:25.709 INFO:teuthology.orchestra.run.smithi204.stdout:1459 trunc from 0xd72d000 to 0xd6d3600 2024-09-12T16:16:25.739 INFO:teuthology.orchestra.run.smithi204.stdout:1462 punch from 0x568cc00 to 0x568ee00, (0x2200 bytes) 2024-09-12T16:16:25.740 INFO:teuthology.orchestra.run.smithi204.stdout:1463 read 0x773c200 thru 0x774374f (0x7550 bytes) 2024-09-12T16:16:25.740 INFO:teuthology.orchestra.run.smithi204.stdout:1464 write 0x7e48000 thru 0x7e4b5eb (0x35ec bytes) 2024-09-12T16:16:25.741 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:25.741+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:25.754 INFO:teuthology.orchestra.run.smithi204.stdout:1466 trunc from 0xd6d3600 to 0x1d1f400 2024-09-12T16:16:25.795 INFO:teuthology.orchestra.run.smithi204.stdout:1467 write 0x34eac00 thru 0x34f2927 (0x7d28 bytes) 2024-09-12T16:16:25.795 INFO:teuthology.orchestra.run.smithi204.stdout:1468 read 0xf9200 thru 0xfcea5 (0x3ca6 bytes) 2024-09-12T16:16:25.796 INFO:teuthology.orchestra.run.smithi204.stdout:1470 read 0x9b5800 thru 0x9c2748 (0xcf49 bytes) 2024-09-12T16:16:25.796 INFO:teuthology.orchestra.run.smithi204.stdout:1472 punch from 0x151ca00 to 0x1523c00, (0x7200 bytes) 2024-09-12T16:16:25.797 INFO:teuthology.orchestra.run.smithi204.stdout:1473 read 0x1456800 thru 0x145934a (0x2b4b bytes) 2024-09-12T16:16:25.797 INFO:teuthology.orchestra.run.smithi204.stdout:1478 read 0x2437400 thru 0x243b3b3 (0x3fb4 bytes) 2024-09-12T16:16:25.797 INFO:teuthology.orchestra.run.smithi204.stdout:1479 read 0x1c9de00 thru 0x1ca4c65 (0x6e66 bytes) 2024-09-12T16:16:25.797 INFO:teuthology.orchestra.run.smithi204.stdout:1481 punch from 0x18e3e00 to 0x18ea600, (0x6800 bytes) 2024-09-12T16:16:25.800 INFO:teuthology.orchestra.run.smithi204.stdout:1483 trunc from 0x34f2a00 to 0x617e000 2024-09-12T16:16:25.812 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:25.812 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:16:25.812 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:16:25.813 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:16:25.813 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:25.822 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:16:25.824 INFO:teuthology.orchestra.run.smithi204.stdout:1484 trunc from 0x617e000 to 0x12ff400 2024-09-12T16:16:25.842 INFO:teuthology.orchestra.run.smithi204.stdout:1489 read 0xb78000 thru 0xb7e5d1 (0x65d2 bytes) 2024-09-12T16:16:25.842 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:25.841+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:25.849 INFO:teuthology.orchestra.run.smithi204.stdout:1490 read 0x986e00 thru 0x991f96 (0xb197 bytes) 2024-09-12T16:16:25.850 INFO:teuthology.orchestra.run.smithi204.stdout:1491 trunc from 0x12ff400 to 0x1ebf200 2024-09-12T16:16:25.859 INFO:teuthology.orchestra.run.smithi204.stdout:1492 read 0x306c00 thru 0x309f0c (0x330d bytes) 2024-09-12T16:16:25.875 INFO:teuthology.orchestra.run.smithi204.stdout:1493 write 0x722d200 thru 0x7237b16 (0xa917 bytes) 2024-09-12T16:16:25.877 INFO:teuthology.orchestra.run.smithi204.stdout:1495 read 0x1228800 thru 0x122ea0c (0x620d bytes) 2024-09-12T16:16:25.877 INFO:teuthology.orchestra.run.smithi204.stdout:1497 punch from 0x4349200 to 0x4349a00, (0x800 bytes) 2024-09-12T16:16:25.877 INFO:teuthology.orchestra.run.smithi204.stdout:1498 punch from 0x191400 to 0x19f800, (0xe400 bytes) 2024-09-12T16:16:25.894 INFO:teuthology.orchestra.run.smithi204.stdout:1499 write 0xc08f800 thru 0xc091b22 (0x2323 bytes) 2024-09-12T16:16:25.902 INFO:teuthology.orchestra.run.smithi204.stdout:1500 write 0x46ada00 thru 0x46afd25 (0x2326 bytes) 2024-09-12T16:16:25.902 INFO:teuthology.orchestra.run.smithi204.stdout:1503 write 0x3ec0600 thru 0x3ec8e07 (0x8808 bytes) 2024-09-12T16:16:25.902 INFO:teuthology.orchestra.run.smithi204.stdout:1504 write 0x3200a00 thru 0x32027ac (0x1dad bytes) 2024-09-12T16:16:25.902 INFO:teuthology.orchestra.run.smithi204.stdout:1506 write 0x4650000 thru 0x46556f8 (0x56f9 bytes) 2024-09-12T16:16:25.902 INFO:teuthology.orchestra.run.smithi204.stdout:1507 write 0x84ce400 thru 0x84d4746 (0x6347 bytes) 2024-09-12T16:16:25.902 INFO:teuthology.orchestra.run.smithi204.stdout:1509 read 0x212fc00 thru 0x21354e8 (0x58e9 bytes) 2024-09-12T16:16:25.902 INFO:teuthology.orchestra.run.smithi204.stdout:1510 read 0x2e7ce00 thru 0x2e83960 (0x6b61 bytes) 2024-09-12T16:16:25.902 INFO:teuthology.orchestra.run.smithi204.stdout:1511 clone 8 order 22 su 1048576 sc 12 2024-09-12T16:16:25.943 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:25.942+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:25.947 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:25.947 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:16:25.947 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:16:25.948 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:16:25.948 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.948 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:20620 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 1482752~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:25.948 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.775875+0000", 2024-09-12T16:16:25.948 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.170117512, 2024-09-12T16:16:25.948 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.051720878999999997, 2024-09-12T16:16:25.948 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:25.948 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:25.948 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:25.948 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:25.948 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:25.948 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:25.948 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 20620 2024-09-12T16:16:25.949 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.949 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:25.949 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.949 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:25.949 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775875+0000", 2024-09-12T16:16:25.949 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:25.949 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.949 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.949 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:25.949 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775875+0000", 2024-09-12T16:16:25.949 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:25.949 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.949 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.949 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:25.950 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775875+0000", 2024-09-12T16:16:25.950 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0599999999999999e-07 2024-09-12T16:16:25.950 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.950 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.950 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:25.950 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775876+0000", 2024-09-12T16:16:25.950 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.034e-06 2024-09-12T16:16:25.950 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.950 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.950 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:25.950 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775879+0000", 2024-09-12T16:16:25.950 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9359999999999999e-06 2024-09-12T16:16:25.950 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.950 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.951 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:25.951 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775882+0000", 2024-09-12T16:16:25.951 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5270000000000001e-06 2024-09-12T16:16:25.951 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.951 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.951 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:25.951 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.827445+0000", 2024-09-12T16:16:25.951 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.051563377000000001 2024-09-12T16:16:25.951 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.951 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.951 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:25.951 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.827489+0000", 2024-09-12T16:16:25.951 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4443999999999997e-05 2024-09-12T16:16:25.951 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.952 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.952 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:25.952 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.827596+0000", 2024-09-12T16:16:25.952 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010635499999999999 2024-09-12T16:16:25.952 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:25.952 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:25.952 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:25.952 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.952 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.952 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:20621 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 1486848~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:25.952 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.775885+0000", 2024-09-12T16:16:25.952 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.1701078860000003, 2024-09-12T16:16:25.952 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.051871970000000003, 2024-09-12T16:16:25.952 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:25.953 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:25.953 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:25.953 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:25.953 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:25.953 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:25.953 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 20621 2024-09-12T16:16:25.953 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.953 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:25.953 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.953 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:25.953 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775885+0000", 2024-09-12T16:16:25.953 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:25.953 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.953 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.953 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:25.954 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775885+0000", 2024-09-12T16:16:25.954 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:25.954 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.954 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.954 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:25.954 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775885+0000", 2024-09-12T16:16:25.954 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0100000000000001e-07 2024-09-12T16:16:25.954 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.954 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.954 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:25.954 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775886+0000", 2024-09-12T16:16:25.954 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1069999999999999e-06 2024-09-12T16:16:25.954 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.954 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.955 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:25.955 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775889+0000", 2024-09-12T16:16:25.955 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9380000000000001e-06 2024-09-12T16:16:25.955 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.955 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.955 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:25.955 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775891+0000", 2024-09-12T16:16:25.955 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3319999999999999e-06 2024-09-12T16:16:25.955 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.955 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.955 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:25.955 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.827613+0000", 2024-09-12T16:16:25.955 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.051721637000000001 2024-09-12T16:16:25.955 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.956 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.956 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:25.956 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.827654+0000", 2024-09-12T16:16:25.956 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1233999999999999e-05 2024-09-12T16:16:25.956 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.956 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.956 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:25.956 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.827756+0000", 2024-09-12T16:16:25.956 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102521 2024-09-12T16:16:25.956 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:25.956 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:25.956 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:25.957 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.957 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.957 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:20622 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 1490944~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:25.957 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.775894+0000", 2024-09-12T16:16:25.957 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.1700983669999996, 2024-09-12T16:16:25.957 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052034955000000001, 2024-09-12T16:16:25.957 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:25.957 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:25.957 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:25.957 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:25.957 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:25.957 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:25.957 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 20622 2024-09-12T16:16:25.957 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.957 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:25.958 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.958 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:25.958 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775894+0000", 2024-09-12T16:16:25.958 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:25.958 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.958 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.958 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:25.958 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775894+0000", 2024-09-12T16:16:25.958 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:25.958 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.958 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.958 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:25.958 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775894+0000", 2024-09-12T16:16:25.958 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0599999999999999e-07 2024-09-12T16:16:25.959 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.959 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.959 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:25.959 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775895+0000", 2024-09-12T16:16:25.959 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.105e-06 2024-09-12T16:16:25.959 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.959 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.959 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:25.959 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775898+0000", 2024-09-12T16:16:25.959 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9469999999999999e-06 2024-09-12T16:16:25.959 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.959 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.959 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:25.959 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775901+0000", 2024-09-12T16:16:25.960 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5110000000000002e-06 2024-09-12T16:16:25.960 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.960 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.960 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:25.960 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.827783+0000", 2024-09-12T16:16:25.960 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.051882686999999997 2024-09-12T16:16:25.960 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.960 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.960 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:25.960 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.827825+0000", 2024-09-12T16:16:25.960 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1573999999999999e-05 2024-09-12T16:16:25.960 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.960 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.961 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:25.961 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.827929+0000", 2024-09-12T16:16:25.961 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010392500000000001 2024-09-12T16:16:25.961 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:25.961 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:25.961 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:25.961 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.961 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.961 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:20623 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 1495040~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:25.961 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.775904+0000", 2024-09-12T16:16:25.961 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.1700885789999997, 2024-09-12T16:16:25.961 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052191906000000003, 2024-09-12T16:16:25.961 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:25.961 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:25.961 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:25.962 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:25.962 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:25.962 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:25.962 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 20623 2024-09-12T16:16:25.962 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.962 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:25.962 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.962 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:25.962 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775904+0000", 2024-09-12T16:16:25.962 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:25.962 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.962 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.962 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:25.963 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775904+0000", 2024-09-12T16:16:25.963 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:25.963 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.963 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.963 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:25.963 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775904+0000", 2024-09-12T16:16:25.963 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0900000000000001e-07 2024-09-12T16:16:25.963 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.963 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.963 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:25.963 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775905+0000", 2024-09-12T16:16:25.963 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.083e-06 2024-09-12T16:16:25.963 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.963 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.964 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:25.964 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775908+0000", 2024-09-12T16:16:25.964 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9849999999999998e-06 2024-09-12T16:16:25.964 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.964 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.964 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:25.964 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775912+0000", 2024-09-12T16:16:25.964 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9419999999999997e-06 2024-09-12T16:16:25.964 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.964 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.964 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:25.964 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.827951+0000", 2024-09-12T16:16:25.964 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052038976000000001 2024-09-12T16:16:25.964 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.965 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.965 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:25.965 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.827996+0000", 2024-09-12T16:16:25.965 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5444000000000001e-05 2024-09-12T16:16:25.965 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.965 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.965 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:25.965 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.828096+0000", 2024-09-12T16:16:25.965 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9266999999999997e-05 2024-09-12T16:16:25.965 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:25.965 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:25.965 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:25.965 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.965 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.965 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:20624 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 1499136~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:25.966 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.775916+0000", 2024-09-12T16:16:25.966 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.1700768229999996, 2024-09-12T16:16:25.966 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052356906000000002, 2024-09-12T16:16:25.966 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:25.966 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:25.966 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:25.966 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:25.966 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:25.966 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:25.966 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 20624 2024-09-12T16:16:25.966 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.966 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:25.966 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.966 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:25.967 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775916+0000", 2024-09-12T16:16:25.967 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:25.967 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.967 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.967 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:25.967 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775916+0000", 2024-09-12T16:16:25.967 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:25.967 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.967 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.967 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:25.967 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.781366+0000", 2024-09-12T16:16:25.967 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0054508339999999999 2024-09-12T16:16:25.967 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.968 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.968 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:25.968 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.781372+0000", 2024-09-12T16:16:25.968 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6980000000000003e-06 2024-09-12T16:16:25.968 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.968 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.968 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:25.968 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.781382+0000", 2024-09-12T16:16:25.968 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6490000000000003e-06 2024-09-12T16:16:25.968 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.968 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.968 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:25.968 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.781386+0000", 2024-09-12T16:16:25.969 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4039999999999997e-06 2024-09-12T16:16:25.969 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.969 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.969 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:25.969 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.828122+0000", 2024-09-12T16:16:25.969 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.046736236 2024-09-12T16:16:25.969 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.969 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.969 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:25.969 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.828164+0000", 2024-09-12T16:16:25.969 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1567999999999999e-05 2024-09-12T16:16:25.969 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.969 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.970 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:25.970 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.828272+0000", 2024-09-12T16:16:25.970 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000108517 2024-09-12T16:16:25.970 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:25.970 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:25.970 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:25.970 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.970 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.970 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:20653 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 1617920~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:25.970 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.781724+0000", 2024-09-12T16:16:25.970 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.16426797, 2024-09-12T16:16:25.970 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.051816203999999998, 2024-09-12T16:16:25.970 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:25.970 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:25.971 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:25.971 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:25.971 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:25.971 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:25.971 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 20653 2024-09-12T16:16:25.971 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.971 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:25.971 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.971 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:25.971 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.781724+0000", 2024-09-12T16:16:25.971 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:25.971 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.971 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.971 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:25.972 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.781724+0000", 2024-09-12T16:16:25.972 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:25.972 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.972 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.972 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:25.972 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.781725+0000", 2024-09-12T16:16:25.972 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0599999999999999e-07 2024-09-12T16:16:25.972 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.972 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.972 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:25.972 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.781726+0000", 2024-09-12T16:16:25.972 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.569999999999999e-07 2024-09-12T16:16:25.972 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.973 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.973 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:25.973 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.781729+0000", 2024-09-12T16:16:25.973 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9289999999999998e-06 2024-09-12T16:16:25.973 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.973 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.973 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:25.973 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.781731+0000", 2024-09-12T16:16:25.973 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3530000000000002e-06 2024-09-12T16:16:25.973 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.973 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.973 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:25.973 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.833393+0000", 2024-09-12T16:16:25.973 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.051662176999999997 2024-09-12T16:16:25.974 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.974 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.974 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:25.974 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.833434+0000", 2024-09-12T16:16:25.974 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1403000000000003e-05 2024-09-12T16:16:25.974 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.974 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.974 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:25.974 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.833541+0000", 2024-09-12T16:16:25.974 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000106179 2024-09-12T16:16:25.974 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:25.974 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:25.974 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:25.974 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.975 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.975 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:20654 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 1622016~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:25.975 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.781737+0000", 2024-09-12T16:16:25.975 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.1642557309999999, 2024-09-12T16:16:25.975 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.05198059, 2024-09-12T16:16:25.975 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:25.975 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:25.975 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:25.975 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:25.975 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:25.975 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:25.976 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 20654 2024-09-12T16:16:25.976 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.976 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:25.977 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.977 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:25.977 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.781737+0000", 2024-09-12T16:16:25.977 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:25.977 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.977 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.977 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:25.977 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.781737+0000", 2024-09-12T16:16:25.977 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:25.977 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.977 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.977 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:25.977 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.787347+0000", 2024-09-12T16:16:25.977 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0056106510000000004 2024-09-12T16:16:25.977 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.978 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.978 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:25.978 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.787350+0000", 2024-09-12T16:16:25.978 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0350000000000002e-06 2024-09-12T16:16:25.978 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.978 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.978 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:25.978 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.787357+0000", 2024-09-12T16:16:25.978 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1920000000000002e-06 2024-09-12T16:16:25.978 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.978 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.978 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:25.978 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.787360+0000", 2024-09-12T16:16:25.978 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8589999999999998e-06 2024-09-12T16:16:25.979 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.979 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.979 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:25.979 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.833566+0000", 2024-09-12T16:16:25.979 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.046205952000000002 2024-09-12T16:16:25.979 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.979 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.979 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:25.979 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.833611+0000", 2024-09-12T16:16:25.979 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5036e-05 2024-09-12T16:16:25.979 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.979 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.979 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:25.980 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.833717+0000", 2024-09-12T16:16:25.980 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000105865 2024-09-12T16:16:25.980 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:25.980 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:25.980 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:25.980 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.980 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.980 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:21541 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 2075648~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:25.980 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.979289+0000", 2024-09-12T16:16:25.980 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.9667031970000002, 2024-09-12T16:16:25.980 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.051802583999999999, 2024-09-12T16:16:25.980 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:25.980 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:25.981 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:25.981 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:25.981 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:25.981 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:25.981 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 21541 2024-09-12T16:16:25.981 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.981 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:25.981 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.981 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:25.981 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979289+0000", 2024-09-12T16:16:25.981 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:25.981 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.981 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.981 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:25.982 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979289+0000", 2024-09-12T16:16:25.982 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:25.982 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.982 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.982 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:25.982 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979290+0000", 2024-09-12T16:16:25.982 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.99e-07 2024-09-12T16:16:25.982 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.982 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.982 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:25.982 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979296+0000", 2024-09-12T16:16:25.982 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2729999999999999e-06 2024-09-12T16:16:25.982 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.982 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.982 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:25.983 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979305+0000", 2024-09-12T16:16:25.983 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0270000000000001e-06 2024-09-12T16:16:25.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.983 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.983 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:25.983 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979311+0000", 2024-09-12T16:16:25.983 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8610000000000003e-06 2024-09-12T16:16:25.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.983 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.983 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:25.983 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.030931+0000", 2024-09-12T16:16:25.983 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.051619736999999999 2024-09-12T16:16:25.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.983 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.983 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:25.984 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.030980+0000", 2024-09-12T16:16:25.984 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9599999999999999e-05 2024-09-12T16:16:25.984 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.984 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.984 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:25.984 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031092+0000", 2024-09-12T16:16:25.984 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000111487 2024-09-12T16:16:25.984 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:25.984 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:25.984 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:25.984 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.984 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.984 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:21542 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 2079744~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:25.984 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.979322+0000", 2024-09-12T16:16:25.985 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.9666706469999999, 2024-09-12T16:16:25.985 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052007360000000002, 2024-09-12T16:16:25.985 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:25.985 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:25.985 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:25.985 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:25.985 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:25.985 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:25.985 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 21542 2024-09-12T16:16:25.985 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.985 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:25.985 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.985 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:25.985 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979322+0000", 2024-09-12T16:16:25.986 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:25.986 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.986 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.986 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:25.986 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979322+0000", 2024-09-12T16:16:25.986 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:25.986 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.986 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.986 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:25.986 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979322+0000", 2024-09-12T16:16:25.986 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1099999999999995e-07 2024-09-12T16:16:25.986 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.986 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.986 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:25.987 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979325+0000", 2024-09-12T16:16:25.987 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1349999999999999e-06 2024-09-12T16:16:25.987 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.987 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.987 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:25.987 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979331+0000", 2024-09-12T16:16:25.987 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7220000000000002e-06 2024-09-12T16:16:25.987 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.987 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.987 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:25.987 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979338+0000", 2024-09-12T16:16:25.987 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5230000000000001e-06 2024-09-12T16:16:25.987 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.987 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.988 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:25.988 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031124+0000", 2024-09-12T16:16:25.988 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.051786302999999999 2024-09-12T16:16:25.988 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.988 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.988 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:25.988 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031166+0000", 2024-09-12T16:16:25.988 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2287999999999999e-05 2024-09-12T16:16:25.988 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.988 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.988 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:25.988 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031329+0000", 2024-09-12T16:16:25.988 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016277800000000001 2024-09-12T16:16:25.988 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:25.989 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:25.989 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:25.989 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.989 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.989 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:21543 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 2083840~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:25.989 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.979347+0000", 2024-09-12T16:16:25.989 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.9666457580000003, 2024-09-12T16:16:25.989 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052189063000000001, 2024-09-12T16:16:25.989 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:25.989 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:25.989 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:25.989 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:25.989 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:25.989 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:25.990 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 21543 2024-09-12T16:16:25.990 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.990 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:25.990 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.990 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:25.990 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979347+0000", 2024-09-12T16:16:25.990 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:25.990 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.990 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.990 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:25.990 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979347+0000", 2024-09-12T16:16:25.990 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:25.990 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.990 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.991 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:25.991 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979347+0000", 2024-09-12T16:16:25.991 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:16:25.991 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.991 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.991 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:25.991 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979349+0000", 2024-09-12T16:16:25.991 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.12e-06 2024-09-12T16:16:25.991 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.991 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.991 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:25.991 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979356+0000", 2024-09-12T16:16:25.991 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6279999999999999e-06 2024-09-12T16:16:25.991 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.991 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.992 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:25.992 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979361+0000", 2024-09-12T16:16:25.992 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8210000000000001e-06 2024-09-12T16:16:25.992 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.992 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.992 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:25.992 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031363+0000", 2024-09-12T16:16:25.992 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052002233000000002 2024-09-12T16:16:25.992 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.992 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.992 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:25.992 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031414+0000", 2024-09-12T16:16:25.992 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1289000000000003e-05 2024-09-12T16:16:25.993 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.993 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.993 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:25.993 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031536+0000", 2024-09-12T16:16:25.993 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000121582 2024-09-12T16:16:25.993 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:25.993 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:25.993 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:25.993 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.993 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.993 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:21544 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 2087936~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:25.993 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.979368+0000", 2024-09-12T16:16:25.993 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.966624779, 2024-09-12T16:16:25.993 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052342535000000003, 2024-09-12T16:16:25.994 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:25.994 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:25.994 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:25.994 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:25.994 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:25.994 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:25.994 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 21544 2024-09-12T16:16:25.994 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.994 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:25.994 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.994 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:25.994 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979368+0000", 2024-09-12T16:16:25.994 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:25.994 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.994 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.995 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:25.995 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979368+0000", 2024-09-12T16:16:25.995 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:25.995 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.995 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.995 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:25.995 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979368+0000", 2024-09-12T16:16:25.995 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9900000000000001e-07 2024-09-12T16:16:25.995 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.995 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.995 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:25.995 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979370+0000", 2024-09-12T16:16:25.995 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9980000000000002e-06 2024-09-12T16:16:25.995 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.996 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.996 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:25.996 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979376+0000", 2024-09-12T16:16:25.996 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1539999999999999e-06 2024-09-12T16:16:25.996 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.996 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.996 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:25.996 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979381+0000", 2024-09-12T16:16:25.996 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4789999999999998e-06 2024-09-12T16:16:25.996 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.996 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.996 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:25.996 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031550+0000", 2024-09-12T16:16:25.996 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052169363000000003 2024-09-12T16:16:25.997 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.997 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.997 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:25.997 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031594+0000", 2024-09-12T16:16:25.997 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3619999999999999e-05 2024-09-12T16:16:25.997 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.997 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.997 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:25.997 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031710+0000", 2024-09-12T16:16:25.997 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000116422 2024-09-12T16:16:25.997 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:25.997 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:25.997 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:25.998 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.998 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.998 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:21545 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 2092032~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:25.998 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.979395+0000", 2024-09-12T16:16:25.998 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.9665972180000004, 2024-09-12T16:16:25.998 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052494740999999998, 2024-09-12T16:16:25.998 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:25.998 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:25.998 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:25.998 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:25.998 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:25.998 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:25.998 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 21545 2024-09-12T16:16:25.998 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.999 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:25.999 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.999 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:25.999 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979395+0000", 2024-09-12T16:16:25.999 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:25.999 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.999 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.999 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:25.999 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979395+0000", 2024-09-12T16:16:25.999 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:25.999 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:25.999 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:25.999 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:25.999 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979396+0000", 2024-09-12T16:16:25.999 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7599999999999997e-07 2024-09-12T16:16:26.000 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.000 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.000 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:26.000 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979398+0000", 2024-09-12T16:16:26.000 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2500000000000001e-06 2024-09-12T16:16:26.000 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.000 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.000 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:26.000 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979405+0000", 2024-09-12T16:16:26.000 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6730000000000003e-06 2024-09-12T16:16:26.000 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.000 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.000 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:26.001 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979410+0000", 2024-09-12T16:16:26.001 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1599999999999997e-06 2024-09-12T16:16:26.001 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.001 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.001 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:26.001 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031738+0000", 2024-09-12T16:16:26.001 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052327775 2024-09-12T16:16:26.001 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.001 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.001 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:26.001 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031782+0000", 2024-09-12T16:16:26.001 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4672999999999997e-05 2024-09-12T16:16:26.001 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.001 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.002 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:26.002 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031890+0000", 2024-09-12T16:16:26.002 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000107734 2024-09-12T16:16:26.002 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:26.002 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:26.002 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:26.002 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.002 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.002 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:21546 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 2096128~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:26.002 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.979416+0000", 2024-09-12T16:16:26.002 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.9665759229999997, 2024-09-12T16:16:26.002 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052634296999999997, 2024-09-12T16:16:26.002 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:26.003 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:26.003 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:26.003 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:26.003 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:26.003 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:26.003 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 21546 2024-09-12T16:16:26.003 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.003 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:26.003 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.003 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:26.003 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979416+0000", 2024-09-12T16:16:26.003 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:26.003 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.003 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.004 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:26.004 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979416+0000", 2024-09-12T16:16:26.004 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:26.004 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.004 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.004 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:26.004 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979417+0000", 2024-09-12T16:16:26.004 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8099999999999998e-07 2024-09-12T16:16:26.004 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.004 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.004 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:26.004 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979419+0000", 2024-09-12T16:16:26.004 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.883e-06 2024-09-12T16:16:26.005 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.005 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.005 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:26.005 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979428+0000", 2024-09-12T16:16:26.005 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5820000000000008e-06 2024-09-12T16:16:26.005 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.005 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.005 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:26.005 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979435+0000", 2024-09-12T16:16:26.005 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2689999999999996e-06 2024-09-12T16:16:26.005 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.005 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.005 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:26.005 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031905+0000", 2024-09-12T16:16:26.005 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052470637000000001 2024-09-12T16:16:26.006 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.006 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.006 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:26.006 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031946+0000", 2024-09-12T16:16:26.006 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0973000000000002e-05 2024-09-12T16:16:26.006 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.006 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.006 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:26.006 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032051+0000", 2024-09-12T16:16:26.006 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000104572 2024-09-12T16:16:26.006 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:26.006 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:26.006 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:26.006 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.007 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.007 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:21549 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 2097152~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:26.007 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.979476+0000", 2024-09-12T16:16:26.007 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.9665162340000002, 2024-09-12T16:16:26.007 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052700314999999998, 2024-09-12T16:16:26.007 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:26.007 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:26.007 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:26.007 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:26.007 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:26.007 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:26.007 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 21549 2024-09-12T16:16:26.007 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.007 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:26.008 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.008 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:26.008 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979476+0000", 2024-09-12T16:16:26.008 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:26.008 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.008 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.008 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:26.008 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979476+0000", 2024-09-12T16:16:26.008 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:26.008 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.008 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.008 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:26.008 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979477+0000", 2024-09-12T16:16:26.009 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.63e-07 2024-09-12T16:16:26.009 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.009 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.009 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:26.009 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979479+0000", 2024-09-12T16:16:26.009 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5799999999999999e-06 2024-09-12T16:16:26.009 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.009 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.009 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:26.009 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979487+0000", 2024-09-12T16:16:26.009 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7200000000000006e-06 2024-09-12T16:16:26.009 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.009 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.009 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:26.009 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979492+0000", 2024-09-12T16:16:26.010 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9479999999999999e-06 2024-09-12T16:16:26.010 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.010 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.010 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:26.010 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032078+0000", 2024-09-12T16:16:26.010 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052585999000000001 2024-09-12T16:16:26.010 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.010 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.010 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:26.010 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032120+0000", 2024-09-12T16:16:26.010 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2367999999999998e-05 2024-09-12T16:16:26.010 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.010 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.011 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:26.011 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032176+0000", 2024-09-12T16:16:26.011 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6236999999999997e-05 2024-09-12T16:16:26.011 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:26.011 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:26.011 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:26.011 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.011 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.011 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:21550 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 2101248~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:26.011 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.979500+0000", 2024-09-12T16:16:26.011 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.9664928740000001, 2024-09-12T16:16:26.011 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052810058, 2024-09-12T16:16:26.011 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:26.012 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:26.012 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:26.012 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:26.012 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:26.012 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:26.012 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 21550 2024-09-12T16:16:26.012 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.012 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:26.012 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.012 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:26.012 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979500+0000", 2024-09-12T16:16:26.012 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:26.012 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.012 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.013 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:26.013 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979500+0000", 2024-09-12T16:16:26.013 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:26.013 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.013 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.013 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:26.013 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979500+0000", 2024-09-12T16:16:26.013 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3300000000000003e-07 2024-09-12T16:16:26.013 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.013 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.013 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:26.013 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979502+0000", 2024-09-12T16:16:26.013 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1859999999999999e-06 2024-09-12T16:16:26.013 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.014 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.014 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:26.014 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979509+0000", 2024-09-12T16:16:26.014 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8859999999999998e-06 2024-09-12T16:16:26.014 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.014 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.014 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:26.014 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979514+0000", 2024-09-12T16:16:26.014 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8539999999999996e-06 2024-09-12T16:16:26.014 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.014 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.014 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:26.014 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032205+0000", 2024-09-12T16:16:26.014 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052690744999999997 2024-09-12T16:16:26.015 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.015 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.015 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:26.015 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032255+0000", 2024-09-12T16:16:26.015 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0444e-05 2024-09-12T16:16:26.015 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.015 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.015 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:26.015 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032310+0000", 2024-09-12T16:16:26.015 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4509999999999998e-05 2024-09-12T16:16:26.015 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:26.015 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:26.015 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:26.015 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.016 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.016 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:21552 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 2105344~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:26.016 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.979520+0000", 2024-09-12T16:16:26.016 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.9664719139999995, 2024-09-12T16:16:26.016 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052925321999999997, 2024-09-12T16:16:26.016 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:26.016 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:26.016 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:26.016 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:26.016 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:26.016 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:26.016 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 21552 2024-09-12T16:16:26.016 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.016 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:26.017 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.017 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:26.017 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979520+0000", 2024-09-12T16:16:26.017 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:26.017 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.017 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.017 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:26.017 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979520+0000", 2024-09-12T16:16:26.017 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:26.017 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.017 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.017 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:26.017 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979521+0000", 2024-09-12T16:16:26.018 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3099999999999999e-07 2024-09-12T16:16:26.018 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.018 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.018 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:26.018 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979523+0000", 2024-09-12T16:16:26.018 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2089999999999999e-06 2024-09-12T16:16:26.018 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.018 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.018 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:26.018 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979529+0000", 2024-09-12T16:16:26.018 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.993e-06 2024-09-12T16:16:26.018 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.018 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.018 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:26.018 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979535+0000", 2024-09-12T16:16:26.019 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8599999999999998e-06 2024-09-12T16:16:26.019 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.019 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.019 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:26.019 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032339+0000", 2024-09-12T16:16:26.019 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052804413000000001 2024-09-12T16:16:26.019 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.019 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.019 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:26.019 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032381+0000", 2024-09-12T16:16:26.019 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2098000000000002e-05 2024-09-12T16:16:26.019 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.019 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.019 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:26.019 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032446+0000", 2024-09-12T16:16:26.019 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4418000000000006e-05 2024-09-12T16:16:26.020 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:26.020 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:26.020 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:26.020 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.020 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.020 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:21553 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 2109440~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:26.020 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.979542+0000", 2024-09-12T16:16:26.020 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.9664505510000003, 2024-09-12T16:16:26.020 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053035463999999997, 2024-09-12T16:16:26.020 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:26.020 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:26.020 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:26.020 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:26.020 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:26.021 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:26.021 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 21553 2024-09-12T16:16:26.021 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.021 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:26.021 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.021 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:26.021 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979542+0000", 2024-09-12T16:16:26.021 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:26.021 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.021 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.021 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:26.021 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979542+0000", 2024-09-12T16:16:26.021 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:26.022 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.022 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.022 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:26.022 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979542+0000", 2024-09-12T16:16:26.022 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8699999999999995e-07 2024-09-12T16:16:26.022 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.022 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.022 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:26.022 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979544+0000", 2024-09-12T16:16:26.022 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.84e-06 2024-09-12T16:16:26.022 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.022 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.022 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:26.023 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979550+0000", 2024-09-12T16:16:26.023 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2280000000000003e-06 2024-09-12T16:16:26.023 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.023 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.023 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:26.023 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979555+0000", 2024-09-12T16:16:26.023 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8999999999999997e-06 2024-09-12T16:16:26.023 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.023 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.023 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:26.023 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032480+0000", 2024-09-12T16:16:26.023 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052924301999999999 2024-09-12T16:16:26.023 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.024 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.024 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:26.024 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032521+0000", 2024-09-12T16:16:26.024 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1563000000000002e-05 2024-09-12T16:16:26.024 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.024 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.024 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:26.024 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032577+0000", 2024-09-12T16:16:26.024 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6144000000000003e-05 2024-09-12T16:16:26.024 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:26.024 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:26.024 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:26.024 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.024 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.025 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:21554 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 2113536~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:26.025 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.979563+0000", 2024-09-12T16:16:26.025 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.9664297299999998, 2024-09-12T16:16:26.025 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053150380999999997, 2024-09-12T16:16:26.025 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:26.025 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:26.025 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:26.025 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:26.025 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:26.025 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:26.025 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 21554 2024-09-12T16:16:26.025 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.025 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:26.025 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.026 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:26.026 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979563+0000", 2024-09-12T16:16:26.026 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:26.026 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.026 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.026 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:26.026 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979563+0000", 2024-09-12T16:16:26.026 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:26.026 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.026 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.026 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:26.026 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979563+0000", 2024-09-12T16:16:26.026 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1600000000000002e-07 2024-09-12T16:16:26.027 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.027 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.027 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:26.027 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979575+0000", 2024-09-12T16:16:26.027 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.222e-05 2024-09-12T16:16:26.027 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.027 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.027 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:26.027 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979580+0000", 2024-09-12T16:16:26.027 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7140000000000001e-06 2024-09-12T16:16:26.027 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.027 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.027 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:26.027 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979583+0000", 2024-09-12T16:16:26.028 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4039999999999999e-06 2024-09-12T16:16:26.028 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.028 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.028 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:26.028 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032607+0000", 2024-09-12T16:16:26.028 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053023709000000002 2024-09-12T16:16:26.028 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.028 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.028 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:26.028 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032650+0000", 2024-09-12T16:16:26.028 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3012000000000001e-05 2024-09-12T16:16:26.028 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.028 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.028 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:26.029 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032713+0000", 2024-09-12T16:16:26.029 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2905999999999997e-05 2024-09-12T16:16:26.029 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:26.029 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:26.029 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:26.029 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.029 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.029 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:21555 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 2117632~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:26.029 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.979589+0000", 2024-09-12T16:16:26.029 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.9664030740000005, 2024-09-12T16:16:26.029 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053262941000000001, 2024-09-12T16:16:26.029 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:26.029 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:26.029 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:26.030 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:26.030 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:26.030 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:26.030 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 21555 2024-09-12T16:16:26.030 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.030 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:26.030 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.030 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:26.030 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979589+0000", 2024-09-12T16:16:26.030 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:26.030 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.030 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.030 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:26.030 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979589+0000", 2024-09-12T16:16:26.031 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:26.031 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.031 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.031 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:26.031 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979790+0000", 2024-09-12T16:16:26.031 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020029499999999999 2024-09-12T16:16:26.031 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.031 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.031 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:26.031 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979794+0000", 2024-09-12T16:16:26.031 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0740000000000003e-06 2024-09-12T16:16:26.031 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.031 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.031 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:26.032 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979803+0000", 2024-09-12T16:16:26.032 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8359999999999998e-06 2024-09-12T16:16:26.032 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.032 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.032 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:26.032 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979810+0000", 2024-09-12T16:16:26.032 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4680000000000003e-06 2024-09-12T16:16:26.032 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.032 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.032 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:26.032 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032742+0000", 2024-09-12T16:16:26.032 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052931745000000002 2024-09-12T16:16:26.032 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.032 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.033 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:26.033 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032783+0000", 2024-09-12T16:16:26.033 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1520000000000002e-05 2024-09-12T16:16:26.033 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.033 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.033 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:26.033 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032852+0000", 2024-09-12T16:16:26.033 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9003000000000003e-05 2024-09-12T16:16:26.033 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:26.033 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:26.033 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:26.033 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.033 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.033 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:21556 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 2121728~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:26.033 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.979821+0000", 2024-09-12T16:16:26.033 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.9661709969999999, 2024-09-12T16:16:26.034 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053150601999999998, 2024-09-12T16:16:26.034 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:26.034 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:26.034 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:26.034 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:26.034 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:26.034 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:26.034 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 21556 2024-09-12T16:16:26.034 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.034 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:26.034 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.034 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:26.034 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979821+0000", 2024-09-12T16:16:26.034 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:26.034 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.034 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.035 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:26.035 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979821+0000", 2024-09-12T16:16:26.035 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:26.035 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.035 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.035 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:26.035 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.985409+0000", 2024-09-12T16:16:26.035 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0055875680000000002 2024-09-12T16:16:26.035 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.035 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.035 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:26.035 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.985412+0000", 2024-09-12T16:16:26.035 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4249999999999998e-06 2024-09-12T16:16:26.035 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.035 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.036 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:26.036 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.985423+0000", 2024-09-12T16:16:26.036 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0713000000000001e-05 2024-09-12T16:16:26.036 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.036 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.036 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:26.036 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.985428+0000", 2024-09-12T16:16:26.036 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9420000000000003e-06 2024-09-12T16:16:26.036 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.036 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.036 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:26.036 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032880+0000", 2024-09-12T16:16:26.036 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.047452342000000002 2024-09-12T16:16:26.036 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.037 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.037 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:26.037 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032921+0000", 2024-09-12T16:16:26.037 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0989999999999999e-05 2024-09-12T16:16:26.037 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:26.037 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:26.037 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:26.037 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032972+0000", 2024-09-12T16:16:26.037 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0621999999999997e-05 2024-09-12T16:16:26.037 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:26.037 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:26.037 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:26.037 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:26.037 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:26.037 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:26.039 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:16:26.082 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-12T16:16:26.083 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:26.082+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:26.145 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:26.145+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:26.155 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:26.155 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:26.155 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:16:26.155 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:26.164 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:16:26.247 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:26.247+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:26.316 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:26.317 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:26.317 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:16:26.317 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:16:26.317 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:26.329 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:16:26.370 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:26.369+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:26.448 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:26.448+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:26.483 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:26.483 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:16:26.483 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:16:26.484 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:26.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.484 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3703 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14803968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:26.484 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139513+0000", 2024-09-12T16:16:26.484 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3427191720000007, 2024-09-12T16:16:26.484 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053248794000000002, 2024-09-12T16:16:26.484 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:26.484 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:26.484 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:26.484 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:26.484 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:26.484 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:26.484 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3703 2024-09-12T16:16:26.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.485 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:26.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:26.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139513+0000", 2024-09-12T16:16:26.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:26.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139513+0000", 2024-09-12T16:16:26.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:26.486 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139639+0000", 2024-09-12T16:16:26.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012673299999999999 2024-09-12T16:16:26.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.486 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:26.486 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139642+0000", 2024-09-12T16:16:26.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4820000000000001e-06 2024-09-12T16:16:26.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.486 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:26.486 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139647+0000", 2024-09-12T16:16:26.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8040000000000001e-06 2024-09-12T16:16:26.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.487 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:26.487 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139650+0000", 2024-09-12T16:16:26.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.529e-06 2024-09-12T16:16:26.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.487 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:26.487 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192537+0000", 2024-09-12T16:16:26.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052886503000000001 2024-09-12T16:16:26.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.487 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:26.487 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192627+0000", 2024-09-12T16:16:26.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0183e-05 2024-09-12T16:16:26.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.488 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:26.488 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192761+0000", 2024-09-12T16:16:26.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013456000000000001 2024-09-12T16:16:26.488 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.488 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:26.488 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.488 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3704 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14808064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:26.488 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139656+0000", 2024-09-12T16:16:26.488 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3425752559999999, 2024-09-12T16:16:26.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053247502000000002, 2024-09-12T16:16:26.489 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:26.489 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:26.489 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:26.489 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:26.489 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:26.489 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:26.489 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3704 2024-09-12T16:16:26.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.489 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:26.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.489 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:26.489 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139656+0000", 2024-09-12T16:16:26.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:26.490 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139656+0000", 2024-09-12T16:16:26.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:26.490 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139790+0000", 2024-09-12T16:16:26.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000133471 2024-09-12T16:16:26.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:26.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139792+0000", 2024-09-12T16:16:26.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.968e-06 2024-09-12T16:16:26.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.491 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:26.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139796+0000", 2024-09-12T16:16:26.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2660000000000003e-06 2024-09-12T16:16:26.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.491 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:26.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139799+0000", 2024-09-12T16:16:26.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2839999999999998e-06 2024-09-12T16:16:26.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.492 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:26.492 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192790+0000", 2024-09-12T16:16:26.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052990388999999999 2024-09-12T16:16:26.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.492 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:26.492 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192835+0000", 2024-09-12T16:16:26.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5101000000000001e-05 2024-09-12T16:16:26.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.492 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:26.492 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192904+0000", 2024-09-12T16:16:26.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9023000000000006e-05 2024-09-12T16:16:26.492 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.493 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:26.493 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.493 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3705 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14812160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:26.493 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:16:26.493 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3424269199999994, 2024-09-12T16:16:26.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053368831999999998, 2024-09-12T16:16:26.493 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:26.493 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:26.493 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:26.493 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:26.493 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:26.493 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:26.494 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3705 2024-09-12T16:16:26.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.494 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:26.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.494 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:26.494 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:16:26.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.494 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:26.494 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:16:26.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.494 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:26.494 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139932+0000", 2024-09-12T16:16:26.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012762099999999999 2024-09-12T16:16:26.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.495 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:26.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139935+0000", 2024-09-12T16:16:26.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.119e-06 2024-09-12T16:16:26.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.495 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:26.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139939+0000", 2024-09-12T16:16:26.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7999999999999998e-06 2024-09-12T16:16:26.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.495 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:26.496 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139953+0000", 2024-09-12T16:16:26.496 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3923999999999999e-05 2024-09-12T16:16:26.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.496 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:26.496 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192946+0000", 2024-09-12T16:16:26.496 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052992971 2024-09-12T16:16:26.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.496 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:26.496 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193035+0000", 2024-09-12T16:16:26.496 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9040000000000001e-05 2024-09-12T16:16:26.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.496 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:26.497 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193174+0000", 2024-09-12T16:16:26.497 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138357 2024-09-12T16:16:26.497 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.497 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:26.497 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.497 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3706 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14816256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:26.497 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:16:26.497 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3422719300000008, 2024-09-12T16:16:26.497 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053341723000000001, 2024-09-12T16:16:26.497 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:26.497 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:26.497 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:26.498 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:26.498 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:26.498 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:26.498 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3706 2024-09-12T16:16:26.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.498 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:26.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:26.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:16:26.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:26.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:16:26.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:26.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140090+0000", 2024-09-12T16:16:26.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013020100000000001 2024-09-12T16:16:26.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:26.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140097+0000", 2024-09-12T16:16:26.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0709999999999997e-06 2024-09-12T16:16:26.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:26.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140103+0000", 2024-09-12T16:16:26.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5450000000000003e-06 2024-09-12T16:16:26.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:26.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140106+0000", 2024-09-12T16:16:26.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3739999999999998e-06 2024-09-12T16:16:26.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:26.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193190+0000", 2024-09-12T16:16:26.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053084131999999999 2024-09-12T16:16:26.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.501 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:26.501 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193232+0000", 2024-09-12T16:16:26.501 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1517000000000002e-05 2024-09-12T16:16:26.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.501 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:26.501 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193302+0000", 2024-09-12T16:16:26.501 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9882999999999995e-05 2024-09-12T16:16:26.501 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.501 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:26.501 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.502 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3707 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14820352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:26.502 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:16:26.502 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.342119941, 2024-09-12T16:16:26.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053452771000000003, 2024-09-12T16:16:26.502 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:26.502 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:26.502 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:26.502 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:26.502 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:26.502 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:26.502 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3707 2024-09-12T16:16:26.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.502 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:26.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:26.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:16:26.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:26.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:16:26.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:26.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140219+0000", 2024-09-12T16:16:26.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106902 2024-09-12T16:16:26.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.504 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:26.504 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140225+0000", 2024-09-12T16:16:26.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3199999999999996e-06 2024-09-12T16:16:26.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.504 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:26.504 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140230+0000", 2024-09-12T16:16:26.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8969999999999999e-06 2024-09-12T16:16:26.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.504 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:26.504 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140233+0000", 2024-09-12T16:16:26.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2119999999999999e-06 2024-09-12T16:16:26.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.505 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:26.505 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193339+0000", 2024-09-12T16:16:26.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053105556999999998 2024-09-12T16:16:26.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.505 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:26.505 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193431+0000", 2024-09-12T16:16:26.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1837999999999997e-05 2024-09-12T16:16:26.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.505 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:26.506 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193565+0000", 2024-09-12T16:16:26.506 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013404500000000001 2024-09-12T16:16:26.506 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.506 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:26.506 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.506 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3708 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14824448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:26.506 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:16:26.506 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3419910989999995, 2024-09-12T16:16:26.506 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053468190999999998, 2024-09-12T16:16:26.506 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:26.506 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:26.507 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:26.507 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:26.507 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:26.507 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:26.507 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3708 2024-09-12T16:16:26.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.507 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:26.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.507 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:26.507 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:16:26.507 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.507 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:26.508 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:16:26.508 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.508 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:26.508 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140351+0000", 2024-09-12T16:16:26.508 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110096 2024-09-12T16:16:26.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.508 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:26.508 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140358+0000", 2024-09-12T16:16:26.508 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.306e-06 2024-09-12T16:16:26.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.508 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:26.509 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140368+0000", 2024-09-12T16:16:26.509 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0225e-05 2024-09-12T16:16:26.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.509 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:26.509 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140372+0000", 2024-09-12T16:16:26.509 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6169999999999998e-06 2024-09-12T16:16:26.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.509 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:26.509 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193594+0000", 2024-09-12T16:16:26.509 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053222419999999999 2024-09-12T16:16:26.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.510 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:26.510 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193640+0000", 2024-09-12T16:16:26.510 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.587e-05 2024-09-12T16:16:26.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.510 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:26.510 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193709+0000", 2024-09-12T16:16:26.510 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8657000000000004e-05 2024-09-12T16:16:26.510 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.510 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:26.510 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.510 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3709 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14828544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:26.510 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:16:26.511 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3418541309999998, 2024-09-12T16:16:26.511 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594033999999999, 2024-09-12T16:16:26.511 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:26.511 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:26.511 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:26.511 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:26.511 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:26.511 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:26.511 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3709 2024-09-12T16:16:26.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.511 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:26.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.512 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:26.512 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:16:26.512 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.512 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:26.512 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:16:26.512 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.512 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:26.512 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140499+0000", 2024-09-12T16:16:26.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121019 2024-09-12T16:16:26.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.513 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:26.513 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140501+0000", 2024-09-12T16:16:26.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2369999999999999e-06 2024-09-12T16:16:26.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.513 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:26.513 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140506+0000", 2024-09-12T16:16:26.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.639e-06 2024-09-12T16:16:26.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.513 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:26.514 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140509+0000", 2024-09-12T16:16:26.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3419999999999999e-06 2024-09-12T16:16:26.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:26.514 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193743+0000", 2024-09-12T16:16:26.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053234311999999999 2024-09-12T16:16:26.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:26.514 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193833+0000", 2024-09-12T16:16:26.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9883999999999995e-05 2024-09-12T16:16:26.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:26.515 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193972+0000", 2024-09-12T16:16:26.515 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138601 2024-09-12T16:16:26.515 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.515 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:26.515 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.515 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3710 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14832640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:26.515 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:16:26.515 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3417167849999991, 2024-09-12T16:16:26.515 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053607324999999997, 2024-09-12T16:16:26.515 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:26.515 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:26.515 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:26.516 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:26.516 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:26.516 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:26.516 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3710 2024-09-12T16:16:26.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.516 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:26.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.516 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:26.516 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:16:26.516 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.516 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:26.516 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:16:26.516 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.517 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:26.517 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140664+0000", 2024-09-12T16:16:26.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014918700000000001 2024-09-12T16:16:26.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.517 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:26.517 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140674+0000", 2024-09-12T16:16:26.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8379999999999997e-06 2024-09-12T16:16:26.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.517 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:26.517 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140694+0000", 2024-09-12T16:16:26.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0145000000000001e-05 2024-09-12T16:16:26.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:26.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140703+0000", 2024-09-12T16:16:26.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5150000000000006e-06 2024-09-12T16:16:26.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:26.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194006+0000", 2024-09-12T16:16:26.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053303370000000003 2024-09-12T16:16:26.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:26.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194051+0000", 2024-09-12T16:16:26.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5012000000000002e-05 2024-09-12T16:16:26.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:26.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194122+0000", 2024-09-12T16:16:26.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1258000000000001e-05 2024-09-12T16:16:26.519 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.519 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:26.519 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.519 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3711 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14836736~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:26.519 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:16:26.519 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3415153370000006, 2024-09-12T16:16:26.520 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053670799999999998, 2024-09-12T16:16:26.520 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:26.520 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:26.520 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:26.520 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:26.520 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:26.520 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:26.520 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3711 2024-09-12T16:16:26.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.520 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:26.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.520 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:26.520 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:16:26.520 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.521 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.521 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:26.521 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:16:26.521 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.521 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.521 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:26.521 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140782+0000", 2024-09-12T16:16:26.521 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5549999999999994e-05 2024-09-12T16:16:26.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.521 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.521 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:26.521 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140786+0000", 2024-09-12T16:16:26.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.89e-06 2024-09-12T16:16:26.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.522 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:26.522 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140796+0000", 2024-09-12T16:16:26.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0057e-05 2024-09-12T16:16:26.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.522 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:26.522 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140819+0000", 2024-09-12T16:16:26.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3005000000000001e-05 2024-09-12T16:16:26.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.522 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:26.523 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194159+0000", 2024-09-12T16:16:26.523 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053340324000000001 2024-09-12T16:16:26.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.523 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:26.523 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194248+0000", 2024-09-12T16:16:26.523 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9209000000000006e-05 2024-09-12T16:16:26.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.523 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:26.523 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194387+0000", 2024-09-12T16:16:26.523 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138765 2024-09-12T16:16:26.523 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.524 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:26.524 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.524 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.524 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3712 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14840832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:26.524 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:16:26.524 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.341400879, 2024-09-12T16:16:26.524 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053699068000000003, 2024-09-12T16:16:26.524 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:26.524 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:26.524 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:26.524 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:26.524 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:26.525 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:26.525 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3712 2024-09-12T16:16:26.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.525 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:26.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.525 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:26.525 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:16:26.525 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.525 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:26.525 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:16:26.525 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.526 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:26.526 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140900+0000", 2024-09-12T16:16:26.526 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9014e-05 2024-09-12T16:16:26.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.526 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:26.526 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140904+0000", 2024-09-12T16:16:26.526 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0940000000000001e-06 2024-09-12T16:16:26.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.526 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:26.526 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140933+0000", 2024-09-12T16:16:26.526 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8996000000000002e-05 2024-09-12T16:16:26.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.527 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:26.527 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140945+0000", 2024-09-12T16:16:26.527 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1909000000000001e-05 2024-09-12T16:16:26.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.527 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:26.527 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194415+0000", 2024-09-12T16:16:26.527 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053470403 2024-09-12T16:16:26.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.527 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:26.527 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194460+0000", 2024-09-12T16:16:26.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5145000000000002e-05 2024-09-12T16:16:26.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.528 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:26.528 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194530+0000", 2024-09-12T16:16:26.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9506999999999997e-05 2024-09-12T16:16:26.528 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.528 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:26.528 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.528 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3713 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14844928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:26.528 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:16:26.529 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3412678190000005, 2024-09-12T16:16:26.529 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053821236000000001, 2024-09-12T16:16:26.529 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:26.529 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:26.529 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:26.529 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:26.529 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:26.529 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:26.529 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3713 2024-09-12T16:16:26.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.529 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:26.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.529 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:26.529 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:16:26.529 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.530 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:26.530 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:16:26.530 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.530 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:26.530 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141078+0000", 2024-09-12T16:16:26.530 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114162 2024-09-12T16:16:26.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.530 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:26.531 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141090+0000", 2024-09-12T16:16:26.531 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.19e-05 2024-09-12T16:16:26.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.531 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.531 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:26.531 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141100+0000", 2024-09-12T16:16:26.531 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0447e-05 2024-09-12T16:16:26.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.531 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.531 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:26.531 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141108+0000", 2024-09-12T16:16:26.531 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7190000000000001e-06 2024-09-12T16:16:26.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.531 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.531 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:26.532 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194564+0000", 2024-09-12T16:16:26.532 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053455729 2024-09-12T16:16:26.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.532 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:26.532 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194652+0000", 2024-09-12T16:16:26.532 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8288999999999994e-05 2024-09-12T16:16:26.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.532 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:26.532 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194785+0000", 2024-09-12T16:16:26.532 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013299000000000001 2024-09-12T16:16:26.532 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.532 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:26.533 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.533 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3714 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14849024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:26.533 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:16:26.533 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3411118900000005, 2024-09-12T16:16:26.533 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053816382000000003, 2024-09-12T16:16:26.533 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:26.533 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:26.533 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:26.533 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:26.533 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:26.533 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:26.534 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3714 2024-09-12T16:16:26.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.534 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:26.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.534 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:26.534 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:16:26.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.534 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:26.534 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:16:26.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.535 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:26.535 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141182+0000", 2024-09-12T16:16:26.535 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1805999999999997e-05 2024-09-12T16:16:26.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.535 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:26.535 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141185+0000", 2024-09-12T16:16:26.535 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5930000000000002e-06 2024-09-12T16:16:26.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.535 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:26.535 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141194+0000", 2024-09-12T16:16:26.535 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5760000000000006e-06 2024-09-12T16:16:26.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.536 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:26.536 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141222+0000", 2024-09-12T16:16:26.536 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8034999999999998e-05 2024-09-12T16:16:26.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.536 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.536 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:26.536 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194817+0000", 2024-09-12T16:16:26.536 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594887000000001 2024-09-12T16:16:26.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.536 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.536 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:26.536 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194860+0000", 2024-09-12T16:16:26.536 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3714999999999997e-05 2024-09-12T16:16:26.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.536 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.536 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:26.537 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194936+0000", 2024-09-12T16:16:26.537 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5770000000000001e-05 2024-09-12T16:16:26.537 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.537 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:26.537 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.537 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3715 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14853120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:26.537 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:16:26.537 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3409882329999991, 2024-09-12T16:16:26.537 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053962307000000001, 2024-09-12T16:16:26.537 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:26.537 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:26.537 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:26.537 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:26.537 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:26.538 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:26.538 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3715 2024-09-12T16:16:26.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.538 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:26.538 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.538 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:26.538 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:16:26.538 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.538 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.538 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:26.538 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:16:26.538 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.539 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.539 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:26.539 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141417+0000", 2024-09-12T16:16:26.539 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017384099999999999 2024-09-12T16:16:26.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.539 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.539 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:26.539 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141422+0000", 2024-09-12T16:16:26.539 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7310000000000001e-06 2024-09-12T16:16:26.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.539 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.539 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:26.539 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141434+0000", 2024-09-12T16:16:26.539 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2058e-05 2024-09-12T16:16:26.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.540 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:26.540 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141442+0000", 2024-09-12T16:16:26.540 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7610000000000007e-06 2024-09-12T16:16:26.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.540 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:26.540 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194973+0000", 2024-09-12T16:16:26.540 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053530618000000002 2024-09-12T16:16:26.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.540 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:26.540 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195063+0000", 2024-09-12T16:16:26.541 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0927000000000005e-05 2024-09-12T16:16:26.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.541 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:26.541 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195206+0000", 2024-09-12T16:16:26.541 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142371 2024-09-12T16:16:26.541 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.541 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:26.541 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.541 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3716 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14857216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:26.541 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:16:26.541 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.340778383, 2024-09-12T16:16:26.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053916360000000003, 2024-09-12T16:16:26.542 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:26.542 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:26.542 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:26.542 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:26.542 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:26.542 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:26.542 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3716 2024-09-12T16:16:26.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.542 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:26.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.542 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:26.542 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:16:26.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.543 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:26.543 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:16:26.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.543 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:26.543 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142933+0000", 2024-09-12T16:16:26.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014796290000000001 2024-09-12T16:16:26.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.543 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:26.544 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142937+0000", 2024-09-12T16:16:26.544 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5760000000000002e-06 2024-09-12T16:16:26.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.544 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:26.544 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142946+0000", 2024-09-12T16:16:26.544 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0380000000000005e-06 2024-09-12T16:16:26.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.544 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:26.544 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142951+0000", 2024-09-12T16:16:26.544 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9749999999999998e-06 2024-09-12T16:16:26.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.545 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:26.545 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195246+0000", 2024-09-12T16:16:26.545 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052295358 2024-09-12T16:16:26.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.545 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:26.545 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195299+0000", 2024-09-12T16:16:26.545 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2976999999999998e-05 2024-09-12T16:16:26.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.545 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:26.545 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195370+0000", 2024-09-12T16:16:26.545 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0807000000000002e-05 2024-09-12T16:16:26.546 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.546 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:26.546 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.546 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3721 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14877696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:26.546 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:16:26.546 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3392049319999995, 2024-09-12T16:16:26.546 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053422994000000001, 2024-09-12T16:16:26.546 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:26.546 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:26.546 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:26.546 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:26.547 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:26.547 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:26.547 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3721 2024-09-12T16:16:26.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.547 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:26.547 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.547 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:26.547 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:16:26.547 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.547 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.547 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:26.547 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:16:26.547 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.548 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:26.548 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:16:26.548 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:16:26.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.548 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:26.548 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143028+0000", 2024-09-12T16:16:26.548 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7399999999999991e-07 2024-09-12T16:16:26.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.548 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:26.549 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143031+0000", 2024-09-12T16:16:26.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7599999999999998e-06 2024-09-12T16:16:26.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.549 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:26.549 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143034+0000", 2024-09-12T16:16:26.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9780000000000001e-06 2024-09-12T16:16:26.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.549 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:26.549 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196220+0000", 2024-09-12T16:16:26.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053186341999999998 2024-09-12T16:16:26.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.550 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:26.550 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196313+0000", 2024-09-12T16:16:26.550 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2676000000000005e-05 2024-09-12T16:16:26.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.550 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:26.550 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196450+0000", 2024-09-12T16:16:26.550 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137052 2024-09-12T16:16:26.550 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.550 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:26.550 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.550 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3722 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14881792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:26.550 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:16:26.551 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3391950399999999, 2024-09-12T16:16:26.551 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053556835999999997, 2024-09-12T16:16:26.551 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:26.551 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:26.551 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:26.551 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:26.551 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:26.551 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:26.551 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3722 2024-09-12T16:16:26.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.551 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:26.551 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.551 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:26.552 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:16:26.552 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.552 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:26.552 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:16:26.552 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.552 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:26.552 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:16:26.552 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.11e-07 2024-09-12T16:16:26.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.552 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:26.552 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143038+0000", 2024-09-12T16:16:26.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2399999999999996e-07 2024-09-12T16:16:26.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.553 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:26.553 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143041+0000", 2024-09-12T16:16:26.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8030000000000001e-06 2024-09-12T16:16:26.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.553 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:26.553 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143043+0000", 2024-09-12T16:16:26.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3140000000000002e-06 2024-09-12T16:16:26.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.553 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:26.554 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196481+0000", 2024-09-12T16:16:26.554 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053437601000000001 2024-09-12T16:16:26.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.554 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:26.554 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196525+0000", 2024-09-12T16:16:26.554 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4280000000000003e-05 2024-09-12T16:16:26.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.554 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:26.554 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196594+0000", 2024-09-12T16:16:26.554 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8702999999999996e-05 2024-09-12T16:16:26.554 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.554 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:26.555 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.555 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.555 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3723 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14885888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:26.555 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:16:26.555 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3391858580000005, 2024-09-12T16:16:26.555 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053815546999999998, 2024-09-12T16:16:26.555 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:26.555 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:26.555 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:26.555 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:26.555 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:26.555 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:26.555 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3723 2024-09-12T16:16:26.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.556 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:26.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.556 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:26.556 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:16:26.556 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.556 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:26.556 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:16:26.556 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.556 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:26.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148994+0000", 2024-09-12T16:16:26.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059481330000000004 2024-09-12T16:16:26.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:26.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148999+0000", 2024-09-12T16:16:26.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7140000000000001e-06 2024-09-12T16:16:26.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:26.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149008+0000", 2024-09-12T16:16:26.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4350000000000003e-06 2024-09-12T16:16:26.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:26.558 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149021+0000", 2024-09-12T16:16:26.558 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2514000000000001e-05 2024-09-12T16:16:26.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.558 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:26.558 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196630+0000", 2024-09-12T16:16:26.558 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047609758000000002 2024-09-12T16:16:26.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.558 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:26.558 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196724+0000", 2024-09-12T16:16:26.558 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3522000000000003e-05 2024-09-12T16:16:26.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.559 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:26.559 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196861+0000", 2024-09-12T16:16:26.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013747100000000001 2024-09-12T16:16:26.559 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.559 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:26.559 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.559 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4438 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15719424~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:26.559 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:16:26.559 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.1943050809999995, 2024-09-12T16:16:26.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367981000000002, 2024-09-12T16:16:26.559 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:26.560 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:26.560 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:26.560 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:26.560 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:26.560 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:26.560 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4438 2024-09-12T16:16:26.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.560 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:26.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.560 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:26.560 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:16:26.560 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:26.561 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:16:26.561 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:26.561 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:16:26.561 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3e-07 2024-09-12T16:16:26.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:26.561 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287930+0000", 2024-09-12T16:16:26.561 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-12T16:16:26.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:26.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287937+0000", 2024-09-12T16:16:26.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.08e-06 2024-09-12T16:16:26.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:26.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287943+0000", 2024-09-12T16:16:26.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5709999999999997e-06 2024-09-12T16:16:26.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:26.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341068+0000", 2024-09-12T16:16:26.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053125101000000001 2024-09-12T16:16:26.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.563 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:26.563 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341154+0000", 2024-09-12T16:16:26.563 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6100999999999994e-05 2024-09-12T16:16:26.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.563 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:26.563 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341295+0000", 2024-09-12T16:16:26.563 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014087999999999999 2024-09-12T16:16:26.563 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.563 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:26.563 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.564 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4439 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15723520~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:26.564 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:16:26.564 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.1942809210000007, 2024-09-12T16:16:26.564 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053526799, 2024-09-12T16:16:26.564 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:26.564 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:26.564 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:26.564 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:26.564 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:26.564 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:26.564 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4439 2024-09-12T16:16:26.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.564 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:26.565 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.565 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:26.565 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:16:26.565 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.565 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.565 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:26.565 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:16:26.565 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.565 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.565 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:26.565 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:16:26.565 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-07 2024-09-12T16:16:26.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.566 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:26.566 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287953+0000", 2024-09-12T16:16:26.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1349999999999999e-06 2024-09-12T16:16:26.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.566 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:26.566 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287960+0000", 2024-09-12T16:16:26.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-12T16:16:26.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.566 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:26.566 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287965+0000", 2024-09-12T16:16:26.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1580000000000004e-06 2024-09-12T16:16:26.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:26.567 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341332+0000", 2024-09-12T16:16:26.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367009 2024-09-12T16:16:26.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:26.567 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341402+0000", 2024-09-12T16:16:26.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9759999999999996e-05 2024-09-12T16:16:26.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:26.568 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341478+0000", 2024-09-12T16:16:26.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5412000000000002e-05 2024-09-12T16:16:26.568 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.568 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:26.568 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.568 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4440 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15727616~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:26.568 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:16:26.568 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.1942598170000007, 2024-09-12T16:16:26.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053761601999999999, 2024-09-12T16:16:26.568 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:26.568 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:26.568 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:26.569 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:26.569 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:26.569 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:26.569 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4440 2024-09-12T16:16:26.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.569 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:26.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.569 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:26.569 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:16:26.569 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.569 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:26.569 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:16:26.569 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.570 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:26.570 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:16:26.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:16:26.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.570 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:26.570 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287974+0000", 2024-09-12T16:16:26.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0540000000000002e-06 2024-09-12T16:16:26.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.570 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:26.570 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287980+0000", 2024-09-12T16:16:26.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9440000000000002e-06 2024-09-12T16:16:26.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:26.571 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287987+0000", 2024-09-12T16:16:26.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5889999999999999e-06 2024-09-12T16:16:26.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:26.571 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341502+0000", 2024-09-12T16:16:26.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053515199999999999 2024-09-12T16:16:26.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:26.572 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341595+0000", 2024-09-12T16:16:26.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3097000000000007e-05 2024-09-12T16:16:26.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.572 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:26.572 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341734+0000", 2024-09-12T16:16:26.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013832800000000001 2024-09-12T16:16:26.572 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.572 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:26.572 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.572 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.572 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:26.572 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:26.574 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:16:26.574 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:26.573+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:26.587 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #6, image image_client.0-clone6 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent7 2024-09-12T16:16:26.656 INFO:teuthology.orchestra.run.smithi204.stdout:1513 write 0x352a200 thru 0x352f9a1 (0x57a2 bytes) 2024-09-12T16:16:26.656 INFO:teuthology.orchestra.run.smithi204.stdout:1515 punch from 0x4c97800 to 0x4c9e600, (0x6e00 bytes) 2024-09-12T16:16:26.669 INFO:teuthology.orchestra.run.smithi204.stdout:1518 write 0x819ec00 thru 0x81a1f36 (0x3337 bytes) 2024-09-12T16:16:26.669 INFO:teuthology.orchestra.run.smithi204.stdout:1519 write 0x29bd200 thru 0x29c97b1 (0xc5b2 bytes) 2024-09-12T16:16:26.673 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [5] live_osds: [0, 1, 2, 3, 4] 2024-09-12T16:16:26.674 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T16:16:26.674 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-09-12T16:16:26.674 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-12T16:16:26.674 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-12T16:16:26.674 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-09-12T16:16:26.675 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:26.674+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:26.677 INFO:teuthology.orchestra.run.smithi204.stdout:1520 trunc from 0xc091c00 to 0x4a10600 2024-09-12T16:16:26.711 INFO:teuthology.orchestra.run.smithi204.stdout:1521 read 0x4779c00 thru 0x4785891 (0xbc92 bytes) 2024-09-12T16:16:26.716 INFO:teuthology.orchestra.run.smithi204.stdout:1522 read 0x1d65800 thru 0x1d69b47 (0x4348 bytes) 2024-09-12T16:16:26.717 INFO:teuthology.orchestra.run.smithi204.stdout:1523 read 0xb6a200 thru 0xb77880 (0xd681 bytes) 2024-09-12T16:16:26.717 INFO:teuthology.orchestra.run.smithi204.stdout:1524 read 0x2587000 thru 0x259549f (0xe4a0 bytes) 2024-09-12T16:16:26.717 INFO:teuthology.orchestra.run.smithi204.stdout:1527 read 0x33e5e00 thru 0x33f3cff (0xdf00 bytes) 2024-09-12T16:16:26.717 INFO:teuthology.orchestra.run.smithi204.stdout:1528 punch from 0x1079600 to 0x107c000, (0x2a00 bytes) 2024-09-12T16:16:26.718 INFO:teuthology.orchestra.run.smithi204.stdout:1531 read 0x2855a00 thru 0x285da93 (0x8094 bytes) 2024-09-12T16:16:26.718 INFO:teuthology.orchestra.run.smithi204.stdout:1532 read 0x1e6c800 thru 0x1e6da20 (0x1221 bytes) 2024-09-12T16:16:26.722 INFO:teuthology.orchestra.run.smithi204.stdout:1535 trunc from 0x4a10600 to 0x1892800 2024-09-12T16:16:26.740 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:26.740 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:26.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.740 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4628.0:487 3.18 3:1acc661f:::rbd_object_map.115575975003:head [call lock.assert_locked in=44b,call rbd.object_map_update in=38b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T16:16:26.740 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:26.737343+0000", 2024-09-12T16:16:26.740 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.002310276, 2024-09-12T16:16:26.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0023294689999999998, 2024-09-12T16:16:26.741 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:26.741 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:26.741 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "waiting for sub ops", 2024-09-12T16:16:26.741 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:26.741 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4628", 2024-09-12T16:16:26.741 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1045866072", 2024-09-12T16:16:26.741 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 487 2024-09-12T16:16:26.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.741 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:26.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:26.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.737343+0000", 2024-09-12T16:16:26.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:26.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.737343+0000", 2024-09-12T16:16:26.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:26.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.737344+0000", 2024-09-12T16:16:26.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5300000000000002e-07 2024-09-12T16:16:26.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:26.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.737349+0000", 2024-09-12T16:16:26.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3499999999999996e-06 2024-09-12T16:16:26.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:26.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.737363+0000", 2024-09-12T16:16:26.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3304e-05 2024-09-12T16:16:26.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:26.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.737372+0000", 2024-09-12T16:16:26.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8829999999999995e-06 2024-09-12T16:16:26.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:26.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.738129+0000", 2024-09-12T16:16:26.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00075736300000000005 2024-09-12T16:16:26.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:26.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.738210+0000", 2024-09-12T16:16:26.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0706999999999998e-05 2024-09-12T16:16:26.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 2", 2024-09-12T16:16:26.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.738495+0000", 2024-09-12T16:16:26.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00028528100000000002 2024-09-12T16:16:26.744 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.745 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:26.745 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.745 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4628.0:488 3.18 3:1acc661f:::rbd_object_map.115575975003:head [call lock.assert_locked in=44b,call rbd.object_map_update in=38b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T16:16:26.745 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:26.737852+0000", 2024-09-12T16:16:26.745 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0018008900000000001, 2024-09-12T16:16:26.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0018601080000000001, 2024-09-12T16:16:26.745 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:26.745 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:26.745 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "waiting for sub ops", 2024-09-12T16:16:26.745 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:26.745 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4628", 2024-09-12T16:16:26.746 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1045866072", 2024-09-12T16:16:26.746 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 488 2024-09-12T16:16:26.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.746 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:26.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:26.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.737852+0000", 2024-09-12T16:16:26.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:26.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.737852+0000", 2024-09-12T16:16:26.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:26.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.737853+0000", 2024-09-12T16:16:26.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3500000000000005e-07 2024-09-12T16:16:26.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:26.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.737858+0000", 2024-09-12T16:16:26.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3359999999999997e-06 2024-09-12T16:16:26.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:26.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.737866+0000", 2024-09-12T16:16:26.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5189999999999992e-06 2024-09-12T16:16:26.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:26.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.737873+0000", 2024-09-12T16:16:26.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9879999999999998e-06 2024-09-12T16:16:26.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:26.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.739131+0000", 2024-09-12T16:16:26.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00125796 2024-09-12T16:16:26.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:26.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.739178+0000", 2024-09-12T16:16:26.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6819e-05 2024-09-12T16:16:26.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 2", 2024-09-12T16:16:26.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.739428+0000", 2024-09-12T16:16:26.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00025055999999999999 2024-09-12T16:16:26.749 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.749 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:26.749 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.749 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4628.0:489 3.18 3.f8663358 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T16:16:26.750 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:26.738069+0000", 2024-09-12T16:16:26.750 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.001584483, 2024-09-12T16:16:26.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0016749429999999999, 2024-09-12T16:16:26.750 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:26.750 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:26.750 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:26.750 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:26.750 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4628", 2024-09-12T16:16:26.750 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1045866072", 2024-09-12T16:16:26.750 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 489 2024-09-12T16:16:26.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.750 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:26.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:26.751 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.738069+0000", 2024-09-12T16:16:26.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.751 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:26.751 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.738069+0000", 2024-09-12T16:16:26.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.751 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:26.751 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.738070+0000", 2024-09-12T16:16:26.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8700000000000004e-07 2024-09-12T16:16:26.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:26.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.738075+0000", 2024-09-12T16:16:26.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4190000000000001e-06 2024-09-12T16:16:26.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:26.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.738087+0000", 2024-09-12T16:16:26.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1873e-05 2024-09-12T16:16:26.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:26.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.738096+0000", 2024-09-12T16:16:26.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4110000000000002e-06 2024-09-12T16:16:26.753 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.753 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:26.753 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.753 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4628.0:490 3.18 3.f8663358 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T16:16:26.753 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:26.738712+0000", 2024-09-12T16:16:26.753 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.00094156700000000003, 2024-09-12T16:16:26.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001055215, 2024-09-12T16:16:26.753 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:26.753 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:26.753 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:26.753 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:26.754 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4628", 2024-09-12T16:16:26.754 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1045866072", 2024-09-12T16:16:26.754 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 490 2024-09-12T16:16:26.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.754 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:26.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:26.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.738712+0000", 2024-09-12T16:16:26.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:26.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.738712+0000", 2024-09-12T16:16:26.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.755 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:26.755 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.738713+0000", 2024-09-12T16:16:26.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9700000000000005e-07 2024-09-12T16:16:26.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.755 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:26.755 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.738718+0000", 2024-09-12T16:16:26.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6300000000000003e-06 2024-09-12T16:16:26.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.755 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:26.756 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.738738+0000", 2024-09-12T16:16:26.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9627999999999999e-05 2024-09-12T16:16:26.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.756 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:26.756 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.738745+0000", 2024-09-12T16:16:26.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1709999999999996e-06 2024-09-12T16:16:26.756 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.756 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:26.756 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.756 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4628.0:491 3.18 3.f8663358 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T16:16:26.757 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:26.739032+0000", 2024-09-12T16:16:26.757 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.00062184399999999998, 2024-09-12T16:16:26.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00075964700000000001, 2024-09-12T16:16:26.757 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:26.757 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:26.757 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:26.757 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:26.757 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4628", 2024-09-12T16:16:26.757 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1045866072", 2024-09-12T16:16:26.757 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 491 2024-09-12T16:16:26.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.757 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:26.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:26.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.739032+0000", 2024-09-12T16:16:26.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:26.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.739032+0000", 2024-09-12T16:16:26.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:26.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.739032+0000", 2024-09-12T16:16:26.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9800000000000003e-07 2024-09-12T16:16:26.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.759 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:26.759 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.739037+0000", 2024-09-12T16:16:26.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4340000000000002e-06 2024-09-12T16:16:26.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.759 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:26.759 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.739046+0000", 2024-09-12T16:16:26.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0780000000000002e-06 2024-09-12T16:16:26.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.759 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:26.759 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.739051+0000", 2024-09-12T16:16:26.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9089999999999999e-06 2024-09-12T16:16:26.760 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.760 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:26.760 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.760 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop_reply(client.4628.0:487 3.18 e41/32)", 2024-09-12T16:16:26.760 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:26.739333+0000", 2024-09-12T16:16:26.760 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.00032056700000000001, 2024-09-12T16:16:26.760 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048006999999999998, 2024-09-12T16:16:26.760 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:26.760 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:26.760 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:26.760 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:26.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:26.761 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.739333+0000", 2024-09-12T16:16:26.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:26.761 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.739333+0000", 2024-09-12T16:16:26.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:26.761 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.739333+0000", 2024-09-12T16:16:26.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3900000000000004e-07 2024-09-12T16:16:26.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:26.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.739337+0000", 2024-09-12T16:16:26.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9040000000000002e-06 2024-09-12T16:16:26.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:26.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.739347+0000", 2024-09-12T16:16:26.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9110000000000005e-06 2024-09-12T16:16:26.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:26.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.739354+0000", 2024-09-12T16:16:26.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0979999999999996e-06 2024-09-12T16:16:26.763 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.763 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:26.763 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.763 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4628.0:492 3.18 3.f8663358 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T16:16:26.763 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:26.739735+0000", 2024-09-12T16:16:26.763 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4294967295.9999185, 2024-09-12T16:16:26.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000105461, 2024-09-12T16:16:26.763 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:26.763 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:26.763 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:26.763 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:26.763 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4628", 2024-09-12T16:16:26.764 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1045866072", 2024-09-12T16:16:26.764 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 492 2024-09-12T16:16:26.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.764 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:26.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:26.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.739735+0000", 2024-09-12T16:16:26.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:26.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.739735+0000", 2024-09-12T16:16:26.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:26.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:26.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.739736+0000", 2024-09-12T16:16:26.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.158e-06 2024-09-12T16:16:26.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:26.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.739743+0000", 2024-09-12T16:16:26.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4989999999999999e-06 2024-09-12T16:16:26.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:26.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.739763+0000", 2024-09-12T16:16:26.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0259e-05 2024-09-12T16:16:26.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:26.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:26.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:26.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.739771+0000", 2024-09-12T16:16:26.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4319999999999999e-06 2024-09-12T16:16:26.766 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.766 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:26.766 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.766 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:26.766 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-12T16:16:26.766 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 7 2024-09-12T16:16:26.766 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:26.766 INFO:teuthology.orchestra.run.smithi204.stdout:1542 read 0x523400 thru 0x5316aa (0xe2ab bytes) 2024-09-12T16:16:26.767 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:16:26.775 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:26.775+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:26.798 INFO:teuthology.orchestra.run.smithi204.stdout:1543 write 0xdf22a00 thru 0xdf2a445 (0x7a46 bytes) 2024-09-12T16:16:26.798 INFO:teuthology.orchestra.run.smithi204.stdout:1547 write 0x3687c00 thru 0x3692b55 (0xaf56 bytes) 2024-09-12T16:16:26.798 INFO:teuthology.orchestra.run.smithi204.stdout:1549 write 0x26c7800 thru 0x26cb4d6 (0x3cd7 bytes) 2024-09-12T16:16:26.799 INFO:teuthology.orchestra.run.smithi204.stdout:1550 punch from 0x9d26000 to 0x9d2a200, (0x4200 bytes) 2024-09-12T16:16:26.799 INFO:teuthology.orchestra.run.smithi204.stdout:1551 read 0x3527000 thru 0x35338a6 (0xc8a7 bytes) 2024-09-12T16:16:26.807 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:26.807 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-12T16:16:26.807 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:26.813 INFO:teuthology.orchestra.run.smithi204.stdout:1552 trunc from 0xdf2a600 to 0x1c92c00 2024-09-12T16:16:26.835 INFO:teuthology.orchestra.run.smithi204.stdout:1553 read 0x25a200 thru 0x25d8b3 (0x36b4 bytes) 2024-09-12T16:16:26.839 INFO:teuthology.orchestra.run.smithi204.stdout:1554 trunc from 0x1c92c00 to 0x31f7a00 2024-09-12T16:16:26.875 INFO:teuthology.orchestra.run.smithi204.stdout:1555 write 0x88ac000 thru 0x88b92ac (0xd2ad bytes) 2024-09-12T16:16:26.876 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:26.875+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:26.881 INFO:teuthology.orchestra.run.smithi204.stdout:1556 trunc from 0x88b9400 to 0x5113200 2024-09-12T16:16:26.885 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:26.885 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:26.885 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:16:26.885 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:16:26.885 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:26.895 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:16:26.924 INFO:teuthology.orchestra.run.smithi204.stdout:1557 write 0xaae1e00 thru 0xaae4d2d (0x2f2e bytes) 2024-09-12T16:16:26.944 INFO:teuthology.orchestra.run.smithi204.stdout:1559 write 0xc43de00 thru 0xc43e92f (0xb30 bytes) 2024-09-12T16:16:26.945 INFO:teuthology.orchestra.run.smithi204.stdout:1561 read 0xa806a00 thru 0xa8093ab (0x29ac bytes) 2024-09-12T16:16:26.945 INFO:teuthology.orchestra.run.smithi204.stdout:1562 read 0x2b20000 thru 0x2b2ca4b (0xca4c bytes) 2024-09-12T16:16:26.946 INFO:teuthology.orchestra.run.smithi204.stdout:1565 punch from 0x24cc800 to 0x24d9200, (0xca00 bytes) 2024-09-12T16:16:26.946 INFO:teuthology.orchestra.run.smithi204.stdout:1566 read 0xb40fe00 thru 0xb41fb4d (0xfd4e bytes) 2024-09-12T16:16:26.953 INFO:teuthology.orchestra.run.smithi204.stdout:1567 trunc from 0xc43ea00 to 0x64c5a00 2024-09-12T16:16:26.973 INFO:teuthology.orchestra.run.smithi204.stdout:1569 read 0x1cba800 thru 0x1cbc62c (0x1e2d bytes) 2024-09-12T16:16:26.975 INFO:teuthology.orchestra.run.smithi204.stdout:1574 punch from 0x1c43000 to 0x1c51600, (0xe600 bytes) 2024-09-12T16:16:26.976 INFO:teuthology.orchestra.run.smithi204.stdout:1575 read 0x204e200 thru 0x2052d71 (0x4b72 bytes) 2024-09-12T16:16:26.976 INFO:teuthology.orchestra.run.smithi204.stdout:1576 write 0x417ac00 thru 0x4180bc9 (0x5fca bytes) 2024-09-12T16:16:26.976 INFO:teuthology.orchestra.run.smithi204.stdout:1580 punch from 0x5f99800 to 0x5fa0600, (0x6e00 bytes) 2024-09-12T16:16:26.982 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:26.981+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:26.982 INFO:teuthology.orchestra.run.smithi204.stdout:1581 trunc from 0x64c5a00 to 0x19e2a00 2024-09-12T16:16:27.020 INFO:teuthology.orchestra.run.smithi204.stdout:1582 write 0x37ace00 thru 0x37b6067 (0x9268 bytes) 2024-09-12T16:16:27.021 INFO:teuthology.orchestra.run.smithi204.stdout:1585 punch from 0x2a92400 to 0x2a9f400, (0xd000 bytes) 2024-09-12T16:16:27.025 INFO:teuthology.orchestra.run.smithi204.stdout:1588 trunc from 0x37b6200 to 0x63a2000 2024-09-12T16:16:27.049 INFO:teuthology.orchestra.run.smithi204.stdout:1590 trunc from 0x63a2000 to 0xe606800 2024-09-12T16:16:27.054 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:27.054 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:16:27.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:16:27.055 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:27.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.055 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2256 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12192768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:27.055 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.889586+0000", 2024-09-12T16:16:27.055 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1636878480000004, 2024-09-12T16:16:27.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037086439999999998, 2024-09-12T16:16:27.055 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.055 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.055 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:27.055 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:27.055 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:27.055 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:27.055 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2256 2024-09-12T16:16:27.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.056 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.889586+0000", 2024-09-12T16:16:27.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.889586+0000", 2024-09-12T16:16:27.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.894952+0000", 2024-09-12T16:16:27.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0053653260000000001 2024-09-12T16:16:27.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.894956+0000", 2024-09-12T16:16:27.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2640000000000002e-06 2024-09-12T16:16:27.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.894966+0000", 2024-09-12T16:16:27.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0607e-05 2024-09-12T16:16:27.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.894982+0000", 2024-09-12T16:16:27.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5528000000000001e-05 2024-09-12T16:16:27.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.926510+0000", 2024-09-12T16:16:27.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.031528325000000003 2024-09-12T16:16:27.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:27.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.926593+0000", 2024-09-12T16:16:27.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2812999999999995e-05 2024-09-12T16:16:27.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.926673+0000", 2024-09-12T16:16:27.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9577000000000001e-05 2024-09-12T16:16:27.059 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.059 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.059 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.059 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2298 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12364800~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:27.059 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.895981+0000", 2024-09-12T16:16:27.059 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1572926769999992, 2024-09-12T16:16:27.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037134176999999997, 2024-09-12T16:16:27.060 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.060 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.060 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:27.060 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:27.060 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:27.060 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:27.060 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2298 2024-09-12T16:16:27.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.060 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.895981+0000", 2024-09-12T16:16:27.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.895981+0000", 2024-09-12T16:16:27.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.895982+0000", 2024-09-12T16:16:27.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6400000000000003e-07 2024-09-12T16:16:27.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.895984+0000", 2024-09-12T16:16:27.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1500000000000002e-06 2024-09-12T16:16:27.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.895991+0000", 2024-09-12T16:16:27.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8730000000000001e-06 2024-09-12T16:16:27.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.895996+0000", 2024-09-12T16:16:27.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1800000000000004e-06 2024-09-12T16:16:27.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.932938+0000", 2024-09-12T16:16:27.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036941781 2024-09-12T16:16:27.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:27.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933028+0000", 2024-09-12T16:16:27.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0493000000000002e-05 2024-09-12T16:16:27.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933116+0000", 2024-09-12T16:16:27.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7236000000000003e-05 2024-09-12T16:16:27.063 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.063 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.063 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.064 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2299 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12368896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:27.064 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896004+0000", 2024-09-12T16:16:27.064 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1572699699999998, 2024-09-12T16:16:27.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037218257999999997, 2024-09-12T16:16:27.064 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.064 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.064 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:27.064 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:27.064 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:27.064 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:27.064 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2299 2024-09-12T16:16:27.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.065 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896004+0000", 2024-09-12T16:16:27.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896004+0000", 2024-09-12T16:16:27.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896005+0000", 2024-09-12T16:16:27.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3700000000000001e-07 2024-09-12T16:16:27.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896006+0000", 2024-09-12T16:16:27.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9929999999999998e-06 2024-09-12T16:16:27.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896013+0000", 2024-09-12T16:16:27.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1709999999999999e-06 2024-09-12T16:16:27.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896017+0000", 2024-09-12T16:16:27.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5050000000000001e-06 2024-09-12T16:16:27.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933142+0000", 2024-09-12T16:16:27.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037125012999999998 2024-09-12T16:16:27.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:27.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933182+0000", 2024-09-12T16:16:27.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9957999999999999e-05 2024-09-12T16:16:27.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933222+0000", 2024-09-12T16:16:27.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0181e-05 2024-09-12T16:16:27.068 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.068 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.068 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.068 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2300 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12372992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:27.068 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:16:27.068 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1572503130000005, 2024-09-12T16:16:27.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037401246999999999, 2024-09-12T16:16:27.068 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.068 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.068 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:27.068 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:27.069 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:27.069 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:27.069 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2300 2024-09-12T16:16:27.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.069 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:16:27.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:16:27.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:16:27.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6100000000000002e-07 2024-09-12T16:16:27.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896026+0000", 2024-09-12T16:16:27.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9130000000000001e-06 2024-09-12T16:16:27.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896032+0000", 2024-09-12T16:16:27.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7540000000000003e-06 2024-09-12T16:16:27.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896036+0000", 2024-09-12T16:16:27.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5750000000000002e-06 2024-09-12T16:16:27.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933254+0000", 2024-09-12T16:16:27.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037217962 2024-09-12T16:16:27.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:27.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933341+0000", 2024-09-12T16:16:27.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6296000000000002e-05 2024-09-12T16:16:27.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933425+0000", 2024-09-12T16:16:27.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4386000000000001e-05 2024-09-12T16:16:27.072 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.072 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.072 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.073 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2301 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12377088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:27.073 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896043+0000", 2024-09-12T16:16:27.073 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1572305709999995, 2024-09-12T16:16:27.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037486197999999998, 2024-09-12T16:16:27.073 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.073 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.073 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:27.073 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:27.073 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:27.073 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:27.073 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2301 2024-09-12T16:16:27.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.073 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896043+0000", 2024-09-12T16:16:27.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896043+0000", 2024-09-12T16:16:27.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896044+0000", 2024-09-12T16:16:27.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.41e-07 2024-09-12T16:16:27.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896053+0000", 2024-09-12T16:16:27.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8049999999999996e-06 2024-09-12T16:16:27.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896060+0000", 2024-09-12T16:16:27.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.221e-06 2024-09-12T16:16:27.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896065+0000", 2024-09-12T16:16:27.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1109999999999999e-06 2024-09-12T16:16:27.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.076 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.076 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933452+0000", 2024-09-12T16:16:27.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037386560999999999 2024-09-12T16:16:27.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.076 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:27.076 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933491+0000", 2024-09-12T16:16:27.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9789000000000001e-05 2024-09-12T16:16:27.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.076 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.076 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933530+0000", 2024-09-12T16:16:27.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.837e-05 2024-09-12T16:16:27.077 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.077 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.077 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.077 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2302 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12381184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:27.077 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:16:27.077 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1571891310000009, 2024-09-12T16:16:27.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037645284000000001, 2024-09-12T16:16:27.077 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.077 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.077 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:27.077 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:27.078 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:27.078 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:27.078 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2302 2024-09-12T16:16:27.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.078 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:16:27.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:16:27.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:16:27.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6800000000000001e-07 2024-09-12T16:16:27.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896088+0000", 2024-09-12T16:16:27.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3429999999999998e-06 2024-09-12T16:16:27.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896096+0000", 2024-09-12T16:16:27.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0860000000000002e-06 2024-09-12T16:16:27.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896102+0000", 2024-09-12T16:16:27.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7610000000000004e-06 2024-09-12T16:16:27.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.081 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.081 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933563+0000", 2024-09-12T16:16:27.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037461019999999998 2024-09-12T16:16:27.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.081 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:27.081 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933648+0000", 2024-09-12T16:16:27.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5468000000000002e-05 2024-09-12T16:16:27.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.081 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.081 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933730+0000", 2024-09-12T16:16:27.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2138000000000005e-05 2024-09-12T16:16:27.082 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.082 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.082 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.082 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2303 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12385280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:27.082 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:16:27.082 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1571653289999997, 2024-09-12T16:16:27.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037723083999999997, 2024-09-12T16:16:27.082 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.082 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.082 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:27.083 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:27.083 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:27.083 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:27.083 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2303 2024-09-12T16:16:27.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.083 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:16:27.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:16:27.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:16:27.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2500000000000001e-07 2024-09-12T16:16:27.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896115+0000", 2024-09-12T16:16:27.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.28e-06 2024-09-12T16:16:27.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896122+0000", 2024-09-12T16:16:27.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4590000000000003e-06 2024-09-12T16:16:27.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896127+0000", 2024-09-12T16:16:27.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0509999999999996e-06 2024-09-12T16:16:27.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933755+0000", 2024-09-12T16:16:27.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037627729999999998 2024-09-12T16:16:27.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:27.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933794+0000", 2024-09-12T16:16:27.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9255000000000003e-05 2024-09-12T16:16:27.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933832+0000", 2024-09-12T16:16:27.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7883999999999998e-05 2024-09-12T16:16:27.086 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.087 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.087 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.087 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2304 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12389376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:27.087 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:16:27.087 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1571399800000002, 2024-09-12T16:16:27.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037911010000000002, 2024-09-12T16:16:27.087 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.087 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.087 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:27.087 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:27.087 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:27.087 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:27.088 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2304 2024-09-12T16:16:27.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.088 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:16:27.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:16:27.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:16:27.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9900000000000001e-07 2024-09-12T16:16:27.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896136+0000", 2024-09-12T16:16:27.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.897e-06 2024-09-12T16:16:27.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896142+0000", 2024-09-12T16:16:27.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9290000000000003e-06 2024-09-12T16:16:27.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896154+0000", 2024-09-12T16:16:27.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.201e-05 2024-09-12T16:16:27.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933865+0000", 2024-09-12T16:16:27.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037710225 2024-09-12T16:16:27.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:27.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933961+0000", 2024-09-12T16:16:27.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6315000000000002e-05 2024-09-12T16:16:27.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934045+0000", 2024-09-12T16:16:27.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4234999999999996e-05 2024-09-12T16:16:27.091 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.091 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.091 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.091 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2305 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12393472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:27.091 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896175+0000", 2024-09-12T16:16:27.091 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1570987899999992, 2024-09-12T16:16:27.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037976941, 2024-09-12T16:16:27.092 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.092 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.092 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:27.092 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:27.092 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:27.092 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:27.092 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2305 2024-09-12T16:16:27.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.092 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896175+0000", 2024-09-12T16:16:27.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896175+0000", 2024-09-12T16:16:27.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896176+0000", 2024-09-12T16:16:27.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7400000000000003e-07 2024-09-12T16:16:27.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896178+0000", 2024-09-12T16:16:27.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6709999999999999e-06 2024-09-12T16:16:27.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896186+0000", 2024-09-12T16:16:27.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9319999999999996e-06 2024-09-12T16:16:27.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896192+0000", 2024-09-12T16:16:27.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0799999999999996e-06 2024-09-12T16:16:27.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.095 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934072+0000", 2024-09-12T16:16:27.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037880888000000001 2024-09-12T16:16:27.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:27.095 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934113+0000", 2024-09-12T16:16:27.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0815999999999997e-05 2024-09-12T16:16:27.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.095 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934152+0000", 2024-09-12T16:16:27.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8980000000000003e-05 2024-09-12T16:16:27.096 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.096 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.096 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.096 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2306 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12397568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:27.096 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:16:27.096 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1570745119999994, 2024-09-12T16:16:27.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038156347, 2024-09-12T16:16:27.096 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.096 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.096 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:27.096 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:27.097 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:27.097 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:27.097 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2306 2024-09-12T16:16:27.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.097 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:16:27.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:16:27.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:16:27.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.77e-07 2024-09-12T16:16:27.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896202+0000", 2024-09-12T16:16:27.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2359999999999999e-06 2024-09-12T16:16:27.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896208+0000", 2024-09-12T16:16:27.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1430000000000003e-06 2024-09-12T16:16:27.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896213+0000", 2024-09-12T16:16:27.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9339999999999997e-06 2024-09-12T16:16:27.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934188+0000", 2024-09-12T16:16:27.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037974490999999999 2024-09-12T16:16:27.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:27.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934275+0000", 2024-09-12T16:16:27.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7639999999999994e-05 2024-09-12T16:16:27.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934356+0000", 2024-09-12T16:16:27.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0525999999999994e-05 2024-09-12T16:16:27.100 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.100 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.100 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.100 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2307 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12401664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:27.101 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:16:27.101 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1570547399999995, 2024-09-12T16:16:27.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038241450000000003, 2024-09-12T16:16:27.101 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.101 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.101 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:27.101 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:27.101 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:27.101 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:27.101 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2307 2024-09-12T16:16:27.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.101 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:16:27.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:16:27.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896220+0000", 2024-09-12T16:16:27.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3500000000000002e-07 2024-09-12T16:16:27.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896222+0000", 2024-09-12T16:16:27.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1720000000000001e-06 2024-09-12T16:16:27.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896228+0000", 2024-09-12T16:16:27.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0870000000000003e-06 2024-09-12T16:16:27.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.104 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896233+0000", 2024-09-12T16:16:27.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:16:27.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.104 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.104 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934382+0000", 2024-09-12T16:16:27.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038149566000000003 2024-09-12T16:16:27.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.104 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:27.104 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934422+0000", 2024-09-12T16:16:27.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0015999999999998e-05 2024-09-12T16:16:27.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.105 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934461+0000", 2024-09-12T16:16:27.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8423999999999997e-05 2024-09-12T16:16:27.105 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.105 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.105 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.105 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2308 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12405760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:27.105 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:16:27.105 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1570350430000005, 2024-09-12T16:16:27.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038420745999999999, 2024-09-12T16:16:27.105 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.106 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.106 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:27.106 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:27.106 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:27.106 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:27.106 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2308 2024-09-12T16:16:27.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.106 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:16:27.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:16:27.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:16:27.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.58e-07 2024-09-12T16:16:27.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896241+0000", 2024-09-12T16:16:27.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7940000000000001e-06 2024-09-12T16:16:27.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896247+0000", 2024-09-12T16:16:27.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1460000000000001e-06 2024-09-12T16:16:27.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896252+0000", 2024-09-12T16:16:27.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6840000000000004e-06 2024-09-12T16:16:27.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934494+0000", 2024-09-12T16:16:27.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038242362000000002 2024-09-12T16:16:27.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:27.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934579+0000", 2024-09-12T16:16:27.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5044999999999996e-05 2024-09-12T16:16:27.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934660+0000", 2024-09-12T16:16:27.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0357000000000003e-05 2024-09-12T16:16:27.110 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.110 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.110 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.110 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2309 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12409856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:27.110 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:16:27.110 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1570144629999994, 2024-09-12T16:16:27.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038504629999999998, 2024-09-12T16:16:27.110 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.110 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.110 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:27.111 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:27.111 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:27.111 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:27.111 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2309 2024-09-12T16:16:27.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.111 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:16:27.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:16:27.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.112 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.112 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:16:27.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5199999999999998e-07 2024-09-12T16:16:27.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.112 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.112 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896263+0000", 2024-09-12T16:16:27.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4209999999999999e-06 2024-09-12T16:16:27.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896269+0000", 2024-09-12T16:16:27.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9449999999999998e-06 2024-09-12T16:16:27.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896274+0000", 2024-09-12T16:16:27.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3950000000000003e-06 2024-09-12T16:16:27.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934686+0000", 2024-09-12T16:16:27.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038412333999999999 2024-09-12T16:16:27.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:27.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934727+0000", 2024-09-12T16:16:27.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0649999999999999e-05 2024-09-12T16:16:27.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934764+0000", 2024-09-12T16:16:27.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7533000000000001e-05 2024-09-12T16:16:27.114 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.114 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.115 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.115 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2310 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12413952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:27.115 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:16:27.115 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1569935909999991, 2024-09-12T16:16:27.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038694183, 2024-09-12T16:16:27.115 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.115 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.115 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:27.115 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:27.115 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:27.115 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:27.116 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2310 2024-09-12T16:16:27.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.116 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:16:27.116 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:16:27.116 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.117 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.117 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896281+0000", 2024-09-12T16:16:27.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1399999999999997e-07 2024-09-12T16:16:27.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.117 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.117 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896283+0000", 2024-09-12T16:16:27.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9549999999999999e-06 2024-09-12T16:16:27.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.117 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.117 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896289+0000", 2024-09-12T16:16:27.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8669999999999999e-06 2024-09-12T16:16:27.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.118 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.118 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896301+0000", 2024-09-12T16:16:27.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1807999999999999e-05 2024-09-12T16:16:27.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.118 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.118 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934798+0000", 2024-09-12T16:16:27.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038497591999999997 2024-09-12T16:16:27.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.118 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:27.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934885+0000", 2024-09-12T16:16:27.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7149000000000002e-05 2024-09-12T16:16:27.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934975+0000", 2024-09-12T16:16:27.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9297999999999998e-05 2024-09-12T16:16:27.119 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.119 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.119 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.119 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2311 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12418048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:27.119 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:16:27.119 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1569663349999999, 2024-09-12T16:16:27.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038768558000000002, 2024-09-12T16:16:27.120 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.120 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.120 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:27.120 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:27.120 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:27.120 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:27.120 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2311 2024-09-12T16:16:27.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.120 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.120 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.120 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.120 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:16:27.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.121 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:16:27.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.121 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:16:27.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.63e-07 2024-09-12T16:16:27.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896310+0000", 2024-09-12T16:16:27.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1560000000000002e-06 2024-09-12T16:16:27.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896316+0000", 2024-09-12T16:16:27.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0249999999999999e-06 2024-09-12T16:16:27.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896322+0000", 2024-09-12T16:16:27.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6400000000000002e-06 2024-09-12T16:16:27.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934997+0000", 2024-09-12T16:16:27.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038674565000000001 2024-09-12T16:16:27.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:27.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935037+0000", 2024-09-12T16:16:27.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0485999999999998e-05 2024-09-12T16:16:27.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.124 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935076+0000", 2024-09-12T16:16:27.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9223e-05 2024-09-12T16:16:27.124 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.124 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.124 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.124 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2312 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12422144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:27.124 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:16:27.124 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1569456420000002, 2024-09-12T16:16:27.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038856784999999998, 2024-09-12T16:16:27.124 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.124 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.125 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:27.125 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:27.125 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:27.125 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:27.125 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2312 2024-09-12T16:16:27.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.125 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.125 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:16:27.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.126 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:16:27.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.126 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.126 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896329+0000", 2024-09-12T16:16:27.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5499999999999999e-07 2024-09-12T16:16:27.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.126 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.126 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896337+0000", 2024-09-12T16:16:27.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0819999999999999e-06 2024-09-12T16:16:27.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.127 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.127 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896343+0000", 2024-09-12T16:16:27.127 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.263e-06 2024-09-12T16:16:27.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.127 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.127 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896348+0000", 2024-09-12T16:16:27.127 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8860000000000003e-06 2024-09-12T16:16:27.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.127 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.127 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935097+0000", 2024-09-12T16:16:27.127 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038748818999999997 2024-09-12T16:16:27.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.128 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:27.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935141+0000", 2024-09-12T16:16:27.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4175000000000003e-05 2024-09-12T16:16:27.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.128 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935185+0000", 2024-09-12T16:16:27.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4205000000000001e-05 2024-09-12T16:16:27.128 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.128 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.128 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.128 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2313 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12426240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:27.129 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:16:27.129 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1569194270000001, 2024-09-12T16:16:27.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038928683999999998, 2024-09-12T16:16:27.129 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.129 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.129 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:27.129 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:27.129 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:27.129 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:27.129 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2313 2024-09-12T16:16:27.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.129 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.130 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.130 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:16:27.130 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.130 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.130 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:16:27.130 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.130 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.130 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:16:27.130 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0400000000000002e-07 2024-09-12T16:16:27.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.131 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.131 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896357+0000", 2024-09-12T16:16:27.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.097e-06 2024-09-12T16:16:27.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.131 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.131 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896363+0000", 2024-09-12T16:16:27.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5119999999999999e-06 2024-09-12T16:16:27.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.131 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.131 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896374+0000", 2024-09-12T16:16:27.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1381e-05 2024-09-12T16:16:27.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935205+0000", 2024-09-12T16:16:27.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038830549999999998 2024-09-12T16:16:27.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:27.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935244+0000", 2024-09-12T16:16:27.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9520000000000001e-05 2024-09-12T16:16:27.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.133 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.133 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935283+0000", 2024-09-12T16:16:27.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9220000000000001e-05 2024-09-12T16:16:27.133 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.133 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.133 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.133 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2314 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12430336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:27.133 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:16:27.133 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1568822569999995, 2024-09-12T16:16:27.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039008137999999998, 2024-09-12T16:16:27.133 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.133 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.134 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:27.134 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:27.134 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:27.134 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:27.134 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2314 2024-09-12T16:16:27.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.134 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.134 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.134 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:16:27.134 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.134 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.135 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:16:27.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.135 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.135 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:16:27.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6499999999999999e-07 2024-09-12T16:16:27.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.135 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.135 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896395+0000", 2024-09-12T16:16:27.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2960000000000001e-06 2024-09-12T16:16:27.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896402+0000", 2024-09-12T16:16:27.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2280000000000001e-06 2024-09-12T16:16:27.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896407+0000", 2024-09-12T16:16:27.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3630000000000002e-06 2024-09-12T16:16:27.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935302+0000", 2024-09-12T16:16:27.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038895181000000001 2024-09-12T16:16:27.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.137 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:27.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935343+0000", 2024-09-12T16:16:27.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0590999999999998e-05 2024-09-12T16:16:27.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.137 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935400+0000", 2024-09-12T16:16:27.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7014e-05 2024-09-12T16:16:27.137 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.138 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.138 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.138 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2315 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12434432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:27.138 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:16:27.138 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1568596059999994, 2024-09-12T16:16:27.138 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039083892000000002, 2024-09-12T16:16:27.138 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.138 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.138 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:27.139 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:27.139 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:27.139 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:27.139 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2315 2024-09-12T16:16:27.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.139 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.139 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.139 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:16:27.139 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:16:27.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896415+0000", 2024-09-12T16:16:27.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3300000000000002e-07 2024-09-12T16:16:27.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896421+0000", 2024-09-12T16:16:27.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7579999999999998e-06 2024-09-12T16:16:27.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.141 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896427+0000", 2024-09-12T16:16:27.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3029999999999996e-06 2024-09-12T16:16:27.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.141 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896432+0000", 2024-09-12T16:16:27.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.215e-06 2024-09-12T16:16:27.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.142 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935420+0000", 2024-09-12T16:16:27.142 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038987727 2024-09-12T16:16:27.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.142 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:27.142 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935460+0000", 2024-09-12T16:16:27.142 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9817999999999997e-05 2024-09-12T16:16:27.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.142 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.142 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935498+0000", 2024-09-12T16:16:27.142 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8438e-05 2024-09-12T16:16:27.142 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.142 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.143 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.143 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.143 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2316 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12438528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:27.143 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:16:27.143 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1568349540000007, 2024-09-12T16:16:27.143 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039160043999999998, 2024-09-12T16:16:27.143 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.143 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.143 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:27.143 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:27.143 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:27.143 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:27.144 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2316 2024-09-12T16:16:27.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.144 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.144 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.144 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:16:27.144 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.144 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.144 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:16:27.144 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.145 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.145 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901945+0000", 2024-09-12T16:16:27.145 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055056050000000002 2024-09-12T16:16:27.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.145 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.145 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901950+0000", 2024-09-12T16:16:27.145 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2490000000000001e-06 2024-09-12T16:16:27.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.145 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.148 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901966+0000", 2024-09-12T16:16:27.148 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6325e-05 2024-09-12T16:16:27.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.148 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.148 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.148 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901974+0000", 2024-09-12T16:16:27.148 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7570000000000004e-06 2024-09-12T16:16:27.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.149 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.149 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.149 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935518+0000", 2024-09-12T16:16:27.149 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033543587999999999 2024-09-12T16:16:27.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.149 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.149 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:27.149 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935559+0000", 2024-09-12T16:16:27.149 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1746000000000003e-05 2024-09-12T16:16:27.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.149 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.149 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.149 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935599+0000", 2024-09-12T16:16:27.149 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9774000000000002e-05 2024-09-12T16:16:27.150 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.150 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.150 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.150 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.150 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.150 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:27.152 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:16:27.153 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:27.150+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:27.153 INFO:teuthology.orchestra.run.smithi204.stdout:1591 write 0x5125600 thru 0x5133fd6 (0xe9d7 bytes) 2024-09-12T16:16:27.153 INFO:teuthology.orchestra.run.smithi204.stdout:1592 write 0x4b65c00 thru 0x4b6cfff (0x7400 bytes) 2024-09-12T16:16:27.154 INFO:teuthology.orchestra.run.smithi204.stdout:1593 punch from 0x471e200 to 0x472c200, (0xe000 bytes) 2024-09-12T16:16:27.154 INFO:teuthology.orchestra.run.smithi204.stdout:1599 write 0x309f800 thru 0x30a7500 (0x7d01 bytes) 2024-09-12T16:16:27.154 INFO:teuthology.orchestra.run.smithi204.stdout:1600 trunc from 0xe606800 to 0x3c04a00 2024-09-12T16:16:27.154 INFO:teuthology.orchestra.run.smithi204.stdout:1602 read 0x2744e00 thru 0x274885e (0x3a5f bytes) 2024-09-12T16:16:27.154 INFO:teuthology.orchestra.run.smithi204.stdout:1604 punch from 0x376de00 to 0x3775800, (0x7a00 bytes) 2024-09-12T16:16:27.154 INFO:teuthology.orchestra.run.smithi204.stdout:1605 write 0x665e000 thru 0x666b79e (0xd79f bytes) 2024-09-12T16:16:27.154 INFO:teuthology.orchestra.run.smithi204.stdout:1606 write 0x6d54a00 thru 0x6d632a8 (0xe8a9 bytes) 2024-09-12T16:16:27.154 INFO:teuthology.orchestra.run.smithi204.stdout:1607 write 0x4252e00 thru 0x425556c (0x276d bytes) 2024-09-12T16:16:27.154 INFO:teuthology.orchestra.run.smithi204.stdout:1608 read 0x64bf600 thru 0x64c6dd3 (0x77d4 bytes) 2024-09-12T16:16:27.154 INFO:teuthology.orchestra.run.smithi204.stdout:1610 read 0x2873400 thru 0x2879b9c (0x679d bytes) 2024-09-12T16:16:27.154 INFO:teuthology.orchestra.run.smithi204.stdout:1614 trunc from 0x6d63400 to 0x1df800 2024-09-12T16:16:27.209 INFO:teuthology.orchestra.run.smithi204.stdout:1615 write 0xaceaa00 thru 0xacf5192 (0xa793 bytes) 2024-09-12T16:16:27.209 INFO:teuthology.orchestra.run.smithi204.stdout:1616 read 0x9911600 thru 0x991c820 (0xb221 bytes) 2024-09-12T16:16:27.209 INFO:teuthology.orchestra.run.smithi204.stdout:1618 punch from 0x5bd5800 to 0x5bdec00, (0x9400 bytes) 2024-09-12T16:16:27.220 INFO:teuthology.orchestra.run.smithi204.stdout:1621 trunc from 0xacf5200 to 0x1a50c00 2024-09-12T16:16:27.242 INFO:teuthology.orchestra.run.smithi204.stdout:1622 read 0x1203800 thru 0x120b532 (0x7d33 bytes) 2024-09-12T16:16:27.252 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:27.251+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:27.264 INFO:teuthology.orchestra.run.smithi204.stdout:1624 write 0x78ad200 thru 0x78af693 (0x2494 bytes) 2024-09-12T16:16:27.264 INFO:teuthology.orchestra.run.smithi204.stdout:1626 write 0x4bb3c00 thru 0x4bbd601 (0x9a02 bytes) 2024-09-12T16:16:27.278 INFO:teuthology.orchestra.run.smithi204.stdout:1628 write 0x8027c00 thru 0x802f23f (0x7640 bytes) 2024-09-12T16:16:27.279 INFO:teuthology.orchestra.run.smithi204.stdout:1630 read 0x2601200 thru 0x2609f9e (0x8d9f bytes) 2024-09-12T16:16:27.279 INFO:teuthology.orchestra.run.smithi204.stdout:1632 punch from 0x4fdb600 to 0x4feac00, (0xf600 bytes) 2024-09-12T16:16:27.288 INFO:teuthology.orchestra.run.smithi204.stdout:1636 trunc from 0x802f400 to 0x94f400 2024-09-12T16:16:27.310 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:27.311 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:27.311 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:16:27.311 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:27.319 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:16:27.331 INFO:teuthology.orchestra.run.smithi204.stdout:1637 write 0xe6ce200 thru 0xe6ce666 (0x467 bytes) 2024-09-12T16:16:27.331 INFO:teuthology.orchestra.run.smithi204.stdout:1638 write 0xdef0a00 thru 0xdef36a3 (0x2ca4 bytes) 2024-09-12T16:16:27.341 INFO:teuthology.orchestra.run.smithi204.stdout:1642 trunc from 0xe6ce800 to 0x5f1be00 2024-09-12T16:16:27.358 INFO:teuthology.orchestra.run.smithi204.stdout:1644 read 0x56e0000 thru 0x56eaa4a (0xaa4b bytes) 2024-09-12T16:16:27.363 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:27.362+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:27.377 INFO:teuthology.orchestra.run.smithi204.stdout:1646 write 0x90f0a00 thru 0x90f6dbd (0x63be bytes) 2024-09-12T16:16:27.382 INFO:teuthology.orchestra.run.smithi204.stdout:1650 punch from 0x156b000 to 0x156ba00, (0xa00 bytes) 2024-09-12T16:16:27.383 INFO:teuthology.orchestra.run.smithi204.stdout:1653 read 0x11e00 thru 0x1fd93 (0xdf94 bytes) 2024-09-12T16:16:27.383 INFO:teuthology.orchestra.run.smithi204.stdout:1654 read 0x41e6600 thru 0x41e9549 (0x2f4a bytes) 2024-09-12T16:16:27.383 INFO:teuthology.orchestra.run.smithi204.stdout:1656 read 0x449aa00 thru 0x44a619a (0xb79b bytes) 2024-09-12T16:16:27.396 INFO:teuthology.orchestra.run.smithi204.stdout:1657 write 0x98ed000 thru 0x98f171a (0x471b bytes) 2024-09-12T16:16:27.401 INFO:teuthology.orchestra.run.smithi204.stdout:1659 punch from 0x7fc1200 to 0x7fd0400, (0xf200 bytes) 2024-09-12T16:16:27.402 INFO:teuthology.orchestra.run.smithi204.stdout:1663 read 0x96a2200 thru 0x96a3075 (0xe76 bytes) 2024-09-12T16:16:27.402 INFO:teuthology.orchestra.run.smithi204.stdout:1664 read 0x34e5200 thru 0x34f0bfc (0xb9fd bytes) 2024-09-12T16:16:27.402 INFO:teuthology.orchestra.run.smithi204.stdout:1665 punch from 0x611fc00 to 0x612b600, (0xba00 bytes) 2024-09-12T16:16:27.402 INFO:teuthology.orchestra.run.smithi204.stdout:1666 read 0x7cfec00 thru 0x7cff27b (0x67c bytes) 2024-09-12T16:16:27.402 INFO:teuthology.orchestra.run.smithi204.stdout:1668 write 0x5c1cc00 thru 0x5c251f5 (0x85f6 bytes) 2024-09-12T16:16:27.402 INFO:teuthology.orchestra.run.smithi204.stdout:1670 write 0xb2b600 thru 0xb32734 (0x7135 bytes) 2024-09-12T16:16:27.403 INFO:teuthology.orchestra.run.smithi204.stdout:1673 trunc from 0x98f1800 to 0x84ee200 2024-09-12T16:16:27.421 INFO:teuthology.orchestra.run.smithi204.stdout:1674 write 0x13e3800 thru 0x13ef420 (0xbc21 bytes) 2024-09-12T16:16:27.426 INFO:teuthology.orchestra.run.smithi204.stdout:1676 write 0x42fe800 thru 0x4302628 (0x3e29 bytes) 2024-09-12T16:16:27.426 INFO:teuthology.orchestra.run.smithi204.stdout:1680 write 0x14a8400 thru 0x14ab662 (0x3263 bytes) 2024-09-12T16:16:27.427 INFO:teuthology.orchestra.run.smithi204.stdout:1683 trunc from 0x84ee200 to 0x768d200 2024-09-12T16:16:27.437 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:27.438 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:27.438 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:16:27.438 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:16:27.438 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:27.445 INFO:teuthology.orchestra.run.smithi204.stdout:1686 read 0x1c3b600 thru 0x1c3d8e1 (0x22e2 bytes) 2024-09-12T16:16:27.447 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:16:27.450 INFO:teuthology.orchestra.run.smithi204.stdout:1687 read 0x5ca8c00 thru 0x5cb3aa1 (0xaea2 bytes) 2024-09-12T16:16:27.450 INFO:teuthology.orchestra.run.smithi204.stdout:1688 read 0x2e47e00 thru 0x2e4a78d (0x298e bytes) 2024-09-12T16:16:27.451 INFO:teuthology.orchestra.run.smithi204.stdout:1689 read 0x35b000 thru 0x35e0fa (0x30fb bytes) 2024-09-12T16:16:27.451 INFO:teuthology.orchestra.run.smithi204.stdout:1690 write 0x32dc600 thru 0x32dd952 (0x1353 bytes) 2024-09-12T16:16:27.451 INFO:teuthology.orchestra.run.smithi204.stdout:1692 punch from 0x4473400 to 0x447d000, (0x9c00 bytes) 2024-09-12T16:16:27.454 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:27.453+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:27.458 INFO:teuthology.orchestra.run.smithi204.stdout:1693 trunc from 0x768d200 to 0xde8400 2024-09-12T16:16:27.474 INFO:teuthology.orchestra.run.smithi204.stdout:1694 trunc from 0xde8400 to 0x25a6e00 2024-09-12T16:16:27.504 INFO:teuthology.orchestra.run.smithi204.stdout:1697 write 0x8a19800 thru 0x8a283d8 (0xebd9 bytes) 2024-09-12T16:16:27.509 INFO:teuthology.orchestra.run.smithi204.stdout:1700 read 0x70e9600 thru 0x70f8459 (0xee5a bytes) 2024-09-12T16:16:27.515 INFO:teuthology.orchestra.run.smithi204.stdout:1701 trunc from 0x8a28400 to 0x416a600 2024-09-12T16:16:27.530 INFO:teuthology.orchestra.run.smithi204.stdout:1703 punch from 0x2d87000 to 0x2d88000, (0x1000 bytes) 2024-09-12T16:16:27.548 INFO:teuthology.orchestra.run.smithi204.stdout:1705 write 0xaa43c00 thru 0xaa4f04e (0xb44f bytes) 2024-09-12T16:16:27.549 INFO:teuthology.orchestra.run.smithi204.stdout:1707 write 0x337a800 thru 0x33848e4 (0xa0e5 bytes) 2024-09-12T16:16:27.550 INFO:teuthology.orchestra.run.smithi204.stdout:1708 write 0xa82800 thru 0xa8a926 (0x8127 bytes) 2024-09-12T16:16:27.557 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:27.556+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:27.557 INFO:teuthology.orchestra.run.smithi204.stdout:1712 trunc from 0xaa4f200 to 0x47af600 2024-09-12T16:16:27.575 INFO:teuthology.orchestra.run.smithi204.stdout:1713 read 0x3d40000 thru 0x3d4b3ee (0xb3ef bytes) 2024-09-12T16:16:27.585 INFO:teuthology.orchestra.run.smithi204.stdout:1716 write 0x5e65400 thru 0x5e65a36 (0x637 bytes) 2024-09-12T16:16:27.605 INFO:teuthology.orchestra.run.smithi204.stdout:1717 write 0xbc8ee00 thru 0xbc95bcf (0x6dd0 bytes) 2024-09-12T16:16:27.611 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:27.611 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:16:27.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:16:27.612 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:27.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.612 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:3893 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 409600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:27.612 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.336389+0000", 2024-09-12T16:16:27.612 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.273666347999999, 2024-09-12T16:16:27.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0045550920000000002, 2024-09-12T16:16:27.612 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.612 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.612 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:27.612 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:27.612 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:27.612 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:27.612 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3893 2024-09-12T16:16:27.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.613 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.613 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.613 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336389+0000", 2024-09-12T16:16:27.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.613 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.613 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336389+0000", 2024-09-12T16:16:27.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.614 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336389+0000", 2024-09-12T16:16:27.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1799999999999999e-07 2024-09-12T16:16:27.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.614 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336390+0000", 2024-09-12T16:16:27.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.082e-06 2024-09-12T16:16:27.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.614 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336393+0000", 2024-09-12T16:16:27.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9849999999999998e-06 2024-09-12T16:16:27.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336395+0000", 2024-09-12T16:16:27.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3460000000000001e-06 2024-09-12T16:16:27.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.339585+0000", 2024-09-12T16:16:27.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031895449999999998 2024-09-12T16:16:27.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:27.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340868+0000", 2024-09-12T16:16:27.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012825009999999999 2024-09-12T16:16:27.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340944+0000", 2024-09-12T16:16:27.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6415000000000006e-05 2024-09-12T16:16:27.616 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.616 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.616 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.616 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:3894 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 466944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:27.616 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.336399+0000", 2024-09-12T16:16:27.616 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.273656532, 2024-09-12T16:16:27.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0047051489999999996, 2024-09-12T16:16:27.617 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.617 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.617 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:27.617 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:27.617 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:27.617 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:27.617 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3894 2024-09-12T16:16:27.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.617 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.617 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336399+0000", 2024-09-12T16:16:27.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.618 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336399+0000", 2024-09-12T16:16:27.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.618 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336399+0000", 2024-09-12T16:16:27.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.34e-07 2024-09-12T16:16:27.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336400+0000", 2024-09-12T16:16:27.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.029e-06 2024-09-12T16:16:27.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336403+0000", 2024-09-12T16:16:27.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.078e-06 2024-09-12T16:16:27.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336405+0000", 2024-09-12T16:16:27.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.34e-06 2024-09-12T16:16:27.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340975+0000", 2024-09-12T16:16:27.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.004569348 2024-09-12T16:16:27.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:27.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341043+0000", 2024-09-12T16:16:27.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8202999999999997e-05 2024-09-12T16:16:27.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341104+0000", 2024-09-12T16:16:27.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0917e-05 2024-09-12T16:16:27.621 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.621 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.621 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.621 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:3895 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 483328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:27.621 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.336409+0000", 2024-09-12T16:16:27.621 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.273646617000001, 2024-09-12T16:16:27.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0048548549999999999, 2024-09-12T16:16:27.621 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.621 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.621 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:27.621 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:27.622 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:27.622 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:27.622 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3895 2024-09-12T16:16:27.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.622 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336409+0000", 2024-09-12T16:16:27.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336409+0000", 2024-09-12T16:16:27.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336409+0000", 2024-09-12T16:16:27.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2499999999999999e-07 2024-09-12T16:16:27.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336410+0000", 2024-09-12T16:16:27.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0139999999999999e-06 2024-09-12T16:16:27.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336413+0000", 2024-09-12T16:16:27.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.038e-06 2024-09-12T16:16:27.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336415+0000", 2024-09-12T16:16:27.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2680000000000001e-06 2024-09-12T16:16:27.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341132+0000", 2024-09-12T16:16:27.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0047171560000000001 2024-09-12T16:16:27.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:27.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341200+0000", 2024-09-12T16:16:27.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7910000000000005e-05 2024-09-12T16:16:27.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341263+0000", 2024-09-12T16:16:27.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3244000000000006e-05 2024-09-12T16:16:27.625 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.625 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.625 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.625 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:3896 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 499712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:27.625 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.336421+0000", 2024-09-12T16:16:27.626 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.273634526999999, 2024-09-12T16:16:27.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0050030539999999998, 2024-09-12T16:16:27.626 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.626 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.626 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:27.626 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:27.626 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:27.626 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:27.626 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3896 2024-09-12T16:16:27.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.626 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336421+0000", 2024-09-12T16:16:27.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336421+0000", 2024-09-12T16:16:27.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336421+0000", 2024-09-12T16:16:27.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8700000000000001e-07 2024-09-12T16:16:27.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336423+0000", 2024-09-12T16:16:27.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.753e-06 2024-09-12T16:16:27.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336428+0000", 2024-09-12T16:16:27.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6149999999999996e-06 2024-09-12T16:16:27.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336433+0000", 2024-09-12T16:16:27.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5909999999999998e-06 2024-09-12T16:16:27.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341292+0000", 2024-09-12T16:16:27.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0048587470000000001 2024-09-12T16:16:27.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:27.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341358+0000", 2024-09-12T16:16:27.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6218999999999997e-05 2024-09-12T16:16:27.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341424+0000", 2024-09-12T16:16:27.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5741999999999995e-05 2024-09-12T16:16:27.630 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.630 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.630 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.630 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:3897 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 516096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:27.630 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.336440+0000", 2024-09-12T16:16:27.630 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.273615473, 2024-09-12T16:16:27.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.005179187, 2024-09-12T16:16:27.630 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.630 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.630 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:27.630 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:27.631 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:27.631 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:27.631 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3897 2024-09-12T16:16:27.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.631 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336440+0000", 2024-09-12T16:16:27.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336440+0000", 2024-09-12T16:16:27.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336440+0000", 2024-09-12T16:16:27.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7e-07 2024-09-12T16:16:27.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336442+0000", 2024-09-12T16:16:27.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1959999999999998e-06 2024-09-12T16:16:27.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336449+0000", 2024-09-12T16:16:27.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8179999999999998e-06 2024-09-12T16:16:27.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336454+0000", 2024-09-12T16:16:27.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1760000000000001e-06 2024-09-12T16:16:27.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341482+0000", 2024-09-12T16:16:27.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0050273460000000002 2024-09-12T16:16:27.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:27.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341552+0000", 2024-09-12T16:16:27.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0297999999999997e-05 2024-09-12T16:16:27.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341619+0000", 2024-09-12T16:16:27.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6983000000000006e-05 2024-09-12T16:16:27.634 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.634 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.634 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.634 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4125 3.5 3:a241af90:::rbd_data.11557ed36bb5.000000000000000f:4 [read 401408~6656] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:27.634 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.337967+0000", 2024-09-12T16:16:27.635 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.272088646, 2024-09-12T16:16:27.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003989467, 2024-09-12T16:16:27.635 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.635 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.635 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:27.635 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:27.635 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:27.635 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:27.635 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4125 2024-09-12T16:16:27.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.635 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337967+0000", 2024-09-12T16:16:27.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337967+0000", 2024-09-12T16:16:27.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337967+0000", 2024-09-12T16:16:27.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0900000000000002e-07 2024-09-12T16:16:27.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337975+0000", 2024-09-12T16:16:27.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6909999999999997e-06 2024-09-12T16:16:27.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337984+0000", 2024-09-12T16:16:27.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2720000000000003e-06 2024-09-12T16:16:27.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337990+0000", 2024-09-12T16:16:27.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3380000000000001e-06 2024-09-12T16:16:27.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340872+0000", 2024-09-12T16:16:27.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002882225 2024-09-12T16:16:27.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:27.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340944+0000", 2024-09-12T16:16:27.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1219999999999999e-05 2024-09-12T16:16:27.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341956+0000", 2024-09-12T16:16:27.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001012312 2024-09-12T16:16:27.639 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.639 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.639 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.639 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4126 3.5 3:a241af90:::rbd_data.11557ed36bb5.000000000000000f:4 [read 442368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:27.639 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.337999+0000", 2024-09-12T16:16:27.639 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.272055848000001, 2024-09-12T16:16:27.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0041510729999999999, 2024-09-12T16:16:27.639 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.639 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.639 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:27.639 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:27.639 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:27.639 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:27.640 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4126 2024-09-12T16:16:27.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.640 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337999+0000", 2024-09-12T16:16:27.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337999+0000", 2024-09-12T16:16:27.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338000+0000", 2024-09-12T16:16:27.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4000000000000002e-07 2024-09-12T16:16:27.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338002+0000", 2024-09-12T16:16:27.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.154e-06 2024-09-12T16:16:27.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338009+0000", 2024-09-12T16:16:27.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9059999999999996e-06 2024-09-12T16:16:27.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338014+0000", 2024-09-12T16:16:27.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7650000000000001e-06 2024-09-12T16:16:27.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342002+0000", 2024-09-12T16:16:27.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039884680000000002 2024-09-12T16:16:27.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:27.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342076+0000", 2024-09-12T16:16:27.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4023999999999995e-05 2024-09-12T16:16:27.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342150+0000", 2024-09-12T16:16:27.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4215999999999996e-05 2024-09-12T16:16:27.643 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.643 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.643 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.643 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4127 3.5 3:a241af90:::rbd_data.11557ed36bb5.000000000000000f:4 [read 458752~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:27.643 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.338021+0000", 2024-09-12T16:16:27.644 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.272034252000001, 2024-09-12T16:16:27.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042934399999999999, 2024-09-12T16:16:27.644 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.644 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.644 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:27.644 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:27.644 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:27.644 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:27.644 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4127 2024-09-12T16:16:27.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.644 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338021+0000", 2024-09-12T16:16:27.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338021+0000", 2024-09-12T16:16:27.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338021+0000", 2024-09-12T16:16:27.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9800000000000004e-07 2024-09-12T16:16:27.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338024+0000", 2024-09-12T16:16:27.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2809999999999998e-06 2024-09-12T16:16:27.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338031+0000", 2024-09-12T16:16:27.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1269999999999997e-06 2024-09-12T16:16:27.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338036+0000", 2024-09-12T16:16:27.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0329999999999999e-06 2024-09-12T16:16:27.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342181+0000", 2024-09-12T16:16:27.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.004144699 2024-09-12T16:16:27.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:27.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342247+0000", 2024-09-12T16:16:27.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6149000000000007e-05 2024-09-12T16:16:27.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342314+0000", 2024-09-12T16:16:27.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7652999999999998e-05 2024-09-12T16:16:27.647 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.647 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.647 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.648 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4128 3.5 3:a241af90:::rbd_data.11557ed36bb5.000000000000000f:4 [read 475136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:27.648 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.338043+0000", 2024-09-12T16:16:27.648 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.272012104000002, 2024-09-12T16:16:27.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0044450189999999997, 2024-09-12T16:16:27.648 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.648 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.648 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:27.648 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:27.648 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:27.648 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:27.648 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4128 2024-09-12T16:16:27.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.649 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338043+0000", 2024-09-12T16:16:27.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338043+0000", 2024-09-12T16:16:27.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338044+0000", 2024-09-12T16:16:27.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2599999999999998e-07 2024-09-12T16:16:27.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338046+0000", 2024-09-12T16:16:27.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9850000000000001e-06 2024-09-12T16:16:27.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338052+0000", 2024-09-12T16:16:27.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7410000000000003e-06 2024-09-12T16:16:27.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338058+0000", 2024-09-12T16:16:27.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5729999999999998e-06 2024-09-12T16:16:27.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342343+0000", 2024-09-12T16:16:27.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042855970000000004 2024-09-12T16:16:27.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:27.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342411+0000", 2024-09-12T16:16:27.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7619000000000004e-05 2024-09-12T16:16:27.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342488+0000", 2024-09-12T16:16:27.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7077999999999996e-05 2024-09-12T16:16:27.652 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.652 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.652 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.652 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4129 3.5 3:a241af90:::rbd_data.11557ed36bb5.000000000000000f:4 [read 491520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:27.652 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.338065+0000", 2024-09-12T16:16:27.652 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.271989799, 2024-09-12T16:16:27.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.004581819, 2024-09-12T16:16:27.653 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.653 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.653 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:27.653 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:27.653 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:27.653 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:27.653 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4129 2024-09-12T16:16:27.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.653 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338065+0000", 2024-09-12T16:16:27.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338065+0000", 2024-09-12T16:16:27.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338066+0000", 2024-09-12T16:16:27.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-07 2024-09-12T16:16:27.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338068+0000", 2024-09-12T16:16:27.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4820000000000001e-06 2024-09-12T16:16:27.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338075+0000", 2024-09-12T16:16:27.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.08e-06 2024-09-12T16:16:27.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338081+0000", 2024-09-12T16:16:27.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2939999999999996e-06 2024-09-12T16:16:27.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342515+0000", 2024-09-12T16:16:27.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0044338720000000002 2024-09-12T16:16:27.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:27.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342582+0000", 2024-09-12T16:16:27.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6962e-05 2024-09-12T16:16:27.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342647+0000", 2024-09-12T16:16:27.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5643999999999997e-05 2024-09-12T16:16:27.657 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.657 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.657 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.657 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4450 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 475136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:27.657 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.345047+0000", 2024-09-12T16:16:27.657 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.265008453, 2024-09-12T16:16:27.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003358088, 2024-09-12T16:16:27.657 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.657 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.657 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:27.657 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:27.658 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:27.658 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:27.658 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4450 2024-09-12T16:16:27.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.658 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345047+0000", 2024-09-12T16:16:27.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345047+0000", 2024-09-12T16:16:27.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345047+0000", 2024-09-12T16:16:27.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2599999999999998e-07 2024-09-12T16:16:27.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345049+0000", 2024-09-12T16:16:27.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1040000000000001e-06 2024-09-12T16:16:27.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345056+0000", 2024-09-12T16:16:27.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6220000000000003e-06 2024-09-12T16:16:27.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345061+0000", 2024-09-12T16:16:27.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0710000000000002e-06 2024-09-12T16:16:27.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.348273+0000", 2024-09-12T16:16:27.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032119649999999998 2024-09-12T16:16:27.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:27.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.348340+0000", 2024-09-12T16:16:27.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7115999999999999e-05 2024-09-12T16:16:27.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.348405+0000", 2024-09-12T16:16:27.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4783999999999995e-05 2024-09-12T16:16:27.661 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.662 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.662 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.662 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4857 3.1e 3.e05fe63e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:27.662 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.351348+0000", 2024-09-12T16:16:27.662 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.258707486999999, 2024-09-12T16:16:27.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032465969999999999, 2024-09-12T16:16:27.662 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.662 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.662 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:16:27.662 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:27.662 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:27.662 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:27.663 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4857 2024-09-12T16:16:27.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.663 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351348+0000", 2024-09-12T16:16:27.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351348+0000", 2024-09-12T16:16:27.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351348+0000", 2024-09-12T16:16:27.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3599999999999999e-07 2024-09-12T16:16:27.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351354+0000", 2024-09-12T16:16:27.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8880000000000002e-06 2024-09-12T16:16:27.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351361+0000", 2024-09-12T16:16:27.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1849999999999998e-06 2024-09-12T16:16:27.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351366+0000", 2024-09-12T16:16:27.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9740000000000001e-06 2024-09-12T16:16:27.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354588+0000", 2024-09-12T16:16:27.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032216200000000001 2024-09-12T16:16:27.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354594+0000", 2024-09-12T16:16:27.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5939999999999999e-06 2024-09-12T16:16:27.666 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.666 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.666 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.666 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4858 3.1e 3.e05fe63e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:27.666 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.351373+0000", 2024-09-12T16:16:27.666 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.25868255, 2024-09-12T16:16:27.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032503800000000002, 2024-09-12T16:16:27.666 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.666 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.666 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:16:27.667 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:27.667 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:27.667 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:27.667 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4858 2024-09-12T16:16:27.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.667 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351373+0000", 2024-09-12T16:16:27.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351373+0000", 2024-09-12T16:16:27.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351373+0000", 2024-09-12T16:16:27.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5999999999999999e-07 2024-09-12T16:16:27.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351376+0000", 2024-09-12T16:16:27.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6170000000000001e-06 2024-09-12T16:16:27.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351381+0000", 2024-09-12T16:16:27.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8209999999999998e-06 2024-09-12T16:16:27.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351386+0000", 2024-09-12T16:16:27.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6190000000000002e-06 2024-09-12T16:16:27.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354616+0000", 2024-09-12T16:16:27.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032299809999999998 2024-09-12T16:16:27.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354623+0000", 2024-09-12T16:16:27.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9820000000000002e-06 2024-09-12T16:16:27.670 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.670 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.670 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.670 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4859 3.1e 3.e05fe63e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:27.670 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.351392+0000", 2024-09-12T16:16:27.670 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.258663293000001, 2024-09-12T16:16:27.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003261983, 2024-09-12T16:16:27.670 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.670 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.671 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:16:27.671 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:27.671 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:27.671 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:27.671 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4859 2024-09-12T16:16:27.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.671 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351392+0000", 2024-09-12T16:16:27.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351392+0000", 2024-09-12T16:16:27.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351392+0000", 2024-09-12T16:16:27.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4999999999999998e-07 2024-09-12T16:16:27.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351394+0000", 2024-09-12T16:16:27.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.669e-06 2024-09-12T16:16:27.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351400+0000", 2024-09-12T16:16:27.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7049999999999996e-06 2024-09-12T16:16:27.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.351404+0000", 2024-09-12T16:16:27.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7249999999999997e-06 2024-09-12T16:16:27.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354646+0000", 2024-09-12T16:16:27.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032411499999999999 2024-09-12T16:16:27.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.354654+0000", 2024-09-12T16:16:27.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3839999999999997e-06 2024-09-12T16:16:27.674 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.674 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.674 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.674 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4859 3.1e 3:7c67fa07:::rbd_data.11557ed36bb5.000000000000001d:4 [read 516096~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:27.674 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.356681+0000", 2024-09-12T16:16:27.674 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.253373728, 2024-09-12T16:16:27.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033342200000000002, 2024-09-12T16:16:27.675 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.675 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.675 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:27.675 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:27.675 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:27.675 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:27.675 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4859 2024-09-12T16:16:27.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.675 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.356681+0000", 2024-09-12T16:16:27.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.356681+0000", 2024-09-12T16:16:27.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.356682+0000", 2024-09-12T16:16:27.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.34e-07 2024-09-12T16:16:27.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.356689+0000", 2024-09-12T16:16:27.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3540000000000002e-06 2024-09-12T16:16:27.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.356697+0000", 2024-09-12T16:16:27.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.038e-06 2024-09-12T16:16:27.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.356703+0000", 2024-09-12T16:16:27.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7690000000000002e-06 2024-09-12T16:16:27.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.359724+0000", 2024-09-12T16:16:27.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030212529999999998 2024-09-12T16:16:27.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:27.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.359807+0000", 2024-09-12T16:16:27.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2956999999999999e-05 2024-09-12T16:16:27.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.360016+0000", 2024-09-12T16:16:27.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020841499999999999 2024-09-12T16:16:27.678 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.678 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.679 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.679 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:611 3.1e 3:781126e5:::rbd_data.11551fa285fd.0000000000000001:5 [sparse-read 4390912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:27.679 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.317383+0000", 2024-09-12T16:16:27.679 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.292672160999999, 2024-09-12T16:16:27.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034147090000000001, 2024-09-12T16:16:27.679 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.679 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.679 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:27.679 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:27.679 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:27.679 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:27.679 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 611 2024-09-12T16:16:27.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.680 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317383+0000", 2024-09-12T16:16:27.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317383+0000", 2024-09-12T16:16:27.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317383+0000", 2024-09-12T16:16:27.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.03e-07 2024-09-12T16:16:27.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317384+0000", 2024-09-12T16:16:27.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.111e-06 2024-09-12T16:16:27.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317387+0000", 2024-09-12T16:16:27.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0920000000000002e-06 2024-09-12T16:16:27.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317391+0000", 2024-09-12T16:16:27.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.191e-06 2024-09-12T16:16:27.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.320634+0000", 2024-09-12T16:16:27.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032436750000000001 2024-09-12T16:16:27.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:27.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.320721+0000", 2024-09-12T16:16:27.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6682999999999997e-05 2024-09-12T16:16:27.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.320798+0000", 2024-09-12T16:16:27.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6754000000000004e-05 2024-09-12T16:16:27.683 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.683 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.683 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.684 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:612 3.1e 3:781126e5:::rbd_data.11551fa285fd.0000000000000001:5 [sparse-read 5439488~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:27.684 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.317394+0000", 2024-09-12T16:16:27.684 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.292661119000002, 2024-09-12T16:16:27.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036457799999999999, 2024-09-12T16:16:27.684 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.684 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.684 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:27.684 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:27.684 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:27.684 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:27.684 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 612 2024-09-12T16:16:27.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.684 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317394+0000", 2024-09-12T16:16:27.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317394+0000", 2024-09-12T16:16:27.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317394+0000", 2024-09-12T16:16:27.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1400000000000001e-07 2024-09-12T16:16:27.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317395+0000", 2024-09-12T16:16:27.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.569999999999999e-07 2024-09-12T16:16:27.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317398+0000", 2024-09-12T16:16:27.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1520000000000001e-06 2024-09-12T16:16:27.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317401+0000", 2024-09-12T16:16:27.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4660000000000002e-06 2024-09-12T16:16:27.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.320843+0000", 2024-09-12T16:16:27.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034421130000000001 2024-09-12T16:16:27.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:27.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.320939+0000", 2024-09-12T16:16:27.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5585e-05 2024-09-12T16:16:27.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321040+0000", 2024-09-12T16:16:27.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010129299999999999 2024-09-12T16:16:27.688 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.688 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.688 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.688 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:613 3.1e 3:781126e5:::rbd_data.11551fa285fd.0000000000000001:5 [sparse-read 6488064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:27.688 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.317404+0000", 2024-09-12T16:16:27.688 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.292651119999999, 2024-09-12T16:16:27.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003785217, 2024-09-12T16:16:27.688 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.688 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.689 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:27.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:27.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:27.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:27.689 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 613 2024-09-12T16:16:27.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.689 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317404+0000", 2024-09-12T16:16:27.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317404+0000", 2024-09-12T16:16:27.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317404+0000", 2024-09-12T16:16:27.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2000000000000001e-07 2024-09-12T16:16:27.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317405+0000", 2024-09-12T16:16:27.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0890000000000001e-06 2024-09-12T16:16:27.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317408+0000", 2024-09-12T16:16:27.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.061e-06 2024-09-12T16:16:27.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317411+0000", 2024-09-12T16:16:27.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.52e-06 2024-09-12T16:16:27.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321069+0000", 2024-09-12T16:16:27.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036582059999999998 2024-09-12T16:16:27.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:27.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321127+0000", 2024-09-12T16:16:27.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7339000000000001e-05 2024-09-12T16:16:27.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321189+0000", 2024-09-12T16:16:27.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2781999999999996e-05 2024-09-12T16:16:27.692 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.692 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.692 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.693 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:614 3.1e 3:781126e5:::rbd_data.11551fa285fd.0000000000000001:5 [sparse-read 7536640~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:27.693 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.317414+0000", 2024-09-12T16:16:27.693 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.292640944999999, 2024-09-12T16:16:27.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039935709999999996, 2024-09-12T16:16:27.693 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.693 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.693 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:27.693 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:27.693 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:27.693 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:27.693 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 614 2024-09-12T16:16:27.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.694 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317414+0000", 2024-09-12T16:16:27.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317414+0000", 2024-09-12T16:16:27.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317414+0000", 2024-09-12T16:16:27.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.05e-07 2024-09-12T16:16:27.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317418+0000", 2024-09-12T16:16:27.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5329999999999999e-06 2024-09-12T16:16:27.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317423+0000", 2024-09-12T16:16:27.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2780000000000001e-06 2024-09-12T16:16:27.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317428+0000", 2024-09-12T16:16:27.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.763e-06 2024-09-12T16:16:27.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321217+0000", 2024-09-12T16:16:27.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003788816 2024-09-12T16:16:27.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:27.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321307+0000", 2024-09-12T16:16:27.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0142999999999994e-05 2024-09-12T16:16:27.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321408+0000", 2024-09-12T16:16:27.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000100833 2024-09-12T16:16:27.697 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.697 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.697 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.697 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4628.0:534 3.1f e41/21 3:fde85b2b:::rbd_data.115575975003.0000000000000000:head v 41'92, mlcod=41'90)", 2024-09-12T16:16:27.698 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:26.749420+0000", 2024-09-12T16:16:27.698 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.86063472399999996, 2024-09-12T16:16:27.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.004333122, 2024-09-12T16:16:27.698 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:27.698 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:27.698 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:27.698 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:27.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:27.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.749420+0000", 2024-09-12T16:16:27.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:27.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.749420+0000", 2024-09-12T16:16:27.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:27.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:27.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.749422+0000", 2024-09-12T16:16:27.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.13e-06 2024-09-12T16:16:27.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:27.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.751400+0000", 2024-09-12T16:16:27.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019781690000000001 2024-09-12T16:16:27.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:27.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.751409+0000", 2024-09-12T16:16:27.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4890000000000001e-06 2024-09-12T16:16:27.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:27.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.751416+0000", 2024-09-12T16:16:27.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6259999999999997e-06 2024-09-12T16:16:27.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:27.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.751496+0000", 2024-09-12T16:16:27.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9938999999999995e-05 2024-09-12T16:16:27.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:27.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.751520+0000", 2024-09-12T16:16:27.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4216e-05 2024-09-12T16:16:27.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:16:27.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.753702+0000", 2024-09-12T16:16:27.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0021816399999999999 2024-09-12T16:16:27.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:27.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:27.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:27.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.753754+0000", 2024-09-12T16:16:27.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1913000000000003e-05 2024-09-12T16:16:27.701 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.701 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.702 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.702 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:27.702 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:27.702 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:27.702 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T16:16:27.704 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:16:27.705 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:27.702+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:27.707 INFO:teuthology.orchestra.run.smithi204.stdout:1718 read 0x6d04e00 thru 0x6d0b160 (0x6361 bytes) 2024-09-12T16:16:27.707 INFO:teuthology.orchestra.run.smithi204.stdout:1723 write 0x13c9400 thru 0x13cf843 (0x6444 bytes) 2024-09-12T16:16:27.707 INFO:teuthology.orchestra.run.smithi204.stdout:1725 punch from 0xbaf8000 to 0xbaff800, (0x7800 bytes) 2024-09-12T16:16:27.707 INFO:teuthology.orchestra.run.smithi204.stdout:1726 write 0x6e46200 thru 0x6e5450a (0xe30b bytes) 2024-09-12T16:16:27.707 INFO:teuthology.orchestra.run.smithi204.stdout:1727 read 0xa26c200 thru 0xa26dde4 (0x1be5 bytes) 2024-09-12T16:16:27.707 INFO:teuthology.orchestra.run.smithi204.stdout:1731 write 0x2d39800 thru 0x2d463fe (0xcbff bytes) 2024-09-12T16:16:27.707 INFO:teuthology.orchestra.run.smithi204.stdout:1732 read 0x1d48000 thru 0x1d4a693 (0x2694 bytes) 2024-09-12T16:16:27.707 INFO:teuthology.orchestra.run.smithi204.stdout:1733 punch from 0x8e0cc00 to 0x8e1b000, (0xe400 bytes) 2024-09-12T16:16:27.708 INFO:teuthology.orchestra.run.smithi204.stdout:1734 read 0x43cfe00 thru 0x43db501 (0xb702 bytes) 2024-09-12T16:16:27.708 INFO:teuthology.orchestra.run.smithi204.stdout:1735 write 0x648f400 thru 0x649132e (0x1f2f bytes) 2024-09-12T16:16:27.708 INFO:teuthology.orchestra.run.smithi204.stdout:1736 punch from 0xa6a4000 to 0xa6ad600, (0x9600 bytes) 2024-09-12T16:16:27.708 INFO:teuthology.orchestra.run.smithi204.stdout:1738 punch from 0x7c84000 to 0x7c8c400, (0x8400 bytes) 2024-09-12T16:16:27.708 INFO:teuthology.orchestra.run.smithi204.stdout:1741 write 0x70b9e00 thru 0x70c8eea (0xf0eb bytes) 2024-09-12T16:16:27.708 INFO:teuthology.orchestra.run.smithi204.stdout:1742 trunc from 0xbc95c00 to 0x8c93800 2024-09-12T16:16:27.708 INFO:teuthology.orchestra.run.smithi204.stdout:1745 read 0x370800 thru 0x37bb0e (0xb30f bytes) 2024-09-12T16:16:27.708 INFO:teuthology.orchestra.run.smithi204.stdout:1749 read 0x4301a00 thru 0x4309f70 (0x8571 bytes) 2024-09-12T16:16:27.708 INFO:teuthology.orchestra.run.smithi204.stdout:1750 write 0x53eda00 thru 0x53efe33 (0x2434 bytes) 2024-09-12T16:16:27.708 INFO:teuthology.orchestra.run.smithi204.stdout:1751 read 0x79e0800 thru 0x79e3d8d (0x358e bytes) 2024-09-12T16:16:27.708 INFO:teuthology.orchestra.run.smithi204.stdout:1752 read 0x1957800 thru 0x196164f (0x9e50 bytes) 2024-09-12T16:16:27.708 INFO:teuthology.orchestra.run.smithi204.stdout:1753 trunc from 0x8c93800 to 0x6600600 2024-09-12T16:16:27.708 INFO:teuthology.orchestra.run.smithi204.stdout:1756 punch from 0x1078400 to 0x1085a00, (0xd600 bytes) 2024-09-12T16:16:27.708 INFO:teuthology.orchestra.run.smithi204.stdout:1757 read 0x2074600 thru 0x207f093 (0xaa94 bytes) 2024-09-12T16:16:27.709 INFO:teuthology.orchestra.run.smithi204.stdout:1759 write 0x5f25800 thru 0x5f303c7 (0xabc8 bytes) 2024-09-12T16:16:27.709 INFO:teuthology.orchestra.run.smithi204.stdout:1761 read 0x3dd5c00 thru 0x3de1308 (0xb709 bytes) 2024-09-12T16:16:27.709 INFO:teuthology.orchestra.run.smithi204.stdout:1762 read 0x564f800 thru 0x565a7fa (0xaffb bytes) 2024-09-12T16:16:27.709 INFO:teuthology.orchestra.run.smithi204.stdout:1763 write 0x457800 thru 0x45ac3d (0x343e bytes) 2024-09-12T16:16:27.709 INFO:teuthology.orchestra.run.smithi204.stdout:1764 write 0xb7e4000 thru 0xb7eb27a (0x727b bytes) 2024-09-12T16:16:27.709 INFO:teuthology.orchestra.run.smithi204.stdout:1765 read 0x6830400 thru 0x683998f (0x9590 bytes) 2024-09-12T16:16:27.709 INFO:teuthology.orchestra.run.smithi204.stdout:1766 clone 9 order 23 su 131072 sc 14 2024-09-12T16:16:27.804 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:27.802+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:27.816 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:27.816 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:16:27.816 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:16:27.816 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:27.825 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:16:27.866 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:16:27.867 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:16:27.883 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:16:27.883 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:16:27.899 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:16:27.900 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:16:27.909 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:27.908+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:27.917 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:16:27.917 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:16:27.934 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:16:27.934 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:16:27.934 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-12T16:16:27.937 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T16:16:27.937 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T16:16:27.973 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:27.973 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:27.981 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:16:28.022 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:28.021+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:28.099 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T16:16:28.106 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:28.105+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:28.134 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:28.134 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:28.144 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:16:28.153 INFO:teuthology.orchestra.run.smithi204.stdout:truncating image image_client.0-clone8 from 0xb7eb400 (overlap 0x1df800) to 0x1af800 2024-09-12T16:16:28.207 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:28.206+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:28.293 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:28.294 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:28.302 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:16:28.308 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:28.308+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:28.409 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:28.409+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:28.413 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:28.413 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:28.422 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:16:28.425 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #7, image image_client.0-clone7 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent8 2024-09-12T16:16:28.511 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:28.509+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:28.531 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:28.531 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:28.540 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:16:28.612 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:28.611+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:28.653 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:28.653 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:28.664 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:16:28.712 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:28.711+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:28.800 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:28.800 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:28.809 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:16:28.853 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:28.852+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:28.914 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:28.913+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:28.939 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:28.939 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:28.949 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:16:29.034 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:29.033+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:29.088 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2024-09-12T16:16:29.110 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:29.111 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:29.117 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:29.116+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:29.119 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:16:29.217 INFO:teuthology.orchestra.run.smithi204.stdout:1767 write 0x5f8e400 thru 0x5f90319 (0x1f1a bytes) 2024-09-12T16:16:29.217 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:29.216+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:29.219 INFO:teuthology.orchestra.run.smithi204.stdout:1768 write 0xb12d000 thru 0xb12dce0 (0xce1 bytes) 2024-09-12T16:16:29.232 INFO:teuthology.orchestra.run.smithi204.stdout:1770 trunc from 0xb7eb400 to 0x360e00 2024-09-12T16:16:29.273 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:29.273 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:29.282 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:16:29.300 INFO:teuthology.orchestra.run.smithi204.stdout:1771 write 0x6181200 thru 0x6185755 (0x4556 bytes) 2024-09-12T16:16:29.301 INFO:teuthology.orchestra.run.smithi204.stdout:1774 punch from 0x23eec00 to 0x23fa800, (0xbc00 bytes) 2024-09-12T16:16:29.301 INFO:teuthology.orchestra.run.smithi204.stdout:1780 write 0x2e7ec00 thru 0x2e7f4d3 (0x8d4 bytes) 2024-09-12T16:16:29.306 INFO:teuthology.orchestra.run.smithi204.stdout:1781 trunc from 0x6185800 to 0x344dc00 2024-09-12T16:16:29.318 INFO:teuthology.orchestra.run.smithi204.stdout:1783 punch from 0x1c83c00 to 0x1c88c00, (0x5000 bytes) 2024-09-12T16:16:29.323 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:29.322+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:29.340 INFO:teuthology.orchestra.run.smithi204.stdout:1785 write 0xcd4c400 thru 0xcd5816b (0xbd6c bytes) 2024-09-12T16:16:29.340 INFO:teuthology.orchestra.run.smithi204.stdout:1787 punch from 0x26b3400 to 0x26b6600, (0x3200 bytes) 2024-09-12T16:16:29.341 INFO:teuthology.orchestra.run.smithi204.stdout:1789 write 0x46ba00 thru 0x477aca (0xc0cb bytes) 2024-09-12T16:16:29.342 INFO:teuthology.orchestra.run.smithi204.stdout:1790 read 0x83b7a00 thru 0x83c48e2 (0xcee3 bytes) 2024-09-12T16:16:29.344 INFO:teuthology.orchestra.run.smithi204.stdout:1791 write 0xaf76800 thru 0xaf82856 (0xc057 bytes) 2024-09-12T16:16:29.344 INFO:teuthology.orchestra.run.smithi204.stdout:1792 read 0x4700600 thru 0x470fc24 (0xf625 bytes) 2024-09-12T16:16:29.345 INFO:teuthology.orchestra.run.smithi204.stdout:1794 write 0x4a69e00 thru 0x4a700ce (0x62cf bytes) 2024-09-12T16:16:29.345 INFO:teuthology.orchestra.run.smithi204.stdout:1796 write 0x8f72000 thru 0x8f727be (0x7bf bytes) 2024-09-12T16:16:29.346 INFO:teuthology.orchestra.run.smithi204.stdout:1797 punch from 0xb4c2600 to 0xb4ce400, (0xbe00 bytes) 2024-09-12T16:16:29.346 INFO:teuthology.orchestra.run.smithi204.stdout:1798 read 0x4500600 thru 0x45039cd (0x33ce bytes) 2024-09-12T16:16:29.348 INFO:teuthology.orchestra.run.smithi204.stdout:1800 read 0xa9e7400 thru 0xa9f0926 (0x9527 bytes) 2024-09-12T16:16:29.348 INFO:teuthology.orchestra.run.smithi204.stdout:1801 write 0xbd15800 thru 0xbd1bd17 (0x6518 bytes) 2024-09-12T16:16:29.348 INFO:teuthology.orchestra.run.smithi204.stdout:1803 read 0x4c7600 thru 0x4d293e (0xb33f bytes) 2024-09-12T16:16:29.348 INFO:teuthology.orchestra.run.smithi204.stdout:1804 read 0x839b400 thru 0x839cc1d (0x181e bytes) 2024-09-12T16:16:29.348 INFO:teuthology.orchestra.run.smithi204.stdout:1805 write 0x9f39400 thru 0x9f43e6c (0xaa6d bytes) 2024-09-12T16:16:29.348 INFO:teuthology.orchestra.run.smithi204.stdout:1806 punch from 0x1221c00 to 0x1229000, (0x7400 bytes) 2024-09-12T16:16:29.349 INFO:teuthology.orchestra.run.smithi204.stdout:1809 write 0xc4e800 thru 0xc56e9f (0x86a0 bytes) 2024-09-12T16:16:29.349 INFO:teuthology.orchestra.run.smithi204.stdout:1811 punch from 0x2a39000 to 0x2a3b400, (0x2400 bytes) 2024-09-12T16:16:29.349 INFO:teuthology.orchestra.run.smithi204.stdout:truncating to largest ever: 0xec56e00 2024-09-12T16:16:29.351 INFO:teuthology.orchestra.run.smithi204.stdout:1812 trunc from 0xcd58200 to 0xec56e00 2024-09-12T16:16:29.359 INFO:teuthology.orchestra.run.smithi204.stdout:1813 write 0x4c79200 thru 0x4c84958 (0xb759 bytes) 2024-09-12T16:16:29.361 INFO:teuthology.orchestra.run.smithi204.stdout:1814 punch from 0x9485e00 to 0x948fe00, (0xa000 bytes) 2024-09-12T16:16:29.361 INFO:teuthology.orchestra.run.smithi204.stdout:1816 read 0x97de600 thru 0x97ea6de (0xc0df bytes) 2024-09-12T16:16:29.361 INFO:teuthology.orchestra.run.smithi204.stdout:1818 write 0xd901200 thru 0xd90a379 (0x917a bytes) 2024-09-12T16:16:29.375 INFO:teuthology.orchestra.run.smithi204.stdout:1819 trunc from 0xec56e00 to 0x6376400 2024-09-12T16:16:29.398 INFO:teuthology.orchestra.run.smithi204.stdout:1821 read 0x4e4c200 thru 0x4e4c2ec (0xed bytes) 2024-09-12T16:16:29.398 INFO:teuthology.orchestra.run.smithi204.stdout:1823 read 0x696800 thru 0x69b779 (0x4f7a bytes) 2024-09-12T16:16:29.398 INFO:teuthology.orchestra.run.smithi204.stdout:1824 read 0x1d83e00 thru 0x1d93268 (0xf469 bytes) 2024-09-12T16:16:29.399 INFO:teuthology.orchestra.run.smithi204.stdout:1825 read 0x1a7ca00 thru 0x1a852e7 (0x88e8 bytes) 2024-09-12T16:16:29.401 INFO:teuthology.orchestra.run.smithi204.stdout:1826 trunc from 0x6376400 to 0x7b3ea00 2024-09-12T16:16:29.415 INFO:teuthology.orchestra.run.smithi204.stdout:1827 read 0x1439400 thru 0x143f685 (0x6286 bytes) 2024-09-12T16:16:29.417 INFO:teuthology.orchestra.run.smithi204.stdout:1829 trunc from 0x7b3ea00 to 0x6266800 2024-09-12T16:16:29.418 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:29.417+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:29.428 INFO:teuthology.orchestra.run.smithi204.stdout:1831 read 0x28f7a00 thru 0x29071ca (0xf7cb bytes) 2024-09-12T16:16:29.433 INFO:teuthology.orchestra.run.smithi204.stdout:1832 punch from 0x58de00 to 0x596000, (0x8200 bytes) 2024-09-12T16:16:29.433 INFO:teuthology.orchestra.run.smithi204.stdout:1835 write 0xb89400 thru 0xb8da10 (0x4611 bytes) 2024-09-12T16:16:29.434 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:29.434 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:29.435 INFO:teuthology.orchestra.run.smithi204.stdout:1836 read 0x1b95c00 thru 0x1b96855 (0xc56 bytes) 2024-09-12T16:16:29.435 INFO:teuthology.orchestra.run.smithi204.stdout:1837 punch from 0x601400 to 0x60da00, (0xc600 bytes) 2024-09-12T16:16:29.435 INFO:teuthology.orchestra.run.smithi204.stdout:1838 read 0x215da00 thru 0x216b03a (0xd63b bytes) 2024-09-12T16:16:29.435 INFO:teuthology.orchestra.run.smithi204.stdout:1839 write 0x1712000 thru 0x171777e (0x577f bytes) 2024-09-12T16:16:29.443 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:16:29.456 INFO:teuthology.orchestra.run.smithi204.stdout:1842 write 0xe4dca00 thru 0xe4e6ec0 (0xa4c1 bytes) 2024-09-12T16:16:29.462 INFO:teuthology.orchestra.run.smithi204.stdout:1843 read 0x4b72600 thru 0x4b74e20 (0x2821 bytes) 2024-09-12T16:16:29.464 INFO:teuthology.orchestra.run.smithi204.stdout:1845 trunc from 0xe4e7000 to 0xd606800 2024-09-12T16:16:29.485 INFO:teuthology.orchestra.run.smithi204.stdout:1846 read 0xd411e00 thru 0xd420bac (0xedad bytes) 2024-09-12T16:16:29.486 INFO:teuthology.orchestra.run.smithi204.stdout:1848 write 0x906ec00 thru 0x906fd6c (0x116d bytes) 2024-09-12T16:16:29.486 INFO:teuthology.orchestra.run.smithi204.stdout:skipping zero length punch hole 2024-09-12T16:16:29.487 INFO:teuthology.orchestra.run.smithi204.stdout:1851 write 0x4957200 thru 0x495a157 (0x2f58 bytes) 2024-09-12T16:16:29.487 INFO:teuthology.orchestra.run.smithi204.stdout:1854 punch from 0x96c4400 to 0x96c9a00, (0x5600 bytes) 2024-09-12T16:16:29.487 INFO:teuthology.orchestra.run.smithi204.stdout:1855 read 0xf1a200 thru 0xf1c193 (0x1f94 bytes) 2024-09-12T16:16:29.488 INFO:teuthology.orchestra.run.smithi204.stdout:1856 read 0x885600 thru 0x891e0d (0xc80e bytes) 2024-09-12T16:16:29.490 INFO:teuthology.orchestra.run.smithi204.stdout:1857 write 0xb342000 thru 0xb34b3f1 (0x93f2 bytes) 2024-09-12T16:16:29.490 INFO:teuthology.orchestra.run.smithi204.stdout:1859 punch from 0x3016000 to 0x301ac00, (0x4c00 bytes) 2024-09-12T16:16:29.490 INFO:teuthology.orchestra.run.smithi204.stdout:1860 punch from 0x286c000 to 0x287b600, (0xf600 bytes) 2024-09-12T16:16:29.490 INFO:teuthology.orchestra.run.smithi204.stdout:1861 read 0x6b36800 thru 0x6b3dabf (0x72c0 bytes) 2024-09-12T16:16:29.504 INFO:teuthology.orchestra.run.smithi204.stdout:1863 trunc from 0xd606800 to 0x142a000 2024-09-12T16:16:29.519 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:29.518+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:29.523 INFO:teuthology.orchestra.run.smithi204.stdout:1867 read 0xe3aa00 thru 0xe3acce (0x2cf bytes) 2024-09-12T16:16:29.530 INFO:teuthology.orchestra.run.smithi204.stdout:1869 read 0x12c200 thru 0x1355e6 (0x93e7 bytes) 2024-09-12T16:16:29.549 INFO:teuthology.orchestra.run.smithi204.stdout:1871 write 0xa960000 thru 0xa960ec6 (0xec7 bytes) 2024-09-12T16:16:29.553 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:29.553 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:29.556 INFO:teuthology.orchestra.run.smithi204.stdout:1874 read 0x3c35800 thru 0x3c3798f (0x2190 bytes) 2024-09-12T16:16:29.556 INFO:teuthology.orchestra.run.smithi204.stdout:1875 write 0x2891400 thru 0x28940bd (0x2cbe bytes) 2024-09-12T16:16:29.562 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:16:29.569 INFO:teuthology.orchestra.run.smithi204.stdout:1876 trunc from 0xa961000 to 0x7d0c00 2024-09-12T16:16:29.601 INFO:teuthology.orchestra.run.smithi204.stdout:1878 trunc from 0x7d0c00 to 0xa227e00 2024-09-12T16:16:29.610 INFO:teuthology.orchestra.run.smithi204.stdout:1879 trunc from 0xa227e00 to 0x9acb800 2024-09-12T16:16:29.629 INFO:teuthology.orchestra.run.smithi204.stdout:1882 write 0xa42b400 thru 0xa4378fa (0xc4fb bytes) 2024-09-12T16:16:29.629 INFO:teuthology.orchestra.run.smithi204.stdout:1886 punch from 0xda9e00 to 0xdb4000, (0xa200 bytes) 2024-09-12T16:16:29.644 INFO:teuthology.orchestra.run.smithi204.stdout:1887 write 0xe84b400 thru 0xe855ae2 (0xa6e3 bytes) 2024-09-12T16:16:29.644 INFO:teuthology.orchestra.run.smithi204.stdout:1888 read 0xa94ae00 thru 0xa95534a (0xa54b bytes) 2024-09-12T16:16:29.645 INFO:teuthology.orchestra.run.smithi204.stdout:1890 read 0x9e1f000 thru 0x9e2833e (0x933f bytes) 2024-09-12T16:16:29.645 INFO:teuthology.orchestra.run.smithi204.stdout:1891 read 0x8162a00 thru 0x816c5f6 (0x9bf7 bytes) 2024-09-12T16:16:29.646 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:29.645+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:29.647 INFO:teuthology.orchestra.run.smithi204.stdout:1894 trunc from 0xe855c00 to 0xc3c8e00 2024-09-12T16:16:29.664 INFO:teuthology.orchestra.run.smithi204.stdout:1895 write 0x5966800 thru 0x59755f1 (0xedf2 bytes) 2024-09-12T16:16:29.666 INFO:teuthology.orchestra.run.smithi204.stdout:1896 read 0x217dc00 thru 0x218ce2e (0xf22f bytes) 2024-09-12T16:16:29.666 INFO:teuthology.orchestra.run.smithi204.stdout:1899 read 0x7f1c400 thru 0x7f288b3 (0xc4b4 bytes) 2024-09-12T16:16:29.666 INFO:teuthology.orchestra.run.smithi204.stdout:1900 read 0x5eb2800 thru 0x5eb53a0 (0x2ba1 bytes) 2024-09-12T16:16:29.679 INFO:teuthology.orchestra.run.smithi204.stdout:1901 trunc from 0xc3c8e00 to 0x1762800 2024-09-12T16:16:29.700 INFO:teuthology.orchestra.run.smithi204.stdout:1903 punch from 0xaad200 to 0xab9600, (0xc400 bytes) 2024-09-12T16:16:29.701 INFO:teuthology.orchestra.run.smithi204.stdout:1905 read 0x13f3000 thru 0x13fb617 (0x8618 bytes) 2024-09-12T16:16:29.711 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:29.711 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:29.720 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:16:29.721 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:29.720+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:29.724 INFO:teuthology.orchestra.run.smithi204.stdout:1906 write 0xd0fe800 thru 0xd101466 (0x2c67 bytes) 2024-09-12T16:16:29.729 INFO:teuthology.orchestra.run.smithi204.stdout:1907 punch from 0x5b85a00 to 0x5b8bc00, (0x6200 bytes) 2024-09-12T16:16:29.730 INFO:teuthology.orchestra.run.smithi204.stdout:1912 write 0xa916a00 thru 0xa91f25f (0x8860 bytes) 2024-09-12T16:16:29.730 INFO:teuthology.orchestra.run.smithi204.stdout:1913 write 0x5aee000 thru 0x5af8a9b (0xaa9c bytes) 2024-09-12T16:16:29.731 INFO:teuthology.orchestra.run.smithi204.stdout:1914 read 0x2f6bc00 thru 0x2f72879 (0x6c7a bytes) 2024-09-12T16:16:29.731 INFO:teuthology.orchestra.run.smithi204.stdout:1917 punch from 0x97e1a00 to 0x97e8c00, (0x7200 bytes) 2024-09-12T16:16:29.732 INFO:teuthology.orchestra.run.smithi204.stdout:1920 punch from 0x3b08a00 to 0x3b17400, (0xea00 bytes) 2024-09-12T16:16:29.732 INFO:teuthology.orchestra.run.smithi204.stdout:1921 read 0x5fa0800 thru 0x5fa742f (0x6c30 bytes) 2024-09-12T16:16:29.732 INFO:teuthology.orchestra.run.smithi204.stdout:1922 write 0x5a11800 thru 0x5a1c559 (0xad5a bytes) 2024-09-12T16:16:29.733 INFO:teuthology.orchestra.run.smithi204.stdout:1923 write 0x747c400 thru 0x747f280 (0x2e81 bytes) 2024-09-12T16:16:29.733 INFO:teuthology.orchestra.run.smithi204.stdout:1926 punch from 0x564ec00 to 0x565dc00, (0xf000 bytes) 2024-09-12T16:16:29.741 INFO:teuthology.orchestra.run.smithi204.stdout:1928 trunc from 0xd101600 to 0x5fa2600 2024-09-12T16:16:29.757 INFO:teuthology.orchestra.run.smithi204.stdout:1929 punch from 0x203b600 to 0x203ee00, (0x3800 bytes) 2024-09-12T16:16:29.765 INFO:teuthology.orchestra.run.smithi204.stdout:1930 trunc from 0x5fa2600 to 0xbbcf600 2024-09-12T16:16:29.773 INFO:teuthology.orchestra.run.smithi204.stdout:1932 read 0x6243800 thru 0x6250daf (0xd5b0 bytes) 2024-09-12T16:16:29.792 INFO:teuthology.orchestra.run.smithi204.stdout:1938 trunc from 0xbbcf600 to 0x1025000 2024-09-12T16:16:29.806 INFO:teuthology.orchestra.run.smithi204.stdout:1940 read 0x392000 thru 0x39640f (0x4410 bytes) 2024-09-12T16:16:29.823 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:29.822+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:29.831 INFO:teuthology.orchestra.run.smithi204.stdout:1946 write 0x8919200 thru 0x8921b27 (0x8928 bytes) 2024-09-12T16:16:29.836 INFO:teuthology.orchestra.run.smithi204.stdout:1947 write 0x1468a00 thru 0x146a0a0 (0x16a1 bytes) 2024-09-12T16:16:29.845 INFO:teuthology.orchestra.run.smithi204.stdout:1952 trunc from 0x8921c00 to 0x2292200 2024-09-12T16:16:29.870 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:29.870 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:29.880 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:16:29.881 INFO:teuthology.orchestra.run.smithi204.stdout:1953 write 0x88b7400 thru 0x88c6384 (0xef85 bytes) 2024-09-12T16:16:29.882 INFO:teuthology.orchestra.run.smithi204.stdout:1954 punch from 0x1c97c00 to 0x1ca5000, (0xd400 bytes) 2024-09-12T16:16:29.883 INFO:teuthology.orchestra.run.smithi204.stdout:1956 read 0x9ed000 thru 0x9f2b87 (0x5b88 bytes) 2024-09-12T16:16:29.891 INFO:teuthology.orchestra.run.smithi204.stdout:1957 trunc from 0x88c6400 to 0x282d200 2024-09-12T16:16:29.915 INFO:teuthology.orchestra.run.smithi204.stdout:1958 read 0x1f8f200 thru 0x1f97ae8 (0x88e9 bytes) 2024-09-12T16:16:29.924 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:29.923+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:29.934 INFO:teuthology.orchestra.run.smithi204.stdout:1960 write 0x61ac600 thru 0x61bc5d2 (0xffd3 bytes) 2024-09-12T16:16:29.938 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T16:16:29.950 INFO:teuthology.orchestra.run.smithi204.stdout:1961 write 0x93dbc00 thru 0x93e549e (0x989f bytes) 2024-09-12T16:16:29.956 INFO:teuthology.orchestra.run.smithi204.stdout:1962 read 0x8ada00 thru 0x8b917b (0xb77c bytes) 2024-09-12T16:16:29.956 INFO:teuthology.orchestra.run.smithi204.stdout:1966 punch from 0x31f1800 to 0x31f4e00, (0x3600 bytes) 2024-09-12T16:16:29.975 INFO:teuthology.orchestra.run.smithi204.stdout:1967 write 0xb8bb400 thru 0xb8c47ce (0x93cf bytes) 2024-09-12T16:16:29.975 INFO:teuthology.orchestra.run.smithi204.stdout:1970 read 0xaecfe00 thru 0xaed8807 (0x8a08 bytes) 2024-09-12T16:16:29.978 INFO:teuthology.orchestra.run.smithi204.stdout:1971 trunc from 0xb8c4800 to 0xe7b1800 2024-09-12T16:16:29.997 INFO:teuthology.orchestra.run.smithi204.stdout:1973 write 0xd8fa400 thru 0xd904144 (0x9d45 bytes) 2024-09-12T16:16:29.997 INFO:teuthology.orchestra.run.smithi204.stdout:1975 write 0x88b400 thru 0x896bcf (0xb7d0 bytes) 2024-09-12T16:16:29.998 INFO:teuthology.orchestra.run.smithi204.stdout:1977 read 0xb623a00 thru 0xb62632e (0x292f bytes) 2024-09-12T16:16:29.998 INFO:teuthology.orchestra.run.smithi204.stdout:1979 write 0x838ba00 thru 0x839a973 (0xef74 bytes) 2024-09-12T16:16:29.998 INFO:teuthology.orchestra.run.smithi204.stdout:1982 write 0xc1a5e00 thru 0xc1b0891 (0xaa92 bytes) 2024-09-12T16:16:29.998 INFO:teuthology.orchestra.run.smithi204.stdout:1985 read 0x7bf3c00 thru 0x7c0147b (0xd87c bytes) 2024-09-12T16:16:29.999 INFO:teuthology.orchestra.run.smithi204.stdout:1986 punch from 0x547b400 to 0x5482200, (0x6e00 bytes) 2024-09-12T16:16:29.999 INFO:teuthology.orchestra.run.smithi204.stdout:1989 write 0x2aa00 thru 0x3a6a7 (0xfca8 bytes) 2024-09-12T16:16:30.000 INFO:teuthology.orchestra.run.smithi204.stdout:1991 read 0xb1e2c00 thru 0xb1eb4ff (0x8900 bytes) 2024-09-12T16:16:30.000 INFO:teuthology.orchestra.run.smithi204.stdout:1993 read 0x4ae2400 thru 0x4aed0a7 (0xaca8 bytes) 2024-09-12T16:16:30.002 INFO:teuthology.orchestra.run.smithi204.stdout:1994 read 0xe6e2600 thru 0xe6ede55 (0xb856 bytes) 2024-09-12T16:16:30.002 INFO:teuthology.orchestra.run.smithi204.stdout:1995 read 0x799cc00 thru 0x79a23b5 (0x57b6 bytes) 2024-09-12T16:16:30.003 INFO:teuthology.orchestra.run.smithi204.stdout:1998 write 0x8c93800 thru 0x8c9a27c (0x6a7d bytes) 2024-09-12T16:16:30.003 INFO:teuthology.orchestra.run.smithi204.stdout:2001 read 0xd0f9c00 thru 0xd1024aa (0x88ab bytes) 2024-09-12T16:16:30.007 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:30.007 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:30.016 INFO:teuthology.orchestra.run.smithi204.stdout:2002 trunc from 0xe7b1800 to 0x4a83600 2024-09-12T16:16:30.017 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:16:30.044 INFO:teuthology.orchestra.run.smithi204.stdout:2005 punch from 0x1629a00 to 0x162f200, (0x5800 bytes) 2024-09-12T16:16:30.061 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:30.060+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:30.064 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:16:30.064 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:16:30.067 INFO:teuthology.orchestra.run.smithi204.stdout:2009 write 0xa4b3e00 thru 0xa4bfbed (0xbdee bytes) 2024-09-12T16:16:30.068 INFO:teuthology.orchestra.run.smithi204.stdout:2013 read 0xa1f9800 thru 0xa1ff063 (0x5864 bytes) 2024-09-12T16:16:30.068 INFO:teuthology.orchestra.run.smithi204.stdout:2016 punch from 0x1bed800 to 0x1bf5e00, (0x8600 bytes) 2024-09-12T16:16:30.069 INFO:teuthology.orchestra.run.smithi204.stdout:2017 punch from 0x9f25a00 to 0x9f35800, (0xfe00 bytes) 2024-09-12T16:16:30.069 INFO:teuthology.orchestra.run.smithi204.stdout:2019 punch from 0xbfe00 to 0xc3200, (0x3400 bytes) 2024-09-12T16:16:30.069 INFO:teuthology.orchestra.run.smithi204.stdout:2020 write 0x82a600 thru 0x82f240 (0x4c41 bytes) 2024-09-12T16:16:30.072 INFO:teuthology.orchestra.run.smithi204.stdout:2021 trunc from 0xa4bfc00 to 0xbb71600 2024-09-12T16:16:30.081 INFO:teuthology.orchestra.run.smithi204.stdout:2022 read 0x9f61c00 thru 0x9f6cfb0 (0xb3b1 bytes) 2024-09-12T16:16:30.082 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:16:30.082 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:16:30.088 INFO:teuthology.orchestra.run.smithi204.stdout:2023 punch from 0x826fe00 to 0x8277400, (0x7600 bytes) 2024-09-12T16:16:30.088 INFO:teuthology.orchestra.run.smithi204.stdout:2025 punch from 0x863f600 to 0x864e400, (0xee00 bytes) 2024-09-12T16:16:30.098 INFO:teuthology.orchestra.run.smithi204.stdout:2026 trunc from 0xbb71600 to 0x41e6400 2024-09-12T16:16:30.098 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:16:30.099 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:16:30.118 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:16:30.118 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:16:30.125 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:30.124+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:30.135 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:16:30.135 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:16:30.135 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-12T16:16:30.138 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T16:16:30.138 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T16:16:30.144 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:30.144 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:16:30.144 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:16:30.144 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:16:30.145 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:30.147 INFO:teuthology.orchestra.run.smithi204.stdout:2027 write 0xbc68600 thru 0xbc7781a (0xf21b bytes) 2024-09-12T16:16:30.147 INFO:teuthology.orchestra.run.smithi204.stdout:2028 read 0x141d000 thru 0x1425452 (0x8453 bytes) 2024-09-12T16:16:30.148 INFO:teuthology.orchestra.run.smithi204.stdout:2030 write 0x1ecd600 thru 0x1ed4dd0 (0x77d1 bytes) 2024-09-12T16:16:30.150 INFO:teuthology.orchestra.run.smithi204.stdout:2033 trunc from 0xbc77a00 to 0xad72600 2024-09-12T16:16:30.154 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:16:30.163 INFO:teuthology.orchestra.run.smithi204.stdout:2034 write 0xfe0c00 thru 0xfe4f92 (0x4393 bytes) 2024-09-12T16:16:30.164 INFO:teuthology.orchestra.run.smithi204.stdout:2035 punch from 0x475a000 to 0x4762200, (0x8200 bytes) 2024-09-12T16:16:30.168 INFO:teuthology.orchestra.run.smithi204.stdout:2036 write 0xabd4000 thru 0xabd4c0b (0xc0c bytes) 2024-09-12T16:16:30.168 INFO:teuthology.orchestra.run.smithi204.stdout:2038 write 0x477000 thru 0x485a75 (0xea76 bytes) 2024-09-12T16:16:30.169 INFO:teuthology.orchestra.run.smithi204.stdout:2039 punch from 0x5b40a00 to 0x5b44600, (0x3c00 bytes) 2024-09-12T16:16:30.169 INFO:teuthology.orchestra.run.smithi204.stdout:2041 read 0x4886600 thru 0x4888e9a (0x289b bytes) 2024-09-12T16:16:30.170 INFO:teuthology.orchestra.run.smithi204.stdout:2042 write 0x7a6c400 thru 0x7a6cef6 (0xaf7 bytes) 2024-09-12T16:16:30.170 INFO:teuthology.orchestra.run.smithi204.stdout:2043 punch from 0xa0d7400 to 0xa0da200, (0x2e00 bytes) 2024-09-12T16:16:30.170 INFO:teuthology.orchestra.run.smithi204.stdout:2046 read 0x3fefc00 thru 0x3ff2cdc (0x30dd bytes) 2024-09-12T16:16:30.171 INFO:teuthology.orchestra.run.smithi204.stdout:2047 read 0x903c800 thru 0x903ea4c (0x224d bytes) 2024-09-12T16:16:30.171 INFO:teuthology.orchestra.run.smithi204.stdout:2050 read 0x81b9c00 thru 0x81bef14 (0x5315 bytes) 2024-09-12T16:16:30.171 INFO:teuthology.orchestra.run.smithi204.stdout:2051 write 0x2507a00 thru 0x251085c (0x8e5d bytes) 2024-09-12T16:16:30.173 INFO:teuthology.orchestra.run.smithi204.stdout:2054 read 0x3789200 thru 0x378cd8a (0x3b8b bytes) 2024-09-12T16:16:30.173 INFO:teuthology.orchestra.run.smithi204.stdout:2055 read 0x5186400 thru 0x518cc69 (0x686a bytes) 2024-09-12T16:16:30.174 INFO:teuthology.orchestra.run.smithi204.stdout:2058 read 0xaea800 thru 0xaec6f8 (0x1ef9 bytes) 2024-09-12T16:16:30.174 INFO:teuthology.orchestra.run.smithi204.stdout:2062 read 0x6275800 thru 0x6276acd (0x12ce bytes) 2024-09-12T16:16:30.175 INFO:teuthology.orchestra.run.smithi204.stdout:2064 trunc from 0xad72600 to 0xa108a00 2024-09-12T16:16:30.186 INFO:teuthology.orchestra.run.smithi204.stdout:2065 read 0x4b69000 thru 0x4b692b1 (0x2b2 bytes) 2024-09-12T16:16:30.187 INFO:teuthology.orchestra.run.smithi204.stdout:2066 write 0x21ad400 thru 0x21b5edc (0x8add bytes) 2024-09-12T16:16:30.193 INFO:teuthology.orchestra.run.smithi204.stdout:2067 trunc from 0xa108a00 to 0x5a2fe00 2024-09-12T16:16:30.212 INFO:teuthology.orchestra.run.smithi204.stdout:2068 trunc from 0x5a2fe00 to 0x4abfc00 2024-09-12T16:16:30.225 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:30.225+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:30.246 INFO:teuthology.orchestra.run.smithi204.stdout:2072 trunc from 0x4abfc00 to 0xce43800 2024-09-12T16:16:30.261 INFO:teuthology.orchestra.run.smithi204.stdout:2074 read 0x8423600 thru 0x8427f34 (0x4935 bytes) 2024-09-12T16:16:30.271 INFO:teuthology.orchestra.run.smithi204.stdout:2076 trunc from 0xce43800 to 0x4525600 2024-09-12T16:16:30.290 INFO:teuthology.orchestra.run.smithi204.stdout:2077 read 0x30e4400 thru 0x30e7d4a (0x394b bytes) 2024-09-12T16:16:30.317 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:30.318 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:16:30.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:16:30.318 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:16:30.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.318 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:16:30.318 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:16:30.318 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 48.551781642000002, 2024-09-12T16:16:30.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55645454900000002, 2024-09-12T16:16:30.318 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.318 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.318 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:30.318 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.319 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:16:30.319 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:16:30.319 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1 2024-09-12T16:16:30.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.319 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.319 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.319 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.319 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:16:30.319 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.319 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.319 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.319 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:16:30.319 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.320 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.320 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.320 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764440+0000", 2024-09-12T16:16:30.320 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6249999999999999e-06 2024-09-12T16:16:30.320 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.320 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.320 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.320 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764447+0000", 2024-09-12T16:16:30.320 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4939999999999997e-06 2024-09-12T16:16:30.320 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.320 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.320 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.320 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764459+0000", 2024-09-12T16:16:30.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1517e-05 2024-09-12T16:16:30.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.321 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.321 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.321 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764468+0000", 2024-09-12T16:16:30.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7690000000000002e-06 2024-09-12T16:16:30.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.321 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.321 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.321 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764539+0000", 2024-09-12T16:16:30.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1103e-05 2024-09-12T16:16:30.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.321 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:16:30.322 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764551+0000", 2024-09-12T16:16:30.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2687999999999999e-05 2024-09-12T16:16:30.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.322 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319497+0000", 2024-09-12T16:16:30.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55494560500000001 2024-09-12T16:16:30.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.322 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319688+0000", 2024-09-12T16:16:30.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019105599999999999 2024-09-12T16:16:30.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.323 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:16:30.323 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319842+0000", 2024-09-12T16:16:30.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015377699999999999 2024-09-12T16:16:30.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.323 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:30.323 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320473+0000", 2024-09-12T16:16:30.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00063117100000000003 2024-09-12T16:16:30.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.323 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:30.323 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320825+0000", 2024-09-12T16:16:30.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00035202500000000001 2024-09-12T16:16:30.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.324 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.324 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:30.324 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320867+0000", 2024-09-12T16:16:30.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2005000000000002e-05 2024-09-12T16:16:30.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.324 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.324 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.324 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320893+0000", 2024-09-12T16:16:30.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5714000000000001e-05 2024-09-12T16:16:30.324 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.324 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.324 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.325 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.325 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.325 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14034 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5035008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:30.325 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:16:30.325 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.794723408999999, 2024-09-12T16:16:30.325 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053404082999999998, 2024-09-12T16:16:30.325 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.325 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.325 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.325 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.325 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:30.325 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:30.326 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14034 2024-09-12T16:16:30.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.326 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.326 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.326 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.326 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:16:30.326 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.326 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.326 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.326 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:16:30.326 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.327 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.327 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.327 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521740+0000", 2024-09-12T16:16:30.327 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000243976 2024-09-12T16:16:30.327 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.327 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.327 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.327 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521745+0000", 2024-09-12T16:16:30.327 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1280000000000001e-06 2024-09-12T16:16:30.327 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.327 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.327 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.327 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521757+0000", 2024-09-12T16:16:30.328 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2751e-05 2024-09-12T16:16:30.328 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.328 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.328 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.328 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521771+0000", 2024-09-12T16:16:30.328 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3328e-05 2024-09-12T16:16:30.328 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.328 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.328 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.328 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574710+0000", 2024-09-12T16:16:30.328 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052939358999999998 2024-09-12T16:16:30.328 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.328 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.329 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.329 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574799+0000", 2024-09-12T16:16:30.329 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8893000000000004e-05 2024-09-12T16:16:30.329 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.329 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.329 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.329 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574901+0000", 2024-09-12T16:16:30.329 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101648 2024-09-12T16:16:30.329 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.329 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.329 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.329 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.329 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.330 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14035 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5039104~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:30.330 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521790+0000", 2024-09-12T16:16:30.330 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.794430168, 2024-09-12T16:16:30.330 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053360027999999997, 2024-09-12T16:16:30.330 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.330 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.330 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.330 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.330 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:30.330 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:30.330 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14035 2024-09-12T16:16:30.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.330 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.330 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.331 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521790+0000", 2024-09-12T16:16:30.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.331 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521790+0000", 2024-09-12T16:16:30.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.331 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521927+0000", 2024-09-12T16:16:30.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013764699999999999 2024-09-12T16:16:30.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521930+0000", 2024-09-12T16:16:30.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.084e-06 2024-09-12T16:16:30.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521938+0000", 2024-09-12T16:16:30.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8280000000000003e-06 2024-09-12T16:16:30.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521943+0000", 2024-09-12T16:16:30.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3019999999999996e-06 2024-09-12T16:16:30.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.333 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574949+0000", 2024-09-12T16:16:30.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053006596000000003 2024-09-12T16:16:30.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.333 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575042+0000", 2024-09-12T16:16:30.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3157000000000003e-05 2024-09-12T16:16:30.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.333 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575150+0000", 2024-09-12T16:16:30.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000107414 2024-09-12T16:16:30.334 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.334 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.334 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.334 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.334 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14036 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5043200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:30.334 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:16:30.334 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.794264215, 2024-09-12T16:16:30.334 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053426247000000003, 2024-09-12T16:16:30.334 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.334 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.334 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.335 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.335 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:30.335 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:30.335 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14036 2024-09-12T16:16:30.335 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.335 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.335 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.335 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.335 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:16:30.335 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.335 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.335 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.336 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.336 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:16:30.336 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.336 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.336 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.336 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522208+0000", 2024-09-12T16:16:30.336 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025195300000000002 2024-09-12T16:16:30.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.336 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.336 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.336 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522211+0000", 2024-09-12T16:16:30.336 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2160000000000002e-06 2024-09-12T16:16:30.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.337 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522223+0000", 2024-09-12T16:16:30.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2044e-05 2024-09-12T16:16:30.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.337 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522229+0000", 2024-09-12T16:16:30.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8850000000000004e-06 2024-09-12T16:16:30.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.338 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.338 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575192+0000", 2024-09-12T16:16:30.338 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052963573 2024-09-12T16:16:30.338 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.338 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.338 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.338 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575282+0000", 2024-09-12T16:16:30.338 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9666000000000005e-05 2024-09-12T16:16:30.338 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.338 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.338 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.338 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575382+0000", 2024-09-12T16:16:30.338 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9909999999999997e-05 2024-09-12T16:16:30.338 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.339 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.339 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.339 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.339 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.339 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14037 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5047296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:30.339 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522245+0000", 2024-09-12T16:16:30.339 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.793975379999999, 2024-09-12T16:16:30.339 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053384907000000002, 2024-09-12T16:16:30.339 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.339 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.339 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.339 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.339 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:30.340 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:30.340 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14037 2024-09-12T16:16:30.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.340 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.340 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.340 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.340 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522245+0000", 2024-09-12T16:16:30.340 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.340 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.340 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.340 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522245+0000", 2024-09-12T16:16:30.340 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.341 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.341 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.341 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522471+0000", 2024-09-12T16:16:30.341 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022601300000000001 2024-09-12T16:16:30.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.341 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.341 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.341 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522474+0000", 2024-09-12T16:16:30.341 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3390000000000001e-06 2024-09-12T16:16:30.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.341 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.341 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.341 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522482+0000", 2024-09-12T16:16:30.341 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7919999999999993e-06 2024-09-12T16:16:30.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.342 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.342 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.342 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522486+0000", 2024-09-12T16:16:30.342 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5109999999999997e-06 2024-09-12T16:16:30.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.342 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.342 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.342 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575433+0000", 2024-09-12T16:16:30.342 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052946673999999999 2024-09-12T16:16:30.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.342 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.342 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.342 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575532+0000", 2024-09-12T16:16:30.343 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9128000000000004e-05 2024-09-12T16:16:30.343 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.343 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.343 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.343 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575629+0000", 2024-09-12T16:16:30.343 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7449999999999997e-05 2024-09-12T16:16:30.343 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.343 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.343 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.343 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.343 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.343 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14038 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5051392~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:30.343 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:16:30.343 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.793725842000001, 2024-09-12T16:16:30.344 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053395152000000001, 2024-09-12T16:16:30.344 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.344 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.344 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.344 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.344 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:30.344 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:30.344 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14038 2024-09-12T16:16:30.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.344 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.344 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.344 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.344 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:16:30.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.345 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.345 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.345 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:16:30.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.345 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.345 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.345 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522601+0000", 2024-09-12T16:16:30.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010702899999999999 2024-09-12T16:16:30.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.345 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.346 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.346 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522605+0000", 2024-09-12T16:16:30.346 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2379999999999999e-06 2024-09-12T16:16:30.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.346 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.346 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522616+0000", 2024-09-12T16:16:30.346 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1185999999999999e-05 2024-09-12T16:16:30.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.346 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.346 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522624+0000", 2024-09-12T16:16:30.346 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1099999999999997e-06 2024-09-12T16:16:30.347 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.347 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.347 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.347 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575677+0000", 2024-09-12T16:16:30.347 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053126999999999 2024-09-12T16:16:30.347 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.347 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.347 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.347 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575764+0000", 2024-09-12T16:16:30.347 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7250000000000007e-05 2024-09-12T16:16:30.347 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.347 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.347 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.347 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575889+0000", 2024-09-12T16:16:30.348 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012521200000000001 2024-09-12T16:16:30.348 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.348 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.348 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.348 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.348 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.348 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14039 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5055488~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:30.348 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:16:30.348 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.793584430999999, 2024-09-12T16:16:30.348 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053466207000000002, 2024-09-12T16:16:30.348 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.348 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.348 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.349 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.349 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:30.349 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:30.349 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14039 2024-09-12T16:16:30.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.349 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.349 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.349 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.349 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:16:30.349 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.349 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.349 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:16:30.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522899+0000", 2024-09-12T16:16:30.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026318199999999999 2024-09-12T16:16:30.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522903+0000", 2024-09-12T16:16:30.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.929e-06 2024-09-12T16:16:30.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.351 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.351 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522913+0000", 2024-09-12T16:16:30.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0162e-05 2024-09-12T16:16:30.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.351 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.351 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522921+0000", 2024-09-12T16:16:30.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.14e-06 2024-09-12T16:16:30.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.351 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.351 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575922+0000", 2024-09-12T16:16:30.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053000712999999998 2024-09-12T16:16:30.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.352 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.352 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.352 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576006+0000", 2024-09-12T16:16:30.352 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4161999999999998e-05 2024-09-12T16:16:30.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.352 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.352 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.352 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576102+0000", 2024-09-12T16:16:30.352 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5919000000000001e-05 2024-09-12T16:16:30.352 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.352 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.352 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.353 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.353 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14040 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5059584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:30.353 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:16:30.353 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.793279536, 2024-09-12T16:16:30.353 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053413258999999998, 2024-09-12T16:16:30.353 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.353 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.353 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.353 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.353 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:30.353 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:30.353 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14040 2024-09-12T16:16:30.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.353 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.353 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.354 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.354 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:16:30.354 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.354 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.354 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:16:30.354 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.354 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.354 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523059+0000", 2024-09-12T16:16:30.354 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118466 2024-09-12T16:16:30.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.355 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.355 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.355 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523062+0000", 2024-09-12T16:16:30.355 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.971e-06 2024-09-12T16:16:30.355 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.355 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.355 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.355 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523069+0000", 2024-09-12T16:16:30.355 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8279999999999997e-06 2024-09-12T16:16:30.355 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.355 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.355 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.355 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523073+0000", 2024-09-12T16:16:30.355 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3019999999999996e-06 2024-09-12T16:16:30.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.356 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.356 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.356 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576155+0000", 2024-09-12T16:16:30.356 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053081962000000003 2024-09-12T16:16:30.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.356 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.356 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.356 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576249+0000", 2024-09-12T16:16:30.356 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3914999999999998e-05 2024-09-12T16:16:30.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.356 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.356 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.356 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576354+0000", 2024-09-12T16:16:30.357 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010481500000000001 2024-09-12T16:16:30.357 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.357 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.357 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.357 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.357 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14041 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5063680~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:30.357 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:16:30.357 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.793129231, 2024-09-12T16:16:30.357 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053519111000000001, 2024-09-12T16:16:30.357 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.357 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.357 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.357 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.358 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:30.358 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:30.358 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14041 2024-09-12T16:16:30.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.358 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.358 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.358 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.358 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:16:30.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.359 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:16:30.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.359 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523309+0000", 2024-09-12T16:16:30.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000218712 2024-09-12T16:16:30.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.359 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523313+0000", 2024-09-12T16:16:30.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.151e-06 2024-09-12T16:16:30.360 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.360 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.360 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.360 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523320+0000", 2024-09-12T16:16:30.360 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9789999999999993e-06 2024-09-12T16:16:30.360 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.360 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.360 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.360 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523325+0000", 2024-09-12T16:16:30.360 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:16:30.360 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.360 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.360 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.361 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576402+0000", 2024-09-12T16:16:30.361 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053076811000000002 2024-09-12T16:16:30.361 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.361 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.361 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.361 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576491+0000", 2024-09-12T16:16:30.361 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8578999999999993e-05 2024-09-12T16:16:30.361 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.361 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.361 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.361 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576610+0000", 2024-09-12T16:16:30.361 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119129 2024-09-12T16:16:30.361 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.361 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.361 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.362 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.362 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.362 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14042 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5067776~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:30.362 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:16:30.362 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.792885797, 2024-09-12T16:16:30.362 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053510350999999998, 2024-09-12T16:16:30.362 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.362 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.362 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.363 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.363 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:30.363 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:30.363 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14042 2024-09-12T16:16:30.363 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.363 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.363 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.363 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.363 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:16:30.363 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.363 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.363 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.363 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.363 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:16:30.364 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.364 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.364 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.364 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.364 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523591+0000", 2024-09-12T16:16:30.364 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025710300000000001 2024-09-12T16:16:30.364 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.364 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.364 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.364 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523594+0000", 2024-09-12T16:16:30.364 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2229999999999999e-06 2024-09-12T16:16:30.364 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.364 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.365 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.365 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523602+0000", 2024-09-12T16:16:30.365 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6930000000000007e-06 2024-09-12T16:16:30.365 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.365 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.365 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.365 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523607+0000", 2024-09-12T16:16:30.365 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4789999999999998e-06 2024-09-12T16:16:30.365 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.365 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.365 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.365 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576661+0000", 2024-09-12T16:16:30.365 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053973999999997 2024-09-12T16:16:30.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.366 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.366 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.366 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576745+0000", 2024-09-12T16:16:30.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4660000000000006e-05 2024-09-12T16:16:30.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.366 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.366 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.366 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576844+0000", 2024-09-12T16:16:30.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9219e-05 2024-09-12T16:16:30.366 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.366 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.366 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.367 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.367 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14043 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5071872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:30.367 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:16:30.367 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.792605318, 2024-09-12T16:16:30.367 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053475295999999999, 2024-09-12T16:16:30.367 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.367 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.367 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.367 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.367 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:30.367 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:30.367 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14043 2024-09-12T16:16:30.368 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.368 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.368 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.368 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.368 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:16:30.368 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.368 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.368 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.368 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.368 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:16:30.368 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.368 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.368 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.369 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.369 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523823+0000", 2024-09-12T16:16:30.369 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020818900000000001 2024-09-12T16:16:30.369 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.369 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.369 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.369 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523826+0000", 2024-09-12T16:16:30.369 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.405e-06 2024-09-12T16:16:30.369 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.369 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.369 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.369 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523834+0000", 2024-09-12T16:16:30.370 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5499999999999997e-06 2024-09-12T16:16:30.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.370 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.370 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.370 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523838+0000", 2024-09-12T16:16:30.370 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.408e-06 2024-09-12T16:16:30.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.370 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.370 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.370 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576904+0000", 2024-09-12T16:16:30.370 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053065687 2024-09-12T16:16:30.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.370 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.371 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.371 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576991+0000", 2024-09-12T16:16:30.371 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7399999999999997e-05 2024-09-12T16:16:30.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.371 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.371 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.371 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577090+0000", 2024-09-12T16:16:30.371 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8657000000000001e-05 2024-09-12T16:16:30.371 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.371 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.371 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.371 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.371 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14044 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5075968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:30.372 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:16:30.372 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.792373788000001, 2024-09-12T16:16:30.372 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053442659000000003, 2024-09-12T16:16:30.372 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.372 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.372 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.372 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.372 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:30.372 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:30.372 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14044 2024-09-12T16:16:30.372 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.372 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.372 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.373 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.373 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:16:30.373 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.373 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.373 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.373 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.373 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:16:30.373 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.373 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.373 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.373 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.373 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523985+0000", 2024-09-12T16:16:30.373 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000138522 2024-09-12T16:16:30.374 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.374 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.374 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.374 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523988+0000", 2024-09-12T16:16:30.374 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.788e-06 2024-09-12T16:16:30.374 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.374 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.374 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.374 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523998+0000", 2024-09-12T16:16:30.374 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8470000000000008e-06 2024-09-12T16:16:30.374 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.374 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.375 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.375 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524010+0000", 2024-09-12T16:16:30.375 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1348999999999999e-05 2024-09-12T16:16:30.375 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.375 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.375 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.375 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577137+0000", 2024-09-12T16:16:30.375 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053127055999999999 2024-09-12T16:16:30.375 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.375 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.375 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.375 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577210+0000", 2024-09-12T16:16:30.375 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3392000000000005e-05 2024-09-12T16:16:30.375 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.375 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.376 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.376 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577289+0000", 2024-09-12T16:16:30.376 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8704999999999999e-05 2024-09-12T16:16:30.376 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.376 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.376 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.376 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.376 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.376 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14045 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5080064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:30.376 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:16:30.376 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.792194967, 2024-09-12T16:16:30.376 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053497514000000003, 2024-09-12T16:16:30.376 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.377 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.377 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.377 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.377 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:30.377 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:30.377 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14045 2024-09-12T16:16:30.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.377 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.377 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.377 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.377 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:16:30.377 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.378 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.378 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.378 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:16:30.378 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.378 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.378 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.378 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.378 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524311+0000", 2024-09-12T16:16:30.378 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028626299999999998 2024-09-12T16:16:30.378 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.378 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.378 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.378 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524315+0000", 2024-09-12T16:16:30.379 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0969999999999999e-06 2024-09-12T16:16:30.379 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.379 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.379 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.379 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524325+0000", 2024-09-12T16:16:30.379 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6330000000000008e-06 2024-09-12T16:16:30.379 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.379 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.379 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.379 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524332+0000", 2024-09-12T16:16:30.379 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8700000000000003e-06 2024-09-12T16:16:30.379 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.379 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.379 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.380 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577334+0000", 2024-09-12T16:16:30.380 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053001834999999997 2024-09-12T16:16:30.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.380 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.380 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.380 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577420+0000", 2024-09-12T16:16:30.380 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6145999999999998e-05 2024-09-12T16:16:30.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.380 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.380 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.380 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577522+0000", 2024-09-12T16:16:30.380 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010267 2024-09-12T16:16:30.381 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.381 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.381 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.381 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.381 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.381 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14047 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5088256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:30.381 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:16:30.381 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.791709241, 2024-09-12T16:16:30.381 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053433340000000003, 2024-09-12T16:16:30.381 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.381 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.381 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.381 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.381 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:30.382 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:30.382 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14047 2024-09-12T16:16:30.382 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.382 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.382 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.382 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.382 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:16:30.382 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.382 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.382 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.382 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.382 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:16:30.382 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.382 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.382 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.383 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.383 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524727+0000", 2024-09-12T16:16:30.383 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000216126 2024-09-12T16:16:30.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.383 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.383 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.383 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524732+0000", 2024-09-12T16:16:30.383 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1569999999999999e-06 2024-09-12T16:16:30.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.383 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.383 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.383 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524742+0000", 2024-09-12T16:16:30.383 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0186999999999999e-05 2024-09-12T16:16:30.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.383 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.384 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.384 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524750+0000", 2024-09-12T16:16:30.384 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4279999999999999e-06 2024-09-12T16:16:30.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.384 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.384 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577743+0000", 2024-09-12T16:16:30.384 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052993077 2024-09-12T16:16:30.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.384 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.384 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577841+0000", 2024-09-12T16:16:30.384 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8369000000000006e-05 2024-09-12T16:16:30.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.385 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.385 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.385 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577944+0000", 2024-09-12T16:16:30.385 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102996 2024-09-12T16:16:30.385 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.385 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.385 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.385 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.385 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.385 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14048 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5092352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:30.385 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:16:30.385 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.791457648, 2024-09-12T16:16:30.385 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053397515, 2024-09-12T16:16:30.386 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.386 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.386 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.386 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.386 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:30.386 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:30.386 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14048 2024-09-12T16:16:30.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.386 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.386 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.386 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.386 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:16:30.386 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.387 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.387 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.387 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:16:30.387 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.387 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.387 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.387 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524957+0000", 2024-09-12T16:16:30.387 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019516999999999999 2024-09-12T16:16:30.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.387 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.387 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524962+0000", 2024-09-12T16:16:30.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7709999999999997e-06 2024-09-12T16:16:30.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.388 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524973+0000", 2024-09-12T16:16:30.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1031e-05 2024-09-12T16:16:30.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.388 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524980+0000", 2024-09-12T16:16:30.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6100000000000002e-06 2024-09-12T16:16:30.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.389 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.389 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.389 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577977+0000", 2024-09-12T16:16:30.389 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052997481999999999 2024-09-12T16:16:30.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.389 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.389 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.389 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578062+0000", 2024-09-12T16:16:30.389 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4851000000000005e-05 2024-09-12T16:16:30.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.389 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.389 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.389 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578160+0000", 2024-09-12T16:16:30.390 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7600000000000001e-05 2024-09-12T16:16:30.390 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.390 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.390 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.390 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.390 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14049 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5096448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:30.390 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:16:30.390 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.791229019999999, 2024-09-12T16:16:30.390 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053439792, 2024-09-12T16:16:30.390 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.390 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.390 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.391 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.391 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:30.391 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:30.391 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14049 2024-09-12T16:16:30.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.391 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.391 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.391 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.392 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:16:30.392 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.392 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.392 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.392 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:16:30.392 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.392 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.392 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.392 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525170+0000", 2024-09-12T16:16:30.392 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017958500000000001 2024-09-12T16:16:30.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.393 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.393 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525174+0000", 2024-09-12T16:16:30.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0239999999999999e-06 2024-09-12T16:16:30.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.393 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.393 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525184+0000", 2024-09-12T16:16:30.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5950000000000005e-06 2024-09-12T16:16:30.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.393 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.393 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525191+0000", 2024-09-12T16:16:30.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8329999999999996e-06 2024-09-12T16:16:30.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578240+0000", 2024-09-12T16:16:30.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053049236 2024-09-12T16:16:30.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578333+0000", 2024-09-12T16:16:30.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2806999999999994e-05 2024-09-12T16:16:30.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578431+0000", 2024-09-12T16:16:30.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7712000000000002e-05 2024-09-12T16:16:30.395 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.395 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.395 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.395 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.395 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.395 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14050 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5100544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:30.395 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.525201+0000", 2024-09-12T16:16:30.395 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.791018467000001, 2024-09-12T16:16:30.395 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053367398000000003, 2024-09-12T16:16:30.395 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.395 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.395 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.396 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.396 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:30.396 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:30.396 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14050 2024-09-12T16:16:30.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.396 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.396 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.396 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.396 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525201+0000", 2024-09-12T16:16:30.396 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.396 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.397 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.397 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525201+0000", 2024-09-12T16:16:30.397 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.397 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.397 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.397 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525449+0000", 2024-09-12T16:16:30.397 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00024803999999999999 2024-09-12T16:16:30.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.397 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.397 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.397 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525453+0000", 2024-09-12T16:16:30.397 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.036e-06 2024-09-12T16:16:30.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.398 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.398 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525462+0000", 2024-09-12T16:16:30.398 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6090000000000001e-06 2024-09-12T16:16:30.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.398 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.398 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525472+0000", 2024-09-12T16:16:30.398 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9629999999999993e-06 2024-09-12T16:16:30.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.398 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.398 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578469+0000", 2024-09-12T16:16:30.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052996877999999997 2024-09-12T16:16:30.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.399 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.399 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.399 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578514+0000", 2024-09-12T16:16:30.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5460000000000002e-05 2024-09-12T16:16:30.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.399 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.399 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.399 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578569+0000", 2024-09-12T16:16:30.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4412e-05 2024-09-12T16:16:30.399 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.400 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.400 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.400 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.400 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.400 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14054 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5116928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:30.400 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.526046+0000", 2024-09-12T16:16:30.400 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.790173671, 2024-09-12T16:16:30.400 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053378408000000002, 2024-09-12T16:16:30.400 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.400 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.400 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.400 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.400 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:30.401 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:30.401 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14054 2024-09-12T16:16:30.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.401 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.401 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.401 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.401 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526046+0000", 2024-09-12T16:16:30.401 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.401 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.401 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.401 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526046+0000", 2024-09-12T16:16:30.402 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.402 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.402 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526228+0000", 2024-09-12T16:16:30.402 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018200200000000001 2024-09-12T16:16:30.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.402 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.402 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526236+0000", 2024-09-12T16:16:30.402 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5109999999999997e-06 2024-09-12T16:16:30.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.403 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.403 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526245+0000", 2024-09-12T16:16:30.403 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9600000000000006e-06 2024-09-12T16:16:30.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.403 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.403 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.403 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526251+0000", 2024-09-12T16:16:30.403 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5520000000000001e-06 2024-09-12T16:16:30.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.403 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.403 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.403 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579226+0000", 2024-09-12T16:16:30.403 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052974343 2024-09-12T16:16:30.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.404 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.404 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.404 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579324+0000", 2024-09-12T16:16:30.404 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8517000000000006e-05 2024-09-12T16:16:30.404 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.404 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.404 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.404 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579425+0000", 2024-09-12T16:16:30.404 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000100523 2024-09-12T16:16:30.404 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.404 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.404 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.404 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.405 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.405 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14055 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5121024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:30.405 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:16:30.405 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.789958328999999, 2024-09-12T16:16:30.405 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053399038000000003, 2024-09-12T16:16:30.405 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.405 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.405 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.405 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.405 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:30.405 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:30.405 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14055 2024-09-12T16:16:30.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.406 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.406 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:16:30.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.406 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:16:30.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.407 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526403+0000", 2024-09-12T16:16:30.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141571 2024-09-12T16:16:30.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.407 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.407 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526406+0000", 2024-09-12T16:16:30.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2660000000000002e-06 2024-09-12T16:16:30.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.407 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.407 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526420+0000", 2024-09-12T16:16:30.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3949e-05 2024-09-12T16:16:30.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.408 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.408 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526428+0000", 2024-09-12T16:16:30.408 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4250000000000001e-06 2024-09-12T16:16:30.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.408 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.408 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.408 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579476+0000", 2024-09-12T16:16:30.408 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053048349000000002 2024-09-12T16:16:30.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.408 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.408 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.408 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579563+0000", 2024-09-12T16:16:30.408 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6502999999999995e-05 2024-09-12T16:16:30.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.409 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.409 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.409 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579661+0000", 2024-09-12T16:16:30.409 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7974999999999996e-05 2024-09-12T16:16:30.409 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.409 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.409 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.409 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.409 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.409 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14056 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5125120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:30.409 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.526441+0000", 2024-09-12T16:16:30.409 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.789778888000001, 2024-09-12T16:16:30.409 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053361440000000003, 2024-09-12T16:16:30.409 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.410 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.410 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.410 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.410 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:30.410 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:30.410 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14056 2024-09-12T16:16:30.410 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.410 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.410 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.410 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.410 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526441+0000", 2024-09-12T16:16:30.410 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.411 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.411 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526441+0000", 2024-09-12T16:16:30.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.411 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.411 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526707+0000", 2024-09-12T16:16:30.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026625599999999998 2024-09-12T16:16:30.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.411 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.411 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526711+0000", 2024-09-12T16:16:30.412 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.844e-06 2024-09-12T16:16:30.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.412 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.412 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526720+0000", 2024-09-12T16:16:30.412 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.704e-06 2024-09-12T16:16:30.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.412 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.412 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526726+0000", 2024-09-12T16:16:30.412 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4679999999999997e-06 2024-09-12T16:16:30.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.413 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.413 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579700+0000", 2024-09-12T16:16:30.413 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052973428000000003 2024-09-12T16:16:30.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.413 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.413 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579745+0000", 2024-09-12T16:16:30.413 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.494e-05 2024-09-12T16:16:30.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.413 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.413 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579802+0000", 2024-09-12T16:16:30.413 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7800000000000002e-05 2024-09-12T16:16:30.413 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.414 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.414 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.414 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.414 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.414 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:30.416 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:16:30.417 INFO:teuthology.orchestra.run.smithi204.stdout:2078 write 0xb01ba00 thru 0xb0204c6 (0x4ac7 bytes) 2024-09-12T16:16:30.417 INFO:teuthology.orchestra.run.smithi204.stdout:2079 write 0x553d600 thru 0x5548696 (0xb097 bytes) 2024-09-12T16:16:30.417 INFO:teuthology.orchestra.run.smithi204.stdout:2082 read 0x8d28200 thru 0x8d30006 (0x7e07 bytes) 2024-09-12T16:16:30.417 INFO:teuthology.orchestra.run.smithi204.stdout:2083 write 0xd4fb600 thru 0xd508016 (0xca17 bytes) 2024-09-12T16:16:30.417 INFO:teuthology.orchestra.run.smithi204.stdout:2087 read 0xc37800 thru 0xc40bb9 (0x93ba bytes) 2024-09-12T16:16:30.417 INFO:teuthology.orchestra.run.smithi204.stdout:2089 read 0xc222800 thru 0xc225ba5 (0x33a6 bytes) 2024-09-12T16:16:30.417 INFO:teuthology.orchestra.run.smithi204.stdout:2091 punch from 0xb2abc00 to 0xb2b8800, (0xcc00 bytes) 2024-09-12T16:16:30.417 INFO:teuthology.orchestra.run.smithi204.stdout:2092 punch from 0x1056200 to 0x1057e00, (0x1c00 bytes) 2024-09-12T16:16:30.417 INFO:teuthology.orchestra.run.smithi204.stdout:2093 punch from 0x3052000 to 0x305b200, (0x9200 bytes) 2024-09-12T16:16:30.418 INFO:teuthology.orchestra.run.smithi204.stdout:2097 write 0x48dc400 thru 0x48e0d6d (0x496e bytes) 2024-09-12T16:16:30.418 INFO:teuthology.orchestra.run.smithi204.stdout:2098 write 0x52e0c00 thru 0x52e5078 (0x4479 bytes) 2024-09-12T16:16:30.418 INFO:teuthology.orchestra.run.smithi204.stdout:2099 punch from 0xade3200 to 0xadf1400, (0xe200 bytes) 2024-09-12T16:16:30.418 INFO:teuthology.orchestra.run.smithi204.stdout:2100 trunc from 0xd508200 to 0x452da00 2024-09-12T16:16:30.419 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:30.414+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:30.419 INFO:teuthology.orchestra.run.smithi204.stdout:2103 trunc from 0x452da00 to 0x2ae3200 2024-09-12T16:16:30.442 INFO:teuthology.orchestra.run.smithi204.stdout:2104 read 0x2175c00 thru 0x2177113 (0x1514 bytes) 2024-09-12T16:16:30.458 INFO:teuthology.orchestra.run.smithi204.stdout:2106 write 0x7c36200 thru 0x7c413ab (0xb1ac bytes) 2024-09-12T16:16:30.466 INFO:teuthology.orchestra.run.smithi204.stdout:2107 trunc from 0x7c41400 to 0x1462e00 2024-09-12T16:16:30.490 INFO:teuthology.orchestra.run.smithi204.stdout:2108 trunc from 0x1462e00 to 0x3222c00 2024-09-12T16:16:30.499 INFO:teuthology.orchestra.run.smithi204.stdout:2109 punch from 0x8e0600 to 0x8e0a00, (0x400 bytes) 2024-09-12T16:16:30.503 INFO:teuthology.orchestra.run.smithi204.stdout:2112 trunc from 0x3222c00 to 0x5c53c00 2024-09-12T16:16:30.516 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:30.514+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:30.519 INFO:teuthology.orchestra.run.smithi204.stdout:2114 read 0xc6ec00 thru 0xc77fec (0x93ed bytes) 2024-09-12T16:16:30.520 INFO:teuthology.orchestra.run.smithi204.stdout:2115 clone 10 order 21 su 16384 sc 15 2024-09-12T16:16:30.543 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:30.543 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:16:30.543 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.543 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4806.0:3640 3.e 3:7004e302:::rbd_data.11552a37e55b.0000000000000009:head [sparse-read 6823936~0 out=8b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:16:30.543 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.542454+0000", 2024-09-12T16:16:30.543 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.00033947399999999998, 2024-09-12T16:16:30.543 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00035744500000000002, 2024-09-12T16:16:30.543 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.543 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.543 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.544 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.544 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4806", 2024-09-12T16:16:30.544 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3959815836", 2024-09-12T16:16:30.544 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 3640 2024-09-12T16:16:30.544 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.544 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.544 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.544 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.544 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.542454+0000", 2024-09-12T16:16:30.544 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.544 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.544 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.544 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.545 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.542454+0000", 2024-09-12T16:16:30.545 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.545 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.545 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.545 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.542455+0000", 2024-09-12T16:16:30.545 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5799999999999999e-07 2024-09-12T16:16:30.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.545 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.545 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.545 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.542457+0000", 2024-09-12T16:16:30.545 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5339999999999998e-06 2024-09-12T16:16:30.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.546 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.546 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.546 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.542465+0000", 2024-09-12T16:16:30.546 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4390000000000003e-06 2024-09-12T16:16:30.546 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.546 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.546 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.546 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.542471+0000", 2024-09-12T16:16:30.546 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7490000000000004e-06 2024-09-12T16:16:30.546 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.546 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.546 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.546 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.542599+0000", 2024-09-12T16:16:30.547 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012864699999999999 2024-09-12T16:16:30.547 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.547 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.547 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.547 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.542683+0000", 2024-09-12T16:16:30.547 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3243000000000002e-05 2024-09-12T16:16:30.547 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.547 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.547 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.547 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.547 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.547 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4806.0:3641 3.e 3.40c7200e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:16:30.547 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.542481+0000", 2024-09-12T16:16:30.547 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.00031260599999999999, 2024-09-12T16:16:30.547 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00036674800000000002, 2024-09-12T16:16:30.548 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.548 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.548 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:30.548 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.548 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4806", 2024-09-12T16:16:30.548 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3959815836", 2024-09-12T16:16:30.548 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 3641 2024-09-12T16:16:30.548 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.548 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.548 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.548 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.548 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.542481+0000", 2024-09-12T16:16:30.548 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.548 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.549 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.549 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.549 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.542481+0000", 2024-09-12T16:16:30.549 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.549 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.549 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.549 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.542482+0000", 2024-09-12T16:16:30.549 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1500000000000005e-07 2024-09-12T16:16:30.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.549 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.549 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.549 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.542484+0000", 2024-09-12T16:16:30.550 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3250000000000002e-06 2024-09-12T16:16:30.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.550 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.550 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.542491+0000", 2024-09-12T16:16:30.550 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8859999999999998e-06 2024-09-12T16:16:30.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.550 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.550 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.542496+0000", 2024-09-12T16:16:30.550 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2360000000000004e-06 2024-09-12T16:16:30.550 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.550 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.551 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.551 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.551 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-12T16:16:30.551 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 2 2024-09-12T16:16:30.551 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:30.552 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:16:30.617 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:30.617+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:30.700 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:30.700 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:16:30.700 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:16:30.700 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:16:30.700 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:30.708 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:16:30.718 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:30.717+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:30.816 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:30.816 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:16:30.816 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:16:30.816 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:16:30.816 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.816 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:20620 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 1482752~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:30.816 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.775875+0000", 2024-09-12T16:16:30.816 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.038659597000001, 2024-09-12T16:16:30.816 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.051720878999999997, 2024-09-12T16:16:30.817 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.817 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.817 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.817 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.817 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:30.817 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:30.817 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 20620 2024-09-12T16:16:30.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.817 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.817 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.817 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.817 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775875+0000", 2024-09-12T16:16:30.817 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.817 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.818 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.818 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775875+0000", 2024-09-12T16:16:30.818 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.818 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.818 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.818 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775875+0000", 2024-09-12T16:16:30.818 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0599999999999999e-07 2024-09-12T16:16:30.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.818 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.818 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.818 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775876+0000", 2024-09-12T16:16:30.818 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.034e-06 2024-09-12T16:16:30.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.819 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.819 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.819 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775879+0000", 2024-09-12T16:16:30.819 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9359999999999999e-06 2024-09-12T16:16:30.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.819 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.819 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.819 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775882+0000", 2024-09-12T16:16:30.819 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5270000000000001e-06 2024-09-12T16:16:30.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.819 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.819 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.819 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.827445+0000", 2024-09-12T16:16:30.819 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.051563377000000001 2024-09-12T16:16:30.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.820 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.820 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.820 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.827489+0000", 2024-09-12T16:16:30.820 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4443999999999997e-05 2024-09-12T16:16:30.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.820 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.820 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.820 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.827596+0000", 2024-09-12T16:16:30.820 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010635499999999999 2024-09-12T16:16:30.820 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.820 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.820 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.821 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.821 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:20621 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 1486848~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:30.821 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.775885+0000", 2024-09-12T16:16:30.821 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.038649971, 2024-09-12T16:16:30.821 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.051871970000000003, 2024-09-12T16:16:30.821 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.821 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.821 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.821 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.821 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:30.821 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:30.821 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 20621 2024-09-12T16:16:30.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.821 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.822 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.822 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.822 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775885+0000", 2024-09-12T16:16:30.822 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.822 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.822 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.822 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775885+0000", 2024-09-12T16:16:30.822 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.822 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.822 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.822 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775885+0000", 2024-09-12T16:16:30.823 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0100000000000001e-07 2024-09-12T16:16:30.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.823 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.823 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775886+0000", 2024-09-12T16:16:30.823 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1069999999999999e-06 2024-09-12T16:16:30.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.823 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.823 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775889+0000", 2024-09-12T16:16:30.823 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9380000000000001e-06 2024-09-12T16:16:30.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.824 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.824 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.824 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775891+0000", 2024-09-12T16:16:30.824 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3319999999999999e-06 2024-09-12T16:16:30.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.824 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.824 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.824 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.827613+0000", 2024-09-12T16:16:30.824 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.051721637000000001 2024-09-12T16:16:30.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.824 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.824 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.825 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.827654+0000", 2024-09-12T16:16:30.825 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1233999999999999e-05 2024-09-12T16:16:30.825 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.825 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.825 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.825 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.827756+0000", 2024-09-12T16:16:30.825 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102521 2024-09-12T16:16:30.825 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.825 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.825 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.825 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.825 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.825 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:20622 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 1490944~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:30.826 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.775894+0000", 2024-09-12T16:16:30.826 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.038640451999999, 2024-09-12T16:16:30.826 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052034955000000001, 2024-09-12T16:16:30.826 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.826 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.826 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.826 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.826 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:30.826 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:30.826 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 20622 2024-09-12T16:16:30.826 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.826 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.826 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.826 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.826 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775894+0000", 2024-09-12T16:16:30.827 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.827 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.827 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.827 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.827 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775894+0000", 2024-09-12T16:16:30.827 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.827 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.827 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.827 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.827 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775894+0000", 2024-09-12T16:16:30.827 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0599999999999999e-07 2024-09-12T16:16:30.827 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.828 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.828 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.828 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775895+0000", 2024-09-12T16:16:30.828 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.105e-06 2024-09-12T16:16:30.828 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.828 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.828 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.828 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775898+0000", 2024-09-12T16:16:30.828 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9469999999999999e-06 2024-09-12T16:16:30.828 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.828 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.828 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.828 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775901+0000", 2024-09-12T16:16:30.828 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5110000000000002e-06 2024-09-12T16:16:30.828 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.829 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.829 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.829 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.827783+0000", 2024-09-12T16:16:30.829 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.051882686999999997 2024-09-12T16:16:30.829 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.829 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.829 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.829 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.827825+0000", 2024-09-12T16:16:30.829 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1573999999999999e-05 2024-09-12T16:16:30.829 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.829 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.829 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.829 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.827929+0000", 2024-09-12T16:16:30.829 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010392500000000001 2024-09-12T16:16:30.829 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.830 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.830 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.830 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.830 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:20623 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 1495040~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:30.830 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.775904+0000", 2024-09-12T16:16:30.830 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.038630663999999, 2024-09-12T16:16:30.830 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052191906000000003, 2024-09-12T16:16:30.830 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.830 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.830 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.830 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.830 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:30.830 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:30.831 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 20623 2024-09-12T16:16:30.831 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.831 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.831 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.831 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.831 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775904+0000", 2024-09-12T16:16:30.831 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.831 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.831 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.831 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.831 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775904+0000", 2024-09-12T16:16:30.831 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.831 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.831 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.831 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.832 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775904+0000", 2024-09-12T16:16:30.832 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0900000000000001e-07 2024-09-12T16:16:30.832 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.832 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.832 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.832 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775905+0000", 2024-09-12T16:16:30.832 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.083e-06 2024-09-12T16:16:30.832 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.832 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.832 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.832 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775908+0000", 2024-09-12T16:16:30.832 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9849999999999998e-06 2024-09-12T16:16:30.832 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.832 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.832 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.833 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775912+0000", 2024-09-12T16:16:30.833 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9419999999999997e-06 2024-09-12T16:16:30.833 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.833 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.833 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.833 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.827951+0000", 2024-09-12T16:16:30.833 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052038976000000001 2024-09-12T16:16:30.833 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.833 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.833 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.833 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.827996+0000", 2024-09-12T16:16:30.833 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5444000000000001e-05 2024-09-12T16:16:30.834 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.834 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.834 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.834 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.828096+0000", 2024-09-12T16:16:30.834 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9266999999999997e-05 2024-09-12T16:16:30.834 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.834 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.834 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.834 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.834 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.834 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:20624 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 1499136~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:30.834 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.775916+0000", 2024-09-12T16:16:30.834 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.038618908, 2024-09-12T16:16:30.834 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052356906000000002, 2024-09-12T16:16:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 20624 2024-09-12T16:16:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775916+0000", 2024-09-12T16:16:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.836 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775916+0000", 2024-09-12T16:16:30.836 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.836 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.836 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.836 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.781366+0000", 2024-09-12T16:16:30.836 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0054508339999999999 2024-09-12T16:16:30.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.836 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.836 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.836 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.781372+0000", 2024-09-12T16:16:30.836 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6980000000000003e-06 2024-09-12T16:16:30.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.837 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.837 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.837 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.781382+0000", 2024-09-12T16:16:30.837 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6490000000000003e-06 2024-09-12T16:16:30.837 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.837 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.837 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.837 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.781386+0000", 2024-09-12T16:16:30.837 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4039999999999997e-06 2024-09-12T16:16:30.837 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.837 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.837 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.837 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.828122+0000", 2024-09-12T16:16:30.837 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.046736236 2024-09-12T16:16:30.838 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.838 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.838 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.838 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.828164+0000", 2024-09-12T16:16:30.838 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1567999999999999e-05 2024-09-12T16:16:30.838 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.838 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.838 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.838 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.828272+0000", 2024-09-12T16:16:30.838 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000108517 2024-09-12T16:16:30.838 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.838 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.838 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.839 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.839 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.839 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:20653 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 1617920~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:30.839 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.781724+0000", 2024-09-12T16:16:30.839 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.032810055000001, 2024-09-12T16:16:30.839 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.051816203999999998, 2024-09-12T16:16:30.839 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.839 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.839 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.839 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.839 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:30.839 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:30.839 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 20653 2024-09-12T16:16:30.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.840 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.840 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.840 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.840 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.781724+0000", 2024-09-12T16:16:30.840 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.840 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.840 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.840 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.781724+0000", 2024-09-12T16:16:30.840 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.840 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.841 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.841 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.781725+0000", 2024-09-12T16:16:30.841 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0599999999999999e-07 2024-09-12T16:16:30.841 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.841 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.841 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.841 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.781726+0000", 2024-09-12T16:16:30.841 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.569999999999999e-07 2024-09-12T16:16:30.841 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.841 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.841 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.841 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.781729+0000", 2024-09-12T16:16:30.841 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9289999999999998e-06 2024-09-12T16:16:30.842 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.842 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.842 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.842 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.781731+0000", 2024-09-12T16:16:30.842 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3530000000000002e-06 2024-09-12T16:16:30.842 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.842 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.842 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.842 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.833393+0000", 2024-09-12T16:16:30.842 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.051662176999999997 2024-09-12T16:16:30.842 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.842 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.842 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.842 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.833434+0000", 2024-09-12T16:16:30.843 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1403000000000003e-05 2024-09-12T16:16:30.843 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.843 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.843 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.843 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.833541+0000", 2024-09-12T16:16:30.843 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000106179 2024-09-12T16:16:30.843 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.843 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.843 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.843 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.843 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.843 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:20654 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 1622016~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:30.843 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.781737+0000", 2024-09-12T16:16:30.844 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.032797816, 2024-09-12T16:16:30.844 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.05198059, 2024-09-12T16:16:30.844 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.844 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.844 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.844 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.844 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:30.844 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:30.844 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 20654 2024-09-12T16:16:30.844 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.844 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.844 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.845 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.845 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.781737+0000", 2024-09-12T16:16:30.845 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.845 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.845 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.845 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.781737+0000", 2024-09-12T16:16:30.845 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.845 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.845 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.845 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.787347+0000", 2024-09-12T16:16:30.845 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0056106510000000004 2024-09-12T16:16:30.846 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.846 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.846 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.846 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.787350+0000", 2024-09-12T16:16:30.846 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0350000000000002e-06 2024-09-12T16:16:30.846 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.846 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.846 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.846 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.787357+0000", 2024-09-12T16:16:30.846 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1920000000000002e-06 2024-09-12T16:16:30.846 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.846 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.847 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.847 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.787360+0000", 2024-09-12T16:16:30.847 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8589999999999998e-06 2024-09-12T16:16:30.847 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.847 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.847 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.847 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.833566+0000", 2024-09-12T16:16:30.847 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.046205952000000002 2024-09-12T16:16:30.847 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.847 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.847 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.847 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.833611+0000", 2024-09-12T16:16:30.847 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5036e-05 2024-09-12T16:16:30.848 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.848 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.848 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.848 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.833717+0000", 2024-09-12T16:16:30.848 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000105865 2024-09-12T16:16:30.848 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.848 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.848 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.848 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.848 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.848 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:21541 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 2075648~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:30.848 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.979289+0000", 2024-09-12T16:16:30.848 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 9.8352452820000007, 2024-09-12T16:16:30.849 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.051802583999999999, 2024-09-12T16:16:30.849 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.849 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.849 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.849 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.849 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:30.849 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:30.849 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 21541 2024-09-12T16:16:30.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.849 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.849 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979289+0000", 2024-09-12T16:16:30.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979289+0000", 2024-09-12T16:16:30.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979290+0000", 2024-09-12T16:16:30.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.99e-07 2024-09-12T16:16:30.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.851 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.851 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979296+0000", 2024-09-12T16:16:30.851 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2729999999999999e-06 2024-09-12T16:16:30.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.851 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.851 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.851 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979305+0000", 2024-09-12T16:16:30.851 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0270000000000001e-06 2024-09-12T16:16:30.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.851 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.851 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.851 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979311+0000", 2024-09-12T16:16:30.852 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8610000000000003e-06 2024-09-12T16:16:30.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.852 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.852 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.852 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.030931+0000", 2024-09-12T16:16:30.852 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.051619736999999999 2024-09-12T16:16:30.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.852 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.852 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.852 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.030980+0000", 2024-09-12T16:16:30.852 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9599999999999999e-05 2024-09-12T16:16:30.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.852 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.853 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.853 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031092+0000", 2024-09-12T16:16:30.853 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000111487 2024-09-12T16:16:30.853 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.853 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.853 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.853 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.853 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.853 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:21542 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 2079744~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:30.853 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.979322+0000", 2024-09-12T16:16:30.853 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 9.8352127320000005, 2024-09-12T16:16:30.853 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052007360000000002, 2024-09-12T16:16:30.853 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.854 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.854 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.854 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.854 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:30.854 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:30.854 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 21542 2024-09-12T16:16:30.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.854 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.854 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.854 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.854 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979322+0000", 2024-09-12T16:16:30.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979322+0000", 2024-09-12T16:16:30.855 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979322+0000", 2024-09-12T16:16:30.855 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1099999999999995e-07 2024-09-12T16:16:30.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979325+0000", 2024-09-12T16:16:30.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1349999999999999e-06 2024-09-12T16:16:30.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.856 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.856 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979331+0000", 2024-09-12T16:16:30.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7220000000000002e-06 2024-09-12T16:16:30.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.856 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.856 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979338+0000", 2024-09-12T16:16:30.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5230000000000001e-06 2024-09-12T16:16:30.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.856 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.857 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031124+0000", 2024-09-12T16:16:30.857 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.051786302999999999 2024-09-12T16:16:30.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.857 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.857 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.857 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031166+0000", 2024-09-12T16:16:30.857 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2287999999999999e-05 2024-09-12T16:16:30.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.857 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.857 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.857 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031329+0000", 2024-09-12T16:16:30.857 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016277800000000001 2024-09-12T16:16:30.857 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.857 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.857 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.858 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.858 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:21543 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 2083840~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:30.858 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.979347+0000", 2024-09-12T16:16:30.858 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 9.8351878429999999, 2024-09-12T16:16:30.858 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052189063000000001, 2024-09-12T16:16:30.858 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.858 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.858 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.858 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.858 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:30.858 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:30.858 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 21543 2024-09-12T16:16:30.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.859 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.859 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.859 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979347+0000", 2024-09-12T16:16:30.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.859 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.859 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979347+0000", 2024-09-12T16:16:30.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.859 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.860 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979347+0000", 2024-09-12T16:16:30.860 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:16:30.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.860 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.860 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.860 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979349+0000", 2024-09-12T16:16:30.860 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.12e-06 2024-09-12T16:16:30.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.860 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.860 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.860 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979356+0000", 2024-09-12T16:16:30.860 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6279999999999999e-06 2024-09-12T16:16:30.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.860 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.861 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.861 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979361+0000", 2024-09-12T16:16:30.861 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8210000000000001e-06 2024-09-12T16:16:30.861 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.861 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.861 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.861 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031363+0000", 2024-09-12T16:16:30.861 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052002233000000002 2024-09-12T16:16:30.861 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.861 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.861 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.861 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031414+0000", 2024-09-12T16:16:30.861 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1289000000000003e-05 2024-09-12T16:16:30.861 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.862 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.862 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.862 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031536+0000", 2024-09-12T16:16:30.862 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000121582 2024-09-12T16:16:30.862 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.862 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.862 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.862 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.862 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.862 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:21544 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 2087936~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:30.862 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.979368+0000", 2024-09-12T16:16:30.862 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 9.8351668639999996, 2024-09-12T16:16:30.862 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052342535000000003, 2024-09-12T16:16:30.862 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.863 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.863 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.863 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.863 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:30.863 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:30.863 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 21544 2024-09-12T16:16:30.863 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.863 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.863 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.863 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.863 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979368+0000", 2024-09-12T16:16:30.863 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.864 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.864 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.864 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.864 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979368+0000", 2024-09-12T16:16:30.864 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.864 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.864 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.864 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.864 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979368+0000", 2024-09-12T16:16:30.864 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9900000000000001e-07 2024-09-12T16:16:30.864 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.864 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.864 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.865 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979370+0000", 2024-09-12T16:16:30.865 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9980000000000002e-06 2024-09-12T16:16:30.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.865 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.865 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.865 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979376+0000", 2024-09-12T16:16:30.865 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1539999999999999e-06 2024-09-12T16:16:30.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.865 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.865 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.865 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979381+0000", 2024-09-12T16:16:30.865 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4789999999999998e-06 2024-09-12T16:16:30.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.866 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.866 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.866 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031550+0000", 2024-09-12T16:16:30.866 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052169363000000003 2024-09-12T16:16:30.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.866 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.866 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.866 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031594+0000", 2024-09-12T16:16:30.866 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3619999999999999e-05 2024-09-12T16:16:30.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.866 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.866 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.866 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031710+0000", 2024-09-12T16:16:30.866 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000116422 2024-09-12T16:16:30.867 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.867 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.867 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.867 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.867 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.867 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:21545 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 2092032~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:30.867 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.979395+0000", 2024-09-12T16:16:30.867 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 9.8351393030000001, 2024-09-12T16:16:30.867 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052494740999999998, 2024-09-12T16:16:30.867 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.867 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.867 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.867 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.867 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:30.868 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:30.868 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 21545 2024-09-12T16:16:30.868 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.868 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.868 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.868 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.868 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979395+0000", 2024-09-12T16:16:30.868 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.868 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.868 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.868 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.868 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979395+0000", 2024-09-12T16:16:30.868 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.868 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.869 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.869 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.869 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979396+0000", 2024-09-12T16:16:30.869 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7599999999999997e-07 2024-09-12T16:16:30.869 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.869 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.869 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.869 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979398+0000", 2024-09-12T16:16:30.869 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2500000000000001e-06 2024-09-12T16:16:30.869 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.869 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.869 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.870 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979405+0000", 2024-09-12T16:16:30.870 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6730000000000003e-06 2024-09-12T16:16:30.870 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.870 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.870 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.870 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979410+0000", 2024-09-12T16:16:30.870 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1599999999999997e-06 2024-09-12T16:16:30.870 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.870 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.870 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.870 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031738+0000", 2024-09-12T16:16:30.870 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052327775 2024-09-12T16:16:30.870 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.870 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.870 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.871 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031782+0000", 2024-09-12T16:16:30.871 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4672999999999997e-05 2024-09-12T16:16:30.871 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.871 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.871 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.871 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031890+0000", 2024-09-12T16:16:30.871 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000107734 2024-09-12T16:16:30.871 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.871 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.871 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.871 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.871 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.871 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:21546 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 2096128~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:30.872 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.979416+0000", 2024-09-12T16:16:30.872 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 9.8351180080000002, 2024-09-12T16:16:30.872 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052634296999999997, 2024-09-12T16:16:30.872 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.872 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.872 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.872 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.872 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:30.872 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:30.872 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 21546 2024-09-12T16:16:30.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.872 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.872 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.872 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.873 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979416+0000", 2024-09-12T16:16:30.873 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.873 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.873 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.873 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.873 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979416+0000", 2024-09-12T16:16:30.873 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.873 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.873 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.873 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.873 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979417+0000", 2024-09-12T16:16:30.873 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8099999999999998e-07 2024-09-12T16:16:30.873 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.874 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.874 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.874 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979419+0000", 2024-09-12T16:16:30.874 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.883e-06 2024-09-12T16:16:30.874 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.874 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.874 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.874 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979428+0000", 2024-09-12T16:16:30.874 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5820000000000008e-06 2024-09-12T16:16:30.874 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.874 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.874 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.874 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979435+0000", 2024-09-12T16:16:30.874 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2689999999999996e-06 2024-09-12T16:16:30.874 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.875 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.875 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.875 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031905+0000", 2024-09-12T16:16:30.875 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052470637000000001 2024-09-12T16:16:30.875 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.875 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.875 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.875 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031946+0000", 2024-09-12T16:16:30.875 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0973000000000002e-05 2024-09-12T16:16:30.875 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.875 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.875 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.875 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032051+0000", 2024-09-12T16:16:30.875 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000104572 2024-09-12T16:16:30.876 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.876 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.876 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.876 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.876 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.876 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:21549 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 2097152~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:30.876 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.979476+0000", 2024-09-12T16:16:30.876 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 9.8350583189999998, 2024-09-12T16:16:30.876 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052700314999999998, 2024-09-12T16:16:30.876 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.876 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.876 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.876 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.876 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:30.877 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:30.877 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 21549 2024-09-12T16:16:30.877 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.877 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.877 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.877 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.877 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979476+0000", 2024-09-12T16:16:30.877 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.877 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.877 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.877 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.877 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979476+0000", 2024-09-12T16:16:30.877 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.877 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.877 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.878 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.878 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979477+0000", 2024-09-12T16:16:30.878 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.63e-07 2024-09-12T16:16:30.878 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.878 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.878 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.878 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979479+0000", 2024-09-12T16:16:30.878 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5799999999999999e-06 2024-09-12T16:16:30.878 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.878 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.878 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.878 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979487+0000", 2024-09-12T16:16:30.878 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7200000000000006e-06 2024-09-12T16:16:30.878 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.878 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.879 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.879 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979492+0000", 2024-09-12T16:16:30.879 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9479999999999999e-06 2024-09-12T16:16:30.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.879 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.879 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.879 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032078+0000", 2024-09-12T16:16:30.879 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052585999000000001 2024-09-12T16:16:30.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.879 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.879 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.879 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032120+0000", 2024-09-12T16:16:30.879 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2367999999999998e-05 2024-09-12T16:16:30.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.879 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.880 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.880 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032176+0000", 2024-09-12T16:16:30.880 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6236999999999997e-05 2024-09-12T16:16:30.880 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.880 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.880 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.880 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.880 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:21550 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 2101248~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:30.880 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.979500+0000", 2024-09-12T16:16:30.880 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 9.8350349589999997, 2024-09-12T16:16:30.880 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052810058, 2024-09-12T16:16:30.880 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.880 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.880 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.881 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.881 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:30.881 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:30.881 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 21550 2024-09-12T16:16:30.881 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.881 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.881 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.881 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.881 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979500+0000", 2024-09-12T16:16:30.881 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.881 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.881 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.881 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.881 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979500+0000", 2024-09-12T16:16:30.882 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.882 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.882 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.882 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.882 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979500+0000", 2024-09-12T16:16:30.882 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3300000000000003e-07 2024-09-12T16:16:30.882 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.882 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.882 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.882 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979502+0000", 2024-09-12T16:16:30.882 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1859999999999999e-06 2024-09-12T16:16:30.882 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.882 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.882 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.882 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979509+0000", 2024-09-12T16:16:30.882 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8859999999999998e-06 2024-09-12T16:16:30.883 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.883 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.883 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.883 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979514+0000", 2024-09-12T16:16:30.883 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8539999999999996e-06 2024-09-12T16:16:30.883 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.883 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.883 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.883 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032205+0000", 2024-09-12T16:16:30.883 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052690744999999997 2024-09-12T16:16:30.883 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.883 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.883 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.884 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032255+0000", 2024-09-12T16:16:30.884 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0444e-05 2024-09-12T16:16:30.884 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.884 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.884 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.884 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032310+0000", 2024-09-12T16:16:30.884 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4509999999999998e-05 2024-09-12T16:16:30.884 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.884 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.884 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.884 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.884 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.884 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:21552 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 2105344~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:30.884 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.979520+0000", 2024-09-12T16:16:30.884 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 9.8350139989999992, 2024-09-12T16:16:30.885 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052925321999999997, 2024-09-12T16:16:30.885 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.885 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.885 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.885 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.885 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:30.885 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:30.885 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 21552 2024-09-12T16:16:30.885 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.885 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.885 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.885 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.885 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979520+0000", 2024-09-12T16:16:30.885 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.885 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.886 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.886 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.886 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979520+0000", 2024-09-12T16:16:30.886 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.886 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.886 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.886 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.886 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979521+0000", 2024-09-12T16:16:30.886 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3099999999999999e-07 2024-09-12T16:16:30.886 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.886 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.886 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.886 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979523+0000", 2024-09-12T16:16:30.886 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2089999999999999e-06 2024-09-12T16:16:30.886 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.887 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.887 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.887 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979529+0000", 2024-09-12T16:16:30.887 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.993e-06 2024-09-12T16:16:30.887 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.887 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.887 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.887 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979535+0000", 2024-09-12T16:16:30.887 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8599999999999998e-06 2024-09-12T16:16:30.887 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.887 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.887 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.887 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032339+0000", 2024-09-12T16:16:30.887 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052804413000000001 2024-09-12T16:16:30.888 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.888 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.888 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.888 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032381+0000", 2024-09-12T16:16:30.888 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2098000000000002e-05 2024-09-12T16:16:30.888 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.888 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.888 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.888 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032446+0000", 2024-09-12T16:16:30.888 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4418000000000006e-05 2024-09-12T16:16:30.888 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.888 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.888 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.888 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.889 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.889 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:21553 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 2109440~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:30.889 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.979542+0000", 2024-09-12T16:16:30.889 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 9.8349926359999991, 2024-09-12T16:16:30.889 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053035463999999997, 2024-09-12T16:16:30.889 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.889 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.889 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.889 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.889 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:30.889 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:30.889 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 21553 2024-09-12T16:16:30.889 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.889 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.889 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.890 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.890 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979542+0000", 2024-09-12T16:16:30.890 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.890 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.890 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.890 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.890 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979542+0000", 2024-09-12T16:16:30.890 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.890 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.890 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.890 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.890 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979542+0000", 2024-09-12T16:16:30.890 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8699999999999995e-07 2024-09-12T16:16:30.890 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.890 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.890 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.891 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979544+0000", 2024-09-12T16:16:30.891 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.84e-06 2024-09-12T16:16:30.891 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.891 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.891 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.891 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979550+0000", 2024-09-12T16:16:30.891 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2280000000000003e-06 2024-09-12T16:16:30.891 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.891 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.891 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.891 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979555+0000", 2024-09-12T16:16:30.891 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8999999999999997e-06 2024-09-12T16:16:30.891 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.891 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.891 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.892 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032480+0000", 2024-09-12T16:16:30.892 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052924301999999999 2024-09-12T16:16:30.892 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.892 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.892 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.892 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032521+0000", 2024-09-12T16:16:30.892 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1563000000000002e-05 2024-09-12T16:16:30.892 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.892 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.892 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.892 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032577+0000", 2024-09-12T16:16:30.892 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6144000000000003e-05 2024-09-12T16:16:30.892 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.893 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.893 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.893 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.893 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.893 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:21554 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 2113536~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:30.893 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.979563+0000", 2024-09-12T16:16:30.893 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 9.8349718149999994, 2024-09-12T16:16:30.893 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053150380999999997, 2024-09-12T16:16:30.893 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.894 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.894 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.894 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.894 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:30.894 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:30.894 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 21554 2024-09-12T16:16:30.894 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.894 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.895 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.895 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.895 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979563+0000", 2024-09-12T16:16:30.895 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.895 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.895 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.895 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.895 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979563+0000", 2024-09-12T16:16:30.895 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.895 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.895 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.895 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.895 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979563+0000", 2024-09-12T16:16:30.895 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1600000000000002e-07 2024-09-12T16:16:30.896 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.896 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.896 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.896 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979575+0000", 2024-09-12T16:16:30.896 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.222e-05 2024-09-12T16:16:30.896 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.896 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.896 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.896 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979580+0000", 2024-09-12T16:16:30.896 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7140000000000001e-06 2024-09-12T16:16:30.896 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.896 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.896 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.896 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979583+0000", 2024-09-12T16:16:30.897 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4039999999999999e-06 2024-09-12T16:16:30.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.897 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.897 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.897 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032607+0000", 2024-09-12T16:16:30.897 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053023709000000002 2024-09-12T16:16:30.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.898 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.898 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.898 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032650+0000", 2024-09-12T16:16:30.898 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3012000000000001e-05 2024-09-12T16:16:30.898 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.898 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.898 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.898 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032713+0000", 2024-09-12T16:16:30.898 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2905999999999997e-05 2024-09-12T16:16:30.898 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.898 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.898 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.898 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.898 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.898 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:21555 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 2117632~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:30.899 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.979589+0000", 2024-09-12T16:16:30.899 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 9.8349451590000001, 2024-09-12T16:16:30.899 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053262941000000001, 2024-09-12T16:16:30.899 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.899 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.899 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.899 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.899 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:30.899 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:30.899 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 21555 2024-09-12T16:16:30.899 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.899 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.899 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.899 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.899 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979589+0000", 2024-09-12T16:16:30.900 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.900 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.900 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.900 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.900 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979589+0000", 2024-09-12T16:16:30.900 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.900 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.900 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.900 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.900 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979790+0000", 2024-09-12T16:16:30.900 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020029499999999999 2024-09-12T16:16:30.900 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.900 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.900 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.901 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979794+0000", 2024-09-12T16:16:30.901 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0740000000000003e-06 2024-09-12T16:16:30.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.901 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.901 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.901 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979803+0000", 2024-09-12T16:16:30.901 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8359999999999998e-06 2024-09-12T16:16:30.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.901 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.901 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.901 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979810+0000", 2024-09-12T16:16:30.901 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4680000000000003e-06 2024-09-12T16:16:30.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.902 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.902 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.902 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032742+0000", 2024-09-12T16:16:30.902 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052931745000000002 2024-09-12T16:16:30.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.902 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.902 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.902 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032783+0000", 2024-09-12T16:16:30.902 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1520000000000002e-05 2024-09-12T16:16:30.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.902 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.902 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.902 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032852+0000", 2024-09-12T16:16:30.902 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9003000000000003e-05 2024-09-12T16:16:30.903 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.903 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.903 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.903 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.903 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.903 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:21556 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 2121728~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:30.903 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.979821+0000", 2024-09-12T16:16:30.903 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 9.8347130820000004, 2024-09-12T16:16:30.903 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053150601999999998, 2024-09-12T16:16:30.903 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:30.903 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:30.903 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:30.903 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:30.903 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:30.904 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:30.904 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 21556 2024-09-12T16:16:30.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.904 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:30.904 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.904 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:30.904 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979821+0000", 2024-09-12T16:16:30.904 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.904 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.904 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:30.904 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979821+0000", 2024-09-12T16:16:30.904 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:30.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.905 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.905 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:30.905 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.985409+0000", 2024-09-12T16:16:30.905 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0055875680000000002 2024-09-12T16:16:30.905 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.905 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.905 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:30.905 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.985412+0000", 2024-09-12T16:16:30.905 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4249999999999998e-06 2024-09-12T16:16:30.905 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.905 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.905 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:30.905 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.985423+0000", 2024-09-12T16:16:30.905 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0713000000000001e-05 2024-09-12T16:16:30.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.906 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.906 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:30.906 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.985428+0000", 2024-09-12T16:16:30.906 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9420000000000003e-06 2024-09-12T16:16:30.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.906 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.906 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:30.906 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032880+0000", 2024-09-12T16:16:30.906 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.047452342000000002 2024-09-12T16:16:30.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.906 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.906 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:30.907 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032921+0000", 2024-09-12T16:16:30.907 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0989999999999999e-05 2024-09-12T16:16:30.907 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:30.907 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:30.907 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:30.907 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032972+0000", 2024-09-12T16:16:30.907 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0621999999999997e-05 2024-09-12T16:16:30.907 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.907 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.907 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.907 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:30.907 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:30.907 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:30.909 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:16:30.909 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:30.908+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:31.009 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:31.008+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:31.018 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:31.018 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:31.018 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:16:31.018 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:31.027 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:16:31.102 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T16:16:31.110 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:31.109+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:31.177 INFO:teuthology.orchestra.run.smithi204.stdout:leaving image image_client.0-clone9 intact 2024-09-12T16:16:31.179 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:31.179 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:31.179 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:16:31.179 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:16:31.179 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:31.188 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:16:31.210 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:31.209+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:31.311 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:31.310+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:31.314 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:31.314 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:16:31.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:16:31.314 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:31.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.314 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3703 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14803968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.314 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139513+0000", 2024-09-12T16:16:31.314 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.173071758000001, 2024-09-12T16:16:31.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053248794000000002, 2024-09-12T16:16:31.315 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.315 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.315 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.315 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.315 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.315 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.315 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3703 2024-09-12T16:16:31.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.315 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139513+0000", 2024-09-12T16:16:31.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139513+0000", 2024-09-12T16:16:31.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.317 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139639+0000", 2024-09-12T16:16:31.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012673299999999999 2024-09-12T16:16:31.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.317 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.317 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139642+0000", 2024-09-12T16:16:31.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4820000000000001e-06 2024-09-12T16:16:31.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.317 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.317 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139647+0000", 2024-09-12T16:16:31.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8040000000000001e-06 2024-09-12T16:16:31.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.318 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139650+0000", 2024-09-12T16:16:31.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.529e-06 2024-09-12T16:16:31.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.318 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192537+0000", 2024-09-12T16:16:31.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052886503000000001 2024-09-12T16:16:31.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192627+0000", 2024-09-12T16:16:31.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0183e-05 2024-09-12T16:16:31.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192761+0000", 2024-09-12T16:16:31.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013456000000000001 2024-09-12T16:16:31.319 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.320 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.320 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.320 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3704 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14808064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.320 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139656+0000", 2024-09-12T16:16:31.320 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.172927842, 2024-09-12T16:16:31.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053247502000000002, 2024-09-12T16:16:31.320 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.320 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.320 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.320 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.321 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.321 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.321 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3704 2024-09-12T16:16:31.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.321 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.321 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.321 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139656+0000", 2024-09-12T16:16:31.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.321 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.322 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139656+0000", 2024-09-12T16:16:31.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.322 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.322 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139790+0000", 2024-09-12T16:16:31.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000133471 2024-09-12T16:16:31.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.322 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.322 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139792+0000", 2024-09-12T16:16:31.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.968e-06 2024-09-12T16:16:31.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139796+0000", 2024-09-12T16:16:31.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2660000000000003e-06 2024-09-12T16:16:31.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139799+0000", 2024-09-12T16:16:31.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2839999999999998e-06 2024-09-12T16:16:31.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192790+0000", 2024-09-12T16:16:31.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052990388999999999 2024-09-12T16:16:31.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192835+0000", 2024-09-12T16:16:31.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5101000000000001e-05 2024-09-12T16:16:31.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.325 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.325 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192904+0000", 2024-09-12T16:16:31.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9023000000000006e-05 2024-09-12T16:16:31.325 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.325 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.325 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.325 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3705 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14812160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.325 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:16:31.325 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.172779505999999, 2024-09-12T16:16:31.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053368831999999998, 2024-09-12T16:16:31.326 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.326 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.326 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.326 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.326 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.326 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.326 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3705 2024-09-12T16:16:31.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.326 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.326 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:16:31.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:16:31.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139932+0000", 2024-09-12T16:16:31.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012762099999999999 2024-09-12T16:16:31.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139935+0000", 2024-09-12T16:16:31.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.119e-06 2024-09-12T16:16:31.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139939+0000", 2024-09-12T16:16:31.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7999999999999998e-06 2024-09-12T16:16:31.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139953+0000", 2024-09-12T16:16:31.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3923999999999999e-05 2024-09-12T16:16:31.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192946+0000", 2024-09-12T16:16:31.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052992971 2024-09-12T16:16:31.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193035+0000", 2024-09-12T16:16:31.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9040000000000001e-05 2024-09-12T16:16:31.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193174+0000", 2024-09-12T16:16:31.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138357 2024-09-12T16:16:31.330 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.330 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.330 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.330 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3706 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14816256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.330 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:16:31.330 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.172624516000001, 2024-09-12T16:16:31.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053341723000000001, 2024-09-12T16:16:31.331 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.331 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.331 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.331 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.331 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.331 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.331 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3706 2024-09-12T16:16:31.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.331 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:16:31.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:16:31.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140090+0000", 2024-09-12T16:16:31.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013020100000000001 2024-09-12T16:16:31.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140097+0000", 2024-09-12T16:16:31.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0709999999999997e-06 2024-09-12T16:16:31.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140103+0000", 2024-09-12T16:16:31.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5450000000000003e-06 2024-09-12T16:16:31.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140106+0000", 2024-09-12T16:16:31.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3739999999999998e-06 2024-09-12T16:16:31.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193190+0000", 2024-09-12T16:16:31.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053084131999999999 2024-09-12T16:16:31.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193232+0000", 2024-09-12T16:16:31.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1517000000000002e-05 2024-09-12T16:16:31.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193302+0000", 2024-09-12T16:16:31.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9882999999999995e-05 2024-09-12T16:16:31.335 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.335 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.335 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.335 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3707 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14820352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.335 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:16:31.335 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.172472527, 2024-09-12T16:16:31.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053452771000000003, 2024-09-12T16:16:31.336 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.336 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.336 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.336 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.336 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.336 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.336 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3707 2024-09-12T16:16:31.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.336 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:16:31.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:16:31.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140219+0000", 2024-09-12T16:16:31.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106902 2024-09-12T16:16:31.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140225+0000", 2024-09-12T16:16:31.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3199999999999996e-06 2024-09-12T16:16:31.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140230+0000", 2024-09-12T16:16:31.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8969999999999999e-06 2024-09-12T16:16:31.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140233+0000", 2024-09-12T16:16:31.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2119999999999999e-06 2024-09-12T16:16:31.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193339+0000", 2024-09-12T16:16:31.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053105556999999998 2024-09-12T16:16:31.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193431+0000", 2024-09-12T16:16:31.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1837999999999997e-05 2024-09-12T16:16:31.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193565+0000", 2024-09-12T16:16:31.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013404500000000001 2024-09-12T16:16:31.340 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.340 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.340 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.340 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3708 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14824448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.340 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:16:31.340 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.172343685, 2024-09-12T16:16:31.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053468190999999998, 2024-09-12T16:16:31.341 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.341 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.341 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.341 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.341 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.341 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.341 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3708 2024-09-12T16:16:31.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.341 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.341 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:16:31.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.342 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:16:31.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140351+0000", 2024-09-12T16:16:31.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110096 2024-09-12T16:16:31.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140358+0000", 2024-09-12T16:16:31.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.306e-06 2024-09-12T16:16:31.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140368+0000", 2024-09-12T16:16:31.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0225e-05 2024-09-12T16:16:31.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140372+0000", 2024-09-12T16:16:31.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6169999999999998e-06 2024-09-12T16:16:31.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193594+0000", 2024-09-12T16:16:31.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053222419999999999 2024-09-12T16:16:31.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.345 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193640+0000", 2024-09-12T16:16:31.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.587e-05 2024-09-12T16:16:31.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.345 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193709+0000", 2024-09-12T16:16:31.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8657000000000004e-05 2024-09-12T16:16:31.346 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.346 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.346 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.346 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3709 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14828544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.346 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:16:31.346 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.172206717, 2024-09-12T16:16:31.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594033999999999, 2024-09-12T16:16:31.347 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.347 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.347 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.347 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.347 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.347 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.347 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3709 2024-09-12T16:16:31.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.347 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:16:31.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:16:31.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140499+0000", 2024-09-12T16:16:31.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121019 2024-09-12T16:16:31.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140501+0000", 2024-09-12T16:16:31.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2369999999999999e-06 2024-09-12T16:16:31.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140506+0000", 2024-09-12T16:16:31.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.639e-06 2024-09-12T16:16:31.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.350 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.350 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140509+0000", 2024-09-12T16:16:31.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3419999999999999e-06 2024-09-12T16:16:31.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.350 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.350 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193743+0000", 2024-09-12T16:16:31.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053234311999999999 2024-09-12T16:16:31.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.350 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193833+0000", 2024-09-12T16:16:31.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9883999999999995e-05 2024-09-12T16:16:31.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193972+0000", 2024-09-12T16:16:31.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138601 2024-09-12T16:16:31.351 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.351 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.351 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.351 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3710 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14832640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.352 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:16:31.352 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.172069370999999, 2024-09-12T16:16:31.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053607324999999997, 2024-09-12T16:16:31.352 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.352 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.352 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.352 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.352 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.352 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.352 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3710 2024-09-12T16:16:31.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.352 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:16:31.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:16:31.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140664+0000", 2024-09-12T16:16:31.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014918700000000001 2024-09-12T16:16:31.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140674+0000", 2024-09-12T16:16:31.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8379999999999997e-06 2024-09-12T16:16:31.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140694+0000", 2024-09-12T16:16:31.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0145000000000001e-05 2024-09-12T16:16:31.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140703+0000", 2024-09-12T16:16:31.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5150000000000006e-06 2024-09-12T16:16:31.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194006+0000", 2024-09-12T16:16:31.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053303370000000003 2024-09-12T16:16:31.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.356 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.356 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194051+0000", 2024-09-12T16:16:31.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5012000000000002e-05 2024-09-12T16:16:31.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.356 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.356 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194122+0000", 2024-09-12T16:16:31.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1258000000000001e-05 2024-09-12T16:16:31.356 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.356 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.357 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.357 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3711 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14836736~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.357 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:16:31.357 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.171867923000001, 2024-09-12T16:16:31.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053670799999999998, 2024-09-12T16:16:31.357 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.357 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.357 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.357 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.357 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.357 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.358 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3711 2024-09-12T16:16:31.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.358 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:16:31.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:16:31.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140782+0000", 2024-09-12T16:16:31.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5549999999999994e-05 2024-09-12T16:16:31.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140786+0000", 2024-09-12T16:16:31.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.89e-06 2024-09-12T16:16:31.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140796+0000", 2024-09-12T16:16:31.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0057e-05 2024-09-12T16:16:31.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140819+0000", 2024-09-12T16:16:31.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3005000000000001e-05 2024-09-12T16:16:31.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194159+0000", 2024-09-12T16:16:31.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053340324000000001 2024-09-12T16:16:31.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194248+0000", 2024-09-12T16:16:31.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9209000000000006e-05 2024-09-12T16:16:31.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194387+0000", 2024-09-12T16:16:31.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138765 2024-09-12T16:16:31.361 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.361 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.361 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.362 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3712 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14840832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.362 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:16:31.362 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.171753465, 2024-09-12T16:16:31.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053699068000000003, 2024-09-12T16:16:31.362 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.362 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.362 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.363 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.363 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.363 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.363 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3712 2024-09-12T16:16:31.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.363 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.363 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:16:31.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.364 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:16:31.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.364 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140900+0000", 2024-09-12T16:16:31.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9014e-05 2024-09-12T16:16:31.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140904+0000", 2024-09-12T16:16:31.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0940000000000001e-06 2024-09-12T16:16:31.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140933+0000", 2024-09-12T16:16:31.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8996000000000002e-05 2024-09-12T16:16:31.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140945+0000", 2024-09-12T16:16:31.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1909000000000001e-05 2024-09-12T16:16:31.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194415+0000", 2024-09-12T16:16:31.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053470403 2024-09-12T16:16:31.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194460+0000", 2024-09-12T16:16:31.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5145000000000002e-05 2024-09-12T16:16:31.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.367 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.367 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194530+0000", 2024-09-12T16:16:31.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9506999999999997e-05 2024-09-12T16:16:31.367 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.367 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.367 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.367 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3713 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14844928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.367 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:16:31.368 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.171620405000001, 2024-09-12T16:16:31.368 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053821236000000001, 2024-09-12T16:16:31.368 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.368 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.368 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.368 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.368 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.368 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.368 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3713 2024-09-12T16:16:31.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.369 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:16:31.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:16:31.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141078+0000", 2024-09-12T16:16:31.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114162 2024-09-12T16:16:31.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141090+0000", 2024-09-12T16:16:31.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.19e-05 2024-09-12T16:16:31.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141100+0000", 2024-09-12T16:16:31.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0447e-05 2024-09-12T16:16:31.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141108+0000", 2024-09-12T16:16:31.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7190000000000001e-06 2024-09-12T16:16:31.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194564+0000", 2024-09-12T16:16:31.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053455729 2024-09-12T16:16:31.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194652+0000", 2024-09-12T16:16:31.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8288999999999994e-05 2024-09-12T16:16:31.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194785+0000", 2024-09-12T16:16:31.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013299000000000001 2024-09-12T16:16:31.372 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.373 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.373 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.373 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3714 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14849024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.373 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:16:31.373 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.171464476000001, 2024-09-12T16:16:31.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053816382000000003, 2024-09-12T16:16:31.373 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.373 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.373 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.373 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.373 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.374 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.374 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3714 2024-09-12T16:16:31.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.374 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:16:31.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:16:31.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.375 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141182+0000", 2024-09-12T16:16:31.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1805999999999997e-05 2024-09-12T16:16:31.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.375 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141185+0000", 2024-09-12T16:16:31.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5930000000000002e-06 2024-09-12T16:16:31.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141194+0000", 2024-09-12T16:16:31.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5760000000000006e-06 2024-09-12T16:16:31.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.376 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141222+0000", 2024-09-12T16:16:31.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8034999999999998e-05 2024-09-12T16:16:31.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.376 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194817+0000", 2024-09-12T16:16:31.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594887000000001 2024-09-12T16:16:31.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194860+0000", 2024-09-12T16:16:31.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3714999999999997e-05 2024-09-12T16:16:31.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194936+0000", 2024-09-12T16:16:31.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5770000000000001e-05 2024-09-12T16:16:31.377 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.377 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.377 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.378 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3715 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14853120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.378 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:16:31.378 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.171340818999999, 2024-09-12T16:16:31.378 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053962307000000001, 2024-09-12T16:16:31.378 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.378 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.378 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.378 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.378 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.378 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.378 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3715 2024-09-12T16:16:31.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.378 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.379 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.379 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:16:31.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.379 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.379 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:16:31.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.379 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141417+0000", 2024-09-12T16:16:31.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017384099999999999 2024-09-12T16:16:31.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141422+0000", 2024-09-12T16:16:31.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7310000000000001e-06 2024-09-12T16:16:31.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141434+0000", 2024-09-12T16:16:31.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2058e-05 2024-09-12T16:16:31.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.381 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141442+0000", 2024-09-12T16:16:31.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7610000000000007e-06 2024-09-12T16:16:31.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.381 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194973+0000", 2024-09-12T16:16:31.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053530618000000002 2024-09-12T16:16:31.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195063+0000", 2024-09-12T16:16:31.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0927000000000005e-05 2024-09-12T16:16:31.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195206+0000", 2024-09-12T16:16:31.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142371 2024-09-12T16:16:31.382 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.382 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.383 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.383 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3716 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14857216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.383 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:16:31.383 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.171130969, 2024-09-12T16:16:31.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053916360000000003, 2024-09-12T16:16:31.383 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.383 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.383 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.383 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.383 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.383 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.384 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3716 2024-09-12T16:16:31.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.384 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:16:31.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:16:31.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.385 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.385 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142933+0000", 2024-09-12T16:16:31.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014796290000000001 2024-09-12T16:16:31.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.385 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.385 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142937+0000", 2024-09-12T16:16:31.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5760000000000002e-06 2024-09-12T16:16:31.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.386 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142946+0000", 2024-09-12T16:16:31.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0380000000000005e-06 2024-09-12T16:16:31.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.386 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142951+0000", 2024-09-12T16:16:31.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9749999999999998e-06 2024-09-12T16:16:31.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.386 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195246+0000", 2024-09-12T16:16:31.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052295358 2024-09-12T16:16:31.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.387 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.387 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195299+0000", 2024-09-12T16:16:31.387 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2976999999999998e-05 2024-09-12T16:16:31.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.387 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.387 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195370+0000", 2024-09-12T16:16:31.387 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0807000000000002e-05 2024-09-12T16:16:31.387 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.387 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.387 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.388 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3721 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14877696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.388 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:16:31.388 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.169557518, 2024-09-12T16:16:31.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053422994000000001, 2024-09-12T16:16:31.388 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.388 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.388 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.388 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.389 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.389 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.389 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3721 2024-09-12T16:16:31.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.389 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.389 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.389 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:16:31.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:16:31.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:16:31.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:16:31.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143028+0000", 2024-09-12T16:16:31.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7399999999999991e-07 2024-09-12T16:16:31.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.391 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.391 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143031+0000", 2024-09-12T16:16:31.391 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7599999999999998e-06 2024-09-12T16:16:31.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.391 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.391 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143034+0000", 2024-09-12T16:16:31.391 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9780000000000001e-06 2024-09-12T16:16:31.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.391 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.392 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196220+0000", 2024-09-12T16:16:31.392 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053186341999999998 2024-09-12T16:16:31.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.392 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.392 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196313+0000", 2024-09-12T16:16:31.392 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2676000000000005e-05 2024-09-12T16:16:31.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.392 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.393 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196450+0000", 2024-09-12T16:16:31.393 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137052 2024-09-12T16:16:31.393 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.393 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.393 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.393 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.393 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3722 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14881792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.393 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:16:31.393 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.169547626, 2024-09-12T16:16:31.393 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053556835999999997, 2024-09-12T16:16:31.394 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.394 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.394 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.394 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.394 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.394 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.394 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3722 2024-09-12T16:16:31.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.394 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.395 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.395 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:16:31.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.395 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.395 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:16:31.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.395 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.395 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:16:31.396 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.11e-07 2024-09-12T16:16:31.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.396 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.396 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143038+0000", 2024-09-12T16:16:31.396 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2399999999999996e-07 2024-09-12T16:16:31.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.396 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.396 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143041+0000", 2024-09-12T16:16:31.396 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8030000000000001e-06 2024-09-12T16:16:31.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.397 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.397 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143043+0000", 2024-09-12T16:16:31.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3140000000000002e-06 2024-09-12T16:16:31.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.397 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.397 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196481+0000", 2024-09-12T16:16:31.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053437601000000001 2024-09-12T16:16:31.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196525+0000", 2024-09-12T16:16:31.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4280000000000003e-05 2024-09-12T16:16:31.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196594+0000", 2024-09-12T16:16:31.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8702999999999996e-05 2024-09-12T16:16:31.398 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.398 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.398 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.399 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3723 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14885888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.399 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:16:31.399 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.169538444000001, 2024-09-12T16:16:31.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053815546999999998, 2024-09-12T16:16:31.399 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.399 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.399 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.399 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.400 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.400 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.400 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3723 2024-09-12T16:16:31.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.400 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.400 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.400 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:16:31.400 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.401 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.401 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:16:31.401 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.401 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.401 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148994+0000", 2024-09-12T16:16:31.401 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059481330000000004 2024-09-12T16:16:31.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148999+0000", 2024-09-12T16:16:31.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7140000000000001e-06 2024-09-12T16:16:31.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149008+0000", 2024-09-12T16:16:31.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4350000000000003e-06 2024-09-12T16:16:31.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149021+0000", 2024-09-12T16:16:31.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2514000000000001e-05 2024-09-12T16:16:31.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196630+0000", 2024-09-12T16:16:31.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047609758000000002 2024-09-12T16:16:31.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196724+0000", 2024-09-12T16:16:31.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3522000000000003e-05 2024-09-12T16:16:31.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.404 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.404 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196861+0000", 2024-09-12T16:16:31.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013747100000000001 2024-09-12T16:16:31.404 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.404 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.404 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.405 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4438 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15719424~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.405 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:16:31.405 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.024657667, 2024-09-12T16:16:31.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367981000000002, 2024-09-12T16:16:31.405 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.405 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.405 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.405 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.405 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.405 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.405 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4438 2024-09-12T16:16:31.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.406 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.406 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:16:31.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.406 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:16:31.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.407 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:16:31.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3e-07 2024-09-12T16:16:31.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.407 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287930+0000", 2024-09-12T16:16:31.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-12T16:16:31.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.408 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.408 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287937+0000", 2024-09-12T16:16:31.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.08e-06 2024-09-12T16:16:31.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.408 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.408 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287943+0000", 2024-09-12T16:16:31.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5709999999999997e-06 2024-09-12T16:16:31.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341068+0000", 2024-09-12T16:16:31.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053125101000000001 2024-09-12T16:16:31.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341154+0000", 2024-09-12T16:16:31.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6100999999999994e-05 2024-09-12T16:16:31.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.410 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.410 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341295+0000", 2024-09-12T16:16:31.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014087999999999999 2024-09-12T16:16:31.410 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.410 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.410 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.411 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4439 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15723520~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.411 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:16:31.411 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.024633507000001, 2024-09-12T16:16:31.411 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053526799, 2024-09-12T16:16:31.411 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.411 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.411 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.411 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.411 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.411 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.412 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4439 2024-09-12T16:16:31.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.412 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:16:31.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:16:31.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:16:31.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-07 2024-09-12T16:16:31.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287953+0000", 2024-09-12T16:16:31.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1349999999999999e-06 2024-09-12T16:16:31.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287960+0000", 2024-09-12T16:16:31.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-12T16:16:31.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287965+0000", 2024-09-12T16:16:31.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1580000000000004e-06 2024-09-12T16:16:31.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.415 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341332+0000", 2024-09-12T16:16:31.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367009 2024-09-12T16:16:31.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.415 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341402+0000", 2024-09-12T16:16:31.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9759999999999996e-05 2024-09-12T16:16:31.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.416 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341478+0000", 2024-09-12T16:16:31.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5412000000000002e-05 2024-09-12T16:16:31.416 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.416 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.416 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.416 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4440 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15727616~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.416 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:16:31.416 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.024612403000001, 2024-09-12T16:16:31.417 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053761601999999999, 2024-09-12T16:16:31.417 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.417 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.417 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.417 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.417 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.417 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.417 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4440 2024-09-12T16:16:31.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.417 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:16:31.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:16:31.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:16:31.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:16:31.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.419 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287974+0000", 2024-09-12T16:16:31.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0540000000000002e-06 2024-09-12T16:16:31.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.419 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287980+0000", 2024-09-12T16:16:31.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9440000000000002e-06 2024-09-12T16:16:31.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287987+0000", 2024-09-12T16:16:31.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5889999999999999e-06 2024-09-12T16:16:31.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341502+0000", 2024-09-12T16:16:31.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053515199999999999 2024-09-12T16:16:31.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341595+0000", 2024-09-12T16:16:31.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3097000000000007e-05 2024-09-12T16:16:31.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341734+0000", 2024-09-12T16:16:31.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013832800000000001 2024-09-12T16:16:31.422 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.422 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.422 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.422 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.422 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.422 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:31.424 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:16:31.424 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:31.422+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:31.489 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #8, image image_client.0-clone8 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent9 2024-09-12T16:16:31.524 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:31.523+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:31.544 INFO:teuthology.orchestra.run.smithi204.stdout:2116 read 0x2d16c00 thru 0x2d1f79a (0x8b9b bytes) 2024-09-12T16:16:31.572 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:31.572 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:31.572 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:16:31.573 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:31.573 INFO:teuthology.orchestra.run.smithi204.stdout:2118 write 0xb65a200 thru 0xb667d18 (0xdb19 bytes) 2024-09-12T16:16:31.574 INFO:teuthology.orchestra.run.smithi204.stdout:2121 read 0x50b600 thru 0x51a18d (0xeb8e bytes) 2024-09-12T16:16:31.575 INFO:teuthology.orchestra.run.smithi204.stdout:2123 read 0x7cb800 thru 0x7d4135 (0x8936 bytes) 2024-09-12T16:16:31.576 INFO:teuthology.orchestra.run.smithi204.stdout:2125 read 0x90ca200 thru 0x90d9a12 (0xf813 bytes) 2024-09-12T16:16:31.576 INFO:teuthology.orchestra.run.smithi204.stdout:2126 write 0x3437e00 thru 0x3444731 (0xc932 bytes) 2024-09-12T16:16:31.577 INFO:teuthology.orchestra.run.smithi204.stdout:2127 read 0x185b400 thru 0x18698fb (0xe4fc bytes) 2024-09-12T16:16:31.578 INFO:teuthology.orchestra.run.smithi204.stdout:2128 write 0x944e600 thru 0x945bd9d (0xd79e bytes) 2024-09-12T16:16:31.578 INFO:teuthology.orchestra.run.smithi204.stdout:2132 read 0x3dce600 thru 0x3dcf747 (0x1148 bytes) 2024-09-12T16:16:31.578 INFO:teuthology.orchestra.run.smithi204.stdout:2134 punch from 0x3e3e000 to 0x3e42600, (0x4600 bytes) 2024-09-12T16:16:31.582 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:16:31.585 INFO:teuthology.orchestra.run.smithi204.stdout:2135 punch from 0x6911400 to 0x6913a00, (0x2600 bytes) 2024-09-12T16:16:31.585 INFO:teuthology.orchestra.run.smithi204.stdout:2136 punch from 0x5bda000 to 0x5be1200, (0x7200 bytes) 2024-09-12T16:16:31.588 INFO:teuthology.orchestra.run.smithi204.stdout:2141 trunc from 0xb667e00 to 0x8fd8800 2024-09-12T16:16:31.624 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:31.623+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:31.630 INFO:teuthology.orchestra.run.smithi204.stdout:2142 write 0x136e800 thru 0x137003b (0x183c bytes) 2024-09-12T16:16:31.670 INFO:teuthology.orchestra.run.smithi204.stdout:2143 write 0xd207200 thru 0xd216581 (0xf382 bytes) 2024-09-12T16:16:31.678 INFO:teuthology.orchestra.run.smithi204.stdout:2146 trunc from 0xd216600 to 0x5f80600 2024-09-12T16:16:31.709 INFO:teuthology.orchestra.run.smithi204.stdout:2147 write 0x4466800 thru 0x446be10 (0x5611 bytes) 2024-09-12T16:16:31.710 INFO:teuthology.orchestra.run.smithi204.stdout:2148 read 0x44bb800 thru 0x44bda41 (0x2242 bytes) 2024-09-12T16:16:31.711 INFO:teuthology.orchestra.run.smithi204.stdout:2151 read 0x830200 thru 0x83a0d5 (0x9ed6 bytes) 2024-09-12T16:16:31.712 INFO:teuthology.orchestra.run.smithi204.stdout:2152 write 0x4db1e00 thru 0x4dbb33a (0x953b bytes) 2024-09-12T16:16:31.713 INFO:teuthology.orchestra.run.smithi204.stdout:2153 write 0x2d91e00 thru 0x2d92a4a (0xc4b bytes) 2024-09-12T16:16:31.713 INFO:teuthology.orchestra.run.smithi204.stdout:2155 punch from 0x454f400 to 0x455b000, (0xbc00 bytes) 2024-09-12T16:16:31.717 INFO:teuthology.orchestra.run.smithi204.stdout:2156 punch from 0x2706600 to 0x2715e00, (0xf800 bytes) 2024-09-12T16:16:31.724 INFO:teuthology.orchestra.run.smithi204.stdout:2158 write 0x2975600 thru 0x2977c46 (0x2647 bytes) 2024-09-12T16:16:31.725 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:31.724+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:31.749 INFO:teuthology.orchestra.run.smithi204.stdout:2161 read 0x56af200 thru 0x56b1488 (0x2289 bytes) 2024-09-12T16:16:31.750 INFO:teuthology.orchestra.run.smithi204.stdout:2162 punch from 0x1781000 to 0x1787400, (0x6400 bytes) 2024-09-12T16:16:31.750 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:31.750 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:31.750 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:16:31.751 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:16:31.751 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:31.762 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:16:31.784 INFO:teuthology.orchestra.run.smithi204.stdout:2163 write 0xdc5fa00 thru 0xdc6061d (0xc1e bytes) 2024-09-12T16:16:31.789 INFO:teuthology.orchestra.run.smithi204.stdout:2165 read 0x7db3400 thru 0x7db4c60 (0x1861 bytes) 2024-09-12T16:16:31.801 INFO:teuthology.orchestra.run.smithi204.stdout:2169 write 0xe364a00 thru 0xe37306b (0xe66c bytes) 2024-09-12T16:16:31.809 INFO:teuthology.orchestra.run.smithi204.stdout:2170 read 0x5ba4200 thru 0x5badd26 (0x9b27 bytes) 2024-09-12T16:16:31.811 INFO:teuthology.orchestra.run.smithi204.stdout:2173 read 0xc57ba00 thru 0xc58a921 (0xef22 bytes) 2024-09-12T16:16:31.811 INFO:teuthology.orchestra.run.smithi204.stdout:2175 read 0x36eec00 thru 0x36f30c2 (0x44c3 bytes) 2024-09-12T16:16:31.811 INFO:teuthology.orchestra.run.smithi204.stdout:2177 read 0x5830a00 thru 0x58321b3 (0x17b4 bytes) 2024-09-12T16:16:31.811 INFO:teuthology.orchestra.run.smithi204.stdout:2185 write 0x6777a00 thru 0x678048e (0x8a8f bytes) 2024-09-12T16:16:31.812 INFO:teuthology.orchestra.run.smithi204.stdout:2186 read 0xe2f9400 thru 0xe3070a9 (0xdcaa bytes) 2024-09-12T16:16:31.812 INFO:teuthology.orchestra.run.smithi204.stdout:2187 read 0x238fc00 thru 0x239f616 (0xfa17 bytes) 2024-09-12T16:16:31.813 INFO:teuthology.orchestra.run.smithi204.stdout:2189 read 0xcccb800 thru 0xccd12b8 (0x5ab9 bytes) 2024-09-12T16:16:31.813 INFO:teuthology.orchestra.run.smithi204.stdout:2191 write 0x9a85600 thru 0x9a92591 (0xcf92 bytes) 2024-09-12T16:16:31.813 INFO:teuthology.orchestra.run.smithi204.stdout:2197 punch from 0x2062c00 to 0x2068400, (0x5800 bytes) 2024-09-12T16:16:31.816 INFO:teuthology.orchestra.run.smithi204.stdout:2198 read 0x5997600 thru 0x599df90 (0x6991 bytes) 2024-09-12T16:16:31.818 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [5] live_osds: [0, 1, 2, 3, 4] 2024-09-12T16:16:31.818 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T16:16:31.818 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-12T16:16:31.818 INFO:tasks.thrashosds.thrasher:Setting osd 2 primary_affinity to 1.000000 2024-09-12T16:16:31.818 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-12T16:16:31.826 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:31.825+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:31.827 INFO:teuthology.orchestra.run.smithi204.stdout:2199 read 0x1f80e00 thru 0x1f8aebe (0xa0bf bytes) 2024-09-12T16:16:31.830 INFO:teuthology.orchestra.run.smithi204.stdout:2201 trunc from 0xe373200 to 0xcd75400 2024-09-12T16:16:31.866 INFO:teuthology.orchestra.run.smithi204.stdout:2203 write 0xd45c800 thru 0xd465283 (0x8a84 bytes) 2024-09-12T16:16:31.867 INFO:teuthology.orchestra.run.smithi204.stdout:2205 write 0xca4d200 thru 0xca53cef (0x6af0 bytes) 2024-09-12T16:16:31.867 INFO:teuthology.orchestra.run.smithi204.stdout:2207 read 0xc67c400 thru 0xc682079 (0x5c7a bytes) 2024-09-12T16:16:31.880 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:31.881 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:16:31.881 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:16:31.881 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:31.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.881 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2256 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12192768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.881 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.889586+0000", 2024-09-12T16:16:31.881 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.989725164999999, 2024-09-12T16:16:31.881 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037086439999999998, 2024-09-12T16:16:31.881 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.881 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.881 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.881 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.882 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.882 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.882 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2256 2024-09-12T16:16:31.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.882 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.882 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.882 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.889586+0000", 2024-09-12T16:16:31.882 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.882 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.882 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.889586+0000", 2024-09-12T16:16:31.882 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.883 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.883 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.894952+0000", 2024-09-12T16:16:31.883 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0053653260000000001 2024-09-12T16:16:31.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.883 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.883 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.894956+0000", 2024-09-12T16:16:31.883 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2640000000000002e-06 2024-09-12T16:16:31.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.883 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.883 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.894966+0000", 2024-09-12T16:16:31.883 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0607e-05 2024-09-12T16:16:31.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.884 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.884 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.894982+0000", 2024-09-12T16:16:31.884 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5528000000000001e-05 2024-09-12T16:16:31.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.884 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.884 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.926510+0000", 2024-09-12T16:16:31.884 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.031528325000000003 2024-09-12T16:16:31.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.885 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.926593+0000", 2024-09-12T16:16:31.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2812999999999995e-05 2024-09-12T16:16:31.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.885 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.926673+0000", 2024-09-12T16:16:31.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9577000000000001e-05 2024-09-12T16:16:31.885 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.885 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.885 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.886 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2298 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12364800~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.886 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.895981+0000", 2024-09-12T16:16:31.886 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.983329994, 2024-09-12T16:16:31.886 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037134176999999997, 2024-09-12T16:16:31.886 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.886 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.886 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.886 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.886 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.886 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.886 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2298 2024-09-12T16:16:31.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.887 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.887 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.887 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.895981+0000", 2024-09-12T16:16:31.887 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.887 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.888 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.895981+0000", 2024-09-12T16:16:31.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.888 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.888 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.895982+0000", 2024-09-12T16:16:31.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6400000000000003e-07 2024-09-12T16:16:31.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.888 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.888 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.895984+0000", 2024-09-12T16:16:31.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1500000000000002e-06 2024-09-12T16:16:31.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.895991+0000", 2024-09-12T16:16:31.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8730000000000001e-06 2024-09-12T16:16:31.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.895996+0000", 2024-09-12T16:16:31.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1800000000000004e-06 2024-09-12T16:16:31.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.932938+0000", 2024-09-12T16:16:31.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036941781 2024-09-12T16:16:31.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.890 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.890 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933028+0000", 2024-09-12T16:16:31.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0493000000000002e-05 2024-09-12T16:16:31.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.890 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.890 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933116+0000", 2024-09-12T16:16:31.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7236000000000003e-05 2024-09-12T16:16:31.890 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.890 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.890 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.891 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2299 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12368896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.891 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896004+0000", 2024-09-12T16:16:31.891 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.983307287000001, 2024-09-12T16:16:31.891 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037218257999999997, 2024-09-12T16:16:31.891 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.891 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.891 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.891 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.891 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.891 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.891 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2299 2024-09-12T16:16:31.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.891 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.892 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.892 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896004+0000", 2024-09-12T16:16:31.892 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.892 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.892 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896004+0000", 2024-09-12T16:16:31.892 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.892 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.892 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896005+0000", 2024-09-12T16:16:31.892 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3700000000000001e-07 2024-09-12T16:16:31.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.893 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896006+0000", 2024-09-12T16:16:31.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9929999999999998e-06 2024-09-12T16:16:31.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.893 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896013+0000", 2024-09-12T16:16:31.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1709999999999999e-06 2024-09-12T16:16:31.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.893 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896017+0000", 2024-09-12T16:16:31.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5050000000000001e-06 2024-09-12T16:16:31.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.894 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.894 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933142+0000", 2024-09-12T16:16:31.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037125012999999998 2024-09-12T16:16:31.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.894 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.894 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933182+0000", 2024-09-12T16:16:31.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9957999999999999e-05 2024-09-12T16:16:31.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.894 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.894 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933222+0000", 2024-09-12T16:16:31.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0181e-05 2024-09-12T16:16:31.894 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.895 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.895 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.895 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2300 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12372992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.895 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:16:31.895 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.98328763, 2024-09-12T16:16:31.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037401246999999999, 2024-09-12T16:16:31.895 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.895 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.895 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.895 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.895 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.895 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.895 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2300 2024-09-12T16:16:31.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.896 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.896 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.896 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:16:31.896 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.896 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.896 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:16:31.896 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.896 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.896 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:16:31.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6100000000000002e-07 2024-09-12T16:16:31.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.897 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.897 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896026+0000", 2024-09-12T16:16:31.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9130000000000001e-06 2024-09-12T16:16:31.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.897 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.897 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896032+0000", 2024-09-12T16:16:31.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7540000000000003e-06 2024-09-12T16:16:31.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.897 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.897 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896036+0000", 2024-09-12T16:16:31.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5750000000000002e-06 2024-09-12T16:16:31.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933254+0000", 2024-09-12T16:16:31.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037217962 2024-09-12T16:16:31.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933341+0000", 2024-09-12T16:16:31.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6296000000000002e-05 2024-09-12T16:16:31.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933425+0000", 2024-09-12T16:16:31.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4386000000000001e-05 2024-09-12T16:16:31.899 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.899 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.899 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.899 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2301 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12377088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.899 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896043+0000", 2024-09-12T16:16:31.899 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.983267888, 2024-09-12T16:16:31.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037486197999999998, 2024-09-12T16:16:31.899 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.899 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.899 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.899 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.899 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.900 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.900 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2301 2024-09-12T16:16:31.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.900 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.900 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.900 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896043+0000", 2024-09-12T16:16:31.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.900 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.900 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896043+0000", 2024-09-12T16:16:31.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.901 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.901 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896044+0000", 2024-09-12T16:16:31.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.41e-07 2024-09-12T16:16:31.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.901 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.901 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896053+0000", 2024-09-12T16:16:31.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8049999999999996e-06 2024-09-12T16:16:31.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896060+0000", 2024-09-12T16:16:31.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.221e-06 2024-09-12T16:16:31.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896065+0000", 2024-09-12T16:16:31.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1109999999999999e-06 2024-09-12T16:16:31.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933452+0000", 2024-09-12T16:16:31.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037386560999999999 2024-09-12T16:16:31.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933491+0000", 2024-09-12T16:16:31.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9789000000000001e-05 2024-09-12T16:16:31.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933530+0000", 2024-09-12T16:16:31.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.837e-05 2024-09-12T16:16:31.903 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.903 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.903 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.903 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2302 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12381184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.904 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:16:31.904 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.983226448, 2024-09-12T16:16:31.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037645284000000001, 2024-09-12T16:16:31.904 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.904 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.904 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.904 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.904 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.904 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.904 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2302 2024-09-12T16:16:31.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.905 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.905 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.905 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:16:31.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.905 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.905 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:16:31.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.905 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.905 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:16:31.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6800000000000001e-07 2024-09-12T16:16:31.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.906 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.906 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896088+0000", 2024-09-12T16:16:31.906 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3429999999999998e-06 2024-09-12T16:16:31.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.906 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.906 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896096+0000", 2024-09-12T16:16:31.906 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0860000000000002e-06 2024-09-12T16:16:31.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.906 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.906 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896102+0000", 2024-09-12T16:16:31.906 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7610000000000004e-06 2024-09-12T16:16:31.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933563+0000", 2024-09-12T16:16:31.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037461019999999998 2024-09-12T16:16:31.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933648+0000", 2024-09-12T16:16:31.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5468000000000002e-05 2024-09-12T16:16:31.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933730+0000", 2024-09-12T16:16:31.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2138000000000005e-05 2024-09-12T16:16:31.907 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.907 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.908 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.908 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2303 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12385280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.908 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:16:31.908 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.983202646000001, 2024-09-12T16:16:31.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037723083999999997, 2024-09-12T16:16:31.908 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.908 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.908 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.908 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.908 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.908 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.908 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2303 2024-09-12T16:16:31.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.909 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:16:31.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:16:31.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:16:31.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2500000000000001e-07 2024-09-12T16:16:31.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.910 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896115+0000", 2024-09-12T16:16:31.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.28e-06 2024-09-12T16:16:31.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.910 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896122+0000", 2024-09-12T16:16:31.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4590000000000003e-06 2024-09-12T16:16:31.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896127+0000", 2024-09-12T16:16:31.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0509999999999996e-06 2024-09-12T16:16:31.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933755+0000", 2024-09-12T16:16:31.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037627729999999998 2024-09-12T16:16:31.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933794+0000", 2024-09-12T16:16:31.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9255000000000003e-05 2024-09-12T16:16:31.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933832+0000", 2024-09-12T16:16:31.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7883999999999998e-05 2024-09-12T16:16:31.912 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.912 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.912 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.912 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2304 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12389376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.912 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:16:31.912 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.983177296999999, 2024-09-12T16:16:31.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037911010000000002, 2024-09-12T16:16:31.913 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.913 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.913 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.913 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.913 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.913 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.913 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2304 2024-09-12T16:16:31.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.913 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.913 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.913 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:16:31.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.914 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.914 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:16:31.914 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.914 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.914 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:16:31.914 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9900000000000001e-07 2024-09-12T16:16:31.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.915 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.915 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896136+0000", 2024-09-12T16:16:31.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.897e-06 2024-09-12T16:16:31.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.915 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.915 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896142+0000", 2024-09-12T16:16:31.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9290000000000003e-06 2024-09-12T16:16:31.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896154+0000", 2024-09-12T16:16:31.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.201e-05 2024-09-12T16:16:31.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933865+0000", 2024-09-12T16:16:31.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037710225 2024-09-12T16:16:31.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933961+0000", 2024-09-12T16:16:31.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6315000000000002e-05 2024-09-12T16:16:31.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934045+0000", 2024-09-12T16:16:31.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4234999999999996e-05 2024-09-12T16:16:31.917 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.917 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.917 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.917 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2305 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12393472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.917 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896175+0000", 2024-09-12T16:16:31.917 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.983136107, 2024-09-12T16:16:31.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037976941, 2024-09-12T16:16:31.917 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.918 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.918 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.918 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.918 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.918 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.918 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2305 2024-09-12T16:16:31.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.918 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896175+0000", 2024-09-12T16:16:31.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896175+0000", 2024-09-12T16:16:31.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.919 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896176+0000", 2024-09-12T16:16:31.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7400000000000003e-07 2024-09-12T16:16:31.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.919 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896178+0000", 2024-09-12T16:16:31.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6709999999999999e-06 2024-09-12T16:16:31.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896186+0000", 2024-09-12T16:16:31.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9319999999999996e-06 2024-09-12T16:16:31.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896192+0000", 2024-09-12T16:16:31.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0799999999999996e-06 2024-09-12T16:16:31.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934072+0000", 2024-09-12T16:16:31.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037880888000000001 2024-09-12T16:16:31.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934113+0000", 2024-09-12T16:16:31.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0815999999999997e-05 2024-09-12T16:16:31.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934152+0000", 2024-09-12T16:16:31.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8980000000000003e-05 2024-09-12T16:16:31.921 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.921 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.922 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.922 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2306 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12397568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.922 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:16:31.922 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.983111829, 2024-09-12T16:16:31.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038156347, 2024-09-12T16:16:31.922 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.922 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.922 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.922 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.922 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.922 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.922 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2306 2024-09-12T16:16:31.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.923 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:16:31.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:16:31.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.924 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:16:31.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.77e-07 2024-09-12T16:16:31.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.924 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.924 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896202+0000", 2024-09-12T16:16:31.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2359999999999999e-06 2024-09-12T16:16:31.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.924 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.924 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896208+0000", 2024-09-12T16:16:31.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1430000000000003e-06 2024-09-12T16:16:31.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896213+0000", 2024-09-12T16:16:31.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9339999999999997e-06 2024-09-12T16:16:31.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934188+0000", 2024-09-12T16:16:31.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037974490999999999 2024-09-12T16:16:31.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934275+0000", 2024-09-12T16:16:31.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7639999999999994e-05 2024-09-12T16:16:31.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934356+0000", 2024-09-12T16:16:31.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0525999999999994e-05 2024-09-12T16:16:31.926 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.926 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.926 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.926 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2307 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12401664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.926 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:16:31.926 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.983092057, 2024-09-12T16:16:31.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038241450000000003, 2024-09-12T16:16:31.926 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.926 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.927 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.927 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.927 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.927 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.927 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2307 2024-09-12T16:16:31.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.927 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:16:31.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:16:31.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.928 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.928 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896220+0000", 2024-09-12T16:16:31.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3500000000000002e-07 2024-09-12T16:16:31.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.928 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.928 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896222+0000", 2024-09-12T16:16:31.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1720000000000001e-06 2024-09-12T16:16:31.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.928 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.929 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896228+0000", 2024-09-12T16:16:31.929 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0870000000000003e-06 2024-09-12T16:16:31.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.929 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.929 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896233+0000", 2024-09-12T16:16:31.929 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:16:31.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.929 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.929 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934382+0000", 2024-09-12T16:16:31.929 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038149566000000003 2024-09-12T16:16:31.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.929 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934422+0000", 2024-09-12T16:16:31.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0015999999999998e-05 2024-09-12T16:16:31.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934461+0000", 2024-09-12T16:16:31.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8423999999999997e-05 2024-09-12T16:16:31.930 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.930 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.930 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.930 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2308 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12405760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.930 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:16:31.930 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.98307236, 2024-09-12T16:16:31.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038420745999999999, 2024-09-12T16:16:31.931 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.931 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.931 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.931 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.931 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.931 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.931 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2308 2024-09-12T16:16:31.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.931 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.931 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:16:31.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.932 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:16:31.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.932 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:16:31.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.58e-07 2024-09-12T16:16:31.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.932 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896241+0000", 2024-09-12T16:16:31.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7940000000000001e-06 2024-09-12T16:16:31.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896247+0000", 2024-09-12T16:16:31.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1460000000000001e-06 2024-09-12T16:16:31.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896252+0000", 2024-09-12T16:16:31.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6840000000000004e-06 2024-09-12T16:16:31.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934494+0000", 2024-09-12T16:16:31.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038242362000000002 2024-09-12T16:16:31.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934579+0000", 2024-09-12T16:16:31.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5044999999999996e-05 2024-09-12T16:16:31.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934660+0000", 2024-09-12T16:16:31.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0357000000000003e-05 2024-09-12T16:16:31.934 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.934 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.935 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.935 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2309 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12409856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.935 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:16:31.935 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.98305178, 2024-09-12T16:16:31.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038504629999999998, 2024-09-12T16:16:31.935 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.935 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.935 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.935 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.935 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.935 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.935 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2309 2024-09-12T16:16:31.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.936 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.936 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.936 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:16:31.936 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.936 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.936 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:16:31.936 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.936 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.936 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:16:31.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5199999999999998e-07 2024-09-12T16:16:31.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.937 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896263+0000", 2024-09-12T16:16:31.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4209999999999999e-06 2024-09-12T16:16:31.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.937 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896269+0000", 2024-09-12T16:16:31.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9449999999999998e-06 2024-09-12T16:16:31.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896274+0000", 2024-09-12T16:16:31.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3950000000000003e-06 2024-09-12T16:16:31.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934686+0000", 2024-09-12T16:16:31.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038412333999999999 2024-09-12T16:16:31.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934727+0000", 2024-09-12T16:16:31.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0649999999999999e-05 2024-09-12T16:16:31.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934764+0000", 2024-09-12T16:16:31.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7533000000000001e-05 2024-09-12T16:16:31.939 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.939 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.939 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.939 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2310 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12413952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.939 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:16:31.939 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.983030908, 2024-09-12T16:16:31.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038694183, 2024-09-12T16:16:31.939 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.940 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.940 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.940 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.940 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.940 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.940 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2310 2024-09-12T16:16:31.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.940 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.940 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:16:31.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:16:31.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.941 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896281+0000", 2024-09-12T16:16:31.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1399999999999997e-07 2024-09-12T16:16:31.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.941 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896283+0000", 2024-09-12T16:16:31.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9549999999999999e-06 2024-09-12T16:16:31.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.941 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896289+0000", 2024-09-12T16:16:31.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8669999999999999e-06 2024-09-12T16:16:31.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.942 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.942 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896301+0000", 2024-09-12T16:16:31.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1807999999999999e-05 2024-09-12T16:16:31.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.942 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.942 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934798+0000", 2024-09-12T16:16:31.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038497591999999997 2024-09-12T16:16:31.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.942 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.942 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934885+0000", 2024-09-12T16:16:31.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7149000000000002e-05 2024-09-12T16:16:31.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.943 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934975+0000", 2024-09-12T16:16:31.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9297999999999998e-05 2024-09-12T16:16:31.943 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.943 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.943 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.943 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2311 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12418048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.943 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:16:31.943 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.983003652000001, 2024-09-12T16:16:31.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038768558000000002, 2024-09-12T16:16:31.944 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.944 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.944 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.944 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.944 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.944 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.944 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2311 2024-09-12T16:16:31.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.944 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:16:31.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:16:31.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:16:31.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.63e-07 2024-09-12T16:16:31.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896310+0000", 2024-09-12T16:16:31.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1560000000000002e-06 2024-09-12T16:16:31.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896316+0000", 2024-09-12T16:16:31.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0249999999999999e-06 2024-09-12T16:16:31.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896322+0000", 2024-09-12T16:16:31.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6400000000000002e-06 2024-09-12T16:16:31.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934997+0000", 2024-09-12T16:16:31.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038674565000000001 2024-09-12T16:16:31.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935037+0000", 2024-09-12T16:16:31.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0485999999999998e-05 2024-09-12T16:16:31.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935076+0000", 2024-09-12T16:16:31.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9223e-05 2024-09-12T16:16:31.947 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.947 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.947 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.948 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2312 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12422144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.948 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:16:31.948 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.982982958999999, 2024-09-12T16:16:31.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038856784999999998, 2024-09-12T16:16:31.948 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.948 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.948 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.948 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.948 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.948 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.948 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2312 2024-09-12T16:16:31.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.949 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.949 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:16:31.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.949 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:16:31.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.949 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896329+0000", 2024-09-12T16:16:31.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5499999999999999e-07 2024-09-12T16:16:31.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896337+0000", 2024-09-12T16:16:31.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0819999999999999e-06 2024-09-12T16:16:31.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896343+0000", 2024-09-12T16:16:31.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.263e-06 2024-09-12T16:16:31.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896348+0000", 2024-09-12T16:16:31.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8860000000000003e-06 2024-09-12T16:16:31.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.951 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.951 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935097+0000", 2024-09-12T16:16:31.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038748818999999997 2024-09-12T16:16:31.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.951 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.951 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935141+0000", 2024-09-12T16:16:31.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4175000000000003e-05 2024-09-12T16:16:31.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.951 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.951 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935185+0000", 2024-09-12T16:16:31.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4205000000000001e-05 2024-09-12T16:16:31.952 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.952 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.952 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.952 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2313 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12426240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.952 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:16:31.952 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.982956743999999, 2024-09-12T16:16:31.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038928683999999998, 2024-09-12T16:16:31.952 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.952 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.952 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.953 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.953 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.953 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.953 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2313 2024-09-12T16:16:31.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.953 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:16:31.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:16:31.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:16:31.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0400000000000002e-07 2024-09-12T16:16:31.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896357+0000", 2024-09-12T16:16:31.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.097e-06 2024-09-12T16:16:31.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896363+0000", 2024-09-12T16:16:31.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5119999999999999e-06 2024-09-12T16:16:31.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896374+0000", 2024-09-12T16:16:31.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1381e-05 2024-09-12T16:16:31.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935205+0000", 2024-09-12T16:16:31.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038830549999999998 2024-09-12T16:16:31.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935244+0000", 2024-09-12T16:16:31.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9520000000000001e-05 2024-09-12T16:16:31.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935283+0000", 2024-09-12T16:16:31.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9220000000000001e-05 2024-09-12T16:16:31.956 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.956 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.956 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.957 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2314 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12430336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.957 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:16:31.957 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.982919574, 2024-09-12T16:16:31.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039008137999999998, 2024-09-12T16:16:31.957 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.957 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.957 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.957 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.957 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.957 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.957 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2314 2024-09-12T16:16:31.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.957 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:16:31.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:16:31.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:16:31.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6499999999999999e-07 2024-09-12T16:16:31.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896395+0000", 2024-09-12T16:16:31.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2960000000000001e-06 2024-09-12T16:16:31.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896402+0000", 2024-09-12T16:16:31.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2280000000000001e-06 2024-09-12T16:16:31.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896407+0000", 2024-09-12T16:16:31.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3630000000000002e-06 2024-09-12T16:16:31.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935302+0000", 2024-09-12T16:16:31.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038895181000000001 2024-09-12T16:16:31.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935343+0000", 2024-09-12T16:16:31.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0590999999999998e-05 2024-09-12T16:16:31.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935400+0000", 2024-09-12T16:16:31.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7014e-05 2024-09-12T16:16:31.961 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.961 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.961 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.961 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2315 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12434432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.961 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:16:31.961 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.982896923, 2024-09-12T16:16:31.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039083892000000002, 2024-09-12T16:16:31.961 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.961 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.962 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.962 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.962 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.962 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.962 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2315 2024-09-12T16:16:31.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.962 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:16:31.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.963 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:16:31.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.963 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896415+0000", 2024-09-12T16:16:31.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3300000000000002e-07 2024-09-12T16:16:31.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.963 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896421+0000", 2024-09-12T16:16:31.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7579999999999998e-06 2024-09-12T16:16:31.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896427+0000", 2024-09-12T16:16:31.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3029999999999996e-06 2024-09-12T16:16:31.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896432+0000", 2024-09-12T16:16:31.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.215e-06 2024-09-12T16:16:31.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935420+0000", 2024-09-12T16:16:31.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038987727 2024-09-12T16:16:31.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935460+0000", 2024-09-12T16:16:31.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9817999999999997e-05 2024-09-12T16:16:31.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935498+0000", 2024-09-12T16:16:31.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8438e-05 2024-09-12T16:16:31.965 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.965 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.965 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.966 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2316 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12438528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:31.966 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:16:31.966 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.982872271, 2024-09-12T16:16:31.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039160043999999998, 2024-09-12T16:16:31.966 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:31.966 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:31.966 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:31.966 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:31.966 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:31.966 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:31.966 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2316 2024-09-12T16:16:31.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.967 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:31.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:31.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:16:31.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:31.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:16:31.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:31.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:31.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901945+0000", 2024-09-12T16:16:31.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055056050000000002 2024-09-12T16:16:31.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:31.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901950+0000", 2024-09-12T16:16:31.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2490000000000001e-06 2024-09-12T16:16:31.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:31.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901966+0000", 2024-09-12T16:16:31.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6325e-05 2024-09-12T16:16:31.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:31.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901974+0000", 2024-09-12T16:16:31.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7570000000000004e-06 2024-09-12T16:16:31.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:31.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935518+0000", 2024-09-12T16:16:31.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033543587999999999 2024-09-12T16:16:31.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:31.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935559+0000", 2024-09-12T16:16:31.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1746000000000003e-05 2024-09-12T16:16:31.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:31.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:31.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:31.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935599+0000", 2024-09-12T16:16:31.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9774000000000002e-05 2024-09-12T16:16:31.970 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.970 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.970 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.970 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:31.970 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:31.970 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:31.971 INFO:teuthology.orchestra.run.smithi204.stdout:2209 trunc from 0xd465400 to 0x1726000 2024-09-12T16:16:31.972 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:16:31.972 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:31.970+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:32.007 INFO:teuthology.orchestra.run.smithi204.stdout:2210 read 0x248a00 thru 0x24e1de (0x57df bytes) 2024-09-12T16:16:32.009 INFO:teuthology.orchestra.run.smithi204.stdout:2211 punch from 0x13fa200 to 0x13fc400, (0x2200 bytes) 2024-09-12T16:16:32.009 INFO:teuthology.orchestra.run.smithi204.stdout:2212 read 0x11e1e00 thru 0x11ee3d1 (0xc5d2 bytes) 2024-09-12T16:16:32.010 INFO:teuthology.orchestra.run.smithi204.stdout:2213 read 0xf6f400 thru 0xf7285a (0x345b bytes) 2024-09-12T16:16:32.011 INFO:teuthology.orchestra.run.smithi204.stdout:2216 read 0x15fcc00 thru 0x15fde0e (0x120f bytes) 2024-09-12T16:16:32.011 INFO:teuthology.orchestra.run.smithi204.stdout:2218 punch from 0x260e00 to 0x26c600, (0xb800 bytes) 2024-09-12T16:16:32.027 INFO:teuthology.orchestra.run.smithi204.stdout:2220 write 0x2a3a800 thru 0x2a451f6 (0xa9f7 bytes) 2024-09-12T16:16:32.059 INFO:teuthology.orchestra.run.smithi204.stdout:2221 write 0xb177600 thru 0xb17880b (0x120c bytes) 2024-09-12T16:16:32.061 INFO:teuthology.orchestra.run.smithi204.stdout:2222 trunc from 0xb178a00 to 0xcbbaa00 2024-09-12T16:16:32.072 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:32.071+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:32.081 INFO:teuthology.orchestra.run.smithi204.stdout:2223 read 0x9203c00 thru 0x921128a (0xd68b bytes) 2024-09-12T16:16:32.081 INFO:teuthology.orchestra.run.smithi204.stdout:2224 read 0x8e06800 thru 0x8e0ddad (0x75ae bytes) 2024-09-12T16:16:32.081 INFO:teuthology.orchestra.run.smithi204.stdout:2225 read 0x2ca7600 thru 0x2cb3843 (0xc244 bytes) 2024-09-12T16:16:32.081 INFO:teuthology.orchestra.run.smithi204.stdout:2228 punch from 0x2fd1000 to 0x2fd5e00, (0x4e00 bytes) 2024-09-12T16:16:32.097 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2024-09-12T16:16:32.101 INFO:teuthology.orchestra.run.smithi204.stdout:2229 write 0xed4b600 thru 0xed5b2da (0xfcdb bytes) 2024-09-12T16:16:32.102 INFO:teuthology.orchestra.run.smithi204.stdout:2230 punch from 0x26e1e00 to 0x26f0400, (0xe600 bytes) 2024-09-12T16:16:32.102 INFO:teuthology.orchestra.run.smithi204.stdout:2231 write 0xb436600 thru 0xb43ba4f (0x5450 bytes) 2024-09-12T16:16:32.102 INFO:teuthology.orchestra.run.smithi204.stdout:2232 read 0x689a000 thru 0x68a65f5 (0xc5f6 bytes) 2024-09-12T16:16:32.102 INFO:teuthology.orchestra.run.smithi204.stdout:2234 read 0x6606200 thru 0x660eadd (0x88de bytes) 2024-09-12T16:16:32.102 INFO:teuthology.orchestra.run.smithi204.stdout:2236 read 0x3483400 thru 0x348b01b (0x7c1c bytes) 2024-09-12T16:16:32.114 INFO:teuthology.orchestra.run.smithi204.stdout:2237 trunc from 0xed5b400 to 0x662d200 2024-09-12T16:16:32.136 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:32.137 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:32.137 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:16:32.137 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:32.137 INFO:teuthology.orchestra.run.smithi204.stdout:2241 read 0x457600 thru 0x45cd7a (0x577b bytes) 2024-09-12T16:16:32.138 INFO:teuthology.orchestra.run.smithi204.stdout:2243 punch from 0x3548400 to 0x3558000, (0xfc00 bytes) 2024-09-12T16:16:32.139 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T16:16:32.147 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:16:32.158 INFO:teuthology.orchestra.run.smithi204.stdout:2244 write 0xb042a00 thru 0xb05138e (0xe98f bytes) 2024-09-12T16:16:32.160 INFO:teuthology.orchestra.run.smithi204.stdout:2247 read 0x1fb5400 thru 0x1fb9f33 (0x4b34 bytes) 2024-09-12T16:16:32.163 INFO:teuthology.orchestra.run.smithi204.stdout:2249 trunc from 0xb051400 to 0x821ac00 2024-09-12T16:16:32.173 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:32.172+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:32.197 INFO:teuthology.orchestra.run.smithi204.stdout:2250 trunc from 0x821ac00 to 0x1d8c600 2024-09-12T16:16:32.244 INFO:teuthology.orchestra.run.smithi204.stdout:2253 write 0xa1b0600 thru 0xa1b1522 (0xf23 bytes) 2024-09-12T16:16:32.244 INFO:teuthology.orchestra.run.smithi204.stdout:2255 write 0xa0dca00 thru 0xa0e881b (0xbe1c bytes) 2024-09-12T16:16:32.245 INFO:teuthology.orchestra.run.smithi204.stdout:2256 write 0x26a200 thru 0x26c6a4 (0x24a5 bytes) 2024-09-12T16:16:32.245 INFO:teuthology.orchestra.run.smithi204.stdout:2262 read 0x27cd400 thru 0x27db981 (0xe582 bytes) 2024-09-12T16:16:32.245 INFO:teuthology.orchestra.run.smithi204.stdout:2266 punch from 0xf95600 to 0xf99c00, (0x4600 bytes) 2024-09-12T16:16:32.246 INFO:teuthology.orchestra.run.smithi204.stdout:2268 read 0x3be3000 thru 0x3bf20b9 (0xf0ba bytes) 2024-09-12T16:16:32.246 INFO:teuthology.orchestra.run.smithi204.stdout:2269 read 0x31edc00 thru 0x31f16ad (0x3aae bytes) 2024-09-12T16:16:32.246 INFO:teuthology.orchestra.run.smithi204.stdout:2271 punch from 0x648fe00 to 0x6495600, (0x5800 bytes) 2024-09-12T16:16:32.247 INFO:teuthology.orchestra.run.smithi204.stdout:2274 read 0x315dc00 thru 0x316ce89 (0xf28a bytes) 2024-09-12T16:16:32.247 INFO:teuthology.orchestra.run.smithi204.stdout:2277 punch from 0x9a2c600 to 0x9a37800, (0xb200 bytes) 2024-09-12T16:16:32.247 INFO:teuthology.orchestra.run.smithi204.stdout:2278 clone 11 order 23 su 32768 sc 12 2024-09-12T16:16:32.275 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:32.274+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:32.278 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:16:32.278 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:16:32.296 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:16:32.296 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:16:32.307 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:32.307 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:32.307 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:16:32.307 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:16:32.307 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:32.312 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:16:32.312 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:16:32.316 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:16:32.330 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:16:32.330 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:16:32.346 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:16:32.347 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:16:32.347 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-12T16:16:32.351 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T16:16:32.351 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T16:16:32.393 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:32.392+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:32.437 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:32.437 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:32.446 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:16:32.490 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:32.489+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:32.553 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:32.554 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:32.562 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:16:32.603 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:32.602+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:32.678 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:32.678+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:32.710 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:32.710 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:32.719 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:16:32.779 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:32.779+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:32.825 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:32.826 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:32.834 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:16:32.880 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:32.879+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:32.941 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:32.941 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:32.950 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:16:32.981 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:32.980+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:33.082 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:33.081+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:33.097 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:33.097 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:33.100 INFO:teuthology.orchestra.run.smithi017.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-12T16:16:33.107 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:16:33.191 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:33.190+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:33.192 INFO:teuthology.orchestra.run.smithi204.stdout:truncating image image_client.0-clone10 from 0xa1b1600 (overlap 0x1726000) to 0x1284c00 2024-09-12T16:16:33.258 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:33.258 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:33.266 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:16:33.311 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:33.310+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:33.376 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:33.376 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:33.385 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:16:33.385 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:33.383+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:33.486 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:33.485+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:33.531 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:33.531 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:33.540 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:16:33.586 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:33.585+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:33.687 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:33.687 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:33.687 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:33.686+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:33.697 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:16:33.788 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:33.788+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:33.844 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:33.845 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:33.853 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:16:33.895 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:33.894+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:33.990 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:33.989+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:34.000 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:34.000 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:34.009 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:16:34.091 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:34.090+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:34.117 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T16:16:34.178 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:34.178 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:34.178 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:16:34.220 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:34.218+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:34.293 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:34.292+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:34.329 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:34.329 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:34.339 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:16:34.352 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T16:16:34.428 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:34.427+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:34.454 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:34.454 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:34.464 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:16:34.478 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #9, image image_client.0-clone9 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent10 2024-09-12T16:16:34.506 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:34.505+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:34.533 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:16:34.534 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:16:34.555 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:16:34.555 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:16:34.587 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:16:34.587 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:16:34.595 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:34.594+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:34.606 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:16:34.606 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:16:34.625 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:16:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:16:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-12T16:16:34.629 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T16:16:34.630 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T16:16:34.632 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:34.632 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:16:34.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:16:34.633 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:34.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.633 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:3893 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 409600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:34.633 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.336389+0000", 2024-09-12T16:16:34.633 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 28.294726496999999, 2024-09-12T16:16:34.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0045550920000000002, 2024-09-12T16:16:34.633 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:34.633 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:34.633 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:34.633 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:34.633 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:34.633 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:34.633 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3893 2024-09-12T16:16:34.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.634 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:34.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:34.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336389+0000", 2024-09-12T16:16:34.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:34.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336389+0000", 2024-09-12T16:16:34.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:34.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336389+0000", 2024-09-12T16:16:34.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1799999999999999e-07 2024-09-12T16:16:34.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:34.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336390+0000", 2024-09-12T16:16:34.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.082e-06 2024-09-12T16:16:34.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:34.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336393+0000", 2024-09-12T16:16:34.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9849999999999998e-06 2024-09-12T16:16:34.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336395+0000", 2024-09-12T16:16:34.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3460000000000001e-06 2024-09-12T16:16:34.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:34.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.339585+0000", 2024-09-12T16:16:34.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031895449999999998 2024-09-12T16:16:34.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:34.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340868+0000", 2024-09-12T16:16:34.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012825009999999999 2024-09-12T16:16:34.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:34.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340944+0000", 2024-09-12T16:16:34.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6415000000000006e-05 2024-09-12T16:16:34.637 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.637 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:34.637 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.637 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:3894 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 466944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:34.637 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.336399+0000", 2024-09-12T16:16:34.637 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 28.294716681000001, 2024-09-12T16:16:34.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0047051489999999996, 2024-09-12T16:16:34.637 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:34.638 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:34.638 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:34.638 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:34.638 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:34.638 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:34.638 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3894 2024-09-12T16:16:34.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.638 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:34.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:34.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336399+0000", 2024-09-12T16:16:34.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:34.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336399+0000", 2024-09-12T16:16:34.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:34.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336399+0000", 2024-09-12T16:16:34.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.34e-07 2024-09-12T16:16:34.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:34.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336400+0000", 2024-09-12T16:16:34.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.029e-06 2024-09-12T16:16:34.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:34.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336403+0000", 2024-09-12T16:16:34.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.078e-06 2024-09-12T16:16:34.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336405+0000", 2024-09-12T16:16:34.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.34e-06 2024-09-12T16:16:34.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:34.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340975+0000", 2024-09-12T16:16:34.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.004569348 2024-09-12T16:16:34.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:34.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341043+0000", 2024-09-12T16:16:34.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8202999999999997e-05 2024-09-12T16:16:34.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:34.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341104+0000", 2024-09-12T16:16:34.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0917e-05 2024-09-12T16:16:34.641 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.642 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:34.642 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.642 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:3895 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 483328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:34.642 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.336409+0000", 2024-09-12T16:16:34.642 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 28.294706766000001, 2024-09-12T16:16:34.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0048548549999999999, 2024-09-12T16:16:34.642 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:34.642 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:34.642 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:34.642 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:34.642 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:34.642 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:34.643 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3895 2024-09-12T16:16:34.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.643 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:34.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:34.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336409+0000", 2024-09-12T16:16:34.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:34.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336409+0000", 2024-09-12T16:16:34.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:34.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336409+0000", 2024-09-12T16:16:34.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2499999999999999e-07 2024-09-12T16:16:34.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:34.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336410+0000", 2024-09-12T16:16:34.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0139999999999999e-06 2024-09-12T16:16:34.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:34.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336413+0000", 2024-09-12T16:16:34.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.038e-06 2024-09-12T16:16:34.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336415+0000", 2024-09-12T16:16:34.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2680000000000001e-06 2024-09-12T16:16:34.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:34.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341132+0000", 2024-09-12T16:16:34.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0047171560000000001 2024-09-12T16:16:34.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:34.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341200+0000", 2024-09-12T16:16:34.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7910000000000005e-05 2024-09-12T16:16:34.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:34.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341263+0000", 2024-09-12T16:16:34.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3244000000000006e-05 2024-09-12T16:16:34.646 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.646 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:34.646 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.646 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:3896 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 499712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:34.646 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.336421+0000", 2024-09-12T16:16:34.647 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 28.294694675999999, 2024-09-12T16:16:34.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0050030539999999998, 2024-09-12T16:16:34.647 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:34.647 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:34.647 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:34.647 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:34.647 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:34.647 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:34.647 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3896 2024-09-12T16:16:34.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.647 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:34.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:34.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336421+0000", 2024-09-12T16:16:34.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:34.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336421+0000", 2024-09-12T16:16:34.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:34.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336421+0000", 2024-09-12T16:16:34.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8700000000000001e-07 2024-09-12T16:16:34.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:34.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336423+0000", 2024-09-12T16:16:34.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.753e-06 2024-09-12T16:16:34.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:34.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336428+0000", 2024-09-12T16:16:34.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6149999999999996e-06 2024-09-12T16:16:34.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336433+0000", 2024-09-12T16:16:34.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5909999999999998e-06 2024-09-12T16:16:34.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:34.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341292+0000", 2024-09-12T16:16:34.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0048587470000000001 2024-09-12T16:16:34.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:34.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341358+0000", 2024-09-12T16:16:34.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6218999999999997e-05 2024-09-12T16:16:34.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:34.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341424+0000", 2024-09-12T16:16:34.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5741999999999995e-05 2024-09-12T16:16:34.651 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.651 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:34.651 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.651 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:3897 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 516096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:34.651 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.336440+0000", 2024-09-12T16:16:34.651 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 28.294675622, 2024-09-12T16:16:34.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.005179187, 2024-09-12T16:16:34.651 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:34.651 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:34.651 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:34.651 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:34.652 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:34.652 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:34.652 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3897 2024-09-12T16:16:34.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.652 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:34.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:34.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336440+0000", 2024-09-12T16:16:34.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:34.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336440+0000", 2024-09-12T16:16:34.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:34.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336440+0000", 2024-09-12T16:16:34.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7e-07 2024-09-12T16:16:34.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:34.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336442+0000", 2024-09-12T16:16:34.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1959999999999998e-06 2024-09-12T16:16:34.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:34.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336449+0000", 2024-09-12T16:16:34.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8179999999999998e-06 2024-09-12T16:16:34.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.336454+0000", 2024-09-12T16:16:34.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1760000000000001e-06 2024-09-12T16:16:34.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:34.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341482+0000", 2024-09-12T16:16:34.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0050273460000000002 2024-09-12T16:16:34.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:34.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341552+0000", 2024-09-12T16:16:34.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0297999999999997e-05 2024-09-12T16:16:34.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:34.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341619+0000", 2024-09-12T16:16:34.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6983000000000006e-05 2024-09-12T16:16:34.655 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.655 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:34.655 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.655 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4125 3.5 3:a241af90:::rbd_data.11557ed36bb5.000000000000000f:4 [read 401408~6656] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:34.656 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.337967+0000", 2024-09-12T16:16:34.656 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 28.293148795, 2024-09-12T16:16:34.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003989467, 2024-09-12T16:16:34.656 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:34.656 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:34.656 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:34.656 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:34.656 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:34.656 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:34.656 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4125 2024-09-12T16:16:34.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.656 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:34.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:34.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337967+0000", 2024-09-12T16:16:34.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:34.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337967+0000", 2024-09-12T16:16:34.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:34.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337967+0000", 2024-09-12T16:16:34.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0900000000000002e-07 2024-09-12T16:16:34.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:34.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337975+0000", 2024-09-12T16:16:34.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6909999999999997e-06 2024-09-12T16:16:34.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:34.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337984+0000", 2024-09-12T16:16:34.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2720000000000003e-06 2024-09-12T16:16:34.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337990+0000", 2024-09-12T16:16:34.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3380000000000001e-06 2024-09-12T16:16:34.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:34.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340872+0000", 2024-09-12T16:16:34.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002882225 2024-09-12T16:16:34.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:34.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.340944+0000", 2024-09-12T16:16:34.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1219999999999999e-05 2024-09-12T16:16:34.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:34.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.341956+0000", 2024-09-12T16:16:34.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001012312 2024-09-12T16:16:34.660 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.660 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:34.660 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.660 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4126 3.5 3:a241af90:::rbd_data.11557ed36bb5.000000000000000f:4 [read 442368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:34.660 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.337999+0000", 2024-09-12T16:16:34.660 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 28.293115997000001, 2024-09-12T16:16:34.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0041510729999999999, 2024-09-12T16:16:34.661 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:34.661 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:34.661 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:34.661 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:34.661 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:34.661 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:34.661 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4126 2024-09-12T16:16:34.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.661 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:34.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:34.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337999+0000", 2024-09-12T16:16:34.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:34.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.337999+0000", 2024-09-12T16:16:34.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:34.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338000+0000", 2024-09-12T16:16:34.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4000000000000002e-07 2024-09-12T16:16:34.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:34.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338002+0000", 2024-09-12T16:16:34.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.154e-06 2024-09-12T16:16:34.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:34.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338009+0000", 2024-09-12T16:16:34.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9059999999999996e-06 2024-09-12T16:16:34.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338014+0000", 2024-09-12T16:16:34.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7650000000000001e-06 2024-09-12T16:16:34.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:34.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342002+0000", 2024-09-12T16:16:34.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039884680000000002 2024-09-12T16:16:34.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:34.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342076+0000", 2024-09-12T16:16:34.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4023999999999995e-05 2024-09-12T16:16:34.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:34.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342150+0000", 2024-09-12T16:16:34.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4215999999999996e-05 2024-09-12T16:16:34.664 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.664 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:34.664 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.665 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4127 3.5 3:a241af90:::rbd_data.11557ed36bb5.000000000000000f:4 [read 458752~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:34.665 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.338021+0000", 2024-09-12T16:16:34.665 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 28.293094401000001, 2024-09-12T16:16:34.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042934399999999999, 2024-09-12T16:16:34.665 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:34.665 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:34.665 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:34.665 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:34.665 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:34.665 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:34.665 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4127 2024-09-12T16:16:34.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.665 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:34.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:34.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338021+0000", 2024-09-12T16:16:34.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:34.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338021+0000", 2024-09-12T16:16:34.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:34.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338021+0000", 2024-09-12T16:16:34.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9800000000000004e-07 2024-09-12T16:16:34.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:34.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338024+0000", 2024-09-12T16:16:34.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2809999999999998e-06 2024-09-12T16:16:34.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:34.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338031+0000", 2024-09-12T16:16:34.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1269999999999997e-06 2024-09-12T16:16:34.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338036+0000", 2024-09-12T16:16:34.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0329999999999999e-06 2024-09-12T16:16:34.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:34.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342181+0000", 2024-09-12T16:16:34.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.004144699 2024-09-12T16:16:34.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:34.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342247+0000", 2024-09-12T16:16:34.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6149000000000007e-05 2024-09-12T16:16:34.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:34.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342314+0000", 2024-09-12T16:16:34.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7652999999999998e-05 2024-09-12T16:16:34.669 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.669 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:34.669 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.669 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4128 3.5 3:a241af90:::rbd_data.11557ed36bb5.000000000000000f:4 [read 475136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:34.669 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.338043+0000", 2024-09-12T16:16:34.669 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 28.293072252999998, 2024-09-12T16:16:34.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0044450189999999997, 2024-09-12T16:16:34.669 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:34.669 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:34.669 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:34.669 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:34.669 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:34.669 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:34.670 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4128 2024-09-12T16:16:34.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.670 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:34.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:34.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338043+0000", 2024-09-12T16:16:34.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:34.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338043+0000", 2024-09-12T16:16:34.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:34.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338044+0000", 2024-09-12T16:16:34.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2599999999999998e-07 2024-09-12T16:16:34.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:34.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338046+0000", 2024-09-12T16:16:34.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9850000000000001e-06 2024-09-12T16:16:34.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:34.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338052+0000", 2024-09-12T16:16:34.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7410000000000003e-06 2024-09-12T16:16:34.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338058+0000", 2024-09-12T16:16:34.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5729999999999998e-06 2024-09-12T16:16:34.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:34.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342343+0000", 2024-09-12T16:16:34.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042855970000000004 2024-09-12T16:16:34.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:34.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342411+0000", 2024-09-12T16:16:34.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7619000000000004e-05 2024-09-12T16:16:34.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:34.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342488+0000", 2024-09-12T16:16:34.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7077999999999996e-05 2024-09-12T16:16:34.673 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.673 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:34.673 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.673 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4129 3.5 3:a241af90:::rbd_data.11557ed36bb5.000000000000000f:4 [read 491520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:34.673 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.338065+0000", 2024-09-12T16:16:34.673 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 28.293049948, 2024-09-12T16:16:34.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.004581819, 2024-09-12T16:16:34.674 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:34.674 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:34.674 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:34.674 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:34.674 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:34.674 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:34.674 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4129 2024-09-12T16:16:34.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.674 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:34.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:34.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338065+0000", 2024-09-12T16:16:34.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:34.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338065+0000", 2024-09-12T16:16:34.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:34.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338066+0000", 2024-09-12T16:16:34.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-07 2024-09-12T16:16:34.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:34.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338068+0000", 2024-09-12T16:16:34.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4820000000000001e-06 2024-09-12T16:16:34.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:34.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338075+0000", 2024-09-12T16:16:34.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.08e-06 2024-09-12T16:16:34.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.338081+0000", 2024-09-12T16:16:34.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2939999999999996e-06 2024-09-12T16:16:34.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:34.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342515+0000", 2024-09-12T16:16:34.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0044338720000000002 2024-09-12T16:16:34.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:34.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342582+0000", 2024-09-12T16:16:34.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6962e-05 2024-09-12T16:16:34.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:34.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.342647+0000", 2024-09-12T16:16:34.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5643999999999997e-05 2024-09-12T16:16:34.677 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.677 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:34.677 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.678 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4542.0:4450 3.18 3:189abea9:::rbd_data.11557ed36bb5.0000000000000004:4 [read 475136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-12T16:16:34.678 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:06.345047+0000", 2024-09-12T16:16:34.678 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 28.286068602, 2024-09-12T16:16:34.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003358088, 2024-09-12T16:16:34.678 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:34.678 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:34.678 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:34.678 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:34.678 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4542", 2024-09-12T16:16:34.678 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2501282026", 2024-09-12T16:16:34.679 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4450 2024-09-12T16:16:34.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.679 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:34.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:34.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345047+0000", 2024-09-12T16:16:34.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:34.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345047+0000", 2024-09-12T16:16:34.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:34.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345047+0000", 2024-09-12T16:16:34.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2599999999999998e-07 2024-09-12T16:16:34.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:34.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345049+0000", 2024-09-12T16:16:34.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1040000000000001e-06 2024-09-12T16:16:34.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:34.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345056+0000", 2024-09-12T16:16:34.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6220000000000003e-06 2024-09-12T16:16:34.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.345061+0000", 2024-09-12T16:16:34.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0710000000000002e-06 2024-09-12T16:16:34.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:34.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.348273+0000", 2024-09-12T16:16:34.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032119649999999998 2024-09-12T16:16:34.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:34.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.348340+0000", 2024-09-12T16:16:34.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7115999999999999e-05 2024-09-12T16:16:34.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:34.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:06.348405+0000", 2024-09-12T16:16:34.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4783999999999995e-05 2024-09-12T16:16:34.682 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.682 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:34.682 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.682 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:611 3.1e 3:781126e5:::rbd_data.11551fa285fd.0000000000000001:5 [sparse-read 4390912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:34.683 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.317383+0000", 2024-09-12T16:16:34.683 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.313732309999999, 2024-09-12T16:16:34.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034147090000000001, 2024-09-12T16:16:34.683 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:34.683 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:34.683 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:34.683 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:34.683 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:34.683 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:34.683 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 611 2024-09-12T16:16:34.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.683 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:34.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:34.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317383+0000", 2024-09-12T16:16:34.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:34.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317383+0000", 2024-09-12T16:16:34.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:34.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317383+0000", 2024-09-12T16:16:34.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.03e-07 2024-09-12T16:16:34.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:34.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317384+0000", 2024-09-12T16:16:34.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.111e-06 2024-09-12T16:16:34.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:34.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317387+0000", 2024-09-12T16:16:34.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0920000000000002e-06 2024-09-12T16:16:34.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317391+0000", 2024-09-12T16:16:34.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.191e-06 2024-09-12T16:16:34.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:34.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.320634+0000", 2024-09-12T16:16:34.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032436750000000001 2024-09-12T16:16:34.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:34.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.320721+0000", 2024-09-12T16:16:34.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6682999999999997e-05 2024-09-12T16:16:34.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:34.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.320798+0000", 2024-09-12T16:16:34.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6754000000000004e-05 2024-09-12T16:16:34.687 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.687 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:34.687 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.687 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:612 3.1e 3:781126e5:::rbd_data.11551fa285fd.0000000000000001:5 [sparse-read 5439488~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:34.687 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.317394+0000", 2024-09-12T16:16:34.687 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.313721267999998, 2024-09-12T16:16:34.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036457799999999999, 2024-09-12T16:16:34.687 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:34.687 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:34.687 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:34.688 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:34.688 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:34.688 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:34.688 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 612 2024-09-12T16:16:34.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.688 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:34.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:34.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317394+0000", 2024-09-12T16:16:34.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:34.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317394+0000", 2024-09-12T16:16:34.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:34.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317394+0000", 2024-09-12T16:16:34.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1400000000000001e-07 2024-09-12T16:16:34.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:34.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317395+0000", 2024-09-12T16:16:34.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.569999999999999e-07 2024-09-12T16:16:34.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:34.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317398+0000", 2024-09-12T16:16:34.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1520000000000001e-06 2024-09-12T16:16:34.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317401+0000", 2024-09-12T16:16:34.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4660000000000002e-06 2024-09-12T16:16:34.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:34.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.320843+0000", 2024-09-12T16:16:34.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034421130000000001 2024-09-12T16:16:34.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:34.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.320939+0000", 2024-09-12T16:16:34.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5585e-05 2024-09-12T16:16:34.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:34.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321040+0000", 2024-09-12T16:16:34.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010129299999999999 2024-09-12T16:16:34.691 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.691 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:34.691 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.692 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:613 3.1e 3:781126e5:::rbd_data.11551fa285fd.0000000000000001:5 [sparse-read 6488064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:34.692 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.317404+0000", 2024-09-12T16:16:34.692 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.313711268999999, 2024-09-12T16:16:34.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003785217, 2024-09-12T16:16:34.692 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:34.692 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:34.692 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:34.692 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:34.692 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:34.692 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:34.692 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 613 2024-09-12T16:16:34.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.692 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:34.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:34.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317404+0000", 2024-09-12T16:16:34.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:34.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317404+0000", 2024-09-12T16:16:34.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:34.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317404+0000", 2024-09-12T16:16:34.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2000000000000001e-07 2024-09-12T16:16:34.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:34.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317405+0000", 2024-09-12T16:16:34.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0890000000000001e-06 2024-09-12T16:16:34.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:34.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317408+0000", 2024-09-12T16:16:34.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.061e-06 2024-09-12T16:16:34.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317411+0000", 2024-09-12T16:16:34.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.52e-06 2024-09-12T16:16:34.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:34.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321069+0000", 2024-09-12T16:16:34.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036582059999999998 2024-09-12T16:16:34.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:34.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321127+0000", 2024-09-12T16:16:34.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7339000000000001e-05 2024-09-12T16:16:34.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:34.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321189+0000", 2024-09-12T16:16:34.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2781999999999996e-05 2024-09-12T16:16:34.696 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.696 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:34.696 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.696 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4581.0:614 3.1e 3:781126e5:::rbd_data.11551fa285fd.0000000000000001:5 [sparse-read 7536640~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T16:16:34.696 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:08.317414+0000", 2024-09-12T16:16:34.696 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.313701093999999, 2024-09-12T16:16:34.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039935709999999996, 2024-09-12T16:16:34.696 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:34.697 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:34.697 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:34.697 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:34.697 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4581", 2024-09-12T16:16:34.697 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2199166674", 2024-09-12T16:16:34.697 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 614 2024-09-12T16:16:34.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.697 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:34.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:34.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317414+0000", 2024-09-12T16:16:34.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:34.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317414+0000", 2024-09-12T16:16:34.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:34.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317414+0000", 2024-09-12T16:16:34.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.05e-07 2024-09-12T16:16:34.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:34.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317418+0000", 2024-09-12T16:16:34.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5329999999999999e-06 2024-09-12T16:16:34.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:34.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317423+0000", 2024-09-12T16:16:34.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2780000000000001e-06 2024-09-12T16:16:34.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.317428+0000", 2024-09-12T16:16:34.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.763e-06 2024-09-12T16:16:34.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:34.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321217+0000", 2024-09-12T16:16:34.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003788816 2024-09-12T16:16:34.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:34.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321307+0000", 2024-09-12T16:16:34.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0142999999999994e-05 2024-09-12T16:16:34.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:34.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:08.321408+0000", 2024-09-12T16:16:34.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000100833 2024-09-12T16:16:34.700 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.700 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:34.700 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.700 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4628.0:534 3.1f e41/21 3:fde85b2b:::rbd_data.115575975003.0000000000000000:head v 41'92, mlcod=41'90)", 2024-09-12T16:16:34.700 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:26.749420+0000", 2024-09-12T16:16:34.701 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.8816948729999998, 2024-09-12T16:16:34.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.004333122, 2024-09-12T16:16:34.701 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:34.701 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:34.701 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:34.701 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:34.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:34.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.749420+0000", 2024-09-12T16:16:34.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:34.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.749420+0000", 2024-09-12T16:16:34.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:34.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.749422+0000", 2024-09-12T16:16:34.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.13e-06 2024-09-12T16:16:34.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:34.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.751400+0000", 2024-09-12T16:16:34.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019781690000000001 2024-09-12T16:16:34.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:34.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.751409+0000", 2024-09-12T16:16:34.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4890000000000001e-06 2024-09-12T16:16:34.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.751416+0000", 2024-09-12T16:16:34.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6259999999999997e-06 2024-09-12T16:16:34.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:34.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.751496+0000", 2024-09-12T16:16:34.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9938999999999995e-05 2024-09-12T16:16:34.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:34.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.751520+0000", 2024-09-12T16:16:34.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4216e-05 2024-09-12T16:16:34.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:16:34.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.753702+0000", 2024-09-12T16:16:34.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0021816399999999999 2024-09-12T16:16:34.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:34.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:26.753754+0000", 2024-09-12T16:16:34.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1913000000000003e-05 2024-09-12T16:16:34.705 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.705 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:34.705 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.705 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4673.0:1560 3.d e44/21 3:b4c31c12:::rbd_data.1155e1e6c0d8.000000000000000e:head v 44'190, mlcod=44'188)", 2024-09-12T16:16:34.705 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:31.650660+0000", 2024-09-12T16:16:34.705 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.9804551290000001, 2024-09-12T16:16:34.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039558359999999999, 2024-09-12T16:16:34.705 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:34.705 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:34.705 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:34.705 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:34.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:34.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.650660+0000", 2024-09-12T16:16:34.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:34.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.650660+0000", 2024-09-12T16:16:34.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:34.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.650662+0000", 2024-09-12T16:16:34.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.559e-06 2024-09-12T16:16:34.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:34.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.652275+0000", 2024-09-12T16:16:34.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00161337 2024-09-12T16:16:34.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:34.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.652293+0000", 2024-09-12T16:16:34.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7591000000000001e-05 2024-09-12T16:16:34.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.652301+0000", 2024-09-12T16:16:34.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3100000000000001e-06 2024-09-12T16:16:34.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:34.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.652371+0000", 2024-09-12T16:16:34.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9775000000000002e-05 2024-09-12T16:16:34.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:34.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.652389+0000", 2024-09-12T16:16:34.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7883000000000001e-05 2024-09-12T16:16:34.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:16:34.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.654582+0000", 2024-09-12T16:16:34.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0021936590000000001 2024-09-12T16:16:34.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:34.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.654616+0000", 2024-09-12T16:16:34.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3689000000000002e-05 2024-09-12T16:16:34.709 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.709 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:34.709 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.709 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4673.0:5375 3.d e44/21 3:b04b67ff:::rbd_data.1155e1e6c0d8.0000000000000001:head v 44'212, mlcod=44'210)", 2024-09-12T16:16:34.709 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:31.974674+0000", 2024-09-12T16:16:34.709 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.6564410899999999, 2024-09-12T16:16:34.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036099460000000002, 2024-09-12T16:16:34.710 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:34.710 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:34.710 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:34.710 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:34.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:34.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.974674+0000", 2024-09-12T16:16:34.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:34.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.974674+0000", 2024-09-12T16:16:34.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:34.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.974676+0000", 2024-09-12T16:16:34.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.24e-06 2024-09-12T16:16:34.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:34.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.976062+0000", 2024-09-12T16:16:34.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001386364 2024-09-12T16:16:34.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:34.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.976081+0000", 2024-09-12T16:16:34.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.891e-05 2024-09-12T16:16:34.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.976091+0000", 2024-09-12T16:16:34.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9150000000000008e-06 2024-09-12T16:16:34.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:34.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.976158+0000", 2024-09-12T16:16:34.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6815000000000003e-05 2024-09-12T16:16:34.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:34.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.976181+0000", 2024-09-12T16:16:34.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3869000000000001e-05 2024-09-12T16:16:34.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:16:34.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.978241+0000", 2024-09-12T16:16:34.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020596249999999998 2024-09-12T16:16:34.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:34.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.978284+0000", 2024-09-12T16:16:34.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3207999999999997e-05 2024-09-12T16:16:34.713 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.713 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:34.713 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.714 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4673.0:5374 3.1e e44/32 3:7a744801:::rbd_data.1155e1e6c0d8.0000000000000000:head v 44'114, mlcod=44'112)", 2024-09-12T16:16:34.714 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:31.979850+0000", 2024-09-12T16:16:34.714 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.6512656859999999, 2024-09-12T16:16:34.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0049100410000000004, 2024-09-12T16:16:34.714 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:34.714 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:34.714 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:34.714 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:34.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:34.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.979850+0000", 2024-09-12T16:16:34.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:34.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.979850+0000", 2024-09-12T16:16:34.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:34.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.979850+0000", 2024-09-12T16:16:34.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0400000000000005e-07 2024-09-12T16:16:34.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:34.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.981188+0000", 2024-09-12T16:16:34.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013376289999999999 2024-09-12T16:16:34.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:34.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.981205+0000", 2024-09-12T16:16:34.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6912999999999999e-05 2024-09-12T16:16:34.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.981216+0000", 2024-09-12T16:16:34.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0845e-05 2024-09-12T16:16:34.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:34.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.981345+0000", 2024-09-12T16:16:34.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012958199999999999 2024-09-12T16:16:34.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:34.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.981419+0000", 2024-09-12T16:16:34.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3572000000000006e-05 2024-09-12T16:16:34.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:16:34.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.984683+0000", 2024-09-12T16:16:34.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032642779999999998 2024-09-12T16:16:34.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:34.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.984760+0000", 2024-09-12T16:16:34.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6417999999999999e-05 2024-09-12T16:16:34.718 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.718 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:34.718 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.718 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4673.0:5440 3.9 e44/21 3:972f65c5:::rbd_data.1155e1e6c0d8.0000000000000008:head v 44'159, mlcod=44'157)", 2024-09-12T16:16:34.719 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:31.981079+0000", 2024-09-12T16:16:34.719 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.6500364300000001, 2024-09-12T16:16:34.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0056687930000000001, 2024-09-12T16:16:34.719 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:34.719 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:34.719 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:34.719 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:34.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:34.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.981079+0000", 2024-09-12T16:16:34.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:34.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.981079+0000", 2024-09-12T16:16:34.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:34.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:34.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.981080+0000", 2024-09-12T16:16:34.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.051e-06 2024-09-12T16:16:34.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:34.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.984043+0000", 2024-09-12T16:16:34.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029626819999999999 2024-09-12T16:16:34.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:34.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.984056+0000", 2024-09-12T16:16:34.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2967e-05 2024-09-12T16:16:34.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.984062+0000", 2024-09-12T16:16:34.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7190000000000004e-06 2024-09-12T16:16:34.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:34.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.984128+0000", 2024-09-12T16:16:34.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5709000000000004e-05 2024-09-12T16:16:34.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:34.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.984162+0000", 2024-09-12T16:16:34.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4201e-05 2024-09-12T16:16:34.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:16:34.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.986684+0000", 2024-09-12T16:16:34.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002521508 2024-09-12T16:16:34.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:34.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:34.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:34.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:31.986748+0000", 2024-09-12T16:16:34.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3955999999999995e-05 2024-09-12T16:16:34.723 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.723 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:34.723 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.723 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:34.723 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:34.723 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:34.724 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:16:34.725 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:34.723+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:34.795 INFO:teuthology.orchestra.run.smithi204.stdout:2279 read 0x43e5600 thru 0x43f0085 (0xaa86 bytes) 2024-09-12T16:16:34.795 INFO:teuthology.orchestra.run.smithi204.stdout:2281 read 0x2f59400 thru 0x2f64c2a (0xb82b bytes) 2024-09-12T16:16:34.806 INFO:teuthology.orchestra.run.smithi204.stdout:2283 trunc from 0xa1b1600 to 0x153fc00 2024-09-12T16:16:34.825 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:34.824+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:34.853 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:34.853 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:16:34.853 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.853 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:1220 3.a 3.6d3d634a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-12T16:16:34.853 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:34.846039+0000", 2024-09-12T16:16:34.853 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0039962749999999997, 2024-09-12T16:16:34.853 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004015729, 2024-09-12T16:16:34.854 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:34.854 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:34.854 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:34.854 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:34.854 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:34.854 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:34.854 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1220 2024-09-12T16:16:34.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.854 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:34.854 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.854 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:34.854 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846039+0000", 2024-09-12T16:16:34.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846039+0000", 2024-09-12T16:16:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846039+0000", 2024-09-12T16:16:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9799999999999999e-07 2024-09-12T16:16:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846042+0000", 2024-09-12T16:16:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2620000000000001e-06 2024-09-12T16:16:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846048+0000", 2024-09-12T16:16:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4500000000000001e-06 2024-09-12T16:16:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846053+0000", 2024-09-12T16:16:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0209999999999999e-06 2024-09-12T16:16:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:1221 3.a 3.6d3d634a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-12T16:16:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:34.846060+0000", 2024-09-12T16:16:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0039755490000000001, 2024-09-12T16:16:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040512630000000003, 2024-09-12T16:16:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1221 2024-09-12T16:16:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846060+0000", 2024-09-12T16:16:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846060+0000", 2024-09-12T16:16:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846060+0000", 2024-09-12T16:16:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2399999999999999e-07 2024-09-12T16:16:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846062+0000", 2024-09-12T16:16:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.007e-06 2024-09-12T16:16:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846068+0000", 2024-09-12T16:16:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8150000000000002e-06 2024-09-12T16:16:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846072+0000", 2024-09-12T16:16:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3440000000000003e-06 2024-09-12T16:16:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:1222 3.a 3.6d3d634a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-12T16:16:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:34.846081+0000", 2024-09-12T16:16:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0039542099999999997, 2024-09-12T16:16:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040790990000000001, 2024-09-12T16:16:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1222 2024-09-12T16:16:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846081+0000", 2024-09-12T16:16:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846081+0000", 2024-09-12T16:16:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846081+0000", 2024-09-12T16:16:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7399999999999999e-07 2024-09-12T16:16:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846083+0000", 2024-09-12T16:16:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.928e-06 2024-09-12T16:16:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846089+0000", 2024-09-12T16:16:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0839999999999997e-06 2024-09-12T16:16:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846094+0000", 2024-09-12T16:16:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5900000000000001e-06 2024-09-12T16:16:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:1127 3.13 3:ca856cdc:::rbd_data.1155e1e6c0d8.0000000000000004:d [read 1736704~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-12T16:16:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:34.845271+0000", 2024-09-12T16:16:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0047646310000000001, 2024-09-12T16:16:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0049404310000000003, 2024-09-12T16:16:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "reached pg", 2024-09-12T16:16:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1127 2024-09-12T16:16:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845271+0000", 2024-09-12T16:16:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845271+0000", 2024-09-12T16:16:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845271+0000", 2024-09-12T16:16:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9900000000000001e-07 2024-09-12T16:16:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845273+0000", 2024-09-12T16:16:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9810000000000002e-06 2024-09-12T16:16:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845279+0000", 2024-09-12T16:16:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1009999999999997e-06 2024-09-12T16:16:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845284+0000", 2024-09-12T16:16:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1959999999999999e-06 2024-09-12T16:16:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.850173+0000", 2024-09-12T16:16:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0048882550000000002 2024-09-12T16:16:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.868 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:1223 3.a 3.6d3d634a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-12T16:16:34.868 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:34.846100+0000", 2024-09-12T16:16:34.868 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0039347009999999997, 2024-09-12T16:16:34.868 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0041723109999999997, 2024-09-12T16:16:34.868 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:34.868 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:34.868 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:34.868 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:34.868 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:34.868 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:34.868 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1223 2024-09-12T16:16:34.868 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.868 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:34.868 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.869 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:34.869 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846100+0000", 2024-09-12T16:16:34.869 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.869 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.869 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.869 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:34.869 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846100+0000", 2024-09-12T16:16:34.869 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.869 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.869 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.869 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:34.869 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846101+0000", 2024-09-12T16:16:34.869 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6300000000000001e-07 2024-09-12T16:16:34.870 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.870 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.870 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:34.870 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846103+0000", 2024-09-12T16:16:34.870 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.95e-06 2024-09-12T16:16:34.870 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.870 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.870 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:34.870 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846109+0000", 2024-09-12T16:16:34.870 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9599999999999997e-06 2024-09-12T16:16:34.870 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.870 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.870 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.870 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846113+0000", 2024-09-12T16:16:34.870 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6689999999999997e-06 2024-09-12T16:16:34.871 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.871 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:34.871 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.871 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.871 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.871 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:1128 3.13 3.3b36a153 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-12T16:16:34.871 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:34.845293+0000", 2024-09-12T16:16:34.871 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0047422109999999996, 2024-09-12T16:16:34.871 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050330510000000002, 2024-09-12T16:16:34.871 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:34.871 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:34.871 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:34.871 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:34.872 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:34.872 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:34.872 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1128 2024-09-12T16:16:34.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.872 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:34.872 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.872 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:34.872 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845293+0000", 2024-09-12T16:16:34.872 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.872 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.872 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:34.872 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845293+0000", 2024-09-12T16:16:34.872 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.873 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.873 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:34.873 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845293+0000", 2024-09-12T16:16:34.873 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2300000000000002e-07 2024-09-12T16:16:34.873 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.873 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.873 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:34.873 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845296+0000", 2024-09-12T16:16:34.873 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1959999999999998e-06 2024-09-12T16:16:34.873 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.873 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.873 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:34.873 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845302+0000", 2024-09-12T16:16:34.873 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3080000000000004e-06 2024-09-12T16:16:34.874 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.874 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.874 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.874 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845307+0000", 2024-09-12T16:16:34.874 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1460000000000004e-06 2024-09-12T16:16:34.874 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.874 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:34.874 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.874 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.874 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.874 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:1224 3.a 3.6d3d634a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-12T16:16:34.874 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:34.846120+0000", 2024-09-12T16:16:34.874 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0039155609999999997, 2024-09-12T16:16:34.874 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0042335460000000004, 2024-09-12T16:16:34.875 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:34.875 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:34.875 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:34.875 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:34.875 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:34.875 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:34.875 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1224 2024-09-12T16:16:34.875 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.875 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:34.875 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.875 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:34.875 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846120+0000", 2024-09-12T16:16:34.875 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.876 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.876 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.876 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:34.876 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846120+0000", 2024-09-12T16:16:34.876 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.876 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.876 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.876 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:34.876 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846120+0000", 2024-09-12T16:16:34.876 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.84e-07 2024-09-12T16:16:34.876 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.876 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.876 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:34.877 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846122+0000", 2024-09-12T16:16:34.877 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0590000000000001e-06 2024-09-12T16:16:34.877 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.877 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.877 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:34.877 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846128+0000", 2024-09-12T16:16:34.877 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8619999999999999e-06 2024-09-12T16:16:34.877 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.877 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.877 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.877 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846133+0000", 2024-09-12T16:16:34.877 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7999999999999998e-06 2024-09-12T16:16:34.877 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.878 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:34.878 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.878 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.878 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.878 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:1129 3.13 3.3b36a153 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-12T16:16:34.878 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:34.845314+0000", 2024-09-12T16:16:34.878 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0047211520000000002, 2024-09-12T16:16:34.878 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050767499999999997, 2024-09-12T16:16:34.878 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:34.878 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:34.878 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:34.878 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:34.879 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:34.879 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:34.879 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1129 2024-09-12T16:16:34.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.879 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:34.879 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.879 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:34.879 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845314+0000", 2024-09-12T16:16:34.879 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.879 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.879 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:34.879 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845314+0000", 2024-09-12T16:16:34.879 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.880 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.880 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:34.880 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845314+0000", 2024-09-12T16:16:34.880 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.34e-07 2024-09-12T16:16:34.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.880 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.880 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:34.880 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845316+0000", 2024-09-12T16:16:34.880 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9089999999999998e-06 2024-09-12T16:16:34.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.880 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.880 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:34.880 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845323+0000", 2024-09-12T16:16:34.881 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6950000000000003e-06 2024-09-12T16:16:34.881 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.881 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.881 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.881 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845328+0000", 2024-09-12T16:16:34.881 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5290000000000002e-06 2024-09-12T16:16:34.881 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.881 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:34.881 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.881 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.881 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.881 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:1225 3.a 3.6d3d634a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-12T16:16:34.881 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:34.846139+0000", 2024-09-12T16:16:34.881 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0038963370000000002, 2024-09-12T16:16:34.881 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0043290969999999996, 2024-09-12T16:16:34.881 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:34.882 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:34.882 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:34.882 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:34.882 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:34.882 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:34.882 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1225 2024-09-12T16:16:34.882 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.882 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:34.882 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.882 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:34.882 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846139+0000", 2024-09-12T16:16:34.882 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.882 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.882 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.883 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:34.883 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846139+0000", 2024-09-12T16:16:34.883 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.883 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.883 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.883 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:34.883 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846139+0000", 2024-09-12T16:16:34.883 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9900000000000001e-07 2024-09-12T16:16:34.883 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.883 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.883 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:34.883 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846141+0000", 2024-09-12T16:16:34.883 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.826e-06 2024-09-12T16:16:34.884 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.884 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.884 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:34.884 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846147+0000", 2024-09-12T16:16:34.884 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7640000000000002e-06 2024-09-12T16:16:34.884 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.884 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.884 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.884 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846152+0000", 2024-09-12T16:16:34.884 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7509999999999999e-06 2024-09-12T16:16:34.884 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.884 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:34.885 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.885 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.885 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.885 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:1226 3.d 3.4838c32d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-12T16:16:34.885 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:34.846158+0000", 2024-09-12T16:16:34.885 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.003877466, 2024-09-12T16:16:34.885 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0043487619999999999, 2024-09-12T16:16:34.885 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:34.885 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:34.885 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:34.885 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:34.885 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:34.885 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:34.885 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1226 2024-09-12T16:16:34.886 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.886 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:34.886 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.886 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:34.886 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846158+0000", 2024-09-12T16:16:34.886 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.886 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.886 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.886 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:34.886 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846158+0000", 2024-09-12T16:16:34.886 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.886 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.886 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.887 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:34.887 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846158+0000", 2024-09-12T16:16:34.887 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7899999999999999e-07 2024-09-12T16:16:34.887 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.887 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.887 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:34.887 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846160+0000", 2024-09-12T16:16:34.887 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0049999999999999e-06 2024-09-12T16:16:34.887 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.887 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.887 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:34.887 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846166+0000", 2024-09-12T16:16:34.887 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7620000000000001e-06 2024-09-12T16:16:34.887 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.888 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.888 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.888 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846171+0000", 2024-09-12T16:16:34.888 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9790000000000001e-06 2024-09-12T16:16:34.888 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.888 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:34.888 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.888 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.888 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.888 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:1227 3.d 3.4838c32d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-12T16:16:34.888 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:34.846178+0000", 2024-09-12T16:16:34.888 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.003857287, 2024-09-12T16:16:34.888 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0043520909999999998, 2024-09-12T16:16:34.888 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:34.888 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:34.889 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:34.889 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:34.889 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:34.889 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:34.889 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1227 2024-09-12T16:16:34.889 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.889 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:34.889 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.889 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:34.889 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846178+0000", 2024-09-12T16:16:34.889 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.889 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.889 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.889 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:34.890 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846178+0000", 2024-09-12T16:16:34.890 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.890 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.890 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.890 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:34.890 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846178+0000", 2024-09-12T16:16:34.890 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.89e-07 2024-09-12T16:16:34.890 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.890 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.890 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:34.890 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846180+0000", 2024-09-12T16:16:34.890 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.199e-06 2024-09-12T16:16:34.890 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.890 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.890 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:34.891 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846187+0000", 2024-09-12T16:16:34.891 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3579999999999999e-06 2024-09-12T16:16:34.891 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.891 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.891 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.891 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846192+0000", 2024-09-12T16:16:34.891 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9629999999999997e-06 2024-09-12T16:16:34.891 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.891 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:34.891 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.891 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.891 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.891 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:1228 3.d 3.4838c32d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-12T16:16:34.891 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:34.846219+0000", 2024-09-12T16:16:34.891 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0038157820000000002, 2024-09-12T16:16:34.892 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00435812, 2024-09-12T16:16:34.892 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:34.892 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:34.892 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:34.892 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:34.892 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:34.892 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:34.892 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1228 2024-09-12T16:16:34.892 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.892 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:34.892 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.892 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:34.892 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846219+0000", 2024-09-12T16:16:34.892 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.892 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.893 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.893 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:34.893 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846219+0000", 2024-09-12T16:16:34.893 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.893 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.893 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.893 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:34.893 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846220+0000", 2024-09-12T16:16:34.893 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2900000000000004e-07 2024-09-12T16:16:34.893 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.893 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.893 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:34.894 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846229+0000", 2024-09-12T16:16:34.894 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8049999999999996e-06 2024-09-12T16:16:34.894 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.894 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.894 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:34.894 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846243+0000", 2024-09-12T16:16:34.894 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3968000000000001e-05 2024-09-12T16:16:34.894 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.894 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.894 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.894 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846250+0000", 2024-09-12T16:16:34.894 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5179999999999998e-06 2024-09-12T16:16:34.894 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.894 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:34.895 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.895 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.895 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.895 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:1229 3.d 3.4838c32d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-12T16:16:34.895 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:34.846260+0000", 2024-09-12T16:16:34.895 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0037752530000000001, 2024-09-12T16:16:34.895 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0043776600000000002, 2024-09-12T16:16:34.895 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:34.895 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:34.895 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:34.895 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:34.895 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:34.896 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:34.896 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1229 2024-09-12T16:16:34.896 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.896 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:34.896 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.896 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:34.896 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846260+0000", 2024-09-12T16:16:34.896 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.896 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.896 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.896 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:34.896 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846260+0000", 2024-09-12T16:16:34.896 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.896 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.896 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.897 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:34.897 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846261+0000", 2024-09-12T16:16:34.897 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0399999999999996e-07 2024-09-12T16:16:34.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.897 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.897 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:34.897 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846263+0000", 2024-09-12T16:16:34.897 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5289999999999998e-06 2024-09-12T16:16:34.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.897 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.897 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:34.897 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846270+0000", 2024-09-12T16:16:34.897 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5200000000000003e-06 2024-09-12T16:16:34.898 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.898 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.898 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.898 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846274+0000", 2024-09-12T16:16:34.898 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8559999999999998e-06 2024-09-12T16:16:34.898 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.898 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:34.898 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.898 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.898 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.898 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:1230 3.d 3.4838c32d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-12T16:16:34.898 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:34.846283+0000", 2024-09-12T16:16:34.899 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0037522639999999999, 2024-09-12T16:16:34.899 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004534082, 2024-09-12T16:16:34.899 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:34.899 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:34.899 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:34.899 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:34.899 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:34.899 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:34.899 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1230 2024-09-12T16:16:34.899 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.899 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:34.899 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.899 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:34.899 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846283+0000", 2024-09-12T16:16:34.900 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.900 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.900 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.900 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:34.900 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846283+0000", 2024-09-12T16:16:34.900 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.900 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.900 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.900 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:34.900 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846283+0000", 2024-09-12T16:16:34.900 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3099999999999998e-07 2024-09-12T16:16:34.900 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.900 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.900 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:34.901 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846285+0000", 2024-09-12T16:16:34.901 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0930000000000001e-06 2024-09-12T16:16:34.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.901 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.901 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:34.901 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846291+0000", 2024-09-12T16:16:34.901 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7869999999999998e-06 2024-09-12T16:16:34.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.901 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.901 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.901 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846296+0000", 2024-09-12T16:16:34.901 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9010000000000002e-06 2024-09-12T16:16:34.901 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.901 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:34.901 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.902 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.902 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:1231 3.d 3.4838c32d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-12T16:16:34.902 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:34.846303+0000", 2024-09-12T16:16:34.902 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0037320919999999998, 2024-09-12T16:16:34.902 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0045557949999999996, 2024-09-12T16:16:34.902 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:34.902 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:34.902 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:34.902 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:34.902 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:34.902 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:34.902 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1231 2024-09-12T16:16:34.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.902 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:34.903 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.903 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:34.903 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846303+0000", 2024-09-12T16:16:34.903 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.903 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.903 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.903 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:34.903 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846303+0000", 2024-09-12T16:16:34.903 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.903 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.903 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.904 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:34.904 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846304+0000", 2024-09-12T16:16:34.904 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.32e-07 2024-09-12T16:16:34.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.904 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.904 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:34.904 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846306+0000", 2024-09-12T16:16:34.904 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0169999999999999e-06 2024-09-12T16:16:34.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.904 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.904 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:34.904 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846312+0000", 2024-09-12T16:16:34.904 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.144e-06 2024-09-12T16:16:34.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.905 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.905 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.905 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846318+0000", 2024-09-12T16:16:34.905 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7279999999999998e-06 2024-09-12T16:16:34.905 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.905 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:34.905 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.905 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.905 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.905 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:1232 3.d 3.4838c32d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-12T16:16:34.905 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:34.846530+0000", 2024-09-12T16:16:34.905 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.003505205, 2024-09-12T16:16:34.905 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004364489, 2024-09-12T16:16:34.906 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:34.906 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:34.906 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:34.906 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:34.906 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:34.906 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:34.906 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1232 2024-09-12T16:16:34.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.906 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:34.906 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.906 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:34.906 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846530+0000", 2024-09-12T16:16:34.906 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.907 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.907 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.907 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:34.907 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846530+0000", 2024-09-12T16:16:34.907 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.907 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.907 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.907 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:34.907 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846531+0000", 2024-09-12T16:16:34.907 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6000000000000003e-07 2024-09-12T16:16:34.907 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.907 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.907 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:34.908 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846624+0000", 2024-09-12T16:16:34.908 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3645000000000002e-05 2024-09-12T16:16:34.908 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.908 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.908 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:34.908 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846633+0000", 2024-09-12T16:16:34.908 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8279999999999992e-06 2024-09-12T16:16:34.908 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.908 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.908 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.908 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846639+0000", 2024-09-12T16:16:34.908 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7699999999999998e-06 2024-09-12T16:16:34.909 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.909 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:34.909 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.909 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.909 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.909 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:1089 3.d 3:b04b67ff:::rbd_data.1155e1e6c0d8.0000000000000001:d [read 1032192~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-12T16:16:34.909 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:34.844843+0000", 2024-09-12T16:16:34.909 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0051925349999999999, 2024-09-12T16:16:34.909 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0060805829999999996, 2024-09-12T16:16:34.909 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:34.909 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:34.909 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "reached pg", 2024-09-12T16:16:34.909 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:34.909 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:34.910 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:34.910 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1089 2024-09-12T16:16:34.910 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.910 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:34.910 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.910 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:34.910 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.844843+0000", 2024-09-12T16:16:34.910 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.910 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.910 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.910 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:34.910 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.844843+0000", 2024-09-12T16:16:34.910 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.910 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.910 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.911 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:34.911 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.844843+0000", 2024-09-12T16:16:34.911 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7199999999999999e-07 2024-09-12T16:16:34.911 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.911 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.911 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:34.911 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.844845+0000", 2024-09-12T16:16:34.911 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3590000000000002e-06 2024-09-12T16:16:34.911 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.911 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.911 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:34.911 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.844853+0000", 2024-09-12T16:16:34.911 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3289999999999996e-06 2024-09-12T16:16:34.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.912 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.912 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.912 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.844860+0000", 2024-09-12T16:16:34.912 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0890000000000002e-06 2024-09-12T16:16:34.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.912 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.912 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:34.912 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.850868+0000", 2024-09-12T16:16:34.912 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0060084200000000004 2024-09-12T16:16:34.912 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.912 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:34.912 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.913 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.913 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.913 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:1233 3.d 3.4838c32d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-12T16:16:34.913 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:34.846650+0000", 2024-09-12T16:16:34.913 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.003384836, 2024-09-12T16:16:34.913 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0043102319999999998, 2024-09-12T16:16:34.913 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:34.913 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:34.913 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:34.913 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:34.913 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:34.914 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:34.914 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1233 2024-09-12T16:16:34.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.914 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:34.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.914 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:34.914 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846650+0000", 2024-09-12T16:16:34.914 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.914 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:34.914 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846650+0000", 2024-09-12T16:16:34.914 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.915 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:34.915 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846651+0000", 2024-09-12T16:16:34.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.68e-07 2024-09-12T16:16:34.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.915 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:34.915 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846654+0000", 2024-09-12T16:16:34.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7630000000000001e-06 2024-09-12T16:16:34.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.915 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:34.915 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846662+0000", 2024-09-12T16:16:34.916 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3329999999999997e-06 2024-09-12T16:16:34.916 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.916 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.916 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.916 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846668+0000", 2024-09-12T16:16:34.916 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5929999999999996e-06 2024-09-12T16:16:34.916 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.916 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:34.916 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.916 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.916 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.916 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:1090 3.d 3.ffe6d20d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-12T16:16:34.917 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:34.844868+0000", 2024-09-12T16:16:34.917 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0051670120000000003, 2024-09-12T16:16:34.917 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0061312559999999999, 2024-09-12T16:16:34.917 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:34.917 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:34.917 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:34.917 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:34.920 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:34.921 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:34.921 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1090 2024-09-12T16:16:34.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.921 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:34.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:34.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.844868+0000", 2024-09-12T16:16:34.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:34.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.844868+0000", 2024-09-12T16:16:34.922 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.922 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.922 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.922 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:34.922 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.844869+0000", 2024-09-12T16:16:34.922 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7800000000000002e-07 2024-09-12T16:16:34.922 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.922 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.922 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:34.922 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.844871+0000", 2024-09-12T16:16:34.922 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0719999999999998e-06 2024-09-12T16:16:34.922 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.923 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.923 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:34.923 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.844880+0000", 2024-09-12T16:16:34.923 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4280000000000002e-06 2024-09-12T16:16:34.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.923 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.923 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.923 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.844886+0000", 2024-09-12T16:16:34.923 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7309999999999998e-06 2024-09-12T16:16:34.923 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.923 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:34.923 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.923 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.924 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:1234 3.d 3.4838c32d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-12T16:16:34.924 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:34.846676+0000", 2024-09-12T16:16:34.924 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0033596210000000001, 2024-09-12T16:16:34.924 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0043496749999999999, 2024-09-12T16:16:34.924 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:34.924 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:34.924 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:34.924 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:34.924 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:34.924 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:34.924 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1234 2024-09-12T16:16:34.924 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.925 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:34.925 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.925 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:34.925 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846676+0000", 2024-09-12T16:16:34.925 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.925 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.925 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:34.925 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846676+0000", 2024-09-12T16:16:34.925 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.925 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.925 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:34.925 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846676+0000", 2024-09-12T16:16:34.926 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.03e-07 2024-09-12T16:16:34.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.926 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.926 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:34.926 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846678+0000", 2024-09-12T16:16:34.926 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.148e-06 2024-09-12T16:16:34.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.926 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.926 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:34.926 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846685+0000", 2024-09-12T16:16:34.926 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4339999999999997e-06 2024-09-12T16:16:34.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.926 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.927 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.927 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846690+0000", 2024-09-12T16:16:34.927 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9599999999999999e-06 2024-09-12T16:16:34.927 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.927 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:34.927 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.927 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.927 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:1091 3.d 3.ffe6d20d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-12T16:16:34.927 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:34.844895+0000", 2024-09-12T16:16:34.927 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0051404789999999999, 2024-09-12T16:16:34.927 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0061559780000000003, 2024-09-12T16:16:34.927 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:34.927 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:34.927 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:34.928 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:34.928 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:34.928 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:34.928 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1091 2024-09-12T16:16:34.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.928 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:34.928 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.928 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:34.928 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.844895+0000", 2024-09-12T16:16:34.928 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.928 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.928 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:34.928 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.844895+0000", 2024-09-12T16:16:34.928 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.929 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.929 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.929 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:34.929 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.844895+0000", 2024-09-12T16:16:34.929 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2899999999999999e-07 2024-09-12T16:16:34.929 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.929 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.929 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:34.929 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.844897+0000", 2024-09-12T16:16:34.929 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2840000000000001e-06 2024-09-12T16:16:34.929 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.929 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.929 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:34.929 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.844905+0000", 2024-09-12T16:16:34.929 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.605e-06 2024-09-12T16:16:34.929 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.930 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.930 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.930 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.844911+0000", 2024-09-12T16:16:34.930 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5090000000000001e-06 2024-09-12T16:16:34.930 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.930 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:34.930 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.930 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.930 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.930 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:1235 3.d 3.4838c32d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-12T16:16:34.930 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:34.846696+0000", 2024-09-12T16:16:34.930 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0033390630000000002, 2024-09-12T16:16:34.930 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0044899529999999997, 2024-09-12T16:16:34.931 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:34.931 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:34.931 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:34.931 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:34.931 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:34.931 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:34.931 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1235 2024-09-12T16:16:34.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.931 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:34.931 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.931 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:34.931 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846696+0000", 2024-09-12T16:16:34.932 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.932 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.932 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:34.932 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846696+0000", 2024-09-12T16:16:34.932 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.932 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.932 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:34.932 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846696+0000", 2024-09-12T16:16:34.932 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7e-07 2024-09-12T16:16:34.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.932 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.933 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:34.933 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846698+0000", 2024-09-12T16:16:34.933 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9530000000000002e-06 2024-09-12T16:16:34.933 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.933 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.933 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:34.933 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846706+0000", 2024-09-12T16:16:34.933 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8369999999999997e-06 2024-09-12T16:16:34.933 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.933 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.933 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.933 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846712+0000", 2024-09-12T16:16:34.934 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7799999999999997e-06 2024-09-12T16:16:34.934 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.934 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:34.934 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.934 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.934 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.934 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:1092 3.d 3.ffe6d20d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-12T16:16:34.934 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:34.844927+0000", 2024-09-12T16:16:34.934 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0051081939999999999, 2024-09-12T16:16:34.934 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0062846999999999998, 2024-09-12T16:16:34.934 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:34.934 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:34.934 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:34.935 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:34.935 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:34.935 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:34.935 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1092 2024-09-12T16:16:34.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.935 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:34.935 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.935 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:34.935 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.844927+0000", 2024-09-12T16:16:34.935 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.935 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.935 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:34.935 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.844927+0000", 2024-09-12T16:16:34.936 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.936 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.936 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.936 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:34.936 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.844928+0000", 2024-09-12T16:16:34.936 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5700000000000002e-07 2024-09-12T16:16:34.936 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.936 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.936 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:34.936 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.844930+0000", 2024-09-12T16:16:34.936 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9359999999999999e-06 2024-09-12T16:16:34.936 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.936 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.936 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:34.936 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.844942+0000", 2024-09-12T16:16:34.937 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1508000000000001e-05 2024-09-12T16:16:34.937 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.937 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.937 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.937 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.844950+0000", 2024-09-12T16:16:34.937 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5399999999999998e-06 2024-09-12T16:16:34.937 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.937 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:34.937 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.937 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.937 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.937 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:1236 3.d 3.4838c32d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-12T16:16:34.937 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:34.846719+0000", 2024-09-12T16:16:34.938 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.003316098, 2024-09-12T16:16:34.938 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0045232570000000001, 2024-09-12T16:16:34.938 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:34.938 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:34.938 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:34.938 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:34.938 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:34.938 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:34.938 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1236 2024-09-12T16:16:34.938 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.938 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:34.938 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.938 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:34.939 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846719+0000", 2024-09-12T16:16:34.939 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.939 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.939 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.939 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:34.939 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846719+0000", 2024-09-12T16:16:34.939 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.939 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.939 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.939 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:34.939 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846719+0000", 2024-09-12T16:16:34.939 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.46e-07 2024-09-12T16:16:34.939 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.940 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.940 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:34.940 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846721+0000", 2024-09-12T16:16:34.940 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9819999999999998e-06 2024-09-12T16:16:34.940 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.940 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.940 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:34.940 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846728+0000", 2024-09-12T16:16:34.940 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2779999999999999e-06 2024-09-12T16:16:34.940 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.940 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.940 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.940 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846733+0000", 2024-09-12T16:16:34.941 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8550000000000001e-06 2024-09-12T16:16:34.941 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.941 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:34.941 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.941 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.941 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.941 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:1093 3.d 3.ffe6d20d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-12T16:16:34.941 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:34.844986+0000", 2024-09-12T16:16:34.941 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0050492719999999996, 2024-09-12T16:16:34.941 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0062918690000000003, 2024-09-12T16:16:34.941 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:34.941 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:34.941 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:34.942 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:34.942 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:34.942 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:34.942 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1093 2024-09-12T16:16:34.942 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.942 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:34.942 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.942 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:34.942 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.844986+0000", 2024-09-12T16:16:34.942 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.942 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.942 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.942 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:34.942 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.844986+0000", 2024-09-12T16:16:34.943 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.943 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.943 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.943 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:34.943 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.844986+0000", 2024-09-12T16:16:34.943 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5999999999999999e-07 2024-09-12T16:16:34.943 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.943 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.943 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:34.943 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.844989+0000", 2024-09-12T16:16:34.943 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2450000000000001e-06 2024-09-12T16:16:34.943 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.943 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.943 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:34.944 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.844994+0000", 2024-09-12T16:16:34.944 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.091e-06 2024-09-12T16:16:34.944 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.944 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.944 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.944 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.844997+0000", 2024-09-12T16:16:34.944 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4800000000000001e-06 2024-09-12T16:16:34.944 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.944 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:34.944 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.944 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.944 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.944 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:1237 3.d 3.4838c32d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-12T16:16:34.944 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:34.846741+0000", 2024-09-12T16:16:34.945 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0032945019999999999, 2024-09-12T16:16:34.945 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0045611360000000004, 2024-09-12T16:16:34.945 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:34.945 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:34.945 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:34.945 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:34.945 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:34.945 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:34.945 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1237 2024-09-12T16:16:34.945 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.945 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:34.945 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.945 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:34.946 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846741+0000", 2024-09-12T16:16:34.946 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.946 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.946 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.946 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:34.946 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846741+0000", 2024-09-12T16:16:34.946 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.946 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.946 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.946 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:34.946 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846741+0000", 2024-09-12T16:16:34.946 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1899999999999998e-07 2024-09-12T16:16:34.946 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.946 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.947 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:34.947 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846743+0000", 2024-09-12T16:16:34.947 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0660000000000002e-06 2024-09-12T16:16:34.947 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.947 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.947 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:34.947 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846750+0000", 2024-09-12T16:16:34.947 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4169999999999997e-06 2024-09-12T16:16:34.947 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.947 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.947 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.947 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846755+0000", 2024-09-12T16:16:34.947 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4430000000000002e-06 2024-09-12T16:16:34.948 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.948 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:34.948 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.948 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.948 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.948 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:1094 3.d 3.ffe6d20d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-12T16:16:34.948 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:34.845002+0000", 2024-09-12T16:16:34.948 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0050327879999999998, 2024-09-12T16:16:34.948 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0063331519999999999, 2024-09-12T16:16:34.948 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:34.948 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:34.948 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:34.948 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:34.948 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:34.949 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:34.949 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1094 2024-09-12T16:16:34.949 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.949 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:34.949 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.949 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:34.949 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845002+0000", 2024-09-12T16:16:34.949 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.949 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.949 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.949 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:34.949 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845002+0000", 2024-09-12T16:16:34.949 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.949 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.950 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.950 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:34.950 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845003+0000", 2024-09-12T16:16:34.950 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0100000000000001e-07 2024-09-12T16:16:34.950 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.950 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.950 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:34.950 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845004+0000", 2024-09-12T16:16:34.950 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.209e-06 2024-09-12T16:16:34.950 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.950 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.950 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:34.950 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845007+0000", 2024-09-12T16:16:34.950 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1410000000000001e-06 2024-09-12T16:16:34.950 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.950 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.951 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.951 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845010+0000", 2024-09-12T16:16:34.951 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2780000000000002e-06 2024-09-12T16:16:34.951 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.951 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:34.951 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.951 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.951 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.951 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:1238 3.d 3.4838c32d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-12T16:16:34.951 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:34.846761+0000", 2024-09-12T16:16:34.951 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0032737399999999998, 2024-09-12T16:16:34.951 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0046150280000000002, 2024-09-12T16:16:34.951 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:34.951 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:34.952 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:34.952 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:34.952 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:34.952 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:34.952 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1238 2024-09-12T16:16:34.952 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.952 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:34.952 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.952 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:34.952 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846761+0000", 2024-09-12T16:16:34.952 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.952 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.952 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.952 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:34.952 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846761+0000", 2024-09-12T16:16:34.952 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.953 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.953 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.953 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:34.953 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846762+0000", 2024-09-12T16:16:34.953 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4200000000000001e-07 2024-09-12T16:16:34.953 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.953 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.953 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:34.953 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846764+0000", 2024-09-12T16:16:34.953 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9240000000000001e-06 2024-09-12T16:16:34.953 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.953 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.953 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:34.953 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846770+0000", 2024-09-12T16:16:34.953 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0619999999999997e-06 2024-09-12T16:16:34.954 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.954 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.954 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.954 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846776+0000", 2024-09-12T16:16:34.954 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0680000000000002e-06 2024-09-12T16:16:34.954 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.954 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:34.954 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.954 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.954 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.954 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:1095 3.d 3.ffe6d20d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-12T16:16:34.954 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:34.845014+0000", 2024-09-12T16:16:34.954 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.005021457, 2024-09-12T16:16:34.954 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0063873230000000003, 2024-09-12T16:16:34.955 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:34.955 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:34.955 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:34.955 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:34.955 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:34.955 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:34.955 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1095 2024-09-12T16:16:34.955 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.955 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:34.955 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.955 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:34.955 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845014+0000", 2024-09-12T16:16:34.955 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.955 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.956 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.956 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:34.956 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845014+0000", 2024-09-12T16:16:34.956 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.956 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.956 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.956 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:34.956 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845014+0000", 2024-09-12T16:16:34.956 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3099999999999999e-07 2024-09-12T16:16:34.956 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.956 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.956 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:34.957 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845015+0000", 2024-09-12T16:16:34.957 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.139e-06 2024-09-12T16:16:34.957 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.957 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.957 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:34.957 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845018+0000", 2024-09-12T16:16:34.957 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1420000000000002e-06 2024-09-12T16:16:34.957 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.957 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.957 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.957 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845021+0000", 2024-09-12T16:16:34.957 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7920000000000001e-06 2024-09-12T16:16:34.957 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.958 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:34.958 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.958 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.958 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.958 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:1239 3.d 3.4838c32d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-12T16:16:34.958 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:34.846784+0000", 2024-09-12T16:16:34.958 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0032516429999999998, 2024-09-12T16:16:34.958 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004646748, 2024-09-12T16:16:34.958 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:34.958 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:34.958 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:34.958 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:34.958 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:34.958 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:34.959 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1239 2024-09-12T16:16:34.959 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.959 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:34.959 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.959 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:34.959 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846784+0000", 2024-09-12T16:16:34.959 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.959 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.959 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.959 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:34.959 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846784+0000", 2024-09-12T16:16:34.959 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.959 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.960 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.960 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:34.960 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846784+0000", 2024-09-12T16:16:34.960 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6199999999999998e-07 2024-09-12T16:16:34.960 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.960 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.960 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:34.960 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846786+0000", 2024-09-12T16:16:34.960 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2110000000000001e-06 2024-09-12T16:16:34.960 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.960 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.960 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:34.960 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846792+0000", 2024-09-12T16:16:34.960 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.19e-06 2024-09-12T16:16:34.960 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.961 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.961 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.961 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846799+0000", 2024-09-12T16:16:34.961 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.117e-06 2024-09-12T16:16:34.961 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.961 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:34.961 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.961 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.961 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.961 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:1096 3.d 3.ffe6d20d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-12T16:16:34.961 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:34.845024+0000", 2024-09-12T16:16:34.961 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0050110060000000001, 2024-09-12T16:16:34.961 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0064440590000000002, 2024-09-12T16:16:34.961 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:34.962 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:34.962 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:34.962 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:34.962 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:34.962 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:34.962 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1096 2024-09-12T16:16:34.962 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.962 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:34.962 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.962 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:34.962 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845024+0000", 2024-09-12T16:16:34.962 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.962 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.962 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.962 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:34.962 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845024+0000", 2024-09-12T16:16:34.963 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.963 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.963 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.963 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:34.963 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845024+0000", 2024-09-12T16:16:34.963 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2100000000000001e-07 2024-09-12T16:16:34.963 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.963 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.963 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:34.963 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845026+0000", 2024-09-12T16:16:34.963 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2470000000000001e-06 2024-09-12T16:16:34.963 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.963 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.963 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:34.963 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845029+0000", 2024-09-12T16:16:34.964 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.971e-06 2024-09-12T16:16:34.964 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.964 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.964 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.964 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845031+0000", 2024-09-12T16:16:34.964 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.463e-06 2024-09-12T16:16:34.964 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.964 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:34.964 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.964 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.964 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.964 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:1240 3.d 3.4838c32d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-12T16:16:34.964 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:34.846812+0000", 2024-09-12T16:16:34.965 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.003222955, 2024-09-12T16:16:34.965 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004680076, 2024-09-12T16:16:34.965 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:34.965 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:34.965 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:34.965 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:34.965 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:34.965 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:34.965 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1240 2024-09-12T16:16:34.965 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.965 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:34.965 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.965 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:34.965 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846812+0000", 2024-09-12T16:16:34.965 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.965 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.966 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.966 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:34.966 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846812+0000", 2024-09-12T16:16:34.966 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.966 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.966 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.966 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:34.966 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846813+0000", 2024-09-12T16:16:34.966 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0600000000000001e-07 2024-09-12T16:16:34.966 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.966 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.966 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:34.966 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846819+0000", 2024-09-12T16:16:34.966 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5760000000000002e-06 2024-09-12T16:16:34.966 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.967 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.967 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:34.967 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846826+0000", 2024-09-12T16:16:34.967 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9779999999999999e-06 2024-09-12T16:16:34.967 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.967 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.967 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.967 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846831+0000", 2024-09-12T16:16:34.967 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2689999999999999e-06 2024-09-12T16:16:34.967 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.967 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:34.967 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.967 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.968 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.968 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:1097 3.d 3.ffe6d20d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-12T16:16:34.968 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:34.845034+0000", 2024-09-12T16:16:34.968 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0050010549999999999, 2024-09-12T16:16:34.968 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0064940589999999999, 2024-09-12T16:16:34.968 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:34.968 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:34.968 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:34.968 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:34.968 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:34.968 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:34.968 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1097 2024-09-12T16:16:34.968 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.968 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:34.968 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.969 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:34.969 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845034+0000", 2024-09-12T16:16:34.969 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.969 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.969 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.969 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:34.969 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845034+0000", 2024-09-12T16:16:34.969 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.969 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.969 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.969 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:34.969 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845034+0000", 2024-09-12T16:16:34.969 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0200000000000001e-07 2024-09-12T16:16:34.969 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.970 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.970 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:34.970 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845035+0000", 2024-09-12T16:16:34.970 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0669999999999999e-06 2024-09-12T16:16:34.970 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.970 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.970 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:34.970 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845038+0000", 2024-09-12T16:16:34.970 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9119999999999998e-06 2024-09-12T16:16:34.970 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.970 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.970 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.970 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.845041+0000", 2024-09-12T16:16:34.970 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3819999999999998e-06 2024-09-12T16:16:34.970 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.970 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:34.971 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.971 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.971 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.971 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:1241 3.d 3.4838c32d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-12T16:16:34.971 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:34.846840+0000", 2024-09-12T16:16:34.971 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.003195083, 2024-09-12T16:16:34.971 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047166930000000001, 2024-09-12T16:16:34.971 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:34.971 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:34.971 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:34.971 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:34.971 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:34.971 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:34.972 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1241 2024-09-12T16:16:34.972 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.972 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:34.972 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.972 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:34.972 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846840+0000", 2024-09-12T16:16:34.972 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.972 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.972 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.972 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:34.972 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846840+0000", 2024-09-12T16:16:34.972 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.972 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.973 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.973 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:34.973 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846841+0000", 2024-09-12T16:16:34.973 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.51e-07 2024-09-12T16:16:34.973 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.973 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.973 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:34.973 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846843+0000", 2024-09-12T16:16:34.973 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3180000000000001e-06 2024-09-12T16:16:34.973 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.973 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.973 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:34.973 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846849+0000", 2024-09-12T16:16:34.973 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2999999999999998e-06 2024-09-12T16:16:34.974 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.974 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.974 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.974 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846855+0000", 2024-09-12T16:16:34.974 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2519999999999999e-06 2024-09-12T16:16:34.974 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.974 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:34.974 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.974 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.974 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.974 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:1242 3.d 3.684a07ed (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-12T16:16:34.974 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:34.846861+0000", 2024-09-12T16:16:34.974 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0031739649999999999, 2024-09-12T16:16:34.974 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004765488, 2024-09-12T16:16:34.975 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:34.975 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:34.975 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:34.975 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:34.975 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:34.975 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:34.975 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1242 2024-09-12T16:16:34.975 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.975 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:34.975 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.975 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:34.975 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846861+0000", 2024-09-12T16:16:34.975 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.976 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.976 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.976 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:34.976 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846861+0000", 2024-09-12T16:16:34.976 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.976 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.976 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.976 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:34.976 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846862+0000", 2024-09-12T16:16:34.976 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6899999999999998e-07 2024-09-12T16:16:34.976 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.976 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.977 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:34.977 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846864+0000", 2024-09-12T16:16:34.977 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0310000000000001e-06 2024-09-12T16:16:34.977 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.977 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.977 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:34.977 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846870+0000", 2024-09-12T16:16:34.977 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8939999999999998e-06 2024-09-12T16:16:34.977 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.977 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.977 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.977 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846874+0000", 2024-09-12T16:16:34.977 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6800000000000001e-06 2024-09-12T16:16:34.978 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.978 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:34.978 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.978 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.978 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.978 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:1243 3.d 3.684a07ed (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-12T16:16:34.978 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:34.846881+0000", 2024-09-12T16:16:34.978 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.003154493, 2024-09-12T16:16:34.978 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047759839999999996, 2024-09-12T16:16:34.978 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:34.978 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:34.978 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:34.978 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:34.978 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:34.979 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:34.979 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1243 2024-09-12T16:16:34.979 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.979 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:34.979 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.979 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:34.979 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846881+0000", 2024-09-12T16:16:34.979 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.979 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.979 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.979 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:34.979 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846881+0000", 2024-09-12T16:16:34.979 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.979 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.980 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.980 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:34.980 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846881+0000", 2024-09-12T16:16:34.980 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9099999999999999e-07 2024-09-12T16:16:34.980 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.980 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.980 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:34.980 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846883+0000", 2024-09-12T16:16:34.980 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.21e-06 2024-09-12T16:16:34.980 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.980 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.980 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:34.980 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846891+0000", 2024-09-12T16:16:34.981 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7519999999999996e-06 2024-09-12T16:16:34.981 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.981 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.981 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.981 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846896+0000", 2024-09-12T16:16:34.981 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6940000000000003e-06 2024-09-12T16:16:34.981 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.981 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:34.981 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.981 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.981 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.981 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:1244 3.d 3.684a07ed (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-12T16:16:34.981 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:34.846903+0000", 2024-09-12T16:16:34.982 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.003132442, 2024-09-12T16:16:34.982 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047814370000000004, 2024-09-12T16:16:34.982 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:34.982 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:34.982 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:34.982 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:34.982 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:34.982 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:34.982 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1244 2024-09-12T16:16:34.982 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.982 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:34.982 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.982 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:34.982 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846903+0000", 2024-09-12T16:16:34.982 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.983 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.983 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:34.983 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846903+0000", 2024-09-12T16:16:34.983 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.983 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.983 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:34.983 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846903+0000", 2024-09-12T16:16:34.983 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9800000000000004e-07 2024-09-12T16:16:34.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.983 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.983 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:34.983 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846905+0000", 2024-09-12T16:16:34.983 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0279999999999999e-06 2024-09-12T16:16:34.984 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.984 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.984 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:34.984 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846912+0000", 2024-09-12T16:16:34.984 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.314e-06 2024-09-12T16:16:34.984 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.984 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.984 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.984 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.846916+0000", 2024-09-12T16:16:34.985 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6269999999999999e-06 2024-09-12T16:16:34.985 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.985 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:34.985 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.985 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.985 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.985 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:1248 3.a 3:50ea470b:::rbd_object_map.115511a83a30:head [call lock.assert_locked in=44b,call rbd.object_map_update in=38b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T16:16:34.985 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:34.849614+0000", 2024-09-12T16:16:34.985 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.00042164699999999998, 2024-09-12T16:16:34.985 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0021062810000000002, 2024-09-12T16:16:34.985 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:34.986 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:34.986 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:34.986 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:34.986 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:34.986 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:34.986 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1248 2024-09-12T16:16:34.986 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.986 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:34.986 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.986 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:34.986 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.849614+0000", 2024-09-12T16:16:34.986 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.986 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.986 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.987 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:34.987 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.849614+0000", 2024-09-12T16:16:34.987 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:34.987 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.987 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.987 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:34.987 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.849614+0000", 2024-09-12T16:16:34.987 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2999999999999999e-07 2024-09-12T16:16:34.987 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.987 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.987 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:34.987 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.849619+0000", 2024-09-12T16:16:34.987 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7589999999999997e-06 2024-09-12T16:16:34.987 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.988 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.988 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:34.988 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.849627+0000", 2024-09-12T16:16:34.988 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7780000000000007e-06 2024-09-12T16:16:34.988 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.988 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.988 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:34.988 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.849633+0000", 2024-09-12T16:16:34.988 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0279999999999997e-06 2024-09-12T16:16:34.988 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.988 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.988 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:34.988 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.851478+0000", 2024-09-12T16:16:34.988 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001844872 2024-09-12T16:16:34.989 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:34.989 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:34.989 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:34.989 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:34.851560+0000", 2024-09-12T16:16:34.989 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2509000000000006e-05 2024-09-12T16:16:34.989 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.989 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:34.989 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.989 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:34.989 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-12T16:16:34.989 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 38 2024-09-12T16:16:34.989 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:34.991 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:16:34.992 INFO:teuthology.orchestra.run.smithi204.stdout:2285 write 0x1cf8e00 thru 0x1cfe4c7 (0x56c8 bytes) 2024-09-12T16:16:34.992 INFO:teuthology.orchestra.run.smithi204.stdout:2288 write 0xe42fa00 thru 0xe43f07c (0xf67d bytes) 2024-09-12T16:16:34.993 INFO:teuthology.orchestra.run.smithi204.stdout:2291 read 0x8b70a00 thru 0x8b7ad4c (0xa34d bytes) 2024-09-12T16:16:34.993 INFO:teuthology.orchestra.run.smithi204.stdout:2292 write 0x7fba400 thru 0x7fc3d76 (0x9977 bytes) 2024-09-12T16:16:34.993 INFO:teuthology.orchestra.run.smithi204.stdout:2293 write 0x9f3ae00 thru 0x9f40ee2 (0x60e3 bytes) 2024-09-12T16:16:34.993 INFO:teuthology.orchestra.run.smithi204.stdout:2295 write 0x1e82200 thru 0x1e8b7bf (0x95c0 bytes) 2024-09-12T16:16:34.993 INFO:teuthology.orchestra.run.smithi204.stdout:2296 read 0xce53600 thru 0xce53bb7 (0x5b8 bytes) 2024-09-12T16:16:34.993 INFO:teuthology.orchestra.run.smithi204.stdout:2297 read 0x1396000 thru 0x139e399 (0x839a bytes) 2024-09-12T16:16:34.993 INFO:teuthology.orchestra.run.smithi204.stdout:2301 punch from 0x1bf5200 to 0x1bf8400, (0x3200 bytes) 2024-09-12T16:16:34.993 INFO:teuthology.orchestra.run.smithi204.stdout:2303 read 0xa25d800 thru 0xa265012 (0x7813 bytes) 2024-09-12T16:16:34.993 INFO:teuthology.orchestra.run.smithi204.stdout:2305 read 0xc655400 thru 0xc65dfb9 (0x8bba bytes) 2024-09-12T16:16:34.993 INFO:teuthology.orchestra.run.smithi204.stdout:2307 trunc from 0xe43f200 to 0x10d1800 2024-09-12T16:16:34.994 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:34.989+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:35.047 INFO:teuthology.orchestra.run.smithi204.stdout:2310 write 0xc22f000 thru 0xc2333e8 (0x43e9 bytes) 2024-09-12T16:16:35.047 INFO:teuthology.orchestra.run.smithi204.stdout:2311 write 0x54ba000 thru 0x54bd1e9 (0x31ea bytes) 2024-09-12T16:16:35.049 INFO:teuthology.orchestra.run.smithi204.stdout:2312 trunc from 0xc233400 to 0xe215800 2024-09-12T16:16:35.068 INFO:teuthology.orchestra.run.smithi204.stdout:2313 read 0x7020000 thru 0x7025af4 (0x5af5 bytes) 2024-09-12T16:16:35.068 INFO:teuthology.orchestra.run.smithi204.stdout:2320 write 0x844ee00 thru 0x8451285 (0x2486 bytes) 2024-09-12T16:16:35.068 INFO:teuthology.orchestra.run.smithi204.stdout:2323 write 0x5da1c00 thru 0x5da6ae0 (0x4ee1 bytes) 2024-09-12T16:16:35.085 INFO:teuthology.orchestra.run.smithi204.stdout:2324 trunc from 0xe215800 to 0x676200 2024-09-12T16:16:35.091 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:35.089+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:35.110 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2024-09-12T16:16:35.111 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:35.111 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:16:35.112 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:16:35.112 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:16:35.112 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:35.125 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:16:35.137 INFO:teuthology.orchestra.run.smithi204.stdout:2325 write 0x5c06000 thru 0x5c0c91f (0x6920 bytes) 2024-09-12T16:16:35.143 INFO:teuthology.orchestra.run.smithi204.stdout:2326 trunc from 0x5c0ca00 to 0x1454000 2024-09-12T16:16:35.164 INFO:teuthology.orchestra.run.smithi204.stdout:2331 read 0x130e800 thru 0x131bd82 (0xd583 bytes) 2024-09-12T16:16:35.178 INFO:teuthology.orchestra.run.smithi204.stdout:2334 write 0x16bce00 thru 0x16cbddf (0xefe0 bytes) 2024-09-12T16:16:35.191 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:35.189+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:35.209 INFO:teuthology.orchestra.run.smithi204.stdout:2338 write 0xd375400 thru 0xd377ea2 (0x2aa3 bytes) 2024-09-12T16:16:35.209 INFO:teuthology.orchestra.run.smithi204.stdout:2339 write 0xf8ae00 thru 0xf93977 (0x8b78 bytes) 2024-09-12T16:16:35.214 INFO:teuthology.orchestra.run.smithi204.stdout:2340 trunc from 0xd378000 to 0x8e25600 2024-09-12T16:16:35.235 INFO:teuthology.orchestra.run.smithi204.stdout:2341 read 0x3dda200 thru 0x3ddc74f (0x2550 bytes) 2024-09-12T16:16:35.241 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:35.241 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:16:35.241 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:16:35.241 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:16:35.241 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.241 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:16:35.241 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:16:35.241 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 53.475174109000001, 2024-09-12T16:16:35.241 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55645454900000002, 2024-09-12T16:16:35.242 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.242 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.242 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:35.242 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.242 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:16:35.242 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:16:35.242 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1 2024-09-12T16:16:35.242 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.242 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.242 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.242 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.242 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:16:35.242 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.242 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.243 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.243 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:16:35.243 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.243 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.243 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764440+0000", 2024-09-12T16:16:35.243 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6249999999999999e-06 2024-09-12T16:16:35.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.243 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.243 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764447+0000", 2024-09-12T16:16:35.244 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4939999999999997e-06 2024-09-12T16:16:35.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.244 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.244 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.244 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764459+0000", 2024-09-12T16:16:35.244 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1517e-05 2024-09-12T16:16:35.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.244 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.244 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.244 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764468+0000", 2024-09-12T16:16:35.244 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7690000000000002e-06 2024-09-12T16:16:35.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.244 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.244 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.244 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764539+0000", 2024-09-12T16:16:35.245 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1103e-05 2024-09-12T16:16:35.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.245 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.245 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:16:35.245 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764551+0000", 2024-09-12T16:16:35.245 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2687999999999999e-05 2024-09-12T16:16:35.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.245 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.245 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.245 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319497+0000", 2024-09-12T16:16:35.245 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55494560500000001 2024-09-12T16:16:35.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.245 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.245 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.245 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319688+0000", 2024-09-12T16:16:35.246 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019105599999999999 2024-09-12T16:16:35.246 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.246 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.246 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:16:35.246 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319842+0000", 2024-09-12T16:16:35.246 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015377699999999999 2024-09-12T16:16:35.246 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.246 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.246 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:35.246 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320473+0000", 2024-09-12T16:16:35.246 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00063117100000000003 2024-09-12T16:16:35.246 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.247 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:35.247 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320825+0000", 2024-09-12T16:16:35.247 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00035202500000000001 2024-09-12T16:16:35.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.247 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:35.247 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320867+0000", 2024-09-12T16:16:35.247 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2005000000000002e-05 2024-09-12T16:16:35.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.247 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.247 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320893+0000", 2024-09-12T16:16:35.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5714000000000001e-05 2024-09-12T16:16:35.248 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.248 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.248 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.248 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.248 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14034 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5035008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:35.248 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:16:35.248 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.718115876000001, 2024-09-12T16:16:35.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053404082999999998, 2024-09-12T16:16:35.248 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.248 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.248 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.249 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.249 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:35.249 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:35.249 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14034 2024-09-12T16:16:35.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.249 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.249 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.249 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:16:35.249 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.249 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.249 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:16:35.250 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.250 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.250 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.250 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.250 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521740+0000", 2024-09-12T16:16:35.250 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000243976 2024-09-12T16:16:35.250 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.250 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.250 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.250 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521745+0000", 2024-09-12T16:16:35.250 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1280000000000001e-06 2024-09-12T16:16:35.250 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.250 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.250 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.250 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521757+0000", 2024-09-12T16:16:35.251 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2751e-05 2024-09-12T16:16:35.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.251 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.251 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.251 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521771+0000", 2024-09-12T16:16:35.251 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3328e-05 2024-09-12T16:16:35.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.251 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.251 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.251 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574710+0000", 2024-09-12T16:16:35.251 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052939358999999998 2024-09-12T16:16:35.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.251 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.251 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.251 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574799+0000", 2024-09-12T16:16:35.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8893000000000004e-05 2024-09-12T16:16:35.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.252 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574901+0000", 2024-09-12T16:16:35.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101648 2024-09-12T16:16:35.252 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.252 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.252 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.252 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14036 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5043200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:35.252 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:16:35.252 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.717656681999999, 2024-09-12T16:16:35.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053426247000000003, 2024-09-12T16:16:35.253 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.253 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.253 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.253 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.253 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:35.253 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:35.253 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14036 2024-09-12T16:16:35.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.253 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:16:35.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.254 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.254 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:16:35.254 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.254 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.254 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.254 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.254 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522208+0000", 2024-09-12T16:16:35.254 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025195300000000002 2024-09-12T16:16:35.254 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.254 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.254 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.254 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522211+0000", 2024-09-12T16:16:35.254 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2160000000000002e-06 2024-09-12T16:16:35.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.255 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.255 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522223+0000", 2024-09-12T16:16:35.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2044e-05 2024-09-12T16:16:35.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.255 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.255 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522229+0000", 2024-09-12T16:16:35.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8850000000000004e-06 2024-09-12T16:16:35.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.255 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.255 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575192+0000", 2024-09-12T16:16:35.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052963573 2024-09-12T16:16:35.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.256 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.256 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575282+0000", 2024-09-12T16:16:35.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9666000000000005e-05 2024-09-12T16:16:35.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.256 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.256 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575382+0000", 2024-09-12T16:16:35.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9909999999999997e-05 2024-09-12T16:16:35.256 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.256 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.256 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.257 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14037 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5047296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:35.257 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522245+0000", 2024-09-12T16:16:35.257 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.717367847, 2024-09-12T16:16:35.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053384907000000002, 2024-09-12T16:16:35.257 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.257 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.257 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.257 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.257 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:35.257 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:35.257 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14037 2024-09-12T16:16:35.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.257 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.258 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522245+0000", 2024-09-12T16:16:35.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.258 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522245+0000", 2024-09-12T16:16:35.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.258 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522471+0000", 2024-09-12T16:16:35.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022601300000000001 2024-09-12T16:16:35.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.259 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.259 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522474+0000", 2024-09-12T16:16:35.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3390000000000001e-06 2024-09-12T16:16:35.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.259 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.259 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522482+0000", 2024-09-12T16:16:35.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7919999999999993e-06 2024-09-12T16:16:35.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.259 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.259 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522486+0000", 2024-09-12T16:16:35.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5109999999999997e-06 2024-09-12T16:16:35.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.260 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.260 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575433+0000", 2024-09-12T16:16:35.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052946673999999999 2024-09-12T16:16:35.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.260 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.260 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575532+0000", 2024-09-12T16:16:35.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9128000000000004e-05 2024-09-12T16:16:35.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.260 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.260 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575629+0000", 2024-09-12T16:16:35.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7449999999999997e-05 2024-09-12T16:16:35.261 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.261 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.261 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.261 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14038 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5051392~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:35.261 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:16:35.261 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.717118309, 2024-09-12T16:16:35.261 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053395152000000001, 2024-09-12T16:16:35.261 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.261 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.261 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.261 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.261 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:35.262 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:35.262 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14038 2024-09-12T16:16:35.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.262 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:16:35.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:16:35.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.263 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522601+0000", 2024-09-12T16:16:35.263 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010702899999999999 2024-09-12T16:16:35.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.263 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.263 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.263 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522605+0000", 2024-09-12T16:16:35.263 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2379999999999999e-06 2024-09-12T16:16:35.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.263 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.263 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.263 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522616+0000", 2024-09-12T16:16:35.263 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1185999999999999e-05 2024-09-12T16:16:35.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.263 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.263 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.263 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522624+0000", 2024-09-12T16:16:35.264 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1099999999999997e-06 2024-09-12T16:16:35.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.264 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.264 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575677+0000", 2024-09-12T16:16:35.264 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053126999999999 2024-09-12T16:16:35.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.264 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.264 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575764+0000", 2024-09-12T16:16:35.264 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7250000000000007e-05 2024-09-12T16:16:35.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.264 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.264 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575889+0000", 2024-09-12T16:16:35.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012521200000000001 2024-09-12T16:16:35.265 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.265 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.265 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.265 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14039 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5055488~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:35.265 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:16:35.265 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.716976898, 2024-09-12T16:16:35.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053466207000000002, 2024-09-12T16:16:35.265 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.265 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.265 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.265 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.266 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:35.266 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:35.266 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14039 2024-09-12T16:16:35.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.266 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:16:35.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:16:35.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.267 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.267 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522899+0000", 2024-09-12T16:16:35.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026318199999999999 2024-09-12T16:16:35.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.267 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.267 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522903+0000", 2024-09-12T16:16:35.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.929e-06 2024-09-12T16:16:35.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.267 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.267 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522913+0000", 2024-09-12T16:16:35.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0162e-05 2024-09-12T16:16:35.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.268 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.268 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.268 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522921+0000", 2024-09-12T16:16:35.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.14e-06 2024-09-12T16:16:35.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.268 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.268 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.268 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575922+0000", 2024-09-12T16:16:35.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053000712999999998 2024-09-12T16:16:35.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.268 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.268 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.269 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576006+0000", 2024-09-12T16:16:35.269 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4161999999999998e-05 2024-09-12T16:16:35.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.269 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.269 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.269 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576102+0000", 2024-09-12T16:16:35.269 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5919000000000001e-05 2024-09-12T16:16:35.269 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.269 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.269 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.269 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.269 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14040 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5059584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:35.270 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:16:35.270 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.716672002999999, 2024-09-12T16:16:35.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053413258999999998, 2024-09-12T16:16:35.270 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.270 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.270 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.270 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.270 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:35.270 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:35.270 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14040 2024-09-12T16:16:35.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.270 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.270 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.270 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:16:35.271 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.271 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.271 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:16:35.271 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.271 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.271 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523059+0000", 2024-09-12T16:16:35.271 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118466 2024-09-12T16:16:35.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.271 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.271 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523062+0000", 2024-09-12T16:16:35.272 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.971e-06 2024-09-12T16:16:35.272 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.272 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.272 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.272 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523069+0000", 2024-09-12T16:16:35.272 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8279999999999997e-06 2024-09-12T16:16:35.272 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.272 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.272 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.272 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523073+0000", 2024-09-12T16:16:35.272 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3019999999999996e-06 2024-09-12T16:16:35.272 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.272 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.273 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.273 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576155+0000", 2024-09-12T16:16:35.273 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053081962000000003 2024-09-12T16:16:35.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.273 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.273 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576249+0000", 2024-09-12T16:16:35.273 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3914999999999998e-05 2024-09-12T16:16:35.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.273 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.273 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576354+0000", 2024-09-12T16:16:35.273 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010481500000000001 2024-09-12T16:16:35.273 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.273 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.274 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.274 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.274 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.274 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14041 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5063680~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:35.274 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:16:35.274 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.716521697999999, 2024-09-12T16:16:35.274 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053519111000000001, 2024-09-12T16:16:35.274 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.274 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.274 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.274 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.274 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:35.274 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:35.275 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14041 2024-09-12T16:16:35.275 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.275 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.275 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.275 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.275 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:16:35.275 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.275 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.275 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.275 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.275 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:16:35.275 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.275 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.275 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.275 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.276 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523309+0000", 2024-09-12T16:16:35.276 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000218712 2024-09-12T16:16:35.276 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.276 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.276 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.276 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523313+0000", 2024-09-12T16:16:35.276 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.151e-06 2024-09-12T16:16:35.276 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.276 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.276 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.276 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523320+0000", 2024-09-12T16:16:35.276 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9789999999999993e-06 2024-09-12T16:16:35.276 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.276 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.277 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.277 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523325+0000", 2024-09-12T16:16:35.277 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:16:35.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.277 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.277 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.277 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576402+0000", 2024-09-12T16:16:35.277 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053076811000000002 2024-09-12T16:16:35.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.277 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.277 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.277 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576491+0000", 2024-09-12T16:16:35.277 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8578999999999993e-05 2024-09-12T16:16:35.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.278 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.278 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.278 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576610+0000", 2024-09-12T16:16:35.278 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119129 2024-09-12T16:16:35.278 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.278 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.278 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.278 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.278 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.278 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14042 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5067776~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:35.278 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:16:35.278 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.716278264, 2024-09-12T16:16:35.278 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053510350999999998, 2024-09-12T16:16:35.279 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.279 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.279 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.279 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.279 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:35.279 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:35.279 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14042 2024-09-12T16:16:35.279 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.279 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.279 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.279 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.279 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:16:35.279 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.279 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.280 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.280 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.280 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:16:35.280 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.280 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.280 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.280 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.280 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523591+0000", 2024-09-12T16:16:35.280 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025710300000000001 2024-09-12T16:16:35.280 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.280 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.280 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.280 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523594+0000", 2024-09-12T16:16:35.280 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2229999999999999e-06 2024-09-12T16:16:35.281 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.281 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.281 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.281 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523602+0000", 2024-09-12T16:16:35.281 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6930000000000007e-06 2024-09-12T16:16:35.281 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.281 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.281 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.281 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523607+0000", 2024-09-12T16:16:35.281 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4789999999999998e-06 2024-09-12T16:16:35.281 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.282 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.282 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.282 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576661+0000", 2024-09-12T16:16:35.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053973999999997 2024-09-12T16:16:35.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.282 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.282 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.282 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576745+0000", 2024-09-12T16:16:35.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4660000000000006e-05 2024-09-12T16:16:35.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.282 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.282 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.282 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576844+0000", 2024-09-12T16:16:35.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9219e-05 2024-09-12T16:16:35.283 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.283 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.283 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.283 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.283 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14043 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5071872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:35.283 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:16:35.283 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.715997785000001, 2024-09-12T16:16:35.283 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053475295999999999, 2024-09-12T16:16:35.283 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.283 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.283 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.283 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.284 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:35.284 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:35.284 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14043 2024-09-12T16:16:35.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.284 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.284 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.284 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.284 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:16:35.284 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.284 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.284 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.284 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:16:35.284 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.285 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.285 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.285 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523823+0000", 2024-09-12T16:16:35.285 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020818900000000001 2024-09-12T16:16:35.285 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.285 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.285 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.285 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523826+0000", 2024-09-12T16:16:35.285 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.405e-06 2024-09-12T16:16:35.285 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.285 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.285 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.285 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523834+0000", 2024-09-12T16:16:35.285 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5499999999999997e-06 2024-09-12T16:16:35.285 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.286 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.286 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.286 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523838+0000", 2024-09-12T16:16:35.286 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.408e-06 2024-09-12T16:16:35.286 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.286 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.286 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.286 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576904+0000", 2024-09-12T16:16:35.286 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053065687 2024-09-12T16:16:35.286 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.286 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.286 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.286 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576991+0000", 2024-09-12T16:16:35.286 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7399999999999997e-05 2024-09-12T16:16:35.286 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.287 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.287 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.287 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577090+0000", 2024-09-12T16:16:35.287 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8657000000000001e-05 2024-09-12T16:16:35.287 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.287 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.287 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.287 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.287 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.287 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14044 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5075968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:35.287 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:16:35.287 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.715766255, 2024-09-12T16:16:35.287 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053442659000000003, 2024-09-12T16:16:35.287 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.288 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.288 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.288 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.288 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:35.288 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:35.288 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14044 2024-09-12T16:16:35.288 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.288 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.288 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.288 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.288 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:16:35.288 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.288 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.288 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.289 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.289 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:16:35.289 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.289 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.289 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.289 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523985+0000", 2024-09-12T16:16:35.289 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000138522 2024-09-12T16:16:35.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.289 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.289 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.289 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523988+0000", 2024-09-12T16:16:35.289 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.788e-06 2024-09-12T16:16:35.290 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.290 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.290 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.290 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523998+0000", 2024-09-12T16:16:35.290 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8470000000000008e-06 2024-09-12T16:16:35.290 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.290 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.290 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.290 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524010+0000", 2024-09-12T16:16:35.290 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1348999999999999e-05 2024-09-12T16:16:35.290 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.290 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.290 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.291 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577137+0000", 2024-09-12T16:16:35.291 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053127055999999999 2024-09-12T16:16:35.291 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.291 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.291 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.291 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577210+0000", 2024-09-12T16:16:35.291 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3392000000000005e-05 2024-09-12T16:16:35.291 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.291 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.291 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.291 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577289+0000", 2024-09-12T16:16:35.291 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8704999999999999e-05 2024-09-12T16:16:35.291 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.291 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.292 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.292 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.292 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.292 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14045 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5080064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:35.292 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:16:35.292 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.715587434, 2024-09-12T16:16:35.292 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053497514000000003, 2024-09-12T16:16:35.292 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.292 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.292 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.292 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.292 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:35.292 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:35.293 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14045 2024-09-12T16:16:35.293 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.293 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.293 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.293 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.293 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:16:35.293 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.293 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.293 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.293 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.293 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:16:35.293 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.293 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.293 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.294 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.294 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524311+0000", 2024-09-12T16:16:35.294 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028626299999999998 2024-09-12T16:16:35.294 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.294 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.294 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.294 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524315+0000", 2024-09-12T16:16:35.294 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0969999999999999e-06 2024-09-12T16:16:35.294 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.294 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.294 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.294 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524325+0000", 2024-09-12T16:16:35.294 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6330000000000008e-06 2024-09-12T16:16:35.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.295 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.295 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.295 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524332+0000", 2024-09-12T16:16:35.295 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8700000000000003e-06 2024-09-12T16:16:35.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.295 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.295 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.295 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577334+0000", 2024-09-12T16:16:35.295 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053001834999999997 2024-09-12T16:16:35.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.295 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.295 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.295 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577420+0000", 2024-09-12T16:16:35.296 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6145999999999998e-05 2024-09-12T16:16:35.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.296 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.296 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.296 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577522+0000", 2024-09-12T16:16:35.296 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010267 2024-09-12T16:16:35.296 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.296 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.296 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.296 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.296 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14047 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5088256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:35.296 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:16:35.297 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.715101708000001, 2024-09-12T16:16:35.297 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053433340000000003, 2024-09-12T16:16:35.297 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.297 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.297 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.297 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.297 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:35.297 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:35.297 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14047 2024-09-12T16:16:35.297 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.297 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.297 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.297 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.298 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:16:35.298 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.298 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.298 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.298 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:16:35.298 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.298 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.298 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.298 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524727+0000", 2024-09-12T16:16:35.298 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000216126 2024-09-12T16:16:35.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.298 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.299 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.299 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524732+0000", 2024-09-12T16:16:35.299 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1569999999999999e-06 2024-09-12T16:16:35.299 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.299 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.299 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.299 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524742+0000", 2024-09-12T16:16:35.299 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0186999999999999e-05 2024-09-12T16:16:35.299 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.299 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.299 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.299 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524750+0000", 2024-09-12T16:16:35.299 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4279999999999999e-06 2024-09-12T16:16:35.300 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.300 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.300 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.300 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577743+0000", 2024-09-12T16:16:35.300 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052993077 2024-09-12T16:16:35.300 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.300 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.300 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.300 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577841+0000", 2024-09-12T16:16:35.300 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8369000000000006e-05 2024-09-12T16:16:35.300 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.300 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.300 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.300 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577944+0000", 2024-09-12T16:16:35.301 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102996 2024-09-12T16:16:35.301 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.301 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.301 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.301 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.301 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.301 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14048 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5092352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:35.301 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:16:35.301 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.714850115000001, 2024-09-12T16:16:35.301 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053397515, 2024-09-12T16:16:35.301 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.301 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.301 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.301 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.301 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:35.302 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:35.302 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14048 2024-09-12T16:16:35.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.302 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.302 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.302 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.302 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:16:35.302 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.302 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.302 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.302 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:16:35.302 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.302 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.302 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.303 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524957+0000", 2024-09-12T16:16:35.303 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019516999999999999 2024-09-12T16:16:35.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.303 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.303 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.303 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524962+0000", 2024-09-12T16:16:35.303 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7709999999999997e-06 2024-09-12T16:16:35.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.303 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.303 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.303 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524973+0000", 2024-09-12T16:16:35.303 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1031e-05 2024-09-12T16:16:35.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.303 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.303 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.304 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524980+0000", 2024-09-12T16:16:35.304 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6100000000000002e-06 2024-09-12T16:16:35.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.304 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.304 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.304 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577977+0000", 2024-09-12T16:16:35.304 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052997481999999999 2024-09-12T16:16:35.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.304 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.304 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.304 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578062+0000", 2024-09-12T16:16:35.304 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4851000000000005e-05 2024-09-12T16:16:35.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.304 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.304 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.305 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578160+0000", 2024-09-12T16:16:35.305 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7600000000000001e-05 2024-09-12T16:16:35.305 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.305 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.305 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.305 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.305 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14049 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5096448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:35.305 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:16:35.305 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.714621487, 2024-09-12T16:16:35.305 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053439792, 2024-09-12T16:16:35.305 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.305 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.305 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.306 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.306 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:35.306 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:35.306 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14049 2024-09-12T16:16:35.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.306 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.306 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.306 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.306 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:16:35.306 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.306 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.306 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.306 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:16:35.307 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.307 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.307 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.307 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525170+0000", 2024-09-12T16:16:35.307 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017958500000000001 2024-09-12T16:16:35.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.307 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.307 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.307 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525174+0000", 2024-09-12T16:16:35.307 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0239999999999999e-06 2024-09-12T16:16:35.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.307 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.307 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.308 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525184+0000", 2024-09-12T16:16:35.308 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5950000000000005e-06 2024-09-12T16:16:35.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.308 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525191+0000", 2024-09-12T16:16:35.308 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8329999999999996e-06 2024-09-12T16:16:35.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578240+0000", 2024-09-12T16:16:35.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053049236 2024-09-12T16:16:35.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578333+0000", 2024-09-12T16:16:35.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2806999999999994e-05 2024-09-12T16:16:35.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578431+0000", 2024-09-12T16:16:35.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7712000000000002e-05 2024-09-12T16:16:35.309 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.310 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.310 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.310 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.310 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14050 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5100544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:35.310 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.525201+0000", 2024-09-12T16:16:35.311 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.714410934, 2024-09-12T16:16:35.311 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053367398000000003, 2024-09-12T16:16:35.311 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.311 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.311 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.311 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.311 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:35.311 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:35.311 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14050 2024-09-12T16:16:35.311 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.311 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.311 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.311 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.312 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525201+0000", 2024-09-12T16:16:35.312 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.312 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.312 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.312 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525201+0000", 2024-09-12T16:16:35.312 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.312 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.312 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.312 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525449+0000", 2024-09-12T16:16:35.312 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00024803999999999999 2024-09-12T16:16:35.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.313 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.313 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.313 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525453+0000", 2024-09-12T16:16:35.313 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.036e-06 2024-09-12T16:16:35.313 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.313 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.313 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.313 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525462+0000", 2024-09-12T16:16:35.313 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6090000000000001e-06 2024-09-12T16:16:35.313 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.313 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.313 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.313 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525472+0000", 2024-09-12T16:16:35.314 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9629999999999993e-06 2024-09-12T16:16:35.314 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.314 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.314 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.314 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578469+0000", 2024-09-12T16:16:35.314 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052996877999999997 2024-09-12T16:16:35.314 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.314 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.314 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.314 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578514+0000", 2024-09-12T16:16:35.314 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5460000000000002e-05 2024-09-12T16:16:35.314 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.314 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.315 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.315 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578569+0000", 2024-09-12T16:16:35.315 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4412e-05 2024-09-12T16:16:35.315 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.315 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.315 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.315 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.315 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.315 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14054 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5116928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:35.315 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.526046+0000", 2024-09-12T16:16:35.315 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.713566138000001, 2024-09-12T16:16:35.315 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053378408000000002, 2024-09-12T16:16:35.315 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.315 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.316 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.316 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.316 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:35.316 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:35.316 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14054 2024-09-12T16:16:35.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.316 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.316 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.316 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526046+0000", 2024-09-12T16:16:35.316 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.317 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526046+0000", 2024-09-12T16:16:35.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.317 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.317 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526228+0000", 2024-09-12T16:16:35.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018200200000000001 2024-09-12T16:16:35.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.317 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.317 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526236+0000", 2024-09-12T16:16:35.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5109999999999997e-06 2024-09-12T16:16:35.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.318 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.318 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526245+0000", 2024-09-12T16:16:35.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9600000000000006e-06 2024-09-12T16:16:35.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.318 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.318 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526251+0000", 2024-09-12T16:16:35.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5520000000000001e-06 2024-09-12T16:16:35.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.318 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.318 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579226+0000", 2024-09-12T16:16:35.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052974343 2024-09-12T16:16:35.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.319 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.319 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.319 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579324+0000", 2024-09-12T16:16:35.319 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8517000000000006e-05 2024-09-12T16:16:35.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.319 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.319 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.319 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579425+0000", 2024-09-12T16:16:35.319 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000100523 2024-09-12T16:16:35.319 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.319 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.319 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.319 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.319 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14055 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5121024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:35.319 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:16:35.320 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.713350796, 2024-09-12T16:16:35.320 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053399038000000003, 2024-09-12T16:16:35.320 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.320 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.320 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.320 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.320 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:35.320 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:35.320 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14055 2024-09-12T16:16:35.320 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.320 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.320 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.320 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.320 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:16:35.320 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.321 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.321 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.321 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:16:35.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.321 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.321 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.321 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526403+0000", 2024-09-12T16:16:35.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141571 2024-09-12T16:16:35.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.321 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.321 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.321 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526406+0000", 2024-09-12T16:16:35.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2660000000000002e-06 2024-09-12T16:16:35.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.322 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526420+0000", 2024-09-12T16:16:35.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3949e-05 2024-09-12T16:16:35.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.322 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526428+0000", 2024-09-12T16:16:35.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4250000000000001e-06 2024-09-12T16:16:35.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.323 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579476+0000", 2024-09-12T16:16:35.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053048349000000002 2024-09-12T16:16:35.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.323 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.323 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579563+0000", 2024-09-12T16:16:35.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6502999999999995e-05 2024-09-12T16:16:35.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.323 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.323 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579661+0000", 2024-09-12T16:16:35.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7974999999999996e-05 2024-09-12T16:16:35.323 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.323 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.324 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.324 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.324 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4806.0:3139 3.1e 3:78d5a095:::rbd_data.11552a37e55b.0000000000000000:head [read 69632~61440] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:16:35.324 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:16:35.324 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.9383565459999996, 2024-09-12T16:16:35.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057851734000000002, 2024-09-12T16:16:35.324 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.324 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.324 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.324 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.324 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4806", 2024-09-12T16:16:35.324 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3959815836", 2024-09-12T16:16:35.325 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 3139 2024-09-12T16:16:35.325 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.325 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.325 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.325 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.325 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:16:35.325 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.325 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.325 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.325 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.325 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:16:35.325 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.325 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.325 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.326 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.326 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:16:35.326 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4799999999999999e-07 2024-09-12T16:16:35.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.326 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.326 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.326 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301258+0000", 2024-09-12T16:16:35.326 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.844e-06 2024-09-12T16:16:35.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.326 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.326 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.326 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301267+0000", 2024-09-12T16:16:35.326 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2960000000000004e-06 2024-09-12T16:16:35.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.327 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.327 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.327 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301276+0000", 2024-09-12T16:16:35.327 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0650000000000005e-06 2024-09-12T16:16:35.327 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.327 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.327 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.327 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301871+0000", 2024-09-12T16:16:35.327 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00059423600000000005 2024-09-12T16:16:35.327 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.327 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.327 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.327 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301920+0000", 2024-09-12T16:16:35.328 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9067000000000003e-05 2024-09-12T16:16:35.328 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.328 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.328 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.328 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359108+0000", 2024-09-12T16:16:35.328 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057187877999999998 2024-09-12T16:16:35.328 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.328 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.328 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.328 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.328 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.328 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:6428 3.14 3:28a44e54:::rbd_header.11552a37e55b:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:16:35.328 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:16:35.328 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.9380279519999997, 2024-09-12T16:16:35.329 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057504023000000001, 2024-09-12T16:16:35.329 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.329 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.329 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.329 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.329 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:16:35.329 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:35.329 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6428 2024-09-12T16:16:35.329 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.329 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.329 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.329 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.329 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:16:35.329 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.330 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.330 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:16:35.330 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.330 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.330 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301585+0000", 2024-09-12T16:16:35.330 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6300000000000005e-07 2024-09-12T16:16:35.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.330 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.331 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301588+0000", 2024-09-12T16:16:35.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4149999999999999e-06 2024-09-12T16:16:35.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.331 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301597+0000", 2024-09-12T16:16:35.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5450000000000003e-06 2024-09-12T16:16:35.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.331 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301617+0000", 2024-09-12T16:16:35.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9837e-05 2024-09-12T16:16:35.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301779+0000", 2024-09-12T16:16:35.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016186799999999999 2024-09-12T16:16:35.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301855+0000", 2024-09-12T16:16:35.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5899e-05 2024-09-12T16:16:35.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359088+0000", 2024-09-12T16:16:35.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057233895999999999 2024-09-12T16:16:35.332 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.333 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.333 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.333 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.333 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.333 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:35.334 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:35.332+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:35.335 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:16:35.336 INFO:teuthology.orchestra.run.smithi204.stdout:2342 write 0xeabac00 thru 0xeabbdf3 (0x11f4 bytes) 2024-09-12T16:16:35.336 INFO:teuthology.orchestra.run.smithi204.stdout:2343 read 0xc6e2400 thru 0xc6e2ed2 (0xad3 bytes) 2024-09-12T16:16:35.337 INFO:teuthology.orchestra.run.smithi204.stdout:2344 trunc from 0xeabbe00 to 0xbb11400 2024-09-12T16:16:35.337 INFO:teuthology.orchestra.run.smithi204.stdout:2346 write 0x20a1600 thru 0x20a380a (0x220b bytes) 2024-09-12T16:16:35.337 INFO:teuthology.orchestra.run.smithi204.stdout:2349 write 0x9f6c600 thru 0x9f79b01 (0xd502 bytes) 2024-09-12T16:16:35.337 INFO:teuthology.orchestra.run.smithi204.stdout:2351 write 0x1863a00 thru 0x1865122 (0x1723 bytes) 2024-09-12T16:16:35.337 INFO:teuthology.orchestra.run.smithi204.stdout:2354 read 0x6a52400 thru 0x6a59243 (0x6e44 bytes) 2024-09-12T16:16:35.337 INFO:teuthology.orchestra.run.smithi204.stdout:2355 read 0x2d08400 thru 0x2d16352 (0xdf53 bytes) 2024-09-12T16:16:35.337 INFO:teuthology.orchestra.run.smithi204.stdout:2356 write 0x7102600 thru 0x7104c02 (0x2603 bytes) 2024-09-12T16:16:35.337 INFO:teuthology.orchestra.run.smithi204.stdout:2357 read 0x7c4fa00 thru 0x7c55e21 (0x6422 bytes) 2024-09-12T16:16:35.337 INFO:teuthology.orchestra.run.smithi204.stdout:2358 punch from 0x395e200 to 0x3965a00, (0x7800 bytes) 2024-09-12T16:16:35.337 INFO:teuthology.orchestra.run.smithi204.stdout:2359 write 0xb20fe00 thru 0xb215a8a (0x5c8b bytes) 2024-09-12T16:16:35.337 INFO:teuthology.orchestra.run.smithi204.stdout:2360 trunc from 0xbb11400 to 0x39bfe00 2024-09-12T16:16:35.342 INFO:teuthology.orchestra.run.smithi204.stdout:2362 write 0xd1a9c00 thru 0xd1aa135 (0x536 bytes) 2024-09-12T16:16:35.342 INFO:teuthology.orchestra.run.smithi204.stdout:2366 read 0x64a1800 thru 0x64a9905 (0x8106 bytes) 2024-09-12T16:16:35.342 INFO:teuthology.orchestra.run.smithi204.stdout:2367 read 0x7c1ca00 thru 0x7c1ca31 (0x32 bytes) 2024-09-12T16:16:35.342 INFO:teuthology.orchestra.run.smithi204.stdout:2370 punch from 0x9f19800 to 0x9f27a00, (0xe200 bytes) 2024-09-12T16:16:35.343 INFO:teuthology.orchestra.run.smithi204.stdout:2371 write 0x76d3200 thru 0x76da29f (0x70a0 bytes) 2024-09-12T16:16:35.343 INFO:teuthology.orchestra.run.smithi204.stdout:2372 write 0x42a000 thru 0x437aa6 (0xdaa7 bytes) 2024-09-12T16:16:35.343 INFO:teuthology.orchestra.run.smithi204.stdout:2373 punch from 0x24c9800 to 0x24ce800, (0x5000 bytes) 2024-09-12T16:16:35.343 INFO:teuthology.orchestra.run.smithi204.stdout:2374 read 0x16d5000 thru 0x16e2b42 (0xdb43 bytes) 2024-09-12T16:16:35.345 INFO:teuthology.orchestra.run.smithi204.stdout:2377 write 0x6aff600 thru 0x6b06b27 (0x7528 bytes) 2024-09-12T16:16:35.345 INFO:teuthology.orchestra.run.smithi204.stdout:2378 write 0x91df000 thru 0x91e4713 (0x5714 bytes) 2024-09-12T16:16:35.345 INFO:teuthology.orchestra.run.smithi204.stdout:2379 read 0x3c9f800 thru 0x3caf5a7 (0xfda8 bytes) 2024-09-12T16:16:35.346 INFO:teuthology.orchestra.run.smithi204.stdout:2381 read 0xbc1e400 thru 0xbc23e9d (0x5a9e bytes) 2024-09-12T16:16:35.346 INFO:teuthology.orchestra.run.smithi204.stdout:2387 punch from 0xa978400 to 0xa986000, (0xdc00 bytes) 2024-09-12T16:16:35.346 INFO:teuthology.orchestra.run.smithi204.stdout:2388 punch from 0x87a0600 to 0x87ad000, (0xca00 bytes) 2024-09-12T16:16:35.346 INFO:teuthology.orchestra.run.smithi204.stdout:2390 read 0x21c1e00 thru 0x21c5608 (0x3809 bytes) 2024-09-12T16:16:35.347 INFO:teuthology.orchestra.run.smithi204.stdout:2391 write 0x101be00 thru 0x1023d5e (0x7f5f bytes) 2024-09-12T16:16:35.362 INFO:teuthology.orchestra.run.smithi204.stdout:2392 trunc from 0xd1aa200 to 0x1f26e00 2024-09-12T16:16:35.388 INFO:teuthology.orchestra.run.smithi204.stdout:2393 read 0xad9e00 thru 0xadea60 (0x4c61 bytes) 2024-09-12T16:16:35.389 INFO:teuthology.orchestra.run.smithi204.stdout:2394 read 0xfa7600 thru 0xfb5f3d (0xe93e bytes) 2024-09-12T16:16:35.395 INFO:teuthology.orchestra.run.smithi204.stdout:2398 trunc from 0x1f26e00 to 0x697b200 2024-09-12T16:16:35.409 INFO:teuthology.orchestra.run.smithi204.stdout:2400 write 0x55c5600 thru 0x55d3d0a (0xe70b bytes) 2024-09-12T16:16:35.409 INFO:teuthology.orchestra.run.smithi204.stdout:2405 punch from 0x42aba00 to 0x42ada00, (0x2000 bytes) 2024-09-12T16:16:35.410 INFO:teuthology.orchestra.run.smithi204.stdout:2407 write 0x2f22a00 thru 0x2f31449 (0xea4a bytes) 2024-09-12T16:16:35.412 INFO:teuthology.orchestra.run.smithi204.stdout:2409 read 0x583ba00 thru 0x584202a (0x662b bytes) 2024-09-12T16:16:35.412 INFO:teuthology.orchestra.run.smithi204.stdout:2410 read 0x941e00 thru 0x942c1e (0xe1f bytes) 2024-09-12T16:16:35.435 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:35.433+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:35.435 INFO:teuthology.orchestra.run.smithi204.stdout:2411 write 0xc2df800 thru 0xc2e6fc7 (0x77c8 bytes) 2024-09-12T16:16:35.447 INFO:teuthology.orchestra.run.smithi204.stdout:2412 trunc from 0xc2e7000 to 0x24d2c00 2024-09-12T16:16:35.458 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:35.458 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:16:35.458 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.458 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:3607 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:head [stat out=16b,truncate 3244032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T16:16:35.459 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:35.457584+0000", 2024-09-12T16:16:35.459 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.000758813, 2024-09-12T16:16:35.459 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000782996, 2024-09-12T16:16:35.459 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.459 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.459 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.459 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.459 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:35.459 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:35.459 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 3607 2024-09-12T16:16:35.459 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.459 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.459 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.459 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.460 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:35.457584+0000", 2024-09-12T16:16:35.460 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.460 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.460 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.460 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.460 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:35.457584+0000", 2024-09-12T16:16:35.460 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.460 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.460 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.460 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.460 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:35.457584+0000", 2024-09-12T16:16:35.460 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5199999999999996e-07 2024-09-12T16:16:35.461 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.461 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.461 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.461 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:35.457588+0000", 2024-09-12T16:16:35.461 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.529e-06 2024-09-12T16:16:35.461 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.461 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.461 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.461 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:35.457597+0000", 2024-09-12T16:16:35.461 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5089999999999999e-06 2024-09-12T16:16:35.461 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.461 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.461 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.461 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:35.457607+0000", 2024-09-12T16:16:35.462 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.234e-06 2024-09-12T16:16:35.462 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.462 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.462 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.462 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:35.457658+0000", 2024-09-12T16:16:35.462 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1479e-05 2024-09-12T16:16:35.462 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.462 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.462 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.462 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:35.457709+0000", 2024-09-12T16:16:35.462 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0793e-05 2024-09-12T16:16:35.462 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.462 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.463 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.463 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.463 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.463 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4703.0:3609 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:head [stat out=16b,truncate 3222528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T16:16:35.463 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:35.457627+0000", 2024-09-12T16:16:35.463 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.00071513000000000002, 2024-09-12T16:16:35.463 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00078618799999999995, 2024-09-12T16:16:35.463 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.463 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.463 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.463 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.463 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4703", 2024-09-12T16:16:35.463 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3829298611", 2024-09-12T16:16:35.463 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 3609 2024-09-12T16:16:35.463 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.464 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.464 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.464 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.464 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:35.457627+0000", 2024-09-12T16:16:35.464 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.464 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.464 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.464 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.464 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:35.457627+0000", 2024-09-12T16:16:35.464 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.464 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.464 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.464 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.465 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:35.457628+0000", 2024-09-12T16:16:35.465 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0999999999999999e-07 2024-09-12T16:16:35.465 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.465 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.465 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.465 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:35.457634+0000", 2024-09-12T16:16:35.465 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0909999999999998e-06 2024-09-12T16:16:35.465 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.465 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.465 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.465 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:35.457642+0000", 2024-09-12T16:16:35.465 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0779999999999996e-06 2024-09-12T16:16:35.465 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.466 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.466 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.466 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:35.457650+0000", 2024-09-12T16:16:35.466 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4889999999999998e-06 2024-09-12T16:16:35.466 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.466 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.466 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.466 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:35.458223+0000", 2024-09-12T16:16:35.466 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00057299900000000003 2024-09-12T16:16:35.466 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.466 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.466 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.466 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:35.458276+0000", 2024-09-12T16:16:35.466 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3446000000000003e-05 2024-09-12T16:16:35.466 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.467 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.467 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.467 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.467 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-12T16:16:35.467 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 2 2024-09-12T16:16:35.467 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:35.469 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:16:35.476 INFO:teuthology.orchestra.run.smithi204.stdout:2416 trunc from 0x24d2c00 to 0x28de00 2024-09-12T16:16:35.492 INFO:teuthology.orchestra.run.smithi204.stdout:2417 read 0x228200 thru 0x22c898 (0x4699 bytes) 2024-09-12T16:16:35.493 INFO:teuthology.orchestra.run.smithi204.stdout:2425 read 0x39400 thru 0x48dc4 (0xf9c5 bytes) 2024-09-12T16:16:35.502 INFO:teuthology.orchestra.run.smithi204.stdout:2426 trunc from 0x28de00 to 0x7731c00 2024-09-12T16:16:35.516 INFO:teuthology.orchestra.run.smithi204.stdout:2427 punch from 0x6c50800 to 0x6c52a00, (0x2200 bytes) 2024-09-12T16:16:35.518 INFO:teuthology.orchestra.run.smithi204.stdout:2429 read 0x446e800 thru 0x447de2c (0xf62d bytes) 2024-09-12T16:16:35.518 INFO:teuthology.orchestra.run.smithi204.stdout:2431 punch from 0x1b01600 to 0x1b09000, (0x7a00 bytes) 2024-09-12T16:16:35.524 INFO:teuthology.orchestra.run.smithi204.stdout:2434 trunc from 0x7731c00 to 0x2706800 2024-09-12T16:16:35.535 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:35.533+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:35.547 INFO:teuthology.orchestra.run.smithi204.stdout:2437 punch from 0xdba200 to 0xdc3a00, (0x9800 bytes) 2024-09-12T16:16:35.573 INFO:teuthology.orchestra.run.smithi204.stdout:2439 write 0xb3ab600 thru 0xb3af01c (0x3a1d bytes) 2024-09-12T16:16:35.573 INFO:teuthology.orchestra.run.smithi204.stdout:2440 read 0x9175400 thru 0x9182eac (0xdaad bytes) 2024-09-12T16:16:35.573 INFO:teuthology.orchestra.run.smithi204.stdout:2441 read 0x8c68400 thru 0x8c6e786 (0x6387 bytes) 2024-09-12T16:16:35.573 INFO:teuthology.orchestra.run.smithi204.stdout:2442 write 0x5b1a600 thru 0x5b25dc7 (0xb7c8 bytes) 2024-09-12T16:16:35.573 INFO:teuthology.orchestra.run.smithi204.stdout:2443 read 0x5ede00 thru 0x5ef99a (0x1b9b bytes) 2024-09-12T16:16:35.574 INFO:teuthology.orchestra.run.smithi204.stdout:2445 write 0x2b16600 thru 0x2b189b0 (0x23b1 bytes) 2024-09-12T16:16:35.586 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:35.586 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:16:35.586 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:16:35.587 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:16:35.587 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:35.593 INFO:teuthology.orchestra.run.smithi204.stdout:2448 write 0xb9eb800 thru 0xb9fb46d (0xfc6e bytes) 2024-09-12T16:16:35.593 INFO:teuthology.orchestra.run.smithi204.stdout:2450 write 0x59d4a00 thru 0x59d555c (0xb5d bytes) 2024-09-12T16:16:35.594 INFO:teuthology.orchestra.run.smithi204.stdout:2451 write 0xf3800 thru 0xf7cf6 (0x44f7 bytes) 2024-09-12T16:16:35.594 INFO:teuthology.orchestra.run.smithi204.stdout:2453 write 0x2ffe000 thru 0x3006983 (0x8984 bytes) 2024-09-12T16:16:35.594 INFO:teuthology.orchestra.run.smithi204.stdout:2455 read 0xa5de00 thru 0xa6a3ce (0xc5cf bytes) 2024-09-12T16:16:35.595 INFO:teuthology.orchestra.run.smithi204.stdout:2456 punch from 0x6e6d000 to 0x6e70a00, (0x3a00 bytes) 2024-09-12T16:16:35.595 INFO:teuthology.orchestra.run.smithi204.stdout:2459 read 0xb7cb600 thru 0xb7cde17 (0x2818 bytes) 2024-09-12T16:16:35.596 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:16:35.597 INFO:teuthology.orchestra.run.smithi204.stdout:2460 read 0xa443400 thru 0xa44e2b2 (0xaeb3 bytes) 2024-09-12T16:16:35.597 INFO:teuthology.orchestra.run.smithi204.stdout:2461 clone 12 order 20 su 4096 sc 9 2024-09-12T16:16:35.636 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:35.635+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:35.706 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:35.706 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:16:35.706 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:16:35.706 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:16:35.706 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.706 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:20620 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 1482752~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:35.706 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.775875+0000", 2024-09-12T16:16:35.706 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.928861469999999, 2024-09-12T16:16:35.707 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.051720878999999997, 2024-09-12T16:16:35.707 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.707 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.707 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.707 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.707 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:35.707 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:35.707 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 20620 2024-09-12T16:16:35.707 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.707 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.708 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.708 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.708 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775875+0000", 2024-09-12T16:16:35.708 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.708 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.708 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.708 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.708 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775875+0000", 2024-09-12T16:16:35.708 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.708 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.708 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.708 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.708 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775875+0000", 2024-09-12T16:16:35.709 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0599999999999999e-07 2024-09-12T16:16:35.709 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.709 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.709 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.709 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775876+0000", 2024-09-12T16:16:35.709 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.034e-06 2024-09-12T16:16:35.709 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.709 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.709 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.709 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775879+0000", 2024-09-12T16:16:35.709 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9359999999999999e-06 2024-09-12T16:16:35.709 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.709 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.710 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.710 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775882+0000", 2024-09-12T16:16:35.710 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5270000000000001e-06 2024-09-12T16:16:35.710 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.710 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.710 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.710 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.827445+0000", 2024-09-12T16:16:35.710 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.051563377000000001 2024-09-12T16:16:35.710 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.710 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.710 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.710 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.827489+0000", 2024-09-12T16:16:35.710 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4443999999999997e-05 2024-09-12T16:16:35.711 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.711 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.711 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.711 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.827596+0000", 2024-09-12T16:16:35.711 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010635499999999999 2024-09-12T16:16:35.711 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.711 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.711 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.711 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.711 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.711 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:20621 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 1486848~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:35.711 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.775885+0000", 2024-09-12T16:16:35.711 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.928851844, 2024-09-12T16:16:35.711 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.051871970000000003, 2024-09-12T16:16:35.711 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.712 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.712 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.712 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.712 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:35.712 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:35.712 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 20621 2024-09-12T16:16:35.712 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.712 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.712 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.712 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.712 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775885+0000", 2024-09-12T16:16:35.712 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.712 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.713 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.713 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.713 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775885+0000", 2024-09-12T16:16:35.713 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.713 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.713 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.713 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.713 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775885+0000", 2024-09-12T16:16:35.713 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0100000000000001e-07 2024-09-12T16:16:35.713 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.713 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.713 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.713 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775886+0000", 2024-09-12T16:16:35.713 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1069999999999999e-06 2024-09-12T16:16:35.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.714 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.714 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.714 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775889+0000", 2024-09-12T16:16:35.714 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9380000000000001e-06 2024-09-12T16:16:35.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.714 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.714 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.714 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775891+0000", 2024-09-12T16:16:35.714 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3319999999999999e-06 2024-09-12T16:16:35.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.714 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.714 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.714 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.827613+0000", 2024-09-12T16:16:35.715 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.051721637000000001 2024-09-12T16:16:35.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.715 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.715 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.715 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.827654+0000", 2024-09-12T16:16:35.715 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1233999999999999e-05 2024-09-12T16:16:35.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.715 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.715 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.715 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.827756+0000", 2024-09-12T16:16:35.715 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102521 2024-09-12T16:16:35.715 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.715 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.715 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.716 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.716 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:20622 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 1490944~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:35.716 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.775894+0000", 2024-09-12T16:16:35.716 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.928842325, 2024-09-12T16:16:35.716 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052034955000000001, 2024-09-12T16:16:35.716 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.716 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.716 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.716 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.716 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:35.716 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:35.716 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 20622 2024-09-12T16:16:35.716 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.717 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.717 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.717 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.717 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775894+0000", 2024-09-12T16:16:35.717 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.717 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.717 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.717 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775894+0000", 2024-09-12T16:16:35.717 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.717 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.717 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.717 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775894+0000", 2024-09-12T16:16:35.718 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0599999999999999e-07 2024-09-12T16:16:35.718 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.718 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.718 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.718 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775895+0000", 2024-09-12T16:16:35.718 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.105e-06 2024-09-12T16:16:35.718 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.718 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.718 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.718 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775898+0000", 2024-09-12T16:16:35.718 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9469999999999999e-06 2024-09-12T16:16:35.718 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.718 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.719 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.719 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775901+0000", 2024-09-12T16:16:35.719 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5110000000000002e-06 2024-09-12T16:16:35.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.719 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.719 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.719 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.827783+0000", 2024-09-12T16:16:35.719 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.051882686999999997 2024-09-12T16:16:35.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.719 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.719 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.719 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.827825+0000", 2024-09-12T16:16:35.719 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1573999999999999e-05 2024-09-12T16:16:35.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.720 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.720 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.720 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.827929+0000", 2024-09-12T16:16:35.720 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010392500000000001 2024-09-12T16:16:35.720 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.720 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.720 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.720 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.720 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:20623 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 1495040~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:35.720 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.775904+0000", 2024-09-12T16:16:35.720 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.928832537, 2024-09-12T16:16:35.721 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052191906000000003, 2024-09-12T16:16:35.721 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.721 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.721 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.721 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.721 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:35.721 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:35.721 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 20623 2024-09-12T16:16:35.721 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.721 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.721 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.721 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.721 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775904+0000", 2024-09-12T16:16:35.721 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.721 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.722 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.722 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.722 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775904+0000", 2024-09-12T16:16:35.722 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.722 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.722 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.722 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775904+0000", 2024-09-12T16:16:35.722 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0900000000000001e-07 2024-09-12T16:16:35.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.722 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.722 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.722 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775905+0000", 2024-09-12T16:16:35.722 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.083e-06 2024-09-12T16:16:35.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.723 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.723 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.723 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775908+0000", 2024-09-12T16:16:35.723 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9849999999999998e-06 2024-09-12T16:16:35.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.723 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.723 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.723 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775912+0000", 2024-09-12T16:16:35.723 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9419999999999997e-06 2024-09-12T16:16:35.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.723 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.723 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.723 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.827951+0000", 2024-09-12T16:16:35.723 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052038976000000001 2024-09-12T16:16:35.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.724 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.724 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.724 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.827996+0000", 2024-09-12T16:16:35.724 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5444000000000001e-05 2024-09-12T16:16:35.724 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.724 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.724 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.724 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.828096+0000", 2024-09-12T16:16:35.724 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9266999999999997e-05 2024-09-12T16:16:35.724 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.724 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.724 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.724 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.724 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.725 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:20624 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 1499136~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:35.725 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.775916+0000", 2024-09-12T16:16:35.725 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.928820781000001, 2024-09-12T16:16:35.725 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052356906000000002, 2024-09-12T16:16:35.725 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.725 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.725 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.725 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.725 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:35.725 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:35.725 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 20624 2024-09-12T16:16:35.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.725 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.726 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.726 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.726 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775916+0000", 2024-09-12T16:16:35.726 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.726 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.726 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.726 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.726 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.775916+0000", 2024-09-12T16:16:35.726 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.726 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.726 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.726 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.726 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.781366+0000", 2024-09-12T16:16:35.727 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0054508339999999999 2024-09-12T16:16:35.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.727 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.781372+0000", 2024-09-12T16:16:35.727 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6980000000000003e-06 2024-09-12T16:16:35.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.727 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.781382+0000", 2024-09-12T16:16:35.727 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6490000000000003e-06 2024-09-12T16:16:35.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.728 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.728 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.781386+0000", 2024-09-12T16:16:35.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4039999999999997e-06 2024-09-12T16:16:35.728 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.728 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.728 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.728 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.828122+0000", 2024-09-12T16:16:35.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.046736236 2024-09-12T16:16:35.728 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.728 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.728 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.728 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.828164+0000", 2024-09-12T16:16:35.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1567999999999999e-05 2024-09-12T16:16:35.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.729 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.729 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.729 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.828272+0000", 2024-09-12T16:16:35.729 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000108517 2024-09-12T16:16:35.729 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.729 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.729 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.729 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.729 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:20653 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 1617920~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:35.729 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.781724+0000", 2024-09-12T16:16:35.729 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.923011927999999, 2024-09-12T16:16:35.729 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.051816203999999998, 2024-09-12T16:16:35.730 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.730 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.730 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.730 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.730 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:35.730 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:35.730 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 20653 2024-09-12T16:16:35.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.730 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.730 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.730 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.781724+0000", 2024-09-12T16:16:35.730 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.731 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.731 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.781724+0000", 2024-09-12T16:16:35.731 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.731 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.731 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.781725+0000", 2024-09-12T16:16:35.731 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0599999999999999e-07 2024-09-12T16:16:35.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.731 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.731 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.781726+0000", 2024-09-12T16:16:35.731 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.569999999999999e-07 2024-09-12T16:16:35.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.781729+0000", 2024-09-12T16:16:35.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9289999999999998e-06 2024-09-12T16:16:35.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.781731+0000", 2024-09-12T16:16:35.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3530000000000002e-06 2024-09-12T16:16:35.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.833393+0000", 2024-09-12T16:16:35.733 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.051662176999999997 2024-09-12T16:16:35.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.733 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.733 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.733 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.833434+0000", 2024-09-12T16:16:35.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1403000000000003e-05 2024-09-12T16:16:35.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.736 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.736 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.737 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.833541+0000", 2024-09-12T16:16:35.737 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000106179 2024-09-12T16:16:35.737 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.737 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.737 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.737 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.737 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.737 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:20654 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 1622016~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:35.737 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.781737+0000", 2024-09-12T16:16:35.737 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.922999688999999, 2024-09-12T16:16:35.737 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.05198059, 2024-09-12T16:16:35.737 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.737 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.737 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.737 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.738 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:35.738 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:35.738 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 20654 2024-09-12T16:16:35.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.738 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.738 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.738 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.738 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.781737+0000", 2024-09-12T16:16:35.738 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.738 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.738 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.738 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.781737+0000", 2024-09-12T16:16:35.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.787347+0000", 2024-09-12T16:16:35.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0056106510000000004 2024-09-12T16:16:35.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.787350+0000", 2024-09-12T16:16:35.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0350000000000002e-06 2024-09-12T16:16:35.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.787357+0000", 2024-09-12T16:16:35.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1920000000000002e-06 2024-09-12T16:16:35.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.740 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.740 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.740 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.787360+0000", 2024-09-12T16:16:35.740 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8589999999999998e-06 2024-09-12T16:16:35.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.740 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.740 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.740 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.833566+0000", 2024-09-12T16:16:35.740 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.046205952000000002 2024-09-12T16:16:35.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.740 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.740 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.740 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.833611+0000", 2024-09-12T16:16:35.740 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5036e-05 2024-09-12T16:16:35.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.741 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.741 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.741 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.833717+0000", 2024-09-12T16:16:35.741 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000105865 2024-09-12T16:16:35.741 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.741 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.741 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.741 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.741 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:21541 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 2075648~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:35.741 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.979289+0000", 2024-09-12T16:16:35.741 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.725447154999999, 2024-09-12T16:16:35.741 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.051802583999999999, 2024-09-12T16:16:35.742 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.742 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.742 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.742 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.742 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:35.742 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:35.742 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 21541 2024-09-12T16:16:35.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.742 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.742 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.742 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979289+0000", 2024-09-12T16:16:35.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979289+0000", 2024-09-12T16:16:35.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.743 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979290+0000", 2024-09-12T16:16:35.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.99e-07 2024-09-12T16:16:35.743 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979296+0000", 2024-09-12T16:16:35.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2729999999999999e-06 2024-09-12T16:16:35.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.744 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.744 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979305+0000", 2024-09-12T16:16:35.744 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0270000000000001e-06 2024-09-12T16:16:35.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.744 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.744 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979311+0000", 2024-09-12T16:16:35.744 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8610000000000003e-06 2024-09-12T16:16:35.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.744 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.744 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.030931+0000", 2024-09-12T16:16:35.745 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.051619736999999999 2024-09-12T16:16:35.745 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.745 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.745 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.745 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.030980+0000", 2024-09-12T16:16:35.745 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9599999999999999e-05 2024-09-12T16:16:35.745 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.745 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.745 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.745 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031092+0000", 2024-09-12T16:16:35.745 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000111487 2024-09-12T16:16:35.745 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.745 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.745 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.746 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.746 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:21542 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 2079744~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:35.746 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.979322+0000", 2024-09-12T16:16:35.746 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.725414604999999, 2024-09-12T16:16:35.746 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052007360000000002, 2024-09-12T16:16:35.746 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.746 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.746 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.746 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.746 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:35.746 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:35.746 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 21542 2024-09-12T16:16:35.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.747 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.747 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979322+0000", 2024-09-12T16:16:35.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.747 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979322+0000", 2024-09-12T16:16:35.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.748 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979322+0000", 2024-09-12T16:16:35.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1099999999999995e-07 2024-09-12T16:16:35.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.748 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.748 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979325+0000", 2024-09-12T16:16:35.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1349999999999999e-06 2024-09-12T16:16:35.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.748 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.748 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979331+0000", 2024-09-12T16:16:35.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7220000000000002e-06 2024-09-12T16:16:35.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.749 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979338+0000", 2024-09-12T16:16:35.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5230000000000001e-06 2024-09-12T16:16:35.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.749 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.749 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031124+0000", 2024-09-12T16:16:35.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.051786302999999999 2024-09-12T16:16:35.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.749 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.749 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031166+0000", 2024-09-12T16:16:35.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2287999999999999e-05 2024-09-12T16:16:35.750 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.750 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.750 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.750 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031329+0000", 2024-09-12T16:16:35.750 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016277800000000001 2024-09-12T16:16:35.750 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.750 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.750 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.750 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.750 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.750 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:21543 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 2083840~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:35.750 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.979347+0000", 2024-09-12T16:16:35.750 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.725389716, 2024-09-12T16:16:35.750 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052189063000000001, 2024-09-12T16:16:35.751 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.751 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.751 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.751 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.751 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:35.751 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:35.751 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 21543 2024-09-12T16:16:35.751 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.751 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.751 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.751 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.751 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979347+0000", 2024-09-12T16:16:35.751 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.752 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.752 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.752 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979347+0000", 2024-09-12T16:16:35.752 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.752 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.752 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.752 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979347+0000", 2024-09-12T16:16:35.752 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:16:35.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.752 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.752 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.752 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979349+0000", 2024-09-12T16:16:35.753 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.12e-06 2024-09-12T16:16:35.753 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.753 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.753 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.753 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979356+0000", 2024-09-12T16:16:35.753 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6279999999999999e-06 2024-09-12T16:16:35.753 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.753 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.753 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.753 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979361+0000", 2024-09-12T16:16:35.753 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8210000000000001e-06 2024-09-12T16:16:35.753 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.753 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.754 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.754 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031363+0000", 2024-09-12T16:16:35.754 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052002233000000002 2024-09-12T16:16:35.754 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.754 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.754 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.754 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031414+0000", 2024-09-12T16:16:35.754 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1289000000000003e-05 2024-09-12T16:16:35.754 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.754 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.754 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.754 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031536+0000", 2024-09-12T16:16:35.754 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000121582 2024-09-12T16:16:35.755 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.755 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.755 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.755 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.755 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:21544 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 2087936~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:35.755 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.979368+0000", 2024-09-12T16:16:35.755 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.725368737, 2024-09-12T16:16:35.755 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052342535000000003, 2024-09-12T16:16:35.755 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.755 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.755 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.756 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.756 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:35.756 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:35.756 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 21544 2024-09-12T16:16:35.756 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.756 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.757 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.757 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.757 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979368+0000", 2024-09-12T16:16:35.757 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.757 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.757 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.757 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979368+0000", 2024-09-12T16:16:35.757 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.757 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.757 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.757 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979368+0000", 2024-09-12T16:16:35.758 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9900000000000001e-07 2024-09-12T16:16:35.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.758 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.758 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.758 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979370+0000", 2024-09-12T16:16:35.758 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9980000000000002e-06 2024-09-12T16:16:35.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.758 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.758 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.758 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979376+0000", 2024-09-12T16:16:35.758 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1539999999999999e-06 2024-09-12T16:16:35.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.758 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.758 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.759 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979381+0000", 2024-09-12T16:16:35.759 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4789999999999998e-06 2024-09-12T16:16:35.759 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.759 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.759 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.759 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031550+0000", 2024-09-12T16:16:35.759 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052169363000000003 2024-09-12T16:16:35.759 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.759 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.759 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.759 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031594+0000", 2024-09-12T16:16:35.759 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3619999999999999e-05 2024-09-12T16:16:35.759 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.759 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.760 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.760 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031710+0000", 2024-09-12T16:16:35.760 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000116422 2024-09-12T16:16:35.760 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.760 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.760 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.760 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.760 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.760 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:21545 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 2092032~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:35.760 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.979395+0000", 2024-09-12T16:16:35.760 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.725341176000001, 2024-09-12T16:16:35.760 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052494740999999998, 2024-09-12T16:16:35.760 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.760 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.761 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.761 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.761 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:35.761 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:35.761 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 21545 2024-09-12T16:16:35.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.761 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.761 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.761 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.761 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979395+0000", 2024-09-12T16:16:35.761 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.761 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.761 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.761 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979395+0000", 2024-09-12T16:16:35.762 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.762 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.762 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.762 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979396+0000", 2024-09-12T16:16:35.762 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7599999999999997e-07 2024-09-12T16:16:35.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.762 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.762 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.762 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979398+0000", 2024-09-12T16:16:35.762 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2500000000000001e-06 2024-09-12T16:16:35.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.762 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.762 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.763 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979405+0000", 2024-09-12T16:16:35.763 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6730000000000003e-06 2024-09-12T16:16:35.763 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.763 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.763 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.763 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979410+0000", 2024-09-12T16:16:35.763 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1599999999999997e-06 2024-09-12T16:16:35.763 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.763 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.763 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.763 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031738+0000", 2024-09-12T16:16:35.763 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052327775 2024-09-12T16:16:35.763 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.763 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.764 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.764 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031782+0000", 2024-09-12T16:16:35.764 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4672999999999997e-05 2024-09-12T16:16:35.764 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.764 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.764 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.764 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031890+0000", 2024-09-12T16:16:35.764 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000107734 2024-09-12T16:16:35.764 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.764 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.764 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.764 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.764 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.764 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:21546 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 2096128~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:35.765 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.979416+0000", 2024-09-12T16:16:35.765 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.725319881000001, 2024-09-12T16:16:35.765 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052634296999999997, 2024-09-12T16:16:35.765 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.765 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.765 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.765 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.765 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:35.765 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:35.765 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 21546 2024-09-12T16:16:35.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.765 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.765 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.765 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979416+0000", 2024-09-12T16:16:35.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.766 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979416+0000", 2024-09-12T16:16:35.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.766 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979417+0000", 2024-09-12T16:16:35.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8099999999999998e-07 2024-09-12T16:16:35.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.767 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.767 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979419+0000", 2024-09-12T16:16:35.767 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.883e-06 2024-09-12T16:16:35.767 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.767 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.767 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.767 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979428+0000", 2024-09-12T16:16:35.767 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5820000000000008e-06 2024-09-12T16:16:35.767 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.767 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.767 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.767 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979435+0000", 2024-09-12T16:16:35.767 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2689999999999996e-06 2024-09-12T16:16:35.767 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.768 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.768 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.768 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031905+0000", 2024-09-12T16:16:35.768 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052470637000000001 2024-09-12T16:16:35.768 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.768 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.768 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.768 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.031946+0000", 2024-09-12T16:16:35.768 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0973000000000002e-05 2024-09-12T16:16:35.768 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.768 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.768 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.768 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032051+0000", 2024-09-12T16:16:35.768 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000104572 2024-09-12T16:16:35.769 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.769 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.769 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.769 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:21549 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 2097152~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:35.769 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.979476+0000", 2024-09-12T16:16:35.769 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.725260192, 2024-09-12T16:16:35.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052700314999999998, 2024-09-12T16:16:35.769 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.769 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.769 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.769 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.770 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:35.770 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:35.770 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 21549 2024-09-12T16:16:35.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.770 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.770 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.770 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979476+0000", 2024-09-12T16:16:35.770 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.770 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.770 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979476+0000", 2024-09-12T16:16:35.770 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.771 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.771 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.771 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979477+0000", 2024-09-12T16:16:35.771 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.63e-07 2024-09-12T16:16:35.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.771 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.771 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.771 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979479+0000", 2024-09-12T16:16:35.771 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5799999999999999e-06 2024-09-12T16:16:35.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.771 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.771 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.771 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979487+0000", 2024-09-12T16:16:35.772 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7200000000000006e-06 2024-09-12T16:16:35.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.772 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.772 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979492+0000", 2024-09-12T16:16:35.772 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9479999999999999e-06 2024-09-12T16:16:35.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.772 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.772 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032078+0000", 2024-09-12T16:16:35.772 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052585999000000001 2024-09-12T16:16:35.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.773 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.773 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032120+0000", 2024-09-12T16:16:35.773 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2367999999999998e-05 2024-09-12T16:16:35.773 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.773 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.773 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.773 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032176+0000", 2024-09-12T16:16:35.773 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6236999999999997e-05 2024-09-12T16:16:35.773 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.773 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.773 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.773 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.773 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.773 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:21550 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 2101248~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:35.774 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.979500+0000", 2024-09-12T16:16:35.774 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.725236832, 2024-09-12T16:16:35.774 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052810058, 2024-09-12T16:16:35.774 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.774 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.774 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.774 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.774 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:35.774 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:35.774 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 21550 2024-09-12T16:16:35.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.774 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.774 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.774 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.775 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979500+0000", 2024-09-12T16:16:35.775 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.775 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.775 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979500+0000", 2024-09-12T16:16:35.775 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.775 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.775 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979500+0000", 2024-09-12T16:16:35.775 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3300000000000003e-07 2024-09-12T16:16:35.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.776 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.776 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979502+0000", 2024-09-12T16:16:35.776 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1859999999999999e-06 2024-09-12T16:16:35.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.776 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.776 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979509+0000", 2024-09-12T16:16:35.776 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8859999999999998e-06 2024-09-12T16:16:35.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.776 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.776 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979514+0000", 2024-09-12T16:16:35.776 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8539999999999996e-06 2024-09-12T16:16:35.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.777 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.777 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.777 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032205+0000", 2024-09-12T16:16:35.777 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052690744999999997 2024-09-12T16:16:35.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.777 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.777 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.777 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032255+0000", 2024-09-12T16:16:35.777 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0444e-05 2024-09-12T16:16:35.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.777 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.777 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.777 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032310+0000", 2024-09-12T16:16:35.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4509999999999998e-05 2024-09-12T16:16:35.778 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.778 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.778 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.778 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:21552 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 2105344~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:35.778 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.979520+0000", 2024-09-12T16:16:35.778 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.725215872, 2024-09-12T16:16:35.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052925321999999997, 2024-09-12T16:16:35.778 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.778 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.778 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.778 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.779 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:35.779 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:35.779 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 21552 2024-09-12T16:16:35.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.779 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979520+0000", 2024-09-12T16:16:35.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979520+0000", 2024-09-12T16:16:35.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.780 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.780 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.780 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979521+0000", 2024-09-12T16:16:35.780 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3099999999999999e-07 2024-09-12T16:16:35.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.780 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.780 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.780 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979523+0000", 2024-09-12T16:16:35.780 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2089999999999999e-06 2024-09-12T16:16:35.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.780 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.780 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.780 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979529+0000", 2024-09-12T16:16:35.781 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.993e-06 2024-09-12T16:16:35.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.781 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.781 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.781 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979535+0000", 2024-09-12T16:16:35.781 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8599999999999998e-06 2024-09-12T16:16:35.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.781 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.781 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.781 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032339+0000", 2024-09-12T16:16:35.781 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052804413000000001 2024-09-12T16:16:35.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.781 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.781 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.782 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032381+0000", 2024-09-12T16:16:35.782 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2098000000000002e-05 2024-09-12T16:16:35.782 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.782 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.782 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.782 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032446+0000", 2024-09-12T16:16:35.782 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4418000000000006e-05 2024-09-12T16:16:35.782 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.782 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.782 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.782 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.782 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.782 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:21553 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 2109440~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:35.783 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.979542+0000", 2024-09-12T16:16:35.783 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.725194509, 2024-09-12T16:16:35.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053035463999999997, 2024-09-12T16:16:35.783 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.783 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.783 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.783 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.783 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:35.783 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:35.783 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 21553 2024-09-12T16:16:35.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.783 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.783 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.784 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979542+0000", 2024-09-12T16:16:35.784 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.784 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.784 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.784 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.784 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979542+0000", 2024-09-12T16:16:35.784 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.784 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.784 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.784 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.784 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979542+0000", 2024-09-12T16:16:35.784 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8699999999999995e-07 2024-09-12T16:16:35.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.785 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.785 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.785 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979544+0000", 2024-09-12T16:16:35.785 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.84e-06 2024-09-12T16:16:35.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.785 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.785 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.785 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979550+0000", 2024-09-12T16:16:35.785 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2280000000000003e-06 2024-09-12T16:16:35.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.785 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.785 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.785 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979555+0000", 2024-09-12T16:16:35.786 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8999999999999997e-06 2024-09-12T16:16:35.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.786 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.786 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.786 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032480+0000", 2024-09-12T16:16:35.786 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052924301999999999 2024-09-12T16:16:35.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.786 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.786 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.786 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032521+0000", 2024-09-12T16:16:35.786 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1563000000000002e-05 2024-09-12T16:16:35.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.786 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.786 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.787 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032577+0000", 2024-09-12T16:16:35.787 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6144000000000003e-05 2024-09-12T16:16:35.787 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.787 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.787 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.787 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.787 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.787 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:21554 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 2113536~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:35.787 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.979563+0000", 2024-09-12T16:16:35.787 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.725173688, 2024-09-12T16:16:35.787 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053150380999999997, 2024-09-12T16:16:35.787 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.787 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.787 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.788 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.788 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:35.788 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:35.788 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 21554 2024-09-12T16:16:35.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.788 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.788 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.788 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.788 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979563+0000", 2024-09-12T16:16:35.788 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.788 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.788 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.789 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979563+0000", 2024-09-12T16:16:35.789 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.789 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.789 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.789 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.789 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979563+0000", 2024-09-12T16:16:35.789 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1600000000000002e-07 2024-09-12T16:16:35.789 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.789 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.789 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.789 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979575+0000", 2024-09-12T16:16:35.789 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.222e-05 2024-09-12T16:16:35.789 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.789 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.790 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.790 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979580+0000", 2024-09-12T16:16:35.790 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7140000000000001e-06 2024-09-12T16:16:35.790 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.790 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.790 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.790 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979583+0000", 2024-09-12T16:16:35.790 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4039999999999999e-06 2024-09-12T16:16:35.790 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.790 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.790 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.790 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032607+0000", 2024-09-12T16:16:35.790 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053023709000000002 2024-09-12T16:16:35.790 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.791 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.791 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.791 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032650+0000", 2024-09-12T16:16:35.791 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3012000000000001e-05 2024-09-12T16:16:35.791 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.791 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.791 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.791 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032713+0000", 2024-09-12T16:16:35.791 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2905999999999997e-05 2024-09-12T16:16:35.791 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.791 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.791 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.791 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.791 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.792 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:21555 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 2117632~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:35.792 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.979589+0000", 2024-09-12T16:16:35.792 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.725147032000001, 2024-09-12T16:16:35.792 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053262941000000001, 2024-09-12T16:16:35.792 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.792 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.792 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.792 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.792 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:35.792 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:35.792 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 21555 2024-09-12T16:16:35.792 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.792 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.793 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.793 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.793 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979589+0000", 2024-09-12T16:16:35.793 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.793 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.793 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.793 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.793 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979589+0000", 2024-09-12T16:16:35.793 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.793 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.793 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.793 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.793 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979790+0000", 2024-09-12T16:16:35.793 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020029499999999999 2024-09-12T16:16:35.793 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.794 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.794 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.794 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979794+0000", 2024-09-12T16:16:35.794 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0740000000000003e-06 2024-09-12T16:16:35.794 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.794 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.794 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.794 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979803+0000", 2024-09-12T16:16:35.794 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8359999999999998e-06 2024-09-12T16:16:35.794 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.794 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.794 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.794 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979810+0000", 2024-09-12T16:16:35.794 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4680000000000003e-06 2024-09-12T16:16:35.795 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.795 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.795 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.795 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032742+0000", 2024-09-12T16:16:35.795 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052931745000000002 2024-09-12T16:16:35.795 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.795 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.795 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.795 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032783+0000", 2024-09-12T16:16:35.795 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1520000000000002e-05 2024-09-12T16:16:35.795 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.795 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.795 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.795 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032852+0000", 2024-09-12T16:16:35.796 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9003000000000003e-05 2024-09-12T16:16:35.796 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.796 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.796 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.796 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.796 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.796 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:21556 3.9 3:97252121:::rbd_data.1155627435cb.0000000000000000:9 [read 2121728~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-12T16:16:35.796 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:20.979821+0000", 2024-09-12T16:16:35.796 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.724914954999999, 2024-09-12T16:16:35.796 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053150601999999998, 2024-09-12T16:16:35.796 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:35.796 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:35.796 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:35.796 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:35.796 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:35.797 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:35.797 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 21556 2024-09-12T16:16:35.797 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.797 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:35.797 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.797 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:35.797 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979821+0000", 2024-09-12T16:16:35.797 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.797 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.797 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.797 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:35.797 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.979821+0000", 2024-09-12T16:16:35.797 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:35.797 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.798 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.798 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:35.798 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.985409+0000", 2024-09-12T16:16:35.798 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0055875680000000002 2024-09-12T16:16:35.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.798 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.798 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:35.798 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.985412+0000", 2024-09-12T16:16:35.798 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4249999999999998e-06 2024-09-12T16:16:35.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.798 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.798 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:35.798 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.985423+0000", 2024-09-12T16:16:35.799 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0713000000000001e-05 2024-09-12T16:16:35.799 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.799 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.799 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:35.799 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:20.985428+0000", 2024-09-12T16:16:35.799 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9420000000000003e-06 2024-09-12T16:16:35.799 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.799 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.799 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:35.799 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032880+0000", 2024-09-12T16:16:35.799 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.047452342000000002 2024-09-12T16:16:35.799 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.799 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.799 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:35.799 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032921+0000", 2024-09-12T16:16:35.800 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0989999999999999e-05 2024-09-12T16:16:35.800 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:35.800 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:35.800 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:35.800 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:21.032972+0000", 2024-09-12T16:16:35.800 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0621999999999997e-05 2024-09-12T16:16:35.800 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.800 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.800 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.800 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:35.800 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:35.800 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:35.802 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:16:35.802 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:35.800+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:35.903 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:35.901+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:35.910 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:35.911 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:35.911 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:16:35.911 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:35.920 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:16:36.004 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:36.002+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:36.066 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:36.067 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:36.067 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:16:36.067 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:16:36.067 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:36.075 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:16:36.105 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:36.103+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:36.205 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:36.204+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:36.213 INFO:teuthology.orchestra.run.smithi204.stdout:truncating image image_client.0-clone11 from 0xb9fb600 (overlap 0x28de00) to 0x41600 2024-09-12T16:16:36.227 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:36.227 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:16:36.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:16:36.227 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:36.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.227 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3703 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14803968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:36.227 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139513+0000", 2024-09-12T16:16:36.228 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.086274096, 2024-09-12T16:16:36.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053248794000000002, 2024-09-12T16:16:36.228 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:36.228 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:36.228 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:36.228 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:36.228 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:36.228 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:36.228 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3703 2024-09-12T16:16:36.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.228 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:36.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:36.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139513+0000", 2024-09-12T16:16:36.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:36.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139513+0000", 2024-09-12T16:16:36.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:36.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139639+0000", 2024-09-12T16:16:36.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012673299999999999 2024-09-12T16:16:36.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:36.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139642+0000", 2024-09-12T16:16:36.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4820000000000001e-06 2024-09-12T16:16:36.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:36.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139647+0000", 2024-09-12T16:16:36.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8040000000000001e-06 2024-09-12T16:16:36.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:36.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139650+0000", 2024-09-12T16:16:36.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.529e-06 2024-09-12T16:16:36.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:36.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192537+0000", 2024-09-12T16:16:36.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052886503000000001 2024-09-12T16:16:36.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:36.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192627+0000", 2024-09-12T16:16:36.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0183e-05 2024-09-12T16:16:36.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:36.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192761+0000", 2024-09-12T16:16:36.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013456000000000001 2024-09-12T16:16:36.232 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.232 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:36.232 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.232 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3704 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14808064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:36.232 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139656+0000", 2024-09-12T16:16:36.232 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.086130180000001, 2024-09-12T16:16:36.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053247502000000002, 2024-09-12T16:16:36.232 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:36.233 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:36.233 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:36.233 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:36.233 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:36.233 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:36.233 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3704 2024-09-12T16:16:36.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.233 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:36.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:36.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139656+0000", 2024-09-12T16:16:36.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:36.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139656+0000", 2024-09-12T16:16:36.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:36.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139790+0000", 2024-09-12T16:16:36.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000133471 2024-09-12T16:16:36.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:36.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139792+0000", 2024-09-12T16:16:36.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.968e-06 2024-09-12T16:16:36.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:36.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139796+0000", 2024-09-12T16:16:36.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2660000000000003e-06 2024-09-12T16:16:36.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:36.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139799+0000", 2024-09-12T16:16:36.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2839999999999998e-06 2024-09-12T16:16:36.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:36.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192790+0000", 2024-09-12T16:16:36.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052990388999999999 2024-09-12T16:16:36.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:36.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192835+0000", 2024-09-12T16:16:36.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5101000000000001e-05 2024-09-12T16:16:36.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:36.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192904+0000", 2024-09-12T16:16:36.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9023000000000006e-05 2024-09-12T16:16:36.236 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.236 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:36.236 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.237 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3705 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14812160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:36.237 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:16:36.237 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.085981843999999, 2024-09-12T16:16:36.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053368831999999998, 2024-09-12T16:16:36.237 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:36.237 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:36.237 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:36.237 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:36.237 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:36.237 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:36.237 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3705 2024-09-12T16:16:36.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.237 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:36.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:36.238 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:16:36.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:36.238 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:16:36.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:36.238 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139932+0000", 2024-09-12T16:16:36.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012762099999999999 2024-09-12T16:16:36.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:36.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139935+0000", 2024-09-12T16:16:36.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.119e-06 2024-09-12T16:16:36.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:36.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139939+0000", 2024-09-12T16:16:36.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7999999999999998e-06 2024-09-12T16:16:36.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:36.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139953+0000", 2024-09-12T16:16:36.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3923999999999999e-05 2024-09-12T16:16:36.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:36.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192946+0000", 2024-09-12T16:16:36.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052992971 2024-09-12T16:16:36.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:36.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193035+0000", 2024-09-12T16:16:36.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9040000000000001e-05 2024-09-12T16:16:36.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:36.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193174+0000", 2024-09-12T16:16:36.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138357 2024-09-12T16:16:36.241 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.241 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:36.241 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.241 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3706 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14816256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:36.241 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:16:36.241 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.085826854, 2024-09-12T16:16:36.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053341723000000001, 2024-09-12T16:16:36.241 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:36.241 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:36.242 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:36.242 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:36.242 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:36.242 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:36.242 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3706 2024-09-12T16:16:36.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.242 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:36.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:36.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:16:36.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:36.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:16:36.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:36.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140090+0000", 2024-09-12T16:16:36.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013020100000000001 2024-09-12T16:16:36.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:36.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140097+0000", 2024-09-12T16:16:36.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0709999999999997e-06 2024-09-12T16:16:36.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.244 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:36.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140103+0000", 2024-09-12T16:16:36.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5450000000000003e-06 2024-09-12T16:16:36.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.244 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:36.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140106+0000", 2024-09-12T16:16:36.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3739999999999998e-06 2024-09-12T16:16:36.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.244 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:36.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193190+0000", 2024-09-12T16:16:36.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053084131999999999 2024-09-12T16:16:36.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:36.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193232+0000", 2024-09-12T16:16:36.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1517000000000002e-05 2024-09-12T16:16:36.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:36.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193302+0000", 2024-09-12T16:16:36.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9882999999999995e-05 2024-09-12T16:16:36.245 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.245 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:36.245 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.246 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3707 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14820352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:36.246 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:16:36.246 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.085674865000001, 2024-09-12T16:16:36.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053452771000000003, 2024-09-12T16:16:36.246 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:36.246 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:36.246 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:36.246 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:36.246 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:36.246 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:36.246 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3707 2024-09-12T16:16:36.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.247 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:36.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:36.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:16:36.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:36.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:16:36.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:36.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140219+0000", 2024-09-12T16:16:36.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106902 2024-09-12T16:16:36.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:36.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140225+0000", 2024-09-12T16:16:36.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3199999999999996e-06 2024-09-12T16:16:36.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:36.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140230+0000", 2024-09-12T16:16:36.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8969999999999999e-06 2024-09-12T16:16:36.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:36.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140233+0000", 2024-09-12T16:16:36.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2119999999999999e-06 2024-09-12T16:16:36.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:36.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193339+0000", 2024-09-12T16:16:36.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053105556999999998 2024-09-12T16:16:36.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:36.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193431+0000", 2024-09-12T16:16:36.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1837999999999997e-05 2024-09-12T16:16:36.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:36.250 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193565+0000", 2024-09-12T16:16:36.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013404500000000001 2024-09-12T16:16:36.250 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.250 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:36.250 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.250 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3708 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14824448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:36.250 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:16:36.250 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.085546022999999, 2024-09-12T16:16:36.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053468190999999998, 2024-09-12T16:16:36.250 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:36.251 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:36.251 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:36.251 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:36.251 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:36.251 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:36.251 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3708 2024-09-12T16:16:36.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.251 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:36.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:36.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:16:36.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:36.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:16:36.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:36.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140351+0000", 2024-09-12T16:16:36.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110096 2024-09-12T16:16:36.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:36.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140358+0000", 2024-09-12T16:16:36.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.306e-06 2024-09-12T16:16:36.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:36.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140368+0000", 2024-09-12T16:16:36.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0225e-05 2024-09-12T16:16:36.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:36.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140372+0000", 2024-09-12T16:16:36.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6169999999999998e-06 2024-09-12T16:16:36.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:36.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193594+0000", 2024-09-12T16:16:36.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053222419999999999 2024-09-12T16:16:36.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:36.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193640+0000", 2024-09-12T16:16:36.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.587e-05 2024-09-12T16:16:36.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:36.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193709+0000", 2024-09-12T16:16:36.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8657000000000004e-05 2024-09-12T16:16:36.254 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.254 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:36.254 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.255 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3709 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14828544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:36.255 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:16:36.255 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.085409055, 2024-09-12T16:16:36.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594033999999999, 2024-09-12T16:16:36.255 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:36.255 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:36.255 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:36.255 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:36.255 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:36.255 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:36.255 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3709 2024-09-12T16:16:36.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.255 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:36.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:36.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:16:36.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:36.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:16:36.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:36.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140499+0000", 2024-09-12T16:16:36.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121019 2024-09-12T16:16:36.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:36.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140501+0000", 2024-09-12T16:16:36.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2369999999999999e-06 2024-09-12T16:16:36.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:36.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140506+0000", 2024-09-12T16:16:36.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.639e-06 2024-09-12T16:16:36.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:36.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140509+0000", 2024-09-12T16:16:36.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3419999999999999e-06 2024-09-12T16:16:36.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:36.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193743+0000", 2024-09-12T16:16:36.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053234311999999999 2024-09-12T16:16:36.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:36.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193833+0000", 2024-09-12T16:16:36.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9883999999999995e-05 2024-09-12T16:16:36.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:36.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193972+0000", 2024-09-12T16:16:36.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138601 2024-09-12T16:16:36.259 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.259 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:36.259 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.259 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3710 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14832640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:36.259 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:16:36.259 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.085271709000001, 2024-09-12T16:16:36.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053607324999999997, 2024-09-12T16:16:36.259 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:36.259 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:36.259 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:36.260 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:36.260 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:36.260 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:36.260 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3710 2024-09-12T16:16:36.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.260 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:36.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:36.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:16:36.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:36.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:16:36.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:36.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140664+0000", 2024-09-12T16:16:36.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014918700000000001 2024-09-12T16:16:36.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:36.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140674+0000", 2024-09-12T16:16:36.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8379999999999997e-06 2024-09-12T16:16:36.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:36.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140694+0000", 2024-09-12T16:16:36.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0145000000000001e-05 2024-09-12T16:16:36.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:36.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140703+0000", 2024-09-12T16:16:36.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5150000000000006e-06 2024-09-12T16:16:36.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:36.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194006+0000", 2024-09-12T16:16:36.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053303370000000003 2024-09-12T16:16:36.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:36.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194051+0000", 2024-09-12T16:16:36.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5012000000000002e-05 2024-09-12T16:16:36.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:36.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194122+0000", 2024-09-12T16:16:36.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1258000000000001e-05 2024-09-12T16:16:36.263 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.263 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:36.263 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.264 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3711 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14836736~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:36.264 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:16:36.264 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.085070260999998, 2024-09-12T16:16:36.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053670799999999998, 2024-09-12T16:16:36.264 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:36.264 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:36.264 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:36.264 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:36.264 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:36.264 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:36.264 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3711 2024-09-12T16:16:36.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.265 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:36.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:36.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:16:36.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:36.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:16:36.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:36.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140782+0000", 2024-09-12T16:16:36.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5549999999999994e-05 2024-09-12T16:16:36.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:36.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140786+0000", 2024-09-12T16:16:36.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.89e-06 2024-09-12T16:16:36.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:36.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140796+0000", 2024-09-12T16:16:36.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0057e-05 2024-09-12T16:16:36.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:36.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140819+0000", 2024-09-12T16:16:36.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3005000000000001e-05 2024-09-12T16:16:36.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:36.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194159+0000", 2024-09-12T16:16:36.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053340324000000001 2024-09-12T16:16:36.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:36.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194248+0000", 2024-09-12T16:16:36.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9209000000000006e-05 2024-09-12T16:16:36.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:36.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194387+0000", 2024-09-12T16:16:36.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138765 2024-09-12T16:16:36.268 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.268 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:36.268 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.268 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3712 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14840832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:36.268 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:16:36.268 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.084955803, 2024-09-12T16:16:36.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053699068000000003, 2024-09-12T16:16:36.268 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:36.269 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:36.269 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:36.269 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:36.269 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:36.269 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:36.269 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3712 2024-09-12T16:16:36.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.269 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:36.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:36.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:16:36.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:36.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:16:36.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:36.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140900+0000", 2024-09-12T16:16:36.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9014e-05 2024-09-12T16:16:36.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:36.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140904+0000", 2024-09-12T16:16:36.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0940000000000001e-06 2024-09-12T16:16:36.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:36.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140933+0000", 2024-09-12T16:16:36.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8996000000000002e-05 2024-09-12T16:16:36.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:36.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140945+0000", 2024-09-12T16:16:36.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1909000000000001e-05 2024-09-12T16:16:36.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:36.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194415+0000", 2024-09-12T16:16:36.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053470403 2024-09-12T16:16:36.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:36.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194460+0000", 2024-09-12T16:16:36.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5145000000000002e-05 2024-09-12T16:16:36.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:36.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194530+0000", 2024-09-12T16:16:36.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9506999999999997e-05 2024-09-12T16:16:36.272 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.272 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:36.272 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.273 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3713 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14844928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:36.273 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:16:36.273 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.084822743, 2024-09-12T16:16:36.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053821236000000001, 2024-09-12T16:16:36.273 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:36.273 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:36.273 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:36.273 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:36.273 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:36.273 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:36.273 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3713 2024-09-12T16:16:36.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.273 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:36.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:36.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:16:36.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:36.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:16:36.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:36.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141078+0000", 2024-09-12T16:16:36.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114162 2024-09-12T16:16:36.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:36.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141090+0000", 2024-09-12T16:16:36.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.19e-05 2024-09-12T16:16:36.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:36.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141100+0000", 2024-09-12T16:16:36.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0447e-05 2024-09-12T16:16:36.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:36.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141108+0000", 2024-09-12T16:16:36.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7190000000000001e-06 2024-09-12T16:16:36.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:36.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194564+0000", 2024-09-12T16:16:36.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053455729 2024-09-12T16:16:36.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:36.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194652+0000", 2024-09-12T16:16:36.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8288999999999994e-05 2024-09-12T16:16:36.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:36.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194785+0000", 2024-09-12T16:16:36.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013299000000000001 2024-09-12T16:16:36.277 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.277 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:36.277 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.277 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3714 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14849024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:36.277 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:16:36.277 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.084666813999998, 2024-09-12T16:16:36.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053816382000000003, 2024-09-12T16:16:36.277 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:36.277 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:36.277 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:36.277 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:36.277 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:36.278 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:36.278 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3714 2024-09-12T16:16:36.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.278 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:36.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:36.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:16:36.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:36.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:16:36.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:36.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141182+0000", 2024-09-12T16:16:36.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1805999999999997e-05 2024-09-12T16:16:36.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:36.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141185+0000", 2024-09-12T16:16:36.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5930000000000002e-06 2024-09-12T16:16:36.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:36.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141194+0000", 2024-09-12T16:16:36.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5760000000000006e-06 2024-09-12T16:16:36.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:36.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141222+0000", 2024-09-12T16:16:36.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8034999999999998e-05 2024-09-12T16:16:36.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:36.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194817+0000", 2024-09-12T16:16:36.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594887000000001 2024-09-12T16:16:36.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:36.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194860+0000", 2024-09-12T16:16:36.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3714999999999997e-05 2024-09-12T16:16:36.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:36.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194936+0000", 2024-09-12T16:16:36.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5770000000000001e-05 2024-09-12T16:16:36.281 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.281 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:36.281 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.282 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3715 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14853120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:36.282 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:16:36.282 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.084543156999999, 2024-09-12T16:16:36.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053962307000000001, 2024-09-12T16:16:36.282 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:36.282 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:36.282 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:36.282 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:36.282 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:36.282 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:36.282 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3715 2024-09-12T16:16:36.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.282 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:36.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:36.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:16:36.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:36.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:16:36.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:36.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141417+0000", 2024-09-12T16:16:36.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017384099999999999 2024-09-12T16:16:36.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:36.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141422+0000", 2024-09-12T16:16:36.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7310000000000001e-06 2024-09-12T16:16:36.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:36.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141434+0000", 2024-09-12T16:16:36.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2058e-05 2024-09-12T16:16:36.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:36.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141442+0000", 2024-09-12T16:16:36.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7610000000000007e-06 2024-09-12T16:16:36.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:36.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194973+0000", 2024-09-12T16:16:36.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053530618000000002 2024-09-12T16:16:36.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:36.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195063+0000", 2024-09-12T16:16:36.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0927000000000005e-05 2024-09-12T16:16:36.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:36.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195206+0000", 2024-09-12T16:16:36.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142371 2024-09-12T16:16:36.286 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.286 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:36.286 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.286 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3716 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14857216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:36.286 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:16:36.286 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.084333307000001, 2024-09-12T16:16:36.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053916360000000003, 2024-09-12T16:16:36.286 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:36.286 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:36.286 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:36.286 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:36.287 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:36.287 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:36.287 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3716 2024-09-12T16:16:36.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.287 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:36.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:36.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:16:36.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:36.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:16:36.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:36.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142933+0000", 2024-09-12T16:16:36.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014796290000000001 2024-09-12T16:16:36.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:36.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142937+0000", 2024-09-12T16:16:36.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5760000000000002e-06 2024-09-12T16:16:36.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:36.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142946+0000", 2024-09-12T16:16:36.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0380000000000005e-06 2024-09-12T16:16:36.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:36.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142951+0000", 2024-09-12T16:16:36.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9749999999999998e-06 2024-09-12T16:16:36.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:36.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195246+0000", 2024-09-12T16:16:36.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052295358 2024-09-12T16:16:36.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:36.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195299+0000", 2024-09-12T16:16:36.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2976999999999998e-05 2024-09-12T16:16:36.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:36.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195370+0000", 2024-09-12T16:16:36.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0807000000000002e-05 2024-09-12T16:16:36.290 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.290 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:36.290 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.291 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3721 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14877696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:36.291 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:16:36.291 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.082759855999999, 2024-09-12T16:16:36.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053422994000000001, 2024-09-12T16:16:36.291 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:36.291 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:36.291 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:36.291 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:36.291 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:36.291 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:36.291 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3721 2024-09-12T16:16:36.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.291 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:36.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:36.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:16:36.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:36.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:16:36.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:36.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:16:36.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:16:36.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:36.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143028+0000", 2024-09-12T16:16:36.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7399999999999991e-07 2024-09-12T16:16:36.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:36.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143031+0000", 2024-09-12T16:16:36.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7599999999999998e-06 2024-09-12T16:16:36.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:36.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143034+0000", 2024-09-12T16:16:36.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9780000000000001e-06 2024-09-12T16:16:36.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:36.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196220+0000", 2024-09-12T16:16:36.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053186341999999998 2024-09-12T16:16:36.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:36.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196313+0000", 2024-09-12T16:16:36.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2676000000000005e-05 2024-09-12T16:16:36.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:36.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196450+0000", 2024-09-12T16:16:36.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137052 2024-09-12T16:16:36.295 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.295 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:36.295 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.295 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3722 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14881792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:36.295 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:16:36.295 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.082749964000001, 2024-09-12T16:16:36.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053556835999999997, 2024-09-12T16:16:36.295 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:36.295 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:36.295 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:36.295 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:36.295 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:36.295 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:36.296 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3722 2024-09-12T16:16:36.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.296 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:36.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:36.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:16:36.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:36.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:16:36.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:36.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:16:36.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.11e-07 2024-09-12T16:16:36.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:36.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143038+0000", 2024-09-12T16:16:36.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2399999999999996e-07 2024-09-12T16:16:36.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:36.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143041+0000", 2024-09-12T16:16:36.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8030000000000001e-06 2024-09-12T16:16:36.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:36.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143043+0000", 2024-09-12T16:16:36.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3140000000000002e-06 2024-09-12T16:16:36.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:36.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196481+0000", 2024-09-12T16:16:36.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053437601000000001 2024-09-12T16:16:36.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:36.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196525+0000", 2024-09-12T16:16:36.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4280000000000003e-05 2024-09-12T16:16:36.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:36.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196594+0000", 2024-09-12T16:16:36.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8702999999999996e-05 2024-09-12T16:16:36.299 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.299 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:36.299 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.299 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3723 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14885888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:36.299 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:16:36.299 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.082740781999998, 2024-09-12T16:16:36.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053815546999999998, 2024-09-12T16:16:36.299 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:36.300 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:36.300 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:36.300 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:36.300 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:36.300 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:36.300 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3723 2024-09-12T16:16:36.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.300 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:36.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:36.300 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:16:36.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:36.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:16:36.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:36.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148994+0000", 2024-09-12T16:16:36.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059481330000000004 2024-09-12T16:16:36.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:36.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148999+0000", 2024-09-12T16:16:36.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7140000000000001e-06 2024-09-12T16:16:36.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:36.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149008+0000", 2024-09-12T16:16:36.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4350000000000003e-06 2024-09-12T16:16:36.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:36.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149021+0000", 2024-09-12T16:16:36.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2514000000000001e-05 2024-09-12T16:16:36.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:36.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196630+0000", 2024-09-12T16:16:36.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047609758000000002 2024-09-12T16:16:36.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:36.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196724+0000", 2024-09-12T16:16:36.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3522000000000003e-05 2024-09-12T16:16:36.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:36.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196861+0000", 2024-09-12T16:16:36.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013747100000000001 2024-09-12T16:16:36.303 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.303 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:36.303 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.304 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4438 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15719424~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:36.304 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:16:36.304 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.937860005000001, 2024-09-12T16:16:36.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367981000000002, 2024-09-12T16:16:36.304 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:36.304 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:36.304 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:36.304 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:36.304 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:36.304 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:36.304 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4438 2024-09-12T16:16:36.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.304 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:36.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:36.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:16:36.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:36.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:16:36.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:36.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:16:36.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3e-07 2024-09-12T16:16:36.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:36.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287930+0000", 2024-09-12T16:16:36.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-12T16:16:36.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:36.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287937+0000", 2024-09-12T16:16:36.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.08e-06 2024-09-12T16:16:36.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:36.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287943+0000", 2024-09-12T16:16:36.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5709999999999997e-06 2024-09-12T16:16:36.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:36.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341068+0000", 2024-09-12T16:16:36.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053125101000000001 2024-09-12T16:16:36.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:36.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341154+0000", 2024-09-12T16:16:36.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6100999999999994e-05 2024-09-12T16:16:36.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:36.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341295+0000", 2024-09-12T16:16:36.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014087999999999999 2024-09-12T16:16:36.308 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.308 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:36.308 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.308 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4439 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15723520~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:36.308 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:16:36.308 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.937835844999999, 2024-09-12T16:16:36.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053526799, 2024-09-12T16:16:36.308 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:36.309 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:36.309 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:36.309 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:36.309 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:36.309 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:36.309 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4439 2024-09-12T16:16:36.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.309 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:36.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:36.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:16:36.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:36.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:16:36.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:36.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:16:36.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-07 2024-09-12T16:16:36.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:36.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287953+0000", 2024-09-12T16:16:36.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1349999999999999e-06 2024-09-12T16:16:36.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:36.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287960+0000", 2024-09-12T16:16:36.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-12T16:16:36.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:36.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287965+0000", 2024-09-12T16:16:36.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1580000000000004e-06 2024-09-12T16:16:36.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:36.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341332+0000", 2024-09-12T16:16:36.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367009 2024-09-12T16:16:36.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:36.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341402+0000", 2024-09-12T16:16:36.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9759999999999996e-05 2024-09-12T16:16:36.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:36.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341478+0000", 2024-09-12T16:16:36.313 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5412000000000002e-05 2024-09-12T16:16:36.313 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.313 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:36.313 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.313 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4440 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15727616~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:36.313 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:16:36.313 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.937814741, 2024-09-12T16:16:36.313 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053761601999999999, 2024-09-12T16:16:36.313 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:36.313 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:36.313 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:36.314 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:36.314 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:36.314 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:36.314 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4440 2024-09-12T16:16:36.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.314 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:36.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:36.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:16:36.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:36.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:16:36.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:36.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:16:36.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:16:36.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:36.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287974+0000", 2024-09-12T16:16:36.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0540000000000002e-06 2024-09-12T16:16:36.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:36.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287980+0000", 2024-09-12T16:16:36.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9440000000000002e-06 2024-09-12T16:16:36.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:36.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287987+0000", 2024-09-12T16:16:36.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5889999999999999e-06 2024-09-12T16:16:36.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:36.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341502+0000", 2024-09-12T16:16:36.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053515199999999999 2024-09-12T16:16:36.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.317 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:36.317 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341595+0000", 2024-09-12T16:16:36.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3097000000000007e-05 2024-09-12T16:16:36.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.317 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:36.317 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341734+0000", 2024-09-12T16:16:36.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013832800000000001 2024-09-12T16:16:36.317 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.317 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:36.317 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.318 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.318 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:36.318 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:36.319 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:16:36.320 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:36.318+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:36.420 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:36.418+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:36.470 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:36.470 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:36.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.470 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:98 3.4 3.7cc68324 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:36.470 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.470185+0000", 2024-09-12T16:16:36.471 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.3255999999999999e-05, 2024-09-12T16:16:36.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8145000000000002e-05, 2024-09-12T16:16:36.471 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:36.471 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:36.471 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:36.471 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:36.471 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:36.471 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:36.471 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 98 2024-09-12T16:16:36.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.471 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:36.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:36.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.470185+0000", 2024-09-12T16:16:36.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:36.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.470185+0000", 2024-09-12T16:16:36.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:36.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:36.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.470186+0000", 2024-09-12T16:16:36.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6099999999999999e-07 2024-09-12T16:16:36.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.473 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:36.473 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.470190+0000", 2024-09-12T16:16:36.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0990000000000001e-06 2024-09-12T16:16:36.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.473 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:36.473 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.470200+0000", 2024-09-12T16:16:36.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0521e-05 2024-09-12T16:16:36.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:36.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:36.473 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:36.473 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.470206+0000", 2024-09-12T16:16:36.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3329999999999996e-06 2024-09-12T16:16:36.474 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.474 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:36.474 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.474 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:36.474 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-12T16:16:36.474 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 1 2024-09-12T16:16:36.474 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:36.479 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:16:36.521 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:36.520+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:36.604 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #10, image image_client.0-clone10 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent11 2024-09-12T16:16:36.622 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:36.620+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:36.631 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T16:16:36.641 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:36.641 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:36.642 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:16:36.642 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:16:36.642 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:36.655 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:16:36.741 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:36.739+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:36.753 INFO:teuthology.orchestra.run.smithi204.stdout:2462 read 0x9f3b400 thru 0x9f450ef (0x9cf0 bytes) 2024-09-12T16:16:36.757 INFO:teuthology.orchestra.run.smithi204.stdout:2464 write 0xe21c00 thru 0xe28eb1 (0x72b2 bytes) 2024-09-12T16:16:36.763 INFO:teuthology.orchestra.run.smithi204.stdout:2465 trunc from 0xb9fb600 to 0x61fac00 2024-09-12T16:16:36.791 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:16:36.791 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:16:36.824 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:36.822+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:36.827 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:16:36.827 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:16:36.839 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:36.839 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:36.850 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:16:36.853 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:16:36.854 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:16:36.871 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:16:36.871 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:16:36.899 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:16:36.899 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:16:36.902 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-12T16:16:36.908 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T16:16:36.909 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T16:16:36.950 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:36.948+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:36.982 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:36.982 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:36.988 INFO:teuthology.orchestra.run.smithi204.stdout:2466 write 0x42aaa00 thru 0x42b6563 (0xbb64 bytes) 2024-09-12T16:16:36.989 INFO:teuthology.orchestra.run.smithi204.stdout:2467 read 0x43e8e00 thru 0x43ed9d2 (0x4bd3 bytes) 2024-09-12T16:16:36.991 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:16:37.025 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:37.024+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:37.126 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:37.124+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:37.127 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T16:16:37.139 INFO:teuthology.orchestra.run.smithi204.stdout:2468 write 0xa349600 thru 0xa3569d5 (0xd3d6 bytes) 2024-09-12T16:16:37.139 INFO:teuthology.orchestra.run.smithi204.stdout:2469 read 0x81d7000 thru 0x81dcab8 (0x5ab9 bytes) 2024-09-12T16:16:37.140 INFO:teuthology.orchestra.run.smithi204.stdout:2471 write 0x454b800 thru 0x454d6d6 (0x1ed7 bytes) 2024-09-12T16:16:37.145 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:37.146 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:37.157 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:16:37.163 INFO:teuthology.orchestra.run.smithi204.stdout:2472 write 0xd311000 thru 0xd3195ee (0x85ef bytes) 2024-09-12T16:16:37.170 INFO:teuthology.orchestra.run.smithi204.stdout:2475 write 0xc6da200 thru 0xc6e238c (0x818d bytes) 2024-09-12T16:16:37.170 INFO:teuthology.orchestra.run.smithi204.stdout:2480 punch from 0xbfac400 to 0xbfb9400, (0xd000 bytes) 2024-09-12T16:16:37.172 INFO:teuthology.orchestra.run.smithi204.stdout:2481 read 0x1bf5a00 thru 0x1bfe696 (0x8c97 bytes) 2024-09-12T16:16:37.174 INFO:teuthology.orchestra.run.smithi204.stdout:2482 read 0xc2a7600 thru 0xc2b1bcc (0xa5cd bytes) 2024-09-12T16:16:37.182 INFO:teuthology.orchestra.run.smithi204.stdout:2483 trunc from 0xd319600 to 0x6f75e00 2024-09-12T16:16:37.226 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:37.225+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:37.229 INFO:teuthology.orchestra.run.smithi204.stdout:2485 punch from 0x1d6600 to 0x1e3600, (0xd000 bytes) 2024-09-12T16:16:37.285 INFO:teuthology.orchestra.run.smithi204.stdout:2490 read 0x5605400 thru 0x560ba71 (0x6672 bytes) 2024-09-12T16:16:37.321 INFO:teuthology.orchestra.run.smithi204.stdout:2491 trunc from 0x6f75e00 to 0x414c200 2024-09-12T16:16:37.327 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:37.326+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:37.374 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:37.374 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:37.380 INFO:teuthology.orchestra.run.smithi204.stdout:skipping zero length punch hole 2024-09-12T16:16:37.382 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:16:37.398 INFO:teuthology.orchestra.run.smithi204.stdout:2496 write 0xca04c00 thru 0xca0b0a0 (0x64a1 bytes) 2024-09-12T16:16:37.405 INFO:teuthology.orchestra.run.smithi204.stdout:2498 punch from 0x6147200 to 0x6157000, (0xfe00 bytes) 2024-09-12T16:16:37.407 INFO:teuthology.orchestra.run.smithi204.stdout:2500 write 0x6f63200 thru 0x6f6b785 (0x8586 bytes) 2024-09-12T16:16:37.407 INFO:teuthology.orchestra.run.smithi204.stdout:2505 read 0x1b87a00 thru 0x1b96d27 (0xf328 bytes) 2024-09-12T16:16:37.409 INFO:teuthology.orchestra.run.smithi204.stdout:2507 punch from 0x15a2400 to 0x15a7c00, (0x5800 bytes) 2024-09-12T16:16:37.427 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:37.426+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:37.442 INFO:teuthology.orchestra.run.smithi204.stdout:2508 write 0x6a0fa00 thru 0x6a1afc1 (0xb5c2 bytes) 2024-09-12T16:16:37.442 INFO:teuthology.orchestra.run.smithi204.stdout:2513 read 0x6e4b800 thru 0x6e57ae5 (0xc2e6 bytes) 2024-09-12T16:16:37.442 INFO:teuthology.orchestra.run.smithi204.stdout:2514 read 0x7d33600 thru 0x7d3d0b5 (0x9ab6 bytes) 2024-09-12T16:16:37.442 INFO:teuthology.orchestra.run.smithi204.stdout:2515 read 0x477e00 thru 0x47a2a0 (0x24a1 bytes) 2024-09-12T16:16:37.497 INFO:teuthology.orchestra.run.smithi204.stdout:2516 read 0x3ed2000 thru 0x3eda732 (0x8733 bytes) 2024-09-12T16:16:37.498 INFO:teuthology.orchestra.run.smithi204.stdout:2518 trunc from 0xca0b200 to 0xc9e7800 2024-09-12T16:16:37.525 INFO:teuthology.orchestra.run.smithi204.stdout:2519 write 0x88ba400 thru 0x88bb3b3 (0xfb4 bytes) 2024-09-12T16:16:37.528 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:37.527+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:37.529 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:37.529 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:37.538 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:16:37.546 INFO:teuthology.orchestra.run.smithi204.stdout:2521 write 0xdfb4c00 thru 0xdfc323c (0xe63d bytes) 2024-09-12T16:16:37.547 INFO:teuthology.orchestra.run.smithi204.stdout:2525 write 0xd40400 thru 0xd42d89 (0x298a bytes) 2024-09-12T16:16:37.548 INFO:teuthology.orchestra.run.smithi204.stdout:2529 read 0x7f48400 thru 0x7f4d1e2 (0x4de3 bytes) 2024-09-12T16:16:37.548 INFO:teuthology.orchestra.run.smithi204.stdout:2530 read 0x8b16c00 thru 0x8b23998 (0xcd99 bytes) 2024-09-12T16:16:37.548 INFO:teuthology.orchestra.run.smithi204.stdout:2531 write 0xea2e00 thru 0xeb2c62 (0xfe63 bytes) 2024-09-12T16:16:37.577 INFO:teuthology.orchestra.run.smithi204.stdout:2532 write 0xe430a00 thru 0xe438dd9 (0x83da bytes) 2024-09-12T16:16:37.591 INFO:teuthology.orchestra.run.smithi204.stdout:2534 trunc from 0xe438e00 to 0x6c38200 2024-09-12T16:16:37.629 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:37.627+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:37.631 INFO:teuthology.orchestra.run.smithi204.stdout:2536 write 0x15dd200 thru 0x15ebc66 (0xea67 bytes) 2024-09-12T16:16:37.687 INFO:teuthology.orchestra.run.smithi204.stdout:2537 write 0x7d73c00 thru 0x7d7801e (0x441f bytes) 2024-09-12T16:16:37.688 INFO:teuthology.orchestra.run.smithi204.stdout:2538 punch from 0x77da200 to 0x77dae00, (0xc00 bytes) 2024-09-12T16:16:37.693 INFO:teuthology.orchestra.run.smithi204.stdout:2539 write 0x6b49800 thru 0x6b58aa6 (0xf2a7 bytes) 2024-09-12T16:16:37.696 INFO:teuthology.orchestra.run.smithi204.stdout:2540 clone 13 order 21 su 1048576 sc 14 2024-09-12T16:16:37.712 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:37.712 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:37.721 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:16:37.730 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:37.729+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:37.831 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:37.829+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:37.869 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:37.869 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:37.877 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:16:37.931 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:37.930+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:37.983 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:37.984 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:37.992 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:16:38.032 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:38.030+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:38.100 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:38.100 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:38.108 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:16:38.119 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [5] live_osds: [0, 1, 2, 3, 4] 2024-09-12T16:16:38.119 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T16:16:38.119 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T16:16:38.120 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-12T16:16:38.136 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:38.134+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:38.220 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:38.220 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:38.223 INFO:teuthology.orchestra.run.smithi204.stdout:truncating image image_client.0-clone12 from 0x7d78200 (overlap 0x414c200) to 0x1396c00 2024-09-12T16:16:38.230 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:16:38.233 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:38.232+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:38.334 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:38.332+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:38.418 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:38.419 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:38.433 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:16:38.474 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:38.472+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:38.536 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:38.534+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:38.593 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:16:38.593 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-12T16:16:38.603 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:38.603 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:38.607 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2024-09-12T16:16:38.117442+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":388261090,"num_objects":355,"num_object_clones":64,"num_object_copies":710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":126,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":355,"num_whiteouts":43,"num_read":104431,"num_read_kb":268977,"num_write":7752,"num_write_kb":56783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6468,"ondisk_log_size":6468,"up":69,"acting":69,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":286052,"kb_used_data":53012,"kb_used_omap":9,"kb_used_meta":232758,"kb_avail":565944988,"statfs":{"total":579820584960,"available":579527667712,"internally_reserved":0,"allocated":54284288,"data_stored":77564588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":238344865},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":44112074,"num_objects":57,"num_object_clones":25,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":23,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":10,"num_read":14453,"num_read_kb":51521,"num_write":1107,"num_write_kb":23283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.018641"},"pg_stats":[{"pgid":"3.1f","version":"46'127","reported_seq":2008,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-12T16:16:34.394580+0000","last_change":"2024-09-12T16:15:59.026352+0000","last_active":"2024-09-12T16:16:34.394580+0000","last_peered":"2024-09-12T16:16:34.394580+0000","last_clean":"2024-09-12T16:16:34.394580+0000","last_became_active":"2024-09-12T16:15:57.010105+0000","last_became_peered":"2024-09-12T16:15:57.010105+0000","last_unstale":"2024-09-12T16:16:34.394580+0000","last_undegraded":"2024-09-12T16:16:34.394580+0000","last_fullsized":"2024-09-12T16:16:34.394580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:57.964528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001341074,"stat_sum":{"num_bytes":12025360,"num_objects":11,"num_object_clones":3,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":2,"num_read":1834,"num_read_kb":24882,"num_write":125,"num_write_kb":1742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"47'120","reported_seq":2647,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-12T16:16:34.679734+0000","last_change":"2024-09-12T16:16:34.111660+0000","last_active":"2024-09-12T16:16:34.679734+0000","last_peered":"2024-09-12T16:16:34.679734+0000","last_clean":"2024-09-12T16:16:34.679734+0000","last_became_active":"2024-09-12T16:16:34.110000+0000","last_became_peered":"2024-09-12T16:16:34.110000+0000","last_unstale":"2024-09-12T16:16:34.679734+0000","last_undegraded":"2024-09-12T16:16:34.679734+0000","last_fullsized":"2024-09-12T16:16:34.679734+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:18.348041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076760299999999995,"stat_sum":{"num_bytes":12558336,"num_objects":16,"num_object_clones":3,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":2,"num_read":2486,"num_read_kb":14236,"num_write":118,"num_write_kb":1846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"45'910","reported_seq":3214,"reported_epoch":47,"state":"active+undersized+degraded","last_fresh":"2024-09-12T16:16:34.679562+0000","last_change":"2024-09-12T16:16:17.075056+0000","last_active":"2024-09-12T16:16:34.679562+0000","last_peered":"2024-09-12T16:16:34.679562+0000","last_clean":"2024-09-12T16:16:15.505352+0000","last_became_active":"2024-09-12T16:16:17.075056+0000","last_became_peered":"2024-09-12T16:16:17.075056+0000","last_unstale":"2024-09-12T16:16:34.679562+0000","last_undegraded":"2024-09-12T16:16:17.074392+0000","last_fullsized":"2024-09-12T16:16:17.074294+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:33.677337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010512060000000001,"stat_sum":{"num_bytes":20784867,"num_objects":14,"num_object_clones":3,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":14,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":3,"num_read":6469,"num_read_kb":14609,"num_write":1572,"num_write_kb":2569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":14}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"46'94","reported_seq":416,"reported_epoch":47,"state":"active+undersized+degraded","last_fresh":"2024-09-12T16:16:34.449434+0000","last_change":"2024-09-12T16:16:17.075094+0000","last_active":"2024-09-12T16:16:34.449434+0000","last_peered":"2024-09-12T16:16:34.449434+0000","last_clean":"2024-09-12T16:16:15.505177+0000","last_became_active":"2024-09-12T16:16:17.075094+0000","last_became_peered":"2024-09-12T16:16:17.075094+0000","last_unstale":"2024-09-12T16:16:34.449434+0000","last_undegraded":"2024-09-12T16:16:17.074440+0000","last_fullsized":"2024-09-12T16:16:17.074393+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:40.628482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011661079999999999,"stat_sum":{"num_bytes":1035264,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":270,"num_read_kb":723,"num_write":93,"num_write_kb":474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":4}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"47'94","reported_seq":435,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-12T16:16:34.387532+0000","last_change":"2024-09-12T16:15:59.013892+0000","last_active":"2024-09-12T16:16:34.387532+0000","last_peered":"2024-09-12T16:16:34.387532+0000","last_clean":"2024-09-12T16:16:34.387532+0000","last_became_active":"2024-09-12T16:15:57.013937+0000","last_became_peered":"2024-09-12T16:15:57.013937+0000","last_unstale":"2024-09-12T16:16:34.387532+0000","last_undegraded":"2024-09-12T16:16:34.387532+0000","last_fullsized":"2024-09-12T16:16:34.387532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:15.727981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056160499999999996,"stat_sum":{"num_bytes":4620288,"num_objects":7,"num_object_clones":2,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":272,"num_read_kb":1312,"num_write":92,"num_write_kb":2071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"46'71","reported_seq":1969,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-12T16:16:34.681924+0000","last_change":"2024-09-12T16:15:59.013909+0000","last_active":"2024-09-12T16:16:34.681924+0000","last_peered":"2024-09-12T16:16:34.681924+0000","last_clean":"2024-09-12T16:16:34.681924+0000","last_became_active":"2024-09-12T16:15:57.014803+0000","last_became_peered":"2024-09-12T16:15:57.014803+0000","last_unstale":"2024-09-12T16:16:34.681924+0000","last_undegraded":"2024-09-12T16:16:34.681924+0000","last_fullsized":"2024-09-12T16:16:34.681924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:27.081278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056998200000000002,"stat_sum":{"num_bytes":3686435,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1851,"num_read_kb":3603,"num_write":71,"num_write_kb":468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"46'104","reported_seq":766,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-12T16:16:34.394671+0000","last_change":"2024-09-12T16:15:59.015220+0000","last_active":"2024-09-12T16:16:34.394671+0000","last_peered":"2024-09-12T16:16:34.394671+0000","last_clean":"2024-09-12T16:16:34.394671+0000","last_became_active":"2024-09-12T16:15:57.016110+0000","last_became_peered":"2024-09-12T16:15:57.016110+0000","last_unstale":"2024-09-12T16:16:34.394671+0000","last_undegraded":"2024-09-12T16:16:34.394671+0000","last_fullsized":"2024-09-12T16:16:34.394671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:12.201653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088668999999999998,"stat_sum":{"num_bytes":7341568,"num_objects":15,"num_object_clones":3,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":3,"num_read":601,"num_read_kb":2815,"num_write":104,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"42'373","reported_seq":1007,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-12T16:16:34.109649+0000","last_change":"2024-09-12T16:16:34.109546+0000","last_active":"2024-09-12T16:16:34.109649+0000","last_peered":"2024-09-12T16:16:34.109649+0000","last_clean":"2024-09-12T16:16:34.109649+0000","last_became_active":"2024-09-12T16:16:34.108806+0000","last_became_peered":"2024-09-12T16:16:34.108806+0000","last_unstale":"2024-09-12T16:16:34.109649+0000","last_undegraded":"2024-09-12T16:16:34.109649+0000","last_fullsized":"2024-09-12T16:16:34.109649+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:08.508704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081349199999999997,"stat_sum":{"num_bytes":2251347,"num_objects":7,"num_object_clones":1,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":2017,"num_read_kb":3987,"num_write":577,"num_write_kb":965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"47'346","reported_seq":2705,"reported_epoch":47,"state":"active+undersized+degraded","last_fresh":"2024-09-12T16:16:34.387651+0000","last_change":"2024-09-12T16:16:17.077998+0000","last_active":"2024-09-12T16:16:34.387651+0000","last_peered":"2024-09-12T16:16:34.387651+0000","last_clean":"2024-09-12T16:16:15.070169+0000","last_became_active":"2024-09-12T16:16:17.077998+0000","last_became_peered":"2024-09-12T16:16:17.077998+0000","last_unstale":"2024-09-12T16:16:34.387651+0000","last_undegraded":"2024-09-12T16:16:17.077267+0000","last_fullsized":"2024-09-12T16:16:17.077181+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:26.454398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059639700000000003,"stat_sum":{"num_bytes":28722756,"num_objects":12,"num_object_clones":2,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":12,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":3602,"num_read_kb":7149,"num_write":537,"num_write_kb":2700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"47'510","reported_seq":1452,"reported_epoch":47,"state":"active+undersized+degraded","last_fresh":"2024-09-12T16:16:34.393388+0000","last_change":"2024-09-12T16:16:17.077087+0000","last_active":"2024-09-12T16:16:34.393388+0000","last_peered":"2024-09-12T16:16:34.393388+0000","last_clean":"2024-09-12T16:16:15.074507+0000","last_became_active":"2024-09-12T16:16:17.077087+0000","last_became_peered":"2024-09-12T16:16:17.077087+0000","last_unstale":"2024-09-12T16:16:34.393388+0000","last_undegraded":"2024-09-12T16:16:17.076739+0000","last_fullsized":"2024-09-12T16:16:17.076646+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:37.458325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001237496,"stat_sum":{"num_bytes":25562945,"num_objects":19,"num_object_clones":6,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":19,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":5,"num_read":3044,"num_read_kb":5801,"num_write":846,"num_write_kb":2910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":19}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"43'94","reported_seq":890,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-12T16:16:34.108554+0000","last_change":"2024-09-12T16:15:59.025890+0000","last_active":"2024-09-12T16:16:34.108554+0000","last_peered":"2024-09-12T16:16:34.108554+0000","last_clean":"2024-09-12T16:16:34.108554+0000","last_became_active":"2024-09-12T16:15:57.009561+0000","last_became_peered":"2024-09-12T16:15:57.009561+0000","last_unstale":"2024-09-12T16:16:34.108554+0000","last_undegraded":"2024-09-12T16:16:34.108554+0000","last_fullsized":"2024-09-12T16:16:34.108554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:05.744206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010193750000000001,"stat_sum":{"num_bytes":10363953,"num_objects":12,"num_object_clones":2,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":745,"num_read_kb":4117,"num_write":96,"num_write_kb":989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"47'382","reported_seq":3459,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-12T16:16:34.680294+0000","last_change":"2024-09-12T16:15:59.025432+0000","last_active":"2024-09-12T16:16:34.680294+0000","last_peered":"2024-09-12T16:16:34.680294+0000","last_clean":"2024-09-12T16:16:34.680294+0000","last_became_active":"2024-09-12T16:15:57.015778+0000","last_became_peered":"2024-09-12T16:15:57.015778+0000","last_unstale":"2024-09-12T16:16:34.680294+0000","last_undegraded":"2024-09-12T16:16:34.680294+0000","last_fullsized":"2024-09-12T16:16:34.680294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:52.683347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000729947,"stat_sum":{"num_bytes":16495670,"num_objects":11,"num_object_clones":1,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":1,"num_read":5223,"num_read_kb":11087,"num_write":405,"num_write_kb":1000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":76,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-12T16:16:34.108861+0000","last_change":"2024-09-12T16:15:48.822675+0000","last_active":"2024-09-12T16:16:34.108861+0000","last_peered":"2024-09-12T16:16:34.108861+0000","last_clean":"2024-09-12T16:16:34.108861+0000","last_became_active":"2024-09-12T16:15:46.818683+0000","last_became_peered":"2024-09-12T16:15:46.818683+0000","last_unstale":"2024-09-12T16:16:34.108861+0000","last_undegraded":"2024-09-12T16:16:34.108861+0000","last_fullsized":"2024-09-12T16:16:34.108861+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:32.099284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073961600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"47'211","reported_seq":2965,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-12T16:16:34.393508+0000","last_change":"2024-09-12T16:15:59.311049+0000","last_active":"2024-09-12T16:16:34.393508+0000","last_peered":"2024-09-12T16:16:34.393508+0000","last_clean":"2024-09-12T16:16:34.393508+0000","last_became_active":"2024-09-12T16:15:57.012577+0000","last_became_peered":"2024-09-12T16:15:57.012577+0000","last_unstale":"2024-09-12T16:16:34.393508+0000","last_undegraded":"2024-09-12T16:16:34.393508+0000","last_fullsized":"2024-09-12T16:16:34.393508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:51:00.214780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063283100000000004,"stat_sum":{"num_bytes":8368686,"num_objects":9,"num_object_clones":2,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":1,"num_read":3976,"num_read_kb":4440,"num_write":128,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":76,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-12T16:16:34.107869+0000","last_change":"2024-09-12T16:15:48.822729+0000","last_active":"2024-09-12T16:16:34.107869+0000","last_peered":"2024-09-12T16:16:34.107869+0000","last_clean":"2024-09-12T16:16:34.107869+0000","last_became_active":"2024-09-12T16:15:46.818462+0000","last_became_peered":"2024-09-12T16:15:46.818462+0000","last_unstale":"2024-09-12T16:16:34.107869+0000","last_undegraded":"2024-09-12T16:16:34.107869+0000","last_fullsized":"2024-09-12T16:16:34.107869+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:25.975652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066384400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"44'64","reported_seq":1423,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-12T16:16:34.110078+0000","last_change":"2024-09-12T16:16:34.109977+0000","last_active":"2024-09-12T16:16:34.110078+0000","last_peered":"2024-09-12T16:16:34.110078+0000","last_clean":"2024-09-12T16:16:34.110078+0000","last_became_active":"2024-09-12T16:16:34.108850+0000","last_became_peered":"2024-09-12T16:16:34.108850+0000","last_unstale":"2024-09-12T16:16:34.110078+0000","last_undegraded":"2024-09-12T16:16:34.110078+0000","last_fullsized":"2024-09-12T16:16:34.110078+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:54.069853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012786130000000001,"stat_sum":{"num_bytes":17841664,"num_objects":9,"num_object_clones":2,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":2,"num_read":1293,"num_read_kb":1665,"num_write":62,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":76,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-12T16:16:34.108690+0000","last_change":"2024-09-12T16:15:48.822426+0000","last_active":"2024-09-12T16:16:34.108690+0000","last_peered":"2024-09-12T16:16:34.108690+0000","last_clean":"2024-09-12T16:16:34.108690+0000","last_became_active":"2024-09-12T16:15:46.819353+0000","last_became_peered":"2024-09-12T16:15:46.819353+0000","last_unstale":"2024-09-12T16:16:34.108690+0000","last_undegraded":"2024-09-12T16:16:34.108690+0000","last_fullsized":"2024-09-12T16:16:34.108690+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:23:56.141583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053074700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"45'141","reported_seq":1730,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-12T16:16:34.107656+0000","last_change":"2024-09-12T16:15:59.016004+0000","last_active":"2024-09-12T16:16:34.107656+0000","last_peered":"2024-09-12T16:16:34.107656+0000","last_clean":"2024-09-12T16:16:34.107656+0000","last_became_active":"2024-09-12T16:15:57.011381+0000","last_became_peered":"2024-09-12T16:15:57.011381+0000","last_unstale":"2024-09-12T16:16:34.107656+0000","last_undegraded":"2024-09-12T16:16:34.107656+0000","last_fullsized":"2024-09-12T16:16:34.107656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:06.309749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001361543,"stat_sum":{"num_bytes":6828544,"num_objects":12,"num_object_clones":1,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":2439,"num_read_kb":5637,"num_write":121,"num_write_kb":598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":76,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-12T16:16:34.107789+0000","last_change":"2024-09-12T16:15:48.822724+0000","last_active":"2024-09-12T16:16:34.107789+0000","last_peered":"2024-09-12T16:16:34.107789+0000","last_clean":"2024-09-12T16:16:34.107789+0000","last_became_active":"2024-09-12T16:15:46.818676+0000","last_became_peered":"2024-09-12T16:15:46.818676+0000","last_unstale":"2024-09-12T16:16:34.107789+0000","last_undegraded":"2024-09-12T16:16:34.107789+0000","last_fullsized":"2024-09-12T16:16:34.107789+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:11.170806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065522900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"47'143","reported_seq":1239,"reported_epoch":47,"state":"active+undersized+degraded","last_fresh":"2024-09-12T16:16:34.347648+0000","last_change":"2024-09-12T16:16:17.076036+0000","last_active":"2024-09-12T16:16:34.347648+0000","last_peered":"2024-09-12T16:16:34.347648+0000","last_clean":"2024-09-12T16:16:13.214748+0000","last_became_active":"2024-09-12T16:16:17.076036+0000","last_became_peered":"2024-09-12T16:16:17.076036+0000","last_unstale":"2024-09-12T16:16:34.347648+0000","last_undegraded":"2024-09-12T16:16:17.074806+0000","last_fullsized":"2024-09-12T16:16:17.074718+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:52.690414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012959270000000001,"stat_sum":{"num_bytes":1075744,"num_objects":8,"num_object_clones":1,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":8,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":1783,"num_read_kb":2460,"num_write":113,"num_write_kb":689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"46'171","reported_seq":1681,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-12T16:16:34.680838+0000","last_change":"2024-09-12T16:15:59.014247+0000","last_active":"2024-09-12T16:16:34.680838+0000","last_peered":"2024-09-12T16:16:34.680838+0000","last_clean":"2024-09-12T16:16:34.680838+0000","last_became_active":"2024-09-12T16:15:57.012238+0000","last_became_peered":"2024-09-12T16:15:57.012238+0000","last_unstale":"2024-09-12T16:16:34.680838+0000","last_undegraded":"2024-09-12T16:16:34.680838+0000","last_fullsized":"2024-09-12T16:16:34.680838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:20.195603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077777399999999996,"stat_sum":{"num_bytes":29387304,"num_objects":12,"num_object_clones":3,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":3,"num_read":1518,"num_read_kb":6122,"num_write":168,"num_write_kb":1773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":71,"reported_epoch":47,"state":"active+undersized+degraded","last_fresh":"2024-09-12T16:16:34.107818+0000","last_change":"2024-09-12T16:16:17.076614+0000","last_active":"2024-09-12T16:16:34.107818+0000","last_peered":"2024-09-12T16:16:34.107818+0000","last_clean":"2024-09-12T16:16:15.067685+0000","last_became_active":"2024-09-12T16:16:17.076614+0000","last_became_peered":"2024-09-12T16:16:17.076614+0000","last_unstale":"2024-09-12T16:16:34.107818+0000","last_undegraded":"2024-09-12T16:16:17.075217+0000","last_fullsized":"2024-09-12T16:16:17.075134+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:59.010859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"43'479","reported_seq":7069,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-12T16:16:34.678125+0000","last_change":"2024-09-12T16:15:59.014931+0000","last_active":"2024-09-12T16:16:34.678125+0000","last_peered":"2024-09-12T16:16:34.678125+0000","last_clean":"2024-09-12T16:16:34.678125+0000","last_became_active":"2024-09-12T16:15:57.014294+0000","last_became_peered":"2024-09-12T16:15:57.014294+0000","last_unstale":"2024-09-12T16:16:34.678125+0000","last_undegraded":"2024-09-12T16:16:34.678125+0000","last_fullsized":"2024-09-12T16:16:34.678125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:22.794310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011576030000000001,"stat_sum":{"num_bytes":7792748,"num_objects":13,"num_object_clones":2,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":2,"num_read":8060,"num_read_kb":9398,"num_write":391,"num_write_kb":1151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-12T16:16:34.109364+0000","last_change":"2024-09-12T16:16:34.109269+0000","last_active":"2024-09-12T16:16:34.109364+0000","last_peered":"2024-09-12T16:16:34.109364+0000","last_clean":"2024-09-12T16:16:34.109364+0000","last_became_active":"2024-09-12T16:16:34.108999+0000","last_became_peered":"2024-09-12T16:16:34.108999+0000","last_unstale":"2024-09-12T16:16:34.109364+0000","last_undegraded":"2024-09-12T16:16:34.109364+0000","last_fullsized":"2024-09-12T16:16:34.109364+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:02:32.771436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"47'155","reported_seq":936,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-12T16:16:34.395444+0000","last_change":"2024-09-12T16:15:59.310828+0000","last_active":"2024-09-12T16:16:34.395444+0000","last_peered":"2024-09-12T16:16:34.395444+0000","last_clean":"2024-09-12T16:16:34.395444+0000","last_became_active":"2024-09-12T16:15:57.015817+0000","last_became_peered":"2024-09-12T16:15:57.015817+0000","last_unstale":"2024-09-12T16:16:34.395444+0000","last_undegraded":"2024-09-12T16:16:34.395444+0000","last_fullsized":"2024-09-12T16:16:34.395444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:06:34.411745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052214999999999998,"stat_sum":{"num_bytes":9659944,"num_objects":11,"num_object_clones":3,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":2,"num_read":1111,"num_read_kb":5155,"num_write":214,"num_write_kb":2604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":76,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-12T16:16:34.108316+0000","last_change":"2024-09-12T16:15:48.822423+0000","last_active":"2024-09-12T16:16:34.108316+0000","last_peered":"2024-09-12T16:16:34.108316+0000","last_clean":"2024-09-12T16:16:34.108316+0000","last_became_active":"2024-09-12T16:15:46.820368+0000","last_became_peered":"2024-09-12T16:15:46.820368+0000","last_unstale":"2024-09-12T16:16:34.108316+0000","last_undegraded":"2024-09-12T16:16:34.108316+0000","last_fullsized":"2024-09-12T16:16:34.108316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:01.722710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055533999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"47'177","reported_seq":1557,"reported_epoch":47,"state":"active+undersized+degraded","last_fresh":"2024-09-12T16:16:34.388934+0000","last_change":"2024-09-12T16:16:17.076255+0000","last_active":"2024-09-12T16:16:34.388934+0000","last_peered":"2024-09-12T16:16:34.388934+0000","last_clean":"2024-09-12T16:16:15.067586+0000","last_became_active":"2024-09-12T16:16:17.076255+0000","last_became_peered":"2024-09-12T16:16:17.076255+0000","last_unstale":"2024-09-12T16:16:34.388934+0000","last_undegraded":"2024-09-12T16:16:17.074981+0000","last_fullsized":"2024-09-12T16:16:17.074882+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:23.616790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090313600000000002,"stat_sum":{"num_bytes":5673488,"num_objects":12,"num_object_clones":2,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":12,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":2205,"num_read_kb":5256,"num_write":143,"num_write_kb":2627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":12}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":50,"reported_epoch":47,"state":"active+undersized+degraded","last_fresh":"2024-09-12T16:16:34.106219+0000","last_change":"2024-09-12T16:16:17.076028+0000","last_active":"2024-09-12T16:16:34.106219+0000","last_peered":"2024-09-12T16:16:34.106219+0000","last_clean":"2024-09-12T16:16:09.045614+0000","last_became_active":"2024-09-12T16:16:17.076028+0000","last_became_peered":"2024-09-12T16:16:17.076028+0000","last_unstale":"2024-09-12T16:16:34.106219+0000","last_undegraded":"2024-09-12T16:16:17.075335+0000","last_fullsized":"2024-09-12T16:16:17.075252+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:33.331144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":167,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-12T16:16:34.108349+0000","last_change":"2024-09-12T16:15:42.320223+0000","last_active":"2024-09-12T16:16:34.108349+0000","last_peered":"2024-09-12T16:16:34.108349+0000","last_clean":"2024-09-12T16:16:34.108349+0000","last_became_active":"2024-09-12T16:15:42.319118+0000","last_became_peered":"2024-09-12T16:15:42.319118+0000","last_unstale":"2024-09-12T16:16:34.108349+0000","last_undegraded":"2024-09-12T16:16:34.108349+0000","last_fullsized":"2024-09-12T16:16:34.108349+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:40.751677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:40.751677+0000","last_clean_scrub_stamp":"2024-09-12T16:15:40.751677+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:57.860633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"45'118","reported_seq":1175,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-12T16:16:34.678532+0000","last_change":"2024-09-12T16:16:34.109457+0000","last_active":"2024-09-12T16:16:34.678532+0000","last_peered":"2024-09-12T16:16:34.678532+0000","last_clean":"2024-09-12T16:16:34.678532+0000","last_became_active":"2024-09-12T16:16:34.108998+0000","last_became_peered":"2024-09-12T16:16:34.108998+0000","last_unstale":"2024-09-12T16:16:34.678532+0000","last_undegraded":"2024-09-12T16:16:34.678532+0000","last_fullsized":"2024-09-12T16:16:34.678532+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:32:35.740444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001425398,"stat_sum":{"num_bytes":14456884,"num_objects":9,"num_object_clones":1,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1114,"num_read_kb":6389,"num_write":131,"num_write_kb":1931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"47'165","reported_seq":26845,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-12T16:16:34.680685+0000","last_change":"2024-09-12T16:15:59.014122+0000","last_active":"2024-09-12T16:16:34.680685+0000","last_peered":"2024-09-12T16:16:34.680685+0000","last_clean":"2024-09-12T16:16:34.680685+0000","last_became_active":"2024-09-12T16:15:57.013620+0000","last_became_peered":"2024-09-12T16:15:57.013620+0000","last_unstale":"2024-09-12T16:16:34.680685+0000","last_undegraded":"2024-09-12T16:16:34.680685+0000","last_fullsized":"2024-09-12T16:16:34.680685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:51.237417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074921299999999998,"stat_sum":{"num_bytes":50889216,"num_objects":11,"num_object_clones":3,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":1,"num_read":26661,"num_read_kb":40174,"num_write":167,"num_write_kb":4879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"47'128","reported_seq":9893,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-12T16:16:34.388840+0000","last_change":"2024-09-12T16:15:59.025612+0000","last_active":"2024-09-12T16:16:34.388840+0000","last_peered":"2024-09-12T16:16:34.388840+0000","last_clean":"2024-09-12T16:16:34.388840+0000","last_became_active":"2024-09-12T16:15:57.012222+0000","last_became_peered":"2024-09-12T16:15:57.012222+0000","last_unstale":"2024-09-12T16:16:34.388840+0000","last_undegraded":"2024-09-12T16:16:34.388840+0000","last_fullsized":"2024-09-12T16:16:34.388840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:43.582571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000830695,"stat_sum":{"num_bytes":24522840,"num_objects":15,"num_object_clones":3,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":2,"num_read":9728,"num_read_kb":16542,"num_write":128,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"45'88","reported_seq":342,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-12T16:16:34.107710+0000","last_change":"2024-09-12T16:15:59.015086+0000","last_active":"2024-09-12T16:16:34.107710+0000","last_peered":"2024-09-12T16:16:34.107710+0000","last_clean":"2024-09-12T16:16:34.107710+0000","last_became_active":"2024-09-12T16:15:57.012845+0000","last_became_peered":"2024-09-12T16:15:57.012845+0000","last_unstale":"2024-09-12T16:16:34.107710+0000","last_undegraded":"2024-09-12T16:16:34.107710+0000","last_fullsized":"2024-09-12T16:16:34.107710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:24:57.470811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001291885,"stat_sum":{"num_bytes":1757200,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":192,"num_read_kb":1019,"num_write":87,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"47'130","reported_seq":3134,"reported_epoch":47,"state":"active+undersized+degraded","last_fresh":"2024-09-12T16:16:34.680525+0000","last_change":"2024-09-12T16:16:17.077684+0000","last_active":"2024-09-12T16:16:34.680525+0000","last_peered":"2024-09-12T16:16:34.680525+0000","last_clean":"2024-09-12T16:16:15.070042+0000","last_became_active":"2024-09-12T16:16:17.077684+0000","last_became_peered":"2024-09-12T16:16:17.077684+0000","last_unstale":"2024-09-12T16:16:34.680525+0000","last_undegraded":"2024-09-12T16:16:17.077158+0000","last_fullsized":"2024-09-12T16:16:17.077077+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:20.987146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001361817,"stat_sum":{"num_bytes":15913472,"num_objects":12,"num_object_clones":2,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":12,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2954,"num_read_kb":21669,"num_write":130,"num_write_kb":2391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"47'258","reported_seq":2696,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-12T16:16:34.394571+0000","last_change":"2024-09-12T16:15:59.025928+0000","last_active":"2024-09-12T16:16:34.394571+0000","last_peered":"2024-09-12T16:16:34.394571+0000","last_clean":"2024-09-12T16:16:34.394571+0000","last_became_active":"2024-09-12T16:15:57.010890+0000","last_became_peered":"2024-09-12T16:15:57.010890+0000","last_unstale":"2024-09-12T16:16:34.394571+0000","last_undegraded":"2024-09-12T16:16:34.394571+0000","last_fullsized":"2024-09-12T16:16:34.394571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:49.422632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096169400000000003,"stat_sum":{"num_bytes":12565553,"num_objects":20,"num_object_clones":5,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":3,"num_read":3177,"num_read_kb":9450,"num_write":296,"num_write_kb":3491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"45'153","reported_seq":1871,"reported_epoch":47,"state":"active+undersized+degraded","last_fresh":"2024-09-12T16:16:34.678835+0000","last_change":"2024-09-12T16:16:17.074867+0000","last_active":"2024-09-12T16:16:34.678835+0000","last_peered":"2024-09-12T16:16:34.678835+0000","last_clean":"2024-09-12T16:16:15.505386+0000","last_became_active":"2024-09-12T16:16:17.074867+0000","last_became_peered":"2024-09-12T16:16:17.074867+0000","last_unstale":"2024-09-12T16:16:34.678835+0000","last_undegraded":"2024-09-12T16:16:17.074397+0000","last_fullsized":"2024-09-12T16:16:17.074341+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:37.609648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013436100000000001,"stat_sum":{"num_bytes":3466240,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":9,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":2217,"num_read_kb":6780,"num_write":140,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":9}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"45'89","reported_seq":1875,"reported_epoch":47,"state":"active+undersized+degraded","last_fresh":"2024-09-12T16:16:34.680109+0000","last_change":"2024-09-12T16:16:17.077357+0000","last_active":"2024-09-12T16:16:34.680109+0000","last_peered":"2024-09-12T16:16:34.680109+0000","last_clean":"2024-09-12T16:16:15.074375+0000","last_became_active":"2024-09-12T16:16:17.077357+0000","last_became_peered":"2024-09-12T16:16:17.077357+0000","last_unstale":"2024-09-12T16:16:34.680109+0000","last_undegraded":"2024-09-12T16:16:17.076846+0000","last_fullsized":"2024-09-12T16:16:17.076764+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:50.311351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001280946,"stat_sum":{"num_bytes":2958352,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1746,"num_read_kb":11901,"num_write":90,"num_write_kb":1138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":6}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"47'97","reported_seq":769,"reported_epoch":47,"state":"active+undersized+degraded","last_fresh":"2024-09-12T16:16:34.392916+0000","last_change":"2024-09-12T16:16:17.077694+0000","last_active":"2024-09-12T16:16:34.392916+0000","last_peered":"2024-09-12T16:16:34.392916+0000","last_clean":"2024-09-12T16:16:15.069976+0000","last_became_active":"2024-09-12T16:16:17.077694+0000","last_became_peered":"2024-09-12T16:16:17.077694+0000","last_unstale":"2024-09-12T16:16:34.392916+0000","last_undegraded":"2024-09-12T16:16:17.077150+0000","last_fullsized":"2024-09-12T16:16:17.077069+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:36.160157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049764000000000004,"stat_sum":{"num_bytes":12040419,"num_objects":12,"num_object_clones":3,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":12,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":621,"num_read_kb":5052,"num_write":154,"num_write_kb":4285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"44'89","reported_seq":629,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-12T16:16:34.108344+0000","last_change":"2024-09-12T16:15:59.025278+0000","last_active":"2024-09-12T16:16:34.108344+0000","last_peered":"2024-09-12T16:16:34.108344+0000","last_clean":"2024-09-12T16:16:34.108344+0000","last_became_active":"2024-09-12T16:15:57.013364+0000","last_became_peered":"2024-09-12T16:15:57.013364+0000","last_unstale":"2024-09-12T16:16:34.108344+0000","last_undegraded":"2024-09-12T16:16:34.108344+0000","last_fullsized":"2024-09-12T16:16:34.108344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:25.661660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058531000000000002,"stat_sum":{"num_bytes":1822208,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":473,"num_read_kb":3063,"num_write":89,"num_write_kb":447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"47'182","reported_seq":2027,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-12T16:16:34.455212+0000","last_change":"2024-09-12T16:15:59.310820+0000","last_active":"2024-09-12T16:16:34.455212+0000","last_peered":"2024-09-12T16:16:34.455212+0000","last_clean":"2024-09-12T16:16:34.455212+0000","last_became_active":"2024-09-12T16:15:57.015638+0000","last_became_peered":"2024-09-12T16:15:57.015638+0000","last_unstale":"2024-09-12T16:16:34.455212+0000","last_undegraded":"2024-09-12T16:16:34.455212+0000","last_fullsized":"2024-09-12T16:16:34.455212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:04.961202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049753500000000001,"stat_sum":{"num_bytes":3404288,"num_objects":8,"num_object_clones":1,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":3158,"num_read_kb":4725,"num_write":133,"num_write_kb":1810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"47'130","reported_seq":1659,"reported_epoch":47,"state":"active+undersized+degraded","last_fresh":"2024-09-12T16:16:34.679661+0000","last_change":"2024-09-12T16:16:17.077343+0000","last_active":"2024-09-12T16:16:34.679661+0000","last_peered":"2024-09-12T16:16:34.679661+0000","last_clean":"2024-09-12T16:16:15.074538+0000","last_became_active":"2024-09-12T16:16:17.077343+0000","last_became_peered":"2024-09-12T16:16:17.077343+0000","last_unstale":"2024-09-12T16:16:34.679661+0000","last_undegraded":"2024-09-12T16:16:17.076739+0000","last_fullsized":"2024-09-12T16:16:17.076648+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:53.209340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050533499999999999,"stat_sum":{"num_bytes":11797120,"num_objects":16,"num_object_clones":3,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":16,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":2,"num_read":1525,"num_read_kb":7704,"num_write":128,"num_write_kb":2385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":16}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":387670703,"num_objects":351,"num_object_clones":64,"num_object_copies":702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":124,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":351,"num_whiteouts":43,"num_read":104365,"num_read_kb":268922,"num_write":7649,"num_write_kb":55153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":50102272,"data_stored":84288206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6393,"ondisk_log_size":6393,"up":53,"acting":53,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":14,"acting":14,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640265,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36948,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334892,"statfs":{"total":96636764160,"available":96598929408,"internally_reserved":0,"allocated":1638400,"data_stored":1465146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640270,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50248,"kb_used_data":10604,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94321592,"statfs":{"total":96636764160,"available":96585310208,"internally_reserved":0,"allocated":10858496,"data_stored":13729513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640271,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55352,"kb_used_data":15840,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94316488,"statfs":{"total":96636764160,"available":96580083712,"internally_reserved":0,"allocated":16220160,"data_stored":23220214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640272,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50580,"kb_used_data":11060,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94321260,"statfs":{"total":96636764160,"available":96584970240,"internally_reserved":0,"allocated":11325440,"data_stored":19165785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640270,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43344,"kb_used_data":3832,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94328496,"statfs":{"total":96636764160,"available":96592379904,"internally_reserved":0,"allocated":3923968,"data_stored":3426607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640271,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49580,"kb_used_data":10076,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322260,"statfs":{"total":96636764160,"available":96585994240,"internally_reserved":0,"allocated":10317824,"data_stored":16557323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9199616,"data_stored":15762918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3407872,"data_stored":4523876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":10801152,"data_stored":18961748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15101952,"data_stored":26308817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10334208,"data_stored":17408484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1257472,"data_stored":1322363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T16:16:38.609 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg force-recovery 2.2 3.2 2.3 3.c 3.e 3.10 2024-09-12T16:16:38.617 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:16:38.659 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:38.657+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:38.737 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:38.735+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:38.776 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:38.776 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:38.786 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:16:38.870 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:38.868+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:38.910 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T16:16:38.937 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:38.937 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:38.938 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:38.937+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:38.947 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:16:38.983 INFO:teuthology.orchestra.run.smithi017.stderr:instructing pg(s) [3.c,3.10] on osd.0 to force-recovery; instructing pg(s) [2.2,3.2] on osd.1 to force-recovery; instructing pg(s) [2.3] on osd.2 to force-recovery; instructing pg(s) [3.e] on osd.4 to force-recovery; 2024-09-12T16:16:38.983 INFO:teuthology.orchestra.run.smithi017.stderr: 2024-09-12T16:16:39.040 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:39.038+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:39.043 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:16:39.044 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:16:39.064 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:16:39.064 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:16:39.082 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:16:39.083 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:16:39.099 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:16:39.099 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:16:39.102 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:39.102 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:39.102 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:16:39.102 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:16:39.103 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:39.112 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:16:39.116 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:16:39.117 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:16:39.117 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-12T16:16:39.120 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T16:16:39.120 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T16:16:39.140 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:39.139+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:39.226 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:39.226 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:16:39.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:16:39.226 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:39.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.227 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2256 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12192768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:39.227 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.889586+0000", 2024-09-12T16:16:39.227 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.335185355, 2024-09-12T16:16:39.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037086439999999998, 2024-09-12T16:16:39.227 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.227 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.227 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.227 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.227 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:39.227 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:39.227 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2256 2024-09-12T16:16:39.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.227 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.889586+0000", 2024-09-12T16:16:39.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.889586+0000", 2024-09-12T16:16:39.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.894952+0000", 2024-09-12T16:16:39.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0053653260000000001 2024-09-12T16:16:39.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.894956+0000", 2024-09-12T16:16:39.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2640000000000002e-06 2024-09-12T16:16:39.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.894966+0000", 2024-09-12T16:16:39.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0607e-05 2024-09-12T16:16:39.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.894982+0000", 2024-09-12T16:16:39.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5528000000000001e-05 2024-09-12T16:16:39.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.926510+0000", 2024-09-12T16:16:39.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.031528325000000003 2024-09-12T16:16:39.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.926593+0000", 2024-09-12T16:16:39.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2812999999999995e-05 2024-09-12T16:16:39.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.926673+0000", 2024-09-12T16:16:39.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9577000000000001e-05 2024-09-12T16:16:39.231 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.231 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.231 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.232 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2298 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12364800~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:39.232 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.895981+0000", 2024-09-12T16:16:39.232 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.328790183999999, 2024-09-12T16:16:39.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037134176999999997, 2024-09-12T16:16:39.232 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.232 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.232 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.232 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.232 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:39.232 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:39.232 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2298 2024-09-12T16:16:39.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.233 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.895981+0000", 2024-09-12T16:16:39.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.895981+0000", 2024-09-12T16:16:39.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.895982+0000", 2024-09-12T16:16:39.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6400000000000003e-07 2024-09-12T16:16:39.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.895984+0000", 2024-09-12T16:16:39.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1500000000000002e-06 2024-09-12T16:16:39.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.895991+0000", 2024-09-12T16:16:39.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8730000000000001e-06 2024-09-12T16:16:39.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.895996+0000", 2024-09-12T16:16:39.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1800000000000004e-06 2024-09-12T16:16:39.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.932938+0000", 2024-09-12T16:16:39.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036941781 2024-09-12T16:16:39.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933028+0000", 2024-09-12T16:16:39.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0493000000000002e-05 2024-09-12T16:16:39.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933116+0000", 2024-09-12T16:16:39.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7236000000000003e-05 2024-09-12T16:16:39.236 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.236 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.236 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.236 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2299 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12368896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:39.236 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896004+0000", 2024-09-12T16:16:39.237 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.328767477, 2024-09-12T16:16:39.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037218257999999997, 2024-09-12T16:16:39.237 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.237 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.237 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.237 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.237 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:39.237 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:39.237 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2299 2024-09-12T16:16:39.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.237 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.237 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896004+0000", 2024-09-12T16:16:39.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.238 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896004+0000", 2024-09-12T16:16:39.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.238 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896005+0000", 2024-09-12T16:16:39.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3700000000000001e-07 2024-09-12T16:16:39.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896006+0000", 2024-09-12T16:16:39.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9929999999999998e-06 2024-09-12T16:16:39.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896013+0000", 2024-09-12T16:16:39.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1709999999999999e-06 2024-09-12T16:16:39.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896017+0000", 2024-09-12T16:16:39.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5050000000000001e-06 2024-09-12T16:16:39.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933142+0000", 2024-09-12T16:16:39.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037125012999999998 2024-09-12T16:16:39.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933182+0000", 2024-09-12T16:16:39.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9957999999999999e-05 2024-09-12T16:16:39.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933222+0000", 2024-09-12T16:16:39.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0181e-05 2024-09-12T16:16:39.241 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.241 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.241 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.241 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2300 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12372992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:39.241 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:16:39.242 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.32874782, 2024-09-12T16:16:39.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037401246999999999, 2024-09-12T16:16:39.242 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.242 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.242 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.242 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.242 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:39.242 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:39.243 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2300 2024-09-12T16:16:39.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.243 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:16:39.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.244 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:16:39.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:16:39.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6100000000000002e-07 2024-09-12T16:16:39.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896026+0000", 2024-09-12T16:16:39.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9130000000000001e-06 2024-09-12T16:16:39.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896032+0000", 2024-09-12T16:16:39.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7540000000000003e-06 2024-09-12T16:16:39.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896036+0000", 2024-09-12T16:16:39.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5750000000000002e-06 2024-09-12T16:16:39.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933254+0000", 2024-09-12T16:16:39.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037217962 2024-09-12T16:16:39.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933341+0000", 2024-09-12T16:16:39.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6296000000000002e-05 2024-09-12T16:16:39.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933425+0000", 2024-09-12T16:16:39.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4386000000000001e-05 2024-09-12T16:16:39.249 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.249 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.249 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.249 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2301 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12377088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:39.249 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896043+0000", 2024-09-12T16:16:39.249 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.328728078000001, 2024-09-12T16:16:39.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037486197999999998, 2024-09-12T16:16:39.249 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.249 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.250 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.250 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.250 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:39.250 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:39.250 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2301 2024-09-12T16:16:39.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.250 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.250 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896043+0000", 2024-09-12T16:16:39.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896043+0000", 2024-09-12T16:16:39.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896044+0000", 2024-09-12T16:16:39.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.41e-07 2024-09-12T16:16:39.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896053+0000", 2024-09-12T16:16:39.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8049999999999996e-06 2024-09-12T16:16:39.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896060+0000", 2024-09-12T16:16:39.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.221e-06 2024-09-12T16:16:39.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896065+0000", 2024-09-12T16:16:39.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1109999999999999e-06 2024-09-12T16:16:39.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933452+0000", 2024-09-12T16:16:39.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037386560999999999 2024-09-12T16:16:39.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933491+0000", 2024-09-12T16:16:39.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9789000000000001e-05 2024-09-12T16:16:39.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933530+0000", 2024-09-12T16:16:39.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.837e-05 2024-09-12T16:16:39.253 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.253 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.253 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.254 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2302 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12381184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:39.254 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:16:39.254 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.328686638000001, 2024-09-12T16:16:39.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037645284000000001, 2024-09-12T16:16:39.254 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.254 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.254 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.254 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.254 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:39.254 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:39.254 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2302 2024-09-12T16:16:39.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.254 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:16:39.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:16:39.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:16:39.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6800000000000001e-07 2024-09-12T16:16:39.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896088+0000", 2024-09-12T16:16:39.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3429999999999998e-06 2024-09-12T16:16:39.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896096+0000", 2024-09-12T16:16:39.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0860000000000002e-06 2024-09-12T16:16:39.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896102+0000", 2024-09-12T16:16:39.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7610000000000004e-06 2024-09-12T16:16:39.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933563+0000", 2024-09-12T16:16:39.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037461019999999998 2024-09-12T16:16:39.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933648+0000", 2024-09-12T16:16:39.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5468000000000002e-05 2024-09-12T16:16:39.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933730+0000", 2024-09-12T16:16:39.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2138000000000005e-05 2024-09-12T16:16:39.258 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.258 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.258 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.258 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2303 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12385280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:39.258 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:16:39.258 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.328662835999999, 2024-09-12T16:16:39.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037723083999999997, 2024-09-12T16:16:39.258 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.259 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.259 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.259 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.259 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:39.259 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:39.259 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2303 2024-09-12T16:16:39.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.259 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:16:39.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:16:39.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:16:39.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2500000000000001e-07 2024-09-12T16:16:39.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896115+0000", 2024-09-12T16:16:39.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.28e-06 2024-09-12T16:16:39.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896122+0000", 2024-09-12T16:16:39.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4590000000000003e-06 2024-09-12T16:16:39.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896127+0000", 2024-09-12T16:16:39.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0509999999999996e-06 2024-09-12T16:16:39.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933755+0000", 2024-09-12T16:16:39.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037627729999999998 2024-09-12T16:16:39.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933794+0000", 2024-09-12T16:16:39.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9255000000000003e-05 2024-09-12T16:16:39.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933832+0000", 2024-09-12T16:16:39.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7883999999999998e-05 2024-09-12T16:16:39.262 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.262 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.262 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.263 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2304 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12389376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:39.263 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:16:39.263 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.328637487000002, 2024-09-12T16:16:39.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037911010000000002, 2024-09-12T16:16:39.263 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.263 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.263 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.263 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.263 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:39.263 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:39.263 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2304 2024-09-12T16:16:39.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.263 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:16:39.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:16:39.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:16:39.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9900000000000001e-07 2024-09-12T16:16:39.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896136+0000", 2024-09-12T16:16:39.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.897e-06 2024-09-12T16:16:39.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896142+0000", 2024-09-12T16:16:39.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9290000000000003e-06 2024-09-12T16:16:39.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896154+0000", 2024-09-12T16:16:39.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.201e-05 2024-09-12T16:16:39.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933865+0000", 2024-09-12T16:16:39.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037710225 2024-09-12T16:16:39.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933961+0000", 2024-09-12T16:16:39.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6315000000000002e-05 2024-09-12T16:16:39.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934045+0000", 2024-09-12T16:16:39.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4234999999999996e-05 2024-09-12T16:16:39.267 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.267 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.267 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.267 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2305 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12393472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:39.267 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896175+0000", 2024-09-12T16:16:39.267 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.328596297000001, 2024-09-12T16:16:39.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037976941, 2024-09-12T16:16:39.267 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.267 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.267 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.268 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.268 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:39.268 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:39.268 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2305 2024-09-12T16:16:39.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.268 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896175+0000", 2024-09-12T16:16:39.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896175+0000", 2024-09-12T16:16:39.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896176+0000", 2024-09-12T16:16:39.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7400000000000003e-07 2024-09-12T16:16:39.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896178+0000", 2024-09-12T16:16:39.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6709999999999999e-06 2024-09-12T16:16:39.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896186+0000", 2024-09-12T16:16:39.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9319999999999996e-06 2024-09-12T16:16:39.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896192+0000", 2024-09-12T16:16:39.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0799999999999996e-06 2024-09-12T16:16:39.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934072+0000", 2024-09-12T16:16:39.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037880888000000001 2024-09-12T16:16:39.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934113+0000", 2024-09-12T16:16:39.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0815999999999997e-05 2024-09-12T16:16:39.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934152+0000", 2024-09-12T16:16:39.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8980000000000003e-05 2024-09-12T16:16:39.271 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.271 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.271 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.272 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2306 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12397568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:39.272 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:16:39.272 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.328572018999999, 2024-09-12T16:16:39.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038156347, 2024-09-12T16:16:39.272 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.272 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.272 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.272 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.272 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:39.272 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:39.272 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2306 2024-09-12T16:16:39.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.273 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:16:39.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:16:39.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:16:39.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.77e-07 2024-09-12T16:16:39.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896202+0000", 2024-09-12T16:16:39.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2359999999999999e-06 2024-09-12T16:16:39.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896208+0000", 2024-09-12T16:16:39.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1430000000000003e-06 2024-09-12T16:16:39.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896213+0000", 2024-09-12T16:16:39.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9339999999999997e-06 2024-09-12T16:16:39.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934188+0000", 2024-09-12T16:16:39.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037974490999999999 2024-09-12T16:16:39.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934275+0000", 2024-09-12T16:16:39.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7639999999999994e-05 2024-09-12T16:16:39.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934356+0000", 2024-09-12T16:16:39.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0525999999999994e-05 2024-09-12T16:16:39.276 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.276 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.276 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.276 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2307 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12401664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:39.276 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:16:39.276 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.328552247000001, 2024-09-12T16:16:39.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038241450000000003, 2024-09-12T16:16:39.277 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.277 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.277 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.277 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.277 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:39.277 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:39.277 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2307 2024-09-12T16:16:39.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.277 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:16:39.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:16:39.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896220+0000", 2024-09-12T16:16:39.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3500000000000002e-07 2024-09-12T16:16:39.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896222+0000", 2024-09-12T16:16:39.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1720000000000001e-06 2024-09-12T16:16:39.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896228+0000", 2024-09-12T16:16:39.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0870000000000003e-06 2024-09-12T16:16:39.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896233+0000", 2024-09-12T16:16:39.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:16:39.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934382+0000", 2024-09-12T16:16:39.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038149566000000003 2024-09-12T16:16:39.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934422+0000", 2024-09-12T16:16:39.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0015999999999998e-05 2024-09-12T16:16:39.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934461+0000", 2024-09-12T16:16:39.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8423999999999997e-05 2024-09-12T16:16:39.280 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.280 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.281 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.281 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2308 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12405760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:39.281 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:16:39.281 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.328532549999998, 2024-09-12T16:16:39.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038420745999999999, 2024-09-12T16:16:39.281 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.281 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.281 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.281 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.281 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:39.281 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:39.281 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2308 2024-09-12T16:16:39.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.282 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:16:39.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:16:39.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:16:39.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.58e-07 2024-09-12T16:16:39.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896241+0000", 2024-09-12T16:16:39.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7940000000000001e-06 2024-09-12T16:16:39.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896247+0000", 2024-09-12T16:16:39.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1460000000000001e-06 2024-09-12T16:16:39.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896252+0000", 2024-09-12T16:16:39.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6840000000000004e-06 2024-09-12T16:16:39.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934494+0000", 2024-09-12T16:16:39.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038242362000000002 2024-09-12T16:16:39.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934579+0000", 2024-09-12T16:16:39.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5044999999999996e-05 2024-09-12T16:16:39.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934660+0000", 2024-09-12T16:16:39.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0357000000000003e-05 2024-09-12T16:16:39.285 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.285 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.285 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.285 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2309 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12409856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:39.285 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:16:39.285 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.328511970000001, 2024-09-12T16:16:39.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038504629999999998, 2024-09-12T16:16:39.285 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.285 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2309 2024-09-12T16:16:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:16:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:16:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:16:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5199999999999998e-07 2024-09-12T16:16:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896263+0000", 2024-09-12T16:16:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4209999999999999e-06 2024-09-12T16:16:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896269+0000", 2024-09-12T16:16:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9449999999999998e-06 2024-09-12T16:16:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896274+0000", 2024-09-12T16:16:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3950000000000003e-06 2024-09-12T16:16:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934686+0000", 2024-09-12T16:16:39.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038412333999999999 2024-09-12T16:16:39.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934727+0000", 2024-09-12T16:16:39.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0649999999999999e-05 2024-09-12T16:16:39.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934764+0000", 2024-09-12T16:16:39.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7533000000000001e-05 2024-09-12T16:16:39.290 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.290 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.291 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.291 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2310 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12413952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:39.291 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:16:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.328491098000001, 2024-09-12T16:16:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038694183, 2024-09-12T16:16:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2310 2024-09-12T16:16:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:16:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:16:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896281+0000", 2024-09-12T16:16:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1399999999999997e-07 2024-09-12T16:16:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896283+0000", 2024-09-12T16:16:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9549999999999999e-06 2024-09-12T16:16:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896289+0000", 2024-09-12T16:16:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8669999999999999e-06 2024-09-12T16:16:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896301+0000", 2024-09-12T16:16:39.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1807999999999999e-05 2024-09-12T16:16:39.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934798+0000", 2024-09-12T16:16:39.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038497591999999997 2024-09-12T16:16:39.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934885+0000", 2024-09-12T16:16:39.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7149000000000002e-05 2024-09-12T16:16:39.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934975+0000", 2024-09-12T16:16:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9297999999999998e-05 2024-09-12T16:16:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2311 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12418048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:16:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.328463842000001, 2024-09-12T16:16:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038768558000000002, 2024-09-12T16:16:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2311 2024-09-12T16:16:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:16:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:16:39.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:16:39.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.63e-07 2024-09-12T16:16:39.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896310+0000", 2024-09-12T16:16:39.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1560000000000002e-06 2024-09-12T16:16:39.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.300 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896316+0000", 2024-09-12T16:16:39.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0249999999999999e-06 2024-09-12T16:16:39.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896322+0000", 2024-09-12T16:16:39.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6400000000000002e-06 2024-09-12T16:16:39.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934997+0000", 2024-09-12T16:16:39.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038674565000000001 2024-09-12T16:16:39.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935037+0000", 2024-09-12T16:16:39.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0485999999999998e-05 2024-09-12T16:16:39.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935076+0000", 2024-09-12T16:16:39.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9223e-05 2024-09-12T16:16:39.304 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.304 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.304 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.304 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2312 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12422144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:39.305 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:16:39.305 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.328443149000002, 2024-09-12T16:16:39.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038856784999999998, 2024-09-12T16:16:39.305 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.305 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.305 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.305 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.305 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:39.305 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:39.305 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2312 2024-09-12T16:16:39.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.305 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:16:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:16:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896329+0000", 2024-09-12T16:16:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5499999999999999e-07 2024-09-12T16:16:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896337+0000", 2024-09-12T16:16:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0819999999999999e-06 2024-09-12T16:16:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896343+0000", 2024-09-12T16:16:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.263e-06 2024-09-12T16:16:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896348+0000", 2024-09-12T16:16:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8860000000000003e-06 2024-09-12T16:16:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935097+0000", 2024-09-12T16:16:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038748818999999997 2024-09-12T16:16:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935141+0000", 2024-09-12T16:16:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4175000000000003e-05 2024-09-12T16:16:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935185+0000", 2024-09-12T16:16:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4205000000000001e-05 2024-09-12T16:16:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2313 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12426240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:16:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.328416934, 2024-09-12T16:16:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038928683999999998, 2024-09-12T16:16:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2313 2024-09-12T16:16:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:16:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:16:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:16:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0400000000000002e-07 2024-09-12T16:16:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896357+0000", 2024-09-12T16:16:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.097e-06 2024-09-12T16:16:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896363+0000", 2024-09-12T16:16:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5119999999999999e-06 2024-09-12T16:16:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896374+0000", 2024-09-12T16:16:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1381e-05 2024-09-12T16:16:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935205+0000", 2024-09-12T16:16:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038830549999999998 2024-09-12T16:16:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935244+0000", 2024-09-12T16:16:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9520000000000001e-05 2024-09-12T16:16:39.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.313 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.313 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935283+0000", 2024-09-12T16:16:39.313 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9220000000000001e-05 2024-09-12T16:16:39.313 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.313 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.313 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.313 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2314 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12430336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:39.313 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:16:39.314 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.328379764000001, 2024-09-12T16:16:39.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039008137999999998, 2024-09-12T16:16:39.314 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.314 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.314 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.314 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.314 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:39.314 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:39.314 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2314 2024-09-12T16:16:39.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:16:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:16:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:16:39.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6499999999999999e-07 2024-09-12T16:16:39.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896395+0000", 2024-09-12T16:16:39.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2960000000000001e-06 2024-09-12T16:16:39.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896402+0000", 2024-09-12T16:16:39.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2280000000000001e-06 2024-09-12T16:16:39.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896407+0000", 2024-09-12T16:16:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3630000000000002e-06 2024-09-12T16:16:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935302+0000", 2024-09-12T16:16:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038895181000000001 2024-09-12T16:16:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935343+0000", 2024-09-12T16:16:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0590999999999998e-05 2024-09-12T16:16:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935400+0000", 2024-09-12T16:16:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7014e-05 2024-09-12T16:16:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2315 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12434432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:16:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.328357112999999, 2024-09-12T16:16:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039083892000000002, 2024-09-12T16:16:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.319 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.319 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.319 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.319 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:39.319 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:39.319 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2315 2024-09-12T16:16:39.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.319 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:16:39.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:16:39.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896415+0000", 2024-09-12T16:16:39.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3300000000000002e-07 2024-09-12T16:16:39.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896421+0000", 2024-09-12T16:16:39.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7579999999999998e-06 2024-09-12T16:16:39.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.321 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.321 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896427+0000", 2024-09-12T16:16:39.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3029999999999996e-06 2024-09-12T16:16:39.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.321 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.321 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896432+0000", 2024-09-12T16:16:39.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.215e-06 2024-09-12T16:16:39.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.321 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.321 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935420+0000", 2024-09-12T16:16:39.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038987727 2024-09-12T16:16:39.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.322 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.322 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935460+0000", 2024-09-12T16:16:39.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9817999999999997e-05 2024-09-12T16:16:39.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.322 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.322 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935498+0000", 2024-09-12T16:16:39.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8438e-05 2024-09-12T16:16:39.322 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.322 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.322 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.323 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2316 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12438528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:39.323 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:16:39.323 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.328332460999999, 2024-09-12T16:16:39.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039160043999999998, 2024-09-12T16:16:39.323 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.323 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.323 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.323 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.323 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:39.323 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:39.323 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2316 2024-09-12T16:16:39.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.323 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:16:39.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:16:39.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901945+0000", 2024-09-12T16:16:39.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055056050000000002 2024-09-12T16:16:39.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.325 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.325 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901950+0000", 2024-09-12T16:16:39.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2490000000000001e-06 2024-09-12T16:16:39.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.325 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.325 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901966+0000", 2024-09-12T16:16:39.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6325e-05 2024-09-12T16:16:39.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.326 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901974+0000", 2024-09-12T16:16:39.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7570000000000004e-06 2024-09-12T16:16:39.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.326 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935518+0000", 2024-09-12T16:16:39.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033543587999999999 2024-09-12T16:16:39.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935559+0000", 2024-09-12T16:16:39.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1746000000000003e-05 2024-09-12T16:16:39.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935599+0000", 2024-09-12T16:16:39.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9774000000000002e-05 2024-09-12T16:16:39.327 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.327 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.327 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.327 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.328 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.328 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:39.329 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:16:39.330 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:39.327+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:39.366 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #11, image image_client.0-clone11 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent12 2024-09-12T16:16:39.418 INFO:teuthology.orchestra.run.smithi204.stdout:2541 trunc from 0x7d78200 to 0x8f26200 2024-09-12T16:16:39.429 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:39.428+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:39.449 INFO:teuthology.orchestra.run.smithi204.stdout:2542 write 0xa4d7800 thru 0xa4e23a5 (0xaba6 bytes) 2024-09-12T16:16:39.464 INFO:teuthology.orchestra.run.smithi204.stdout:2544 write 0xb484200 thru 0xb484b8e (0x98f bytes) 2024-09-12T16:16:39.466 INFO:teuthology.orchestra.run.smithi204.stdout:2545 write 0x6831c00 thru 0x6839acf (0x7ed0 bytes) 2024-09-12T16:16:39.466 INFO:teuthology.orchestra.run.smithi204.stdout:2546 read 0x2202a00 thru 0x2210ae4 (0xe0e5 bytes) 2024-09-12T16:16:39.469 INFO:teuthology.orchestra.run.smithi204.stdout:2550 write 0x212f200 thru 0x2136507 (0x7308 bytes) 2024-09-12T16:16:39.470 INFO:teuthology.orchestra.run.smithi204.stdout:2551 read 0x9971200 thru 0x9980028 (0xee29 bytes) 2024-09-12T16:16:39.470 INFO:teuthology.orchestra.run.smithi204.stdout:2554 write 0x6b31800 thru 0x6b391c5 (0x79c6 bytes) 2024-09-12T16:16:39.471 INFO:teuthology.orchestra.run.smithi204.stdout:2556 punch from 0x575e200 to 0x5768800, (0xa600 bytes) 2024-09-12T16:16:39.473 INFO:teuthology.orchestra.run.smithi204.stdout:2558 read 0xee5200 thru 0xef2440 (0xd241 bytes) 2024-09-12T16:16:39.482 INFO:teuthology.orchestra.run.smithi204.stdout:2560 read 0x3ef5e00 thru 0x3ef6132 (0x333 bytes) 2024-09-12T16:16:39.483 INFO:teuthology.orchestra.run.smithi204.stdout:2562 write 0x5f17400 thru 0x5f214c2 (0xa0c3 bytes) 2024-09-12T16:16:39.492 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:39.492 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:39.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.492 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4944.0:798 3.7 3:e1dc7340:::rbd_data.1155525b14e3.0000000000000000:f [read 4096~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-12T16:16:39.492 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:39.491542+0000", 2024-09-12T16:16:39.492 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.00016994199999999999, 2024-09-12T16:16:39.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019521600000000001, 2024-09-12T16:16:39.493 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.493 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.493 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:16:39.493 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.493 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4944", 2024-09-12T16:16:39.493 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:39.493 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 798 2024-09-12T16:16:39.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.493 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.493 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.493 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:39.491542+0000", 2024-09-12T16:16:39.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.494 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.494 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:39.491542+0000", 2024-09-12T16:16:39.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.494 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.494 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:39.491543+0000", 2024-09-12T16:16:39.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0440000000000001e-06 2024-09-12T16:16:39.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.495 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:39.491548+0000", 2024-09-12T16:16:39.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5390000000000001e-06 2024-09-12T16:16:39.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.495 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:39.491584+0000", 2024-09-12T16:16:39.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6834e-05 2024-09-12T16:16:39.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.495 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:39.491593+0000", 2024-09-12T16:16:39.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0080000000000008e-06 2024-09-12T16:16:39.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.496 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.496 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:39.491682+0000", 2024-09-12T16:16:39.496 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8373000000000002e-05 2024-09-12T16:16:39.496 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.496 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.496 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.496 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4944.0:804 3.7 3.4d92087 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-12T16:16:39.496 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:39.491616+0000", 2024-09-12T16:16:39.496 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.6267999999999994e-05, 2024-09-12T16:16:39.497 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018924299999999999, 2024-09-12T16:16:39.497 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.497 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.497 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:39.497 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.497 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4944", 2024-09-12T16:16:39.497 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:39.497 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 804 2024-09-12T16:16:39.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.497 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.497 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.497 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:39.491616+0000", 2024-09-12T16:16:39.497 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:39.491616+0000", 2024-09-12T16:16:39.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:39.491616+0000", 2024-09-12T16:16:39.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8500000000000001e-07 2024-09-12T16:16:39.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:39.491620+0000", 2024-09-12T16:16:39.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9740000000000004e-06 2024-09-12T16:16:39.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:39.491629+0000", 2024-09-12T16:16:39.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3550000000000005e-06 2024-09-12T16:16:39.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:39.491635+0000", 2024-09-12T16:16:39.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3199999999999996e-06 2024-09-12T16:16:39.499 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.499 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.499 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.500 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4944.0:806 3.7 3.2ce3b87 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-12T16:16:39.500 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:39.491776+0000", 2024-09-12T16:16:39.500 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4294967295.9999356, 2024-09-12T16:16:39.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8951999999999999e-05, 2024-09-12T16:16:39.500 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.500 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.500 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:39.500 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.500 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4944", 2024-09-12T16:16:39.500 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:39.500 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 806 2024-09-12T16:16:39.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.501 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.501 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.501 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:39.491776+0000", 2024-09-12T16:16:39.501 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.501 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.501 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:39.491776+0000", 2024-09-12T16:16:39.501 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.501 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.502 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:39.491777+0000", 2024-09-12T16:16:39.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2699999999999998e-07 2024-09-12T16:16:39.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.502 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.502 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:39.491781+0000", 2024-09-12T16:16:39.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4429999999999999e-06 2024-09-12T16:16:39.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.502 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.502 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:39.491792+0000", 2024-09-12T16:16:39.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1790000000000001e-05 2024-09-12T16:16:39.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:39.491800+0000", 2024-09-12T16:16:39.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3309999999999998e-06 2024-09-12T16:16:39.503 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.503 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.503 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.503 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4944.0:811 3.7 3.4d92087 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-12T16:16:39.503 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:39.491821+0000", 2024-09-12T16:16:39.503 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4294967295.9998913, 2024-09-12T16:16:39.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7750999999999994e-05, 2024-09-12T16:16:39.503 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.503 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.504 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:39.504 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.504 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4944", 2024-09-12T16:16:39.504 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:39.504 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 811 2024-09-12T16:16:39.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.504 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.504 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.504 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:39.491821+0000", 2024-09-12T16:16:39.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.504 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.505 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:39.491821+0000", 2024-09-12T16:16:39.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.505 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.505 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:39.491821+0000", 2024-09-12T16:16:39.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5099999999999999e-07 2024-09-12T16:16:39.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.505 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.505 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:39.491825+0000", 2024-09-12T16:16:39.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3500000000000001e-06 2024-09-12T16:16:39.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.506 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.506 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:39.491833+0000", 2024-09-12T16:16:39.506 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9279999999999993e-06 2024-09-12T16:16:39.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.506 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.506 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:39.491838+0000", 2024-09-12T16:16:39.506 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9030000000000001e-06 2024-09-12T16:16:39.506 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.506 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.506 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.506 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.506 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-12T16:16:39.506 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 4 2024-09-12T16:16:39.507 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:39.507 INFO:teuthology.orchestra.run.smithi204.stdout:2563 trunc from 0xb484c00 to 0x3902400 2024-09-12T16:16:39.508 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:16:39.530 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:39.529+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:39.537 INFO:teuthology.orchestra.run.smithi204.stdout:2566 read 0x14e7600 thru 0x14edc70 (0x6671 bytes) 2024-09-12T16:16:39.544 INFO:teuthology.orchestra.run.smithi204.stdout:2567 trunc from 0x3902400 to 0x7d0f800 2024-09-12T16:16:39.552 INFO:teuthology.orchestra.run.smithi204.stdout:2568 read 0x610e200 thru 0x611a75f (0xc560 bytes) 2024-09-12T16:16:39.553 INFO:teuthology.orchestra.run.smithi204.stdout:2569 read 0x6db000 thru 0x6dcd30 (0x1d31 bytes) 2024-09-12T16:16:39.566 INFO:teuthology.orchestra.run.smithi204.stdout:2570 write 0x8a1e800 thru 0x8a28aee (0xa2ef bytes) 2024-09-12T16:16:39.567 INFO:teuthology.orchestra.run.smithi204.stdout:2571 write 0x352a200 thru 0x353823f (0xe040 bytes) 2024-09-12T16:16:39.570 INFO:teuthology.orchestra.run.smithi204.stdout:2572 read 0x5151200 thru 0x5161059 (0xfe5a bytes) 2024-09-12T16:16:39.571 INFO:teuthology.orchestra.run.smithi204.stdout:2573 trunc from 0x8a28c00 to 0xa7e5200 2024-09-12T16:16:39.590 INFO:teuthology.orchestra.run.smithi204.stdout:2574 write 0x1377e00 thru 0x137cdbb (0x4fbc bytes) 2024-09-12T16:16:39.594 INFO:teuthology.orchestra.run.smithi204.stdout:2575 trunc from 0xa7e5200 to 0x891e000 2024-09-12T16:16:39.610 INFO:teuthology.orchestra.run.smithi204.stdout:2578 read 0x53f6200 thru 0x53ff1d4 (0x8fd5 bytes) 2024-09-12T16:16:39.610 INFO:teuthology.orchestra.run.smithi204.stdout:2586 read 0x1b6400 thru 0x1c539e (0xef9f bytes) 2024-09-12T16:16:39.629 INFO:teuthology.orchestra.run.smithi204.stdout:2587 write 0xd28c200 thru 0xd295592 (0x9393 bytes) 2024-09-12T16:16:39.630 INFO:teuthology.orchestra.run.smithi204.stdout:2589 read 0x4b37600 thru 0x4b3ef82 (0x7983 bytes) 2024-09-12T16:16:39.630 INFO:teuthology.orchestra.run.smithi204.stdout:2590 write 0x598fc00 thru 0x599632b (0x672c bytes) 2024-09-12T16:16:39.631 INFO:teuthology.orchestra.run.smithi204.stdout:2594 write 0x49ec400 thru 0x49efe2f (0x3a30 bytes) 2024-09-12T16:16:39.631 INFO:teuthology.orchestra.run.smithi204.stdout:2595 write 0x4b55400 thru 0x4b601bb (0xadbc bytes) 2024-09-12T16:16:39.631 INFO:teuthology.orchestra.run.smithi204.stdout:2596 write 0x8910e00 thru 0x891a911 (0x9b12 bytes) 2024-09-12T16:16:39.631 INFO:teuthology.orchestra.run.smithi204.stdout:2597 write 0x14c2a00 thru 0x14cf4ad (0xcaae bytes) 2024-09-12T16:16:39.631 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:39.628+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:39.632 INFO:teuthology.orchestra.run.smithi204.stdout:2598 read 0x338dc00 thru 0x33907b1 (0x2bb2 bytes) 2024-09-12T16:16:39.632 INFO:teuthology.orchestra.run.smithi204.stdout:2601 read 0x4c4be00 thru 0x4c52ab4 (0x6cb5 bytes) 2024-09-12T16:16:39.632 INFO:teuthology.orchestra.run.smithi204.stdout:2602 write 0xcb04e00 thru 0xcb13687 (0xe888 bytes) 2024-09-12T16:16:39.634 INFO:teuthology.orchestra.run.smithi204.stdout:2603 read 0xc2f4c00 thru 0xc2f8dec (0x41ed bytes) 2024-09-12T16:16:39.634 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:39.634 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:39.634 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:16:39.634 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:16:39.635 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:39.639 INFO:teuthology.orchestra.run.smithi204.stdout:2604 trunc from 0xd295600 to 0x7623400 2024-09-12T16:16:39.645 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:16:39.679 INFO:teuthology.orchestra.run.smithi204.stdout:2605 write 0x9593200 thru 0x959750e (0x430f bytes) 2024-09-12T16:16:39.679 INFO:teuthology.orchestra.run.smithi204.stdout:2607 write 0x4cb5600 thru 0x4cb9352 (0x3d53 bytes) 2024-09-12T16:16:39.679 INFO:teuthology.orchestra.run.smithi204.stdout:2608 trunc from 0x9597600 to 0x8ed7600 2024-09-12T16:16:39.696 INFO:teuthology.orchestra.run.smithi204.stdout:2609 read 0x5760800 thru 0x5768696 (0x7e97 bytes) 2024-09-12T16:16:39.698 INFO:teuthology.orchestra.run.smithi204.stdout:2612 punch from 0x3838800 to 0x3841400, (0x8c00 bytes) 2024-09-12T16:16:39.699 INFO:teuthology.orchestra.run.smithi204.stdout:2613 write 0x2a39800 thru 0x2a434b7 (0x9cb8 bytes) 2024-09-12T16:16:39.731 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:39.730+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:39.738 INFO:teuthology.orchestra.run.smithi204.stdout:2615 write 0xc69f200 thru 0xc6a6dd0 (0x7bd1 bytes) 2024-09-12T16:16:39.742 INFO:teuthology.orchestra.run.smithi204.stdout:2616 trunc from 0xc6a6e00 to 0xad1e800 2024-09-12T16:16:39.759 INFO:teuthology.orchestra.run.smithi204.stdout:2617 write 0x9e42a00 thru 0x9e436b6 (0xcb7 bytes) 2024-09-12T16:16:39.776 INFO:teuthology.orchestra.run.smithi204.stdout:2619 write 0xebbee00 thru 0xebce253 (0xf454 bytes) 2024-09-12T16:16:39.776 INFO:teuthology.orchestra.run.smithi204.stdout:2620 read 0x3b87e00 thru 0x3b8e18f (0x6390 bytes) 2024-09-12T16:16:39.788 INFO:teuthology.orchestra.run.smithi204.stdout:2621 trunc from 0xebce400 to 0x610b200 2024-09-12T16:16:39.804 INFO:teuthology.orchestra.run.smithi204.stdout:2623 read 0x5f6b000 thru 0x5f75708 (0xa709 bytes) 2024-09-12T16:16:39.810 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:39.810 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:16:39.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:16:39.810 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:39.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.810 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:1757 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1499136~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:39.810 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.789031+0000", 2024-09-12T16:16:39.810 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.0194074529999999, 2024-09-12T16:16:39.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.022090216999999999, 2024-09-12T16:16:39.810 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.811 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.811 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.811 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.811 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:39.811 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:39.811 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1757 2024-09-12T16:16:39.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.811 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.811 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.811 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.811 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.789031+0000", 2024-09-12T16:16:39.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.789031+0000", 2024-09-12T16:16:39.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.789031+0000", 2024-09-12T16:16:39.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8500000000000001e-07 2024-09-12T16:16:39.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.789033+0000", 2024-09-12T16:16:39.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.933e-06 2024-09-12T16:16:39.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.789041+0000", 2024-09-12T16:16:39.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2919999999999998e-06 2024-09-12T16:16:39.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.789046+0000", 2024-09-12T16:16:39.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1580000000000004e-06 2024-09-12T16:16:39.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.810897+0000", 2024-09-12T16:16:39.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021851247000000001 2024-09-12T16:16:39.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.810985+0000", 2024-09-12T16:16:39.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8299000000000003e-05 2024-09-12T16:16:39.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.815 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.811121+0000", 2024-09-12T16:16:39.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013570300000000001 2024-09-12T16:16:39.815 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.815 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.815 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.815 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:1758 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1507328~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:39.815 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.789053+0000", 2024-09-12T16:16:39.815 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.0193857240000002, 2024-09-12T16:16:39.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.022297586000000001, 2024-09-12T16:16:39.816 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.816 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.816 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.816 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.816 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:39.816 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:39.816 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1758 2024-09-12T16:16:39.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.816 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.816 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.816 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.789053+0000", 2024-09-12T16:16:39.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.789053+0000", 2024-09-12T16:16:39.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.789053+0000", 2024-09-12T16:16:39.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1600000000000002e-07 2024-09-12T16:16:39.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.789055+0000", 2024-09-12T16:16:39.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0899999999999999e-06 2024-09-12T16:16:39.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.789061+0000", 2024-09-12T16:16:39.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.874e-06 2024-09-12T16:16:39.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.789066+0000", 2024-09-12T16:16:39.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1959999999999999e-06 2024-09-12T16:16:39.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.811152+0000", 2024-09-12T16:16:39.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.022086011999999999 2024-09-12T16:16:39.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.811235+0000", 2024-09-12T16:16:39.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2749000000000003e-05 2024-09-12T16:16:39.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.820 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.820 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.811350+0000", 2024-09-12T16:16:39.820 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011524899999999999 2024-09-12T16:16:39.820 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.820 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.820 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.820 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:1759 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1552384~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:39.820 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.789073+0000", 2024-09-12T16:16:39.821 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.019365568, 2024-09-12T16:16:39.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.022478730999999998, 2024-09-12T16:16:39.821 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.821 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.821 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.825 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.825 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:39.825 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:39.825 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1759 2024-09-12T16:16:39.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.825 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.825 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.825 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.789073+0000", 2024-09-12T16:16:39.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.789073+0000", 2024-09-12T16:16:39.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.789073+0000", 2024-09-12T16:16:39.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0999999999999999e-07 2024-09-12T16:16:39.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.789075+0000", 2024-09-12T16:16:39.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.074e-06 2024-09-12T16:16:39.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.789083+0000", 2024-09-12T16:16:39.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3459999999999996e-06 2024-09-12T16:16:39.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.789088+0000", 2024-09-12T16:16:39.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0730000000000004e-06 2024-09-12T16:16:39.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.829 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.811374+0000", 2024-09-12T16:16:39.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.022286456 2024-09-12T16:16:39.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.829 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.829 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.811427+0000", 2024-09-12T16:16:39.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2711999999999999e-05 2024-09-12T16:16:39.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.830 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.830 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.811551+0000", 2024-09-12T16:16:39.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012455999999999999 2024-09-12T16:16:39.830 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.830 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.830 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.830 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2003 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 913408~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:39.830 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790264+0000", 2024-09-12T16:16:39.830 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.0181745700000002, 2024-09-12T16:16:39.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.022267623, 2024-09-12T16:16:39.831 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.831 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.831 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.831 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.831 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:39.831 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:39.831 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2003 2024-09-12T16:16:39.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.831 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790264+0000", 2024-09-12T16:16:39.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.832 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790264+0000", 2024-09-12T16:16:39.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.832 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790264+0000", 2024-09-12T16:16:39.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4200000000000001e-07 2024-09-12T16:16:39.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790266+0000", 2024-09-12T16:16:39.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.244e-06 2024-09-12T16:16:39.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790272+0000", 2024-09-12T16:16:39.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7679999999999997e-06 2024-09-12T16:16:39.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790277+0000", 2024-09-12T16:16:39.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0259999999999998e-06 2024-09-12T16:16:39.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.834 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.812318+0000", 2024-09-12T16:16:39.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.022040994000000001 2024-09-12T16:16:39.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.834 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.812399+0000", 2024-09-12T16:16:39.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0457000000000006e-05 2024-09-12T16:16:39.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.812531+0000", 2024-09-12T16:16:39.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013269200000000001 2024-09-12T16:16:39.835 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.835 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.835 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.835 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2004 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 921600~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:39.835 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790284+0000", 2024-09-12T16:16:39.835 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.018153946, 2024-09-12T16:16:39.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.022493638, 2024-09-12T16:16:39.836 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.836 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.836 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.836 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.836 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:39.836 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:39.836 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2004 2024-09-12T16:16:39.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.836 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790284+0000", 2024-09-12T16:16:39.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790284+0000", 2024-09-12T16:16:39.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790285+0000", 2024-09-12T16:16:39.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1899999999999998e-07 2024-09-12T16:16:39.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790287+0000", 2024-09-12T16:16:39.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3690000000000001e-06 2024-09-12T16:16:39.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790293+0000", 2024-09-12T16:16:39.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2790000000000004e-06 2024-09-12T16:16:39.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790298+0000", 2024-09-12T16:16:39.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.843e-06 2024-09-12T16:16:39.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.812562+0000", 2024-09-12T16:16:39.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.022263811000000001 2024-09-12T16:16:39.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.812645+0000", 2024-09-12T16:16:39.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2997000000000005e-05 2024-09-12T16:16:39.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.812778+0000", 2024-09-12T16:16:39.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013291999999999999 2024-09-12T16:16:39.840 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.840 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.840 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.840 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2005 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 966656~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:39.841 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790305+0000", 2024-09-12T16:16:39.841 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.0181331619999998, 2024-09-12T16:16:39.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.022766748999999999, 2024-09-12T16:16:39.841 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.841 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.841 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.841 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.842 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:39.842 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:39.842 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2005 2024-09-12T16:16:39.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.842 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790305+0000", 2024-09-12T16:16:39.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790305+0000", 2024-09-12T16:16:39.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.843 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790305+0000", 2024-09-12T16:16:39.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0200000000000003e-07 2024-09-12T16:16:39.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.843 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790308+0000", 2024-09-12T16:16:39.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3120000000000001e-06 2024-09-12T16:16:39.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790314+0000", 2024-09-12T16:16:39.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2890000000000003e-06 2024-09-12T16:16:39.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790319+0000", 2024-09-12T16:16:39.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1000000000000003e-06 2024-09-12T16:16:39.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.812810+0000", 2024-09-12T16:16:39.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.022490508999999999 2024-09-12T16:16:39.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.812891+0000", 2024-09-12T16:16:39.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0927999999999995e-05 2024-09-12T16:16:39.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.813072+0000", 2024-09-12T16:16:39.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018120899999999999 2024-09-12T16:16:39.845 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.845 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.845 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.846 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2006 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1011712~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:39.846 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790327+0000", 2024-09-12T16:16:39.846 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.0181113060000002, 2024-09-12T16:16:39.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023039903, 2024-09-12T16:16:39.846 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.846 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.846 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.846 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.846 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:39.846 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:39.846 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2006 2024-09-12T16:16:39.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.847 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790327+0000", 2024-09-12T16:16:39.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790327+0000", 2024-09-12T16:16:39.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790327+0000", 2024-09-12T16:16:39.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8699999999999995e-07 2024-09-12T16:16:39.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.848 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790329+0000", 2024-09-12T16:16:39.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8470000000000001e-06 2024-09-12T16:16:39.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.848 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790335+0000", 2024-09-12T16:16:39.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4949999999999999e-06 2024-09-12T16:16:39.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790342+0000", 2024-09-12T16:16:39.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7789999999999998e-06 2024-09-12T16:16:39.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.813121+0000", 2024-09-12T16:16:39.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.022779666 2024-09-12T16:16:39.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.813220+0000", 2024-09-12T16:16:39.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8604999999999995e-05 2024-09-12T16:16:39.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.813367+0000", 2024-09-12T16:16:39.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014702399999999999 2024-09-12T16:16:39.850 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.850 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.850 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.850 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2007 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1019904~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:39.850 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790350+0000", 2024-09-12T16:16:39.850 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.018088739, 2024-09-12T16:16:39.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023289529, 2024-09-12T16:16:39.851 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.851 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.851 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.851 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.851 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:39.851 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:39.851 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2007 2024-09-12T16:16:39.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.851 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.851 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790350+0000", 2024-09-12T16:16:39.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790350+0000", 2024-09-12T16:16:39.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790350+0000", 2024-09-12T16:16:39.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5999999999999999e-07 2024-09-12T16:16:39.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790352+0000", 2024-09-12T16:16:39.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.99e-06 2024-09-12T16:16:39.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790358+0000", 2024-09-12T16:16:39.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4629999999999998e-06 2024-09-12T16:16:39.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790364+0000", 2024-09-12T16:16:39.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7300000000000002e-06 2024-09-12T16:16:39.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.813413+0000", 2024-09-12T16:16:39.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023049039 2024-09-12T16:16:39.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.813502+0000", 2024-09-12T16:16:39.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9142999999999997e-05 2024-09-12T16:16:39.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.813639+0000", 2024-09-12T16:16:39.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000136704 2024-09-12T16:16:39.855 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.855 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.855 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.855 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2008 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1064960~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:39.855 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790371+0000", 2024-09-12T16:16:39.855 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.0180672799999999, 2024-09-12T16:16:39.855 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023562461999999999, 2024-09-12T16:16:39.855 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.855 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.855 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.855 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.856 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:39.856 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:39.856 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2008 2024-09-12T16:16:39.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.856 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.856 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.856 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790371+0000", 2024-09-12T16:16:39.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.856 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.856 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790371+0000", 2024-09-12T16:16:39.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.857 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790371+0000", 2024-09-12T16:16:39.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1399999999999997e-07 2024-09-12T16:16:39.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.857 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790374+0000", 2024-09-12T16:16:39.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0650000000000001e-06 2024-09-12T16:16:39.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790380+0000", 2024-09-12T16:16:39.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.849e-06 2024-09-12T16:16:39.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790385+0000", 2024-09-12T16:16:39.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.074e-06 2024-09-12T16:16:39.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.813686+0000", 2024-09-12T16:16:39.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023300867999999999 2024-09-12T16:16:39.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.859 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.813780+0000", 2024-09-12T16:16:39.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3333999999999998e-05 2024-09-12T16:16:39.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.859 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.813933+0000", 2024-09-12T16:16:39.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015375799999999999 2024-09-12T16:16:39.859 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.859 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.859 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.859 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2009 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1110016~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:39.859 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790398+0000", 2024-09-12T16:16:39.859 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.0180407269999998, 2024-09-12T16:16:39.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023711804999999999, 2024-09-12T16:16:39.860 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.860 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.860 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.860 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.860 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:39.860 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:39.860 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2009 2024-09-12T16:16:39.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.860 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.860 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790398+0000", 2024-09-12T16:16:39.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.861 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.861 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790398+0000", 2024-09-12T16:16:39.861 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.861 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.861 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790398+0000", 2024-09-12T16:16:39.861 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7999999999999996e-07 2024-09-12T16:16:39.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.861 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.861 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790400+0000", 2024-09-12T16:16:39.861 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2989999999999999e-06 2024-09-12T16:16:39.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790407+0000", 2024-09-12T16:16:39.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7379999999999997e-06 2024-09-12T16:16:39.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790424+0000", 2024-09-12T16:16:39.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7062e-05 2024-09-12T16:16:39.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.813967+0000", 2024-09-12T16:16:39.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023542639000000001 2024-09-12T16:16:39.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814035+0000", 2024-09-12T16:16:39.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8299000000000005e-05 2024-09-12T16:16:39.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814109+0000", 2024-09-12T16:16:39.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4288000000000004e-05 2024-09-12T16:16:39.863 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.863 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.863 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.864 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2010 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1118208~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:39.864 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790432+0000", 2024-09-12T16:16:39.864 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.018006121, 2024-09-12T16:16:39.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023851981000000001, 2024-09-12T16:16:39.864 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.864 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.864 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.864 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.864 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:39.864 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:39.864 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2010 2024-09-12T16:16:39.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.864 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790432+0000", 2024-09-12T16:16:39.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790432+0000", 2024-09-12T16:16:39.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790433+0000", 2024-09-12T16:16:39.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1799999999999995e-07 2024-09-12T16:16:39.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790442+0000", 2024-09-12T16:16:39.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8030000000000008e-06 2024-09-12T16:16:39.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790449+0000", 2024-09-12T16:16:39.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-12T16:16:39.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790455+0000", 2024-09-12T16:16:39.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2700000000000004e-06 2024-09-12T16:16:39.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814126+0000", 2024-09-12T16:16:39.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023671668999999999 2024-09-12T16:16:39.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814168+0000", 2024-09-12T16:16:39.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1727999999999998e-05 2024-09-12T16:16:39.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.868 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.868 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814284+0000", 2024-09-12T16:16:39.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116153 2024-09-12T16:16:39.868 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.868 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.868 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.868 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2011 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1163264~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:39.868 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790463+0000", 2024-09-12T16:16:39.868 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.017975641, 2024-09-12T16:16:39.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024104724000000001, 2024-09-12T16:16:39.868 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.869 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.869 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.869 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.869 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:39.869 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:39.869 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2011 2024-09-12T16:16:39.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.869 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.869 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.869 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790463+0000", 2024-09-12T16:16:39.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.870 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790463+0000", 2024-09-12T16:16:39.870 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.870 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790463+0000", 2024-09-12T16:16:39.870 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6199999999999998e-07 2024-09-12T16:16:39.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790465+0000", 2024-09-12T16:16:39.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2419999999999999e-06 2024-09-12T16:16:39.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790471+0000", 2024-09-12T16:16:39.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0000000000000002e-06 2024-09-12T16:16:39.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790477+0000", 2024-09-12T16:16:39.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3669999999999996e-06 2024-09-12T16:16:39.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814317+0000", 2024-09-12T16:16:39.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023840413000000001 2024-09-12T16:16:39.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814410+0000", 2024-09-12T16:16:39.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3049999999999998e-05 2024-09-12T16:16:39.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814567+0000", 2024-09-12T16:16:39.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015719 2024-09-12T16:16:39.873 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.873 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.873 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.873 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2012 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1208320~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:39.873 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790484+0000", 2024-09-12T16:16:39.873 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.0179543830000002, 2024-09-12T16:16:39.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024289805000000001, 2024-09-12T16:16:39.873 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.874 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.874 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.874 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.874 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:39.874 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:39.874 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2012 2024-09-12T16:16:39.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.874 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.874 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.874 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790484+0000", 2024-09-12T16:16:39.874 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.875 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790484+0000", 2024-09-12T16:16:39.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.875 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790484+0000", 2024-09-12T16:16:39.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2199999999999999e-07 2024-09-12T16:16:39.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.875 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790486+0000", 2024-09-12T16:16:39.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.979e-06 2024-09-12T16:16:39.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.876 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.876 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790493+0000", 2024-09-12T16:16:39.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8950000000000001e-06 2024-09-12T16:16:39.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.876 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.876 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790498+0000", 2024-09-12T16:16:39.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8289999999999998e-06 2024-09-12T16:16:39.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.877 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.877 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814603+0000", 2024-09-12T16:16:39.877 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024104787999999999 2024-09-12T16:16:39.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.877 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.877 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814686+0000", 2024-09-12T16:16:39.877 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3224000000000001e-05 2024-09-12T16:16:39.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.877 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.877 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814774+0000", 2024-09-12T16:16:39.877 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7668000000000002e-05 2024-09-12T16:16:39.878 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.878 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.878 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.878 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2013 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1216512~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:39.878 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790507+0000", 2024-09-12T16:16:39.878 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.0179317280000002, 2024-09-12T16:16:39.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024529395999999998, 2024-09-12T16:16:39.878 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.878 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.878 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.878 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.878 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:39.879 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:39.879 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2013 2024-09-12T16:16:39.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.879 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.879 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790507+0000", 2024-09-12T16:16:39.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.879 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790507+0000", 2024-09-12T16:16:39.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790507+0000", 2024-09-12T16:16:39.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8599999999999997e-07 2024-09-12T16:16:39.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790510+0000", 2024-09-12T16:16:39.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.339e-06 2024-09-12T16:16:39.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790516+0000", 2024-09-12T16:16:39.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2609999999999999e-06 2024-09-12T16:16:39.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.881 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.881 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790521+0000", 2024-09-12T16:16:39.881 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0549999999999999e-06 2024-09-12T16:16:39.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.881 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.881 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814810+0000", 2024-09-12T16:16:39.881 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024289409000000001 2024-09-12T16:16:39.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.881 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.881 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814890+0000", 2024-09-12T16:16:39.881 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9138e-05 2024-09-12T16:16:39.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.882 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.882 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815036+0000", 2024-09-12T16:16:39.882 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000146408 2024-09-12T16:16:39.882 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.882 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.882 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.882 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2014 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1261568~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:39.882 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790529+0000", 2024-09-12T16:16:39.882 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.0179094979999999, 2024-09-12T16:16:39.883 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024767824000000001, 2024-09-12T16:16:39.883 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.883 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.883 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.883 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.883 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:39.883 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:39.883 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2014 2024-09-12T16:16:39.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.884 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.884 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.884 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790529+0000", 2024-09-12T16:16:39.884 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.884 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.884 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790529+0000", 2024-09-12T16:16:39.884 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.884 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790529+0000", 2024-09-12T16:16:39.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6100000000000001e-07 2024-09-12T16:16:39.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.885 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790532+0000", 2024-09-12T16:16:39.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3429999999999998e-06 2024-09-12T16:16:39.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.885 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790538+0000", 2024-09-12T16:16:39.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3709999999999996e-06 2024-09-12T16:16:39.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.886 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.886 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790543+0000", 2024-09-12T16:16:39.886 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.933e-06 2024-09-12T16:16:39.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.886 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.886 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815084+0000", 2024-09-12T16:16:39.886 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024541469 2024-09-12T16:16:39.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.886 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.886 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815172+0000", 2024-09-12T16:16:39.886 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7869999999999997e-05 2024-09-12T16:16:39.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.887 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.887 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815297+0000", 2024-09-12T16:16:39.887 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012437700000000001 2024-09-12T16:16:39.887 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.887 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.887 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.887 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2015 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1306624~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:39.887 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790549+0000", 2024-09-12T16:16:39.887 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.0178891999999999, 2024-09-12T16:16:39.887 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025019062000000002, 2024-09-12T16:16:39.887 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.887 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.888 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.888 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.888 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:39.888 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:39.888 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2015 2024-09-12T16:16:39.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.888 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.888 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.888 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790549+0000", 2024-09-12T16:16:39.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790549+0000", 2024-09-12T16:16:39.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790549+0000", 2024-09-12T16:16:39.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1800000000000001e-07 2024-09-12T16:16:39.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790551+0000", 2024-09-12T16:16:39.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.855e-06 2024-09-12T16:16:39.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.890 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.890 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790557+0000", 2024-09-12T16:16:39.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2460000000000003e-06 2024-09-12T16:16:39.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.890 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.890 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790561+0000", 2024-09-12T16:16:39.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8799999999999999e-06 2024-09-12T16:16:39.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.890 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.891 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815329+0000", 2024-09-12T16:16:39.891 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024767320999999998 2024-09-12T16:16:39.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.891 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.891 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815408+0000", 2024-09-12T16:16:39.891 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9226000000000003e-05 2024-09-12T16:16:39.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.891 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.891 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815568+0000", 2024-09-12T16:16:39.891 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000160116 2024-09-12T16:16:39.891 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.891 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.892 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.892 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2016 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1314816~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:39.892 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790568+0000", 2024-09-12T16:16:39.892 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.0178700580000002, 2024-09-12T16:16:39.892 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025220411000000002, 2024-09-12T16:16:39.892 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.892 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.892 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.892 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.892 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:39.892 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:39.893 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2016 2024-09-12T16:16:39.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.893 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.893 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790568+0000", 2024-09-12T16:16:39.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.893 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790568+0000", 2024-09-12T16:16:39.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.894 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.894 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790569+0000", 2024-09-12T16:16:39.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1699999999999999e-07 2024-09-12T16:16:39.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.894 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.894 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790571+0000", 2024-09-12T16:16:39.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2819999999999999e-06 2024-09-12T16:16:39.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.895 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.895 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790577+0000", 2024-09-12T16:16:39.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.117e-06 2024-09-12T16:16:39.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.895 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.895 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790582+0000", 2024-09-12T16:16:39.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6110000000000004e-06 2024-09-12T16:16:39.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.895 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.895 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815611+0000", 2024-09-12T16:16:39.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025029518000000001 2024-09-12T16:16:39.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.896 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.896 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815669+0000", 2024-09-12T16:16:39.896 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7896999999999998e-05 2024-09-12T16:16:39.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.896 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.896 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815789+0000", 2024-09-12T16:16:39.896 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011956900000000001 2024-09-12T16:16:39.896 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.896 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.897 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.897 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2017 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1359872~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:39.897 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790596+0000", 2024-09-12T16:16:39.897 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.0178420340000001, 2024-09-12T16:16:39.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025446261000000001, 2024-09-12T16:16:39.897 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.897 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.897 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.897 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.897 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:39.897 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:39.898 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2017 2024-09-12T16:16:39.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.898 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790596+0000", 2024-09-12T16:16:39.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790596+0000", 2024-09-12T16:16:39.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.899 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790597+0000", 2024-09-12T16:16:39.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7400000000000003e-07 2024-09-12T16:16:39.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.899 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790599+0000", 2024-09-12T16:16:39.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4389999999999999e-06 2024-09-12T16:16:39.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.899 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790606+0000", 2024-09-12T16:16:39.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9589999999999998e-06 2024-09-12T16:16:39.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.900 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.900 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790612+0000", 2024-09-12T16:16:39.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4840000000000003e-06 2024-09-12T16:16:39.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.900 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.900 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815818+0000", 2024-09-12T16:16:39.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025206447 2024-09-12T16:16:39.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.900 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.900 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815910+0000", 2024-09-12T16:16:39.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1898999999999995e-05 2024-09-12T16:16:39.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.901 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.901 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.816042+0000", 2024-09-12T16:16:39.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132359 2024-09-12T16:16:39.901 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.901 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.901 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.901 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2018 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1404928~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:39.901 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790619+0000", 2024-09-12T16:16:39.901 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.0178188289999999, 2024-09-12T16:16:39.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025656844000000002, 2024-09-12T16:16:39.902 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.902 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.902 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.902 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.902 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:39.902 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:39.902 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2018 2024-09-12T16:16:39.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.902 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790619+0000", 2024-09-12T16:16:39.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790619+0000", 2024-09-12T16:16:39.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790620+0000", 2024-09-12T16:16:39.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.46e-07 2024-09-12T16:16:39.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790622+0000", 2024-09-12T16:16:39.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0090000000000002e-06 2024-09-12T16:16:39.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790628+0000", 2024-09-12T16:16:39.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0349999999999998e-06 2024-09-12T16:16:39.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790641+0000", 2024-09-12T16:16:39.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2889e-05 2024-09-12T16:16:39.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.905 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.905 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.816075+0000", 2024-09-12T16:16:39.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025433951 2024-09-12T16:16:39.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.905 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.905 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.816155+0000", 2024-09-12T16:16:39.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9907000000000006e-05 2024-09-12T16:16:39.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.905 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.905 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.816276+0000", 2024-09-12T16:16:39.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121607 2024-09-12T16:16:39.906 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.906 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.906 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.906 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2019 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1413120~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:39.906 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790652+0000", 2024-09-12T16:16:39.906 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.0177866930000001, 2024-09-12T16:16:39.906 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.02584908, 2024-09-12T16:16:39.906 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:39.906 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:39.906 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:39.906 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:39.906 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:39.906 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:39.907 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2019 2024-09-12T16:16:39.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.907 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:39.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:39.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790652+0000", 2024-09-12T16:16:39.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:39.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790652+0000", 2024-09-12T16:16:39.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:39.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:39.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790652+0000", 2024-09-12T16:16:39.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9399999999999995e-07 2024-09-12T16:16:39.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:39.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790655+0000", 2024-09-12T16:16:39.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.481e-06 2024-09-12T16:16:39.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:39.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790661+0000", 2024-09-12T16:16:39.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1999999999999999e-06 2024-09-12T16:16:39.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:39.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790666+0000", 2024-09-12T16:16:39.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8670000000000002e-06 2024-09-12T16:16:39.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:39.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.816306+0000", 2024-09-12T16:16:39.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025640039 2024-09-12T16:16:39.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:39.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.816382+0000", 2024-09-12T16:16:39.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6771000000000001e-05 2024-09-12T16:16:39.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:39.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:39.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:39.910 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.816501+0000", 2024-09-12T16:16:39.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011822799999999999 2024-09-12T16:16:39.910 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.910 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.910 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.910 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:39.910 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:39.910 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:39.912 INFO:teuthology.orchestra.run.smithi204.stdout:2624 write 0xa852c00 thru 0xa8611db (0xe5dc bytes) 2024-09-12T16:16:39.912 INFO:teuthology.orchestra.run.smithi204.stdout:2627 punch from 0xa84be00 to 0xa84ec00, (0x2e00 bytes) 2024-09-12T16:16:39.912 INFO:teuthology.orchestra.run.smithi204.stdout:2628 clone 14 order 19 su 16384 sc 8 2024-09-12T16:16:39.913 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:16:39.913 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:39.910+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:40.013 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:40.011+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:40.020 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:40.021 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:16:40.021 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:16:40.021 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:40.028 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:16:40.114 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:40.112+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:40.137 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T16:16:40.182 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:40.182 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:16:40.182 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:16:40.182 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:16:40.182 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:40.192 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:16:40.235 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:40.234+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:40.246 INFO:teuthology.orchestra.run.smithi204.stdout:truncating image image_client.0-clone13 from 0xa861200 (overlap 0x3902400) to 0x16cda00 2024-09-12T16:16:40.315 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:40.314+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:40.338 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:40.338 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:16:40.338 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:16:40.338 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:16:40.338 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.338 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:16:40.339 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:16:40.339 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 58.571345674, 2024-09-12T16:16:40.339 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55645454900000002, 2024-09-12T16:16:40.339 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.339 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.339 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:40.339 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.339 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:16:40.339 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:16:40.339 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1 2024-09-12T16:16:40.339 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.339 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.339 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.339 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.340 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:16:40.340 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.340 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.340 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.340 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:16:40.340 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.340 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.340 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.340 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764440+0000", 2024-09-12T16:16:40.340 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6249999999999999e-06 2024-09-12T16:16:40.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.340 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.341 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.341 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764447+0000", 2024-09-12T16:16:40.341 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4939999999999997e-06 2024-09-12T16:16:40.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.341 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.341 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.341 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764459+0000", 2024-09-12T16:16:40.341 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1517e-05 2024-09-12T16:16:40.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.341 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.341 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.341 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764468+0000", 2024-09-12T16:16:40.341 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7690000000000002e-06 2024-09-12T16:16:40.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.342 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.342 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.342 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764539+0000", 2024-09-12T16:16:40.342 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1103e-05 2024-09-12T16:16:40.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.342 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.342 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:16:40.342 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764551+0000", 2024-09-12T16:16:40.342 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2687999999999999e-05 2024-09-12T16:16:40.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.342 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.342 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.342 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319497+0000", 2024-09-12T16:16:40.342 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55494560500000001 2024-09-12T16:16:40.343 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.343 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.343 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.343 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319688+0000", 2024-09-12T16:16:40.343 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019105599999999999 2024-09-12T16:16:40.343 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.343 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.343 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:16:40.343 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319842+0000", 2024-09-12T16:16:40.343 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015377699999999999 2024-09-12T16:16:40.343 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.344 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.344 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:40.344 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320473+0000", 2024-09-12T16:16:40.344 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00063117100000000003 2024-09-12T16:16:40.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.344 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.344 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:40.344 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320825+0000", 2024-09-12T16:16:40.344 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00035202500000000001 2024-09-12T16:16:40.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.344 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.344 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:40.344 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320867+0000", 2024-09-12T16:16:40.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2005000000000002e-05 2024-09-12T16:16:40.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.345 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.345 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.345 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320893+0000", 2024-09-12T16:16:40.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5714000000000001e-05 2024-09-12T16:16:40.345 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.345 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.345 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.345 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.346 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14034 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5035008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:40.346 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:16:40.346 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.814287441000001, 2024-09-12T16:16:40.346 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053404082999999998, 2024-09-12T16:16:40.346 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.346 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.346 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:40.346 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.346 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:40.346 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:40.346 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14034 2024-09-12T16:16:40.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.346 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.347 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.347 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.347 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:16:40.347 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.347 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.347 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.347 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.347 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:16:40.347 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.347 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.347 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.348 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.348 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521740+0000", 2024-09-12T16:16:40.348 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000243976 2024-09-12T16:16:40.348 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.348 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.348 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.348 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521745+0000", 2024-09-12T16:16:40.348 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1280000000000001e-06 2024-09-12T16:16:40.348 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.348 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.348 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.348 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521757+0000", 2024-09-12T16:16:40.349 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2751e-05 2024-09-12T16:16:40.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.349 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.349 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.349 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521771+0000", 2024-09-12T16:16:40.349 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3328e-05 2024-09-12T16:16:40.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.349 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.349 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.349 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574710+0000", 2024-09-12T16:16:40.349 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052939358999999998 2024-09-12T16:16:40.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574799+0000", 2024-09-12T16:16:40.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8893000000000004e-05 2024-09-12T16:16:40.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574901+0000", 2024-09-12T16:16:40.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101648 2024-09-12T16:16:40.350 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.350 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.350 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.351 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14036 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5043200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:40.351 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:16:40.351 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.813828247, 2024-09-12T16:16:40.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053426247000000003, 2024-09-12T16:16:40.351 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.351 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.351 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:40.351 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.351 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:40.351 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:40.351 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14036 2024-09-12T16:16:40.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.351 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.351 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.352 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:16:40.352 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.352 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.352 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.352 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:16:40.352 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.352 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.352 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.352 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522208+0000", 2024-09-12T16:16:40.352 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025195300000000002 2024-09-12T16:16:40.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.352 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.353 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.353 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522211+0000", 2024-09-12T16:16:40.353 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2160000000000002e-06 2024-09-12T16:16:40.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.353 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.353 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.353 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522223+0000", 2024-09-12T16:16:40.353 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2044e-05 2024-09-12T16:16:40.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.353 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.353 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.353 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522229+0000", 2024-09-12T16:16:40.353 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8850000000000004e-06 2024-09-12T16:16:40.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.354 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.354 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575192+0000", 2024-09-12T16:16:40.354 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052963573 2024-09-12T16:16:40.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.354 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.354 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575282+0000", 2024-09-12T16:16:40.354 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9666000000000005e-05 2024-09-12T16:16:40.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.354 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.355 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575382+0000", 2024-09-12T16:16:40.355 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9909999999999997e-05 2024-09-12T16:16:40.355 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.355 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.355 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.355 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.355 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.355 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14037 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5047296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:40.355 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522245+0000", 2024-09-12T16:16:40.355 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.813539412000001, 2024-09-12T16:16:40.355 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053384907000000002, 2024-09-12T16:16:40.355 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.356 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.356 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:40.356 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.356 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:40.356 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:40.356 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14037 2024-09-12T16:16:40.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.356 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.356 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.356 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.356 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522245+0000", 2024-09-12T16:16:40.356 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.357 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.357 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.357 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522245+0000", 2024-09-12T16:16:40.357 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.357 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.357 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.357 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522471+0000", 2024-09-12T16:16:40.357 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022601300000000001 2024-09-12T16:16:40.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.357 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.357 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.357 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522474+0000", 2024-09-12T16:16:40.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3390000000000001e-06 2024-09-12T16:16:40.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.358 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.358 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.358 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522482+0000", 2024-09-12T16:16:40.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7919999999999993e-06 2024-09-12T16:16:40.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.358 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.358 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.358 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522486+0000", 2024-09-12T16:16:40.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5109999999999997e-06 2024-09-12T16:16:40.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.358 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.359 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575433+0000", 2024-09-12T16:16:40.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052946673999999999 2024-09-12T16:16:40.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.359 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575532+0000", 2024-09-12T16:16:40.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9128000000000004e-05 2024-09-12T16:16:40.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.359 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575629+0000", 2024-09-12T16:16:40.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7449999999999997e-05 2024-09-12T16:16:40.359 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.359 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.360 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.360 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.360 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.360 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14038 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5051392~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:40.360 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:16:40.360 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.813289873999999, 2024-09-12T16:16:40.360 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053395152000000001, 2024-09-12T16:16:40.360 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.360 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.360 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:40.360 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.360 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:40.360 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:40.360 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14038 2024-09-12T16:16:40.360 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.361 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.361 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.361 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.361 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:16:40.361 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.361 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.361 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.361 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.361 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:16:40.361 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.361 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.361 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.361 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.361 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522601+0000", 2024-09-12T16:16:40.362 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010702899999999999 2024-09-12T16:16:40.362 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.362 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.362 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.362 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522605+0000", 2024-09-12T16:16:40.362 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2379999999999999e-06 2024-09-12T16:16:40.362 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.362 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.362 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.362 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522616+0000", 2024-09-12T16:16:40.362 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1185999999999999e-05 2024-09-12T16:16:40.362 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.362 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.362 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.362 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522624+0000", 2024-09-12T16:16:40.363 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1099999999999997e-06 2024-09-12T16:16:40.363 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.363 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.363 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.363 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575677+0000", 2024-09-12T16:16:40.363 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053126999999999 2024-09-12T16:16:40.363 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.363 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.363 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.363 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575764+0000", 2024-09-12T16:16:40.363 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7250000000000007e-05 2024-09-12T16:16:40.363 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.363 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.364 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.364 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575889+0000", 2024-09-12T16:16:40.364 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012521200000000001 2024-09-12T16:16:40.364 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.364 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.364 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.364 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.364 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.364 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14039 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5055488~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:40.364 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:16:40.364 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.813148463000001, 2024-09-12T16:16:40.364 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053466207000000002, 2024-09-12T16:16:40.364 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.364 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.365 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:40.365 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.365 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:40.365 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:40.365 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14039 2024-09-12T16:16:40.365 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.365 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.365 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.365 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.365 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:16:40.365 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.365 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.365 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.366 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.366 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:16:40.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.366 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.366 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.366 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522899+0000", 2024-09-12T16:16:40.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026318199999999999 2024-09-12T16:16:40.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.366 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.366 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.367 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522903+0000", 2024-09-12T16:16:40.367 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.929e-06 2024-09-12T16:16:40.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.367 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.367 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.367 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522913+0000", 2024-09-12T16:16:40.367 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0162e-05 2024-09-12T16:16:40.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.367 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.367 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.367 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522921+0000", 2024-09-12T16:16:40.368 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.14e-06 2024-09-12T16:16:40.368 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.368 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.368 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.368 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575922+0000", 2024-09-12T16:16:40.368 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053000712999999998 2024-09-12T16:16:40.368 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.368 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.368 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.368 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576006+0000", 2024-09-12T16:16:40.368 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4161999999999998e-05 2024-09-12T16:16:40.368 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.369 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.369 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.369 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576102+0000", 2024-09-12T16:16:40.369 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5919000000000001e-05 2024-09-12T16:16:40.369 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.369 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.369 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.369 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.369 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.369 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14040 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5059584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:40.369 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:16:40.369 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.812843568000002, 2024-09-12T16:16:40.369 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053413258999999998, 2024-09-12T16:16:40.369 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.370 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.370 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:40.370 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.370 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:40.370 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:40.370 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14040 2024-09-12T16:16:40.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.370 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.370 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.370 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.370 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:16:40.370 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.371 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.371 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.371 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:16:40.371 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.371 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.371 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.371 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523059+0000", 2024-09-12T16:16:40.371 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118466 2024-09-12T16:16:40.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.371 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.372 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.372 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523062+0000", 2024-09-12T16:16:40.372 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.971e-06 2024-09-12T16:16:40.372 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.372 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.372 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.372 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523069+0000", 2024-09-12T16:16:40.372 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8279999999999997e-06 2024-09-12T16:16:40.372 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.372 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.372 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.372 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523073+0000", 2024-09-12T16:16:40.372 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3019999999999996e-06 2024-09-12T16:16:40.372 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.373 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.373 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.373 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576155+0000", 2024-09-12T16:16:40.373 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053081962000000003 2024-09-12T16:16:40.373 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.373 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.373 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.373 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576249+0000", 2024-09-12T16:16:40.373 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3914999999999998e-05 2024-09-12T16:16:40.373 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.373 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.373 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.373 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576354+0000", 2024-09-12T16:16:40.374 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010481500000000001 2024-09-12T16:16:40.374 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.374 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.374 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.374 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.374 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.374 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14041 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5063680~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:40.374 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:16:40.374 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.812693263, 2024-09-12T16:16:40.374 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053519111000000001, 2024-09-12T16:16:40.374 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.375 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.375 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:40.375 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.375 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:40.375 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:40.375 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14041 2024-09-12T16:16:40.375 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.375 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.375 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.375 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.375 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:16:40.375 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.375 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.375 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.376 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.376 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:16:40.376 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.376 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.376 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.376 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.376 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523309+0000", 2024-09-12T16:16:40.376 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000218712 2024-09-12T16:16:40.376 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.376 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.376 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.376 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523313+0000", 2024-09-12T16:16:40.377 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.151e-06 2024-09-12T16:16:40.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.377 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.377 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.377 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523320+0000", 2024-09-12T16:16:40.377 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9789999999999993e-06 2024-09-12T16:16:40.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.377 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.377 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.377 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523325+0000", 2024-09-12T16:16:40.377 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:16:40.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.377 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.377 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.378 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576402+0000", 2024-09-12T16:16:40.378 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053076811000000002 2024-09-12T16:16:40.378 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.378 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.378 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.378 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576491+0000", 2024-09-12T16:16:40.378 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8578999999999993e-05 2024-09-12T16:16:40.378 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.378 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.378 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.378 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576610+0000", 2024-09-12T16:16:40.378 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119129 2024-09-12T16:16:40.378 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.379 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.379 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.379 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.379 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.379 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14042 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5067776~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:40.379 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:16:40.379 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.812449828999998, 2024-09-12T16:16:40.379 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053510350999999998, 2024-09-12T16:16:40.379 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.379 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.379 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:40.379 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.379 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:40.379 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:40.380 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14042 2024-09-12T16:16:40.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.380 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.380 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.380 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.380 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:16:40.380 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.380 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.380 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.380 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:16:40.380 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.380 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.380 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.381 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523591+0000", 2024-09-12T16:16:40.381 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025710300000000001 2024-09-12T16:16:40.381 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.381 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.381 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.381 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523594+0000", 2024-09-12T16:16:40.381 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2229999999999999e-06 2024-09-12T16:16:40.381 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.381 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.381 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.381 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523602+0000", 2024-09-12T16:16:40.381 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6930000000000007e-06 2024-09-12T16:16:40.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.384 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.384 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523607+0000", 2024-09-12T16:16:40.384 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4789999999999998e-06 2024-09-12T16:16:40.385 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.385 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.385 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.385 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576661+0000", 2024-09-12T16:16:40.385 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053973999999997 2024-09-12T16:16:40.385 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.385 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.385 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.385 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576745+0000", 2024-09-12T16:16:40.385 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4660000000000006e-05 2024-09-12T16:16:40.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.386 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.386 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.386 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576844+0000", 2024-09-12T16:16:40.386 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9219e-05 2024-09-12T16:16:40.386 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.386 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.386 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.386 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.386 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14043 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5071872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:40.386 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:16:40.386 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.812169350000001, 2024-09-12T16:16:40.386 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053475295999999999, 2024-09-12T16:16:40.387 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.387 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.387 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:40.387 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.387 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:40.387 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:40.387 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14043 2024-09-12T16:16:40.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.387 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.387 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.387 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.387 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:16:40.387 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.387 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:16:40.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.388 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523823+0000", 2024-09-12T16:16:40.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020818900000000001 2024-09-12T16:16:40.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.388 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523826+0000", 2024-09-12T16:16:40.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.405e-06 2024-09-12T16:16:40.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.389 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.389 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.389 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523834+0000", 2024-09-12T16:16:40.389 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5499999999999997e-06 2024-09-12T16:16:40.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.389 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.389 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.389 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523838+0000", 2024-09-12T16:16:40.389 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.408e-06 2024-09-12T16:16:40.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.389 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.389 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.389 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576904+0000", 2024-09-12T16:16:40.389 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053065687 2024-09-12T16:16:40.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.390 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.390 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.390 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576991+0000", 2024-09-12T16:16:40.390 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7399999999999997e-05 2024-09-12T16:16:40.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.390 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.390 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.390 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577090+0000", 2024-09-12T16:16:40.390 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8657000000000001e-05 2024-09-12T16:16:40.390 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.390 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.391 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.391 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.391 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14044 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5075968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:40.391 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:16:40.391 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.811937820000001, 2024-09-12T16:16:40.391 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053442659000000003, 2024-09-12T16:16:40.391 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.391 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.391 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:40.391 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.391 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:40.391 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:40.392 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14044 2024-09-12T16:16:40.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.392 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.392 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.392 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.392 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:16:40.392 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.392 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.392 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.392 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:16:40.392 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.392 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.392 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.393 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523985+0000", 2024-09-12T16:16:40.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000138522 2024-09-12T16:16:40.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.393 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.393 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523988+0000", 2024-09-12T16:16:40.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.788e-06 2024-09-12T16:16:40.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.393 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.393 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523998+0000", 2024-09-12T16:16:40.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8470000000000008e-06 2024-09-12T16:16:40.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524010+0000", 2024-09-12T16:16:40.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1348999999999999e-05 2024-09-12T16:16:40.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577137+0000", 2024-09-12T16:16:40.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053127055999999999 2024-09-12T16:16:40.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577210+0000", 2024-09-12T16:16:40.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3392000000000005e-05 2024-09-12T16:16:40.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.395 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.395 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577289+0000", 2024-09-12T16:16:40.395 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8704999999999999e-05 2024-09-12T16:16:40.395 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.395 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.395 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.395 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.395 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.395 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14045 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5080064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:40.395 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:16:40.395 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.811758998999998, 2024-09-12T16:16:40.395 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053497514000000003, 2024-09-12T16:16:40.395 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.395 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.396 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:40.396 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.396 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:40.396 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:40.396 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14045 2024-09-12T16:16:40.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.396 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.396 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.396 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.396 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:16:40.396 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.396 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.396 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.397 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:16:40.397 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.397 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.397 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.397 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524311+0000", 2024-09-12T16:16:40.397 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028626299999999998 2024-09-12T16:16:40.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.397 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.397 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.397 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524315+0000", 2024-09-12T16:16:40.397 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0969999999999999e-06 2024-09-12T16:16:40.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.398 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.398 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524325+0000", 2024-09-12T16:16:40.398 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6330000000000008e-06 2024-09-12T16:16:40.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.398 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.398 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524332+0000", 2024-09-12T16:16:40.398 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8700000000000003e-06 2024-09-12T16:16:40.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.398 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.398 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577334+0000", 2024-09-12T16:16:40.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053001834999999997 2024-09-12T16:16:40.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.399 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.399 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.399 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577420+0000", 2024-09-12T16:16:40.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6145999999999998e-05 2024-09-12T16:16:40.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.399 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.399 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.399 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577522+0000", 2024-09-12T16:16:40.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010267 2024-09-12T16:16:40.399 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.399 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.400 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.400 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.400 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.400 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14047 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5088256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:40.400 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:16:40.400 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.811273273000001, 2024-09-12T16:16:40.400 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053433340000000003, 2024-09-12T16:16:40.400 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.400 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.400 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:40.400 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.400 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:40.401 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:40.401 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14047 2024-09-12T16:16:40.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.401 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.401 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.401 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.401 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:16:40.401 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.401 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.401 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.401 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:16:40.401 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.402 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.402 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524727+0000", 2024-09-12T16:16:40.402 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000216126 2024-09-12T16:16:40.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.402 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.402 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524732+0000", 2024-09-12T16:16:40.402 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1569999999999999e-06 2024-09-12T16:16:40.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.402 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.403 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524742+0000", 2024-09-12T16:16:40.403 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0186999999999999e-05 2024-09-12T16:16:40.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.403 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.403 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.403 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524750+0000", 2024-09-12T16:16:40.403 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4279999999999999e-06 2024-09-12T16:16:40.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.403 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.403 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.403 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577743+0000", 2024-09-12T16:16:40.403 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052993077 2024-09-12T16:16:40.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.403 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.404 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.404 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577841+0000", 2024-09-12T16:16:40.404 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8369000000000006e-05 2024-09-12T16:16:40.404 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.404 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.404 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.404 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577944+0000", 2024-09-12T16:16:40.404 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102996 2024-09-12T16:16:40.404 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.404 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.404 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.405 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.405 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14048 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5092352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:40.405 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:16:40.405 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.81102168, 2024-09-12T16:16:40.405 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053397515, 2024-09-12T16:16:40.405 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.405 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.405 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:40.405 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.405 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:40.405 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:40.405 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14048 2024-09-12T16:16:40.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.406 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.406 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:16:40.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.406 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:16:40.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.407 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524957+0000", 2024-09-12T16:16:40.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019516999999999999 2024-09-12T16:16:40.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.407 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.407 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524962+0000", 2024-09-12T16:16:40.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7709999999999997e-06 2024-09-12T16:16:40.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.407 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.407 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524973+0000", 2024-09-12T16:16:40.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1031e-05 2024-09-12T16:16:40.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.408 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.408 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524980+0000", 2024-09-12T16:16:40.408 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6100000000000002e-06 2024-09-12T16:16:40.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.408 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.408 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.408 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577977+0000", 2024-09-12T16:16:40.408 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052997481999999999 2024-09-12T16:16:40.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.408 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.408 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.408 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578062+0000", 2024-09-12T16:16:40.408 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4851000000000005e-05 2024-09-12T16:16:40.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.408 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.409 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.409 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578160+0000", 2024-09-12T16:16:40.409 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7600000000000001e-05 2024-09-12T16:16:40.409 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.409 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.409 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.409 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.409 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.409 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14049 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5096448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:40.409 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:16:40.409 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.810793052000001, 2024-09-12T16:16:40.409 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053439792, 2024-09-12T16:16:40.409 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.409 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.409 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:40.410 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.410 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:40.410 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:40.410 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14049 2024-09-12T16:16:40.410 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.410 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.410 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.410 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.410 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:16:40.410 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.410 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.410 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.410 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.410 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:16:40.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.411 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.411 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525170+0000", 2024-09-12T16:16:40.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017958500000000001 2024-09-12T16:16:40.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.411 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.411 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525174+0000", 2024-09-12T16:16:40.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0239999999999999e-06 2024-09-12T16:16:40.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.411 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.411 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.412 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525184+0000", 2024-09-12T16:16:40.412 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5950000000000005e-06 2024-09-12T16:16:40.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.412 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.412 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525191+0000", 2024-09-12T16:16:40.412 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8329999999999996e-06 2024-09-12T16:16:40.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.412 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.412 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578240+0000", 2024-09-12T16:16:40.412 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053049236 2024-09-12T16:16:40.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.412 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.413 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578333+0000", 2024-09-12T16:16:40.413 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2806999999999994e-05 2024-09-12T16:16:40.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.413 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.413 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578431+0000", 2024-09-12T16:16:40.413 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7712000000000002e-05 2024-09-12T16:16:40.413 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.413 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.413 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.413 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14050 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5100544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:40.414 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.525201+0000", 2024-09-12T16:16:40.414 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.810582498999999, 2024-09-12T16:16:40.414 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053367398000000003, 2024-09-12T16:16:40.414 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.414 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.414 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:40.414 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.414 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:40.414 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:40.414 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14050 2024-09-12T16:16:40.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.414 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.415 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.415 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.415 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525201+0000", 2024-09-12T16:16:40.415 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.415 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.415 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.415 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525201+0000", 2024-09-12T16:16:40.415 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.415 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.415 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.416 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525449+0000", 2024-09-12T16:16:40.416 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00024803999999999999 2024-09-12T16:16:40.416 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.416 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.416 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.416 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525453+0000", 2024-09-12T16:16:40.416 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.036e-06 2024-09-12T16:16:40.416 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.416 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.416 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.416 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525462+0000", 2024-09-12T16:16:40.416 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6090000000000001e-06 2024-09-12T16:16:40.416 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.417 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.417 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.417 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525472+0000", 2024-09-12T16:16:40.417 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9629999999999993e-06 2024-09-12T16:16:40.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.417 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.417 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.417 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578469+0000", 2024-09-12T16:16:40.417 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052996877999999997 2024-09-12T16:16:40.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.417 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.417 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.417 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578514+0000", 2024-09-12T16:16:40.417 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5460000000000002e-05 2024-09-12T16:16:40.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.417 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.418 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.418 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578569+0000", 2024-09-12T16:16:40.418 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4412e-05 2024-09-12T16:16:40.418 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.418 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.418 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.418 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.418 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.418 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14054 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5116928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:40.418 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.526046+0000", 2024-09-12T16:16:40.418 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.809737703, 2024-09-12T16:16:40.418 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053378408000000002, 2024-09-12T16:16:40.418 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.418 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.419 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:40.419 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.419 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:40.419 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:40.419 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14054 2024-09-12T16:16:40.419 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.419 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.419 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.419 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.419 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526046+0000", 2024-09-12T16:16:40.419 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.419 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.419 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.419 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.420 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526046+0000", 2024-09-12T16:16:40.420 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.420 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.420 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.420 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526228+0000", 2024-09-12T16:16:40.420 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018200200000000001 2024-09-12T16:16:40.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.420 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.420 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.420 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526236+0000", 2024-09-12T16:16:40.420 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5109999999999997e-06 2024-09-12T16:16:40.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.421 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.421 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.421 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526245+0000", 2024-09-12T16:16:40.421 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9600000000000006e-06 2024-09-12T16:16:40.421 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.421 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.421 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.421 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526251+0000", 2024-09-12T16:16:40.421 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5520000000000001e-06 2024-09-12T16:16:40.421 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.421 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.421 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.421 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579226+0000", 2024-09-12T16:16:40.421 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052974343 2024-09-12T16:16:40.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.422 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.422 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.422 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579324+0000", 2024-09-12T16:16:40.422 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8517000000000006e-05 2024-09-12T16:16:40.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.422 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.422 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.422 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579425+0000", 2024-09-12T16:16:40.422 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000100523 2024-09-12T16:16:40.422 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.422 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.422 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.423 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.423 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14055 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5121024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:40.423 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:16:40.423 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.809522360999999, 2024-09-12T16:16:40.423 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053399038000000003, 2024-09-12T16:16:40.423 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.423 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.423 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:40.423 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.423 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:40.423 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:40.423 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14055 2024-09-12T16:16:40.423 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.423 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.424 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.424 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.424 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:16:40.424 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.424 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.424 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.424 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.424 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:16:40.424 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.424 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.424 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.424 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.425 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526403+0000", 2024-09-12T16:16:40.425 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141571 2024-09-12T16:16:40.425 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.425 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.425 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.425 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526406+0000", 2024-09-12T16:16:40.425 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2660000000000002e-06 2024-09-12T16:16:40.425 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.425 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.425 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.425 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526420+0000", 2024-09-12T16:16:40.425 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3949e-05 2024-09-12T16:16:40.425 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.426 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.426 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.426 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526428+0000", 2024-09-12T16:16:40.426 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4250000000000001e-06 2024-09-12T16:16:40.426 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.426 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.426 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.426 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579476+0000", 2024-09-12T16:16:40.426 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053048349000000002 2024-09-12T16:16:40.426 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.426 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.426 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.426 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579563+0000", 2024-09-12T16:16:40.426 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6502999999999995e-05 2024-09-12T16:16:40.427 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.427 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.427 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.427 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579661+0000", 2024-09-12T16:16:40.427 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7974999999999996e-05 2024-09-12T16:16:40.427 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.427 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.427 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.427 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.427 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.427 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4806.0:3139 3.1e 3:78d5a095:::rbd_data.11552a37e55b.0000000000000000:head [read 69632~61440] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:16:40.427 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:16:40.427 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.034528111, 2024-09-12T16:16:40.427 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057851734000000002, 2024-09-12T16:16:40.428 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.428 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.428 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:40.428 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.428 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4806", 2024-09-12T16:16:40.428 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3959815836", 2024-09-12T16:16:40.428 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 3139 2024-09-12T16:16:40.428 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.428 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.428 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.428 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.428 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:16:40.428 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.429 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.429 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.429 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:16:40.429 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.429 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.429 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.429 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:16:40.429 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4799999999999999e-07 2024-09-12T16:16:40.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.429 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.429 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.430 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301258+0000", 2024-09-12T16:16:40.430 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.844e-06 2024-09-12T16:16:40.430 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.430 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.430 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.430 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301267+0000", 2024-09-12T16:16:40.430 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2960000000000004e-06 2024-09-12T16:16:40.430 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.430 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.430 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.430 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301276+0000", 2024-09-12T16:16:40.430 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0650000000000005e-06 2024-09-12T16:16:40.430 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.431 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.431 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.431 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301871+0000", 2024-09-12T16:16:40.431 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00059423600000000005 2024-09-12T16:16:40.431 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.431 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.431 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.431 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301920+0000", 2024-09-12T16:16:40.431 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9067000000000003e-05 2024-09-12T16:16:40.431 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.431 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.431 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.431 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359108+0000", 2024-09-12T16:16:40.431 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057187877999999998 2024-09-12T16:16:40.432 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.432 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.432 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.432 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.432 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.432 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:6428 3.14 3:28a44e54:::rbd_header.11552a37e55b:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:16:40.432 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:16:40.432 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.034199516999999, 2024-09-12T16:16:40.432 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057504023000000001, 2024-09-12T16:16:40.432 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.432 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.432 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:40.432 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.432 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:16:40.433 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:40.433 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6428 2024-09-12T16:16:40.433 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.433 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.433 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.433 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.433 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:16:40.433 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.433 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.433 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.433 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.433 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:16:40.433 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.434 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.434 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.434 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.434 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301585+0000", 2024-09-12T16:16:40.434 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6300000000000005e-07 2024-09-12T16:16:40.434 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.434 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.434 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.434 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301588+0000", 2024-09-12T16:16:40.434 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4149999999999999e-06 2024-09-12T16:16:40.434 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.434 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.434 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.434 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301597+0000", 2024-09-12T16:16:40.435 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5450000000000003e-06 2024-09-12T16:16:40.435 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.435 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.435 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.435 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301617+0000", 2024-09-12T16:16:40.435 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9837e-05 2024-09-12T16:16:40.435 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.435 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.435 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.435 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301779+0000", 2024-09-12T16:16:40.435 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016186799999999999 2024-09-12T16:16:40.435 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.435 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.435 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.436 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301855+0000", 2024-09-12T16:16:40.436 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5899e-05 2024-09-12T16:16:40.436 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.436 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.436 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.436 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359088+0000", 2024-09-12T16:16:40.436 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057233895999999999 2024-09-12T16:16:40.436 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.436 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.436 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.436 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.436 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.436 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:40.438 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:16:40.438 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:40.436+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:40.538 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:40.536+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:40.589 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:40.589 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:16:40.589 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:16:40.590 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:40.598 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:16:40.640 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:40.637+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:40.708 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:40.708 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:16:40.709 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:16:40.709 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:16:40.709 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:40.718 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:16:40.739 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:40.737+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:40.833 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:40.833 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:16:40.833 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:16:40.833 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:16:40.834 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.834 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5599 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4788224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:40.834 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:16:40.834 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.53560439599999998, 2024-09-12T16:16:40.834 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061192059, 2024-09-12T16:16:40.834 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.834 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.834 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:40.834 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.834 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:40.834 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:40.834 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5599 2024-09-12T16:16:40.834 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.835 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.835 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.835 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.835 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:16:40.835 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.835 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.835 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.835 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:16:40.835 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.835 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.836 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.836 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296333+0000", 2024-09-12T16:16:40.836 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6599999999999996e-07 2024-09-12T16:16:40.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.836 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.836 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.836 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296335+0000", 2024-09-12T16:16:40.836 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5900000000000002e-06 2024-09-12T16:16:40.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.836 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.836 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.836 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296344+0000", 2024-09-12T16:16:40.836 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9539999999999993e-06 2024-09-12T16:16:40.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.837 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.837 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.837 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296350+0000", 2024-09-12T16:16:40.837 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5589999999999996e-06 2024-09-12T16:16:40.837 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.837 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.837 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.837 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357307+0000", 2024-09-12T16:16:40.837 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.060957573000000001 2024-09-12T16:16:40.837 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.837 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.837 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.837 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357401+0000", 2024-09-12T16:16:40.838 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3512999999999997e-05 2024-09-12T16:16:40.838 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.838 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.838 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.838 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357524+0000", 2024-09-12T16:16:40.838 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000123304 2024-09-12T16:16:40.838 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.838 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.838 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.838 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.838 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.838 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5611 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4730880~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:40.838 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:16:40.838 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.53554195199999999, 2024-09-12T16:16:40.838 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061359348000000001, 2024-09-12T16:16:40.839 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.839 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.839 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:40.839 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.839 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:40.839 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:40.839 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5611 2024-09-12T16:16:40.839 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.839 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.839 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.839 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.839 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:16:40.839 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.840 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.840 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.840 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:16:40.840 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.840 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.840 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.840 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296395+0000", 2024-09-12T16:16:40.840 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4600000000000003e-07 2024-09-12T16:16:40.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.840 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.840 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.840 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296399+0000", 2024-09-12T16:16:40.841 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9430000000000002e-06 2024-09-12T16:16:40.841 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.841 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.841 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.841 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296411+0000", 2024-09-12T16:16:40.841 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1755e-05 2024-09-12T16:16:40.841 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.841 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.841 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.841 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296417+0000", 2024-09-12T16:16:40.841 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3790000000000003e-06 2024-09-12T16:16:40.841 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.842 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.842 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.842 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357572+0000", 2024-09-12T16:16:40.842 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061154871 2024-09-12T16:16:40.842 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.842 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.842 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.842 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357663+0000", 2024-09-12T16:16:40.842 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0389999999999993e-05 2024-09-12T16:16:40.842 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.842 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.842 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.842 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357754+0000", 2024-09-12T16:16:40.843 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1063999999999994e-05 2024-09-12T16:16:40.843 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.843 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.843 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.843 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.843 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.843 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5613 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4775936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:40.843 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:16:40.843 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.53550077200000001, 2024-09-12T16:16:40.843 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061491777999999997, 2024-09-12T16:16:40.843 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.843 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.844 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:40.844 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.844 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:40.844 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:40.844 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5613 2024-09-12T16:16:40.844 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.844 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.844 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.844 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.844 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:16:40.844 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.844 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.844 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.845 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.845 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:16:40.845 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.845 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.845 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.845 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:16:40.845 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8899999999999999e-07 2024-09-12T16:16:40.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.845 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.845 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.845 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296439+0000", 2024-09-12T16:16:40.845 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8439999999999998e-06 2024-09-12T16:16:40.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.846 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.846 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.846 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296452+0000", 2024-09-12T16:16:40.846 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2639e-05 2024-09-12T16:16:40.846 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.846 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.846 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.846 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296457+0000", 2024-09-12T16:16:40.846 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5720000000000002e-06 2024-09-12T16:16:40.846 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.846 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.846 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.847 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357773+0000", 2024-09-12T16:16:40.847 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061315500000000002 2024-09-12T16:16:40.847 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.847 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.847 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.847 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357814+0000", 2024-09-12T16:16:40.847 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1448e-05 2024-09-12T16:16:40.847 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.847 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.847 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.847 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357927+0000", 2024-09-12T16:16:40.847 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000113186 2024-09-12T16:16:40.847 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.848 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.848 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.848 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.848 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.848 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5616 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4784128~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:40.848 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:16:40.848 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.53546570999999998, 2024-09-12T16:16:40.848 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061725002000000001, 2024-09-12T16:16:40.848 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.848 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.848 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:40.848 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.848 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:40.849 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:40.849 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5616 2024-09-12T16:16:40.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.849 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.849 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.849 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:16:40.849 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.849 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.849 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:16:40.849 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:16:40.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5900000000000002e-07 2024-09-12T16:16:40.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296473+0000", 2024-09-12T16:16:40.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3130000000000001e-06 2024-09-12T16:16:40.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296481+0000", 2024-09-12T16:16:40.851 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1389999999999998e-06 2024-09-12T16:16:40.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.851 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.851 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.851 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296486+0000", 2024-09-12T16:16:40.851 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3310000000000003e-06 2024-09-12T16:16:40.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.851 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.851 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.851 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357981+0000", 2024-09-12T16:16:40.851 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061494866000000002 2024-09-12T16:16:40.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.851 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.851 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.852 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358082+0000", 2024-09-12T16:16:40.852 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101424 2024-09-12T16:16:40.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.852 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.852 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.852 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358196+0000", 2024-09-12T16:16:40.852 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011347 2024-09-12T16:16:40.852 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.852 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.852 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.852 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.852 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5626 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4739072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:40.853 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:16:40.853 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.53538775400000005, 2024-09-12T16:16:40.853 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061802430999999998, 2024-09-12T16:16:40.853 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.853 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.853 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:40.853 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.853 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:40.853 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:40.853 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5626 2024-09-12T16:16:40.853 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.853 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.853 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.853 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.854 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:16:40.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.854 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.854 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.854 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:16:40.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.854 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.854 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.854 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296550+0000", 2024-09-12T16:16:40.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.215e-06 2024-09-12T16:16:40.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.854 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296555+0000", 2024-09-12T16:16:40.855 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9590000000000003e-06 2024-09-12T16:16:40.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296568+0000", 2024-09-12T16:16:40.855 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3338e-05 2024-09-12T16:16:40.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296576+0000", 2024-09-12T16:16:40.855 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5510000000000002e-06 2024-09-12T16:16:40.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.856 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358241+0000", 2024-09-12T16:16:40.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.06166576 2024-09-12T16:16:40.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.856 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.856 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358288+0000", 2024-09-12T16:16:40.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6097000000000003e-05 2024-09-12T16:16:40.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.856 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.856 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358351+0000", 2024-09-12T16:16:40.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3510999999999996e-05 2024-09-12T16:16:40.856 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.856 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.856 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.857 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.857 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5628 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4792320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:40.857 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:16:40.857 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.53534525399999999, 2024-09-12T16:16:40.857 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061961161000000001, 2024-09-12T16:16:40.857 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.857 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.857 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:40.857 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.857 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:40.857 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:40.857 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5628 2024-09-12T16:16:40.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.858 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.858 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.858 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.858 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:16:40.858 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.858 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.858 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.858 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:16:40.858 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.858 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.858 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.859 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296592+0000", 2024-09-12T16:16:40.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2099999999999996e-07 2024-09-12T16:16:40.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.859 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.859 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296595+0000", 2024-09-12T16:16:40.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0429999999999999e-06 2024-09-12T16:16:40.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.859 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.859 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296603+0000", 2024-09-12T16:16:40.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9899999999999997e-06 2024-09-12T16:16:40.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.860 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.860 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.860 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296609+0000", 2024-09-12T16:16:40.860 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7259999999999999e-06 2024-09-12T16:16:40.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.860 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.860 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.860 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358393+0000", 2024-09-12T16:16:40.860 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061784617 2024-09-12T16:16:40.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.860 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.860 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.860 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358460+0000", 2024-09-12T16:16:40.861 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7253000000000001e-05 2024-09-12T16:16:40.861 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.861 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.861 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.861 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358552+0000", 2024-09-12T16:16:40.861 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1811000000000006e-05 2024-09-12T16:16:40.861 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.861 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.861 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.861 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.861 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.861 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5638 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4734976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:40.861 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:16:40.862 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.534872703, 2024-09-12T16:16:40.862 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061654460000000001, 2024-09-12T16:16:40.862 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.862 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.862 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:40.862 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.862 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:40.862 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:40.862 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5638 2024-09-12T16:16:40.862 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.862 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.862 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.862 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.863 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:16:40.863 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.863 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.863 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.863 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.863 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:16:40.863 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.863 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.863 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.863 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.863 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:16:40.863 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.23e-07 2024-09-12T16:16:40.863 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.864 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.864 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.864 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297068+0000", 2024-09-12T16:16:40.864 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0060000000000003e-06 2024-09-12T16:16:40.864 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.864 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.864 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.864 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297080+0000", 2024-09-12T16:16:40.864 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1234e-05 2024-09-12T16:16:40.864 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.864 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.864 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.864 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297095+0000", 2024-09-12T16:16:40.865 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5698000000000001e-05 2024-09-12T16:16:40.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.865 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.865 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.865 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358582+0000", 2024-09-12T16:16:40.865 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061486274 2024-09-12T16:16:40.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.865 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.865 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.865 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358637+0000", 2024-09-12T16:16:40.865 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5439999999999998e-05 2024-09-12T16:16:40.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.865 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.866 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.866 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358718+0000", 2024-09-12T16:16:40.866 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0984999999999998e-05 2024-09-12T16:16:40.866 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.866 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.866 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.866 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.866 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5640 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4780032~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:40.866 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:16:40.866 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.53479098300000005, 2024-09-12T16:16:40.866 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061746620000000002, 2024-09-12T16:16:40.866 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.866 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.866 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:40.867 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.867 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:40.867 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:40.867 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5640 2024-09-12T16:16:40.867 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.867 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.867 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.867 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.867 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:16:40.867 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.867 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.867 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.867 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.867 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:16:40.867 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.868 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.868 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.868 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.868 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297146+0000", 2024-09-12T16:16:40.868 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3600000000000003e-07 2024-09-12T16:16:40.868 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.868 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.868 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.868 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297150+0000", 2024-09-12T16:16:40.868 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8430000000000003e-06 2024-09-12T16:16:40.868 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.868 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.868 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.868 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297160+0000", 2024-09-12T16:16:40.869 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7229999999999999e-06 2024-09-12T16:16:40.869 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.869 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.869 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.869 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297167+0000", 2024-09-12T16:16:40.869 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0180000000000004e-06 2024-09-12T16:16:40.869 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.869 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.869 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.869 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358750+0000", 2024-09-12T16:16:40.869 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061583104 2024-09-12T16:16:40.869 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.869 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.869 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.869 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358804+0000", 2024-09-12T16:16:40.870 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4277000000000002e-05 2024-09-12T16:16:40.870 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.870 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.870 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.870 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358892+0000", 2024-09-12T16:16:40.870 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7918999999999996e-05 2024-09-12T16:16:40.870 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.870 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.870 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.870 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.870 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.870 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5642 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4788224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:40.870 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:16:40.871 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.53474663899999997, 2024-09-12T16:16:40.871 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061860409999999998, 2024-09-12T16:16:40.871 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.871 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.871 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:40.871 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.871 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:40.871 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:40.871 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5642 2024-09-12T16:16:40.871 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.871 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.871 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.871 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.871 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:16:40.872 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.872 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.872 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.872 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:16:40.872 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.872 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.872 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.872 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:16:40.872 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7999999999999995e-07 2024-09-12T16:16:40.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.872 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.872 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.872 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297193+0000", 2024-09-12T16:16:40.873 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8310000000000001e-06 2024-09-12T16:16:40.873 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.873 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.873 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.873 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297204+0000", 2024-09-12T16:16:40.873 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0832999999999999e-05 2024-09-12T16:16:40.873 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.873 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.873 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.873 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297210+0000", 2024-09-12T16:16:40.873 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1770000000000003e-06 2024-09-12T16:16:40.873 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.873 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.873 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.873 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358928+0000", 2024-09-12T16:16:40.874 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061717826000000003 2024-09-12T16:16:40.874 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.874 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.874 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.874 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358977+0000", 2024-09-12T16:16:40.874 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9514000000000001e-05 2024-09-12T16:16:40.874 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.874 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.874 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.874 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359050+0000", 2024-09-12T16:16:40.874 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2649000000000002e-05 2024-09-12T16:16:40.874 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.874 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.874 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.875 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.875 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.875 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5646 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4743168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:40.875 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:16:40.875 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.53456669800000001, 2024-09-12T16:16:40.875 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061822122, 2024-09-12T16:16:40.875 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.875 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.875 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:40.875 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.875 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:40.875 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:40.875 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5646 2024-09-12T16:16:40.876 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.876 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.876 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.876 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.876 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:16:40.876 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.876 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.876 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.876 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.876 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:16:40.876 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.876 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.876 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.877 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.877 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:16:40.877 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3200000000000004e-07 2024-09-12T16:16:40.877 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.877 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.877 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.877 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297374+0000", 2024-09-12T16:16:40.877 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8240000000000001e-06 2024-09-12T16:16:40.877 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.877 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.877 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.877 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297384+0000", 2024-09-12T16:16:40.877 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5710000000000004e-06 2024-09-12T16:16:40.878 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.878 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.878 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.878 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297390+0000", 2024-09-12T16:16:40.878 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5130000000000002e-06 2024-09-12T16:16:40.878 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.878 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.878 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.878 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359080+0000", 2024-09-12T16:16:40.878 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061689569999999999 2024-09-12T16:16:40.878 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.878 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.878 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.878 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359134+0000", 2024-09-12T16:16:40.878 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3838999999999997e-05 2024-09-12T16:16:40.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.879 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.879 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.879 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359192+0000", 2024-09-12T16:16:40.879 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8072999999999998e-05 2024-09-12T16:16:40.879 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.879 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.879 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.879 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.879 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5647 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4751360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:40.879 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:16:40.879 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.53453001300000003, 2024-09-12T16:16:40.880 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061927569000000002, 2024-09-12T16:16:40.880 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.880 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.880 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:40.880 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.880 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:40.880 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:40.880 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5647 2024-09-12T16:16:40.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.880 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.880 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.880 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.880 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:16:40.881 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.881 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.881 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.881 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.881 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:16:40.881 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.881 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.881 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.881 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.881 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297407+0000", 2024-09-12T16:16:40.881 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.46e-07 2024-09-12T16:16:40.881 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.881 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.882 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.882 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297409+0000", 2024-09-12T16:16:40.882 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.469e-06 2024-09-12T16:16:40.882 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.882 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.882 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.882 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297415+0000", 2024-09-12T16:16:40.882 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9259999999999997e-06 2024-09-12T16:16:40.882 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.882 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.882 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.882 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297419+0000", 2024-09-12T16:16:40.882 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3840000000000001e-06 2024-09-12T16:16:40.882 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.883 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.883 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.883 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359224+0000", 2024-09-12T16:16:40.883 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061805367999999999 2024-09-12T16:16:40.883 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.883 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.883 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.883 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359275+0000", 2024-09-12T16:16:40.883 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1338000000000002e-05 2024-09-12T16:16:40.883 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.883 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.883 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.883 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359334+0000", 2024-09-12T16:16:40.883 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8638000000000003e-05 2024-09-12T16:16:40.884 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.884 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.884 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.884 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.884 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.884 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5649 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4796416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:40.884 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:16:40.884 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.53447515400000001, 2024-09-12T16:16:40.884 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.062018578999999997, 2024-09-12T16:16:40.884 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.884 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.884 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:40.884 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.885 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:40.885 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:40.885 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5649 2024-09-12T16:16:40.885 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.885 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.885 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.885 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.885 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:16:40.885 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.885 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.885 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.885 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.885 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:16:40.885 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.886 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.886 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.886 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.886 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297462+0000", 2024-09-12T16:16:40.886 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2399999999999998e-07 2024-09-12T16:16:40.886 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.886 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.886 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.886 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297465+0000", 2024-09-12T16:16:40.886 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.371e-06 2024-09-12T16:16:40.886 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.886 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.887 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.887 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297473+0000", 2024-09-12T16:16:40.887 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4699999999999996e-06 2024-09-12T16:16:40.887 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.887 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.887 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.887 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297478+0000", 2024-09-12T16:16:40.887 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2780000000000001e-06 2024-09-12T16:16:40.887 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.887 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.887 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.887 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359368+0000", 2024-09-12T16:16:40.888 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061889758000000003 2024-09-12T16:16:40.888 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.888 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.888 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.888 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359420+0000", 2024-09-12T16:16:40.888 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2574999999999997e-05 2024-09-12T16:16:40.888 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.888 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.888 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.888 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359480+0000", 2024-09-12T16:16:40.888 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9503000000000003e-05 2024-09-12T16:16:40.888 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.888 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.889 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.889 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.889 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.889 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5674 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4739072~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:40.889 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:16:40.889 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.53407138600000004, 2024-09-12T16:16:40.889 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061762989999999997, 2024-09-12T16:16:40.889 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.889 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.889 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:40.889 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.889 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:40.889 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:40.890 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5674 2024-09-12T16:16:40.890 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.890 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.890 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.890 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.890 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:16:40.890 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.890 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.890 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.890 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.890 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:16:40.890 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.890 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.890 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.891 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.891 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297866+0000", 2024-09-12T16:16:40.891 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1900000000000001e-07 2024-09-12T16:16:40.891 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.891 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.891 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.891 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297870+0000", 2024-09-12T16:16:40.891 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3560000000000003e-06 2024-09-12T16:16:40.891 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.891 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.891 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.891 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297888+0000", 2024-09-12T16:16:40.891 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8088999999999999e-05 2024-09-12T16:16:40.891 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.892 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.892 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.892 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297904+0000", 2024-09-12T16:16:40.892 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5971e-05 2024-09-12T16:16:40.892 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.892 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.892 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.892 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359510+0000", 2024-09-12T16:16:40.892 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061605634999999999 2024-09-12T16:16:40.892 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.892 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.892 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.892 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359554+0000", 2024-09-12T16:16:40.893 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4024999999999999e-05 2024-09-12T16:16:40.893 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.893 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.893 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.893 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359628+0000", 2024-09-12T16:16:40.893 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4095000000000001e-05 2024-09-12T16:16:40.893 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.893 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.893 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.893 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.893 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.893 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5676 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4792320~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:40.893 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:16:40.894 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.53387030599999996, 2024-09-12T16:16:40.894 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061720143999999998, 2024-09-12T16:16:40.894 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.894 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.894 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:40.894 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.894 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:40.894 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:40.894 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5676 2024-09-12T16:16:40.894 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.894 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.894 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.894 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.894 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:16:40.895 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.895 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.895 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.895 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.895 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:16:40.895 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.895 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.895 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.895 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.895 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298067+0000", 2024-09-12T16:16:40.895 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8199999999999999e-07 2024-09-12T16:16:40.895 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.895 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.895 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.896 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298070+0000", 2024-09-12T16:16:40.896 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.743e-06 2024-09-12T16:16:40.896 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.896 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.896 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.896 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298080+0000", 2024-09-12T16:16:40.896 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4059999999999994e-06 2024-09-12T16:16:40.896 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.896 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.896 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.896 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298088+0000", 2024-09-12T16:16:40.896 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0779999999999996e-06 2024-09-12T16:16:40.896 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.896 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.897 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.897 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359659+0000", 2024-09-12T16:16:40.897 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061570688999999998 2024-09-12T16:16:40.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.897 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.897 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.897 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359713+0000", 2024-09-12T16:16:40.897 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3939e-05 2024-09-12T16:16:40.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.897 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.897 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.897 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359786+0000", 2024-09-12T16:16:40.897 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3607000000000002e-05 2024-09-12T16:16:40.897 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.898 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.898 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.898 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.898 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.898 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5684 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4747264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:40.898 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:16:40.898 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.53340301400000001, 2024-09-12T16:16:40.898 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061394799, 2024-09-12T16:16:40.898 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.898 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.898 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:40.898 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.898 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:40.898 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:40.899 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5684 2024-09-12T16:16:40.899 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.899 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.899 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.899 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.899 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:16:40.899 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.899 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.899 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.899 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.899 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:16:40.899 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.899 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.899 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.900 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.900 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298534+0000", 2024-09-12T16:16:40.900 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4399999999999999e-07 2024-09-12T16:16:40.900 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.900 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.900 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.900 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298539+0000", 2024-09-12T16:16:40.900 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5360000000000003e-06 2024-09-12T16:16:40.900 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.900 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.900 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.900 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298550+0000", 2024-09-12T16:16:40.900 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1499e-05 2024-09-12T16:16:40.900 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.901 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.901 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.901 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298558+0000", 2024-09-12T16:16:40.901 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3000000000000004e-06 2024-09-12T16:16:40.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.901 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.901 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.901 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359815+0000", 2024-09-12T16:16:40.901 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061257952999999997 2024-09-12T16:16:40.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.901 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.901 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.901 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359868+0000", 2024-09-12T16:16:40.901 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2317000000000001e-05 2024-09-12T16:16:40.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.902 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.902 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.902 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359928+0000", 2024-09-12T16:16:40.902 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0350000000000003e-05 2024-09-12T16:16:40.902 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.902 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.902 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.902 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.902 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5686 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4755456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:40.902 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:16:40.902 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.53323558999999998, 2024-09-12T16:16:40.902 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061355082999999998, 2024-09-12T16:16:40.903 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.903 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.903 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:40.903 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.903 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:40.903 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:40.903 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5686 2024-09-12T16:16:40.903 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.903 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.903 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.903 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.903 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:16:40.903 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.903 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.903 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.904 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.904 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:16:40.904 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.904 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.904 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.904 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298702+0000", 2024-09-12T16:16:40.904 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2399999999999997e-07 2024-09-12T16:16:40.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.904 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.904 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.904 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298706+0000", 2024-09-12T16:16:40.904 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5700000000000003e-06 2024-09-12T16:16:40.905 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.905 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.905 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.905 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298718+0000", 2024-09-12T16:16:40.905 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1457999999999999e-05 2024-09-12T16:16:40.905 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.905 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.905 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.905 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298732+0000", 2024-09-12T16:16:40.905 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.452e-05 2024-09-12T16:16:40.905 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.905 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.905 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.905 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359956+0000", 2024-09-12T16:16:40.906 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061223626000000003 2024-09-12T16:16:40.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.906 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.906 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.906 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360000+0000", 2024-09-12T16:16:40.906 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3922999999999999e-05 2024-09-12T16:16:40.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.906 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.906 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.906 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360056+0000", 2024-09-12T16:16:40.906 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6162000000000002e-05 2024-09-12T16:16:40.906 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.906 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.907 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.907 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.907 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.907 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5688 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4800512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:40.907 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:16:40.907 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.53301253699999995, 2024-09-12T16:16:40.907 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061270514999999998, 2024-09-12T16:16:40.907 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.907 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.907 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:40.907 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.907 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:40.907 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:40.907 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5688 2024-09-12T16:16:40.907 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.908 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.908 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.908 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.908 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:16:40.908 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.908 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.908 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.908 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.908 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:16:40.908 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.908 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.908 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.909 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.909 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298925+0000", 2024-09-12T16:16:40.909 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4e-07 2024-09-12T16:16:40.909 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.909 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.909 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.909 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298929+0000", 2024-09-12T16:16:40.909 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9890000000000003e-06 2024-09-12T16:16:40.909 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.909 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.909 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.909 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298936+0000", 2024-09-12T16:16:40.909 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.52e-06 2024-09-12T16:16:40.909 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.910 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.910 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.910 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298941+0000", 2024-09-12T16:16:40.910 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4800000000000003e-06 2024-09-12T16:16:40.910 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.910 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.910 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.910 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360087+0000", 2024-09-12T16:16:40.910 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061146143 2024-09-12T16:16:40.910 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.910 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.910 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.910 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360137+0000", 2024-09-12T16:16:40.910 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0584000000000002e-05 2024-09-12T16:16:40.911 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.911 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.911 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.911 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360194+0000", 2024-09-12T16:16:40.911 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6858999999999999e-05 2024-09-12T16:16:40.911 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.911 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.911 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.911 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.911 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.911 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5693 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4751360~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:40.911 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:16:40.911 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.53259089999999998, 2024-09-12T16:16:40.911 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061139444000000001, 2024-09-12T16:16:40.911 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.912 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.912 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:40.912 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.912 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:40.912 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:40.912 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5693 2024-09-12T16:16:40.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.912 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.912 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.912 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.912 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:16:40.912 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.912 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.913 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.913 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:16:40.913 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.913 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.913 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.913 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.913 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299346+0000", 2024-09-12T16:16:40.913 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2300000000000001e-07 2024-09-12T16:16:40.913 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.913 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.913 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.913 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299349+0000", 2024-09-12T16:16:40.913 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5270000000000001e-06 2024-09-12T16:16:40.913 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.914 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.914 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299358+0000", 2024-09-12T16:16:40.914 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7030000000000001e-06 2024-09-12T16:16:40.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.914 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.914 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299364+0000", 2024-09-12T16:16:40.914 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7239999999999997e-06 2024-09-12T16:16:40.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.914 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.914 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360369+0000", 2024-09-12T16:16:40.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061004713000000002 2024-09-12T16:16:40.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.915 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.915 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360415+0000", 2024-09-12T16:16:40.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5926e-05 2024-09-12T16:16:40.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.915 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.915 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360485+0000", 2024-09-12T16:16:40.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0327999999999995e-05 2024-09-12T16:16:40.915 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.915 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.915 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.916 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.916 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.916 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5694 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4796416~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:40.916 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:16:40.916 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.53256187099999996, 2024-09-12T16:16:40.916 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061258034000000003, 2024-09-12T16:16:40.916 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.916 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.916 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:40.916 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.916 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:40.916 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:40.916 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5694 2024-09-12T16:16:40.916 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.917 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.917 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.917 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.917 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:16:40.917 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.917 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.917 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.917 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.917 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:16:40.917 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.917 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.917 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.917 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.917 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301884+0000", 2024-09-12T16:16:40.918 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025090379999999999 2024-09-12T16:16:40.918 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.918 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.918 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.918 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301889+0000", 2024-09-12T16:16:40.918 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5879999999999997e-06 2024-09-12T16:16:40.918 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.918 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.918 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.918 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301901+0000", 2024-09-12T16:16:40.918 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1466e-05 2024-09-12T16:16:40.918 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.918 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.918 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.918 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301908+0000", 2024-09-12T16:16:40.919 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1999999999999997e-06 2024-09-12T16:16:40.919 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.919 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.919 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.919 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360513+0000", 2024-09-12T16:16:40.919 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.058605023999999999 2024-09-12T16:16:40.919 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.919 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.919 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.919 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360562+0000", 2024-09-12T16:16:40.919 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9546000000000003e-05 2024-09-12T16:16:40.919 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.919 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.919 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.920 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360633+0000", 2024-09-12T16:16:40.920 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0172000000000005e-05 2024-09-12T16:16:40.920 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.920 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.920 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.920 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.920 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.920 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5759 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4767744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:40.920 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:16:40.920 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.52976833700000003, 2024-09-12T16:16:40.920 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061058604000000002, 2024-09-12T16:16:40.920 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:40.920 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:40.921 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:40.921 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:40.921 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:40.921 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:40.921 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5759 2024-09-12T16:16:40.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.921 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:40.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:40.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:16:40.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:40.922 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:16:40.922 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:40.922 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.922 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.922 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:40.922 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302548+0000", 2024-09-12T16:16:40.922 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00038011000000000002 2024-09-12T16:16:40.922 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.922 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.922 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:40.922 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302553+0000", 2024-09-12T16:16:40.922 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1830000000000002e-06 2024-09-12T16:16:40.922 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.922 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.923 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:40.923 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302564+0000", 2024-09-12T16:16:40.923 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1011e-05 2024-09-12T16:16:40.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.923 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.923 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:40.923 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302572+0000", 2024-09-12T16:16:40.923 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9009999999999994e-06 2024-09-12T16:16:40.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.923 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.923 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:40.923 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363102+0000", 2024-09-12T16:16:40.923 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.060529782999999997 2024-09-12T16:16:40.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.924 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.924 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:40.924 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363149+0000", 2024-09-12T16:16:40.924 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7321000000000003e-05 2024-09-12T16:16:40.924 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:40.924 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:40.924 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:40.924 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363227+0000", 2024-09-12T16:16:40.924 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7294999999999998e-05 2024-09-12T16:16:40.924 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.924 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.924 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.924 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:40.924 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:40.925 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:40.925 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #12, image image_client.0-clone12 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent13 2024-09-12T16:16:40.926 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:16:40.927 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:40.924+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:41.015 INFO:teuthology.orchestra.run.smithi204.stdout:2629 read 0x112c400 thru 0x113beab (0xfaac bytes) 2024-09-12T16:16:41.017 INFO:teuthology.orchestra.run.smithi204.stdout:2630 punch from 0x8a33e00 to 0x8a35800, (0x1a00 bytes) 2024-09-12T16:16:41.024 INFO:teuthology.orchestra.run.smithi204.stdout:2631 punch from 0x9653400 to 0x9660000, (0xcc00 bytes) 2024-09-12T16:16:41.027 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:41.025+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:41.030 INFO:teuthology.orchestra.run.smithi204.stdout:2634 trunc from 0xa861200 to 0xb4f0c00 2024-09-12T16:16:41.038 INFO:teuthology.orchestra.run.smithi204.stdout:2635 write 0x92eb400 thru 0x92f0935 (0x5536 bytes) 2024-09-12T16:16:41.039 INFO:teuthology.orchestra.run.smithi204.stdout:2637 punch from 0x2ca7200 to 0x2cb0000, (0x8e00 bytes) 2024-09-12T16:16:41.045 INFO:teuthology.orchestra.run.smithi204.stdout:2638 read 0xa72b800 thru 0xa72e4bf (0x2cc0 bytes) 2024-09-12T16:16:41.046 INFO:teuthology.orchestra.run.smithi204.stdout:2639 read 0x8393a00 thru 0x839d007 (0x9608 bytes) 2024-09-12T16:16:41.046 INFO:teuthology.orchestra.run.smithi204.stdout:2641 read 0x37d5400 thru 0x37daaf1 (0x56f2 bytes) 2024-09-12T16:16:41.047 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:41.047 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:41.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.047 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:642 3.17 3.e6402c97 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:41.047 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.045164+0000", 2024-09-12T16:16:41.048 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0010492699999999999, 2024-09-12T16:16:41.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010677799999999999, 2024-09-12T16:16:41.048 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:41.048 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:41.048 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:41.048 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:41.048 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:16:41.048 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:16:41.048 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 642 2024-09-12T16:16:41.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.048 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:41.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:41.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045164+0000", 2024-09-12T16:16:41.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:41.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:41.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045164+0000", 2024-09-12T16:16:41.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:41.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:41.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045165+0000", 2024-09-12T16:16:41.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9100000000000003e-07 2024-09-12T16:16:41.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:41.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045169+0000", 2024-09-12T16:16:41.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0589999999999996e-06 2024-09-12T16:16:41.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:41.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045180+0000", 2024-09-12T16:16:41.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0547000000000001e-05 2024-09-12T16:16:41.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:41.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045195+0000", 2024-09-12T16:16:41.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5475e-05 2024-09-12T16:16:41.051 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:41.051 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:41.051 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:41.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.051 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:658 3.17 3.e6402c97 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:41.051 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.045214+0000", 2024-09-12T16:16:41.051 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.00099945999999999998, 2024-09-12T16:16:41.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010758289999999999, 2024-09-12T16:16:41.051 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:41.051 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:41.051 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:41.051 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:41.051 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:16:41.052 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:16:41.052 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 658 2024-09-12T16:16:41.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.052 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:41.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:41.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045214+0000", 2024-09-12T16:16:41.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:41.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:41.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045214+0000", 2024-09-12T16:16:41.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:41.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:41.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045215+0000", 2024-09-12T16:16:41.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2999999999999999e-07 2024-09-12T16:16:41.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:41.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045221+0000", 2024-09-12T16:16:41.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7830000000000004e-06 2024-09-12T16:16:41.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:41.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045230+0000", 2024-09-12T16:16:41.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8980000000000002e-06 2024-09-12T16:16:41.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:41.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045236+0000", 2024-09-12T16:16:41.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4450000000000001e-06 2024-09-12T16:16:41.054 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:41.054 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:41.054 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:41.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.054 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:664 3.17 3.e6402c97 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:41.054 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.045254+0000", 2024-09-12T16:16:41.054 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.00095936000000000003, 2024-09-12T16:16:41.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001086166, 2024-09-12T16:16:41.055 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:41.055 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:41.055 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:41.055 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:41.055 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:16:41.055 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:16:41.055 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 664 2024-09-12T16:16:41.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.055 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:41.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:41.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045254+0000", 2024-09-12T16:16:41.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:41.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:41.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045254+0000", 2024-09-12T16:16:41.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:41.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:41.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045255+0000", 2024-09-12T16:16:41.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6000000000000004e-07 2024-09-12T16:16:41.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:41.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045258+0000", 2024-09-12T16:16:41.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9830000000000001e-06 2024-09-12T16:16:41.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:41.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045266+0000", 2024-09-12T16:16:41.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8769999999999993e-06 2024-09-12T16:16:41.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:41.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045272+0000", 2024-09-12T16:16:41.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1569999999999997e-06 2024-09-12T16:16:41.057 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:41.057 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:41.057 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:41.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.057 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:678 3.17 3.e6402c97 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:41.058 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.045636+0000", 2024-09-12T16:16:41.058 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.00057737700000000001, 2024-09-12T16:16:41.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00075380399999999995, 2024-09-12T16:16:41.058 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:41.058 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:41.058 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:41.058 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:41.058 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:16:41.058 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:16:41.058 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 678 2024-09-12T16:16:41.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.058 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:41.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:41.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045636+0000", 2024-09-12T16:16:41.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:41.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:41.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045636+0000", 2024-09-12T16:16:41.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:41.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:41.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045637+0000", 2024-09-12T16:16:41.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.71e-07 2024-09-12T16:16:41.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:41.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045642+0000", 2024-09-12T16:16:41.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6249999999999998e-06 2024-09-12T16:16:41.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:41.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045655+0000", 2024-09-12T16:16:41.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3555e-05 2024-09-12T16:16:41.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:41.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045669+0000", 2024-09-12T16:16:41.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3732e-05 2024-09-12T16:16:41.060 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:41.060 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:41.060 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:41.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.061 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:684 3.17 3.e6402c97 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:41.061 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.045681+0000", 2024-09-12T16:16:41.061 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.00053227700000000005, 2024-09-12T16:16:41.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00075622799999999996, 2024-09-12T16:16:41.061 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:41.061 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:41.061 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:41.061 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:41.061 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:16:41.061 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:16:41.061 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 684 2024-09-12T16:16:41.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.061 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:41.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:41.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045681+0000", 2024-09-12T16:16:41.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:41.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:41.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045681+0000", 2024-09-12T16:16:41.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:41.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:41.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045682+0000", 2024-09-12T16:16:41.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4199999999999996e-07 2024-09-12T16:16:41.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:41.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045685+0000", 2024-09-12T16:16:41.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6570000000000001e-06 2024-09-12T16:16:41.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:41.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045693+0000", 2024-09-12T16:16:41.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2549999999999997e-06 2024-09-12T16:16:41.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:41.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045699+0000", 2024-09-12T16:16:41.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.156e-06 2024-09-12T16:16:41.063 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:41.063 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:691 3.17 3.e6402c97 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.045708+0000", 2024-09-12T16:16:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.00050582299999999997, 2024-09-12T16:16:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00077970899999999996, 2024-09-12T16:16:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:16:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:16:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 691 2024-09-12T16:16:41.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.065 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:41.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:41.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045708+0000", 2024-09-12T16:16:41.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:41.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:41.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045708+0000", 2024-09-12T16:16:41.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:41.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:41.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045708+0000", 2024-09-12T16:16:41.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6100000000000001e-07 2024-09-12T16:16:41.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:41.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045711+0000", 2024-09-12T16:16:41.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3939999999999999e-06 2024-09-12T16:16:41.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:41.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045718+0000", 2024-09-12T16:16:41.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2320000000000004e-06 2024-09-12T16:16:41.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:41.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045726+0000", 2024-09-12T16:16:41.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0949999999999996e-06 2024-09-12T16:16:41.067 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:41.067 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:41.067 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:41.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.067 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:698 3.17 3.e6402c97 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:41.067 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.045734+0000", 2024-09-12T16:16:41.067 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.00048008600000000001, 2024-09-12T16:16:41.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000800652, 2024-09-12T16:16:41.067 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:41.067 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:41.068 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:41.068 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:41.068 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:16:41.068 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:16:41.068 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 698 2024-09-12T16:16:41.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.068 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:41.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:41.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045734+0000", 2024-09-12T16:16:41.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:41.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:41.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045734+0000", 2024-09-12T16:16:41.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:41.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:41.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045734+0000", 2024-09-12T16:16:41.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1899999999999998e-07 2024-09-12T16:16:41.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:41.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045736+0000", 2024-09-12T16:16:41.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2500000000000001e-06 2024-09-12T16:16:41.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:41.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045747+0000", 2024-09-12T16:16:41.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0458999999999999e-05 2024-09-12T16:16:41.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:41.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045753+0000", 2024-09-12T16:16:41.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8540000000000002e-06 2024-09-12T16:16:41.070 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:41.070 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:41.070 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:41.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.070 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:717 3.17 3.e6402c97 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:41.071 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.045764+0000", 2024-09-12T16:16:41.071 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.00044924899999999998, 2024-09-12T16:16:41.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00082070500000000002, 2024-09-12T16:16:41.071 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:41.071 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:41.071 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:41.071 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:41.071 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:16:41.071 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:16:41.071 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 717 2024-09-12T16:16:41.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.071 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:41.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045764+0000", 2024-09-12T16:16:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045764+0000", 2024-09-12T16:16:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045765+0000", 2024-09-12T16:16:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.37e-07 2024-09-12T16:16:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045768+0000", 2024-09-12T16:16:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7190000000000001e-06 2024-09-12T16:16:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045775+0000", 2024-09-12T16:16:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2300000000000002e-06 2024-09-12T16:16:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.045783+0000", 2024-09-12T16:16:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4109999999999996e-06 2024-09-12T16:16:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:41.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.074 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:611 3.17 3:e9340267:::rbd_data.1155525b14e3.0000000000000031:f [read 118784~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:41.074 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.044851+0000", 2024-09-12T16:16:41.074 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0013628760000000001, 2024-09-12T16:16:41.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017865699999999999, 2024-09-12T16:16:41.074 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:41.074 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:41.074 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:16:41.074 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:41.074 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:16:41.074 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:16:41.074 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 611 2024-09-12T16:16:41.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.074 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:41.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:41.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.044851+0000", 2024-09-12T16:16:41.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:41.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:41.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.044851+0000", 2024-09-12T16:16:41.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:41.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:41.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.044851+0000", 2024-09-12T16:16:41.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0800000000000005e-07 2024-09-12T16:16:41.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.076 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:41.076 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.044854+0000", 2024-09-12T16:16:41.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.554e-06 2024-09-12T16:16:41.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.076 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:41.076 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.044883+0000", 2024-09-12T16:16:41.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9345000000000001e-05 2024-09-12T16:16:41.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.076 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:41.076 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.044891+0000", 2024-09-12T16:16:41.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5689999999999999e-06 2024-09-12T16:16:41.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:41.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.046569+0000", 2024-09-12T16:16:41.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0016782050000000001 2024-09-12T16:16:41.077 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:41.077 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:41.077 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:41.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.077 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:617 3.17 3.e6402c97 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:41.077 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.044901+0000", 2024-09-12T16:16:41.077 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0013130559999999999, 2024-09-12T16:16:41.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017940090000000001, 2024-09-12T16:16:41.078 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:41.078 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:41.078 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:41.078 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:41.078 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:16:41.078 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:16:41.078 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 617 2024-09-12T16:16:41.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.078 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:41.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:41.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.044901+0000", 2024-09-12T16:16:41.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:41.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:41.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.044901+0000", 2024-09-12T16:16:41.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:41.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:41.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.044901+0000", 2024-09-12T16:16:41.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3e-07 2024-09-12T16:16:41.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:41.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.044904+0000", 2024-09-12T16:16:41.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0699999999999998e-06 2024-09-12T16:16:41.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:41.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.044913+0000", 2024-09-12T16:16:41.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5580000000000001e-06 2024-09-12T16:16:41.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:41.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.044925+0000", 2024-09-12T16:16:41.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2102e-05 2024-09-12T16:16:41.080 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:41.080 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:41.080 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:41.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.081 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:635 3.17 3.e6402c97 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:41.081 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.044939+0000", 2024-09-12T16:16:41.081 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.001274671, 2024-09-12T16:16:41.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0018035289999999999, 2024-09-12T16:16:41.081 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:41.081 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:41.081 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:41.081 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:41.081 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:16:41.081 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:16:41.081 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 635 2024-09-12T16:16:41.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.081 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:41.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:41.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.044939+0000", 2024-09-12T16:16:41.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:41.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:41.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.044939+0000", 2024-09-12T16:16:41.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:41.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:41.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.044939+0000", 2024-09-12T16:16:41.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4199999999999996e-07 2024-09-12T16:16:41.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:41.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.044942+0000", 2024-09-12T16:16:41.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.005e-06 2024-09-12T16:16:41.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:41.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.044950+0000", 2024-09-12T16:16:41.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9049999999999997e-06 2024-09-12T16:16:41.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:41.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:41.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:41.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.044957+0000", 2024-09-12T16:16:41.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7800000000000003e-06 2024-09-12T16:16:41.084 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:41.084 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:41.084 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:41.084 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:41.084 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-12T16:16:41.084 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 11 2024-09-12T16:16:41.084 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:41.085 INFO:teuthology.orchestra.run.smithi204.stdout:2643 read 0x650de00 thru 0x650e613 (0x814 bytes) 2024-09-12T16:16:41.085 INFO:teuthology.orchestra.run.smithi204.stdout:2644 write 0xd122800 thru 0xd1324ef (0xfcf0 bytes) 2024-09-12T16:16:41.085 INFO:teuthology.orchestra.run.smithi204.stdout:2645 punch from 0x2c18e00 to 0x2c24c00, (0xbe00 bytes) 2024-09-12T16:16:41.085 INFO:teuthology.orchestra.run.smithi204.stdout:2646 read 0x563400 thru 0x572264 (0xee65 bytes) 2024-09-12T16:16:41.086 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:16:41.086 INFO:teuthology.orchestra.run.smithi204.stdout:2649 read 0x781c400 thru 0x7827480 (0xb081 bytes) 2024-09-12T16:16:41.087 INFO:teuthology.orchestra.run.smithi204.stdout:2650 read 0x3107e00 thru 0x310e3b2 (0x65b3 bytes) 2024-09-12T16:16:41.099 INFO:teuthology.orchestra.run.smithi204.stdout:2651 trunc from 0xd132600 to 0x9974200 2024-09-12T16:16:41.121 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T16:16:41.127 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:41.126+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:41.128 INFO:teuthology.orchestra.run.smithi204.stdout:2652 read 0x4bd8600 thru 0x4bdf003 (0x6a04 bytes) 2024-09-12T16:16:41.129 INFO:teuthology.orchestra.run.smithi204.stdout:2653 read 0x697f800 thru 0x6989741 (0x9f42 bytes) 2024-09-12T16:16:41.136 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2024-09-12T16:16:41.228 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:41.226+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:41.243 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:41.243 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:41.243 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:16:41.243 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:16:41.243 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:41.252 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:16:41.258 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:16:41.258 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:16:41.275 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:16:41.275 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:16:41.293 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:16:41.293 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:16:41.310 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:16:41.310 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:16:41.327 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:16:41.327 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:16:41.327 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-12T16:16:41.329 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:41.328+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:41.330 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T16:16:41.331 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T16:16:41.366 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:41.366 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:41.375 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:16:41.395 INFO:teuthology.orchestra.run.smithi204.stdout:2654 write 0xe67a000 thru 0xe686c0f (0xcc10 bytes) 2024-09-12T16:16:41.395 INFO:teuthology.orchestra.run.smithi204.stdout:2655 read 0x9928c00 thru 0x992a0f0 (0x14f1 bytes) 2024-09-12T16:16:41.395 INFO:teuthology.orchestra.run.smithi204.stdout:2658 punch from 0x478f600 to 0x4795000, (0x5a00 bytes) 2024-09-12T16:16:41.398 INFO:teuthology.orchestra.run.smithi204.stdout:2659 trunc from 0xe686e00 to 0xd19e800 2024-09-12T16:16:41.416 INFO:teuthology.orchestra.run.smithi204.stdout:2660 read 0x402c000 thru 0x4030a45 (0x4a46 bytes) 2024-09-12T16:16:41.418 INFO:teuthology.orchestra.run.smithi204.stdout:2661 write 0x9cb800 thru 0x9d100b (0x580c bytes) 2024-09-12T16:16:41.418 INFO:teuthology.orchestra.run.smithi204.stdout:2664 read 0x9a76000 thru 0x9a7c375 (0x6376 bytes) 2024-09-12T16:16:41.419 INFO:teuthology.orchestra.run.smithi204.stdout:2665 write 0x5566200 thru 0x55694ef (0x32f0 bytes) 2024-09-12T16:16:41.419 INFO:teuthology.orchestra.run.smithi204.stdout:2666 clone 15 order 25 su 4194304 sc 13 2024-09-12T16:16:41.430 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:41.429+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:41.530 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:41.530 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:41.531 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:41.530+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:41.539 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:16:41.631 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:41.630+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:41.645 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:41.645 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:41.653 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:16:41.738 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:41.737+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:41.801 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:41.801 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:41.809 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:16:41.851 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:41.850+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:41.934 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:41.932+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:41.957 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:41.958 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:41.966 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:16:42.035 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:42.034+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:42.113 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:42.113 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:42.121 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:16:42.135 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:42.134+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:42.232 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:42.233 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:42.236 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:42.234+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:42.242 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:16:42.280 INFO:teuthology.orchestra.run.smithi204.stdout:truncating image image_client.0-clone14 from 0xd19e800 (overlap 0x9974200) to 0x2e09200 2024-09-12T16:16:42.339 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:42.335+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:42.406 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:42.406 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:42.420 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:16:42.437 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:42.436+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:42.538 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:42.537+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:42.574 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:42.574 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:42.584 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:16:42.639 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:42.638+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:42.739 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:42.739 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:42.740 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:42.739+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:42.748 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:16:42.841 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:42.840+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:42.859 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:42.859 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:42.868 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:16:42.941 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:42.940+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:42.959 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #13, image image_client.0-clone13 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent14 2024-09-12T16:16:42.977 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:42.977 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:42.986 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:16:43.042 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:43.041+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:43.104 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:43.104 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:43.110 INFO:teuthology.orchestra.run.smithi204.stdout:2667 write 0x5e72600 thru 0x5e7d2b8 (0xacb9 bytes) 2024-09-12T16:16:43.111 INFO:teuthology.orchestra.run.smithi204.stdout:2668 write 0x82fe400 thru 0x8305d94 (0x7995 bytes) 2024-09-12T16:16:43.112 INFO:teuthology.orchestra.run.smithi204.stdout:2669 read 0x4c99c00 thru 0x4c9e330 (0x4731 bytes) 2024-09-12T16:16:43.113 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:16:43.113 INFO:teuthology.orchestra.run.smithi204.stdout:2673 write 0x613a600 thru 0x6143dc7 (0x97c8 bytes) 2024-09-12T16:16:43.113 INFO:teuthology.orchestra.run.smithi204.stdout:2674 write 0xb062800 thru 0xb06d538 (0xad39 bytes) 2024-09-12T16:16:43.114 INFO:teuthology.orchestra.run.smithi204.stdout:2678 read 0x6a00 thru 0xf11f (0x8720 bytes) 2024-09-12T16:16:43.114 INFO:teuthology.orchestra.run.smithi204.stdout:2679 write 0xa507200 thru 0xa5140e7 (0xcee8 bytes) 2024-09-12T16:16:43.115 INFO:teuthology.orchestra.run.smithi204.stdout:2680 punch from 0x3669000 to 0x3672600, (0x9600 bytes) 2024-09-12T16:16:43.153 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T16:16:43.154 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:43.153+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:43.243 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:43.242+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:43.295 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:43.295 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:43.309 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:16:43.331 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T16:16:43.353 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:43.352+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:43.445 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:43.444+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:43.455 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:43.455 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:43.459 INFO:teuthology.orchestra.run.smithi204.stdout:2683 read 0x445c400 thru 0x4469786 (0xd387 bytes) 2024-09-12T16:16:43.464 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:16:43.469 INFO:teuthology.orchestra.run.smithi204.stdout:2684 write 0xd4df000 thru 0xd4df1fc (0x1fd bytes) 2024-09-12T16:16:43.528 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:16:43.528 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:16:43.533 INFO:teuthology.orchestra.run.smithi204.stdout:2685 write 0xdde8800 thru 0xddee905 (0x6106 bytes) 2024-09-12T16:16:43.535 INFO:teuthology.orchestra.run.smithi204.stdout:2686 write 0xdabd200 thru 0xdabd8ea (0x6eb bytes) 2024-09-12T16:16:43.546 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:43.544+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:43.558 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:16:43.559 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:16:43.580 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:16:43.580 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:16:43.598 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:16:43.598 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:16:43.616 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:16:43.617 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:16:43.617 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-12T16:16:43.620 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T16:16:43.620 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T16:16:43.635 INFO:teuthology.orchestra.run.smithi204.stdout:2689 write 0xee25a00 thru 0xee2d594 (0x7b95 bytes) 2024-09-12T16:16:43.636 INFO:teuthology.orchestra.run.smithi204.stdout:2690 read 0x44c6200 thru 0x44d2cdf (0xcae0 bytes) 2024-09-12T16:16:43.643 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:43.643 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:16:43.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:16:43.643 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:43.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.643 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3703 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14803968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:43.643 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139513+0000", 2024-09-12T16:16:43.643 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.502381579000001, 2024-09-12T16:16:43.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053248794000000002, 2024-09-12T16:16:43.644 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:43.644 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:43.644 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:43.644 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:43.644 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:43.644 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:43.644 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3703 2024-09-12T16:16:43.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.644 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:43.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:43.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139513+0000", 2024-09-12T16:16:43.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:43.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139513+0000", 2024-09-12T16:16:43.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:43.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139639+0000", 2024-09-12T16:16:43.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012673299999999999 2024-09-12T16:16:43.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:43.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139642+0000", 2024-09-12T16:16:43.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4820000000000001e-06 2024-09-12T16:16:43.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:43.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139647+0000", 2024-09-12T16:16:43.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8040000000000001e-06 2024-09-12T16:16:43.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:43.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139650+0000", 2024-09-12T16:16:43.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.529e-06 2024-09-12T16:16:43.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:43.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192537+0000", 2024-09-12T16:16:43.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052886503000000001 2024-09-12T16:16:43.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:43.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192627+0000", 2024-09-12T16:16:43.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0183e-05 2024-09-12T16:16:43.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:43.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192761+0000", 2024-09-12T16:16:43.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013456000000000001 2024-09-12T16:16:43.648 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.648 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:43.648 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.648 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3704 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14808064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:43.648 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139656+0000", 2024-09-12T16:16:43.648 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.502237662999999, 2024-09-12T16:16:43.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053247502000000002, 2024-09-12T16:16:43.648 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:43.648 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:43.649 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:43.649 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:43.649 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:43.649 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:43.649 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3704 2024-09-12T16:16:43.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.649 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:43.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:43.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139656+0000", 2024-09-12T16:16:43.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:43.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139656+0000", 2024-09-12T16:16:43.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:43.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139790+0000", 2024-09-12T16:16:43.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000133471 2024-09-12T16:16:43.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:43.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139792+0000", 2024-09-12T16:16:43.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.968e-06 2024-09-12T16:16:43.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:43.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139796+0000", 2024-09-12T16:16:43.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2660000000000003e-06 2024-09-12T16:16:43.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:43.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139799+0000", 2024-09-12T16:16:43.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2839999999999998e-06 2024-09-12T16:16:43.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:43.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192790+0000", 2024-09-12T16:16:43.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052990388999999999 2024-09-12T16:16:43.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:43.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192835+0000", 2024-09-12T16:16:43.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5101000000000001e-05 2024-09-12T16:16:43.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:43.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192904+0000", 2024-09-12T16:16:43.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9023000000000006e-05 2024-09-12T16:16:43.652 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.652 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:43.652 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.652 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3705 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14812160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:43.652 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:16:43.652 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.502089327, 2024-09-12T16:16:43.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053368831999999998, 2024-09-12T16:16:43.652 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:43.653 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:43.653 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:43.653 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:43.653 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:43.653 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:43.653 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3705 2024-09-12T16:16:43.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.653 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:43.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:43.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:16:43.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:43.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:16:43.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:43.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139932+0000", 2024-09-12T16:16:43.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012762099999999999 2024-09-12T16:16:43.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:43.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139935+0000", 2024-09-12T16:16:43.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.119e-06 2024-09-12T16:16:43.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:43.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139939+0000", 2024-09-12T16:16:43.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7999999999999998e-06 2024-09-12T16:16:43.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:43.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139953+0000", 2024-09-12T16:16:43.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3923999999999999e-05 2024-09-12T16:16:43.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:43.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192946+0000", 2024-09-12T16:16:43.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052992971 2024-09-12T16:16:43.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:43.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193035+0000", 2024-09-12T16:16:43.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9040000000000001e-05 2024-09-12T16:16:43.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:43.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193174+0000", 2024-09-12T16:16:43.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138357 2024-09-12T16:16:43.656 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.656 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:43.656 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.657 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3706 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14816256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:43.657 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:16:43.657 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.501934337000002, 2024-09-12T16:16:43.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053341723000000001, 2024-09-12T16:16:43.657 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:43.657 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:43.657 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:43.657 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:43.657 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:43.657 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:43.658 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3706 2024-09-12T16:16:43.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.658 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:43.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:43.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:16:43.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:43.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:16:43.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:43.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140090+0000", 2024-09-12T16:16:43.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013020100000000001 2024-09-12T16:16:43.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:43.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140097+0000", 2024-09-12T16:16:43.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0709999999999997e-06 2024-09-12T16:16:43.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:43.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140103+0000", 2024-09-12T16:16:43.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5450000000000003e-06 2024-09-12T16:16:43.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:43.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140106+0000", 2024-09-12T16:16:43.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3739999999999998e-06 2024-09-12T16:16:43.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:43.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193190+0000", 2024-09-12T16:16:43.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053084131999999999 2024-09-12T16:16:43.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:43.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193232+0000", 2024-09-12T16:16:43.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1517000000000002e-05 2024-09-12T16:16:43.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:43.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193302+0000", 2024-09-12T16:16:43.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9882999999999995e-05 2024-09-12T16:16:43.661 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.661 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:43.661 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.662 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3707 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14820352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:43.662 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:16:43.662 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.501782347999999, 2024-09-12T16:16:43.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053452771000000003, 2024-09-12T16:16:43.662 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:43.662 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:43.662 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:43.662 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:43.662 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:43.662 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:43.662 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3707 2024-09-12T16:16:43.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.662 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:43.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:43.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:16:43.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:43.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:16:43.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:43.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140219+0000", 2024-09-12T16:16:43.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106902 2024-09-12T16:16:43.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:43.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140225+0000", 2024-09-12T16:16:43.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3199999999999996e-06 2024-09-12T16:16:43.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:43.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140230+0000", 2024-09-12T16:16:43.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8969999999999999e-06 2024-09-12T16:16:43.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:43.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140233+0000", 2024-09-12T16:16:43.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2119999999999999e-06 2024-09-12T16:16:43.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:43.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193339+0000", 2024-09-12T16:16:43.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053105556999999998 2024-09-12T16:16:43.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:43.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193431+0000", 2024-09-12T16:16:43.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1837999999999997e-05 2024-09-12T16:16:43.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:43.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193565+0000", 2024-09-12T16:16:43.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013404500000000001 2024-09-12T16:16:43.666 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.666 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:43.666 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.666 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3708 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14824448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:43.666 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:16:43.666 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.501653506, 2024-09-12T16:16:43.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053468190999999998, 2024-09-12T16:16:43.666 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:43.666 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:43.666 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:43.666 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:43.666 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:43.667 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:43.667 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3708 2024-09-12T16:16:43.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.667 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:43.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:43.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:16:43.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:43.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:16:43.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:43.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140351+0000", 2024-09-12T16:16:43.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110096 2024-09-12T16:16:43.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:43.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140358+0000", 2024-09-12T16:16:43.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.306e-06 2024-09-12T16:16:43.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:43.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140368+0000", 2024-09-12T16:16:43.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0225e-05 2024-09-12T16:16:43.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:43.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140372+0000", 2024-09-12T16:16:43.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6169999999999998e-06 2024-09-12T16:16:43.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:43.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193594+0000", 2024-09-12T16:16:43.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053222419999999999 2024-09-12T16:16:43.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:43.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193640+0000", 2024-09-12T16:16:43.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.587e-05 2024-09-12T16:16:43.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:43.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193709+0000", 2024-09-12T16:16:43.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8657000000000004e-05 2024-09-12T16:16:43.670 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.670 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:43.670 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.670 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3709 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14828544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:43.670 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:16:43.670 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.501516538000001, 2024-09-12T16:16:43.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594033999999999, 2024-09-12T16:16:43.670 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:43.670 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:43.670 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:43.670 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:43.670 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:43.671 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:43.671 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3709 2024-09-12T16:16:43.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.671 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:43.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:43.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:16:43.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:43.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:16:43.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:43.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140499+0000", 2024-09-12T16:16:43.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121019 2024-09-12T16:16:43.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:43.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140501+0000", 2024-09-12T16:16:43.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2369999999999999e-06 2024-09-12T16:16:43.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:43.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140506+0000", 2024-09-12T16:16:43.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.639e-06 2024-09-12T16:16:43.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:43.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140509+0000", 2024-09-12T16:16:43.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3419999999999999e-06 2024-09-12T16:16:43.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:43.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193743+0000", 2024-09-12T16:16:43.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053234311999999999 2024-09-12T16:16:43.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:43.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193833+0000", 2024-09-12T16:16:43.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9883999999999995e-05 2024-09-12T16:16:43.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:43.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193972+0000", 2024-09-12T16:16:43.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138601 2024-09-12T16:16:43.674 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.674 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:43.674 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.674 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3710 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14832640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:43.674 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:16:43.674 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.501379192000002, 2024-09-12T16:16:43.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053607324999999997, 2024-09-12T16:16:43.674 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:43.674 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:43.674 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:43.675 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:43.675 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:43.675 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:43.675 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3710 2024-09-12T16:16:43.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.675 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:43.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:43.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:16:43.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:43.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:16:43.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:43.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140664+0000", 2024-09-12T16:16:43.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014918700000000001 2024-09-12T16:16:43.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:43.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140674+0000", 2024-09-12T16:16:43.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8379999999999997e-06 2024-09-12T16:16:43.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:43.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140694+0000", 2024-09-12T16:16:43.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0145000000000001e-05 2024-09-12T16:16:43.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:43.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140703+0000", 2024-09-12T16:16:43.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5150000000000006e-06 2024-09-12T16:16:43.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:43.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194006+0000", 2024-09-12T16:16:43.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053303370000000003 2024-09-12T16:16:43.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:43.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194051+0000", 2024-09-12T16:16:43.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5012000000000002e-05 2024-09-12T16:16:43.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:43.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194122+0000", 2024-09-12T16:16:43.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1258000000000001e-05 2024-09-12T16:16:43.678 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.678 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:43.678 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.678 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3711 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14836736~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:43.678 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:16:43.678 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.501177744, 2024-09-12T16:16:43.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053670799999999998, 2024-09-12T16:16:43.678 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:43.678 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:43.678 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:43.679 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:43.679 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:43.679 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:43.679 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3711 2024-09-12T16:16:43.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.679 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:43.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:43.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:16:43.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:43.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:16:43.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:43.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140782+0000", 2024-09-12T16:16:43.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5549999999999994e-05 2024-09-12T16:16:43.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:43.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140786+0000", 2024-09-12T16:16:43.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.89e-06 2024-09-12T16:16:43.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:43.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140796+0000", 2024-09-12T16:16:43.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0057e-05 2024-09-12T16:16:43.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:43.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140819+0000", 2024-09-12T16:16:43.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3005000000000001e-05 2024-09-12T16:16:43.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:43.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194159+0000", 2024-09-12T16:16:43.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053340324000000001 2024-09-12T16:16:43.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:43.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194248+0000", 2024-09-12T16:16:43.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9209000000000006e-05 2024-09-12T16:16:43.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:43.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194387+0000", 2024-09-12T16:16:43.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138765 2024-09-12T16:16:43.682 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.682 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:43.682 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.682 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3712 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14840832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:43.682 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:16:43.682 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.501063286000001, 2024-09-12T16:16:43.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053699068000000003, 2024-09-12T16:16:43.682 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:43.682 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:43.683 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:43.683 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:43.683 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:43.683 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:43.683 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3712 2024-09-12T16:16:43.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.683 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:43.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:43.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:16:43.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:43.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:16:43.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:43.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140900+0000", 2024-09-12T16:16:43.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9014e-05 2024-09-12T16:16:43.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:43.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140904+0000", 2024-09-12T16:16:43.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0940000000000001e-06 2024-09-12T16:16:43.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:43.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140933+0000", 2024-09-12T16:16:43.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8996000000000002e-05 2024-09-12T16:16:43.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:43.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140945+0000", 2024-09-12T16:16:43.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1909000000000001e-05 2024-09-12T16:16:43.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:43.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194415+0000", 2024-09-12T16:16:43.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053470403 2024-09-12T16:16:43.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:43.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194460+0000", 2024-09-12T16:16:43.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5145000000000002e-05 2024-09-12T16:16:43.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:43.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194530+0000", 2024-09-12T16:16:43.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9506999999999997e-05 2024-09-12T16:16:43.686 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.687 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:43.687 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.687 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3713 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14844928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:43.687 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:16:43.687 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.500930226000001, 2024-09-12T16:16:43.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053821236000000001, 2024-09-12T16:16:43.687 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:43.687 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:43.687 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:43.687 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:43.688 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:43.688 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:43.688 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3713 2024-09-12T16:16:43.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.688 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:43.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:43.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:16:43.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:43.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:16:43.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141078+0000", 2024-09-12T16:16:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114162 2024-09-12T16:16:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141090+0000", 2024-09-12T16:16:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.19e-05 2024-09-12T16:16:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141100+0000", 2024-09-12T16:16:43.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0447e-05 2024-09-12T16:16:43.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:43.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141108+0000", 2024-09-12T16:16:43.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7190000000000001e-06 2024-09-12T16:16:43.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:43.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194564+0000", 2024-09-12T16:16:43.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053455729 2024-09-12T16:16:43.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:43.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194652+0000", 2024-09-12T16:16:43.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8288999999999994e-05 2024-09-12T16:16:43.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:43.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194785+0000", 2024-09-12T16:16:43.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013299000000000001 2024-09-12T16:16:43.691 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.691 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:43.691 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.691 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3714 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14849024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:43.691 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:16:43.691 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.500774297, 2024-09-12T16:16:43.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053816382000000003, 2024-09-12T16:16:43.691 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:43.692 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:43.692 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:43.692 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:43.692 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:43.692 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:43.692 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3714 2024-09-12T16:16:43.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.692 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:43.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:43.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:16:43.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:43.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:16:43.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:43.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141182+0000", 2024-09-12T16:16:43.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1805999999999997e-05 2024-09-12T16:16:43.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:43.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141185+0000", 2024-09-12T16:16:43.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5930000000000002e-06 2024-09-12T16:16:43.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:43.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141194+0000", 2024-09-12T16:16:43.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5760000000000006e-06 2024-09-12T16:16:43.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:43.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141222+0000", 2024-09-12T16:16:43.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8034999999999998e-05 2024-09-12T16:16:43.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:43.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194817+0000", 2024-09-12T16:16:43.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594887000000001 2024-09-12T16:16:43.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:43.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194860+0000", 2024-09-12T16:16:43.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3714999999999997e-05 2024-09-12T16:16:43.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:43.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194936+0000", 2024-09-12T16:16:43.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5770000000000001e-05 2024-09-12T16:16:43.695 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.695 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:43.695 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.696 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3715 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14853120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:43.696 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:16:43.696 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.50065064, 2024-09-12T16:16:43.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053962307000000001, 2024-09-12T16:16:43.696 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:43.696 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:43.696 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:43.696 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:43.696 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:43.696 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:43.696 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3715 2024-09-12T16:16:43.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.696 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:43.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:43.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:16:43.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:43.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:16:43.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:43.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141417+0000", 2024-09-12T16:16:43.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017384099999999999 2024-09-12T16:16:43.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:43.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141422+0000", 2024-09-12T16:16:43.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7310000000000001e-06 2024-09-12T16:16:43.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:43.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141434+0000", 2024-09-12T16:16:43.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2058e-05 2024-09-12T16:16:43.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:43.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141442+0000", 2024-09-12T16:16:43.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7610000000000007e-06 2024-09-12T16:16:43.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:43.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194973+0000", 2024-09-12T16:16:43.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053530618000000002 2024-09-12T16:16:43.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:43.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195063+0000", 2024-09-12T16:16:43.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0927000000000005e-05 2024-09-12T16:16:43.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:43.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195206+0000", 2024-09-12T16:16:43.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142371 2024-09-12T16:16:43.700 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.700 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:43.700 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.700 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3716 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14857216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:43.700 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:16:43.700 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.500440789999999, 2024-09-12T16:16:43.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053916360000000003, 2024-09-12T16:16:43.700 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:43.700 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:43.701 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:43.701 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:43.701 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:43.701 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:43.701 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3716 2024-09-12T16:16:43.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.701 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:43.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:43.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:16:43.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:43.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:16:43.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:43.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142933+0000", 2024-09-12T16:16:43.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014796290000000001 2024-09-12T16:16:43.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:43.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142937+0000", 2024-09-12T16:16:43.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5760000000000002e-06 2024-09-12T16:16:43.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:43.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142946+0000", 2024-09-12T16:16:43.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0380000000000005e-06 2024-09-12T16:16:43.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:43.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142951+0000", 2024-09-12T16:16:43.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9749999999999998e-06 2024-09-12T16:16:43.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:43.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195246+0000", 2024-09-12T16:16:43.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052295358 2024-09-12T16:16:43.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:43.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195299+0000", 2024-09-12T16:16:43.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2976999999999998e-05 2024-09-12T16:16:43.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:43.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195370+0000", 2024-09-12T16:16:43.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0807000000000002e-05 2024-09-12T16:16:43.704 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.704 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:43.704 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.704 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3721 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14877696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:43.705 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:16:43.705 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.498867339, 2024-09-12T16:16:43.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053422994000000001, 2024-09-12T16:16:43.705 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:43.705 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:43.705 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:43.705 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:43.705 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:43.705 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:43.705 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3721 2024-09-12T16:16:43.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.705 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:43.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:43.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:16:43.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:43.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:16:43.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:43.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:16:43.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:16:43.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:43.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143028+0000", 2024-09-12T16:16:43.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7399999999999991e-07 2024-09-12T16:16:43.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:43.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143031+0000", 2024-09-12T16:16:43.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7599999999999998e-06 2024-09-12T16:16:43.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:43.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143034+0000", 2024-09-12T16:16:43.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9780000000000001e-06 2024-09-12T16:16:43.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:43.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196220+0000", 2024-09-12T16:16:43.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053186341999999998 2024-09-12T16:16:43.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:43.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196313+0000", 2024-09-12T16:16:43.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2676000000000005e-05 2024-09-12T16:16:43.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:43.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196450+0000", 2024-09-12T16:16:43.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137052 2024-09-12T16:16:43.708 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.708 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:43.708 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.709 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3722 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14881792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:43.709 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:16:43.709 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.498857446999999, 2024-09-12T16:16:43.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053556835999999997, 2024-09-12T16:16:43.709 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:43.709 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:43.709 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:43.709 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:43.709 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:43.709 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:43.710 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3722 2024-09-12T16:16:43.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.710 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:43.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:43.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:16:43.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:43.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:16:43.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:43.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:16:43.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.11e-07 2024-09-12T16:16:43.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:43.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143038+0000", 2024-09-12T16:16:43.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2399999999999996e-07 2024-09-12T16:16:43.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:43.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143041+0000", 2024-09-12T16:16:43.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8030000000000001e-06 2024-09-12T16:16:43.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:43.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143043+0000", 2024-09-12T16:16:43.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3140000000000002e-06 2024-09-12T16:16:43.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:43.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196481+0000", 2024-09-12T16:16:43.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053437601000000001 2024-09-12T16:16:43.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:43.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196525+0000", 2024-09-12T16:16:43.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4280000000000003e-05 2024-09-12T16:16:43.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:43.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196594+0000", 2024-09-12T16:16:43.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8702999999999996e-05 2024-09-12T16:16:43.713 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.713 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:43.713 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.713 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3723 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14885888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:43.713 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:16:43.713 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.498848264999999, 2024-09-12T16:16:43.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053815546999999998, 2024-09-12T16:16:43.713 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:43.714 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:43.714 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:43.714 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:43.714 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:43.714 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:43.714 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3723 2024-09-12T16:16:43.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.714 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:43.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:43.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:16:43.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:43.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:16:43.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:43.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148994+0000", 2024-09-12T16:16:43.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059481330000000004 2024-09-12T16:16:43.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:43.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148999+0000", 2024-09-12T16:16:43.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7140000000000001e-06 2024-09-12T16:16:43.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:43.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149008+0000", 2024-09-12T16:16:43.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4350000000000003e-06 2024-09-12T16:16:43.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:43.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149021+0000", 2024-09-12T16:16:43.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2514000000000001e-05 2024-09-12T16:16:43.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:43.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196630+0000", 2024-09-12T16:16:43.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047609758000000002 2024-09-12T16:16:43.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:43.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196724+0000", 2024-09-12T16:16:43.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3522000000000003e-05 2024-09-12T16:16:43.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:43.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196861+0000", 2024-09-12T16:16:43.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013747100000000001 2024-09-12T16:16:43.717 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.718 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:43.718 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.718 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4438 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15719424~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:43.718 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:16:43.718 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.353967487999999, 2024-09-12T16:16:43.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367981000000002, 2024-09-12T16:16:43.718 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:43.718 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:43.718 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:43.718 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:43.718 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:43.719 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:43.719 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4438 2024-09-12T16:16:43.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.719 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:43.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:43.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:16:43.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:43.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:16:43.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:43.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:16:43.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3e-07 2024-09-12T16:16:43.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:43.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287930+0000", 2024-09-12T16:16:43.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-12T16:16:43.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:43.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287937+0000", 2024-09-12T16:16:43.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.08e-06 2024-09-12T16:16:43.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:43.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287943+0000", 2024-09-12T16:16:43.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5709999999999997e-06 2024-09-12T16:16:43.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:43.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341068+0000", 2024-09-12T16:16:43.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053125101000000001 2024-09-12T16:16:43.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:43.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341154+0000", 2024-09-12T16:16:43.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6100999999999994e-05 2024-09-12T16:16:43.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:43.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341295+0000", 2024-09-12T16:16:43.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014087999999999999 2024-09-12T16:16:43.722 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.722 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:43.722 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.722 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4439 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15723520~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:43.722 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:16:43.723 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.353943328, 2024-09-12T16:16:43.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053526799, 2024-09-12T16:16:43.723 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:43.723 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:43.723 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:43.723 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:43.723 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:43.723 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:43.723 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4439 2024-09-12T16:16:43.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.723 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:43.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:43.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:16:43.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:43.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:16:43.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:43.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:16:43.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-07 2024-09-12T16:16:43.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:43.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287953+0000", 2024-09-12T16:16:43.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1349999999999999e-06 2024-09-12T16:16:43.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:43.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287960+0000", 2024-09-12T16:16:43.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-12T16:16:43.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:43.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287965+0000", 2024-09-12T16:16:43.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1580000000000004e-06 2024-09-12T16:16:43.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:43.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341332+0000", 2024-09-12T16:16:43.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367009 2024-09-12T16:16:43.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:43.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341402+0000", 2024-09-12T16:16:43.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9759999999999996e-05 2024-09-12T16:16:43.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:43.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341478+0000", 2024-09-12T16:16:43.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5412000000000002e-05 2024-09-12T16:16:43.727 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.727 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:43.727 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.727 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4440 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15727616~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:43.727 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:16:43.727 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.353922224000002, 2024-09-12T16:16:43.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053761601999999999, 2024-09-12T16:16:43.727 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:43.727 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:43.727 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:43.728 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:43.728 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:43.728 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:43.728 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4440 2024-09-12T16:16:43.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.728 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:43.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:43.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:16:43.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:43.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:16:43.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:43.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:43.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:16:43.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:16:43.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:43.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287974+0000", 2024-09-12T16:16:43.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0540000000000002e-06 2024-09-12T16:16:43.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:43.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287980+0000", 2024-09-12T16:16:43.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9440000000000002e-06 2024-09-12T16:16:43.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:43.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287987+0000", 2024-09-12T16:16:43.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5889999999999999e-06 2024-09-12T16:16:43.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:43.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341502+0000", 2024-09-12T16:16:43.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053515199999999999 2024-09-12T16:16:43.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:43.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341595+0000", 2024-09-12T16:16:43.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3097000000000007e-05 2024-09-12T16:16:43.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:43.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:43.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:43.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341734+0000", 2024-09-12T16:16:43.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013832800000000001 2024-09-12T16:16:43.731 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.731 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:43.731 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.731 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:43.731 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:43.731 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:43.732 INFO:teuthology.orchestra.run.smithi204.stdout:2695 trunc from 0xee2d600 to 0x65aca00 2024-09-12T16:16:43.733 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:16:43.733 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:43.732+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:43.833 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:43.833+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:43.904 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:43.904 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:43.904 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:16:43.904 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:43.913 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:16:43.923 INFO:teuthology.orchestra.run.smithi204.stdout:2696 write 0x6bdd800 thru 0x6be9401 (0xbc02 bytes) 2024-09-12T16:16:43.923 INFO:teuthology.orchestra.run.smithi204.stdout:2697 read 0x4c4a600 thru 0x4c570b4 (0xcab5 bytes) 2024-09-12T16:16:43.925 INFO:teuthology.orchestra.run.smithi204.stdout:2701 trunc from 0x6be9600 to 0x7b0d600 2024-09-12T16:16:43.941 INFO:teuthology.orchestra.run.smithi204.stdout:2702 punch from 0x5fc9400 to 0x5fcf000, (0x5c00 bytes) 2024-09-12T16:16:43.941 INFO:teuthology.orchestra.run.smithi204.stdout:2704 punch from 0x65ac600 to 0x65b9400, (0xce00 bytes) 2024-09-12T16:16:43.941 INFO:teuthology.orchestra.run.smithi204.stdout:2705 read 0xc76a00 thru 0xc7d687 (0x6c88 bytes) 2024-09-12T16:16:43.944 INFO:teuthology.orchestra.run.smithi204.stdout:2706 trunc from 0x7b0d600 to 0x633bc00 2024-09-12T16:16:43.954 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:43.953+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:43.960 INFO:teuthology.orchestra.run.smithi204.stdout:2707 read 0x38fce00 thru 0x38fd28a (0x48b bytes) 2024-09-12T16:16:43.960 INFO:teuthology.orchestra.run.smithi204.stdout:2710 read 0x5bec400 thru 0x5bf3a30 (0x7631 bytes) 2024-09-12T16:16:43.967 INFO:teuthology.orchestra.run.smithi204.stdout:2711 trunc from 0x633bc00 to 0xbd2e00 2024-09-12T16:16:43.999 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [5] live_osds: [0, 1, 2, 3, 4] 2024-09-12T16:16:43.999 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T16:16:43.999 INFO:tasks.thrashosds.thrasher:Removing osd 3, in_osds are: [0, 1, 2, 3, 4, 5] 2024-09-12T16:16:44.000 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 3 2024-09-12T16:16:44.035 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:44.034+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:44.038 INFO:teuthology.orchestra.run.smithi204.stdout:2713 trunc from 0xbd2e00 to 0x3859e00 2024-09-12T16:16:44.066 INFO:teuthology.orchestra.run.smithi204.stdout:2714 write 0xa3ca200 thru 0xa3d367e (0x947f bytes) 2024-09-12T16:16:44.068 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:44.068 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:44.068 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:16:44.068 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:16:44.068 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:44.069 INFO:teuthology.orchestra.run.smithi204.stdout:2719 write 0x9bee800 thru 0x9bf911d (0xa91e bytes) 2024-09-12T16:16:44.069 INFO:teuthology.orchestra.run.smithi204.stdout:2720 punch from 0x42ff800 to 0x430a600, (0xae00 bytes) 2024-09-12T16:16:44.069 INFO:teuthology.orchestra.run.smithi204.stdout:2724 punch from 0x68f4000 to 0x68f5400, (0x1400 bytes) 2024-09-12T16:16:44.069 INFO:teuthology.orchestra.run.smithi204.stdout:2725 write 0x121b600 thru 0x12212b9 (0x5cba bytes) 2024-09-12T16:16:44.069 INFO:teuthology.orchestra.run.smithi204.stdout:2726 write 0x3b9a600 thru 0x3ba064c (0x604d bytes) 2024-09-12T16:16:44.071 INFO:teuthology.orchestra.run.smithi204.stdout:2728 write 0xa364800 thru 0xa36d724 (0x8f25 bytes) 2024-09-12T16:16:44.071 INFO:teuthology.orchestra.run.smithi204.stdout:2729 read 0x8643800 thru 0x86468dd (0x30de bytes) 2024-09-12T16:16:44.072 INFO:teuthology.orchestra.run.smithi204.stdout:2733 read 0x567ee00 thru 0x56850e5 (0x62e6 bytes) 2024-09-12T16:16:44.072 INFO:teuthology.orchestra.run.smithi204.stdout:2734 read 0x9134c00 thru 0x91401fc (0xb5fd bytes) 2024-09-12T16:16:44.072 INFO:teuthology.orchestra.run.smithi204.stdout:2737 read 0x8b53a00 thru 0x8b59361 (0x5962 bytes) 2024-09-12T16:16:44.072 INFO:teuthology.orchestra.run.smithi204.stdout:2738 write 0x2ce0e00 thru 0x2ce5ac3 (0x4cc4 bytes) 2024-09-12T16:16:44.077 INFO:teuthology.orchestra.run.smithi204.stdout:2739 trunc from 0xa3d3800 to 0x5a57000 2024-09-12T16:16:44.079 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:16:44.091 INFO:teuthology.orchestra.run.smithi204.stdout:2741 clone 16 order 20 su 262144 sc 10 2024-09-12T16:16:44.136 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:44.135+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:44.146 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2024-09-12T16:16:44.203 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:44.203 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:16:44.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:16:44.204 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:44.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.204 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2299 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12368896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:44.204 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896004+0000", 2024-09-12T16:16:44.204 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.305988537000001, 2024-09-12T16:16:44.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037218257999999997, 2024-09-12T16:16:44.204 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.204 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.204 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:44.204 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.204 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:44.204 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:44.205 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2299 2024-09-12T16:16:44.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.205 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896004+0000", 2024-09-12T16:16:44.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896004+0000", 2024-09-12T16:16:44.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896005+0000", 2024-09-12T16:16:44.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3700000000000001e-07 2024-09-12T16:16:44.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896006+0000", 2024-09-12T16:16:44.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9929999999999998e-06 2024-09-12T16:16:44.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896013+0000", 2024-09-12T16:16:44.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1709999999999999e-06 2024-09-12T16:16:44.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896017+0000", 2024-09-12T16:16:44.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5050000000000001e-06 2024-09-12T16:16:44.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933142+0000", 2024-09-12T16:16:44.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037125012999999998 2024-09-12T16:16:44.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933182+0000", 2024-09-12T16:16:44.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9957999999999999e-05 2024-09-12T16:16:44.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933222+0000", 2024-09-12T16:16:44.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0181e-05 2024-09-12T16:16:44.209 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.209 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.209 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.209 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2300 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12372992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:44.209 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:16:44.209 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.305968880000002, 2024-09-12T16:16:44.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037401246999999999, 2024-09-12T16:16:44.209 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.210 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.210 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:44.210 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.210 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:44.210 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:44.210 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2300 2024-09-12T16:16:44.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.210 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:16:44.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:16:44.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:16:44.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6100000000000002e-07 2024-09-12T16:16:44.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896026+0000", 2024-09-12T16:16:44.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9130000000000001e-06 2024-09-12T16:16:44.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896032+0000", 2024-09-12T16:16:44.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7540000000000003e-06 2024-09-12T16:16:44.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896036+0000", 2024-09-12T16:16:44.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5750000000000002e-06 2024-09-12T16:16:44.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933254+0000", 2024-09-12T16:16:44.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037217962 2024-09-12T16:16:44.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933341+0000", 2024-09-12T16:16:44.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6296000000000002e-05 2024-09-12T16:16:44.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933425+0000", 2024-09-12T16:16:44.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4386000000000001e-05 2024-09-12T16:16:44.214 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.214 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.214 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.214 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2301 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12377088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:44.214 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896043+0000", 2024-09-12T16:16:44.214 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.305949137999999, 2024-09-12T16:16:44.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037486197999999998, 2024-09-12T16:16:44.214 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.214 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.214 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:44.215 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.215 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:44.215 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:44.215 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2301 2024-09-12T16:16:44.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.215 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896043+0000", 2024-09-12T16:16:44.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896043+0000", 2024-09-12T16:16:44.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896044+0000", 2024-09-12T16:16:44.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.41e-07 2024-09-12T16:16:44.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896053+0000", 2024-09-12T16:16:44.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8049999999999996e-06 2024-09-12T16:16:44.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896060+0000", 2024-09-12T16:16:44.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.221e-06 2024-09-12T16:16:44.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896065+0000", 2024-09-12T16:16:44.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1109999999999999e-06 2024-09-12T16:16:44.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933452+0000", 2024-09-12T16:16:44.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037386560999999999 2024-09-12T16:16:44.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933491+0000", 2024-09-12T16:16:44.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9789000000000001e-05 2024-09-12T16:16:44.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933530+0000", 2024-09-12T16:16:44.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.837e-05 2024-09-12T16:16:44.218 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.218 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.218 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.219 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2302 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12381184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:44.219 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:16:44.219 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.305907697999999, 2024-09-12T16:16:44.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037645284000000001, 2024-09-12T16:16:44.219 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.219 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.219 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:44.219 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.219 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:44.219 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:44.219 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2302 2024-09-12T16:16:44.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.219 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.220 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.220 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:16:44.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.220 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.220 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:16:44.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:16:44.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6800000000000001e-07 2024-09-12T16:16:44.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896088+0000", 2024-09-12T16:16:44.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3429999999999998e-06 2024-09-12T16:16:44.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896096+0000", 2024-09-12T16:16:44.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0860000000000002e-06 2024-09-12T16:16:44.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896102+0000", 2024-09-12T16:16:44.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7610000000000004e-06 2024-09-12T16:16:44.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933563+0000", 2024-09-12T16:16:44.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037461019999999998 2024-09-12T16:16:44.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933648+0000", 2024-09-12T16:16:44.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5468000000000002e-05 2024-09-12T16:16:44.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.223 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933730+0000", 2024-09-12T16:16:44.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2138000000000005e-05 2024-09-12T16:16:44.223 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.223 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.223 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.223 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2303 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12385280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:44.224 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:16:44.224 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.305883896000001, 2024-09-12T16:16:44.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037723083999999997, 2024-09-12T16:16:44.224 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.224 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.224 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:44.224 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.224 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:44.224 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:44.224 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2303 2024-09-12T16:16:44.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.224 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:16:44.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:16:44.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:16:44.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2500000000000001e-07 2024-09-12T16:16:44.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896115+0000", 2024-09-12T16:16:44.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.28e-06 2024-09-12T16:16:44.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896122+0000", 2024-09-12T16:16:44.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4590000000000003e-06 2024-09-12T16:16:44.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896127+0000", 2024-09-12T16:16:44.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0509999999999996e-06 2024-09-12T16:16:44.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933755+0000", 2024-09-12T16:16:44.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037627729999999998 2024-09-12T16:16:44.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933794+0000", 2024-09-12T16:16:44.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9255000000000003e-05 2024-09-12T16:16:44.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933832+0000", 2024-09-12T16:16:44.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7883999999999998e-05 2024-09-12T16:16:44.227 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.228 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.228 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.228 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2304 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12389376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:44.228 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:16:44.228 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.305858547, 2024-09-12T16:16:44.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037911010000000002, 2024-09-12T16:16:44.228 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.228 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.228 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:44.228 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.228 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:44.229 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:44.229 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2304 2024-09-12T16:16:44.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.229 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:16:44.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:16:44.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:16:44.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9900000000000001e-07 2024-09-12T16:16:44.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896136+0000", 2024-09-12T16:16:44.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.897e-06 2024-09-12T16:16:44.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896142+0000", 2024-09-12T16:16:44.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9290000000000003e-06 2024-09-12T16:16:44.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896154+0000", 2024-09-12T16:16:44.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.201e-05 2024-09-12T16:16:44.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933865+0000", 2024-09-12T16:16:44.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037710225 2024-09-12T16:16:44.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933961+0000", 2024-09-12T16:16:44.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6315000000000002e-05 2024-09-12T16:16:44.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934045+0000", 2024-09-12T16:16:44.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4234999999999996e-05 2024-09-12T16:16:44.232 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.232 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.232 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.232 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2305 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12393472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:44.233 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896175+0000", 2024-09-12T16:16:44.233 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.305817356999999, 2024-09-12T16:16:44.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037976941, 2024-09-12T16:16:44.233 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.233 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.233 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:44.233 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.233 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:44.233 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:44.233 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2305 2024-09-12T16:16:44.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.233 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896175+0000", 2024-09-12T16:16:44.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896175+0000", 2024-09-12T16:16:44.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896176+0000", 2024-09-12T16:16:44.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7400000000000003e-07 2024-09-12T16:16:44.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896178+0000", 2024-09-12T16:16:44.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6709999999999999e-06 2024-09-12T16:16:44.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896186+0000", 2024-09-12T16:16:44.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9319999999999996e-06 2024-09-12T16:16:44.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896192+0000", 2024-09-12T16:16:44.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0799999999999996e-06 2024-09-12T16:16:44.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934072+0000", 2024-09-12T16:16:44.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037880888000000001 2024-09-12T16:16:44.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934113+0000", 2024-09-12T16:16:44.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0815999999999997e-05 2024-09-12T16:16:44.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.237 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934152+0000", 2024-09-12T16:16:44.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8980000000000003e-05 2024-09-12T16:16:44.237 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.237 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.237 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.237 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2306 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12397568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:44.237 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:16:44.237 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.305793079000001, 2024-09-12T16:16:44.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038156347, 2024-09-12T16:16:44.238 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.238 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.238 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:44.238 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.238 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:44.238 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:44.238 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2306 2024-09-12T16:16:44.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.238 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.238 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:16:44.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:16:44.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:16:44.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.77e-07 2024-09-12T16:16:44.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896202+0000", 2024-09-12T16:16:44.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2359999999999999e-06 2024-09-12T16:16:44.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896208+0000", 2024-09-12T16:16:44.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1430000000000003e-06 2024-09-12T16:16:44.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896213+0000", 2024-09-12T16:16:44.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9339999999999997e-06 2024-09-12T16:16:44.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934188+0000", 2024-09-12T16:16:44.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037974490999999999 2024-09-12T16:16:44.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934275+0000", 2024-09-12T16:16:44.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7639999999999994e-05 2024-09-12T16:16:44.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934356+0000", 2024-09-12T16:16:44.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0525999999999994e-05 2024-09-12T16:16:44.241 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.241 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.241 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.242 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2307 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12401664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:44.242 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:16:44.242 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.305773306999999, 2024-09-12T16:16:44.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038241450000000003, 2024-09-12T16:16:44.242 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.242 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.242 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:44.243 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.243 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:44.243 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:44.243 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2307 2024-09-12T16:16:44.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.243 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:16:44.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.244 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:16:44.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.244 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896220+0000", 2024-09-12T16:16:44.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3500000000000002e-07 2024-09-12T16:16:44.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896222+0000", 2024-09-12T16:16:44.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1720000000000001e-06 2024-09-12T16:16:44.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896228+0000", 2024-09-12T16:16:44.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0870000000000003e-06 2024-09-12T16:16:44.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896233+0000", 2024-09-12T16:16:44.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:16:44.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934382+0000", 2024-09-12T16:16:44.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038149566000000003 2024-09-12T16:16:44.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934422+0000", 2024-09-12T16:16:44.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0015999999999998e-05 2024-09-12T16:16:44.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934461+0000", 2024-09-12T16:16:44.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8423999999999997e-05 2024-09-12T16:16:44.247 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.247 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.247 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.247 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2308 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12405760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:44.247 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:16:44.247 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.30575361, 2024-09-12T16:16:44.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038420745999999999, 2024-09-12T16:16:44.247 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.247 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.248 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:44.248 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.248 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:44.248 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:44.248 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2308 2024-09-12T16:16:44.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.248 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:16:44.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:16:44.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:16:44.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.58e-07 2024-09-12T16:16:44.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896241+0000", 2024-09-12T16:16:44.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7940000000000001e-06 2024-09-12T16:16:44.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.250 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896247+0000", 2024-09-12T16:16:44.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1460000000000001e-06 2024-09-12T16:16:44.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.250 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896252+0000", 2024-09-12T16:16:44.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6840000000000004e-06 2024-09-12T16:16:44.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.250 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934494+0000", 2024-09-12T16:16:44.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038242362000000002 2024-09-12T16:16:44.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934579+0000", 2024-09-12T16:16:44.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5044999999999996e-05 2024-09-12T16:16:44.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934660+0000", 2024-09-12T16:16:44.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0357000000000003e-05 2024-09-12T16:16:44.251 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.251 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.251 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.252 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2309 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12409856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:44.252 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:16:44.252 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.305733029999999, 2024-09-12T16:16:44.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038504629999999998, 2024-09-12T16:16:44.252 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.252 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.252 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:44.252 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.252 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:44.252 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:44.252 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2309 2024-09-12T16:16:44.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.252 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:16:44.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:16:44.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:16:44.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5199999999999998e-07 2024-09-12T16:16:44.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896263+0000", 2024-09-12T16:16:44.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4209999999999999e-06 2024-09-12T16:16:44.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896269+0000", 2024-09-12T16:16:44.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9449999999999998e-06 2024-09-12T16:16:44.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896274+0000", 2024-09-12T16:16:44.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3950000000000003e-06 2024-09-12T16:16:44.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934686+0000", 2024-09-12T16:16:44.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038412333999999999 2024-09-12T16:16:44.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934727+0000", 2024-09-12T16:16:44.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0649999999999999e-05 2024-09-12T16:16:44.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934764+0000", 2024-09-12T16:16:44.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7533000000000001e-05 2024-09-12T16:16:44.256 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.256 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.256 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.256 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2310 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12413952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:44.256 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:16:44.257 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.305712157999999, 2024-09-12T16:16:44.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038694183, 2024-09-12T16:16:44.257 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.257 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.257 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:44.257 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.257 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:44.257 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:44.257 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2310 2024-09-12T16:16:44.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.257 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:16:44.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:16:44.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896281+0000", 2024-09-12T16:16:44.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1399999999999997e-07 2024-09-12T16:16:44.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896283+0000", 2024-09-12T16:16:44.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9549999999999999e-06 2024-09-12T16:16:44.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896289+0000", 2024-09-12T16:16:44.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8669999999999999e-06 2024-09-12T16:16:44.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896301+0000", 2024-09-12T16:16:44.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1807999999999999e-05 2024-09-12T16:16:44.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934798+0000", 2024-09-12T16:16:44.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038497591999999997 2024-09-12T16:16:44.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934885+0000", 2024-09-12T16:16:44.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7149000000000002e-05 2024-09-12T16:16:44.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934975+0000", 2024-09-12T16:16:44.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9297999999999998e-05 2024-09-12T16:16:44.261 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.261 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.261 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.261 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2311 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12418048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:44.261 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:16:44.261 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.305684901999999, 2024-09-12T16:16:44.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038768558000000002, 2024-09-12T16:16:44.261 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.261 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.262 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:44.262 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.262 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:44.262 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:44.262 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2311 2024-09-12T16:16:44.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.262 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:16:44.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:16:44.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:16:44.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.63e-07 2024-09-12T16:16:44.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896310+0000", 2024-09-12T16:16:44.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1560000000000002e-06 2024-09-12T16:16:44.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896316+0000", 2024-09-12T16:16:44.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0249999999999999e-06 2024-09-12T16:16:44.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896322+0000", 2024-09-12T16:16:44.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6400000000000002e-06 2024-09-12T16:16:44.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934997+0000", 2024-09-12T16:16:44.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038674565000000001 2024-09-12T16:16:44.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935037+0000", 2024-09-12T16:16:44.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0485999999999998e-05 2024-09-12T16:16:44.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935076+0000", 2024-09-12T16:16:44.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9223e-05 2024-09-12T16:16:44.266 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.266 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.266 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.266 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2312 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12422144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:44.266 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:16:44.266 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.305664209, 2024-09-12T16:16:44.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038856784999999998, 2024-09-12T16:16:44.266 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.266 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.266 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:44.266 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.266 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:44.267 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:44.267 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2312 2024-09-12T16:16:44.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.267 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:16:44.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:16:44.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896329+0000", 2024-09-12T16:16:44.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5499999999999999e-07 2024-09-12T16:16:44.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896337+0000", 2024-09-12T16:16:44.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0819999999999999e-06 2024-09-12T16:16:44.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896343+0000", 2024-09-12T16:16:44.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.263e-06 2024-09-12T16:16:44.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896348+0000", 2024-09-12T16:16:44.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8860000000000003e-06 2024-09-12T16:16:44.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935097+0000", 2024-09-12T16:16:44.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038748818999999997 2024-09-12T16:16:44.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935141+0000", 2024-09-12T16:16:44.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4175000000000003e-05 2024-09-12T16:16:44.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935185+0000", 2024-09-12T16:16:44.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4205000000000001e-05 2024-09-12T16:16:44.270 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.271 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.271 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.271 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2313 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12426240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:44.271 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:16:44.271 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.305637994000001, 2024-09-12T16:16:44.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038928683999999998, 2024-09-12T16:16:44.271 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.271 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.271 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:44.271 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.271 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:44.271 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:44.271 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2313 2024-09-12T16:16:44.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.272 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:16:44.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:16:44.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:16:44.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0400000000000002e-07 2024-09-12T16:16:44.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896357+0000", 2024-09-12T16:16:44.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.097e-06 2024-09-12T16:16:44.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896363+0000", 2024-09-12T16:16:44.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5119999999999999e-06 2024-09-12T16:16:44.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896374+0000", 2024-09-12T16:16:44.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1381e-05 2024-09-12T16:16:44.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935205+0000", 2024-09-12T16:16:44.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038830549999999998 2024-09-12T16:16:44.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935244+0000", 2024-09-12T16:16:44.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9520000000000001e-05 2024-09-12T16:16:44.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935283+0000", 2024-09-12T16:16:44.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9220000000000001e-05 2024-09-12T16:16:44.275 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.275 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.275 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.275 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2314 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12430336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:44.275 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:16:44.275 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.305600823999999, 2024-09-12T16:16:44.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039008137999999998, 2024-09-12T16:16:44.275 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.275 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.276 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:44.276 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.276 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:44.276 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:44.276 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2314 2024-09-12T16:16:44.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.276 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:16:44.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:16:44.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:16:44.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6499999999999999e-07 2024-09-12T16:16:44.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896395+0000", 2024-09-12T16:16:44.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2960000000000001e-06 2024-09-12T16:16:44.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896402+0000", 2024-09-12T16:16:44.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2280000000000001e-06 2024-09-12T16:16:44.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896407+0000", 2024-09-12T16:16:44.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3630000000000002e-06 2024-09-12T16:16:44.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935302+0000", 2024-09-12T16:16:44.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038895181000000001 2024-09-12T16:16:44.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935343+0000", 2024-09-12T16:16:44.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0590999999999998e-05 2024-09-12T16:16:44.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935400+0000", 2024-09-12T16:16:44.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7014e-05 2024-09-12T16:16:44.279 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.279 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.279 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.279 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2315 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12434432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:44.279 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:16:44.279 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.305578173000001, 2024-09-12T16:16:44.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039083892000000002, 2024-09-12T16:16:44.280 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.280 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.280 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:44.280 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.280 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:44.280 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:44.280 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2315 2024-09-12T16:16:44.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.280 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:16:44.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:16:44.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896415+0000", 2024-09-12T16:16:44.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3300000000000002e-07 2024-09-12T16:16:44.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896421+0000", 2024-09-12T16:16:44.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7579999999999998e-06 2024-09-12T16:16:44.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896427+0000", 2024-09-12T16:16:44.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3029999999999996e-06 2024-09-12T16:16:44.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896432+0000", 2024-09-12T16:16:44.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.215e-06 2024-09-12T16:16:44.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935420+0000", 2024-09-12T16:16:44.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038987727 2024-09-12T16:16:44.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935460+0000", 2024-09-12T16:16:44.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9817999999999997e-05 2024-09-12T16:16:44.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935498+0000", 2024-09-12T16:16:44.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8438e-05 2024-09-12T16:16:44.284 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.284 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.284 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.284 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2316 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12438528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:44.284 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:16:44.284 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.305553521, 2024-09-12T16:16:44.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039160043999999998, 2024-09-12T16:16:44.285 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.285 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.285 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:44.285 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.285 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:44.285 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:44.285 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2316 2024-09-12T16:16:44.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.285 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:16:44.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:16:44.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901945+0000", 2024-09-12T16:16:44.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055056050000000002 2024-09-12T16:16:44.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901950+0000", 2024-09-12T16:16:44.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2490000000000001e-06 2024-09-12T16:16:44.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901966+0000", 2024-09-12T16:16:44.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6325e-05 2024-09-12T16:16:44.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901974+0000", 2024-09-12T16:16:44.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7570000000000004e-06 2024-09-12T16:16:44.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935518+0000", 2024-09-12T16:16:44.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033543587999999999 2024-09-12T16:16:44.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935559+0000", 2024-09-12T16:16:44.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1746000000000003e-05 2024-09-12T16:16:44.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935599+0000", 2024-09-12T16:16:44.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9774000000000002e-05 2024-09-12T16:16:44.288 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.289 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.289 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.289 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1571 3.b 3:d046566d:::rbd_data.1155525b14e3.0000000000000001:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:16:44.289 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:16:44.289 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.0494284789999999, 2024-09-12T16:16:44.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064439785999999999, 2024-09-12T16:16:44.289 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.289 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.289 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:44.289 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.289 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:16:44.289 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:16:44.290 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1571 2024-09-12T16:16:44.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.290 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:16:44.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:16:44.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:16:44.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5400000000000002e-07 2024-09-12T16:16:44.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152567+0000", 2024-09-12T16:16:44.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.131e-06 2024-09-12T16:16:44.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152574+0000", 2024-09-12T16:16:44.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1840000000000002e-06 2024-09-12T16:16:44.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152579+0000", 2024-09-12T16:16:44.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.152e-06 2024-09-12T16:16:44.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153671+0000", 2024-09-12T16:16:44.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001092078 2024-09-12T16:16:44.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153779+0000", 2024-09-12T16:16:44.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108461 2024-09-12T16:16:44.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217004+0000", 2024-09-12T16:16:44.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.063224426 2024-09-12T16:16:44.293 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.293 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.293 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.293 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1581 3.4 3:22e34893:::rbd_data.1155525b14e3.0000000000000005:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:16:44.293 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:16:44.294 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.049331354, 2024-09-12T16:16:44.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064484407999999993, 2024-09-12T16:16:44.294 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.294 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.294 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:44.294 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.294 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:16:44.294 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:16:44.294 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1581 2024-09-12T16:16:44.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.294 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:16:44.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:16:44.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152662+0000", 2024-09-12T16:16:44.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.65e-07 2024-09-12T16:16:44.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152664+0000", 2024-09-12T16:16:44.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9829999999999999e-06 2024-09-12T16:16:44.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152670+0000", 2024-09-12T16:16:44.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2260000000000002e-06 2024-09-12T16:16:44.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152675+0000", 2024-09-12T16:16:44.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7990000000000001e-06 2024-09-12T16:16:44.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.216945+0000", 2024-09-12T16:16:44.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064270341999999994 2024-09-12T16:16:44.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217040+0000", 2024-09-12T16:16:44.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5242999999999996e-05 2024-09-12T16:16:44.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217146+0000", 2024-09-12T16:16:44.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010545 2024-09-12T16:16:44.297 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.297 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.297 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.298 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.298 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.298 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:44.299 INFO:teuthology.orchestra.run.smithi204.stdout:leaving image image_client.0-clone15 intact 2024-09-12T16:16:44.300 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:16:44.300 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:44.298+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:44.336 INFO:tasks.ceph.mon.a.smithi017.stderr:2024-09-12T16:16:44.335+0000 7f3942a34640 -1 mon.a@0(leader).osd e54 definitely_dead 0 2024-09-12T16:16:44.400 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:44.399+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:44.443 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:44.443 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:44.443 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:16:44.443 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:44.452 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:16:44.536 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:44.535+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:44.601 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:44.602 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:44.602 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:16:44.602 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:16:44.602 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:44.602 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:44.601+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:44.610 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:16:44.702 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:44.702+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:44.761 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:16:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:16:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2010 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1118208~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790432+0000", 2024-09-12T16:16:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.9689815770000001, 2024-09-12T16:16:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023851981000000001, 2024-09-12T16:16:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2010 2024-09-12T16:16:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790432+0000", 2024-09-12T16:16:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790432+0000", 2024-09-12T16:16:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790433+0000", 2024-09-12T16:16:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1799999999999995e-07 2024-09-12T16:16:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790442+0000", 2024-09-12T16:16:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8030000000000008e-06 2024-09-12T16:16:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790449+0000", 2024-09-12T16:16:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-12T16:16:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790455+0000", 2024-09-12T16:16:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2700000000000004e-06 2024-09-12T16:16:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814126+0000", 2024-09-12T16:16:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023671668999999999 2024-09-12T16:16:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814168+0000", 2024-09-12T16:16:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1727999999999998e-05 2024-09-12T16:16:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814284+0000", 2024-09-12T16:16:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116153 2024-09-12T16:16:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2011 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1163264~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790463+0000", 2024-09-12T16:16:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.9689510969999997, 2024-09-12T16:16:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024104724000000001, 2024-09-12T16:16:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2011 2024-09-12T16:16:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790463+0000", 2024-09-12T16:16:44.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.768 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.768 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790463+0000", 2024-09-12T16:16:44.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.768 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.768 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790463+0000", 2024-09-12T16:16:44.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6199999999999998e-07 2024-09-12T16:16:44.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790465+0000", 2024-09-12T16:16:44.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2419999999999999e-06 2024-09-12T16:16:44.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790471+0000", 2024-09-12T16:16:44.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0000000000000002e-06 2024-09-12T16:16:44.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790477+0000", 2024-09-12T16:16:44.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3669999999999996e-06 2024-09-12T16:16:44.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.770 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.770 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814317+0000", 2024-09-12T16:16:44.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023840413000000001 2024-09-12T16:16:44.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.770 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.770 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814410+0000", 2024-09-12T16:16:44.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3049999999999998e-05 2024-09-12T16:16:44.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814567+0000", 2024-09-12T16:16:44.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015719 2024-09-12T16:16:44.771 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.771 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.771 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.771 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2012 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1208320~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:44.771 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790484+0000", 2024-09-12T16:16:44.771 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.9689298390000003, 2024-09-12T16:16:44.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024289805000000001, 2024-09-12T16:16:44.771 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.771 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2012 2024-09-12T16:16:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790484+0000", 2024-09-12T16:16:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790484+0000", 2024-09-12T16:16:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790484+0000", 2024-09-12T16:16:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2199999999999999e-07 2024-09-12T16:16:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790486+0000", 2024-09-12T16:16:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.979e-06 2024-09-12T16:16:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790493+0000", 2024-09-12T16:16:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8950000000000001e-06 2024-09-12T16:16:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790498+0000", 2024-09-12T16:16:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8289999999999998e-06 2024-09-12T16:16:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814603+0000", 2024-09-12T16:16:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024104787999999999 2024-09-12T16:16:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814686+0000", 2024-09-12T16:16:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3224000000000001e-05 2024-09-12T16:16:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814774+0000", 2024-09-12T16:16:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7668000000000002e-05 2024-09-12T16:16:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2013 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1216512~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790507+0000", 2024-09-12T16:16:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.9689071839999999, 2024-09-12T16:16:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024529395999999998, 2024-09-12T16:16:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2013 2024-09-12T16:16:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790507+0000", 2024-09-12T16:16:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790507+0000", 2024-09-12T16:16:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790507+0000", 2024-09-12T16:16:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8599999999999997e-07 2024-09-12T16:16:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790510+0000", 2024-09-12T16:16:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.339e-06 2024-09-12T16:16:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790516+0000", 2024-09-12T16:16:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2609999999999999e-06 2024-09-12T16:16:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790521+0000", 2024-09-12T16:16:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0549999999999999e-06 2024-09-12T16:16:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814810+0000", 2024-09-12T16:16:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024289409000000001 2024-09-12T16:16:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814890+0000", 2024-09-12T16:16:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9138e-05 2024-09-12T16:16:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815036+0000", 2024-09-12T16:16:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000146408 2024-09-12T16:16:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2014 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1261568~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790529+0000", 2024-09-12T16:16:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.968884954, 2024-09-12T16:16:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024767824000000001, 2024-09-12T16:16:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2014 2024-09-12T16:16:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790529+0000", 2024-09-12T16:16:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790529+0000", 2024-09-12T16:16:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790529+0000", 2024-09-12T16:16:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6100000000000001e-07 2024-09-12T16:16:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790532+0000", 2024-09-12T16:16:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3429999999999998e-06 2024-09-12T16:16:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790538+0000", 2024-09-12T16:16:44.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3709999999999996e-06 2024-09-12T16:16:44.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790543+0000", 2024-09-12T16:16:44.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.933e-06 2024-09-12T16:16:44.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815084+0000", 2024-09-12T16:16:44.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024541469 2024-09-12T16:16:44.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.784 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815172+0000", 2024-09-12T16:16:44.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7869999999999997e-05 2024-09-12T16:16:44.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.784 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.784 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815297+0000", 2024-09-12T16:16:44.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012437700000000001 2024-09-12T16:16:44.784 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.784 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.784 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.784 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2015 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1306624~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:44.784 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790549+0000", 2024-09-12T16:16:44.785 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.968864656, 2024-09-12T16:16:44.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025019062000000002, 2024-09-12T16:16:44.785 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.785 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.785 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:44.785 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.785 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:44.785 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:44.785 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2015 2024-09-12T16:16:44.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.785 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.785 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.785 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790549+0000", 2024-09-12T16:16:44.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.786 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.786 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790549+0000", 2024-09-12T16:16:44.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.786 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.786 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790549+0000", 2024-09-12T16:16:44.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1800000000000001e-07 2024-09-12T16:16:44.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790551+0000", 2024-09-12T16:16:44.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.855e-06 2024-09-12T16:16:44.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790557+0000", 2024-09-12T16:16:44.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2460000000000003e-06 2024-09-12T16:16:44.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790561+0000", 2024-09-12T16:16:44.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8799999999999999e-06 2024-09-12T16:16:44.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815329+0000", 2024-09-12T16:16:44.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024767320999999998 2024-09-12T16:16:44.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815408+0000", 2024-09-12T16:16:44.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9226000000000003e-05 2024-09-12T16:16:44.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.790 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815568+0000", 2024-09-12T16:16:44.790 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000160116 2024-09-12T16:16:44.790 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.790 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.790 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.790 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2016 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1314816~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:44.790 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790568+0000", 2024-09-12T16:16:44.790 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.9688455139999999, 2024-09-12T16:16:44.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025220411000000002, 2024-09-12T16:16:44.791 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.791 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.791 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:44.791 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.791 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:44.792 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:44.792 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2016 2024-09-12T16:16:44.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.792 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.792 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.792 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790568+0000", 2024-09-12T16:16:44.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.793 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.793 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790568+0000", 2024-09-12T16:16:44.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.793 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.793 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790569+0000", 2024-09-12T16:16:44.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1699999999999999e-07 2024-09-12T16:16:44.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.794 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790571+0000", 2024-09-12T16:16:44.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2819999999999999e-06 2024-09-12T16:16:44.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790577+0000", 2024-09-12T16:16:44.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.117e-06 2024-09-12T16:16:44.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790582+0000", 2024-09-12T16:16:44.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6110000000000004e-06 2024-09-12T16:16:44.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815611+0000", 2024-09-12T16:16:44.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025029518000000001 2024-09-12T16:16:44.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815669+0000", 2024-09-12T16:16:44.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7896999999999998e-05 2024-09-12T16:16:44.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815789+0000", 2024-09-12T16:16:44.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011956900000000001 2024-09-12T16:16:44.796 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.796 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.796 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.797 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2017 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1359872~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:44.797 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790596+0000", 2024-09-12T16:16:44.797 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.9688174900000002, 2024-09-12T16:16:44.797 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025446261000000001, 2024-09-12T16:16:44.797 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.797 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.797 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:44.797 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.797 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:44.797 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:44.797 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2017 2024-09-12T16:16:44.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.797 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.798 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.798 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790596+0000", 2024-09-12T16:16:44.798 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.798 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.798 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790596+0000", 2024-09-12T16:16:44.798 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.798 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.798 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790597+0000", 2024-09-12T16:16:44.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7400000000000003e-07 2024-09-12T16:16:44.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790599+0000", 2024-09-12T16:16:44.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4389999999999999e-06 2024-09-12T16:16:44.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790606+0000", 2024-09-12T16:16:44.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9589999999999998e-06 2024-09-12T16:16:44.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790612+0000", 2024-09-12T16:16:44.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4840000000000003e-06 2024-09-12T16:16:44.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.800 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815818+0000", 2024-09-12T16:16:44.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025206447 2024-09-12T16:16:44.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.800 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815910+0000", 2024-09-12T16:16:44.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1898999999999995e-05 2024-09-12T16:16:44.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.816042+0000", 2024-09-12T16:16:44.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132359 2024-09-12T16:16:44.801 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.801 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.801 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.802 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2018 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1404928~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:44.802 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790619+0000", 2024-09-12T16:16:44.802 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.9687942849999995, 2024-09-12T16:16:44.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025656844000000002, 2024-09-12T16:16:44.802 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.802 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.802 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:44.802 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.802 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:44.802 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:44.802 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2018 2024-09-12T16:16:44.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.803 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790619+0000", 2024-09-12T16:16:44.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790619+0000", 2024-09-12T16:16:44.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790620+0000", 2024-09-12T16:16:44.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.46e-07 2024-09-12T16:16:44.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790622+0000", 2024-09-12T16:16:44.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0090000000000002e-06 2024-09-12T16:16:44.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.805 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790628+0000", 2024-09-12T16:16:44.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0349999999999998e-06 2024-09-12T16:16:44.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.805 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790641+0000", 2024-09-12T16:16:44.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2889e-05 2024-09-12T16:16:44.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.805 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.816075+0000", 2024-09-12T16:16:44.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025433951 2024-09-12T16:16:44.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.816155+0000", 2024-09-12T16:16:44.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9907000000000006e-05 2024-09-12T16:16:44.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.816276+0000", 2024-09-12T16:16:44.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121607 2024-09-12T16:16:44.806 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.806 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.806 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.807 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2019 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1413120~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:44.807 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790652+0000", 2024-09-12T16:16:44.807 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.9687621489999998, 2024-09-12T16:16:44.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.02584908, 2024-09-12T16:16:44.807 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.807 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.807 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:44.807 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.807 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:44.807 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:44.807 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2019 2024-09-12T16:16:44.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.807 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790652+0000", 2024-09-12T16:16:44.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790652+0000", 2024-09-12T16:16:44.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790652+0000", 2024-09-12T16:16:44.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9399999999999995e-07 2024-09-12T16:16:44.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790655+0000", 2024-09-12T16:16:44.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.481e-06 2024-09-12T16:16:44.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790661+0000", 2024-09-12T16:16:44.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1999999999999999e-06 2024-09-12T16:16:44.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.810 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790666+0000", 2024-09-12T16:16:44.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8670000000000002e-06 2024-09-12T16:16:44.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.810 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.816306+0000", 2024-09-12T16:16:44.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025640039 2024-09-12T16:16:44.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.811 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.811 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.816382+0000", 2024-09-12T16:16:44.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6771000000000001e-05 2024-09-12T16:16:44.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.816501+0000", 2024-09-12T16:16:44.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011822799999999999 2024-09-12T16:16:44.813 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.813 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.813 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.813 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4805.0:6829 3.18 3:1e2ee373:::rbd_data.1155c2c5fc24.0000000000000003:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 18778112~25088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T16:16:44.813 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:43.576065+0000", 2024-09-12T16:16:44.813 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.1833482790000001, 2024-09-12T16:16:44.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044824155999999997, 2024-09-12T16:16:44.814 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.814 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.814 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:44.814 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.814 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4805", 2024-09-12T16:16:44.815 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3734391115", 2024-09-12T16:16:44.815 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6829 2024-09-12T16:16:44.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.815 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.816 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.816 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.576065+0000", 2024-09-12T16:16:44.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.816 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.816 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.576065+0000", 2024-09-12T16:16:44.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.816 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.576068+0000", 2024-09-12T16:16:44.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1629999999999999e-06 2024-09-12T16:16:44.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.588880+0000", 2024-09-12T16:16:44.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012812054 2024-09-12T16:16:44.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.588909+0000", 2024-09-12T16:16:44.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9354000000000001e-05 2024-09-12T16:16:44.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.588930+0000", 2024-09-12T16:16:44.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0571999999999999e-05 2024-09-12T16:16:44.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.589010+0000", 2024-09-12T16:16:44.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0780999999999998e-05 2024-09-12T16:16:44.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.589174+0000", 2024-09-12T16:16:44.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016337799999999999 2024-09-12T16:16:44.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 1", 2024-09-12T16:16:44.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.590261+0000", 2024-09-12T16:16:44.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001087735 2024-09-12T16:16:44.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:16:44.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.610690+0000", 2024-09-12T16:16:44.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020428281999999999 2024-09-12T16:16:44.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:44.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.620760+0000", 2024-09-12T16:16:44.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010070325999999999 2024-09-12T16:16:44.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.820 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:16:44.820 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.620836+0000", 2024-09-12T16:16:44.820 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5617999999999993e-05 2024-09-12T16:16:44.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.820 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.820 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.620890+0000", 2024-09-12T16:16:44.820 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3893000000000001e-05 2024-09-12T16:16:44.820 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.820 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.820 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.821 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4805.0:10630 3.5 3:a735f393:::rbd_data.1155525b14e3.0000000000000035:f [read 679936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-09-12T16:16:44.821 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:43.839654+0000", 2024-09-12T16:16:44.821 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.91976015, 2024-09-12T16:16:44.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023715737000000001, 2024-09-12T16:16:44.821 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.821 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.821 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:44.822 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.822 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4805", 2024-09-12T16:16:44.822 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3734391115", 2024-09-12T16:16:44.822 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 10630 2024-09-12T16:16:44.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.822 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.822 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.822 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839654+0000", 2024-09-12T16:16:44.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.822 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.822 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839654+0000", 2024-09-12T16:16:44.823 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.823 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.823 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.823 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839654+0000", 2024-09-12T16:16:44.823 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7099999999999997e-07 2024-09-12T16:16:44.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.823 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.823 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.823 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839656+0000", 2024-09-12T16:16:44.823 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0980000000000001e-06 2024-09-12T16:16:44.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.824 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.824 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839663+0000", 2024-09-12T16:16:44.824 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5119999999999997e-06 2024-09-12T16:16:44.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.824 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.824 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839668+0000", 2024-09-12T16:16:44.824 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0900000000000004e-06 2024-09-12T16:16:44.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.825 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.825 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863252+0000", 2024-09-12T16:16:44.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023583908000000001 2024-09-12T16:16:44.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.825 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.825 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863300+0000", 2024-09-12T16:16:44.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8347999999999999e-05 2024-09-12T16:16:44.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.825 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.825 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863369+0000", 2024-09-12T16:16:44.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9410000000000001e-05 2024-09-12T16:16:44.825 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.826 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.826 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.826 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4805.0:10631 3.5 3:a1218f83:::rbd_data.1155525b14e3.000000000000002d:f [read 712704~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-09-12T16:16:44.826 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:43.839674+0000", 2024-09-12T16:16:44.826 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.91973932300000005, 2024-09-12T16:16:44.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023832401, 2024-09-12T16:16:44.826 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.826 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.826 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:44.826 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.826 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4805", 2024-09-12T16:16:44.827 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3734391115", 2024-09-12T16:16:44.827 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 10631 2024-09-12T16:16:44.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.827 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839674+0000", 2024-09-12T16:16:44.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839674+0000", 2024-09-12T16:16:44.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.828 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839675+0000", 2024-09-12T16:16:44.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.72e-07 2024-09-12T16:16:44.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.828 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839677+0000", 2024-09-12T16:16:44.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0219999999999999e-06 2024-09-12T16:16:44.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.829 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.829 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839683+0000", 2024-09-12T16:16:44.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5060000000000001e-06 2024-09-12T16:16:44.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.829 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.829 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839688+0000", 2024-09-12T16:16:44.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8879999999999996e-06 2024-09-12T16:16:44.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.830 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.830 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863393+0000", 2024-09-12T16:16:44.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023704691 2024-09-12T16:16:44.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.830 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.830 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863438+0000", 2024-09-12T16:16:44.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5077000000000002e-05 2024-09-12T16:16:44.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863507+0000", 2024-09-12T16:16:44.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8844999999999996e-05 2024-09-12T16:16:44.831 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.831 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.831 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.832 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4805.0:10635 3.5 3:a735f393:::rbd_data.1155525b14e3.0000000000000035:f [read 708608~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-09-12T16:16:44.832 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:43.839695+0000", 2024-09-12T16:16:44.832 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.91971885200000003, 2024-09-12T16:16:44.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023949386999999999, 2024-09-12T16:16:44.833 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.833 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.833 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:44.833 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.833 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4805", 2024-09-12T16:16:44.833 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3734391115", 2024-09-12T16:16:44.834 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 10635 2024-09-12T16:16:44.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.834 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.834 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839695+0000", 2024-09-12T16:16:44.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.834 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839695+0000", 2024-09-12T16:16:44.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839695+0000", 2024-09-12T16:16:44.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8700000000000001e-07 2024-09-12T16:16:44.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839697+0000", 2024-09-12T16:16:44.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0549999999999998e-06 2024-09-12T16:16:44.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839704+0000", 2024-09-12T16:16:44.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4989999999999999e-06 2024-09-12T16:16:44.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839709+0000", 2024-09-12T16:16:44.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3970000000000002e-06 2024-09-12T16:16:44.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863529+0000", 2024-09-12T16:16:44.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023820277000000001 2024-09-12T16:16:44.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863575+0000", 2024-09-12T16:16:44.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5259000000000002e-05 2024-09-12T16:16:44.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863644+0000", 2024-09-12T16:16:44.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9512999999999997e-05 2024-09-12T16:16:44.837 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.838 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.838 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.838 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4805.0:10637 3.5 3:a1218f83:::rbd_data.1155525b14e3.000000000000002d:f [read 741376~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-09-12T16:16:44.838 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:43.839716+0000", 2024-09-12T16:16:44.839 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.91969816900000001, 2024-09-12T16:16:44.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024074149999999999, 2024-09-12T16:16:44.839 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.839 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.839 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:44.839 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.840 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4805", 2024-09-12T16:16:44.840 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3734391115", 2024-09-12T16:16:44.840 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 10637 2024-09-12T16:16:44.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.840 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839716+0000", 2024-09-12T16:16:44.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839716+0000", 2024-09-12T16:16:44.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839716+0000", 2024-09-12T16:16:44.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9499999999999998e-07 2024-09-12T16:16:44.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839718+0000", 2024-09-12T16:16:44.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.012e-06 2024-09-12T16:16:44.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839724+0000", 2024-09-12T16:16:44.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4180000000000002e-06 2024-09-12T16:16:44.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.843 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839729+0000", 2024-09-12T16:16:44.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1089999999999997e-06 2024-09-12T16:16:44.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863668+0000", 2024-09-12T16:16:44.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023938734999999999 2024-09-12T16:16:44.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863713+0000", 2024-09-12T16:16:44.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4994999999999999e-05 2024-09-12T16:16:44.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863790+0000", 2024-09-12T16:16:44.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6485999999999999e-05 2024-09-12T16:16:44.845 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.845 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.845 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.845 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4805.0:10642 3.5 3:a735f393:::rbd_data.1155525b14e3.0000000000000035:f [read 737280~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-09-12T16:16:44.845 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:43.839736+0000", 2024-09-12T16:16:44.845 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.919677513, 2024-09-12T16:16:44.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024204321000000001, 2024-09-12T16:16:44.846 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.846 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.846 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:44.846 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.846 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4805", 2024-09-12T16:16:44.846 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3734391115", 2024-09-12T16:16:44.847 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 10642 2024-09-12T16:16:44.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.847 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839736+0000", 2024-09-12T16:16:44.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.848 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839736+0000", 2024-09-12T16:16:44.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.848 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839737+0000", 2024-09-12T16:16:44.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2e-07 2024-09-12T16:16:44.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839739+0000", 2024-09-12T16:16:44.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9740000000000001e-06 2024-09-12T16:16:44.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839745+0000", 2024-09-12T16:16:44.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5139999999999998e-06 2024-09-12T16:16:44.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.851 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839750+0000", 2024-09-12T16:16:44.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8230000000000002e-06 2024-09-12T16:16:44.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863812+0000", 2024-09-12T16:16:44.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024062554 2024-09-12T16:16:44.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863858+0000", 2024-09-12T16:16:44.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5827e-05 2024-09-12T16:16:44.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863941+0000", 2024-09-12T16:16:44.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2208999999999998e-05 2024-09-12T16:16:44.853 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.853 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.853 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.853 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4805.0:10643 3.5 3:a1218f83:::rbd_data.1155525b14e3.000000000000002d:f [read 770048~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-09-12T16:16:44.853 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:43.839757+0000", 2024-09-12T16:16:44.854 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.91965707500000005, 2024-09-12T16:16:44.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024320068, 2024-09-12T16:16:44.854 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.854 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.854 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:44.854 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.854 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4805", 2024-09-12T16:16:44.854 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3734391115", 2024-09-12T16:16:44.854 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 10643 2024-09-12T16:16:44.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.854 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.855 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.855 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839757+0000", 2024-09-12T16:16:44.855 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.855 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.855 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839757+0000", 2024-09-12T16:16:44.855 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.856 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.856 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839757+0000", 2024-09-12T16:16:44.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0400000000000002e-07 2024-09-12T16:16:44.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.856 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.856 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839759+0000", 2024-09-12T16:16:44.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.99e-06 2024-09-12T16:16:44.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.856 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.857 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839765+0000", 2024-09-12T16:16:44.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3289999999999999e-06 2024-09-12T16:16:44.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.857 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839770+0000", 2024-09-12T16:16:44.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9969999999999998e-06 2024-09-12T16:16:44.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.857 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863964+0000", 2024-09-12T16:16:44.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024193394999999999 2024-09-12T16:16:44.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.864008+0000", 2024-09-12T16:16:44.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4002999999999999e-05 2024-09-12T16:16:44.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.864077+0000", 2024-09-12T16:16:44.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8949999999999995e-05 2024-09-12T16:16:44.858 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.858 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.858 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.859 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4805.0:10653 3.5 3:a735f393:::rbd_data.1155525b14e3.0000000000000035:f [read 782336~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-09-12T16:16:44.859 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:43.839781+0000", 2024-09-12T16:16:44.859 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.91963224399999999, 2024-09-12T16:16:44.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024439470000000001, 2024-09-12T16:16:44.859 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.859 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.859 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:44.859 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.859 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4805", 2024-09-12T16:16:44.859 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3734391115", 2024-09-12T16:16:44.859 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 10653 2024-09-12T16:16:44.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.860 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.860 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839781+0000", 2024-09-12T16:16:44.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.860 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839781+0000", 2024-09-12T16:16:44.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.860 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839782+0000", 2024-09-12T16:16:44.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4099999999999999e-07 2024-09-12T16:16:44.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.861 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.861 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839784+0000", 2024-09-12T16:16:44.861 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2479999999999999e-06 2024-09-12T16:16:44.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839794+0000", 2024-09-12T16:16:44.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0283e-05 2024-09-12T16:16:44.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839800+0000", 2024-09-12T16:16:44.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4870000000000002e-06 2024-09-12T16:16:44.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.864102+0000", 2024-09-12T16:16:44.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.02430177 2024-09-12T16:16:44.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.864146+0000", 2024-09-12T16:16:44.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4697000000000003e-05 2024-09-12T16:16:44.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.864221+0000", 2024-09-12T16:16:44.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4543999999999996e-05 2024-09-12T16:16:44.863 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.863 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.863 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.864 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4805.0:10656 3.5 3:a1218f83:::rbd_data.1155525b14e3.000000000000002d:f [read 815104~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-09-12T16:16:44.864 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:43.839808+0000", 2024-09-12T16:16:44.864 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.91960551499999998, 2024-09-12T16:16:44.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024552312999999999, 2024-09-12T16:16:44.864 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.864 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.864 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:44.864 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.864 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4805", 2024-09-12T16:16:44.864 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3734391115", 2024-09-12T16:16:44.865 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 10656 2024-09-12T16:16:44.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.865 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839808+0000", 2024-09-12T16:16:44.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839808+0000", 2024-09-12T16:16:44.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839809+0000", 2024-09-12T16:16:44.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1399999999999997e-07 2024-09-12T16:16:44.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839811+0000", 2024-09-12T16:16:44.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4480000000000001e-06 2024-09-12T16:16:44.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839817+0000", 2024-09-12T16:16:44.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3980000000000004e-06 2024-09-12T16:16:44.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839823+0000", 2024-09-12T16:16:44.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2789999999999998e-06 2024-09-12T16:16:44.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.868 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.868 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.864244+0000", 2024-09-12T16:16:44.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024420996 2024-09-12T16:16:44.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.868 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.869 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.864289+0000", 2024-09-12T16:16:44.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4981000000000002e-05 2024-09-12T16:16:44.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.869 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.869 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.864360+0000", 2024-09-12T16:16:44.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1797000000000004e-05 2024-09-12T16:16:44.869 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.869 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.869 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.870 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4805.0:10662 3.5 3:a735f393:::rbd_data.1155525b14e3.0000000000000035:f [read 811008~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-09-12T16:16:44.870 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:43.839830+0000", 2024-09-12T16:16:44.870 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.91958376100000006, 2024-09-12T16:16:44.870 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024660374999999998, 2024-09-12T16:16:44.870 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:44.870 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:44.870 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:44.870 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:44.870 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4805", 2024-09-12T16:16:44.870 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3734391115", 2024-09-12T16:16:44.870 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 10662 2024-09-12T16:16:44.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.870 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:44.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:44.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839830+0000", 2024-09-12T16:16:44.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:44.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839830+0000", 2024-09-12T16:16:44.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:44.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:44.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839830+0000", 2024-09-12T16:16:44.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2399999999999999e-07 2024-09-12T16:16:44.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:44.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839832+0000", 2024-09-12T16:16:44.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0229999999999999e-06 2024-09-12T16:16:44.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:44.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839839+0000", 2024-09-12T16:16:44.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3589999999999996e-06 2024-09-12T16:16:44.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:44.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839843+0000", 2024-09-12T16:16:44.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7530000000000001e-06 2024-09-12T16:16:44.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:44.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.864374+0000", 2024-09-12T16:16:44.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024530600999999999 2024-09-12T16:16:44.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:44.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.864421+0000", 2024-09-12T16:16:44.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6968999999999997e-05 2024-09-12T16:16:44.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:44.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:44.874 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:44.874 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.864490+0000", 2024-09-12T16:16:44.874 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9245999999999994e-05 2024-09-12T16:16:44.874 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.874 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.874 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.874 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:44.874 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:44.874 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:44.875 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #14, image image_client.0-clone14 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent15 2024-09-12T16:16:44.876 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:44.874+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:44.876 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:16:44.977 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:44.976+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:45.022 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:45.022 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:16:45.022 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.022 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4844.0:5007 3.1f 3:fbbe90f1:::rbd_data.1155525b14e3.0000000000000018:f [read 4096~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T16:16:45.022 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:45.021725+0000", 2024-09-12T16:16:45.022 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.000150502, 2024-09-12T16:16:45.023 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018527800000000001, 2024-09-12T16:16:45.023 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.023 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.023 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:45.023 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.023 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4844", 2024-09-12T16:16:45.023 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/841174996", 2024-09-12T16:16:45.023 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5007 2024-09-12T16:16:45.023 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.023 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.023 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.023 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.023 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.021725+0000", 2024-09-12T16:16:45.023 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.023 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.024 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.024 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.024 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.021725+0000", 2024-09-12T16:16:45.024 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.024 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.024 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.024 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.024 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.021726+0000", 2024-09-12T16:16:45.024 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8100000000000002e-07 2024-09-12T16:16:45.024 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.024 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.024 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.024 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.021729+0000", 2024-09-12T16:16:45.025 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.552e-06 2024-09-12T16:16:45.025 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.025 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.025 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.025 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.021740+0000", 2024-09-12T16:16:45.025 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0631999999999999e-05 2024-09-12T16:16:45.025 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.025 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.025 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.025 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.021747+0000", 2024-09-12T16:16:45.025 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4239999999999998e-06 2024-09-12T16:16:45.025 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.026 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.026 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.026 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.021789+0000", 2024-09-12T16:16:45.026 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2834999999999999e-05 2024-09-12T16:16:45.026 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.026 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.026 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:45.026 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.021860+0000", 2024-09-12T16:16:45.026 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1077999999999999e-05 2024-09-12T16:16:45.026 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.027 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.027 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.027 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.027 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.027 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4844.0:5009 3.1f 3.8f097ddf (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T16:16:45.027 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:45.021832+0000", 2024-09-12T16:16:45.027 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.3603999999999998e-05, 2024-09-12T16:16:45.027 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000146391, 2024-09-12T16:16:45.027 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.027 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.027 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:45.027 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.028 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4844", 2024-09-12T16:16:45.028 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/841174996", 2024-09-12T16:16:45.028 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5009 2024-09-12T16:16:45.028 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.028 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.028 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.028 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.028 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.021832+0000", 2024-09-12T16:16:45.028 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.028 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.028 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.029 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.029 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.021832+0000", 2024-09-12T16:16:45.029 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.029 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.029 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.029 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.030 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.021833+0000", 2024-09-12T16:16:45.030 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7100000000000001e-07 2024-09-12T16:16:45.030 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.030 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.030 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.030 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.021841+0000", 2024-09-12T16:16:45.030 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0409999999999998e-06 2024-09-12T16:16:45.030 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.030 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.030 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.030 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.021849+0000", 2024-09-12T16:16:45.030 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.208e-06 2024-09-12T16:16:45.030 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.030 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.031 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.031 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.021854+0000", 2024-09-12T16:16:45.031 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9189999999999998e-06 2024-09-12T16:16:45.031 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.031 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.031 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.031 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.031 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.031 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4844.0:5016 3.1f 3.8f097ddf (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T16:16:45.031 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:45.021870+0000", 2024-09-12T16:16:45.031 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 6.0820000000000004e-06, 2024-09-12T16:16:45.031 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000159197, 2024-09-12T16:16:45.031 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.032 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.032 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:16:45.032 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.032 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4844", 2024-09-12T16:16:45.032 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/841174996", 2024-09-12T16:16:45.032 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5016 2024-09-12T16:16:45.032 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.032 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.032 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.033 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.033 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.021870+0000", 2024-09-12T16:16:45.033 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.033 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.033 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.033 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.033 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.021870+0000", 2024-09-12T16:16:45.033 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.033 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.033 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.033 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.033 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.021870+0000", 2024-09-12T16:16:45.034 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4700000000000001e-07 2024-09-12T16:16:45.034 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.034 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.034 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.034 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.021873+0000", 2024-09-12T16:16:45.034 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.644e-06 2024-09-12T16:16:45.034 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.034 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.034 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.034 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.021880+0000", 2024-09-12T16:16:45.034 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7839999999999998e-06 2024-09-12T16:16:45.034 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.035 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.035 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.035 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.021886+0000", 2024-09-12T16:16:45.035 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4829999999999996e-06 2024-09-12T16:16:45.035 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.035 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.035 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.035 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.035 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.035 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4844.0:5023 3.a 3:562839fa:::rbd_data.1155b4d1eca0.0000000000000027:head [read 278528~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T16:16:45.035 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:45.021923+0000", 2024-09-12T16:16:45.035 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4294967295.9999533, 2024-09-12T16:16:45.035 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000158827, 2024-09-12T16:16:45.035 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.036 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.036 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "reached pg", 2024-09-12T16:16:45.036 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.036 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4844", 2024-09-12T16:16:45.036 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/841174996", 2024-09-12T16:16:45.036 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5023 2024-09-12T16:16:45.036 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.036 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.036 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.036 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.036 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.021923+0000", 2024-09-12T16:16:45.036 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.037 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.037 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.037 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.037 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.021923+0000", 2024-09-12T16:16:45.037 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.037 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.037 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.037 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.037 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.021923+0000", 2024-09-12T16:16:45.037 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8500000000000002e-07 2024-09-12T16:16:45.037 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.037 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.037 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.038 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.021926+0000", 2024-09-12T16:16:45.038 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.503e-06 2024-09-12T16:16:45.038 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.038 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.038 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.038 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.021932+0000", 2024-09-12T16:16:45.038 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5729999999999996e-06 2024-09-12T16:16:45.038 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.038 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.038 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.038 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.021937+0000", 2024-09-12T16:16:45.038 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2379999999999997e-06 2024-09-12T16:16:45.038 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.038 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.039 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.039 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.022036+0000", 2024-09-12T16:16:45.039 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8187e-05 2024-09-12T16:16:45.039 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.039 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.039 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.039 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.039 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-12T16:16:45.039 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 4 2024-09-12T16:16:45.039 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:45.041 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:16:45.085 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:45.084+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:45.154 INFO:teuthology.orchestra.run.smithi017.stderr:marked out osd.3. 2024-09-12T16:16:45.173 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:45.173 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:16:45.173 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:16:45.174 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:16:45.174 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:45.182 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:16:45.214 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:45.213+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:45.279 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:45.278+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:45.331 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:45.331 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:16:45.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:16:45.331 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:16:45.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.331 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:16:45.331 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:16:45.331 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 63.564775509, 2024-09-12T16:16:45.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55645454900000002, 2024-09-12T16:16:45.331 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.332 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.332 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:45.332 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.332 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:16:45.332 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:16:45.332 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1 2024-09-12T16:16:45.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.332 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:16:45.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.333 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:16:45.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.333 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764440+0000", 2024-09-12T16:16:45.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6249999999999999e-06 2024-09-12T16:16:45.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.334 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.334 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764447+0000", 2024-09-12T16:16:45.334 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4939999999999997e-06 2024-09-12T16:16:45.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.334 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.334 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.334 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764459+0000", 2024-09-12T16:16:45.334 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1517e-05 2024-09-12T16:16:45.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.334 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.334 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.334 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764468+0000", 2024-09-12T16:16:45.334 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7690000000000002e-06 2024-09-12T16:16:45.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.335 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.335 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.335 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764539+0000", 2024-09-12T16:16:45.335 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1103e-05 2024-09-12T16:16:45.335 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.335 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.335 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:16:45.335 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764551+0000", 2024-09-12T16:16:45.335 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2687999999999999e-05 2024-09-12T16:16:45.335 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.335 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.335 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.335 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319497+0000", 2024-09-12T16:16:45.336 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55494560500000001 2024-09-12T16:16:45.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.336 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.336 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:45.336 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319688+0000", 2024-09-12T16:16:45.336 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019105599999999999 2024-09-12T16:16:45.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.336 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.336 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:16:45.336 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319842+0000", 2024-09-12T16:16:45.336 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015377699999999999 2024-09-12T16:16:45.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.336 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.336 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:45.336 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320473+0000", 2024-09-12T16:16:45.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00063117100000000003 2024-09-12T16:16:45.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.337 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:45.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320825+0000", 2024-09-12T16:16:45.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00035202500000000001 2024-09-12T16:16:45.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.337 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:45.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320867+0000", 2024-09-12T16:16:45.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2005000000000002e-05 2024-09-12T16:16:45.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.337 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:45.338 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320893+0000", 2024-09-12T16:16:45.338 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5714000000000001e-05 2024-09-12T16:16:45.338 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.338 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.338 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.338 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.338 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.338 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14034 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5035008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:45.338 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:16:45.338 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 25.807717275999998, 2024-09-12T16:16:45.338 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053404082999999998, 2024-09-12T16:16:45.338 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.338 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.338 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:45.339 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.339 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:45.339 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:45.339 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14034 2024-09-12T16:16:45.339 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.339 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.339 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.339 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.339 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:16:45.339 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.339 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.339 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.339 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.339 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:16:45.339 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.340 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.340 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.340 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521740+0000", 2024-09-12T16:16:45.340 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000243976 2024-09-12T16:16:45.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.340 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.340 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.340 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521745+0000", 2024-09-12T16:16:45.340 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1280000000000001e-06 2024-09-12T16:16:45.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.340 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.340 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.340 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521757+0000", 2024-09-12T16:16:45.340 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2751e-05 2024-09-12T16:16:45.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.341 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.341 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.341 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521771+0000", 2024-09-12T16:16:45.341 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3328e-05 2024-09-12T16:16:45.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.341 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.341 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.341 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574710+0000", 2024-09-12T16:16:45.341 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052939358999999998 2024-09-12T16:16:45.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.341 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.341 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:45.341 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574799+0000", 2024-09-12T16:16:45.341 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8893000000000004e-05 2024-09-12T16:16:45.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.342 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.342 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:45.342 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574901+0000", 2024-09-12T16:16:45.342 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101648 2024-09-12T16:16:45.342 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.342 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.342 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.342 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.342 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14036 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5043200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:45.342 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:16:45.342 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 25.807258082000001, 2024-09-12T16:16:45.342 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053426247000000003, 2024-09-12T16:16:45.342 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.343 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.343 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:45.343 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.343 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:45.343 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:45.343 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14036 2024-09-12T16:16:45.343 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.343 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.343 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.343 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.343 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:16:45.343 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.343 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.343 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.343 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.344 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:16:45.344 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.344 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.344 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.344 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522208+0000", 2024-09-12T16:16:45.344 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025195300000000002 2024-09-12T16:16:45.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.344 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.344 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.344 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522211+0000", 2024-09-12T16:16:45.344 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2160000000000002e-06 2024-09-12T16:16:45.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.345 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.345 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.345 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522223+0000", 2024-09-12T16:16:45.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2044e-05 2024-09-12T16:16:45.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.345 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.345 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.345 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522229+0000", 2024-09-12T16:16:45.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8850000000000004e-06 2024-09-12T16:16:45.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.346 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.346 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575192+0000", 2024-09-12T16:16:45.346 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052963573 2024-09-12T16:16:45.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.346 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:45.346 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575282+0000", 2024-09-12T16:16:45.346 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9666000000000005e-05 2024-09-12T16:16:45.347 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.347 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.347 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:45.347 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575382+0000", 2024-09-12T16:16:45.347 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9909999999999997e-05 2024-09-12T16:16:45.347 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.347 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.347 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.347 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.347 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.347 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14037 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5047296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:45.347 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522245+0000", 2024-09-12T16:16:45.348 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 25.806969247000001, 2024-09-12T16:16:45.348 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053384907000000002, 2024-09-12T16:16:45.348 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.348 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.348 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:45.348 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.348 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:45.348 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:45.348 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14037 2024-09-12T16:16:45.348 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.348 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.348 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.348 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.349 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522245+0000", 2024-09-12T16:16:45.349 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.349 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.349 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.349 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522245+0000", 2024-09-12T16:16:45.349 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.349 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.349 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.349 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522471+0000", 2024-09-12T16:16:45.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022601300000000001 2024-09-12T16:16:45.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522474+0000", 2024-09-12T16:16:45.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3390000000000001e-06 2024-09-12T16:16:45.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522482+0000", 2024-09-12T16:16:45.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7919999999999993e-06 2024-09-12T16:16:45.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.351 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522486+0000", 2024-09-12T16:16:45.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5109999999999997e-06 2024-09-12T16:16:45.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.351 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.351 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575433+0000", 2024-09-12T16:16:45.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052946673999999999 2024-09-12T16:16:45.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.351 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:45.351 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575532+0000", 2024-09-12T16:16:45.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9128000000000004e-05 2024-09-12T16:16:45.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.351 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:45.352 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575629+0000", 2024-09-12T16:16:45.352 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7449999999999997e-05 2024-09-12T16:16:45.352 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.352 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.352 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.352 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.352 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14038 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5051392~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:45.352 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:16:45.352 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 25.806719708999999, 2024-09-12T16:16:45.352 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053395152000000001, 2024-09-12T16:16:45.353 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.353 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.353 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:45.353 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.353 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:45.353 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:45.353 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14038 2024-09-12T16:16:45.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.353 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.353 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.353 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.353 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:16:45.353 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.354 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.354 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:16:45.354 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.354 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.354 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522601+0000", 2024-09-12T16:16:45.354 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010702899999999999 2024-09-12T16:16:45.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.355 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.355 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.355 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522605+0000", 2024-09-12T16:16:45.355 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2379999999999999e-06 2024-09-12T16:16:45.355 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.355 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.355 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.355 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522616+0000", 2024-09-12T16:16:45.355 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1185999999999999e-05 2024-09-12T16:16:45.355 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.355 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.355 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.355 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522624+0000", 2024-09-12T16:16:45.356 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1099999999999997e-06 2024-09-12T16:16:45.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.356 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.356 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.356 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575677+0000", 2024-09-12T16:16:45.356 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053126999999999 2024-09-12T16:16:45.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.356 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.356 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:45.356 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575764+0000", 2024-09-12T16:16:45.356 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7250000000000007e-05 2024-09-12T16:16:45.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.356 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.356 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:45.356 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575889+0000", 2024-09-12T16:16:45.357 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012521200000000001 2024-09-12T16:16:45.357 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.357 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.357 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.357 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.357 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14039 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5055488~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:45.357 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:16:45.357 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 25.806578298000002, 2024-09-12T16:16:45.357 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053466207000000002, 2024-09-12T16:16:45.357 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.357 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.357 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:45.357 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.358 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:45.358 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:45.358 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14039 2024-09-12T16:16:45.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.358 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.358 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.358 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.358 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:16:45.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.358 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.358 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.358 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:16:45.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.359 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522899+0000", 2024-09-12T16:16:45.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026318199999999999 2024-09-12T16:16:45.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.359 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522903+0000", 2024-09-12T16:16:45.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.929e-06 2024-09-12T16:16:45.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.359 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522913+0000", 2024-09-12T16:16:45.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0162e-05 2024-09-12T16:16:45.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.360 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.360 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.360 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522921+0000", 2024-09-12T16:16:45.360 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.14e-06 2024-09-12T16:16:45.360 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.360 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.360 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.360 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575922+0000", 2024-09-12T16:16:45.360 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053000712999999998 2024-09-12T16:16:45.360 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.360 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.360 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:45.360 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576006+0000", 2024-09-12T16:16:45.360 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4161999999999998e-05 2024-09-12T16:16:45.361 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.361 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.361 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:45.361 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576102+0000", 2024-09-12T16:16:45.361 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5919000000000001e-05 2024-09-12T16:16:45.361 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.361 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.361 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.361 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.361 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.361 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14040 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5059584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:45.362 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:16:45.362 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 25.806273402999999, 2024-09-12T16:16:45.362 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053413258999999998, 2024-09-12T16:16:45.362 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.362 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.362 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:45.362 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.362 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:45.362 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:45.362 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14040 2024-09-12T16:16:45.362 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.362 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.362 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.362 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.362 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:16:45.363 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.363 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.363 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.363 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.363 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:16:45.363 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.363 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.363 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.363 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.363 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523059+0000", 2024-09-12T16:16:45.363 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118466 2024-09-12T16:16:45.364 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.364 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.364 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.364 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523062+0000", 2024-09-12T16:16:45.364 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.971e-06 2024-09-12T16:16:45.364 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.364 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.364 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.364 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523069+0000", 2024-09-12T16:16:45.364 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8279999999999997e-06 2024-09-12T16:16:45.364 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.364 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.364 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.364 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523073+0000", 2024-09-12T16:16:45.364 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3019999999999996e-06 2024-09-12T16:16:45.364 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.365 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.365 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.365 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576155+0000", 2024-09-12T16:16:45.365 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053081962000000003 2024-09-12T16:16:45.365 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.365 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.365 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:45.365 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576249+0000", 2024-09-12T16:16:45.365 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3914999999999998e-05 2024-09-12T16:16:45.365 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.365 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.365 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:45.365 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576354+0000", 2024-09-12T16:16:45.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010481500000000001 2024-09-12T16:16:45.366 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.366 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.366 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.366 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.366 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14041 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5063680~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:45.366 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:16:45.366 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 25.806123098, 2024-09-12T16:16:45.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053519111000000001, 2024-09-12T16:16:45.366 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.366 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.366 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:45.366 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.366 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:45.367 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:45.367 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14041 2024-09-12T16:16:45.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.367 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.367 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.367 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.367 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:16:45.367 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.367 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.367 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.367 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:16:45.367 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.368 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.368 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.368 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523309+0000", 2024-09-12T16:16:45.368 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000218712 2024-09-12T16:16:45.368 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.368 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.368 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.368 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523313+0000", 2024-09-12T16:16:45.368 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.151e-06 2024-09-12T16:16:45.368 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.368 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.368 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.369 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523320+0000", 2024-09-12T16:16:45.369 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9789999999999993e-06 2024-09-12T16:16:45.369 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.369 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.369 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.369 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523325+0000", 2024-09-12T16:16:45.369 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:16:45.369 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.369 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.369 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.369 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576402+0000", 2024-09-12T16:16:45.369 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053076811000000002 2024-09-12T16:16:45.369 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.370 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.370 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:45.370 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576491+0000", 2024-09-12T16:16:45.370 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8578999999999993e-05 2024-09-12T16:16:45.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.370 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.370 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:45.370 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576610+0000", 2024-09-12T16:16:45.370 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119129 2024-09-12T16:16:45.370 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.370 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.370 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.370 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.370 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14042 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5067776~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:45.370 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:16:45.371 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 25.805879663999999, 2024-09-12T16:16:45.371 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053510350999999998, 2024-09-12T16:16:45.371 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.371 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.371 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:45.371 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.371 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:45.371 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:45.371 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14042 2024-09-12T16:16:45.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.371 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.371 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.371 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.371 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:16:45.371 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.372 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.372 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.372 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.372 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:16:45.372 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.372 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.372 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.372 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.372 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523591+0000", 2024-09-12T16:16:45.372 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025710300000000001 2024-09-12T16:16:45.372 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.372 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.372 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.372 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523594+0000", 2024-09-12T16:16:45.373 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2229999999999999e-06 2024-09-12T16:16:45.373 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.373 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.373 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.373 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523602+0000", 2024-09-12T16:16:45.373 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6930000000000007e-06 2024-09-12T16:16:45.373 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.373 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.373 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.373 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523607+0000", 2024-09-12T16:16:45.373 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4789999999999998e-06 2024-09-12T16:16:45.373 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.373 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.373 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.374 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576661+0000", 2024-09-12T16:16:45.374 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053973999999997 2024-09-12T16:16:45.374 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.374 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.374 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:45.374 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576745+0000", 2024-09-12T16:16:45.374 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4660000000000006e-05 2024-09-12T16:16:45.374 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.374 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.374 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:45.374 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576844+0000", 2024-09-12T16:16:45.374 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9219e-05 2024-09-12T16:16:45.374 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.374 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.374 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.375 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.375 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.375 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14043 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5071872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:45.375 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:16:45.375 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 25.805599184999998, 2024-09-12T16:16:45.375 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053475295999999999, 2024-09-12T16:16:45.375 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.375 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.375 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:45.375 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.375 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:45.375 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:45.375 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14043 2024-09-12T16:16:45.376 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.376 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.376 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.376 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.376 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:16:45.376 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.376 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.376 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.376 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.376 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:16:45.376 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.376 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.376 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.377 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.377 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523823+0000", 2024-09-12T16:16:45.377 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020818900000000001 2024-09-12T16:16:45.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.377 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.377 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.377 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523826+0000", 2024-09-12T16:16:45.377 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.405e-06 2024-09-12T16:16:45.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.377 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.377 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.377 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523834+0000", 2024-09-12T16:16:45.377 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5499999999999997e-06 2024-09-12T16:16:45.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.378 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.378 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.378 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523838+0000", 2024-09-12T16:16:45.378 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.408e-06 2024-09-12T16:16:45.378 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.378 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.378 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.378 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576904+0000", 2024-09-12T16:16:45.378 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053065687 2024-09-12T16:16:45.378 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.378 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.378 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:45.378 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576991+0000", 2024-09-12T16:16:45.378 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7399999999999997e-05 2024-09-12T16:16:45.378 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.379 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.379 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:45.379 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577090+0000", 2024-09-12T16:16:45.379 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8657000000000001e-05 2024-09-12T16:16:45.379 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.379 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.379 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.379 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.379 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.379 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14044 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5075968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:45.379 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:16:45.379 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 25.805367655000001, 2024-09-12T16:16:45.379 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053442659000000003, 2024-09-12T16:16:45.379 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.379 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.380 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:45.380 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.380 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:45.380 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:45.380 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14044 2024-09-12T16:16:45.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.380 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.380 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.380 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.380 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:16:45.380 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.380 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.381 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.381 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:16:45.381 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.381 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.381 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.381 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.382 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523985+0000", 2024-09-12T16:16:45.382 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000138522 2024-09-12T16:16:45.382 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.382 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.382 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.382 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523988+0000", 2024-09-12T16:16:45.382 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.788e-06 2024-09-12T16:16:45.382 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.383 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.383 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.383 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523998+0000", 2024-09-12T16:16:45.383 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8470000000000008e-06 2024-09-12T16:16:45.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.383 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.383 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.383 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524010+0000", 2024-09-12T16:16:45.383 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1348999999999999e-05 2024-09-12T16:16:45.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.383 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.383 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.383 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577137+0000", 2024-09-12T16:16:45.383 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053127055999999999 2024-09-12T16:16:45.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.384 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:45.384 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577210+0000", 2024-09-12T16:16:45.384 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3392000000000005e-05 2024-09-12T16:16:45.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.384 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:45.384 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577289+0000", 2024-09-12T16:16:45.384 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8704999999999999e-05 2024-09-12T16:16:45.384 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.384 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.384 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.385 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14045 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5080064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:45.385 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:16:45.385 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 25.805188833999999, 2024-09-12T16:16:45.385 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053497514000000003, 2024-09-12T16:16:45.385 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.385 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.385 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:45.385 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.385 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:45.385 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:45.385 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14045 2024-09-12T16:16:45.385 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.385 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.385 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.385 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.386 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:16:45.386 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.386 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.386 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.386 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:16:45.386 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.386 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.386 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.386 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524311+0000", 2024-09-12T16:16:45.386 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028626299999999998 2024-09-12T16:16:45.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.387 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.387 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.387 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524315+0000", 2024-09-12T16:16:45.387 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0969999999999999e-06 2024-09-12T16:16:45.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.387 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.387 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.387 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524325+0000", 2024-09-12T16:16:45.387 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6330000000000008e-06 2024-09-12T16:16:45.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.387 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.387 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.387 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524332+0000", 2024-09-12T16:16:45.387 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8700000000000003e-06 2024-09-12T16:16:45.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.387 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.387 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577334+0000", 2024-09-12T16:16:45.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053001834999999997 2024-09-12T16:16:45.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.388 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:45.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577420+0000", 2024-09-12T16:16:45.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6145999999999998e-05 2024-09-12T16:16:45.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.388 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:45.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577522+0000", 2024-09-12T16:16:45.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010267 2024-09-12T16:16:45.388 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.388 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.389 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.389 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.389 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14047 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5088256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:45.389 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:16:45.389 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 25.804703107999998, 2024-09-12T16:16:45.389 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053433340000000003, 2024-09-12T16:16:45.389 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.389 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.389 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:45.389 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.389 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:45.389 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:45.389 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14047 2024-09-12T16:16:45.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.390 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.390 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.390 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.390 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:16:45.390 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.390 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.390 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.390 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:16:45.390 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.390 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.390 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.390 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524727+0000", 2024-09-12T16:16:45.391 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000216126 2024-09-12T16:16:45.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.391 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.391 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.391 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524732+0000", 2024-09-12T16:16:45.391 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1569999999999999e-06 2024-09-12T16:16:45.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.391 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.391 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.391 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524742+0000", 2024-09-12T16:16:45.391 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0186999999999999e-05 2024-09-12T16:16:45.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.391 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.391 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.391 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524750+0000", 2024-09-12T16:16:45.392 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4279999999999999e-06 2024-09-12T16:16:45.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.392 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.392 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.392 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577743+0000", 2024-09-12T16:16:45.392 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052993077 2024-09-12T16:16:45.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.392 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.392 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:45.392 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577841+0000", 2024-09-12T16:16:45.392 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8369000000000006e-05 2024-09-12T16:16:45.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.392 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.392 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:45.393 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577944+0000", 2024-09-12T16:16:45.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102996 2024-09-12T16:16:45.393 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.393 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.393 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.393 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14048 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5092352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:45.393 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:16:45.393 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 25.804451515, 2024-09-12T16:16:45.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053397515, 2024-09-12T16:16:45.393 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.393 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.393 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:45.394 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.394 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:45.394 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:45.394 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14048 2024-09-12T16:16:45.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.394 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:16:45.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:16:45.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.395 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.395 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.395 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524957+0000", 2024-09-12T16:16:45.395 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019516999999999999 2024-09-12T16:16:45.395 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.395 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.395 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.395 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524962+0000", 2024-09-12T16:16:45.395 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7709999999999997e-06 2024-09-12T16:16:45.395 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.395 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.395 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.395 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524973+0000", 2024-09-12T16:16:45.396 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1031e-05 2024-09-12T16:16:45.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.396 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.396 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.396 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524980+0000", 2024-09-12T16:16:45.396 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6100000000000002e-06 2024-09-12T16:16:45.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.396 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.396 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.396 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577977+0000", 2024-09-12T16:16:45.396 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052997481999999999 2024-09-12T16:16:45.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.396 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.397 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:45.397 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578062+0000", 2024-09-12T16:16:45.397 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4851000000000005e-05 2024-09-12T16:16:45.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.397 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.397 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:45.397 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578160+0000", 2024-09-12T16:16:45.397 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7600000000000001e-05 2024-09-12T16:16:45.397 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.397 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.397 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.398 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14049 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5096448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:45.398 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:16:45.398 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 25.804222887000002, 2024-09-12T16:16:45.398 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053439792, 2024-09-12T16:16:45.398 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.398 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.398 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:45.398 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.398 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:45.398 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:45.398 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14049 2024-09-12T16:16:45.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.398 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.398 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.399 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:16:45.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.399 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.399 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.399 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:16:45.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.399 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.399 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.399 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525170+0000", 2024-09-12T16:16:45.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017958500000000001 2024-09-12T16:16:45.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.399 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.399 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.400 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525174+0000", 2024-09-12T16:16:45.400 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0239999999999999e-06 2024-09-12T16:16:45.400 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.400 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.400 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.400 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525184+0000", 2024-09-12T16:16:45.400 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5950000000000005e-06 2024-09-12T16:16:45.400 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.400 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.400 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.400 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525191+0000", 2024-09-12T16:16:45.400 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8329999999999996e-06 2024-09-12T16:16:45.400 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.400 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.401 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.401 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578240+0000", 2024-09-12T16:16:45.401 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053049236 2024-09-12T16:16:45.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.401 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.401 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:45.401 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578333+0000", 2024-09-12T16:16:45.401 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2806999999999994e-05 2024-09-12T16:16:45.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.401 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.401 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:45.401 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578431+0000", 2024-09-12T16:16:45.401 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7712000000000002e-05 2024-09-12T16:16:45.401 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.401 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.402 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.402 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14050 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5100544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:45.402 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.525201+0000", 2024-09-12T16:16:45.402 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 25.804012333999999, 2024-09-12T16:16:45.402 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053367398000000003, 2024-09-12T16:16:45.402 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.402 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.402 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:45.402 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.402 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:45.403 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:45.403 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14050 2024-09-12T16:16:45.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.403 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.403 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.403 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.403 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525201+0000", 2024-09-12T16:16:45.403 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.403 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.403 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.403 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525201+0000", 2024-09-12T16:16:45.403 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.404 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.404 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.404 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525449+0000", 2024-09-12T16:16:45.404 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00024803999999999999 2024-09-12T16:16:45.404 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.404 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.404 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.404 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525453+0000", 2024-09-12T16:16:45.404 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.036e-06 2024-09-12T16:16:45.404 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.404 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.405 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.405 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525462+0000", 2024-09-12T16:16:45.405 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6090000000000001e-06 2024-09-12T16:16:45.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.405 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.405 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.405 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525472+0000", 2024-09-12T16:16:45.405 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9629999999999993e-06 2024-09-12T16:16:45.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.405 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.405 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.405 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578469+0000", 2024-09-12T16:16:45.405 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052996877999999997 2024-09-12T16:16:45.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:45.406 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578514+0000", 2024-09-12T16:16:45.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5460000000000002e-05 2024-09-12T16:16:45.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:45.406 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578569+0000", 2024-09-12T16:16:45.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4412e-05 2024-09-12T16:16:45.406 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.406 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.406 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.407 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14054 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5116928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:45.407 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.526046+0000", 2024-09-12T16:16:45.407 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 25.803167538, 2024-09-12T16:16:45.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053378408000000002, 2024-09-12T16:16:45.407 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.407 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.407 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:45.407 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.407 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:45.407 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:45.407 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14054 2024-09-12T16:16:45.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.407 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.408 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.408 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526046+0000", 2024-09-12T16:16:45.408 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.408 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.408 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.408 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526046+0000", 2024-09-12T16:16:45.408 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.408 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.408 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.408 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526228+0000", 2024-09-12T16:16:45.408 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018200200000000001 2024-09-12T16:16:45.409 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.409 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.409 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.409 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526236+0000", 2024-09-12T16:16:45.409 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5109999999999997e-06 2024-09-12T16:16:45.409 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.409 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.409 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.409 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526245+0000", 2024-09-12T16:16:45.409 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9600000000000006e-06 2024-09-12T16:16:45.409 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.409 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.410 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.410 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526251+0000", 2024-09-12T16:16:45.410 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5520000000000001e-06 2024-09-12T16:16:45.410 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.410 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.410 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.410 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579226+0000", 2024-09-12T16:16:45.410 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052974343 2024-09-12T16:16:45.410 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.410 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.410 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:45.410 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579324+0000", 2024-09-12T16:16:45.410 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8517000000000006e-05 2024-09-12T16:16:45.410 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.410 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.411 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:45.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579425+0000", 2024-09-12T16:16:45.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000100523 2024-09-12T16:16:45.411 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.411 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.411 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.411 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.411 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14055 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5121024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:45.411 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:16:45.411 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 25.802952196, 2024-09-12T16:16:45.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053399038000000003, 2024-09-12T16:16:45.411 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.411 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.411 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:45.412 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.412 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:45.412 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:45.412 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14055 2024-09-12T16:16:45.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.412 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.412 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.412 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:16:45.412 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.413 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.413 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:16:45.413 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.413 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.413 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526403+0000", 2024-09-12T16:16:45.413 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141571 2024-09-12T16:16:45.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.413 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.413 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526406+0000", 2024-09-12T16:16:45.413 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2660000000000002e-06 2024-09-12T16:16:45.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.414 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.414 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.414 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526420+0000", 2024-09-12T16:16:45.414 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3949e-05 2024-09-12T16:16:45.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.414 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.414 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.414 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526428+0000", 2024-09-12T16:16:45.414 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4250000000000001e-06 2024-09-12T16:16:45.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.414 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.414 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.415 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579476+0000", 2024-09-12T16:16:45.415 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053048349000000002 2024-09-12T16:16:45.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.415 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.415 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:45.415 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579563+0000", 2024-09-12T16:16:45.415 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6502999999999995e-05 2024-09-12T16:16:45.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.415 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.415 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:45.415 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579661+0000", 2024-09-12T16:16:45.415 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7974999999999996e-05 2024-09-12T16:16:45.415 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.415 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.415 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.416 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.416 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4806.0:3139 3.1e 3:78d5a095:::rbd_data.11552a37e55b.0000000000000000:head [read 69632~61440] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:16:45.416 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:16:45.416 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.027957946000001, 2024-09-12T16:16:45.416 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057851734000000002, 2024-09-12T16:16:45.416 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.416 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.416 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:45.416 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.416 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4806", 2024-09-12T16:16:45.416 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3959815836", 2024-09-12T16:16:45.416 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 3139 2024-09-12T16:16:45.416 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.416 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.416 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.416 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.417 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:16:45.417 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.417 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.417 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.417 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:16:45.417 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.417 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.417 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.417 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:16:45.417 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4799999999999999e-07 2024-09-12T16:16:45.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.418 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.418 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.418 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301258+0000", 2024-09-12T16:16:45.418 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.844e-06 2024-09-12T16:16:45.418 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.418 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.418 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.418 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301267+0000", 2024-09-12T16:16:45.418 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2960000000000004e-06 2024-09-12T16:16:45.418 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.418 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.418 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.418 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301276+0000", 2024-09-12T16:16:45.418 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0650000000000005e-06 2024-09-12T16:16:45.418 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.418 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.419 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.419 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301871+0000", 2024-09-12T16:16:45.419 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00059423600000000005 2024-09-12T16:16:45.419 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.419 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.419 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:45.419 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301920+0000", 2024-09-12T16:16:45.419 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9067000000000003e-05 2024-09-12T16:16:45.419 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.419 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.419 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:45.419 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359108+0000", 2024-09-12T16:16:45.419 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057187877999999998 2024-09-12T16:16:45.419 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.419 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.420 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.420 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.420 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:6428 3.14 3:28a44e54:::rbd_header.11552a37e55b:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:16:45.420 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:16:45.420 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.027629352, 2024-09-12T16:16:45.420 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057504023000000001, 2024-09-12T16:16:45.420 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.420 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.420 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:45.420 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.420 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:16:45.420 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:45.420 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6428 2024-09-12T16:16:45.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.421 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.421 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.421 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.421 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:16:45.421 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.421 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.421 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.421 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.421 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:16:45.421 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.421 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.421 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.421 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.421 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301585+0000", 2024-09-12T16:16:45.421 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6300000000000005e-07 2024-09-12T16:16:45.421 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.422 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.422 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.422 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301588+0000", 2024-09-12T16:16:45.422 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4149999999999999e-06 2024-09-12T16:16:45.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.422 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.422 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.422 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301597+0000", 2024-09-12T16:16:45.422 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5450000000000003e-06 2024-09-12T16:16:45.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.422 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.422 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.422 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301617+0000", 2024-09-12T16:16:45.422 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9837e-05 2024-09-12T16:16:45.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.423 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.423 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.423 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301779+0000", 2024-09-12T16:16:45.423 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016186799999999999 2024-09-12T16:16:45.423 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.423 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.423 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:45.423 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301855+0000", 2024-09-12T16:16:45.423 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5899e-05 2024-09-12T16:16:45.423 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.423 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.423 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:45.423 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359088+0000", 2024-09-12T16:16:45.423 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057233895999999999 2024-09-12T16:16:45.423 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.423 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.424 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.424 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.424 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.424 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:45.425 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:16:45.425 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:45.424+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:45.526 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:45.525+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:45.573 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:45.574 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:16:45.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.574 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4844.0:7800 3.11 3.2e54a471 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-12T16:16:45.574 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:45.155161+0000", 2024-09-12T16:16:45.574 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.41742953100000002, 2024-09-12T16:16:45.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.41745008099999997, 2024-09-12T16:16:45.574 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.574 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.574 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "waiting for peered", 2024-09-12T16:16:45.574 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.574 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4844", 2024-09-12T16:16:45.574 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/841174996", 2024-09-12T16:16:45.574 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 7800 2024-09-12T16:16:45.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.575 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.575 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.575 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.575 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.155161+0000", 2024-09-12T16:16:45.575 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.575 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.575 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.575 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.155161+0000", 2024-09-12T16:16:45.575 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.575 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.575 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.575 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.155162+0000", 2024-09-12T16:16:45.576 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7100000000000001e-07 2024-09-12T16:16:45.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.576 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.576 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.576 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.155171+0000", 2024-09-12T16:16:45.576 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9630000000000004e-06 2024-09-12T16:16:45.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.576 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.576 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.576 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.155180+0000", 2024-09-12T16:16:45.576 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7559999999999994e-06 2024-09-12T16:16:45.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.576 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.577 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.155188+0000", 2024-09-12T16:16:45.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3599999999999998e-06 2024-09-12T16:16:45.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.577 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.155255+0000", 2024-09-12T16:16:45.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7322000000000004e-05 2024-09-12T16:16:45.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.577 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op must wait for map", 2024-09-12T16:16:45.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.155261+0000", 2024-09-12T16:16:45.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2179999999999996e-06 2024-09-12T16:16:45.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.578 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.578 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.160142+0000", 2024-09-12T16:16:45.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0048813299999999997 2024-09-12T16:16:45.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.578 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:16:45.578 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.160153+0000", 2024-09-12T16:16:45.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0054000000000001e-05 2024-09-12T16:16:45.578 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.578 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.578 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.579 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4844.0:7801 3.1b 3.37b31a9b (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-12T16:16:45.579 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:45.155417+0000", 2024-09-12T16:16:45.579 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.41717374000000002, 2024-09-12T16:16:45.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.41723610700000002, 2024-09-12T16:16:45.579 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.579 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.579 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "waiting for peered", 2024-09-12T16:16:45.579 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.579 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4844", 2024-09-12T16:16:45.579 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/841174996", 2024-09-12T16:16:45.579 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 7801 2024-09-12T16:16:45.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.579 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.580 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.580 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.580 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.155417+0000", 2024-09-12T16:16:45.580 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.580 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.580 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.580 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.155417+0000", 2024-09-12T16:16:45.580 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.580 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.580 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.580 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.155417+0000", 2024-09-12T16:16:45.580 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0800000000000003e-07 2024-09-12T16:16:45.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.155422+0000", 2024-09-12T16:16:45.581 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8500000000000002e-06 2024-09-12T16:16:45.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.155431+0000", 2024-09-12T16:16:45.581 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4700000000000002e-06 2024-09-12T16:16:45.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.155439+0000", 2024-09-12T16:16:45.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0220000000000004e-06 2024-09-12T16:16:45.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.155486+0000", 2024-09-12T16:16:45.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7218000000000001e-05 2024-09-12T16:16:45.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op must wait for map", 2024-09-12T16:16:45.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.155491+0000", 2024-09-12T16:16:45.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2379999999999997e-06 2024-09-12T16:16:45.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.160702+0000", 2024-09-12T16:16:45.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0052103510000000002 2024-09-12T16:16:45.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:16:45.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.160710+0000", 2024-09-12T16:16:45.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6000000000000007e-06 2024-09-12T16:16:45.583 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.583 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.583 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.583 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4844.0:7802 3.1b 3.37b31a9b (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-12T16:16:45.583 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:45.155490+0000", 2024-09-12T16:16:45.584 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.41710045299999998, 2024-09-12T16:16:45.584 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.417196978, 2024-09-12T16:16:45.584 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.584 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.584 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "waiting for peered", 2024-09-12T16:16:45.584 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.584 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4844", 2024-09-12T16:16:45.584 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/841174996", 2024-09-12T16:16:45.584 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 7802 2024-09-12T16:16:45.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.584 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.584 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.584 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.585 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.155490+0000", 2024-09-12T16:16:45.585 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.585 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.585 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.585 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.155490+0000", 2024-09-12T16:16:45.585 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.585 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.585 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.585 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.155491+0000", 2024-09-12T16:16:45.585 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4600000000000004e-07 2024-09-12T16:16:45.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.585 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.585 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.155494+0000", 2024-09-12T16:16:45.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5039999999999998e-06 2024-09-12T16:16:45.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.155503+0000", 2024-09-12T16:16:45.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5979999999999997e-06 2024-09-12T16:16:45.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.155509+0000", 2024-09-12T16:16:45.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6000000000000003e-06 2024-09-12T16:16:45.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.155562+0000", 2024-09-12T16:16:45.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2936000000000003e-05 2024-09-12T16:16:45.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting_for_map not empty", 2024-09-12T16:16:45.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.155571+0000", 2024-09-12T16:16:45.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.456e-06 2024-09-12T16:16:45.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.160742+0000", 2024-09-12T16:16:45.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0051715540000000001 2024-09-12T16:16:45.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:16:45.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.160750+0000", 2024-09-12T16:16:45.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7060000000000004e-06 2024-09-12T16:16:45.588 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.588 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.588 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.588 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4844.0:7810 3.11 3.2e54a471 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-12T16:16:45.588 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:45.155767+0000", 2024-09-12T16:16:45.588 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.41682346199999998, 2024-09-12T16:16:45.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.41695415499999999, 2024-09-12T16:16:45.588 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.588 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.589 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "waiting for peered", 2024-09-12T16:16:45.589 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.589 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4844", 2024-09-12T16:16:45.589 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/841174996", 2024-09-12T16:16:45.589 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 7810 2024-09-12T16:16:45.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.589 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.589 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.589 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.155767+0000", 2024-09-12T16:16:45.589 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.155767+0000", 2024-09-12T16:16:45.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.155768+0000", 2024-09-12T16:16:45.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9500000000000001e-07 2024-09-12T16:16:45.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.155772+0000", 2024-09-12T16:16:45.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5589999999999999e-06 2024-09-12T16:16:45.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.155783+0000", 2024-09-12T16:16:45.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1248e-05 2024-09-12T16:16:45.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.155793+0000", 2024-09-12T16:16:45.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4159999999999993e-06 2024-09-12T16:16:45.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.155846+0000", 2024-09-12T16:16:45.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3381000000000003e-05 2024-09-12T16:16:45.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting_for_map not empty", 2024-09-12T16:16:45.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.155853+0000", 2024-09-12T16:16:45.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0439999999999998e-06 2024-09-12T16:16:45.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.160183+0000", 2024-09-12T16:16:45.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0043294479999999996 2024-09-12T16:16:45.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:16:45.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.160191+0000", 2024-09-12T16:16:45.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7420000000000003e-06 2024-09-12T16:16:45.593 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.593 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.593 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.593 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4844.0:7811 3.1b 3.37b31a9b (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-12T16:16:45.593 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:45.157954+0000", 2024-09-12T16:16:45.593 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.41463640499999999, 2024-09-12T16:16:45.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.41480030099999998, 2024-09-12T16:16:45.593 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.593 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.593 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "waiting for peered", 2024-09-12T16:16:45.593 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.594 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4844", 2024-09-12T16:16:45.594 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/841174996", 2024-09-12T16:16:45.594 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 7811 2024-09-12T16:16:45.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.594 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.594 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.594 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.594 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.157954+0000", 2024-09-12T16:16:45.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.594 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.594 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.594 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.157954+0000", 2024-09-12T16:16:45.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.157955+0000", 2024-09-12T16:16:45.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4900000000000005e-07 2024-09-12T16:16:45.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.157962+0000", 2024-09-12T16:16:45.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.238e-06 2024-09-12T16:16:45.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.157971+0000", 2024-09-12T16:16:45.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0229999999999998e-06 2024-09-12T16:16:45.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.596 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.596 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.596 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.157980+0000", 2024-09-12T16:16:45.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8820000000000007e-06 2024-09-12T16:16:45.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.596 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.596 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.596 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.158064+0000", 2024-09-12T16:16:45.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4029000000000005e-05 2024-09-12T16:16:45.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.596 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.596 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting_for_map not empty", 2024-09-12T16:16:45.596 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.158070+0000", 2024-09-12T16:16:45.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8139999999999997e-06 2024-09-12T16:16:45.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.160775+0000", 2024-09-12T16:16:45.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00270491 2024-09-12T16:16:45.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:16:45.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.160782+0000", 2024-09-12T16:16:45.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9190000000000002e-06 2024-09-12T16:16:45.597 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.597 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.597 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.598 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.598 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4844.0:7812 3.1b 3.37b31a9b (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-12T16:16:45.598 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:45.158084+0000", 2024-09-12T16:16:45.598 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.41450638499999998, 2024-09-12T16:16:45.598 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.41470288199999999, 2024-09-12T16:16:45.598 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.598 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.598 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "waiting for peered", 2024-09-12T16:16:45.598 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.598 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4844", 2024-09-12T16:16:45.598 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/841174996", 2024-09-12T16:16:45.598 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 7812 2024-09-12T16:16:45.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.599 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.158084+0000", 2024-09-12T16:16:45.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.158084+0000", 2024-09-12T16:16:45.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.158085+0000", 2024-09-12T16:16:45.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4700000000000001e-07 2024-09-12T16:16:45.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.158088+0000", 2024-09-12T16:16:45.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7309999999999999e-06 2024-09-12T16:16:45.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.158096+0000", 2024-09-12T16:16:45.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6899999999999992e-06 2024-09-12T16:16:45.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.158102+0000", 2024-09-12T16:16:45.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2689999999999996e-06 2024-09-12T16:16:45.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.158150+0000", 2024-09-12T16:16:45.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8127000000000002e-05 2024-09-12T16:16:45.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting_for_map not empty", 2024-09-12T16:16:45.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.158154+0000", 2024-09-12T16:16:45.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9419999999999997e-06 2024-09-12T16:16:45.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.602 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.602 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.160826+0000", 2024-09-12T16:16:45.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002671377 2024-09-12T16:16:45.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.602 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:16:45.602 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.160840+0000", 2024-09-12T16:16:45.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4765e-05 2024-09-12T16:16:45.602 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.602 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.602 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.603 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4844.0:7813 3.1b 3.37b31a9b (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-12T16:16:45.603 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:45.160081+0000", 2024-09-12T16:16:45.603 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.41250912699999998, 2024-09-12T16:16:45.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.412739403, 2024-09-12T16:16:45.603 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.603 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.603 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "waiting for peered", 2024-09-12T16:16:45.603 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.603 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4844", 2024-09-12T16:16:45.603 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/841174996", 2024-09-12T16:16:45.603 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 7813 2024-09-12T16:16:45.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.604 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.604 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.604 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.160081+0000", 2024-09-12T16:16:45.604 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.604 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.604 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.160081+0000", 2024-09-12T16:16:45.604 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.604 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.160082+0000", 2024-09-12T16:16:45.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9999999999999995e-07 2024-09-12T16:16:45.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.605 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.160091+0000", 2024-09-12T16:16:45.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6319999999999997e-06 2024-09-12T16:16:45.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.605 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.160102+0000", 2024-09-12T16:16:45.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1078e-05 2024-09-12T16:16:45.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.160111+0000", 2024-09-12T16:16:45.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1980000000000007e-06 2024-09-12T16:16:45.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.160891+0000", 2024-09-12T16:16:45.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000780187 2024-09-12T16:16:45.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:16:45.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.160901+0000", 2024-09-12T16:16:45.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3279999999999995e-06 2024-09-12T16:16:45.606 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.606 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.607 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.607 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4844.0:7814 3.1b 3.37b31a9b (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-12T16:16:45.607 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:45.160783+0000", 2024-09-12T16:16:45.607 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.41180694000000001, 2024-09-12T16:16:45.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.41206560599999997, 2024-09-12T16:16:45.607 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.607 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.607 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "waiting for peered", 2024-09-12T16:16:45.607 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.607 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4844", 2024-09-12T16:16:45.607 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/841174996", 2024-09-12T16:16:45.607 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 7814 2024-09-12T16:16:45.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.608 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.608 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.608 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.160783+0000", 2024-09-12T16:16:45.608 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.608 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.608 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.160783+0000", 2024-09-12T16:16:45.608 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.160784+0000", 2024-09-12T16:16:45.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8599999999999997e-07 2024-09-12T16:16:45.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.160788+0000", 2024-09-12T16:16:45.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9450000000000003e-06 2024-09-12T16:16:45.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.160799+0000", 2024-09-12T16:16:45.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1235e-05 2024-09-12T16:16:45.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.610 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.610 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.160806+0000", 2024-09-12T16:16:45.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1489999999999997e-06 2024-09-12T16:16:45.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.610 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.610 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.160933+0000", 2024-09-12T16:16:45.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012630000000000001 2024-09-12T16:16:45.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.610 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:16:45.610 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.160940+0000", 2024-09-12T16:16:45.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6459999999999993e-06 2024-09-12T16:16:45.611 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.611 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.611 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.611 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4844.0:7815 3.1b 3.37b31a9b (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-12T16:16:45.611 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:45.161150+0000", 2024-09-12T16:16:45.611 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.41144061300000001, 2024-09-12T16:16:45.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.41172695799999998, 2024-09-12T16:16:45.611 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.611 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.611 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "waiting for peered", 2024-09-12T16:16:45.611 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.611 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4844", 2024-09-12T16:16:45.611 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/841174996", 2024-09-12T16:16:45.611 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 7815 2024-09-12T16:16:45.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.612 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161150+0000", 2024-09-12T16:16:45.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161150+0000", 2024-09-12T16:16:45.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161151+0000", 2024-09-12T16:16:45.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5000000000000001e-07 2024-09-12T16:16:45.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.613 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.613 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.613 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161154+0000", 2024-09-12T16:16:45.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8659999999999999e-06 2024-09-12T16:16:45.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.613 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.613 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.613 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161179+0000", 2024-09-12T16:16:45.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4326999999999999e-05 2024-09-12T16:16:45.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.613 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.613 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.614 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161188+0000", 2024-09-12T16:16:45.614 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4730000000000006e-06 2024-09-12T16:16:45.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.614 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.614 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161266+0000", 2024-09-12T16:16:45.614 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8181000000000002e-05 2024-09-12T16:16:45.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.614 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:16:45.614 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161275+0000", 2024-09-12T16:16:45.614 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6009999999999995e-06 2024-09-12T16:16:45.614 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.614 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.614 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.615 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.615 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4844.0:7816 3.1b 3.37b31a9b (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-12T16:16:45.615 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:45.161210+0000", 2024-09-12T16:16:45.615 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.41138004, 2024-09-12T16:16:45.615 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.41169382599999998, 2024-09-12T16:16:45.615 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.615 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.615 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "waiting for peered", 2024-09-12T16:16:45.615 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.615 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4844", 2024-09-12T16:16:45.615 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/841174996", 2024-09-12T16:16:45.615 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 7816 2024-09-12T16:16:45.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.616 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.616 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.616 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161210+0000", 2024-09-12T16:16:45.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.616 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.616 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161210+0000", 2024-09-12T16:16:45.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.616 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.616 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161211+0000", 2024-09-12T16:16:45.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9999999999999997e-07 2024-09-12T16:16:45.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.617 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161214+0000", 2024-09-12T16:16:45.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0189999999999998e-06 2024-09-12T16:16:45.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.617 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161222+0000", 2024-09-12T16:16:45.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2500000000000006e-06 2024-09-12T16:16:45.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.617 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161228+0000", 2024-09-12T16:16:45.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3289999999999999e-06 2024-09-12T16:16:45.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.618 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.618 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161317+0000", 2024-09-12T16:16:45.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8137e-05 2024-09-12T16:16:45.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.618 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:16:45.618 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161324+0000", 2024-09-12T16:16:45.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6229999999999997e-06 2024-09-12T16:16:45.618 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.618 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.618 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.619 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.619 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4844.0:7817 3.1b 3.37b31a9b (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-12T16:16:45.619 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:45.161245+0000", 2024-09-12T16:16:45.619 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.41134556, 2024-09-12T16:16:45.619 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.41168742800000002, 2024-09-12T16:16:45.619 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.619 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.619 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "waiting for peered", 2024-09-12T16:16:45.619 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.619 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4844", 2024-09-12T16:16:45.619 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/841174996", 2024-09-12T16:16:45.619 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 7817 2024-09-12T16:16:45.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.619 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.620 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161245+0000", 2024-09-12T16:16:45.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.620 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161245+0000", 2024-09-12T16:16:45.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.620 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161245+0000", 2024-09-12T16:16:45.621 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7800000000000001e-07 2024-09-12T16:16:45.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.621 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.621 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161248+0000", 2024-09-12T16:16:45.621 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5440000000000001e-06 2024-09-12T16:16:45.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.621 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.621 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161255+0000", 2024-09-12T16:16:45.621 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3529999999999997e-06 2024-09-12T16:16:45.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.621 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.622 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161262+0000", 2024-09-12T16:16:45.622 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6599999999999998e-06 2024-09-12T16:16:45.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.622 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.622 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.622 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161356+0000", 2024-09-12T16:16:45.622 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4438000000000006e-05 2024-09-12T16:16:45.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.622 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.622 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:16:45.622 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161365+0000", 2024-09-12T16:16:45.622 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8920000000000006e-06 2024-09-12T16:16:45.622 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.622 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.622 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.623 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4844.0:7818 3.1b 3.37b31a9b (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-12T16:16:45.623 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:45.161270+0000", 2024-09-12T16:16:45.623 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.41132051200000003, 2024-09-12T16:16:45.623 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.411690163, 2024-09-12T16:16:45.623 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.623 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.623 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "waiting for peered", 2024-09-12T16:16:45.623 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.623 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4844", 2024-09-12T16:16:45.623 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/841174996", 2024-09-12T16:16:45.623 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 7818 2024-09-12T16:16:45.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.624 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.624 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161270+0000", 2024-09-12T16:16:45.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.624 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161270+0000", 2024-09-12T16:16:45.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.624 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161270+0000", 2024-09-12T16:16:45.625 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9999999999999998e-07 2024-09-12T16:16:45.625 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.625 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.625 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.625 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161272+0000", 2024-09-12T16:16:45.625 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2589999999999999e-06 2024-09-12T16:16:45.625 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.625 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.625 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.625 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161279+0000", 2024-09-12T16:16:45.625 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4899999999999997e-06 2024-09-12T16:16:45.625 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.625 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.625 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.626 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161285+0000", 2024-09-12T16:16:45.626 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.733e-06 2024-09-12T16:16:45.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.626 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.626 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.626 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161397+0000", 2024-09-12T16:16:45.626 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011230600000000001 2024-09-12T16:16:45.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.626 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.626 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:16:45.626 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161405+0000", 2024-09-12T16:16:45.626 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9200000000000004e-06 2024-09-12T16:16:45.626 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.626 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.626 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.627 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.627 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4844.0:7819 3.1b 3.37b31a9b (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-12T16:16:45.627 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:45.161638+0000", 2024-09-12T16:16:45.627 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.41095245000000002, 2024-09-12T16:16:45.627 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.41135040899999997, 2024-09-12T16:16:45.627 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.627 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.627 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "waiting for peered", 2024-09-12T16:16:45.627 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.627 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4844", 2024-09-12T16:16:45.627 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/841174996", 2024-09-12T16:16:45.627 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 7819 2024-09-12T16:16:45.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.627 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.627 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.628 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.628 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161638+0000", 2024-09-12T16:16:45.628 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.628 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.628 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.628 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.628 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161638+0000", 2024-09-12T16:16:45.628 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.628 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.628 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.628 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.628 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161639+0000", 2024-09-12T16:16:45.628 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7999999999999993e-07 2024-09-12T16:16:45.628 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.628 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.629 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161644+0000", 2024-09-12T16:16:45.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8609999999999997e-06 2024-09-12T16:16:45.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.629 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161656+0000", 2024-09-12T16:16:45.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2041999999999999e-05 2024-09-12T16:16:45.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.629 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161663+0000", 2024-09-12T16:16:45.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2370000000000003e-06 2024-09-12T16:16:45.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.630 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.630 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161717+0000", 2024-09-12T16:16:45.630 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4388000000000002e-05 2024-09-12T16:16:45.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.630 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.630 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:16:45.630 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161727+0000", 2024-09-12T16:16:45.630 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3319999999999998e-06 2024-09-12T16:16:45.630 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.630 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.630 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.630 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.630 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4844.0:7820 3.1b 3.37b31a9b (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-12T16:16:45.630 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:45.161687+0000", 2024-09-12T16:16:45.631 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.41090364200000001, 2024-09-12T16:16:45.631 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.41133243200000003, 2024-09-12T16:16:45.631 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.631 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.631 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "waiting for peered", 2024-09-12T16:16:45.631 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.631 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4844", 2024-09-12T16:16:45.631 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/841174996", 2024-09-12T16:16:45.631 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 7820 2024-09-12T16:16:45.631 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.631 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.631 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.631 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.632 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161687+0000", 2024-09-12T16:16:45.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.632 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.632 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.632 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.632 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161687+0000", 2024-09-12T16:16:45.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.632 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.632 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.632 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.632 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161687+0000", 2024-09-12T16:16:45.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.89e-07 2024-09-12T16:16:45.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.633 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.633 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.633 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161690+0000", 2024-09-12T16:16:45.633 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.695e-06 2024-09-12T16:16:45.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.633 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.633 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.633 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161699+0000", 2024-09-12T16:16:45.633 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8100000000000004e-06 2024-09-12T16:16:45.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.633 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.633 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.633 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161703+0000", 2024-09-12T16:16:45.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6779999999999999e-06 2024-09-12T16:16:45.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.634 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.634 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.634 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161758+0000", 2024-09-12T16:16:45.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4570000000000001e-05 2024-09-12T16:16:45.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.634 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.634 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:16:45.634 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161768+0000", 2024-09-12T16:16:45.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0188e-05 2024-09-12T16:16:45.634 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.634 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.635 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.635 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.635 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4844.0:7821 3.1b 3.37b31a9b (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-12T16:16:45.635 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:45.161813+0000", 2024-09-12T16:16:45.635 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.41077766199999999, 2024-09-12T16:16:45.635 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.41123427099999998, 2024-09-12T16:16:45.635 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.635 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.635 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "waiting for peered", 2024-09-12T16:16:45.635 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.635 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4844", 2024-09-12T16:16:45.635 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/841174996", 2024-09-12T16:16:45.636 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 7821 2024-09-12T16:16:45.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.636 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.636 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.636 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.636 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161813+0000", 2024-09-12T16:16:45.636 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.636 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.636 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.636 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161813+0000", 2024-09-12T16:16:45.636 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.636 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.637 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.637 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161813+0000", 2024-09-12T16:16:45.637 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7199999999999998e-07 2024-09-12T16:16:45.637 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.637 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.637 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.637 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161817+0000", 2024-09-12T16:16:45.637 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9670000000000003e-06 2024-09-12T16:16:45.637 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.637 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.637 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.637 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161829+0000", 2024-09-12T16:16:45.637 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1206000000000001e-05 2024-09-12T16:16:45.637 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.637 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.638 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.638 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161834+0000", 2024-09-12T16:16:45.638 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0250000000000002e-06 2024-09-12T16:16:45.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.638 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.638 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.638 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161869+0000", 2024-09-12T16:16:45.638 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5543999999999997e-05 2024-09-12T16:16:45.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.638 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.638 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:16:45.638 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161875+0000", 2024-09-12T16:16:45.638 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7640000000000002e-06 2024-09-12T16:16:45.638 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.638 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.639 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.639 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.639 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4844.0:7822 3.1b 3.37b31a9b (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-12T16:16:45.639 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:45.161913+0000", 2024-09-12T16:16:45.639 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.41067774699999998, 2024-09-12T16:16:45.639 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.41116224800000001, 2024-09-12T16:16:45.639 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:45.639 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:45.639 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "waiting for peered", 2024-09-12T16:16:45.639 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:45.639 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4844", 2024-09-12T16:16:45.639 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/841174996", 2024-09-12T16:16:45.639 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 7822 2024-09-12T16:16:45.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.640 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:45.640 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.640 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:45.640 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161913+0000", 2024-09-12T16:16:45.640 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.640 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.640 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:45.640 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161913+0000", 2024-09-12T16:16:45.640 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:45.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.640 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.640 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:45.640 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161913+0000", 2024-09-12T16:16:45.641 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3900000000000004e-07 2024-09-12T16:16:45.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.641 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.641 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:45.641 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161920+0000", 2024-09-12T16:16:45.641 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6139999999999997e-06 2024-09-12T16:16:45.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.641 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.641 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:45.641 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161930+0000", 2024-09-12T16:16:45.641 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9499999999999996e-06 2024-09-12T16:16:45.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.641 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.641 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:45.641 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161937+0000", 2024-09-12T16:16:45.642 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1949999999999997e-06 2024-09-12T16:16:45.642 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.642 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.642 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:45.642 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161964+0000", 2024-09-12T16:16:45.642 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7183e-05 2024-09-12T16:16:45.642 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:45.642 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:45.642 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:16:45.642 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:45.161969+0000", 2024-09-12T16:16:45.642 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9259999999999999e-06 2024-09-12T16:16:45.642 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.642 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:45.642 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.642 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:45.643 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-12T16:16:45.643 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 16 2024-09-12T16:16:45.643 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:45.643 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T16:16:45.645 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:16:45.645 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:45.643+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:45.745 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:45.744+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:45.772 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:16:45.772 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:16:45.789 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:16:45.789 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:16:45.792 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:45.792 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:16:45.792 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:16:45.792 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:16:45.792 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:45.800 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:16:45.805 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:16:45.805 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:16:45.822 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:16:45.822 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:16:45.839 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:16:45.839 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:16:45.839 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-12T16:16:45.842 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T16:16:45.843 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T16:16:45.884 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:45.883+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:45.907 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:45.907 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:45.916 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:16:45.960 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:45.959+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:46.023 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:46.023 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:46.032 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:16:46.073 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:46.072+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:46.147 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:46.146+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:46.163 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T16:16:46.186 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:46.186 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:46.195 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:16:46.248 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:46.247+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:46.345 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:46.346 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:46.349 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:46.348+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:46.354 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:16:46.449 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:46.449+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:46.461 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:46.462 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:46.471 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:16:46.557 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:46.556+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:46.619 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:46.619 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:46.628 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:16:46.669 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:46.668+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:46.753 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:46.752+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:46.775 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:46.775 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:46.783 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:16:46.853 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:46.853+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:46.890 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:46.890 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:46.899 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:16:46.983 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:46.982+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:47.046 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:47.046 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:47.055 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:16:47.055 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:47.054+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:47.155 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:47.154+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:47.161 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2024-09-12T16:16:47.220 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:47.220 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:47.232 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:16:47.273 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:47.272+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:47.357 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:47.356+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:47.378 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:47.378 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:47.389 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:16:47.458 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:47.457+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:47.531 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:47.531 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:47.542 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:16:47.583 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:47.582+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:47.645 INFO:teuthology.orchestra.run.smithi204.stdout:2743 trunc from 0x5a57000 to 0x9e35400 2024-09-12T16:16:47.659 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:47.658+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:47.663 INFO:teuthology.orchestra.run.smithi204.stdout:2744 read 0x11e8400 thru 0x11ee200 (0x5e01 bytes) 2024-09-12T16:16:47.684 INFO:teuthology.orchestra.run.smithi204.stdout:2747 write 0xe0dea00 thru 0xe0e3700 (0x4d01 bytes) 2024-09-12T16:16:47.684 INFO:teuthology.orchestra.run.smithi204.stdout:2748 read 0x13f600 thru 0x141fd1 (0x29d2 bytes) 2024-09-12T16:16:47.685 INFO:teuthology.orchestra.run.smithi204.stdout:2749 punch from 0xa699800 to 0xa69e200, (0x4a00 bytes) 2024-09-12T16:16:47.685 INFO:teuthology.orchestra.run.smithi204.stdout:2751 punch from 0x55f7c00 to 0x5603200, (0xb600 bytes) 2024-09-12T16:16:47.685 INFO:teuthology.orchestra.run.smithi204.stdout:2753 read 0x558ea00 thru 0x55915be (0x2bbf bytes) 2024-09-12T16:16:47.685 INFO:teuthology.orchestra.run.smithi204.stdout:2754 trunc from 0xe0e3800 to 0xd96ba00 2024-09-12T16:16:47.699 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:47.699 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:47.708 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:16:47.709 INFO:teuthology.orchestra.run.smithi204.stdout:2755 punch from 0xc85bc00 to 0xc868600, (0xca00 bytes) 2024-09-12T16:16:47.710 INFO:teuthology.orchestra.run.smithi204.stdout:2757 write 0xc4dd800 thru 0xc4de661 (0xe62 bytes) 2024-09-12T16:16:47.710 INFO:teuthology.orchestra.run.smithi204.stdout:2758 punch from 0x1fe6000 to 0x1feb000, (0x5000 bytes) 2024-09-12T16:16:47.710 INFO:teuthology.orchestra.run.smithi204.stdout:2759 read 0xd8c3200 thru 0xd8c62f8 (0x30f9 bytes) 2024-09-12T16:16:47.710 INFO:teuthology.orchestra.run.smithi204.stdout:2763 write 0x7381600 thru 0x7383a21 (0x2422 bytes) 2024-09-12T16:16:47.710 INFO:teuthology.orchestra.run.smithi204.stdout:2765 read 0x8c7e800 thru 0x8c8335a (0x4b5b bytes) 2024-09-12T16:16:47.714 INFO:teuthology.orchestra.run.smithi204.stdout:2766 trunc from 0xd96ba00 to 0x9a19e00 2024-09-12T16:16:47.736 INFO:teuthology.orchestra.run.smithi204.stdout:2768 read 0x9880a00 thru 0x9886c3e (0x623f bytes) 2024-09-12T16:16:47.736 INFO:teuthology.orchestra.run.smithi204.stdout:2774 write 0x78ee400 thru 0x78f98b0 (0xb4b1 bytes) 2024-09-12T16:16:47.760 INFO:teuthology.orchestra.run.smithi204.stdout:2775 write 0xdc19800 thru 0xdc237db (0x9fdc bytes) 2024-09-12T16:16:47.760 INFO:teuthology.orchestra.run.smithi204.stdout:2776 write 0x9e0ea00 thru 0x9e1cf44 (0xe545 bytes) 2024-09-12T16:16:47.760 INFO:teuthology.orchestra.run.smithi204.stdout:2777 read 0x40e6e00 thru 0x40e856b (0x176c bytes) 2024-09-12T16:16:47.761 INFO:teuthology.orchestra.run.smithi204.stdout:2778 read 0x234b000 thru 0x23596a4 (0xe6a5 bytes) 2024-09-12T16:16:47.761 INFO:teuthology.orchestra.run.smithi204.stdout:2780 write 0x1b82e00 thru 0x1b92599 (0xf79a bytes) 2024-09-12T16:16:47.762 INFO:teuthology.orchestra.run.smithi204.stdout:2781 trunc from 0xdc23800 to 0xc4ece00 2024-09-12T16:16:47.787 INFO:teuthology.orchestra.run.smithi204.stdout:2782 read 0x337a800 thru 0x3388793 (0xdf94 bytes) 2024-09-12T16:16:47.792 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:47.791+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:47.805 INFO:teuthology.orchestra.run.smithi204.stdout:2783 write 0xed3d000 thru 0xed40988 (0x3989 bytes) 2024-09-12T16:16:47.812 INFO:teuthology.orchestra.run.smithi204.stdout:2784 trunc from 0xed40a00 to 0x8bf5c00 2024-09-12T16:16:47.828 INFO:teuthology.orchestra.run.smithi204.stdout:2787 read 0x2089e00 thru 0x208b6ec (0x18ed bytes) 2024-09-12T16:16:47.836 INFO:teuthology.orchestra.run.smithi204.stdout:2788 read 0x1e5600 thru 0x1ecc35 (0x7636 bytes) 2024-09-12T16:16:47.837 INFO:teuthology.orchestra.run.smithi204.stdout:2791 punch from 0x52d6a00 to 0x52e6200, (0xf800 bytes) 2024-09-12T16:16:47.838 INFO:teuthology.orchestra.run.smithi204.stdout:2792 trunc from 0x8bf5c00 to 0x9ead200 2024-09-12T16:16:47.844 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T16:16:47.854 INFO:teuthology.orchestra.run.smithi204.stdout:2794 punch from 0x942fc00 to 0x943de00, (0xe200 bytes) 2024-09-12T16:16:47.855 INFO:teuthology.orchestra.run.smithi204.stdout:2801 read 0xc55000 thru 0xc5650c (0x150d bytes) 2024-09-12T16:16:47.860 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:47.859+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:47.861 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:47.861 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:47.870 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:16:47.873 INFO:teuthology.orchestra.run.smithi204.stdout:2802 write 0xb369600 thru 0xb371e86 (0x8887 bytes) 2024-09-12T16:16:47.876 INFO:teuthology.orchestra.run.smithi204.stdout:2804 trunc from 0xb372000 to 0x8542e00 2024-09-12T16:16:47.892 INFO:teuthology.orchestra.run.smithi204.stdout:2806 punch from 0xe08e00 to 0xe10200, (0x7400 bytes) 2024-09-12T16:16:47.893 INFO:teuthology.orchestra.run.smithi204.stdout:2807 read 0x5b05800 thru 0x5b05ae8 (0x2e9 bytes) 2024-09-12T16:16:47.898 INFO:teuthology.orchestra.run.smithi204.stdout:2810 trunc from 0x8542e00 to 0xc5a4800 2024-09-12T16:16:47.908 INFO:teuthology.orchestra.run.smithi204.stdout:2812 punch from 0x15ccc00 to 0x15d0000, (0x3400 bytes) 2024-09-12T16:16:47.910 INFO:teuthology.orchestra.run.smithi204.stdout:2813 read 0xfbe800 thru 0xfce3eb (0xfbec bytes) 2024-09-12T16:16:47.910 INFO:teuthology.orchestra.run.smithi204.stdout:2815 write 0x1d86400 thru 0x1d8b4d8 (0x50d9 bytes) 2024-09-12T16:16:47.914 INFO:teuthology.orchestra.run.smithi204.stdout:2816 trunc from 0xc5a4800 to 0xa2ffc00 2024-09-12T16:16:47.937 INFO:teuthology.orchestra.run.smithi204.stdout:2817 write 0xc2eb400 thru 0xc2ede56 (0x2a57 bytes) 2024-09-12T16:16:47.938 INFO:teuthology.orchestra.run.smithi204.stdout:2818 read 0xe5ca00 thru 0xe60770 (0x3d71 bytes) 2024-09-12T16:16:47.938 INFO:teuthology.orchestra.run.smithi204.stdout:2819 write 0x2f48a00 thru 0x2f58789 (0xfd8a bytes) 2024-09-12T16:16:47.939 INFO:teuthology.orchestra.run.smithi204.stdout:2822 write 0xbb2ca00 thru 0xbb308ac (0x3ead bytes) 2024-09-12T16:16:47.939 INFO:teuthology.orchestra.run.smithi204.stdout:2823 read 0x2958c00 thru 0x295dc6a (0x506b bytes) 2024-09-12T16:16:47.940 INFO:teuthology.orchestra.run.smithi204.stdout:2824 read 0x74b4c00 thru 0x74c1582 (0xc983 bytes) 2024-09-12T16:16:47.949 INFO:teuthology.orchestra.run.smithi204.stdout:2825 trunc from 0xc2ee000 to 0x4cbf000 2024-09-12T16:16:47.962 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:47.961+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:47.978 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:16:47.979 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:16:47.979 INFO:teuthology.orchestra.run.smithi204.stdout:2826 write 0x39f7800 thru 0x39ff044 (0x7845 bytes) 2024-09-12T16:16:47.981 INFO:teuthology.orchestra.run.smithi204.stdout:2827 punch from 0x24c1000 to 0x24d0a00, (0xfa00 bytes) 2024-09-12T16:16:47.994 INFO:teuthology.orchestra.run.smithi204.stdout:2828 write 0x8defe00 thru 0x8df9861 (0x9a62 bytes) 2024-09-12T16:16:47.995 INFO:teuthology.orchestra.run.smithi204.stdout:2831 write 0x7598400 thru 0x75a1b76 (0x9777 bytes) 2024-09-12T16:16:47.999 INFO:teuthology.orchestra.run.smithi204.stdout:2832 trunc from 0x8df9a00 to 0x61bf000 2024-09-12T16:16:48.029 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:48.029 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:48.037 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:16:48.063 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:48.062+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:48.144 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:48.144 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:48.153 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:16:48.164 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:48.163+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:48.198 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:16:48.198 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:16:48.215 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:16:48.215 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:16:48.232 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:16:48.232 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:16:48.249 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:16:48.249 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:16:48.249 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-12T16:16:48.252 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T16:16:48.253 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T16:16:48.264 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:48.264 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:48.264 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:16:48.264 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:48.264 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:48.263+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:48.273 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:16:48.365 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:48.364+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:48.419 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:48.419 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:48.419 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:16:48.419 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:16:48.420 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:48.428 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:16:48.469 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:48.468+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:48.567 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:48.567+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:48.576 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:48.576 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:16:48.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:16:48.576 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:48.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.576 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3703 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14803968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:48.576 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139513+0000", 2024-09-12T16:16:48.577 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.435316402000002, 2024-09-12T16:16:48.577 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053248794000000002, 2024-09-12T16:16:48.577 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:48.577 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:48.577 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:48.577 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:48.577 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:48.577 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:48.577 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3703 2024-09-12T16:16:48.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.577 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:48.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.577 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:48.577 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139513+0000", 2024-09-12T16:16:48.577 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.578 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:48.578 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139513+0000", 2024-09-12T16:16:48.578 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.578 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:48.578 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139639+0000", 2024-09-12T16:16:48.578 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012673299999999999 2024-09-12T16:16:48.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.578 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:48.579 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139642+0000", 2024-09-12T16:16:48.579 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4820000000000001e-06 2024-09-12T16:16:48.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.579 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:48.579 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139647+0000", 2024-09-12T16:16:48.579 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8040000000000001e-06 2024-09-12T16:16:48.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.579 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:48.579 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139650+0000", 2024-09-12T16:16:48.579 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.529e-06 2024-09-12T16:16:48.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:48.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192537+0000", 2024-09-12T16:16:48.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052886503000000001 2024-09-12T16:16:48.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:48.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192627+0000", 2024-09-12T16:16:48.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0183e-05 2024-09-12T16:16:48.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:48.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192761+0000", 2024-09-12T16:16:48.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013456000000000001 2024-09-12T16:16:48.581 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.581 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:48.581 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.581 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.581 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3704 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14808064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:48.581 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139656+0000", 2024-09-12T16:16:48.581 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.435172485999999, 2024-09-12T16:16:48.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053247502000000002, 2024-09-12T16:16:48.581 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:48.581 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:48.582 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:48.582 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:48.582 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:48.582 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:48.582 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3704 2024-09-12T16:16:48.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.582 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:48.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.582 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:48.582 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139656+0000", 2024-09-12T16:16:48.582 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.582 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:48.583 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139656+0000", 2024-09-12T16:16:48.583 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.583 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:48.583 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139790+0000", 2024-09-12T16:16:48.583 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000133471 2024-09-12T16:16:48.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.583 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:48.583 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139792+0000", 2024-09-12T16:16:48.583 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.968e-06 2024-09-12T16:16:48.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.584 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:48.584 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139796+0000", 2024-09-12T16:16:48.584 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2660000000000003e-06 2024-09-12T16:16:48.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.584 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.584 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:48.584 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139799+0000", 2024-09-12T16:16:48.584 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2839999999999998e-06 2024-09-12T16:16:48.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.584 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.584 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:48.584 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192790+0000", 2024-09-12T16:16:48.584 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052990388999999999 2024-09-12T16:16:48.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.585 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.585 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:48.585 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192835+0000", 2024-09-12T16:16:48.585 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5101000000000001e-05 2024-09-12T16:16:48.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.585 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.585 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:48.585 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192904+0000", 2024-09-12T16:16:48.585 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9023000000000006e-05 2024-09-12T16:16:48.585 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.585 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:48.585 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.585 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.586 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3705 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14812160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:48.586 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:16:48.586 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.43502415, 2024-09-12T16:16:48.586 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053368831999999998, 2024-09-12T16:16:48.586 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:48.586 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:48.586 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:48.586 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:48.586 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:48.586 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:48.586 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3705 2024-09-12T16:16:48.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.586 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:48.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.586 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:48.586 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:16:48.587 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.587 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:48.587 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:16:48.587 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.587 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:48.587 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139932+0000", 2024-09-12T16:16:48.587 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012762099999999999 2024-09-12T16:16:48.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.587 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:48.587 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139935+0000", 2024-09-12T16:16:48.588 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.119e-06 2024-09-12T16:16:48.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.588 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.588 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:48.588 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139939+0000", 2024-09-12T16:16:48.588 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7999999999999998e-06 2024-09-12T16:16:48.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.588 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.588 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:48.588 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139953+0000", 2024-09-12T16:16:48.588 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3923999999999999e-05 2024-09-12T16:16:48.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.588 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.588 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:48.588 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192946+0000", 2024-09-12T16:16:48.589 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052992971 2024-09-12T16:16:48.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.589 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:48.589 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193035+0000", 2024-09-12T16:16:48.589 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9040000000000001e-05 2024-09-12T16:16:48.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.589 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:48.589 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193174+0000", 2024-09-12T16:16:48.589 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138357 2024-09-12T16:16:48.589 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.589 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:48.589 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.590 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.590 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3706 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14816256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:48.590 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:16:48.590 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.434869160000002, 2024-09-12T16:16:48.590 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053341723000000001, 2024-09-12T16:16:48.590 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:48.590 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:48.590 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:48.590 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:48.591 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:48.591 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:48.591 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3706 2024-09-12T16:16:48.591 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.591 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:48.592 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.592 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:48.592 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:16:48.592 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.592 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.592 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.592 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:48.592 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:16:48.592 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.592 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.592 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.593 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:48.593 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140090+0000", 2024-09-12T16:16:48.593 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013020100000000001 2024-09-12T16:16:48.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.593 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.593 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:48.593 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140097+0000", 2024-09-12T16:16:48.593 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0709999999999997e-06 2024-09-12T16:16:48.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.593 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.593 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:48.593 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140103+0000", 2024-09-12T16:16:48.593 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5450000000000003e-06 2024-09-12T16:16:48.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.594 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.594 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:48.594 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140106+0000", 2024-09-12T16:16:48.594 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3739999999999998e-06 2024-09-12T16:16:48.594 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.594 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.594 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:48.594 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193190+0000", 2024-09-12T16:16:48.594 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053084131999999999 2024-09-12T16:16:48.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.595 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.595 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:48.595 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193232+0000", 2024-09-12T16:16:48.595 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1517000000000002e-05 2024-09-12T16:16:48.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.595 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.595 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:48.595 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193302+0000", 2024-09-12T16:16:48.595 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9882999999999995e-05 2024-09-12T16:16:48.595 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.595 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:48.595 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.595 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.596 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3707 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14820352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:48.596 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:16:48.596 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.434717170999999, 2024-09-12T16:16:48.596 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053452771000000003, 2024-09-12T16:16:48.596 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:48.596 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:48.596 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:48.596 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:48.596 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:48.596 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:48.596 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3707 2024-09-12T16:16:48.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.596 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:48.596 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.596 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:48.597 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:16:48.597 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.597 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.597 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:48.597 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:16:48.597 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.597 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.597 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:48.597 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140219+0000", 2024-09-12T16:16:48.597 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106902 2024-09-12T16:16:48.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.597 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.598 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:48.598 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140225+0000", 2024-09-12T16:16:48.598 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3199999999999996e-06 2024-09-12T16:16:48.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.598 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:48.598 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140230+0000", 2024-09-12T16:16:48.598 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8969999999999999e-06 2024-09-12T16:16:48.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.598 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:48.598 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140233+0000", 2024-09-12T16:16:48.598 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2119999999999999e-06 2024-09-12T16:16:48.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.599 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.599 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:48.599 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193339+0000", 2024-09-12T16:16:48.599 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053105556999999998 2024-09-12T16:16:48.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.599 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.599 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:48.599 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193431+0000", 2024-09-12T16:16:48.599 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1837999999999997e-05 2024-09-12T16:16:48.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.599 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.599 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:48.599 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193565+0000", 2024-09-12T16:16:48.600 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013404500000000001 2024-09-12T16:16:48.600 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.600 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:48.600 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.600 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.600 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3708 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14824448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:48.600 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:16:48.600 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.434588329, 2024-09-12T16:16:48.600 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053468190999999998, 2024-09-12T16:16:48.600 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:48.600 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:48.600 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:48.600 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:48.600 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:48.601 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:48.601 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3708 2024-09-12T16:16:48.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.601 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:48.601 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.601 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:48.601 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:16:48.601 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.601 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.601 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:48.601 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:16:48.601 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.602 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.602 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:48.602 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140351+0000", 2024-09-12T16:16:48.602 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110096 2024-09-12T16:16:48.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.602 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.602 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:48.602 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140358+0000", 2024-09-12T16:16:48.602 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.306e-06 2024-09-12T16:16:48.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.602 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.602 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:48.603 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140368+0000", 2024-09-12T16:16:48.603 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0225e-05 2024-09-12T16:16:48.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.603 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.603 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:48.603 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140372+0000", 2024-09-12T16:16:48.603 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6169999999999998e-06 2024-09-12T16:16:48.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.603 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.603 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:48.603 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193594+0000", 2024-09-12T16:16:48.603 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053222419999999999 2024-09-12T16:16:48.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.603 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.603 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:48.603 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193640+0000", 2024-09-12T16:16:48.604 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.587e-05 2024-09-12T16:16:48.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.604 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.604 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:48.604 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193709+0000", 2024-09-12T16:16:48.604 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8657000000000004e-05 2024-09-12T16:16:48.604 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.604 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:48.604 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.604 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.604 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3709 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14828544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:48.604 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:16:48.604 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.434451361000001, 2024-09-12T16:16:48.605 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594033999999999, 2024-09-12T16:16:48.605 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:48.605 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:48.605 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:48.605 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:48.605 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:48.605 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:48.605 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3709 2024-09-12T16:16:48.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.605 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:48.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.605 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:48.605 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:16:48.605 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.606 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:48.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:16:48.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.606 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:48.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140499+0000", 2024-09-12T16:16:48.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121019 2024-09-12T16:16:48.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.606 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:48.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140501+0000", 2024-09-12T16:16:48.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2369999999999999e-06 2024-09-12T16:16:48.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.607 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:48.607 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140506+0000", 2024-09-12T16:16:48.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.639e-06 2024-09-12T16:16:48.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.607 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:48.607 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140509+0000", 2024-09-12T16:16:48.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3419999999999999e-06 2024-09-12T16:16:48.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.607 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:48.607 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193743+0000", 2024-09-12T16:16:48.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053234311999999999 2024-09-12T16:16:48.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.608 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:48.608 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193833+0000", 2024-09-12T16:16:48.608 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9883999999999995e-05 2024-09-12T16:16:48.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.608 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:48.608 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193972+0000", 2024-09-12T16:16:48.608 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138601 2024-09-12T16:16:48.608 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.608 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:48.609 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.609 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.609 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3710 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14832640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:48.609 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:16:48.609 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.434314014999998, 2024-09-12T16:16:48.609 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053607324999999997, 2024-09-12T16:16:48.609 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:48.609 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:48.609 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:48.609 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:48.609 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:48.609 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:48.609 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3710 2024-09-12T16:16:48.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.610 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:48.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.610 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:48.610 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:16:48.610 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.612 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:48.612 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:16:48.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.612 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:48.612 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140664+0000", 2024-09-12T16:16:48.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014918700000000001 2024-09-12T16:16:48.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.612 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:48.612 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140674+0000", 2024-09-12T16:16:48.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8379999999999997e-06 2024-09-12T16:16:48.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.613 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:48.613 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140694+0000", 2024-09-12T16:16:48.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0145000000000001e-05 2024-09-12T16:16:48.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.613 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:48.613 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140703+0000", 2024-09-12T16:16:48.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5150000000000006e-06 2024-09-12T16:16:48.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.613 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:48.613 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194006+0000", 2024-09-12T16:16:48.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053303370000000003 2024-09-12T16:16:48.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.614 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:48.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194051+0000", 2024-09-12T16:16:48.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5012000000000002e-05 2024-09-12T16:16:48.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.614 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:48.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194122+0000", 2024-09-12T16:16:48.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1258000000000001e-05 2024-09-12T16:16:48.614 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.614 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:48.614 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.615 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3711 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14836736~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:48.615 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:16:48.615 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.434112567, 2024-09-12T16:16:48.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053670799999999998, 2024-09-12T16:16:48.615 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:48.615 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:48.615 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:48.615 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:48.615 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:48.615 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:48.615 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3711 2024-09-12T16:16:48.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.615 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:48.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:48.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:16:48.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:48.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:16:48.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:48.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140782+0000", 2024-09-12T16:16:48.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5549999999999994e-05 2024-09-12T16:16:48.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:48.617 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140786+0000", 2024-09-12T16:16:48.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.89e-06 2024-09-12T16:16:48.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:48.617 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140796+0000", 2024-09-12T16:16:48.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0057e-05 2024-09-12T16:16:48.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:48.617 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140819+0000", 2024-09-12T16:16:48.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3005000000000001e-05 2024-09-12T16:16:48.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:48.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194159+0000", 2024-09-12T16:16:48.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053340324000000001 2024-09-12T16:16:48.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.618 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:48.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194248+0000", 2024-09-12T16:16:48.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9209000000000006e-05 2024-09-12T16:16:48.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.618 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:48.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194387+0000", 2024-09-12T16:16:48.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138765 2024-09-12T16:16:48.618 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.618 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:48.619 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.619 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3712 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14840832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:48.619 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:16:48.619 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.433998109000001, 2024-09-12T16:16:48.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053699068000000003, 2024-09-12T16:16:48.619 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:48.619 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:48.619 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:48.619 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:48.619 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:48.620 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:48.620 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3712 2024-09-12T16:16:48.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.620 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:48.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:48.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:16:48.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:48.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:16:48.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:48.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140900+0000", 2024-09-12T16:16:48.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9014e-05 2024-09-12T16:16:48.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:48.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140904+0000", 2024-09-12T16:16:48.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0940000000000001e-06 2024-09-12T16:16:48.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:48.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140933+0000", 2024-09-12T16:16:48.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8996000000000002e-05 2024-09-12T16:16:48.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:48.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140945+0000", 2024-09-12T16:16:48.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1909000000000001e-05 2024-09-12T16:16:48.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:48.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194415+0000", 2024-09-12T16:16:48.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053470403 2024-09-12T16:16:48.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:48.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194460+0000", 2024-09-12T16:16:48.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5145000000000002e-05 2024-09-12T16:16:48.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:48.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194530+0000", 2024-09-12T16:16:48.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9506999999999997e-05 2024-09-12T16:16:48.623 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.623 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:48.623 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.624 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3713 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14844928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:48.624 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:16:48.624 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.433865049000001, 2024-09-12T16:16:48.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053821236000000001, 2024-09-12T16:16:48.624 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:48.624 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:48.624 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:48.624 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:48.624 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:48.624 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:48.624 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3713 2024-09-12T16:16:48.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.625 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:48.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:48.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:16:48.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:48.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:16:48.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:48.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141078+0000", 2024-09-12T16:16:48.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114162 2024-09-12T16:16:48.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:48.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141090+0000", 2024-09-12T16:16:48.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.19e-05 2024-09-12T16:16:48.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:48.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141100+0000", 2024-09-12T16:16:48.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0447e-05 2024-09-12T16:16:48.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:48.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141108+0000", 2024-09-12T16:16:48.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7190000000000001e-06 2024-09-12T16:16:48.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:48.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194564+0000", 2024-09-12T16:16:48.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053455729 2024-09-12T16:16:48.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:48.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194652+0000", 2024-09-12T16:16:48.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8288999999999994e-05 2024-09-12T16:16:48.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:48.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194785+0000", 2024-09-12T16:16:48.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013299000000000001 2024-09-12T16:16:48.627 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.627 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:48.628 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.628 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3714 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14849024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:48.628 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:16:48.628 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.43370912, 2024-09-12T16:16:48.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053816382000000003, 2024-09-12T16:16:48.628 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:48.628 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:48.628 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:48.628 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:48.628 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:48.628 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:48.628 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3714 2024-09-12T16:16:48.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.629 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:48.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:48.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:16:48.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:48.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:16:48.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:48.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141182+0000", 2024-09-12T16:16:48.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1805999999999997e-05 2024-09-12T16:16:48.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:48.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141185+0000", 2024-09-12T16:16:48.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5930000000000002e-06 2024-09-12T16:16:48.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:48.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141194+0000", 2024-09-12T16:16:48.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5760000000000006e-06 2024-09-12T16:16:48.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:48.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141222+0000", 2024-09-12T16:16:48.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8034999999999998e-05 2024-09-12T16:16:48.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:48.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194817+0000", 2024-09-12T16:16:48.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594887000000001 2024-09-12T16:16:48.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:48.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194860+0000", 2024-09-12T16:16:48.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3714999999999997e-05 2024-09-12T16:16:48.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:48.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194936+0000", 2024-09-12T16:16:48.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5770000000000001e-05 2024-09-12T16:16:48.632 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.632 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:48.632 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.633 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3715 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14853120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:48.633 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:16:48.633 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.433585463, 2024-09-12T16:16:48.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053962307000000001, 2024-09-12T16:16:48.633 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:48.633 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:48.633 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:48.633 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:48.633 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:48.633 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:48.633 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3715 2024-09-12T16:16:48.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.633 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:48.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:48.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:16:48.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:48.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:16:48.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:48.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141417+0000", 2024-09-12T16:16:48.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017384099999999999 2024-09-12T16:16:48.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:48.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141422+0000", 2024-09-12T16:16:48.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7310000000000001e-06 2024-09-12T16:16:48.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:48.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141434+0000", 2024-09-12T16:16:48.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2058e-05 2024-09-12T16:16:48.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:48.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141442+0000", 2024-09-12T16:16:48.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7610000000000007e-06 2024-09-12T16:16:48.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:48.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194973+0000", 2024-09-12T16:16:48.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053530618000000002 2024-09-12T16:16:48.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:48.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195063+0000", 2024-09-12T16:16:48.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0927000000000005e-05 2024-09-12T16:16:48.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:48.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195206+0000", 2024-09-12T16:16:48.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142371 2024-09-12T16:16:48.637 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.637 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:48.637 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.637 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3716 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14857216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:48.637 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:16:48.637 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.433375612999999, 2024-09-12T16:16:48.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053916360000000003, 2024-09-12T16:16:48.638 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:48.638 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:48.638 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:48.638 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:48.638 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:48.638 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:48.638 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3716 2024-09-12T16:16:48.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.638 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:48.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:48.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:16:48.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:48.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:16:48.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:48.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142933+0000", 2024-09-12T16:16:48.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014796290000000001 2024-09-12T16:16:48.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:48.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142937+0000", 2024-09-12T16:16:48.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5760000000000002e-06 2024-09-12T16:16:48.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:48.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142946+0000", 2024-09-12T16:16:48.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0380000000000005e-06 2024-09-12T16:16:48.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:48.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142951+0000", 2024-09-12T16:16:48.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9749999999999998e-06 2024-09-12T16:16:48.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:48.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195246+0000", 2024-09-12T16:16:48.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052295358 2024-09-12T16:16:48.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:48.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195299+0000", 2024-09-12T16:16:48.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2976999999999998e-05 2024-09-12T16:16:48.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:48.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195370+0000", 2024-09-12T16:16:48.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0807000000000002e-05 2024-09-12T16:16:48.644 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.644 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:48.644 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.644 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3721 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14877696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:48.644 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:16:48.644 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.431802162, 2024-09-12T16:16:48.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053422994000000001, 2024-09-12T16:16:48.644 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:48.644 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:48.644 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:48.644 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:48.644 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:48.645 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:48.645 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3721 2024-09-12T16:16:48.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.645 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:48.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:48.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:16:48.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:48.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:16:48.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:48.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:16:48.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:16:48.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:48.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143028+0000", 2024-09-12T16:16:48.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7399999999999991e-07 2024-09-12T16:16:48.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:48.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143031+0000", 2024-09-12T16:16:48.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7599999999999998e-06 2024-09-12T16:16:48.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:48.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143034+0000", 2024-09-12T16:16:48.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9780000000000001e-06 2024-09-12T16:16:48.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:48.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196220+0000", 2024-09-12T16:16:48.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053186341999999998 2024-09-12T16:16:48.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:48.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196313+0000", 2024-09-12T16:16:48.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2676000000000005e-05 2024-09-12T16:16:48.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:48.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196450+0000", 2024-09-12T16:16:48.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137052 2024-09-12T16:16:48.648 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.648 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:48.648 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.649 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3722 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14881792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:48.649 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:16:48.649 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.431792269999999, 2024-09-12T16:16:48.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053556835999999997, 2024-09-12T16:16:48.649 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:48.649 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:48.649 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:48.649 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:48.649 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:48.649 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:48.649 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3722 2024-09-12T16:16:48.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.649 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:48.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:48.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:16:48.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:48.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:16:48.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:48.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:16:48.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.11e-07 2024-09-12T16:16:48.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:48.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143038+0000", 2024-09-12T16:16:48.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2399999999999996e-07 2024-09-12T16:16:48.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:48.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143041+0000", 2024-09-12T16:16:48.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8030000000000001e-06 2024-09-12T16:16:48.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:48.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143043+0000", 2024-09-12T16:16:48.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3140000000000002e-06 2024-09-12T16:16:48.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:48.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196481+0000", 2024-09-12T16:16:48.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053437601000000001 2024-09-12T16:16:48.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:48.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196525+0000", 2024-09-12T16:16:48.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4280000000000003e-05 2024-09-12T16:16:48.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:48.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196594+0000", 2024-09-12T16:16:48.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8702999999999996e-05 2024-09-12T16:16:48.653 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.653 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:48.653 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.653 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3723 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14885888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:48.653 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:16:48.653 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.431783088, 2024-09-12T16:16:48.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053815546999999998, 2024-09-12T16:16:48.653 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:48.653 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:48.654 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:48.654 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:48.654 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:48.654 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:48.654 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3723 2024-09-12T16:16:48.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.654 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:48.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:48.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:16:48.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:48.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:16:48.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:48.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148994+0000", 2024-09-12T16:16:48.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059481330000000004 2024-09-12T16:16:48.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:48.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148999+0000", 2024-09-12T16:16:48.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7140000000000001e-06 2024-09-12T16:16:48.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:48.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149008+0000", 2024-09-12T16:16:48.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4350000000000003e-06 2024-09-12T16:16:48.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:48.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149021+0000", 2024-09-12T16:16:48.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2514000000000001e-05 2024-09-12T16:16:48.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:48.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196630+0000", 2024-09-12T16:16:48.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047609758000000002 2024-09-12T16:16:48.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:48.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196724+0000", 2024-09-12T16:16:48.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3522000000000003e-05 2024-09-12T16:16:48.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:48.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196861+0000", 2024-09-12T16:16:48.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013747100000000001 2024-09-12T16:16:48.657 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.657 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:48.658 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.658 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4438 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15719424~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:48.658 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:16:48.658 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.286902310999999, 2024-09-12T16:16:48.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367981000000002, 2024-09-12T16:16:48.658 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:48.658 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:48.658 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:48.658 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:48.658 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:48.659 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:48.659 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4438 2024-09-12T16:16:48.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.659 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:48.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:48.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:16:48.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:48.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:16:48.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:48.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:16:48.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3e-07 2024-09-12T16:16:48.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:48.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287930+0000", 2024-09-12T16:16:48.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-12T16:16:48.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:48.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287937+0000", 2024-09-12T16:16:48.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.08e-06 2024-09-12T16:16:48.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:48.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287943+0000", 2024-09-12T16:16:48.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5709999999999997e-06 2024-09-12T16:16:48.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:48.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341068+0000", 2024-09-12T16:16:48.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053125101000000001 2024-09-12T16:16:48.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:48.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341154+0000", 2024-09-12T16:16:48.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6100999999999994e-05 2024-09-12T16:16:48.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:48.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341295+0000", 2024-09-12T16:16:48.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014087999999999999 2024-09-12T16:16:48.663 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.663 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:48.663 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.663 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4439 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15723520~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:48.663 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:16:48.663 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.286878151, 2024-09-12T16:16:48.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053526799, 2024-09-12T16:16:48.663 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:48.664 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:48.664 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:48.664 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:48.664 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:48.664 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:48.664 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4439 2024-09-12T16:16:48.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.664 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:48.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:48.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:16:48.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:48.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:16:48.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:48.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:16:48.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-07 2024-09-12T16:16:48.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:48.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287953+0000", 2024-09-12T16:16:48.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1349999999999999e-06 2024-09-12T16:16:48.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:48.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287960+0000", 2024-09-12T16:16:48.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-12T16:16:48.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:48.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287965+0000", 2024-09-12T16:16:48.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1580000000000004e-06 2024-09-12T16:16:48.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:48.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341332+0000", 2024-09-12T16:16:48.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367009 2024-09-12T16:16:48.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:48.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341402+0000", 2024-09-12T16:16:48.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9759999999999996e-05 2024-09-12T16:16:48.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:48.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341478+0000", 2024-09-12T16:16:48.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5412000000000002e-05 2024-09-12T16:16:48.668 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.668 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:48.669 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.669 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4440 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15727616~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:48.670 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:16:48.670 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.286857047000002, 2024-09-12T16:16:48.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053761601999999999, 2024-09-12T16:16:48.670 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:48.670 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:48.670 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:48.671 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:48.671 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:48.671 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:48.671 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4440 2024-09-12T16:16:48.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.671 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:48.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:48.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:16:48.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:48.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:16:48.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:48.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:48.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:16:48.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:16:48.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:48.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287974+0000", 2024-09-12T16:16:48.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0540000000000002e-06 2024-09-12T16:16:48.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:48.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287980+0000", 2024-09-12T16:16:48.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9440000000000002e-06 2024-09-12T16:16:48.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:48.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287987+0000", 2024-09-12T16:16:48.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5889999999999999e-06 2024-09-12T16:16:48.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:48.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341502+0000", 2024-09-12T16:16:48.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053515199999999999 2024-09-12T16:16:48.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:48.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341595+0000", 2024-09-12T16:16:48.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3097000000000007e-05 2024-09-12T16:16:48.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:48.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:48.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:48.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341734+0000", 2024-09-12T16:16:48.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013832800000000001 2024-09-12T16:16:48.674 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.674 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:48.674 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.674 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:48.674 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:48.675 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:48.676 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:16:48.676 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:48.675+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:48.777 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:48.775+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:48.823 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:48.824 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:48.824 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:16:48.824 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:48.832 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:16:48.878 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:48.877+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:48.938 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:48.939 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:48.939 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:16:48.939 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:16:48.939 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:48.947 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:16:48.990 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:48.990+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:49.049 INFO:teuthology.orchestra.run.smithi204.stdout:2833 write 0xbb58200 thru 0xbb5de52 (0x5c53 bytes) 2024-09-12T16:16:49.055 INFO:teuthology.orchestra.run.smithi204.stdout:2836 write 0x5aa5800 thru 0x5aa78c0 (0x20c1 bytes) 2024-09-12T16:16:49.055 INFO:teuthology.orchestra.run.smithi204.stdout:2837 read 0x22fe600 thru 0x230df52 (0xf953 bytes) 2024-09-12T16:16:49.055 INFO:teuthology.orchestra.run.smithi204.stdout:2839 read 0x1cec400 thru 0x1cee811 (0x2412 bytes) 2024-09-12T16:16:49.055 INFO:teuthology.orchestra.run.smithi204.stdout:2840 read 0x8d45000 thru 0x8d4ca6f (0x7a70 bytes) 2024-09-12T16:16:49.055 INFO:teuthology.orchestra.run.smithi204.stdout:2842 punch from 0x3573e00 to 0x3576200, (0x2400 bytes) 2024-09-12T16:16:49.056 INFO:teuthology.orchestra.run.smithi204.stdout:2843 punch from 0xb165800 to 0xb171200, (0xba00 bytes) 2024-09-12T16:16:49.056 INFO:teuthology.orchestra.run.smithi204.stdout:2844 read 0x939fe00 thru 0x93af638 (0xf839 bytes) 2024-09-12T16:16:49.056 INFO:teuthology.orchestra.run.smithi204.stdout:2847 read 0xaf7c000 thru 0xaf82ffe (0x6fff bytes) 2024-09-12T16:16:49.066 INFO:teuthology.orchestra.run.smithi204.stdout:2848 trunc from 0xbb5e000 to 0x40ea200 2024-09-12T16:16:49.067 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:49.067 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:16:49.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:16:49.068 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:49.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.068 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2299 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12368896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:49.068 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896004+0000", 2024-09-12T16:16:49.068 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.170359718, 2024-09-12T16:16:49.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037218257999999997, 2024-09-12T16:16:49.068 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.068 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.068 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.068 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.068 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:49.068 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:49.069 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2299 2024-09-12T16:16:49.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.069 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896004+0000", 2024-09-12T16:16:49.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896004+0000", 2024-09-12T16:16:49.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896005+0000", 2024-09-12T16:16:49.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3700000000000001e-07 2024-09-12T16:16:49.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896006+0000", 2024-09-12T16:16:49.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9929999999999998e-06 2024-09-12T16:16:49.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896013+0000", 2024-09-12T16:16:49.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1709999999999999e-06 2024-09-12T16:16:49.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896017+0000", 2024-09-12T16:16:49.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5050000000000001e-06 2024-09-12T16:16:49.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933142+0000", 2024-09-12T16:16:49.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037125012999999998 2024-09-12T16:16:49.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933182+0000", 2024-09-12T16:16:49.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9957999999999999e-05 2024-09-12T16:16:49.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933222+0000", 2024-09-12T16:16:49.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0181e-05 2024-09-12T16:16:49.072 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.072 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.072 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.072 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2300 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12372992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:49.072 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:16:49.073 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.170340061000001, 2024-09-12T16:16:49.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037401246999999999, 2024-09-12T16:16:49.073 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.073 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.073 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.073 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.073 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:49.073 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:49.073 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2300 2024-09-12T16:16:49.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.073 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:16:49.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:16:49.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:16:49.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6100000000000002e-07 2024-09-12T16:16:49.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896026+0000", 2024-09-12T16:16:49.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9130000000000001e-06 2024-09-12T16:16:49.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896032+0000", 2024-09-12T16:16:49.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7540000000000003e-06 2024-09-12T16:16:49.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896036+0000", 2024-09-12T16:16:49.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5750000000000002e-06 2024-09-12T16:16:49.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.076 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.076 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933254+0000", 2024-09-12T16:16:49.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037217962 2024-09-12T16:16:49.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.076 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.076 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933341+0000", 2024-09-12T16:16:49.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6296000000000002e-05 2024-09-12T16:16:49.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933425+0000", 2024-09-12T16:16:49.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4386000000000001e-05 2024-09-12T16:16:49.077 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.077 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.077 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.077 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2301 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12377088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:49.077 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896043+0000", 2024-09-12T16:16:49.077 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.170320318999998, 2024-09-12T16:16:49.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037486197999999998, 2024-09-12T16:16:49.077 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.078 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.078 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.078 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.078 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:49.078 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:49.078 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2301 2024-09-12T16:16:49.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.078 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896043+0000", 2024-09-12T16:16:49.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896043+0000", 2024-09-12T16:16:49.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896044+0000", 2024-09-12T16:16:49.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.41e-07 2024-09-12T16:16:49.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896053+0000", 2024-09-12T16:16:49.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8049999999999996e-06 2024-09-12T16:16:49.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896060+0000", 2024-09-12T16:16:49.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.221e-06 2024-09-12T16:16:49.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896065+0000", 2024-09-12T16:16:49.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1109999999999999e-06 2024-09-12T16:16:49.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933452+0000", 2024-09-12T16:16:49.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037386560999999999 2024-09-12T16:16:49.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.081 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.081 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933491+0000", 2024-09-12T16:16:49.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9789000000000001e-05 2024-09-12T16:16:49.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.081 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.081 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933530+0000", 2024-09-12T16:16:49.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.837e-05 2024-09-12T16:16:49.081 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.081 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.081 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.082 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2302 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12381184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:49.082 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:16:49.082 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.170278879000001, 2024-09-12T16:16:49.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037645284000000001, 2024-09-12T16:16:49.082 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.082 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.082 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.082 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.082 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:49.082 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:49.082 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2302 2024-09-12T16:16:49.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.082 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:16:49.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:16:49.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:16:49.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6800000000000001e-07 2024-09-12T16:16:49.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896088+0000", 2024-09-12T16:16:49.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3429999999999998e-06 2024-09-12T16:16:49.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896096+0000", 2024-09-12T16:16:49.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0860000000000002e-06 2024-09-12T16:16:49.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896102+0000", 2024-09-12T16:16:49.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7610000000000004e-06 2024-09-12T16:16:49.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933563+0000", 2024-09-12T16:16:49.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037461019999999998 2024-09-12T16:16:49.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933648+0000", 2024-09-12T16:16:49.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5468000000000002e-05 2024-09-12T16:16:49.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933730+0000", 2024-09-12T16:16:49.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2138000000000005e-05 2024-09-12T16:16:49.085 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.086 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.086 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.086 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2303 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12385280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:49.086 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:16:49.086 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.170255077, 2024-09-12T16:16:49.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037723083999999997, 2024-09-12T16:16:49.086 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.086 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.086 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.086 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.086 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:49.086 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:49.086 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2303 2024-09-12T16:16:49.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.087 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:16:49.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:16:49.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:16:49.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2500000000000001e-07 2024-09-12T16:16:49.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896115+0000", 2024-09-12T16:16:49.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.28e-06 2024-09-12T16:16:49.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896122+0000", 2024-09-12T16:16:49.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4590000000000003e-06 2024-09-12T16:16:49.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896127+0000", 2024-09-12T16:16:49.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0509999999999996e-06 2024-09-12T16:16:49.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933755+0000", 2024-09-12T16:16:49.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037627729999999998 2024-09-12T16:16:49.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933794+0000", 2024-09-12T16:16:49.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9255000000000003e-05 2024-09-12T16:16:49.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933832+0000", 2024-09-12T16:16:49.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7883999999999998e-05 2024-09-12T16:16:49.090 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.090 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.090 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.090 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2304 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12389376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:49.090 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:16:49.090 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.170229727999999, 2024-09-12T16:16:49.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037911010000000002, 2024-09-12T16:16:49.090 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.090 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.090 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.091 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.091 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:49.091 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:49.091 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2304 2024-09-12T16:16:49.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.091 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:16:49.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:16:49.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:16:49.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9900000000000001e-07 2024-09-12T16:16:49.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896136+0000", 2024-09-12T16:16:49.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.897e-06 2024-09-12T16:16:49.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896142+0000", 2024-09-12T16:16:49.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9290000000000003e-06 2024-09-12T16:16:49.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896154+0000", 2024-09-12T16:16:49.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.201e-05 2024-09-12T16:16:49.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933865+0000", 2024-09-12T16:16:49.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037710225 2024-09-12T16:16:49.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933961+0000", 2024-09-12T16:16:49.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6315000000000002e-05 2024-09-12T16:16:49.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934045+0000", 2024-09-12T16:16:49.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4234999999999996e-05 2024-09-12T16:16:49.094 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.094 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.094 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.094 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2305 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12393472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:49.095 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896175+0000", 2024-09-12T16:16:49.095 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.170188538000001, 2024-09-12T16:16:49.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037976941, 2024-09-12T16:16:49.095 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.095 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.095 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.095 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.095 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:49.095 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:49.095 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2305 2024-09-12T16:16:49.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.095 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.095 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896175+0000", 2024-09-12T16:16:49.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.096 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.096 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896175+0000", 2024-09-12T16:16:49.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.096 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.096 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896176+0000", 2024-09-12T16:16:49.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7400000000000003e-07 2024-09-12T16:16:49.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.096 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.096 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896178+0000", 2024-09-12T16:16:49.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6709999999999999e-06 2024-09-12T16:16:49.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896186+0000", 2024-09-12T16:16:49.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9319999999999996e-06 2024-09-12T16:16:49.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896192+0000", 2024-09-12T16:16:49.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0799999999999996e-06 2024-09-12T16:16:49.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934072+0000", 2024-09-12T16:16:49.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037880888000000001 2024-09-12T16:16:49.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934113+0000", 2024-09-12T16:16:49.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0815999999999997e-05 2024-09-12T16:16:49.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934152+0000", 2024-09-12T16:16:49.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8980000000000003e-05 2024-09-12T16:16:49.098 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.098 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.099 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.099 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2306 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12397568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:49.099 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:16:49.099 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.17016426, 2024-09-12T16:16:49.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038156347, 2024-09-12T16:16:49.099 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.099 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.099 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.099 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.099 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:49.099 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:49.100 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2306 2024-09-12T16:16:49.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.100 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:16:49.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:16:49.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:16:49.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.77e-07 2024-09-12T16:16:49.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896202+0000", 2024-09-12T16:16:49.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2359999999999999e-06 2024-09-12T16:16:49.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896208+0000", 2024-09-12T16:16:49.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1430000000000003e-06 2024-09-12T16:16:49.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896213+0000", 2024-09-12T16:16:49.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9339999999999997e-06 2024-09-12T16:16:49.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934188+0000", 2024-09-12T16:16:49.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037974490999999999 2024-09-12T16:16:49.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934275+0000", 2024-09-12T16:16:49.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7639999999999994e-05 2024-09-12T16:16:49.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934356+0000", 2024-09-12T16:16:49.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0525999999999994e-05 2024-09-12T16:16:49.103 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.103 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.103 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.103 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2307 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12401664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:49.103 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:16:49.103 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.170144487999998, 2024-09-12T16:16:49.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038241450000000003, 2024-09-12T16:16:49.104 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.104 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.104 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.104 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.104 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:49.104 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:49.104 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2307 2024-09-12T16:16:49.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.104 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.104 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.104 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:16:49.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.105 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:16:49.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.105 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896220+0000", 2024-09-12T16:16:49.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3500000000000002e-07 2024-09-12T16:16:49.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.105 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896222+0000", 2024-09-12T16:16:49.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1720000000000001e-06 2024-09-12T16:16:49.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896228+0000", 2024-09-12T16:16:49.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0870000000000003e-06 2024-09-12T16:16:49.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896233+0000", 2024-09-12T16:16:49.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:16:49.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934382+0000", 2024-09-12T16:16:49.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038149566000000003 2024-09-12T16:16:49.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934422+0000", 2024-09-12T16:16:49.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0015999999999998e-05 2024-09-12T16:16:49.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934461+0000", 2024-09-12T16:16:49.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8423999999999997e-05 2024-09-12T16:16:49.107 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.107 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.107 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.107 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2308 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12405760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:49.107 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:16:49.108 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.170124790999999, 2024-09-12T16:16:49.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038420745999999999, 2024-09-12T16:16:49.108 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.108 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.108 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.108 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.108 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:49.108 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:49.108 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2308 2024-09-12T16:16:49.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.108 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:16:49.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:16:49.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:16:49.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.58e-07 2024-09-12T16:16:49.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896241+0000", 2024-09-12T16:16:49.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7940000000000001e-06 2024-09-12T16:16:49.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896247+0000", 2024-09-12T16:16:49.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1460000000000001e-06 2024-09-12T16:16:49.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896252+0000", 2024-09-12T16:16:49.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6840000000000004e-06 2024-09-12T16:16:49.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934494+0000", 2024-09-12T16:16:49.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038242362000000002 2024-09-12T16:16:49.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934579+0000", 2024-09-12T16:16:49.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5044999999999996e-05 2024-09-12T16:16:49.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934660+0000", 2024-09-12T16:16:49.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0357000000000003e-05 2024-09-12T16:16:49.111 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.111 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.112 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.112 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2309 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12409856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:49.112 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:16:49.112 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.170104211000002, 2024-09-12T16:16:49.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038504629999999998, 2024-09-12T16:16:49.112 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.112 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.112 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.112 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.112 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:49.113 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:49.113 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2309 2024-09-12T16:16:49.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.113 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:16:49.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:16:49.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:16:49.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5199999999999998e-07 2024-09-12T16:16:49.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896263+0000", 2024-09-12T16:16:49.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4209999999999999e-06 2024-09-12T16:16:49.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.115 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.115 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896269+0000", 2024-09-12T16:16:49.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9449999999999998e-06 2024-09-12T16:16:49.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.115 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.115 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896274+0000", 2024-09-12T16:16:49.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3950000000000003e-06 2024-09-12T16:16:49.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.115 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.115 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934686+0000", 2024-09-12T16:16:49.116 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038412333999999999 2024-09-12T16:16:49.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934727+0000", 2024-09-12T16:16:49.116 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0649999999999999e-05 2024-09-12T16:16:49.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934764+0000", 2024-09-12T16:16:49.116 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7533000000000001e-05 2024-09-12T16:16:49.116 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.116 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.116 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.117 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2310 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12413952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:49.117 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:16:49.117 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.170083339000001, 2024-09-12T16:16:49.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038694183, 2024-09-12T16:16:49.117 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.117 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.117 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.117 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.117 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:49.117 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:49.117 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2310 2024-09-12T16:16:49.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.118 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.118 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.118 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:16:49.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.118 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.118 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:16:49.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896281+0000", 2024-09-12T16:16:49.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1399999999999997e-07 2024-09-12T16:16:49.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896283+0000", 2024-09-12T16:16:49.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9549999999999999e-06 2024-09-12T16:16:49.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896289+0000", 2024-09-12T16:16:49.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8669999999999999e-06 2024-09-12T16:16:49.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.120 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.120 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896301+0000", 2024-09-12T16:16:49.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1807999999999999e-05 2024-09-12T16:16:49.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.120 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.120 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.120 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934798+0000", 2024-09-12T16:16:49.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038497591999999997 2024-09-12T16:16:49.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.120 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.120 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.120 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934885+0000", 2024-09-12T16:16:49.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7149000000000002e-05 2024-09-12T16:16:49.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934975+0000", 2024-09-12T16:16:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9297999999999998e-05 2024-09-12T16:16:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2311 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12418048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:16:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.170056082999999, 2024-09-12T16:16:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038768558000000002, 2024-09-12T16:16:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.122 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.122 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.122 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:49.122 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:49.122 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2311 2024-09-12T16:16:49.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.122 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:16:49.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:16:49.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:16:49.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.63e-07 2024-09-12T16:16:49.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896310+0000", 2024-09-12T16:16:49.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1560000000000002e-06 2024-09-12T16:16:49.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896316+0000", 2024-09-12T16:16:49.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0249999999999999e-06 2024-09-12T16:16:49.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.124 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.124 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896322+0000", 2024-09-12T16:16:49.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6400000000000002e-06 2024-09-12T16:16:49.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.124 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.124 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934997+0000", 2024-09-12T16:16:49.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038674565000000001 2024-09-12T16:16:49.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.124 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.124 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935037+0000", 2024-09-12T16:16:49.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0485999999999998e-05 2024-09-12T16:16:49.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.125 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935076+0000", 2024-09-12T16:16:49.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9223e-05 2024-09-12T16:16:49.125 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.125 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.125 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.125 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2312 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12422144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:49.125 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:16:49.125 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.170035389999999, 2024-09-12T16:16:49.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038856784999999998, 2024-09-12T16:16:49.126 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.126 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.126 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.126 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.126 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:49.126 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:49.126 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2312 2024-09-12T16:16:49.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.126 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.126 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.126 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:16:49.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.127 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.127 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:16:49.127 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.127 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.127 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896329+0000", 2024-09-12T16:16:49.127 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5499999999999999e-07 2024-09-12T16:16:49.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.127 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.127 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896337+0000", 2024-09-12T16:16:49.127 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0819999999999999e-06 2024-09-12T16:16:49.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.127 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896343+0000", 2024-09-12T16:16:49.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.263e-06 2024-09-12T16:16:49.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.128 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896348+0000", 2024-09-12T16:16:49.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8860000000000003e-06 2024-09-12T16:16:49.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.128 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935097+0000", 2024-09-12T16:16:49.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038748818999999997 2024-09-12T16:16:49.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.128 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.129 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935141+0000", 2024-09-12T16:16:49.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4175000000000003e-05 2024-09-12T16:16:49.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.129 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.129 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935185+0000", 2024-09-12T16:16:49.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4205000000000001e-05 2024-09-12T16:16:49.129 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.129 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.129 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.129 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2313 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12426240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:49.129 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:16:49.129 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.170009175000001, 2024-09-12T16:16:49.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038928683999999998, 2024-09-12T16:16:49.130 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.130 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.130 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.130 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.130 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:49.130 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:49.130 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2313 2024-09-12T16:16:49.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.130 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.130 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.130 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:16:49.130 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.131 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.131 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:16:49.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.131 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.131 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:16:49.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0400000000000002e-07 2024-09-12T16:16:49.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.131 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.131 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896357+0000", 2024-09-12T16:16:49.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.097e-06 2024-09-12T16:16:49.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.131 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896363+0000", 2024-09-12T16:16:49.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5119999999999999e-06 2024-09-12T16:16:49.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896374+0000", 2024-09-12T16:16:49.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1381e-05 2024-09-12T16:16:49.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935205+0000", 2024-09-12T16:16:49.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038830549999999998 2024-09-12T16:16:49.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.133 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.133 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935244+0000", 2024-09-12T16:16:49.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9520000000000001e-05 2024-09-12T16:16:49.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.133 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.133 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935283+0000", 2024-09-12T16:16:49.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9220000000000001e-05 2024-09-12T16:16:49.133 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.133 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.133 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.133 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2314 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12430336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:49.134 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:16:49.134 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.169972005000002, 2024-09-12T16:16:49.134 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039008137999999998, 2024-09-12T16:16:49.134 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.134 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.134 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.134 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.134 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:49.134 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:49.134 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2314 2024-09-12T16:16:49.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.134 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.135 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.135 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:16:49.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.135 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.135 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:16:49.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:16:49.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6499999999999999e-07 2024-09-12T16:16:49.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896395+0000", 2024-09-12T16:16:49.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2960000000000001e-06 2024-09-12T16:16:49.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896402+0000", 2024-09-12T16:16:49.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2280000000000001e-06 2024-09-12T16:16:49.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.137 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896407+0000", 2024-09-12T16:16:49.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3630000000000002e-06 2024-09-12T16:16:49.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.137 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935302+0000", 2024-09-12T16:16:49.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038895181000000001 2024-09-12T16:16:49.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.137 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935343+0000", 2024-09-12T16:16:49.138 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0590999999999998e-05 2024-09-12T16:16:49.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.138 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.138 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935400+0000", 2024-09-12T16:16:49.138 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7014e-05 2024-09-12T16:16:49.138 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.138 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.138 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.138 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2315 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12434432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:49.138 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:16:49.138 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.169949354, 2024-09-12T16:16:49.138 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039083892000000002, 2024-09-12T16:16:49.138 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.139 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.139 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.139 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.139 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:49.139 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:49.139 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2315 2024-09-12T16:16:49.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.139 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.139 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.139 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:16:49.139 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.139 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:16:49.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896415+0000", 2024-09-12T16:16:49.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3300000000000002e-07 2024-09-12T16:16:49.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896421+0000", 2024-09-12T16:16:49.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7579999999999998e-06 2024-09-12T16:16:49.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896427+0000", 2024-09-12T16:16:49.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3029999999999996e-06 2024-09-12T16:16:49.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.141 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896432+0000", 2024-09-12T16:16:49.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.215e-06 2024-09-12T16:16:49.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.141 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935420+0000", 2024-09-12T16:16:49.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038987727 2024-09-12T16:16:49.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.142 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.142 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935460+0000", 2024-09-12T16:16:49.142 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9817999999999997e-05 2024-09-12T16:16:49.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.142 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.142 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935498+0000", 2024-09-12T16:16:49.142 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8438e-05 2024-09-12T16:16:49.142 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.142 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.142 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.143 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.143 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2316 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12438528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:49.143 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:16:49.143 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.169924701999999, 2024-09-12T16:16:49.143 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039160043999999998, 2024-09-12T16:16:49.143 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.143 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.143 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.143 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.143 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:49.143 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:49.143 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2316 2024-09-12T16:16:49.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.143 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.143 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.144 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.144 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:16:49.144 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.144 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.144 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:16:49.144 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.144 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.145 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901945+0000", 2024-09-12T16:16:49.145 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055056050000000002 2024-09-12T16:16:49.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.145 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.145 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901950+0000", 2024-09-12T16:16:49.145 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2490000000000001e-06 2024-09-12T16:16:49.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.145 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.145 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901966+0000", 2024-09-12T16:16:49.145 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6325e-05 2024-09-12T16:16:49.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.146 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.146 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901974+0000", 2024-09-12T16:16:49.146 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7570000000000004e-06 2024-09-12T16:16:49.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.146 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.146 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935518+0000", 2024-09-12T16:16:49.146 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033543587999999999 2024-09-12T16:16:49.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.146 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.146 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935559+0000", 2024-09-12T16:16:49.146 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1746000000000003e-05 2024-09-12T16:16:49.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.147 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.147 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.147 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935599+0000", 2024-09-12T16:16:49.147 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9774000000000002e-05 2024-09-12T16:16:49.147 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.147 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.147 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.147 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.147 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1571 3.b 3:d046566d:::rbd_data.1155525b14e3.0000000000000001:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:16:49.147 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:16:49.147 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.9137996600000005, 2024-09-12T16:16:49.147 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064439785999999999, 2024-09-12T16:16:49.147 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.147 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.147 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.148 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.148 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:16:49.148 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:16:49.148 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1571 2024-09-12T16:16:49.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.148 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.148 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.148 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.148 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:16:49.148 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.148 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.148 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.148 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:16:49.148 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.149 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.149 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.149 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:16:49.149 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5400000000000002e-07 2024-09-12T16:16:49.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.149 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.149 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.149 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152567+0000", 2024-09-12T16:16:49.149 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.131e-06 2024-09-12T16:16:49.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.149 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.149 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.149 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152574+0000", 2024-09-12T16:16:49.149 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1840000000000002e-06 2024-09-12T16:16:49.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.150 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.150 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152579+0000", 2024-09-12T16:16:49.150 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.152e-06 2024-09-12T16:16:49.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.150 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.150 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153671+0000", 2024-09-12T16:16:49.150 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001092078 2024-09-12T16:16:49.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.150 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.150 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153779+0000", 2024-09-12T16:16:49.150 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108461 2024-09-12T16:16:49.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.151 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.151 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.151 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217004+0000", 2024-09-12T16:16:49.151 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.063224426 2024-09-12T16:16:49.151 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.151 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.151 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.151 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.151 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1581 3.4 3:22e34893:::rbd_data.1155525b14e3.0000000000000005:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:16:49.151 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:16:49.151 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.9137025349999996, 2024-09-12T16:16:49.151 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064484407999999993, 2024-09-12T16:16:49.151 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.152 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.152 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.152 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.152 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:16:49.152 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:16:49.152 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1581 2024-09-12T16:16:49.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.152 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.152 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.152 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.152 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:16:49.152 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.152 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.153 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.153 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:16:49.153 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.153 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.153 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.153 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152662+0000", 2024-09-12T16:16:49.153 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.65e-07 2024-09-12T16:16:49.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.153 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.153 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.153 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152664+0000", 2024-09-12T16:16:49.153 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9829999999999999e-06 2024-09-12T16:16:49.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.154 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.154 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.154 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152670+0000", 2024-09-12T16:16:49.154 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2260000000000002e-06 2024-09-12T16:16:49.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.154 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.154 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.154 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152675+0000", 2024-09-12T16:16:49.154 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7990000000000001e-06 2024-09-12T16:16:49.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.154 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.154 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.154 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.216945+0000", 2024-09-12T16:16:49.155 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064270341999999994 2024-09-12T16:16:49.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.155 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.155 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.155 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217040+0000", 2024-09-12T16:16:49.155 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5242999999999996e-05 2024-09-12T16:16:49.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.155 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.155 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.155 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217146+0000", 2024-09-12T16:16:49.155 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010545 2024-09-12T16:16:49.155 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.155 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.156 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.156 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.156 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.156 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:49.157 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:49.156+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:49.158 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:16:49.159 INFO:teuthology.orchestra.run.smithi204.stdout:2849 read 0x1ded400 thru 0x1df48d4 (0x74d5 bytes) 2024-09-12T16:16:49.159 INFO:teuthology.orchestra.run.smithi204.stdout:2850 punch from 0x2885600 to 0x288b800, (0x6200 bytes) 2024-09-12T16:16:49.159 INFO:teuthology.orchestra.run.smithi204.stdout:2851 write 0x759f800 thru 0x75a8e20 (0x9621 bytes) 2024-09-12T16:16:49.159 INFO:teuthology.orchestra.run.smithi204.stdout:2854 read 0x2fb9a00 thru 0x2fc9761 (0xfd62 bytes) 2024-09-12T16:16:49.159 INFO:teuthology.orchestra.run.smithi204.stdout:2855 read 0x2c4c00 thru 0x2ceb09 (0x9f0a bytes) 2024-09-12T16:16:49.159 INFO:teuthology.orchestra.run.smithi204.stdout:2856 read 0x176a000 thru 0x177955b (0xf55c bytes) 2024-09-12T16:16:49.159 INFO:teuthology.orchestra.run.smithi204.stdout:2859 write 0x7b50a00 thru 0x7b5e6b8 (0xdcb9 bytes) 2024-09-12T16:16:49.160 INFO:teuthology.orchestra.run.smithi204.stdout:2860 trunc from 0x7b5e800 to 0x3278000 2024-09-12T16:16:49.166 INFO:teuthology.orchestra.run.smithi204.stdout:2861 write 0x3db9a00 thru 0x3dbe244 (0x4845 bytes) 2024-09-12T16:16:49.166 INFO:teuthology.orchestra.run.smithi204.stdout:2862 read 0xb7d200 thru 0xb81dac (0x4bad bytes) 2024-09-12T16:16:49.167 INFO:teuthology.orchestra.run.smithi204.stdout:2865 read 0x2455e00 thru 0x2462d68 (0xcf69 bytes) 2024-09-12T16:16:49.167 INFO:teuthology.orchestra.run.smithi204.stdout:2867 punch from 0x110a000 to 0x1110e00, (0x6e00 bytes) 2024-09-12T16:16:49.167 INFO:teuthology.orchestra.run.smithi204.stdout:2869 punch from 0x30e8e00 to 0x30f6e00, (0xe000 bytes) 2024-09-12T16:16:49.168 INFO:teuthology.orchestra.run.smithi204.stdout:2870 read 0x2e44000 thru 0x2e487ee (0x47ef bytes) 2024-09-12T16:16:49.169 INFO:teuthology.orchestra.run.smithi204.stdout:2871 read 0x11f8200 thru 0x11f87c2 (0x5c3 bytes) 2024-09-12T16:16:49.169 INFO:teuthology.orchestra.run.smithi204.stdout:2872 punch from 0x268a400 to 0x2696200, (0xbe00 bytes) 2024-09-12T16:16:49.173 INFO:teuthology.orchestra.run.smithi204.stdout:2877 trunc from 0x3dbe400 to 0x76cae00 2024-09-12T16:16:49.182 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T16:16:49.182 INFO:teuthology.orchestra.run.smithi204.stdout:2878 read 0x11d3c00 thru 0x11d6b75 (0x2f76 bytes) 2024-09-12T16:16:49.199 INFO:teuthology.orchestra.run.smithi204.stdout:2882 write 0xd4aca00 thru 0xd4b2a57 (0x6058 bytes) 2024-09-12T16:16:49.201 INFO:teuthology.orchestra.run.smithi204.stdout:2883 read 0x95b3600 thru 0x95c1e6c (0xe86d bytes) 2024-09-12T16:16:49.201 INFO:teuthology.orchestra.run.smithi204.stdout:2884 read 0x746de00 thru 0x747ac2c (0xce2d bytes) 2024-09-12T16:16:49.201 INFO:teuthology.orchestra.run.smithi204.stdout:2886 write 0x45af200 thru 0x45b2950 (0x3751 bytes) 2024-09-12T16:16:49.201 INFO:teuthology.orchestra.run.smithi204.stdout:2887 punch from 0xc7b5400 to 0xc7c2400, (0xd000 bytes) 2024-09-12T16:16:49.201 INFO:teuthology.orchestra.run.smithi204.stdout:2888 read 0x40cf000 thru 0x40d0fbc (0x1fbd bytes) 2024-09-12T16:16:49.201 INFO:teuthology.orchestra.run.smithi204.stdout:2889 read 0x4b30c00 thru 0x4b395ec (0x89ed bytes) 2024-09-12T16:16:49.201 INFO:teuthology.orchestra.run.smithi204.stdout:2891 write 0x5d2bc00 thru 0x5d2bda8 (0x1a9 bytes) 2024-09-12T16:16:49.201 INFO:teuthology.orchestra.run.smithi204.stdout:2892 punch from 0xc41f000 to 0xc41f800, (0x800 bytes) 2024-09-12T16:16:49.201 INFO:teuthology.orchestra.run.smithi204.stdout:2893 read 0x60ad200 thru 0x60b3661 (0x6462 bytes) 2024-09-12T16:16:49.202 INFO:teuthology.orchestra.run.smithi204.stdout:2894 write 0xab9f400 thru 0xaba78fc (0x84fd bytes) 2024-09-12T16:16:49.202 INFO:teuthology.orchestra.run.smithi204.stdout:2899 write 0x6180800 thru 0x618c17e (0xb97f bytes) 2024-09-12T16:16:49.216 INFO:teuthology.orchestra.run.smithi204.stdout:2902 trunc from 0xd4b2c00 to 0x325c00 2024-09-12T16:16:49.257 INFO:teuthology.orchestra.run.smithi204.stdout:2903 punch from 0xe6e00 to 0xec200, (0x5400 bytes) 2024-09-12T16:16:49.257 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:49.256+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:49.277 INFO:teuthology.orchestra.run.smithi204.stdout:2905 trunc from 0x325c00 to 0xa526e00 2024-09-12T16:16:49.295 INFO:teuthology.orchestra.run.smithi204.stdout:2907 trunc from 0xa526e00 to 0x501bc00 2024-09-12T16:16:49.323 INFO:teuthology.orchestra.run.smithi204.stdout:2908 write 0xacc4200 thru 0xacc8308 (0x4109 bytes) 2024-09-12T16:16:49.325 INFO:teuthology.orchestra.run.smithi204.stdout:2913 read 0x5c8d400 thru 0x5c9568a (0x828b bytes) 2024-09-12T16:16:49.330 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:49.330 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:49.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.331 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4835.0:1844 3.13 3:c9e062c3:::rbd_object_map.1155c422dd19:head [call lock.assert_locked in=44b,call rbd.object_map_update in=38b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T16:16:49.331 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:49.329856+0000", 2024-09-12T16:16:49.331 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.00058289099999999999, 2024-09-12T16:16:49.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000605705, 2024-09-12T16:16:49.331 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.331 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.331 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.331 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.331 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4835", 2024-09-12T16:16:49.331 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2251080659", 2024-09-12T16:16:49.331 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1844 2024-09-12T16:16:49.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.331 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:49.329856+0000", 2024-09-12T16:16:49.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:49.329856+0000", 2024-09-12T16:16:49.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:49.329857+0000", 2024-09-12T16:16:49.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9099999999999991e-07 2024-09-12T16:16:49.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:49.329863+0000", 2024-09-12T16:16:49.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5969999999999999e-06 2024-09-12T16:16:49.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:49.329876+0000", 2024-09-12T16:16:49.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3230999999999999e-05 2024-09-12T16:16:49.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:49.329881+0000", 2024-09-12T16:16:49.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2490000000000001e-06 2024-09-12T16:16:49.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:49.329963+0000", 2024-09-12T16:16:49.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2198000000000001e-05 2024-09-12T16:16:49.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:49.330093+0000", 2024-09-12T16:16:49.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013001000000000001 2024-09-12T16:16:49.334 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.334 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.334 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.335 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4835.0:1846 3.8 3.9970d2a8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-12T16:16:49.335 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:49.330441+0000", 2024-09-12T16:16:49.335 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4294967295.9999981, 2024-09-12T16:16:49.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1069000000000005e-05, 2024-09-12T16:16:49.335 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.335 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.335 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:16:49.335 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.335 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4835", 2024-09-12T16:16:49.335 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2251080659", 2024-09-12T16:16:49.335 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1846 2024-09-12T16:16:49.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.336 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:49.330441+0000", 2024-09-12T16:16:49.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:49.330441+0000", 2024-09-12T16:16:49.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:49.330442+0000", 2024-09-12T16:16:49.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0070000000000001e-06 2024-09-12T16:16:49.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:49.330446+0000", 2024-09-12T16:16:49.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5469999999999998e-06 2024-09-12T16:16:49.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:49.330458+0000", 2024-09-12T16:16:49.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2051e-05 2024-09-12T16:16:49.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:49.330469+0000", 2024-09-12T16:16:49.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0862999999999999e-05 2024-09-12T16:16:49.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:49.330528+0000", 2024-09-12T16:16:49.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8671000000000001e-05 2024-09-12T16:16:49.338 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.338 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.338 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.338 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.339 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-12T16:16:49.339 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 2 2024-09-12T16:16:49.339 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:49.341 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:16:49.344 INFO:teuthology.orchestra.run.smithi204.stdout:2915 write 0xe935a00 thru 0xe9360d0 (0x6d1 bytes) 2024-09-12T16:16:49.350 INFO:teuthology.orchestra.run.smithi204.stdout:2916 punch from 0x265ec00 to 0x266c800, (0xdc00 bytes) 2024-09-12T16:16:49.351 INFO:teuthology.orchestra.run.smithi204.stdout:2918 write 0x5059200 thru 0x5063620 (0xa421 bytes) 2024-09-12T16:16:49.358 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:49.357+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:49.368 INFO:teuthology.orchestra.run.smithi204.stdout:2919 trunc from 0xe936200 to 0x7c8a00 2024-09-12T16:16:49.389 INFO:teuthology.orchestra.run.smithi204.stdout:2923 punch from 0x6c1e00 to 0x6ca200, (0x8400 bytes) 2024-09-12T16:16:49.396 INFO:teuthology.orchestra.run.smithi204.stdout:2924 trunc from 0x7c8a00 to 0x4a53200 2024-09-12T16:16:49.405 INFO:teuthology.orchestra.run.smithi204.stdout:2933 read 0x1c46200 thru 0x1c4a7ba (0x45bb bytes) 2024-09-12T16:16:49.405 INFO:teuthology.orchestra.run.smithi204.stdout:2934 punch from 0x1573400 to 0x157bc00, (0x8800 bytes) 2024-09-12T16:16:49.424 INFO:teuthology.orchestra.run.smithi204.stdout:2936 write 0xd800c00 thru 0xd80b878 (0xac79 bytes) 2024-09-12T16:16:49.425 INFO:teuthology.orchestra.run.smithi204.stdout:2938 punch from 0x6b8d000 to 0x6b96200, (0x9200 bytes) 2024-09-12T16:16:49.425 INFO:teuthology.orchestra.run.smithi204.stdout:2939 read 0x9a74600 thru 0x9a8396d (0xf36e bytes) 2024-09-12T16:16:49.433 INFO:teuthology.orchestra.run.smithi204.stdout:2940 trunc from 0xd80ba00 to 0x6cf4800 2024-09-12T16:16:49.460 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:49.458+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:49.460 INFO:teuthology.orchestra.run.smithi204.stdout:2941 write 0x8f64a00 thru 0x8f65b7a (0x117b bytes) 2024-09-12T16:16:49.461 INFO:teuthology.orchestra.run.smithi204.stdout:2942 read 0x11d1400 thru 0x11da281 (0x8e82 bytes) 2024-09-12T16:16:49.462 INFO:teuthology.orchestra.run.smithi204.stdout:2943 trunc from 0x8f65c00 to 0x84baa00 2024-09-12T16:16:49.469 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:49.554 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:49.554 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:16:49.555 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:16:49.555 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:49.556 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:16:49.600 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:49.599+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:49.661 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:49.660+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:49.664 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:49.664 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:16:49.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:16:49.664 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:49.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.665 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2010 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1118208~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:49.665 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790432+0000", 2024-09-12T16:16:49.665 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 12.872466524, 2024-09-12T16:16:49.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023851981000000001, 2024-09-12T16:16:49.665 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.665 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.665 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.665 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.665 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:49.665 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:49.665 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2010 2024-09-12T16:16:49.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.666 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790432+0000", 2024-09-12T16:16:49.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790432+0000", 2024-09-12T16:16:49.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790433+0000", 2024-09-12T16:16:49.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1799999999999995e-07 2024-09-12T16:16:49.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790442+0000", 2024-09-12T16:16:49.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8030000000000008e-06 2024-09-12T16:16:49.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790449+0000", 2024-09-12T16:16:49.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-12T16:16:49.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790455+0000", 2024-09-12T16:16:49.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2700000000000004e-06 2024-09-12T16:16:49.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814126+0000", 2024-09-12T16:16:49.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023671668999999999 2024-09-12T16:16:49.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814168+0000", 2024-09-12T16:16:49.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1727999999999998e-05 2024-09-12T16:16:49.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814284+0000", 2024-09-12T16:16:49.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116153 2024-09-12T16:16:49.669 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.669 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.669 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.670 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2011 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1163264~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:49.670 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790463+0000", 2024-09-12T16:16:49.670 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 12.872436044000001, 2024-09-12T16:16:49.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024104724000000001, 2024-09-12T16:16:49.670 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.670 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.670 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.670 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.670 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:49.670 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:49.670 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2011 2024-09-12T16:16:49.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.670 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790463+0000", 2024-09-12T16:16:49.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790463+0000", 2024-09-12T16:16:49.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790463+0000", 2024-09-12T16:16:49.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6199999999999998e-07 2024-09-12T16:16:49.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790465+0000", 2024-09-12T16:16:49.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2419999999999999e-06 2024-09-12T16:16:49.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790471+0000", 2024-09-12T16:16:49.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0000000000000002e-06 2024-09-12T16:16:49.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790477+0000", 2024-09-12T16:16:49.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3669999999999996e-06 2024-09-12T16:16:49.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814317+0000", 2024-09-12T16:16:49.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023840413000000001 2024-09-12T16:16:49.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814410+0000", 2024-09-12T16:16:49.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3049999999999998e-05 2024-09-12T16:16:49.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814567+0000", 2024-09-12T16:16:49.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015719 2024-09-12T16:16:49.674 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.674 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.674 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.674 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2012 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1208320~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:49.674 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790484+0000", 2024-09-12T16:16:49.674 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 12.872414786, 2024-09-12T16:16:49.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024289805000000001, 2024-09-12T16:16:49.674 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.674 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.674 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.674 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.674 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:49.675 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:49.675 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2012 2024-09-12T16:16:49.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.675 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790484+0000", 2024-09-12T16:16:49.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790484+0000", 2024-09-12T16:16:49.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790484+0000", 2024-09-12T16:16:49.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2199999999999999e-07 2024-09-12T16:16:49.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790486+0000", 2024-09-12T16:16:49.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.979e-06 2024-09-12T16:16:49.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790493+0000", 2024-09-12T16:16:49.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8950000000000001e-06 2024-09-12T16:16:49.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790498+0000", 2024-09-12T16:16:49.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8289999999999998e-06 2024-09-12T16:16:49.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814603+0000", 2024-09-12T16:16:49.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024104787999999999 2024-09-12T16:16:49.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814686+0000", 2024-09-12T16:16:49.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3224000000000001e-05 2024-09-12T16:16:49.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814774+0000", 2024-09-12T16:16:49.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7668000000000002e-05 2024-09-12T16:16:49.678 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.678 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.678 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.678 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2013 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1216512~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:49.678 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790507+0000", 2024-09-12T16:16:49.678 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 12.872392131, 2024-09-12T16:16:49.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024529395999999998, 2024-09-12T16:16:49.679 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.679 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.679 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.679 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.679 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:49.679 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:49.679 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2013 2024-09-12T16:16:49.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.679 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790507+0000", 2024-09-12T16:16:49.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790507+0000", 2024-09-12T16:16:49.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790507+0000", 2024-09-12T16:16:49.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8599999999999997e-07 2024-09-12T16:16:49.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790510+0000", 2024-09-12T16:16:49.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.339e-06 2024-09-12T16:16:49.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790516+0000", 2024-09-12T16:16:49.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2609999999999999e-06 2024-09-12T16:16:49.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790521+0000", 2024-09-12T16:16:49.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0549999999999999e-06 2024-09-12T16:16:49.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814810+0000", 2024-09-12T16:16:49.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024289409000000001 2024-09-12T16:16:49.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814890+0000", 2024-09-12T16:16:49.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9138e-05 2024-09-12T16:16:49.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815036+0000", 2024-09-12T16:16:49.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000146408 2024-09-12T16:16:49.683 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.683 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.683 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.683 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2014 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1261568~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:49.683 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790529+0000", 2024-09-12T16:16:49.683 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 12.872369901000001, 2024-09-12T16:16:49.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024767824000000001, 2024-09-12T16:16:49.684 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.684 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.684 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.684 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.684 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:49.684 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:49.684 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2014 2024-09-12T16:16:49.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.684 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790529+0000", 2024-09-12T16:16:49.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790529+0000", 2024-09-12T16:16:49.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790529+0000", 2024-09-12T16:16:49.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6100000000000001e-07 2024-09-12T16:16:49.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790532+0000", 2024-09-12T16:16:49.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3429999999999998e-06 2024-09-12T16:16:49.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790538+0000", 2024-09-12T16:16:49.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3709999999999996e-06 2024-09-12T16:16:49.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790543+0000", 2024-09-12T16:16:49.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.933e-06 2024-09-12T16:16:49.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815084+0000", 2024-09-12T16:16:49.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024541469 2024-09-12T16:16:49.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815172+0000", 2024-09-12T16:16:49.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7869999999999997e-05 2024-09-12T16:16:49.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815297+0000", 2024-09-12T16:16:49.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012437700000000001 2024-09-12T16:16:49.688 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.688 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.688 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.688 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2015 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1306624~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:49.688 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790549+0000", 2024-09-12T16:16:49.688 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 12.872349603, 2024-09-12T16:16:49.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025019062000000002, 2024-09-12T16:16:49.688 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.689 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.689 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:49.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:49.689 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2015 2024-09-12T16:16:49.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.689 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790549+0000", 2024-09-12T16:16:49.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790549+0000", 2024-09-12T16:16:49.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790549+0000", 2024-09-12T16:16:49.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1800000000000001e-07 2024-09-12T16:16:49.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790551+0000", 2024-09-12T16:16:49.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.855e-06 2024-09-12T16:16:49.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790557+0000", 2024-09-12T16:16:49.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2460000000000003e-06 2024-09-12T16:16:49.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790561+0000", 2024-09-12T16:16:49.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8799999999999999e-06 2024-09-12T16:16:49.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815329+0000", 2024-09-12T16:16:49.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024767320999999998 2024-09-12T16:16:49.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815408+0000", 2024-09-12T16:16:49.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9226000000000003e-05 2024-09-12T16:16:49.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815568+0000", 2024-09-12T16:16:49.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000160116 2024-09-12T16:16:49.692 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.692 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.693 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.693 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2016 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1314816~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:49.693 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790568+0000", 2024-09-12T16:16:49.693 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 12.872330461000001, 2024-09-12T16:16:49.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025220411000000002, 2024-09-12T16:16:49.693 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.693 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.693 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.693 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.693 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:49.693 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:49.694 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2016 2024-09-12T16:16:49.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.694 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790568+0000", 2024-09-12T16:16:49.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790568+0000", 2024-09-12T16:16:49.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790569+0000", 2024-09-12T16:16:49.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1699999999999999e-07 2024-09-12T16:16:49.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790571+0000", 2024-09-12T16:16:49.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2819999999999999e-06 2024-09-12T16:16:49.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790577+0000", 2024-09-12T16:16:49.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.117e-06 2024-09-12T16:16:49.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790582+0000", 2024-09-12T16:16:49.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6110000000000004e-06 2024-09-12T16:16:49.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815611+0000", 2024-09-12T16:16:49.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025029518000000001 2024-09-12T16:16:49.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815669+0000", 2024-09-12T16:16:49.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7896999999999998e-05 2024-09-12T16:16:49.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815789+0000", 2024-09-12T16:16:49.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011956900000000001 2024-09-12T16:16:49.697 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.697 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.697 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.697 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2017 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1359872~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:49.697 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790596+0000", 2024-09-12T16:16:49.697 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 12.872302437, 2024-09-12T16:16:49.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025446261000000001, 2024-09-12T16:16:49.697 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.697 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.698 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.698 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.698 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:49.698 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:49.698 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2017 2024-09-12T16:16:49.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.698 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790596+0000", 2024-09-12T16:16:49.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790596+0000", 2024-09-12T16:16:49.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790597+0000", 2024-09-12T16:16:49.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7400000000000003e-07 2024-09-12T16:16:49.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790599+0000", 2024-09-12T16:16:49.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4389999999999999e-06 2024-09-12T16:16:49.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790606+0000", 2024-09-12T16:16:49.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9589999999999998e-06 2024-09-12T16:16:49.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790612+0000", 2024-09-12T16:16:49.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4840000000000003e-06 2024-09-12T16:16:49.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815818+0000", 2024-09-12T16:16:49.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025206447 2024-09-12T16:16:49.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815910+0000", 2024-09-12T16:16:49.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1898999999999995e-05 2024-09-12T16:16:49.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.816042+0000", 2024-09-12T16:16:49.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132359 2024-09-12T16:16:49.701 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.701 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.701 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.701 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2018 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1404928~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:49.701 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790619+0000", 2024-09-12T16:16:49.701 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 12.872279232, 2024-09-12T16:16:49.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025656844000000002, 2024-09-12T16:16:49.701 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.701 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.702 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.702 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.702 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:49.702 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:49.702 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2018 2024-09-12T16:16:49.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.702 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790619+0000", 2024-09-12T16:16:49.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790619+0000", 2024-09-12T16:16:49.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790620+0000", 2024-09-12T16:16:49.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.46e-07 2024-09-12T16:16:49.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790622+0000", 2024-09-12T16:16:49.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0090000000000002e-06 2024-09-12T16:16:49.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790628+0000", 2024-09-12T16:16:49.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0349999999999998e-06 2024-09-12T16:16:49.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790641+0000", 2024-09-12T16:16:49.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2889e-05 2024-09-12T16:16:49.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.816075+0000", 2024-09-12T16:16:49.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025433951 2024-09-12T16:16:49.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.816155+0000", 2024-09-12T16:16:49.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9907000000000006e-05 2024-09-12T16:16:49.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.816276+0000", 2024-09-12T16:16:49.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121607 2024-09-12T16:16:49.705 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.705 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.705 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.705 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2019 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1413120~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:49.705 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790652+0000", 2024-09-12T16:16:49.705 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 12.872247096000001, 2024-09-12T16:16:49.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.02584908, 2024-09-12T16:16:49.706 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.706 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.706 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.706 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.706 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:49.706 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:49.706 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2019 2024-09-12T16:16:49.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.706 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790652+0000", 2024-09-12T16:16:49.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790652+0000", 2024-09-12T16:16:49.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790652+0000", 2024-09-12T16:16:49.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9399999999999995e-07 2024-09-12T16:16:49.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790655+0000", 2024-09-12T16:16:49.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.481e-06 2024-09-12T16:16:49.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790661+0000", 2024-09-12T16:16:49.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1999999999999999e-06 2024-09-12T16:16:49.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790666+0000", 2024-09-12T16:16:49.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8670000000000002e-06 2024-09-12T16:16:49.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.816306+0000", 2024-09-12T16:16:49.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025640039 2024-09-12T16:16:49.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.816382+0000", 2024-09-12T16:16:49.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6771000000000001e-05 2024-09-12T16:16:49.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.816501+0000", 2024-09-12T16:16:49.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011822799999999999 2024-09-12T16:16:49.709 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.709 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.709 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.710 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4805.0:6829 3.18 3:1e2ee373:::rbd_data.1155c2c5fc24.0000000000000003:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 18778112~25088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T16:16:49.710 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:43.576065+0000", 2024-09-12T16:16:49.710 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.0868332260000004, 2024-09-12T16:16:49.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044824155999999997, 2024-09-12T16:16:49.710 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.710 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.710 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:49.710 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.710 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4805", 2024-09-12T16:16:49.710 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3734391115", 2024-09-12T16:16:49.710 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6829 2024-09-12T16:16:49.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.710 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.576065+0000", 2024-09-12T16:16:49.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.576065+0000", 2024-09-12T16:16:49.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.576068+0000", 2024-09-12T16:16:49.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1629999999999999e-06 2024-09-12T16:16:49.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.588880+0000", 2024-09-12T16:16:49.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012812054 2024-09-12T16:16:49.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.588909+0000", 2024-09-12T16:16:49.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9354000000000001e-05 2024-09-12T16:16:49.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.588930+0000", 2024-09-12T16:16:49.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0571999999999999e-05 2024-09-12T16:16:49.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.589010+0000", 2024-09-12T16:16:49.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0780999999999998e-05 2024-09-12T16:16:49.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.589174+0000", 2024-09-12T16:16:49.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016337799999999999 2024-09-12T16:16:49.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 1", 2024-09-12T16:16:49.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.590261+0000", 2024-09-12T16:16:49.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001087735 2024-09-12T16:16:49.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:16:49.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.610690+0000", 2024-09-12T16:16:49.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020428281999999999 2024-09-12T16:16:49.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:49.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.620760+0000", 2024-09-12T16:16:49.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010070325999999999 2024-09-12T16:16:49.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:16:49.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.620836+0000", 2024-09-12T16:16:49.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5617999999999993e-05 2024-09-12T16:16:49.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.620890+0000", 2024-09-12T16:16:49.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3893000000000001e-05 2024-09-12T16:16:49.715 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.715 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.715 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.715 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4805.0:10630 3.5 3:a735f393:::rbd_data.1155525b14e3.0000000000000035:f [read 679936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-09-12T16:16:49.715 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:43.839654+0000", 2024-09-12T16:16:49.716 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.823245097, 2024-09-12T16:16:49.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023715737000000001, 2024-09-12T16:16:49.716 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.716 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.716 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.716 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.716 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4805", 2024-09-12T16:16:49.716 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3734391115", 2024-09-12T16:16:49.716 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 10630 2024-09-12T16:16:49.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.716 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839654+0000", 2024-09-12T16:16:49.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839654+0000", 2024-09-12T16:16:49.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839654+0000", 2024-09-12T16:16:49.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7099999999999997e-07 2024-09-12T16:16:49.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839656+0000", 2024-09-12T16:16:49.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0980000000000001e-06 2024-09-12T16:16:49.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839663+0000", 2024-09-12T16:16:49.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5119999999999997e-06 2024-09-12T16:16:49.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839668+0000", 2024-09-12T16:16:49.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0900000000000004e-06 2024-09-12T16:16:49.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863252+0000", 2024-09-12T16:16:49.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023583908000000001 2024-09-12T16:16:49.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863300+0000", 2024-09-12T16:16:49.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8347999999999999e-05 2024-09-12T16:16:49.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863369+0000", 2024-09-12T16:16:49.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9410000000000001e-05 2024-09-12T16:16:49.719 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.720 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.720 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.720 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4805.0:10631 3.5 3:a1218f83:::rbd_data.1155525b14e3.000000000000002d:f [read 712704~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-09-12T16:16:49.720 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:43.839674+0000", 2024-09-12T16:16:49.720 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.8232242699999999, 2024-09-12T16:16:49.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023832401, 2024-09-12T16:16:49.720 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.720 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.721 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.721 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.721 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4805", 2024-09-12T16:16:49.721 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3734391115", 2024-09-12T16:16:49.721 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 10631 2024-09-12T16:16:49.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.721 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839674+0000", 2024-09-12T16:16:49.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839674+0000", 2024-09-12T16:16:49.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839675+0000", 2024-09-12T16:16:49.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.72e-07 2024-09-12T16:16:49.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839677+0000", 2024-09-12T16:16:49.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0219999999999999e-06 2024-09-12T16:16:49.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839683+0000", 2024-09-12T16:16:49.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5060000000000001e-06 2024-09-12T16:16:49.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839688+0000", 2024-09-12T16:16:49.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8879999999999996e-06 2024-09-12T16:16:49.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863393+0000", 2024-09-12T16:16:49.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023704691 2024-09-12T16:16:49.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863438+0000", 2024-09-12T16:16:49.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5077000000000002e-05 2024-09-12T16:16:49.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863507+0000", 2024-09-12T16:16:49.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8844999999999996e-05 2024-09-12T16:16:49.724 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.724 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.724 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.724 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4805.0:10635 3.5 3:a735f393:::rbd_data.1155525b14e3.0000000000000035:f [read 708608~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-09-12T16:16:49.725 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:43.839695+0000", 2024-09-12T16:16:49.725 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.8232037989999998, 2024-09-12T16:16:49.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023949386999999999, 2024-09-12T16:16:49.725 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.725 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.725 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.725 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.725 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4805", 2024-09-12T16:16:49.725 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3734391115", 2024-09-12T16:16:49.725 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 10635 2024-09-12T16:16:49.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.725 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839695+0000", 2024-09-12T16:16:49.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839695+0000", 2024-09-12T16:16:49.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839695+0000", 2024-09-12T16:16:49.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8700000000000001e-07 2024-09-12T16:16:49.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839697+0000", 2024-09-12T16:16:49.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0549999999999998e-06 2024-09-12T16:16:49.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839704+0000", 2024-09-12T16:16:49.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4989999999999999e-06 2024-09-12T16:16:49.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839709+0000", 2024-09-12T16:16:49.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3970000000000002e-06 2024-09-12T16:16:49.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863529+0000", 2024-09-12T16:16:49.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023820277000000001 2024-09-12T16:16:49.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863575+0000", 2024-09-12T16:16:49.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5259000000000002e-05 2024-09-12T16:16:49.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863644+0000", 2024-09-12T16:16:49.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9512999999999997e-05 2024-09-12T16:16:49.728 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.728 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.729 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.729 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4805.0:10637 3.5 3:a1218f83:::rbd_data.1155525b14e3.000000000000002d:f [read 741376~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-09-12T16:16:49.729 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:43.839716+0000", 2024-09-12T16:16:49.729 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.823183116, 2024-09-12T16:16:49.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024074149999999999, 2024-09-12T16:16:49.729 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.729 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.729 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.729 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.729 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4805", 2024-09-12T16:16:49.729 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3734391115", 2024-09-12T16:16:49.729 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 10637 2024-09-12T16:16:49.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.730 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839716+0000", 2024-09-12T16:16:49.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839716+0000", 2024-09-12T16:16:49.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839716+0000", 2024-09-12T16:16:49.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9499999999999998e-07 2024-09-12T16:16:49.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839718+0000", 2024-09-12T16:16:49.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.012e-06 2024-09-12T16:16:49.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839724+0000", 2024-09-12T16:16:49.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4180000000000002e-06 2024-09-12T16:16:49.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839729+0000", 2024-09-12T16:16:49.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1089999999999997e-06 2024-09-12T16:16:49.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863668+0000", 2024-09-12T16:16:49.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023938734999999999 2024-09-12T16:16:49.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863713+0000", 2024-09-12T16:16:49.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4994999999999999e-05 2024-09-12T16:16:49.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.733 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863790+0000", 2024-09-12T16:16:49.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6485999999999999e-05 2024-09-12T16:16:49.733 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.733 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.733 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.733 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4805.0:10642 3.5 3:a735f393:::rbd_data.1155525b14e3.0000000000000035:f [read 737280~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-09-12T16:16:49.733 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:43.839736+0000", 2024-09-12T16:16:49.733 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.8231624599999998, 2024-09-12T16:16:49.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024204321000000001, 2024-09-12T16:16:49.733 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.733 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.733 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.733 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.734 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4805", 2024-09-12T16:16:49.734 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3734391115", 2024-09-12T16:16:49.734 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 10642 2024-09-12T16:16:49.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.734 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839736+0000", 2024-09-12T16:16:49.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839736+0000", 2024-09-12T16:16:49.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839737+0000", 2024-09-12T16:16:49.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2e-07 2024-09-12T16:16:49.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839739+0000", 2024-09-12T16:16:49.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9740000000000001e-06 2024-09-12T16:16:49.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839745+0000", 2024-09-12T16:16:49.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5139999999999998e-06 2024-09-12T16:16:49.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839750+0000", 2024-09-12T16:16:49.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8230000000000002e-06 2024-09-12T16:16:49.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863812+0000", 2024-09-12T16:16:49.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024062554 2024-09-12T16:16:49.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863858+0000", 2024-09-12T16:16:49.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5827e-05 2024-09-12T16:16:49.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863941+0000", 2024-09-12T16:16:49.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2208999999999998e-05 2024-09-12T16:16:49.737 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.737 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.737 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.737 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4805.0:10643 3.5 3:a1218f83:::rbd_data.1155525b14e3.000000000000002d:f [read 770048~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-09-12T16:16:49.737 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:43.839757+0000", 2024-09-12T16:16:49.737 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.8231420219999999, 2024-09-12T16:16:49.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024320068, 2024-09-12T16:16:49.737 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.738 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.738 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.738 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.738 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4805", 2024-09-12T16:16:49.738 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3734391115", 2024-09-12T16:16:49.738 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 10643 2024-09-12T16:16:49.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.738 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839757+0000", 2024-09-12T16:16:49.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839757+0000", 2024-09-12T16:16:49.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839757+0000", 2024-09-12T16:16:49.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0400000000000002e-07 2024-09-12T16:16:49.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839759+0000", 2024-09-12T16:16:49.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.99e-06 2024-09-12T16:16:49.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839765+0000", 2024-09-12T16:16:49.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3289999999999999e-06 2024-09-12T16:16:49.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839770+0000", 2024-09-12T16:16:49.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9969999999999998e-06 2024-09-12T16:16:49.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863964+0000", 2024-09-12T16:16:49.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024193394999999999 2024-09-12T16:16:49.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.864008+0000", 2024-09-12T16:16:49.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4002999999999999e-05 2024-09-12T16:16:49.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.864077+0000", 2024-09-12T16:16:49.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8949999999999995e-05 2024-09-12T16:16:49.741 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.741 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.741 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.742 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4805.0:10653 3.5 3:a735f393:::rbd_data.1155525b14e3.0000000000000035:f [read 782336~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-09-12T16:16:49.742 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:43.839781+0000", 2024-09-12T16:16:49.742 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.8231171909999997, 2024-09-12T16:16:49.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024439470000000001, 2024-09-12T16:16:49.742 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.742 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.742 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.742 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.742 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4805", 2024-09-12T16:16:49.742 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3734391115", 2024-09-12T16:16:49.742 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 10653 2024-09-12T16:16:49.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.743 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839781+0000", 2024-09-12T16:16:49.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839781+0000", 2024-09-12T16:16:49.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839782+0000", 2024-09-12T16:16:49.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4099999999999999e-07 2024-09-12T16:16:49.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839784+0000", 2024-09-12T16:16:49.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2479999999999999e-06 2024-09-12T16:16:49.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839794+0000", 2024-09-12T16:16:49.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0283e-05 2024-09-12T16:16:49.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839800+0000", 2024-09-12T16:16:49.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4870000000000002e-06 2024-09-12T16:16:49.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.864102+0000", 2024-09-12T16:16:49.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.02430177 2024-09-12T16:16:49.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.864146+0000", 2024-09-12T16:16:49.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4697000000000003e-05 2024-09-12T16:16:49.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.864221+0000", 2024-09-12T16:16:49.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4543999999999996e-05 2024-09-12T16:16:49.746 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.746 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.746 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.746 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4805.0:10656 3.5 3:a1218f83:::rbd_data.1155525b14e3.000000000000002d:f [read 815104~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-09-12T16:16:49.746 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:43.839808+0000", 2024-09-12T16:16:49.746 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.8230904619999997, 2024-09-12T16:16:49.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024552312999999999, 2024-09-12T16:16:49.747 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.747 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.747 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.747 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.747 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4805", 2024-09-12T16:16:49.747 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3734391115", 2024-09-12T16:16:49.747 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 10656 2024-09-12T16:16:49.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.747 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839808+0000", 2024-09-12T16:16:49.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839808+0000", 2024-09-12T16:16:49.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839809+0000", 2024-09-12T16:16:49.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1399999999999997e-07 2024-09-12T16:16:49.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839811+0000", 2024-09-12T16:16:49.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4480000000000001e-06 2024-09-12T16:16:49.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839817+0000", 2024-09-12T16:16:49.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3980000000000004e-06 2024-09-12T16:16:49.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839823+0000", 2024-09-12T16:16:49.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2789999999999998e-06 2024-09-12T16:16:49.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.864244+0000", 2024-09-12T16:16:49.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024420996 2024-09-12T16:16:49.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.864289+0000", 2024-09-12T16:16:49.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4981000000000002e-05 2024-09-12T16:16:49.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.864360+0000", 2024-09-12T16:16:49.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1797000000000004e-05 2024-09-12T16:16:49.750 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.750 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.750 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.751 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4805.0:10662 3.5 3:a735f393:::rbd_data.1155525b14e3.0000000000000035:f [read 811008~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-09-12T16:16:49.751 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:43.839830+0000", 2024-09-12T16:16:49.751 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.8230687080000001, 2024-09-12T16:16:49.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024660374999999998, 2024-09-12T16:16:49.751 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:49.751 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:49.751 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:49.751 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:49.751 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4805", 2024-09-12T16:16:49.751 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3734391115", 2024-09-12T16:16:49.751 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 10662 2024-09-12T16:16:49.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.751 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:49.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:49.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839830+0000", 2024-09-12T16:16:49.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:49.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839830+0000", 2024-09-12T16:16:49.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:49.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:49.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839830+0000", 2024-09-12T16:16:49.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2399999999999999e-07 2024-09-12T16:16:49.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:49.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839832+0000", 2024-09-12T16:16:49.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0229999999999999e-06 2024-09-12T16:16:49.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:49.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839839+0000", 2024-09-12T16:16:49.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3589999999999996e-06 2024-09-12T16:16:49.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:49.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839843+0000", 2024-09-12T16:16:49.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7530000000000001e-06 2024-09-12T16:16:49.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:49.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.864374+0000", 2024-09-12T16:16:49.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024530600999999999 2024-09-12T16:16:49.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:49.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.864421+0000", 2024-09-12T16:16:49.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6968999999999997e-05 2024-09-12T16:16:49.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:49.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:49.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:49.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.864490+0000", 2024-09-12T16:16:49.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9245999999999994e-05 2024-09-12T16:16:49.755 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.755 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.755 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.755 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:49.755 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:49.755 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:49.756 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:16:49.757 INFO:teuthology.orchestra.run.smithi204.stdout:2944 write 0xde00200 thru 0xde0451b (0x431c bytes) 2024-09-12T16:16:49.757 INFO:teuthology.orchestra.run.smithi204.stdout:2945 punch from 0xd46e00 to 0xd4a400, (0x3600 bytes) 2024-09-12T16:16:49.757 INFO:teuthology.orchestra.run.smithi204.stdout:2946 write 0xbfd0400 thru 0xbfde4e4 (0xe0e5 bytes) 2024-09-12T16:16:49.757 INFO:teuthology.orchestra.run.smithi204.stdout:2948 read 0xd402600 thru 0xd406a9f (0x44a0 bytes) 2024-09-12T16:16:49.757 INFO:teuthology.orchestra.run.smithi204.stdout:2950 punch from 0x2c39e00 to 0x2c41600, (0x7800 bytes) 2024-09-12T16:16:49.758 INFO:teuthology.orchestra.run.smithi204.stdout:2953 write 0x7af4600 thru 0x7af8148 (0x3b49 bytes) 2024-09-12T16:16:49.758 INFO:teuthology.orchestra.run.smithi204.stdout:2954 write 0x8ec2000 thru 0x8ec43d3 (0x23d4 bytes) 2024-09-12T16:16:49.758 INFO:teuthology.orchestra.run.smithi204.stdout:2955 read 0x7a08e00 thru 0x7a1546d (0xc66e bytes) 2024-09-12T16:16:49.758 INFO:teuthology.orchestra.run.smithi204.stdout:2956 write 0xa458400 thru 0xa4647dd (0xc3de bytes) 2024-09-12T16:16:49.758 INFO:teuthology.orchestra.run.smithi204.stdout:2959 trunc from 0xde04600 to 0xaaa0c00 2024-09-12T16:16:49.768 INFO:teuthology.orchestra.run.smithi204.stdout:2961 read 0xa751600 thru 0xa75ffe8 (0xe9e9 bytes) 2024-09-12T16:16:49.774 INFO:teuthology.orchestra.run.smithi204.stdout:2963 write 0x42f0c00 thru 0x42f8585 (0x7986 bytes) 2024-09-12T16:16:49.774 INFO:teuthology.orchestra.run.smithi204.stdout:2964 read 0x1590400 thru 0x159be4c (0xba4d bytes) 2024-09-12T16:16:49.774 INFO:teuthology.orchestra.run.smithi204.stdout:2965 punch from 0x36b8400 to 0x36bb600, (0x3200 bytes) 2024-09-12T16:16:49.786 INFO:teuthology.orchestra.run.smithi204.stdout:2966 write 0xbf5c000 thru 0xbf6b96e (0xf96f bytes) 2024-09-12T16:16:49.793 INFO:teuthology.orchestra.run.smithi204.stdout:2967 punch from 0x53c8800 to 0x53d4400, (0xbc00 bytes) 2024-09-12T16:16:49.793 INFO:teuthology.orchestra.run.smithi204.stdout:2968 read 0x2105800 thru 0x21060ad (0x8ae bytes) 2024-09-12T16:16:49.795 INFO:teuthology.orchestra.run.smithi204.stdout:2969 trunc from 0xbf6ba00 to 0xa6e0200 2024-09-12T16:16:49.798 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:49.798+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:49.810 INFO:teuthology.orchestra.run.smithi204.stdout:2972 read 0x4270800 thru 0x427b3c3 (0xabc4 bytes) 2024-09-12T16:16:49.811 INFO:teuthology.orchestra.run.smithi204.stdout:2973 punch from 0x63cac00 to 0x63d7a00, (0xce00 bytes) 2024-09-12T16:16:49.828 INFO:teuthology.orchestra.run.smithi204.stdout:2976 write 0xe2aae00 thru 0xe2b8de8 (0xdfe9 bytes) 2024-09-12T16:16:49.836 INFO:teuthology.orchestra.run.smithi204.stdout:2977 write 0x70a3600 thru 0x70ab637 (0x8038 bytes) 2024-09-12T16:16:49.836 INFO:teuthology.orchestra.run.smithi204.stdout:2978 read 0x14dba00 thru 0x14e7554 (0xbb55 bytes) 2024-09-12T16:16:49.840 INFO:teuthology.orchestra.run.smithi204.stdout:2979 trunc from 0xe2b8e00 to 0xa0bf200 2024-09-12T16:16:49.860 INFO:teuthology.orchestra.run.smithi204.stdout:2982 read 0x150aa00 thru 0x151356f (0x8b70 bytes) 2024-09-12T16:16:49.862 INFO:teuthology.orchestra.run.smithi204.stdout:2985 punch from 0xa05a200 to 0xa060a00, (0x6800 bytes) 2024-09-12T16:16:49.862 INFO:teuthology.orchestra.run.smithi204.stdout:2990 read 0x8e3f800 thru 0x8e48698 (0x8e99 bytes) 2024-09-12T16:16:49.862 INFO:teuthology.orchestra.run.smithi204.stdout:2993 punch from 0x4624800 to 0x462f000, (0xa800 bytes) 2024-09-12T16:16:49.863 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:49.862+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:49.868 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:49.868 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:16:49.868 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:16:49.868 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:49.873 INFO:teuthology.orchestra.run.smithi204.stdout:2994 write 0xa2c1200 thru 0xa2c93bc (0x81bd bytes) 2024-09-12T16:16:49.876 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:16:49.879 INFO:teuthology.orchestra.run.smithi204.stdout:2995 read 0x4788e00 thru 0x4796bae (0xddaf bytes) 2024-09-12T16:16:49.879 INFO:teuthology.orchestra.run.smithi204.stdout:2996 punch from 0x92da600 to 0x92e5400, (0xae00 bytes) 2024-09-12T16:16:49.884 INFO:teuthology.orchestra.run.smithi204.stdout:3002 trunc from 0xa2c9400 to 0x571d400 2024-09-12T16:16:49.925 INFO:teuthology.orchestra.run.smithi204.stdout:3003 write 0xbf6b800 thru 0xbf72792 (0x6f93 bytes) 2024-09-12T16:16:49.925 INFO:teuthology.orchestra.run.smithi204.stdout:3006 punch from 0x81d400 to 0x822a00, (0x5600 bytes) 2024-09-12T16:16:49.929 INFO:teuthology.orchestra.run.smithi204.stdout:3007 write 0xbbc8400 thru 0xbbcae51 (0x2a52 bytes) 2024-09-12T16:16:49.930 INFO:teuthology.orchestra.run.smithi204.stdout:3008 read 0xa653800 thru 0xa654bb7 (0x13b8 bytes) 2024-09-12T16:16:49.930 INFO:teuthology.orchestra.run.smithi204.stdout:3011 trunc from 0xbf72800 to 0x98c0c00 2024-09-12T16:16:49.944 INFO:teuthology.orchestra.run.smithi204.stdout:3015 read 0x44acc00 thru 0x44bb3a4 (0xe7a5 bytes) 2024-09-12T16:16:49.945 INFO:teuthology.orchestra.run.smithi204.stdout:3020 read 0x3f7ba00 thru 0x3f7d85f (0x1e60 bytes) 2024-09-12T16:16:49.946 INFO:teuthology.orchestra.run.smithi204.stdout:3021 read 0x159800 thru 0x15f657 (0x5e58 bytes) 2024-09-12T16:16:49.946 INFO:teuthology.orchestra.run.smithi204.stdout:3024 read 0x329c600 thru 0x32a9a59 (0xd45a bytes) 2024-09-12T16:16:49.946 INFO:teuthology.orchestra.run.smithi204.stdout:3028 read 0x67dac00 thru 0x67df0a9 (0x44aa bytes) 2024-09-12T16:16:49.952 INFO:teuthology.orchestra.run.smithi204.stdout:3029 trunc from 0x98c0c00 to 0xeab9600 2024-09-12T16:16:49.963 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:49.962+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:49.966 INFO:teuthology.orchestra.run.smithi204.stdout:3030 write 0xd1c6600 thru 0xd1c8db3 (0x27b4 bytes) 2024-09-12T16:16:49.966 INFO:teuthology.orchestra.run.smithi204.stdout:3031 punch from 0x5132400 to 0x5139c00, (0x7800 bytes) 2024-09-12T16:16:49.978 INFO:teuthology.orchestra.run.smithi204.stdout:3032 trunc from 0xeab9600 to 0x5355200 2024-09-12T16:16:49.992 INFO:teuthology.orchestra.run.smithi204.stdout:3034 read 0x3486200 thru 0x348c0bc (0x5ebd bytes) 2024-09-12T16:16:49.997 INFO:teuthology.orchestra.run.smithi204.stdout:3035 flatten 2024-09-12T16:16:50.009 INFO:teuthology.orchestra.run.smithi204.stdout:3037 trunc from 0x5355200 to 0x5a2b200 2024-09-12T16:16:50.027 INFO:teuthology.orchestra.run.smithi204.stdout:3038 read 0x240fe00 thru 0x2410ede (0x10df bytes) 2024-09-12T16:16:50.028 INFO:teuthology.orchestra.run.smithi204.stdout:3040 write 0x4265000 thru 0x4265ad0 (0xad1 bytes) 2024-09-12T16:16:50.028 INFO:teuthology.orchestra.run.smithi204.stdout:3041 read 0x1c1e400 thru 0x1c2d393 (0xef94 bytes) 2024-09-12T16:16:50.028 INFO:teuthology.orchestra.run.smithi204.stdout:3042 read 0x13e2600 thru 0x13e82e8 (0x5ce9 bytes) 2024-09-12T16:16:50.028 INFO:teuthology.orchestra.run.smithi204.stdout:3043 write 0xb0e800 thru 0xb11345 (0x2b46 bytes) 2024-09-12T16:16:50.028 INFO:teuthology.orchestra.run.smithi204.stdout:3044 read 0x52c9600 thru 0x52c9c2f (0x630 bytes) 2024-09-12T16:16:50.028 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:50.028 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:16:50.028 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:16:50.028 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:16:50.028 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:50.037 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:16:50.045 INFO:teuthology.orchestra.run.smithi204.stdout:3045 write 0x5e26400 thru 0x5e2fde8 (0x99e9 bytes) 2024-09-12T16:16:50.063 INFO:teuthology.orchestra.run.smithi204.stdout:3047 write 0xaec0200 thru 0xaecf9e8 (0xf7e9 bytes) 2024-09-12T16:16:50.064 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:50.063+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:50.064 INFO:teuthology.orchestra.run.smithi204.stdout:3048 read 0x3d9c600 thru 0x3da981e (0xd21f bytes) 2024-09-12T16:16:50.064 INFO:teuthology.orchestra.run.smithi204.stdout:3050 write 0x5aa1e00 thru 0x5aa8d2d (0x6f2e bytes) 2024-09-12T16:16:50.084 INFO:teuthology.orchestra.run.smithi204.stdout:3052 write 0xd380a00 thru 0xd382240 (0x1841 bytes) 2024-09-12T16:16:50.084 INFO:teuthology.orchestra.run.smithi204.stdout:3055 read 0xc52600 thru 0xc5f2be (0xccbf bytes) 2024-09-12T16:16:50.084 INFO:teuthology.orchestra.run.smithi204.stdout:3056 write 0x82daa00 thru 0x82dae8d (0x48e bytes) 2024-09-12T16:16:50.085 INFO:teuthology.orchestra.run.smithi204.stdout:3057 write 0x6829200 thru 0x682d901 (0x4702 bytes) 2024-09-12T16:16:50.085 INFO:teuthology.orchestra.run.smithi204.stdout:3058 write 0xa72fe00 thru 0xa737e50 (0x8051 bytes) 2024-09-12T16:16:50.091 INFO:teuthology.orchestra.run.smithi204.stdout:3061 trunc from 0xd382400 to 0x72b3600 2024-09-12T16:16:50.116 INFO:teuthology.orchestra.run.smithi204.stdout:3063 read 0x30a5a00 thru 0x30a8670 (0x2c71 bytes) 2024-09-12T16:16:50.116 INFO:teuthology.orchestra.run.smithi204.stdout:3064 write 0x2beba00 thru 0x2bf1ad5 (0x60d6 bytes) 2024-09-12T16:16:50.123 INFO:teuthology.orchestra.run.smithi204.stdout:3065 trunc from 0x72b3600 to 0x1802c00 2024-09-12T16:16:50.146 INFO:teuthology.orchestra.run.smithi204.stdout:3066 read 0x3a2400 thru 0x3af4da (0xd0db bytes) 2024-09-12T16:16:50.147 INFO:teuthology.orchestra.run.smithi204.stdout:3067 punch from 0xe7a000 to 0xe87200, (0xd200 bytes) 2024-09-12T16:16:50.147 INFO:teuthology.orchestra.run.smithi204.stdout:3071 punch from 0x16c0000 to 0x16cec00, (0xec00 bytes) 2024-09-12T16:16:50.148 INFO:teuthology.orchestra.run.smithi204.stdout:3072 read 0x7afa00 thru 0x7bc879 (0xce7a bytes) 2024-09-12T16:16:50.149 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:50.149 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:16:50.149 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:16:50.149 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:16:50.149 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.149 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:16:50.149 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:16:50.149 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 68.381972211000004, 2024-09-12T16:16:50.149 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55645454900000002, 2024-09-12T16:16:50.149 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:50.149 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:50.149 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:50.149 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:50.150 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:16:50.150 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:16:50.150 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1 2024-09-12T16:16:50.150 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.150 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:50.150 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.150 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:50.150 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:16:50.150 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.150 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.150 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.150 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:50.150 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:16:50.150 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.150 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.151 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.151 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:50.151 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764440+0000", 2024-09-12T16:16:50.151 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6249999999999999e-06 2024-09-12T16:16:50.151 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.151 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.151 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:50.151 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764447+0000", 2024-09-12T16:16:50.151 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4939999999999997e-06 2024-09-12T16:16:50.151 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.151 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.151 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:50.151 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764459+0000", 2024-09-12T16:16:50.151 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1517e-05 2024-09-12T16:16:50.151 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.152 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.152 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:50.152 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764468+0000", 2024-09-12T16:16:50.152 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7690000000000002e-06 2024-09-12T16:16:50.152 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.152 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.152 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:50.152 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764539+0000", 2024-09-12T16:16:50.152 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1103e-05 2024-09-12T16:16:50.152 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.152 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.152 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:16:50.152 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764551+0000", 2024-09-12T16:16:50.152 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2687999999999999e-05 2024-09-12T16:16:50.153 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.153 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.153 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:50.153 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319497+0000", 2024-09-12T16:16:50.153 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55494560500000001 2024-09-12T16:16:50.153 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.153 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.153 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:50.153 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319688+0000", 2024-09-12T16:16:50.153 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019105599999999999 2024-09-12T16:16:50.153 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.153 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.153 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:16:50.153 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319842+0000", 2024-09-12T16:16:50.153 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015377699999999999 2024-09-12T16:16:50.154 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.154 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.154 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:16:50.154 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320473+0000", 2024-09-12T16:16:50.154 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00063117100000000003 2024-09-12T16:16:50.154 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.154 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.154 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:50.154 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320825+0000", 2024-09-12T16:16:50.154 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00035202500000000001 2024-09-12T16:16:50.154 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.154 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.154 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:16:50.154 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320867+0000", 2024-09-12T16:16:50.155 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2005000000000002e-05 2024-09-12T16:16:50.155 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.155 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.155 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:50.155 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320893+0000", 2024-09-12T16:16:50.155 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5714000000000001e-05 2024-09-12T16:16:50.155 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.155 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:50.155 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.155 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.155 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.155 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14034 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5035008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:50.155 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:16:50.155 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 30.624913977999999, 2024-09-12T16:16:50.156 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053404082999999998, 2024-09-12T16:16:50.156 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:50.156 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:50.156 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:50.156 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:50.156 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:50.156 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:50.156 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14034 2024-09-12T16:16:50.156 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.156 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:50.156 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.156 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:50.156 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:16:50.157 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.157 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.157 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.157 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:50.157 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:16:50.157 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.157 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.157 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.157 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:50.157 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521740+0000", 2024-09-12T16:16:50.157 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000243976 2024-09-12T16:16:50.157 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.157 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.157 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:50.158 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521745+0000", 2024-09-12T16:16:50.158 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1280000000000001e-06 2024-09-12T16:16:50.158 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.158 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.158 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:50.158 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521757+0000", 2024-09-12T16:16:50.158 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2751e-05 2024-09-12T16:16:50.158 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.158 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.158 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:50.158 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521771+0000", 2024-09-12T16:16:50.158 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3328e-05 2024-09-12T16:16:50.158 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.159 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.159 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:50.159 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574710+0000", 2024-09-12T16:16:50.159 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052939358999999998 2024-09-12T16:16:50.159 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.159 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.159 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:50.159 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574799+0000", 2024-09-12T16:16:50.159 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8893000000000004e-05 2024-09-12T16:16:50.159 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.159 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.159 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:50.159 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574901+0000", 2024-09-12T16:16:50.160 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101648 2024-09-12T16:16:50.160 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.160 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:50.160 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.160 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.160 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.160 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14036 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5043200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:50.160 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:16:50.160 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 30.624454784000001, 2024-09-12T16:16:50.160 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053426247000000003, 2024-09-12T16:16:50.160 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:50.160 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:50.160 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:50.160 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:50.160 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:50.161 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:50.161 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14036 2024-09-12T16:16:50.161 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.161 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:50.161 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.161 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:50.161 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:16:50.161 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.161 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.161 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.161 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:50.161 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:16:50.161 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.161 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.161 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.162 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:50.162 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522208+0000", 2024-09-12T16:16:50.162 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025195300000000002 2024-09-12T16:16:50.162 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.162 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.162 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:50.162 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522211+0000", 2024-09-12T16:16:50.162 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2160000000000002e-06 2024-09-12T16:16:50.162 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.162 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.162 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:50.162 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522223+0000", 2024-09-12T16:16:50.162 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2044e-05 2024-09-12T16:16:50.162 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.163 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.163 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:50.163 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522229+0000", 2024-09-12T16:16:50.163 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8850000000000004e-06 2024-09-12T16:16:50.163 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.163 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.163 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:50.163 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575192+0000", 2024-09-12T16:16:50.163 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052963573 2024-09-12T16:16:50.163 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.163 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.163 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:50.163 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575282+0000", 2024-09-12T16:16:50.163 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9666000000000005e-05 2024-09-12T16:16:50.164 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.164 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.164 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:50.164 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575382+0000", 2024-09-12T16:16:50.164 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9909999999999997e-05 2024-09-12T16:16:50.164 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.164 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:50.164 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.164 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.164 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.164 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14037 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5047296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:50.164 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522245+0000", 2024-09-12T16:16:50.164 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 30.624165949000002, 2024-09-12T16:16:50.165 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053384907000000002, 2024-09-12T16:16:50.165 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:50.165 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:50.165 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:50.165 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:50.165 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:50.165 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:50.165 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14037 2024-09-12T16:16:50.165 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.165 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:50.165 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.165 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:50.165 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522245+0000", 2024-09-12T16:16:50.165 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.166 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.166 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.166 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:50.166 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522245+0000", 2024-09-12T16:16:50.166 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.166 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.166 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.166 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:50.166 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522471+0000", 2024-09-12T16:16:50.166 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022601300000000001 2024-09-12T16:16:50.166 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.166 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.166 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:50.166 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522474+0000", 2024-09-12T16:16:50.167 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3390000000000001e-06 2024-09-12T16:16:50.167 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.167 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.167 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:50.167 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522482+0000", 2024-09-12T16:16:50.167 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7919999999999993e-06 2024-09-12T16:16:50.167 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.167 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.167 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:50.167 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522486+0000", 2024-09-12T16:16:50.167 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5109999999999997e-06 2024-09-12T16:16:50.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.168 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.168 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:50.168 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575433+0000", 2024-09-12T16:16:50.168 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052946673999999999 2024-09-12T16:16:50.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.168 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.168 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:50.168 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575532+0000", 2024-09-12T16:16:50.168 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9128000000000004e-05 2024-09-12T16:16:50.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.168 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.169 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:50.169 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575629+0000", 2024-09-12T16:16:50.169 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7449999999999997e-05 2024-09-12T16:16:50.169 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.169 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:50.169 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.169 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.169 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.169 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14038 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5051392~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:50.169 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:16:50.169 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 30.623916411, 2024-09-12T16:16:50.169 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053395152000000001, 2024-09-12T16:16:50.169 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:50.170 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:50.170 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:50.170 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:50.170 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:50.170 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:50.170 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14038 2024-09-12T16:16:50.170 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.170 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:50.170 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.170 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:50.170 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:16:50.170 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.170 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.170 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.171 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:50.171 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:16:50.171 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.171 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.171 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.171 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:50.171 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522601+0000", 2024-09-12T16:16:50.171 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010702899999999999 2024-09-12T16:16:50.171 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.171 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.171 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:50.171 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522605+0000", 2024-09-12T16:16:50.171 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2379999999999999e-06 2024-09-12T16:16:50.171 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.172 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.172 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:50.172 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522616+0000", 2024-09-12T16:16:50.172 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1185999999999999e-05 2024-09-12T16:16:50.172 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.172 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.172 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:50.172 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522624+0000", 2024-09-12T16:16:50.172 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1099999999999997e-06 2024-09-12T16:16:50.172 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.172 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.172 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:50.172 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575677+0000", 2024-09-12T16:16:50.172 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053126999999999 2024-09-12T16:16:50.173 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.173 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.173 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:50.173 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575764+0000", 2024-09-12T16:16:50.173 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7250000000000007e-05 2024-09-12T16:16:50.173 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.173 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.173 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:50.173 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575889+0000", 2024-09-12T16:16:50.173 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012521200000000001 2024-09-12T16:16:50.173 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.173 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:50.173 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.173 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.173 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.174 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14039 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5055488~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:50.174 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:16:50.174 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 30.623774999999998, 2024-09-12T16:16:50.174 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053466207000000002, 2024-09-12T16:16:50.174 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:50.174 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:50.174 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:50.174 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:50.174 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:50.174 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:50.174 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14039 2024-09-12T16:16:50.174 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.174 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:50.174 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.175 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:50.175 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:16:50.175 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.175 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.175 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.175 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:50.175 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:16:50.175 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.175 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.175 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.175 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:50.175 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522899+0000", 2024-09-12T16:16:50.175 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026318199999999999 2024-09-12T16:16:50.175 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.175 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.176 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:50.176 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522903+0000", 2024-09-12T16:16:50.176 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.929e-06 2024-09-12T16:16:50.176 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.176 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.176 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:50.176 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522913+0000", 2024-09-12T16:16:50.176 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0162e-05 2024-09-12T16:16:50.176 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.176 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.176 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:50.176 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522921+0000", 2024-09-12T16:16:50.176 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.14e-06 2024-09-12T16:16:50.177 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.177 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.177 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:50.177 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575922+0000", 2024-09-12T16:16:50.177 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053000712999999998 2024-09-12T16:16:50.177 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.177 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.177 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:50.177 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576006+0000", 2024-09-12T16:16:50.177 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4161999999999998e-05 2024-09-12T16:16:50.177 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.177 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.177 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:50.178 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576102+0000", 2024-09-12T16:16:50.178 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5919000000000001e-05 2024-09-12T16:16:50.178 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.178 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:50.178 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.178 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.178 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.178 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14040 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5059584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:50.178 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:16:50.178 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 30.623470104999999, 2024-09-12T16:16:50.178 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053413258999999998, 2024-09-12T16:16:50.178 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:50.179 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:50.179 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:50.179 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:50.179 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:50.179 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:50.179 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14040 2024-09-12T16:16:50.179 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.179 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:50.179 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.179 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:50.179 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:16:50.179 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.179 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.180 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.180 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:50.180 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:16:50.180 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.180 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.180 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.180 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:50.180 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523059+0000", 2024-09-12T16:16:50.180 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118466 2024-09-12T16:16:50.180 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.180 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.180 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:50.180 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523062+0000", 2024-09-12T16:16:50.180 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.971e-06 2024-09-12T16:16:50.181 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.181 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.181 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:50.181 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523069+0000", 2024-09-12T16:16:50.181 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8279999999999997e-06 2024-09-12T16:16:50.181 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.181 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.181 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:50.181 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523073+0000", 2024-09-12T16:16:50.181 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3019999999999996e-06 2024-09-12T16:16:50.181 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.181 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.182 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:50.182 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576155+0000", 2024-09-12T16:16:50.182 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053081962000000003 2024-09-12T16:16:50.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.182 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.182 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:50.182 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576249+0000", 2024-09-12T16:16:50.182 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3914999999999998e-05 2024-09-12T16:16:50.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.182 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.182 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:50.182 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576354+0000", 2024-09-12T16:16:50.182 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010481500000000001 2024-09-12T16:16:50.182 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.182 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:50.183 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.183 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.183 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.183 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14041 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5063680~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:50.183 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:16:50.183 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 30.623319800000001, 2024-09-12T16:16:50.183 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053519111000000001, 2024-09-12T16:16:50.183 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:50.183 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:50.183 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:50.183 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:50.183 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:50.183 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:50.183 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14041 2024-09-12T16:16:50.183 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.184 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:50.184 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.184 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:50.184 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:16:50.184 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.184 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.184 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.184 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:50.184 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:16:50.184 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.184 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.184 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.185 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:50.185 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523309+0000", 2024-09-12T16:16:50.185 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000218712 2024-09-12T16:16:50.185 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.185 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.185 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:50.185 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523313+0000", 2024-09-12T16:16:50.185 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.151e-06 2024-09-12T16:16:50.185 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.185 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.185 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:50.185 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523320+0000", 2024-09-12T16:16:50.185 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9789999999999993e-06 2024-09-12T16:16:50.185 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.185 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.186 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:50.186 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523325+0000", 2024-09-12T16:16:50.186 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:16:50.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.186 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.186 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:50.186 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576402+0000", 2024-09-12T16:16:50.186 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053076811000000002 2024-09-12T16:16:50.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.186 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.186 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:50.186 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576491+0000", 2024-09-12T16:16:50.186 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8578999999999993e-05 2024-09-12T16:16:50.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.187 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.187 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:50.187 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576610+0000", 2024-09-12T16:16:50.187 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119129 2024-09-12T16:16:50.187 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.187 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:50.187 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.187 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.187 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.187 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14042 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5067776~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:50.187 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:16:50.187 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 30.623076365999999, 2024-09-12T16:16:50.187 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053510350999999998, 2024-09-12T16:16:50.187 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:50.188 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:50.188 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:50.188 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:50.188 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:50.188 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:50.188 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14042 2024-09-12T16:16:50.188 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.188 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:50.188 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.188 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:50.188 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:16:50.188 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.189 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.189 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.189 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:50.189 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:16:50.189 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.189 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.189 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.189 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:50.189 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523591+0000", 2024-09-12T16:16:50.189 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025710300000000001 2024-09-12T16:16:50.189 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.189 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.189 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:50.189 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523594+0000", 2024-09-12T16:16:50.189 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2229999999999999e-06 2024-09-12T16:16:50.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.190 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.190 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:50.190 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523602+0000", 2024-09-12T16:16:50.190 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6930000000000007e-06 2024-09-12T16:16:50.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.190 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.190 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:50.190 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523607+0000", 2024-09-12T16:16:50.190 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4789999999999998e-06 2024-09-12T16:16:50.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.190 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.190 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:50.191 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576661+0000", 2024-09-12T16:16:50.191 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053973999999997 2024-09-12T16:16:50.191 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.191 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.191 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:50.191 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576745+0000", 2024-09-12T16:16:50.191 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4660000000000006e-05 2024-09-12T16:16:50.191 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.191 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.191 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:50.191 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576844+0000", 2024-09-12T16:16:50.191 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9219e-05 2024-09-12T16:16:50.191 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.191 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:50.192 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.192 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.192 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.192 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14043 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5071872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:50.192 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:16:50.192 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 30.622795886999999, 2024-09-12T16:16:50.192 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053475295999999999, 2024-09-12T16:16:50.192 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:50.192 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:50.192 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:50.192 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:50.192 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:50.192 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:50.193 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14043 2024-09-12T16:16:50.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.193 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:50.193 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.193 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:50.193 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:16:50.193 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.193 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.193 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:50.193 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:16:50.193 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.194 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.194 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:50.194 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523823+0000", 2024-09-12T16:16:50.194 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020818900000000001 2024-09-12T16:16:50.194 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.194 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.194 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:50.194 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523826+0000", 2024-09-12T16:16:50.194 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.405e-06 2024-09-12T16:16:50.194 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.194 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.194 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:50.194 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523834+0000", 2024-09-12T16:16:50.194 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5499999999999997e-06 2024-09-12T16:16:50.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:50.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523838+0000", 2024-09-12T16:16:50.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.408e-06 2024-09-12T16:16:50.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:50.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576904+0000", 2024-09-12T16:16:50.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053065687 2024-09-12T16:16:50.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:50.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576991+0000", 2024-09-12T16:16:50.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7399999999999997e-05 2024-09-12T16:16:50.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.196 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:50.196 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577090+0000", 2024-09-12T16:16:50.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8657000000000001e-05 2024-09-12T16:16:50.196 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.196 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:50.196 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.196 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14044 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5075968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:50.196 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:16:50.196 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 30.622564357000002, 2024-09-12T16:16:50.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053442659000000003, 2024-09-12T16:16:50.197 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:50.197 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:50.197 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:50.197 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:50.197 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:50.197 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:50.197 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14044 2024-09-12T16:16:50.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.197 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:50.197 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.197 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:50.197 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:16:50.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.198 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.198 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:50.198 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:16:50.198 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.198 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.198 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:50.198 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523985+0000", 2024-09-12T16:16:50.198 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000138522 2024-09-12T16:16:50.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.198 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.198 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:50.198 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523988+0000", 2024-09-12T16:16:50.198 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.788e-06 2024-09-12T16:16:50.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:50.199 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523998+0000", 2024-09-12T16:16:50.199 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8470000000000008e-06 2024-09-12T16:16:50.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:50.199 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524010+0000", 2024-09-12T16:16:50.199 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1348999999999999e-05 2024-09-12T16:16:50.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:50.199 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577137+0000", 2024-09-12T16:16:50.199 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053127055999999999 2024-09-12T16:16:50.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:50.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577210+0000", 2024-09-12T16:16:50.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3392000000000005e-05 2024-09-12T16:16:50.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:50.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577289+0000", 2024-09-12T16:16:50.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8704999999999999e-05 2024-09-12T16:16:50.200 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.200 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:50.200 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.200 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14045 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5080064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:50.201 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:16:50.201 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 30.622385535999999, 2024-09-12T16:16:50.201 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053497514000000003, 2024-09-12T16:16:50.201 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:50.201 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:50.201 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:50.201 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:50.201 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:50.201 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:50.201 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14045 2024-09-12T16:16:50.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.201 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:50.201 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.202 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:50.202 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:16:50.202 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.202 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.202 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.202 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:50.202 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:16:50.202 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.202 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.202 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.202 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:50.202 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524311+0000", 2024-09-12T16:16:50.202 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028626299999999998 2024-09-12T16:16:50.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:50.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524315+0000", 2024-09-12T16:16:50.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0969999999999999e-06 2024-09-12T16:16:50.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:50.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524325+0000", 2024-09-12T16:16:50.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6330000000000008e-06 2024-09-12T16:16:50.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:50.204 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524332+0000", 2024-09-12T16:16:50.204 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8700000000000003e-06 2024-09-12T16:16:50.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.204 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.204 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:50.204 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577334+0000", 2024-09-12T16:16:50.204 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053001834999999997 2024-09-12T16:16:50.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.204 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.204 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:50.204 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577420+0000", 2024-09-12T16:16:50.204 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6145999999999998e-05 2024-09-12T16:16:50.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.205 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:50.205 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577522+0000", 2024-09-12T16:16:50.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010267 2024-09-12T16:16:50.205 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.205 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:50.205 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.205 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14047 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5088256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:50.205 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:16:50.205 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 30.621899809999999, 2024-09-12T16:16:50.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053433340000000003, 2024-09-12T16:16:50.205 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:50.205 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:50.206 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:50.206 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:50.206 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:50.206 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:50.206 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14047 2024-09-12T16:16:50.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.206 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:50.206 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.206 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:50.206 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:16:50.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.206 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.206 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:50.206 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:16:50.207 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.207 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:50.207 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524727+0000", 2024-09-12T16:16:50.207 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000216126 2024-09-12T16:16:50.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.207 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:50.207 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524732+0000", 2024-09-12T16:16:50.207 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1569999999999999e-06 2024-09-12T16:16:50.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.207 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:50.208 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524742+0000", 2024-09-12T16:16:50.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0186999999999999e-05 2024-09-12T16:16:50.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.208 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.208 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:50.208 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524750+0000", 2024-09-12T16:16:50.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4279999999999999e-06 2024-09-12T16:16:50.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.208 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.208 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:50.208 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577743+0000", 2024-09-12T16:16:50.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052993077 2024-09-12T16:16:50.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:50.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577841+0000", 2024-09-12T16:16:50.209 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8369000000000006e-05 2024-09-12T16:16:50.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:50.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577944+0000", 2024-09-12T16:16:50.209 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102996 2024-09-12T16:16:50.209 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.209 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:50.209 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.209 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14048 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5092352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:50.210 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:16:50.210 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 30.621648217000001, 2024-09-12T16:16:50.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053397515, 2024-09-12T16:16:50.210 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:50.210 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:50.210 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:50.210 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:50.210 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:50.210 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:50.210 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14048 2024-09-12T16:16:50.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.210 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:50.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.211 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:50.211 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:16:50.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.211 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:50.211 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:16:50.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.211 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:50.211 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524957+0000", 2024-09-12T16:16:50.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019516999999999999 2024-09-12T16:16:50.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:50.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524962+0000", 2024-09-12T16:16:50.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7709999999999997e-06 2024-09-12T16:16:50.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:50.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524973+0000", 2024-09-12T16:16:50.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1031e-05 2024-09-12T16:16:50.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:50.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524980+0000", 2024-09-12T16:16:50.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6100000000000002e-06 2024-09-12T16:16:50.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.213 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:50.213 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577977+0000", 2024-09-12T16:16:50.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052997481999999999 2024-09-12T16:16:50.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.213 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:50.213 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578062+0000", 2024-09-12T16:16:50.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4851000000000005e-05 2024-09-12T16:16:50.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.213 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:50.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578160+0000", 2024-09-12T16:16:50.214 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7600000000000001e-05 2024-09-12T16:16:50.214 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.214 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:50.214 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.214 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.214 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14049 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5096448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:50.214 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:16:50.214 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 30.621419588999998, 2024-09-12T16:16:50.214 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053439792, 2024-09-12T16:16:50.214 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:50.214 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:50.214 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:50.214 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:50.214 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:50.215 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:50.215 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14049 2024-09-12T16:16:50.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.215 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:50.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.215 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:50.215 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:16:50.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.215 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:50.215 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:16:50.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.216 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:50.216 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525170+0000", 2024-09-12T16:16:50.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017958500000000001 2024-09-12T16:16:50.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.216 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:50.216 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525174+0000", 2024-09-12T16:16:50.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0239999999999999e-06 2024-09-12T16:16:50.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.216 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:50.216 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525184+0000", 2024-09-12T16:16:50.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5950000000000005e-06 2024-09-12T16:16:50.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:50.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525191+0000", 2024-09-12T16:16:50.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8329999999999996e-06 2024-09-12T16:16:50.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:50.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578240+0000", 2024-09-12T16:16:50.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053049236 2024-09-12T16:16:50.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:50.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578333+0000", 2024-09-12T16:16:50.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2806999999999994e-05 2024-09-12T16:16:50.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:50.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578431+0000", 2024-09-12T16:16:50.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7712000000000002e-05 2024-09-12T16:16:50.218 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.218 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:50.218 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.218 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14050 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5100544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:50.218 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.525201+0000", 2024-09-12T16:16:50.218 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 30.621209036, 2024-09-12T16:16:50.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053367398000000003, 2024-09-12T16:16:50.218 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:50.219 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:50.219 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:50.219 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:50.219 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:50.219 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:50.219 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14050 2024-09-12T16:16:50.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.219 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:50.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:50.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525201+0000", 2024-09-12T16:16:50.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:50.220 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525201+0000", 2024-09-12T16:16:50.220 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.220 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.220 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:50.220 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525449+0000", 2024-09-12T16:16:50.220 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00024803999999999999 2024-09-12T16:16:50.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.220 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.220 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:50.220 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525453+0000", 2024-09-12T16:16:50.220 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.036e-06 2024-09-12T16:16:50.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.220 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.220 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:50.221 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525462+0000", 2024-09-12T16:16:50.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6090000000000001e-06 2024-09-12T16:16:50.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.221 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.221 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:50.221 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525472+0000", 2024-09-12T16:16:50.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9629999999999993e-06 2024-09-12T16:16:50.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.221 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.221 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:50.221 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578469+0000", 2024-09-12T16:16:50.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052996877999999997 2024-09-12T16:16:50.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:50.222 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578514+0000", 2024-09-12T16:16:50.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5460000000000002e-05 2024-09-12T16:16:50.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:50.222 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578569+0000", 2024-09-12T16:16:50.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4412e-05 2024-09-12T16:16:50.222 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.222 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:50.222 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.223 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14054 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5116928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:50.223 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.526046+0000", 2024-09-12T16:16:50.223 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 30.620364240000001, 2024-09-12T16:16:50.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053378408000000002, 2024-09-12T16:16:50.223 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:50.223 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:50.223 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:50.223 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:50.223 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:50.223 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:50.223 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14054 2024-09-12T16:16:50.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.223 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:50.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:50.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526046+0000", 2024-09-12T16:16:50.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:50.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526046+0000", 2024-09-12T16:16:50.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:50.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526228+0000", 2024-09-12T16:16:50.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018200200000000001 2024-09-12T16:16:50.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:50.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526236+0000", 2024-09-12T16:16:50.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5109999999999997e-06 2024-09-12T16:16:50.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:50.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526245+0000", 2024-09-12T16:16:50.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9600000000000006e-06 2024-09-12T16:16:50.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:50.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526251+0000", 2024-09-12T16:16:50.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5520000000000001e-06 2024-09-12T16:16:50.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:50.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579226+0000", 2024-09-12T16:16:50.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052974343 2024-09-12T16:16:50.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:50.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579324+0000", 2024-09-12T16:16:50.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8517000000000006e-05 2024-09-12T16:16:50.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:50.227 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579425+0000", 2024-09-12T16:16:50.227 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000100523 2024-09-12T16:16:50.227 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.227 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:50.227 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.227 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.227 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14055 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5121024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:50.227 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:16:50.227 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 30.620148898, 2024-09-12T16:16:50.227 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053399038000000003, 2024-09-12T16:16:50.227 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:50.227 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:50.227 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:50.227 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:50.227 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:16:50.228 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:50.228 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14055 2024-09-12T16:16:50.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.228 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:50.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.228 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:50.228 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:16:50.228 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.228 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:50.228 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:16:50.228 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.228 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:50.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526403+0000", 2024-09-12T16:16:50.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141571 2024-09-12T16:16:50.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:50.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526406+0000", 2024-09-12T16:16:50.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2660000000000002e-06 2024-09-12T16:16:50.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:50.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526420+0000", 2024-09-12T16:16:50.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3949e-05 2024-09-12T16:16:50.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:50.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526428+0000", 2024-09-12T16:16:50.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4250000000000001e-06 2024-09-12T16:16:50.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:50.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579476+0000", 2024-09-12T16:16:50.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053048349000000002 2024-09-12T16:16:50.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:50.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579563+0000", 2024-09-12T16:16:50.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6502999999999995e-05 2024-09-12T16:16:50.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.231 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:50.231 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579661+0000", 2024-09-12T16:16:50.231 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7974999999999996e-05 2024-09-12T16:16:50.231 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.231 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:50.231 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.231 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.231 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4806.0:3139 3.1e 3:78d5a095:::rbd_data.11552a37e55b.0000000000000000:head [read 69632~61440] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:16:50.231 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:16:50.231 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 19.845154648000001, 2024-09-12T16:16:50.231 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057851734000000002, 2024-09-12T16:16:50.231 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:50.231 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:50.231 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:50.232 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:50.232 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4806", 2024-09-12T16:16:50.232 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3959815836", 2024-09-12T16:16:50.232 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 3139 2024-09-12T16:16:50.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.232 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:50.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:50.232 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:16:50.232 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:50.232 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:16:50.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.233 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:50.233 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:16:50.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4799999999999999e-07 2024-09-12T16:16:50.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.233 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:50.233 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301258+0000", 2024-09-12T16:16:50.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.844e-06 2024-09-12T16:16:50.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.233 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:50.234 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301267+0000", 2024-09-12T16:16:50.234 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2960000000000004e-06 2024-09-12T16:16:50.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.234 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.234 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:50.234 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301276+0000", 2024-09-12T16:16:50.234 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0650000000000005e-06 2024-09-12T16:16:50.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.234 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.234 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:50.234 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301871+0000", 2024-09-12T16:16:50.234 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00059423600000000005 2024-09-12T16:16:50.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.235 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.235 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:50.235 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301920+0000", 2024-09-12T16:16:50.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9067000000000003e-05 2024-09-12T16:16:50.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.235 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.235 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:50.235 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359108+0000", 2024-09-12T16:16:50.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057187877999999998 2024-09-12T16:16:50.235 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.235 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:50.235 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.236 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.236 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.236 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:6428 3.14 3:28a44e54:::rbd_header.11552a37e55b:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:16:50.236 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:16:50.236 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 19.844826053999999, 2024-09-12T16:16:50.236 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057504023000000001, 2024-09-12T16:16:50.236 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:50.236 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:50.236 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:50.236 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:50.236 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:16:50.236 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:50.236 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6428 2024-09-12T16:16:50.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.237 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:50.237 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.237 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:50.237 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:16:50.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.237 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.237 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:50.237 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:16:50.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:50.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.237 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.237 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:50.237 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301585+0000", 2024-09-12T16:16:50.238 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6300000000000005e-07 2024-09-12T16:16:50.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.238 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:50.238 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301588+0000", 2024-09-12T16:16:50.238 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4149999999999999e-06 2024-09-12T16:16:50.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.238 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:50.238 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301597+0000", 2024-09-12T16:16:50.238 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5450000000000003e-06 2024-09-12T16:16:50.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.239 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:50.239 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301617+0000", 2024-09-12T16:16:50.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9837e-05 2024-09-12T16:16:50.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.239 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:50.239 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301779+0000", 2024-09-12T16:16:50.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016186799999999999 2024-09-12T16:16:50.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.239 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:50.239 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301855+0000", 2024-09-12T16:16:50.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5899e-05 2024-09-12T16:16:50.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:50.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:50.240 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:50.240 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359088+0000", 2024-09-12T16:16:50.240 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057233895999999999 2024-09-12T16:16:50.240 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.240 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:50.240 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.240 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:50.240 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:50.240 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:50.240 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5] out_osds: [3] dead_osds: [5] live_osds: [0, 1, 2, 3, 4] 2024-09-12T16:16:50.241 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T16:16:50.241 INFO:tasks.thrashosds.thrasher:Adding osd 3 2024-09-12T16:16:50.243 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 3 2024-09-12T16:16:50.246 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-12T16:16:50.246 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:16:50.247 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:50.240+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:50.249 INFO:teuthology.orchestra.run.smithi204.stdout:3073 write 0x920a200 thru 0x92133ab (0x91ac bytes) 2024-09-12T16:16:50.249 INFO:teuthology.orchestra.run.smithi204.stdout:3075 read 0x2a82400 thru 0x2a88cf0 (0x68f1 bytes) 2024-09-12T16:16:50.249 INFO:teuthology.orchestra.run.smithi204.stdout:3076 read 0x10a1c00 thru 0x10a8f01 (0x7302 bytes) 2024-09-12T16:16:50.249 INFO:teuthology.orchestra.run.smithi204.stdout:3077 punch from 0x1fa4a00 to 0x1fb2400, (0xda00 bytes) 2024-09-12T16:16:50.249 INFO:teuthology.orchestra.run.smithi204.stdout:3078 read 0x6f8c400 thru 0x6f9785e (0xb45f bytes) 2024-09-12T16:16:50.249 INFO:teuthology.orchestra.run.smithi204.stdout:3080 read 0x296d600 thru 0x297b3fa (0xddfb bytes) 2024-09-12T16:16:50.249 INFO:teuthology.orchestra.run.smithi204.stdout:3082 read 0x719fe00 thru 0x71aca59 (0xcc5a bytes) 2024-09-12T16:16:50.249 INFO:teuthology.orchestra.run.smithi204.stdout:3084 read 0x41fae00 thru 0x41fd027 (0x2228 bytes) 2024-09-12T16:16:50.249 INFO:teuthology.orchestra.run.smithi204.stdout:3087 read 0x3a94a00 thru 0x3a98520 (0x3b21 bytes) 2024-09-12T16:16:50.249 INFO:teuthology.orchestra.run.smithi204.stdout:3088 read 0x8e1ac00 thru 0x8e1e3ae (0x37af bytes) 2024-09-12T16:16:50.249 INFO:teuthology.orchestra.run.smithi204.stdout:3090 punch from 0x37b5800 to 0x37ba800, (0x5000 bytes) 2024-09-12T16:16:50.249 INFO:teuthology.orchestra.run.smithi204.stdout:3091 read 0x1389800 thru 0x1398e8b (0xf68c bytes) 2024-09-12T16:16:50.249 INFO:teuthology.orchestra.run.smithi204.stdout:3092 read 0x7a0c000 thru 0x7a1735a (0xb35b bytes) 2024-09-12T16:16:50.250 INFO:teuthology.orchestra.run.smithi204.stdout:3095 punch from 0x946e00 to 0x94ce00, (0x6000 bytes) 2024-09-12T16:16:50.250 INFO:teuthology.orchestra.run.smithi204.stdout:3098 read 0x919da00 thru 0x91ad73a (0xfd3b bytes) 2024-09-12T16:16:50.250 INFO:teuthology.orchestra.run.smithi204.stdout:3100 read 0x1d83e00 thru 0x1d8b4d4 (0x76d5 bytes) 2024-09-12T16:16:50.250 INFO:teuthology.orchestra.run.smithi204.stdout:3102 write 0xae39400 thru 0xae42eb8 (0x9ab9 bytes) 2024-09-12T16:16:50.250 INFO:teuthology.orchestra.run.smithi204.stdout:3103 write 0x1d6a000 thru 0x1d6a31d (0x31e bytes) 2024-09-12T16:16:50.250 INFO:teuthology.orchestra.run.smithi204.stdout:3104 punch from 0x28ace00 to 0x28ae600, (0x1800 bytes) 2024-09-12T16:16:50.250 INFO:teuthology.orchestra.run.smithi204.stdout:3106 write 0x1601600 thru 0x160b791 (0xa192 bytes) 2024-09-12T16:16:50.250 INFO:teuthology.orchestra.run.smithi204.stdout:3108 write 0xae3e000 thru 0xae3ef5a (0xf5b bytes) 2024-09-12T16:16:50.250 INFO:teuthology.orchestra.run.smithi204.stdout:3111 write 0x353e800 thru 0x354c270 (0xda71 bytes) 2024-09-12T16:16:50.250 INFO:teuthology.orchestra.run.smithi204.stdout:3112 read 0x6433c00 thru 0x6438026 (0x4427 bytes) 2024-09-12T16:16:50.250 INFO:teuthology.orchestra.run.smithi204.stdout:3113 trunc from 0xae43000 to 0x3eab400 2024-09-12T16:16:50.250 INFO:teuthology.orchestra.run.smithi204.stdout:3115 trunc from 0x3eab400 to 0x3c62e00 2024-09-12T16:16:50.251 INFO:teuthology.orchestra.run.smithi204.stdout:3117 trunc from 0x3c62e00 to 0xd1a6c00 2024-09-12T16:16:50.254 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T16:16:50.265 INFO:teuthology.orchestra.run.smithi204.stdout:truncating to largest ever: 0xede5000 2024-09-12T16:16:50.267 INFO:teuthology.orchestra.run.smithi204.stdout:3119 trunc from 0xd1a6c00 to 0xede5000 2024-09-12T16:16:50.282 INFO:teuthology.orchestra.run.smithi204.stdout:3120 read 0x9abe000 thru 0x9ac718b (0x918c bytes) 2024-09-12T16:16:50.282 INFO:teuthology.orchestra.run.smithi204.stdout:3124 write 0xa7d5400 thru 0xa7da12e (0x4d2f bytes) 2024-09-12T16:16:50.296 INFO:teuthology.orchestra.run.smithi204.stdout:3125 trunc from 0xede5000 to 0x2875400 2024-09-12T16:16:50.342 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:50.341+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:50.350 INFO:teuthology.orchestra.run.smithi204.stdout:3126 write 0xbc24000 thru 0xbc2c528 (0x8529 bytes) 2024-09-12T16:16:50.350 INFO:teuthology.orchestra.run.smithi204.stdout:3127 read 0xb789200 thru 0xb79308d (0x9e8e bytes) 2024-09-12T16:16:50.350 INFO:teuthology.orchestra.run.smithi204.stdout:3128 write 0x6aa0e00 thru 0x6ab004f (0xf250 bytes) 2024-09-12T16:16:50.351 INFO:teuthology.orchestra.run.smithi204.stdout:3129 punch from 0x781c00 to 0x784c00, (0x3000 bytes) 2024-09-12T16:16:50.351 INFO:teuthology.orchestra.run.smithi204.stdout:3130 write 0xae00600 thru 0xae0942c (0x8e2d bytes) 2024-09-12T16:16:50.351 INFO:teuthology.orchestra.run.smithi204.stdout:3132 write 0xbb69600 thru 0xbb6be30 (0x2831 bytes) 2024-09-12T16:16:50.352 INFO:teuthology.orchestra.run.smithi204.stdout:3133 read 0x55f8c00 thru 0x5605345 (0xc746 bytes) 2024-09-12T16:16:50.352 INFO:teuthology.orchestra.run.smithi204.stdout:3137 read 0x23da000 thru 0x23e783e (0xd83f bytes) 2024-09-12T16:16:50.352 INFO:teuthology.orchestra.run.smithi204.stdout:3139 read 0x256ae00 thru 0x25711c5 (0x63c6 bytes) 2024-09-12T16:16:50.355 INFO:teuthology.orchestra.run.smithi204.stdout:3140 trunc from 0xbc2c600 to 0x8906800 2024-09-12T16:16:50.382 INFO:teuthology.orchestra.run.smithi204.stdout:3145 trunc from 0x8906800 to 0xccc7e00 2024-09-12T16:16:50.396 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:50.396 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:16:50.396 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:16:50.396 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:50.398 INFO:teuthology.orchestra.run.smithi204.stdout:3146 write 0x5f1aa00 thru 0x5f22261 (0x7862 bytes) 2024-09-12T16:16:50.398 INFO:teuthology.orchestra.run.smithi204.stdout:3147 write 0x922a00 thru 0x92a4e9 (0x7aea bytes) 2024-09-12T16:16:50.399 INFO:teuthology.orchestra.run.smithi204.stdout:3148 write 0x59a9c00 thru 0x59b16b2 (0x7ab3 bytes) 2024-09-12T16:16:50.399 INFO:teuthology.orchestra.run.smithi204.stdout:3149 clone 17 order 21 su 16384 sc 15 2024-09-12T16:16:50.405 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:16:50.439 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:16:50.439 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:16:50.443 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:50.442+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:50.472 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:16:50.472 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:16:50.489 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:16:50.489 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:16:50.506 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:16:50.506 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:16:50.512 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:50.512 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:16:50.512 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:16:50.512 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:16:50.512 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:50.521 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:16:50.523 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:16:50.523 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:16:50.523 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-12T16:16:50.526 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T16:16:50.526 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T16:16:50.565 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:50.564+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:50.628 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:50.628 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:50.636 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:16:50.642 INFO:tasks.ceph.mon.a.smithi017.stderr:2024-09-12T16:16:50.641+0000 7f3942a34640 -1 mon.a@0(leader).osd e60 definitely_dead 0 2024-09-12T16:16:50.677 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:50.676+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:50.743 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:50.743 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:50.744 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:50.744+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:50.752 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:16:50.845 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:50.844+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:50.898 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:50.898 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:50.907 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:16:50.946 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:50.946+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:51.047 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:51.047+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:51.055 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:51.056 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:51.064 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:16:51.148 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:51.148+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:51.180 INFO:teuthology.orchestra.run.smithi017.stderr:marked in osd.3. 2024-09-12T16:16:51.199 INFO:tasks.thrashosds.thrasher:Added osd 3 2024-09-12T16:16:51.222 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:51.222 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:51.231 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:16:51.273 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:51.272+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:51.350 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:51.350+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:51.378 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:51.379 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:51.387 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:16:51.472 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:51.471+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:51.535 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:51.535 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:51.544 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:16:51.585 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:51.584+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:51.654 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:51.653+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:51.691 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:51.692 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:51.700 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:16:51.755 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:51.754+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:51.848 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:51.848 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:51.855 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:51.854+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:51.856 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:16:51.956 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:51.955+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:52.003 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:52.003 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:52.012 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:16:52.057 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:52.056+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:52.132 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:52.133 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:52.141 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:16:52.158 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:52.157+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:52.248 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T16:16:52.253 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:52.253 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:52.259 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:52.257+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:52.262 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:16:52.359 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:52.358+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:52.410 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:52.410 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:52.418 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:16:52.459 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:52.458+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:52.527 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T16:16:52.560 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:52.559+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:52.565 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:52.565 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:52.574 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:16:52.650 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:16:52.650 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:16:52.661 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:52.660+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:52.667 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:16:52.667 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:16:52.683 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:16:52.683 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:16:52.700 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:16:52.700 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:16:52.717 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:16:52.718 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:16:52.718 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-12T16:16:52.721 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T16:16:52.721 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T16:16:52.722 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:52.722 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:16:52.722 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:16:52.722 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:16:52.722 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:52.730 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:16:52.763 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:52.762+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:52.841 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:52.841 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:16:52.841 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:16:52.841 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:16:52.841 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.841 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5599 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4788224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:52.841 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:16:52.841 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 12.543059210999999, 2024-09-12T16:16:52.841 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061192059, 2024-09-12T16:16:52.841 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:52.842 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:52.842 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:52.842 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:52.842 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:52.842 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:52.842 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5599 2024-09-12T16:16:52.842 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.842 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:52.842 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.842 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:52.842 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:16:52.842 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.842 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.843 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.843 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:52.843 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:16:52.843 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.843 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.843 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.843 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:52.843 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296333+0000", 2024-09-12T16:16:52.843 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6599999999999996e-07 2024-09-12T16:16:52.844 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.844 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.844 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:52.844 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296335+0000", 2024-09-12T16:16:52.844 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5900000000000002e-06 2024-09-12T16:16:52.844 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.844 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.844 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:52.844 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296344+0000", 2024-09-12T16:16:52.844 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9539999999999993e-06 2024-09-12T16:16:52.844 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.844 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.845 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:52.845 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296350+0000", 2024-09-12T16:16:52.845 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5589999999999996e-06 2024-09-12T16:16:52.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.845 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.845 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:52.845 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357307+0000", 2024-09-12T16:16:52.845 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.060957573000000001 2024-09-12T16:16:52.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.845 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.845 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:52.846 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357401+0000", 2024-09-12T16:16:52.846 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3512999999999997e-05 2024-09-12T16:16:52.846 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.846 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.846 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:52.846 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357524+0000", 2024-09-12T16:16:52.846 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000123304 2024-09-12T16:16:52.846 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.846 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:52.846 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.846 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.847 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.847 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5611 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4730880~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:52.847 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:16:52.847 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 12.542996767, 2024-09-12T16:16:52.847 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061359348000000001, 2024-09-12T16:16:52.847 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:52.847 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:52.847 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:52.847 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:52.847 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:52.847 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:52.847 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5611 2024-09-12T16:16:52.847 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.847 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:52.848 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.848 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:52.848 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:16:52.848 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.848 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.848 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.848 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:52.848 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:16:52.848 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.848 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.848 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.848 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:52.849 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296395+0000", 2024-09-12T16:16:52.849 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4600000000000003e-07 2024-09-12T16:16:52.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.849 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:52.849 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296399+0000", 2024-09-12T16:16:52.849 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9430000000000002e-06 2024-09-12T16:16:52.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.849 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:52.849 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296411+0000", 2024-09-12T16:16:52.849 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1755e-05 2024-09-12T16:16:52.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:52.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296417+0000", 2024-09-12T16:16:52.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3790000000000003e-06 2024-09-12T16:16:52.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:52.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357572+0000", 2024-09-12T16:16:52.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061154871 2024-09-12T16:16:52.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:52.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357663+0000", 2024-09-12T16:16:52.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0389999999999993e-05 2024-09-12T16:16:52.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.851 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.851 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:52.851 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357754+0000", 2024-09-12T16:16:52.851 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1063999999999994e-05 2024-09-12T16:16:52.851 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.851 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:52.851 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.851 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.852 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5613 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4775936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:52.852 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:16:52.852 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 12.542955587, 2024-09-12T16:16:52.852 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061491777999999997, 2024-09-12T16:16:52.852 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:52.852 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:52.852 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:52.852 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:52.852 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:52.852 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:52.852 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5613 2024-09-12T16:16:52.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.853 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:52.853 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.853 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:52.853 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:16:52.853 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.853 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.853 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.853 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:52.853 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:16:52.853 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.853 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.853 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.853 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:52.854 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:16:52.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8899999999999999e-07 2024-09-12T16:16:52.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.854 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.854 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:52.854 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296439+0000", 2024-09-12T16:16:52.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8439999999999998e-06 2024-09-12T16:16:52.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.854 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:52.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296452+0000", 2024-09-12T16:16:52.855 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2639e-05 2024-09-12T16:16:52.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:52.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296457+0000", 2024-09-12T16:16:52.855 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5720000000000002e-06 2024-09-12T16:16:52.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:52.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357773+0000", 2024-09-12T16:16:52.855 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061315500000000002 2024-09-12T16:16:52.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.856 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:52.856 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357814+0000", 2024-09-12T16:16:52.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1448e-05 2024-09-12T16:16:52.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.856 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:52.856 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357927+0000", 2024-09-12T16:16:52.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000113186 2024-09-12T16:16:52.856 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.856 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:52.856 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.857 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.857 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5616 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4784128~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:52.857 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:16:52.857 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 12.542920525, 2024-09-12T16:16:52.857 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061725002000000001, 2024-09-12T16:16:52.857 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:52.857 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:52.857 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:52.857 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:52.857 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:52.858 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:52.858 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5616 2024-09-12T16:16:52.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.858 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:52.858 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.858 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:52.858 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:16:52.858 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.858 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.858 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:52.859 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:16:52.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.859 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:52.859 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:16:52.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5900000000000002e-07 2024-09-12T16:16:52.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.859 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:52.859 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296473+0000", 2024-09-12T16:16:52.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3130000000000001e-06 2024-09-12T16:16:52.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.860 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.860 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:52.860 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296481+0000", 2024-09-12T16:16:52.860 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1389999999999998e-06 2024-09-12T16:16:52.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.860 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.860 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:52.860 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296486+0000", 2024-09-12T16:16:52.860 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3310000000000003e-06 2024-09-12T16:16:52.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.860 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.860 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:52.860 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357981+0000", 2024-09-12T16:16:52.861 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061494866000000002 2024-09-12T16:16:52.861 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.861 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.861 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:52.861 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358082+0000", 2024-09-12T16:16:52.861 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101424 2024-09-12T16:16:52.861 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.861 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.861 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:52.861 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358196+0000", 2024-09-12T16:16:52.861 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011347 2024-09-12T16:16:52.861 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.861 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:52.861 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.862 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.862 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.862 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5626 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4739072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:52.862 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:16:52.862 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 12.542842568999999, 2024-09-12T16:16:52.862 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061802430999999998, 2024-09-12T16:16:52.862 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:52.862 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:52.862 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:52.862 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:52.862 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:52.862 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:52.862 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5626 2024-09-12T16:16:52.863 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.863 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:52.863 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.863 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:52.863 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:16:52.863 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.863 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.863 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.863 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:52.863 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:16:52.863 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.863 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.863 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.864 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:52.864 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296550+0000", 2024-09-12T16:16:52.864 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.215e-06 2024-09-12T16:16:52.864 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.864 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.864 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:52.864 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296555+0000", 2024-09-12T16:16:52.864 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9590000000000003e-06 2024-09-12T16:16:52.864 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.864 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.864 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:52.864 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296568+0000", 2024-09-12T16:16:52.864 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3338e-05 2024-09-12T16:16:52.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.865 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.865 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:52.865 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296576+0000", 2024-09-12T16:16:52.865 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5510000000000002e-06 2024-09-12T16:16:52.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.865 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.865 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:52.865 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358241+0000", 2024-09-12T16:16:52.865 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.06166576 2024-09-12T16:16:52.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.865 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.865 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:52.866 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358288+0000", 2024-09-12T16:16:52.866 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6097000000000003e-05 2024-09-12T16:16:52.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.866 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.866 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:52.866 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358351+0000", 2024-09-12T16:16:52.866 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3510999999999996e-05 2024-09-12T16:16:52.866 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.866 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:52.866 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.866 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.866 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5628 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4792320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:52.866 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:16:52.867 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 12.542800069, 2024-09-12T16:16:52.867 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061961161000000001, 2024-09-12T16:16:52.867 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:52.867 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:52.867 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:52.867 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:52.867 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:52.867 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:52.867 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5628 2024-09-12T16:16:52.867 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.867 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:52.867 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.867 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:52.868 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:16:52.868 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.868 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.868 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.868 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:52.868 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:16:52.868 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.868 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.868 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.868 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:52.868 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296592+0000", 2024-09-12T16:16:52.868 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2099999999999996e-07 2024-09-12T16:16:52.868 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.868 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.869 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:52.869 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296595+0000", 2024-09-12T16:16:52.869 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0429999999999999e-06 2024-09-12T16:16:52.869 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.869 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.869 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:52.869 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296603+0000", 2024-09-12T16:16:52.869 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9899999999999997e-06 2024-09-12T16:16:52.869 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.869 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.869 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:52.869 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296609+0000", 2024-09-12T16:16:52.869 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7259999999999999e-06 2024-09-12T16:16:52.869 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.870 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.870 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:52.870 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358393+0000", 2024-09-12T16:16:52.870 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061784617 2024-09-12T16:16:52.870 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.870 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.870 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:52.870 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358460+0000", 2024-09-12T16:16:52.870 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7253000000000001e-05 2024-09-12T16:16:52.870 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.870 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.870 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:52.870 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358552+0000", 2024-09-12T16:16:52.870 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1811000000000006e-05 2024-09-12T16:16:52.871 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.871 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:52.871 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.871 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.871 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.871 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5638 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4734976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:52.871 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:16:52.871 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 12.542327518, 2024-09-12T16:16:52.871 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061654460000000001, 2024-09-12T16:16:52.871 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:52.871 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:52.871 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:52.871 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:52.871 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:52.872 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:52.872 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5638 2024-09-12T16:16:52.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.872 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:52.872 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.872 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:52.872 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:16:52.872 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.872 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.872 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:52.872 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:16:52.872 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.873 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.873 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.873 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:52.873 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:16:52.873 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.23e-07 2024-09-12T16:16:52.873 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.874 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.874 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:52.874 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297068+0000", 2024-09-12T16:16:52.874 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0060000000000003e-06 2024-09-12T16:16:52.874 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.874 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.874 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:52.874 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297080+0000", 2024-09-12T16:16:52.874 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1234e-05 2024-09-12T16:16:52.874 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.874 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.874 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:52.874 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297095+0000", 2024-09-12T16:16:52.874 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5698000000000001e-05 2024-09-12T16:16:52.875 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.875 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.875 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:52.875 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358582+0000", 2024-09-12T16:16:52.875 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061486274 2024-09-12T16:16:52.875 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.875 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.875 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:52.875 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358637+0000", 2024-09-12T16:16:52.875 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5439999999999998e-05 2024-09-12T16:16:52.875 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.875 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.875 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:52.876 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358718+0000", 2024-09-12T16:16:52.876 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0984999999999998e-05 2024-09-12T16:16:52.876 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.876 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:52.876 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.876 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.876 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.876 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5640 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4780032~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:52.876 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:16:52.876 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 12.542245798, 2024-09-12T16:16:52.876 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061746620000000002, 2024-09-12T16:16:52.876 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:52.877 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:52.877 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:52.877 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:52.877 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:52.877 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:52.877 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5640 2024-09-12T16:16:52.877 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.877 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:52.877 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.877 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:52.877 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:16:52.877 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.877 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.878 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.878 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:52.878 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:16:52.878 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.878 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.878 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.878 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:52.878 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297146+0000", 2024-09-12T16:16:52.878 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3600000000000003e-07 2024-09-12T16:16:52.878 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.878 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.879 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:52.879 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297150+0000", 2024-09-12T16:16:52.879 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8430000000000003e-06 2024-09-12T16:16:52.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.879 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.879 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:52.879 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297160+0000", 2024-09-12T16:16:52.879 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7229999999999999e-06 2024-09-12T16:16:52.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.879 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.879 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:52.879 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297167+0000", 2024-09-12T16:16:52.880 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0180000000000004e-06 2024-09-12T16:16:52.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.880 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.880 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:52.880 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358750+0000", 2024-09-12T16:16:52.880 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061583104 2024-09-12T16:16:52.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.880 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.880 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:52.880 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358804+0000", 2024-09-12T16:16:52.880 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4277000000000002e-05 2024-09-12T16:16:52.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.880 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.881 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:52.881 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358892+0000", 2024-09-12T16:16:52.881 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7918999999999996e-05 2024-09-12T16:16:52.881 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.881 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:52.881 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.881 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.881 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.881 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5642 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4788224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:52.881 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:16:52.881 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 12.542201454000001, 2024-09-12T16:16:52.881 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061860409999999998, 2024-09-12T16:16:52.881 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:52.881 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:52.882 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:52.882 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:52.882 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:52.882 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:52.882 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5642 2024-09-12T16:16:52.882 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.882 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:52.882 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.882 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:52.882 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:16:52.882 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.882 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.882 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.882 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:52.883 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:16:52.883 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.883 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.883 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.883 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:52.883 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:16:52.883 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7999999999999995e-07 2024-09-12T16:16:52.883 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.883 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.883 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:52.883 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297193+0000", 2024-09-12T16:16:52.883 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8310000000000001e-06 2024-09-12T16:16:52.883 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.884 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.884 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:52.884 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297204+0000", 2024-09-12T16:16:52.884 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0832999999999999e-05 2024-09-12T16:16:52.884 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.884 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.884 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:52.884 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297210+0000", 2024-09-12T16:16:52.884 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1770000000000003e-06 2024-09-12T16:16:52.884 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.884 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.884 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:52.884 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358928+0000", 2024-09-12T16:16:52.885 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061717826000000003 2024-09-12T16:16:52.885 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.885 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.885 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:52.885 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358977+0000", 2024-09-12T16:16:52.885 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9514000000000001e-05 2024-09-12T16:16:52.885 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.885 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.885 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:52.885 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359050+0000", 2024-09-12T16:16:52.885 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2649000000000002e-05 2024-09-12T16:16:52.885 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.885 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:52.885 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.886 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.886 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.886 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5646 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4743168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:52.886 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:16:52.886 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 12.542021513, 2024-09-12T16:16:52.886 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061822122, 2024-09-12T16:16:52.886 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:52.886 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:52.886 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:52.886 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:52.886 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:52.886 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:52.886 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5646 2024-09-12T16:16:52.886 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.887 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:52.887 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.887 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:52.887 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:16:52.887 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.887 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.887 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.887 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:52.887 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:16:52.888 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.888 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.888 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.888 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:52.888 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:16:52.888 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3200000000000004e-07 2024-09-12T16:16:52.888 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.888 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.888 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:52.888 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297374+0000", 2024-09-12T16:16:52.888 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8240000000000001e-06 2024-09-12T16:16:52.888 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.888 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.888 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:52.889 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297384+0000", 2024-09-12T16:16:52.889 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5710000000000004e-06 2024-09-12T16:16:52.889 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.889 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.889 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:52.889 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297390+0000", 2024-09-12T16:16:52.889 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5130000000000002e-06 2024-09-12T16:16:52.889 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.889 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.889 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:52.889 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359080+0000", 2024-09-12T16:16:52.889 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061689569999999999 2024-09-12T16:16:52.889 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.890 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.890 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:52.890 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359134+0000", 2024-09-12T16:16:52.890 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3838999999999997e-05 2024-09-12T16:16:52.890 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.890 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.890 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:52.890 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359192+0000", 2024-09-12T16:16:52.890 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8072999999999998e-05 2024-09-12T16:16:52.890 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.890 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:52.890 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.890 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.891 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.891 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5647 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4751360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:52.891 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:16:52.891 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 12.541984828, 2024-09-12T16:16:52.891 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061927569000000002, 2024-09-12T16:16:52.891 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:52.891 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:52.891 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:52.891 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:52.891 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:52.891 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:52.891 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5647 2024-09-12T16:16:52.891 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.891 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:52.892 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.892 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:52.892 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:16:52.892 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.892 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.892 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.892 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:52.892 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:16:52.892 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.892 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.892 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.892 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:52.892 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297407+0000", 2024-09-12T16:16:52.892 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.46e-07 2024-09-12T16:16:52.892 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.893 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.893 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:52.893 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297409+0000", 2024-09-12T16:16:52.893 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.469e-06 2024-09-12T16:16:52.893 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.893 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.893 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:52.893 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297415+0000", 2024-09-12T16:16:52.893 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9259999999999997e-06 2024-09-12T16:16:52.893 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.893 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.893 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:52.893 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297419+0000", 2024-09-12T16:16:52.894 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3840000000000001e-06 2024-09-12T16:16:52.894 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.894 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.894 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:52.894 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359224+0000", 2024-09-12T16:16:52.894 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061805367999999999 2024-09-12T16:16:52.894 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.894 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.894 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:52.894 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359275+0000", 2024-09-12T16:16:52.894 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1338000000000002e-05 2024-09-12T16:16:52.894 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.894 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.894 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:52.895 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359334+0000", 2024-09-12T16:16:52.895 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8638000000000003e-05 2024-09-12T16:16:52.895 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.895 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:52.895 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.895 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.895 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.895 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5649 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4796416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:52.895 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:16:52.895 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 12.541929969, 2024-09-12T16:16:52.895 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.062018578999999997, 2024-09-12T16:16:52.895 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:52.895 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:52.895 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:52.895 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:52.896 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:52.896 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:52.896 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5649 2024-09-12T16:16:52.896 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.896 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:52.896 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.896 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:52.896 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:16:52.896 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.896 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.896 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.896 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:52.896 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:16:52.896 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.897 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.897 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:52.897 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297462+0000", 2024-09-12T16:16:52.897 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2399999999999998e-07 2024-09-12T16:16:52.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.897 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.897 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:52.897 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297465+0000", 2024-09-12T16:16:52.897 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.371e-06 2024-09-12T16:16:52.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.897 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.897 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:52.897 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297473+0000", 2024-09-12T16:16:52.897 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4699999999999996e-06 2024-09-12T16:16:52.898 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.898 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.898 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:52.898 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297478+0000", 2024-09-12T16:16:52.898 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2780000000000001e-06 2024-09-12T16:16:52.898 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.898 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.898 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:52.898 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359368+0000", 2024-09-12T16:16:52.898 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061889758000000003 2024-09-12T16:16:52.898 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.899 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.899 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:52.899 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359420+0000", 2024-09-12T16:16:52.899 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2574999999999997e-05 2024-09-12T16:16:52.899 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.899 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.899 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:52.899 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359480+0000", 2024-09-12T16:16:52.899 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9503000000000003e-05 2024-09-12T16:16:52.899 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.899 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:52.899 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.899 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.900 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.900 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5674 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4739072~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:52.900 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:16:52.900 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 12.541526201, 2024-09-12T16:16:52.900 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061762989999999997, 2024-09-12T16:16:52.900 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:52.900 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:52.900 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:52.900 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:52.900 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:52.900 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:52.901 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5674 2024-09-12T16:16:52.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.901 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:52.901 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.901 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:52.901 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:16:52.901 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.901 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.901 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:52.901 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:16:52.901 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.902 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.902 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:52.902 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297866+0000", 2024-09-12T16:16:52.902 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1900000000000001e-07 2024-09-12T16:16:52.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.902 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.902 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:52.902 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297870+0000", 2024-09-12T16:16:52.902 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3560000000000003e-06 2024-09-12T16:16:52.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.902 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.902 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:52.903 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297888+0000", 2024-09-12T16:16:52.903 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8088999999999999e-05 2024-09-12T16:16:52.903 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.903 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.903 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:52.903 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297904+0000", 2024-09-12T16:16:52.903 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5971e-05 2024-09-12T16:16:52.903 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.903 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.903 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:52.903 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359510+0000", 2024-09-12T16:16:52.903 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061605634999999999 2024-09-12T16:16:52.903 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.903 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.903 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:52.904 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359554+0000", 2024-09-12T16:16:52.904 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4024999999999999e-05 2024-09-12T16:16:52.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.904 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.904 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:52.904 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359628+0000", 2024-09-12T16:16:52.904 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4095000000000001e-05 2024-09-12T16:16:52.904 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.904 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:52.904 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.904 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.904 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5676 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4792320~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:52.904 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:16:52.905 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 12.541325121, 2024-09-12T16:16:52.905 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061720143999999998, 2024-09-12T16:16:52.905 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:52.905 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:52.905 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:52.905 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:52.905 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:52.905 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:52.905 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5676 2024-09-12T16:16:52.905 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.905 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:52.905 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.905 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:52.905 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:16:52.905 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.906 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.906 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:52.906 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:16:52.906 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.906 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.906 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:52.906 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298067+0000", 2024-09-12T16:16:52.906 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8199999999999999e-07 2024-09-12T16:16:52.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.906 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.906 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:52.907 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298070+0000", 2024-09-12T16:16:52.907 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.743e-06 2024-09-12T16:16:52.907 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.907 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.907 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:52.907 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298080+0000", 2024-09-12T16:16:52.907 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4059999999999994e-06 2024-09-12T16:16:52.907 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.907 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.907 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:52.907 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298088+0000", 2024-09-12T16:16:52.907 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0779999999999996e-06 2024-09-12T16:16:52.907 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.908 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.908 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:52.908 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359659+0000", 2024-09-12T16:16:52.908 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061570688999999998 2024-09-12T16:16:52.908 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.908 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.908 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:52.908 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359713+0000", 2024-09-12T16:16:52.908 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3939e-05 2024-09-12T16:16:52.908 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.908 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.908 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:52.909 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359786+0000", 2024-09-12T16:16:52.909 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3607000000000002e-05 2024-09-12T16:16:52.909 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.909 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:52.909 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.909 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.909 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.909 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5684 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4747264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:52.909 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:16:52.909 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 12.540857829, 2024-09-12T16:16:52.909 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061394799, 2024-09-12T16:16:52.909 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:52.910 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:52.910 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:52.910 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:52.910 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:52.910 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:52.910 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5684 2024-09-12T16:16:52.910 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.910 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:52.910 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.910 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:52.910 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:16:52.911 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.911 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.911 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.911 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:52.911 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:16:52.911 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.911 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.911 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.911 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:52.911 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298534+0000", 2024-09-12T16:16:52.911 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4399999999999999e-07 2024-09-12T16:16:52.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.912 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.912 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:52.912 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298539+0000", 2024-09-12T16:16:52.912 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5360000000000003e-06 2024-09-12T16:16:52.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.912 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.912 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:52.912 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298550+0000", 2024-09-12T16:16:52.912 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1499e-05 2024-09-12T16:16:52.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.912 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.912 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:52.913 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298558+0000", 2024-09-12T16:16:52.913 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3000000000000004e-06 2024-09-12T16:16:52.913 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.913 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.913 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:52.913 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359815+0000", 2024-09-12T16:16:52.913 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061257952999999997 2024-09-12T16:16:52.913 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.913 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.913 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:52.913 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359868+0000", 2024-09-12T16:16:52.913 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2317000000000001e-05 2024-09-12T16:16:52.913 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.913 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.914 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:52.914 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359928+0000", 2024-09-12T16:16:52.914 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0350000000000003e-05 2024-09-12T16:16:52.914 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.914 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:52.914 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.914 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5686 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4755456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:52.914 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:16:52.914 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 12.540690404999999, 2024-09-12T16:16:52.914 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061355082999999998, 2024-09-12T16:16:52.914 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:52.915 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:52.915 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:52.915 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:52.915 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:52.915 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:52.915 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5686 2024-09-12T16:16:52.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.915 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:52.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.915 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:52.915 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:16:52.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.916 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:52.916 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:16:52.916 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.916 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.916 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.916 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:52.916 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298702+0000", 2024-09-12T16:16:52.916 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2399999999999997e-07 2024-09-12T16:16:52.916 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.916 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.916 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:52.916 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298706+0000", 2024-09-12T16:16:52.916 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5700000000000003e-06 2024-09-12T16:16:52.916 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.917 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.917 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:52.917 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298718+0000", 2024-09-12T16:16:52.917 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1457999999999999e-05 2024-09-12T16:16:52.917 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.917 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.917 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:52.917 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298732+0000", 2024-09-12T16:16:52.917 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.452e-05 2024-09-12T16:16:52.917 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.917 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.917 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:52.918 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359956+0000", 2024-09-12T16:16:52.918 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061223626000000003 2024-09-12T16:16:52.918 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.918 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.918 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:52.918 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360000+0000", 2024-09-12T16:16:52.918 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3922999999999999e-05 2024-09-12T16:16:52.918 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.918 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.918 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:52.918 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360056+0000", 2024-09-12T16:16:52.918 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6162000000000002e-05 2024-09-12T16:16:52.919 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.919 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:52.919 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.919 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.919 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.919 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5688 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4800512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:52.919 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:16:52.919 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 12.540467352, 2024-09-12T16:16:52.919 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061270514999999998, 2024-09-12T16:16:52.919 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:52.919 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:52.919 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:52.919 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:52.920 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:52.920 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:52.920 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5688 2024-09-12T16:16:52.920 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.920 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:52.920 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.920 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:52.920 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:16:52.920 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.920 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.920 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.920 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:52.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:16:52.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:52.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298925+0000", 2024-09-12T16:16:52.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4e-07 2024-09-12T16:16:52.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:52.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298929+0000", 2024-09-12T16:16:52.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9890000000000003e-06 2024-09-12T16:16:52.922 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.922 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.922 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:52.922 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298936+0000", 2024-09-12T16:16:52.922 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.52e-06 2024-09-12T16:16:52.922 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.922 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.922 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:52.922 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298941+0000", 2024-09-12T16:16:52.922 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4800000000000003e-06 2024-09-12T16:16:52.922 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.922 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.923 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:52.923 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360087+0000", 2024-09-12T16:16:52.923 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061146143 2024-09-12T16:16:52.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.923 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.923 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:52.923 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360137+0000", 2024-09-12T16:16:52.923 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0584000000000002e-05 2024-09-12T16:16:52.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.923 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.923 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:52.924 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360194+0000", 2024-09-12T16:16:52.924 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6858999999999999e-05 2024-09-12T16:16:52.924 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.924 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:52.924 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.924 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.924 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.924 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5693 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4751360~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:52.924 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:16:52.924 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 12.540045715, 2024-09-12T16:16:52.924 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061139444000000001, 2024-09-12T16:16:52.924 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:52.925 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:52.925 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:52.925 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:52.925 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:52.925 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:52.925 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5693 2024-09-12T16:16:52.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.925 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:52.925 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.925 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:52.925 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:16:52.925 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.926 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.926 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:52.926 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:16:52.926 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.926 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.926 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:52.926 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299346+0000", 2024-09-12T16:16:52.926 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2300000000000001e-07 2024-09-12T16:16:52.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.926 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.926 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:52.927 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299349+0000", 2024-09-12T16:16:52.927 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5270000000000001e-06 2024-09-12T16:16:52.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.927 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.927 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:52.927 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299358+0000", 2024-09-12T16:16:52.927 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7030000000000001e-06 2024-09-12T16:16:52.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.927 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.927 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:52.927 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299364+0000", 2024-09-12T16:16:52.927 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7239999999999997e-06 2024-09-12T16:16:52.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.928 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.928 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:52.928 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360369+0000", 2024-09-12T16:16:52.928 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061004713000000002 2024-09-12T16:16:52.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.928 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.928 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:52.928 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360415+0000", 2024-09-12T16:16:52.928 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5926e-05 2024-09-12T16:16:52.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.928 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.928 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:52.928 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360485+0000", 2024-09-12T16:16:52.929 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0327999999999995e-05 2024-09-12T16:16:52.929 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.929 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:52.929 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.929 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.929 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.929 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5694 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4796416~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:52.929 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:16:52.929 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 12.540016686, 2024-09-12T16:16:52.929 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061258034000000003, 2024-09-12T16:16:52.929 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:52.929 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:52.929 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:52.929 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:52.929 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:52.930 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:52.930 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5694 2024-09-12T16:16:52.930 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.930 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:52.930 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.930 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:52.930 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:16:52.930 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.930 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.930 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.930 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:52.930 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:16:52.930 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.930 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.931 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.931 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:52.931 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301884+0000", 2024-09-12T16:16:52.931 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025090379999999999 2024-09-12T16:16:52.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.931 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.931 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:52.931 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301889+0000", 2024-09-12T16:16:52.931 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5879999999999997e-06 2024-09-12T16:16:52.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.931 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.931 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:52.931 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301901+0000", 2024-09-12T16:16:52.931 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1466e-05 2024-09-12T16:16:52.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.932 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.932 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:52.932 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301908+0000", 2024-09-12T16:16:52.932 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1999999999999997e-06 2024-09-12T16:16:52.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.932 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.932 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:52.932 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360513+0000", 2024-09-12T16:16:52.932 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.058605023999999999 2024-09-12T16:16:52.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.932 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.932 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:52.932 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360562+0000", 2024-09-12T16:16:52.932 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9546000000000003e-05 2024-09-12T16:16:52.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.933 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.933 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:52.933 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360633+0000", 2024-09-12T16:16:52.933 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0172000000000005e-05 2024-09-12T16:16:52.933 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.933 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:52.933 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.933 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.933 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.933 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5759 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4767744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:52.933 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:16:52.933 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 12.537223151999999, 2024-09-12T16:16:52.933 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061058604000000002, 2024-09-12T16:16:52.933 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:52.933 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:52.934 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:52.934 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:52.934 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:52.934 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:52.934 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5759 2024-09-12T16:16:52.934 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.934 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:52.934 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.934 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:52.934 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:16:52.934 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.934 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.935 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.935 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:52.935 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:16:52.935 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:52.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.935 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.935 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:52.935 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302548+0000", 2024-09-12T16:16:52.935 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00038011000000000002 2024-09-12T16:16:52.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.935 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.935 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:52.935 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302553+0000", 2024-09-12T16:16:52.935 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1830000000000002e-06 2024-09-12T16:16:52.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.936 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.936 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:52.936 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302564+0000", 2024-09-12T16:16:52.936 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1011e-05 2024-09-12T16:16:52.936 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.936 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.936 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:52.936 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302572+0000", 2024-09-12T16:16:52.936 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9009999999999994e-06 2024-09-12T16:16:52.936 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.936 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.936 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:52.936 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363102+0000", 2024-09-12T16:16:52.936 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.060529782999999997 2024-09-12T16:16:52.936 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.937 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.937 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:52.937 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363149+0000", 2024-09-12T16:16:52.937 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7321000000000003e-05 2024-09-12T16:16:52.937 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:52.937 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:52.937 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:52.937 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363227+0000", 2024-09-12T16:16:52.937 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7294999999999998e-05 2024-09-12T16:16:52.937 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.937 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:52.937 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.938 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:52.938 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:52.938 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:52.939 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:52.938+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:52.940 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:16:53.040 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:53.039+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:53.049 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:53.049 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:53.049 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:16:53.049 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:53.057 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:16:53.143 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:53.142+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:53.178 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2024-09-12T16:16:53.218 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:53.218 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:53.218 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:16:53.218 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:16:53.219 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:53.228 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:16:53.269 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:53.268+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:53.343 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:53.342+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:53.381 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:53.382 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:16:53.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:16:53.382 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:53.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.382 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3703 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14803968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:53.382 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139513+0000", 2024-09-12T16:16:53.382 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.240936370999997, 2024-09-12T16:16:53.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053248794000000002, 2024-09-12T16:16:53.382 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:53.382 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:53.382 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:53.382 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:53.382 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:53.382 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:53.383 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3703 2024-09-12T16:16:53.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.383 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:53.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:53.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139513+0000", 2024-09-12T16:16:53.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:53.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139513+0000", 2024-09-12T16:16:53.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:53.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139639+0000", 2024-09-12T16:16:53.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012673299999999999 2024-09-12T16:16:53.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:53.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139642+0000", 2024-09-12T16:16:53.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4820000000000001e-06 2024-09-12T16:16:53.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:53.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139647+0000", 2024-09-12T16:16:53.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8040000000000001e-06 2024-09-12T16:16:53.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.385 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:53.385 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139650+0000", 2024-09-12T16:16:53.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.529e-06 2024-09-12T16:16:53.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.385 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:53.385 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192537+0000", 2024-09-12T16:16:53.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052886503000000001 2024-09-12T16:16:53.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.385 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:53.385 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192627+0000", 2024-09-12T16:16:53.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0183e-05 2024-09-12T16:16:53.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.386 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:53.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192761+0000", 2024-09-12T16:16:53.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013456000000000001 2024-09-12T16:16:53.386 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.386 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:53.386 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.386 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3704 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14808064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:53.386 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139656+0000", 2024-09-12T16:16:53.386 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.240792454999998, 2024-09-12T16:16:53.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053247502000000002, 2024-09-12T16:16:53.386 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:53.387 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:53.387 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:53.387 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:53.387 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:53.387 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:53.387 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3704 2024-09-12T16:16:53.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.387 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:53.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.387 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:53.387 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139656+0000", 2024-09-12T16:16:53.387 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.387 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:53.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139656+0000", 2024-09-12T16:16:53.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:53.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139790+0000", 2024-09-12T16:16:53.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000133471 2024-09-12T16:16:53.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:53.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139792+0000", 2024-09-12T16:16:53.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.968e-06 2024-09-12T16:16:53.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:53.389 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139796+0000", 2024-09-12T16:16:53.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2660000000000003e-06 2024-09-12T16:16:53.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.389 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:53.389 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139799+0000", 2024-09-12T16:16:53.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2839999999999998e-06 2024-09-12T16:16:53.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.389 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:53.389 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192790+0000", 2024-09-12T16:16:53.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052990388999999999 2024-09-12T16:16:53.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:53.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192835+0000", 2024-09-12T16:16:53.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5101000000000001e-05 2024-09-12T16:16:53.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:53.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192904+0000", 2024-09-12T16:16:53.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9023000000000006e-05 2024-09-12T16:16:53.390 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.390 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:53.390 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.390 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3705 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14812160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:53.391 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:16:53.391 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.240644119000002, 2024-09-12T16:16:53.391 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053368831999999998, 2024-09-12T16:16:53.391 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:53.391 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:53.391 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:53.391 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:53.391 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:53.391 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:53.391 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3705 2024-09-12T16:16:53.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.391 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:53.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.391 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:53.391 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:16:53.392 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.392 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:53.392 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:16:53.392 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.392 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:53.392 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139932+0000", 2024-09-12T16:16:53.392 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012762099999999999 2024-09-12T16:16:53.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.393 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:53.393 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139935+0000", 2024-09-12T16:16:53.393 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.119e-06 2024-09-12T16:16:53.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.393 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.393 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:53.393 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139939+0000", 2024-09-12T16:16:53.393 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7999999999999998e-06 2024-09-12T16:16:53.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.393 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.393 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:53.393 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139953+0000", 2024-09-12T16:16:53.394 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3923999999999999e-05 2024-09-12T16:16:53.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.394 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:53.394 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192946+0000", 2024-09-12T16:16:53.394 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052992971 2024-09-12T16:16:53.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.394 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:53.394 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193035+0000", 2024-09-12T16:16:53.394 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9040000000000001e-05 2024-09-12T16:16:53.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.395 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:53.395 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193174+0000", 2024-09-12T16:16:53.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138357 2024-09-12T16:16:53.395 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.395 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:53.395 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.395 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3706 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14816256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:53.395 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:16:53.395 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.240489128999997, 2024-09-12T16:16:53.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053341723000000001, 2024-09-12T16:16:53.396 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:53.396 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:53.396 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:53.396 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:53.396 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:53.396 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:53.396 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3706 2024-09-12T16:16:53.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.396 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:53.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.396 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:53.396 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:16:53.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.397 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:53.397 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:16:53.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.397 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:53.397 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140090+0000", 2024-09-12T16:16:53.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013020100000000001 2024-09-12T16:16:53.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.397 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:53.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140097+0000", 2024-09-12T16:16:53.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0709999999999997e-06 2024-09-12T16:16:53.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:53.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140103+0000", 2024-09-12T16:16:53.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5450000000000003e-06 2024-09-12T16:16:53.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:53.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140106+0000", 2024-09-12T16:16:53.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3739999999999998e-06 2024-09-12T16:16:53.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:53.399 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193190+0000", 2024-09-12T16:16:53.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053084131999999999 2024-09-12T16:16:53.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:53.399 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193232+0000", 2024-09-12T16:16:53.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1517000000000002e-05 2024-09-12T16:16:53.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:53.399 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193302+0000", 2024-09-12T16:16:53.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9882999999999995e-05 2024-09-12T16:16:53.399 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.399 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:53.399 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.400 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3707 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14820352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:53.400 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:16:53.400 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.240337140000001, 2024-09-12T16:16:53.400 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053452771000000003, 2024-09-12T16:16:53.400 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:53.400 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:53.400 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:53.400 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:53.400 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:53.400 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:53.400 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3707 2024-09-12T16:16:53.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.400 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:53.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.401 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:53.401 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:16:53.401 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.401 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:53.401 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:16:53.401 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.401 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:53.401 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140219+0000", 2024-09-12T16:16:53.401 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106902 2024-09-12T16:16:53.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:53.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140225+0000", 2024-09-12T16:16:53.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3199999999999996e-06 2024-09-12T16:16:53.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:53.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140230+0000", 2024-09-12T16:16:53.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8969999999999999e-06 2024-09-12T16:16:53.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:53.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140233+0000", 2024-09-12T16:16:53.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2119999999999999e-06 2024-09-12T16:16:53.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:53.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193339+0000", 2024-09-12T16:16:53.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053105556999999998 2024-09-12T16:16:53.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:53.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193431+0000", 2024-09-12T16:16:53.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1837999999999997e-05 2024-09-12T16:16:53.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:53.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193565+0000", 2024-09-12T16:16:53.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013404500000000001 2024-09-12T16:16:53.403 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.404 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:53.404 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.404 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3708 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14824448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:53.404 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:16:53.404 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.240208297999999, 2024-09-12T16:16:53.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053468190999999998, 2024-09-12T16:16:53.404 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:53.404 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:53.404 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:53.404 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:53.404 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:53.404 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:53.405 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3708 2024-09-12T16:16:53.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.405 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:53.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.405 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:53.405 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:16:53.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.405 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:53.405 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:16:53.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.405 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:53.406 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140351+0000", 2024-09-12T16:16:53.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110096 2024-09-12T16:16:53.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:53.406 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140358+0000", 2024-09-12T16:16:53.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.306e-06 2024-09-12T16:16:53.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:53.406 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140368+0000", 2024-09-12T16:16:53.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0225e-05 2024-09-12T16:16:53.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:53.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140372+0000", 2024-09-12T16:16:53.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6169999999999998e-06 2024-09-12T16:16:53.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.407 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:53.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193594+0000", 2024-09-12T16:16:53.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053222419999999999 2024-09-12T16:16:53.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.407 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:53.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193640+0000", 2024-09-12T16:16:53.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.587e-05 2024-09-12T16:16:53.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.408 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:53.408 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193709+0000", 2024-09-12T16:16:53.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8657000000000004e-05 2024-09-12T16:16:53.408 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.408 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:53.408 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.408 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3709 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14828544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:53.408 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:16:53.408 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.240071329999999, 2024-09-12T16:16:53.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594033999999999, 2024-09-12T16:16:53.408 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:53.409 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:53.409 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:53.409 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:53.409 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:53.409 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:53.409 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3709 2024-09-12T16:16:53.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.409 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:53.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:53.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:16:53.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.410 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:53.410 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:16:53.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.410 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:53.410 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140499+0000", 2024-09-12T16:16:53.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121019 2024-09-12T16:16:53.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.410 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:53.410 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140501+0000", 2024-09-12T16:16:53.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2369999999999999e-06 2024-09-12T16:16:53.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.411 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:53.411 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140506+0000", 2024-09-12T16:16:53.411 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.639e-06 2024-09-12T16:16:53.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.411 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:53.411 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140509+0000", 2024-09-12T16:16:53.411 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3419999999999999e-06 2024-09-12T16:16:53.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.411 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:53.411 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193743+0000", 2024-09-12T16:16:53.411 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053234311999999999 2024-09-12T16:16:53.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:53.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193833+0000", 2024-09-12T16:16:53.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9883999999999995e-05 2024-09-12T16:16:53.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:53.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193972+0000", 2024-09-12T16:16:53.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138601 2024-09-12T16:16:53.412 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.412 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:53.412 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.412 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3710 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14832640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:53.413 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:16:53.413 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.239933983999997, 2024-09-12T16:16:53.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053607324999999997, 2024-09-12T16:16:53.413 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:53.413 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:53.413 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:53.413 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:53.413 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:53.413 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:53.413 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3710 2024-09-12T16:16:53.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.413 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:53.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:53.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:16:53.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:53.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:16:53.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:53.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140664+0000", 2024-09-12T16:16:53.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014918700000000001 2024-09-12T16:16:53.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:53.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140674+0000", 2024-09-12T16:16:53.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8379999999999997e-06 2024-09-12T16:16:53.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.415 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:53.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140694+0000", 2024-09-12T16:16:53.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0145000000000001e-05 2024-09-12T16:16:53.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.415 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:53.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140703+0000", 2024-09-12T16:16:53.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5150000000000006e-06 2024-09-12T16:16:53.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.415 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:53.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194006+0000", 2024-09-12T16:16:53.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053303370000000003 2024-09-12T16:16:53.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.416 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:53.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194051+0000", 2024-09-12T16:16:53.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5012000000000002e-05 2024-09-12T16:16:53.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.416 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:53.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194122+0000", 2024-09-12T16:16:53.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1258000000000001e-05 2024-09-12T16:16:53.416 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.416 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:53.417 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.417 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3711 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14836736~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:53.417 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:16:53.417 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.239732535999998, 2024-09-12T16:16:53.417 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053670799999999998, 2024-09-12T16:16:53.417 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:53.417 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:53.417 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:53.417 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:53.417 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:53.418 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:53.418 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3711 2024-09-12T16:16:53.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.418 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:53.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:53.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:16:53.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:53.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:16:53.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.419 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:53.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140782+0000", 2024-09-12T16:16:53.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5549999999999994e-05 2024-09-12T16:16:53.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.419 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:53.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140786+0000", 2024-09-12T16:16:53.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.89e-06 2024-09-12T16:16:53.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:53.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140796+0000", 2024-09-12T16:16:53.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0057e-05 2024-09-12T16:16:53.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:53.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140819+0000", 2024-09-12T16:16:53.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3005000000000001e-05 2024-09-12T16:16:53.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:53.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194159+0000", 2024-09-12T16:16:53.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053340324000000001 2024-09-12T16:16:53.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:53.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194248+0000", 2024-09-12T16:16:53.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9209000000000006e-05 2024-09-12T16:16:53.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:53.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194387+0000", 2024-09-12T16:16:53.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138765 2024-09-12T16:16:53.421 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.421 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:53.421 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.422 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3712 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14840832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:53.422 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:16:53.422 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.239618077999999, 2024-09-12T16:16:53.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053699068000000003, 2024-09-12T16:16:53.422 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:53.422 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:53.422 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:53.422 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:53.422 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:53.422 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:53.423 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3712 2024-09-12T16:16:53.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.423 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:53.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.423 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:53.423 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:16:53.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.423 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:53.423 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:16:53.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.424 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:53.424 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140900+0000", 2024-09-12T16:16:53.424 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9014e-05 2024-09-12T16:16:53.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.424 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:53.424 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140904+0000", 2024-09-12T16:16:53.424 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0940000000000001e-06 2024-09-12T16:16:53.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.424 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:53.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140933+0000", 2024-09-12T16:16:53.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8996000000000002e-05 2024-09-12T16:16:53.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:53.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140945+0000", 2024-09-12T16:16:53.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1909000000000001e-05 2024-09-12T16:16:53.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:53.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194415+0000", 2024-09-12T16:16:53.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053470403 2024-09-12T16:16:53.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:53.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194460+0000", 2024-09-12T16:16:53.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5145000000000002e-05 2024-09-12T16:16:53.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:53.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194530+0000", 2024-09-12T16:16:53.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9506999999999997e-05 2024-09-12T16:16:53.426 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.426 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:53.426 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.426 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3713 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14844928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:53.426 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:16:53.427 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.239485018000003, 2024-09-12T16:16:53.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053821236000000001, 2024-09-12T16:16:53.427 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:53.427 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:53.427 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:53.427 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:53.427 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:53.427 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:53.427 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3713 2024-09-12T16:16:53.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.427 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:53.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:53.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:16:53.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.428 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.428 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:53.428 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:16:53.428 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.428 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.428 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:53.428 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141078+0000", 2024-09-12T16:16:53.428 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114162 2024-09-12T16:16:53.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.428 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.428 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:53.428 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141090+0000", 2024-09-12T16:16:53.428 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.19e-05 2024-09-12T16:16:53.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.429 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:53.429 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141100+0000", 2024-09-12T16:16:53.429 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0447e-05 2024-09-12T16:16:53.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.429 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:53.429 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141108+0000", 2024-09-12T16:16:53.429 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7190000000000001e-06 2024-09-12T16:16:53.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.429 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:53.429 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194564+0000", 2024-09-12T16:16:53.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053455729 2024-09-12T16:16:53.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.430 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:53.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194652+0000", 2024-09-12T16:16:53.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8288999999999994e-05 2024-09-12T16:16:53.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.430 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:53.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194785+0000", 2024-09-12T16:16:53.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013299000000000001 2024-09-12T16:16:53.430 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.430 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:53.430 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.431 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3714 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14849024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:53.431 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:16:53.431 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.239329089000002, 2024-09-12T16:16:53.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053816382000000003, 2024-09-12T16:16:53.431 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:53.431 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:53.431 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:53.431 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:53.431 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:53.431 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:53.431 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3714 2024-09-12T16:16:53.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.431 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:53.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:53.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:16:53.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:53.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:16:53.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:53.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141182+0000", 2024-09-12T16:16:53.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1805999999999997e-05 2024-09-12T16:16:53.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:53.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141185+0000", 2024-09-12T16:16:53.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5930000000000002e-06 2024-09-12T16:16:53.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:53.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141194+0000", 2024-09-12T16:16:53.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5760000000000006e-06 2024-09-12T16:16:53.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:53.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141222+0000", 2024-09-12T16:16:53.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8034999999999998e-05 2024-09-12T16:16:53.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.434 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:53.434 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194817+0000", 2024-09-12T16:16:53.434 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594887000000001 2024-09-12T16:16:53.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.434 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:53.434 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194860+0000", 2024-09-12T16:16:53.434 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3714999999999997e-05 2024-09-12T16:16:53.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.434 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:53.434 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194936+0000", 2024-09-12T16:16:53.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5770000000000001e-05 2024-09-12T16:16:53.435 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.435 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:53.435 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.435 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3715 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14853120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:53.435 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:16:53.435 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.239205431999999, 2024-09-12T16:16:53.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053962307000000001, 2024-09-12T16:16:53.435 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:53.435 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:53.435 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:53.436 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:53.436 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:53.436 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:53.436 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3715 2024-09-12T16:16:53.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.436 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:53.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:53.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:16:53.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:53.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:16:53.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.437 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:53.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141417+0000", 2024-09-12T16:16:53.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017384099999999999 2024-09-12T16:16:53.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.437 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:53.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141422+0000", 2024-09-12T16:16:53.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7310000000000001e-06 2024-09-12T16:16:53.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.438 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:53.438 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141434+0000", 2024-09-12T16:16:53.438 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2058e-05 2024-09-12T16:16:53.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.438 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:53.438 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141442+0000", 2024-09-12T16:16:53.438 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7610000000000007e-06 2024-09-12T16:16:53.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.438 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:53.438 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194973+0000", 2024-09-12T16:16:53.438 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053530618000000002 2024-09-12T16:16:53.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.439 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:53.439 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195063+0000", 2024-09-12T16:16:53.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0927000000000005e-05 2024-09-12T16:16:53.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.439 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:53.439 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195206+0000", 2024-09-12T16:16:53.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142371 2024-09-12T16:16:53.439 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.439 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:53.439 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.440 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3716 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14857216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:53.440 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:16:53.440 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.238995582000001, 2024-09-12T16:16:53.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053916360000000003, 2024-09-12T16:16:53.440 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:53.440 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:53.440 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:53.440 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:53.440 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:53.440 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:53.440 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3716 2024-09-12T16:16:53.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.440 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:53.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.441 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:53.441 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:16:53.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.441 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:53.441 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:16:53.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.441 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:53.441 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142933+0000", 2024-09-12T16:16:53.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014796290000000001 2024-09-12T16:16:53.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.442 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:53.442 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142937+0000", 2024-09-12T16:16:53.442 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5760000000000002e-06 2024-09-12T16:16:53.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.442 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:53.442 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142946+0000", 2024-09-12T16:16:53.442 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0380000000000005e-06 2024-09-12T16:16:53.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.442 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:53.443 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142951+0000", 2024-09-12T16:16:53.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9749999999999998e-06 2024-09-12T16:16:53.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.443 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:53.443 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195246+0000", 2024-09-12T16:16:53.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052295358 2024-09-12T16:16:53.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.443 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:53.443 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195299+0000", 2024-09-12T16:16:53.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2976999999999998e-05 2024-09-12T16:16:53.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:53.444 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195370+0000", 2024-09-12T16:16:53.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0807000000000002e-05 2024-09-12T16:16:53.444 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.444 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:53.444 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.444 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3721 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14877696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:53.444 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:16:53.444 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.237422131000002, 2024-09-12T16:16:53.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053422994000000001, 2024-09-12T16:16:53.445 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:53.445 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:53.445 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:53.445 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:53.445 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:53.445 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:53.445 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3721 2024-09-12T16:16:53.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.445 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:53.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.445 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:53.445 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:16:53.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.446 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:53.446 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:16:53.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.446 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:53.446 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:16:53.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:16:53.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.446 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:53.446 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143028+0000", 2024-09-12T16:16:53.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7399999999999991e-07 2024-09-12T16:16:53.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.447 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:53.447 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143031+0000", 2024-09-12T16:16:53.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7599999999999998e-06 2024-09-12T16:16:53.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.447 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:53.447 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143034+0000", 2024-09-12T16:16:53.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9780000000000001e-06 2024-09-12T16:16:53.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.447 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:53.448 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196220+0000", 2024-09-12T16:16:53.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053186341999999998 2024-09-12T16:16:53.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.448 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:53.448 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196313+0000", 2024-09-12T16:16:53.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2676000000000005e-05 2024-09-12T16:16:53.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.448 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:53.448 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196450+0000", 2024-09-12T16:16:53.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137052 2024-09-12T16:16:53.448 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.448 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:53.449 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.449 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3722 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14881792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:53.449 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:16:53.449 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.237412239000001, 2024-09-12T16:16:53.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053556835999999997, 2024-09-12T16:16:53.449 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:53.449 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:53.449 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:53.449 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:53.449 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:53.449 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:53.449 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3722 2024-09-12T16:16:53.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.450 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:53.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:53.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:16:53.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:53.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:16:53.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:53.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:16:53.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.11e-07 2024-09-12T16:16:53.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:53.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143038+0000", 2024-09-12T16:16:53.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2399999999999996e-07 2024-09-12T16:16:53.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:53.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143041+0000", 2024-09-12T16:16:53.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8030000000000001e-06 2024-09-12T16:16:53.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:53.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143043+0000", 2024-09-12T16:16:53.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3140000000000002e-06 2024-09-12T16:16:53.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:53.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196481+0000", 2024-09-12T16:16:53.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053437601000000001 2024-09-12T16:16:53.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:53.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196525+0000", 2024-09-12T16:16:53.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4280000000000003e-05 2024-09-12T16:16:53.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:53.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196594+0000", 2024-09-12T16:16:53.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8702999999999996e-05 2024-09-12T16:16:53.453 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.453 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:53.453 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.453 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3723 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14885888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:53.453 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:16:53.453 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.237403057000002, 2024-09-12T16:16:53.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053815546999999998, 2024-09-12T16:16:53.453 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:53.453 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:53.453 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:53.453 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:53.454 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:53.454 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:53.454 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3723 2024-09-12T16:16:53.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.454 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:53.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:53.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:16:53.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:53.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:16:53.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:53.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148994+0000", 2024-09-12T16:16:53.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059481330000000004 2024-09-12T16:16:53.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:53.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148999+0000", 2024-09-12T16:16:53.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7140000000000001e-06 2024-09-12T16:16:53.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:53.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149008+0000", 2024-09-12T16:16:53.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4350000000000003e-06 2024-09-12T16:16:53.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:53.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149021+0000", 2024-09-12T16:16:53.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2514000000000001e-05 2024-09-12T16:16:53.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:53.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196630+0000", 2024-09-12T16:16:53.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047609758000000002 2024-09-12T16:16:53.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:53.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196724+0000", 2024-09-12T16:16:53.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3522000000000003e-05 2024-09-12T16:16:53.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:53.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196861+0000", 2024-09-12T16:16:53.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013747100000000001 2024-09-12T16:16:53.458 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.458 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:53.458 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.458 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4438 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15719424~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:53.458 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:16:53.458 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.092522279999997, 2024-09-12T16:16:53.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367981000000002, 2024-09-12T16:16:53.458 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:53.458 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:53.458 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:53.458 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:53.458 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:53.459 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:53.459 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4438 2024-09-12T16:16:53.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.459 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:53.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:53.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:16:53.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:53.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:16:53.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.460 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:53.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:16:53.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3e-07 2024-09-12T16:16:53.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.460 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:53.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287930+0000", 2024-09-12T16:16:53.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-12T16:16:53.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:53.461 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287937+0000", 2024-09-12T16:16:53.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.08e-06 2024-09-12T16:16:53.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:53.461 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287943+0000", 2024-09-12T16:16:53.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5709999999999997e-06 2024-09-12T16:16:53.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:53.461 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341068+0000", 2024-09-12T16:16:53.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053125101000000001 2024-09-12T16:16:53.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:53.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341154+0000", 2024-09-12T16:16:53.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6100999999999994e-05 2024-09-12T16:16:53.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:53.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341295+0000", 2024-09-12T16:16:53.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014087999999999999 2024-09-12T16:16:53.462 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.462 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:53.462 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.463 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4439 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15723520~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:53.463 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:16:53.463 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.092498120000002, 2024-09-12T16:16:53.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053526799, 2024-09-12T16:16:53.463 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:53.463 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:53.463 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:53.463 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:53.463 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:53.463 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:53.463 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4439 2024-09-12T16:16:53.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.464 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:53.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.464 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:53.464 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:16:53.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.464 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:53.464 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:16:53.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.464 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:53.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:16:53.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-07 2024-09-12T16:16:53.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:53.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287953+0000", 2024-09-12T16:16:53.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1349999999999999e-06 2024-09-12T16:16:53.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:53.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287960+0000", 2024-09-12T16:16:53.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-12T16:16:53.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:53.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287965+0000", 2024-09-12T16:16:53.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1580000000000004e-06 2024-09-12T16:16:53.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:53.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341332+0000", 2024-09-12T16:16:53.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367009 2024-09-12T16:16:53.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:53.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341402+0000", 2024-09-12T16:16:53.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9759999999999996e-05 2024-09-12T16:16:53.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.467 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:53.467 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341478+0000", 2024-09-12T16:16:53.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5412000000000002e-05 2024-09-12T16:16:53.467 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.467 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:53.467 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.467 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4440 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15727616~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:53.467 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:16:53.467 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.092477015999997, 2024-09-12T16:16:53.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053761601999999999, 2024-09-12T16:16:53.467 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:53.467 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:53.468 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:53.468 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:53.468 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:53.468 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:53.468 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4440 2024-09-12T16:16:53.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.468 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:53.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.468 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:53.468 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:16:53.468 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.469 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:53.469 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:16:53.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.469 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:53.469 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:16:53.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:16:53.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.469 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:53.469 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287974+0000", 2024-09-12T16:16:53.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0540000000000002e-06 2024-09-12T16:16:53.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:53.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287980+0000", 2024-09-12T16:16:53.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9440000000000002e-06 2024-09-12T16:16:53.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:53.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287987+0000", 2024-09-12T16:16:53.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5889999999999999e-06 2024-09-12T16:16:53.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:53.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341502+0000", 2024-09-12T16:16:53.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053515199999999999 2024-09-12T16:16:53.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:53.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341595+0000", 2024-09-12T16:16:53.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3097000000000007e-05 2024-09-12T16:16:53.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:53.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341734+0000", 2024-09-12T16:16:53.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013832800000000001 2024-09-12T16:16:53.471 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.471 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:53.471 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.471 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.472 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:53.472 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:53.473 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:16:53.474 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:53.471+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:53.573 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:53.572+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:53.594 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:53.594 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:53.594 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:16:53.594 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:53.604 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:16:53.688 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:53.687+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:53.723 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #15, image image_client.0-clone15 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent16 2024-09-12T16:16:53.755 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:53.755 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:53.755 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:16:53.755 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:16:53.755 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:53.764 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:16:53.805 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:53.804+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:53.876 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:53.874+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:53.916 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:53.916 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:16:53.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:16:53.916 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:53.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.916 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2299 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12368896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:53.916 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896004+0000", 2024-09-12T16:16:53.917 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 36.017444187000002, 2024-09-12T16:16:53.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037218257999999997, 2024-09-12T16:16:53.917 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:53.917 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:53.917 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:53.917 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:53.917 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:53.917 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:53.917 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2299 2024-09-12T16:16:53.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.917 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:53.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:53.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896004+0000", 2024-09-12T16:16:53.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:53.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896004+0000", 2024-09-12T16:16:53.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:53.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896005+0000", 2024-09-12T16:16:53.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3700000000000001e-07 2024-09-12T16:16:53.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.919 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:53.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896006+0000", 2024-09-12T16:16:53.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9929999999999998e-06 2024-09-12T16:16:53.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.919 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:53.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896013+0000", 2024-09-12T16:16:53.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1709999999999999e-06 2024-09-12T16:16:53.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.919 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:53.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896017+0000", 2024-09-12T16:16:53.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5050000000000001e-06 2024-09-12T16:16:53.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:53.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933142+0000", 2024-09-12T16:16:53.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037125012999999998 2024-09-12T16:16:53.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:53.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933182+0000", 2024-09-12T16:16:53.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9957999999999999e-05 2024-09-12T16:16:53.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:53.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933222+0000", 2024-09-12T16:16:53.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0181e-05 2024-09-12T16:16:53.921 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.921 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:53.921 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.921 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2300 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12372992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:53.921 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:16:53.921 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 36.01742453, 2024-09-12T16:16:53.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037401246999999999, 2024-09-12T16:16:53.921 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:53.922 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:53.922 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:53.922 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:53.922 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:53.922 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:53.922 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2300 2024-09-12T16:16:53.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.922 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:53.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:53.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:16:53.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:53.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:16:53.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:53.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:16:53.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6100000000000002e-07 2024-09-12T16:16:53.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:53.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896026+0000", 2024-09-12T16:16:53.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9130000000000001e-06 2024-09-12T16:16:53.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.924 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:53.924 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896032+0000", 2024-09-12T16:16:53.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7540000000000003e-06 2024-09-12T16:16:53.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.924 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:53.924 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896036+0000", 2024-09-12T16:16:53.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5750000000000002e-06 2024-09-12T16:16:53.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:53.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933254+0000", 2024-09-12T16:16:53.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037217962 2024-09-12T16:16:53.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:53.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933341+0000", 2024-09-12T16:16:53.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6296000000000002e-05 2024-09-12T16:16:53.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:53.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933425+0000", 2024-09-12T16:16:53.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4386000000000001e-05 2024-09-12T16:16:53.926 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.926 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:53.926 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.926 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2301 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12377088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:53.926 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896043+0000", 2024-09-12T16:16:53.926 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 36.017404788, 2024-09-12T16:16:53.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037486197999999998, 2024-09-12T16:16:53.926 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:53.926 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:53.927 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:53.927 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:53.927 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:53.927 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:53.927 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2301 2024-09-12T16:16:53.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.927 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:53.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:53.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896043+0000", 2024-09-12T16:16:53.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.928 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:53.928 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896043+0000", 2024-09-12T16:16:53.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.928 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:53.928 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896044+0000", 2024-09-12T16:16:53.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.41e-07 2024-09-12T16:16:53.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.928 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:53.928 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896053+0000", 2024-09-12T16:16:53.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8049999999999996e-06 2024-09-12T16:16:53.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.929 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:53.929 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896060+0000", 2024-09-12T16:16:53.929 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.221e-06 2024-09-12T16:16:53.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.929 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:53.929 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896065+0000", 2024-09-12T16:16:53.929 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1109999999999999e-06 2024-09-12T16:16:53.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.929 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:53.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933452+0000", 2024-09-12T16:16:53.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037386560999999999 2024-09-12T16:16:53.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:53.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933491+0000", 2024-09-12T16:16:53.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9789000000000001e-05 2024-09-12T16:16:53.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:53.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933530+0000", 2024-09-12T16:16:53.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.837e-05 2024-09-12T16:16:53.930 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.930 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:53.931 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.931 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2302 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12381184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:53.931 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:16:53.931 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 36.017363348000003, 2024-09-12T16:16:53.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037645284000000001, 2024-09-12T16:16:53.931 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:53.931 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:53.931 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:53.931 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:53.931 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:53.931 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:53.931 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2302 2024-09-12T16:16:53.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.932 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:53.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.932 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:53.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:16:53.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.932 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:53.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:16:53.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:53.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:16:53.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6800000000000001e-07 2024-09-12T16:16:53.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:53.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896088+0000", 2024-09-12T16:16:53.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3429999999999998e-06 2024-09-12T16:16:53.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:53.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896096+0000", 2024-09-12T16:16:53.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0860000000000002e-06 2024-09-12T16:16:53.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:53.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896102+0000", 2024-09-12T16:16:53.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7610000000000004e-06 2024-09-12T16:16:53.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:53.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933563+0000", 2024-09-12T16:16:53.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037461019999999998 2024-09-12T16:16:53.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:53.935 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933648+0000", 2024-09-12T16:16:53.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5468000000000002e-05 2024-09-12T16:16:53.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.935 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:53.935 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933730+0000", 2024-09-12T16:16:53.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2138000000000005e-05 2024-09-12T16:16:53.935 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.935 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:53.935 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.936 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2303 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12385280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:53.936 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:16:53.936 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 36.017339546000002, 2024-09-12T16:16:53.936 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037723083999999997, 2024-09-12T16:16:53.936 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:53.936 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:53.936 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:53.936 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:53.936 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:53.936 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:53.936 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2303 2024-09-12T16:16:53.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.936 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:53.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:53.937 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:16:53.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:53.937 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:16:53.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:53.937 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:16:53.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2500000000000001e-07 2024-09-12T16:16:53.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:53.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896115+0000", 2024-09-12T16:16:53.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.28e-06 2024-09-12T16:16:53.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:53.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896122+0000", 2024-09-12T16:16:53.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4590000000000003e-06 2024-09-12T16:16:53.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:53.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896127+0000", 2024-09-12T16:16:53.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0509999999999996e-06 2024-09-12T16:16:53.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:53.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933755+0000", 2024-09-12T16:16:53.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037627729999999998 2024-09-12T16:16:53.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:53.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933794+0000", 2024-09-12T16:16:53.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9255000000000003e-05 2024-09-12T16:16:53.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:53.940 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933832+0000", 2024-09-12T16:16:53.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7883999999999998e-05 2024-09-12T16:16:53.940 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.940 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:53.940 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.940 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2304 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12389376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:53.940 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:16:53.940 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 36.017314196999997, 2024-09-12T16:16:53.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037911010000000002, 2024-09-12T16:16:53.940 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:53.940 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:53.940 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:53.941 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:53.941 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:53.941 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:53.941 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2304 2024-09-12T16:16:53.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.941 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:53.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.941 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:53.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:16:53.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.941 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:53.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:16:53.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.942 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:53.942 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:16:53.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9900000000000001e-07 2024-09-12T16:16:53.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.942 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:53.942 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896136+0000", 2024-09-12T16:16:53.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.897e-06 2024-09-12T16:16:53.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.942 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:53.942 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896142+0000", 2024-09-12T16:16:53.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9290000000000003e-06 2024-09-12T16:16:53.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:53.943 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896154+0000", 2024-09-12T16:16:53.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.201e-05 2024-09-12T16:16:53.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:53.943 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933865+0000", 2024-09-12T16:16:53.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037710225 2024-09-12T16:16:53.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:53.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933961+0000", 2024-09-12T16:16:53.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6315000000000002e-05 2024-09-12T16:16:53.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:53.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934045+0000", 2024-09-12T16:16:53.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4234999999999996e-05 2024-09-12T16:16:53.944 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.944 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:53.944 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.944 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2305 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12393472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:53.945 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896175+0000", 2024-09-12T16:16:53.945 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 36.017273007, 2024-09-12T16:16:53.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037976941, 2024-09-12T16:16:53.945 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:53.945 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:53.945 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:53.945 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:53.945 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:53.945 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:53.945 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2305 2024-09-12T16:16:53.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.945 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:53.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:53.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896175+0000", 2024-09-12T16:16:53.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:53.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896175+0000", 2024-09-12T16:16:53.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:53.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896176+0000", 2024-09-12T16:16:53.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7400000000000003e-07 2024-09-12T16:16:53.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:53.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896178+0000", 2024-09-12T16:16:53.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6709999999999999e-06 2024-09-12T16:16:53.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:53.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896186+0000", 2024-09-12T16:16:53.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9319999999999996e-06 2024-09-12T16:16:53.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:53.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896192+0000", 2024-09-12T16:16:53.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0799999999999996e-06 2024-09-12T16:16:53.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:53.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934072+0000", 2024-09-12T16:16:53.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037880888000000001 2024-09-12T16:16:53.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:53.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934113+0000", 2024-09-12T16:16:53.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0815999999999997e-05 2024-09-12T16:16:53.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:53.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934152+0000", 2024-09-12T16:16:53.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8980000000000003e-05 2024-09-12T16:16:53.949 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.949 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:53.949 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.949 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2306 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12397568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:53.949 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:16:53.949 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 36.017248729000002, 2024-09-12T16:16:53.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038156347, 2024-09-12T16:16:53.949 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:53.949 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:53.949 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:53.949 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:53.949 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:53.950 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:53.950 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2306 2024-09-12T16:16:53.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.950 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:53.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:53.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:16:53.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:53.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:16:53.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.951 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:53.951 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:16:53.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.77e-07 2024-09-12T16:16:53.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.951 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:53.951 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896202+0000", 2024-09-12T16:16:53.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2359999999999999e-06 2024-09-12T16:16:53.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.951 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:53.951 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896208+0000", 2024-09-12T16:16:53.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1430000000000003e-06 2024-09-12T16:16:53.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:53.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896213+0000", 2024-09-12T16:16:53.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9339999999999997e-06 2024-09-12T16:16:53.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:53.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934188+0000", 2024-09-12T16:16:53.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037974490999999999 2024-09-12T16:16:53.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:53.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934275+0000", 2024-09-12T16:16:53.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7639999999999994e-05 2024-09-12T16:16:53.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:53.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934356+0000", 2024-09-12T16:16:53.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0525999999999994e-05 2024-09-12T16:16:53.953 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.953 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:53.953 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.954 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2307 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12401664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:53.954 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:16:53.954 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 36.017228957, 2024-09-12T16:16:53.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038241450000000003, 2024-09-12T16:16:53.954 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:53.954 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:53.954 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:53.954 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:53.954 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:53.954 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:53.954 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2307 2024-09-12T16:16:53.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.955 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:53.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:53.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:16:53.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:53.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:16:53.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:53.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896220+0000", 2024-09-12T16:16:53.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3500000000000002e-07 2024-09-12T16:16:53.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:53.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896222+0000", 2024-09-12T16:16:53.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1720000000000001e-06 2024-09-12T16:16:53.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:53.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896228+0000", 2024-09-12T16:16:53.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0870000000000003e-06 2024-09-12T16:16:53.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:53.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896233+0000", 2024-09-12T16:16:53.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:16:53.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:53.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934382+0000", 2024-09-12T16:16:53.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038149566000000003 2024-09-12T16:16:53.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:53.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934422+0000", 2024-09-12T16:16:53.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0015999999999998e-05 2024-09-12T16:16:53.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:53.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934461+0000", 2024-09-12T16:16:53.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8423999999999997e-05 2024-09-12T16:16:53.958 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.958 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:53.958 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.958 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2308 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12405760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:53.958 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:16:53.958 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 36.017209260000001, 2024-09-12T16:16:53.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038420745999999999, 2024-09-12T16:16:53.958 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:53.958 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:53.958 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:53.958 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:53.958 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:53.959 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:53.959 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2308 2024-09-12T16:16:53.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.959 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:53.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:53.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:16:53.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:53.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:16:53.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:53.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:16:53.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.58e-07 2024-09-12T16:16:53.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:53.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896241+0000", 2024-09-12T16:16:53.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7940000000000001e-06 2024-09-12T16:16:53.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:53.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896247+0000", 2024-09-12T16:16:53.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1460000000000001e-06 2024-09-12T16:16:53.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:53.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896252+0000", 2024-09-12T16:16:53.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6840000000000004e-06 2024-09-12T16:16:53.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:53.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934494+0000", 2024-09-12T16:16:53.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038242362000000002 2024-09-12T16:16:53.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:53.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934579+0000", 2024-09-12T16:16:53.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5044999999999996e-05 2024-09-12T16:16:53.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:53.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934660+0000", 2024-09-12T16:16:53.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0357000000000003e-05 2024-09-12T16:16:53.962 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.962 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:53.962 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.962 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2309 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12409856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:53.963 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:16:53.963 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 36.017188679999997, 2024-09-12T16:16:53.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038504629999999998, 2024-09-12T16:16:53.963 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:53.963 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:53.963 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:53.963 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:53.963 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:53.963 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:53.963 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2309 2024-09-12T16:16:53.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.963 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:53.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:53.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:16:53.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:53.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:16:53.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:53.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:16:53.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5199999999999998e-07 2024-09-12T16:16:53.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:53.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896263+0000", 2024-09-12T16:16:53.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4209999999999999e-06 2024-09-12T16:16:53.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:53.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896269+0000", 2024-09-12T16:16:53.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9449999999999998e-06 2024-09-12T16:16:53.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:53.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896274+0000", 2024-09-12T16:16:53.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3950000000000003e-06 2024-09-12T16:16:53.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:53.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934686+0000", 2024-09-12T16:16:53.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038412333999999999 2024-09-12T16:16:53.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:53.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934727+0000", 2024-09-12T16:16:53.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0649999999999999e-05 2024-09-12T16:16:53.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:53.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934764+0000", 2024-09-12T16:16:53.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7533000000000001e-05 2024-09-12T16:16:53.967 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.967 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:53.967 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.967 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2310 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12413952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:53.967 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:16:53.967 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 36.017167808000004, 2024-09-12T16:16:53.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038694183, 2024-09-12T16:16:53.968 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:53.968 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:53.968 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:53.968 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:53.968 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:53.968 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:53.968 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2310 2024-09-12T16:16:53.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.968 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:53.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:53.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:16:53.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:53.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:16:53.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:53.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896281+0000", 2024-09-12T16:16:53.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1399999999999997e-07 2024-09-12T16:16:53.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:53.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896283+0000", 2024-09-12T16:16:53.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9549999999999999e-06 2024-09-12T16:16:53.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:53.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896289+0000", 2024-09-12T16:16:53.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8669999999999999e-06 2024-09-12T16:16:53.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:53.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896301+0000", 2024-09-12T16:16:53.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1807999999999999e-05 2024-09-12T16:16:53.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:53.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934798+0000", 2024-09-12T16:16:53.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038497591999999997 2024-09-12T16:16:53.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:53.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934885+0000", 2024-09-12T16:16:53.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7149000000000002e-05 2024-09-12T16:16:53.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:53.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934975+0000", 2024-09-12T16:16:53.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9297999999999998e-05 2024-09-12T16:16:53.971 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.971 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:53.971 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.972 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2311 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12418048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:53.972 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:16:53.972 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 36.017140552000001, 2024-09-12T16:16:53.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038768558000000002, 2024-09-12T16:16:53.972 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:53.972 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:53.972 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:53.972 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:53.972 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:53.972 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:53.972 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2311 2024-09-12T16:16:53.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.972 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:53.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:53.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:16:53.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:53.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:16:53.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:53.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:16:53.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.63e-07 2024-09-12T16:16:53.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:53.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896310+0000", 2024-09-12T16:16:53.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1560000000000002e-06 2024-09-12T16:16:53.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:53.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896316+0000", 2024-09-12T16:16:53.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0249999999999999e-06 2024-09-12T16:16:53.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:53.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896322+0000", 2024-09-12T16:16:53.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6400000000000002e-06 2024-09-12T16:16:53.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:53.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934997+0000", 2024-09-12T16:16:53.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038674565000000001 2024-09-12T16:16:53.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:53.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935037+0000", 2024-09-12T16:16:53.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0485999999999998e-05 2024-09-12T16:16:53.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:53.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935076+0000", 2024-09-12T16:16:53.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9223e-05 2024-09-12T16:16:53.976 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.976 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:53.976 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.976 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2312 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12422144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:53.976 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:16:53.976 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 36.017119858999997, 2024-09-12T16:16:53.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038856784999999998, 2024-09-12T16:16:53.977 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:53.977 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:53.977 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:53.977 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:53.977 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:53.977 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:53.977 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2312 2024-09-12T16:16:53.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.977 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:53.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:53.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:16:53.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:53.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:16:53.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:53.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896329+0000", 2024-09-12T16:16:53.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5499999999999999e-07 2024-09-12T16:16:53.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:53.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896337+0000", 2024-09-12T16:16:53.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0819999999999999e-06 2024-09-12T16:16:53.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:53.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896343+0000", 2024-09-12T16:16:53.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.263e-06 2024-09-12T16:16:53.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:53.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896348+0000", 2024-09-12T16:16:53.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8860000000000003e-06 2024-09-12T16:16:53.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:53.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935097+0000", 2024-09-12T16:16:53.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038748818999999997 2024-09-12T16:16:53.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:53.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935141+0000", 2024-09-12T16:16:53.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4175000000000003e-05 2024-09-12T16:16:53.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:53.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935185+0000", 2024-09-12T16:16:53.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4205000000000001e-05 2024-09-12T16:16:53.981 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.981 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:53.981 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.981 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2313 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12426240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:53.981 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:16:53.981 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 36.017093643999999, 2024-09-12T16:16:53.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038928683999999998, 2024-09-12T16:16:53.982 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:53.982 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:53.982 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:53.982 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:53.982 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:53.982 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:53.982 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2313 2024-09-12T16:16:53.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.982 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:53.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:53.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:16:53.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:53.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:16:53.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:53.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:16:53.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0400000000000002e-07 2024-09-12T16:16:53.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:53.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896357+0000", 2024-09-12T16:16:53.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.097e-06 2024-09-12T16:16:53.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:53.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896363+0000", 2024-09-12T16:16:53.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5119999999999999e-06 2024-09-12T16:16:53.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:53.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896374+0000", 2024-09-12T16:16:53.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1381e-05 2024-09-12T16:16:53.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:53.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935205+0000", 2024-09-12T16:16:53.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038830549999999998 2024-09-12T16:16:53.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:53.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935244+0000", 2024-09-12T16:16:53.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9520000000000001e-05 2024-09-12T16:16:53.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:53.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935283+0000", 2024-09-12T16:16:53.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9220000000000001e-05 2024-09-12T16:16:53.985 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.986 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:53.986 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.986 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2314 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12430336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:53.986 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:16:53.986 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 36.017056474, 2024-09-12T16:16:53.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039008137999999998, 2024-09-12T16:16:53.986 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:53.986 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:53.986 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:53.986 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:53.986 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:53.986 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:53.987 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2314 2024-09-12T16:16:53.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.987 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:53.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:53.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:16:53.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:53.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:16:53.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:53.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:16:53.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6499999999999999e-07 2024-09-12T16:16:53.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:53.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896395+0000", 2024-09-12T16:16:53.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2960000000000001e-06 2024-09-12T16:16:53.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:53.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896402+0000", 2024-09-12T16:16:53.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2280000000000001e-06 2024-09-12T16:16:53.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:53.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896407+0000", 2024-09-12T16:16:53.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3630000000000002e-06 2024-09-12T16:16:53.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:53.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935302+0000", 2024-09-12T16:16:53.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038895181000000001 2024-09-12T16:16:53.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:53.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935343+0000", 2024-09-12T16:16:53.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0590999999999998e-05 2024-09-12T16:16:53.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:53.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935400+0000", 2024-09-12T16:16:53.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7014e-05 2024-09-12T16:16:53.990 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.990 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:53.990 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.990 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2315 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12434432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:53.990 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:16:53.990 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 36.017033822999998, 2024-09-12T16:16:53.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039083892000000002, 2024-09-12T16:16:53.991 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:53.991 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:53.991 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:53.991 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:53.991 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:53.991 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:53.991 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2315 2024-09-12T16:16:53.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.991 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:53.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:53.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:16:53.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:53.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:16:53.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:53.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896415+0000", 2024-09-12T16:16:53.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3300000000000002e-07 2024-09-12T16:16:53.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:53.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896421+0000", 2024-09-12T16:16:53.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7579999999999998e-06 2024-09-12T16:16:53.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:53.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896427+0000", 2024-09-12T16:16:53.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3029999999999996e-06 2024-09-12T16:16:53.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:53.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896432+0000", 2024-09-12T16:16:53.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.215e-06 2024-09-12T16:16:53.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:53.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935420+0000", 2024-09-12T16:16:53.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038987727 2024-09-12T16:16:53.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:53.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935460+0000", 2024-09-12T16:16:53.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9817999999999997e-05 2024-09-12T16:16:53.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:53.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935498+0000", 2024-09-12T16:16:53.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8438e-05 2024-09-12T16:16:53.995 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.995 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:53.995 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.995 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2316 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12438528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:53.995 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:16:53.995 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 36.017009170999998, 2024-09-12T16:16:53.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039160043999999998, 2024-09-12T16:16:53.995 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:53.995 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:53.995 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:53.995 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:53.995 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:53.996 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:53.996 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2316 2024-09-12T16:16:53.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.996 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:53.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:53.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:16:53.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:53.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:16:53.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:53.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:53.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901945+0000", 2024-09-12T16:16:53.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055056050000000002 2024-09-12T16:16:53.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:53.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901950+0000", 2024-09-12T16:16:53.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2490000000000001e-06 2024-09-12T16:16:53.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:53.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901966+0000", 2024-09-12T16:16:53.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6325e-05 2024-09-12T16:16:53.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:53.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901974+0000", 2024-09-12T16:16:53.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7570000000000004e-06 2024-09-12T16:16:53.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:53.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935518+0000", 2024-09-12T16:16:53.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033543587999999999 2024-09-12T16:16:53.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:53.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935559+0000", 2024-09-12T16:16:53.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1746000000000003e-05 2024-09-12T16:16:53.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:53.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:53.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:53.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935599+0000", 2024-09-12T16:16:53.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9774000000000002e-05 2024-09-12T16:16:53.999 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.999 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:53.999 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:53.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.000 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1571 3.b 3:d046566d:::rbd_data.1155525b14e3.0000000000000001:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:16:54.000 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:16:54.000 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 12.760884129000001, 2024-09-12T16:16:54.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064439785999999999, 2024-09-12T16:16:54.000 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:54.000 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:54.000 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:54.000 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:54.000 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:16:54.000 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:16:54.000 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1571 2024-09-12T16:16:54.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.001 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:54.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:54.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:16:54.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:54.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:16:54.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:54.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:16:54.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5400000000000002e-07 2024-09-12T16:16:54.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:54.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152567+0000", 2024-09-12T16:16:54.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.131e-06 2024-09-12T16:16:54.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:54.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152574+0000", 2024-09-12T16:16:54.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1840000000000002e-06 2024-09-12T16:16:54.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:54.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152579+0000", 2024-09-12T16:16:54.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.152e-06 2024-09-12T16:16:54.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:54.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153671+0000", 2024-09-12T16:16:54.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001092078 2024-09-12T16:16:54.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:54.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153779+0000", 2024-09-12T16:16:54.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108461 2024-09-12T16:16:54.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:54.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217004+0000", 2024-09-12T16:16:54.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.063224426 2024-09-12T16:16:54.004 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.004 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:54.004 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.004 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1581 3.4 3:22e34893:::rbd_data.1155525b14e3.0000000000000005:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:16:54.004 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:16:54.005 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 12.760787004000001, 2024-09-12T16:16:54.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064484407999999993, 2024-09-12T16:16:54.005 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:54.005 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:54.005 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:54.005 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:54.005 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:16:54.005 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:16:54.005 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1581 2024-09-12T16:16:54.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.005 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:54.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:54.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:16:54.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:54.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:16:54.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:54.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152662+0000", 2024-09-12T16:16:54.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.65e-07 2024-09-12T16:16:54.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:54.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152664+0000", 2024-09-12T16:16:54.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9829999999999999e-06 2024-09-12T16:16:54.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:54.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152670+0000", 2024-09-12T16:16:54.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2260000000000002e-06 2024-09-12T16:16:54.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:54.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152675+0000", 2024-09-12T16:16:54.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7990000000000001e-06 2024-09-12T16:16:54.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:54.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.216945+0000", 2024-09-12T16:16:54.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064270341999999994 2024-09-12T16:16:54.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:54.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217040+0000", 2024-09-12T16:16:54.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5242999999999996e-05 2024-09-12T16:16:54.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:54.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217146+0000", 2024-09-12T16:16:54.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010545 2024-09-12T16:16:54.009 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.009 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:54.009 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.009 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.009 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:54.009 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:54.010 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:54.009+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:54.011 INFO:teuthology.orchestra.run.smithi204.stdout:3150 read 0x4a38200 thru 0x4a41eff (0x9d00 bytes) 2024-09-12T16:16:54.011 INFO:teuthology.orchestra.run.smithi204.stdout:3152 read 0x6c43400 thru 0x6c4ba27 (0x8628 bytes) 2024-09-12T16:16:54.011 INFO:teuthology.orchestra.run.smithi204.stdout:3153 read 0x77f5e00 thru 0x7800cc5 (0xaec6 bytes) 2024-09-12T16:16:54.011 INFO:teuthology.orchestra.run.smithi204.stdout:3155 clone 18 order 23 su 32768 sc 7 2024-09-12T16:16:54.011 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:16:54.111 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:54.111+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:54.119 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:54.119 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:54.119 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:16:54.119 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:54.127 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:16:54.212 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:54.211+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:54.241 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:54.241 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:54.241 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:16:54.241 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:16:54.241 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:54.250 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:16:54.334 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:54.333+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:54.399 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:54.399 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:16:54.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:16:54.399 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:54.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.399 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2010 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1118208~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:54.399 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790432+0000", 2024-09-12T16:16:54.400 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.606930424000002, 2024-09-12T16:16:54.400 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023851981000000001, 2024-09-12T16:16:54.400 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:54.400 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:54.400 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:54.400 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:54.400 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:54.400 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:54.400 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2010 2024-09-12T16:16:54.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.401 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:54.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.401 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:54.401 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790432+0000", 2024-09-12T16:16:54.401 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.401 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:54.401 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790432+0000", 2024-09-12T16:16:54.401 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:54.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790433+0000", 2024-09-12T16:16:54.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1799999999999995e-07 2024-09-12T16:16:54.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:54.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790442+0000", 2024-09-12T16:16:54.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8030000000000008e-06 2024-09-12T16:16:54.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:54.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790449+0000", 2024-09-12T16:16:54.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-12T16:16:54.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:54.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790455+0000", 2024-09-12T16:16:54.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2700000000000004e-06 2024-09-12T16:16:54.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:54.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814126+0000", 2024-09-12T16:16:54.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023671668999999999 2024-09-12T16:16:54.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.404 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:54.404 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814168+0000", 2024-09-12T16:16:54.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1727999999999998e-05 2024-09-12T16:16:54.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.404 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:54.404 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814284+0000", 2024-09-12T16:16:54.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116153 2024-09-12T16:16:54.405 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.405 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:54.405 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.405 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2011 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1163264~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:54.405 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790463+0000", 2024-09-12T16:16:54.405 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.606899943999998, 2024-09-12T16:16:54.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024104724000000001, 2024-09-12T16:16:54.405 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:54.406 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:54.406 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:54.406 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:54.406 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:54.406 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:54.406 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2011 2024-09-12T16:16:54.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.406 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:54.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:54.406 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790463+0000", 2024-09-12T16:16:54.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.407 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:54.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790463+0000", 2024-09-12T16:16:54.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.407 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:54.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790463+0000", 2024-09-12T16:16:54.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6199999999999998e-07 2024-09-12T16:16:54.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.408 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:54.408 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790465+0000", 2024-09-12T16:16:54.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2419999999999999e-06 2024-09-12T16:16:54.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.408 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:54.408 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790471+0000", 2024-09-12T16:16:54.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0000000000000002e-06 2024-09-12T16:16:54.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:54.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790477+0000", 2024-09-12T16:16:54.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3669999999999996e-06 2024-09-12T16:16:54.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:54.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814317+0000", 2024-09-12T16:16:54.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023840413000000001 2024-09-12T16:16:54.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.410 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:54.410 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814410+0000", 2024-09-12T16:16:54.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3049999999999998e-05 2024-09-12T16:16:54.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.410 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:54.410 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814567+0000", 2024-09-12T16:16:54.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015719 2024-09-12T16:16:54.410 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.410 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:54.410 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.411 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2012 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1208320~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:54.411 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790484+0000", 2024-09-12T16:16:54.411 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.606878686000002, 2024-09-12T16:16:54.411 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024289805000000001, 2024-09-12T16:16:54.411 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:54.411 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:54.411 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:54.411 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:54.411 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:54.411 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:54.411 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2012 2024-09-12T16:16:54.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.411 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:54.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:54.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790484+0000", 2024-09-12T16:16:54.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:54.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790484+0000", 2024-09-12T16:16:54.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:54.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790484+0000", 2024-09-12T16:16:54.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2199999999999999e-07 2024-09-12T16:16:54.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:54.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790486+0000", 2024-09-12T16:16:54.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.979e-06 2024-09-12T16:16:54.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:54.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790493+0000", 2024-09-12T16:16:54.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8950000000000001e-06 2024-09-12T16:16:54.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:54.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790498+0000", 2024-09-12T16:16:54.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8289999999999998e-06 2024-09-12T16:16:54.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:54.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814603+0000", 2024-09-12T16:16:54.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024104787999999999 2024-09-12T16:16:54.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.415 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:54.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814686+0000", 2024-09-12T16:16:54.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3224000000000001e-05 2024-09-12T16:16:54.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.415 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:54.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814774+0000", 2024-09-12T16:16:54.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7668000000000002e-05 2024-09-12T16:16:54.416 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.416 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:54.416 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.416 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2013 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1216512~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:54.416 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790507+0000", 2024-09-12T16:16:54.416 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.606856031, 2024-09-12T16:16:54.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024529395999999998, 2024-09-12T16:16:54.416 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:54.416 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:54.417 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:54.417 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:54.417 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:54.417 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:54.417 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2013 2024-09-12T16:16:54.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.417 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:54.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.417 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:54.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790507+0000", 2024-09-12T16:16:54.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:54.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790507+0000", 2024-09-12T16:16:54.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.419 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:54.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790507+0000", 2024-09-12T16:16:54.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8599999999999997e-07 2024-09-12T16:16:54.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.419 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:54.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790510+0000", 2024-09-12T16:16:54.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.339e-06 2024-09-12T16:16:54.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:54.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790516+0000", 2024-09-12T16:16:54.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2609999999999999e-06 2024-09-12T16:16:54.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:54.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790521+0000", 2024-09-12T16:16:54.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0549999999999999e-06 2024-09-12T16:16:54.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:54.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814810+0000", 2024-09-12T16:16:54.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024289409000000001 2024-09-12T16:16:54.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:54.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.814890+0000", 2024-09-12T16:16:54.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9138e-05 2024-09-12T16:16:54.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.422 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:54.422 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815036+0000", 2024-09-12T16:16:54.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000146408 2024-09-12T16:16:54.422 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.422 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:54.422 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.422 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2014 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1261568~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:54.422 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790529+0000", 2024-09-12T16:16:54.422 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.606833801000001, 2024-09-12T16:16:54.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024767824000000001, 2024-09-12T16:16:54.423 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:54.423 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:54.423 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:54.423 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:54.423 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:54.423 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:54.423 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2014 2024-09-12T16:16:54.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.423 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:54.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.423 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:54.424 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790529+0000", 2024-09-12T16:16:54.424 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.424 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:54.424 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790529+0000", 2024-09-12T16:16:54.424 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.424 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:54.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790529+0000", 2024-09-12T16:16:54.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6100000000000001e-07 2024-09-12T16:16:54.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:54.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790532+0000", 2024-09-12T16:16:54.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3429999999999998e-06 2024-09-12T16:16:54.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:54.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790538+0000", 2024-09-12T16:16:54.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3709999999999996e-06 2024-09-12T16:16:54.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:54.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790543+0000", 2024-09-12T16:16:54.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.933e-06 2024-09-12T16:16:54.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:54.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815084+0000", 2024-09-12T16:16:54.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024541469 2024-09-12T16:16:54.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:54.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815172+0000", 2024-09-12T16:16:54.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7869999999999997e-05 2024-09-12T16:16:54.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:54.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815297+0000", 2024-09-12T16:16:54.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012437700000000001 2024-09-12T16:16:54.427 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.427 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:54.427 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.428 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.428 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2015 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1306624~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:54.428 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790549+0000", 2024-09-12T16:16:54.428 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.606813503000001, 2024-09-12T16:16:54.428 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025019062000000002, 2024-09-12T16:16:54.428 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:54.428 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:54.428 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:54.428 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:54.429 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:54.429 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:54.429 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2015 2024-09-12T16:16:54.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.429 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:54.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.429 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:54.429 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790549+0000", 2024-09-12T16:16:54.429 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.429 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:54.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790549+0000", 2024-09-12T16:16:54.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.430 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:54.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790549+0000", 2024-09-12T16:16:54.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1800000000000001e-07 2024-09-12T16:16:54.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.430 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:54.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790551+0000", 2024-09-12T16:16:54.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.855e-06 2024-09-12T16:16:54.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:54.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790557+0000", 2024-09-12T16:16:54.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2460000000000003e-06 2024-09-12T16:16:54.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:54.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790561+0000", 2024-09-12T16:16:54.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8799999999999999e-06 2024-09-12T16:16:54.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:54.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815329+0000", 2024-09-12T16:16:54.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024767320999999998 2024-09-12T16:16:54.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:54.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815408+0000", 2024-09-12T16:16:54.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9226000000000003e-05 2024-09-12T16:16:54.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:54.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815568+0000", 2024-09-12T16:16:54.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000160116 2024-09-12T16:16:54.433 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.433 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:54.433 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.433 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2016 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1314816~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:54.434 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790568+0000", 2024-09-12T16:16:54.434 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.606794360999999, 2024-09-12T16:16:54.434 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025220411000000002, 2024-09-12T16:16:54.434 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:54.434 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:54.434 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:54.434 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:54.434 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:54.434 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:54.434 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2016 2024-09-12T16:16:54.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.434 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:54.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.435 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:54.435 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790568+0000", 2024-09-12T16:16:54.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.435 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:54.435 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790568+0000", 2024-09-12T16:16:54.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:54.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790569+0000", 2024-09-12T16:16:54.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1699999999999999e-07 2024-09-12T16:16:54.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:54.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790571+0000", 2024-09-12T16:16:54.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2819999999999999e-06 2024-09-12T16:16:54.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:54.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790577+0000", 2024-09-12T16:16:54.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.117e-06 2024-09-12T16:16:54.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.437 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:54.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790582+0000", 2024-09-12T16:16:54.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6110000000000004e-06 2024-09-12T16:16:54.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.437 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:54.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815611+0000", 2024-09-12T16:16:54.438 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025029518000000001 2024-09-12T16:16:54.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.438 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:54.438 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815669+0000", 2024-09-12T16:16:54.438 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7896999999999998e-05 2024-09-12T16:16:54.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.438 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:54.439 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815789+0000", 2024-09-12T16:16:54.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011956900000000001 2024-09-12T16:16:54.439 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.439 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:54.439 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.439 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2017 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1359872~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:54.439 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790596+0000", 2024-09-12T16:16:54.439 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.606766337, 2024-09-12T16:16:54.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025446261000000001, 2024-09-12T16:16:54.439 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:54.440 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:54.440 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:54.440 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:54.440 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:54.440 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:54.440 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2017 2024-09-12T16:16:54.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.440 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:54.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.440 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:54.440 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790596+0000", 2024-09-12T16:16:54.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.441 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:54.441 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790596+0000", 2024-09-12T16:16:54.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.441 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:54.441 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790597+0000", 2024-09-12T16:16:54.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7400000000000003e-07 2024-09-12T16:16:54.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.442 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:54.442 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790599+0000", 2024-09-12T16:16:54.442 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4389999999999999e-06 2024-09-12T16:16:54.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.442 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:54.442 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790606+0000", 2024-09-12T16:16:54.442 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9589999999999998e-06 2024-09-12T16:16:54.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.442 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:54.443 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790612+0000", 2024-09-12T16:16:54.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4840000000000003e-06 2024-09-12T16:16:54.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.443 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:54.443 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815818+0000", 2024-09-12T16:16:54.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025206447 2024-09-12T16:16:54.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.443 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:54.444 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.815910+0000", 2024-09-12T16:16:54.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1898999999999995e-05 2024-09-12T16:16:54.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:54.444 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.816042+0000", 2024-09-12T16:16:54.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132359 2024-09-12T16:16:54.444 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.444 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:54.444 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.445 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2018 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1404928~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:54.445 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790619+0000", 2024-09-12T16:16:54.445 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.606743131999998, 2024-09-12T16:16:54.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025656844000000002, 2024-09-12T16:16:54.445 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:54.445 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:54.445 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:54.445 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:54.446 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:54.446 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:54.446 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2018 2024-09-12T16:16:54.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.446 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:54.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.446 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:54.446 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790619+0000", 2024-09-12T16:16:54.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.446 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:54.447 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790619+0000", 2024-09-12T16:16:54.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.447 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:54.447 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790620+0000", 2024-09-12T16:16:54.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.46e-07 2024-09-12T16:16:54.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.447 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:54.447 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790622+0000", 2024-09-12T16:16:54.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0090000000000002e-06 2024-09-12T16:16:54.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.448 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:54.448 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790628+0000", 2024-09-12T16:16:54.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0349999999999998e-06 2024-09-12T16:16:54.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.448 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:54.448 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790641+0000", 2024-09-12T16:16:54.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2889e-05 2024-09-12T16:16:54.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.449 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:54.449 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.816075+0000", 2024-09-12T16:16:54.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025433951 2024-09-12T16:16:54.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.449 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:54.449 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.816155+0000", 2024-09-12T16:16:54.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9907000000000006e-05 2024-09-12T16:16:54.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.449 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:54.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.816276+0000", 2024-09-12T16:16:54.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121607 2024-09-12T16:16:54.450 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.450 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:54.450 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.450 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4733.0:2019 3.5 3:a19a1fd1:::rbd_data.115511a83a30.0000000000000001:e [read 1413120~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-12T16:16:54.450 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:36.790652+0000", 2024-09-12T16:16:54.450 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.606710996, 2024-09-12T16:16:54.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.02584908, 2024-09-12T16:16:54.451 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:54.451 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:54.451 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:54.451 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:54.451 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4733", 2024-09-12T16:16:54.451 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3488614314", 2024-09-12T16:16:54.451 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2019 2024-09-12T16:16:54.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.451 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:54.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:54.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790652+0000", 2024-09-12T16:16:54.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:54.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790652+0000", 2024-09-12T16:16:54.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:54.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790652+0000", 2024-09-12T16:16:54.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9399999999999995e-07 2024-09-12T16:16:54.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:54.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790655+0000", 2024-09-12T16:16:54.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.481e-06 2024-09-12T16:16:54.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:54.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790661+0000", 2024-09-12T16:16:54.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1999999999999999e-06 2024-09-12T16:16:54.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:54.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.790666+0000", 2024-09-12T16:16:54.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8670000000000002e-06 2024-09-12T16:16:54.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:54.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.816306+0000", 2024-09-12T16:16:54.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025640039 2024-09-12T16:16:54.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:54.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.816382+0000", 2024-09-12T16:16:54.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6771000000000001e-05 2024-09-12T16:16:54.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:54.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:36.816501+0000", 2024-09-12T16:16:54.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011822799999999999 2024-09-12T16:16:54.455 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.455 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:54.455 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.456 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4805.0:6829 3.18 3:1e2ee373:::rbd_data.1155c2c5fc24.0000000000000003:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 18778112~25088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T16:16:54.456 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:43.576065+0000", 2024-09-12T16:16:54.456 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.821297125999999, 2024-09-12T16:16:54.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044824155999999997, 2024-09-12T16:16:54.456 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:54.456 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:54.456 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:54.456 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:54.456 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4805", 2024-09-12T16:16:54.457 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3734391115", 2024-09-12T16:16:54.457 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6829 2024-09-12T16:16:54.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.457 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:54.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:54.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.576065+0000", 2024-09-12T16:16:54.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:54.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.576065+0000", 2024-09-12T16:16:54.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:54.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.576068+0000", 2024-09-12T16:16:54.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1629999999999999e-06 2024-09-12T16:16:54.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:54.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.588880+0000", 2024-09-12T16:16:54.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012812054 2024-09-12T16:16:54.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:54.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.588909+0000", 2024-09-12T16:16:54.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9354000000000001e-05 2024-09-12T16:16:54.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:54.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.588930+0000", 2024-09-12T16:16:54.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0571999999999999e-05 2024-09-12T16:16:54.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.460 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:54.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.589010+0000", 2024-09-12T16:16:54.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0780999999999998e-05 2024-09-12T16:16:54.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.460 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:54.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.589174+0000", 2024-09-12T16:16:54.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016337799999999999 2024-09-12T16:16:54.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 1", 2024-09-12T16:16:54.461 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.590261+0000", 2024-09-12T16:16:54.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001087735 2024-09-12T16:16:54.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:16:54.461 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.610690+0000", 2024-09-12T16:16:54.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020428281999999999 2024-09-12T16:16:54.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:54.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.620760+0000", 2024-09-12T16:16:54.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010070325999999999 2024-09-12T16:16:54.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:16:54.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.620836+0000", 2024-09-12T16:16:54.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5617999999999993e-05 2024-09-12T16:16:54.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.463 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:54.463 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.620890+0000", 2024-09-12T16:16:54.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3893000000000001e-05 2024-09-12T16:16:54.463 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.463 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:54.463 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.463 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4805.0:10630 3.5 3:a735f393:::rbd_data.1155525b14e3.0000000000000035:f [read 679936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-09-12T16:16:54.463 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:43.839654+0000", 2024-09-12T16:16:54.463 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.557708997000001, 2024-09-12T16:16:54.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023715737000000001, 2024-09-12T16:16:54.464 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:54.464 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:54.464 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:54.464 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:54.464 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4805", 2024-09-12T16:16:54.464 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3734391115", 2024-09-12T16:16:54.464 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 10630 2024-09-12T16:16:54.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.464 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:54.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:54.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839654+0000", 2024-09-12T16:16:54.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:54.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839654+0000", 2024-09-12T16:16:54.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:54.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839654+0000", 2024-09-12T16:16:54.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7099999999999997e-07 2024-09-12T16:16:54.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:54.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839656+0000", 2024-09-12T16:16:54.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0980000000000001e-06 2024-09-12T16:16:54.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:54.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839663+0000", 2024-09-12T16:16:54.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5119999999999997e-06 2024-09-12T16:16:54.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.467 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:54.467 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839668+0000", 2024-09-12T16:16:54.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0900000000000004e-06 2024-09-12T16:16:54.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.467 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:54.467 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863252+0000", 2024-09-12T16:16:54.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023583908000000001 2024-09-12T16:16:54.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.468 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:54.468 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863300+0000", 2024-09-12T16:16:54.468 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8347999999999999e-05 2024-09-12T16:16:54.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.468 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:54.468 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863369+0000", 2024-09-12T16:16:54.468 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9410000000000001e-05 2024-09-12T16:16:54.468 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.468 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:54.468 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.469 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4805.0:10631 3.5 3:a1218f83:::rbd_data.1155525b14e3.000000000000002d:f [read 712704~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-09-12T16:16:54.469 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:43.839674+0000", 2024-09-12T16:16:54.469 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.55768817, 2024-09-12T16:16:54.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023832401, 2024-09-12T16:16:54.469 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:54.469 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:54.469 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:54.469 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:54.470 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4805", 2024-09-12T16:16:54.470 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3734391115", 2024-09-12T16:16:54.470 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 10631 2024-09-12T16:16:54.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.470 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:54.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:54.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839674+0000", 2024-09-12T16:16:54.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:54.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839674+0000", 2024-09-12T16:16:54.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:54.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839675+0000", 2024-09-12T16:16:54.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.72e-07 2024-09-12T16:16:54.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:54.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839677+0000", 2024-09-12T16:16:54.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0219999999999999e-06 2024-09-12T16:16:54.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:54.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839683+0000", 2024-09-12T16:16:54.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5060000000000001e-06 2024-09-12T16:16:54.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:54.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839688+0000", 2024-09-12T16:16:54.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8879999999999996e-06 2024-09-12T16:16:54.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.473 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:54.473 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863393+0000", 2024-09-12T16:16:54.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023704691 2024-09-12T16:16:54.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.473 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:54.473 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863438+0000", 2024-09-12T16:16:54.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5077000000000002e-05 2024-09-12T16:16:54.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.474 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:54.474 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863507+0000", 2024-09-12T16:16:54.474 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8844999999999996e-05 2024-09-12T16:16:54.474 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.474 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:54.474 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.474 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4805.0:10635 3.5 3:a735f393:::rbd_data.1155525b14e3.0000000000000035:f [read 708608~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-09-12T16:16:54.475 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:43.839695+0000", 2024-09-12T16:16:54.475 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.557667699, 2024-09-12T16:16:54.475 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023949386999999999, 2024-09-12T16:16:54.475 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:54.475 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:54.475 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:54.475 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:54.475 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4805", 2024-09-12T16:16:54.475 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3734391115", 2024-09-12T16:16:54.475 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 10635 2024-09-12T16:16:54.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.476 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:54.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.476 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:54.476 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839695+0000", 2024-09-12T16:16:54.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.476 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:54.476 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839695+0000", 2024-09-12T16:16:54.477 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.477 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:54.477 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839695+0000", 2024-09-12T16:16:54.477 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8700000000000001e-07 2024-09-12T16:16:54.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.477 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:54.477 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839697+0000", 2024-09-12T16:16:54.477 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0549999999999998e-06 2024-09-12T16:16:54.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.478 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.478 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:54.478 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839704+0000", 2024-09-12T16:16:54.478 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4989999999999999e-06 2024-09-12T16:16:54.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.478 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.478 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:54.478 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839709+0000", 2024-09-12T16:16:54.478 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3970000000000002e-06 2024-09-12T16:16:54.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.479 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:54.479 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863529+0000", 2024-09-12T16:16:54.479 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023820277000000001 2024-09-12T16:16:54.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.479 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:54.479 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863575+0000", 2024-09-12T16:16:54.479 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5259000000000002e-05 2024-09-12T16:16:54.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.480 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:54.480 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863644+0000", 2024-09-12T16:16:54.480 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9512999999999997e-05 2024-09-12T16:16:54.480 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.480 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:54.480 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.481 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4805.0:10637 3.5 3:a1218f83:::rbd_data.1155525b14e3.000000000000002d:f [read 741376~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-09-12T16:16:54.481 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:43.839716+0000", 2024-09-12T16:16:54.481 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.557647016000001, 2024-09-12T16:16:54.481 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024074149999999999, 2024-09-12T16:16:54.481 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:54.481 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:54.481 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:54.481 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:54.481 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4805", 2024-09-12T16:16:54.481 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3734391115", 2024-09-12T16:16:54.481 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 10637 2024-09-12T16:16:54.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.482 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:54.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.482 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:54.482 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839716+0000", 2024-09-12T16:16:54.482 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.482 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:54.482 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839716+0000", 2024-09-12T16:16:54.482 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.483 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.483 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:54.483 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839716+0000", 2024-09-12T16:16:54.483 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9499999999999998e-07 2024-09-12T16:16:54.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.483 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.483 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:54.483 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839718+0000", 2024-09-12T16:16:54.483 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.012e-06 2024-09-12T16:16:54.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.484 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:54.484 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839724+0000", 2024-09-12T16:16:54.484 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4180000000000002e-06 2024-09-12T16:16:54.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.484 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:54.484 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839729+0000", 2024-09-12T16:16:54.484 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1089999999999997e-06 2024-09-12T16:16:54.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:54.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863668+0000", 2024-09-12T16:16:54.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023938734999999999 2024-09-12T16:16:54.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:54.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863713+0000", 2024-09-12T16:16:54.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4994999999999999e-05 2024-09-12T16:16:54.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:54.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863790+0000", 2024-09-12T16:16:54.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6485999999999999e-05 2024-09-12T16:16:54.486 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.486 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:54.486 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.486 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4805.0:10642 3.5 3:a735f393:::rbd_data.1155525b14e3.0000000000000035:f [read 737280~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-09-12T16:16:54.486 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:43.839736+0000", 2024-09-12T16:16:54.486 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.55762636, 2024-09-12T16:16:54.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024204321000000001, 2024-09-12T16:16:54.486 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:54.487 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:54.487 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:54.487 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:54.487 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4805", 2024-09-12T16:16:54.487 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3734391115", 2024-09-12T16:16:54.487 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 10642 2024-09-12T16:16:54.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.487 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:54.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.487 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:54.487 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839736+0000", 2024-09-12T16:16:54.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.488 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:54.488 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839736+0000", 2024-09-12T16:16:54.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.488 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:54.488 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839737+0000", 2024-09-12T16:16:54.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2e-07 2024-09-12T16:16:54.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.489 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:54.489 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839739+0000", 2024-09-12T16:16:54.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9740000000000001e-06 2024-09-12T16:16:54.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.489 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:54.489 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839745+0000", 2024-09-12T16:16:54.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5139999999999998e-06 2024-09-12T16:16:54.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.489 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:54.489 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839750+0000", 2024-09-12T16:16:54.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8230000000000002e-06 2024-09-12T16:16:54.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:54.490 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863812+0000", 2024-09-12T16:16:54.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024062554 2024-09-12T16:16:54.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:54.490 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863858+0000", 2024-09-12T16:16:54.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5827e-05 2024-09-12T16:16:54.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.491 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:54.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863941+0000", 2024-09-12T16:16:54.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2208999999999998e-05 2024-09-12T16:16:54.491 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.491 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:54.491 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.491 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4805.0:10643 3.5 3:a1218f83:::rbd_data.1155525b14e3.000000000000002d:f [read 770048~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-09-12T16:16:54.491 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:43.839757+0000", 2024-09-12T16:16:54.491 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.557605922, 2024-09-12T16:16:54.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024320068, 2024-09-12T16:16:54.492 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:54.492 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:54.492 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:54.492 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:54.492 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4805", 2024-09-12T16:16:54.492 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3734391115", 2024-09-12T16:16:54.492 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 10643 2024-09-12T16:16:54.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.492 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:54.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.493 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:54.493 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839757+0000", 2024-09-12T16:16:54.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.493 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:54.493 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839757+0000", 2024-09-12T16:16:54.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.494 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:54.494 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839757+0000", 2024-09-12T16:16:54.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0400000000000002e-07 2024-09-12T16:16:54.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.496 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:54.496 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839759+0000", 2024-09-12T16:16:54.496 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.99e-06 2024-09-12T16:16:54.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.496 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:54.496 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839765+0000", 2024-09-12T16:16:54.496 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3289999999999999e-06 2024-09-12T16:16:54.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.497 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:54.497 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839770+0000", 2024-09-12T16:16:54.497 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9969999999999998e-06 2024-09-12T16:16:54.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.497 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:54.497 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.863964+0000", 2024-09-12T16:16:54.497 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024193394999999999 2024-09-12T16:16:54.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:54.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.864008+0000", 2024-09-12T16:16:54.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4002999999999999e-05 2024-09-12T16:16:54.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:54.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.864077+0000", 2024-09-12T16:16:54.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8949999999999995e-05 2024-09-12T16:16:54.498 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.498 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:54.499 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.499 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4805.0:10653 3.5 3:a735f393:::rbd_data.1155525b14e3.0000000000000035:f [read 782336~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-09-12T16:16:54.499 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:43.839781+0000", 2024-09-12T16:16:54.499 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.557581090999999, 2024-09-12T16:16:54.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024439470000000001, 2024-09-12T16:16:54.499 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:54.499 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:54.499 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:54.499 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:54.500 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4805", 2024-09-12T16:16:54.500 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3734391115", 2024-09-12T16:16:54.500 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 10653 2024-09-12T16:16:54.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.500 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:54.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:54.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839781+0000", 2024-09-12T16:16:54.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:54.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839781+0000", 2024-09-12T16:16:54.501 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.501 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:54.501 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839782+0000", 2024-09-12T16:16:54.501 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4099999999999999e-07 2024-09-12T16:16:54.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.501 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:54.501 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839784+0000", 2024-09-12T16:16:54.501 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2479999999999999e-06 2024-09-12T16:16:54.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.502 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:54.502 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839794+0000", 2024-09-12T16:16:54.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0283e-05 2024-09-12T16:16:54.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.502 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:54.502 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839800+0000", 2024-09-12T16:16:54.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4870000000000002e-06 2024-09-12T16:16:54.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.502 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:54.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.864102+0000", 2024-09-12T16:16:54.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.02430177 2024-09-12T16:16:54.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:54.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.864146+0000", 2024-09-12T16:16:54.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4697000000000003e-05 2024-09-12T16:16:54.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:54.504 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.864221+0000", 2024-09-12T16:16:54.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4543999999999996e-05 2024-09-12T16:16:54.504 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.504 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:54.504 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.504 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4805.0:10656 3.5 3:a1218f83:::rbd_data.1155525b14e3.000000000000002d:f [read 815104~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-09-12T16:16:54.504 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:43.839808+0000", 2024-09-12T16:16:54.504 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.557554361999999, 2024-09-12T16:16:54.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024552312999999999, 2024-09-12T16:16:54.504 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:54.505 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:54.505 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:54.505 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:54.505 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4805", 2024-09-12T16:16:54.505 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3734391115", 2024-09-12T16:16:54.505 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 10656 2024-09-12T16:16:54.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.505 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:54.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.505 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:54.505 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839808+0000", 2024-09-12T16:16:54.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.506 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:54.506 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839808+0000", 2024-09-12T16:16:54.506 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.506 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:54.506 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839809+0000", 2024-09-12T16:16:54.506 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1399999999999997e-07 2024-09-12T16:16:54.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.507 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:54.507 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839811+0000", 2024-09-12T16:16:54.507 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4480000000000001e-06 2024-09-12T16:16:54.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.507 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:54.507 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839817+0000", 2024-09-12T16:16:54.507 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3980000000000004e-06 2024-09-12T16:16:54.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.507 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:54.507 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839823+0000", 2024-09-12T16:16:54.508 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2789999999999998e-06 2024-09-12T16:16:54.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.508 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:54.508 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.864244+0000", 2024-09-12T16:16:54.508 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024420996 2024-09-12T16:16:54.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.508 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:54.508 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.864289+0000", 2024-09-12T16:16:54.508 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4981000000000002e-05 2024-09-12T16:16:54.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.509 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:54.509 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.864360+0000", 2024-09-12T16:16:54.509 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1797000000000004e-05 2024-09-12T16:16:54.509 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.509 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:54.509 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.509 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4805.0:10662 3.5 3:a735f393:::rbd_data.1155525b14e3.0000000000000035:f [read 811008~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-09-12T16:16:54.509 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:43.839830+0000", 2024-09-12T16:16:54.510 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.557532608000001, 2024-09-12T16:16:54.510 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024660374999999998, 2024-09-12T16:16:54.510 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:54.510 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:54.510 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:54.510 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:54.510 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4805", 2024-09-12T16:16:54.510 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3734391115", 2024-09-12T16:16:54.510 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 10662 2024-09-12T16:16:54.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.510 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:54.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.511 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:54.511 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839830+0000", 2024-09-12T16:16:54.511 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.511 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:54.511 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839830+0000", 2024-09-12T16:16:54.511 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:54.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.511 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:54.511 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839830+0000", 2024-09-12T16:16:54.512 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2399999999999999e-07 2024-09-12T16:16:54.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.512 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:54.512 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839832+0000", 2024-09-12T16:16:54.512 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0229999999999999e-06 2024-09-12T16:16:54.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.512 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:54.512 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839839+0000", 2024-09-12T16:16:54.512 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3589999999999996e-06 2024-09-12T16:16:54.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.513 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:54.513 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.839843+0000", 2024-09-12T16:16:54.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7530000000000001e-06 2024-09-12T16:16:54.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.513 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:54.513 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.864374+0000", 2024-09-12T16:16:54.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024530600999999999 2024-09-12T16:16:54.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:54.514 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.864421+0000", 2024-09-12T16:16:54.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6968999999999997e-05 2024-09-12T16:16:54.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:54.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:54.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:54.514 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.864490+0000", 2024-09-12T16:16:54.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9245999999999994e-05 2024-09-12T16:16:54.514 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.514 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:54.514 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.514 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:54.515 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:54.515 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:54.516 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:16:54.517 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:54.515+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:54.617 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:54.615+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:54.631 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:54.631 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:16:54.632 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:54.632 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:11588 3.11 3.2eef4811 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-12T16:16:54.632 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:54.236151+0000", 2024-09-12T16:16:54.632 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.395403277, 2024-09-12T16:16:54.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.39542292600000001, 2024-09-12T16:16:54.632 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:54.632 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:54.632 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "waiting for peered", 2024-09-12T16:16:54.632 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:54.632 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:16:54.632 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:16:54.633 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 11588 2024-09-12T16:16:54.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:54.633 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:54.633 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:54.633 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:54.633 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:54.236151+0000", 2024-09-12T16:16:54.633 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:54.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:54.633 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:54.633 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:54.633 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:54.236151+0000", 2024-09-12T16:16:54.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:54.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:54.634 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:54.634 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:54.634 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:54.236154+0000", 2024-09-12T16:16:54.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.773e-06 2024-09-12T16:16:54.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:54.634 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:54.634 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:54.634 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:54.236173+0000", 2024-09-12T16:16:54.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9655000000000001e-05 2024-09-12T16:16:54.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:54.635 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:54.635 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:54.635 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:54.236186+0000", 2024-09-12T16:16:54.635 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2644e-05 2024-09-12T16:16:54.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:54.635 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:54.635 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:54.635 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:54.236192+0000", 2024-09-12T16:16:54.635 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0229999999999998e-06 2024-09-12T16:16:54.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:54.635 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:54.636 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:54.636 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:54.236260+0000", 2024-09-12T16:16:54.636 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8133000000000006e-05 2024-09-12T16:16:54.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:54.636 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:54.636 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:16:54.636 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:54.236268+0000", 2024-09-12T16:16:54.636 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7919999999999993e-06 2024-09-12T16:16:54.636 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:54.636 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:54.636 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:54.637 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:54.637 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-12T16:16:54.637 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 1 2024-09-12T16:16:54.637 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:54.641 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:16:54.718 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:54.717+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:54.722 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T16:16:54.788 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:54.788 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:16:54.789 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:16:54.789 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:16:54.789 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:54.797 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:16:54.819 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:54.818+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:54.847 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:16:54.847 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:16:54.864 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:16:54.864 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:16:54.880 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:16:54.880 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:16:54.897 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:16:54.897 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:16:54.904 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:54.904 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:54.913 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:16:54.914 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:16:54.914 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:16:54.915 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-12T16:16:54.918 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T16:16:54.918 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T16:16:54.957 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:54.956+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:55.020 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:55.020 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:55.021 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:55.020+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:55.028 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:16:55.121 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:55.120+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:55.175 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:55.175 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:55.183 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:16:55.203 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T16:16:55.238 INFO:teuthology.orchestra.run.smithi204.stdout:truncating image image_client.0-clone17 from 0xccc7e00 (overlap 0xccc7e00) to 0x8f58a00 2024-09-12T16:16:55.247 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:55.246+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:55.324 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:55.323+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:55.339 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:55.340 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:55.348 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:16:55.426 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:55.424+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:55.462 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:55.462 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:55.470 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:16:55.526 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:55.525+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:55.583 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:55.583 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:55.592 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:16:55.603 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #16, image image_client.0-clone16 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent17 2024-09-12T16:16:55.636 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:55.635+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:55.708 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:55.708 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:55.718 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:16:55.728 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:55.727+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:55.829 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:55.828+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:55.877 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:55.877 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:55.887 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:16:55.930 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:55.928+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:56.004 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:56.005 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:56.014 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:16:56.058 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:56.057+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:56.121 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:56.121 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:56.129 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:16:56.171 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:56.170+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:56.188 INFO:teuthology.orchestra.run.smithi204.stdout:3156 write 0x9c77e00 thru 0x9c7e551 (0x6752 bytes) 2024-09-12T16:16:56.191 INFO:teuthology.orchestra.run.smithi204.stdout:3157 trunc from 0xccc7e00 to 0xe843600 2024-09-12T16:16:56.200 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5, 3] out_osds: [] dead_osds: [5] live_osds: [0, 1, 2, 3, 4] 2024-09-12T16:16:56.200 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T16:16:56.200 INFO:tasks.thrashosds.thrasher:Reviving osd 5 2024-09-12T16:16:56.200 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T16:16:56.201 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T16:16:56.203 INFO:tasks.ceph.osd.5:Started 2024-09-12T16:16:56.203 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:16:56.204 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2024-09-12T16:16:56.222 INFO:teuthology.orchestra.run.smithi204.stdout:3159 write 0xda8e800 thru 0xda9af0d (0xc70e bytes) 2024-09-12T16:16:56.233 INFO:teuthology.orchestra.run.smithi204.stdout:3162 trunc from 0xe843600 to 0x54d7600 2024-09-12T16:16:56.259 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:56.258+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:56.291 INFO:teuthology.orchestra.run.smithi204.stdout:3163 punch from 0x3b4e800 to 0x3b5ca00, (0xe200 bytes) 2024-09-12T16:16:56.293 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:56.293 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:56.303 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:16:56.306 INFO:teuthology.orchestra.run.smithi204.stdout:3164 write 0x5aa2c00 thru 0x5aa6f6f (0x4370 bytes) 2024-09-12T16:16:56.307 INFO:teuthology.orchestra.run.smithi204.stdout:3165 read 0x2989c00 thru 0x299139d (0x779e bytes) 2024-09-12T16:16:56.307 INFO:teuthology.orchestra.run.smithi204.stdout:3166 read 0x5564800 thru 0x557242b (0xdc2c bytes) 2024-09-12T16:16:56.321 INFO:teuthology.orchestra.run.smithi047.stderr:no valid command found; 10 closest matches: 2024-09-12T16:16:56.321 INFO:teuthology.orchestra.run.smithi047.stderr:0 2024-09-12T16:16:56.321 INFO:teuthology.orchestra.run.smithi047.stderr:1 2024-09-12T16:16:56.321 INFO:teuthology.orchestra.run.smithi047.stderr:2 2024-09-12T16:16:56.321 INFO:teuthology.orchestra.run.smithi047.stderr:abort 2024-09-12T16:16:56.321 INFO:teuthology.orchestra.run.smithi047.stderr:assert 2024-09-12T16:16:56.321 INFO:teuthology.orchestra.run.smithi047.stderr:config diff 2024-09-12T16:16:56.322 INFO:teuthology.orchestra.run.smithi047.stderr:config diff get 2024-09-12T16:16:56.322 INFO:teuthology.orchestra.run.smithi047.stderr:config get 2024-09-12T16:16:56.322 INFO:teuthology.orchestra.run.smithi047.stderr:config help [] 2024-09-12T16:16:56.322 INFO:teuthology.orchestra.run.smithi047.stderr:config set ... 2024-09-12T16:16:56.322 INFO:teuthology.orchestra.run.smithi047.stderr:admin_socket: invalid command 2024-09-12T16:16:56.324 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T16:16:56.324 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-5, ['dump_ops_in_flight'] 2024-09-12T16:16:56.334 INFO:teuthology.orchestra.run.smithi204.stdout:3167 write 0xd7c4800 thru 0xd7d03af (0xbbb0 bytes) 2024-09-12T16:16:56.334 INFO:teuthology.orchestra.run.smithi204.stdout:3171 trunc from 0xd7d0400 to 0xdfc3a00 2024-09-12T16:16:56.344 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:56.343+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:56.362 INFO:teuthology.orchestra.run.smithi204.stdout:3172 trunc from 0xdfc3a00 to 0x6d1c400 2024-09-12T16:16:56.385 INFO:teuthology.orchestra.run.smithi204.stdout:3173 read 0x191a000 thru 0x1925593 (0xb594 bytes) 2024-09-12T16:16:56.385 INFO:teuthology.orchestra.run.smithi204.stdout:3174 read 0x6679400 thru 0x668932d (0xff2e bytes) 2024-09-12T16:16:56.403 INFO:teuthology.orchestra.run.smithi204.stdout:3175 write 0x9a19e00 thru 0x9a19ed2 (0xd3 bytes) 2024-09-12T16:16:56.403 INFO:teuthology.orchestra.run.smithi204.stdout:3179 read 0x870e800 thru 0x8711db0 (0x35b1 bytes) 2024-09-12T16:16:56.403 INFO:teuthology.orchestra.run.smithi204.stdout:3180 punch from 0x4e58a00 to 0x4e66c00, (0xe200 bytes) 2024-09-12T16:16:56.421 INFO:teuthology.orchestra.run.smithi204.stdout:3181 write 0xbfdb400 thru 0xbfe160f (0x6210 bytes) 2024-09-12T16:16:56.421 INFO:teuthology.orchestra.run.smithi204.stdout:3182 punch from 0x5ddbe00 to 0x5de3200, (0x7400 bytes) 2024-09-12T16:16:56.421 INFO:teuthology.orchestra.run.smithi204.stdout:3184 read 0x9b65800 thru 0x9b6bef4 (0x66f5 bytes) 2024-09-12T16:16:56.421 INFO:teuthology.orchestra.run.smithi204.stdout:3185 write 0x9d94400 thru 0x9d9b8e9 (0x74ea bytes) 2024-09-12T16:16:56.422 INFO:teuthology.orchestra.run.smithi204.stdout:3186 clone 19 order 24 su 262144 sc 11 2024-09-12T16:16:56.435 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:56.434+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:56.457 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:56.457 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:56.466 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:16:56.536 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:56.535+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:56.613 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:56.613 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:56.622 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:16:56.637 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:56.636+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:56.731 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:56.731 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:56.738 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:56.737+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:56.740 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:16:56.838 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:56.837+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:56.847 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:56.847 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:56.855 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:16:56.919 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T16:16:56.963 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:56.962+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:57.002 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:57.002 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:57.011 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:16:57.040 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:57.039+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:57.043 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:16:57.044 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:16:57.061 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:16:57.061 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:16:57.077 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:16:57.077 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:16:57.094 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:16:57.094 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:16:57.111 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:16:57.111 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:16:57.111 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-12T16:16:57.114 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T16:16:57.115 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T16:16:57.119 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:57.119 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:16:57.119 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:16:57.119 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:57.127 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:16:57.145 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:16:57.144+0000 7fb45ec0b640 -1 Falling back to public interface 2024-09-12T16:16:57.156 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:57.155+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:57.239 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:57.240 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:16:57.240 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:16:57.240 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:16:57.240 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:57.242 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:57.241+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:57.248 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:16:57.282 INFO:teuthology.orchestra.run.smithi204.stdout:truncating image image_client.0-clone18 from 0xbfe1800 (overlap 0x54d7600) to 0x87be00 2024-09-12T16:16:57.343 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:57.342+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:57.409 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:16:57.409 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:16:57.409 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:16:57.409 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:16:57.409 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.409 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5599 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4788224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:57.409 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:16:57.410 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 17.110981045999999, 2024-09-12T16:16:57.410 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061192059, 2024-09-12T16:16:57.410 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:57.410 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:57.410 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:57.410 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:57.410 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:57.410 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:57.410 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5599 2024-09-12T16:16:57.410 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.410 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:57.410 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.410 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:57.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:16:57.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.411 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.411 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:57.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:16:57.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.411 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.411 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:57.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296333+0000", 2024-09-12T16:16:57.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6599999999999996e-07 2024-09-12T16:16:57.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.412 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:57.412 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296335+0000", 2024-09-12T16:16:57.412 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5900000000000002e-06 2024-09-12T16:16:57.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.412 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:57.412 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296344+0000", 2024-09-12T16:16:57.412 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9539999999999993e-06 2024-09-12T16:16:57.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.412 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:57.412 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296350+0000", 2024-09-12T16:16:57.413 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5589999999999996e-06 2024-09-12T16:16:57.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.413 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:57.413 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357307+0000", 2024-09-12T16:16:57.413 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.060957573000000001 2024-09-12T16:16:57.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.413 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:57.413 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357401+0000", 2024-09-12T16:16:57.413 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3512999999999997e-05 2024-09-12T16:16:57.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.414 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:57.414 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357524+0000", 2024-09-12T16:16:57.414 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000123304 2024-09-12T16:16:57.414 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.414 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:57.414 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.414 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.414 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5611 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4730880~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:57.414 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:16:57.414 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 17.110918602000002, 2024-09-12T16:16:57.414 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061359348000000001, 2024-09-12T16:16:57.414 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:57.414 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:57.415 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:57.415 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:57.415 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:57.415 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:57.415 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5611 2024-09-12T16:16:57.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.415 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:57.415 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.415 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:57.415 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:16:57.415 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.415 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.415 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:57.416 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:16:57.416 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.416 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.416 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.416 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:57.416 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296395+0000", 2024-09-12T16:16:57.416 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4600000000000003e-07 2024-09-12T16:16:57.416 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.416 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.416 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:57.416 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296399+0000", 2024-09-12T16:16:57.416 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9430000000000002e-06 2024-09-12T16:16:57.416 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.417 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.417 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:57.417 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296411+0000", 2024-09-12T16:16:57.417 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1755e-05 2024-09-12T16:16:57.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.417 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.417 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:57.417 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296417+0000", 2024-09-12T16:16:57.417 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3790000000000003e-06 2024-09-12T16:16:57.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.417 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.417 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:57.417 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357572+0000", 2024-09-12T16:16:57.417 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061154871 2024-09-12T16:16:57.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.418 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.418 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:57.418 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357663+0000", 2024-09-12T16:16:57.418 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0389999999999993e-05 2024-09-12T16:16:57.418 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.418 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.418 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:57.418 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357754+0000", 2024-09-12T16:16:57.418 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1063999999999994e-05 2024-09-12T16:16:57.418 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.418 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:57.418 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.418 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.418 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.418 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5613 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4775936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:57.419 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:16:57.419 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 17.110877422000002, 2024-09-12T16:16:57.419 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061491777999999997, 2024-09-12T16:16:57.419 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:57.419 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:57.419 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:57.419 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:57.419 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:57.419 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:57.419 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5613 2024-09-12T16:16:57.419 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.419 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:57.419 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.419 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:57.419 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:16:57.419 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.420 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.420 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:57.420 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:16:57.420 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.420 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.420 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:57.420 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:16:57.420 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8899999999999999e-07 2024-09-12T16:16:57.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.420 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.420 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:57.420 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296439+0000", 2024-09-12T16:16:57.420 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8439999999999998e-06 2024-09-12T16:16:57.421 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.421 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.421 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:57.421 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296452+0000", 2024-09-12T16:16:57.421 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2639e-05 2024-09-12T16:16:57.421 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.421 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.421 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:57.421 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296457+0000", 2024-09-12T16:16:57.421 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5720000000000002e-06 2024-09-12T16:16:57.421 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.421 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.421 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:57.421 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357773+0000", 2024-09-12T16:16:57.421 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061315500000000002 2024-09-12T16:16:57.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.422 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.422 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:57.422 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357814+0000", 2024-09-12T16:16:57.422 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1448e-05 2024-09-12T16:16:57.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.422 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.422 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:57.422 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357927+0000", 2024-09-12T16:16:57.422 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000113186 2024-09-12T16:16:57.422 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.422 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:57.422 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.422 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.423 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5616 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4784128~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:57.423 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:16:57.423 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 17.110842359999999, 2024-09-12T16:16:57.423 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061725002000000001, 2024-09-12T16:16:57.423 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:57.423 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:57.423 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:57.423 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:57.423 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:57.423 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:57.423 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5616 2024-09-12T16:16:57.423 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.423 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:57.423 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.424 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:57.424 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:16:57.424 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.424 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.424 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.424 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:57.424 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:16:57.424 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.424 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.424 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.424 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:57.424 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:16:57.424 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5900000000000002e-07 2024-09-12T16:16:57.424 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.425 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.425 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:57.425 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296473+0000", 2024-09-12T16:16:57.425 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3130000000000001e-06 2024-09-12T16:16:57.425 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.425 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.425 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:57.425 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296481+0000", 2024-09-12T16:16:57.425 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1389999999999998e-06 2024-09-12T16:16:57.425 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.425 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.425 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:57.425 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296486+0000", 2024-09-12T16:16:57.425 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3310000000000003e-06 2024-09-12T16:16:57.426 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.426 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.426 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:57.426 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357981+0000", 2024-09-12T16:16:57.426 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061494866000000002 2024-09-12T16:16:57.426 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.426 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.426 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:57.426 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358082+0000", 2024-09-12T16:16:57.426 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101424 2024-09-12T16:16:57.426 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.426 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.426 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:57.426 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358196+0000", 2024-09-12T16:16:57.427 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011347 2024-09-12T16:16:57.427 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.427 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:57.427 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.427 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.427 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.427 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5626 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4739072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:57.427 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:16:57.427 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 17.110764404000001, 2024-09-12T16:16:57.427 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061802430999999998, 2024-09-12T16:16:57.427 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:57.427 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:57.427 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:57.427 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:57.428 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:57.428 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:57.428 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5626 2024-09-12T16:16:57.428 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.428 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:57.428 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.428 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:57.428 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:16:57.428 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.428 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.428 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.428 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:57.428 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:16:57.428 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.429 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.429 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:57.429 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296550+0000", 2024-09-12T16:16:57.429 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.215e-06 2024-09-12T16:16:57.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.429 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.429 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:57.429 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296555+0000", 2024-09-12T16:16:57.429 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9590000000000003e-06 2024-09-12T16:16:57.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.429 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.429 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:57.429 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296568+0000", 2024-09-12T16:16:57.430 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3338e-05 2024-09-12T16:16:57.430 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.430 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.430 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:57.430 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296576+0000", 2024-09-12T16:16:57.430 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5510000000000002e-06 2024-09-12T16:16:57.430 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.430 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.430 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:57.430 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358241+0000", 2024-09-12T16:16:57.430 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.06166576 2024-09-12T16:16:57.430 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.430 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.430 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:57.430 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358288+0000", 2024-09-12T16:16:57.431 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6097000000000003e-05 2024-09-12T16:16:57.431 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.431 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.431 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:57.431 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358351+0000", 2024-09-12T16:16:57.431 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3510999999999996e-05 2024-09-12T16:16:57.431 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.431 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:57.431 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.431 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.431 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.431 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5628 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4792320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:57.431 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:16:57.431 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 17.110721903999998, 2024-09-12T16:16:57.431 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061961161000000001, 2024-09-12T16:16:57.432 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:57.432 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:57.432 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:57.432 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:57.432 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:57.432 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:57.432 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5628 2024-09-12T16:16:57.432 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.432 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:57.432 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.432 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:57.432 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:16:57.432 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.432 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.433 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.433 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:57.433 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:16:57.433 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.433 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.433 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.433 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:57.433 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296592+0000", 2024-09-12T16:16:57.433 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2099999999999996e-07 2024-09-12T16:16:57.433 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.433 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.433 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:57.433 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296595+0000", 2024-09-12T16:16:57.433 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0429999999999999e-06 2024-09-12T16:16:57.434 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.434 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.434 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:57.434 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296603+0000", 2024-09-12T16:16:57.434 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9899999999999997e-06 2024-09-12T16:16:57.434 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.434 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.434 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:57.434 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296609+0000", 2024-09-12T16:16:57.434 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7259999999999999e-06 2024-09-12T16:16:57.434 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.434 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.434 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:57.434 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358393+0000", 2024-09-12T16:16:57.434 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061784617 2024-09-12T16:16:57.435 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.435 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.435 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:57.435 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358460+0000", 2024-09-12T16:16:57.435 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7253000000000001e-05 2024-09-12T16:16:57.435 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.435 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.435 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:57.435 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358552+0000", 2024-09-12T16:16:57.435 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1811000000000006e-05 2024-09-12T16:16:57.435 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.435 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:57.435 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.435 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.436 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.436 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5638 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4734976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:57.436 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:16:57.436 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 17.110249353, 2024-09-12T16:16:57.436 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061654460000000001, 2024-09-12T16:16:57.436 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:57.436 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:57.436 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:57.436 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:57.436 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:57.436 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:57.436 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5638 2024-09-12T16:16:57.436 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.436 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:57.437 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.437 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:57.437 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:16:57.437 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.437 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.437 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.437 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:57.437 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:16:57.437 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.437 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.437 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.437 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:57.437 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:16:57.438 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.23e-07 2024-09-12T16:16:57.438 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.438 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.438 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:57.438 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297068+0000", 2024-09-12T16:16:57.438 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0060000000000003e-06 2024-09-12T16:16:57.438 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.438 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.438 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:57.438 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297080+0000", 2024-09-12T16:16:57.438 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1234e-05 2024-09-12T16:16:57.438 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.438 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.438 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:57.438 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297095+0000", 2024-09-12T16:16:57.439 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5698000000000001e-05 2024-09-12T16:16:57.439 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.439 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.439 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:57.439 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358582+0000", 2024-09-12T16:16:57.439 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061486274 2024-09-12T16:16:57.439 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.439 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.439 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:57.439 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358637+0000", 2024-09-12T16:16:57.439 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5439999999999998e-05 2024-09-12T16:16:57.439 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.439 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.440 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:57.440 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358718+0000", 2024-09-12T16:16:57.440 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0984999999999998e-05 2024-09-12T16:16:57.440 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.440 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:57.440 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.440 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.440 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.440 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5640 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4780032~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:57.440 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:16:57.440 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 17.110167633, 2024-09-12T16:16:57.440 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061746620000000002, 2024-09-12T16:16:57.440 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:57.441 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:57.441 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:57.441 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:57.441 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:57.441 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:57.441 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5640 2024-09-12T16:16:57.441 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.441 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:57.441 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.441 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:57.441 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:16:57.441 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.441 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.441 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.442 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:57.442 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:16:57.442 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.442 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.442 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.442 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:57.442 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297146+0000", 2024-09-12T16:16:57.442 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3600000000000003e-07 2024-09-12T16:16:57.442 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.442 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.442 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:57.442 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297150+0000", 2024-09-12T16:16:57.442 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8430000000000003e-06 2024-09-12T16:16:57.442 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.442 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.443 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:57.443 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297160+0000", 2024-09-12T16:16:57.443 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7229999999999999e-06 2024-09-12T16:16:57.443 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.443 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.443 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:57.443 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297167+0000", 2024-09-12T16:16:57.443 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0180000000000004e-06 2024-09-12T16:16:57.443 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.443 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.443 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:57.443 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358750+0000", 2024-09-12T16:16:57.443 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061583104 2024-09-12T16:16:57.443 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.443 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.444 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:57.444 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358804+0000", 2024-09-12T16:16:57.444 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4277000000000002e-05 2024-09-12T16:16:57.444 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.444 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.444 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:57.444 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358892+0000", 2024-09-12T16:16:57.444 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7918999999999996e-05 2024-09-12T16:16:57.444 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.444 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:57.444 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.444 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.444 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.445 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5642 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4788224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:57.445 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:16:57.445 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 17.110123289000001, 2024-09-12T16:16:57.445 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061860409999999998, 2024-09-12T16:16:57.445 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:57.445 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:57.445 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:57.445 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:57.445 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:57.445 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:57.445 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5642 2024-09-12T16:16:57.445 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.445 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:57.446 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.446 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:57.446 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:16:57.446 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.446 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.446 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.446 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:57.446 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:16:57.446 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.446 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.446 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.446 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:57.446 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:16:57.446 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7999999999999995e-07 2024-09-12T16:16:57.447 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.447 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.447 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:57.447 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297193+0000", 2024-09-12T16:16:57.447 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8310000000000001e-06 2024-09-12T16:16:57.447 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.447 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.447 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:57.447 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297204+0000", 2024-09-12T16:16:57.447 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0832999999999999e-05 2024-09-12T16:16:57.447 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.447 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.447 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:57.447 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297210+0000", 2024-09-12T16:16:57.448 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1770000000000003e-06 2024-09-12T16:16:57.448 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.448 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.448 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:57.448 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358928+0000", 2024-09-12T16:16:57.448 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061717826000000003 2024-09-12T16:16:57.448 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.448 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.448 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:57.448 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358977+0000", 2024-09-12T16:16:57.448 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9514000000000001e-05 2024-09-12T16:16:57.448 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.449 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.449 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:57.449 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359050+0000", 2024-09-12T16:16:57.449 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2649000000000002e-05 2024-09-12T16:16:57.449 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.449 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:57.449 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.449 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.449 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.449 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5646 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4743168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:57.449 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:16:57.449 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 17.109943348000002, 2024-09-12T16:16:57.449 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061822122, 2024-09-12T16:16:57.449 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:57.450 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:57.450 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:57.450 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:57.450 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:57.450 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:57.450 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5646 2024-09-12T16:16:57.450 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.450 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:57.450 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.450 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:57.450 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:16:57.450 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.450 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.450 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.451 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:57.451 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:16:57.451 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.451 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.451 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.451 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:57.451 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:16:57.451 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3200000000000004e-07 2024-09-12T16:16:57.451 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.451 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.451 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:57.451 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297374+0000", 2024-09-12T16:16:57.451 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8240000000000001e-06 2024-09-12T16:16:57.451 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.452 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.452 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:57.452 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297384+0000", 2024-09-12T16:16:57.452 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5710000000000004e-06 2024-09-12T16:16:57.452 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.452 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.452 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:57.452 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297390+0000", 2024-09-12T16:16:57.452 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5130000000000002e-06 2024-09-12T16:16:57.452 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.452 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.452 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:57.452 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359080+0000", 2024-09-12T16:16:57.453 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061689569999999999 2024-09-12T16:16:57.453 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.453 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.453 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:57.453 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359134+0000", 2024-09-12T16:16:57.453 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3838999999999997e-05 2024-09-12T16:16:57.453 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.453 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.453 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:57.453 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359192+0000", 2024-09-12T16:16:57.453 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8072999999999998e-05 2024-09-12T16:16:57.453 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.453 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:57.454 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.454 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.454 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.454 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5647 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4751360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:57.454 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:16:57.454 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 17.109906663, 2024-09-12T16:16:57.454 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061927569000000002, 2024-09-12T16:16:57.454 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:57.454 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:57.454 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:57.454 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:57.454 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:57.454 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:57.455 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5647 2024-09-12T16:16:57.455 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.455 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:57.455 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.455 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:57.455 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:16:57.455 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.455 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.455 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.455 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:57.455 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:16:57.455 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.455 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.456 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.456 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:57.456 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297407+0000", 2024-09-12T16:16:57.456 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.46e-07 2024-09-12T16:16:57.456 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.456 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.456 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:57.456 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297409+0000", 2024-09-12T16:16:57.456 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.469e-06 2024-09-12T16:16:57.456 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.456 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.456 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:57.456 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297415+0000", 2024-09-12T16:16:57.456 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9259999999999997e-06 2024-09-12T16:16:57.457 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.457 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.457 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:57.457 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297419+0000", 2024-09-12T16:16:57.457 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3840000000000001e-06 2024-09-12T16:16:57.457 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.457 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.457 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:57.457 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359224+0000", 2024-09-12T16:16:57.457 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061805367999999999 2024-09-12T16:16:57.457 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.457 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.457 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:57.457 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359275+0000", 2024-09-12T16:16:57.458 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1338000000000002e-05 2024-09-12T16:16:57.458 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.458 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.458 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:57.458 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359334+0000", 2024-09-12T16:16:57.458 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8638000000000003e-05 2024-09-12T16:16:57.458 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.458 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:57.458 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.458 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.458 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.458 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5649 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4796416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:57.458 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:16:57.459 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 17.109851804000002, 2024-09-12T16:16:57.459 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.062018578999999997, 2024-09-12T16:16:57.459 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:57.459 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:57.459 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:57.459 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:57.459 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:57.459 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:57.459 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5649 2024-09-12T16:16:57.459 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.459 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:57.459 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.459 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:57.459 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:16:57.460 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.460 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.460 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.460 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:57.460 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:16:57.460 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.460 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.460 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.460 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:57.460 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297462+0000", 2024-09-12T16:16:57.460 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2399999999999998e-07 2024-09-12T16:16:57.460 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.460 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.461 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:57.461 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297465+0000", 2024-09-12T16:16:57.461 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.371e-06 2024-09-12T16:16:57.461 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.461 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.461 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:57.461 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297473+0000", 2024-09-12T16:16:57.461 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4699999999999996e-06 2024-09-12T16:16:57.461 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.461 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.461 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:57.461 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297478+0000", 2024-09-12T16:16:57.461 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2780000000000001e-06 2024-09-12T16:16:57.462 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.462 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.462 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:57.462 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359368+0000", 2024-09-12T16:16:57.462 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061889758000000003 2024-09-12T16:16:57.462 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.462 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.462 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:57.462 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359420+0000", 2024-09-12T16:16:57.462 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2574999999999997e-05 2024-09-12T16:16:57.462 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.462 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.462 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:57.462 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359480+0000", 2024-09-12T16:16:57.463 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9503000000000003e-05 2024-09-12T16:16:57.463 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.463 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:57.463 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.463 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.463 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.463 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5674 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4739072~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:57.463 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:16:57.463 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 17.109448036, 2024-09-12T16:16:57.463 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061762989999999997, 2024-09-12T16:16:57.463 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:57.463 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:57.463 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:57.464 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:57.464 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:57.464 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:57.464 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5674 2024-09-12T16:16:57.464 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.464 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:57.464 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.464 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:57.464 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:16:57.464 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.464 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.464 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.464 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:57.465 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:16:57.465 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.465 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.465 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.465 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:57.465 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297866+0000", 2024-09-12T16:16:57.465 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1900000000000001e-07 2024-09-12T16:16:57.465 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.465 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.465 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:57.465 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297870+0000", 2024-09-12T16:16:57.465 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3560000000000003e-06 2024-09-12T16:16:57.465 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.466 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.466 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:57.466 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297888+0000", 2024-09-12T16:16:57.466 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8088999999999999e-05 2024-09-12T16:16:57.466 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.466 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.466 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:57.466 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297904+0000", 2024-09-12T16:16:57.466 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5971e-05 2024-09-12T16:16:57.466 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.466 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.466 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:57.466 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359510+0000", 2024-09-12T16:16:57.467 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061605634999999999 2024-09-12T16:16:57.467 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.467 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.467 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:57.467 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359554+0000", 2024-09-12T16:16:57.467 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4024999999999999e-05 2024-09-12T16:16:57.467 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.467 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.467 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:57.467 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359628+0000", 2024-09-12T16:16:57.467 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4095000000000001e-05 2024-09-12T16:16:57.467 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.467 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:57.468 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.468 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.468 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.468 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5676 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4792320~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:57.468 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:16:57.468 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 17.109246956, 2024-09-12T16:16:57.468 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061720143999999998, 2024-09-12T16:16:57.468 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:57.468 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:57.468 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:57.468 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:57.468 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:57.468 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:57.469 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5676 2024-09-12T16:16:57.469 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.469 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:57.469 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.469 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:57.469 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:16:57.469 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.469 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.469 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.470 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:57.470 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:16:57.470 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.470 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.470 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.470 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:57.470 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298067+0000", 2024-09-12T16:16:57.470 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8199999999999999e-07 2024-09-12T16:16:57.470 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.470 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.470 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:57.470 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298070+0000", 2024-09-12T16:16:57.470 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.743e-06 2024-09-12T16:16:57.470 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.471 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.471 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:57.471 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298080+0000", 2024-09-12T16:16:57.471 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4059999999999994e-06 2024-09-12T16:16:57.471 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.471 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.471 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:57.471 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298088+0000", 2024-09-12T16:16:57.471 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0779999999999996e-06 2024-09-12T16:16:57.471 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.471 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.471 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:57.471 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359659+0000", 2024-09-12T16:16:57.471 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061570688999999998 2024-09-12T16:16:57.472 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.472 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.472 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:57.472 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359713+0000", 2024-09-12T16:16:57.472 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3939e-05 2024-09-12T16:16:57.472 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.472 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.472 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:57.472 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359786+0000", 2024-09-12T16:16:57.472 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3607000000000002e-05 2024-09-12T16:16:57.472 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.472 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:57.472 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.472 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.473 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.473 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5684 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4747264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:57.473 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:16:57.473 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 17.108779664, 2024-09-12T16:16:57.473 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061394799, 2024-09-12T16:16:57.473 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:57.473 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:57.473 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:57.473 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:57.473 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:57.473 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:57.473 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5684 2024-09-12T16:16:57.473 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.474 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:57.474 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.474 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:57.474 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:16:57.474 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.474 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.474 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.474 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:57.474 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:16:57.474 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.474 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.474 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.474 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:57.475 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298534+0000", 2024-09-12T16:16:57.475 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4399999999999999e-07 2024-09-12T16:16:57.475 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.475 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.475 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:57.475 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298539+0000", 2024-09-12T16:16:57.475 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5360000000000003e-06 2024-09-12T16:16:57.475 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.475 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.475 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:57.475 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298550+0000", 2024-09-12T16:16:57.475 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1499e-05 2024-09-12T16:16:57.475 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.475 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.476 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:57.476 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298558+0000", 2024-09-12T16:16:57.476 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3000000000000004e-06 2024-09-12T16:16:57.476 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.476 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.476 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:57.476 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359815+0000", 2024-09-12T16:16:57.476 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061257952999999997 2024-09-12T16:16:57.476 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.476 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.476 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:57.476 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359868+0000", 2024-09-12T16:16:57.476 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2317000000000001e-05 2024-09-12T16:16:57.476 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.477 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.477 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:57.477 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359928+0000", 2024-09-12T16:16:57.477 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0350000000000003e-05 2024-09-12T16:16:57.477 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.477 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:57.477 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.477 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.477 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.477 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5686 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4755456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:57.477 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:16:57.477 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 17.108612239999999, 2024-09-12T16:16:57.477 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061355082999999998, 2024-09-12T16:16:57.478 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:57.478 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:57.478 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:57.478 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:57.478 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:57.478 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:57.478 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5686 2024-09-12T16:16:57.478 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.478 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:57.478 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.478 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:57.478 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:16:57.478 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.478 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.479 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.479 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:57.479 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:16:57.479 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.479 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.479 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.479 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:57.479 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298702+0000", 2024-09-12T16:16:57.479 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2399999999999997e-07 2024-09-12T16:16:57.479 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.479 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.479 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:57.479 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298706+0000", 2024-09-12T16:16:57.479 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5700000000000003e-06 2024-09-12T16:16:57.480 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.480 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.480 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:57.480 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298718+0000", 2024-09-12T16:16:57.480 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1457999999999999e-05 2024-09-12T16:16:57.480 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.480 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.480 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:57.480 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298732+0000", 2024-09-12T16:16:57.480 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.452e-05 2024-09-12T16:16:57.480 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.480 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.481 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:57.481 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359956+0000", 2024-09-12T16:16:57.481 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061223626000000003 2024-09-12T16:16:57.481 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.481 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.481 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:57.481 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360000+0000", 2024-09-12T16:16:57.481 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3922999999999999e-05 2024-09-12T16:16:57.481 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.481 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.481 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:57.481 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360056+0000", 2024-09-12T16:16:57.481 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6162000000000002e-05 2024-09-12T16:16:57.481 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.482 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:57.482 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.482 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.482 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.482 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5688 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4800512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:57.482 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:16:57.482 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 17.108389187, 2024-09-12T16:16:57.482 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061270514999999998, 2024-09-12T16:16:57.482 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:57.482 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:57.482 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:57.482 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:57.482 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:57.483 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:57.483 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5688 2024-09-12T16:16:57.483 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.483 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:57.483 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.483 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:57.483 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:16:57.483 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.483 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.483 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.483 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:57.483 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:16:57.483 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.483 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.483 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.484 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:57.484 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298925+0000", 2024-09-12T16:16:57.484 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4e-07 2024-09-12T16:16:57.484 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.484 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.484 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:57.484 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298929+0000", 2024-09-12T16:16:57.484 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9890000000000003e-06 2024-09-12T16:16:57.484 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.484 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.484 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:57.484 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298936+0000", 2024-09-12T16:16:57.484 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.52e-06 2024-09-12T16:16:57.484 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.485 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.485 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:57.485 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298941+0000", 2024-09-12T16:16:57.485 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4800000000000003e-06 2024-09-12T16:16:57.485 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.485 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.485 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:57.485 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360087+0000", 2024-09-12T16:16:57.485 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061146143 2024-09-12T16:16:57.485 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.485 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.485 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:57.485 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360137+0000", 2024-09-12T16:16:57.486 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0584000000000002e-05 2024-09-12T16:16:57.486 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.486 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.486 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:57.486 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360194+0000", 2024-09-12T16:16:57.486 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6858999999999999e-05 2024-09-12T16:16:57.486 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.486 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:57.486 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.486 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.486 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.486 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5693 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4751360~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:57.486 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:16:57.486 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 17.107967550000001, 2024-09-12T16:16:57.487 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061139444000000001, 2024-09-12T16:16:57.487 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:57.487 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:57.487 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:57.487 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:57.487 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:57.487 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:57.487 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5693 2024-09-12T16:16:57.487 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.487 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:57.487 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.487 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:57.487 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:16:57.487 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.488 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.488 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.488 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:57.488 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:16:57.488 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.488 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.488 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.488 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:57.488 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299346+0000", 2024-09-12T16:16:57.488 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2300000000000001e-07 2024-09-12T16:16:57.488 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.488 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.488 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:57.488 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299349+0000", 2024-09-12T16:16:57.488 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5270000000000001e-06 2024-09-12T16:16:57.489 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.489 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.489 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:57.489 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299358+0000", 2024-09-12T16:16:57.489 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7030000000000001e-06 2024-09-12T16:16:57.489 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.489 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.489 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:57.489 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299364+0000", 2024-09-12T16:16:57.489 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7239999999999997e-06 2024-09-12T16:16:57.489 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.489 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.489 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:57.490 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360369+0000", 2024-09-12T16:16:57.490 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061004713000000002 2024-09-12T16:16:57.490 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.490 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.490 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:57.490 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360415+0000", 2024-09-12T16:16:57.490 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5926e-05 2024-09-12T16:16:57.490 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.490 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.490 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:57.490 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360485+0000", 2024-09-12T16:16:57.490 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0327999999999995e-05 2024-09-12T16:16:57.490 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.490 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:57.491 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.491 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.491 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5694 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4796416~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:57.491 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:16:57.491 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 17.107938521000001, 2024-09-12T16:16:57.491 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061258034000000003, 2024-09-12T16:16:57.491 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:57.491 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:57.491 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:57.491 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:57.491 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:57.491 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:57.491 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5694 2024-09-12T16:16:57.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.492 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:57.492 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.492 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:57.492 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:16:57.492 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.492 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.492 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.492 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:57.492 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:16:57.492 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.492 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.492 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.492 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:57.493 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301884+0000", 2024-09-12T16:16:57.493 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025090379999999999 2024-09-12T16:16:57.493 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.493 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.493 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:57.493 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301889+0000", 2024-09-12T16:16:57.493 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5879999999999997e-06 2024-09-12T16:16:57.493 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.493 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.493 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:57.493 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301901+0000", 2024-09-12T16:16:57.493 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1466e-05 2024-09-12T16:16:57.493 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.493 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.494 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:57.494 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301908+0000", 2024-09-12T16:16:57.494 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1999999999999997e-06 2024-09-12T16:16:57.494 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.494 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.494 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:57.494 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360513+0000", 2024-09-12T16:16:57.494 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.058605023999999999 2024-09-12T16:16:57.494 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.494 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.494 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:57.494 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360562+0000", 2024-09-12T16:16:57.494 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9546000000000003e-05 2024-09-12T16:16:57.495 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.495 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.495 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:57.495 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360633+0000", 2024-09-12T16:16:57.495 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0172000000000005e-05 2024-09-12T16:16:57.495 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.495 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:57.495 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.495 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.495 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.495 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5759 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4767744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:16:57.495 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:16:57.495 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 17.105144986999999, 2024-09-12T16:16:57.495 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061058604000000002, 2024-09-12T16:16:57.496 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:16:57.496 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:16:57.496 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:16:57.496 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:16:57.496 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:16:57.496 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:16:57.496 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5759 2024-09-12T16:16:57.496 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.496 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:16:57.496 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.496 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:16:57.496 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:16:57.496 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.496 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.497 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.497 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:16:57.497 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:16:57.497 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:16:57.497 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.497 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.497 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:16:57.497 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302548+0000", 2024-09-12T16:16:57.497 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00038011000000000002 2024-09-12T16:16:57.497 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.497 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.497 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:16:57.497 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302553+0000", 2024-09-12T16:16:57.497 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1830000000000002e-06 2024-09-12T16:16:57.498 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.498 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.498 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:16:57.498 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302564+0000", 2024-09-12T16:16:57.498 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1011e-05 2024-09-12T16:16:57.498 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.498 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.498 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:16:57.498 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302572+0000", 2024-09-12T16:16:57.498 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9009999999999994e-06 2024-09-12T16:16:57.498 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.498 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.498 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:16:57.498 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363102+0000", 2024-09-12T16:16:57.499 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.060529782999999997 2024-09-12T16:16:57.499 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.499 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.499 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:16:57.499 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363149+0000", 2024-09-12T16:16:57.499 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7321000000000003e-05 2024-09-12T16:16:57.499 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:16:57.499 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:16:57.499 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:16:57.499 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363227+0000", 2024-09-12T16:16:57.499 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7294999999999998e-05 2024-09-12T16:16:57.499 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.499 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:57.499 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.500 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:16:57.500 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:16:57.500 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:16:57.501 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:57.500+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:57.501 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:16:57.602 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:57.601+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:57.611 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:57.611 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:57.611 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:16:57.611 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:57.620 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:16:57.704 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:57.703+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:57.756 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #17, image image_client.0-clone17 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent18 2024-09-12T16:16:57.772 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:57.772 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:57.772 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:16:57.772 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:16:57.772 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:57.782 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:16:57.804 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:57.803+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:57.905 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:57.905+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:57.967 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:57.967 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:16:57.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:16:57.967 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:57.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.967 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3703 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14803968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:57.968 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139513+0000", 2024-09-12T16:16:57.968 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.825878985000003, 2024-09-12T16:16:57.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053248794000000002, 2024-09-12T16:16:57.968 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:57.968 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:57.968 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:57.968 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:57.968 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:57.968 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:57.968 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3703 2024-09-12T16:16:57.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.968 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:57.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:57.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139513+0000", 2024-09-12T16:16:57.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:57.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:57.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139513+0000", 2024-09-12T16:16:57.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:57.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:57.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139639+0000", 2024-09-12T16:16:57.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012673299999999999 2024-09-12T16:16:57.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:57.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139642+0000", 2024-09-12T16:16:57.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4820000000000001e-06 2024-09-12T16:16:57.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:57.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139647+0000", 2024-09-12T16:16:57.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8040000000000001e-06 2024-09-12T16:16:57.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:57.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139650+0000", 2024-09-12T16:16:57.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.529e-06 2024-09-12T16:16:57.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:57.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192537+0000", 2024-09-12T16:16:57.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052886503000000001 2024-09-12T16:16:57.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:57.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192627+0000", 2024-09-12T16:16:57.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0183e-05 2024-09-12T16:16:57.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:57.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192761+0000", 2024-09-12T16:16:57.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013456000000000001 2024-09-12T16:16:57.972 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:57.972 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:57.972 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:57.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.972 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3705 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14812160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:57.972 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:16:57.972 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.825586733000002, 2024-09-12T16:16:57.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053368831999999998, 2024-09-12T16:16:57.972 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:57.972 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:57.973 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:57.973 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:57.973 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:57.973 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:57.973 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3705 2024-09-12T16:16:57.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.973 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:57.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:57.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:16:57.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:57.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:57.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:16:57.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:57.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:57.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139932+0000", 2024-09-12T16:16:57.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012762099999999999 2024-09-12T16:16:57.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:57.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139935+0000", 2024-09-12T16:16:57.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.119e-06 2024-09-12T16:16:57.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:57.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139939+0000", 2024-09-12T16:16:57.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7999999999999998e-06 2024-09-12T16:16:57.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:57.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139953+0000", 2024-09-12T16:16:57.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3923999999999999e-05 2024-09-12T16:16:57.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:57.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192946+0000", 2024-09-12T16:16:57.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052992971 2024-09-12T16:16:57.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:57.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193035+0000", 2024-09-12T16:16:57.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9040000000000001e-05 2024-09-12T16:16:57.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:57.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193174+0000", 2024-09-12T16:16:57.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138357 2024-09-12T16:16:57.976 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3706 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14816256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:16:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.825431743000003, 2024-09-12T16:16:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053341723000000001, 2024-09-12T16:16:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3706 2024-09-12T16:16:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:16:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:16:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140090+0000", 2024-09-12T16:16:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013020100000000001 2024-09-12T16:16:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140097+0000", 2024-09-12T16:16:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0709999999999997e-06 2024-09-12T16:16:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140103+0000", 2024-09-12T16:16:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5450000000000003e-06 2024-09-12T16:16:57.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:57.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140106+0000", 2024-09-12T16:16:57.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3739999999999998e-06 2024-09-12T16:16:57.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:57.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193190+0000", 2024-09-12T16:16:57.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053084131999999999 2024-09-12T16:16:57.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:57.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193232+0000", 2024-09-12T16:16:57.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1517000000000002e-05 2024-09-12T16:16:57.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:57.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193302+0000", 2024-09-12T16:16:57.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9882999999999995e-05 2024-09-12T16:16:57.981 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:57.981 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:57.981 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:57.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.981 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3707 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14820352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:57.981 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:16:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.825279754, 2024-09-12T16:16:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053452771000000003, 2024-09-12T16:16:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3707 2024-09-12T16:16:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:57.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:16:57.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:57.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:57.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:16:57.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:57.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:57.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140219+0000", 2024-09-12T16:16:57.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106902 2024-09-12T16:16:57.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:57.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140225+0000", 2024-09-12T16:16:57.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3199999999999996e-06 2024-09-12T16:16:57.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:57.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140230+0000", 2024-09-12T16:16:57.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8969999999999999e-06 2024-09-12T16:16:57.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:57.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140233+0000", 2024-09-12T16:16:57.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2119999999999999e-06 2024-09-12T16:16:57.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:57.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193339+0000", 2024-09-12T16:16:57.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053105556999999998 2024-09-12T16:16:57.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:57.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193431+0000", 2024-09-12T16:16:57.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1837999999999997e-05 2024-09-12T16:16:57.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:57.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193565+0000", 2024-09-12T16:16:57.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013404500000000001 2024-09-12T16:16:57.986 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:57.986 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:57.986 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:57.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.986 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3708 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14824448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:57.986 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:16:57.986 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.825150911999998, 2024-09-12T16:16:57.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053468190999999998, 2024-09-12T16:16:57.986 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:57.986 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:57.986 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:57.987 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:57.987 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:57.987 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:57.987 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3708 2024-09-12T16:16:57.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.987 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:57.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:57.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:16:57.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:57.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:57.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:16:57.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:57.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:57.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140351+0000", 2024-09-12T16:16:57.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110096 2024-09-12T16:16:57.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:57.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140358+0000", 2024-09-12T16:16:57.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.306e-06 2024-09-12T16:16:57.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:57.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140368+0000", 2024-09-12T16:16:57.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0225e-05 2024-09-12T16:16:57.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:57.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140372+0000", 2024-09-12T16:16:57.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6169999999999998e-06 2024-09-12T16:16:57.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:57.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193594+0000", 2024-09-12T16:16:57.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053222419999999999 2024-09-12T16:16:57.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:57.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193640+0000", 2024-09-12T16:16:57.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.587e-05 2024-09-12T16:16:57.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:57.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193709+0000", 2024-09-12T16:16:57.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8657000000000004e-05 2024-09-12T16:16:57.990 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:57.990 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:57.990 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:57.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.991 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3709 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14828544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:57.991 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:16:57.991 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.825013943999998, 2024-09-12T16:16:57.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594033999999999, 2024-09-12T16:16:57.991 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:57.991 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:57.991 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:57.991 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:57.991 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:57.991 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:57.992 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3709 2024-09-12T16:16:57.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.992 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:57.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:57.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:16:57.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:57.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:57.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:16:57.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:57.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:57.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140499+0000", 2024-09-12T16:16:57.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121019 2024-09-12T16:16:57.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:57.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140501+0000", 2024-09-12T16:16:57.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2369999999999999e-06 2024-09-12T16:16:57.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:57.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140506+0000", 2024-09-12T16:16:57.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.639e-06 2024-09-12T16:16:57.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:57.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140509+0000", 2024-09-12T16:16:57.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3419999999999999e-06 2024-09-12T16:16:57.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:57.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193743+0000", 2024-09-12T16:16:57.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053234311999999999 2024-09-12T16:16:57.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193833+0000", 2024-09-12T16:16:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9883999999999995e-05 2024-09-12T16:16:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193972+0000", 2024-09-12T16:16:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138601 2024-09-12T16:16:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3710 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14832640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:16:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.824876598000003, 2024-09-12T16:16:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053607324999999997, 2024-09-12T16:16:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3710 2024-09-12T16:16:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:16:57.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:57.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:57.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:16:57.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:57.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:57.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140664+0000", 2024-09-12T16:16:57.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014918700000000001 2024-09-12T16:16:57.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140674+0000", 2024-09-12T16:16:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8379999999999997e-06 2024-09-12T16:16:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140694+0000", 2024-09-12T16:16:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0145000000000001e-05 2024-09-12T16:16:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140703+0000", 2024-09-12T16:16:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5150000000000006e-06 2024-09-12T16:16:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194006+0000", 2024-09-12T16:16:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053303370000000003 2024-09-12T16:16:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194051+0000", 2024-09-12T16:16:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5012000000000002e-05 2024-09-12T16:16:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194122+0000", 2024-09-12T16:16:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1258000000000001e-05 2024-09-12T16:16:58.000 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.000 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:58.000 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.000 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3711 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14836736~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:58.000 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:16:58.000 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.824675149999997, 2024-09-12T16:16:58.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053670799999999998, 2024-09-12T16:16:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3711 2024-09-12T16:16:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:16:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:16:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140782+0000", 2024-09-12T16:16:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5549999999999994e-05 2024-09-12T16:16:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140786+0000", 2024-09-12T16:16:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.89e-06 2024-09-12T16:16:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140796+0000", 2024-09-12T16:16:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0057e-05 2024-09-12T16:16:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140819+0000", 2024-09-12T16:16:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3005000000000001e-05 2024-09-12T16:16:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:58.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194159+0000", 2024-09-12T16:16:58.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053340324000000001 2024-09-12T16:16:58.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:58.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194248+0000", 2024-09-12T16:16:58.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9209000000000006e-05 2024-09-12T16:16:58.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:58.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194387+0000", 2024-09-12T16:16:58.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138765 2024-09-12T16:16:58.004 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.004 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3712 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14840832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:16:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.824560691999999, 2024-09-12T16:16:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053699068000000003, 2024-09-12T16:16:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3712 2024-09-12T16:16:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:16:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:16:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140900+0000", 2024-09-12T16:16:58.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9014e-05 2024-09-12T16:16:58.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:58.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140904+0000", 2024-09-12T16:16:58.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0940000000000001e-06 2024-09-12T16:16:58.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:58.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140933+0000", 2024-09-12T16:16:58.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8996000000000002e-05 2024-09-12T16:16:58.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:58.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140945+0000", 2024-09-12T16:16:58.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1909000000000001e-05 2024-09-12T16:16:58.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:58.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194415+0000", 2024-09-12T16:16:58.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053470403 2024-09-12T16:16:58.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:58.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194460+0000", 2024-09-12T16:16:58.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5145000000000002e-05 2024-09-12T16:16:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194530+0000", 2024-09-12T16:16:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9506999999999997e-05 2024-09-12T16:16:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3713 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14844928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:16:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.824427632000003, 2024-09-12T16:16:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053821236000000001, 2024-09-12T16:16:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3713 2024-09-12T16:16:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:16:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:58.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:16:58.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:58.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141078+0000", 2024-09-12T16:16:58.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114162 2024-09-12T16:16:58.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:58.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141090+0000", 2024-09-12T16:16:58.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.19e-05 2024-09-12T16:16:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141100+0000", 2024-09-12T16:16:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0447e-05 2024-09-12T16:16:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141108+0000", 2024-09-12T16:16:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7190000000000001e-06 2024-09-12T16:16:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194564+0000", 2024-09-12T16:16:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053455729 2024-09-12T16:16:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194652+0000", 2024-09-12T16:16:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8288999999999994e-05 2024-09-12T16:16:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194785+0000", 2024-09-12T16:16:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013299000000000001 2024-09-12T16:16:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3714 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14849024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:16:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.824271703000001, 2024-09-12T16:16:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053816382000000003, 2024-09-12T16:16:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3714 2024-09-12T16:16:58.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.015 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:58.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:58.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:16:58.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:58.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:16:58.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:58.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141182+0000", 2024-09-12T16:16:58.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1805999999999997e-05 2024-09-12T16:16:58.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.016 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:58.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141185+0000", 2024-09-12T16:16:58.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5930000000000002e-06 2024-09-12T16:16:58.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.016 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:58.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141194+0000", 2024-09-12T16:16:58.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5760000000000006e-06 2024-09-12T16:16:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141222+0000", 2024-09-12T16:16:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8034999999999998e-05 2024-09-12T16:16:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194817+0000", 2024-09-12T16:16:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594887000000001 2024-09-12T16:16:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194860+0000", 2024-09-12T16:16:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3714999999999997e-05 2024-09-12T16:16:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194936+0000", 2024-09-12T16:16:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5770000000000001e-05 2024-09-12T16:16:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3715 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14853120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:16:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.824148045999998, 2024-09-12T16:16:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053962307000000001, 2024-09-12T16:16:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3715 2024-09-12T16:16:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:16:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:16:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141417+0000", 2024-09-12T16:16:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017384099999999999 2024-09-12T16:16:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141422+0000", 2024-09-12T16:16:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7310000000000001e-06 2024-09-12T16:16:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141434+0000", 2024-09-12T16:16:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2058e-05 2024-09-12T16:16:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141442+0000", 2024-09-12T16:16:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7610000000000007e-06 2024-09-12T16:16:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194973+0000", 2024-09-12T16:16:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053530618000000002 2024-09-12T16:16:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195063+0000", 2024-09-12T16:16:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0927000000000005e-05 2024-09-12T16:16:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195206+0000", 2024-09-12T16:16:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142371 2024-09-12T16:16:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3716 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14857216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:16:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.823938196, 2024-09-12T16:16:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053916360000000003, 2024-09-12T16:16:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3716 2024-09-12T16:16:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:16:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:16:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142933+0000", 2024-09-12T16:16:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014796290000000001 2024-09-12T16:16:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142937+0000", 2024-09-12T16:16:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5760000000000002e-06 2024-09-12T16:16:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142946+0000", 2024-09-12T16:16:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0380000000000005e-06 2024-09-12T16:16:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142951+0000", 2024-09-12T16:16:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9749999999999998e-06 2024-09-12T16:16:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195246+0000", 2024-09-12T16:16:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052295358 2024-09-12T16:16:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195299+0000", 2024-09-12T16:16:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2976999999999998e-05 2024-09-12T16:16:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195370+0000", 2024-09-12T16:16:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0807000000000002e-05 2024-09-12T16:16:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3721 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14877696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:16:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.822364745000002, 2024-09-12T16:16:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053422994000000001, 2024-09-12T16:16:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3721 2024-09-12T16:16:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:16:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:16:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:58.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:16:58.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:16:58.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:58.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143028+0000", 2024-09-12T16:16:58.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7399999999999991e-07 2024-09-12T16:16:58.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:58.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143031+0000", 2024-09-12T16:16:58.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7599999999999998e-06 2024-09-12T16:16:58.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:58.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143034+0000", 2024-09-12T16:16:58.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9780000000000001e-06 2024-09-12T16:16:58.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:58.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196220+0000", 2024-09-12T16:16:58.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053186341999999998 2024-09-12T16:16:58.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:58.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196313+0000", 2024-09-12T16:16:58.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2676000000000005e-05 2024-09-12T16:16:58.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:58.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196450+0000", 2024-09-12T16:16:58.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137052 2024-09-12T16:16:58.031 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.031 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:58.031 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.031 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3722 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14881792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:58.031 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:16:58.031 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.822354853, 2024-09-12T16:16:58.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053556835999999997, 2024-09-12T16:16:58.031 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:58.031 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:58.032 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:58.032 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:58.032 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:58.032 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:58.032 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3722 2024-09-12T16:16:58.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.032 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:58.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:58.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:16:58.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:58.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:16:58.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:58.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:16:58.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.11e-07 2024-09-12T16:16:58.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:58.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143038+0000", 2024-09-12T16:16:58.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2399999999999996e-07 2024-09-12T16:16:58.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.034 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:58.034 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143041+0000", 2024-09-12T16:16:58.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8030000000000001e-06 2024-09-12T16:16:58.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.034 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:58.034 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143043+0000", 2024-09-12T16:16:58.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3140000000000002e-06 2024-09-12T16:16:58.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.034 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:58.034 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196481+0000", 2024-09-12T16:16:58.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053437601000000001 2024-09-12T16:16:58.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.035 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:58.035 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196525+0000", 2024-09-12T16:16:58.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4280000000000003e-05 2024-09-12T16:16:58.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.035 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:58.035 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196594+0000", 2024-09-12T16:16:58.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8702999999999996e-05 2024-09-12T16:16:58.035 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.035 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:58.035 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.035 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3723 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14885888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:58.036 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:16:58.036 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.822345671000001, 2024-09-12T16:16:58.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053815546999999998, 2024-09-12T16:16:58.036 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:58.036 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:58.036 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:58.036 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:58.036 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:58.036 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:58.036 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3723 2024-09-12T16:16:58.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.036 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:58.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:58.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:16:58.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:58.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:16:58.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:58.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148994+0000", 2024-09-12T16:16:58.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059481330000000004 2024-09-12T16:16:58.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:58.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148999+0000", 2024-09-12T16:16:58.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7140000000000001e-06 2024-09-12T16:16:58.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:58.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149008+0000", 2024-09-12T16:16:58.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4350000000000003e-06 2024-09-12T16:16:58.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:58.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149021+0000", 2024-09-12T16:16:58.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2514000000000001e-05 2024-09-12T16:16:58.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:58.039 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196630+0000", 2024-09-12T16:16:58.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047609758000000002 2024-09-12T16:16:58.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:58.039 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196724+0000", 2024-09-12T16:16:58.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3522000000000003e-05 2024-09-12T16:16:58.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:58.039 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196861+0000", 2024-09-12T16:16:58.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013747100000000001 2024-09-12T16:16:58.040 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.040 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:58.040 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.040 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4438 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15719424~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:58.040 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:16:58.040 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.677464894000003, 2024-09-12T16:16:58.040 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367981000000002, 2024-09-12T16:16:58.040 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:58.040 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:58.040 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:58.040 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:58.041 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:58.041 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:58.041 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4438 2024-09-12T16:16:58.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.041 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:58.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:58.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:16:58.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:58.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:16:58.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:58.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:16:58.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3e-07 2024-09-12T16:16:58.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:58.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287930+0000", 2024-09-12T16:16:58.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-12T16:16:58.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:58.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287937+0000", 2024-09-12T16:16:58.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.08e-06 2024-09-12T16:16:58.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:58.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287943+0000", 2024-09-12T16:16:58.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5709999999999997e-06 2024-09-12T16:16:58.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:58.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341068+0000", 2024-09-12T16:16:58.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053125101000000001 2024-09-12T16:16:58.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:58.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341154+0000", 2024-09-12T16:16:58.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6100999999999994e-05 2024-09-12T16:16:58.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:58.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341295+0000", 2024-09-12T16:16:58.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014087999999999999 2024-09-12T16:16:58.044 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.044 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:58.044 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.044 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4439 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15723520~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:58.044 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:16:58.045 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.677440734000001, 2024-09-12T16:16:58.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053526799, 2024-09-12T16:16:58.045 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:58.045 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:58.045 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:58.045 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:58.045 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:58.045 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:58.045 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4439 2024-09-12T16:16:58.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.045 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:58.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:58.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:16:58.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:58.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:16:58.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:58.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:16:58.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-07 2024-09-12T16:16:58.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:58.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287953+0000", 2024-09-12T16:16:58.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1349999999999999e-06 2024-09-12T16:16:58.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:58.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287960+0000", 2024-09-12T16:16:58.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-12T16:16:58.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:58.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287965+0000", 2024-09-12T16:16:58.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1580000000000004e-06 2024-09-12T16:16:58.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:58.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341332+0000", 2024-09-12T16:16:58.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367009 2024-09-12T16:16:58.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:58.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341402+0000", 2024-09-12T16:16:58.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9759999999999996e-05 2024-09-12T16:16:58.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:58.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341478+0000", 2024-09-12T16:16:58.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5412000000000002e-05 2024-09-12T16:16:58.048 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.048 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:58.049 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.049 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4440 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15727616~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:58.049 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:16:58.049 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.677419630000003, 2024-09-12T16:16:58.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053761601999999999, 2024-09-12T16:16:58.049 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:58.049 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:58.049 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:58.049 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:58.049 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:58.049 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:58.049 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4440 2024-09-12T16:16:58.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.050 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:58.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:58.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:16:58.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:58.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:16:58.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:58.051 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:16:58.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:16:58.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:58.051 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287974+0000", 2024-09-12T16:16:58.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0540000000000002e-06 2024-09-12T16:16:58.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:58.051 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287980+0000", 2024-09-12T16:16:58.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9440000000000002e-06 2024-09-12T16:16:58.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:58.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287987+0000", 2024-09-12T16:16:58.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5889999999999999e-06 2024-09-12T16:16:58.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:58.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341502+0000", 2024-09-12T16:16:58.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053515199999999999 2024-09-12T16:16:58.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:58.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341595+0000", 2024-09-12T16:16:58.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3097000000000007e-05 2024-09-12T16:16:58.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:58.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341734+0000", 2024-09-12T16:16:58.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013832800000000001 2024-09-12T16:16:58.053 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.053 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:58.053 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.053 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2209 3.1 3:85f36d3b:::rbd_data.1155ccb1894c.0000000000000004:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:16:58.054 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:16:58.054 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.59373449199999995, 2024-09-12T16:16:58.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.060659365, 2024-09-12T16:16:58.054 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:58.054 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:58.054 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:58.054 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:58.054 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:16:58.054 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:16:58.054 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2209 2024-09-12T16:16:58.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.054 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:58.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:58.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:16:58.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:58.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:16:58.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:58.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371658+0000", 2024-09-12T16:16:58.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1570000000000001e-06 2024-09-12T16:16:58.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:58.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393414+0000", 2024-09-12T16:16:58.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021755495999999999 2024-09-12T16:16:58.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:58.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393447+0000", 2024-09-12T16:16:58.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3630000000000002e-05 2024-09-12T16:16:58.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:58.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393462+0000", 2024-09-12T16:16:58.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5048999999999999e-05 2024-09-12T16:16:58.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:58.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393556+0000", 2024-09-12T16:16:58.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3549999999999997e-05 2024-09-12T16:16:58.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:58.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393697+0000", 2024-09-12T16:16:58.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000141414 2024-09-12T16:16:58.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T16:16:58.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.394944+0000", 2024-09-12T16:16:58.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012463039999999999 2024-09-12T16:16:58.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:58.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.431803+0000", 2024-09-12T16:16:58.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0368594 2024-09-12T16:16:58.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:16:58.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432268+0000", 2024-09-12T16:16:58.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046457600000000002 2024-09-12T16:16:58.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:16:58.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432293+0000", 2024-09-12T16:16:58.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.527e-05 2024-09-12T16:16:58.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:58.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432316+0000", 2024-09-12T16:16:58.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3519e-05 2024-09-12T16:16:58.059 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.059 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:58.059 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.059 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.059 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:58.059 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:58.061 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:16:58.061 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:58.059+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:58.161 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:58.160+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:58.219 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T16:16:58.250 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:58.250 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:58.250 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:16:58.251 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:58.262 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:16:58.262 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:58.261+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:58.363 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:58.362+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:58.441 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:58.441 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:58.441 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:16:58.441 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:16:58.441 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:58.450 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:16:58.491 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:58.490+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:58.536 INFO:teuthology.orchestra.run.smithi204.stdout:3188 write 0x95c9000 thru 0x95cfd50 (0x6d51 bytes) 2024-09-12T16:16:58.548 INFO:teuthology.orchestra.run.smithi204.stdout:3190 trunc from 0xbfe1800 to 0x2a1c400 2024-09-12T16:16:58.564 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:58.563+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:58.621 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:58.621 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:16:58.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:16:58.621 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2300 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12372992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:16:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.723552181999999, 2024-09-12T16:16:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037401246999999999, 2024-09-12T16:16:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2300 2024-09-12T16:16:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:16:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:16:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:16:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6100000000000002e-07 2024-09-12T16:16:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896026+0000", 2024-09-12T16:16:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9130000000000001e-06 2024-09-12T16:16:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896032+0000", 2024-09-12T16:16:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7540000000000003e-06 2024-09-12T16:16:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896036+0000", 2024-09-12T16:16:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5750000000000002e-06 2024-09-12T16:16:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933254+0000", 2024-09-12T16:16:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037217962 2024-09-12T16:16:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933341+0000", 2024-09-12T16:16:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6296000000000002e-05 2024-09-12T16:16:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933425+0000", 2024-09-12T16:16:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4386000000000001e-05 2024-09-12T16:16:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2301 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12377088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896043+0000", 2024-09-12T16:16:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.72353244, 2024-09-12T16:16:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037486197999999998, 2024-09-12T16:16:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2301 2024-09-12T16:16:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896043+0000", 2024-09-12T16:16:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896043+0000", 2024-09-12T16:16:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896044+0000", 2024-09-12T16:16:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.41e-07 2024-09-12T16:16:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896053+0000", 2024-09-12T16:16:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8049999999999996e-06 2024-09-12T16:16:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896060+0000", 2024-09-12T16:16:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.221e-06 2024-09-12T16:16:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896065+0000", 2024-09-12T16:16:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1109999999999999e-06 2024-09-12T16:16:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933452+0000", 2024-09-12T16:16:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037386560999999999 2024-09-12T16:16:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933491+0000", 2024-09-12T16:16:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9789000000000001e-05 2024-09-12T16:16:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933530+0000", 2024-09-12T16:16:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.837e-05 2024-09-12T16:16:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2302 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12381184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:16:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.723491000000003, 2024-09-12T16:16:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037645284000000001, 2024-09-12T16:16:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2302 2024-09-12T16:16:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:16:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:16:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:16:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6800000000000001e-07 2024-09-12T16:16:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896088+0000", 2024-09-12T16:16:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3429999999999998e-06 2024-09-12T16:16:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896096+0000", 2024-09-12T16:16:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0860000000000002e-06 2024-09-12T16:16:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896102+0000", 2024-09-12T16:16:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7610000000000004e-06 2024-09-12T16:16:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933563+0000", 2024-09-12T16:16:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037461019999999998 2024-09-12T16:16:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933648+0000", 2024-09-12T16:16:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5468000000000002e-05 2024-09-12T16:16:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933730+0000", 2024-09-12T16:16:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2138000000000005e-05 2024-09-12T16:16:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2303 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12385280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:16:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.723467198000002, 2024-09-12T16:16:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037723083999999997, 2024-09-12T16:16:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2303 2024-09-12T16:16:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:16:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:16:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:16:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2500000000000001e-07 2024-09-12T16:16:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896115+0000", 2024-09-12T16:16:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.28e-06 2024-09-12T16:16:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896122+0000", 2024-09-12T16:16:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4590000000000003e-06 2024-09-12T16:16:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896127+0000", 2024-09-12T16:16:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0509999999999996e-06 2024-09-12T16:16:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933755+0000", 2024-09-12T16:16:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037627729999999998 2024-09-12T16:16:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933794+0000", 2024-09-12T16:16:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9255000000000003e-05 2024-09-12T16:16:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933832+0000", 2024-09-12T16:16:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7883999999999998e-05 2024-09-12T16:16:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2304 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12389376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:16:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.723441848999997, 2024-09-12T16:16:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037911010000000002, 2024-09-12T16:16:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2304 2024-09-12T16:16:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:16:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:16:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:16:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9900000000000001e-07 2024-09-12T16:16:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896136+0000", 2024-09-12T16:16:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.897e-06 2024-09-12T16:16:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896142+0000", 2024-09-12T16:16:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9290000000000003e-06 2024-09-12T16:16:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896154+0000", 2024-09-12T16:16:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.201e-05 2024-09-12T16:16:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933865+0000", 2024-09-12T16:16:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037710225 2024-09-12T16:16:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:58.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933961+0000", 2024-09-12T16:16:58.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6315000000000002e-05 2024-09-12T16:16:58.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:58.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934045+0000", 2024-09-12T16:16:58.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4234999999999996e-05 2024-09-12T16:16:58.643 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.643 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:58.643 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.644 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2305 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12393472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:58.644 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896175+0000", 2024-09-12T16:16:58.644 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.723400658999999, 2024-09-12T16:16:58.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037976941, 2024-09-12T16:16:58.644 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:58.644 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:58.644 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:58.644 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:58.644 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:58.644 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:58.644 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2305 2024-09-12T16:16:58.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.645 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:58.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:58.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896175+0000", 2024-09-12T16:16:58.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:58.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896175+0000", 2024-09-12T16:16:58.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:58.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896176+0000", 2024-09-12T16:16:58.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7400000000000003e-07 2024-09-12T16:16:58.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:58.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896178+0000", 2024-09-12T16:16:58.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6709999999999999e-06 2024-09-12T16:16:58.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:58.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896186+0000", 2024-09-12T16:16:58.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9319999999999996e-06 2024-09-12T16:16:58.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:58.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896192+0000", 2024-09-12T16:16:58.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0799999999999996e-06 2024-09-12T16:16:58.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:58.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934072+0000", 2024-09-12T16:16:58.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037880888000000001 2024-09-12T16:16:58.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:58.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934113+0000", 2024-09-12T16:16:58.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0815999999999997e-05 2024-09-12T16:16:58.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:58.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934152+0000", 2024-09-12T16:16:58.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8980000000000003e-05 2024-09-12T16:16:58.648 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.648 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:58.648 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.648 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2306 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12397568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:58.648 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:16:58.648 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.723376381000001, 2024-09-12T16:16:58.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038156347, 2024-09-12T16:16:58.648 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:58.648 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:58.649 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:58.649 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:58.649 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:58.649 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:58.649 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2306 2024-09-12T16:16:58.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.649 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:58.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:58.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:16:58.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:58.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:16:58.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:58.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:16:58.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.77e-07 2024-09-12T16:16:58.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:58.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896202+0000", 2024-09-12T16:16:58.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2359999999999999e-06 2024-09-12T16:16:58.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:58.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896208+0000", 2024-09-12T16:16:58.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1430000000000003e-06 2024-09-12T16:16:58.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:58.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896213+0000", 2024-09-12T16:16:58.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9339999999999997e-06 2024-09-12T16:16:58.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:58.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934188+0000", 2024-09-12T16:16:58.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037974490999999999 2024-09-12T16:16:58.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:58.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934275+0000", 2024-09-12T16:16:58.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7639999999999994e-05 2024-09-12T16:16:58.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:58.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934356+0000", 2024-09-12T16:16:58.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0525999999999994e-05 2024-09-12T16:16:58.653 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.653 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:58.653 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.653 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2307 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12401664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:58.653 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:16:58.653 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.723356609, 2024-09-12T16:16:58.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038241450000000003, 2024-09-12T16:16:58.653 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:58.654 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:58.654 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:58.654 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:58.654 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:58.654 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:58.654 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2307 2024-09-12T16:16:58.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.654 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:58.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:58.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:16:58.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:58.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:16:58.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:58.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896220+0000", 2024-09-12T16:16:58.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3500000000000002e-07 2024-09-12T16:16:58.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:58.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896222+0000", 2024-09-12T16:16:58.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1720000000000001e-06 2024-09-12T16:16:58.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:58.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896228+0000", 2024-09-12T16:16:58.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0870000000000003e-06 2024-09-12T16:16:58.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:58.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896233+0000", 2024-09-12T16:16:58.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:16:58.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:58.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934382+0000", 2024-09-12T16:16:58.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038149566000000003 2024-09-12T16:16:58.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:58.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934422+0000", 2024-09-12T16:16:58.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0015999999999998e-05 2024-09-12T16:16:58.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:58.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934461+0000", 2024-09-12T16:16:58.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8423999999999997e-05 2024-09-12T16:16:58.657 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.657 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:58.657 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.658 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2308 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12405760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:58.658 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:16:58.658 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.723336912000001, 2024-09-12T16:16:58.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038420745999999999, 2024-09-12T16:16:58.658 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:58.658 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:58.658 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:58.658 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:58.658 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:58.658 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:58.658 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2308 2024-09-12T16:16:58.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.658 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:58.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:58.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:16:58.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:58.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:16:58.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:58.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:16:58.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.58e-07 2024-09-12T16:16:58.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:58.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896241+0000", 2024-09-12T16:16:58.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7940000000000001e-06 2024-09-12T16:16:58.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:58.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896247+0000", 2024-09-12T16:16:58.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1460000000000001e-06 2024-09-12T16:16:58.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:58.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896252+0000", 2024-09-12T16:16:58.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6840000000000004e-06 2024-09-12T16:16:58.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:58.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934494+0000", 2024-09-12T16:16:58.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038242362000000002 2024-09-12T16:16:58.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:58.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934579+0000", 2024-09-12T16:16:58.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5044999999999996e-05 2024-09-12T16:16:58.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:58.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934660+0000", 2024-09-12T16:16:58.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0357000000000003e-05 2024-09-12T16:16:58.662 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.662 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:58.662 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.662 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2309 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12409856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:58.662 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:16:58.662 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.723316332000003, 2024-09-12T16:16:58.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038504629999999998, 2024-09-12T16:16:58.662 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:58.662 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:58.662 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:58.662 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:58.662 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:58.663 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:58.663 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2309 2024-09-12T16:16:58.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.663 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:58.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:58.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:16:58.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:58.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:16:58.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:58.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:16:58.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5199999999999998e-07 2024-09-12T16:16:58.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:58.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896263+0000", 2024-09-12T16:16:58.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4209999999999999e-06 2024-09-12T16:16:58.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:58.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896269+0000", 2024-09-12T16:16:58.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9449999999999998e-06 2024-09-12T16:16:58.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:58.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896274+0000", 2024-09-12T16:16:58.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3950000000000003e-06 2024-09-12T16:16:58.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:58.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934686+0000", 2024-09-12T16:16:58.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038412333999999999 2024-09-12T16:16:58.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:58.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934727+0000", 2024-09-12T16:16:58.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0649999999999999e-05 2024-09-12T16:16:58.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:58.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934764+0000", 2024-09-12T16:16:58.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7533000000000001e-05 2024-09-12T16:16:58.666 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.666 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:58.666 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.666 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2310 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12413952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:58.666 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:16:58.666 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.723295460000003, 2024-09-12T16:16:58.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038694183, 2024-09-12T16:16:58.666 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:58.666 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:58.667 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:58.667 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:58.667 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:58.667 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:58.667 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2310 2024-09-12T16:16:58.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.667 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:58.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:58.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:16:58.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:58.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:16:58.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:58.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896281+0000", 2024-09-12T16:16:58.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1399999999999997e-07 2024-09-12T16:16:58.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:58.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896283+0000", 2024-09-12T16:16:58.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9549999999999999e-06 2024-09-12T16:16:58.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:58.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896289+0000", 2024-09-12T16:16:58.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8669999999999999e-06 2024-09-12T16:16:58.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:58.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896301+0000", 2024-09-12T16:16:58.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1807999999999999e-05 2024-09-12T16:16:58.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:58.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934798+0000", 2024-09-12T16:16:58.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038497591999999997 2024-09-12T16:16:58.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:58.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934885+0000", 2024-09-12T16:16:58.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7149000000000002e-05 2024-09-12T16:16:58.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:58.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934975+0000", 2024-09-12T16:16:58.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9297999999999998e-05 2024-09-12T16:16:58.670 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.670 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:58.670 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.670 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2311 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12418048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:58.671 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:16:58.671 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.723268204, 2024-09-12T16:16:58.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038768558000000002, 2024-09-12T16:16:58.671 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:58.671 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:58.671 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:58.671 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:58.671 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:58.671 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:58.671 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2311 2024-09-12T16:16:58.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.672 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:58.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:58.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:16:58.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:58.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:16:58.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:58.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:16:58.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.63e-07 2024-09-12T16:16:58.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:58.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896310+0000", 2024-09-12T16:16:58.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1560000000000002e-06 2024-09-12T16:16:58.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:58.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896316+0000", 2024-09-12T16:16:58.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0249999999999999e-06 2024-09-12T16:16:58.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:58.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896322+0000", 2024-09-12T16:16:58.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6400000000000002e-06 2024-09-12T16:16:58.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:58.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934997+0000", 2024-09-12T16:16:58.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038674565000000001 2024-09-12T16:16:58.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:58.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935037+0000", 2024-09-12T16:16:58.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0485999999999998e-05 2024-09-12T16:16:58.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:58.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935076+0000", 2024-09-12T16:16:58.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9223e-05 2024-09-12T16:16:58.675 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.675 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:58.675 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.675 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2312 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12422144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:58.675 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:16:58.675 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.723247510999997, 2024-09-12T16:16:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038856784999999998, 2024-09-12T16:16:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2312 2024-09-12T16:16:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:16:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:16:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896329+0000", 2024-09-12T16:16:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5499999999999999e-07 2024-09-12T16:16:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896337+0000", 2024-09-12T16:16:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0819999999999999e-06 2024-09-12T16:16:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:58.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896343+0000", 2024-09-12T16:16:58.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.263e-06 2024-09-12T16:16:58.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:58.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896348+0000", 2024-09-12T16:16:58.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8860000000000003e-06 2024-09-12T16:16:58.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:58.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935097+0000", 2024-09-12T16:16:58.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038748818999999997 2024-09-12T16:16:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935141+0000", 2024-09-12T16:16:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4175000000000003e-05 2024-09-12T16:16:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935185+0000", 2024-09-12T16:16:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4205000000000001e-05 2024-09-12T16:16:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2313 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12426240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:58.680 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:16:58.680 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.723221295999998, 2024-09-12T16:16:58.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038928683999999998, 2024-09-12T16:16:58.680 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:58.680 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:58.680 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:58.680 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:58.680 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:58.680 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:58.680 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2313 2024-09-12T16:16:58.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.680 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:58.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:58.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:16:58.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:58.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:16:58.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:58.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:16:58.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0400000000000002e-07 2024-09-12T16:16:58.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:58.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896357+0000", 2024-09-12T16:16:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.097e-06 2024-09-12T16:16:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896363+0000", 2024-09-12T16:16:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5119999999999999e-06 2024-09-12T16:16:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896374+0000", 2024-09-12T16:16:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1381e-05 2024-09-12T16:16:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935205+0000", 2024-09-12T16:16:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038830549999999998 2024-09-12T16:16:58.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:58.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935244+0000", 2024-09-12T16:16:58.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9520000000000001e-05 2024-09-12T16:16:58.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:58.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935283+0000", 2024-09-12T16:16:58.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9220000000000001e-05 2024-09-12T16:16:58.683 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.683 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:58.683 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.684 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2314 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12430336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:58.684 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:16:58.684 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.723184126, 2024-09-12T16:16:58.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039008137999999998, 2024-09-12T16:16:58.684 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:58.684 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:58.684 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:58.684 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:58.684 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:58.684 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:58.684 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2314 2024-09-12T16:16:58.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:16:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:16:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:16:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6499999999999999e-07 2024-09-12T16:16:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896395+0000", 2024-09-12T16:16:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2960000000000001e-06 2024-09-12T16:16:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896402+0000", 2024-09-12T16:16:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2280000000000001e-06 2024-09-12T16:16:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896407+0000", 2024-09-12T16:16:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3630000000000002e-06 2024-09-12T16:16:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935302+0000", 2024-09-12T16:16:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038895181000000001 2024-09-12T16:16:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935343+0000", 2024-09-12T16:16:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0590999999999998e-05 2024-09-12T16:16:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935400+0000", 2024-09-12T16:16:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7014e-05 2024-09-12T16:16:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2315 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12434432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:16:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.723161474999998, 2024-09-12T16:16:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039083892000000002, 2024-09-12T16:16:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2315 2024-09-12T16:16:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:16:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:16:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896415+0000", 2024-09-12T16:16:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3300000000000002e-07 2024-09-12T16:16:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896421+0000", 2024-09-12T16:16:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7579999999999998e-06 2024-09-12T16:16:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896427+0000", 2024-09-12T16:16:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3029999999999996e-06 2024-09-12T16:16:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896432+0000", 2024-09-12T16:16:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.215e-06 2024-09-12T16:16:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935420+0000", 2024-09-12T16:16:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038987727 2024-09-12T16:16:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935460+0000", 2024-09-12T16:16:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9817999999999997e-05 2024-09-12T16:16:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:58.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935498+0000", 2024-09-12T16:16:58.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8438e-05 2024-09-12T16:16:58.692 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.692 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:58.692 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.692 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2316 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12438528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:16:58.692 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:16:58.692 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.723136822999997, 2024-09-12T16:16:58.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039160043999999998, 2024-09-12T16:16:58.692 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:58.693 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:58.693 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:58.693 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:58.693 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:16:58.693 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:16:58.693 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2316 2024-09-12T16:16:58.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.693 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:58.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:58.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:16:58.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:58.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:16:58.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:58.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901945+0000", 2024-09-12T16:16:58.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055056050000000002 2024-09-12T16:16:58.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:58.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901950+0000", 2024-09-12T16:16:58.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2490000000000001e-06 2024-09-12T16:16:58.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:58.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901966+0000", 2024-09-12T16:16:58.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6325e-05 2024-09-12T16:16:58.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:58.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901974+0000", 2024-09-12T16:16:58.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7570000000000004e-06 2024-09-12T16:16:58.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:58.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935518+0000", 2024-09-12T16:16:58.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033543587999999999 2024-09-12T16:16:58.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:58.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935559+0000", 2024-09-12T16:16:58.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1746000000000003e-05 2024-09-12T16:16:58.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935599+0000", 2024-09-12T16:16:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9774000000000002e-05 2024-09-12T16:16:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1571 3.b 3:d046566d:::rbd_data.1155525b14e3.0000000000000001:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:16:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:16:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.467011781, 2024-09-12T16:16:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064439785999999999, 2024-09-12T16:16:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:16:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:16:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1571 2024-09-12T16:16:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:16:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:16:58.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:58.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:16:58.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5400000000000002e-07 2024-09-12T16:16:58.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:58.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152567+0000", 2024-09-12T16:16:58.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.131e-06 2024-09-12T16:16:58.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:58.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152574+0000", 2024-09-12T16:16:58.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1840000000000002e-06 2024-09-12T16:16:58.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:58.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152579+0000", 2024-09-12T16:16:58.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.152e-06 2024-09-12T16:16:58.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:58.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153671+0000", 2024-09-12T16:16:58.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001092078 2024-09-12T16:16:58.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:58.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153779+0000", 2024-09-12T16:16:58.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108461 2024-09-12T16:16:58.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:58.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217004+0000", 2024-09-12T16:16:58.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.063224426 2024-09-12T16:16:58.701 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.701 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:58.701 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1581 3.4 3:22e34893:::rbd_data.1155525b14e3.0000000000000005:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:16:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:16:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.466914656, 2024-09-12T16:16:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064484407999999993, 2024-09-12T16:16:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:16:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:16:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1581 2024-09-12T16:16:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:58.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:58.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:16:58.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:58.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:16:58.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:58.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152662+0000", 2024-09-12T16:16:58.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.65e-07 2024-09-12T16:16:58.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:58.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152664+0000", 2024-09-12T16:16:58.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9829999999999999e-06 2024-09-12T16:16:58.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:58.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152670+0000", 2024-09-12T16:16:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2260000000000002e-06 2024-09-12T16:16:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152675+0000", 2024-09-12T16:16:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7990000000000001e-06 2024-09-12T16:16:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.216945+0000", 2024-09-12T16:16:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064270341999999994 2024-09-12T16:16:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217040+0000", 2024-09-12T16:16:58.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5242999999999996e-05 2024-09-12T16:16:58.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:58.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217146+0000", 2024-09-12T16:16:58.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010545 2024-09-12T16:16:58.706 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.706 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:58.706 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.706 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2207 3.0 3:05fdc61f:::rbd_data.1155ccb1894c.0000000000000003:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:16:58.706 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:16:58.706 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.2488710949999999, 2024-09-12T16:16:58.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.05105382, 2024-09-12T16:16:58.707 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:58.707 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:58.707 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:58.707 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:58.707 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:16:58.707 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:16:58.707 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2207 2024-09-12T16:16:58.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.707 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:58.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:58.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:16:58.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:58.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:16:58.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:58.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:58.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370706+0000", 2024-09-12T16:16:58.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7800000000000001e-07 2024-09-12T16:16:58.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:58.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391581+0000", 2024-09-12T16:16:58.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020875624999999998 2024-09-12T16:16:58.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:58.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391608+0000", 2024-09-12T16:16:58.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6412999999999999e-05 2024-09-12T16:16:58.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:58.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391618+0000", 2024-09-12T16:16:58.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9240000000000002e-06 2024-09-12T16:16:58.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:58.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391705+0000", 2024-09-12T16:16:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7489000000000002e-05 2024-09-12T16:16:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391838+0000", 2024-09-12T16:16:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132865 2024-09-12T16:16:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 2", 2024-09-12T16:16:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.392587+0000", 2024-09-12T16:16:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074930000000000005 2024-09-12T16:16:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.420095+0000", 2024-09-12T16:16:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027507949 2024-09-12T16:16:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:16:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421610+0000", 2024-09-12T16:16:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001515195 2024-09-12T16:16:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:16:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421681+0000", 2024-09-12T16:16:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0320000000000004e-05 2024-09-12T16:16:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:58.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421759+0000", 2024-09-12T16:16:58.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7961999999999997e-05 2024-09-12T16:16:58.712 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.712 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:58.712 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.712 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:58.712 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:58.712 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:58.713 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:16:58.714 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:58.712+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:58.813 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:58.813+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:58.867 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:58.867 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:58.867 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:16:58.867 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:58.876 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:16:58.917 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:16:58.916+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:16:59.014 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:59.013+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:16:59.032 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:59.032 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:16:59.032 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:16:59.032 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:16:59.032 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:59.042 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:16:59.113 INFO:teuthology.orchestra.run.smithi204.stdout:3191 read 0x397c00 thru 0x3a1f94 (0xa395 bytes) 2024-09-12T16:16:59.115 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T16:16:59.116 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:59.114+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:59.124 INFO:teuthology.orchestra.run.smithi204.stdout:3192 trunc from 0x2a1c400 to 0xaf21a00 2024-09-12T16:16:59.135 INFO:teuthology.orchestra.run.smithi204.stdout:3195 read 0x7e4c000 thru 0x7e559db (0x99dc bytes) 2024-09-12T16:16:59.142 INFO:teuthology.orchestra.run.smithi204.stdout:3197 punch from 0x1390e00 to 0x1393a00, (0x2c00 bytes) 2024-09-12T16:16:59.142 INFO:teuthology.orchestra.run.smithi204.stdout:3198 write 0x90a0400 thru 0x90ae8af (0xe4b0 bytes) 2024-09-12T16:16:59.143 INFO:teuthology.orchestra.run.smithi204.stdout:3200 read 0x967ca00 thru 0x9687b4a (0xb14b bytes) 2024-09-12T16:16:59.156 INFO:teuthology.orchestra.run.smithi204.stdout:3202 write 0xd57ea00 thru 0xd5866ba (0x7cbb bytes) 2024-09-12T16:16:59.166 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:16:59.166 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:16:59.166 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:16:59.166 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:16:59.166 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.166 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4805.0:6829 3.18 3:1e2ee373:::rbd_data.1155c2c5fc24.0000000000000003:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 18778112~25088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T16:16:59.166 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:43.576065+0000", 2024-09-12T16:16:59.166 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.588462263, 2024-09-12T16:16:59.166 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044824155999999997, 2024-09-12T16:16:59.167 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:59.167 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:59.167 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:59.167 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:59.167 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4805", 2024-09-12T16:16:59.167 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3734391115", 2024-09-12T16:16:59.167 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6829 2024-09-12T16:16:59.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.167 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:59.167 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.167 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:59.167 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.576065+0000", 2024-09-12T16:16:59.168 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.168 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.168 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:59.168 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.576065+0000", 2024-09-12T16:16:59.168 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.168 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.168 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:59.168 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.576068+0000", 2024-09-12T16:16:59.168 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1629999999999999e-06 2024-09-12T16:16:59.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.168 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.169 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:59.169 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.588880+0000", 2024-09-12T16:16:59.169 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012812054 2024-09-12T16:16:59.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.169 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:59.169 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.588909+0000", 2024-09-12T16:16:59.169 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9354000000000001e-05 2024-09-12T16:16:59.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.169 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:59.169 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.588930+0000", 2024-09-12T16:16:59.169 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0571999999999999e-05 2024-09-12T16:16:59.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.170 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:59.170 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.589010+0000", 2024-09-12T16:16:59.170 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0780999999999998e-05 2024-09-12T16:16:59.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.170 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:59.170 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.589174+0000", 2024-09-12T16:16:59.170 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016337799999999999 2024-09-12T16:16:59.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.170 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 1", 2024-09-12T16:16:59.170 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.590261+0000", 2024-09-12T16:16:59.171 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001087735 2024-09-12T16:16:59.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.171 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.171 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:16:59.171 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.610690+0000", 2024-09-12T16:16:59.171 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020428281999999999 2024-09-12T16:16:59.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.171 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.171 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:59.171 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.620760+0000", 2024-09-12T16:16:59.171 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010070325999999999 2024-09-12T16:16:59.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.172 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:16:59.172 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.620836+0000", 2024-09-12T16:16:59.172 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5617999999999993e-05 2024-09-12T16:16:59.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.172 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:59.172 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.620890+0000", 2024-09-12T16:16:59.172 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3893000000000001e-05 2024-09-12T16:16:59.172 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.172 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:59.172 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.173 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:1673 3.7 3:e722ca22:::rbd_data.1155ccb1894c.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:16:59.173 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.314024+0000", 2024-09-12T16:16:59.173 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.8505038709999999, 2024-09-12T16:16:59.173 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040583337999999997, 2024-09-12T16:16:59.173 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:59.173 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:59.173 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:59.173 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:59.173 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:16:59.173 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:16:59.173 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1673 2024-09-12T16:16:59.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.174 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:59.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.174 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:59.174 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.314024+0000", 2024-09-12T16:16:59.174 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.174 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:59.174 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.314024+0000", 2024-09-12T16:16:59.174 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.174 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:59.175 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.314025+0000", 2024-09-12T16:16:59.175 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0839999999999999e-06 2024-09-12T16:16:59.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.175 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:59.175 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.331177+0000", 2024-09-12T16:16:59.175 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017152499000000002 2024-09-12T16:16:59.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.175 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:59.175 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.331201+0000", 2024-09-12T16:16:59.175 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3845e-05 2024-09-12T16:16:59.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.176 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:59.176 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.331210+0000", 2024-09-12T16:16:59.176 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2840000000000006e-06 2024-09-12T16:16:59.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.176 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.176 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:59.176 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.331285+0000", 2024-09-12T16:16:59.176 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5747999999999994e-05 2024-09-12T16:16:59.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.176 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.176 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:59.176 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.331445+0000", 2024-09-12T16:16:59.176 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015985000000000001 2024-09-12T16:16:59.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.177 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 1", 2024-09-12T16:16:59.177 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.332166+0000", 2024-09-12T16:16:59.177 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000720438 2024-09-12T16:16:59.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.177 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:16:59.177 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.353178+0000", 2024-09-12T16:16:59.177 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021012638 2024-09-12T16:16:59.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.177 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:59.177 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.354503+0000", 2024-09-12T16:16:59.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001324806 2024-09-12T16:16:59.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.178 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:16:59.178 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.354566+0000", 2024-09-12T16:16:59.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3446000000000002e-05 2024-09-12T16:16:59.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.178 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:59.178 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.354607+0000", 2024-09-12T16:16:59.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.07e-05 2024-09-12T16:16:59.178 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.178 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:59.178 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.179 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2213 3.18 3:1944e921:::rbd_data.1155ccb1894c.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:16:59.179 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:16:59.179 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.789178664, 2024-09-12T16:16:59.179 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.055657836000000002, 2024-09-12T16:16:59.179 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:59.179 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:59.179 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:16:59.179 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:59.179 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:16:59.179 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:16:59.179 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2213 2024-09-12T16:16:59.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.179 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:59.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.179 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:59.180 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:16:59.180 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.180 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:59.180 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:16:59.180 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.180 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:59.180 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375351+0000", 2024-09-12T16:16:59.180 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.556e-06 2024-09-12T16:16:59.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.180 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:59.181 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.399989+0000", 2024-09-12T16:16:59.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024637949999999999 2024-09-12T16:16:59.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.181 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:59.181 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400038+0000", 2024-09-12T16:16:59.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9187999999999997e-05 2024-09-12T16:16:59.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.181 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:59.181 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400056+0000", 2024-09-12T16:16:59.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8451e-05 2024-09-12T16:16:59.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.181 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:59.182 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400151+0000", 2024-09-12T16:16:59.182 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5026999999999997e-05 2024-09-12T16:16:59.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.182 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.182 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:59.182 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400345+0000", 2024-09-12T16:16:59.182 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019352900000000001 2024-09-12T16:16:59.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.182 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.182 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 1", 2024-09-12T16:16:59.182 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.401319+0000", 2024-09-12T16:16:59.182 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00097419399999999995 2024-09-12T16:16:59.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.182 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.183 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:16:59.183 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.429350+0000", 2024-09-12T16:16:59.183 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028030607999999999 2024-09-12T16:16:59.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.183 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.183 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:16:59.183 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.430907+0000", 2024-09-12T16:16:59.183 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001557466 2024-09-12T16:16:59.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.183 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.183 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:16:59.183 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.430966+0000", 2024-09-12T16:16:59.183 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9437e-05 2024-09-12T16:16:59.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.183 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.183 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:59.184 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.431007+0000", 2024-09-12T16:16:59.184 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0429999999999997e-05 2024-09-12T16:16:59.184 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.184 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:59.184 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.184 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.184 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:963 3.18 3:1b6fb776:::rbd_data.1155ccb1894c.0000000000000006:15 [read 8257536~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:16:59.184 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.589219+0000", 2024-09-12T16:16:59.184 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.57530881099999998, 2024-09-12T16:16:59.184 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036869616000000001, 2024-09-12T16:16:59.184 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:59.184 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:59.184 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:59.185 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:59.185 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:16:59.185 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:16:59.185 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 963 2024-09-12T16:16:59.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.185 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:59.185 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.185 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:59.185 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.589219+0000", 2024-09-12T16:16:59.185 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.185 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.185 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:59.185 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.589219+0000", 2024-09-12T16:16:59.186 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.186 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.186 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:59.186 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.589219+0000", 2024-09-12T16:16:59.186 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.01e-07 2024-09-12T16:16:59.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.186 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.186 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:59.186 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.589221+0000", 2024-09-12T16:16:59.186 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9999999999999999e-06 2024-09-12T16:16:59.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.186 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.186 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:59.186 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.589228+0000", 2024-09-12T16:16:59.187 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3799999999999999e-06 2024-09-12T16:16:59.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.187 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.187 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:59.187 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.589233+0000", 2024-09-12T16:16:59.187 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.135e-06 2024-09-12T16:16:59.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.187 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.187 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:59.187 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.625902+0000", 2024-09-12T16:16:59.187 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036668919000000001 2024-09-12T16:16:59.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.188 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.188 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:59.188 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.625957+0000", 2024-09-12T16:16:59.188 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5192000000000003e-05 2024-09-12T16:16:59.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.188 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.188 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:59.188 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.626088+0000", 2024-09-12T16:16:59.188 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013158899999999999 2024-09-12T16:16:59.188 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.188 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:59.188 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.189 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.189 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1128 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [read 1802240~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:16:59.189 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590009+0000", 2024-09-12T16:16:59.189 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.57451877299999998, 2024-09-12T16:16:59.189 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037087889999999998, 2024-09-12T16:16:59.189 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:59.189 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:59.189 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:59.189 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:59.189 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:16:59.189 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:16:59.189 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1128 2024-09-12T16:16:59.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.190 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:59.190 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.190 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:59.190 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590009+0000", 2024-09-12T16:16:59.190 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.190 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.190 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:59.190 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590009+0000", 2024-09-12T16:16:59.190 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.191 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:59.191 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590009+0000", 2024-09-12T16:16:59.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.46e-07 2024-09-12T16:16:59.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.191 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:59.191 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590018+0000", 2024-09-12T16:16:59.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7120000000000006e-06 2024-09-12T16:16:59.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.191 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:59.191 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590025+0000", 2024-09-12T16:16:59.192 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1600000000000001e-06 2024-09-12T16:16:59.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.192 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:59.192 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590031+0000", 2024-09-12T16:16:59.192 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8289999999999996e-06 2024-09-12T16:16:59.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.192 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:59.192 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.626874+0000", 2024-09-12T16:16:59.192 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036843072999999997 2024-09-12T16:16:59.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.192 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:59.193 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.626980+0000", 2024-09-12T16:16:59.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106057 2024-09-12T16:16:59.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.193 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:59.193 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627097+0000", 2024-09-12T16:16:59.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116613 2024-09-12T16:16:59.193 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.193 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:59.193 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.193 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1129 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [sparse-read 2195456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:16:59.193 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590039+0000", 2024-09-12T16:16:59.194 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.57448887400000004, 2024-09-12T16:16:59.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037187049, 2024-09-12T16:16:59.194 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:59.194 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:59.194 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:59.194 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:59.194 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:16:59.194 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:16:59.194 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1129 2024-09-12T16:16:59.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.194 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:59.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:59.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590039+0000", 2024-09-12T16:16:59.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:59.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590039+0000", 2024-09-12T16:16:59.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:59.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590039+0000", 2024-09-12T16:16:59.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8700000000000001e-07 2024-09-12T16:16:59.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.196 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:59.196 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590041+0000", 2024-09-12T16:16:59.196 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1449999999999998e-06 2024-09-12T16:16:59.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.196 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:59.196 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590049+0000", 2024-09-12T16:16:59.196 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2830000000000004e-06 2024-09-12T16:16:59.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.196 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:59.196 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590054+0000", 2024-09-12T16:16:59.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1540000000000001e-06 2024-09-12T16:16:59.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:59.197 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627113+0000", 2024-09-12T16:16:59.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037059170000000002 2024-09-12T16:16:59.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:59.197 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627157+0000", 2024-09-12T16:16:59.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4069000000000001e-05 2024-09-12T16:16:59.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:59.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627226+0000", 2024-09-12T16:16:59.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8841e-05 2024-09-12T16:16:59.198 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.198 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:59.198 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.198 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1130 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [read 2621440~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:16:59.198 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590061+0000", 2024-09-12T16:16:59.198 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.57446668199999995, 2024-09-12T16:16:59.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037392033999999998, 2024-09-12T16:16:59.198 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:59.199 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:59.199 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:59.199 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:59.199 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:16:59.199 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:16:59.199 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1130 2024-09-12T16:16:59.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.199 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:59.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:59.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590061+0000", 2024-09-12T16:16:59.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.200 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:59.200 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590061+0000", 2024-09-12T16:16:59.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.200 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.200 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:59.200 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590061+0000", 2024-09-12T16:16:59.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4000000000000002e-07 2024-09-12T16:16:59.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.200 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.200 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:59.200 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590064+0000", 2024-09-12T16:16:59.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2539999999999999e-06 2024-09-12T16:16:59.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.201 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:59.201 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590071+0000", 2024-09-12T16:16:59.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9430000000000003e-06 2024-09-12T16:16:59.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.201 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:59.201 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590076+0000", 2024-09-12T16:16:59.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1159999999999998e-06 2024-09-12T16:16:59.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.201 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:59.202 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627262+0000", 2024-09-12T16:16:59.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037186581000000003 2024-09-12T16:16:59.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.202 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:59.202 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627348+0000", 2024-09-12T16:16:59.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5481000000000004e-05 2024-09-12T16:16:59.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.202 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:59.202 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627453+0000", 2024-09-12T16:16:59.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000105219 2024-09-12T16:16:59.202 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.202 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:59.202 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.203 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1131 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [read 3047424~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:16:59.203 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590082+0000", 2024-09-12T16:16:59.203 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.57444537399999995, 2024-09-12T16:16:59.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037515370999999999, 2024-09-12T16:16:59.203 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:59.203 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:59.203 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:59.203 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:59.203 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:16:59.203 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:16:59.203 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1131 2024-09-12T16:16:59.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.203 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:59.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:59.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590082+0000", 2024-09-12T16:16:59.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:59.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590082+0000", 2024-09-12T16:16:59.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:59.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590083+0000", 2024-09-12T16:16:59.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.34e-07 2024-09-12T16:16:59.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:59.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590086+0000", 2024-09-12T16:16:59.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5470000000000001e-06 2024-09-12T16:16:59.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:59.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590093+0000", 2024-09-12T16:16:59.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4740000000000002e-06 2024-09-12T16:16:59.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:59.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590098+0000", 2024-09-12T16:16:59.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2299999999999999e-06 2024-09-12T16:16:59.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:59.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627485+0000", 2024-09-12T16:16:59.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037386913000000001 2024-09-12T16:16:59.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:59.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627531+0000", 2024-09-12T16:16:59.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5723000000000003e-05 2024-09-12T16:16:59.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:59.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627598+0000", 2024-09-12T16:16:59.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7050000000000003e-05 2024-09-12T16:16:59.207 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.207 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:59.207 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.207 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1132 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [read 3440640~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:16:59.207 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590105+0000", 2024-09-12T16:16:59.207 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.57442269700000004, 2024-09-12T16:16:59.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037722536000000001, 2024-09-12T16:16:59.207 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:59.207 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:59.207 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:59.207 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:59.207 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:16:59.208 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:16:59.208 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1132 2024-09-12T16:16:59.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.208 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:59.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:59.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590105+0000", 2024-09-12T16:16:59.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:59.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590105+0000", 2024-09-12T16:16:59.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:59.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590105+0000", 2024-09-12T16:16:59.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0699999999999998e-07 2024-09-12T16:16:59.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:59.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590107+0000", 2024-09-12T16:16:59.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9709999999999998e-06 2024-09-12T16:16:59.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:59.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590114+0000", 2024-09-12T16:16:59.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6939999999999998e-06 2024-09-12T16:16:59.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:59.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590119+0000", 2024-09-12T16:16:59.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2900000000000002e-06 2024-09-12T16:16:59.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:59.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627637+0000", 2024-09-12T16:16:59.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037517803000000002 2024-09-12T16:16:59.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:59.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627724+0000", 2024-09-12T16:16:59.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6380999999999998e-05 2024-09-12T16:16:59.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:59.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627828+0000", 2024-09-12T16:16:59.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010399 2024-09-12T16:16:59.211 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.211 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:59.211 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.211 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1133 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [read 3866624~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:16:59.211 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590126+0000", 2024-09-12T16:16:59.211 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.57440155000000004, 2024-09-12T16:16:59.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037838388000000001, 2024-09-12T16:16:59.212 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:59.212 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:59.212 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:59.212 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:59.212 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:16:59.212 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:16:59.212 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1133 2024-09-12T16:16:59.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.212 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:59.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:59.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590126+0000", 2024-09-12T16:16:59.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:59.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590126+0000", 2024-09-12T16:16:59.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:59.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590127+0000", 2024-09-12T16:16:59.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9299999999999999e-07 2024-09-12T16:16:59.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:59.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590129+0000", 2024-09-12T16:16:59.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9929999999999998e-06 2024-09-12T16:16:59.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.214 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:59.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590135+0000", 2024-09-12T16:16:59.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5069999999999997e-06 2024-09-12T16:16:59.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.214 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:59.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590140+0000", 2024-09-12T16:16:59.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.271e-06 2024-09-12T16:16:59.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:59.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627859+0000", 2024-09-12T16:16:59.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037718805000000001 2024-09-12T16:16:59.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:59.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627905+0000", 2024-09-12T16:16:59.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5398000000000001e-05 2024-09-12T16:16:59.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:59.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627965+0000", 2024-09-12T16:16:59.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0021e-05 2024-09-12T16:16:59.216 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.216 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:59.216 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.216 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1134 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [read 4259840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:16:59.216 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590147+0000", 2024-09-12T16:16:59.216 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.57438106799999999, 2024-09-12T16:16:59.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038029861999999998, 2024-09-12T16:16:59.216 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:59.216 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:59.216 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:59.216 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:59.217 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:16:59.217 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:16:59.217 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1134 2024-09-12T16:16:59.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.217 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:59.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:59.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590147+0000", 2024-09-12T16:16:59.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:59.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590147+0000", 2024-09-12T16:16:59.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:59.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590147+0000", 2024-09-12T16:16:59.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2899999999999999e-07 2024-09-12T16:16:59.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:59.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590151+0000", 2024-09-12T16:16:59.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8430000000000003e-06 2024-09-12T16:16:59.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:59.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590158+0000", 2024-09-12T16:16:59.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7170000000000002e-06 2024-09-12T16:16:59.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:59.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590163+0000", 2024-09-12T16:16:59.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.074e-06 2024-09-12T16:16:59.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:59.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628000+0000", 2024-09-12T16:16:59.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037837588999999998 2024-09-12T16:16:59.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:59.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628081+0000", 2024-09-12T16:16:59.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1062000000000004e-05 2024-09-12T16:16:59.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.220 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:59.220 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628176+0000", 2024-09-12T16:16:59.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5148000000000004e-05 2024-09-12T16:16:59.220 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.220 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:59.220 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.220 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1135 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [read 4685824~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:16:59.220 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590169+0000", 2024-09-12T16:16:59.220 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.57435839899999996, 2024-09-12T16:16:59.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038127017999999999, 2024-09-12T16:16:59.220 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:59.220 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:59.220 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:59.220 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:59.221 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:16:59.221 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:16:59.221 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1135 2024-09-12T16:16:59.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.221 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:59.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:59.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590169+0000", 2024-09-12T16:16:59.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:59.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590169+0000", 2024-09-12T16:16:59.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:59.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590170+0000", 2024-09-12T16:16:59.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.15e-07 2024-09-12T16:16:59.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:59.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590172+0000", 2024-09-12T16:16:59.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9479999999999998e-06 2024-09-12T16:16:59.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:59.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590178+0000", 2024-09-12T16:16:59.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6660000000000002e-06 2024-09-12T16:16:59.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.223 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:59.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590183+0000", 2024-09-12T16:16:59.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0300000000000001e-06 2024-09-12T16:16:59.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.223 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:59.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628195+0000", 2024-09-12T16:16:59.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038011251000000003 2024-09-12T16:16:59.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.223 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:59.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628237+0000", 2024-09-12T16:16:59.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2354999999999997e-05 2024-09-12T16:16:59.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:59.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628296+0000", 2024-09-12T16:16:59.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9352999999999999e-05 2024-09-12T16:16:59.224 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.224 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:59.224 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.224 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1136 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [sparse-read 5079040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:16:59.224 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590189+0000", 2024-09-12T16:16:59.224 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.57433818599999997, 2024-09-12T16:16:59.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038326948999999999, 2024-09-12T16:16:59.225 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:59.225 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:59.225 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:59.225 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:59.225 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:16:59.225 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:16:59.225 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1136 2024-09-12T16:16:59.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.225 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:59.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:59.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590189+0000", 2024-09-12T16:16:59.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:59.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590189+0000", 2024-09-12T16:16:59.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:59.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590190+0000", 2024-09-12T16:16:59.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7e-07 2024-09-12T16:16:59.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:59.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590192+0000", 2024-09-12T16:16:59.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9e-06 2024-09-12T16:16:59.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:59.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590198+0000", 2024-09-12T16:16:59.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6420000000000001e-06 2024-09-12T16:16:59.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:59.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590203+0000", 2024-09-12T16:16:59.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6399999999999996e-06 2024-09-12T16:16:59.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:59.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628327+0000", 2024-09-12T16:16:59.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038123655999999999 2024-09-12T16:16:59.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:59.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628409+0000", 2024-09-12T16:16:59.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2040999999999996e-05 2024-09-12T16:16:59.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:59.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628516+0000", 2024-09-12T16:16:59.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0001077 2024-09-12T16:16:59.228 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.229 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:59.229 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.229 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1137 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [read 5505024~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:16:59.229 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590210+0000", 2024-09-12T16:16:59.229 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.57431755699999998, 2024-09-12T16:16:59.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038424246000000002, 2024-09-12T16:16:59.229 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:59.229 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:59.229 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:59.229 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:59.229 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:16:59.230 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:16:59.230 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1137 2024-09-12T16:16:59.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.230 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:59.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:59.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590210+0000", 2024-09-12T16:16:59.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:59.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590210+0000", 2024-09-12T16:16:59.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:59.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590210+0000", 2024-09-12T16:16:59.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.72e-07 2024-09-12T16:16:59.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:59.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590213+0000", 2024-09-12T16:16:59.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.311e-06 2024-09-12T16:16:59.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:59.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590219+0000", 2024-09-12T16:16:59.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4400000000000002e-06 2024-09-12T16:16:59.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:59.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590227+0000", 2024-09-12T16:16:59.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3880000000000002e-06 2024-09-12T16:16:59.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:59.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628531+0000", 2024-09-12T16:16:59.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038304546000000002 2024-09-12T16:16:59.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:59.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628580+0000", 2024-09-12T16:16:59.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8457e-05 2024-09-12T16:16:59.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:59.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628634+0000", 2024-09-12T16:16:59.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4731999999999997e-05 2024-09-12T16:16:59.233 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.233 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:59.233 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.233 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1138 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [read 5931008~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:16:59.234 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590235+0000", 2024-09-12T16:16:59.234 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.57429298799999995, 2024-09-12T16:16:59.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038616549, 2024-09-12T16:16:59.234 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:59.234 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:59.234 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:59.234 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:59.234 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:16:59.234 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:16:59.234 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1138 2024-09-12T16:16:59.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.234 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:59.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:59.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590235+0000", 2024-09-12T16:16:59.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:59.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590235+0000", 2024-09-12T16:16:59.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:59.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590235+0000", 2024-09-12T16:16:59.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4700000000000002e-07 2024-09-12T16:16:59.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:59.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590244+0000", 2024-09-12T16:16:59.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3449999999999995e-06 2024-09-12T16:16:59.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:59.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590252+0000", 2024-09-12T16:16:59.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7859999999999997e-06 2024-09-12T16:16:59.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:59.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590257+0000", 2024-09-12T16:16:59.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1410000000000004e-06 2024-09-12T16:16:59.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.237 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:59.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628668+0000", 2024-09-12T16:16:59.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038410776000000001 2024-09-12T16:16:59.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.237 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:59.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628750+0000", 2024-09-12T16:16:59.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2081000000000002e-05 2024-09-12T16:16:59.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:59.238 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628851+0000", 2024-09-12T16:16:59.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000100973 2024-09-12T16:16:59.238 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.238 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:59.238 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.238 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1139 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [read 6324224~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:16:59.238 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590265+0000", 2024-09-12T16:16:59.238 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.57426237999999996, 2024-09-12T16:16:59.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038713368999999997, 2024-09-12T16:16:59.238 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:59.238 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:59.239 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:59.239 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:59.239 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:16:59.239 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:16:59.239 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1139 2024-09-12T16:16:59.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.239 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:59.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:59.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590265+0000", 2024-09-12T16:16:59.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:59.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590265+0000", 2024-09-12T16:16:59.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:59.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590266+0000", 2024-09-12T16:16:59.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.32e-07 2024-09-12T16:16:59.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:59.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590268+0000", 2024-09-12T16:16:59.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3010000000000001e-06 2024-09-12T16:16:59.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:59.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590275+0000", 2024-09-12T16:16:59.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7120000000000003e-06 2024-09-12T16:16:59.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:59.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590280+0000", 2024-09-12T16:16:59.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1590000000000001e-06 2024-09-12T16:16:59.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:59.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628865+0000", 2024-09-12T16:16:59.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038584682000000002 2024-09-12T16:16:59.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:59.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628910+0000", 2024-09-12T16:16:59.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5130000000000003e-05 2024-09-12T16:16:59.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:59.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628979+0000", 2024-09-12T16:16:59.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8953000000000002e-05 2024-09-12T16:16:59.242 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.242 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:59.242 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.243 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1140 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [read 6750208~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:16:59.243 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590287+0000", 2024-09-12T16:16:59.243 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.57424093600000004, 2024-09-12T16:16:59.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038901031000000003, 2024-09-12T16:16:59.243 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:59.243 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:59.243 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:59.243 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:59.243 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:16:59.243 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:16:59.243 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1140 2024-09-12T16:16:59.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.243 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:59.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.244 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:59.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590287+0000", 2024-09-12T16:16:59.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.244 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:59.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590287+0000", 2024-09-12T16:16:59.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.244 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:59.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590287+0000", 2024-09-12T16:16:59.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.96e-07 2024-09-12T16:16:59.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:59.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590294+0000", 2024-09-12T16:16:59.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2130000000000002e-06 2024-09-12T16:16:59.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:59.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590302+0000", 2024-09-12T16:16:59.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2579999999999998e-06 2024-09-12T16:16:59.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:59.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590307+0000", 2024-09-12T16:16:59.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1970000000000004e-06 2024-09-12T16:16:59.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:59.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.629013+0000", 2024-09-12T16:16:59.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038705900000000001 2024-09-12T16:16:59.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:59.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.629091+0000", 2024-09-12T16:16:59.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8300000000000006e-05 2024-09-12T16:16:59.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:59.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.629188+0000", 2024-09-12T16:16:59.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6767000000000004e-05 2024-09-12T16:16:59.247 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.247 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:59.247 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.247 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1141 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [read 7143424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:16:59.247 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590316+0000", 2024-09-12T16:16:59.247 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.57421218200000002, 2024-09-12T16:16:59.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038993406000000001, 2024-09-12T16:16:59.247 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:59.247 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:59.247 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:59.248 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:59.248 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:16:59.248 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:16:59.248 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1141 2024-09-12T16:16:59.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.248 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:59.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:59.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590316+0000", 2024-09-12T16:16:59.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:59.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590316+0000", 2024-09-12T16:16:59.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:59.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590316+0000", 2024-09-12T16:16:59.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2199999999999999e-07 2024-09-12T16:16:59.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:59.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590318+0000", 2024-09-12T16:16:59.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.12e-06 2024-09-12T16:16:59.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:59.250 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590325+0000", 2024-09-12T16:16:59.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.708e-06 2024-09-12T16:16:59.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:59.250 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590331+0000", 2024-09-12T16:16:59.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2169999999999999e-06 2024-09-12T16:16:59.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:59.250 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.629220+0000", 2024-09-12T16:16:59.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038888859999999997 2024-09-12T16:16:59.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:59.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.629267+0000", 2024-09-12T16:16:59.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6966999999999999e-05 2024-09-12T16:16:59.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:59.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.629309+0000", 2024-09-12T16:16:59.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2111999999999999e-05 2024-09-12T16:16:59.251 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.251 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:59.251 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.252 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1142 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [read 7569408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:16:59.252 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590339+0000", 2024-09-12T16:16:59.252 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.57418913500000002, 2024-09-12T16:16:59.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039150314999999998, 2024-09-12T16:16:59.252 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:59.252 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:59.252 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:59.252 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:59.252 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:16:59.252 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:16:59.252 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1142 2024-09-12T16:16:59.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.252 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:59.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:59.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590339+0000", 2024-09-12T16:16:59.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:59.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590339+0000", 2024-09-12T16:16:59.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:59.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590339+0000", 2024-09-12T16:16:59.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0600000000000001e-07 2024-09-12T16:16:59.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:59.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590341+0000", 2024-09-12T16:16:59.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2000000000000001e-06 2024-09-12T16:16:59.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:59.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590348+0000", 2024-09-12T16:16:59.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0219999999999999e-06 2024-09-12T16:16:59.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:59.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590354+0000", 2024-09-12T16:16:59.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4500000000000003e-06 2024-09-12T16:16:59.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:59.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.629340+0000", 2024-09-12T16:16:59.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038986051000000001 2024-09-12T16:16:59.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:59.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.629415+0000", 2024-09-12T16:16:59.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5136999999999996e-05 2024-09-12T16:16:59.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:59.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.629489+0000", 2024-09-12T16:16:59.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4048999999999995e-05 2024-09-12T16:16:59.256 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.256 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:59.256 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.256 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1143 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [sparse-read 7962624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:16:59.256 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590360+0000", 2024-09-12T16:16:59.256 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.57416743000000003, 2024-09-12T16:16:59.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039250647999999999, 2024-09-12T16:16:59.256 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:16:59.256 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:16:59.256 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:16:59.256 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:16:59.257 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:16:59.257 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:16:59.257 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1143 2024-09-12T16:16:59.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.257 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:16:59.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:16:59.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590360+0000", 2024-09-12T16:16:59.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:16:59.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590360+0000", 2024-09-12T16:16:59.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:16:59.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:16:59.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590361+0000", 2024-09-12T16:16:59.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6300000000000001e-07 2024-09-12T16:16:59.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:16:59.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590363+0000", 2024-09-12T16:16:59.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9309999999999998e-06 2024-09-12T16:16:59.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:16:59.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590371+0000", 2024-09-12T16:16:59.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5960000000000004e-06 2024-09-12T16:16:59.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:16:59.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590376+0000", 2024-09-12T16:16:59.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3229999999999997e-06 2024-09-12T16:16:59.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:16:59.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.629506+0000", 2024-09-12T16:16:59.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039129215000000002 2024-09-12T16:16:59.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:16:59.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.629556+0000", 2024-09-12T16:16:59.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0685e-05 2024-09-12T16:16:59.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:16:59.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:16:59.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:16:59.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.629611+0000", 2024-09-12T16:16:59.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4534999999999999e-05 2024-09-12T16:16:59.260 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.260 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:59.260 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.260 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:16:59.260 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:16:59.260 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:16:59.263 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:16:59.263 INFO:teuthology.orchestra.run.smithi204.stdout:3204 trunc from 0xd586800 to 0x6625800 2024-09-12T16:16:59.263 INFO:teuthology.orchestra.run.smithi204.stdout:3205 write 0xa9e4a00 thru 0xa9e80f2 (0x36f3 bytes) 2024-09-12T16:16:59.263 INFO:teuthology.orchestra.run.smithi204.stdout:3211 read 0x4c0cc00 thru 0x4c104b9 (0x38ba bytes) 2024-09-12T16:16:59.264 INFO:teuthology.orchestra.run.smithi204.stdout:3212 read 0x314a00 thru 0x3189f0 (0x3ff1 bytes) 2024-09-12T16:16:59.264 INFO:teuthology.orchestra.run.smithi204.stdout:3214 trunc from 0xa9e8200 to 0x9726e00 2024-09-12T16:16:59.264 INFO:teuthology.orchestra.run.smithi204.stdout:3216 read 0x7327000 thru 0x73327a3 (0xb7a4 bytes) 2024-09-12T16:16:59.264 INFO:teuthology.orchestra.run.smithi204.stdout:3217 trunc from 0x9726e00 to 0xd095a00 2024-09-12T16:16:59.264 INFO:teuthology.orchestra.run.smithi204.stdout:3219 trunc from 0xd095a00 to 0x29e7400 2024-09-12T16:16:59.264 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2024-09-12T16:16:59.265 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:16:59.265 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:16:59.265 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:59.261+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:59.265 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:16:59.266 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:16:59.283 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:16:59.283 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:16:59.300 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:16:59.300 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:16:59.305 INFO:teuthology.orchestra.run.smithi204.stdout:3221 write 0xe3af400 thru 0xe3ba61c (0xb21d bytes) 2024-09-12T16:16:59.306 INFO:teuthology.orchestra.run.smithi204.stdout:3222 write 0xb87a00 thru 0xb95a64 (0xe065 bytes) 2024-09-12T16:16:59.307 INFO:teuthology.orchestra.run.smithi204.stdout:3223 read 0x7865600 thru 0x78691d9 (0x3bda bytes) 2024-09-12T16:16:59.307 INFO:teuthology.orchestra.run.smithi204.stdout:3224 write 0x38d3400 thru 0x38d4cbc (0x18bd bytes) 2024-09-12T16:16:59.308 INFO:teuthology.orchestra.run.smithi204.stdout:3225 punch from 0x265ac00 to 0x265fe00, (0x5200 bytes) 2024-09-12T16:16:59.312 INFO:teuthology.orchestra.run.smithi204.stdout:3226 trunc from 0xe3ba800 to 0xb536400 2024-09-12T16:16:59.317 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:16:59.318 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:16:59.318 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-12T16:16:59.321 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T16:16:59.321 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T16:16:59.324 INFO:teuthology.orchestra.run.smithi204.stdout:3227 write 0x6cc6000 thru 0x6cd1476 (0xb477 bytes) 2024-09-12T16:16:59.326 INFO:teuthology.orchestra.run.smithi204.stdout:3228 trunc from 0xb536400 to 0xa30c400 2024-09-12T16:16:59.343 INFO:teuthology.orchestra.run.smithi204.stdout:3230 write 0x48cca00 thru 0x48d11ef (0x47f0 bytes) 2024-09-12T16:16:59.345 INFO:teuthology.orchestra.run.smithi204.stdout:3233 write 0x6408400 thru 0x640fbc0 (0x77c1 bytes) 2024-09-12T16:16:59.346 INFO:teuthology.orchestra.run.smithi204.stdout:3234 read 0x4de9200 thru 0x4df3b47 (0xa948 bytes) 2024-09-12T16:16:59.348 INFO:teuthology.orchestra.run.smithi204.stdout:3236 clone 20 order 24 su 65536 sc 14 2024-09-12T16:16:59.363 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:16:59.362+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:16:59.388 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:59.389 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:59.397 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:16:59.463 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:59.462+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:59.504 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:59.504 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:59.512 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:16:59.597 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:16:59.596+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:16:59.659 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:59.660 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:59.665 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:59.664+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:59.668 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:16:59.766 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:59.765+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:59.815 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:59.815 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:59.824 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:16:59.866 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:16:59.866+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:16:59.930 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:16:59.931 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:16:59.939 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:16:59.983 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:16:59.982+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:00.046 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:00.046 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:00.054 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:17:00.095 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:00.094+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:00.168 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:00.167+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:00.174 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:00.174 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:00.183 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:17:00.269 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:00.268+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:00.296 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:00.296 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:00.298 INFO:teuthology.orchestra.run.smithi204.stdout:truncating image image_client.0-clone19 from 0xa30c400 (overlap 0x29e7400) to 0x861600 2024-09-12T16:17:00.305 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:17:00.370 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:00.369+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:00.415 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:00.415 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:00.424 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:17:00.509 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:00.508+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:00.572 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:00.571+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:00.574 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:00.574 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:00.584 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:17:00.671 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #18, image image_client.0-clone18 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent19 2024-09-12T16:17:00.673 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:00.672+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:00.745 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:00.746 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:00.754 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:17:00.768 INFO:teuthology.orchestra.run.smithi204.stdout:3242 punch from 0x4d21800 to 0x4d30000, (0xe800 bytes) 2024-09-12T16:17:00.796 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:00.795+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:00.799 INFO:teuthology.orchestra.run.smithi204.stdout:3247 trunc from 0xa30c400 to 0x3d75000 2024-09-12T16:17:00.874 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:00.873+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:00.940 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:00.940 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:00.947 INFO:teuthology.orchestra.run.smithi204.stdout:3248 write 0x28b6c00 thru 0x28c1b13 (0xaf14 bytes) 2024-09-12T16:17:00.949 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:17:00.953 INFO:teuthology.orchestra.run.smithi204.stdout:3249 trunc from 0x3d75000 to 0x163000 2024-09-12T16:17:00.983 INFO:teuthology.orchestra.run.smithi204.stdout:3250 write 0x2f5e000 thru 0x2f67cb0 (0x9cb1 bytes) 2024-09-12T16:17:00.991 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:00.990+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:00.991 INFO:teuthology.orchestra.run.smithi204.stdout:3251 punch from 0x2e41a00 to 0x2e4e000, (0xc600 bytes) 2024-09-12T16:17:00.991 INFO:teuthology.orchestra.run.smithi204.stdout:3252 read 0x2a9c800 thru 0x2aa1ffa (0x57fb bytes) 2024-09-12T16:17:00.995 INFO:teuthology.orchestra.run.smithi204.stdout:3253 trunc from 0x2f67e00 to 0x14e200 2024-09-12T16:17:01.034 INFO:teuthology.orchestra.run.smithi204.stdout:3254 write 0x3d05200 thru 0x3d0cdd9 (0x7bda bytes) 2024-09-12T16:17:01.076 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:01.075+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:01.101 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:01.101 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:01.109 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:17:01.194 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:01.193+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:01.231 INFO:teuthology.orchestra.run.smithi204.stdout:3255 read 0x3c66e00 thru 0x3c73669 (0xc86a bytes) 2024-09-12T16:17:01.232 INFO:teuthology.orchestra.run.smithi204.stdout:3257 trunc from 0x3d0ce00 to 0x3a0c000 2024-09-12T16:17:01.262 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:01.262 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:01.265 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T16:17:01.271 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:17:01.279 INFO:teuthology.orchestra.run.smithi204.stdout:3258 write 0xe0c5600 thru 0xe0cb1e3 (0x5be4 bytes) 2024-09-12T16:17:01.279 INFO:teuthology.orchestra.run.smithi204.stdout:3262 read 0xa20be00 thru 0xa21bcff (0xff00 bytes) 2024-09-12T16:17:01.279 INFO:teuthology.orchestra.run.smithi204.stdout:3263 read 0x209bc00 thru 0x20a0531 (0x4932 bytes) 2024-09-12T16:17:01.280 INFO:teuthology.orchestra.run.smithi204.stdout:3266 punch from 0xa6d5200 to 0xa6d7000, (0x1e00 bytes) 2024-09-12T16:17:01.280 INFO:teuthology.orchestra.run.smithi204.stdout:3267 punch from 0x64a4400 to 0x64aec00, (0xa800 bytes) 2024-09-12T16:17:01.280 INFO:teuthology.orchestra.run.smithi204.stdout:3269 punch from 0x274000 to 0x27be00, (0x7e00 bytes) 2024-09-12T16:17:01.291 INFO:teuthology.orchestra.run.smithi204.stdout:3271 trunc from 0xe0cb200 to 0x4a27800 2024-09-12T16:17:01.312 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:01.311+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:01.312 INFO:teuthology.orchestra.run.smithi204.stdout:3272 write 0x2c92600 thru 0x2c9c632 (0xa033 bytes) 2024-09-12T16:17:01.315 INFO:teuthology.orchestra.run.smithi204.stdout:3276 trunc from 0x4a27800 to 0x4436e00 2024-09-12T16:17:01.322 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T16:17:01.325 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:17:01.357 INFO:teuthology.orchestra.run.smithi204.stdout:3277 write 0xe516800 thru 0xe51aa16 (0x4217 bytes) 2024-09-12T16:17:01.357 INFO:teuthology.orchestra.run.smithi204.stdout:3283 write 0x4ab8c00 thru 0x4ac28fc (0x9cfd bytes) 2024-09-12T16:17:01.371 INFO:teuthology.orchestra.run.smithi204.stdout:3284 trunc from 0xe51ac00 to 0x2cf5e00 2024-09-12T16:17:01.397 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:01.397+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:01.409 INFO:teuthology.orchestra.run.smithi204.stdout:3285 read 0x2918400 thru 0x29250c5 (0xccc6 bytes) 2024-09-12T16:17:01.417 INFO:teuthology.orchestra.run.smithi204.stdout:3286 trunc from 0x2cf5e00 to 0x7747800 2024-09-12T16:17:01.427 INFO:teuthology.orchestra.run.smithi204.stdout:3287 read 0x1de6c00 thru 0x1df6b56 (0xff57 bytes) 2024-09-12T16:17:01.429 INFO:teuthology.orchestra.run.smithi204.stdout:3288 read 0x6f8400 thru 0x707e60 (0xfa61 bytes) 2024-09-12T16:17:01.430 INFO:teuthology.orchestra.run.smithi204.stdout:3290 read 0x36dea00 thru 0x36edcd9 (0xf2da bytes) 2024-09-12T16:17:01.437 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:01.437 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:01.447 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:17:01.449 INFO:teuthology.orchestra.run.smithi204.stdout:3292 write 0xde17600 thru 0xde1b26b (0x3c6c bytes) 2024-09-12T16:17:01.450 INFO:teuthology.orchestra.run.smithi204.stdout:3296 read 0x5661200 thru 0x56612b4 (0xb5 bytes) 2024-09-12T16:17:01.451 INFO:teuthology.orchestra.run.smithi204.stdout:3298 read 0x57b8600 thru 0x57c2d4a (0xa74b bytes) 2024-09-12T16:17:01.451 INFO:teuthology.orchestra.run.smithi204.stdout:3299 read 0x23eb200 thru 0x23f0c50 (0x5a51 bytes) 2024-09-12T16:17:01.452 INFO:teuthology.orchestra.run.smithi047.stderr:no valid command found; 10 closest matches: 2024-09-12T16:17:01.452 INFO:teuthology.orchestra.run.smithi047.stderr:0 2024-09-12T16:17:01.452 INFO:teuthology.orchestra.run.smithi047.stderr:1 2024-09-12T16:17:01.452 INFO:teuthology.orchestra.run.smithi047.stderr:2 2024-09-12T16:17:01.452 INFO:teuthology.orchestra.run.smithi047.stderr:abort 2024-09-12T16:17:01.453 INFO:teuthology.orchestra.run.smithi047.stderr:assert 2024-09-12T16:17:01.453 INFO:teuthology.orchestra.run.smithi047.stderr:bluefs debug_inject_read_zeros 2024-09-12T16:17:01.453 INFO:teuthology.orchestra.run.smithi047.stderr:bluefs files list 2024-09-12T16:17:01.453 INFO:teuthology.orchestra.run.smithi047.stderr:bluefs stats 2024-09-12T16:17:01.453 INFO:teuthology.orchestra.run.smithi047.stderr:bluestore allocator dump block 2024-09-12T16:17:01.453 INFO:teuthology.orchestra.run.smithi047.stderr:bluestore allocator fragmentation block 2024-09-12T16:17:01.453 INFO:teuthology.orchestra.run.smithi047.stderr:admin_socket: invalid command 2024-09-12T16:17:01.454 INFO:teuthology.orchestra.run.smithi204.stdout:3300 punch from 0x452ea00 to 0x4537800, (0x8e00 bytes) 2024-09-12T16:17:01.454 INFO:teuthology.orchestra.run.smithi204.stdout:3301 read 0x7c13800 thru 0x7c16d32 (0x3533 bytes) 2024-09-12T16:17:01.454 INFO:teuthology.orchestra.run.smithi204.stdout:3302 read 0x929e200 thru 0x92a2084 (0x3e85 bytes) 2024-09-12T16:17:01.454 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T16:17:01.455 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-5, ['dump_ops_in_flight'] 2024-09-12T16:17:01.455 INFO:teuthology.orchestra.run.smithi204.stdout:3304 trunc from 0xde1b400 to 0xd28ba00 2024-09-12T16:17:01.458 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:01.457+0000 7fb45ec0b640 -1 osd.5 35 log_to_monitors true 2024-09-12T16:17:01.474 INFO:teuthology.orchestra.run.smithi204.stdout:3309 read 0x8e48e00 thru 0x8e57b6b (0xed6c bytes) 2024-09-12T16:17:01.474 INFO:teuthology.orchestra.run.smithi204.stdout:3310 read 0xc968c00 thru 0xc970ba2 (0x7fa3 bytes) 2024-09-12T16:17:01.474 INFO:teuthology.orchestra.run.smithi204.stdout:3313 read 0xc858200 thru 0xc8641f5 (0xbff6 bytes) 2024-09-12T16:17:01.475 INFO:teuthology.orchestra.run.smithi204.stdout:3314 read 0x52d1e00 thru 0x52d2489 (0x68a bytes) 2024-09-12T16:17:01.475 INFO:teuthology.orchestra.run.smithi204.stdout:3317 read 0x4b16000 thru 0x4b243d7 (0xe3d8 bytes) 2024-09-12T16:17:01.476 INFO:teuthology.orchestra.run.smithi204.stdout:3319 read 0xd068c00 thru 0xd078330 (0xf731 bytes) 2024-09-12T16:17:01.476 INFO:teuthology.orchestra.run.smithi204.stdout:3320 read 0x7f64200 thru 0x7f72699 (0xe49a bytes) 2024-09-12T16:17:01.477 INFO:teuthology.orchestra.run.smithi204.stdout:3321 read 0x6be5200 thru 0x6be84e2 (0x32e3 bytes) 2024-09-12T16:17:01.478 INFO:teuthology.orchestra.run.smithi204.stdout:3324 read 0xa747a00 thru 0xa75785c (0xfe5d bytes) 2024-09-12T16:17:01.478 INFO:teuthology.orchestra.run.smithi204.stdout:3325 read 0x29abe00 thru 0x29af7b3 (0x39b4 bytes) 2024-09-12T16:17:01.479 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:01.478+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:01.479 INFO:teuthology.orchestra.run.smithi204.stdout:3326 write 0x11c6e00 thru 0x11d6101 (0xf302 bytes) 2024-09-12T16:17:01.480 INFO:teuthology.orchestra.run.smithi204.stdout:3327 punch from 0x6bbc800 to 0x6bc7c00, (0xb400 bytes) 2024-09-12T16:17:01.481 INFO:teuthology.orchestra.run.smithi204.stdout:3333 read 0xcd99000 thru 0xcda0075 (0x7076 bytes) 2024-09-12T16:17:01.481 INFO:teuthology.orchestra.run.smithi204.stdout:3335 punch from 0xe16a00 to 0xe1f800, (0x8e00 bytes) 2024-09-12T16:17:01.482 INFO:teuthology.orchestra.run.smithi204.stdout:3336 read 0x82d000 thru 0x839dfb (0xcdfc bytes) 2024-09-12T16:17:01.483 INFO:teuthology.orchestra.run.smithi204.stdout:3339 write 0x2a91c00 thru 0x2a9c6ec (0xaaed bytes) 2024-09-12T16:17:01.496 INFO:teuthology.orchestra.run.smithi204.stdout:3341 trunc from 0xd28ba00 to 0x23e7600 2024-09-12T16:17:01.499 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:17:01.499 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:17:01.518 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:17:01.518 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:17:01.535 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:17:01.535 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:17:01.537 INFO:teuthology.orchestra.run.smithi204.stdout:3343 trunc from 0x23e7600 to 0xd29aa00 2024-09-12T16:17:01.546 INFO:teuthology.orchestra.run.smithi204.stdout:3344 punch from 0x8d0f600 to 0x8d1dc00, (0xe600 bytes) 2024-09-12T16:17:01.551 INFO:teuthology.orchestra.run.smithi204.stdout:3347 write 0xadc6200 thru 0xadc824e (0x204f bytes) 2024-09-12T16:17:01.551 INFO:teuthology.orchestra.run.smithi204.stdout:3351 write 0x8472a00 thru 0x847e2e5 (0xb8e6 bytes) 2024-09-12T16:17:01.552 INFO:teuthology.orchestra.run.smithi204.stdout:3352 read 0x9053a00 thru 0x9053dda (0x3db bytes) 2024-09-12T16:17:01.553 INFO:teuthology.orchestra.run.smithi204.stdout:3353 read 0x492b200 thru 0x492b6b6 (0x4b7 bytes) 2024-09-12T16:17:01.553 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:17:01.553 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:17:01.554 INFO:teuthology.orchestra.run.smithi204.stdout:3354 trunc from 0xd29aa00 to 0xc118c00 2024-09-12T16:17:01.569 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:01.569 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:01.569 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:17:01.569 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:01.573 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:17:01.573 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:17:01.573 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-12T16:17:01.577 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T16:17:01.577 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T16:17:01.578 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:17:01.579 INFO:teuthology.orchestra.run.smithi204.stdout:3356 trunc from 0xc118c00 to 0x3ab5e00 2024-09-12T16:17:01.595 INFO:teuthology.orchestra.run.smithi204.stdout:3358 write 0x71aa00 thru 0x725ab5 (0xb0b6 bytes) 2024-09-12T16:17:01.604 INFO:teuthology.orchestra.run.smithi204.stdout:3359 read 0x2310200 thru 0x2314995 (0x4796 bytes) 2024-09-12T16:17:01.604 INFO:teuthology.orchestra.run.smithi204.stdout:3361 clone 21 order 19 su 262144 sc 3 2024-09-12T16:17:01.619 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:01.619+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:01.680 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:01.679+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:01.725 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:01.725 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:01.725 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:17:01.725 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:17:01.725 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:01.733 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:17:01.781 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:01.779+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:01.842 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:01.842 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:17:01.842 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:17:01.842 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:17:01.842 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.842 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:17:01.842 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:17:01.842 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 80.076088803000005, 2024-09-12T16:17:01.842 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55645454900000002, 2024-09-12T16:17:01.843 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:01.843 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:01.843 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:01.843 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:01.843 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:17:01.843 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:17:01.843 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1 2024-09-12T16:17:01.843 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.843 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:01.843 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.843 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:01.843 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:17:01.843 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.843 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.844 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.844 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:01.844 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:17:01.844 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.844 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.844 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.844 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:01.844 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764440+0000", 2024-09-12T16:17:01.844 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6249999999999999e-06 2024-09-12T16:17:01.844 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.844 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.844 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:01.844 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764447+0000", 2024-09-12T16:17:01.845 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4939999999999997e-06 2024-09-12T16:17:01.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.845 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.845 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:01.845 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764459+0000", 2024-09-12T16:17:01.845 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1517e-05 2024-09-12T16:17:01.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.845 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.845 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:01.845 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764468+0000", 2024-09-12T16:17:01.845 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7690000000000002e-06 2024-09-12T16:17:01.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.846 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.846 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:01.846 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764539+0000", 2024-09-12T16:17:01.846 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1103e-05 2024-09-12T16:17:01.846 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.846 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.846 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:17:01.846 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764551+0000", 2024-09-12T16:17:01.846 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2687999999999999e-05 2024-09-12T16:17:01.846 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.846 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.846 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:01.846 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319497+0000", 2024-09-12T16:17:01.846 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55494560500000001 2024-09-12T16:17:01.847 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.847 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.847 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:01.847 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319688+0000", 2024-09-12T16:17:01.847 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019105599999999999 2024-09-12T16:17:01.847 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.847 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.847 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:17:01.847 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319842+0000", 2024-09-12T16:17:01.847 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015377699999999999 2024-09-12T16:17:01.847 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.847 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.847 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:17:01.847 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320473+0000", 2024-09-12T16:17:01.848 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00063117100000000003 2024-09-12T16:17:01.848 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.848 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.848 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:01.848 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320825+0000", 2024-09-12T16:17:01.848 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00035202500000000001 2024-09-12T16:17:01.848 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.848 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.848 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:01.848 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320867+0000", 2024-09-12T16:17:01.848 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2005000000000002e-05 2024-09-12T16:17:01.848 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.848 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.848 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:01.849 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320893+0000", 2024-09-12T16:17:01.849 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5714000000000001e-05 2024-09-12T16:17:01.849 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.849 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:01.849 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.849 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14034 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5035008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:01.849 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:17:01.849 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 42.319030570000002, 2024-09-12T16:17:01.849 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053404082999999998, 2024-09-12T16:17:01.849 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:01.850 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:01.850 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:01.850 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:01.850 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:01.850 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:01.850 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14034 2024-09-12T16:17:01.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.850 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:01.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:01.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:17:01.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.851 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.851 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:01.851 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:17:01.851 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.851 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.851 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:01.851 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521740+0000", 2024-09-12T16:17:01.851 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000243976 2024-09-12T16:17:01.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.851 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.851 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:01.852 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521745+0000", 2024-09-12T16:17:01.852 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1280000000000001e-06 2024-09-12T16:17:01.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.852 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.852 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:01.852 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521757+0000", 2024-09-12T16:17:01.852 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2751e-05 2024-09-12T16:17:01.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.852 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.852 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:01.852 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521771+0000", 2024-09-12T16:17:01.852 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3328e-05 2024-09-12T16:17:01.853 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.853 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.853 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:01.853 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574710+0000", 2024-09-12T16:17:01.853 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052939358999999998 2024-09-12T16:17:01.853 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.853 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.853 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:01.853 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574799+0000", 2024-09-12T16:17:01.853 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8893000000000004e-05 2024-09-12T16:17:01.853 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.853 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.854 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:01.854 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574901+0000", 2024-09-12T16:17:01.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101648 2024-09-12T16:17:01.854 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.854 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:01.854 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.854 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.854 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14036 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5043200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:01.854 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:17:01.854 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 42.318571376000001, 2024-09-12T16:17:01.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053426247000000003, 2024-09-12T16:17:01.854 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:01.854 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:01.854 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:01.855 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:01.855 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:01.855 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:01.855 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14036 2024-09-12T16:17:01.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.855 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:01.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:01.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:17:01.855 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:01.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:17:01.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.856 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:01.856 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522208+0000", 2024-09-12T16:17:01.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025195300000000002 2024-09-12T16:17:01.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.856 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:01.856 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522211+0000", 2024-09-12T16:17:01.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2160000000000002e-06 2024-09-12T16:17:01.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.856 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:01.857 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522223+0000", 2024-09-12T16:17:01.857 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2044e-05 2024-09-12T16:17:01.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.857 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.857 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:01.857 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522229+0000", 2024-09-12T16:17:01.857 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8850000000000004e-06 2024-09-12T16:17:01.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.857 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.857 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:01.857 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575192+0000", 2024-09-12T16:17:01.857 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052963573 2024-09-12T16:17:01.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.858 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.858 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:01.858 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575282+0000", 2024-09-12T16:17:01.858 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9666000000000005e-05 2024-09-12T16:17:01.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.858 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.858 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:01.858 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575382+0000", 2024-09-12T16:17:01.858 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9909999999999997e-05 2024-09-12T16:17:01.858 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.858 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:01.858 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.858 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.858 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14037 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5047296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:01.859 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522245+0000", 2024-09-12T16:17:01.859 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 42.318282541000002, 2024-09-12T16:17:01.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053384907000000002, 2024-09-12T16:17:01.859 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:01.859 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:01.859 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:01.859 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:01.859 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:01.859 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:01.859 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14037 2024-09-12T16:17:01.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.859 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:01.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.859 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:01.860 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522245+0000", 2024-09-12T16:17:01.860 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.860 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.860 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:01.860 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522245+0000", 2024-09-12T16:17:01.860 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.860 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.860 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:01.860 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522471+0000", 2024-09-12T16:17:01.860 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022601300000000001 2024-09-12T16:17:01.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.861 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.861 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:01.861 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522474+0000", 2024-09-12T16:17:01.861 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3390000000000001e-06 2024-09-12T16:17:01.861 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.861 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.861 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:01.861 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522482+0000", 2024-09-12T16:17:01.861 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7919999999999993e-06 2024-09-12T16:17:01.861 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.861 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.861 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:01.861 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522486+0000", 2024-09-12T16:17:01.862 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5109999999999997e-06 2024-09-12T16:17:01.862 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.862 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.862 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:01.862 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575433+0000", 2024-09-12T16:17:01.862 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052946673999999999 2024-09-12T16:17:01.862 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.862 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.862 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:01.862 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575532+0000", 2024-09-12T16:17:01.862 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9128000000000004e-05 2024-09-12T16:17:01.862 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.862 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.862 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:01.863 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575629+0000", 2024-09-12T16:17:01.863 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7449999999999997e-05 2024-09-12T16:17:01.863 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.863 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:01.863 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.863 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.863 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.863 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14038 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5051392~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:01.863 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:17:01.863 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 42.318033002999996, 2024-09-12T16:17:01.863 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053395152000000001, 2024-09-12T16:17:01.863 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:01.863 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:01.863 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:01.864 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:01.864 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:01.864 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:01.864 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14038 2024-09-12T16:17:01.864 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.864 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:01.864 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.864 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:01.864 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:17:01.864 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.864 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.864 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.865 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:01.865 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:17:01.865 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.865 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.865 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:01.865 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522601+0000", 2024-09-12T16:17:01.865 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010702899999999999 2024-09-12T16:17:01.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.865 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.865 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:01.865 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522605+0000", 2024-09-12T16:17:01.865 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2379999999999999e-06 2024-09-12T16:17:01.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.866 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.866 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:01.866 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522616+0000", 2024-09-12T16:17:01.866 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1185999999999999e-05 2024-09-12T16:17:01.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.866 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.866 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:01.866 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522624+0000", 2024-09-12T16:17:01.866 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1099999999999997e-06 2024-09-12T16:17:01.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.866 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.866 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:01.866 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575677+0000", 2024-09-12T16:17:01.866 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053126999999999 2024-09-12T16:17:01.867 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.867 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.867 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:01.867 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575764+0000", 2024-09-12T16:17:01.867 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7250000000000007e-05 2024-09-12T16:17:01.867 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.867 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.867 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:01.867 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575889+0000", 2024-09-12T16:17:01.867 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012521200000000001 2024-09-12T16:17:01.867 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.867 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:01.867 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.867 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.868 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.868 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14039 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5055488~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:01.868 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:17:01.868 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 42.317891592000002, 2024-09-12T16:17:01.868 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053466207000000002, 2024-09-12T16:17:01.868 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:01.868 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:01.868 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:01.868 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:01.868 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:01.868 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:01.868 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14039 2024-09-12T16:17:01.868 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.868 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:01.869 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.869 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:01.869 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:17:01.869 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.869 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.869 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.869 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:01.869 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:17:01.869 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.869 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.869 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.869 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:01.870 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522899+0000", 2024-09-12T16:17:01.870 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026318199999999999 2024-09-12T16:17:01.870 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.870 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.870 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:01.870 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522903+0000", 2024-09-12T16:17:01.870 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.929e-06 2024-09-12T16:17:01.870 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.870 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.870 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:01.870 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522913+0000", 2024-09-12T16:17:01.870 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0162e-05 2024-09-12T16:17:01.870 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.870 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.870 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:01.871 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522921+0000", 2024-09-12T16:17:01.871 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.14e-06 2024-09-12T16:17:01.871 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.871 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.871 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:01.871 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575922+0000", 2024-09-12T16:17:01.871 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053000712999999998 2024-09-12T16:17:01.871 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.871 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.871 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:01.871 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576006+0000", 2024-09-12T16:17:01.871 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4161999999999998e-05 2024-09-12T16:17:01.871 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.871 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.872 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:01.872 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576102+0000", 2024-09-12T16:17:01.872 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5919000000000001e-05 2024-09-12T16:17:01.872 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.872 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:01.872 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.872 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.872 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14040 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5059584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:01.872 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:17:01.872 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 42.317586697000003, 2024-09-12T16:17:01.872 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053413258999999998, 2024-09-12T16:17:01.872 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:01.872 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:01.872 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:01.873 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:01.873 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:01.873 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:01.873 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14040 2024-09-12T16:17:01.873 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.873 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:01.873 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.873 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:01.873 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:17:01.873 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.873 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.873 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.873 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:01.874 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:17:01.874 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.874 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.874 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.874 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:01.874 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523059+0000", 2024-09-12T16:17:01.874 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118466 2024-09-12T16:17:01.874 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.874 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.874 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:01.874 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523062+0000", 2024-09-12T16:17:01.874 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.971e-06 2024-09-12T16:17:01.874 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.875 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.875 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:01.875 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523069+0000", 2024-09-12T16:17:01.875 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8279999999999997e-06 2024-09-12T16:17:01.875 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.875 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.875 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:01.875 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523073+0000", 2024-09-12T16:17:01.875 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3019999999999996e-06 2024-09-12T16:17:01.875 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.875 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.875 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:01.875 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576155+0000", 2024-09-12T16:17:01.876 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053081962000000003 2024-09-12T16:17:01.876 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.876 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.876 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:01.876 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576249+0000", 2024-09-12T16:17:01.876 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3914999999999998e-05 2024-09-12T16:17:01.876 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.876 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.876 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:01.876 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576354+0000", 2024-09-12T16:17:01.876 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010481500000000001 2024-09-12T16:17:01.876 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.876 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:01.877 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.877 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.877 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.877 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14041 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5063680~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:01.877 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:17:01.877 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 42.317436391999998, 2024-09-12T16:17:01.877 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053519111000000001, 2024-09-12T16:17:01.877 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:01.877 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:01.877 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:01.877 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:01.877 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:01.877 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:01.878 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14041 2024-09-12T16:17:01.878 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.878 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:01.878 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.878 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:01.878 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:17:01.878 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.878 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.878 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.878 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:01.878 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:17:01.878 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.878 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.878 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.879 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:01.879 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523309+0000", 2024-09-12T16:17:01.879 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000218712 2024-09-12T16:17:01.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.879 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.879 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:01.879 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523313+0000", 2024-09-12T16:17:01.879 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.151e-06 2024-09-12T16:17:01.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.879 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.879 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:01.879 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523320+0000", 2024-09-12T16:17:01.879 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9789999999999993e-06 2024-09-12T16:17:01.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.880 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.880 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:01.880 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523325+0000", 2024-09-12T16:17:01.880 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:17:01.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.880 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.880 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:01.880 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576402+0000", 2024-09-12T16:17:01.880 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053076811000000002 2024-09-12T16:17:01.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.880 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.880 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:01.881 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576491+0000", 2024-09-12T16:17:01.881 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8578999999999993e-05 2024-09-12T16:17:01.881 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.881 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.881 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:01.881 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576610+0000", 2024-09-12T16:17:01.881 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119129 2024-09-12T16:17:01.881 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.881 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:01.881 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.881 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.881 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.881 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14042 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5067776~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:01.881 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:17:01.882 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 42.317192958, 2024-09-12T16:17:01.882 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053510350999999998, 2024-09-12T16:17:01.882 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:01.882 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:01.882 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:01.882 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:01.882 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:01.882 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:01.882 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14042 2024-09-12T16:17:01.882 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.882 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:01.882 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.882 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:01.883 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:17:01.883 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.883 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.883 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.883 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:01.883 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:17:01.883 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.883 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.883 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.883 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:01.883 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523591+0000", 2024-09-12T16:17:01.883 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025710300000000001 2024-09-12T16:17:01.883 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.884 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.884 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:01.884 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523594+0000", 2024-09-12T16:17:01.884 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2229999999999999e-06 2024-09-12T16:17:01.884 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.884 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.884 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:01.884 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523602+0000", 2024-09-12T16:17:01.884 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6930000000000007e-06 2024-09-12T16:17:01.884 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.884 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.884 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:01.884 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523607+0000", 2024-09-12T16:17:01.885 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4789999999999998e-06 2024-09-12T16:17:01.885 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.885 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.885 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:01.885 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576661+0000", 2024-09-12T16:17:01.885 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053973999999997 2024-09-12T16:17:01.885 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.885 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.885 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:01.885 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576745+0000", 2024-09-12T16:17:01.885 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4660000000000006e-05 2024-09-12T16:17:01.885 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.885 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.886 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:01.886 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576844+0000", 2024-09-12T16:17:01.886 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9219e-05 2024-09-12T16:17:01.886 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.886 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:01.886 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.886 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.886 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.886 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14043 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5071872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:01.886 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:17:01.886 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 42.316912479000003, 2024-09-12T16:17:01.886 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053475295999999999, 2024-09-12T16:17:01.886 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:01.887 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:01.887 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:01.887 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:01.887 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:01.887 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:01.887 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14043 2024-09-12T16:17:01.887 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.887 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:01.887 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.887 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:01.887 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:17:01.887 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.887 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.887 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.888 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:01.888 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:17:01.888 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.888 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.888 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.888 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:01.888 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523823+0000", 2024-09-12T16:17:01.888 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020818900000000001 2024-09-12T16:17:01.888 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.888 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.888 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:01.888 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523826+0000", 2024-09-12T16:17:01.888 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.405e-06 2024-09-12T16:17:01.888 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.889 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.889 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:01.889 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523834+0000", 2024-09-12T16:17:01.889 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5499999999999997e-06 2024-09-12T16:17:01.889 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.889 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.889 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:01.889 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523838+0000", 2024-09-12T16:17:01.889 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.408e-06 2024-09-12T16:17:01.889 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.889 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.889 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:01.889 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576904+0000", 2024-09-12T16:17:01.889 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053065687 2024-09-12T16:17:01.889 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.889 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.890 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:01.890 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576991+0000", 2024-09-12T16:17:01.890 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7399999999999997e-05 2024-09-12T16:17:01.890 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.890 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.890 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:01.890 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577090+0000", 2024-09-12T16:17:01.890 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8657000000000001e-05 2024-09-12T16:17:01.890 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.890 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:01.890 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.890 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.890 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.890 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14044 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5075968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:01.890 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:17:01.891 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 42.316680949000002, 2024-09-12T16:17:01.891 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053442659000000003, 2024-09-12T16:17:01.891 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:01.891 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:01.891 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:01.891 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:01.891 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:01.891 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:01.891 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14044 2024-09-12T16:17:01.891 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.891 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:01.891 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.891 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:01.891 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:17:01.891 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.892 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.892 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.892 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:01.892 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:17:01.892 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.892 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.892 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.892 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:01.892 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523985+0000", 2024-09-12T16:17:01.892 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000138522 2024-09-12T16:17:01.892 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.892 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.892 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:01.892 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523988+0000", 2024-09-12T16:17:01.893 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.788e-06 2024-09-12T16:17:01.893 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.893 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.893 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:01.893 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523998+0000", 2024-09-12T16:17:01.893 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8470000000000008e-06 2024-09-12T16:17:01.893 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.893 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.893 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:01.893 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524010+0000", 2024-09-12T16:17:01.893 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1348999999999999e-05 2024-09-12T16:17:01.893 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.893 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.894 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:01.894 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577137+0000", 2024-09-12T16:17:01.894 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053127055999999999 2024-09-12T16:17:01.894 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.894 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.894 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:01.894 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577210+0000", 2024-09-12T16:17:01.894 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3392000000000005e-05 2024-09-12T16:17:01.894 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.894 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.894 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:01.894 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577289+0000", 2024-09-12T16:17:01.894 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8704999999999999e-05 2024-09-12T16:17:01.895 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.895 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:01.895 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.895 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.895 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.895 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14045 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5080064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:01.895 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:17:01.895 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 42.316502128000003, 2024-09-12T16:17:01.895 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053497514000000003, 2024-09-12T16:17:01.895 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:01.895 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:01.895 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:01.895 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:01.895 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:01.896 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:01.896 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14045 2024-09-12T16:17:01.896 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.896 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:01.896 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.896 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:01.896 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:17:01.896 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.896 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.896 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.896 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:01.896 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:17:01.896 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.897 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.897 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:01.897 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524311+0000", 2024-09-12T16:17:01.897 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028626299999999998 2024-09-12T16:17:01.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.897 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.897 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:01.897 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524315+0000", 2024-09-12T16:17:01.897 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0969999999999999e-06 2024-09-12T16:17:01.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.897 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.897 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:01.897 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524325+0000", 2024-09-12T16:17:01.897 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6330000000000008e-06 2024-09-12T16:17:01.898 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.898 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.898 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:01.898 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524332+0000", 2024-09-12T16:17:01.898 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8700000000000003e-06 2024-09-12T16:17:01.898 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.898 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.898 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:01.898 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577334+0000", 2024-09-12T16:17:01.898 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053001834999999997 2024-09-12T16:17:01.898 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.898 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.898 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:01.898 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577420+0000", 2024-09-12T16:17:01.898 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6145999999999998e-05 2024-09-12T16:17:01.898 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.899 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.899 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:01.899 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577522+0000", 2024-09-12T16:17:01.899 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010267 2024-09-12T16:17:01.899 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.899 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:01.899 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.899 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.899 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.899 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14047 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5088256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:01.899 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:17:01.899 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 42.316016402000002, 2024-09-12T16:17:01.899 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053433340000000003, 2024-09-12T16:17:01.900 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:01.900 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:01.900 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:01.900 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:01.900 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:01.900 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:01.900 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14047 2024-09-12T16:17:01.900 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.900 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:01.900 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.900 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:01.900 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:17:01.900 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.900 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.900 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.901 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:01.901 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:17:01.901 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.901 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.901 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:01.901 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524727+0000", 2024-09-12T16:17:01.901 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000216126 2024-09-12T16:17:01.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.901 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.901 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:01.901 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524732+0000", 2024-09-12T16:17:01.901 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1569999999999999e-06 2024-09-12T16:17:01.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.902 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.902 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:01.902 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524742+0000", 2024-09-12T16:17:01.902 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0186999999999999e-05 2024-09-12T16:17:01.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.902 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.902 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:01.902 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524750+0000", 2024-09-12T16:17:01.902 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4279999999999999e-06 2024-09-12T16:17:01.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.902 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.902 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:01.902 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577743+0000", 2024-09-12T16:17:01.902 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052993077 2024-09-12T16:17:01.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.903 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.903 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:01.903 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577841+0000", 2024-09-12T16:17:01.903 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8369000000000006e-05 2024-09-12T16:17:01.903 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.903 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.903 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:01.903 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577944+0000", 2024-09-12T16:17:01.903 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102996 2024-09-12T16:17:01.903 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.903 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:01.903 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.903 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.904 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.904 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14048 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5092352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:01.904 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:17:01.904 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 42.315764809000001, 2024-09-12T16:17:01.904 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053397515, 2024-09-12T16:17:01.904 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:01.904 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:01.904 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:01.904 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:01.905 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:01.905 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:01.905 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14048 2024-09-12T16:17:01.905 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.905 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:01.905 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.905 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:01.905 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:17:01.905 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.905 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.905 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.905 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:01.905 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:17:01.905 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.905 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.906 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.906 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:01.906 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524957+0000", 2024-09-12T16:17:01.906 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019516999999999999 2024-09-12T16:17:01.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.906 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.906 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:01.906 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524962+0000", 2024-09-12T16:17:01.906 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7709999999999997e-06 2024-09-12T16:17:01.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.906 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.906 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:01.906 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524973+0000", 2024-09-12T16:17:01.907 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1031e-05 2024-09-12T16:17:01.907 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.907 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.907 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:01.907 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524980+0000", 2024-09-12T16:17:01.907 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6100000000000002e-06 2024-09-12T16:17:01.907 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.907 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.907 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:01.907 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577977+0000", 2024-09-12T16:17:01.907 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052997481999999999 2024-09-12T16:17:01.907 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.907 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.908 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:01.908 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578062+0000", 2024-09-12T16:17:01.908 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4851000000000005e-05 2024-09-12T16:17:01.908 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.908 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.908 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:01.908 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578160+0000", 2024-09-12T16:17:01.908 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7600000000000001e-05 2024-09-12T16:17:01.908 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.908 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:01.908 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.908 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.908 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.908 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14049 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5096448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:01.909 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:17:01.909 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 42.315536180999999, 2024-09-12T16:17:01.909 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053439792, 2024-09-12T16:17:01.909 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:01.909 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:01.909 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:01.909 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:01.909 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:01.909 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:01.909 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14049 2024-09-12T16:17:01.909 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.909 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:01.909 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.910 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:01.910 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:17:01.910 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.910 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.910 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.910 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:01.910 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:17:01.910 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.910 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.910 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.910 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:01.910 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525170+0000", 2024-09-12T16:17:01.910 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017958500000000001 2024-09-12T16:17:01.910 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.911 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.911 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:01.911 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525174+0000", 2024-09-12T16:17:01.911 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0239999999999999e-06 2024-09-12T16:17:01.911 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.911 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.911 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:01.911 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525184+0000", 2024-09-12T16:17:01.911 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5950000000000005e-06 2024-09-12T16:17:01.911 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.911 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.911 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:01.911 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525191+0000", 2024-09-12T16:17:01.911 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8329999999999996e-06 2024-09-12T16:17:01.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.912 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.912 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:01.912 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578240+0000", 2024-09-12T16:17:01.912 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053049236 2024-09-12T16:17:01.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.912 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.912 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:01.912 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578333+0000", 2024-09-12T16:17:01.912 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2806999999999994e-05 2024-09-12T16:17:01.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.912 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.912 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:01.912 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578431+0000", 2024-09-12T16:17:01.913 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7712000000000002e-05 2024-09-12T16:17:01.913 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.913 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:01.913 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.913 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.913 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.913 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14050 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5100544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:01.913 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.525201+0000", 2024-09-12T16:17:01.913 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 42.315325627999997, 2024-09-12T16:17:01.913 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053367398000000003, 2024-09-12T16:17:01.913 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:01.913 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:01.913 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:01.914 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:01.914 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:01.914 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:01.914 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14050 2024-09-12T16:17:01.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.914 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:01.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.914 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:01.914 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525201+0000", 2024-09-12T16:17:01.914 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.914 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:01.914 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525201+0000", 2024-09-12T16:17:01.914 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.915 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:01.915 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525449+0000", 2024-09-12T16:17:01.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00024803999999999999 2024-09-12T16:17:01.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.915 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:01.915 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525453+0000", 2024-09-12T16:17:01.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.036e-06 2024-09-12T16:17:01.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.915 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:01.915 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525462+0000", 2024-09-12T16:17:01.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6090000000000001e-06 2024-09-12T16:17:01.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.916 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.916 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:01.916 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525472+0000", 2024-09-12T16:17:01.916 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9629999999999993e-06 2024-09-12T16:17:01.916 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.916 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.916 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:01.916 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578469+0000", 2024-09-12T16:17:01.917 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052996877999999997 2024-09-12T16:17:01.917 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.917 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.917 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:01.917 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578514+0000", 2024-09-12T16:17:01.917 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5460000000000002e-05 2024-09-12T16:17:01.917 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.917 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.917 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:01.917 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578569+0000", 2024-09-12T16:17:01.917 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4412e-05 2024-09-12T16:17:01.917 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.917 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:01.918 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.918 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.918 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.918 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14054 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5116928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:01.918 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.526046+0000", 2024-09-12T16:17:01.918 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 42.314480832000001, 2024-09-12T16:17:01.918 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053378408000000002, 2024-09-12T16:17:01.918 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:01.918 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:01.918 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:01.918 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:01.918 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:01.918 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:01.918 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14054 2024-09-12T16:17:01.919 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.919 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:01.919 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.919 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:01.919 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526046+0000", 2024-09-12T16:17:01.919 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.919 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.919 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.919 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:01.919 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526046+0000", 2024-09-12T16:17:01.919 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.919 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.919 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.919 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:01.920 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526228+0000", 2024-09-12T16:17:01.920 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018200200000000001 2024-09-12T16:17:01.920 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.920 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.920 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:01.920 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526236+0000", 2024-09-12T16:17:01.920 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5109999999999997e-06 2024-09-12T16:17:01.920 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.920 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.920 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:01.920 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526245+0000", 2024-09-12T16:17:01.920 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9600000000000006e-06 2024-09-12T16:17:01.920 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:01.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526251+0000", 2024-09-12T16:17:01.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5520000000000001e-06 2024-09-12T16:17:01.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:01.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579226+0000", 2024-09-12T16:17:01.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052974343 2024-09-12T16:17:01.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:01.922 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579324+0000", 2024-09-12T16:17:01.922 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8517000000000006e-05 2024-09-12T16:17:01.922 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.922 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.922 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:01.922 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579425+0000", 2024-09-12T16:17:01.922 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000100523 2024-09-12T16:17:01.922 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.922 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:01.922 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.922 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.923 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.923 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14055 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5121024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:01.923 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:17:01.923 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 42.314265489999997, 2024-09-12T16:17:01.923 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053399038000000003, 2024-09-12T16:17:01.923 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:01.923 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:01.923 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:01.923 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:01.923 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:01.923 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:01.923 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14055 2024-09-12T16:17:01.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.924 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:01.924 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.924 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:01.924 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:17:01.924 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.924 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.924 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.924 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:01.924 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:17:01.924 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.924 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.924 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.925 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:01.925 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526403+0000", 2024-09-12T16:17:01.925 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141571 2024-09-12T16:17:01.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.925 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.925 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:01.925 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526406+0000", 2024-09-12T16:17:01.925 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2660000000000002e-06 2024-09-12T16:17:01.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.925 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.925 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:01.925 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526420+0000", 2024-09-12T16:17:01.925 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3949e-05 2024-09-12T16:17:01.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.926 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.926 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:01.926 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526428+0000", 2024-09-12T16:17:01.926 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4250000000000001e-06 2024-09-12T16:17:01.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.926 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.926 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:01.926 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579476+0000", 2024-09-12T16:17:01.926 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053048349000000002 2024-09-12T16:17:01.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.926 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.926 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:01.926 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579563+0000", 2024-09-12T16:17:01.926 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6502999999999995e-05 2024-09-12T16:17:01.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.927 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.927 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:01.927 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579661+0000", 2024-09-12T16:17:01.927 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7974999999999996e-05 2024-09-12T16:17:01.927 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.927 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:01.927 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.927 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.927 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4806.0:3139 3.1e 3:78d5a095:::rbd_data.11552a37e55b.0000000000000000:head [read 69632~61440] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:17:01.927 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:01.927 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 31.539271240000001, 2024-09-12T16:17:01.927 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057851734000000002, 2024-09-12T16:17:01.928 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:01.928 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:01.928 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:01.928 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:01.928 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4806", 2024-09-12T16:17:01.928 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3959815836", 2024-09-12T16:17:01.928 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 3139 2024-09-12T16:17:01.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.928 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:01.928 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.928 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:01.928 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:01.928 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.929 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.929 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:01.929 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:01.929 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.929 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.929 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.929 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:01.929 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:01.929 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4799999999999999e-07 2024-09-12T16:17:01.929 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.929 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.929 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:01.929 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301258+0000", 2024-09-12T16:17:01.930 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.844e-06 2024-09-12T16:17:01.930 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.930 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.930 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:01.930 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301267+0000", 2024-09-12T16:17:01.930 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2960000000000004e-06 2024-09-12T16:17:01.930 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.930 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.930 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:01.930 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301276+0000", 2024-09-12T16:17:01.930 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0650000000000005e-06 2024-09-12T16:17:01.930 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.930 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.931 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:01.931 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301871+0000", 2024-09-12T16:17:01.931 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00059423600000000005 2024-09-12T16:17:01.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.931 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.931 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:01.931 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301920+0000", 2024-09-12T16:17:01.931 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9067000000000003e-05 2024-09-12T16:17:01.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.931 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.931 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:01.931 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359108+0000", 2024-09-12T16:17:01.931 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057187877999999998 2024-09-12T16:17:01.931 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.932 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:01.932 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.932 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.932 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:6428 3.14 3:28a44e54:::rbd_header.11552a37e55b:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:17:01.932 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:17:01.932 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 31.538942645999999, 2024-09-12T16:17:01.932 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057504023000000001, 2024-09-12T16:17:01.932 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:01.932 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:01.932 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:01.932 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:01.932 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:17:01.932 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:17:01.933 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6428 2024-09-12T16:17:01.933 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.933 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:01.933 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.933 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:01.933 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:17:01.933 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.933 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.933 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.933 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:01.933 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:17:01.933 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:01.933 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.933 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.934 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:01.934 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301585+0000", 2024-09-12T16:17:01.934 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6300000000000005e-07 2024-09-12T16:17:01.934 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.934 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.934 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:01.934 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301588+0000", 2024-09-12T16:17:01.934 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4149999999999999e-06 2024-09-12T16:17:01.934 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.934 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.934 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:01.934 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301597+0000", 2024-09-12T16:17:01.934 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5450000000000003e-06 2024-09-12T16:17:01.934 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.934 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.934 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:01.935 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301617+0000", 2024-09-12T16:17:01.935 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9837e-05 2024-09-12T16:17:01.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.935 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.935 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:01.935 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301779+0000", 2024-09-12T16:17:01.935 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016186799999999999 2024-09-12T16:17:01.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.935 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.935 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:01.935 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301855+0000", 2024-09-12T16:17:01.935 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5899e-05 2024-09-12T16:17:01.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:01.935 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:01.935 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:01.936 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359088+0000", 2024-09-12T16:17:01.936 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057233895999999999 2024-09-12T16:17:01.936 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.936 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:01.936 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.936 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:01.936 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:01.936 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:01.938 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:17:01.938 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:01.937+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:02.038 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:02.037+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:02.086 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:02.086 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:02.086 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:17:02.086 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:02.094 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:17:02.140 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:02.139+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:02.223 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-12T16:17:02.240 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:02.238+0000 7fb452418640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T16:17:02.240 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:02.239+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:02.247 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:02.247 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:02.247 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:17:02.248 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:17:02.248 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:02.257 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:17:02.327 INFO:teuthology.orchestra.run.smithi204.stdout:truncating image image_client.0-clone20 from 0x3ab5e00 (overlap 0x14e200) to 0xc8600 2024-09-12T16:17:02.341 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:02.340+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:02.411 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:02.411 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:17:02.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:17:02.411 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:17:02.411 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.412 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5599 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4788224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:02.412 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:17:02.412 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 22.113797562999999, 2024-09-12T16:17:02.412 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061192059, 2024-09-12T16:17:02.412 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:02.412 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:02.412 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:02.412 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:02.412 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:02.412 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:02.412 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5599 2024-09-12T16:17:02.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.412 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:02.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.413 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:02.413 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:17:02.413 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.413 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:02.413 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:17:02.413 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.413 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:02.413 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296333+0000", 2024-09-12T16:17:02.413 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6599999999999996e-07 2024-09-12T16:17:02.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.414 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.414 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:02.414 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296335+0000", 2024-09-12T16:17:02.414 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5900000000000002e-06 2024-09-12T16:17:02.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.414 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.414 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:02.414 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296344+0000", 2024-09-12T16:17:02.414 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9539999999999993e-06 2024-09-12T16:17:02.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.414 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.414 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.414 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296350+0000", 2024-09-12T16:17:02.415 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5589999999999996e-06 2024-09-12T16:17:02.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.415 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.415 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:02.415 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357307+0000", 2024-09-12T16:17:02.415 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.060957573000000001 2024-09-12T16:17:02.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.415 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.415 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:02.415 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357401+0000", 2024-09-12T16:17:02.415 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3512999999999997e-05 2024-09-12T16:17:02.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.415 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.415 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:02.415 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357524+0000", 2024-09-12T16:17:02.416 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000123304 2024-09-12T16:17:02.416 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.416 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:02.416 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.416 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.416 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.416 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5611 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4730880~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:02.416 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:17:02.416 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 22.113735119000001, 2024-09-12T16:17:02.416 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061359348000000001, 2024-09-12T16:17:02.416 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:02.416 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:02.416 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:02.416 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:02.417 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:02.417 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:02.417 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5611 2024-09-12T16:17:02.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.417 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:02.417 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.417 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:02.417 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:17:02.417 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.417 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.417 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:02.417 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:17:02.417 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.418 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.418 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.418 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:02.418 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296395+0000", 2024-09-12T16:17:02.418 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4600000000000003e-07 2024-09-12T16:17:02.418 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.418 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.418 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:02.418 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296399+0000", 2024-09-12T16:17:02.418 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9430000000000002e-06 2024-09-12T16:17:02.418 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.418 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.418 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:02.418 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296411+0000", 2024-09-12T16:17:02.419 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1755e-05 2024-09-12T16:17:02.419 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.419 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.419 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.419 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296417+0000", 2024-09-12T16:17:02.419 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3790000000000003e-06 2024-09-12T16:17:02.419 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.419 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.419 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:02.419 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357572+0000", 2024-09-12T16:17:02.419 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061154871 2024-09-12T16:17:02.419 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.419 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.419 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:02.420 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357663+0000", 2024-09-12T16:17:02.420 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0389999999999993e-05 2024-09-12T16:17:02.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.420 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.420 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:02.420 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357754+0000", 2024-09-12T16:17:02.420 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1063999999999994e-05 2024-09-12T16:17:02.420 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.420 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:02.420 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.420 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.421 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5613 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4775936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:02.421 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:02.421 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 22.113693939000001, 2024-09-12T16:17:02.421 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061491777999999997, 2024-09-12T16:17:02.421 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:02.421 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:02.421 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:02.421 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:02.421 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:02.421 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:02.421 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5613 2024-09-12T16:17:02.421 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.421 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:02.421 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.422 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:02.422 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:02.422 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.422 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.422 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:02.422 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:02.422 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.422 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.422 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:02.422 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:02.422 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8899999999999999e-07 2024-09-12T16:17:02.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.422 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.423 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:02.423 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296439+0000", 2024-09-12T16:17:02.423 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8439999999999998e-06 2024-09-12T16:17:02.423 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.423 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.423 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:02.423 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296452+0000", 2024-09-12T16:17:02.423 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2639e-05 2024-09-12T16:17:02.423 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.423 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.423 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.423 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296457+0000", 2024-09-12T16:17:02.423 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5720000000000002e-06 2024-09-12T16:17:02.424 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.424 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.424 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:02.424 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357773+0000", 2024-09-12T16:17:02.424 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061315500000000002 2024-09-12T16:17:02.424 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.424 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.424 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:02.424 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357814+0000", 2024-09-12T16:17:02.424 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1448e-05 2024-09-12T16:17:02.425 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.425 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.425 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:02.425 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357927+0000", 2024-09-12T16:17:02.425 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000113186 2024-09-12T16:17:02.425 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.425 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:02.425 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.425 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.425 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.426 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5616 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4784128~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:02.426 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:02.426 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 22.113658876999999, 2024-09-12T16:17:02.426 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061725002000000001, 2024-09-12T16:17:02.426 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:02.426 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:02.426 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:02.426 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:02.426 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:02.426 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:02.426 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5616 2024-09-12T16:17:02.426 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.426 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:02.427 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.427 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:02.427 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:02.427 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.427 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.427 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.427 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:02.427 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:02.427 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.427 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.427 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.427 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:02.427 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:02.427 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5900000000000002e-07 2024-09-12T16:17:02.427 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.428 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.428 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:02.428 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296473+0000", 2024-09-12T16:17:02.428 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3130000000000001e-06 2024-09-12T16:17:02.428 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.428 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.428 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:02.428 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296481+0000", 2024-09-12T16:17:02.428 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1389999999999998e-06 2024-09-12T16:17:02.428 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.428 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.428 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.428 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296486+0000", 2024-09-12T16:17:02.429 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3310000000000003e-06 2024-09-12T16:17:02.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.429 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.429 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:02.429 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357981+0000", 2024-09-12T16:17:02.429 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061494866000000002 2024-09-12T16:17:02.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.429 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.429 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:02.429 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358082+0000", 2024-09-12T16:17:02.429 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101424 2024-09-12T16:17:02.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.429 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.429 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:02.430 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358196+0000", 2024-09-12T16:17:02.430 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011347 2024-09-12T16:17:02.430 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.430 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:02.430 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.430 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.430 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.430 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5626 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4739072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:02.430 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:17:02.430 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 22.113580921000001, 2024-09-12T16:17:02.430 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061802430999999998, 2024-09-12T16:17:02.430 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:02.430 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:02.431 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:02.431 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:02.431 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:02.431 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:02.431 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5626 2024-09-12T16:17:02.431 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.431 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:02.431 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.431 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:02.431 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:17:02.431 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.431 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.431 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.432 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:02.432 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:17:02.432 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.432 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.432 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.432 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:02.432 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296550+0000", 2024-09-12T16:17:02.432 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.215e-06 2024-09-12T16:17:02.432 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.432 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.432 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:02.432 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296555+0000", 2024-09-12T16:17:02.432 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9590000000000003e-06 2024-09-12T16:17:02.432 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.433 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.433 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:02.433 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296568+0000", 2024-09-12T16:17:02.433 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3338e-05 2024-09-12T16:17:02.433 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.433 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.433 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.433 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296576+0000", 2024-09-12T16:17:02.433 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5510000000000002e-06 2024-09-12T16:17:02.433 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.433 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.433 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:02.433 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358241+0000", 2024-09-12T16:17:02.433 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.06166576 2024-09-12T16:17:02.433 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.434 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.434 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:02.434 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358288+0000", 2024-09-12T16:17:02.434 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6097000000000003e-05 2024-09-12T16:17:02.434 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.434 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.434 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:02.434 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358351+0000", 2024-09-12T16:17:02.434 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3510999999999996e-05 2024-09-12T16:17:02.434 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.434 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:02.434 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.434 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.434 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.434 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5628 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4792320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:02.435 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:17:02.435 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 22.113538421000001, 2024-09-12T16:17:02.435 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061961161000000001, 2024-09-12T16:17:02.435 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:02.435 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:02.435 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:02.435 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:02.435 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:02.435 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:02.435 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5628 2024-09-12T16:17:02.435 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.435 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:02.435 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.435 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:02.435 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:17:02.436 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.436 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.436 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.436 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:02.436 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:17:02.436 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.436 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.436 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.436 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:02.436 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296592+0000", 2024-09-12T16:17:02.436 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2099999999999996e-07 2024-09-12T16:17:02.436 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.436 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.436 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:02.436 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296595+0000", 2024-09-12T16:17:02.437 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0429999999999999e-06 2024-09-12T16:17:02.437 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.437 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.437 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:02.437 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296603+0000", 2024-09-12T16:17:02.437 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9899999999999997e-06 2024-09-12T16:17:02.437 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.437 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.437 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.437 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296609+0000", 2024-09-12T16:17:02.437 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7259999999999999e-06 2024-09-12T16:17:02.437 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.437 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.437 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:02.438 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358393+0000", 2024-09-12T16:17:02.438 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061784617 2024-09-12T16:17:02.438 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.438 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.438 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:02.438 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358460+0000", 2024-09-12T16:17:02.438 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7253000000000001e-05 2024-09-12T16:17:02.438 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.438 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.438 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:02.438 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358552+0000", 2024-09-12T16:17:02.438 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1811000000000006e-05 2024-09-12T16:17:02.438 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.438 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:02.439 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.439 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.439 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.439 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5638 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4734976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:02.439 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:02.439 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 22.11306587, 2024-09-12T16:17:02.439 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061654460000000001, 2024-09-12T16:17:02.439 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:02.439 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:02.439 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:02.439 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:02.439 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:02.439 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:02.439 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5638 2024-09-12T16:17:02.439 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.440 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:02.440 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.440 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:02.440 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:02.440 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.440 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.440 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.440 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:02.440 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:02.440 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.440 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.440 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.440 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:02.440 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:02.441 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.23e-07 2024-09-12T16:17:02.441 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.441 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.441 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:02.441 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297068+0000", 2024-09-12T16:17:02.441 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0060000000000003e-06 2024-09-12T16:17:02.441 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.441 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.441 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:02.441 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297080+0000", 2024-09-12T16:17:02.441 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1234e-05 2024-09-12T16:17:02.441 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.441 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.441 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.442 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297095+0000", 2024-09-12T16:17:02.442 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5698000000000001e-05 2024-09-12T16:17:02.442 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.442 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.442 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:02.442 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358582+0000", 2024-09-12T16:17:02.442 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061486274 2024-09-12T16:17:02.442 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.442 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.442 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:02.442 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358637+0000", 2024-09-12T16:17:02.442 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5439999999999998e-05 2024-09-12T16:17:02.442 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.442 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.443 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:02.443 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358718+0000", 2024-09-12T16:17:02.443 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0984999999999998e-05 2024-09-12T16:17:02.443 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.443 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:02.443 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.443 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.443 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.443 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5640 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4780032~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:02.443 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:17:02.443 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 22.112984149999999, 2024-09-12T16:17:02.443 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061746620000000002, 2024-09-12T16:17:02.443 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:02.444 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:02.444 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:02.444 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:02.444 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:02.444 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:02.444 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5640 2024-09-12T16:17:02.444 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.444 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:02.444 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.444 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:02.444 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:17:02.444 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.444 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.445 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.445 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:02.445 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:17:02.445 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.445 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.445 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.445 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:02.445 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297146+0000", 2024-09-12T16:17:02.445 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3600000000000003e-07 2024-09-12T16:17:02.445 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.445 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.445 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:02.445 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297150+0000", 2024-09-12T16:17:02.446 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8430000000000003e-06 2024-09-12T16:17:02.446 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.446 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.446 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:02.446 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297160+0000", 2024-09-12T16:17:02.446 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7229999999999999e-06 2024-09-12T16:17:02.446 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.446 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.446 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.446 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297167+0000", 2024-09-12T16:17:02.446 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0180000000000004e-06 2024-09-12T16:17:02.446 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.446 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.446 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:02.447 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358750+0000", 2024-09-12T16:17:02.447 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061583104 2024-09-12T16:17:02.447 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.447 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.447 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:02.447 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358804+0000", 2024-09-12T16:17:02.447 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4277000000000002e-05 2024-09-12T16:17:02.447 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.447 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.447 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:02.447 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358892+0000", 2024-09-12T16:17:02.447 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7918999999999996e-05 2024-09-12T16:17:02.447 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.447 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:02.447 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.448 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.448 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.448 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5642 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4788224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:02.448 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:02.448 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 22.112939806, 2024-09-12T16:17:02.448 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061860409999999998, 2024-09-12T16:17:02.448 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:02.448 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:02.448 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:02.448 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:02.448 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:02.448 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:02.448 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5642 2024-09-12T16:17:02.448 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.449 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:02.449 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.449 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:02.449 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:02.449 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.449 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.449 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.449 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:02.449 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:02.449 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.449 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.449 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.449 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:02.449 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:02.450 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7999999999999995e-07 2024-09-12T16:17:02.450 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.450 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.450 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:02.450 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297193+0000", 2024-09-12T16:17:02.450 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8310000000000001e-06 2024-09-12T16:17:02.450 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.450 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.450 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:02.450 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297204+0000", 2024-09-12T16:17:02.450 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0832999999999999e-05 2024-09-12T16:17:02.450 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.450 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.450 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.450 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297210+0000", 2024-09-12T16:17:02.451 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1770000000000003e-06 2024-09-12T16:17:02.451 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.451 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.451 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:02.451 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358928+0000", 2024-09-12T16:17:02.451 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061717826000000003 2024-09-12T16:17:02.451 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.451 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.451 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:02.451 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358977+0000", 2024-09-12T16:17:02.451 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9514000000000001e-05 2024-09-12T16:17:02.451 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.451 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.451 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:02.452 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359050+0000", 2024-09-12T16:17:02.452 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2649000000000002e-05 2024-09-12T16:17:02.452 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.452 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:02.452 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.452 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.452 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.452 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5646 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4743168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:02.452 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:02.452 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 22.112759865000001, 2024-09-12T16:17:02.452 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061822122, 2024-09-12T16:17:02.452 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:02.452 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:02.453 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:02.453 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:02.453 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:02.453 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:02.453 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5646 2024-09-12T16:17:02.453 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.453 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:02.453 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.453 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:02.453 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:02.453 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.453 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.453 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.453 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:02.454 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:02.454 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.454 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.454 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.454 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:02.454 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:02.454 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3200000000000004e-07 2024-09-12T16:17:02.454 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.454 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.454 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:02.454 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297374+0000", 2024-09-12T16:17:02.454 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8240000000000001e-06 2024-09-12T16:17:02.454 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.455 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.455 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:02.455 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297384+0000", 2024-09-12T16:17:02.455 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5710000000000004e-06 2024-09-12T16:17:02.455 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.455 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.455 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.455 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297390+0000", 2024-09-12T16:17:02.455 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5130000000000002e-06 2024-09-12T16:17:02.455 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.455 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.455 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:02.455 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359080+0000", 2024-09-12T16:17:02.455 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061689569999999999 2024-09-12T16:17:02.456 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.456 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.456 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:02.456 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359134+0000", 2024-09-12T16:17:02.456 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3838999999999997e-05 2024-09-12T16:17:02.456 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.456 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.456 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:02.456 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359192+0000", 2024-09-12T16:17:02.456 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8072999999999998e-05 2024-09-12T16:17:02.456 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.456 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:02.456 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.457 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.457 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.457 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5647 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4751360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:02.457 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:17:02.457 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 22.11272318, 2024-09-12T16:17:02.457 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061927569000000002, 2024-09-12T16:17:02.457 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:02.457 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:02.457 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:02.457 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:02.457 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:02.457 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:02.457 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5647 2024-09-12T16:17:02.457 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.458 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:02.458 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.458 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:02.458 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:17:02.458 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.458 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.458 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.458 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:02.458 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:17:02.458 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.458 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.458 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.458 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:02.458 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297407+0000", 2024-09-12T16:17:02.458 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.46e-07 2024-09-12T16:17:02.459 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.459 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.459 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:02.459 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297409+0000", 2024-09-12T16:17:02.459 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.469e-06 2024-09-12T16:17:02.459 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.459 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.459 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:02.459 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297415+0000", 2024-09-12T16:17:02.459 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9259999999999997e-06 2024-09-12T16:17:02.459 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.459 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.459 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.459 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297419+0000", 2024-09-12T16:17:02.459 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3840000000000001e-06 2024-09-12T16:17:02.460 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.460 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.460 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:02.460 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359224+0000", 2024-09-12T16:17:02.460 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061805367999999999 2024-09-12T16:17:02.460 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.460 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.460 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:02.460 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359275+0000", 2024-09-12T16:17:02.460 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1338000000000002e-05 2024-09-12T16:17:02.460 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.460 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.460 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:02.460 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359334+0000", 2024-09-12T16:17:02.460 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8638000000000003e-05 2024-09-12T16:17:02.461 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.461 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:02.461 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.461 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.461 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.461 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5649 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4796416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:02.461 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:17:02.461 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 22.112668321000001, 2024-09-12T16:17:02.461 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.062018578999999997, 2024-09-12T16:17:02.461 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:02.461 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:02.461 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:02.461 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:02.461 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:02.462 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:02.462 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5649 2024-09-12T16:17:02.462 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.462 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:02.462 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.462 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:02.462 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:17:02.462 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.462 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.462 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.462 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:02.462 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:17:02.462 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.462 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.462 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.462 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:02.463 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297462+0000", 2024-09-12T16:17:02.463 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2399999999999998e-07 2024-09-12T16:17:02.463 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.463 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.463 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:02.463 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297465+0000", 2024-09-12T16:17:02.463 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.371e-06 2024-09-12T16:17:02.463 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.463 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.463 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:02.463 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297473+0000", 2024-09-12T16:17:02.463 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4699999999999996e-06 2024-09-12T16:17:02.463 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.463 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.463 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.464 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297478+0000", 2024-09-12T16:17:02.464 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2780000000000001e-06 2024-09-12T16:17:02.464 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.464 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.464 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:02.464 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359368+0000", 2024-09-12T16:17:02.464 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061889758000000003 2024-09-12T16:17:02.464 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.464 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.464 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:02.464 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359420+0000", 2024-09-12T16:17:02.464 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2574999999999997e-05 2024-09-12T16:17:02.464 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.464 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.465 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:02.465 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359480+0000", 2024-09-12T16:17:02.465 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9503000000000003e-05 2024-09-12T16:17:02.465 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.465 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:02.465 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.465 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.465 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.465 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5674 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4739072~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:02.465 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:17:02.465 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 22.112264552999999, 2024-09-12T16:17:02.465 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061762989999999997, 2024-09-12T16:17:02.465 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:02.466 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:02.466 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:02.466 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:02.466 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:02.466 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:02.466 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5674 2024-09-12T16:17:02.466 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.466 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:02.466 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.466 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:02.466 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:17:02.466 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.466 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.467 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.467 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:02.467 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:17:02.467 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.467 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.467 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.467 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:02.467 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297866+0000", 2024-09-12T16:17:02.467 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1900000000000001e-07 2024-09-12T16:17:02.467 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.467 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.467 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:02.467 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297870+0000", 2024-09-12T16:17:02.467 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3560000000000003e-06 2024-09-12T16:17:02.467 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.468 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.468 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:02.468 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297888+0000", 2024-09-12T16:17:02.468 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8088999999999999e-05 2024-09-12T16:17:02.468 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.468 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.468 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.468 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297904+0000", 2024-09-12T16:17:02.468 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5971e-05 2024-09-12T16:17:02.468 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.468 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.468 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:02.468 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359510+0000", 2024-09-12T16:17:02.469 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061605634999999999 2024-09-12T16:17:02.469 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.469 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.469 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:02.469 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359554+0000", 2024-09-12T16:17:02.469 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4024999999999999e-05 2024-09-12T16:17:02.469 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.469 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.469 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:02.469 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359628+0000", 2024-09-12T16:17:02.469 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4095000000000001e-05 2024-09-12T16:17:02.469 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.469 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:02.470 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.470 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.470 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.470 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5676 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4792320~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:02.470 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:17:02.470 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 22.112063472999999, 2024-09-12T16:17:02.470 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061720143999999998, 2024-09-12T16:17:02.470 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:02.470 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:02.470 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:02.470 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:02.470 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:02.470 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:02.470 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5676 2024-09-12T16:17:02.470 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.471 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:02.471 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.471 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:02.471 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:17:02.471 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.471 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.471 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.471 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:02.471 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:17:02.471 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.471 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.471 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.471 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:02.472 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298067+0000", 2024-09-12T16:17:02.472 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8199999999999999e-07 2024-09-12T16:17:02.472 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.472 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.472 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:02.472 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298070+0000", 2024-09-12T16:17:02.472 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.743e-06 2024-09-12T16:17:02.472 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.472 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.472 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:02.472 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298080+0000", 2024-09-12T16:17:02.472 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4059999999999994e-06 2024-09-12T16:17:02.472 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.472 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.473 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.473 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298088+0000", 2024-09-12T16:17:02.473 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0779999999999996e-06 2024-09-12T16:17:02.473 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.473 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.473 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:02.473 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359659+0000", 2024-09-12T16:17:02.473 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061570688999999998 2024-09-12T16:17:02.473 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.473 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.473 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:02.473 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359713+0000", 2024-09-12T16:17:02.473 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3939e-05 2024-09-12T16:17:02.473 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.473 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.473 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:02.474 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359786+0000", 2024-09-12T16:17:02.474 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3607000000000002e-05 2024-09-12T16:17:02.474 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.474 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:02.474 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.474 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.474 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.474 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5684 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4747264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:02.474 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:17:02.474 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 22.111596180999999, 2024-09-12T16:17:02.474 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061394799, 2024-09-12T16:17:02.474 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:02.474 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:02.474 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:02.474 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:02.475 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:02.475 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:02.475 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5684 2024-09-12T16:17:02.475 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.475 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:02.475 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.475 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:02.475 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:17:02.475 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.475 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.475 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.475 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:02.475 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:17:02.475 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.475 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.476 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.476 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:02.476 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298534+0000", 2024-09-12T16:17:02.476 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4399999999999999e-07 2024-09-12T16:17:02.476 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.476 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.476 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:02.476 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298539+0000", 2024-09-12T16:17:02.476 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5360000000000003e-06 2024-09-12T16:17:02.476 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.476 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.476 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:02.476 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298550+0000", 2024-09-12T16:17:02.476 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1499e-05 2024-09-12T16:17:02.476 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.476 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.477 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.477 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298558+0000", 2024-09-12T16:17:02.477 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3000000000000004e-06 2024-09-12T16:17:02.477 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.477 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.477 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:02.477 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359815+0000", 2024-09-12T16:17:02.477 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061257952999999997 2024-09-12T16:17:02.477 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.477 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.477 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:02.477 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359868+0000", 2024-09-12T16:17:02.477 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2317000000000001e-05 2024-09-12T16:17:02.477 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.478 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.478 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:02.478 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359928+0000", 2024-09-12T16:17:02.478 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0350000000000003e-05 2024-09-12T16:17:02.478 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.478 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:02.478 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.478 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.478 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.478 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5686 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4755456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:02.478 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:17:02.478 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 22.111428756999999, 2024-09-12T16:17:02.478 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061355082999999998, 2024-09-12T16:17:02.478 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:02.478 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:02.479 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:02.479 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:02.479 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:02.479 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:02.479 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5686 2024-09-12T16:17:02.479 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.479 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:02.479 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.479 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:02.479 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:17:02.479 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.479 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.479 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.479 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:02.480 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:17:02.480 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.480 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.480 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.480 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:02.480 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298702+0000", 2024-09-12T16:17:02.480 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2399999999999997e-07 2024-09-12T16:17:02.480 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.480 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.480 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:02.480 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298706+0000", 2024-09-12T16:17:02.480 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5700000000000003e-06 2024-09-12T16:17:02.480 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.480 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.480 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:02.481 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298718+0000", 2024-09-12T16:17:02.481 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1457999999999999e-05 2024-09-12T16:17:02.481 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.481 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.481 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.481 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298732+0000", 2024-09-12T16:17:02.481 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.452e-05 2024-09-12T16:17:02.481 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.481 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.481 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:02.481 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359956+0000", 2024-09-12T16:17:02.481 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061223626000000003 2024-09-12T16:17:02.481 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.481 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.482 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:02.482 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360000+0000", 2024-09-12T16:17:02.482 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3922999999999999e-05 2024-09-12T16:17:02.482 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.482 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.482 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:02.482 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360056+0000", 2024-09-12T16:17:02.482 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6162000000000002e-05 2024-09-12T16:17:02.482 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.482 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:02.482 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.482 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.482 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.482 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5688 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4800512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:02.482 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:17:02.482 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 22.111205704, 2024-09-12T16:17:02.483 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061270514999999998, 2024-09-12T16:17:02.483 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:02.483 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:02.483 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:02.483 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:02.483 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:02.483 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:02.483 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5688 2024-09-12T16:17:02.483 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.483 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:02.483 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.483 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:02.483 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:17:02.483 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.484 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.484 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.484 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:02.484 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:17:02.484 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.484 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.484 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.484 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:02.484 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298925+0000", 2024-09-12T16:17:02.484 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4e-07 2024-09-12T16:17:02.484 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.484 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.484 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:02.485 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298929+0000", 2024-09-12T16:17:02.485 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9890000000000003e-06 2024-09-12T16:17:02.485 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.485 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.485 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:02.485 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298936+0000", 2024-09-12T16:17:02.485 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.52e-06 2024-09-12T16:17:02.485 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.485 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.485 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.485 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298941+0000", 2024-09-12T16:17:02.485 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4800000000000003e-06 2024-09-12T16:17:02.485 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.485 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.486 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:02.486 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360087+0000", 2024-09-12T16:17:02.486 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061146143 2024-09-12T16:17:02.486 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.486 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.486 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:02.486 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360137+0000", 2024-09-12T16:17:02.486 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0584000000000002e-05 2024-09-12T16:17:02.486 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.486 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.486 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:02.486 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360194+0000", 2024-09-12T16:17:02.486 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6858999999999999e-05 2024-09-12T16:17:02.487 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.487 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:02.487 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.487 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.487 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.487 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5693 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4751360~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:02.487 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:17:02.487 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 22.110784067000001, 2024-09-12T16:17:02.487 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061139444000000001, 2024-09-12T16:17:02.487 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:02.487 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:02.487 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:02.487 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:02.487 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:02.488 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:02.488 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5693 2024-09-12T16:17:02.488 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.488 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:02.488 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.488 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:02.488 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:17:02.488 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.488 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.488 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.488 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:02.488 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:17:02.489 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.489 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.489 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.489 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:02.489 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299346+0000", 2024-09-12T16:17:02.489 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2300000000000001e-07 2024-09-12T16:17:02.489 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.489 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.489 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:02.489 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299349+0000", 2024-09-12T16:17:02.489 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5270000000000001e-06 2024-09-12T16:17:02.489 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.489 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.490 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:02.490 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299358+0000", 2024-09-12T16:17:02.490 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7030000000000001e-06 2024-09-12T16:17:02.490 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.490 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.490 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.490 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299364+0000", 2024-09-12T16:17:02.490 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7239999999999997e-06 2024-09-12T16:17:02.490 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.490 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.490 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:02.490 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360369+0000", 2024-09-12T16:17:02.490 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061004713000000002 2024-09-12T16:17:02.490 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.490 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.491 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:02.491 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360415+0000", 2024-09-12T16:17:02.491 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5926e-05 2024-09-12T16:17:02.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.491 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.491 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:02.491 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360485+0000", 2024-09-12T16:17:02.491 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0327999999999995e-05 2024-09-12T16:17:02.491 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.491 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:02.491 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.491 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.491 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5694 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4796416~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:02.492 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:17:02.492 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 22.110755038000001, 2024-09-12T16:17:02.492 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061258034000000003, 2024-09-12T16:17:02.492 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:02.492 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:02.492 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:02.492 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:02.492 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:02.492 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:02.492 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5694 2024-09-12T16:17:02.492 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.492 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:02.492 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.492 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:02.493 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:17:02.493 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.493 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.493 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.493 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:02.493 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:17:02.493 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.493 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.493 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.493 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:02.493 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301884+0000", 2024-09-12T16:17:02.493 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025090379999999999 2024-09-12T16:17:02.493 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.493 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.494 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:02.494 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301889+0000", 2024-09-12T16:17:02.494 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5879999999999997e-06 2024-09-12T16:17:02.494 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.494 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.494 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:02.494 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301901+0000", 2024-09-12T16:17:02.494 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1466e-05 2024-09-12T16:17:02.494 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.494 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.494 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.494 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301908+0000", 2024-09-12T16:17:02.494 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1999999999999997e-06 2024-09-12T16:17:02.494 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.495 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.495 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:02.495 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360513+0000", 2024-09-12T16:17:02.495 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.058605023999999999 2024-09-12T16:17:02.495 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.495 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.495 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:02.495 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360562+0000", 2024-09-12T16:17:02.495 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9546000000000003e-05 2024-09-12T16:17:02.495 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.495 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.495 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:02.495 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360633+0000", 2024-09-12T16:17:02.495 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0172000000000005e-05 2024-09-12T16:17:02.496 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.496 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:02.496 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.496 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.496 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.496 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5759 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4767744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:02.496 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:17:02.496 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 22.107961503999999, 2024-09-12T16:17:02.496 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061058604000000002, 2024-09-12T16:17:02.496 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:02.496 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:02.496 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:02.496 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:02.497 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:02.497 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:02.497 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5759 2024-09-12T16:17:02.497 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.497 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:02.497 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.497 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:02.497 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:17:02.497 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.497 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.497 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.497 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:02.497 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:17:02.497 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:02.498 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.498 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.498 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:02.498 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302548+0000", 2024-09-12T16:17:02.498 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00038011000000000002 2024-09-12T16:17:02.498 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.498 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.498 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:02.498 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302553+0000", 2024-09-12T16:17:02.498 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1830000000000002e-06 2024-09-12T16:17:02.498 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.498 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.498 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:02.498 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302564+0000", 2024-09-12T16:17:02.499 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1011e-05 2024-09-12T16:17:02.499 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.499 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.499 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.499 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302572+0000", 2024-09-12T16:17:02.499 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9009999999999994e-06 2024-09-12T16:17:02.499 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.499 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.499 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:02.499 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363102+0000", 2024-09-12T16:17:02.499 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.060529782999999997 2024-09-12T16:17:02.499 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.499 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.499 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:02.499 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363149+0000", 2024-09-12T16:17:02.500 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7321000000000003e-05 2024-09-12T16:17:02.500 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:02.500 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:02.500 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:02.500 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363227+0000", 2024-09-12T16:17:02.500 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7294999999999998e-05 2024-09-12T16:17:02.500 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.500 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:02.500 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.500 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:02.500 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:02.500 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:02.502 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:02.501+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:02.502 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:17:02.603 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:02.603+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:02.618 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:02.618 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:02.618 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:17:02.618 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:02.627 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:17:02.703 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:02.702+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:02.720 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #19, image image_client.0-clone19 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent20 2024-09-12T16:17:02.738 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:02.738 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:02.738 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:17:02.739 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:17:02.739 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:02.748 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:17:02.803 INFO:teuthology.orchestra.run.smithi204.stdout:3363 read 0x927000 thru 0x9317ca (0xa7cb bytes) 2024-09-12T16:17:02.804 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:02.803+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:02.804 INFO:teuthology.orchestra.run.smithi204.stdout:3368 punch from 0x187a200 to 0x1886a00, (0xc800 bytes) 2024-09-12T16:17:02.813 INFO:teuthology.orchestra.run.smithi204.stdout:3369 punch from 0x2ec2e00 to 0x2ec7800, (0x4a00 bytes) 2024-09-12T16:17:02.816 INFO:teuthology.orchestra.run.smithi204.stdout:3370 read 0xa1e400 thru 0xa26264 (0x7e65 bytes) 2024-09-12T16:17:02.816 INFO:teuthology.orchestra.run.smithi204.stdout:3371 write 0x267ba00 thru 0x267ba5f (0x60 bytes) 2024-09-12T16:17:02.817 INFO:teuthology.orchestra.run.smithi204.stdout:3373 write 0x2a94a00 thru 0x2a96820 (0x1e21 bytes) 2024-09-12T16:17:02.819 INFO:teuthology.orchestra.run.smithi204.stdout:3376 trunc from 0x3ab5e00 to 0x2851e00 2024-09-12T16:17:02.862 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:02.862 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:17:02.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:17:02.862 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:17:02.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.862 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3703 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14803968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:02.862 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139513+0000", 2024-09-12T16:17:02.862 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.720663672000001, 2024-09-12T16:17:02.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053248794000000002, 2024-09-12T16:17:02.862 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3703 2024-09-12T16:17:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139513+0000", 2024-09-12T16:17:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:02.864 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139513+0000", 2024-09-12T16:17:02.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.864 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:02.864 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139639+0000", 2024-09-12T16:17:02.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012673299999999999 2024-09-12T16:17:02.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.864 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:02.864 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139642+0000", 2024-09-12T16:17:02.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4820000000000001e-06 2024-09-12T16:17:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139647+0000", 2024-09-12T16:17:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8040000000000001e-06 2024-09-12T16:17:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139650+0000", 2024-09-12T16:17:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.529e-06 2024-09-12T16:17:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192537+0000", 2024-09-12T16:17:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052886503000000001 2024-09-12T16:17:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192627+0000", 2024-09-12T16:17:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0183e-05 2024-09-12T16:17:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192761+0000", 2024-09-12T16:17:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013456000000000001 2024-09-12T16:17:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3705 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14812160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:17:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.720371419999999, 2024-09-12T16:17:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053368831999999998, 2024-09-12T16:17:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:02.868 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3705 2024-09-12T16:17:02.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.868 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:02.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.868 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:02.868 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:17:02.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.868 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:02.868 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:17:02.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139932+0000", 2024-09-12T16:17:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012762099999999999 2024-09-12T16:17:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139935+0000", 2024-09-12T16:17:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.119e-06 2024-09-12T16:17:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139939+0000", 2024-09-12T16:17:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7999999999999998e-06 2024-09-12T16:17:02.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.870 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139953+0000", 2024-09-12T16:17:02.870 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3923999999999999e-05 2024-09-12T16:17:02.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:02.870 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192946+0000", 2024-09-12T16:17:02.870 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052992971 2024-09-12T16:17:02.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193035+0000", 2024-09-12T16:17:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9040000000000001e-05 2024-09-12T16:17:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193174+0000", 2024-09-12T16:17:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138357 2024-09-12T16:17:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3706 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14816256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:17:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.720216430000001, 2024-09-12T16:17:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053341723000000001, 2024-09-12T16:17:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3706 2024-09-12T16:17:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:17:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:17:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140090+0000", 2024-09-12T16:17:02.874 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013020100000000001 2024-09-12T16:17:02.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.874 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:02.874 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140097+0000", 2024-09-12T16:17:02.874 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0709999999999997e-06 2024-09-12T16:17:02.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.874 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:02.874 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140103+0000", 2024-09-12T16:17:02.874 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5450000000000003e-06 2024-09-12T16:17:02.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140106+0000", 2024-09-12T16:17:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3739999999999998e-06 2024-09-12T16:17:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193190+0000", 2024-09-12T16:17:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053084131999999999 2024-09-12T16:17:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193232+0000", 2024-09-12T16:17:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1517000000000002e-05 2024-09-12T16:17:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193302+0000", 2024-09-12T16:17:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9882999999999995e-05 2024-09-12T16:17:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3707 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14820352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:17:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.720064440999998, 2024-09-12T16:17:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053452771000000003, 2024-09-12T16:17:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:02.877 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:02.877 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:02.877 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:02.877 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3707 2024-09-12T16:17:02.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.877 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:02.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.877 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:02.877 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:17:02.877 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.878 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:02.878 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:17:02.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.878 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:02.878 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140219+0000", 2024-09-12T16:17:02.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106902 2024-09-12T16:17:02.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.878 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:02.878 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140225+0000", 2024-09-12T16:17:02.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3199999999999996e-06 2024-09-12T16:17:02.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.879 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:02.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140230+0000", 2024-09-12T16:17:02.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8969999999999999e-06 2024-09-12T16:17:02.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.879 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140233+0000", 2024-09-12T16:17:02.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2119999999999999e-06 2024-09-12T16:17:02.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.879 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:02.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193339+0000", 2024-09-12T16:17:02.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053105556999999998 2024-09-12T16:17:02.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:02.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193431+0000", 2024-09-12T16:17:02.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1837999999999997e-05 2024-09-12T16:17:02.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:02.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193565+0000", 2024-09-12T16:17:02.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013404500000000001 2024-09-12T16:17:02.880 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.881 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:02.881 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.881 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3708 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14824448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:02.881 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:17:02.881 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.719935599000003, 2024-09-12T16:17:02.881 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053468190999999998, 2024-09-12T16:17:02.881 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:02.881 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:02.881 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:02.881 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:02.881 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:02.881 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:02.882 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3708 2024-09-12T16:17:02.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.882 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:02.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.882 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:02.882 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:17:02.882 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.882 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:02.882 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:17:02.882 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.883 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:02.883 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140351+0000", 2024-09-12T16:17:02.883 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110096 2024-09-12T16:17:02.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.883 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:02.883 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140358+0000", 2024-09-12T16:17:02.883 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.306e-06 2024-09-12T16:17:02.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.884 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:02.884 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140368+0000", 2024-09-12T16:17:02.884 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0225e-05 2024-09-12T16:17:02.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.884 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.884 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140372+0000", 2024-09-12T16:17:02.884 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6169999999999998e-06 2024-09-12T16:17:02.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.884 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:02.884 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193594+0000", 2024-09-12T16:17:02.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053222419999999999 2024-09-12T16:17:02.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.885 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:02.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193640+0000", 2024-09-12T16:17:02.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.587e-05 2024-09-12T16:17:02.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.885 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:02.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193709+0000", 2024-09-12T16:17:02.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8657000000000004e-05 2024-09-12T16:17:02.886 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.886 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:02.886 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.886 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3709 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14828544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:02.886 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:17:02.886 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.719798631000003, 2024-09-12T16:17:02.886 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594033999999999, 2024-09-12T16:17:02.886 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:02.886 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:02.886 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:02.887 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:02.887 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:02.887 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:02.887 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3709 2024-09-12T16:17:02.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.887 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:02.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.887 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:02.887 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:17:02.887 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.887 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:02.888 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:17:02.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.888 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:02.888 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140499+0000", 2024-09-12T16:17:02.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121019 2024-09-12T16:17:02.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.888 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:02.888 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140501+0000", 2024-09-12T16:17:02.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2369999999999999e-06 2024-09-12T16:17:02.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:02.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140506+0000", 2024-09-12T16:17:02.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.639e-06 2024-09-12T16:17:02.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140509+0000", 2024-09-12T16:17:02.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3419999999999999e-06 2024-09-12T16:17:02.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:02.890 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193743+0000", 2024-09-12T16:17:02.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053234311999999999 2024-09-12T16:17:02.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.890 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:02.890 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193833+0000", 2024-09-12T16:17:02.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9883999999999995e-05 2024-09-12T16:17:02.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.890 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:02.890 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193972+0000", 2024-09-12T16:17:02.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138601 2024-09-12T16:17:02.891 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.891 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:02.891 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.891 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3710 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14832640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:02.891 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:17:02.891 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.719661285000001, 2024-09-12T16:17:02.891 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053607324999999997, 2024-09-12T16:17:02.891 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:02.891 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:02.891 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:02.891 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:02.891 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:02.892 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:02.892 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3710 2024-09-12T16:17:02.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.892 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:02.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.892 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:02.892 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:17:02.892 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.892 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:02.892 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:17:02.892 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.893 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:02.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140664+0000", 2024-09-12T16:17:02.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014918700000000001 2024-09-12T16:17:02.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.893 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:02.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140674+0000", 2024-09-12T16:17:02.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8379999999999997e-06 2024-09-12T16:17:02.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.893 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:02.894 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140694+0000", 2024-09-12T16:17:02.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0145000000000001e-05 2024-09-12T16:17:02.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.894 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.894 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140703+0000", 2024-09-12T16:17:02.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5150000000000006e-06 2024-09-12T16:17:02.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.894 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:02.894 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194006+0000", 2024-09-12T16:17:02.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053303370000000003 2024-09-12T16:17:02.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.895 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:02.895 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194051+0000", 2024-09-12T16:17:02.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5012000000000002e-05 2024-09-12T16:17:02.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.895 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:02.895 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194122+0000", 2024-09-12T16:17:02.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1258000000000001e-05 2024-09-12T16:17:02.895 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.895 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:02.895 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.896 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3711 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14836736~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:02.896 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:17:02.896 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.719459837000002, 2024-09-12T16:17:02.896 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053670799999999998, 2024-09-12T16:17:02.896 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:02.896 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:02.896 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:02.896 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:02.896 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:02.896 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:02.896 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3711 2024-09-12T16:17:02.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.897 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:02.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.897 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:02.897 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:17:02.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.897 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:02.897 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:17:02.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:02.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140782+0000", 2024-09-12T16:17:02.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5549999999999994e-05 2024-09-12T16:17:02.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:02.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140786+0000", 2024-09-12T16:17:02.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.89e-06 2024-09-12T16:17:02.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:02.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140796+0000", 2024-09-12T16:17:02.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0057e-05 2024-09-12T16:17:02.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.899 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140819+0000", 2024-09-12T16:17:02.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3005000000000001e-05 2024-09-12T16:17:02.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:02.899 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194159+0000", 2024-09-12T16:17:02.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053340324000000001 2024-09-12T16:17:02.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:02.900 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194248+0000", 2024-09-12T16:17:02.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9209000000000006e-05 2024-09-12T16:17:02.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.900 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:02.900 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194387+0000", 2024-09-12T16:17:02.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138765 2024-09-12T16:17:02.900 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.900 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:02.900 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.900 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3712 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14840832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:02.901 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:17:02.901 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.719345379000004, 2024-09-12T16:17:02.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053699068000000003, 2024-09-12T16:17:02.901 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:02.901 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:02.901 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:02.901 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:02.901 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:02.901 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:02.901 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3712 2024-09-12T16:17:02.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.901 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:02.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:02.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:17:02.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:02.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:17:02.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:02.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140900+0000", 2024-09-12T16:17:02.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9014e-05 2024-09-12T16:17:02.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:02.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140904+0000", 2024-09-12T16:17:02.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0940000000000001e-06 2024-09-12T16:17:02.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:02.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140933+0000", 2024-09-12T16:17:02.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8996000000000002e-05 2024-09-12T16:17:02.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140945+0000", 2024-09-12T16:17:02.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1909000000000001e-05 2024-09-12T16:17:02.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:02.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194415+0000", 2024-09-12T16:17:02.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053470403 2024-09-12T16:17:02.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:02.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194460+0000", 2024-09-12T16:17:02.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5145000000000002e-05 2024-09-12T16:17:02.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.905 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:02.905 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194530+0000", 2024-09-12T16:17:02.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9506999999999997e-05 2024-09-12T16:17:02.905 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.905 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:02.905 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.905 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3713 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14844928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:02.905 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:17:02.905 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.719212319, 2024-09-12T16:17:02.906 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053821236000000001, 2024-09-12T16:17:02.906 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:02.906 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:02.906 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:02.906 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:02.906 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:02.906 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:02.906 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3713 2024-09-12T16:17:02.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.906 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:02.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.906 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:02.906 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:17:02.906 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:02.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:17:02.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:02.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141078+0000", 2024-09-12T16:17:02.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114162 2024-09-12T16:17:02.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:02.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141090+0000", 2024-09-12T16:17:02.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.19e-05 2024-09-12T16:17:02.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:02.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141100+0000", 2024-09-12T16:17:02.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0447e-05 2024-09-12T16:17:02.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141108+0000", 2024-09-12T16:17:02.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7190000000000001e-06 2024-09-12T16:17:02.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:02.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194564+0000", 2024-09-12T16:17:02.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053455729 2024-09-12T16:17:02.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:02.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194652+0000", 2024-09-12T16:17:02.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8288999999999994e-05 2024-09-12T16:17:02.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:02.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194785+0000", 2024-09-12T16:17:02.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013299000000000001 2024-09-12T16:17:02.910 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.910 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:02.910 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.910 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3714 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14849024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:02.910 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:17:02.910 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.719056389999999, 2024-09-12T16:17:02.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053816382000000003, 2024-09-12T16:17:02.910 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:02.910 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:02.911 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:02.911 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:02.911 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:02.911 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:02.911 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3714 2024-09-12T16:17:02.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.911 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:02.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:02.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:17:02.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:02.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:17:02.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:02.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141182+0000", 2024-09-12T16:17:02.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1805999999999997e-05 2024-09-12T16:17:02.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:02.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141185+0000", 2024-09-12T16:17:02.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5930000000000002e-06 2024-09-12T16:17:02.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.913 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:02.913 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141194+0000", 2024-09-12T16:17:02.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5760000000000006e-06 2024-09-12T16:17:02.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.913 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.913 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141222+0000", 2024-09-12T16:17:02.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8034999999999998e-05 2024-09-12T16:17:02.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.914 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:02.914 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194817+0000", 2024-09-12T16:17:02.914 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594887000000001 2024-09-12T16:17:02.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.914 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:02.914 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194860+0000", 2024-09-12T16:17:02.914 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3714999999999997e-05 2024-09-12T16:17:02.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.914 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:02.914 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194936+0000", 2024-09-12T16:17:02.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5770000000000001e-05 2024-09-12T16:17:02.915 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.915 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:02.915 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.915 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3715 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14853120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:02.915 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:17:02.915 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.718932733000003, 2024-09-12T16:17:02.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053962307000000001, 2024-09-12T16:17:02.915 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:02.915 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:02.915 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:02.915 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:02.916 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:02.916 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:02.916 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3715 2024-09-12T16:17:02.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.916 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:02.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:02.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:17:02.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:02.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:17:02.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:02.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141417+0000", 2024-09-12T16:17:02.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017384099999999999 2024-09-12T16:17:02.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:02.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141422+0000", 2024-09-12T16:17:02.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7310000000000001e-06 2024-09-12T16:17:02.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:02.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141434+0000", 2024-09-12T16:17:02.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2058e-05 2024-09-12T16:17:02.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141442+0000", 2024-09-12T16:17:02.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7610000000000007e-06 2024-09-12T16:17:02.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:02.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194973+0000", 2024-09-12T16:17:02.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053530618000000002 2024-09-12T16:17:02.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.919 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:02.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195063+0000", 2024-09-12T16:17:02.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0927000000000005e-05 2024-09-12T16:17:02.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.919 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:02.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195206+0000", 2024-09-12T16:17:02.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142371 2024-09-12T16:17:02.919 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.919 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:02.919 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.920 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3716 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14857216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:02.920 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:17:02.920 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.718722882999998, 2024-09-12T16:17:02.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053916360000000003, 2024-09-12T16:17:02.920 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:02.920 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:02.920 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:02.920 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:02.920 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:02.920 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:02.920 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3716 2024-09-12T16:17:02.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.920 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:02.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:02.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:17:02.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:02.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:17:02.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:02.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142933+0000", 2024-09-12T16:17:02.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014796290000000001 2024-09-12T16:17:02.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:02.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142937+0000", 2024-09-12T16:17:02.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5760000000000002e-06 2024-09-12T16:17:02.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:02.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142946+0000", 2024-09-12T16:17:02.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0380000000000005e-06 2024-09-12T16:17:02.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142951+0000", 2024-09-12T16:17:02.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9749999999999998e-06 2024-09-12T16:17:02.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:02.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195246+0000", 2024-09-12T16:17:02.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052295358 2024-09-12T16:17:02.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:02.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195299+0000", 2024-09-12T16:17:02.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2976999999999998e-05 2024-09-12T16:17:02.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:02.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195370+0000", 2024-09-12T16:17:02.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0807000000000002e-05 2024-09-12T16:17:02.924 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.924 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:02.924 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.924 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3721 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14877696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:02.924 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:02.924 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.717149431999999, 2024-09-12T16:17:02.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053422994000000001, 2024-09-12T16:17:02.924 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:02.924 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:02.924 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:02.924 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:02.925 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:02.925 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:02.925 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3721 2024-09-12T16:17:02.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.925 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:02.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:02.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:02.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:02.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:02.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:02.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:02.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:17:02.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:02.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143028+0000", 2024-09-12T16:17:02.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7399999999999991e-07 2024-09-12T16:17:02.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:02.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143031+0000", 2024-09-12T16:17:02.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7599999999999998e-06 2024-09-12T16:17:02.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143034+0000", 2024-09-12T16:17:02.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9780000000000001e-06 2024-09-12T16:17:02.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:02.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196220+0000", 2024-09-12T16:17:02.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053186341999999998 2024-09-12T16:17:02.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:02.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196313+0000", 2024-09-12T16:17:02.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2676000000000005e-05 2024-09-12T16:17:02.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.928 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:02.928 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196450+0000", 2024-09-12T16:17:02.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137052 2024-09-12T16:17:02.928 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.928 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:02.928 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.928 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3722 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14881792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:02.928 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:02.928 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.717139539999998, 2024-09-12T16:17:02.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053556835999999997, 2024-09-12T16:17:02.929 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:02.929 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:02.929 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:02.929 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:02.929 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:02.929 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:02.929 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3722 2024-09-12T16:17:02.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.929 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:02.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.929 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:02.929 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:02.929 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:02.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:02.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:02.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:02.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.11e-07 2024-09-12T16:17:02.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:02.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143038+0000", 2024-09-12T16:17:02.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2399999999999996e-07 2024-09-12T16:17:02.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:02.931 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143041+0000", 2024-09-12T16:17:02.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8030000000000001e-06 2024-09-12T16:17:02.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.931 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143043+0000", 2024-09-12T16:17:02.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3140000000000002e-06 2024-09-12T16:17:02.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:02.931 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196481+0000", 2024-09-12T16:17:02.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053437601000000001 2024-09-12T16:17:02.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.932 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:02.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196525+0000", 2024-09-12T16:17:02.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4280000000000003e-05 2024-09-12T16:17:02.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.932 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:02.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196594+0000", 2024-09-12T16:17:02.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8702999999999996e-05 2024-09-12T16:17:02.932 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.932 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:02.932 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.933 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3723 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14885888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:02.933 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:17:02.933 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.717130357999999, 2024-09-12T16:17:02.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053815546999999998, 2024-09-12T16:17:02.933 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:02.933 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:02.933 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:02.933 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:02.933 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:02.933 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:02.933 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3723 2024-09-12T16:17:02.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.933 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:02.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:02.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:17:02.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:02.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:17:02.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:02.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148994+0000", 2024-09-12T16:17:02.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059481330000000004 2024-09-12T16:17:02.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.935 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:02.935 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148999+0000", 2024-09-12T16:17:02.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7140000000000001e-06 2024-09-12T16:17:02.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.935 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:02.935 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149008+0000", 2024-09-12T16:17:02.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4350000000000003e-06 2024-09-12T16:17:02.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.935 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.936 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149021+0000", 2024-09-12T16:17:02.936 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2514000000000001e-05 2024-09-12T16:17:02.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.936 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:02.936 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196630+0000", 2024-09-12T16:17:02.936 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047609758000000002 2024-09-12T16:17:02.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.936 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:02.936 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196724+0000", 2024-09-12T16:17:02.936 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3522000000000003e-05 2024-09-12T16:17:02.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:02.937 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196861+0000", 2024-09-12T16:17:02.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013747100000000001 2024-09-12T16:17:02.937 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.937 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:02.937 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.937 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4438 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15719424~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:02.937 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:02.937 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.572249581000001, 2024-09-12T16:17:02.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367981000000002, 2024-09-12T16:17:02.937 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:02.937 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:02.938 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:02.938 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:02.938 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:02.938 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:02.938 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4438 2024-09-12T16:17:02.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.938 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:02.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:02.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:02.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:02.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:02.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:02.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:02.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3e-07 2024-09-12T16:17:02.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:02.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287930+0000", 2024-09-12T16:17:02.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-12T16:17:02.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:02.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287937+0000", 2024-09-12T16:17:02.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.08e-06 2024-09-12T16:17:02.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.940 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287943+0000", 2024-09-12T16:17:02.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5709999999999997e-06 2024-09-12T16:17:02.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:02.940 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341068+0000", 2024-09-12T16:17:02.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053125101000000001 2024-09-12T16:17:02.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:02.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341154+0000", 2024-09-12T16:17:02.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6100999999999994e-05 2024-09-12T16:17:02.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.941 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:02.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341295+0000", 2024-09-12T16:17:02.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014087999999999999 2024-09-12T16:17:02.941 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.941 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:02.941 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.941 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4439 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15723520~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:02.941 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:02.942 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.572225420999999, 2024-09-12T16:17:02.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053526799, 2024-09-12T16:17:02.942 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:02.942 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:02.942 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:02.942 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:02.942 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:02.942 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:02.942 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4439 2024-09-12T16:17:02.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.942 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:02.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.942 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:02.942 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:02.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:02.943 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:02.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:02.943 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:02.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-07 2024-09-12T16:17:02.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:02.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287953+0000", 2024-09-12T16:17:02.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1349999999999999e-06 2024-09-12T16:17:02.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:02.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287960+0000", 2024-09-12T16:17:02.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-12T16:17:02.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287965+0000", 2024-09-12T16:17:02.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1580000000000004e-06 2024-09-12T16:17:02.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:02.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341332+0000", 2024-09-12T16:17:02.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367009 2024-09-12T16:17:02.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:02.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341402+0000", 2024-09-12T16:17:02.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9759999999999996e-05 2024-09-12T16:17:02.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:02.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341478+0000", 2024-09-12T16:17:02.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5412000000000002e-05 2024-09-12T16:17:02.946 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.946 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:02.946 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.946 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4440 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15727616~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:02.946 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:02.946 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.572204317000001, 2024-09-12T16:17:02.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053761601999999999, 2024-09-12T16:17:02.946 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:02.946 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:02.946 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:02.946 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:02.947 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:02.947 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:02.947 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4440 2024-09-12T16:17:02.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.947 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:02.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:02.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:02.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:02.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:02.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:02.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:02.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:17:02.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:02.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287974+0000", 2024-09-12T16:17:02.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0540000000000002e-06 2024-09-12T16:17:02.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:02.949 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287980+0000", 2024-09-12T16:17:02.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9440000000000002e-06 2024-09-12T16:17:02.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.949 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287987+0000", 2024-09-12T16:17:02.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5889999999999999e-06 2024-09-12T16:17:02.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:02.949 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341502+0000", 2024-09-12T16:17:02.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053515199999999999 2024-09-12T16:17:02.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:02.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341595+0000", 2024-09-12T16:17:02.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3097000000000007e-05 2024-09-12T16:17:02.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:02.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341734+0000", 2024-09-12T16:17:02.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013832800000000001 2024-09-12T16:17:02.950 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.950 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:02.950 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.951 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2209 3.1 3:85f36d3b:::rbd_data.1155ccb1894c.0000000000000004:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:02.951 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:17:02.951 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.4885191789999999, 2024-09-12T16:17:02.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.060659365, 2024-09-12T16:17:02.951 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:02.951 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:02.951 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:02.951 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:02.951 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:17:02.951 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:17:02.951 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2209 2024-09-12T16:17:02.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.951 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:02.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.951 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:02.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:17:02.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:02.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:17:02.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:02.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:02.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371658+0000", 2024-09-12T16:17:02.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1570000000000001e-06 2024-09-12T16:17:02.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:02.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393414+0000", 2024-09-12T16:17:02.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021755495999999999 2024-09-12T16:17:02.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:02.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393447+0000", 2024-09-12T16:17:02.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3630000000000002e-05 2024-09-12T16:17:02.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:02.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393462+0000", 2024-09-12T16:17:02.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5048999999999999e-05 2024-09-12T16:17:02.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:02.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393556+0000", 2024-09-12T16:17:02.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3549999999999997e-05 2024-09-12T16:17:02.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:02.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393697+0000", 2024-09-12T16:17:02.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000141414 2024-09-12T16:17:02.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T16:17:02.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.394944+0000", 2024-09-12T16:17:02.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012463039999999999 2024-09-12T16:17:02.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:02.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.431803+0000", 2024-09-12T16:17:02.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0368594 2024-09-12T16:17:02.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:17:02.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432268+0000", 2024-09-12T16:17:02.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046457600000000002 2024-09-12T16:17:02.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:17:02.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432293+0000", 2024-09-12T16:17:02.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.527e-05 2024-09-12T16:17:02.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:02.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:02.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:02.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432316+0000", 2024-09-12T16:17:02.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3519e-05 2024-09-12T16:17:02.956 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.956 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:02.956 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.956 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:02.956 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:02.956 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:02.958 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:17:02.959 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:02.956+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:02.959 INFO:teuthology.orchestra.run.smithi204.stdout:3380 write 0xcb93a00 thru 0xcb96a26 (0x3027 bytes) 2024-09-12T16:17:02.959 INFO:teuthology.orchestra.run.smithi204.stdout:3381 write 0xa6d200 thru 0xa7c16d (0xef6e bytes) 2024-09-12T16:17:02.959 INFO:teuthology.orchestra.run.smithi204.stdout:3384 write 0x4aec400 thru 0x4afa8fc (0xe4fd bytes) 2024-09-12T16:17:02.959 INFO:teuthology.orchestra.run.smithi204.stdout:3385 read 0x4c21000 thru 0x4c29188 (0x8189 bytes) 2024-09-12T16:17:02.959 INFO:teuthology.orchestra.run.smithi204.stdout:3386 write 0xccd3e00 thru 0xccda329 (0x652a bytes) 2024-09-12T16:17:02.959 INFO:teuthology.orchestra.run.smithi204.stdout:3387 write 0xb926400 thru 0xb929c99 (0x389a bytes) 2024-09-12T16:17:02.960 INFO:teuthology.orchestra.run.smithi204.stdout:3388 write 0x7d81e00 thru 0x7d87fc0 (0x61c1 bytes) 2024-09-12T16:17:02.960 INFO:teuthology.orchestra.run.smithi204.stdout:3391 read 0x2708800 thru 0x271410e (0xb90f bytes) 2024-09-12T16:17:02.960 INFO:teuthology.orchestra.run.smithi204.stdout:3392 read 0x9125800 thru 0x9135625 (0xfe26 bytes) 2024-09-12T16:17:02.960 INFO:teuthology.orchestra.run.smithi204.stdout:3393 read 0x6752e00 thru 0x675c649 (0x984a bytes) 2024-09-12T16:17:02.974 INFO:teuthology.orchestra.run.smithi204.stdout:3395 write 0xec56200 thru 0xec5f261 (0x9062 bytes) 2024-09-12T16:17:02.976 INFO:teuthology.orchestra.run.smithi204.stdout:3396 write 0x8ffe600 thru 0x9007667 (0x9068 bytes) 2024-09-12T16:17:02.976 INFO:teuthology.orchestra.run.smithi204.stdout:3399 read 0xc7c3a00 thru 0xc7c7709 (0x3d0a bytes) 2024-09-12T16:17:02.976 INFO:teuthology.orchestra.run.smithi204.stdout:3401 read 0xb46de00 thru 0xb474cf8 (0x6ef9 bytes) 2024-09-12T16:17:02.988 INFO:teuthology.orchestra.run.smithi204.stdout:3406 trunc from 0xec5f400 to 0x43dc200 2024-09-12T16:17:03.012 INFO:teuthology.orchestra.run.smithi204.stdout:3407 read 0x994800 thru 0x99e6f5 (0x9ef6 bytes) 2024-09-12T16:17:03.014 INFO:teuthology.orchestra.run.smithi204.stdout:3408 punch from 0x7e5200 to 0x7f5000, (0xfe00 bytes) 2024-09-12T16:17:03.015 INFO:teuthology.orchestra.run.smithi204.stdout:3409 read 0x6ad200 thru 0x6b5905 (0x8706 bytes) 2024-09-12T16:17:03.018 INFO:teuthology.orchestra.run.smithi204.stdout:3410 read 0xb03a00 thru 0xb0b5e6 (0x7be7 bytes) 2024-09-12T16:17:03.037 INFO:teuthology.orchestra.run.smithi204.stdout:3411 write 0xba1bc00 thru 0xba27503 (0xb904 bytes) 2024-09-12T16:17:03.042 INFO:teuthology.orchestra.run.smithi204.stdout:3412 trunc from 0xba27600 to 0x7b01800 2024-09-12T16:17:03.058 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:03.057+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:03.059 INFO:teuthology.orchestra.run.smithi204.stdout:3413 read 0x305d000 thru 0x306c211 (0xf212 bytes) 2024-09-12T16:17:03.068 INFO:teuthology.orchestra.run.smithi204.stdout:3414 trunc from 0x7b01800 to 0xe40a800 2024-09-12T16:17:03.078 INFO:teuthology.orchestra.run.smithi204.stdout:3415 write 0x25b0400 thru 0x25bd745 (0xd346 bytes) 2024-09-12T16:17:03.079 INFO:teuthology.orchestra.run.smithi204.stdout:3416 write 0x52ad400 thru 0x52b6919 (0x951a bytes) 2024-09-12T16:17:03.079 INFO:teuthology.orchestra.run.smithi204.stdout:3419 read 0x8a8200 thru 0x8ac3b4 (0x41b5 bytes) 2024-09-12T16:17:03.079 INFO:teuthology.orchestra.run.smithi204.stdout:3421 write 0x8eee200 thru 0x8ef2d1d (0x4b1e bytes) 2024-09-12T16:17:03.080 INFO:teuthology.orchestra.run.smithi204.stdout:3422 punch from 0x774000 to 0x779800, (0x5800 bytes) 2024-09-12T16:17:03.081 INFO:teuthology.orchestra.run.smithi204.stdout:3423 read 0x528a200 thru 0x52916b8 (0x74b9 bytes) 2024-09-12T16:17:03.081 INFO:teuthology.orchestra.run.smithi204.stdout:3425 write 0xe3fda00 thru 0xe406976 (0x8f77 bytes) 2024-09-12T16:17:03.081 INFO:teuthology.orchestra.run.smithi204.stdout:3430 read 0x369f200 thru 0x36add0b (0xeb0c bytes) 2024-09-12T16:17:03.095 INFO:teuthology.orchestra.run.smithi204.stdout:3431 trunc from 0xe40a800 to 0x217ea00 2024-09-12T16:17:03.118 INFO:teuthology.orchestra.run.smithi204.stdout:3432 read 0xbfa800 thru 0xc0a6c4 (0xfec5 bytes) 2024-09-12T16:17:03.122 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:03.122 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:03.122 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:17:03.122 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:03.132 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:17:03.140 INFO:teuthology.orchestra.run.smithi204.stdout:3434 write 0xaf38600 thru 0xaf3a33a (0x1d3b bytes) 2024-09-12T16:17:03.160 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:03.159+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:03.163 INFO:teuthology.orchestra.run.smithi204.stdout:3435 write 0xdf2e800 thru 0xdf3c6de (0xdedf bytes) 2024-09-12T16:17:03.170 INFO:teuthology.orchestra.run.smithi204.stdout:3436 trunc from 0xdf3c800 to 0x7b9a800 2024-09-12T16:17:03.203 INFO:teuthology.orchestra.run.smithi204.stdout:3438 trunc from 0x7b9a800 to 0xe26000 2024-09-12T16:17:03.230 INFO:teuthology.orchestra.run.smithi204.stdout:3439 punch from 0x11d800 to 0x125000, (0x7800 bytes) 2024-09-12T16:17:03.260 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:03.259+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:03.291 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:03.292 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:03.292 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:17:03.292 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:17:03.292 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:03.300 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:17:03.384 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:03.383+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:03.449 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:03.449 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:17:03.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:17:03.450 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:17:03.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.450 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2300 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12372992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:03.450 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:17:03.450 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 45.552131166999999, 2024-09-12T16:17:03.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037401246999999999, 2024-09-12T16:17:03.450 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:03.450 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:03.450 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:03.450 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:03.450 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:03.451 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:03.451 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2300 2024-09-12T16:17:03.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.451 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:03.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:03.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:17:03.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:03.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:17:03.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:17:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6100000000000002e-07 2024-09-12T16:17:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896026+0000", 2024-09-12T16:17:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9130000000000001e-06 2024-09-12T16:17:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896032+0000", 2024-09-12T16:17:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7540000000000003e-06 2024-09-12T16:17:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896036+0000", 2024-09-12T16:17:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5750000000000002e-06 2024-09-12T16:17:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933254+0000", 2024-09-12T16:17:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037217962 2024-09-12T16:17:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933341+0000", 2024-09-12T16:17:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6296000000000002e-05 2024-09-12T16:17:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933425+0000", 2024-09-12T16:17:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4386000000000001e-05 2024-09-12T16:17:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2301 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12377088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896043+0000", 2024-09-12T16:17:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 45.552111425, 2024-09-12T16:17:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037486197999999998, 2024-09-12T16:17:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2301 2024-09-12T16:17:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896043+0000", 2024-09-12T16:17:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896043+0000", 2024-09-12T16:17:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896044+0000", 2024-09-12T16:17:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.41e-07 2024-09-12T16:17:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896053+0000", 2024-09-12T16:17:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8049999999999996e-06 2024-09-12T16:17:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896060+0000", 2024-09-12T16:17:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.221e-06 2024-09-12T16:17:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896065+0000", 2024-09-12T16:17:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1109999999999999e-06 2024-09-12T16:17:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933452+0000", 2024-09-12T16:17:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037386560999999999 2024-09-12T16:17:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933491+0000", 2024-09-12T16:17:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9789000000000001e-05 2024-09-12T16:17:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933530+0000", 2024-09-12T16:17:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.837e-05 2024-09-12T16:17:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2302 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12381184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:17:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 45.552069985000003, 2024-09-12T16:17:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037645284000000001, 2024-09-12T16:17:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2302 2024-09-12T16:17:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:17:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:17:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:17:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6800000000000001e-07 2024-09-12T16:17:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896088+0000", 2024-09-12T16:17:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3429999999999998e-06 2024-09-12T16:17:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896096+0000", 2024-09-12T16:17:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0860000000000002e-06 2024-09-12T16:17:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896102+0000", 2024-09-12T16:17:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7610000000000004e-06 2024-09-12T16:17:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933563+0000", 2024-09-12T16:17:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037461019999999998 2024-09-12T16:17:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933648+0000", 2024-09-12T16:17:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5468000000000002e-05 2024-09-12T16:17:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933730+0000", 2024-09-12T16:17:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2138000000000005e-05 2024-09-12T16:17:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2303 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12385280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:17:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 45.552046183000002, 2024-09-12T16:17:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037723083999999997, 2024-09-12T16:17:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2303 2024-09-12T16:17:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:17:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:17:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:17:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2500000000000001e-07 2024-09-12T16:17:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896115+0000", 2024-09-12T16:17:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.28e-06 2024-09-12T16:17:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896122+0000", 2024-09-12T16:17:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4590000000000003e-06 2024-09-12T16:17:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896127+0000", 2024-09-12T16:17:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0509999999999996e-06 2024-09-12T16:17:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933755+0000", 2024-09-12T16:17:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037627729999999998 2024-09-12T16:17:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.468 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:03.468 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933794+0000", 2024-09-12T16:17:03.468 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9255000000000003e-05 2024-09-12T16:17:03.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.468 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:03.468 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933832+0000", 2024-09-12T16:17:03.468 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7883999999999998e-05 2024-09-12T16:17:03.468 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.468 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:03.468 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2304 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12389376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:17:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 45.552020833999997, 2024-09-12T16:17:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037911010000000002, 2024-09-12T16:17:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2304 2024-09-12T16:17:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:17:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:17:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:17:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9900000000000001e-07 2024-09-12T16:17:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896136+0000", 2024-09-12T16:17:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.897e-06 2024-09-12T16:17:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896142+0000", 2024-09-12T16:17:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9290000000000003e-06 2024-09-12T16:17:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896154+0000", 2024-09-12T16:17:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.201e-05 2024-09-12T16:17:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933865+0000", 2024-09-12T16:17:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037710225 2024-09-12T16:17:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933961+0000", 2024-09-12T16:17:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6315000000000002e-05 2024-09-12T16:17:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934045+0000", 2024-09-12T16:17:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4234999999999996e-05 2024-09-12T16:17:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2305 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12393472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896175+0000", 2024-09-12T16:17:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 45.551979643999999, 2024-09-12T16:17:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037976941, 2024-09-12T16:17:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2305 2024-09-12T16:17:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896175+0000", 2024-09-12T16:17:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896175+0000", 2024-09-12T16:17:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896176+0000", 2024-09-12T16:17:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7400000000000003e-07 2024-09-12T16:17:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896178+0000", 2024-09-12T16:17:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6709999999999999e-06 2024-09-12T16:17:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896186+0000", 2024-09-12T16:17:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9319999999999996e-06 2024-09-12T16:17:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896192+0000", 2024-09-12T16:17:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0799999999999996e-06 2024-09-12T16:17:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934072+0000", 2024-09-12T16:17:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037880888000000001 2024-09-12T16:17:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934113+0000", 2024-09-12T16:17:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0815999999999997e-05 2024-09-12T16:17:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934152+0000", 2024-09-12T16:17:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8980000000000003e-05 2024-09-12T16:17:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2306 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12397568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:17:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 45.551955366000001, 2024-09-12T16:17:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038156347, 2024-09-12T16:17:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2306 2024-09-12T16:17:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:17:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:17:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:17:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.77e-07 2024-09-12T16:17:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896202+0000", 2024-09-12T16:17:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2359999999999999e-06 2024-09-12T16:17:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896208+0000", 2024-09-12T16:17:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1430000000000003e-06 2024-09-12T16:17:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896213+0000", 2024-09-12T16:17:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9339999999999997e-06 2024-09-12T16:17:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934188+0000", 2024-09-12T16:17:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037974490999999999 2024-09-12T16:17:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934275+0000", 2024-09-12T16:17:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7639999999999994e-05 2024-09-12T16:17:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934356+0000", 2024-09-12T16:17:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0525999999999994e-05 2024-09-12T16:17:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2307 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12401664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:17:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 45.551935594, 2024-09-12T16:17:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038241450000000003, 2024-09-12T16:17:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2307 2024-09-12T16:17:03.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.484 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:03.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.484 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:03.484 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:17:03.484 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.484 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:03.484 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:17:03.484 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896220+0000", 2024-09-12T16:17:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3500000000000002e-07 2024-09-12T16:17:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896222+0000", 2024-09-12T16:17:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1720000000000001e-06 2024-09-12T16:17:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896228+0000", 2024-09-12T16:17:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0870000000000003e-06 2024-09-12T16:17:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.486 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:03.486 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896233+0000", 2024-09-12T16:17:03.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:17:03.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.486 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:03.486 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934382+0000", 2024-09-12T16:17:03.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038149566000000003 2024-09-12T16:17:03.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.486 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:03.486 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934422+0000", 2024-09-12T16:17:03.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0015999999999998e-05 2024-09-12T16:17:03.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.487 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:03.487 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934461+0000", 2024-09-12T16:17:03.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8423999999999997e-05 2024-09-12T16:17:03.487 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.487 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:03.487 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.487 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2308 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12405760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:03.487 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:17:03.487 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 45.551915897000001, 2024-09-12T16:17:03.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038420745999999999, 2024-09-12T16:17:03.488 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:03.488 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:03.488 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:03.488 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:03.488 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:03.488 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:03.488 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2308 2024-09-12T16:17:03.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.488 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:03.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.488 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:03.488 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:17:03.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.489 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:03.489 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:17:03.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.489 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:03.489 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:17:03.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.58e-07 2024-09-12T16:17:03.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.489 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:03.490 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896241+0000", 2024-09-12T16:17:03.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7940000000000001e-06 2024-09-12T16:17:03.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:03.490 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896247+0000", 2024-09-12T16:17:03.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1460000000000001e-06 2024-09-12T16:17:03.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:03.490 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896252+0000", 2024-09-12T16:17:03.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6840000000000004e-06 2024-09-12T16:17:03.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.491 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:03.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934494+0000", 2024-09-12T16:17:03.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038242362000000002 2024-09-12T16:17:03.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.491 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:03.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934579+0000", 2024-09-12T16:17:03.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5044999999999996e-05 2024-09-12T16:17:03.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.491 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:03.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934660+0000", 2024-09-12T16:17:03.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0357000000000003e-05 2024-09-12T16:17:03.492 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.492 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:03.492 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.492 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2309 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12409856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:03.492 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:17:03.492 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 45.551895317000003, 2024-09-12T16:17:03.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038504629999999998, 2024-09-12T16:17:03.492 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:03.492 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:03.492 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:03.492 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:03.493 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:03.493 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:03.493 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2309 2024-09-12T16:17:03.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.493 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:03.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.493 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:03.493 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:17:03.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.493 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:03.493 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:17:03.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.494 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:03.494 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:17:03.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5199999999999998e-07 2024-09-12T16:17:03.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.494 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:03.494 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896263+0000", 2024-09-12T16:17:03.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4209999999999999e-06 2024-09-12T16:17:03.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.494 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:03.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896269+0000", 2024-09-12T16:17:03.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9449999999999998e-06 2024-09-12T16:17:03.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.495 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:03.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896274+0000", 2024-09-12T16:17:03.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3950000000000003e-06 2024-09-12T16:17:03.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.495 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:03.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934686+0000", 2024-09-12T16:17:03.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038412333999999999 2024-09-12T16:17:03.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.496 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:03.496 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934727+0000", 2024-09-12T16:17:03.496 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0649999999999999e-05 2024-09-12T16:17:03.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.496 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:03.496 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934764+0000", 2024-09-12T16:17:03.496 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7533000000000001e-05 2024-09-12T16:17:03.496 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.496 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:03.496 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.497 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2310 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12413952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:03.497 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:17:03.497 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 45.551874445000003, 2024-09-12T16:17:03.497 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038694183, 2024-09-12T16:17:03.497 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:03.497 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:03.497 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:03.497 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:03.497 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:03.497 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:03.497 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2310 2024-09-12T16:17:03.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.497 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:03.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:03.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:17:03.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:03.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:17:03.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:03.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896281+0000", 2024-09-12T16:17:03.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1399999999999997e-07 2024-09-12T16:17:03.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:03.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896283+0000", 2024-09-12T16:17:03.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9549999999999999e-06 2024-09-12T16:17:03.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:03.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896289+0000", 2024-09-12T16:17:03.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8669999999999999e-06 2024-09-12T16:17:03.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:03.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896301+0000", 2024-09-12T16:17:03.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1807999999999999e-05 2024-09-12T16:17:03.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:03.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934798+0000", 2024-09-12T16:17:03.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038497591999999997 2024-09-12T16:17:03.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:03.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934885+0000", 2024-09-12T16:17:03.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7149000000000002e-05 2024-09-12T16:17:03.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934975+0000", 2024-09-12T16:17:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9297999999999998e-05 2024-09-12T16:17:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2311 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12418048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:17:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 45.551847189, 2024-09-12T16:17:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038768558000000002, 2024-09-12T16:17:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:03.502 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:03.502 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:03.502 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:03.502 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:03.502 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:03.502 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2311 2024-09-12T16:17:03.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.502 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:03.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.502 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:03.502 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:17:03.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:03.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:17:03.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:03.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:17:03.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.63e-07 2024-09-12T16:17:03.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:03.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896310+0000", 2024-09-12T16:17:03.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1560000000000002e-06 2024-09-12T16:17:03.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.504 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:03.504 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896316+0000", 2024-09-12T16:17:03.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0249999999999999e-06 2024-09-12T16:17:03.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.504 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:03.504 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896322+0000", 2024-09-12T16:17:03.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6400000000000002e-06 2024-09-12T16:17:03.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.504 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:03.505 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934997+0000", 2024-09-12T16:17:03.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038674565000000001 2024-09-12T16:17:03.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.505 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:03.505 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935037+0000", 2024-09-12T16:17:03.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0485999999999998e-05 2024-09-12T16:17:03.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.505 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:03.505 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935076+0000", 2024-09-12T16:17:03.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9223e-05 2024-09-12T16:17:03.505 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.505 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:03.506 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.506 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2312 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12422144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:03.506 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:17:03.506 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 45.551826495999997, 2024-09-12T16:17:03.506 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038856784999999998, 2024-09-12T16:17:03.506 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:03.506 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:03.506 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:03.506 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:03.506 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:03.506 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:03.507 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2312 2024-09-12T16:17:03.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.507 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:03.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.507 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:03.507 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:17:03.507 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.507 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:03.507 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:17:03.507 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.508 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:03.508 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896329+0000", 2024-09-12T16:17:03.508 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5499999999999999e-07 2024-09-12T16:17:03.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.508 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:03.508 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896337+0000", 2024-09-12T16:17:03.508 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0819999999999999e-06 2024-09-12T16:17:03.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.508 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:03.508 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896343+0000", 2024-09-12T16:17:03.508 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.263e-06 2024-09-12T16:17:03.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.509 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:03.509 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896348+0000", 2024-09-12T16:17:03.509 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8860000000000003e-06 2024-09-12T16:17:03.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.509 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:03.509 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935097+0000", 2024-09-12T16:17:03.509 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038748818999999997 2024-09-12T16:17:03.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.509 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:03.509 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935141+0000", 2024-09-12T16:17:03.510 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4175000000000003e-05 2024-09-12T16:17:03.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.510 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:03.510 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935185+0000", 2024-09-12T16:17:03.510 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4205000000000001e-05 2024-09-12T16:17:03.510 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.510 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:03.510 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.510 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2313 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12426240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:03.510 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:17:03.510 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 45.551800280999998, 2024-09-12T16:17:03.511 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038928683999999998, 2024-09-12T16:17:03.511 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:03.511 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:03.511 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:03.511 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:03.511 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:03.511 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:03.511 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2313 2024-09-12T16:17:03.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.511 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:03.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.511 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:03.511 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:17:03.512 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.512 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:03.512 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:17:03.512 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.512 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:03.512 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:17:03.512 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0400000000000002e-07 2024-09-12T16:17:03.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.513 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:03.513 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896357+0000", 2024-09-12T16:17:03.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.097e-06 2024-09-12T16:17:03.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.513 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:03.513 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896363+0000", 2024-09-12T16:17:03.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5119999999999999e-06 2024-09-12T16:17:03.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.513 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:03.513 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896374+0000", 2024-09-12T16:17:03.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1381e-05 2024-09-12T16:17:03.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:03.514 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935205+0000", 2024-09-12T16:17:03.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038830549999999998 2024-09-12T16:17:03.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:03.515 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935244+0000", 2024-09-12T16:17:03.516 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9520000000000001e-05 2024-09-12T16:17:03.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.516 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:03.516 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935283+0000", 2024-09-12T16:17:03.516 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9220000000000001e-05 2024-09-12T16:17:03.516 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.516 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:03.516 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.516 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2314 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12430336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:03.516 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:17:03.517 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 45.551763111, 2024-09-12T16:17:03.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039008137999999998, 2024-09-12T16:17:03.517 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:03.517 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:03.517 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:03.517 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:03.517 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:03.517 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:03.517 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2314 2024-09-12T16:17:03.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.517 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:03.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.517 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:03.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:17:03.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:03.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:17:03.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:03.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:17:03.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6499999999999999e-07 2024-09-12T16:17:03.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:03.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896395+0000", 2024-09-12T16:17:03.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2960000000000001e-06 2024-09-12T16:17:03.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:03.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896402+0000", 2024-09-12T16:17:03.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2280000000000001e-06 2024-09-12T16:17:03.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:03.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896407+0000", 2024-09-12T16:17:03.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3630000000000002e-06 2024-09-12T16:17:03.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.520 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:03.520 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935302+0000", 2024-09-12T16:17:03.520 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038895181000000001 2024-09-12T16:17:03.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.520 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:03.520 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935343+0000", 2024-09-12T16:17:03.520 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0590999999999998e-05 2024-09-12T16:17:03.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.520 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:03.521 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935400+0000", 2024-09-12T16:17:03.521 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7014e-05 2024-09-12T16:17:03.521 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.521 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:03.521 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.521 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.521 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2315 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12434432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:03.521 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:17:03.521 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 45.551740459999998, 2024-09-12T16:17:03.521 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039083892000000002, 2024-09-12T16:17:03.521 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:03.521 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:03.521 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:03.522 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:03.522 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:03.522 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:03.522 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2315 2024-09-12T16:17:03.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.522 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:03.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.522 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:03.522 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:17:03.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.523 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:03.523 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:17:03.523 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.523 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:03.523 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896415+0000", 2024-09-12T16:17:03.523 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3300000000000002e-07 2024-09-12T16:17:03.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.523 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:03.523 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896421+0000", 2024-09-12T16:17:03.523 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7579999999999998e-06 2024-09-12T16:17:03.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.524 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.524 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:03.524 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896427+0000", 2024-09-12T16:17:03.524 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3029999999999996e-06 2024-09-12T16:17:03.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.524 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.524 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:03.524 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896432+0000", 2024-09-12T16:17:03.524 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.215e-06 2024-09-12T16:17:03.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.524 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.524 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:03.524 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935420+0000", 2024-09-12T16:17:03.525 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038987727 2024-09-12T16:17:03.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.525 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:03.525 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935460+0000", 2024-09-12T16:17:03.525 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9817999999999997e-05 2024-09-12T16:17:03.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.525 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:03.525 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935498+0000", 2024-09-12T16:17:03.525 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8438e-05 2024-09-12T16:17:03.525 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.525 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:03.526 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.526 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2316 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12438528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:03.526 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:17:03.526 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 45.551715807999997, 2024-09-12T16:17:03.526 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039160043999999998, 2024-09-12T16:17:03.526 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:03.526 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:03.526 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:03.526 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:03.526 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:03.526 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:03.527 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2316 2024-09-12T16:17:03.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.527 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:03.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.527 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:03.527 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:17:03.527 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.527 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:03.527 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:17:03.527 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.528 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:03.528 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901945+0000", 2024-09-12T16:17:03.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055056050000000002 2024-09-12T16:17:03.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.528 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:03.528 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901950+0000", 2024-09-12T16:17:03.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2490000000000001e-06 2024-09-12T16:17:03.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.528 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:03.529 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901966+0000", 2024-09-12T16:17:03.529 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6325e-05 2024-09-12T16:17:03.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.529 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:03.529 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901974+0000", 2024-09-12T16:17:03.529 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7570000000000004e-06 2024-09-12T16:17:03.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.529 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:03.529 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935518+0000", 2024-09-12T16:17:03.529 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033543587999999999 2024-09-12T16:17:03.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.530 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:03.530 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935559+0000", 2024-09-12T16:17:03.530 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1746000000000003e-05 2024-09-12T16:17:03.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.530 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:03.530 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935599+0000", 2024-09-12T16:17:03.530 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9774000000000002e-05 2024-09-12T16:17:03.530 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.530 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:03.530 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.531 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.531 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1571 3.b 3:d046566d:::rbd_data.1155525b14e3.0000000000000001:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:17:03.531 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:17:03.531 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.295590766, 2024-09-12T16:17:03.531 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064439785999999999, 2024-09-12T16:17:03.531 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:03.531 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:03.531 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:03.531 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:03.531 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:17:03.531 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:17:03.531 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1571 2024-09-12T16:17:03.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.531 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:03.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.532 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:03.532 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:17:03.532 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.532 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:03.532 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:17:03.532 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.532 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:03.532 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:17:03.533 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5400000000000002e-07 2024-09-12T16:17:03.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.533 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:03.533 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152567+0000", 2024-09-12T16:17:03.533 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.131e-06 2024-09-12T16:17:03.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.533 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:03.533 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152574+0000", 2024-09-12T16:17:03.533 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1840000000000002e-06 2024-09-12T16:17:03.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.534 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:03.534 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152579+0000", 2024-09-12T16:17:03.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.152e-06 2024-09-12T16:17:03.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.534 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:03.534 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153671+0000", 2024-09-12T16:17:03.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001092078 2024-09-12T16:17:03.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.534 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:03.534 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153779+0000", 2024-09-12T16:17:03.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108461 2024-09-12T16:17:03.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.535 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:03.535 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217004+0000", 2024-09-12T16:17:03.535 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.063224426 2024-09-12T16:17:03.535 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.535 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:03.535 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.535 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1581 3.4 3:22e34893:::rbd_data.1155525b14e3.0000000000000005:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:17:03.535 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:17:03.535 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.295493641, 2024-09-12T16:17:03.535 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064484407999999993, 2024-09-12T16:17:03.536 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:03.536 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:03.536 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:03.536 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:03.536 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:17:03.536 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:17:03.536 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1581 2024-09-12T16:17:03.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.536 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:03.536 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.536 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:03.536 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:17:03.536 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.537 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:03.537 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:17:03.537 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.537 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:03.537 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152662+0000", 2024-09-12T16:17:03.537 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.65e-07 2024-09-12T16:17:03.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.537 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:03.537 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152664+0000", 2024-09-12T16:17:03.538 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9829999999999999e-06 2024-09-12T16:17:03.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.538 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.538 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:03.538 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152670+0000", 2024-09-12T16:17:03.538 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2260000000000002e-06 2024-09-12T16:17:03.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.538 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.538 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:03.538 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152675+0000", 2024-09-12T16:17:03.538 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7990000000000001e-06 2024-09-12T16:17:03.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.538 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.538 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:03.539 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.216945+0000", 2024-09-12T16:17:03.539 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064270341999999994 2024-09-12T16:17:03.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.539 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.539 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:03.539 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217040+0000", 2024-09-12T16:17:03.539 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5242999999999996e-05 2024-09-12T16:17:03.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.539 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.539 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:03.539 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217146+0000", 2024-09-12T16:17:03.539 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010545 2024-09-12T16:17:03.539 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.540 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:03.540 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.540 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2207 3.0 3:05fdc61f:::rbd_data.1155ccb1894c.0000000000000003:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:03.540 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:17:03.540 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.0774500800000002, 2024-09-12T16:17:03.540 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.05105382, 2024-09-12T16:17:03.540 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:03.540 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:03.540 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:03.540 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:03.541 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:17:03.541 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:17:03.541 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2207 2024-09-12T16:17:03.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.541 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:03.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.541 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:03.541 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:17:03.541 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.541 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:03.541 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:17:03.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:03.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.542 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:03.542 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370706+0000", 2024-09-12T16:17:03.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7800000000000001e-07 2024-09-12T16:17:03.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.542 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:03.542 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391581+0000", 2024-09-12T16:17:03.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020875624999999998 2024-09-12T16:17:03.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.542 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:03.543 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391608+0000", 2024-09-12T16:17:03.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6412999999999999e-05 2024-09-12T16:17:03.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.543 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:03.543 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391618+0000", 2024-09-12T16:17:03.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9240000000000002e-06 2024-09-12T16:17:03.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.543 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:03.543 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391705+0000", 2024-09-12T16:17:03.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7489000000000002e-05 2024-09-12T16:17:03.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.544 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:03.544 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391838+0000", 2024-09-12T16:17:03.544 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132865 2024-09-12T16:17:03.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.544 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 2", 2024-09-12T16:17:03.544 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.392587+0000", 2024-09-12T16:17:03.544 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074930000000000005 2024-09-12T16:17:03.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.544 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:03.544 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.420095+0000", 2024-09-12T16:17:03.544 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027507949 2024-09-12T16:17:03.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.545 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:17:03.545 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421610+0000", 2024-09-12T16:17:03.545 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001515195 2024-09-12T16:17:03.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.545 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:17:03.545 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421681+0000", 2024-09-12T16:17:03.545 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0320000000000004e-05 2024-09-12T16:17:03.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:03.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:03.545 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:03.546 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421759+0000", 2024-09-12T16:17:03.546 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7961999999999997e-05 2024-09-12T16:17:03.546 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.546 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:03.546 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.546 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:03.546 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:03.546 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:03.547 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:17:03.548 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:03.547+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:03.578 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T16:17:03.648 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:03.647+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:03.699 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:03.699 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:03.699 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:17:03.699 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:03.708 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:17:03.713 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:17:03.713 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:17:03.731 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:17:03.731 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:17:03.747 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:17:03.748 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:17:03.749 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:03.748+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:03.765 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:17:03.765 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:17:03.782 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:17:03.782 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:17:03.799 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:17:03.800 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_enable_op_tracker = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' 2024-09-12T16:17:03.821 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:03.821 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:03.830 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:17:03.872 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:03.871+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:03.951 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:03.950+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:03.978 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:03.978 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:03.987 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:17:04.052 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:04.052+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:04.108 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:04.108 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:04.117 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:17:04.153 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:04.152+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:04.240 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T16:17:04.271 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:04.271 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:04.280 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:17:04.285 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:04.284+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:04.354 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:04.354+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:04.387 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:04.387 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:04.395 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:17:04.479 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:04.479+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:04.543 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:04.543 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:04.551 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:17:04.556 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:04.555+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:04.656 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:04.656+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:04.699 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:04.699 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:04.708 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:17:04.792 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:04.792+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:04.856 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:04.856 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:04.858 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:04.857+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:04.864 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:17:04.959 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:04.958+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:04.974 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:04.974 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:04.982 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:17:05.060 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:05.059+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:05.089 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:05.089 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:05.098 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:17:05.182 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:05.181+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:05.231 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2024-09-12T16:17:05.249 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:05.250 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:05.259 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:17:05.300 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:05.299+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:05.361 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:05.361+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:05.406 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:05.406 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:05.415 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:17:05.462 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:05.462+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:05.498 INFO:teuthology.orchestra.run.smithi204.stdout:3441 write 0x1031e00 thru 0x10384a4 (0x66a5 bytes) 2024-09-12T16:17:05.498 INFO:teuthology.orchestra.run.smithi204.stdout:3443 read 0xf4c00 thru 0xff828 (0xac29 bytes) 2024-09-12T16:17:05.499 INFO:teuthology.orchestra.run.smithi204.stdout:3444 punch from 0x344000 to 0x349800, (0x5800 bytes) 2024-09-12T16:17:05.499 INFO:teuthology.orchestra.run.smithi204.stdout:3445 read 0xd13e00 thru 0xd14e87 (0x1088 bytes) 2024-09-12T16:17:05.500 INFO:teuthology.orchestra.run.smithi204.stdout:3446 read 0xf0aa00 thru 0xf0d610 (0x2c11 bytes) 2024-09-12T16:17:05.500 INFO:teuthology.orchestra.run.smithi204.stdout:3447 read 0x912800 thru 0x91f97e (0xd17f bytes) 2024-09-12T16:17:05.516 INFO:teuthology.orchestra.run.smithi204.stdout:3448 trunc from 0x1038600 to 0xa6d8400 2024-09-12T16:17:05.527 INFO:teuthology.orchestra.run.smithi204.stdout:3450 read 0x2548400 thru 0x25534c3 (0xb0c4 bytes) 2024-09-12T16:17:05.528 INFO:teuthology.orchestra.run.smithi204.stdout:3453 read 0x937c000 thru 0x937eba3 (0x2ba4 bytes) 2024-09-12T16:17:05.528 INFO:teuthology.orchestra.run.smithi204.stdout:3455 read 0x4bfee00 thru 0x4c0da7e (0xec7f bytes) 2024-09-12T16:17:05.528 INFO:teuthology.orchestra.run.smithi204.stdout:3456 write 0x830c00 thru 0x832979 (0x1d7a bytes) 2024-09-12T16:17:05.529 INFO:teuthology.orchestra.run.smithi204.stdout:3458 write 0x4cf3600 thru 0x4cf9a73 (0x6474 bytes) 2024-09-12T16:17:05.529 INFO:teuthology.orchestra.run.smithi204.stdout:3459 write 0x3f37a00 thru 0x3f400d1 (0x86d2 bytes) 2024-09-12T16:17:05.531 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:05.531 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:05.532 INFO:teuthology.orchestra.run.smithi204.stdout:3460 trunc from 0xa6d8400 to 0x83c1a00 2024-09-12T16:17:05.542 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:17:05.550 INFO:teuthology.orchestra.run.smithi204.stdout:3463 read 0x6a2dc00 thru 0x6a33e58 (0x6259 bytes) 2024-09-12T16:17:05.557 INFO:teuthology.orchestra.run.smithi204.stdout:3471 write 0x2abf400 thru 0x2ac8475 (0x9076 bytes) 2024-09-12T16:17:05.557 INFO:teuthology.orchestra.run.smithi204.stdout:3472 read 0x6729c00 thru 0x6732f67 (0x9368 bytes) 2024-09-12T16:17:05.559 INFO:teuthology.orchestra.run.smithi204.stdout:3474 trunc from 0x83c1a00 to 0x9b9c200 2024-09-12T16:17:05.574 INFO:teuthology.orchestra.run.smithi204.stdout:3475 write 0xcad800 thru 0xcb71d6 (0x99d7 bytes) 2024-09-12T16:17:05.582 INFO:teuthology.orchestra.run.smithi204.stdout:3477 read 0x71e4e00 thru 0x71f1e0e (0xd00f bytes) 2024-09-12T16:17:05.583 INFO:teuthology.orchestra.run.smithi204.stdout:3479 write 0x1b84200 thru 0x1b8e4d2 (0xa2d3 bytes) 2024-09-12T16:17:05.583 INFO:teuthology.orchestra.run.smithi204.stdout:3480 read 0x50c3800 thru 0x50c586b (0x206c bytes) 2024-09-12T16:17:05.583 INFO:teuthology.orchestra.run.smithi204.stdout:3481 punch from 0x88fca00 to 0x8909200, (0xc800 bytes) 2024-09-12T16:17:05.583 INFO:teuthology.orchestra.run.smithi204.stdout:3482 write 0x8e8dc00 thru 0x8e92ab4 (0x4eb5 bytes) 2024-09-12T16:17:05.583 INFO:teuthology.orchestra.run.smithi204.stdout:3483 punch from 0x666bc00 to 0x6675a00, (0x9e00 bytes) 2024-09-12T16:17:05.584 INFO:teuthology.orchestra.run.smithi204.stdout:3485 read 0x904bc00 thru 0x904f076 (0x3477 bytes) 2024-09-12T16:17:05.584 INFO:teuthology.orchestra.run.smithi204.stdout:3486 write 0x5fc8c00 thru 0x5fd5291 (0xc692 bytes) 2024-09-12T16:17:05.584 INFO:teuthology.orchestra.run.smithi204.stdout:3487 read 0x49d0a00 thru 0x49d51d9 (0x47da bytes) 2024-09-12T16:17:05.586 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:05.585+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:05.589 INFO:teuthology.orchestra.run.smithi204.stdout:3490 trunc from 0x9b9c200 to 0xe63be00 2024-09-12T16:17:05.602 INFO:teuthology.orchestra.run.smithi204.stdout:3491 read 0xdc84200 thru 0xdc897a7 (0x55a8 bytes) 2024-09-12T16:17:05.609 INFO:teuthology.orchestra.run.smithi204.stdout:3492 write 0xb0c9c00 thru 0xb0cf36c (0x576d bytes) 2024-09-12T16:17:05.621 INFO:teuthology.orchestra.run.smithi204.stdout:3493 trunc from 0xe63be00 to 0x4270600 2024-09-12T16:17:05.640 INFO:teuthology.orchestra.run.smithi204.stdout:3494 write 0x1119400 thru 0x111a669 (0x126a bytes) 2024-09-12T16:17:05.641 INFO:teuthology.orchestra.run.smithi204.stdout:3495 punch from 0x1f0c00 to 0x1fa600, (0x9a00 bytes) 2024-09-12T16:17:05.649 INFO:teuthology.orchestra.run.smithi204.stdout:3497 trunc from 0x4270600 to 0x9625800 2024-09-12T16:17:05.657 INFO:teuthology.orchestra.run.smithi204.stdout:3501 trunc from 0x9625800 to 0x92f8800 2024-09-12T16:17:05.663 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:05.663+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:05.672 INFO:teuthology.orchestra.run.smithi204.stdout:3504 trunc from 0x92f8800 to 0xc396800 2024-09-12T16:17:05.672 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:05.673 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:05.683 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:17:05.696 INFO:teuthology.orchestra.run.smithi204.stdout:3506 write 0xe529800 thru 0xe529b2d (0x32e bytes) 2024-09-12T16:17:05.708 INFO:teuthology.orchestra.run.smithi204.stdout:3507 trunc from 0xe529c00 to 0x476a800 2024-09-12T16:17:05.724 INFO:teuthology.orchestra.run.smithi204.stdout:3509 punch from 0x55a400 to 0x55e200, (0x3e00 bytes) 2024-09-12T16:17:05.745 INFO:teuthology.orchestra.run.smithi204.stdout:3514 write 0xc16ac00 thru 0xc17429d (0x969e bytes) 2024-09-12T16:17:05.751 INFO:teuthology.orchestra.run.smithi204.stdout:3517 read 0x261ba00 thru 0x261c214 (0x815 bytes) 2024-09-12T16:17:05.752 INFO:teuthology.orchestra.run.smithi204.stdout:3518 trunc from 0xc174400 to 0xcb22800 2024-09-12T16:17:05.765 INFO:teuthology.orchestra.run.smithi204.stdout:3519 write 0x6e6d000 thru 0x6e71ddb (0x4ddc bytes) 2024-09-12T16:17:05.768 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:05.767+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:05.770 INFO:teuthology.orchestra.run.smithi204.stdout:3521 punch from 0x1529a00 to 0x1538400, (0xea00 bytes) 2024-09-12T16:17:05.772 INFO:teuthology.orchestra.run.smithi204.stdout:3522 clone 22 order 19 su 32768 sc 12 2024-09-12T16:17:05.811 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T16:17:05.846 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:05.846 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:05.857 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:17:05.899 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:05.898+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:05.938 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:17:05.939 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:17:05.955 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:17:05.956 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:17:05.967 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:05.967+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:05.972 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:17:05.972 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:17:05.989 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:17:05.989 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:17:06.006 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:17:06.006 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:17:06.008 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:06.008 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:06.008 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:17:06.008 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:17:06.008 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:06.017 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:17:06.023 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:17:06.024 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:17:06.075 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:06.075+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:06.138 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:06.138 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:17:06.138 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:17:06.138 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:17:06.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.138 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4805.0:6829 3.18 3:1e2ee373:::rbd_data.1155c2c5fc24.0000000000000003:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 18778112~25088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T16:17:06.139 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:43.576065+0000", 2024-09-12T16:17:06.139 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.560518645999998, 2024-09-12T16:17:06.139 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044824155999999997, 2024-09-12T16:17:06.139 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:06.139 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:06.139 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:06.139 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:06.139 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4805", 2024-09-12T16:17:06.139 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3734391115", 2024-09-12T16:17:06.139 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6829 2024-09-12T16:17:06.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.139 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:06.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:06.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.576065+0000", 2024-09-12T16:17:06.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:06.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.576065+0000", 2024-09-12T16:17:06.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:06.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.576068+0000", 2024-09-12T16:17:06.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1629999999999999e-06 2024-09-12T16:17:06.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:06.141 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.588880+0000", 2024-09-12T16:17:06.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012812054 2024-09-12T16:17:06.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:06.141 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.588909+0000", 2024-09-12T16:17:06.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9354000000000001e-05 2024-09-12T16:17:06.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.142 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.142 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.588930+0000", 2024-09-12T16:17:06.142 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0571999999999999e-05 2024-09-12T16:17:06.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.142 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:06.142 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.589010+0000", 2024-09-12T16:17:06.142 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0780999999999998e-05 2024-09-12T16:17:06.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.142 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:06.142 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.589174+0000", 2024-09-12T16:17:06.142 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016337799999999999 2024-09-12T16:17:06.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.143 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.143 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 1", 2024-09-12T16:17:06.143 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.590261+0000", 2024-09-12T16:17:06.143 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001087735 2024-09-12T16:17:06.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.143 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.143 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:17:06.143 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.610690+0000", 2024-09-12T16:17:06.143 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020428281999999999 2024-09-12T16:17:06.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.143 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.143 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:06.143 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.620760+0000", 2024-09-12T16:17:06.144 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010070325999999999 2024-09-12T16:17:06.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.144 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:17:06.144 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.620836+0000", 2024-09-12T16:17:06.144 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5617999999999993e-05 2024-09-12T16:17:06.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.144 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:06.144 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.620890+0000", 2024-09-12T16:17:06.144 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3893000000000001e-05 2024-09-12T16:17:06.144 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.144 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:06.145 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.145 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:1673 3.7 3:e722ca22:::rbd_data.1155ccb1894c.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:06.145 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.314024+0000", 2024-09-12T16:17:06.145 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.8225602540000008, 2024-09-12T16:17:06.145 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040583337999999997, 2024-09-12T16:17:06.145 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:06.145 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:06.145 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:06.145 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:06.146 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:17:06.146 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:17:06.146 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1673 2024-09-12T16:17:06.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.146 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:06.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.146 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:06.146 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.314024+0000", 2024-09-12T16:17:06.146 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.146 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:06.146 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.314024+0000", 2024-09-12T16:17:06.147 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.147 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.147 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:06.147 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.314025+0000", 2024-09-12T16:17:06.147 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0839999999999999e-06 2024-09-12T16:17:06.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.147 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.147 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:06.147 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.331177+0000", 2024-09-12T16:17:06.147 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017152499000000002 2024-09-12T16:17:06.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.148 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.148 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:06.148 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.331201+0000", 2024-09-12T16:17:06.148 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3845e-05 2024-09-12T16:17:06.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.148 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.148 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.148 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.331210+0000", 2024-09-12T16:17:06.148 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2840000000000006e-06 2024-09-12T16:17:06.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.148 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.148 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:06.149 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.331285+0000", 2024-09-12T16:17:06.149 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5747999999999994e-05 2024-09-12T16:17:06.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.149 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.149 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:06.149 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.331445+0000", 2024-09-12T16:17:06.149 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015985000000000001 2024-09-12T16:17:06.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.149 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.149 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 1", 2024-09-12T16:17:06.149 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.332166+0000", 2024-09-12T16:17:06.149 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000720438 2024-09-12T16:17:06.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.149 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.150 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:17:06.150 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.353178+0000", 2024-09-12T16:17:06.150 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021012638 2024-09-12T16:17:06.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.150 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:06.150 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.354503+0000", 2024-09-12T16:17:06.150 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001324806 2024-09-12T16:17:06.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.150 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:17:06.150 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.354566+0000", 2024-09-12T16:17:06.151 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3446000000000002e-05 2024-09-12T16:17:06.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.151 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.151 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:06.151 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.354607+0000", 2024-09-12T16:17:06.151 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.07e-05 2024-09-12T16:17:06.151 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.151 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:06.151 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.151 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.151 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2213 3.18 3:1944e921:::rbd_data.1155ccb1894c.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:06.151 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:17:06.151 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.7612350469999996, 2024-09-12T16:17:06.151 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.055657836000000002, 2024-09-12T16:17:06.152 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:06.152 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:06.152 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:06.152 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:06.152 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:17:06.152 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:17:06.152 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2213 2024-09-12T16:17:06.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.152 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:06.152 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.152 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:06.152 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:17:06.152 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.153 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.153 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:06.153 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:17:06.153 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.153 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.153 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:06.153 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375351+0000", 2024-09-12T16:17:06.153 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.556e-06 2024-09-12T16:17:06.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.153 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.153 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:06.153 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.399989+0000", 2024-09-12T16:17:06.154 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024637949999999999 2024-09-12T16:17:06.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.154 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.154 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:06.154 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400038+0000", 2024-09-12T16:17:06.154 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9187999999999997e-05 2024-09-12T16:17:06.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.154 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.154 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.154 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400056+0000", 2024-09-12T16:17:06.154 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8451e-05 2024-09-12T16:17:06.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.154 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.155 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:06.155 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400151+0000", 2024-09-12T16:17:06.155 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5026999999999997e-05 2024-09-12T16:17:06.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.155 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.155 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:06.155 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400345+0000", 2024-09-12T16:17:06.155 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019352900000000001 2024-09-12T16:17:06.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.155 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.155 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 1", 2024-09-12T16:17:06.155 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.401319+0000", 2024-09-12T16:17:06.155 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00097419399999999995 2024-09-12T16:17:06.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.156 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.156 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:17:06.156 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.429350+0000", 2024-09-12T16:17:06.156 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028030607999999999 2024-09-12T16:17:06.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.156 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.156 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:06.156 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.430907+0000", 2024-09-12T16:17:06.156 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001557466 2024-09-12T16:17:06.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.156 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.156 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:17:06.156 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.430966+0000", 2024-09-12T16:17:06.157 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9437e-05 2024-09-12T16:17:06.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.157 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.157 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:06.157 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.431007+0000", 2024-09-12T16:17:06.157 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0429999999999997e-05 2024-09-12T16:17:06.157 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.157 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:06.157 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.157 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.157 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:963 3.18 3:1b6fb776:::rbd_data.1155ccb1894c.0000000000000006:15 [read 8257536~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:06.157 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.589219+0000", 2024-09-12T16:17:06.158 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.5473651940000002, 2024-09-12T16:17:06.158 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036869616000000001, 2024-09-12T16:17:06.158 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:06.158 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:06.158 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:06.158 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:06.158 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:17:06.158 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:17:06.158 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 963 2024-09-12T16:17:06.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.158 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:06.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.158 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:06.158 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.589219+0000", 2024-09-12T16:17:06.159 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.159 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.159 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:06.159 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.589219+0000", 2024-09-12T16:17:06.159 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.159 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.159 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:06.159 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.589219+0000", 2024-09-12T16:17:06.159 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.01e-07 2024-09-12T16:17:06.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.159 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.159 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:06.160 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.589221+0000", 2024-09-12T16:17:06.160 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9999999999999999e-06 2024-09-12T16:17:06.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.160 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:06.160 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.589228+0000", 2024-09-12T16:17:06.160 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3799999999999999e-06 2024-09-12T16:17:06.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.160 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.160 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.589233+0000", 2024-09-12T16:17:06.160 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.135e-06 2024-09-12T16:17:06.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.161 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:06.161 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.625902+0000", 2024-09-12T16:17:06.161 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036668919000000001 2024-09-12T16:17:06.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.161 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:06.161 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.625957+0000", 2024-09-12T16:17:06.161 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5192000000000003e-05 2024-09-12T16:17:06.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.161 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:06.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.626088+0000", 2024-09-12T16:17:06.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013158899999999999 2024-09-12T16:17:06.162 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.162 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:06.162 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.162 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1128 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [read 1802240~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:06.162 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590009+0000", 2024-09-12T16:17:06.162 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.5465751560000003, 2024-09-12T16:17:06.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037087889999999998, 2024-09-12T16:17:06.162 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:06.162 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:06.162 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:06.163 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:06.163 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:17:06.163 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:17:06.163 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1128 2024-09-12T16:17:06.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.163 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:06.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:06.163 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590009+0000", 2024-09-12T16:17:06.163 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:06.164 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590009+0000", 2024-09-12T16:17:06.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.164 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.164 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:06.164 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590009+0000", 2024-09-12T16:17:06.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.46e-07 2024-09-12T16:17:06.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.164 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.164 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:06.164 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590018+0000", 2024-09-12T16:17:06.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7120000000000006e-06 2024-09-12T16:17:06.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.165 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.165 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:06.165 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590025+0000", 2024-09-12T16:17:06.165 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1600000000000001e-06 2024-09-12T16:17:06.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.165 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.165 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.165 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590031+0000", 2024-09-12T16:17:06.165 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8289999999999996e-06 2024-09-12T16:17:06.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.165 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.165 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:06.165 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.626874+0000", 2024-09-12T16:17:06.166 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036843072999999997 2024-09-12T16:17:06.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.166 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.166 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:06.166 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.626980+0000", 2024-09-12T16:17:06.166 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106057 2024-09-12T16:17:06.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.166 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.166 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:06.166 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627097+0000", 2024-09-12T16:17:06.166 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116613 2024-09-12T16:17:06.166 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.166 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:06.166 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.167 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.167 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1129 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [sparse-read 2195456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:06.167 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590039+0000", 2024-09-12T16:17:06.167 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.546545257, 2024-09-12T16:17:06.167 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037187049, 2024-09-12T16:17:06.167 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:06.167 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:06.167 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:06.167 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:06.167 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:17:06.167 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:17:06.167 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1129 2024-09-12T16:17:06.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.168 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:06.168 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.168 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:06.168 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590039+0000", 2024-09-12T16:17:06.168 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.168 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.168 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:06.168 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590039+0000", 2024-09-12T16:17:06.168 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.168 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.168 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:06.168 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590039+0000", 2024-09-12T16:17:06.169 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8700000000000001e-07 2024-09-12T16:17:06.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.169 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:06.169 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590041+0000", 2024-09-12T16:17:06.169 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1449999999999998e-06 2024-09-12T16:17:06.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.169 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:06.169 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590049+0000", 2024-09-12T16:17:06.169 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2830000000000004e-06 2024-09-12T16:17:06.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.170 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.170 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590054+0000", 2024-09-12T16:17:06.170 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1540000000000001e-06 2024-09-12T16:17:06.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.170 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:06.170 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627113+0000", 2024-09-12T16:17:06.170 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037059170000000002 2024-09-12T16:17:06.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.170 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:06.170 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627157+0000", 2024-09-12T16:17:06.170 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4069000000000001e-05 2024-09-12T16:17:06.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.171 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:06.171 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627226+0000", 2024-09-12T16:17:06.171 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8841e-05 2024-09-12T16:17:06.171 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.171 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:06.171 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.171 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.171 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1130 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [read 2621440~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:06.171 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590061+0000", 2024-09-12T16:17:06.171 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.5465230649999997, 2024-09-12T16:17:06.171 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037392033999999998, 2024-09-12T16:17:06.171 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:06.171 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:06.172 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:06.172 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:06.172 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:17:06.172 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:17:06.172 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1130 2024-09-12T16:17:06.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.172 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:06.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.172 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:06.172 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590061+0000", 2024-09-12T16:17:06.172 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.172 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:06.172 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590061+0000", 2024-09-12T16:17:06.173 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.173 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:06.173 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590061+0000", 2024-09-12T16:17:06.173 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4000000000000002e-07 2024-09-12T16:17:06.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.173 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:06.173 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590064+0000", 2024-09-12T16:17:06.173 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2539999999999999e-06 2024-09-12T16:17:06.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.174 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:06.174 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590071+0000", 2024-09-12T16:17:06.174 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9430000000000003e-06 2024-09-12T16:17:06.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.174 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.174 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590076+0000", 2024-09-12T16:17:06.174 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1159999999999998e-06 2024-09-12T16:17:06.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.174 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:06.174 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627262+0000", 2024-09-12T16:17:06.174 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037186581000000003 2024-09-12T16:17:06.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.175 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:06.175 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627348+0000", 2024-09-12T16:17:06.175 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5481000000000004e-05 2024-09-12T16:17:06.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.175 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:06.175 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627453+0000", 2024-09-12T16:17:06.175 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000105219 2024-09-12T16:17:06.175 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.175 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:06.176 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.176 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.176 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1131 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [read 3047424~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:06.176 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590082+0000", 2024-09-12T16:17:06.176 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.5465017569999997, 2024-09-12T16:17:06.176 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037515370999999999, 2024-09-12T16:17:06.176 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:06.176 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:06.176 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:06.176 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:06.176 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:17:06.176 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:17:06.176 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1131 2024-09-12T16:17:06.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.177 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:06.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.177 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:06.177 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590082+0000", 2024-09-12T16:17:06.177 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.177 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:06.177 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590082+0000", 2024-09-12T16:17:06.177 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.178 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:06.178 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590083+0000", 2024-09-12T16:17:06.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.34e-07 2024-09-12T16:17:06.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.178 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:06.178 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590086+0000", 2024-09-12T16:17:06.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5470000000000001e-06 2024-09-12T16:17:06.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.178 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:06.178 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590093+0000", 2024-09-12T16:17:06.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4740000000000002e-06 2024-09-12T16:17:06.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.179 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.179 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590098+0000", 2024-09-12T16:17:06.179 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2299999999999999e-06 2024-09-12T16:17:06.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.179 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:06.179 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627485+0000", 2024-09-12T16:17:06.179 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037386913000000001 2024-09-12T16:17:06.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.179 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:06.180 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627531+0000", 2024-09-12T16:17:06.180 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5723000000000003e-05 2024-09-12T16:17:06.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.180 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:06.180 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627598+0000", 2024-09-12T16:17:06.180 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7050000000000003e-05 2024-09-12T16:17:06.180 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.180 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:06.180 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.181 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1132 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [read 3440640~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:06.181 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590105+0000", 2024-09-12T16:17:06.181 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.5464790800000001, 2024-09-12T16:17:06.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037722536000000001, 2024-09-12T16:17:06.181 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:06.181 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:06.181 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:06.181 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:06.181 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:17:06.181 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:17:06.181 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1132 2024-09-12T16:17:06.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.182 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:06.182 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.182 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:06.182 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590105+0000", 2024-09-12T16:17:06.182 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.182 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.182 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:06.182 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590105+0000", 2024-09-12T16:17:06.182 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.183 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.183 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:06.183 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590105+0000", 2024-09-12T16:17:06.183 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0699999999999998e-07 2024-09-12T16:17:06.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.183 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.183 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:06.183 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590107+0000", 2024-09-12T16:17:06.183 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9709999999999998e-06 2024-09-12T16:17:06.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.183 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.183 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:06.184 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590114+0000", 2024-09-12T16:17:06.184 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6939999999999998e-06 2024-09-12T16:17:06.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.184 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.184 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.184 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590119+0000", 2024-09-12T16:17:06.184 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2900000000000002e-06 2024-09-12T16:17:06.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.184 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.184 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:06.184 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627637+0000", 2024-09-12T16:17:06.184 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037517803000000002 2024-09-12T16:17:06.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.184 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.185 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:06.185 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627724+0000", 2024-09-12T16:17:06.185 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6380999999999998e-05 2024-09-12T16:17:06.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.185 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.185 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:06.185 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627828+0000", 2024-09-12T16:17:06.185 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010399 2024-09-12T16:17:06.185 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.185 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:06.185 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.185 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.186 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1133 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [read 3866624~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:06.186 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590126+0000", 2024-09-12T16:17:06.186 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.5464579330000001, 2024-09-12T16:17:06.186 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037838388000000001, 2024-09-12T16:17:06.186 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:06.186 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:06.186 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:06.186 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:06.186 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:17:06.186 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:17:06.186 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1133 2024-09-12T16:17:06.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.187 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:06.187 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.187 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:06.187 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590126+0000", 2024-09-12T16:17:06.187 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.187 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.187 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:06.187 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590126+0000", 2024-09-12T16:17:06.187 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.187 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.187 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:06.188 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590127+0000", 2024-09-12T16:17:06.188 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9299999999999999e-07 2024-09-12T16:17:06.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.188 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.188 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:06.188 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590129+0000", 2024-09-12T16:17:06.188 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9929999999999998e-06 2024-09-12T16:17:06.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.188 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.188 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:06.188 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590135+0000", 2024-09-12T16:17:06.188 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5069999999999997e-06 2024-09-12T16:17:06.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.189 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.189 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.189 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590140+0000", 2024-09-12T16:17:06.189 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.271e-06 2024-09-12T16:17:06.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.189 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.189 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:06.189 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627859+0000", 2024-09-12T16:17:06.189 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037718805000000001 2024-09-12T16:17:06.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.189 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.189 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:06.189 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627905+0000", 2024-09-12T16:17:06.190 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5398000000000001e-05 2024-09-12T16:17:06.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.190 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.190 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:06.190 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627965+0000", 2024-09-12T16:17:06.190 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0021e-05 2024-09-12T16:17:06.190 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.190 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:06.190 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.190 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.190 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1134 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [read 4259840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:06.190 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590147+0000", 2024-09-12T16:17:06.190 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.5464374510000001, 2024-09-12T16:17:06.190 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038029861999999998, 2024-09-12T16:17:06.191 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:06.191 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:06.191 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:06.191 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:06.191 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:17:06.191 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:17:06.191 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1134 2024-09-12T16:17:06.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.191 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:06.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.191 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:06.191 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590147+0000", 2024-09-12T16:17:06.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.192 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:06.192 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590147+0000", 2024-09-12T16:17:06.192 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.192 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:06.192 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590147+0000", 2024-09-12T16:17:06.192 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2899999999999999e-07 2024-09-12T16:17:06.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.192 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:06.192 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590151+0000", 2024-09-12T16:17:06.192 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8430000000000003e-06 2024-09-12T16:17:06.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.193 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:06.193 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590158+0000", 2024-09-12T16:17:06.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7170000000000002e-06 2024-09-12T16:17:06.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.193 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.193 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590163+0000", 2024-09-12T16:17:06.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.074e-06 2024-09-12T16:17:06.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.193 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:06.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628000+0000", 2024-09-12T16:17:06.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037837588999999998 2024-09-12T16:17:06.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:06.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628081+0000", 2024-09-12T16:17:06.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1062000000000004e-05 2024-09-12T16:17:06.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:06.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628176+0000", 2024-09-12T16:17:06.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5148000000000004e-05 2024-09-12T16:17:06.195 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.195 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:06.195 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.195 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1135 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [read 4685824~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:06.195 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590169+0000", 2024-09-12T16:17:06.195 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.5464147820000003, 2024-09-12T16:17:06.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038127017999999999, 2024-09-12T16:17:06.195 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:06.195 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:06.195 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:06.195 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:06.196 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:17:06.196 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:17:06.196 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1135 2024-09-12T16:17:06.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.196 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:06.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.196 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:06.196 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590169+0000", 2024-09-12T16:17:06.196 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.196 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:06.196 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590169+0000", 2024-09-12T16:17:06.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:06.197 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590170+0000", 2024-09-12T16:17:06.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.15e-07 2024-09-12T16:17:06.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:06.197 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590172+0000", 2024-09-12T16:17:06.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9479999999999998e-06 2024-09-12T16:17:06.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:06.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590178+0000", 2024-09-12T16:17:06.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6660000000000002e-06 2024-09-12T16:17:06.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590183+0000", 2024-09-12T16:17:06.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0300000000000001e-06 2024-09-12T16:17:06.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:06.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628195+0000", 2024-09-12T16:17:06.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038011251000000003 2024-09-12T16:17:06.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:06.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628237+0000", 2024-09-12T16:17:06.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2354999999999997e-05 2024-09-12T16:17:06.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:06.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628296+0000", 2024-09-12T16:17:06.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9352999999999999e-05 2024-09-12T16:17:06.199 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.199 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:06.199 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.200 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1136 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [sparse-read 5079040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:06.200 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590189+0000", 2024-09-12T16:17:06.200 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.5463945690000003, 2024-09-12T16:17:06.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038326948999999999, 2024-09-12T16:17:06.200 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:06.200 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:06.200 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:06.200 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:06.200 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:17:06.200 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:17:06.200 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1136 2024-09-12T16:17:06.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.200 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:06.200 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.200 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:06.201 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590189+0000", 2024-09-12T16:17:06.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.201 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:06.201 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590189+0000", 2024-09-12T16:17:06.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.201 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:06.201 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590190+0000", 2024-09-12T16:17:06.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7e-07 2024-09-12T16:17:06.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.202 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:06.202 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590192+0000", 2024-09-12T16:17:06.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9e-06 2024-09-12T16:17:06.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.202 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:06.202 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590198+0000", 2024-09-12T16:17:06.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6420000000000001e-06 2024-09-12T16:17:06.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.202 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.202 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590203+0000", 2024-09-12T16:17:06.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6399999999999996e-06 2024-09-12T16:17:06.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:06.203 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628327+0000", 2024-09-12T16:17:06.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038123655999999999 2024-09-12T16:17:06.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:06.203 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628409+0000", 2024-09-12T16:17:06.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2040999999999996e-05 2024-09-12T16:17:06.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:06.203 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628516+0000", 2024-09-12T16:17:06.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0001077 2024-09-12T16:17:06.204 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.204 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:06.204 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.204 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1137 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [read 5505024~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:06.204 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590210+0000", 2024-09-12T16:17:06.204 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.5463739399999996, 2024-09-12T16:17:06.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038424246000000002, 2024-09-12T16:17:06.204 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:06.204 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:06.204 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:06.205 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:06.205 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:17:06.205 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:17:06.205 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1137 2024-09-12T16:17:06.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.205 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:06.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:06.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590210+0000", 2024-09-12T16:17:06.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:06.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590210+0000", 2024-09-12T16:17:06.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:06.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590210+0000", 2024-09-12T16:17:06.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.72e-07 2024-09-12T16:17:06.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:06.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590213+0000", 2024-09-12T16:17:06.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.311e-06 2024-09-12T16:17:06.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:06.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590219+0000", 2024-09-12T16:17:06.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4400000000000002e-06 2024-09-12T16:17:06.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590227+0000", 2024-09-12T16:17:06.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3880000000000002e-06 2024-09-12T16:17:06.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:06.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628531+0000", 2024-09-12T16:17:06.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038304546000000002 2024-09-12T16:17:06.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:06.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628580+0000", 2024-09-12T16:17:06.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8457e-05 2024-09-12T16:17:06.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:06.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628634+0000", 2024-09-12T16:17:06.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4731999999999997e-05 2024-09-12T16:17:06.208 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.208 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:06.209 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.209 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1138 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [read 5931008~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:06.209 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590235+0000", 2024-09-12T16:17:06.209 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.5463493709999998, 2024-09-12T16:17:06.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038616549, 2024-09-12T16:17:06.209 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:06.209 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:06.209 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:06.209 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:06.209 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:17:06.210 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:17:06.210 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1138 2024-09-12T16:17:06.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.210 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:06.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:06.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590235+0000", 2024-09-12T16:17:06.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:06.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590235+0000", 2024-09-12T16:17:06.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:06.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590235+0000", 2024-09-12T16:17:06.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4700000000000002e-07 2024-09-12T16:17:06.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:06.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590244+0000", 2024-09-12T16:17:06.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3449999999999995e-06 2024-09-12T16:17:06.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:06.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590252+0000", 2024-09-12T16:17:06.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7859999999999997e-06 2024-09-12T16:17:06.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590257+0000", 2024-09-12T16:17:06.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1410000000000004e-06 2024-09-12T16:17:06.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:06.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628668+0000", 2024-09-12T16:17:06.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038410776000000001 2024-09-12T16:17:06.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:06.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628750+0000", 2024-09-12T16:17:06.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2081000000000002e-05 2024-09-12T16:17:06.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:06.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628851+0000", 2024-09-12T16:17:06.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000100973 2024-09-12T16:17:06.213 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.213 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:06.213 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.214 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1139 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [read 6324224~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:06.214 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590265+0000", 2024-09-12T16:17:06.214 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.5463187630000004, 2024-09-12T16:17:06.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038713368999999997, 2024-09-12T16:17:06.214 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:06.214 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:06.214 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:06.214 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:06.214 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:17:06.214 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:17:06.214 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1139 2024-09-12T16:17:06.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.215 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:06.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:06.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590265+0000", 2024-09-12T16:17:06.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:06.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590265+0000", 2024-09-12T16:17:06.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:06.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590266+0000", 2024-09-12T16:17:06.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.32e-07 2024-09-12T16:17:06.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:06.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590268+0000", 2024-09-12T16:17:06.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3010000000000001e-06 2024-09-12T16:17:06.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:06.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590275+0000", 2024-09-12T16:17:06.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7120000000000003e-06 2024-09-12T16:17:06.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590280+0000", 2024-09-12T16:17:06.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1590000000000001e-06 2024-09-12T16:17:06.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:06.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628865+0000", 2024-09-12T16:17:06.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038584682000000002 2024-09-12T16:17:06.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:06.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628910+0000", 2024-09-12T16:17:06.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5130000000000003e-05 2024-09-12T16:17:06.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:06.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628979+0000", 2024-09-12T16:17:06.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8953000000000002e-05 2024-09-12T16:17:06.218 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.218 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:06.218 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.218 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1140 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [read 6750208~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:06.218 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590287+0000", 2024-09-12T16:17:06.218 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.5462973189999998, 2024-09-12T16:17:06.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038901031000000003, 2024-09-12T16:17:06.219 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:06.219 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:06.219 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:06.219 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:06.219 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:17:06.219 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:17:06.219 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1140 2024-09-12T16:17:06.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.219 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:06.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:06.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590287+0000", 2024-09-12T16:17:06.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.220 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:06.220 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590287+0000", 2024-09-12T16:17:06.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.220 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:06.220 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590287+0000", 2024-09-12T16:17:06.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.96e-07 2024-09-12T16:17:06.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.220 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:06.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590294+0000", 2024-09-12T16:17:06.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2130000000000002e-06 2024-09-12T16:17:06.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:06.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590302+0000", 2024-09-12T16:17:06.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2579999999999998e-06 2024-09-12T16:17:06.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590307+0000", 2024-09-12T16:17:06.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1970000000000004e-06 2024-09-12T16:17:06.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:06.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.629013+0000", 2024-09-12T16:17:06.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038705900000000001 2024-09-12T16:17:06.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:06.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.629091+0000", 2024-09-12T16:17:06.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8300000000000006e-05 2024-09-12T16:17:06.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:06.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.629188+0000", 2024-09-12T16:17:06.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6767000000000004e-05 2024-09-12T16:17:06.223 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.223 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:06.223 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.223 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1141 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [read 7143424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:06.223 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590316+0000", 2024-09-12T16:17:06.223 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.5462685650000001, 2024-09-12T16:17:06.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038993406000000001, 2024-09-12T16:17:06.223 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:06.223 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:06.223 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:06.224 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:06.224 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:17:06.224 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:17:06.224 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1141 2024-09-12T16:17:06.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.224 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:06.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:06.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590316+0000", 2024-09-12T16:17:06.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:06.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590316+0000", 2024-09-12T16:17:06.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:06.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590316+0000", 2024-09-12T16:17:06.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2199999999999999e-07 2024-09-12T16:17:06.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:06.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590318+0000", 2024-09-12T16:17:06.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.12e-06 2024-09-12T16:17:06.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:06.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590325+0000", 2024-09-12T16:17:06.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.708e-06 2024-09-12T16:17:06.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590331+0000", 2024-09-12T16:17:06.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2169999999999999e-06 2024-09-12T16:17:06.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:06.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.629220+0000", 2024-09-12T16:17:06.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038888859999999997 2024-09-12T16:17:06.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:06.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.629267+0000", 2024-09-12T16:17:06.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6966999999999999e-05 2024-09-12T16:17:06.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:06.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.629309+0000", 2024-09-12T16:17:06.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2111999999999999e-05 2024-09-12T16:17:06.228 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.228 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:06.228 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.228 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1142 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [read 7569408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:06.228 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590339+0000", 2024-09-12T16:17:06.228 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.5462455180000001, 2024-09-12T16:17:06.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039150314999999998, 2024-09-12T16:17:06.228 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:06.228 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:06.228 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:06.228 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:06.228 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:17:06.229 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:17:06.229 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1142 2024-09-12T16:17:06.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.229 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:06.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:06.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590339+0000", 2024-09-12T16:17:06.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:06.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590339+0000", 2024-09-12T16:17:06.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:06.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590339+0000", 2024-09-12T16:17:06.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0600000000000001e-07 2024-09-12T16:17:06.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:06.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590341+0000", 2024-09-12T16:17:06.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2000000000000001e-06 2024-09-12T16:17:06.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:06.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590348+0000", 2024-09-12T16:17:06.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0219999999999999e-06 2024-09-12T16:17:06.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590354+0000", 2024-09-12T16:17:06.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4500000000000003e-06 2024-09-12T16:17:06.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:06.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.629340+0000", 2024-09-12T16:17:06.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038986051000000001 2024-09-12T16:17:06.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:06.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.629415+0000", 2024-09-12T16:17:06.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5136999999999996e-05 2024-09-12T16:17:06.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:06.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.629489+0000", 2024-09-12T16:17:06.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4048999999999995e-05 2024-09-12T16:17:06.232 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.233 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:06.233 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.233 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1143 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [sparse-read 7962624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:06.233 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590360+0000", 2024-09-12T16:17:06.233 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.5462238130000001, 2024-09-12T16:17:06.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039250647999999999, 2024-09-12T16:17:06.233 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:06.233 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:06.233 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:06.233 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:06.234 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:17:06.234 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:17:06.234 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1143 2024-09-12T16:17:06.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.234 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:06.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:06.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590360+0000", 2024-09-12T16:17:06.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:06.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590360+0000", 2024-09-12T16:17:06.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:06.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:06.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590361+0000", 2024-09-12T16:17:06.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6300000000000001e-07 2024-09-12T16:17:06.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:06.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590363+0000", 2024-09-12T16:17:06.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9309999999999998e-06 2024-09-12T16:17:06.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:06.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590371+0000", 2024-09-12T16:17:06.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5960000000000004e-06 2024-09-12T16:17:06.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590376+0000", 2024-09-12T16:17:06.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3229999999999997e-06 2024-09-12T16:17:06.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:06.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.629506+0000", 2024-09-12T16:17:06.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039129215000000002 2024-09-12T16:17:06.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.237 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:06.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.629556+0000", 2024-09-12T16:17:06.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0685e-05 2024-09-12T16:17:06.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:06.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:06.237 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:06.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.629611+0000", 2024-09-12T16:17:06.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4534999999999999e-05 2024-09-12T16:17:06.237 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.238 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:06.238 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.238 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:06.238 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:06.238 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:06.239 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:17:06.240 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:06.238+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:06.340 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:06.340+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:06.356 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:06.356 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:17:06.357 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.357 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5223.0:1814 3.f 3.a38d8def (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-12T16:17:06.357 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:17:06.357 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.119310446, 2024-09-12T16:17:06.357 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.11932916, 2024-09-12T16:17:06.357 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:06.357 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:06.357 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "waiting for peered", 2024-09-12T16:17:06.357 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:06.357 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5223", 2024-09-12T16:17:06.357 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/4066330994", 2024-09-12T16:17:06.357 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1814 2024-09-12T16:17:06.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.358 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:06.358 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.358 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:06.358 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:17:06.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.358 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.358 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:06.358 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:17:06.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.358 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.358 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:06.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237252+0000", 2024-09-12T16:17:06.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.344e-06 2024-09-12T16:17:06.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.359 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:06.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237258+0000", 2024-09-12T16:17:06.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1070000000000001e-06 2024-09-12T16:17:06.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.359 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:06.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237270+0000", 2024-09-12T16:17:06.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1758e-05 2024-09-12T16:17:06.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.360 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.360 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.360 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237278+0000", 2024-09-12T16:17:06.360 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3219999999999993e-06 2024-09-12T16:17:06.360 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.360 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.360 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:06.360 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237334+0000", 2024-09-12T16:17:06.360 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6356e-05 2024-09-12T16:17:06.360 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.360 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.360 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:17:06.361 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237345+0000", 2024-09-12T16:17:06.361 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0433e-05 2024-09-12T16:17:06.361 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.361 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:06.361 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.361 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.361 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-12T16:17:06.361 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 1 2024-09-12T16:17:06.361 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:06.365 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:17:06.449 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:06.449+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:06.456 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:17:06.513 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:06.513 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:06.513 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:17:06.513 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:17:06.513 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:06.522 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:17:06.541 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:06.540+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:06.564 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:06.564 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:06.564 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:17:06.564 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:06.632 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:06.632 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:17:06.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:17:06.632 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:17:06.632 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.632 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:17:06.632 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:17:06.632 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 84.865846524999995, 2024-09-12T16:17:06.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55645454900000002, 2024-09-12T16:17:06.632 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:06.633 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:06.633 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:06.633 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:06.633 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:17:06.633 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:17:06.633 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1 2024-09-12T16:17:06.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.633 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:06.633 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.633 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:06.633 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:17:06.633 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.634 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.634 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:06.634 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:17:06.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.634 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.634 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:06.634 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764440+0000", 2024-09-12T16:17:06.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6249999999999999e-06 2024-09-12T16:17:06.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.634 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.635 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:06.635 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764447+0000", 2024-09-12T16:17:06.635 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4939999999999997e-06 2024-09-12T16:17:06.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.635 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.635 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:06.635 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764459+0000", 2024-09-12T16:17:06.635 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1517e-05 2024-09-12T16:17:06.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.635 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.635 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.636 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764468+0000", 2024-09-12T16:17:06.636 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7690000000000002e-06 2024-09-12T16:17:06.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.636 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.636 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:06.636 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764539+0000", 2024-09-12T16:17:06.636 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1103e-05 2024-09-12T16:17:06.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.636 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.636 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:17:06.636 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764551+0000", 2024-09-12T16:17:06.636 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2687999999999999e-05 2024-09-12T16:17:06.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.637 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.637 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:06.637 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319497+0000", 2024-09-12T16:17:06.637 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55494560500000001 2024-09-12T16:17:06.637 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.637 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.637 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:06.637 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319688+0000", 2024-09-12T16:17:06.637 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019105599999999999 2024-09-12T16:17:06.637 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.637 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.637 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:17:06.637 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319842+0000", 2024-09-12T16:17:06.638 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015377699999999999 2024-09-12T16:17:06.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.638 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.638 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:17:06.638 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320473+0000", 2024-09-12T16:17:06.638 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00063117100000000003 2024-09-12T16:17:06.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.638 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.638 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:06.638 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320825+0000", 2024-09-12T16:17:06.638 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00035202500000000001 2024-09-12T16:17:06.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.638 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.639 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:06.639 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320867+0000", 2024-09-12T16:17:06.639 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2005000000000002e-05 2024-09-12T16:17:06.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.639 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.639 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:06.639 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320893+0000", 2024-09-12T16:17:06.639 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5714000000000001e-05 2024-09-12T16:17:06.639 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.639 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:06.640 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.640 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.640 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14034 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5035008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:06.640 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:17:06.640 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 47.108788292, 2024-09-12T16:17:06.640 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053404082999999998, 2024-09-12T16:17:06.640 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:06.640 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:06.640 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:06.640 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:06.640 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:06.641 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:06.641 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14034 2024-09-12T16:17:06.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.641 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:06.641 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.641 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:06.641 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:17:06.641 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.641 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.641 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:06.641 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:17:06.642 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.642 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.642 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.642 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:06.642 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521740+0000", 2024-09-12T16:17:06.642 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000243976 2024-09-12T16:17:06.642 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.642 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.642 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:06.642 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521745+0000", 2024-09-12T16:17:06.642 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1280000000000001e-06 2024-09-12T16:17:06.642 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.642 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.642 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:06.643 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521757+0000", 2024-09-12T16:17:06.643 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2751e-05 2024-09-12T16:17:06.643 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.643 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.643 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.643 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521771+0000", 2024-09-12T16:17:06.643 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3328e-05 2024-09-12T16:17:06.643 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.643 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.643 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:06.643 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574710+0000", 2024-09-12T16:17:06.643 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052939358999999998 2024-09-12T16:17:06.643 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.644 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.644 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:06.644 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574799+0000", 2024-09-12T16:17:06.644 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8893000000000004e-05 2024-09-12T16:17:06.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.644 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.644 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:06.644 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574901+0000", 2024-09-12T16:17:06.644 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101648 2024-09-12T16:17:06.644 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.644 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:06.644 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.645 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.645 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14036 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5043200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:06.645 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:17:06.645 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 47.108329097999999, 2024-09-12T16:17:06.645 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053426247000000003, 2024-09-12T16:17:06.645 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:06.645 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:06.645 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:06.645 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:06.645 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:06.645 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:06.645 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14036 2024-09-12T16:17:06.645 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.646 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:06.646 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.646 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:06.646 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:17:06.646 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.646 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.646 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.646 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:06.646 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:17:06.646 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.646 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.646 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.646 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:06.646 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522208+0000", 2024-09-12T16:17:06.646 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025195300000000002 2024-09-12T16:17:06.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.647 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.647 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:06.647 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522211+0000", 2024-09-12T16:17:06.647 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2160000000000002e-06 2024-09-12T16:17:06.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.647 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.647 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:06.647 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522223+0000", 2024-09-12T16:17:06.647 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2044e-05 2024-09-12T16:17:06.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.647 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.647 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.648 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522229+0000", 2024-09-12T16:17:06.648 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8850000000000004e-06 2024-09-12T16:17:06.648 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.648 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.648 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:06.648 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575192+0000", 2024-09-12T16:17:06.648 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052963573 2024-09-12T16:17:06.648 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.648 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.648 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:06.648 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575282+0000", 2024-09-12T16:17:06.648 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9666000000000005e-05 2024-09-12T16:17:06.648 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.648 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.648 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:06.649 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575382+0000", 2024-09-12T16:17:06.649 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9909999999999997e-05 2024-09-12T16:17:06.649 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.649 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:06.649 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.649 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.649 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.649 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14037 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5047296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:06.649 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522245+0000", 2024-09-12T16:17:06.649 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 47.108040262999999, 2024-09-12T16:17:06.649 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053384907000000002, 2024-09-12T16:17:06.649 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:06.649 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:06.650 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:06.650 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:06.650 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:06.650 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:06.650 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14037 2024-09-12T16:17:06.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.650 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:06.650 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.650 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:06.650 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522245+0000", 2024-09-12T16:17:06.650 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.650 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.651 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:06.651 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522245+0000", 2024-09-12T16:17:06.651 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.651 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.651 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:06.651 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522471+0000", 2024-09-12T16:17:06.651 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022601300000000001 2024-09-12T16:17:06.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.651 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.651 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:06.651 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522474+0000", 2024-09-12T16:17:06.652 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3390000000000001e-06 2024-09-12T16:17:06.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.652 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.652 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:06.652 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522482+0000", 2024-09-12T16:17:06.652 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7919999999999993e-06 2024-09-12T16:17:06.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.652 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.652 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.652 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522486+0000", 2024-09-12T16:17:06.652 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5109999999999997e-06 2024-09-12T16:17:06.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.652 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.652 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:06.652 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575433+0000", 2024-09-12T16:17:06.653 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052946673999999999 2024-09-12T16:17:06.653 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.653 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.653 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:06.653 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575532+0000", 2024-09-12T16:17:06.653 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9128000000000004e-05 2024-09-12T16:17:06.653 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.653 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.653 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:06.653 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575629+0000", 2024-09-12T16:17:06.653 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7449999999999997e-05 2024-09-12T16:17:06.653 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.653 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:06.654 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.654 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.654 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.654 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14038 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5051392~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:06.654 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:17:06.654 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 47.107790725000001, 2024-09-12T16:17:06.654 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053395152000000001, 2024-09-12T16:17:06.654 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:06.654 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:06.654 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:06.654 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:06.654 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:06.654 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:06.655 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14038 2024-09-12T16:17:06.655 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.655 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:06.655 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.655 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:06.655 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:17:06.655 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.655 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.655 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.655 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:06.655 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:17:06.655 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.655 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.656 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.656 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:06.656 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522601+0000", 2024-09-12T16:17:06.656 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010702899999999999 2024-09-12T16:17:06.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.656 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.656 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:06.656 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522605+0000", 2024-09-12T16:17:06.656 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2379999999999999e-06 2024-09-12T16:17:06.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.656 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.656 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:06.656 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522616+0000", 2024-09-12T16:17:06.657 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1185999999999999e-05 2024-09-12T16:17:06.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.657 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.657 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.657 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522624+0000", 2024-09-12T16:17:06.657 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1099999999999997e-06 2024-09-12T16:17:06.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.657 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.657 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:06.657 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575677+0000", 2024-09-12T16:17:06.657 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053126999999999 2024-09-12T16:17:06.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.658 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.658 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:06.658 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575764+0000", 2024-09-12T16:17:06.658 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7250000000000007e-05 2024-09-12T16:17:06.658 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.658 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.658 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:06.658 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575889+0000", 2024-09-12T16:17:06.658 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012521200000000001 2024-09-12T16:17:06.658 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.658 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:06.658 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.658 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.658 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.659 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14039 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5055488~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:06.659 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:17:06.659 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 47.107649314, 2024-09-12T16:17:06.659 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053466207000000002, 2024-09-12T16:17:06.659 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:06.659 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:06.659 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:06.659 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:06.659 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:06.659 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:06.659 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14039 2024-09-12T16:17:06.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.660 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:06.660 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.660 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:06.660 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:17:06.660 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.660 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.660 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.660 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:06.660 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:17:06.660 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.660 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.660 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.660 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:06.660 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522899+0000", 2024-09-12T16:17:06.661 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026318199999999999 2024-09-12T16:17:06.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.661 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.661 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:06.661 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522903+0000", 2024-09-12T16:17:06.661 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.929e-06 2024-09-12T16:17:06.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.661 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.661 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:06.661 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522913+0000", 2024-09-12T16:17:06.661 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0162e-05 2024-09-12T16:17:06.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.662 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.662 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.662 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522921+0000", 2024-09-12T16:17:06.662 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.14e-06 2024-09-12T16:17:06.662 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.662 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.662 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:06.662 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575922+0000", 2024-09-12T16:17:06.662 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053000712999999998 2024-09-12T16:17:06.662 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.662 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.662 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:06.662 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576006+0000", 2024-09-12T16:17:06.663 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4161999999999998e-05 2024-09-12T16:17:06.663 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.663 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.663 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:06.663 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576102+0000", 2024-09-12T16:17:06.663 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5919000000000001e-05 2024-09-12T16:17:06.663 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.663 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:06.663 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.663 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.663 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.663 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14040 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5059584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:06.663 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:17:06.664 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 47.107344419, 2024-09-12T16:17:06.664 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053413258999999998, 2024-09-12T16:17:06.664 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:06.664 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:06.664 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:06.664 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:06.664 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:06.664 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:06.664 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14040 2024-09-12T16:17:06.664 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.664 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:06.664 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.664 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:06.665 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:17:06.665 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.665 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.665 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.665 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:06.665 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:17:06.665 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.665 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.665 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.665 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:06.665 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523059+0000", 2024-09-12T16:17:06.665 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118466 2024-09-12T16:17:06.665 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.665 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.665 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:06.666 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523062+0000", 2024-09-12T16:17:06.666 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.971e-06 2024-09-12T16:17:06.666 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.666 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.666 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:06.666 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523069+0000", 2024-09-12T16:17:06.666 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8279999999999997e-06 2024-09-12T16:17:06.666 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.666 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.666 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.666 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523073+0000", 2024-09-12T16:17:06.666 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3019999999999996e-06 2024-09-12T16:17:06.666 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.666 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.666 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:06.667 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576155+0000", 2024-09-12T16:17:06.667 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053081962000000003 2024-09-12T16:17:06.667 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.667 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.667 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:06.667 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576249+0000", 2024-09-12T16:17:06.667 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3914999999999998e-05 2024-09-12T16:17:06.667 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.667 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.667 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:06.667 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576354+0000", 2024-09-12T16:17:06.667 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010481500000000001 2024-09-12T16:17:06.667 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.667 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:06.668 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.668 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.668 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.668 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14041 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5063680~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:06.668 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:17:06.668 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 47.107194114000002, 2024-09-12T16:17:06.668 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053519111000000001, 2024-09-12T16:17:06.668 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:06.668 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:06.668 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:06.668 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:06.668 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:06.668 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:06.668 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14041 2024-09-12T16:17:06.669 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.669 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:06.669 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.669 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:06.669 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:17:06.669 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.669 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.669 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.669 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:06.669 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:17:06.669 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.669 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.669 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.669 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:06.670 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523309+0000", 2024-09-12T16:17:06.670 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000218712 2024-09-12T16:17:06.670 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.670 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.670 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:06.670 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523313+0000", 2024-09-12T16:17:06.670 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.151e-06 2024-09-12T16:17:06.670 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.670 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.670 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:06.670 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523320+0000", 2024-09-12T16:17:06.670 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9789999999999993e-06 2024-09-12T16:17:06.670 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.670 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.671 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.671 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523325+0000", 2024-09-12T16:17:06.671 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:17:06.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.671 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.671 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:06.671 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576402+0000", 2024-09-12T16:17:06.671 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053076811000000002 2024-09-12T16:17:06.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.671 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.671 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:06.671 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576491+0000", 2024-09-12T16:17:06.671 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8578999999999993e-05 2024-09-12T16:17:06.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.671 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.672 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:06.672 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576610+0000", 2024-09-12T16:17:06.672 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119129 2024-09-12T16:17:06.672 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.672 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:06.672 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.672 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.672 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.672 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14042 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5067776~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:06.672 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:17:06.672 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 47.106950679999997, 2024-09-12T16:17:06.672 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053510350999999998, 2024-09-12T16:17:06.672 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:06.673 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:06.673 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:06.673 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:06.673 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:06.673 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:06.673 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14042 2024-09-12T16:17:06.673 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.673 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:06.673 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.673 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:06.673 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:17:06.673 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.673 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.673 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.674 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:06.674 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:17:06.674 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.674 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.674 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.674 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:06.674 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523591+0000", 2024-09-12T16:17:06.674 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025710300000000001 2024-09-12T16:17:06.674 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.674 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.674 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:06.674 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523594+0000", 2024-09-12T16:17:06.674 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2229999999999999e-06 2024-09-12T16:17:06.674 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.675 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.675 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:06.675 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523602+0000", 2024-09-12T16:17:06.675 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6930000000000007e-06 2024-09-12T16:17:06.675 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.675 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.675 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.675 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523607+0000", 2024-09-12T16:17:06.675 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4789999999999998e-06 2024-09-12T16:17:06.675 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.675 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.675 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:06.675 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576661+0000", 2024-09-12T16:17:06.675 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053973999999997 2024-09-12T16:17:06.675 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.676 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.676 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:06.676 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576745+0000", 2024-09-12T16:17:06.676 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4660000000000006e-05 2024-09-12T16:17:06.676 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.676 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.676 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:06.676 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576844+0000", 2024-09-12T16:17:06.676 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9219e-05 2024-09-12T16:17:06.676 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.676 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:06.676 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.676 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.677 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.677 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14043 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5071872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:06.677 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:17:06.677 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 47.106670201, 2024-09-12T16:17:06.677 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053475295999999999, 2024-09-12T16:17:06.677 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:06.677 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:06.677 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:06.677 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:06.677 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:06.677 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:06.677 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14043 2024-09-12T16:17:06.677 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.677 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:06.678 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.678 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:06.678 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:17:06.678 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.678 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.678 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.678 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:06.678 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:17:06.678 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.678 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.678 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.678 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:06.678 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523823+0000", 2024-09-12T16:17:06.678 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020818900000000001 2024-09-12T16:17:06.678 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.679 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.679 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:06.679 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523826+0000", 2024-09-12T16:17:06.679 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.405e-06 2024-09-12T16:17:06.679 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.679 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.679 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:06.679 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523834+0000", 2024-09-12T16:17:06.679 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5499999999999997e-06 2024-09-12T16:17:06.679 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.679 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.679 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.679 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523838+0000", 2024-09-12T16:17:06.679 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.408e-06 2024-09-12T16:17:06.679 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.680 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.680 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:06.680 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576904+0000", 2024-09-12T16:17:06.680 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053065687 2024-09-12T16:17:06.680 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.680 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.680 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:06.680 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576991+0000", 2024-09-12T16:17:06.680 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7399999999999997e-05 2024-09-12T16:17:06.680 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.680 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.680 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:06.680 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577090+0000", 2024-09-12T16:17:06.680 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8657000000000001e-05 2024-09-12T16:17:06.681 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.681 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:06.681 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.681 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.681 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.681 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14044 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5075968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:06.681 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:17:06.681 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 47.106438670999999, 2024-09-12T16:17:06.681 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053442659000000003, 2024-09-12T16:17:06.681 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:06.681 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:06.681 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:06.682 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:06.682 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:06.682 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:06.682 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14044 2024-09-12T16:17:06.682 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.682 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:06.682 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.682 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:06.682 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:17:06.682 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.682 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.682 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.682 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:06.682 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:17:06.683 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.683 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.683 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.683 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:06.683 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523985+0000", 2024-09-12T16:17:06.683 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000138522 2024-09-12T16:17:06.683 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.683 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.683 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:06.683 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523988+0000", 2024-09-12T16:17:06.683 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.788e-06 2024-09-12T16:17:06.683 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.683 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.684 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:06.684 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523998+0000", 2024-09-12T16:17:06.684 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8470000000000008e-06 2024-09-12T16:17:06.684 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.684 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.684 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.684 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524010+0000", 2024-09-12T16:17:06.684 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1348999999999999e-05 2024-09-12T16:17:06.684 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.684 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.684 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:06.684 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577137+0000", 2024-09-12T16:17:06.685 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053127055999999999 2024-09-12T16:17:06.685 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.685 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.685 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:06.685 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577210+0000", 2024-09-12T16:17:06.685 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3392000000000005e-05 2024-09-12T16:17:06.685 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.685 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.685 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:06.685 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577289+0000", 2024-09-12T16:17:06.685 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8704999999999999e-05 2024-09-12T16:17:06.685 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.685 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:06.685 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.685 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.686 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.686 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14045 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5080064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:06.686 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:17:06.686 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 47.106259850000001, 2024-09-12T16:17:06.686 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053497514000000003, 2024-09-12T16:17:06.686 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:06.686 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:06.686 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:06.686 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:06.686 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:06.686 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:06.686 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14045 2024-09-12T16:17:06.686 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.686 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:06.687 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.687 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:06.687 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:17:06.687 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.687 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.687 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.687 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:06.687 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:17:06.687 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.687 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.687 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.687 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:06.687 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524311+0000", 2024-09-12T16:17:06.687 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028626299999999998 2024-09-12T16:17:06.688 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.688 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.688 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:06.688 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524315+0000", 2024-09-12T16:17:06.688 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0969999999999999e-06 2024-09-12T16:17:06.688 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.688 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.688 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:06.688 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524325+0000", 2024-09-12T16:17:06.688 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6330000000000008e-06 2024-09-12T16:17:06.688 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.688 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.688 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.688 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524332+0000", 2024-09-12T16:17:06.689 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8700000000000003e-06 2024-09-12T16:17:06.689 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.689 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.689 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:06.689 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577334+0000", 2024-09-12T16:17:06.689 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053001834999999997 2024-09-12T16:17:06.689 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.689 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.689 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:06.689 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577420+0000", 2024-09-12T16:17:06.689 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6145999999999998e-05 2024-09-12T16:17:06.689 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.689 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.690 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:06.690 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577522+0000", 2024-09-12T16:17:06.690 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010267 2024-09-12T16:17:06.690 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.690 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:06.690 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.690 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.690 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.690 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14047 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5088256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:06.690 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:17:06.690 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 47.105774124, 2024-09-12T16:17:06.690 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053433340000000003, 2024-09-12T16:17:06.690 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:06.690 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:06.691 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:06.691 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:06.691 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:06.691 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:06.691 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14047 2024-09-12T16:17:06.691 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.691 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:06.691 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.691 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:06.691 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:17:06.691 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.691 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.691 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.691 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:06.692 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:17:06.692 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.692 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.692 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.692 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:06.692 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524727+0000", 2024-09-12T16:17:06.692 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000216126 2024-09-12T16:17:06.692 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.692 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.692 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:06.692 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524732+0000", 2024-09-12T16:17:06.692 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1569999999999999e-06 2024-09-12T16:17:06.692 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.692 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.692 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:06.693 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524742+0000", 2024-09-12T16:17:06.693 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0186999999999999e-05 2024-09-12T16:17:06.693 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.693 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.693 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.693 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524750+0000", 2024-09-12T16:17:06.693 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4279999999999999e-06 2024-09-12T16:17:06.693 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.693 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.693 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:06.693 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577743+0000", 2024-09-12T16:17:06.693 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052993077 2024-09-12T16:17:06.693 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.693 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.694 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:06.694 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577841+0000", 2024-09-12T16:17:06.694 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8369000000000006e-05 2024-09-12T16:17:06.694 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.694 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.694 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:06.694 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577944+0000", 2024-09-12T16:17:06.694 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102996 2024-09-12T16:17:06.694 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.694 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:06.694 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.694 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.694 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.694 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14048 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5092352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:06.695 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:17:06.695 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 47.105522530999998, 2024-09-12T16:17:06.695 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053397515, 2024-09-12T16:17:06.695 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:06.695 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:06.695 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:06.695 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:06.695 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:06.695 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:06.695 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14048 2024-09-12T16:17:06.695 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.695 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:06.695 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.695 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:06.696 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:17:06.696 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.696 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.696 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.696 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:06.696 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:17:06.696 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.696 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.696 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.696 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:06.696 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524957+0000", 2024-09-12T16:17:06.697 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019516999999999999 2024-09-12T16:17:06.697 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.697 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.697 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:06.697 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524962+0000", 2024-09-12T16:17:06.697 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7709999999999997e-06 2024-09-12T16:17:06.697 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.697 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.697 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:06.697 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524973+0000", 2024-09-12T16:17:06.697 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1031e-05 2024-09-12T16:17:06.697 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.697 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.698 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.698 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524980+0000", 2024-09-12T16:17:06.698 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6100000000000002e-06 2024-09-12T16:17:06.698 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.698 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.698 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:06.698 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577977+0000", 2024-09-12T16:17:06.698 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052997481999999999 2024-09-12T16:17:06.698 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.698 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.698 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:06.698 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578062+0000", 2024-09-12T16:17:06.698 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4851000000000005e-05 2024-09-12T16:17:06.699 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.699 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.699 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:06.699 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578160+0000", 2024-09-12T16:17:06.699 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7600000000000001e-05 2024-09-12T16:17:06.699 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.699 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:06.699 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.699 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.699 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.699 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14049 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5096448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:06.699 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:17:06.699 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 47.105293903000003, 2024-09-12T16:17:06.700 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053439792, 2024-09-12T16:17:06.700 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:06.700 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:06.700 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:06.700 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:06.700 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:06.700 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:06.700 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14049 2024-09-12T16:17:06.700 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.700 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:06.700 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.700 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:06.700 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:17:06.700 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.701 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.701 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.701 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:06.701 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:17:06.701 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.701 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.701 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.701 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:06.701 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525170+0000", 2024-09-12T16:17:06.701 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017958500000000001 2024-09-12T16:17:06.701 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.701 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.701 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:06.702 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525174+0000", 2024-09-12T16:17:06.702 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0239999999999999e-06 2024-09-12T16:17:06.702 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.702 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.702 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:06.702 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525184+0000", 2024-09-12T16:17:06.702 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5950000000000005e-06 2024-09-12T16:17:06.702 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.702 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.702 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.702 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525191+0000", 2024-09-12T16:17:06.702 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8329999999999996e-06 2024-09-12T16:17:06.702 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.702 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.702 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:06.703 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578240+0000", 2024-09-12T16:17:06.703 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053049236 2024-09-12T16:17:06.703 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.703 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.703 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:06.703 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578333+0000", 2024-09-12T16:17:06.703 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2806999999999994e-05 2024-09-12T16:17:06.703 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.703 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.703 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:06.703 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578431+0000", 2024-09-12T16:17:06.704 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7712000000000002e-05 2024-09-12T16:17:06.704 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.704 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:06.704 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.704 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.704 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.704 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14050 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5100544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:06.704 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.525201+0000", 2024-09-12T16:17:06.704 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 47.105083350000001, 2024-09-12T16:17:06.704 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053367398000000003, 2024-09-12T16:17:06.704 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:06.704 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:06.704 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:06.705 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:06.705 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:06.705 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:06.705 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14050 2024-09-12T16:17:06.705 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.705 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:06.705 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.705 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:06.705 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525201+0000", 2024-09-12T16:17:06.705 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.705 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.706 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.706 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:06.706 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525201+0000", 2024-09-12T16:17:06.706 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.706 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.706 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.706 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:06.706 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525449+0000", 2024-09-12T16:17:06.706 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00024803999999999999 2024-09-12T16:17:06.706 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.706 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.706 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:06.706 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525453+0000", 2024-09-12T16:17:06.706 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.036e-06 2024-09-12T16:17:06.706 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.707 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.707 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:06.707 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525462+0000", 2024-09-12T16:17:06.707 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6090000000000001e-06 2024-09-12T16:17:06.707 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.707 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.707 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.707 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525472+0000", 2024-09-12T16:17:06.707 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9629999999999993e-06 2024-09-12T16:17:06.707 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.707 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.708 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:06.708 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578469+0000", 2024-09-12T16:17:06.708 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052996877999999997 2024-09-12T16:17:06.708 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.708 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.708 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:06.708 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578514+0000", 2024-09-12T16:17:06.708 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5460000000000002e-05 2024-09-12T16:17:06.708 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.708 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.708 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:06.708 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578569+0000", 2024-09-12T16:17:06.708 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4412e-05 2024-09-12T16:17:06.709 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.709 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:06.709 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.709 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.709 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.709 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14054 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5116928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:06.709 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.526046+0000", 2024-09-12T16:17:06.709 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 47.104238553999998, 2024-09-12T16:17:06.709 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053378408000000002, 2024-09-12T16:17:06.709 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:06.709 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:06.709 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:06.709 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:06.709 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:06.710 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:06.710 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14054 2024-09-12T16:17:06.710 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.710 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:06.710 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.710 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:06.710 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526046+0000", 2024-09-12T16:17:06.710 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.710 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.710 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.710 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:06.710 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526046+0000", 2024-09-12T16:17:06.710 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.710 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.711 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.711 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:06.711 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526228+0000", 2024-09-12T16:17:06.711 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018200200000000001 2024-09-12T16:17:06.711 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.711 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.711 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:06.711 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526236+0000", 2024-09-12T16:17:06.711 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5109999999999997e-06 2024-09-12T16:17:06.711 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.711 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.711 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:06.711 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526245+0000", 2024-09-12T16:17:06.711 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9600000000000006e-06 2024-09-12T16:17:06.712 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.712 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.712 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.712 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526251+0000", 2024-09-12T16:17:06.712 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5520000000000001e-06 2024-09-12T16:17:06.712 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.712 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.712 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:06.712 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579226+0000", 2024-09-12T16:17:06.712 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052974343 2024-09-12T16:17:06.712 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.712 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.712 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:06.712 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579324+0000", 2024-09-12T16:17:06.712 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8517000000000006e-05 2024-09-12T16:17:06.713 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.713 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.713 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:06.713 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579425+0000", 2024-09-12T16:17:06.713 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000100523 2024-09-12T16:17:06.713 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.713 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:06.713 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.713 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.713 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.713 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14055 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5121024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:06.713 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:17:06.713 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 47.104023212000001, 2024-09-12T16:17:06.714 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053399038000000003, 2024-09-12T16:17:06.714 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:06.714 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:06.714 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:06.714 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:06.714 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:06.714 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:06.714 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14055 2024-09-12T16:17:06.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.714 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:06.714 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.714 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:06.714 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:17:06.715 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.715 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.715 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:06.715 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:17:06.715 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.715 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.715 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:06.715 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526403+0000", 2024-09-12T16:17:06.715 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141571 2024-09-12T16:17:06.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.715 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.716 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:06.716 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526406+0000", 2024-09-12T16:17:06.716 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2660000000000002e-06 2024-09-12T16:17:06.716 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.716 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.716 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:06.716 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526420+0000", 2024-09-12T16:17:06.716 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3949e-05 2024-09-12T16:17:06.716 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.716 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.716 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.716 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526428+0000", 2024-09-12T16:17:06.716 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4250000000000001e-06 2024-09-12T16:17:06.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.717 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.717 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:06.717 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579476+0000", 2024-09-12T16:17:06.717 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053048349000000002 2024-09-12T16:17:06.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.717 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.717 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:06.717 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579563+0000", 2024-09-12T16:17:06.717 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6502999999999995e-05 2024-09-12T16:17:06.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.717 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.717 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:06.717 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579661+0000", 2024-09-12T16:17:06.718 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7974999999999996e-05 2024-09-12T16:17:06.718 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.718 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:06.718 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.718 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.718 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.718 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4806.0:3139 3.1e 3:78d5a095:::rbd_data.11552a37e55b.0000000000000000:head [read 69632~61440] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:17:06.718 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:06.718 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 36.329028962000002, 2024-09-12T16:17:06.718 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057851734000000002, 2024-09-12T16:17:06.718 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:06.718 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:06.718 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:06.719 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:06.719 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4806", 2024-09-12T16:17:06.719 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3959815836", 2024-09-12T16:17:06.719 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 3139 2024-09-12T16:17:06.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.719 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:06.719 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.719 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:06.719 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:06.719 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.719 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.719 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:06.720 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:06.720 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.720 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.720 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:06.720 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:06.720 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4799999999999999e-07 2024-09-12T16:17:06.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.720 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.720 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:06.720 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301258+0000", 2024-09-12T16:17:06.720 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.844e-06 2024-09-12T16:17:06.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.721 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.721 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:06.721 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301267+0000", 2024-09-12T16:17:06.721 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2960000000000004e-06 2024-09-12T16:17:06.721 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.721 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.721 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.721 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301276+0000", 2024-09-12T16:17:06.721 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0650000000000005e-06 2024-09-12T16:17:06.721 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.721 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.721 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:06.721 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301871+0000", 2024-09-12T16:17:06.722 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00059423600000000005 2024-09-12T16:17:06.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.722 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.722 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:06.722 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301920+0000", 2024-09-12T16:17:06.722 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9067000000000003e-05 2024-09-12T16:17:06.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.722 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.722 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:06.723 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359108+0000", 2024-09-12T16:17:06.723 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057187877999999998 2024-09-12T16:17:06.723 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.723 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:06.723 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.723 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.723 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:6428 3.14 3:28a44e54:::rbd_header.11552a37e55b:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:17:06.723 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:17:06.723 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 36.328700368, 2024-09-12T16:17:06.723 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057504023000000001, 2024-09-12T16:17:06.723 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:06.723 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:06.723 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:06.724 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:06.724 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:17:06.724 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:17:06.724 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6428 2024-09-12T16:17:06.724 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.724 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:06.724 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.724 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:06.724 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:17:06.724 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.724 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.724 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.724 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:06.725 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:17:06.725 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:06.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.725 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.725 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:06.725 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301585+0000", 2024-09-12T16:17:06.725 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6300000000000005e-07 2024-09-12T16:17:06.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.725 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.725 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:06.726 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301588+0000", 2024-09-12T16:17:06.726 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4149999999999999e-06 2024-09-12T16:17:06.726 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.726 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.726 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:06.726 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301597+0000", 2024-09-12T16:17:06.726 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5450000000000003e-06 2024-09-12T16:17:06.726 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.726 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.726 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:06.726 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301617+0000", 2024-09-12T16:17:06.726 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9837e-05 2024-09-12T16:17:06.726 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.727 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:06.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301779+0000", 2024-09-12T16:17:06.727 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016186799999999999 2024-09-12T16:17:06.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.727 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:06.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301855+0000", 2024-09-12T16:17:06.727 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5899e-05 2024-09-12T16:17:06.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:06.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:06.727 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:06.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359088+0000", 2024-09-12T16:17:06.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057233895999999999 2024-09-12T16:17:06.728 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.728 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:06.728 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.728 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:06.728 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:06.728 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:06.729 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:17:06.730 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:06.729+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:06.830 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:06.830+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:06.880 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:06.880 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:06.880 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:17:06.880 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:06.888 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:17:06.931 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:06.931+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:07.031 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:07.031+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:07.036 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:07.036 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:07.036 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:17:07.036 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:17:07.036 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:07.044 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:17:07.132 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:07.131+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:07.193 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:07.193 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:17:07.193 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:17:07.193 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:17:07.193 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.193 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5599 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4788224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:07.194 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:17:07.194 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 26.895540778000001, 2024-09-12T16:17:07.194 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061192059, 2024-09-12T16:17:07.194 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.194 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.194 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:07.194 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:07.194 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:07.194 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:07.194 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5599 2024-09-12T16:17:07.194 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.194 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.194 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:17:07.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:17:07.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296333+0000", 2024-09-12T16:17:07.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6599999999999996e-07 2024-09-12T16:17:07.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.196 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.196 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296335+0000", 2024-09-12T16:17:07.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5900000000000002e-06 2024-09-12T16:17:07.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.196 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.196 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296344+0000", 2024-09-12T16:17:07.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9539999999999993e-06 2024-09-12T16:17:07.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.196 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.197 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296350+0000", 2024-09-12T16:17:07.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5589999999999996e-06 2024-09-12T16:17:07.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.197 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.197 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.197 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357307+0000", 2024-09-12T16:17:07.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.060957573000000001 2024-09-12T16:17:07.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.197 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.197 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.197 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357401+0000", 2024-09-12T16:17:07.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3512999999999997e-05 2024-09-12T16:17:07.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.198 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.198 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.198 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357524+0000", 2024-09-12T16:17:07.198 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000123304 2024-09-12T16:17:07.198 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.198 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.198 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.198 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.198 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5611 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4730880~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:07.198 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:17:07.198 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 26.895478334, 2024-09-12T16:17:07.198 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061359348000000001, 2024-09-12T16:17:07.199 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.199 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.199 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:07.199 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:07.199 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:07.199 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:07.199 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5611 2024-09-12T16:17:07.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.199 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.199 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:17:07.199 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:17:07.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296395+0000", 2024-09-12T16:17:07.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4600000000000003e-07 2024-09-12T16:17:07.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296399+0000", 2024-09-12T16:17:07.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9430000000000002e-06 2024-09-12T16:17:07.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.201 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.201 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.201 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296411+0000", 2024-09-12T16:17:07.201 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1755e-05 2024-09-12T16:17:07.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.201 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.201 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.201 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296417+0000", 2024-09-12T16:17:07.201 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3790000000000003e-06 2024-09-12T16:17:07.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.201 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.202 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.202 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357572+0000", 2024-09-12T16:17:07.202 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061154871 2024-09-12T16:17:07.202 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.202 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.202 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.202 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357663+0000", 2024-09-12T16:17:07.202 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0389999999999993e-05 2024-09-12T16:17:07.202 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.202 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.202 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.202 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357754+0000", 2024-09-12T16:17:07.202 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1063999999999994e-05 2024-09-12T16:17:07.202 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.203 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.203 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.203 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5613 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4775936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:07.203 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:07.203 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 26.895437154, 2024-09-12T16:17:07.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061491777999999997, 2024-09-12T16:17:07.203 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.203 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.203 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:07.203 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:07.203 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:07.204 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:07.204 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5613 2024-09-12T16:17:07.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.204 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.204 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.204 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.204 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:07.204 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.204 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.204 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.204 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:07.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.205 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.205 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:07.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8899999999999999e-07 2024-09-12T16:17:07.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.205 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.205 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296439+0000", 2024-09-12T16:17:07.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8439999999999998e-06 2024-09-12T16:17:07.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.205 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.206 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296452+0000", 2024-09-12T16:17:07.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2639e-05 2024-09-12T16:17:07.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.206 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.206 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.206 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296457+0000", 2024-09-12T16:17:07.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5720000000000002e-06 2024-09-12T16:17:07.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.206 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.206 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.206 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357773+0000", 2024-09-12T16:17:07.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061315500000000002 2024-09-12T16:17:07.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.206 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.207 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.207 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357814+0000", 2024-09-12T16:17:07.207 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1448e-05 2024-09-12T16:17:07.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.207 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.207 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357927+0000", 2024-09-12T16:17:07.207 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000113186 2024-09-12T16:17:07.207 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.207 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.207 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.207 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5616 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4784128~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:07.208 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:07.208 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 26.895402092000001, 2024-09-12T16:17:07.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061725002000000001, 2024-09-12T16:17:07.208 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.208 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.208 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:07.208 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:07.208 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:07.208 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:07.208 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5616 2024-09-12T16:17:07.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.208 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:07.209 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:07.209 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.210 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:07.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5900000000000002e-07 2024-09-12T16:17:07.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.210 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.210 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.210 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296473+0000", 2024-09-12T16:17:07.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3130000000000001e-06 2024-09-12T16:17:07.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.210 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.210 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.210 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296481+0000", 2024-09-12T16:17:07.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1389999999999998e-06 2024-09-12T16:17:07.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.211 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.211 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296486+0000", 2024-09-12T16:17:07.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3310000000000003e-06 2024-09-12T16:17:07.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.211 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.211 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357981+0000", 2024-09-12T16:17:07.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061494866000000002 2024-09-12T16:17:07.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.211 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.211 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358082+0000", 2024-09-12T16:17:07.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101424 2024-09-12T16:17:07.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358196+0000", 2024-09-12T16:17:07.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011347 2024-09-12T16:17:07.212 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.212 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.212 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.212 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5626 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4739072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:07.212 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:17:07.212 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 26.895324135999999, 2024-09-12T16:17:07.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061802430999999998, 2024-09-12T16:17:07.213 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.213 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.213 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:07.213 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:07.213 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:07.213 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:07.213 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5626 2024-09-12T16:17:07.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.213 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.213 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.213 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:17:07.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.214 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.214 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:17:07.214 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.214 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.214 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296550+0000", 2024-09-12T16:17:07.214 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.215e-06 2024-09-12T16:17:07.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.214 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.214 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296555+0000", 2024-09-12T16:17:07.214 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9590000000000003e-06 2024-09-12T16:17:07.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.215 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.215 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296568+0000", 2024-09-12T16:17:07.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3338e-05 2024-09-12T16:17:07.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.215 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.215 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296576+0000", 2024-09-12T16:17:07.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5510000000000002e-06 2024-09-12T16:17:07.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.215 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.216 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358241+0000", 2024-09-12T16:17:07.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.06166576 2024-09-12T16:17:07.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.216 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.216 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358288+0000", 2024-09-12T16:17:07.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6097000000000003e-05 2024-09-12T16:17:07.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.216 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.216 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358351+0000", 2024-09-12T16:17:07.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3510999999999996e-05 2024-09-12T16:17:07.216 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.216 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.217 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.217 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5628 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4792320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:07.217 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:17:07.217 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 26.895281636, 2024-09-12T16:17:07.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061961161000000001, 2024-09-12T16:17:07.217 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.217 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.217 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:07.217 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:07.217 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:07.218 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:07.218 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5628 2024-09-12T16:17:07.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.218 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:17:07.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:17:07.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296592+0000", 2024-09-12T16:17:07.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2099999999999996e-07 2024-09-12T16:17:07.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296595+0000", 2024-09-12T16:17:07.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0429999999999999e-06 2024-09-12T16:17:07.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296603+0000", 2024-09-12T16:17:07.220 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9899999999999997e-06 2024-09-12T16:17:07.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.220 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.220 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.220 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296609+0000", 2024-09-12T16:17:07.220 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7259999999999999e-06 2024-09-12T16:17:07.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.220 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.220 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.220 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358393+0000", 2024-09-12T16:17:07.220 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061784617 2024-09-12T16:17:07.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.220 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.221 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.221 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358460+0000", 2024-09-12T16:17:07.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7253000000000001e-05 2024-09-12T16:17:07.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.221 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.221 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.221 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358552+0000", 2024-09-12T16:17:07.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1811000000000006e-05 2024-09-12T16:17:07.221 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.221 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.221 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.221 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.222 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5638 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4734976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:07.222 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:07.222 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 26.894809084999999, 2024-09-12T16:17:07.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061654460000000001, 2024-09-12T16:17:07.222 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.222 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.222 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:07.222 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:07.222 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:07.222 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:07.222 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5638 2024-09-12T16:17:07.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.222 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:07.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:07.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:07.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.23e-07 2024-09-12T16:17:07.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297068+0000", 2024-09-12T16:17:07.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0060000000000003e-06 2024-09-12T16:17:07.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297080+0000", 2024-09-12T16:17:07.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1234e-05 2024-09-12T16:17:07.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297095+0000", 2024-09-12T16:17:07.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5698000000000001e-05 2024-09-12T16:17:07.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358582+0000", 2024-09-12T16:17:07.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061486274 2024-09-12T16:17:07.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358637+0000", 2024-09-12T16:17:07.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5439999999999998e-05 2024-09-12T16:17:07.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358718+0000", 2024-09-12T16:17:07.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0984999999999998e-05 2024-09-12T16:17:07.226 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.226 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.226 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.226 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5640 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4780032~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:07.226 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:17:07.226 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 26.894727365000001, 2024-09-12T16:17:07.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061746620000000002, 2024-09-12T16:17:07.226 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.227 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.227 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:07.227 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:07.227 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:07.227 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:07.227 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5640 2024-09-12T16:17:07.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.227 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.227 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.227 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.227 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:17:07.227 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.228 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.228 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:17:07.228 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.228 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.228 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297146+0000", 2024-09-12T16:17:07.228 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3600000000000003e-07 2024-09-12T16:17:07.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.228 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.228 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297150+0000", 2024-09-12T16:17:07.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8430000000000003e-06 2024-09-12T16:17:07.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297160+0000", 2024-09-12T16:17:07.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7229999999999999e-06 2024-09-12T16:17:07.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297167+0000", 2024-09-12T16:17:07.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0180000000000004e-06 2024-09-12T16:17:07.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358750+0000", 2024-09-12T16:17:07.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061583104 2024-09-12T16:17:07.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358804+0000", 2024-09-12T16:17:07.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4277000000000002e-05 2024-09-12T16:17:07.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.231 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358892+0000", 2024-09-12T16:17:07.231 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7918999999999996e-05 2024-09-12T16:17:07.231 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.231 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.231 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.231 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.231 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5642 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4788224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:07.231 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:07.231 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 26.894683020999999, 2024-09-12T16:17:07.231 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061860409999999998, 2024-09-12T16:17:07.231 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.231 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.232 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:07.232 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:07.232 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:07.232 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:07.232 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5642 2024-09-12T16:17:07.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.232 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.232 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:07.232 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.233 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.233 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:07.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.233 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.233 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:07.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7999999999999995e-07 2024-09-12T16:17:07.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.233 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.233 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297193+0000", 2024-09-12T16:17:07.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8310000000000001e-06 2024-09-12T16:17:07.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.234 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.234 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.234 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297204+0000", 2024-09-12T16:17:07.234 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0832999999999999e-05 2024-09-12T16:17:07.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.234 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.234 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.234 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297210+0000", 2024-09-12T16:17:07.234 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1770000000000003e-06 2024-09-12T16:17:07.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.234 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.234 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.234 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358928+0000", 2024-09-12T16:17:07.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061717826000000003 2024-09-12T16:17:07.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.235 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.235 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.235 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358977+0000", 2024-09-12T16:17:07.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9514000000000001e-05 2024-09-12T16:17:07.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.235 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.235 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.235 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359050+0000", 2024-09-12T16:17:07.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2649000000000002e-05 2024-09-12T16:17:07.235 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.235 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.236 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.236 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.236 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.236 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5646 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4743168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:07.236 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:07.236 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 26.89450308, 2024-09-12T16:17:07.236 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061822122, 2024-09-12T16:17:07.236 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.236 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.236 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:07.236 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:07.236 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:07.236 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:07.237 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5646 2024-09-12T16:17:07.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.237 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.237 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.237 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.237 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:07.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.237 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.237 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.237 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:07.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.238 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.238 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:07.238 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3200000000000004e-07 2024-09-12T16:17:07.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.238 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.238 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297374+0000", 2024-09-12T16:17:07.238 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8240000000000001e-06 2024-09-12T16:17:07.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.238 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.238 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297384+0000", 2024-09-12T16:17:07.238 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5710000000000004e-06 2024-09-12T16:17:07.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.239 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.239 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297390+0000", 2024-09-12T16:17:07.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5130000000000002e-06 2024-09-12T16:17:07.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.239 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.239 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359080+0000", 2024-09-12T16:17:07.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061689569999999999 2024-09-12T16:17:07.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.240 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.240 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359134+0000", 2024-09-12T16:17:07.240 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3838999999999997e-05 2024-09-12T16:17:07.240 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.240 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.240 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.240 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359192+0000", 2024-09-12T16:17:07.240 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8072999999999998e-05 2024-09-12T16:17:07.240 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.240 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.240 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.240 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.240 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.241 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5647 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4751360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:07.241 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:17:07.241 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 26.894466394999998, 2024-09-12T16:17:07.241 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061927569000000002, 2024-09-12T16:17:07.241 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.241 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.241 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:07.241 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:07.241 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:07.241 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:07.241 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5647 2024-09-12T16:17:07.241 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.241 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.242 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.242 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.242 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:17:07.242 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.242 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.242 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.242 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.242 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:17:07.242 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.242 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.242 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.242 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.242 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297407+0000", 2024-09-12T16:17:07.242 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.46e-07 2024-09-12T16:17:07.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.243 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.243 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297409+0000", 2024-09-12T16:17:07.243 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.469e-06 2024-09-12T16:17:07.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.243 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.243 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297415+0000", 2024-09-12T16:17:07.243 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9259999999999997e-06 2024-09-12T16:17:07.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.244 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.244 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297419+0000", 2024-09-12T16:17:07.244 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3840000000000001e-06 2024-09-12T16:17:07.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.244 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.244 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.244 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359224+0000", 2024-09-12T16:17:07.244 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061805367999999999 2024-09-12T16:17:07.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.244 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.244 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.244 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359275+0000", 2024-09-12T16:17:07.244 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1338000000000002e-05 2024-09-12T16:17:07.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.245 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.245 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.245 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359334+0000", 2024-09-12T16:17:07.245 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8638000000000003e-05 2024-09-12T16:17:07.245 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.245 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.245 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.245 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.245 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5649 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4796416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:07.245 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:17:07.245 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 26.894411536, 2024-09-12T16:17:07.246 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.062018578999999997, 2024-09-12T16:17:07.246 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.246 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.246 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:07.246 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:07.246 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:07.246 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:07.246 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5649 2024-09-12T16:17:07.246 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.246 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.246 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.246 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.246 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:17:07.247 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.247 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.247 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:17:07.247 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.247 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.247 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297462+0000", 2024-09-12T16:17:07.247 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2399999999999998e-07 2024-09-12T16:17:07.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.248 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.248 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297465+0000", 2024-09-12T16:17:07.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.371e-06 2024-09-12T16:17:07.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.248 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.248 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.248 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297473+0000", 2024-09-12T16:17:07.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4699999999999996e-06 2024-09-12T16:17:07.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.248 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.248 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.248 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297478+0000", 2024-09-12T16:17:07.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2780000000000001e-06 2024-09-12T16:17:07.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.249 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.249 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359368+0000", 2024-09-12T16:17:07.249 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061889758000000003 2024-09-12T16:17:07.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.249 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.249 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359420+0000", 2024-09-12T16:17:07.249 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2574999999999997e-05 2024-09-12T16:17:07.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.249 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.250 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359480+0000", 2024-09-12T16:17:07.250 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9503000000000003e-05 2024-09-12T16:17:07.250 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.250 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.250 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.250 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.250 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.250 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5674 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4739072~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:07.250 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:17:07.250 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 26.894007768000002, 2024-09-12T16:17:07.250 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061762989999999997, 2024-09-12T16:17:07.250 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.250 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.251 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:07.251 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:07.251 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:07.251 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:07.251 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5674 2024-09-12T16:17:07.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.251 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.251 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.251 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.251 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:17:07.251 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.251 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.252 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:17:07.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.252 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297866+0000", 2024-09-12T16:17:07.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1900000000000001e-07 2024-09-12T16:17:07.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.252 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297870+0000", 2024-09-12T16:17:07.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3560000000000003e-06 2024-09-12T16:17:07.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297888+0000", 2024-09-12T16:17:07.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8088999999999999e-05 2024-09-12T16:17:07.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297904+0000", 2024-09-12T16:17:07.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5971e-05 2024-09-12T16:17:07.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.254 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359510+0000", 2024-09-12T16:17:07.254 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061605634999999999 2024-09-12T16:17:07.254 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.254 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.254 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.254 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359554+0000", 2024-09-12T16:17:07.254 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4024999999999999e-05 2024-09-12T16:17:07.254 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.254 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.254 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.254 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359628+0000", 2024-09-12T16:17:07.254 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4095000000000001e-05 2024-09-12T16:17:07.254 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.254 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.255 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.255 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5676 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4792320~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:07.255 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:17:07.255 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 26.893806688000002, 2024-09-12T16:17:07.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061720143999999998, 2024-09-12T16:17:07.255 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.255 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.255 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:07.255 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:07.255 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:07.255 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:07.256 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5676 2024-09-12T16:17:07.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.256 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.256 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.256 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:17:07.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.256 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.256 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:17:07.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.257 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.257 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298067+0000", 2024-09-12T16:17:07.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8199999999999999e-07 2024-09-12T16:17:07.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.257 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.257 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298070+0000", 2024-09-12T16:17:07.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.743e-06 2024-09-12T16:17:07.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.257 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.257 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298080+0000", 2024-09-12T16:17:07.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4059999999999994e-06 2024-09-12T16:17:07.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.258 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298088+0000", 2024-09-12T16:17:07.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0779999999999996e-06 2024-09-12T16:17:07.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.258 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359659+0000", 2024-09-12T16:17:07.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061570688999999998 2024-09-12T16:17:07.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.258 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.259 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359713+0000", 2024-09-12T16:17:07.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3939e-05 2024-09-12T16:17:07.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.259 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.259 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359786+0000", 2024-09-12T16:17:07.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3607000000000002e-05 2024-09-12T16:17:07.259 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.259 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.259 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.259 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5684 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4747264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:07.259 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:17:07.260 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 26.893339396000002, 2024-09-12T16:17:07.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061394799, 2024-09-12T16:17:07.260 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.260 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.260 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:07.260 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:07.260 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:07.260 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:07.260 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5684 2024-09-12T16:17:07.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.260 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.260 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.261 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:17:07.261 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.261 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.261 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:17:07.261 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.261 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.261 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298534+0000", 2024-09-12T16:17:07.261 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4399999999999999e-07 2024-09-12T16:17:07.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298539+0000", 2024-09-12T16:17:07.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5360000000000003e-06 2024-09-12T16:17:07.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298550+0000", 2024-09-12T16:17:07.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1499e-05 2024-09-12T16:17:07.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298558+0000", 2024-09-12T16:17:07.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3000000000000004e-06 2024-09-12T16:17:07.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.263 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.263 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.263 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359815+0000", 2024-09-12T16:17:07.263 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061257952999999997 2024-09-12T16:17:07.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.263 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.263 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.263 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359868+0000", 2024-09-12T16:17:07.263 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2317000000000001e-05 2024-09-12T16:17:07.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.263 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.263 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.263 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359928+0000", 2024-09-12T16:17:07.264 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0350000000000003e-05 2024-09-12T16:17:07.264 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.264 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.264 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.264 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5686 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4755456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:07.264 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:17:07.264 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 26.893171972000001, 2024-09-12T16:17:07.264 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061355082999999998, 2024-09-12T16:17:07.264 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.264 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.265 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:07.265 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:07.265 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:07.265 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:07.265 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5686 2024-09-12T16:17:07.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.265 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:17:07.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:17:07.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298702+0000", 2024-09-12T16:17:07.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2399999999999997e-07 2024-09-12T16:17:07.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298706+0000", 2024-09-12T16:17:07.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5700000000000003e-06 2024-09-12T16:17:07.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.267 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.267 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298718+0000", 2024-09-12T16:17:07.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1457999999999999e-05 2024-09-12T16:17:07.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.267 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.267 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298732+0000", 2024-09-12T16:17:07.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.452e-05 2024-09-12T16:17:07.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.267 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.267 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359956+0000", 2024-09-12T16:17:07.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061223626000000003 2024-09-12T16:17:07.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.268 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.268 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.268 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360000+0000", 2024-09-12T16:17:07.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3922999999999999e-05 2024-09-12T16:17:07.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.268 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.268 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.268 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360056+0000", 2024-09-12T16:17:07.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6162000000000002e-05 2024-09-12T16:17:07.268 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.268 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.268 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.269 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.269 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5688 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4800512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:07.269 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:17:07.269 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 26.892948918999998, 2024-09-12T16:17:07.269 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061270514999999998, 2024-09-12T16:17:07.269 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.269 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.269 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:07.269 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:07.269 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:07.269 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:07.269 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5688 2024-09-12T16:17:07.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.270 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.270 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.270 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:17:07.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.270 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.270 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:17:07.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.270 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.271 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298925+0000", 2024-09-12T16:17:07.271 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4e-07 2024-09-12T16:17:07.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.271 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.271 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298929+0000", 2024-09-12T16:17:07.271 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9890000000000003e-06 2024-09-12T16:17:07.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.271 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.271 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298936+0000", 2024-09-12T16:17:07.271 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.52e-06 2024-09-12T16:17:07.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.272 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.272 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298941+0000", 2024-09-12T16:17:07.272 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4800000000000003e-06 2024-09-12T16:17:07.272 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.272 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.272 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.272 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360087+0000", 2024-09-12T16:17:07.272 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061146143 2024-09-12T16:17:07.272 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.272 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.272 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.272 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360137+0000", 2024-09-12T16:17:07.272 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0584000000000002e-05 2024-09-12T16:17:07.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.273 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.273 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360194+0000", 2024-09-12T16:17:07.273 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6858999999999999e-05 2024-09-12T16:17:07.273 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.273 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.273 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.273 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5693 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4751360~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:07.273 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:17:07.274 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 26.892527282, 2024-09-12T16:17:07.274 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061139444000000001, 2024-09-12T16:17:07.274 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.274 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.274 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:07.274 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:07.274 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:07.274 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:07.274 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5693 2024-09-12T16:17:07.274 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.274 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.274 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.275 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.275 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:17:07.275 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.275 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.275 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.275 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.275 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:17:07.275 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.275 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.275 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.275 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.275 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299346+0000", 2024-09-12T16:17:07.275 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2300000000000001e-07 2024-09-12T16:17:07.276 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.276 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.276 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.276 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299349+0000", 2024-09-12T16:17:07.276 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5270000000000001e-06 2024-09-12T16:17:07.276 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.276 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.276 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.276 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299358+0000", 2024-09-12T16:17:07.276 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7030000000000001e-06 2024-09-12T16:17:07.276 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.276 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.276 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.277 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299364+0000", 2024-09-12T16:17:07.277 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7239999999999997e-06 2024-09-12T16:17:07.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.277 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.277 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.277 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360369+0000", 2024-09-12T16:17:07.277 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061004713000000002 2024-09-12T16:17:07.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.277 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.277 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.277 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360415+0000", 2024-09-12T16:17:07.277 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5926e-05 2024-09-12T16:17:07.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.277 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.278 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.278 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360485+0000", 2024-09-12T16:17:07.278 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0327999999999995e-05 2024-09-12T16:17:07.278 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.278 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.278 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.278 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.278 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.278 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5694 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4796416~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:07.278 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:17:07.278 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 26.892498252999999, 2024-09-12T16:17:07.278 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061258034000000003, 2024-09-12T16:17:07.278 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.278 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.279 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:07.279 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:07.279 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:07.279 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:07.279 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5694 2024-09-12T16:17:07.279 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.279 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.279 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.279 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.279 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:17:07.279 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.279 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.279 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.280 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.280 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:17:07.280 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.280 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.280 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.280 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.280 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301884+0000", 2024-09-12T16:17:07.280 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025090379999999999 2024-09-12T16:17:07.280 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.280 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.280 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.280 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301889+0000", 2024-09-12T16:17:07.280 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5879999999999997e-06 2024-09-12T16:17:07.281 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.281 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.281 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.281 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301901+0000", 2024-09-12T16:17:07.281 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1466e-05 2024-09-12T16:17:07.281 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.281 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.281 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.281 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301908+0000", 2024-09-12T16:17:07.281 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1999999999999997e-06 2024-09-12T16:17:07.281 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.281 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.281 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.282 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360513+0000", 2024-09-12T16:17:07.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.058605023999999999 2024-09-12T16:17:07.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.282 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.282 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.282 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360562+0000", 2024-09-12T16:17:07.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9546000000000003e-05 2024-09-12T16:17:07.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.282 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.282 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.282 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360633+0000", 2024-09-12T16:17:07.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0172000000000005e-05 2024-09-12T16:17:07.282 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.282 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.282 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.283 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.283 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5759 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4767744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:07.283 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:17:07.283 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 26.889704719000001, 2024-09-12T16:17:07.283 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061058604000000002, 2024-09-12T16:17:07.283 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.283 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.283 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:07.283 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:07.283 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:07.283 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:07.283 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5759 2024-09-12T16:17:07.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.284 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.284 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.284 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.284 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:17:07.284 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.284 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.284 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.284 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:17:07.284 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.284 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.285 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.285 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302548+0000", 2024-09-12T16:17:07.285 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00038011000000000002 2024-09-12T16:17:07.285 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.285 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.285 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.285 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302553+0000", 2024-09-12T16:17:07.285 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1830000000000002e-06 2024-09-12T16:17:07.285 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.285 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.286 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.286 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302564+0000", 2024-09-12T16:17:07.286 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1011e-05 2024-09-12T16:17:07.286 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.286 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.286 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.286 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302572+0000", 2024-09-12T16:17:07.286 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9009999999999994e-06 2024-09-12T16:17:07.286 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.286 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.286 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.286 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363102+0000", 2024-09-12T16:17:07.286 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.060529782999999997 2024-09-12T16:17:07.286 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.287 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.287 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.287 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363149+0000", 2024-09-12T16:17:07.287 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7321000000000003e-05 2024-09-12T16:17:07.287 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.287 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.287 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.287 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363227+0000", 2024-09-12T16:17:07.287 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7294999999999998e-05 2024-09-12T16:17:07.287 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.287 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.287 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.287 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.287 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.288 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:07.288 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T16:17:07.289 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:07.288+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:07.290 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:17:07.390 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:07.389+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:07.398 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:07.398 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:07.398 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:17:07.398 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:07.406 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:17:07.491 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:07.491+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:07.554 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:07.555 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:07.555 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:17:07.555 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:17:07.555 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:07.563 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:17:07.590 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:07.590+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:07.691 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:07.691+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:07.712 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:07.712 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:17:07.712 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:17:07.713 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:17:07.713 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.713 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.17 73/72 [PushOp(3:edb83cf9:::rbd_data.1155e1e6c0d8.0000000000000007:d, version: 47'343, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:edb83cf9:::rbd_data.1155e1e6c0d8.0000000000000007:d@47'343, size: 2064384, copy_subset: [(0, 2064384)], clone_subset: {}, snapset: d=[]:{d: [d]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T16:17:07.713 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.057473+0000", 2024-09-12T16:17:07.713 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.6532193020000001, 2024-09-12T16:17:07.713 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017021130000000001, 2024-09-12T16:17:07.713 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.713 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.713 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:07.713 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.713 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.713 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.714 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.057473+0000", 2024-09-12T16:17:07.714 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.714 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.714 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.714 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.057473+0000", 2024-09-12T16:17:07.714 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.714 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.714 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.714 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.057474+0000", 2024-09-12T16:17:07.714 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3e-07 2024-09-12T16:17:07.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.715 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.715 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.715 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.058406+0000", 2024-09-12T16:17:07.715 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00093254899999999996 2024-09-12T16:17:07.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.715 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.715 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.715 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.058423+0000", 2024-09-12T16:17:07.715 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6656000000000001e-05 2024-09-12T16:17:07.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.715 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.716 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.716 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.058433+0000", 2024-09-12T16:17:07.716 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0349e-05 2024-09-12T16:17:07.716 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.716 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.716 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.716 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.058516+0000", 2024-09-12T16:17:07.716 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2386999999999996e-05 2024-09-12T16:17:07.716 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.716 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.716 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.716 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.058524+0000", 2024-09-12T16:17:07.717 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3960000000000006e-06 2024-09-12T16:17:07.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.717 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.717 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.717 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.059175+0000", 2024-09-12T16:17:07.717 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00065114600000000002 2024-09-12T16:17:07.717 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.717 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.717 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.717 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.718 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.17 73/72 [PushOp(3:e9340267:::rbd_data.1155525b14e3.0000000000000031:f, version: 50'357, data_included: [0~4096,20480~4096,40960~8192,65536~4096,81920~8192,110592~4096,126976~8192,151552~4096,172032~8192,196608~4096,212992~8192,241664~4096,258048~8192,282624~4096,303104~8192,327680~4096,344064~8192,372736~4096,389120~8192,413696~4096,434176~8192,458752~4096,475136~8192,503808~4096,520192~8192,544768~4096,565248~8192,589824~4096,606208~8192,634880~4096,651264~8192,675840~4096,696320~8192,720896~4096,737280~8192,765952~4096,782336~8192,806912~4096,827392~8192,851968~4096,868352~8192,897024~4096,913408~8192,937984~4096,958464~8192,983040~4096,999424~8192,1028096~4096,1044480~4096], data_size: 294912, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:e9340267:::rbd_data.1155525b14e3.0000000000000031:f@50'357, size: 1048576, copy_subset: [(0, 1048576)], clone_subset: {}, snapset: f=[]:{f: [f]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T16:17:07.718 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.067448+0000", 2024-09-12T16:17:07.718 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.643244143, 2024-09-12T16:17:07.718 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003036721, 2024-09-12T16:17:07.718 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.718 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.718 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:07.718 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.718 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.718 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.718 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067448+0000", 2024-09-12T16:17:07.719 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.719 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.719 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.719 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067448+0000", 2024-09-12T16:17:07.719 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.719 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.719 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.719 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067449+0000", 2024-09-12T16:17:07.719 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2200000000000004e-07 2024-09-12T16:17:07.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.720 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.720 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.720 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067703+0000", 2024-09-12T16:17:07.720 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025377199999999998 2024-09-12T16:17:07.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.720 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.720 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.720 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067723+0000", 2024-09-12T16:17:07.720 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.986e-05 2024-09-12T16:17:07.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.720 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.721 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.721 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067743+0000", 2024-09-12T16:17:07.721 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9942e-05 2024-09-12T16:17:07.721 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.721 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.721 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.721 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067860+0000", 2024-09-12T16:17:07.721 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000116959 2024-09-12T16:17:07.721 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.721 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.721 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.721 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067872+0000", 2024-09-12T16:17:07.721 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2928000000000001e-05 2024-09-12T16:17:07.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.722 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.722 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.722 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.070485+0000", 2024-09-12T16:17:07.722 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0026127379999999999 2024-09-12T16:17:07.722 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.722 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.722 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.722 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.722 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.17 73/72 [PushOp(3:eaf4b41c:::rbd_data.1155b4d1eca0.000000000000006e:11, version: 53'372, data_included: [0~148480,262144~262144], data_size: 410624, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:eaf4b41c:::rbd_data.1155b4d1eca0.000000000000006e:11@53'372, size: 524288, copy_subset: [(0, 524288)], clone_subset: {}, snapset: 11=[]:{11: [11]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 524288, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T16:17:07.722 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.083470+0000", 2024-09-12T16:17:07.723 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.6272228819999999, 2024-09-12T16:17:07.723 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001061198, 2024-09-12T16:17:07.723 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.723 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.723 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:07.723 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.723 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.724 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.724 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.083470+0000", 2024-09-12T16:17:07.724 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.724 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.724 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.724 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.724 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.083470+0000", 2024-09-12T16:17:07.724 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.725 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.725 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.725 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.083470+0000", 2024-09-12T16:17:07.725 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7100000000000002e-07 2024-09-12T16:17:07.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.725 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.725 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.725 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.083841+0000", 2024-09-12T16:17:07.725 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000370427 2024-09-12T16:17:07.726 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.726 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.726 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.083857+0000", 2024-09-12T16:17:07.727 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6316000000000001e-05 2024-09-12T16:17:07.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.727 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.083869+0000", 2024-09-12T16:17:07.727 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1731e-05 2024-09-12T16:17:07.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.727 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.728 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.083955+0000", 2024-09-12T16:17:07.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5858000000000004e-05 2024-09-12T16:17:07.728 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.728 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.728 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.728 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.083963+0000", 2024-09-12T16:17:07.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5979999999999997e-06 2024-09-12T16:17:07.728 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.728 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.728 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.728 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.084531+0000", 2024-09-12T16:17:07.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00056769700000000004 2024-09-12T16:17:07.729 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.729 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.729 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.729 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.729 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.17 73/72 [PushOp(3:eaf8fb13:::rbd_data.1155972f715b.0000000000000009:16, version: 69'415, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:eaf8fb13:::rbd_data.1155972f715b.0000000000000009:16@69'415, size: 15466496, copy_subset: [(0, 15466496)], clone_subset: {}, snapset: 16=[]:{16: [16]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T16:17:07.729 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.110999+0000", 2024-09-12T16:17:07.729 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.5996939289999998, 2024-09-12T16:17:07.729 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001744827, 2024-09-12T16:17:07.729 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.729 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.729 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:07.730 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.730 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.730 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.110999+0000", 2024-09-12T16:17:07.730 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.730 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.730 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.110999+0000", 2024-09-12T16:17:07.730 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.730 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.731 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.110999+0000", 2024-09-12T16:17:07.731 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2699999999999999e-07 2024-09-12T16:17:07.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.731 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.731 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.112026+0000", 2024-09-12T16:17:07.731 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001026424 2024-09-12T16:17:07.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.731 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.731 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.112041+0000", 2024-09-12T16:17:07.731 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5599000000000001e-05 2024-09-12T16:17:07.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.112052+0000", 2024-09-12T16:17:07.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0481e-05 2024-09-12T16:17:07.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.112117+0000", 2024-09-12T16:17:07.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5395999999999995e-05 2024-09-12T16:17:07.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.112125+0000", 2024-09-12T16:17:07.733 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0730000000000005e-06 2024-09-12T16:17:07.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.733 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.733 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.733 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.112744+0000", 2024-09-12T16:17:07.733 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00061822699999999995 2024-09-12T16:17:07.733 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.733 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.733 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.733 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.733 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.17 73/72 [PushOp(3:eaf8fb13:::rbd_data.1155972f715b.0000000000000009:16, version: 69'415, data_included: [1048576~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:eaf8fb13:::rbd_data.1155972f715b.0000000000000009:16@69'415, size: 15466496, copy_subset: [(0, 15466496)], clone_subset: {}, snapset: 16=[]:{16: [16]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 2097152, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-09-12T16:17:07.733 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.113776+0000", 2024-09-12T16:17:07.734 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.596916674, 2024-09-12T16:17:07.734 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015855190000000001, 2024-09-12T16:17:07.734 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.734 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.734 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:07.734 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.734 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.734 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.734 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.113776+0000", 2024-09-12T16:17:07.734 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.734 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.734 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.735 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.735 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.113776+0000", 2024-09-12T16:17:07.735 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.735 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.735 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.735 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.735 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.113776+0000", 2024-09-12T16:17:07.735 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7800000000000002e-07 2024-09-12T16:17:07.735 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.735 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.735 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.735 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.114760+0000", 2024-09-12T16:17:07.735 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00098372499999999996 2024-09-12T16:17:07.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.736 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.736 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.736 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.114775+0000", 2024-09-12T16:17:07.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5234e-05 2024-09-12T16:17:07.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.736 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.736 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.736 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.114785+0000", 2024-09-12T16:17:07.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0115000000000001e-05 2024-09-12T16:17:07.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.736 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.737 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.737 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.114854+0000", 2024-09-12T16:17:07.737 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8124e-05 2024-09-12T16:17:07.737 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.737 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.737 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.737 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.114862+0000", 2024-09-12T16:17:07.737 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2689999999999999e-06 2024-09-12T16:17:07.737 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.737 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.737 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.737 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.115361+0000", 2024-09-12T16:17:07.737 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00049957400000000002 2024-09-12T16:17:07.737 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.738 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.738 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.738 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.738 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.17 73/72 [PushOp(3:eaf8fb13:::rbd_data.1155972f715b.0000000000000009:16, version: 69'415, data_included: [2097152~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:eaf8fb13:::rbd_data.1155972f715b.0000000000000009:16@69'415, size: 15466496, copy_subset: [(0, 15466496)], clone_subset: {}, snapset: 16=[]:{16: [16]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 3145728, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 2097152, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-09-12T16:17:07.738 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.116555+0000", 2024-09-12T16:17:07.738 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.5941372629999999, 2024-09-12T16:17:07.738 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015493480000000001, 2024-09-12T16:17:07.738 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.738 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.738 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:07.738 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.738 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.116555+0000", 2024-09-12T16:17:07.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.116555+0000", 2024-09-12T16:17:07.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.116556+0000", 2024-09-12T16:17:07.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0500000000000004e-07 2024-09-12T16:17:07.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.740 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.740 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.740 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.117499+0000", 2024-09-12T16:17:07.740 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00094320899999999997 2024-09-12T16:17:07.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.740 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.740 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.740 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.117514+0000", 2024-09-12T16:17:07.740 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4827999999999999e-05 2024-09-12T16:17:07.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.740 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.741 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.741 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.117524+0000", 2024-09-12T16:17:07.741 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7569999999999999e-06 2024-09-12T16:17:07.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.741 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.741 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.741 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.117588+0000", 2024-09-12T16:17:07.741 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4097999999999995e-05 2024-09-12T16:17:07.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.741 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.741 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.741 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.117596+0000", 2024-09-12T16:17:07.741 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1100000000000003e-06 2024-09-12T16:17:07.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.742 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.742 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.118105+0000", 2024-09-12T16:17:07.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000508841 2024-09-12T16:17:07.742 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.742 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.742 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.742 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.17 73/72 [PushOp(3:eaf8fb13:::rbd_data.1155972f715b.0000000000000009:16, version: 69'415, data_included: [3145728~786432], data_size: 786432, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:eaf8fb13:::rbd_data.1155972f715b.0000000000000009:16@69'415, size: 15466496, copy_subset: [(0, 15466496)], clone_subset: {}, snapset: 16=[]:{16: [16]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 15466496, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 3145728, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-09-12T16:17:07.742 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.119177+0000", 2024-09-12T16:17:07.742 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.591515257, 2024-09-12T16:17:07.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0016371809999999999, 2024-09-12T16:17:07.743 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.743 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.743 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:07.743 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.119177+0000", 2024-09-12T16:17:07.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.743 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.119177+0000", 2024-09-12T16:17:07.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.744 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.744 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.119179+0000", 2024-09-12T16:17:07.744 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3060000000000001e-06 2024-09-12T16:17:07.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.744 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.744 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.120003+0000", 2024-09-12T16:17:07.744 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00082408899999999996 2024-09-12T16:17:07.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.744 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.745 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.120018+0000", 2024-09-12T16:17:07.745 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4782e-05 2024-09-12T16:17:07.745 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.745 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.745 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.745 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.120027+0000", 2024-09-12T16:17:07.745 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6469999999999993e-06 2024-09-12T16:17:07.745 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.745 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.745 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.745 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.120092+0000", 2024-09-12T16:17:07.745 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4401999999999998e-05 2024-09-12T16:17:07.745 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.746 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.746 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.746 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.120100+0000", 2024-09-12T16:17:07.746 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4970000000000001e-06 2024-09-12T16:17:07.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.746 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.746 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.746 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.120815+0000", 2024-09-12T16:17:07.746 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00071445799999999996 2024-09-12T16:17:07.746 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.746 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.746 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.747 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.1d 73/72 [PushOp(3:b81abef1:::rbd_data.1155525b14e3.0000000000000032:f, version: 50'956, data_included: [0~4096,20480~4096,40960~4096,65536~4096,81920~8192,126976~8192,151552~4096,172032~4096,196608~4096,212992~8192,258048~8192,282624~4096,303104~4096,327680~4096,344064~8192,389120~8192,413696~4096,434176~4096,458752~4096,475136~8192,520192~8192,544768~4096,565248~4096,589824~4096,606208~8192,651264~8192,675840~4096,696320~4096,720896~4096,737280~8192,782336~8192,806912~4096,827392~4096,851968~4096,868352~8192,913408~8192,937984~4096,958464~4096,983040~4096,999424~8192,1044480~4096], data_size: 229376, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:b81abef1:::rbd_data.1155525b14e3.0000000000000032:f@50'956, size: 1048576, copy_subset: [(0, 1048576)], clone_subset: {}, snapset: f=[]:{f: [f]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T16:17:07.747 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.169142+0000", 2024-09-12T16:17:07.747 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.541550838, 2024-09-12T16:17:07.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025628640000000002, 2024-09-12T16:17:07.747 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.747 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.747 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:07.747 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.747 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.169142+0000", 2024-09-12T16:17:07.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.748 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.748 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.169142+0000", 2024-09-12T16:17:07.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.748 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.748 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.169142+0000", 2024-09-12T16:17:07.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1799999999999995e-07 2024-09-12T16:17:07.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.748 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.169263+0000", 2024-09-12T16:17:07.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000120897 2024-09-12T16:17:07.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.749 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.749 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.169292+0000", 2024-09-12T16:17:07.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8357999999999999e-05 2024-09-12T16:17:07.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.749 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.749 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.169312+0000", 2024-09-12T16:17:07.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0239999999999999e-05 2024-09-12T16:17:07.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.750 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.750 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.750 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.169425+0000", 2024-09-12T16:17:07.750 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000113336 2024-09-12T16:17:07.750 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.750 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.750 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.750 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.169438+0000", 2024-09-12T16:17:07.750 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3185e-05 2024-09-12T16:17:07.750 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.750 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.750 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.750 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.171705+0000", 2024-09-12T16:17:07.751 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0022662300000000002 2024-09-12T16:17:07.751 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.751 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.751 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.751 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.751 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.751 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.1d 73/72 [PushOp(3:bd148db4:::rbd_data.1155ccb1894c.0000000000000002:15, version: 67'990, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:bd148db4:::rbd_data.1155ccb1894c.0000000000000002:15@67'990, size: 8388608, copy_subset: [(0, 8388608)], clone_subset: {}, snapset: 15=[]:{15: [15]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T16:17:07.751 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.193086+0000", 2024-09-12T16:17:07.751 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.517606507, 2024-09-12T16:17:07.751 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001356784, 2024-09-12T16:17:07.751 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.751 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.751 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:07.752 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.752 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.752 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.752 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.193086+0000", 2024-09-12T16:17:07.752 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.752 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.752 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.752 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.193086+0000", 2024-09-12T16:17:07.752 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.752 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.752 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.753 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.193087+0000", 2024-09-12T16:17:07.753 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1900000000000002e-07 2024-09-12T16:17:07.753 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.753 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.753 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.753 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.193688+0000", 2024-09-12T16:17:07.753 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00060120799999999999 2024-09-12T16:17:07.753 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.753 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.753 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.753 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.193705+0000", 2024-09-12T16:17:07.753 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6929999999999999e-05 2024-09-12T16:17:07.753 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.754 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.754 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.754 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.193720+0000", 2024-09-12T16:17:07.754 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4679e-05 2024-09-12T16:17:07.754 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.754 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.754 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.754 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.193791+0000", 2024-09-12T16:17:07.754 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1710000000000003e-05 2024-09-12T16:17:07.754 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.754 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.754 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.754 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.193800+0000", 2024-09-12T16:17:07.754 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4999999999999999e-06 2024-09-12T16:17:07.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.755 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.755 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.755 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.194443+0000", 2024-09-12T16:17:07.755 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00064313800000000002 2024-09-12T16:17:07.755 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.755 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.755 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.755 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.755 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.1d 73/72 [PushOp(3:bd148db4:::rbd_data.1155ccb1894c.0000000000000002:15, version: 67'990, data_included: [1048576~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:bd148db4:::rbd_data.1155ccb1894c.0000000000000002:15@67'990, size: 8388608, copy_subset: [(0, 8388608)], clone_subset: {}, snapset: 15=[]:{15: [15]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 2097152, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-09-12T16:17:07.755 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.195855+0000", 2024-09-12T16:17:07.755 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.514838041, 2024-09-12T16:17:07.756 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001129463, 2024-09-12T16:17:07.756 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.756 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.756 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:07.756 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.756 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.756 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.756 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.195855+0000", 2024-09-12T16:17:07.756 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.756 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.756 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.756 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.756 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.195855+0000", 2024-09-12T16:17:07.757 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.757 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.757 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.757 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.195855+0000", 2024-09-12T16:17:07.757 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1099999999999995e-07 2024-09-12T16:17:07.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.757 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.757 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.757 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.196297+0000", 2024-09-12T16:17:07.757 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00044200499999999998 2024-09-12T16:17:07.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.757 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.758 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.758 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.196314+0000", 2024-09-12T16:17:07.758 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7195000000000001e-05 2024-09-12T16:17:07.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.758 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.758 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.758 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.196325+0000", 2024-09-12T16:17:07.758 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0686000000000001e-05 2024-09-12T16:17:07.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.758 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.758 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.758 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.196383+0000", 2024-09-12T16:17:07.758 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8244e-05 2024-09-12T16:17:07.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.759 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.759 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.759 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.196392+0000", 2024-09-12T16:17:07.759 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.704e-06 2024-09-12T16:17:07.759 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.759 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.759 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.759 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.196984+0000", 2024-09-12T16:17:07.759 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00059201800000000004 2024-09-12T16:17:07.759 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.759 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.759 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.759 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.759 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.760 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.1d 73/72 [PushOp(3:bd148db4:::rbd_data.1155ccb1894c.0000000000000002:15, version: 67'990, data_included: [2097152~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:bd148db4:::rbd_data.1155ccb1894c.0000000000000002:15@67'990, size: 8388608, copy_subset: [(0, 8388608)], clone_subset: {}, snapset: 15=[]:{15: [15]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 3145728, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 2097152, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-09-12T16:17:07.760 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.198325+0000", 2024-09-12T16:17:07.760 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.5123671600000002, 2024-09-12T16:17:07.760 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001138656, 2024-09-12T16:17:07.760 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.760 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.760 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:07.760 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.760 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.760 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.760 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.198325+0000", 2024-09-12T16:17:07.760 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.760 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.761 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.761 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.761 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.198325+0000", 2024-09-12T16:17:07.761 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.761 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.761 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.761 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.198326+0000", 2024-09-12T16:17:07.761 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5099999999999999e-07 2024-09-12T16:17:07.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.761 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.761 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.761 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.198753+0000", 2024-09-12T16:17:07.762 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042718600000000003 2024-09-12T16:17:07.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.762 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.762 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.762 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.198771+0000", 2024-09-12T16:17:07.762 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.753e-05 2024-09-12T16:17:07.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.762 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.762 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.762 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.198781+0000", 2024-09-12T16:17:07.762 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0353000000000001e-05 2024-09-12T16:17:07.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.762 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.763 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.763 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.198861+0000", 2024-09-12T16:17:07.763 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9449000000000005e-05 2024-09-12T16:17:07.763 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.763 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.763 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.763 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.198873+0000", 2024-09-12T16:17:07.763 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.236e-05 2024-09-12T16:17:07.763 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.763 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.764 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.764 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.199464+0000", 2024-09-12T16:17:07.764 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00059112699999999999 2024-09-12T16:17:07.764 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.764 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.764 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.764 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.764 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.764 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.1d 73/72 [PushOp(3:bd148db4:::rbd_data.1155ccb1894c.0000000000000002:15, version: 67'990, data_included: [3145728~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:bd148db4:::rbd_data.1155ccb1894c.0000000000000002:15@67'990, size: 8388608, copy_subset: [(0, 8388608)], clone_subset: {}, snapset: 15=[]:{15: [15]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 4194304, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 3145728, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-09-12T16:17:07.764 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.200882+0000", 2024-09-12T16:17:07.764 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.509810501, 2024-09-12T16:17:07.764 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001108571, 2024-09-12T16:17:07.764 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.765 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.765 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:07.765 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.765 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.765 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.765 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.200882+0000", 2024-09-12T16:17:07.765 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.765 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.765 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.765 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.200882+0000", 2024-09-12T16:17:07.765 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.766 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.200883+0000", 2024-09-12T16:17:07.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.06e-07 2024-09-12T16:17:07.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.766 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.201317+0000", 2024-09-12T16:17:07.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00043382799999999998 2024-09-12T16:17:07.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.766 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.201333+0000", 2024-09-12T16:17:07.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6945000000000001e-05 2024-09-12T16:17:07.767 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.767 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.767 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.767 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.201344+0000", 2024-09-12T16:17:07.767 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0682e-05 2024-09-12T16:17:07.767 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.767 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.767 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.767 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.201419+0000", 2024-09-12T16:17:07.767 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4542999999999994e-05 2024-09-12T16:17:07.767 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.767 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.767 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.768 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.201427+0000", 2024-09-12T16:17:07.768 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.585e-06 2024-09-12T16:17:07.768 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.768 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.768 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.768 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.201991+0000", 2024-09-12T16:17:07.768 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00056338199999999997 2024-09-12T16:17:07.768 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.768 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.768 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.768 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.768 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.768 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.1d 73/72 [PushOp(3:bd148db4:::rbd_data.1155ccb1894c.0000000000000002:15, version: 67'990, data_included: [4194304~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:bd148db4:::rbd_data.1155ccb1894c.0000000000000002:15@67'990, size: 8388608, copy_subset: [(0, 8388608)], clone_subset: {}, snapset: 15=[]:{15: [15]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 5242880, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 4194304, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-09-12T16:17:07.769 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.203274+0000", 2024-09-12T16:17:07.769 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.5074189609999999, 2024-09-12T16:17:07.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0010910239999999999, 2024-09-12T16:17:07.769 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.769 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.769 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:07.769 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.769 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.769 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.203274+0000", 2024-09-12T16:17:07.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.769 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.770 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.203274+0000", 2024-09-12T16:17:07.770 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.770 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.770 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.203274+0000", 2024-09-12T16:17:07.770 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9500000000000003e-07 2024-09-12T16:17:07.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.770 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.770 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.203694+0000", 2024-09-12T16:17:07.770 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042013499999999997 2024-09-12T16:17:07.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.771 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.771 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.203708+0000", 2024-09-12T16:17:07.771 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3881e-05 2024-09-12T16:17:07.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.771 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.771 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.771 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.203717+0000", 2024-09-12T16:17:07.771 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9760000000000001e-06 2024-09-12T16:17:07.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.771 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.771 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.771 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.203788+0000", 2024-09-12T16:17:07.771 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0947999999999999e-05 2024-09-12T16:17:07.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.772 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.772 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.203797+0000", 2024-09-12T16:17:07.772 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6910000000000003e-06 2024-09-12T16:17:07.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.772 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.772 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.204365+0000", 2024-09-12T16:17:07.772 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00056789799999999995 2024-09-12T16:17:07.772 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.772 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.773 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.773 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.773 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.773 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.1d 73/72 [PushOp(3:bd148db4:::rbd_data.1155ccb1894c.0000000000000002:15, version: 67'990, data_included: [5242880~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:bd148db4:::rbd_data.1155ccb1894c.0000000000000002:15@67'990, size: 8388608, copy_subset: [(0, 8388608)], clone_subset: {}, snapset: 15=[]:{15: [15]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 6291456, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 5242880, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-09-12T16:17:07.773 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.205672+0000", 2024-09-12T16:17:07.773 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.5050209890000001, 2024-09-12T16:17:07.773 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011256110000000001, 2024-09-12T16:17:07.773 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.773 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.773 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:07.773 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.773 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.773 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.774 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.205672+0000", 2024-09-12T16:17:07.774 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.774 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.774 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.774 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.205672+0000", 2024-09-12T16:17:07.774 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.774 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.774 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.774 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.205672+0000", 2024-09-12T16:17:07.774 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7599999999999997e-07 2024-09-12T16:17:07.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.775 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.775 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.206096+0000", 2024-09-12T16:17:07.775 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042363900000000001 2024-09-12T16:17:07.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.775 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.775 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.206112+0000", 2024-09-12T16:17:07.775 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6215e-05 2024-09-12T16:17:07.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.775 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.775 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.206122+0000", 2024-09-12T16:17:07.776 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0427e-05 2024-09-12T16:17:07.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.776 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.776 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.206204+0000", 2024-09-12T16:17:07.776 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1256999999999998e-05 2024-09-12T16:17:07.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.776 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.776 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.206213+0000", 2024-09-12T16:17:07.776 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3200000000000006e-06 2024-09-12T16:17:07.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.777 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.777 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.206797+0000", 2024-09-12T16:17:07.777 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00058417699999999996 2024-09-12T16:17:07.777 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.777 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.777 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.777 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.777 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.1d 73/72 [PushOp(3:bd148db4:::rbd_data.1155ccb1894c.0000000000000002:15, version: 67'990, data_included: [6291456~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:bd148db4:::rbd_data.1155ccb1894c.0000000000000002:15@67'990, size: 8388608, copy_subset: [(0, 8388608)], clone_subset: {}, snapset: 15=[]:{15: [15]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 7340032, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 6291456, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-09-12T16:17:07.777 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.208134+0000", 2024-09-12T16:17:07.777 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.502558649, 2024-09-12T16:17:07.777 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001122421, 2024-09-12T16:17:07.777 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.778 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.778 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:07.778 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.778 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.778 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.208134+0000", 2024-09-12T16:17:07.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.778 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.778 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.208134+0000", 2024-09-12T16:17:07.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.208134+0000", 2024-09-12T16:17:07.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8500000000000002e-07 2024-09-12T16:17:07.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.208568+0000", 2024-09-12T16:17:07.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00043328300000000002 2024-09-12T16:17:07.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.208582+0000", 2024-09-12T16:17:07.780 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4419999999999999e-05 2024-09-12T16:17:07.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.780 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.780 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.780 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.208592+0000", 2024-09-12T16:17:07.780 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4409999999999999e-06 2024-09-12T16:17:07.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.780 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.780 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.780 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.208666+0000", 2024-09-12T16:17:07.780 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4326000000000006e-05 2024-09-12T16:17:07.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.780 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.781 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.781 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.208675+0000", 2024-09-12T16:17:07.781 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6430000000000001e-06 2024-09-12T16:17:07.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.781 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.781 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.781 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.209256+0000", 2024-09-12T16:17:07.781 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00058182299999999998 2024-09-12T16:17:07.781 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.781 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.781 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.781 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.781 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.1d 73/72 [PushOp(3:bd148db4:::rbd_data.1155ccb1894c.0000000000000002:15, version: 67'990, data_included: [7340032~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:bd148db4:::rbd_data.1155ccb1894c.0000000000000002:15@67'990, size: 8388608, copy_subset: [(0, 8388608)], clone_subset: {}, snapset: 15=[]:{15: [15]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 8388608, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 7340032, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-09-12T16:17:07.782 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.210611+0000", 2024-09-12T16:17:07.782 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.5000819239999998, 2024-09-12T16:17:07.782 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015420290000000001, 2024-09-12T16:17:07.782 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.782 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.782 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:07.782 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.782 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.782 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.782 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.210611+0000", 2024-09-12T16:17:07.782 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.782 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.782 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.782 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.783 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.210611+0000", 2024-09-12T16:17:07.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.783 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.783 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.210611+0000", 2024-09-12T16:17:07.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.99e-07 2024-09-12T16:17:07.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.783 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.783 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.211034+0000", 2024-09-12T16:17:07.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042300699999999998 2024-09-12T16:17:07.784 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.784 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.784 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.784 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.211051+0000", 2024-09-12T16:17:07.784 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7153999999999999e-05 2024-09-12T16:17:07.784 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.784 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.784 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.784 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.211062+0000", 2024-09-12T16:17:07.784 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0570999999999999e-05 2024-09-12T16:17:07.784 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.784 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.784 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.785 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.211136+0000", 2024-09-12T16:17:07.785 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4253999999999998e-05 2024-09-12T16:17:07.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.785 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.785 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.785 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.211145+0000", 2024-09-12T16:17:07.785 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7749999999999998e-06 2024-09-12T16:17:07.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.785 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.785 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.785 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.212153+0000", 2024-09-12T16:17:07.785 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0010076690000000001 2024-09-12T16:17:07.786 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.786 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.786 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.786 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.786 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.16 74/72 [PushOp(3:6c6f03bc:::rbd_data.115575975003.0000000000000017:b, version: 42'486, data_included: [3069952~10240,3299328~44032], data_size: 54272, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:6c6f03bc:::rbd_data.115575975003.0000000000000017:b@42'486, size: 3343360, copy_subset: [(0, 3343360)], clone_subset: {}, snapset: b=[]:{b: [b]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 3343360, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T16:17:07.786 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.244340+0000", 2024-09-12T16:17:07.786 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.466352678, 2024-09-12T16:17:07.786 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001024591, 2024-09-12T16:17:07.786 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.786 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.786 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:07.786 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.787 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.787 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.787 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.244340+0000", 2024-09-12T16:17:07.787 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.787 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.787 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.787 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.787 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.244340+0000", 2024-09-12T16:17:07.787 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.787 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.787 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.787 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.787 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.244341+0000", 2024-09-12T16:17:07.788 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5799999999999999e-07 2024-09-12T16:17:07.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.788 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.788 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.788 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.244375+0000", 2024-09-12T16:17:07.788 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4362000000000001e-05 2024-09-12T16:17:07.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.788 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.788 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.788 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.244397+0000", 2024-09-12T16:17:07.788 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1631e-05 2024-09-12T16:17:07.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.789 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.789 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.789 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.244415+0000", 2024-09-12T16:17:07.789 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8385000000000001e-05 2024-09-12T16:17:07.789 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.789 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.789 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.789 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.244511+0000", 2024-09-12T16:17:07.789 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5989999999999994e-05 2024-09-12T16:17:07.789 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.789 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.789 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.789 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.244525+0000", 2024-09-12T16:17:07.790 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4498000000000001e-05 2024-09-12T16:17:07.790 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.790 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.790 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.790 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.245365+0000", 2024-09-12T16:17:07.790 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00083906699999999998 2024-09-12T16:17:07.790 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.790 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.790 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.790 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.790 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.790 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.16 74/72 [PushOp(3:6fac99c0:::rbd_data.1155e1e6c0d8.000000000000000a:d, version: 47'509, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:6fac99c0:::rbd_data.1155e1e6c0d8.000000000000000a:d@47'509, size: 2064384, copy_subset: [(0, 2064384)], clone_subset: {}, snapset: d=[]:{d: [d]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T16:17:07.790 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.255766+0000", 2024-09-12T16:17:07.790 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.4549263969999999, 2024-09-12T16:17:07.791 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0013103430000000001, 2024-09-12T16:17:07.791 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.791 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.791 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:07.791 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.791 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.791 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.791 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.255766+0000", 2024-09-12T16:17:07.791 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.791 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.791 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.791 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.791 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.255766+0000", 2024-09-12T16:17:07.792 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.792 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.792 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.792 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.792 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.255767+0000", 2024-09-12T16:17:07.792 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7700000000000004e-07 2024-09-12T16:17:07.792 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.792 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.792 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.792 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.256361+0000", 2024-09-12T16:17:07.792 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00059404499999999997 2024-09-12T16:17:07.792 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.792 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.793 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.793 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.256380+0000", 2024-09-12T16:17:07.793 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9063999999999999e-05 2024-09-12T16:17:07.793 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.793 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.793 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.793 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.256395+0000", 2024-09-12T16:17:07.793 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4662e-05 2024-09-12T16:17:07.793 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.793 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.793 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.793 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.256456+0000", 2024-09-12T16:17:07.793 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1787999999999999e-05 2024-09-12T16:17:07.794 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.794 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.794 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.794 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.256464+0000", 2024-09-12T16:17:07.794 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2339999999999997e-06 2024-09-12T16:17:07.794 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.794 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.794 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.794 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.257077+0000", 2024-09-12T16:17:07.794 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000612873 2024-09-12T16:17:07.794 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.794 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.794 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.794 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.795 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.795 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.16 74/72 [PushOp(3:68db2424:::rbd_data.1155525b14e3.000000000000002a:f, version: 50'736, data_included: [0~352256,368640~4096,385024~12288,413696~4096,430080~8192,458752~4096,471040~12288,499712~4096,516096~12288,544768~4096,561152~8192,589824~4096,602112~12288,630784~4096,647168~12288,675840~4096,692224~8192,720896~4096,733184~12288,761856~4096,778240~12288,806912~4096,823296~8192,851968~4096,868352~8192,892928~4096,913408~8192,937984~4096,958464~4096,983040~4096,999424~8192,1024000~4096,1044480~4096], data_size: 569344, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:68db2424:::rbd_data.1155525b14e3.000000000000002a:f@50'736, size: 1048576, copy_subset: [(0, 1048576)], clone_subset: {}, snapset: f=[]:{f: [f]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T16:17:07.795 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.264309+0000", 2024-09-12T16:17:07.795 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.4463832189999999, 2024-09-12T16:17:07.795 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025728819999999999, 2024-09-12T16:17:07.795 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.795 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.795 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:07.795 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.795 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.795 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.795 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.264309+0000", 2024-09-12T16:17:07.795 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.796 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.796 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.796 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.796 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.264309+0000", 2024-09-12T16:17:07.796 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.796 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.796 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.796 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.796 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.264310+0000", 2024-09-12T16:17:07.796 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5499999999999998e-07 2024-09-12T16:17:07.796 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.796 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.796 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.797 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.264565+0000", 2024-09-12T16:17:07.797 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025476399999999999 2024-09-12T16:17:07.797 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.797 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.797 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.797 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.264584+0000", 2024-09-12T16:17:07.797 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9349999999999999e-05 2024-09-12T16:17:07.797 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.797 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.797 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.797 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.264602+0000", 2024-09-12T16:17:07.797 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8173e-05 2024-09-12T16:17:07.797 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.797 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.798 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.798 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.264690+0000", 2024-09-12T16:17:07.798 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7403000000000003e-05 2024-09-12T16:17:07.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.798 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.798 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.798 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.264701+0000", 2024-09-12T16:17:07.798 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1566000000000001e-05 2024-09-12T16:17:07.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.798 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.798 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.798 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.266882+0000", 2024-09-12T16:17:07.798 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0021810710000000001 2024-09-12T16:17:07.799 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.799 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.799 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.799 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.799 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.799 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5223.0:1815 3.f e75/74 3:f7eb80a2:::rbd_object_map.1155a1fd27d2.0000000000000018:head v 75'246, mlcod=0'0)", 2024-09-12T16:17:07.799 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:07.245416+0000", 2024-09-12T16:17:07.799 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.465276464, 2024-09-12T16:17:07.799 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0010607500000000001, 2024-09-12T16:17:07.799 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:07.799 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:07.799 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:07.799 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:07.800 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.800 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:07.800 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.245416+0000", 2024-09-12T16:17:07.800 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.800 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.800 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.800 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:07.800 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.245416+0000", 2024-09-12T16:17:07.800 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:07.800 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.800 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.800 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:07.800 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.245417+0000", 2024-09-12T16:17:07.801 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9800000000000003e-07 2024-09-12T16:17:07.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.801 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.801 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:07.801 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.245423+0000", 2024-09-12T16:17:07.801 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6499999999999999e-06 2024-09-12T16:17:07.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.801 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.801 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:07.801 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.245433+0000", 2024-09-12T16:17:07.801 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0071999999999999e-05 2024-09-12T16:17:07.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.801 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.801 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:07.802 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.245440+0000", 2024-09-12T16:17:07.802 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8680000000000001e-06 2024-09-12T16:17:07.802 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.802 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.802 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:07.802 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.245488+0000", 2024-09-12T16:17:07.802 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7556999999999999e-05 2024-09-12T16:17:07.802 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.802 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.802 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:07.802 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.245507+0000", 2024-09-12T16:17:07.802 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9468999999999999e-05 2024-09-12T16:17:07.802 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.803 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.803 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:07.803 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.246446+0000", 2024-09-12T16:17:07.803 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00093877100000000003 2024-09-12T16:17:07.803 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:07.803 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:07.803 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:07.803 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.246477+0000", 2024-09-12T16:17:07.803 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0765000000000001e-05 2024-09-12T16:17:07.803 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.803 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.803 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.803 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:07.803 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:07.804 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:07.809 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:17:07.810 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:07.804+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:07.906 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:07.905+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:07.917 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:07.917 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:07.917 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:17:07.917 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:07.925 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:17:08.010 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:08.009+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:08.035 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T16:17:08.074 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:08.075 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:08.075 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:17:08.075 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:17:08.075 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:08.084 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:17:08.125 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:08.124+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:08.159 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:17:08.159 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:17:08.176 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:17:08.177 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:17:08.193 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:17:08.193 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:17:08.207 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:08.207+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:08.211 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:17:08.211 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:17:08.228 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:17:08.229 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:17:08.233 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:08.233 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:08.238 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2024-09-12T16:17:08.245 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:17:08.249 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:17:08.249 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:17:08.309 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:08.308+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:08.321 INFO:teuthology.orchestra.run.smithi204.stdout:truncating image image_client.0-clone21 from 0xcb22800 (overlap 0xe26000) to 0xb51800 2024-09-12T16:17:08.366 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:08.367 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:08.376 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:17:08.417 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:08.416+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:08.511 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:08.511+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:08.525 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:08.525 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:08.534 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:17:08.612 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:08.612+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:08.645 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:08.645 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:08.653 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:17:08.713 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:08.712+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:08.761 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:08.761 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:08.769 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:17:08.854 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:08.853+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:08.914 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:08.913+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:08.919 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:08.920 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:08.929 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:17:08.931 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #20, image image_client.0-clone20 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent21 2024-09-12T16:17:08.995 INFO:teuthology.orchestra.run.smithi204.stdout:3523 trunc from 0xcb22800 to 0x59fd600 2024-09-12T16:17:09.014 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:09.013+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:09.019 INFO:teuthology.orchestra.run.smithi204.stdout:3524 punch from 0x25e7a00 to 0x25f1c00, (0xa200 bytes) 2024-09-12T16:17:09.019 INFO:teuthology.orchestra.run.smithi204.stdout:3525 flatten 2024-09-12T16:17:09.099 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:09.099 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:09.109 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:17:09.131 INFO:teuthology.orchestra.run.smithi204.stdout:3526 read 0x241b600 thru 0x2429e3a (0xe83b bytes) 2024-09-12T16:17:09.137 INFO:teuthology.orchestra.run.smithi204.stdout:3527 trunc from 0x59fd600 to 0xd50400 2024-09-12T16:17:09.151 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:09.150+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:09.157 INFO:teuthology.orchestra.run.smithi204.stdout:3531 punch from 0x5b1600 to 0x5bb600, (0xa000 bytes) 2024-09-12T16:17:09.159 INFO:teuthology.orchestra.run.smithi204.stdout:3533 read 0x71e600 thru 0x7227c6 (0x41c7 bytes) 2024-09-12T16:17:09.170 INFO:teuthology.orchestra.run.smithi204.stdout:3534 trunc from 0xd50400 to 0x9bb8200 2024-09-12T16:17:09.181 INFO:teuthology.orchestra.run.smithi204.stdout:3535 write 0x65a3800 thru 0x65b1ef3 (0xe6f4 bytes) 2024-09-12T16:17:09.185 INFO:teuthology.orchestra.run.smithi204.stdout:3538 trunc from 0x9bb8200 to 0x7768400 2024-09-12T16:17:09.216 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:09.215+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:09.223 INFO:teuthology.orchestra.run.smithi204.stdout:3541 write 0xd8bf400 thru 0xd8c1128 (0x1d29 bytes) 2024-09-12T16:17:09.229 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:09.229 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:09.230 INFO:teuthology.orchestra.run.smithi204.stdout:3542 trunc from 0xd8c1200 to 0x890b800 2024-09-12T16:17:09.238 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:17:09.255 INFO:teuthology.orchestra.run.smithi204.stdout:3543 write 0x4dcc000 thru 0x4dd79bc (0xb9bd bytes) 2024-09-12T16:17:09.255 INFO:teuthology.orchestra.run.smithi204.stdout:3545 write 0x7df7c00 thru 0x7e04d09 (0xd10a bytes) 2024-09-12T16:17:09.255 INFO:teuthology.orchestra.run.smithi204.stdout:3546 read 0x20e7400 thru 0x20ed86a (0x646b bytes) 2024-09-12T16:17:09.261 INFO:teuthology.orchestra.run.smithi204.stdout:3548 trunc from 0x890b800 to 0xdf84000 2024-09-12T16:17:09.284 INFO:teuthology.orchestra.run.smithi204.stdout:3551 read 0x36b5400 thru 0x36b975a (0x435b bytes) 2024-09-12T16:17:09.284 INFO:teuthology.orchestra.run.smithi204.stdout:3552 punch from 0x127f800 to 0x128a600, (0xae00 bytes) 2024-09-12T16:17:09.285 INFO:teuthology.orchestra.run.smithi204.stdout:3554 write 0x511ba00 thru 0x511c0b5 (0x6b6 bytes) 2024-09-12T16:17:09.285 INFO:teuthology.orchestra.run.smithi204.stdout:3555 read 0x66ae200 thru 0x66b6043 (0x7e44 bytes) 2024-09-12T16:17:09.285 INFO:teuthology.orchestra.run.smithi204.stdout:3557 write 0x211dc00 thru 0x211f8b3 (0x1cb4 bytes) 2024-09-12T16:17:09.285 INFO:teuthology.orchestra.run.smithi204.stdout:3558 write 0x1bbd000 thru 0x1bc3957 (0x6958 bytes) 2024-09-12T16:17:09.285 INFO:teuthology.orchestra.run.smithi204.stdout:3559 read 0x2dbb000 thru 0x2dbf259 (0x425a bytes) 2024-09-12T16:17:09.285 INFO:teuthology.orchestra.run.smithi204.stdout:3561 read 0x3a4e400 thru 0x3a4e692 (0x293 bytes) 2024-09-12T16:17:09.285 INFO:teuthology.orchestra.run.smithi204.stdout:3565 read 0x91eee00 thru 0x91fa6aa (0xb8ab bytes) 2024-09-12T16:17:09.285 INFO:teuthology.orchestra.run.smithi204.stdout:3567 read 0x794e600 thru 0x7950c18 (0x2619 bytes) 2024-09-12T16:17:09.287 INFO:teuthology.orchestra.run.smithi204.stdout:3570 write 0x83f4c00 thru 0x83fd833 (0x8c34 bytes) 2024-09-12T16:17:09.287 INFO:teuthology.orchestra.run.smithi204.stdout:3571 read 0xa09d600 thru 0xa0a8196 (0xab97 bytes) 2024-09-12T16:17:09.287 INFO:teuthology.orchestra.run.smithi204.stdout:3572 punch from 0x608d200 to 0x609bc00, (0xea00 bytes) 2024-09-12T16:17:09.287 INFO:teuthology.orchestra.run.smithi204.stdout:3574 read 0xb266400 thru 0xb2750dd (0xecde bytes) 2024-09-12T16:17:09.288 INFO:teuthology.orchestra.run.smithi204.stdout:3577 read 0x9f19400 thru 0x9f216a4 (0x82a5 bytes) 2024-09-12T16:17:09.288 INFO:teuthology.orchestra.run.smithi204.stdout:3578 write 0x9042e00 thru 0x904bb8e (0x8d8f bytes) 2024-09-12T16:17:09.288 INFO:teuthology.orchestra.run.smithi204.stdout:3581 read 0x21ce200 thru 0x21d1d17 (0x3b18 bytes) 2024-09-12T16:17:09.288 INFO:teuthology.orchestra.run.smithi204.stdout:3582 write 0x3b66800 thru 0x3b6cf3f (0x6740 bytes) 2024-09-12T16:17:09.288 INFO:teuthology.orchestra.run.smithi204.stdout:3586 read 0x3065c00 thru 0x306be36 (0x6237 bytes) 2024-09-12T16:17:09.288 INFO:teuthology.orchestra.run.smithi204.stdout:3589 read 0x2134400 thru 0x2140823 (0xc424 bytes) 2024-09-12T16:17:09.288 INFO:teuthology.orchestra.run.smithi204.stdout:3590 read 0x600f000 thru 0x600febb (0xebc bytes) 2024-09-12T16:17:09.288 INFO:teuthology.orchestra.run.smithi204.stdout:3592 write 0xc4d8000 thru 0xc4e45d7 (0xc5d8 bytes) 2024-09-12T16:17:09.288 INFO:teuthology.orchestra.run.smithi204.stdout:3593 write 0x2601400 thru 0x260a3d6 (0x8fd7 bytes) 2024-09-12T16:17:09.288 INFO:teuthology.orchestra.run.smithi204.stdout:3595 read 0x71b9400 thru 0x71c0e84 (0x7a85 bytes) 2024-09-12T16:17:09.289 INFO:teuthology.orchestra.run.smithi204.stdout:3596 read 0xcfe6a00 thru 0xcfe982d (0x2e2e bytes) 2024-09-12T16:17:09.289 INFO:teuthology.orchestra.run.smithi204.stdout:3598 read 0x5ec6800 thru 0x5ec6ce8 (0x4e9 bytes) 2024-09-12T16:17:09.289 INFO:teuthology.orchestra.run.smithi204.stdout:3600 read 0xc0aa400 thru 0xc0ae77b (0x437c bytes) 2024-09-12T16:17:09.289 INFO:teuthology.orchestra.run.smithi204.stdout:3605 write 0x3cf1c00 thru 0x3cfc1c1 (0xa5c2 bytes) 2024-09-12T16:17:09.292 INFO:teuthology.orchestra.run.smithi204.stdout:3608 trunc from 0xdf84000 to 0x9e12400 2024-09-12T16:17:09.317 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:09.317+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:09.332 INFO:teuthology.orchestra.run.smithi204.stdout:3609 trunc from 0x9e12400 to 0x70ebe00 2024-09-12T16:17:09.346 INFO:teuthology.orchestra.run.smithi204.stdout:3612 read 0x145ea00 thru 0x1463334 (0x4935 bytes) 2024-09-12T16:17:09.352 INFO:teuthology.orchestra.run.smithi204.stdout:3613 punch from 0xd59400 to 0xd59600, (0x200 bytes) 2024-09-12T16:17:09.352 INFO:teuthology.orchestra.run.smithi204.stdout:3615 read 0x1dc9a00 thru 0x1dd322a (0x982b bytes) 2024-09-12T16:17:09.352 INFO:teuthology.orchestra.run.smithi204.stdout:3617 read 0x4531c00 thru 0x45411f9 (0xf5fa bytes) 2024-09-12T16:17:09.352 INFO:teuthology.orchestra.run.smithi204.stdout:3619 write 0x3311a00 thru 0x331b9bc (0x9fbd bytes) 2024-09-12T16:17:09.355 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:09.356 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:09.366 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:17:09.367 INFO:teuthology.orchestra.run.smithi204.stdout:3623 write 0x8f49800 thru 0x8f564af (0xccb0 bytes) 2024-09-12T16:17:09.376 INFO:teuthology.orchestra.run.smithi204.stdout:3625 trunc from 0x8f56600 to 0x1279c00 2024-09-12T16:17:09.410 INFO:teuthology.orchestra.run.smithi204.stdout:3626 trunc from 0x1279c00 to 0x63e6200 2024-09-12T16:17:09.420 INFO:teuthology.orchestra.run.smithi204.stdout:3627 read 0x3624a00 thru 0x3626208 (0x1809 bytes) 2024-09-12T16:17:09.436 INFO:teuthology.orchestra.run.smithi204.stdout:3629 write 0x84d1a00 thru 0x84dce08 (0xb409 bytes) 2024-09-12T16:17:09.437 INFO:teuthology.orchestra.run.smithi204.stdout:3630 read 0x526b800 thru 0x5275fce (0xa7cf bytes) 2024-09-12T16:17:09.438 INFO:teuthology.orchestra.run.smithi204.stdout:3631 write 0x16ca400 thru 0x16d9acb (0xf6cc bytes) 2024-09-12T16:17:09.441 INFO:teuthology.orchestra.run.smithi204.stdout:3632 trunc from 0x84dd000 to 0xb0bde00 2024-09-12T16:17:09.450 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:09.450+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:09.474 INFO:teuthology.orchestra.run.smithi204.stdout:3633 write 0xdde4e00 thru 0xdde63ba (0x15bb bytes) 2024-09-12T16:17:09.475 INFO:teuthology.orchestra.run.smithi204.stdout:3634 write 0x8c16000 thru 0x8c17f2b (0x1f2c bytes) 2024-09-12T16:17:09.475 INFO:teuthology.orchestra.run.smithi204.stdout:3636 read 0x4227e00 thru 0x4228e69 (0x106a bytes) 2024-09-12T16:17:09.475 INFO:teuthology.orchestra.run.smithi204.stdout:3637 write 0xdb83000 thru 0xdb88f32 (0x5f33 bytes) 2024-09-12T16:17:09.475 INFO:teuthology.orchestra.run.smithi204.stdout:3639 write 0xc268800 thru 0xc26e092 (0x5893 bytes) 2024-09-12T16:17:09.476 INFO:teuthology.orchestra.run.smithi204.stdout:3642 punch from 0x67f6600 to 0x67f9800, (0x3200 bytes) 2024-09-12T16:17:09.476 INFO:teuthology.orchestra.run.smithi204.stdout:3646 write 0xb160800 thru 0xb161738 (0xf39 bytes) 2024-09-12T16:17:09.476 INFO:teuthology.orchestra.run.smithi204.stdout:3649 write 0x385b200 thru 0x385d433 (0x2234 bytes) 2024-09-12T16:17:09.491 INFO:teuthology.orchestra.run.smithi204.stdout:3652 trunc from 0xdde6400 to 0x501600 2024-09-12T16:17:09.520 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:09.519+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:09.526 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:09.526 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:09.535 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:17:09.544 INFO:teuthology.orchestra.run.smithi204.stdout:3654 write 0x8885a00 thru 0x88894c6 (0x3ac7 bytes) 2024-09-12T16:17:09.544 INFO:teuthology.orchestra.run.smithi204.stdout:3655 write 0x60bf200 thru 0x60c9140 (0x9f41 bytes) 2024-09-12T16:17:09.555 INFO:teuthology.orchestra.run.smithi204.stdout:3656 trunc from 0x8889600 to 0x234a00 2024-09-12T16:17:09.577 INFO:teuthology.orchestra.run.smithi204.stdout:3657 read 0x15b800 thru 0x15c243 (0xa44 bytes) 2024-09-12T16:17:09.578 INFO:teuthology.orchestra.run.smithi204.stdout:3658 read 0xaa000 thru 0xb82a9 (0xe2aa bytes) 2024-09-12T16:17:09.578 INFO:teuthology.orchestra.run.smithi204.stdout:3660 read 0x21b400 thru 0x220217 (0x4e18 bytes) 2024-09-12T16:17:09.590 INFO:teuthology.orchestra.run.smithi204.stdout:3661 write 0x1478800 thru 0x148041e (0x7c1f bytes) 2024-09-12T16:17:09.597 INFO:teuthology.orchestra.run.smithi204.stdout:3662 trunc from 0x1480600 to 0x6413000 2024-09-12T16:17:09.611 INFO:teuthology.orchestra.run.smithi204.stdout:3663 punch from 0x54e8000 to 0x54f5e00, (0xde00 bytes) 2024-09-12T16:17:09.612 INFO:teuthology.orchestra.run.smithi204.stdout:3664 write 0xb4b400 thru 0xb4f4b3 (0x40b4 bytes) 2024-09-12T16:17:09.612 INFO:teuthology.orchestra.run.smithi204.stdout:3665 read 0x169b800 thru 0x16a4787 (0x8f88 bytes) 2024-09-12T16:17:09.612 INFO:teuthology.orchestra.run.smithi204.stdout:3666 trunc from 0x6413000 to 0x6a5b800 2024-09-12T16:17:09.620 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:09.620+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:09.626 INFO:teuthology.orchestra.run.smithi204.stdout:3668 punch from 0x4ff3400 to 0x5002000, (0xec00 bytes) 2024-09-12T16:17:09.641 INFO:teuthology.orchestra.run.smithi204.stdout:3670 write 0x74d4600 thru 0x74d6cd9 (0x26da bytes) 2024-09-12T16:17:09.642 INFO:teuthology.orchestra.run.smithi204.stdout:3671 read 0x7285000 thru 0x728a220 (0x5221 bytes) 2024-09-12T16:17:09.663 INFO:teuthology.orchestra.run.smithi204.stdout:3674 write 0xe5b1e00 thru 0xe5bc88e (0xaa8f bytes) 2024-09-12T16:17:09.664 INFO:teuthology.orchestra.run.smithi204.stdout:3682 write 0x408aa00 thru 0x408f410 (0x4a11 bytes) 2024-09-12T16:17:09.664 INFO:teuthology.orchestra.run.smithi204.stdout:3683 write 0x455ec00 thru 0x45607c6 (0x1bc7 bytes) 2024-09-12T16:17:09.665 INFO:teuthology.orchestra.run.smithi204.stdout:3685 write 0xa901600 thru 0xa9040ed (0x2aee bytes) 2024-09-12T16:17:09.665 INFO:teuthology.orchestra.run.smithi204.stdout:3691 write 0xa39ee00 thru 0xa3a4897 (0x5a98 bytes) 2024-09-12T16:17:09.665 INFO:teuthology.orchestra.run.smithi204.stdout:3693 punch from 0x9810e00 to 0x9819600, (0x8800 bytes) 2024-09-12T16:17:09.666 INFO:teuthology.orchestra.run.smithi204.stdout:3694 write 0x3566600 thru 0x3568e32 (0x2833 bytes) 2024-09-12T16:17:09.666 INFO:teuthology.orchestra.run.smithi204.stdout:3696 read 0x2e75a00 thru 0x2e7ee55 (0x9456 bytes) 2024-09-12T16:17:09.666 INFO:teuthology.orchestra.run.smithi204.stdout:3697 read 0x49cc600 thru 0x49dc4a2 (0xfea3 bytes) 2024-09-12T16:17:09.666 INFO:teuthology.orchestra.run.smithi204.stdout:3702 read 0xcbff600 thru 0xcc03d42 (0x4743 bytes) 2024-09-12T16:17:09.666 INFO:teuthology.orchestra.run.smithi204.stdout:3705 read 0xa6a2400 thru 0xa6ad1b9 (0xadba bytes) 2024-09-12T16:17:09.666 INFO:teuthology.orchestra.run.smithi204.stdout:3707 write 0xc84fa00 thru 0xc858ca9 (0x92aa bytes) 2024-09-12T16:17:09.666 INFO:teuthology.orchestra.run.smithi204.stdout:3710 read 0x8e73600 thru 0x8e747f9 (0x11fa bytes) 2024-09-12T16:17:09.670 INFO:teuthology.orchestra.run.smithi204.stdout:3711 trunc from 0xe5bca00 to 0xa80fe00 2024-09-12T16:17:09.699 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:09.700 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:09.704 INFO:teuthology.orchestra.run.smithi204.stdout:3712 read 0x3001400 thru 0x3008a93 (0x7694 bytes) 2024-09-12T16:17:09.705 INFO:teuthology.orchestra.run.smithi204.stdout:3713 write 0x2d9bc00 thru 0x2daa607 (0xea08 bytes) 2024-09-12T16:17:09.705 INFO:teuthology.orchestra.run.smithi204.stdout:3714 write 0x80db200 thru 0x80e6ce9 (0xbaea bytes) 2024-09-12T16:17:09.705 INFO:teuthology.orchestra.run.smithi204.stdout:3716 punch from 0x8a75c00 to 0x8a76a00, (0xe00 bytes) 2024-09-12T16:17:09.706 INFO:teuthology.orchestra.run.smithi204.stdout:3718 punch from 0x897a00 to 0x8a2000, (0xa600 bytes) 2024-09-12T16:17:09.706 INFO:teuthology.orchestra.run.smithi204.stdout:3719 read 0x98c5000 thru 0x98cfd9b (0xad9c bytes) 2024-09-12T16:17:09.706 INFO:teuthology.orchestra.run.smithi204.stdout:3720 write 0x4c23a00 thru 0x4c28c67 (0x5268 bytes) 2024-09-12T16:17:09.709 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:17:09.726 INFO:teuthology.orchestra.run.smithi204.stdout:3723 write 0xc720400 thru 0xc727340 (0x6f41 bytes) 2024-09-12T16:17:09.736 INFO:teuthology.orchestra.run.smithi204.stdout:3725 trunc from 0xc727400 to 0x489d600 2024-09-12T16:17:09.750 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:09.750+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:09.785 INFO:teuthology.orchestra.run.smithi204.stdout:3727 write 0xe3cf400 thru 0xe3d92fc (0x9efd bytes) 2024-09-12T16:17:09.787 INFO:teuthology.orchestra.run.smithi204.stdout:3728 punch from 0x1bb0e00 to 0x1bb4200, (0x3400 bytes) 2024-09-12T16:17:09.787 INFO:teuthology.orchestra.run.smithi204.stdout:3730 punch from 0x2f1b800 to 0x2f1ec00, (0x3400 bytes) 2024-09-12T16:17:09.787 INFO:teuthology.orchestra.run.smithi204.stdout:3731 write 0x2b7800 thru 0x2bebaa (0x73ab bytes) 2024-09-12T16:17:09.787 INFO:teuthology.orchestra.run.smithi204.stdout:3732 write 0x4a8800 thru 0x4b620b (0xda0c bytes) 2024-09-12T16:17:09.788 INFO:teuthology.orchestra.run.smithi204.stdout:3733 read 0x139a000 thru 0x139f0cc (0x50cd bytes) 2024-09-12T16:17:09.788 INFO:teuthology.orchestra.run.smithi204.stdout:3735 read 0x93ece00 thru 0x93f50f3 (0x82f4 bytes) 2024-09-12T16:17:09.788 INFO:teuthology.orchestra.run.smithi204.stdout:3736 punch from 0x37f2200 to 0x3800800, (0xe600 bytes) 2024-09-12T16:17:09.800 INFO:teuthology.orchestra.run.smithi204.stdout:3737 trunc from 0xe3d9400 to 0x3dfc400 2024-09-12T16:17:09.816 INFO:teuthology.orchestra.run.smithi204.stdout:3738 trunc from 0x3dfc400 to 0x41cf400 2024-09-12T16:17:09.822 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:09.821+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:09.826 INFO:teuthology.orchestra.run.smithi204.stdout:3739 punch from 0x1fb1400 to 0x1fc0200, (0xee00 bytes) 2024-09-12T16:17:09.840 INFO:teuthology.orchestra.run.smithi204.stdout:3740 write 0x682f600 thru 0x68390c7 (0x9ac8 bytes) 2024-09-12T16:17:09.841 INFO:teuthology.orchestra.run.smithi204.stdout:3742 punch from 0x1bdd400 to 0x1be3c00, (0x6800 bytes) 2024-09-12T16:17:09.848 INFO:teuthology.orchestra.run.smithi204.stdout:3743 trunc from 0x6839200 to 0xbac3200 2024-09-12T16:17:09.859 INFO:teuthology.orchestra.run.smithi204.stdout:3744 punch from 0xa5ace00 to 0xa5af000, (0x2200 bytes) 2024-09-12T16:17:09.871 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:09.871 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:09.873 INFO:teuthology.orchestra.run.smithi204.stdout:3747 write 0xe571a00 thru 0xe5778f2 (0x5ef3 bytes) 2024-09-12T16:17:09.873 INFO:teuthology.orchestra.run.smithi204.stdout:3748 read 0x7096a00 thru 0x70a1ccf (0xb2d0 bytes) 2024-09-12T16:17:09.874 INFO:teuthology.orchestra.run.smithi204.stdout:3752 write 0xa23600 thru 0xa2ccc5 (0x96c6 bytes) 2024-09-12T16:17:09.874 INFO:teuthology.orchestra.run.smithi204.stdout:3753 punch from 0x6e7e400 to 0x6e8c400, (0xe000 bytes) 2024-09-12T16:17:09.875 INFO:teuthology.orchestra.run.smithi204.stdout:3754 write 0xb5d4400 thru 0xb5e2233 (0xde34 bytes) 2024-09-12T16:17:09.875 INFO:teuthology.orchestra.run.smithi204.stdout:3756 read 0x8e96600 thru 0x8e994d9 (0x2eda bytes) 2024-09-12T16:17:09.875 INFO:teuthology.orchestra.run.smithi204.stdout:3758 read 0x844c800 thru 0x8455349 (0x8b4a bytes) 2024-09-12T16:17:09.875 INFO:teuthology.orchestra.run.smithi204.stdout:3760 write 0x2b5600 thru 0x2baf25 (0x5926 bytes) 2024-09-12T16:17:09.882 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:17:09.894 INFO:teuthology.orchestra.run.smithi204.stdout:3761 trunc from 0xe577a00 to 0x183b600 2024-09-12T16:17:09.923 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:09.922+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:09.928 INFO:teuthology.orchestra.run.smithi204.stdout:3762 punch from 0x10d0c00 to 0x10dd400, (0xc800 bytes) 2024-09-12T16:17:09.947 INFO:teuthology.orchestra.run.smithi204.stdout:3763 write 0x8481e00 thru 0x8487a8b (0x5c8c bytes) 2024-09-12T16:17:09.947 INFO:teuthology.orchestra.run.smithi204.stdout:3765 read 0x13af200 thru 0x13b9ff8 (0xadf9 bytes) 2024-09-12T16:17:09.948 INFO:teuthology.orchestra.run.smithi204.stdout:3766 punch from 0x291e600 to 0x2923a00, (0x5400 bytes) 2024-09-12T16:17:09.961 INFO:teuthology.orchestra.run.smithi204.stdout:3768 write 0xb166200 thru 0xb168f87 (0x2d88 bytes) 2024-09-12T16:17:09.962 INFO:teuthology.orchestra.run.smithi204.stdout:3769 read 0x59f9600 thru 0x59fc526 (0x2f27 bytes) 2024-09-12T16:17:09.977 INFO:teuthology.orchestra.run.smithi204.stdout:3771 write 0xdf78200 thru 0xdf7f8f9 (0x76fa bytes) 2024-09-12T16:17:09.979 INFO:teuthology.orchestra.run.smithi204.stdout:3772 trunc from 0xdf7fa00 to 0xea80400 2024-09-12T16:17:09.992 INFO:teuthology.orchestra.run.smithi204.stdout:3773 write 0x6471800 thru 0x6478951 (0x7152 bytes) 2024-09-12T16:17:09.999 INFO:teuthology.orchestra.run.smithi204.stdout:3774 write 0xba43200 thru 0xba50cd7 (0xdad8 bytes) 2024-09-12T16:17:09.999 INFO:teuthology.orchestra.run.smithi204.stdout:3777 read 0x2566400 thru 0x256a86f (0x4470 bytes) 2024-09-12T16:17:10.000 INFO:teuthology.orchestra.run.smithi204.stdout:3778 read 0x6d0e00 thru 0x6dff9b (0xf19c bytes) 2024-09-12T16:17:10.000 INFO:teuthology.orchestra.run.smithi204.stdout:3780 write 0x1a54e00 thru 0x1a55da2 (0xfa3 bytes) 2024-09-12T16:17:10.001 INFO:teuthology.orchestra.run.smithi204.stdout:3781 punch from 0x7224800 to 0x722aa00, (0x6200 bytes) 2024-09-12T16:17:10.001 INFO:teuthology.orchestra.run.smithi204.stdout:3783 read 0x792ce00 thru 0x793cc5e (0xfe5f bytes) 2024-09-12T16:17:10.001 INFO:teuthology.orchestra.run.smithi204.stdout:3785 punch from 0xbe78400 to 0xbe79200, (0xe00 bytes) 2024-09-12T16:17:10.001 INFO:teuthology.orchestra.run.smithi204.stdout:3786 write 0x6e17400 thru 0x6e26f0a (0xfb0b bytes) 2024-09-12T16:17:10.001 INFO:teuthology.orchestra.run.smithi204.stdout:3789 write 0x9755a00 thru 0x975b818 (0x5e19 bytes) 2024-09-12T16:17:10.001 INFO:teuthology.orchestra.run.smithi204.stdout:3790 write 0xc755000 thru 0xc75b1c8 (0x61c9 bytes) 2024-09-12T16:17:10.001 INFO:teuthology.orchestra.run.smithi204.stdout:3792 write 0xb9e4000 thru 0xb9e73ae (0x33af bytes) 2024-09-12T16:17:10.001 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:10.001 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:10.010 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:17:10.014 INFO:teuthology.orchestra.run.smithi204.stdout:3793 trunc from 0xea80400 to 0x2dd9a00 2024-09-12T16:17:10.050 INFO:teuthology.orchestra.run.smithi204.stdout:3796 read 0x2764a00 thru 0x2770b2c (0xc12d bytes) 2024-09-12T16:17:10.056 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:10.054+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:10.078 INFO:teuthology.orchestra.run.smithi204.stdout:3798 write 0xc50ec00 thru 0xc518189 (0x958a bytes) 2024-09-12T16:17:10.086 INFO:teuthology.orchestra.run.smithi204.stdout:3799 read 0xbc9ca00 thru 0xbca0d24 (0x4325 bytes) 2024-09-12T16:17:10.086 INFO:teuthology.orchestra.run.smithi204.stdout:3801 write 0x759da00 thru 0x75ac3c0 (0xe9c1 bytes) 2024-09-12T16:17:10.086 INFO:teuthology.orchestra.run.smithi204.stdout:3807 punch from 0x982bc00 to 0x982f200, (0x3600 bytes) 2024-09-12T16:17:10.086 INFO:teuthology.orchestra.run.smithi204.stdout:3808 punch from 0x2543c00 to 0x254e400, (0xa800 bytes) 2024-09-12T16:17:10.086 INFO:teuthology.orchestra.run.smithi204.stdout:3810 write 0x487f400 thru 0x488e0b2 (0xecb3 bytes) 2024-09-12T16:17:10.087 INFO:teuthology.orchestra.run.smithi204.stdout:3811 write 0xba15c00 thru 0xba1b173 (0x5574 bytes) 2024-09-12T16:17:10.087 INFO:teuthology.orchestra.run.smithi204.stdout:3812 trunc from 0xc518200 to 0xd18ca00 2024-09-12T16:17:10.122 INFO:teuthology.orchestra.run.smithi204.stdout:3813 trunc from 0xd18ca00 to 0x3730400 2024-09-12T16:17:10.125 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:10.124+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:10.127 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:10.127 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:10.137 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:17:10.139 INFO:teuthology.orchestra.run.smithi204.stdout:3815 punch from 0x3d0600 to 0x3dec00, (0xe600 bytes) 2024-09-12T16:17:10.140 INFO:teuthology.orchestra.run.smithi204.stdout:3817 clone 23 order 22 su 65536 sc 12 2024-09-12T16:17:10.225 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:10.225+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:10.254 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T16:17:10.261 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T16:17:10.290 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:10.290 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:10.299 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:17:10.340 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:10.340+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:10.426 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:17:10.427 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:17:10.427 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:10.426+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:10.444 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:17:10.444 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:17:10.449 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:10.449 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:10.458 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:17:10.462 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:17:10.462 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:17:10.480 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:17:10.481 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:17:10.500 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:17:10.500 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:17:10.517 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:17:10.517 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:17:10.528 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:10.527+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:10.571 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:10.571 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:10.571 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:17:10.571 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:10.581 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:17:10.630 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:10.629+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:10.631 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #21, image image_client.0-clone21 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent22 2024-09-12T16:17:10.696 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:10.696 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:10.696 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:17:10.696 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:17:10.696 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:10.705 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:17:10.726 INFO:teuthology.orchestra.run.smithi204.stdout:3819 punch from 0x2044800 to 0x2048e00, (0x4600 bytes) 2024-09-12T16:17:10.737 INFO:teuthology.orchestra.run.smithi204.stdout:3823 read 0x2a07600 thru 0x2a0eba6 (0x75a7 bytes) 2024-09-12T16:17:10.749 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:10.748+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:10.759 INFO:teuthology.orchestra.run.smithi204.stdout:3825 write 0xd739e00 thru 0xd73a05b (0x25c bytes) 2024-09-12T16:17:10.781 INFO:teuthology.orchestra.run.smithi204.stdout:3826 trunc from 0xd73a200 to 0x4b6000 2024-09-12T16:17:10.821 INFO:teuthology.orchestra.run.smithi204.stdout:3828 read 0x2c8e00 thru 0x2d1c03 (0x8e04 bytes) 2024-09-12T16:17:10.823 INFO:teuthology.orchestra.run.smithi204.stdout:3829 punch from 0xd9a00 to 0xe3400, (0x9a00 bytes) 2024-09-12T16:17:10.829 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:10.830 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:17:10.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:17:10.830 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:17:10.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.830 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3703 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14803968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:10.830 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139513+0000", 2024-09-12T16:17:10.830 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.688648227000002, 2024-09-12T16:17:10.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053248794000000002, 2024-09-12T16:17:10.830 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:10.830 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:10.830 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:10.830 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:10.831 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:10.831 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:10.831 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3703 2024-09-12T16:17:10.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.831 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:10.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:10.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139513+0000", 2024-09-12T16:17:10.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:10.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139513+0000", 2024-09-12T16:17:10.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.832 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:10.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139639+0000", 2024-09-12T16:17:10.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012673299999999999 2024-09-12T16:17:10.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.832 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:10.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139642+0000", 2024-09-12T16:17:10.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4820000000000001e-06 2024-09-12T16:17:10.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.832 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:10.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139647+0000", 2024-09-12T16:17:10.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8040000000000001e-06 2024-09-12T16:17:10.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:10.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139650+0000", 2024-09-12T16:17:10.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.529e-06 2024-09-12T16:17:10.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:10.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192537+0000", 2024-09-12T16:17:10.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052886503000000001 2024-09-12T16:17:10.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:10.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192627+0000", 2024-09-12T16:17:10.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0183e-05 2024-09-12T16:17:10.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:10.834 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192761+0000", 2024-09-12T16:17:10.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013456000000000001 2024-09-12T16:17:10.834 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.834 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:10.834 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.834 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3705 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14812160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:10.834 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:17:10.834 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.688355975, 2024-09-12T16:17:10.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053368831999999998, 2024-09-12T16:17:10.835 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:10.835 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:10.835 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:10.835 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:10.835 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:10.835 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:10.835 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3705 2024-09-12T16:17:10.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.835 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:10.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:10.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:17:10.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:10.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:17:10.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:10.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139932+0000", 2024-09-12T16:17:10.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012762099999999999 2024-09-12T16:17:10.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:10.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139935+0000", 2024-09-12T16:17:10.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.119e-06 2024-09-12T16:17:10.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:10.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139939+0000", 2024-09-12T16:17:10.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7999999999999998e-06 2024-09-12T16:17:10.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:10.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139953+0000", 2024-09-12T16:17:10.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3923999999999999e-05 2024-09-12T16:17:10.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:10.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192946+0000", 2024-09-12T16:17:10.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052992971 2024-09-12T16:17:10.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:10.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193035+0000", 2024-09-12T16:17:10.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9040000000000001e-05 2024-09-12T16:17:10.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:10.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193174+0000", 2024-09-12T16:17:10.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138357 2024-09-12T16:17:10.838 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.838 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:10.839 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.839 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3706 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14816256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:10.839 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:17:10.839 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.688200985000002, 2024-09-12T16:17:10.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053341723000000001, 2024-09-12T16:17:10.839 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:10.839 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:10.839 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:10.839 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:10.839 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:10.839 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:10.840 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3706 2024-09-12T16:17:10.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.840 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:10.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:10.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:17:10.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:10.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:17:10.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:10.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140090+0000", 2024-09-12T16:17:10.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013020100000000001 2024-09-12T16:17:10.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:10.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140097+0000", 2024-09-12T16:17:10.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0709999999999997e-06 2024-09-12T16:17:10.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:10.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140103+0000", 2024-09-12T16:17:10.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5450000000000003e-06 2024-09-12T16:17:10.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:10.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140106+0000", 2024-09-12T16:17:10.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3739999999999998e-06 2024-09-12T16:17:10.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:10.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193190+0000", 2024-09-12T16:17:10.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053084131999999999 2024-09-12T16:17:10.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:10.843 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193232+0000", 2024-09-12T16:17:10.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1517000000000002e-05 2024-09-12T16:17:10.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:10.843 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193302+0000", 2024-09-12T16:17:10.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9882999999999995e-05 2024-09-12T16:17:10.843 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.843 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:10.843 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.844 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3707 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14820352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:10.844 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:17:10.844 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.688048995999999, 2024-09-12T16:17:10.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053452771000000003, 2024-09-12T16:17:10.844 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:10.844 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:10.844 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:10.844 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:10.844 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:10.844 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:10.844 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3707 2024-09-12T16:17:10.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.845 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:10.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:10.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:17:10.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:10.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:17:10.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:10.846 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140219+0000", 2024-09-12T16:17:10.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106902 2024-09-12T16:17:10.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.846 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:10.846 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140225+0000", 2024-09-12T16:17:10.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3199999999999996e-06 2024-09-12T16:17:10.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.846 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:10.846 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140230+0000", 2024-09-12T16:17:10.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8969999999999999e-06 2024-09-12T16:17:10.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:10.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140233+0000", 2024-09-12T16:17:10.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2119999999999999e-06 2024-09-12T16:17:10.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:10.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193339+0000", 2024-09-12T16:17:10.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053105556999999998 2024-09-12T16:17:10.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:10.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193431+0000", 2024-09-12T16:17:10.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1837999999999997e-05 2024-09-12T16:17:10.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:10.848 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193565+0000", 2024-09-12T16:17:10.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013404500000000001 2024-09-12T16:17:10.848 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.848 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:10.848 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.848 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3708 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14824448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:10.848 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:17:10.848 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.687920153999997, 2024-09-12T16:17:10.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053468190999999998, 2024-09-12T16:17:10.849 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:10.849 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:10.849 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:10.849 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:10.849 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:10.849 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:10.849 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3708 2024-09-12T16:17:10.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.849 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:10.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:10.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:17:10.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:10.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:17:10.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:10.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140351+0000", 2024-09-12T16:17:10.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110096 2024-09-12T16:17:10.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:10.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140358+0000", 2024-09-12T16:17:10.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.306e-06 2024-09-12T16:17:10.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:10.851 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140368+0000", 2024-09-12T16:17:10.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0225e-05 2024-09-12T16:17:10.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:10.851 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140372+0000", 2024-09-12T16:17:10.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6169999999999998e-06 2024-09-12T16:17:10.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:10.851 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193594+0000", 2024-09-12T16:17:10.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053222419999999999 2024-09-12T16:17:10.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:10.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193640+0000", 2024-09-12T16:17:10.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.587e-05 2024-09-12T16:17:10.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:10.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193709+0000", 2024-09-12T16:17:10.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8657000000000004e-05 2024-09-12T16:17:10.852 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.852 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:10.852 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.853 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3709 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14828544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:10.853 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:17:10.853 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.687783185999997, 2024-09-12T16:17:10.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594033999999999, 2024-09-12T16:17:10.853 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:10.853 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:10.853 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:10.853 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:10.853 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:10.853 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:10.853 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3709 2024-09-12T16:17:10.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.853 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:10.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:10.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:17:10.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:10.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:17:10.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:10.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140499+0000", 2024-09-12T16:17:10.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121019 2024-09-12T16:17:10.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140501+0000", 2024-09-12T16:17:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2369999999999999e-06 2024-09-12T16:17:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140506+0000", 2024-09-12T16:17:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.639e-06 2024-09-12T16:17:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140509+0000", 2024-09-12T16:17:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3419999999999999e-06 2024-09-12T16:17:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.856 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:10.856 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193743+0000", 2024-09-12T16:17:10.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053234311999999999 2024-09-12T16:17:10.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.856 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:10.856 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193833+0000", 2024-09-12T16:17:10.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9883999999999995e-05 2024-09-12T16:17:10.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.856 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:10.856 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193972+0000", 2024-09-12T16:17:10.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138601 2024-09-12T16:17:10.856 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3710 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14832640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:17:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.687645840000002, 2024-09-12T16:17:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053607324999999997, 2024-09-12T16:17:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3710 2024-09-12T16:17:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:17:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:17:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140664+0000", 2024-09-12T16:17:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014918700000000001 2024-09-12T16:17:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140674+0000", 2024-09-12T16:17:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8379999999999997e-06 2024-09-12T16:17:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140694+0000", 2024-09-12T16:17:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0145000000000001e-05 2024-09-12T16:17:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140703+0000", 2024-09-12T16:17:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5150000000000006e-06 2024-09-12T16:17:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194006+0000", 2024-09-12T16:17:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053303370000000003 2024-09-12T16:17:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194051+0000", 2024-09-12T16:17:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5012000000000002e-05 2024-09-12T16:17:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194122+0000", 2024-09-12T16:17:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1258000000000001e-05 2024-09-12T16:17:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3711 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14836736~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:17:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.687444392000003, 2024-09-12T16:17:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053670799999999998, 2024-09-12T16:17:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3711 2024-09-12T16:17:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:17:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:17:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140782+0000", 2024-09-12T16:17:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5549999999999994e-05 2024-09-12T16:17:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140786+0000", 2024-09-12T16:17:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.89e-06 2024-09-12T16:17:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140796+0000", 2024-09-12T16:17:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0057e-05 2024-09-12T16:17:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140819+0000", 2024-09-12T16:17:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3005000000000001e-05 2024-09-12T16:17:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194159+0000", 2024-09-12T16:17:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053340324000000001 2024-09-12T16:17:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194248+0000", 2024-09-12T16:17:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9209000000000006e-05 2024-09-12T16:17:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194387+0000", 2024-09-12T16:17:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138765 2024-09-12T16:17:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.866 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3712 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14840832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:10.866 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:17:10.866 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.687329933999997, 2024-09-12T16:17:10.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053699068000000003, 2024-09-12T16:17:10.866 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:10.866 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:10.866 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:10.866 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:10.866 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:10.866 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:10.866 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3712 2024-09-12T16:17:10.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.866 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:10.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:10.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:17:10.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:10.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:17:10.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:10.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140900+0000", 2024-09-12T16:17:10.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9014e-05 2024-09-12T16:17:10.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.868 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:10.868 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140904+0000", 2024-09-12T16:17:10.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0940000000000001e-06 2024-09-12T16:17:10.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.868 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:10.868 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140933+0000", 2024-09-12T16:17:10.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8996000000000002e-05 2024-09-12T16:17:10.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.868 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:10.868 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140945+0000", 2024-09-12T16:17:10.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1909000000000001e-05 2024-09-12T16:17:10.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194415+0000", 2024-09-12T16:17:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053470403 2024-09-12T16:17:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194460+0000", 2024-09-12T16:17:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5145000000000002e-05 2024-09-12T16:17:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194530+0000", 2024-09-12T16:17:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9506999999999997e-05 2024-09-12T16:17:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3713 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14844928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:17:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.687196874000001, 2024-09-12T16:17:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053821236000000001, 2024-09-12T16:17:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3713 2024-09-12T16:17:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:17:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:17:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141078+0000", 2024-09-12T16:17:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114162 2024-09-12T16:17:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141090+0000", 2024-09-12T16:17:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.19e-05 2024-09-12T16:17:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141100+0000", 2024-09-12T16:17:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0447e-05 2024-09-12T16:17:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:10.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141108+0000", 2024-09-12T16:17:10.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7190000000000001e-06 2024-09-12T16:17:10.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:10.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194564+0000", 2024-09-12T16:17:10.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053455729 2024-09-12T16:17:10.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:10.874 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194652+0000", 2024-09-12T16:17:10.874 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8288999999999994e-05 2024-09-12T16:17:10.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.874 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:10.874 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194785+0000", 2024-09-12T16:17:10.874 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013299000000000001 2024-09-12T16:17:10.874 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.874 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:10.874 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.876 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3714 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14849024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:10.876 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:17:10.876 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.687040945, 2024-09-12T16:17:10.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053816382000000003, 2024-09-12T16:17:10.876 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:10.876 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:10.876 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:10.876 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:10.876 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:10.877 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:10.877 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3714 2024-09-12T16:17:10.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.877 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:10.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.877 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:10.877 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:17:10.877 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.877 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:10.877 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:17:10.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.878 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:10.878 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141182+0000", 2024-09-12T16:17:10.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1805999999999997e-05 2024-09-12T16:17:10.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.878 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:10.878 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141185+0000", 2024-09-12T16:17:10.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5930000000000002e-06 2024-09-12T16:17:10.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.878 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141194+0000", 2024-09-12T16:17:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5760000000000006e-06 2024-09-12T16:17:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141222+0000", 2024-09-12T16:17:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8034999999999998e-05 2024-09-12T16:17:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194817+0000", 2024-09-12T16:17:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594887000000001 2024-09-12T16:17:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194860+0000", 2024-09-12T16:17:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3714999999999997e-05 2024-09-12T16:17:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194936+0000", 2024-09-12T16:17:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5770000000000001e-05 2024-09-12T16:17:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3715 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14853120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:17:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.686917287999997, 2024-09-12T16:17:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053962307000000001, 2024-09-12T16:17:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3715 2024-09-12T16:17:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:17:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:17:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141417+0000", 2024-09-12T16:17:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017384099999999999 2024-09-12T16:17:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141422+0000", 2024-09-12T16:17:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7310000000000001e-06 2024-09-12T16:17:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141434+0000", 2024-09-12T16:17:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2058e-05 2024-09-12T16:17:10.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.884 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:10.884 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141442+0000", 2024-09-12T16:17:10.884 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7610000000000007e-06 2024-09-12T16:17:10.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.884 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:10.884 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194973+0000", 2024-09-12T16:17:10.884 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053530618000000002 2024-09-12T16:17:10.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.884 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195063+0000", 2024-09-12T16:17:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0927000000000005e-05 2024-09-12T16:17:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195206+0000", 2024-09-12T16:17:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142371 2024-09-12T16:17:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3716 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14857216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:17:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.686707437999999, 2024-09-12T16:17:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053916360000000003, 2024-09-12T16:17:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3716 2024-09-12T16:17:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:17:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:17:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142933+0000", 2024-09-12T16:17:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014796290000000001 2024-09-12T16:17:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.888 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:10.888 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142937+0000", 2024-09-12T16:17:10.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5760000000000002e-06 2024-09-12T16:17:10.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.888 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:10.888 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142946+0000", 2024-09-12T16:17:10.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0380000000000005e-06 2024-09-12T16:17:10.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.888 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:10.888 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142951+0000", 2024-09-12T16:17:10.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9749999999999998e-06 2024-09-12T16:17:10.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:10.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195246+0000", 2024-09-12T16:17:10.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052295358 2024-09-12T16:17:10.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:10.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195299+0000", 2024-09-12T16:17:10.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2976999999999998e-05 2024-09-12T16:17:10.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195370+0000", 2024-09-12T16:17:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0807000000000002e-05 2024-09-12T16:17:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3721 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14877696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.685133987, 2024-09-12T16:17:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053422994000000001, 2024-09-12T16:17:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3721 2024-09-12T16:17:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.892 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:10.892 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:10.892 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.892 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:10.892 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:10.892 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:17:10.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.892 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:10.892 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143028+0000", 2024-09-12T16:17:10.892 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7399999999999991e-07 2024-09-12T16:17:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143031+0000", 2024-09-12T16:17:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7599999999999998e-06 2024-09-12T16:17:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143034+0000", 2024-09-12T16:17:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9780000000000001e-06 2024-09-12T16:17:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196220+0000", 2024-09-12T16:17:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053186341999999998 2024-09-12T16:17:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196313+0000", 2024-09-12T16:17:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2676000000000005e-05 2024-09-12T16:17:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196450+0000", 2024-09-12T16:17:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137052 2024-09-12T16:17:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3722 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14881792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.685124094999999, 2024-09-12T16:17:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053556835999999997, 2024-09-12T16:17:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3722 2024-09-12T16:17:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.11e-07 2024-09-12T16:17:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143038+0000", 2024-09-12T16:17:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2399999999999996e-07 2024-09-12T16:17:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143041+0000", 2024-09-12T16:17:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8030000000000001e-06 2024-09-12T16:17:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143043+0000", 2024-09-12T16:17:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3140000000000002e-06 2024-09-12T16:17:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196481+0000", 2024-09-12T16:17:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053437601000000001 2024-09-12T16:17:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:10.899 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196525+0000", 2024-09-12T16:17:10.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4280000000000003e-05 2024-09-12T16:17:10.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:10.899 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196594+0000", 2024-09-12T16:17:10.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8702999999999996e-05 2024-09-12T16:17:10.899 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.899 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:10.899 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.899 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3723 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14885888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:17:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.685114913, 2024-09-12T16:17:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053815546999999998, 2024-09-12T16:17:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3723 2024-09-12T16:17:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:17:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:17:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148994+0000", 2024-09-12T16:17:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059481330000000004 2024-09-12T16:17:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148999+0000", 2024-09-12T16:17:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7140000000000001e-06 2024-09-12T16:17:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149008+0000", 2024-09-12T16:17:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4350000000000003e-06 2024-09-12T16:17:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149021+0000", 2024-09-12T16:17:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2514000000000001e-05 2024-09-12T16:17:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196630+0000", 2024-09-12T16:17:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047609758000000002 2024-09-12T16:17:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196724+0000", 2024-09-12T16:17:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3522000000000003e-05 2024-09-12T16:17:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196861+0000", 2024-09-12T16:17:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013747100000000001 2024-09-12T16:17:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4438 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15719424~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.540234136000002, 2024-09-12T16:17:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367981000000002, 2024-09-12T16:17:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4438 2024-09-12T16:17:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3e-07 2024-09-12T16:17:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287930+0000", 2024-09-12T16:17:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-12T16:17:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287937+0000", 2024-09-12T16:17:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.08e-06 2024-09-12T16:17:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287943+0000", 2024-09-12T16:17:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5709999999999997e-06 2024-09-12T16:17:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341068+0000", 2024-09-12T16:17:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053125101000000001 2024-09-12T16:17:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341154+0000", 2024-09-12T16:17:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6100999999999994e-05 2024-09-12T16:17:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341295+0000", 2024-09-12T16:17:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014087999999999999 2024-09-12T16:17:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4439 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15723520~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.540209976, 2024-09-12T16:17:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053526799, 2024-09-12T16:17:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:10.909 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:10.909 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:10.909 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:10.909 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:10.909 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4439 2024-09-12T16:17:10.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.909 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:10.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:10.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:10.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-07 2024-09-12T16:17:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287953+0000", 2024-09-12T16:17:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1349999999999999e-06 2024-09-12T16:17:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287960+0000", 2024-09-12T16:17:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-12T16:17:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287965+0000", 2024-09-12T16:17:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1580000000000004e-06 2024-09-12T16:17:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341332+0000", 2024-09-12T16:17:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367009 2024-09-12T16:17:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341402+0000", 2024-09-12T16:17:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9759999999999996e-05 2024-09-12T16:17:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341478+0000", 2024-09-12T16:17:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5412000000000002e-05 2024-09-12T16:17:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4440 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15727616~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.540188872000002, 2024-09-12T16:17:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053761601999999999, 2024-09-12T16:17:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4440 2024-09-12T16:17:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:17:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287974+0000", 2024-09-12T16:17:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0540000000000002e-06 2024-09-12T16:17:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287980+0000", 2024-09-12T16:17:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9440000000000002e-06 2024-09-12T16:17:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287987+0000", 2024-09-12T16:17:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5889999999999999e-06 2024-09-12T16:17:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341502+0000", 2024-09-12T16:17:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053515199999999999 2024-09-12T16:17:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341595+0000", 2024-09-12T16:17:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3097000000000007e-05 2024-09-12T16:17:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341734+0000", 2024-09-12T16:17:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013832800000000001 2024-09-12T16:17:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2209 3.1 3:85f36d3b:::rbd_data.1155ccb1894c.0000000000000004:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:17:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.456503734, 2024-09-12T16:17:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.060659365, 2024-09-12T16:17:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:17:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:17:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2209 2024-09-12T16:17:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:17:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:17:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371658+0000", 2024-09-12T16:17:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1570000000000001e-06 2024-09-12T16:17:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:10.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393414+0000", 2024-09-12T16:17:10.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021755495999999999 2024-09-12T16:17:10.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:10.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393447+0000", 2024-09-12T16:17:10.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3630000000000002e-05 2024-09-12T16:17:10.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393462+0000", 2024-09-12T16:17:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5048999999999999e-05 2024-09-12T16:17:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393556+0000", 2024-09-12T16:17:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3549999999999997e-05 2024-09-12T16:17:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393697+0000", 2024-09-12T16:17:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000141414 2024-09-12T16:17:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T16:17:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.394944+0000", 2024-09-12T16:17:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012463039999999999 2024-09-12T16:17:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.431803+0000", 2024-09-12T16:17:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0368594 2024-09-12T16:17:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:17:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432268+0000", 2024-09-12T16:17:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046457600000000002 2024-09-12T16:17:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:17:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432293+0000", 2024-09-12T16:17:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.527e-05 2024-09-12T16:17:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432316+0000", 2024-09-12T16:17:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3519e-05 2024-09-12T16:17:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.924 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:10.924 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:10.924 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:10.926 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:17:10.927 INFO:teuthology.orchestra.run.smithi204.stdout:3832 write 0xd9f9a00 thru 0xd9fb4dd (0x1ade bytes) 2024-09-12T16:17:10.927 INFO:teuthology.orchestra.run.smithi204.stdout:3833 read 0x5182e00 thru 0x5184594 (0x1795 bytes) 2024-09-12T16:17:10.927 INFO:teuthology.orchestra.run.smithi204.stdout:3835 read 0x9201e00 thru 0x92025f8 (0x7f9 bytes) 2024-09-12T16:17:10.927 INFO:teuthology.orchestra.run.smithi204.stdout:3842 read 0xc365000 thru 0xc3692cd (0x42ce bytes) 2024-09-12T16:17:10.927 INFO:teuthology.orchestra.run.smithi204.stdout:3845 read 0x3a28800 thru 0x3a290b1 (0x8b2 bytes) 2024-09-12T16:17:10.927 INFO:teuthology.orchestra.run.smithi204.stdout:3847 read 0x2ce9200 thru 0x2ceaaee (0x18ef bytes) 2024-09-12T16:17:10.927 INFO:teuthology.orchestra.run.smithi204.stdout:3849 write 0xdbdcc00 thru 0xdbde10d (0x150e bytes) 2024-09-12T16:17:10.927 INFO:teuthology.orchestra.run.smithi204.stdout:3850 punch from 0x4b70000 to 0x4b74800, (0x4800 bytes) 2024-09-12T16:17:10.928 INFO:teuthology.orchestra.run.smithi204.stdout:3851 write 0xe83c000 thru 0xe83d2a2 (0x12a3 bytes) 2024-09-12T16:17:10.928 INFO:teuthology.orchestra.run.smithi204.stdout:3852 punch from 0xdbee800 to 0xdbf6e00, (0x8600 bytes) 2024-09-12T16:17:10.928 INFO:teuthology.orchestra.run.smithi204.stdout:3853 write 0xc0a9400 thru 0xc0a9f37 (0xb38 bytes) 2024-09-12T16:17:10.928 INFO:teuthology.orchestra.run.smithi204.stdout:3855 read 0xda43600 thru 0xda4f19e (0xbb9f bytes) 2024-09-12T16:17:10.928 INFO:teuthology.orchestra.run.smithi204.stdout:3856 clone 24 order 18 su 1024 sc 15 2024-09-12T16:17:10.928 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:10.925+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:11.025 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:11.025+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:11.073 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:11.073 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:11.073 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:17:11.073 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:11.082 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:17:11.126 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:11.125+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:11.226 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:11.225+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:11.230 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:11.230 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:11.230 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:17:11.230 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:17:11.230 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:11.238 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:17:11.250 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2024-09-12T16:17:11.319 INFO:teuthology.orchestra.run.smithi204.stdout:truncating image image_client.0-clone23 from 0xe83d400 (overlap 0x4b6000) to 0x3c4c00 2024-09-12T16:17:11.327 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:11.326+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:11.368 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:11.368 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:17:11.368 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:17:11.368 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:17:11.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.369 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2300 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12372992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:11.369 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:17:11.369 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.470845074000003, 2024-09-12T16:17:11.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037401246999999999, 2024-09-12T16:17:11.369 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:11.369 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:11.369 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:11.369 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:11.369 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:11.369 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:11.369 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2300 2024-09-12T16:17:11.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.370 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:11.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:11.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:17:11.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:11.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:17:11.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:11.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:17:11.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6100000000000002e-07 2024-09-12T16:17:11.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:11.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896026+0000", 2024-09-12T16:17:11.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9130000000000001e-06 2024-09-12T16:17:11.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:11.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896032+0000", 2024-09-12T16:17:11.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7540000000000003e-06 2024-09-12T16:17:11.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:11.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896036+0000", 2024-09-12T16:17:11.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5750000000000002e-06 2024-09-12T16:17:11.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:11.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933254+0000", 2024-09-12T16:17:11.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037217962 2024-09-12T16:17:11.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:11.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933341+0000", 2024-09-12T16:17:11.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6296000000000002e-05 2024-09-12T16:17:11.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:11.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933425+0000", 2024-09-12T16:17:11.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4386000000000001e-05 2024-09-12T16:17:11.373 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.373 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:11.373 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.373 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2301 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12377088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:11.373 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896043+0000", 2024-09-12T16:17:11.373 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.470825331999997, 2024-09-12T16:17:11.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037486197999999998, 2024-09-12T16:17:11.373 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:11.373 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:11.374 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:11.374 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:11.374 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:11.374 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:11.374 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2301 2024-09-12T16:17:11.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.374 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:11.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:11.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896043+0000", 2024-09-12T16:17:11.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:11.375 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896043+0000", 2024-09-12T16:17:11.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:11.375 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896044+0000", 2024-09-12T16:17:11.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.41e-07 2024-09-12T16:17:11.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:11.375 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896053+0000", 2024-09-12T16:17:11.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8049999999999996e-06 2024-09-12T16:17:11.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.376 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:11.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896060+0000", 2024-09-12T16:17:11.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.221e-06 2024-09-12T16:17:11.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.376 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:11.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896065+0000", 2024-09-12T16:17:11.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1109999999999999e-06 2024-09-12T16:17:11.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.376 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:11.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933452+0000", 2024-09-12T16:17:11.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037386560999999999 2024-09-12T16:17:11.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:11.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933491+0000", 2024-09-12T16:17:11.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9789000000000001e-05 2024-09-12T16:17:11.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:11.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933530+0000", 2024-09-12T16:17:11.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.837e-05 2024-09-12T16:17:11.377 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.377 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:11.377 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.378 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2302 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12381184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:11.378 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:17:11.378 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.470783892, 2024-09-12T16:17:11.378 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037645284000000001, 2024-09-12T16:17:11.378 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:11.378 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:11.378 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:11.378 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:11.378 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:11.378 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:11.378 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2302 2024-09-12T16:17:11.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.379 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:11.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.379 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:11.379 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:17:11.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.379 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:11.379 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:17:11.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.379 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:11.379 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:17:11.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6800000000000001e-07 2024-09-12T16:17:11.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:11.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896088+0000", 2024-09-12T16:17:11.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3429999999999998e-06 2024-09-12T16:17:11.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:11.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896096+0000", 2024-09-12T16:17:11.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0860000000000002e-06 2024-09-12T16:17:11.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:11.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896102+0000", 2024-09-12T16:17:11.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7610000000000004e-06 2024-09-12T16:17:11.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.381 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:11.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933563+0000", 2024-09-12T16:17:11.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037461019999999998 2024-09-12T16:17:11.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.381 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:11.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933648+0000", 2024-09-12T16:17:11.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5468000000000002e-05 2024-09-12T16:17:11.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.381 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:11.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933730+0000", 2024-09-12T16:17:11.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2138000000000005e-05 2024-09-12T16:17:11.382 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.382 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:11.382 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.382 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2303 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12385280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:11.382 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:17:11.382 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.470760089999999, 2024-09-12T16:17:11.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037723083999999997, 2024-09-12T16:17:11.382 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:11.382 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:11.382 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:11.382 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:11.382 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:11.383 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:11.383 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2303 2024-09-12T16:17:11.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.383 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:11.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:11.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:17:11.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:11.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:17:11.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:11.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:17:11.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2500000000000001e-07 2024-09-12T16:17:11.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:11.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896115+0000", 2024-09-12T16:17:11.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.28e-06 2024-09-12T16:17:11.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:11.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896122+0000", 2024-09-12T16:17:11.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4590000000000003e-06 2024-09-12T16:17:11.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.385 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:11.385 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896127+0000", 2024-09-12T16:17:11.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0509999999999996e-06 2024-09-12T16:17:11.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.385 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:11.385 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933755+0000", 2024-09-12T16:17:11.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037627729999999998 2024-09-12T16:17:11.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.385 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:11.385 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933794+0000", 2024-09-12T16:17:11.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9255000000000003e-05 2024-09-12T16:17:11.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.386 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:11.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933832+0000", 2024-09-12T16:17:11.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7883999999999998e-05 2024-09-12T16:17:11.386 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.386 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:11.386 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.386 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2304 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12389376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:11.386 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:17:11.387 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.470734741000001, 2024-09-12T16:17:11.387 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037911010000000002, 2024-09-12T16:17:11.387 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:11.387 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:11.387 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:11.387 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:11.387 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:11.387 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:11.387 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2304 2024-09-12T16:17:11.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.387 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:11.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.387 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:11.387 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:17:11.387 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:11.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:17:11.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:11.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:17:11.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9900000000000001e-07 2024-09-12T16:17:11.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:11.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896136+0000", 2024-09-12T16:17:11.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.897e-06 2024-09-12T16:17:11.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.389 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:11.389 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896142+0000", 2024-09-12T16:17:11.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9290000000000003e-06 2024-09-12T16:17:11.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.389 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:11.389 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896154+0000", 2024-09-12T16:17:11.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.201e-05 2024-09-12T16:17:11.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.389 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:11.389 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933865+0000", 2024-09-12T16:17:11.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037710225 2024-09-12T16:17:11.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:11.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933961+0000", 2024-09-12T16:17:11.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6315000000000002e-05 2024-09-12T16:17:11.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:11.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934045+0000", 2024-09-12T16:17:11.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4234999999999996e-05 2024-09-12T16:17:11.391 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.391 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:11.391 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.391 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2305 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12393472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:11.391 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896175+0000", 2024-09-12T16:17:11.391 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.470693550999997, 2024-09-12T16:17:11.391 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037976941, 2024-09-12T16:17:11.391 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:11.391 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:11.392 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:11.392 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:11.392 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:11.392 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:11.392 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2305 2024-09-12T16:17:11.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.392 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:11.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.392 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:11.392 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896175+0000", 2024-09-12T16:17:11.392 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.393 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:11.393 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896175+0000", 2024-09-12T16:17:11.393 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.393 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.393 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:11.393 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896176+0000", 2024-09-12T16:17:11.393 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7400000000000003e-07 2024-09-12T16:17:11.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.393 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.393 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:11.393 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896178+0000", 2024-09-12T16:17:11.393 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6709999999999999e-06 2024-09-12T16:17:11.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.394 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:11.394 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896186+0000", 2024-09-12T16:17:11.394 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9319999999999996e-06 2024-09-12T16:17:11.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.394 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:11.394 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896192+0000", 2024-09-12T16:17:11.394 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0799999999999996e-06 2024-09-12T16:17:11.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.394 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:11.395 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934072+0000", 2024-09-12T16:17:11.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037880888000000001 2024-09-12T16:17:11.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.395 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:11.395 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934113+0000", 2024-09-12T16:17:11.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0815999999999997e-05 2024-09-12T16:17:11.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.395 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:11.395 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934152+0000", 2024-09-12T16:17:11.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8980000000000003e-05 2024-09-12T16:17:11.395 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.396 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:11.396 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.396 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2306 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12397568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:11.396 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:17:11.396 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.470669272999999, 2024-09-12T16:17:11.396 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038156347, 2024-09-12T16:17:11.396 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:11.396 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:11.396 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:11.396 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:11.397 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:11.397 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:11.397 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2306 2024-09-12T16:17:11.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.397 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:11.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.397 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:11.397 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:17:11.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.397 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:11.397 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:17:11.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:11.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:17:11.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.77e-07 2024-09-12T16:17:11.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:11.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896202+0000", 2024-09-12T16:17:11.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2359999999999999e-06 2024-09-12T16:17:11.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:11.399 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896208+0000", 2024-09-12T16:17:11.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1430000000000003e-06 2024-09-12T16:17:11.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:11.399 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896213+0000", 2024-09-12T16:17:11.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9339999999999997e-06 2024-09-12T16:17:11.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:11.399 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934188+0000", 2024-09-12T16:17:11.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037974490999999999 2024-09-12T16:17:11.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.400 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:11.400 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934275+0000", 2024-09-12T16:17:11.400 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7639999999999994e-05 2024-09-12T16:17:11.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.400 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:11.400 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934356+0000", 2024-09-12T16:17:11.400 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0525999999999994e-05 2024-09-12T16:17:11.400 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.400 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:11.400 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.401 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2307 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12401664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:11.401 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:17:11.401 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.470649500999997, 2024-09-12T16:17:11.401 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038241450000000003, 2024-09-12T16:17:11.401 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:11.401 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:11.401 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:11.401 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:11.401 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:11.401 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:11.401 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2307 2024-09-12T16:17:11.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.402 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:11.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:11.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:17:11.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:11.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:17:11.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:11.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896220+0000", 2024-09-12T16:17:11.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3500000000000002e-07 2024-09-12T16:17:11.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:11.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896222+0000", 2024-09-12T16:17:11.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1720000000000001e-06 2024-09-12T16:17:11.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:11.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896228+0000", 2024-09-12T16:17:11.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0870000000000003e-06 2024-09-12T16:17:11.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:11.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896233+0000", 2024-09-12T16:17:11.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:17:11.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.404 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:11.404 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934382+0000", 2024-09-12T16:17:11.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038149566000000003 2024-09-12T16:17:11.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.404 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:11.404 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934422+0000", 2024-09-12T16:17:11.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0015999999999998e-05 2024-09-12T16:17:11.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.405 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:11.405 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934461+0000", 2024-09-12T16:17:11.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8423999999999997e-05 2024-09-12T16:17:11.405 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.405 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:11.405 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.405 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2308 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12405760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:11.405 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:17:11.405 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.470629803999998, 2024-09-12T16:17:11.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038420745999999999, 2024-09-12T16:17:11.405 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:11.406 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:11.406 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:11.406 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:11.406 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:11.406 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:11.406 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2308 2024-09-12T16:17:11.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.406 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:11.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:11.406 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:17:11.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.407 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:11.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:17:11.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.407 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:11.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:17:11.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.58e-07 2024-09-12T16:17:11.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.407 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:11.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896241+0000", 2024-09-12T16:17:11.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7940000000000001e-06 2024-09-12T16:17:11.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.408 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:11.408 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896247+0000", 2024-09-12T16:17:11.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1460000000000001e-06 2024-09-12T16:17:11.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.408 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:11.408 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896252+0000", 2024-09-12T16:17:11.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6840000000000004e-06 2024-09-12T16:17:11.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.408 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:11.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934494+0000", 2024-09-12T16:17:11.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038242362000000002 2024-09-12T16:17:11.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:11.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934579+0000", 2024-09-12T16:17:11.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5044999999999996e-05 2024-09-12T16:17:11.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:11.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934660+0000", 2024-09-12T16:17:11.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0357000000000003e-05 2024-09-12T16:17:11.409 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.409 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:11.410 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.410 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2309 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12409856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:11.410 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:17:11.410 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.470609224, 2024-09-12T16:17:11.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038504629999999998, 2024-09-12T16:17:11.410 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:11.410 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:11.410 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:11.410 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:11.410 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:11.410 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:11.410 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2309 2024-09-12T16:17:11.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.411 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:11.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.411 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:11.411 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:17:11.411 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.411 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:11.411 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:17:11.411 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.411 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:11.411 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:17:11.411 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5199999999999998e-07 2024-09-12T16:17:11.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:11.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896263+0000", 2024-09-12T16:17:11.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4209999999999999e-06 2024-09-12T16:17:11.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:11.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896269+0000", 2024-09-12T16:17:11.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9449999999999998e-06 2024-09-12T16:17:11.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:11.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896274+0000", 2024-09-12T16:17:11.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3950000000000003e-06 2024-09-12T16:17:11.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:11.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934686+0000", 2024-09-12T16:17:11.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038412333999999999 2024-09-12T16:17:11.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:11.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934727+0000", 2024-09-12T16:17:11.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0649999999999999e-05 2024-09-12T16:17:11.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:11.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934764+0000", 2024-09-12T16:17:11.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7533000000000001e-05 2024-09-12T16:17:11.414 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.414 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:11.414 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.414 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2310 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12413952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:11.414 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:17:11.414 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.470588352, 2024-09-12T16:17:11.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038694183, 2024-09-12T16:17:11.414 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:11.414 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:11.414 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:11.414 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:11.414 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:11.415 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:11.415 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2310 2024-09-12T16:17:11.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.415 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:11.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.415 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:11.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:17:11.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.415 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:11.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:17:11.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.416 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:11.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896281+0000", 2024-09-12T16:17:11.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1399999999999997e-07 2024-09-12T16:17:11.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.416 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:11.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896283+0000", 2024-09-12T16:17:11.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9549999999999999e-06 2024-09-12T16:17:11.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.417 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:11.417 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896289+0000", 2024-09-12T16:17:11.417 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8669999999999999e-06 2024-09-12T16:17:11.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.417 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:11.417 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896301+0000", 2024-09-12T16:17:11.417 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1807999999999999e-05 2024-09-12T16:17:11.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.417 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:11.417 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934798+0000", 2024-09-12T16:17:11.417 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038497591999999997 2024-09-12T16:17:11.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:11.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934885+0000", 2024-09-12T16:17:11.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7149000000000002e-05 2024-09-12T16:17:11.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:11.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934975+0000", 2024-09-12T16:17:11.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9297999999999998e-05 2024-09-12T16:17:11.418 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.418 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:11.418 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.419 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2311 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12418048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:11.419 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:17:11.419 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.470561095999997, 2024-09-12T16:17:11.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038768558000000002, 2024-09-12T16:17:11.419 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:11.419 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:11.419 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:11.419 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:11.419 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:11.419 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:11.419 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2311 2024-09-12T16:17:11.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.419 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:11.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:11.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:17:11.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:11.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:17:11.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:11.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:17:11.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.63e-07 2024-09-12T16:17:11.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:11.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896310+0000", 2024-09-12T16:17:11.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1560000000000002e-06 2024-09-12T16:17:11.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:11.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896316+0000", 2024-09-12T16:17:11.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0249999999999999e-06 2024-09-12T16:17:11.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:11.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896322+0000", 2024-09-12T16:17:11.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6400000000000002e-06 2024-09-12T16:17:11.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.422 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:11.422 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934997+0000", 2024-09-12T16:17:11.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038674565000000001 2024-09-12T16:17:11.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.422 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:11.422 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935037+0000", 2024-09-12T16:17:11.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0485999999999998e-05 2024-09-12T16:17:11.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.422 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:11.423 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935076+0000", 2024-09-12T16:17:11.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9223e-05 2024-09-12T16:17:11.423 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.423 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:11.423 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.423 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2312 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12422144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:11.423 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:17:11.423 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.470540403000001, 2024-09-12T16:17:11.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038856784999999998, 2024-09-12T16:17:11.423 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:11.423 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:11.423 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:11.424 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:11.424 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:11.424 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:11.424 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2312 2024-09-12T16:17:11.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.424 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:11.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.424 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:11.424 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:17:11.424 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.424 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:11.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:17:11.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:11.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896329+0000", 2024-09-12T16:17:11.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5499999999999999e-07 2024-09-12T16:17:11.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:11.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896337+0000", 2024-09-12T16:17:11.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0819999999999999e-06 2024-09-12T16:17:11.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:11.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896343+0000", 2024-09-12T16:17:11.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.263e-06 2024-09-12T16:17:11.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:11.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896348+0000", 2024-09-12T16:17:11.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8860000000000003e-06 2024-09-12T16:17:11.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:11.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935097+0000", 2024-09-12T16:17:11.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038748818999999997 2024-09-12T16:17:11.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:11.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935141+0000", 2024-09-12T16:17:11.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4175000000000003e-05 2024-09-12T16:17:11.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:11.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935185+0000", 2024-09-12T16:17:11.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4205000000000001e-05 2024-09-12T16:17:11.427 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.427 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:11.427 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.428 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2313 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12426240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:11.428 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:17:11.428 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.470514188000003, 2024-09-12T16:17:11.428 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038928683999999998, 2024-09-12T16:17:11.428 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:11.428 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:11.428 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:11.428 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:11.428 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:11.428 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:11.428 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2313 2024-09-12T16:17:11.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.429 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:11.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.429 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:11.429 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:17:11.429 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.429 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:11.429 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:17:11.429 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.429 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:11.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:17:11.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0400000000000002e-07 2024-09-12T16:17:11.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.430 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:11.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896357+0000", 2024-09-12T16:17:11.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.097e-06 2024-09-12T16:17:11.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.430 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:11.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896363+0000", 2024-09-12T16:17:11.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5119999999999999e-06 2024-09-12T16:17:11.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:11.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896374+0000", 2024-09-12T16:17:11.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1381e-05 2024-09-12T16:17:11.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:11.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935205+0000", 2024-09-12T16:17:11.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038830549999999998 2024-09-12T16:17:11.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:11.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935244+0000", 2024-09-12T16:17:11.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9520000000000001e-05 2024-09-12T16:17:11.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:11.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935283+0000", 2024-09-12T16:17:11.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9220000000000001e-05 2024-09-12T16:17:11.432 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.432 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:11.432 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.432 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2314 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12430336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:11.432 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:17:11.432 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.470477017999997, 2024-09-12T16:17:11.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039008137999999998, 2024-09-12T16:17:11.433 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:11.433 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:11.433 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:11.433 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:11.433 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:11.433 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:11.433 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2314 2024-09-12T16:17:11.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.433 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:11.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:11.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:17:11.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.434 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:11.434 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:17:11.434 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.434 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:11.434 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:17:11.434 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6499999999999999e-07 2024-09-12T16:17:11.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.434 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:11.435 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896395+0000", 2024-09-12T16:17:11.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2960000000000001e-06 2024-09-12T16:17:11.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.435 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:11.435 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896402+0000", 2024-09-12T16:17:11.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2280000000000001e-06 2024-09-12T16:17:11.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.435 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:11.435 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896407+0000", 2024-09-12T16:17:11.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3630000000000002e-06 2024-09-12T16:17:11.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:11.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935302+0000", 2024-09-12T16:17:11.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038895181000000001 2024-09-12T16:17:11.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:11.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935343+0000", 2024-09-12T16:17:11.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0590999999999998e-05 2024-09-12T16:17:11.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:11.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935400+0000", 2024-09-12T16:17:11.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7014e-05 2024-09-12T16:17:11.437 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.437 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:11.437 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.437 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2315 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12434432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:11.437 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:17:11.437 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.470454367000002, 2024-09-12T16:17:11.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039083892000000002, 2024-09-12T16:17:11.437 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:11.437 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:11.437 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:11.437 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:11.437 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:11.438 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:11.438 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2315 2024-09-12T16:17:11.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.438 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:11.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.438 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:11.438 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:17:11.438 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.438 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:11.438 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:17:11.438 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.439 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:11.439 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896415+0000", 2024-09-12T16:17:11.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3300000000000002e-07 2024-09-12T16:17:11.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.439 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:11.439 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896421+0000", 2024-09-12T16:17:11.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7579999999999998e-06 2024-09-12T16:17:11.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.439 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:11.439 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896427+0000", 2024-09-12T16:17:11.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3029999999999996e-06 2024-09-12T16:17:11.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.440 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:11.440 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896432+0000", 2024-09-12T16:17:11.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.215e-06 2024-09-12T16:17:11.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.440 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:11.440 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935420+0000", 2024-09-12T16:17:11.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038987727 2024-09-12T16:17:11.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.440 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:11.440 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935460+0000", 2024-09-12T16:17:11.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9817999999999997e-05 2024-09-12T16:17:11.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.441 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:11.441 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935498+0000", 2024-09-12T16:17:11.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8438e-05 2024-09-12T16:17:11.441 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.441 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:11.441 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.441 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2316 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12438528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:11.442 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:17:11.442 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.470429715000002, 2024-09-12T16:17:11.442 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039160043999999998, 2024-09-12T16:17:11.442 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:11.442 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:11.442 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:11.442 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:11.442 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:11.442 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:11.442 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2316 2024-09-12T16:17:11.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.442 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:11.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.442 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:11.443 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:17:11.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.443 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:11.443 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:17:11.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.443 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:11.443 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901945+0000", 2024-09-12T16:17:11.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055056050000000002 2024-09-12T16:17:11.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.443 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:11.444 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901950+0000", 2024-09-12T16:17:11.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2490000000000001e-06 2024-09-12T16:17:11.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:11.444 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901966+0000", 2024-09-12T16:17:11.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6325e-05 2024-09-12T16:17:11.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:11.444 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901974+0000", 2024-09-12T16:17:11.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7570000000000004e-06 2024-09-12T16:17:11.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.445 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:11.445 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935518+0000", 2024-09-12T16:17:11.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033543587999999999 2024-09-12T16:17:11.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.445 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:11.445 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935559+0000", 2024-09-12T16:17:11.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1746000000000003e-05 2024-09-12T16:17:11.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.445 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:11.445 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935599+0000", 2024-09-12T16:17:11.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9774000000000002e-05 2024-09-12T16:17:11.445 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.446 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:11.446 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.446 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1571 3.b 3:d046566d:::rbd_data.1155525b14e3.0000000000000001:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:17:11.446 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:17:11.446 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.214304673000001, 2024-09-12T16:17:11.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064439785999999999, 2024-09-12T16:17:11.446 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:11.446 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:11.446 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:11.446 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:11.446 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:17:11.447 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:17:11.447 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1571 2024-09-12T16:17:11.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.447 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:11.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.447 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:11.447 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:17:11.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.447 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:11.447 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:17:11.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.448 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:11.448 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:17:11.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5400000000000002e-07 2024-09-12T16:17:11.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.448 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:11.448 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152567+0000", 2024-09-12T16:17:11.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.131e-06 2024-09-12T16:17:11.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.448 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:11.448 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152574+0000", 2024-09-12T16:17:11.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1840000000000002e-06 2024-09-12T16:17:11.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.449 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:11.449 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152579+0000", 2024-09-12T16:17:11.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.152e-06 2024-09-12T16:17:11.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.449 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:11.449 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153671+0000", 2024-09-12T16:17:11.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001092078 2024-09-12T16:17:11.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.449 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:11.449 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153779+0000", 2024-09-12T16:17:11.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108461 2024-09-12T16:17:11.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:11.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217004+0000", 2024-09-12T16:17:11.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.063224426 2024-09-12T16:17:11.450 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.450 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:11.450 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.450 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1581 3.4 3:22e34893:::rbd_data.1155525b14e3.0000000000000005:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:17:11.450 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:17:11.450 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.214207548000001, 2024-09-12T16:17:11.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064484407999999993, 2024-09-12T16:17:11.450 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:11.451 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:11.451 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:11.451 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:11.451 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:17:11.451 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:17:11.451 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1581 2024-09-12T16:17:11.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.451 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:11.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:11.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:17:11.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:11.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:17:11.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:11.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152662+0000", 2024-09-12T16:17:11.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.65e-07 2024-09-12T16:17:11.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:11.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152664+0000", 2024-09-12T16:17:11.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9829999999999999e-06 2024-09-12T16:17:11.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152670+0000", 2024-09-12T16:17:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2260000000000002e-06 2024-09-12T16:17:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152675+0000", 2024-09-12T16:17:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7990000000000001e-06 2024-09-12T16:17:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.216945+0000", 2024-09-12T16:17:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064270341999999994 2024-09-12T16:17:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:11.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217040+0000", 2024-09-12T16:17:11.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5242999999999996e-05 2024-09-12T16:17:11.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:11.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217146+0000", 2024-09-12T16:17:11.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010545 2024-09-12T16:17:11.454 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.454 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:11.454 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.454 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2207 3.0 3:05fdc61f:::rbd_data.1155ccb1894c.0000000000000003:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:11.455 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:17:11.455 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.996163986999999, 2024-09-12T16:17:11.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.05105382, 2024-09-12T16:17:11.455 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:11.455 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:11.455 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:11.455 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:11.455 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:17:11.455 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:17:11.455 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2207 2024-09-12T16:17:11.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.455 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:11.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:11.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:17:11.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:11.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:17:11.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:11.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370706+0000", 2024-09-12T16:17:11.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7800000000000001e-07 2024-09-12T16:17:11.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:11.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391581+0000", 2024-09-12T16:17:11.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020875624999999998 2024-09-12T16:17:11.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:11.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391608+0000", 2024-09-12T16:17:11.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6412999999999999e-05 2024-09-12T16:17:11.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:11.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391618+0000", 2024-09-12T16:17:11.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9240000000000002e-06 2024-09-12T16:17:11.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:11.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391705+0000", 2024-09-12T16:17:11.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7489000000000002e-05 2024-09-12T16:17:11.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:11.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391838+0000", 2024-09-12T16:17:11.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132865 2024-09-12T16:17:11.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 2", 2024-09-12T16:17:11.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.392587+0000", 2024-09-12T16:17:11.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074930000000000005 2024-09-12T16:17:11.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:11.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.420095+0000", 2024-09-12T16:17:11.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027507949 2024-09-12T16:17:11.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:17:11.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421610+0000", 2024-09-12T16:17:11.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001515195 2024-09-12T16:17:11.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.460 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:17:11.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421681+0000", 2024-09-12T16:17:11.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0320000000000004e-05 2024-09-12T16:17:11.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.460 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:11.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421759+0000", 2024-09-12T16:17:11.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7961999999999997e-05 2024-09-12T16:17:11.460 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.460 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:11.460 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.460 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.460 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:11.460 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:11.462 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:17:11.464 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:11.461+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:11.562 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:11.562+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:11.573 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-12T16:17:11.574 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T16:17:11.574 INFO:tasks.thrashosds.thrasher:inject_pause on osd.3 2024-09-12T16:17:11.574 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-12T16:17:11.574 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-12T16:17:11.574 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok config set filestore_inject_stall 3 2024-09-12T16:17:11.588 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #22, image image_client.0-clone22 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent23 2024-09-12T16:17:11.638 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:11.638 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:11.638 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:17:11.638 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:11.649 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:17:11.694 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:11.693+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:11.698 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:11.698 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-12T16:17:11.698 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:11.764 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:11.764+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:11.780 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:11.780 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:11.780 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:17:11.780 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:17:11.780 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:11.789 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:17:11.841 INFO:teuthology.orchestra.run.smithi204.stdout:3857 write 0x59e8600 thru 0x59f769e (0xf09f bytes) 2024-09-12T16:17:11.842 INFO:teuthology.orchestra.run.smithi204.stdout:3858 read 0xc8c5400 thru 0xc8cfe70 (0xaa71 bytes) 2024-09-12T16:17:11.843 INFO:teuthology.orchestra.run.smithi204.stdout:3859 write 0x3ed0000 thru 0x3ed4e6e (0x4e6f bytes) 2024-09-12T16:17:11.843 INFO:teuthology.orchestra.run.smithi204.stdout:3861 read 0x5bfc800 thru 0x5c0abe8 (0xe3e9 bytes) 2024-09-12T16:17:11.846 INFO:teuthology.orchestra.run.smithi204.stdout:3862 read 0x5861e00 thru 0x586a84c (0x8a4d bytes) 2024-09-12T16:17:11.847 INFO:teuthology.orchestra.run.smithi204.stdout:3865 punch from 0xb01fc00 to 0xb024a00, (0x4e00 bytes) 2024-09-12T16:17:11.873 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:11.872+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:11.942 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:11.942 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:17:11.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:17:11.942 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:17:11.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.942 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4805.0:6829 3.18 3:1e2ee373:::rbd_data.1155c2c5fc24.0000000000000003:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 18778112~25088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T16:17:11.942 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:43.576065+0000", 2024-09-12T16:17:11.942 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 28.364475768999998, 2024-09-12T16:17:11.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044824155999999997, 2024-09-12T16:17:11.943 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:11.943 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:11.943 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:11.943 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:11.943 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4805", 2024-09-12T16:17:11.943 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/3734391115", 2024-09-12T16:17:11.943 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6829 2024-09-12T16:17:11.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.943 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:11.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:11.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.576065+0000", 2024-09-12T16:17:11.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:11.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.576065+0000", 2024-09-12T16:17:11.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:11.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.576068+0000", 2024-09-12T16:17:11.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1629999999999999e-06 2024-09-12T16:17:11.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:11.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.588880+0000", 2024-09-12T16:17:11.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012812054 2024-09-12T16:17:11.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:11.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.588909+0000", 2024-09-12T16:17:11.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9354000000000001e-05 2024-09-12T16:17:11.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:11.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.588930+0000", 2024-09-12T16:17:11.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0571999999999999e-05 2024-09-12T16:17:11.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:11.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.589010+0000", 2024-09-12T16:17:11.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0780999999999998e-05 2024-09-12T16:17:11.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:11.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.589174+0000", 2024-09-12T16:17:11.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016337799999999999 2024-09-12T16:17:11.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 1", 2024-09-12T16:17:11.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.590261+0000", 2024-09-12T16:17:11.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001087735 2024-09-12T16:17:11.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:17:11.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.610690+0000", 2024-09-12T16:17:11.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020428281999999999 2024-09-12T16:17:11.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:11.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.620760+0000", 2024-09-12T16:17:11.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010070325999999999 2024-09-12T16:17:11.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:17:11.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.620836+0000", 2024-09-12T16:17:11.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5617999999999993e-05 2024-09-12T16:17:11.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:11.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:43.620890+0000", 2024-09-12T16:17:11.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3893000000000001e-05 2024-09-12T16:17:11.949 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.949 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:11.949 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.949 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:1673 3.7 3:e722ca22:::rbd_data.1155ccb1894c.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:11.949 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.314024+0000", 2024-09-12T16:17:11.949 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.626517377000001, 2024-09-12T16:17:11.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040583337999999997, 2024-09-12T16:17:11.949 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:11.950 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:11.950 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:11.950 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:11.950 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:17:11.950 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:17:11.950 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1673 2024-09-12T16:17:11.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.950 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:11.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:11.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.314024+0000", 2024-09-12T16:17:11.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.951 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:11.951 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.314024+0000", 2024-09-12T16:17:11.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.951 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:11.951 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.314025+0000", 2024-09-12T16:17:11.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0839999999999999e-06 2024-09-12T16:17:11.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.951 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:11.951 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.331177+0000", 2024-09-12T16:17:11.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017152499000000002 2024-09-12T16:17:11.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:11.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.331201+0000", 2024-09-12T16:17:11.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3845e-05 2024-09-12T16:17:11.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:11.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.331210+0000", 2024-09-12T16:17:11.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2840000000000006e-06 2024-09-12T16:17:11.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:11.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.331285+0000", 2024-09-12T16:17:11.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5747999999999994e-05 2024-09-12T16:17:11.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:11.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.331445+0000", 2024-09-12T16:17:11.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015985000000000001 2024-09-12T16:17:11.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 1", 2024-09-12T16:17:11.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.332166+0000", 2024-09-12T16:17:11.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000720438 2024-09-12T16:17:11.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:17:11.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.353178+0000", 2024-09-12T16:17:11.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021012638 2024-09-12T16:17:11.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:11.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.354503+0000", 2024-09-12T16:17:11.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001324806 2024-09-12T16:17:11.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:17:11.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.354566+0000", 2024-09-12T16:17:11.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3446000000000002e-05 2024-09-12T16:17:11.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:11.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.354607+0000", 2024-09-12T16:17:11.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.07e-05 2024-09-12T16:17:11.955 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.955 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:11.955 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.955 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2213 3.18 3:1944e921:::rbd_data.1155ccb1894c.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:11.955 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:17:11.955 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.56519217, 2024-09-12T16:17:11.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.055657836000000002, 2024-09-12T16:17:11.956 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:11.956 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:11.956 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:11.956 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:11.956 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:17:11.956 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:17:11.956 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2213 2024-09-12T16:17:11.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.956 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:11.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:11.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:17:11.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:11.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:17:11.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:11.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375351+0000", 2024-09-12T16:17:11.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.556e-06 2024-09-12T16:17:11.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:11.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.399989+0000", 2024-09-12T16:17:11.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024637949999999999 2024-09-12T16:17:11.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:11.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400038+0000", 2024-09-12T16:17:11.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9187999999999997e-05 2024-09-12T16:17:11.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:11.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400056+0000", 2024-09-12T16:17:11.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8451e-05 2024-09-12T16:17:11.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:11.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400151+0000", 2024-09-12T16:17:11.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5026999999999997e-05 2024-09-12T16:17:11.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:11.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400345+0000", 2024-09-12T16:17:11.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019352900000000001 2024-09-12T16:17:11.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 1", 2024-09-12T16:17:11.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.401319+0000", 2024-09-12T16:17:11.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00097419399999999995 2024-09-12T16:17:11.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:17:11.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.429350+0000", 2024-09-12T16:17:11.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028030607999999999 2024-09-12T16:17:11.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:11.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.430907+0000", 2024-09-12T16:17:11.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001557466 2024-09-12T16:17:11.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:17:11.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.430966+0000", 2024-09-12T16:17:11.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9437e-05 2024-09-12T16:17:11.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:11.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.431007+0000", 2024-09-12T16:17:11.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0429999999999997e-05 2024-09-12T16:17:11.961 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.961 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:11.961 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.961 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:963 3.18 3:1b6fb776:::rbd_data.1155ccb1894c.0000000000000006:15 [read 8257536~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:11.961 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.589219+0000", 2024-09-12T16:17:11.961 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.351322316999999, 2024-09-12T16:17:11.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036869616000000001, 2024-09-12T16:17:11.962 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:11.962 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:11.962 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:11.962 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:11.962 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:17:11.962 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:17:11.962 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 963 2024-09-12T16:17:11.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.962 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:11.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:11.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.589219+0000", 2024-09-12T16:17:11.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.963 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:11.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.589219+0000", 2024-09-12T16:17:11.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.963 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:11.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.589219+0000", 2024-09-12T16:17:11.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.01e-07 2024-09-12T16:17:11.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.963 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:11.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.589221+0000", 2024-09-12T16:17:11.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9999999999999999e-06 2024-09-12T16:17:11.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:11.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.589228+0000", 2024-09-12T16:17:11.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3799999999999999e-06 2024-09-12T16:17:11.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:11.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.589233+0000", 2024-09-12T16:17:11.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.135e-06 2024-09-12T16:17:11.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:11.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.625902+0000", 2024-09-12T16:17:11.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036668919000000001 2024-09-12T16:17:11.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:11.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.625957+0000", 2024-09-12T16:17:11.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5192000000000003e-05 2024-09-12T16:17:11.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:11.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.626088+0000", 2024-09-12T16:17:11.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013158899999999999 2024-09-12T16:17:11.965 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.965 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:11.965 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.966 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1128 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [read 1802240~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:11.966 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590009+0000", 2024-09-12T16:17:11.966 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.350532278999999, 2024-09-12T16:17:11.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037087889999999998, 2024-09-12T16:17:11.966 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:11.966 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:11.966 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:11.966 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:11.966 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:17:11.966 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:17:11.966 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1128 2024-09-12T16:17:11.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.967 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:11.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:11.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590009+0000", 2024-09-12T16:17:11.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:11.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590009+0000", 2024-09-12T16:17:11.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:11.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590009+0000", 2024-09-12T16:17:11.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.46e-07 2024-09-12T16:17:11.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:11.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590018+0000", 2024-09-12T16:17:11.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7120000000000006e-06 2024-09-12T16:17:11.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:11.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590025+0000", 2024-09-12T16:17:11.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1600000000000001e-06 2024-09-12T16:17:11.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:11.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590031+0000", 2024-09-12T16:17:11.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8289999999999996e-06 2024-09-12T16:17:11.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:11.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.626874+0000", 2024-09-12T16:17:11.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036843072999999997 2024-09-12T16:17:11.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:11.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.626980+0000", 2024-09-12T16:17:11.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106057 2024-09-12T16:17:11.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:11.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627097+0000", 2024-09-12T16:17:11.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116613 2024-09-12T16:17:11.970 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.970 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:11.970 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.970 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1129 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [sparse-read 2195456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:11.970 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590039+0000", 2024-09-12T16:17:11.970 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.35050238, 2024-09-12T16:17:11.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037187049, 2024-09-12T16:17:11.971 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:11.971 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:11.971 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:11.971 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:11.971 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:17:11.971 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:17:11.971 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1129 2024-09-12T16:17:11.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.971 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:11.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:11.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590039+0000", 2024-09-12T16:17:11.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:11.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590039+0000", 2024-09-12T16:17:11.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:11.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590039+0000", 2024-09-12T16:17:11.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8700000000000001e-07 2024-09-12T16:17:11.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:11.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590041+0000", 2024-09-12T16:17:11.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1449999999999998e-06 2024-09-12T16:17:11.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:11.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590049+0000", 2024-09-12T16:17:11.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2830000000000004e-06 2024-09-12T16:17:11.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:11.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590054+0000", 2024-09-12T16:17:11.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1540000000000001e-06 2024-09-12T16:17:11.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:11.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627113+0000", 2024-09-12T16:17:11.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037059170000000002 2024-09-12T16:17:11.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:11.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627157+0000", 2024-09-12T16:17:11.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4069000000000001e-05 2024-09-12T16:17:11.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:11.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627226+0000", 2024-09-12T16:17:11.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8841e-05 2024-09-12T16:17:11.975 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.975 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:11.975 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.975 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1130 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [read 2621440~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:11.975 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590061+0000", 2024-09-12T16:17:11.975 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.350480188000001, 2024-09-12T16:17:11.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037392033999999998, 2024-09-12T16:17:11.975 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:11.975 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:11.975 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:11.976 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:11.976 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:17:11.976 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:17:11.976 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1130 2024-09-12T16:17:11.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.976 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:11.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:11.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590061+0000", 2024-09-12T16:17:11.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:11.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590061+0000", 2024-09-12T16:17:11.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:11.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590061+0000", 2024-09-12T16:17:11.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4000000000000002e-07 2024-09-12T16:17:11.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:11.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590064+0000", 2024-09-12T16:17:11.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2539999999999999e-06 2024-09-12T16:17:11.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:11.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590071+0000", 2024-09-12T16:17:11.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9430000000000003e-06 2024-09-12T16:17:11.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:11.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590076+0000", 2024-09-12T16:17:11.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1159999999999998e-06 2024-09-12T16:17:11.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:11.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627262+0000", 2024-09-12T16:17:11.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037186581000000003 2024-09-12T16:17:11.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:11.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627348+0000", 2024-09-12T16:17:11.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5481000000000004e-05 2024-09-12T16:17:11.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:11.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627453+0000", 2024-09-12T16:17:11.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000105219 2024-09-12T16:17:11.979 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.979 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:11.980 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.980 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1131 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [read 3047424~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:11.980 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590082+0000", 2024-09-12T16:17:11.980 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.35045888, 2024-09-12T16:17:11.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037515370999999999, 2024-09-12T16:17:11.980 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:11.980 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:11.980 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:11.980 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:11.980 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:17:11.980 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:17:11.981 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1131 2024-09-12T16:17:11.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.981 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:11.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:11.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590082+0000", 2024-09-12T16:17:11.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:11.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590082+0000", 2024-09-12T16:17:11.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:11.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590083+0000", 2024-09-12T16:17:11.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.34e-07 2024-09-12T16:17:11.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:11.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590086+0000", 2024-09-12T16:17:11.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5470000000000001e-06 2024-09-12T16:17:11.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:11.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590093+0000", 2024-09-12T16:17:11.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4740000000000002e-06 2024-09-12T16:17:11.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:11.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590098+0000", 2024-09-12T16:17:11.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2299999999999999e-06 2024-09-12T16:17:11.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:11.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627485+0000", 2024-09-12T16:17:11.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037386913000000001 2024-09-12T16:17:11.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:11.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627531+0000", 2024-09-12T16:17:11.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5723000000000003e-05 2024-09-12T16:17:11.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:11.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627598+0000", 2024-09-12T16:17:11.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7050000000000003e-05 2024-09-12T16:17:11.984 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.984 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:11.984 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.984 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1132 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [read 3440640~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:11.984 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590105+0000", 2024-09-12T16:17:11.984 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.350436202999999, 2024-09-12T16:17:11.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037722536000000001, 2024-09-12T16:17:11.985 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:11.985 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:11.985 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:11.985 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:11.985 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:17:11.985 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:17:11.985 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1132 2024-09-12T16:17:11.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.985 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:11.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:11.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590105+0000", 2024-09-12T16:17:11.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:11.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590105+0000", 2024-09-12T16:17:11.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:11.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590105+0000", 2024-09-12T16:17:11.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0699999999999998e-07 2024-09-12T16:17:11.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:11.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590107+0000", 2024-09-12T16:17:11.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9709999999999998e-06 2024-09-12T16:17:11.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:11.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590114+0000", 2024-09-12T16:17:11.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6939999999999998e-06 2024-09-12T16:17:11.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:11.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590119+0000", 2024-09-12T16:17:11.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2900000000000002e-06 2024-09-12T16:17:11.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:11.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627637+0000", 2024-09-12T16:17:11.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037517803000000002 2024-09-12T16:17:11.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:11.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627724+0000", 2024-09-12T16:17:11.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6380999999999998e-05 2024-09-12T16:17:11.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:11.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627828+0000", 2024-09-12T16:17:11.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010399 2024-09-12T16:17:11.988 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.988 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:11.989 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.989 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1133 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [read 3866624~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:11.989 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590126+0000", 2024-09-12T16:17:11.989 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.350415055999999, 2024-09-12T16:17:11.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037838388000000001, 2024-09-12T16:17:11.989 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:11.989 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:11.989 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:11.989 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:11.989 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:17:11.989 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:17:11.990 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1133 2024-09-12T16:17:11.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.990 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:11.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:11.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590126+0000", 2024-09-12T16:17:11.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:11.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590126+0000", 2024-09-12T16:17:11.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:11.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590127+0000", 2024-09-12T16:17:11.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9299999999999999e-07 2024-09-12T16:17:11.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:11.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590129+0000", 2024-09-12T16:17:11.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9929999999999998e-06 2024-09-12T16:17:11.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:11.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590135+0000", 2024-09-12T16:17:11.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5069999999999997e-06 2024-09-12T16:17:11.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:11.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590140+0000", 2024-09-12T16:17:11.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.271e-06 2024-09-12T16:17:11.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:11.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627859+0000", 2024-09-12T16:17:11.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037718805000000001 2024-09-12T16:17:11.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:11.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627905+0000", 2024-09-12T16:17:11.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5398000000000001e-05 2024-09-12T16:17:11.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:11.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.627965+0000", 2024-09-12T16:17:11.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0021e-05 2024-09-12T16:17:11.993 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.993 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:11.993 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.993 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1134 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [read 4259840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:11.993 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590147+0000", 2024-09-12T16:17:11.993 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.350394573999999, 2024-09-12T16:17:11.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038029861999999998, 2024-09-12T16:17:11.994 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:11.994 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:11.994 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:11.994 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:11.994 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:17:11.994 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:17:11.994 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1134 2024-09-12T16:17:11.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.994 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:11.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:11.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590147+0000", 2024-09-12T16:17:11.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:11.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590147+0000", 2024-09-12T16:17:11.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:11.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590147+0000", 2024-09-12T16:17:11.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2899999999999999e-07 2024-09-12T16:17:11.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:11.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590151+0000", 2024-09-12T16:17:11.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8430000000000003e-06 2024-09-12T16:17:11.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:11.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590158+0000", 2024-09-12T16:17:11.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7170000000000002e-06 2024-09-12T16:17:11.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:11.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590163+0000", 2024-09-12T16:17:11.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.074e-06 2024-09-12T16:17:11.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:11.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628000+0000", 2024-09-12T16:17:11.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037837588999999998 2024-09-12T16:17:11.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:11.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628081+0000", 2024-09-12T16:17:11.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1062000000000004e-05 2024-09-12T16:17:11.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:11.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628176+0000", 2024-09-12T16:17:11.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5148000000000004e-05 2024-09-12T16:17:11.998 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.998 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:11.998 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:11.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.998 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1135 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [read 4685824~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:11.998 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590169+0000", 2024-09-12T16:17:11.998 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.350371904999999, 2024-09-12T16:17:11.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038127017999999999, 2024-09-12T16:17:11.998 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:11.998 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:11.998 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:11.999 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:11.999 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:17:11.999 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:17:11.999 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1135 2024-09-12T16:17:11.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.999 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:11.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:11.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590169+0000", 2024-09-12T16:17:11.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:11.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:11.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:11.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:11.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590169+0000", 2024-09-12T16:17:12.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:12.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:12.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590170+0000", 2024-09-12T16:17:12.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.15e-07 2024-09-12T16:17:12.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:12.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590172+0000", 2024-09-12T16:17:12.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9479999999999998e-06 2024-09-12T16:17:12.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:12.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590178+0000", 2024-09-12T16:17:12.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6660000000000002e-06 2024-09-12T16:17:12.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:12.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590183+0000", 2024-09-12T16:17:12.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0300000000000001e-06 2024-09-12T16:17:12.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:12.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628195+0000", 2024-09-12T16:17:12.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038011251000000003 2024-09-12T16:17:12.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:12.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628237+0000", 2024-09-12T16:17:12.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2354999999999997e-05 2024-09-12T16:17:12.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:12.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628296+0000", 2024-09-12T16:17:12.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9352999999999999e-05 2024-09-12T16:17:12.002 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:12.002 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:12.002 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:12.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.003 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1136 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [sparse-read 5079040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:12.003 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590189+0000", 2024-09-12T16:17:12.003 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.350351692, 2024-09-12T16:17:12.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038326948999999999, 2024-09-12T16:17:12.003 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:12.003 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:12.003 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:12.003 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:12.003 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:17:12.003 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:17:12.003 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1136 2024-09-12T16:17:12.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.003 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:12.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:12.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590189+0000", 2024-09-12T16:17:12.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:12.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:12.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590189+0000", 2024-09-12T16:17:12.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:12.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:12.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590190+0000", 2024-09-12T16:17:12.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7e-07 2024-09-12T16:17:12.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:12.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590192+0000", 2024-09-12T16:17:12.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9e-06 2024-09-12T16:17:12.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:12.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590198+0000", 2024-09-12T16:17:12.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6420000000000001e-06 2024-09-12T16:17:12.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:12.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590203+0000", 2024-09-12T16:17:12.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6399999999999996e-06 2024-09-12T16:17:12.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:12.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628327+0000", 2024-09-12T16:17:12.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038123655999999999 2024-09-12T16:17:12.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:12.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628409+0000", 2024-09-12T16:17:12.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2040999999999996e-05 2024-09-12T16:17:12.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:12.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628516+0000", 2024-09-12T16:17:12.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0001077 2024-09-12T16:17:12.006 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:12.007 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:12.007 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:12.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.007 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1137 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [read 5505024~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:12.007 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590210+0000", 2024-09-12T16:17:12.007 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.350331063, 2024-09-12T16:17:12.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038424246000000002, 2024-09-12T16:17:12.007 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:12.007 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:12.007 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:12.007 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:12.007 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:17:12.007 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:17:12.008 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1137 2024-09-12T16:17:12.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.008 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:12.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:12.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590210+0000", 2024-09-12T16:17:12.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:12.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:12.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590210+0000", 2024-09-12T16:17:12.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:12.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:12.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590210+0000", 2024-09-12T16:17:12.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.72e-07 2024-09-12T16:17:12.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:12.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590213+0000", 2024-09-12T16:17:12.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.311e-06 2024-09-12T16:17:12.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:12.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590219+0000", 2024-09-12T16:17:12.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4400000000000002e-06 2024-09-12T16:17:12.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:12.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590227+0000", 2024-09-12T16:17:12.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3880000000000002e-06 2024-09-12T16:17:12.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:12.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628531+0000", 2024-09-12T16:17:12.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038304546000000002 2024-09-12T16:17:12.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:12.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628580+0000", 2024-09-12T16:17:12.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8457e-05 2024-09-12T16:17:12.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:12.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628634+0000", 2024-09-12T16:17:12.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4731999999999997e-05 2024-09-12T16:17:12.011 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:12.011 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:12.011 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:12.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.011 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1138 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [read 5931008~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:12.011 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590235+0000", 2024-09-12T16:17:12.011 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.350306494, 2024-09-12T16:17:12.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038616549, 2024-09-12T16:17:12.012 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:12.012 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:12.012 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:12.012 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:12.012 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:17:12.012 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:17:12.012 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1138 2024-09-12T16:17:12.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.012 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:12.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:12.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590235+0000", 2024-09-12T16:17:12.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:12.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:12.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590235+0000", 2024-09-12T16:17:12.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:12.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:12.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590235+0000", 2024-09-12T16:17:12.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4700000000000002e-07 2024-09-12T16:17:12.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:12.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590244+0000", 2024-09-12T16:17:12.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3449999999999995e-06 2024-09-12T16:17:12.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:12.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590252+0000", 2024-09-12T16:17:12.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7859999999999997e-06 2024-09-12T16:17:12.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:12.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590257+0000", 2024-09-12T16:17:12.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1410000000000004e-06 2024-09-12T16:17:12.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:12.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628668+0000", 2024-09-12T16:17:12.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038410776000000001 2024-09-12T16:17:12.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:12.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628750+0000", 2024-09-12T16:17:12.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2081000000000002e-05 2024-09-12T16:17:12.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.016 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:12.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628851+0000", 2024-09-12T16:17:12.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000100973 2024-09-12T16:17:12.016 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:12.016 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:12.016 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:12.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.016 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1139 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [read 6324224~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:12.016 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590265+0000", 2024-09-12T16:17:12.016 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.350275886, 2024-09-12T16:17:12.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038713368999999997, 2024-09-12T16:17:12.017 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:12.017 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:12.017 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:12.017 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:12.017 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:17:12.017 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:17:12.017 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1139 2024-09-12T16:17:12.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.017 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:12.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:12.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590265+0000", 2024-09-12T16:17:12.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:12.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:12.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590265+0000", 2024-09-12T16:17:12.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:12.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:12.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590266+0000", 2024-09-12T16:17:12.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.32e-07 2024-09-12T16:17:12.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:12.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590268+0000", 2024-09-12T16:17:12.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3010000000000001e-06 2024-09-12T16:17:12.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:12.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590275+0000", 2024-09-12T16:17:12.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7120000000000003e-06 2024-09-12T16:17:12.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:12.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590280+0000", 2024-09-12T16:17:12.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1590000000000001e-06 2024-09-12T16:17:12.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:12.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628865+0000", 2024-09-12T16:17:12.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038584682000000002 2024-09-12T16:17:12.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:12.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628910+0000", 2024-09-12T16:17:12.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5130000000000003e-05 2024-09-12T16:17:12.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:12.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.628979+0000", 2024-09-12T16:17:12.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8953000000000002e-05 2024-09-12T16:17:12.021 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:12.021 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:12.021 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:12.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.021 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1140 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [read 6750208~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:12.021 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590287+0000", 2024-09-12T16:17:12.021 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.350254442000001, 2024-09-12T16:17:12.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038901031000000003, 2024-09-12T16:17:12.021 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:12.021 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:12.022 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:12.022 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:12.022 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:17:12.022 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:17:12.022 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1140 2024-09-12T16:17:12.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.022 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:12.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:12.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590287+0000", 2024-09-12T16:17:12.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:12.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:12.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590287+0000", 2024-09-12T16:17:12.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:12.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:12.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590287+0000", 2024-09-12T16:17:12.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.96e-07 2024-09-12T16:17:12.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:12.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590294+0000", 2024-09-12T16:17:12.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2130000000000002e-06 2024-09-12T16:17:12.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:12.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590302+0000", 2024-09-12T16:17:12.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2579999999999998e-06 2024-09-12T16:17:12.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:12.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590307+0000", 2024-09-12T16:17:12.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1970000000000004e-06 2024-09-12T16:17:12.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:12.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.629013+0000", 2024-09-12T16:17:12.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038705900000000001 2024-09-12T16:17:12.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:12.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.629091+0000", 2024-09-12T16:17:12.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8300000000000006e-05 2024-09-12T16:17:12.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:12.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.629188+0000", 2024-09-12T16:17:12.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6767000000000004e-05 2024-09-12T16:17:12.025 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:12.025 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:12.025 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:12.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.026 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1141 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [read 7143424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:12.026 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590316+0000", 2024-09-12T16:17:12.026 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.350225688, 2024-09-12T16:17:12.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038993406000000001, 2024-09-12T16:17:12.026 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:12.026 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:12.026 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:12.026 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:12.026 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:17:12.026 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:17:12.026 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1141 2024-09-12T16:17:12.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.027 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:12.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:12.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590316+0000", 2024-09-12T16:17:12.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:12.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:12.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590316+0000", 2024-09-12T16:17:12.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:12.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:12.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590316+0000", 2024-09-12T16:17:12.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2199999999999999e-07 2024-09-12T16:17:12.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:12.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590318+0000", 2024-09-12T16:17:12.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.12e-06 2024-09-12T16:17:12.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:12.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590325+0000", 2024-09-12T16:17:12.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.708e-06 2024-09-12T16:17:12.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:12.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590331+0000", 2024-09-12T16:17:12.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2169999999999999e-06 2024-09-12T16:17:12.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:12.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.629220+0000", 2024-09-12T16:17:12.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038888859999999997 2024-09-12T16:17:12.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:12.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.629267+0000", 2024-09-12T16:17:12.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6966999999999999e-05 2024-09-12T16:17:12.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:12.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.629309+0000", 2024-09-12T16:17:12.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2111999999999999e-05 2024-09-12T16:17:12.030 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:12.030 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:12.030 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:12.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.030 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1142 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [read 7569408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:12.030 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590339+0000", 2024-09-12T16:17:12.030 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.350202640999999, 2024-09-12T16:17:12.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039150314999999998, 2024-09-12T16:17:12.030 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:12.030 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:12.031 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:12.031 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:12.031 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:17:12.031 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:17:12.031 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1142 2024-09-12T16:17:12.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.031 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:12.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:12.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590339+0000", 2024-09-12T16:17:12.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:12.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:12.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590339+0000", 2024-09-12T16:17:12.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:12.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:12.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590339+0000", 2024-09-12T16:17:12.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0600000000000001e-07 2024-09-12T16:17:12.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:12.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590341+0000", 2024-09-12T16:17:12.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2000000000000001e-06 2024-09-12T16:17:12.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:12.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590348+0000", 2024-09-12T16:17:12.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0219999999999999e-06 2024-09-12T16:17:12.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:12.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590354+0000", 2024-09-12T16:17:12.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4500000000000003e-06 2024-09-12T16:17:12.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:12.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.629340+0000", 2024-09-12T16:17:12.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038986051000000001 2024-09-12T16:17:12.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.034 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:12.034 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.629415+0000", 2024-09-12T16:17:12.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5136999999999996e-05 2024-09-12T16:17:12.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.034 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:12.034 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.629489+0000", 2024-09-12T16:17:12.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4048999999999995e-05 2024-09-12T16:17:12.034 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:12.034 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:12.034 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:12.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.035 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5044.0:1143 3.18 3:1d6c2f4b:::rbd_data.1155ccb1894c.0000000000000011:15 [sparse-read 7962624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:12.035 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:58.590360+0000", 2024-09-12T16:17:12.035 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.350180935999999, 2024-09-12T16:17:12.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039250647999999999, 2024-09-12T16:17:12.035 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:12.035 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:12.035 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:12.035 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:12.035 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5044", 2024-09-12T16:17:12.035 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2631211904", 2024-09-12T16:17:12.036 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1143 2024-09-12T16:17:12.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.036 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:12.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:12.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590360+0000", 2024-09-12T16:17:12.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:12.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:12.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590360+0000", 2024-09-12T16:17:12.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:12.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:12.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590361+0000", 2024-09-12T16:17:12.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6300000000000001e-07 2024-09-12T16:17:12.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:12.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590363+0000", 2024-09-12T16:17:12.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9309999999999998e-06 2024-09-12T16:17:12.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:12.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590371+0000", 2024-09-12T16:17:12.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5960000000000004e-06 2024-09-12T16:17:12.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:12.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.590376+0000", 2024-09-12T16:17:12.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3229999999999997e-06 2024-09-12T16:17:12.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:12.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.629506+0000", 2024-09-12T16:17:12.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039129215000000002 2024-09-12T16:17:12.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:12.039 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.629556+0000", 2024-09-12T16:17:12.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0685e-05 2024-09-12T16:17:12.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:12.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:12.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:12.039 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:58.629611+0000", 2024-09-12T16:17:12.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4534999999999999e-05 2024-09-12T16:17:12.039 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:12.039 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:12.039 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:12.039 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:12.039 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:12.039 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:12.042 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:17:12.042 INFO:teuthology.orchestra.run.smithi204.stdout:3866 trunc from 0xe83d400 to 0x9588400 2024-09-12T16:17:12.042 INFO:teuthology.orchestra.run.smithi204.stdout:3868 trunc from 0x9588400 to 0xbc4dc00 2024-09-12T16:17:12.042 INFO:teuthology.orchestra.run.smithi204.stdout:3870 write 0x4956600 thru 0x4964f5c (0xe95d bytes) 2024-09-12T16:17:12.042 INFO:teuthology.orchestra.run.smithi204.stdout:3872 write 0x7032000 thru 0x70391a7 (0x71a8 bytes) 2024-09-12T16:17:12.042 INFO:teuthology.orchestra.run.smithi204.stdout:3876 write 0xb809e00 thru 0xb817a7a (0xdc7b bytes) 2024-09-12T16:17:12.043 INFO:teuthology.orchestra.run.smithi204.stdout:3877 write 0x9e19e00 thru 0x9e208ff (0x6b00 bytes) 2024-09-12T16:17:12.043 INFO:teuthology.orchestra.run.smithi204.stdout:3879 punch from 0xac84400 to 0xac84c00, (0x800 bytes) 2024-09-12T16:17:12.043 INFO:teuthology.orchestra.run.smithi204.stdout:3880 write 0x8263e00 thru 0x8267087 (0x3288 bytes) 2024-09-12T16:17:12.043 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:12.040+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:12.047 INFO:teuthology.orchestra.run.smithi204.stdout:3881 trunc from 0xbc4dc00 to 0x47bc600 2024-09-12T16:17:12.142 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:12.142+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:12.201 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:12.201 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:12.202 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:17:12.202 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:12.211 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:17:12.252 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:12.252+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:12.344 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:12.344+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:12.360 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:12.360 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:12.360 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:17:12.360 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:17:12.360 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:12.369 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:17:12.445 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:12.444+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:12.467 INFO:teuthology.orchestra.run.smithi204.stdout:3883 read 0x15cfa00 thru 0x15d8ad7 (0x90d8 bytes) 2024-09-12T16:17:12.472 INFO:teuthology.orchestra.run.smithi204.stdout:3885 read 0x46ba800 thru 0x46bce89 (0x268a bytes) 2024-09-12T16:17:12.473 INFO:teuthology.orchestra.run.smithi204.stdout:3886 read 0x1e74000 thru 0x1e83db2 (0xfdb3 bytes) 2024-09-12T16:17:12.484 INFO:teuthology.orchestra.run.smithi204.stdout:3887 trunc from 0x47bc600 to 0x1b76800 2024-09-12T16:17:12.530 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T16:17:12.537 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:12.537 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:17:12.537 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:17:12.538 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:17:12.538 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.538 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:17:12.538 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:17:12.538 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 90.771342336999993, 2024-09-12T16:17:12.538 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55645454900000002, 2024-09-12T16:17:12.538 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:12.538 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:12.538 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:12.538 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:12.538 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:17:12.538 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:17:12.538 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1 2024-09-12T16:17:12.538 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.539 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:12.539 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.539 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:12.539 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:17:12.539 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.539 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.539 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.539 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:12.539 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:17:12.539 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.539 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.539 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.539 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:12.539 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764440+0000", 2024-09-12T16:17:12.539 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6249999999999999e-06 2024-09-12T16:17:12.540 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.540 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.540 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:12.540 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764447+0000", 2024-09-12T16:17:12.540 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4939999999999997e-06 2024-09-12T16:17:12.540 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.540 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.540 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:12.540 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764459+0000", 2024-09-12T16:17:12.540 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1517e-05 2024-09-12T16:17:12.540 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.540 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.540 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:12.541 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764468+0000", 2024-09-12T16:17:12.541 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7690000000000002e-06 2024-09-12T16:17:12.541 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.541 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.541 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:12.541 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764539+0000", 2024-09-12T16:17:12.541 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1103e-05 2024-09-12T16:17:12.541 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.541 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.541 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:17:12.541 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764551+0000", 2024-09-12T16:17:12.541 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2687999999999999e-05 2024-09-12T16:17:12.541 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.542 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.542 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:12.542 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319497+0000", 2024-09-12T16:17:12.542 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55494560500000001 2024-09-12T16:17:12.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.542 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.542 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:12.542 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319688+0000", 2024-09-12T16:17:12.542 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019105599999999999 2024-09-12T16:17:12.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.542 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.542 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:17:12.542 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319842+0000", 2024-09-12T16:17:12.543 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015377699999999999 2024-09-12T16:17:12.543 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.543 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.543 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:17:12.543 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320473+0000", 2024-09-12T16:17:12.543 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00063117100000000003 2024-09-12T16:17:12.543 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.543 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.543 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:12.543 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320825+0000", 2024-09-12T16:17:12.543 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00035202500000000001 2024-09-12T16:17:12.543 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.544 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.544 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:12.544 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320867+0000", 2024-09-12T16:17:12.544 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2005000000000002e-05 2024-09-12T16:17:12.544 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.544 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.544 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:12.544 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320893+0000", 2024-09-12T16:17:12.544 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5714000000000001e-05 2024-09-12T16:17:12.544 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.544 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:12.544 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.544 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.545 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.545 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14034 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5035008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:12.545 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:17:12.545 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 53.014284103999998, 2024-09-12T16:17:12.545 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053404082999999998, 2024-09-12T16:17:12.545 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:12.545 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:12.545 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:12.545 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:12.545 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:12.545 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:12.545 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14034 2024-09-12T16:17:12.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.545 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:12.546 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.546 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:12.546 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:17:12.546 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.546 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.546 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.546 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:12.546 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:17:12.546 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.546 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.546 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.546 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:12.546 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521740+0000", 2024-09-12T16:17:12.547 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000243976 2024-09-12T16:17:12.547 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.547 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.547 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:12.547 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521745+0000", 2024-09-12T16:17:12.547 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1280000000000001e-06 2024-09-12T16:17:12.547 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.547 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.547 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:12.547 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521757+0000", 2024-09-12T16:17:12.547 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2751e-05 2024-09-12T16:17:12.547 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.547 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.547 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:12.548 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521771+0000", 2024-09-12T16:17:12.548 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3328e-05 2024-09-12T16:17:12.548 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.548 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.548 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:12.548 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574710+0000", 2024-09-12T16:17:12.548 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052939358999999998 2024-09-12T16:17:12.548 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.548 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.548 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:12.548 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574799+0000", 2024-09-12T16:17:12.548 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8893000000000004e-05 2024-09-12T16:17:12.548 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.548 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.549 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:12.549 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574901+0000", 2024-09-12T16:17:12.549 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101648 2024-09-12T16:17:12.549 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.549 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:12.549 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.549 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.549 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14036 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5043200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:12.549 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:17:12.549 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 53.013824909999997, 2024-09-12T16:17:12.549 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053426247000000003, 2024-09-12T16:17:12.549 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:12.549 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:12.550 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:12.550 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:12.550 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:12.550 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:12.550 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14036 2024-09-12T16:17:12.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.550 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:12.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.550 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:12.550 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:17:12.550 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.550 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:12.550 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:17:12.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.551 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:12.551 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522208+0000", 2024-09-12T16:17:12.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025195300000000002 2024-09-12T16:17:12.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.551 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:12.551 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522211+0000", 2024-09-12T16:17:12.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2160000000000002e-06 2024-09-12T16:17:12.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.552 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:12.552 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522223+0000", 2024-09-12T16:17:12.552 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2044e-05 2024-09-12T16:17:12.552 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.552 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.552 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:12.552 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522229+0000", 2024-09-12T16:17:12.552 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8850000000000004e-06 2024-09-12T16:17:12.552 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.552 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.552 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:12.552 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575192+0000", 2024-09-12T16:17:12.552 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052963573 2024-09-12T16:17:12.552 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.553 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:12.553 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575282+0000", 2024-09-12T16:17:12.553 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9666000000000005e-05 2024-09-12T16:17:12.553 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.553 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:12.553 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575382+0000", 2024-09-12T16:17:12.553 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9909999999999997e-05 2024-09-12T16:17:12.553 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.553 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:12.553 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.553 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.554 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14038 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5051392~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:12.554 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:17:12.554 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 53.013286536999999, 2024-09-12T16:17:12.554 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053395152000000001, 2024-09-12T16:17:12.554 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:12.554 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:12.554 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:12.554 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:12.554 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:12.554 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:12.554 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14038 2024-09-12T16:17:12.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.554 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:12.554 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.555 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:12.555 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:17:12.555 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.555 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.555 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.555 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:12.555 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:17:12.555 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.555 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.555 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.555 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:12.555 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522601+0000", 2024-09-12T16:17:12.555 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010702899999999999 2024-09-12T16:17:12.555 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.555 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.556 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:12.556 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522605+0000", 2024-09-12T16:17:12.556 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2379999999999999e-06 2024-09-12T16:17:12.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.556 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.556 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:12.556 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522616+0000", 2024-09-12T16:17:12.556 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1185999999999999e-05 2024-09-12T16:17:12.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.556 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.556 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:12.556 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522624+0000", 2024-09-12T16:17:12.556 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1099999999999997e-06 2024-09-12T16:17:12.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.557 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.557 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:12.557 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575677+0000", 2024-09-12T16:17:12.557 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053126999999999 2024-09-12T16:17:12.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.557 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.557 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:12.557 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575764+0000", 2024-09-12T16:17:12.557 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7250000000000007e-05 2024-09-12T16:17:12.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.557 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.557 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:12.558 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575889+0000", 2024-09-12T16:17:12.558 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012521200000000001 2024-09-12T16:17:12.558 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.558 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:12.558 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.558 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.558 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.558 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14039 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5055488~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:12.558 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:17:12.558 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 53.013145125999998, 2024-09-12T16:17:12.558 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053466207000000002, 2024-09-12T16:17:12.558 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:12.558 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:12.558 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:12.559 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:12.559 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:12.559 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:12.559 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14039 2024-09-12T16:17:12.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.559 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:12.559 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.559 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:12.559 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:17:12.559 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.559 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.559 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:12.559 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:17:12.559 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.560 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.560 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:12.560 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522899+0000", 2024-09-12T16:17:12.560 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026318199999999999 2024-09-12T16:17:12.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.560 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.560 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:12.560 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522903+0000", 2024-09-12T16:17:12.560 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.929e-06 2024-09-12T16:17:12.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.560 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.560 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:12.561 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522913+0000", 2024-09-12T16:17:12.561 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0162e-05 2024-09-12T16:17:12.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.561 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:12.561 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522921+0000", 2024-09-12T16:17:12.561 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.14e-06 2024-09-12T16:17:12.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.561 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:12.561 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575922+0000", 2024-09-12T16:17:12.561 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053000712999999998 2024-09-12T16:17:12.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.562 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:12.562 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576006+0000", 2024-09-12T16:17:12.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4161999999999998e-05 2024-09-12T16:17:12.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.562 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.562 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:12.562 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576102+0000", 2024-09-12T16:17:12.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5919000000000001e-05 2024-09-12T16:17:12.562 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.562 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:12.562 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.562 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.562 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14040 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5059584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:12.563 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:17:12.563 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 53.012840230999998, 2024-09-12T16:17:12.563 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053413258999999998, 2024-09-12T16:17:12.563 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:12.563 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:12.563 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:12.563 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:12.563 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:12.563 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:12.563 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14040 2024-09-12T16:17:12.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.563 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:12.563 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.563 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:12.563 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:17:12.563 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.564 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.564 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:12.564 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:17:12.564 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.564 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.564 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:12.564 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523059+0000", 2024-09-12T16:17:12.564 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118466 2024-09-12T16:17:12.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.564 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.564 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:12.564 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523062+0000", 2024-09-12T16:17:12.564 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.971e-06 2024-09-12T16:17:12.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.565 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.565 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:12.565 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523069+0000", 2024-09-12T16:17:12.565 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8279999999999997e-06 2024-09-12T16:17:12.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.565 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.565 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:12.565 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523073+0000", 2024-09-12T16:17:12.565 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3019999999999996e-06 2024-09-12T16:17:12.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.565 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.565 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:12.565 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576155+0000", 2024-09-12T16:17:12.565 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053081962000000003 2024-09-12T16:17:12.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.566 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:12.566 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576249+0000", 2024-09-12T16:17:12.566 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3914999999999998e-05 2024-09-12T16:17:12.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.566 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:12.566 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576354+0000", 2024-09-12T16:17:12.566 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010481500000000001 2024-09-12T16:17:12.566 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.566 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:12.566 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.567 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14041 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5063680~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:12.567 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:17:12.567 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 53.012689926, 2024-09-12T16:17:12.567 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053519111000000001, 2024-09-12T16:17:12.567 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:12.567 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:12.567 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:12.567 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:12.567 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:12.567 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:12.567 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14041 2024-09-12T16:17:12.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.567 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:12.567 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.567 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:12.568 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:17:12.568 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.568 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.568 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:12.568 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:17:12.568 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.568 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.568 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:12.568 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523309+0000", 2024-09-12T16:17:12.568 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000218712 2024-09-12T16:17:12.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.568 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:12.569 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523313+0000", 2024-09-12T16:17:12.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.151e-06 2024-09-12T16:17:12.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.569 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:12.569 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523320+0000", 2024-09-12T16:17:12.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9789999999999993e-06 2024-09-12T16:17:12.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.569 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:12.569 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523325+0000", 2024-09-12T16:17:12.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:17:12.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.570 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:12.570 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576402+0000", 2024-09-12T16:17:12.570 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053076811000000002 2024-09-12T16:17:12.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.570 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:12.570 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576491+0000", 2024-09-12T16:17:12.570 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8578999999999993e-05 2024-09-12T16:17:12.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.570 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:12.570 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576610+0000", 2024-09-12T16:17:12.570 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119129 2024-09-12T16:17:12.570 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.571 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:12.571 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.571 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.571 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14042 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5067776~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:12.571 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:17:12.571 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 53.012446492000002, 2024-09-12T16:17:12.571 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053510350999999998, 2024-09-12T16:17:12.571 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:12.571 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:12.571 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:12.571 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:12.571 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:12.571 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:12.571 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14042 2024-09-12T16:17:12.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.572 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:12.572 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.572 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:12.572 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:17:12.572 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.572 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.572 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:12.572 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:17:12.572 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.572 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.572 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:12.572 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523591+0000", 2024-09-12T16:17:12.573 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025710300000000001 2024-09-12T16:17:12.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.573 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:12.573 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523594+0000", 2024-09-12T16:17:12.573 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2229999999999999e-06 2024-09-12T16:17:12.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.573 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:12.573 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523602+0000", 2024-09-12T16:17:12.573 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6930000000000007e-06 2024-09-12T16:17:12.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.573 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:12.573 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523607+0000", 2024-09-12T16:17:12.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4789999999999998e-06 2024-09-12T16:17:12.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:12.574 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576661+0000", 2024-09-12T16:17:12.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053973999999997 2024-09-12T16:17:12.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:12.574 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576745+0000", 2024-09-12T16:17:12.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4660000000000006e-05 2024-09-12T16:17:12.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:12.574 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576844+0000", 2024-09-12T16:17:12.575 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9219e-05 2024-09-12T16:17:12.575 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.575 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:12.575 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.575 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.575 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14043 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5071872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:12.575 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:17:12.575 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 53.012166012999998, 2024-09-12T16:17:12.575 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053475295999999999, 2024-09-12T16:17:12.575 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:12.576 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:12.576 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:12.576 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:12.576 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:12.576 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:12.576 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14043 2024-09-12T16:17:12.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.576 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:12.576 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.576 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:12.576 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:17:12.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.577 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:12.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:17:12.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.577 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:12.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523823+0000", 2024-09-12T16:17:12.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020818900000000001 2024-09-12T16:17:12.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.578 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:12.578 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523826+0000", 2024-09-12T16:17:12.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.405e-06 2024-09-12T16:17:12.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.578 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:12.578 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523834+0000", 2024-09-12T16:17:12.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5499999999999997e-06 2024-09-12T16:17:12.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.578 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:12.578 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523838+0000", 2024-09-12T16:17:12.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.408e-06 2024-09-12T16:17:12.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:12.579 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576904+0000", 2024-09-12T16:17:12.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053065687 2024-09-12T16:17:12.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:12.579 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576991+0000", 2024-09-12T16:17:12.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7399999999999997e-05 2024-09-12T16:17:12.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:12.579 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577090+0000", 2024-09-12T16:17:12.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8657000000000001e-05 2024-09-12T16:17:12.579 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.580 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:12.580 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.580 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.580 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14044 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5075968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:12.580 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:17:12.580 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 53.011934482999997, 2024-09-12T16:17:12.580 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053442659000000003, 2024-09-12T16:17:12.580 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:12.580 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:12.580 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:12.580 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:12.580 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:12.580 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:12.581 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14044 2024-09-12T16:17:12.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.581 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:12.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:12.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:17:12.581 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:12.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:17:12.581 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:12.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523985+0000", 2024-09-12T16:17:12.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000138522 2024-09-12T16:17:12.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:12.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523988+0000", 2024-09-12T16:17:12.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.788e-06 2024-09-12T16:17:12.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:12.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523998+0000", 2024-09-12T16:17:12.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8470000000000008e-06 2024-09-12T16:17:12.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:12.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524010+0000", 2024-09-12T16:17:12.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1348999999999999e-05 2024-09-12T16:17:12.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:12.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577137+0000", 2024-09-12T16:17:12.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053127055999999999 2024-09-12T16:17:12.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:12.584 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577210+0000", 2024-09-12T16:17:12.584 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3392000000000005e-05 2024-09-12T16:17:12.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.584 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.584 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:12.584 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577289+0000", 2024-09-12T16:17:12.584 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8704999999999999e-05 2024-09-12T16:17:12.584 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.584 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:12.584 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.584 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.584 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14045 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5080064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:12.585 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:17:12.585 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 53.011755661999999, 2024-09-12T16:17:12.585 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053497514000000003, 2024-09-12T16:17:12.585 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:12.585 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:12.585 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:12.585 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:12.585 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:12.585 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:12.585 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14045 2024-09-12T16:17:12.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.585 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:12.585 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:12.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:17:12.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:12.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:17:12.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:12.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524311+0000", 2024-09-12T16:17:12.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028626299999999998 2024-09-12T16:17:12.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:12.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524315+0000", 2024-09-12T16:17:12.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0969999999999999e-06 2024-09-12T16:17:12.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:12.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524325+0000", 2024-09-12T16:17:12.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6330000000000008e-06 2024-09-12T16:17:12.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:12.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524332+0000", 2024-09-12T16:17:12.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8700000000000003e-06 2024-09-12T16:17:12.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.588 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:12.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577334+0000", 2024-09-12T16:17:12.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053001834999999997 2024-09-12T16:17:12.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.588 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:12.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577420+0000", 2024-09-12T16:17:12.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6145999999999998e-05 2024-09-12T16:17:12.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.588 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:12.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577522+0000", 2024-09-12T16:17:12.589 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010267 2024-09-12T16:17:12.589 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.589 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:12.589 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.589 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14047 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5088256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:12.589 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:17:12.589 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 53.011269935999998, 2024-09-12T16:17:12.589 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053433340000000003, 2024-09-12T16:17:12.589 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:12.589 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:12.589 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:12.589 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:12.590 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:12.590 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:12.590 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14047 2024-09-12T16:17:12.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.590 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:12.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:12.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:17:12.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:12.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:17:12.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:12.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524727+0000", 2024-09-12T16:17:12.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000216126 2024-09-12T16:17:12.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:12.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524732+0000", 2024-09-12T16:17:12.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1569999999999999e-06 2024-09-12T16:17:12.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:12.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524742+0000", 2024-09-12T16:17:12.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0186999999999999e-05 2024-09-12T16:17:12.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:12.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524750+0000", 2024-09-12T16:17:12.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4279999999999999e-06 2024-09-12T16:17:12.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:12.593 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577743+0000", 2024-09-12T16:17:12.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052993077 2024-09-12T16:17:12.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.593 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:12.593 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577841+0000", 2024-09-12T16:17:12.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8369000000000006e-05 2024-09-12T16:17:12.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.593 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:12.593 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577944+0000", 2024-09-12T16:17:12.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102996 2024-09-12T16:17:12.593 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.593 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:12.594 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.594 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.594 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14048 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5092352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:12.594 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:17:12.594 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 53.011018343000003, 2024-09-12T16:17:12.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053397515, 2024-09-12T16:17:12.594 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:12.594 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:12.594 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:12.594 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:12.594 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:12.594 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:12.594 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14048 2024-09-12T16:17:12.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.594 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:12.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:12.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:17:12.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:12.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:17:12.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:12.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524957+0000", 2024-09-12T16:17:12.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019516999999999999 2024-09-12T16:17:12.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.596 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.596 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:12.596 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524962+0000", 2024-09-12T16:17:12.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7709999999999997e-06 2024-09-12T16:17:12.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.596 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.596 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:12.596 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524973+0000", 2024-09-12T16:17:12.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1031e-05 2024-09-12T16:17:12.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.596 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.596 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:12.596 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524980+0000", 2024-09-12T16:17:12.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6100000000000002e-06 2024-09-12T16:17:12.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:12.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577977+0000", 2024-09-12T16:17:12.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052997481999999999 2024-09-12T16:17:12.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:12.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578062+0000", 2024-09-12T16:17:12.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4851000000000005e-05 2024-09-12T16:17:12.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:12.598 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578160+0000", 2024-09-12T16:17:12.598 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7600000000000001e-05 2024-09-12T16:17:12.598 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.598 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:12.598 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.598 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.598 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14049 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5096448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:12.598 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:17:12.598 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 53.010789715000001, 2024-09-12T16:17:12.598 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053439792, 2024-09-12T16:17:12.598 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:12.598 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:12.598 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:12.599 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:12.599 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:12.599 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:12.599 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14049 2024-09-12T16:17:12.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.599 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:12.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:12.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:17:12.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:12.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:17:12.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:12.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525170+0000", 2024-09-12T16:17:12.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017958500000000001 2024-09-12T16:17:12.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:12.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525174+0000", 2024-09-12T16:17:12.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0239999999999999e-06 2024-09-12T16:17:12.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:12.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525184+0000", 2024-09-12T16:17:12.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5950000000000005e-06 2024-09-12T16:17:12.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:12.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525191+0000", 2024-09-12T16:17:12.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8329999999999996e-06 2024-09-12T16:17:12.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:12.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578240+0000", 2024-09-12T16:17:12.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053049236 2024-09-12T16:17:12.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.602 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:12.602 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578333+0000", 2024-09-12T16:17:12.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2806999999999994e-05 2024-09-12T16:17:12.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.602 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:12.602 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578431+0000", 2024-09-12T16:17:12.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7712000000000002e-05 2024-09-12T16:17:12.602 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.602 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:12.602 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.603 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.603 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14055 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5121024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:12.603 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:17:12.603 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 53.009519023999999, 2024-09-12T16:17:12.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053399038000000003, 2024-09-12T16:17:12.603 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:12.603 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:12.603 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:12.603 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:12.603 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:12.603 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:12.603 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14055 2024-09-12T16:17:12.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.604 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:12.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.604 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:12.604 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:17:12.604 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.604 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:12.604 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:17:12.604 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.604 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:12.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526403+0000", 2024-09-12T16:17:12.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141571 2024-09-12T16:17:12.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.605 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:12.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526406+0000", 2024-09-12T16:17:12.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2660000000000002e-06 2024-09-12T16:17:12.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.605 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:12.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526420+0000", 2024-09-12T16:17:12.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3949e-05 2024-09-12T16:17:12.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:12.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526428+0000", 2024-09-12T16:17:12.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4250000000000001e-06 2024-09-12T16:17:12.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:12.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579476+0000", 2024-09-12T16:17:12.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053048349000000002 2024-09-12T16:17:12.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:12.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579563+0000", 2024-09-12T16:17:12.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6502999999999995e-05 2024-09-12T16:17:12.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:12.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579661+0000", 2024-09-12T16:17:12.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7974999999999996e-05 2024-09-12T16:17:12.607 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.607 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:12.607 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.607 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4806.0:3139 3.1e 3:78d5a095:::rbd_data.11552a37e55b.0000000000000000:head [read 69632~61440] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:17:12.607 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:12.607 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 42.234524774, 2024-09-12T16:17:12.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057851734000000002, 2024-09-12T16:17:12.608 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:12.608 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:12.608 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:12.608 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:12.608 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4806", 2024-09-12T16:17:12.608 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3959815836", 2024-09-12T16:17:12.608 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 3139 2024-09-12T16:17:12.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.608 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:12.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.608 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:12.608 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:12.608 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:12.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:12.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:12.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:12.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4799999999999999e-07 2024-09-12T16:17:12.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:12.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301258+0000", 2024-09-12T16:17:12.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.844e-06 2024-09-12T16:17:12.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.610 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:12.610 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301267+0000", 2024-09-12T16:17:12.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2960000000000004e-06 2024-09-12T16:17:12.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.610 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:12.610 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301276+0000", 2024-09-12T16:17:12.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0650000000000005e-06 2024-09-12T16:17:12.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.610 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:12.610 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301871+0000", 2024-09-12T16:17:12.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00059423600000000005 2024-09-12T16:17:12.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.611 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:12.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301920+0000", 2024-09-12T16:17:12.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9067000000000003e-05 2024-09-12T16:17:12.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.611 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:12.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359108+0000", 2024-09-12T16:17:12.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057187877999999998 2024-09-12T16:17:12.611 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.611 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:12.612 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.612 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:6428 3.14 3:28a44e54:::rbd_header.11552a37e55b:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:17:12.612 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:17:12.612 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 42.234196179999998, 2024-09-12T16:17:12.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057504023000000001, 2024-09-12T16:17:12.612 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:12.612 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:12.612 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:12.612 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:12.612 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:17:12.613 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:17:12.613 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6428 2024-09-12T16:17:12.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.613 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:12.613 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.613 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:12.613 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:17:12.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.613 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.613 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:12.613 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:17:12.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.614 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:12.614 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301585+0000", 2024-09-12T16:17:12.614 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6300000000000005e-07 2024-09-12T16:17:12.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.614 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:12.614 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301588+0000", 2024-09-12T16:17:12.614 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4149999999999999e-06 2024-09-12T16:17:12.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.615 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:12.615 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301597+0000", 2024-09-12T16:17:12.615 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5450000000000003e-06 2024-09-12T16:17:12.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.615 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.615 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:12.615 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301617+0000", 2024-09-12T16:17:12.615 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9837e-05 2024-09-12T16:17:12.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.615 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.615 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:12.615 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301779+0000", 2024-09-12T16:17:12.615 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016186799999999999 2024-09-12T16:17:12.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.616 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:12.616 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301855+0000", 2024-09-12T16:17:12.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5899e-05 2024-09-12T16:17:12.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.616 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:12.616 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359088+0000", 2024-09-12T16:17:12.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057233895999999999 2024-09-12T16:17:12.616 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.616 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:12.616 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.617 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5223.0:1814 3.f 3:f7b1b1c5:::rbd_object_map.1155a1fd27d2:head [read 0~136] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-12T16:17:12.617 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:17:12.617 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 6.2985301160000002, 2024-09-12T16:17:12.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.006378226, 2024-09-12T16:17:12.617 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:12.617 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:12.617 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:12.617 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:12.617 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5223", 2024-09-12T16:17:12.617 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/4066330994", 2024-09-12T16:17:12.617 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1814 2024-09-12T16:17:12.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.617 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:12.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.618 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:12.618 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:17:12.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.618 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:12.618 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:17:12.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.618 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:12.618 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237252+0000", 2024-09-12T16:17:12.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.344e-06 2024-09-12T16:17:12.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.618 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:12.619 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237258+0000", 2024-09-12T16:17:12.619 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1070000000000001e-06 2024-09-12T16:17:12.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.619 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.619 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:12.619 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237270+0000", 2024-09-12T16:17:12.619 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1758e-05 2024-09-12T16:17:12.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.619 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.619 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:12.619 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237278+0000", 2024-09-12T16:17:12.619 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3219999999999993e-06 2024-09-12T16:17:12.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.619 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.619 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:12.620 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237334+0000", 2024-09-12T16:17:12.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6356e-05 2024-09-12T16:17:12.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:17:12.620 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237345+0000", 2024-09-12T16:17:12.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0433e-05 2024-09-12T16:17:12.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:12.620 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243426+0000", 2024-09-12T16:17:12.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.00608133 2024-09-12T16:17:12.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:12.621 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243534+0000", 2024-09-12T16:17:12.621 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010784 2024-09-12T16:17:12.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.621 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:12.621 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243629+0000", 2024-09-12T16:17:12.621 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4735999999999996e-05 2024-09-12T16:17:12.621 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.621 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:12.621 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.621 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5328.0:2542 3.16 3:6928f3a1:::rbd_object_map.11551722dd77:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:12.622 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:17:12.622 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.48018468600000003, 2024-09-12T16:17:12.622 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.054219934999999997, 2024-09-12T16:17:12.622 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:12.622 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:12.622 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:12.622 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:12.622 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5328", 2024-09-12T16:17:12.622 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:12.622 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2542 2024-09-12T16:17:12.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.622 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:12.622 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.622 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:12.622 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:17:12.623 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.623 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:12.623 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:17:12.623 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.623 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:12.623 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055597+0000", 2024-09-12T16:17:12.623 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4300000000000001e-07 2024-09-12T16:17:12.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.623 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:12.623 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055602+0000", 2024-09-12T16:17:12.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4269999999999999e-06 2024-09-12T16:17:12.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.624 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:12.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055613+0000", 2024-09-12T16:17:12.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0815000000000001e-05 2024-09-12T16:17:12.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.624 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:12.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055621+0000", 2024-09-12T16:17:12.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4189999999999996e-06 2024-09-12T16:17:12.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.624 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:12.625 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102196+0000", 2024-09-12T16:17:12.625 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.046575616 2024-09-12T16:17:12.625 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.625 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.625 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:12.625 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102258+0000", 2024-09-12T16:17:12.625 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1872000000000007e-05 2024-09-12T16:17:12.625 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.625 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.625 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T16:17:12.625 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102601+0000", 2024-09-12T16:17:12.625 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034285700000000001 2024-09-12T16:17:12.625 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.625 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.625 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:12.626 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.104431+0000", 2024-09-12T16:17:12.626 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001830524 2024-09-12T16:17:12.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.626 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.626 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:17:12.626 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109733+0000", 2024-09-12T16:17:12.626 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0053020089999999999 2024-09-12T16:17:12.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.626 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.626 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:12.626 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109777+0000", 2024-09-12T16:17:12.626 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3754000000000002e-05 2024-09-12T16:17:12.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.626 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.626 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:12.627 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109816+0000", 2024-09-12T16:17:12.627 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8699000000000003e-05 2024-09-12T16:17:12.627 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.627 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:12.627 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.627 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.627 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5328.0:2543 3.16 3:6928f3a1:::rbd_object_map.11551722dd77:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:12.627 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:17:12.627 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.479590707, 2024-09-12T16:17:12.627 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053695720000000002, 2024-09-12T16:17:12.627 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:12.627 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:12.627 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:12.627 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:12.628 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5328", 2024-09-12T16:17:12.628 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:12.628 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2543 2024-09-12T16:17:12.628 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.628 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:12.628 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.628 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:12.628 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:17:12.628 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.628 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.628 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.628 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:12.628 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:17:12.628 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:12.628 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:12.629 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056191+0000", 2024-09-12T16:17:12.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.54e-07 2024-09-12T16:17:12.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:12.629 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056195+0000", 2024-09-12T16:17:12.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5460000000000002e-06 2024-09-12T16:17:12.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:12.629 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056205+0000", 2024-09-12T16:17:12.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7350000000000008e-06 2024-09-12T16:17:12.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.630 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.630 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:12.630 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056214+0000", 2024-09-12T16:17:12.630 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8089999999999999e-06 2024-09-12T16:17:12.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.630 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.630 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:12.630 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103317+0000", 2024-09-12T16:17:12.630 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.047102889000000002 2024-09-12T16:17:12.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.630 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.630 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:12.630 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103410+0000", 2024-09-12T16:17:12.630 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3689000000000004e-05 2024-09-12T16:17:12.631 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.631 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.631 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T16:17:12.631 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103754+0000", 2024-09-12T16:17:12.631 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034344699999999998 2024-09-12T16:17:12.631 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.631 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.631 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:12.631 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.106487+0000", 2024-09-12T16:17:12.631 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0027330100000000001 2024-09-12T16:17:12.631 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.631 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.631 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:17:12.632 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109827+0000", 2024-09-12T16:17:12.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033406640000000001 2024-09-12T16:17:12.632 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.632 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.632 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:12.632 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109854+0000", 2024-09-12T16:17:12.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6866999999999999e-05 2024-09-12T16:17:12.632 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:12.632 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:12.632 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:12.632 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109886+0000", 2024-09-12T16:17:12.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1309999999999997e-05 2024-09-12T16:17:12.633 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.633 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:12.633 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.633 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:12.633 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:12.633 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:12.634 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:17:12.635 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:12.633+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:12.674 INFO:teuthology.orchestra.run.smithi204.stdout:3890 read 0x1619a00 thru 0x161fbd9 (0x61da bytes) 2024-09-12T16:17:12.704 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:17:12.705 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:17:12.730 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:17:12.731 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:17:12.735 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:12.735+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:12.746 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:12.747 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:12.747 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:17:12.747 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:12.755 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:17:12.756 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:17:12.756 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:17:12.772 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:17:12.773 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:17:12.789 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:17:12.790 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:17:12.807 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:17:12.807 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:17:12.858 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:12.858+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:12.899 INFO:teuthology.orchestra.run.smithi204.stdout:3891 write 0x634fe00 thru 0x63545ac (0x47ad bytes) 2024-09-12T16:17:12.902 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:12.902 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:12.906 INFO:teuthology.orchestra.run.smithi204.stdout:3893 trunc from 0x6354600 to 0xc745800 2024-09-12T16:17:12.912 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:17:12.936 INFO:teuthology.orchestra.run.smithi204.stdout:3896 punch from 0x458da00 to 0x4592a00, (0x5000 bytes) 2024-09-12T16:17:12.937 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:12.936+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:12.937 INFO:teuthology.orchestra.run.smithi204.stdout:3897 write 0x118e000 thru 0x118fb0b (0x1b0c bytes) 2024-09-12T16:17:12.938 INFO:teuthology.orchestra.run.smithi204.stdout:3898 read 0x3893e00 thru 0x38982c1 (0x44c2 bytes) 2024-09-12T16:17:12.938 INFO:teuthology.orchestra.run.smithi204.stdout:3901 write 0xb2ca800 thru 0xb2d93f3 (0xebf4 bytes) 2024-09-12T16:17:12.938 INFO:teuthology.orchestra.run.smithi204.stdout:3905 read 0x3685800 thru 0x368e4f2 (0x8cf3 bytes) 2024-09-12T16:17:12.938 INFO:teuthology.orchestra.run.smithi204.stdout:3906 write 0x47b0800 thru 0x47be85d (0xe05e bytes) 2024-09-12T16:17:12.938 INFO:teuthology.orchestra.run.smithi204.stdout:3908 write 0x61fd600 thru 0x6201bc4 (0x45c5 bytes) 2024-09-12T16:17:12.954 INFO:teuthology.orchestra.run.smithi204.stdout:3910 trunc from 0xc745800 to 0xbe8e00 2024-09-12T16:17:13.038 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:13.036+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:13.049 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:13.050 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:13.059 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:17:13.138 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:13.137+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:13.203 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:13.203 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:13.214 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:17:13.239 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:13.238+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:13.267 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T16:17:13.310 INFO:teuthology.orchestra.run.smithi204.stdout:skipping zero length punch hole 2024-09-12T16:17:13.318 INFO:teuthology.orchestra.run.smithi204.stdout:3912 trunc from 0xbe8e00 to 0x73eea00 2024-09-12T16:17:13.331 INFO:teuthology.orchestra.run.smithi204.stdout:3914 trunc from 0x73eea00 to 0x4f48800 2024-09-12T16:17:13.331 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:13.331 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:13.339 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:13.339+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:13.341 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:17:13.342 INFO:teuthology.orchestra.run.smithi204.stdout:3915 clone 25 order 18 su 131072 sc 2 2024-09-12T16:17:13.440 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:13.440+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:13.491 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:13.491 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:13.499 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:17:13.543 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:13.542+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:13.607 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:13.607 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:13.615 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:17:13.643 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:13.642+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:13.744 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:13.742+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:13.763 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:13.763 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:13.771 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:17:13.844 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:13.843+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:13.878 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:13.878 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:13.887 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:17:13.971 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:13.970+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:14.035 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:14.035 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:14.043 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:17:14.085 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:14.084+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:14.147 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:14.146+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:14.191 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:14.191 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:14.200 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:17:14.248 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:14.246+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:14.265 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-12T16:17:14.348 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:14.347+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:14.354 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:14.354 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:14.361 INFO:teuthology.orchestra.run.smithi204.stdout:truncating image image_client.0-clone24 from 0x4f48800 (overlap 0xbe8e00) to 0x725400 2024-09-12T16:17:14.363 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:17:14.449 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:14.448+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:14.550 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:14.549+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:14.552 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:14.552 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:14.563 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:17:14.650 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:14.649+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:14.751 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:14.750+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:14.767 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:14.767 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:14.780 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:17:14.818 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T16:17:14.852 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:14.851+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:14.911 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:14.912 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:14.921 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:17:14.960 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:17:14.960 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:17:14.966 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:14.965+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:14.977 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:17:14.977 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:17:14.993 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:17:14.994 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:17:15.011 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:17:15.011 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:17:15.028 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:17:15.028 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:17:15.031 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:15.031 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:15.031 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:17:15.031 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:15.040 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:17:15.045 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:17:15.045 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:17:15.081 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:15.080+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:15.155 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:15.154+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:15.188 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:15.188 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:15.188 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:17:15.188 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:17:15.188 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:15.197 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:17:15.255 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:15.254+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:15.306 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:15.306 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:17:15.306 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:17:15.306 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:17:15.307 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.307 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:17:15.307 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:17:15.307 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 93.540253500000006, 2024-09-12T16:17:15.307 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55645454900000002, 2024-09-12T16:17:15.307 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.307 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.307 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:15.307 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.307 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:17:15.307 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:17:15.307 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1 2024-09-12T16:17:15.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.308 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.308 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:17:15.308 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.308 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:17:15.308 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.308 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764440+0000", 2024-09-12T16:17:15.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6249999999999999e-06 2024-09-12T16:17:15.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764447+0000", 2024-09-12T16:17:15.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4939999999999997e-06 2024-09-12T16:17:15.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764459+0000", 2024-09-12T16:17:15.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1517e-05 2024-09-12T16:17:15.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.310 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.310 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.310 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764468+0000", 2024-09-12T16:17:15.310 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7690000000000002e-06 2024-09-12T16:17:15.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.310 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.310 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.310 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764539+0000", 2024-09-12T16:17:15.310 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1103e-05 2024-09-12T16:17:15.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.310 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.310 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:17:15.310 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764551+0000", 2024-09-12T16:17:15.311 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2687999999999999e-05 2024-09-12T16:17:15.311 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.311 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.311 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.311 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319497+0000", 2024-09-12T16:17:15.311 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55494560500000001 2024-09-12T16:17:15.311 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.311 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.311 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.311 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319688+0000", 2024-09-12T16:17:15.311 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019105599999999999 2024-09-12T16:17:15.311 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.311 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.311 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:17:15.312 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319842+0000", 2024-09-12T16:17:15.312 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015377699999999999 2024-09-12T16:17:15.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.312 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.312 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:17:15.312 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320473+0000", 2024-09-12T16:17:15.312 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00063117100000000003 2024-09-12T16:17:15.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.312 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.312 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:15.312 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320825+0000", 2024-09-12T16:17:15.312 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00035202500000000001 2024-09-12T16:17:15.313 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.313 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.313 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:15.313 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320867+0000", 2024-09-12T16:17:15.313 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2005000000000002e-05 2024-09-12T16:17:15.313 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.313 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.313 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.313 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320893+0000", 2024-09-12T16:17:15.313 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5714000000000001e-05 2024-09-12T16:17:15.313 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.313 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.314 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.314 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.314 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.314 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14034 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5035008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:15.314 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:17:15.314 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 55.783195266999996, 2024-09-12T16:17:15.314 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053404082999999998, 2024-09-12T16:17:15.314 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.314 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.314 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:15.314 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.314 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:15.314 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:15.315 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14034 2024-09-12T16:17:15.315 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.315 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.315 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.315 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.315 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:17:15.315 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.315 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.315 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.315 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.315 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:17:15.315 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.315 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.316 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.316 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521740+0000", 2024-09-12T16:17:15.316 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000243976 2024-09-12T16:17:15.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.316 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.316 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521745+0000", 2024-09-12T16:17:15.316 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1280000000000001e-06 2024-09-12T16:17:15.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.316 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.316 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521757+0000", 2024-09-12T16:17:15.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2751e-05 2024-09-12T16:17:15.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.317 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.317 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521771+0000", 2024-09-12T16:17:15.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3328e-05 2024-09-12T16:17:15.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.317 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.317 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574710+0000", 2024-09-12T16:17:15.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052939358999999998 2024-09-12T16:17:15.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.317 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.318 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574799+0000", 2024-09-12T16:17:15.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8893000000000004e-05 2024-09-12T16:17:15.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.318 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.318 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574901+0000", 2024-09-12T16:17:15.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101648 2024-09-12T16:17:15.318 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.318 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.318 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.318 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14036 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5043200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:15.319 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:17:15.319 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 55.782736073000002, 2024-09-12T16:17:15.319 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053426247000000003, 2024-09-12T16:17:15.319 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.319 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.319 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:15.319 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.319 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:15.319 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:15.319 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14036 2024-09-12T16:17:15.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.319 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.319 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.319 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.320 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:17:15.320 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.320 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.320 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.320 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.320 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:17:15.320 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.320 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.320 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.320 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.320 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522208+0000", 2024-09-12T16:17:15.320 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025195300000000002 2024-09-12T16:17:15.320 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.320 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.321 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.321 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522211+0000", 2024-09-12T16:17:15.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2160000000000002e-06 2024-09-12T16:17:15.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.321 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.321 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.321 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522223+0000", 2024-09-12T16:17:15.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2044e-05 2024-09-12T16:17:15.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.321 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.321 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.322 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522229+0000", 2024-09-12T16:17:15.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8850000000000004e-06 2024-09-12T16:17:15.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.322 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575192+0000", 2024-09-12T16:17:15.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052963573 2024-09-12T16:17:15.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.322 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575282+0000", 2024-09-12T16:17:15.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9666000000000005e-05 2024-09-12T16:17:15.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.323 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575382+0000", 2024-09-12T16:17:15.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9909999999999997e-05 2024-09-12T16:17:15.323 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.323 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.323 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.323 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14038 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5051392~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:15.323 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:17:15.323 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 55.782197699999998, 2024-09-12T16:17:15.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053395152000000001, 2024-09-12T16:17:15.323 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.323 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.324 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:15.324 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.324 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:15.324 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:15.324 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14038 2024-09-12T16:17:15.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.324 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.324 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.324 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.324 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:17:15.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.324 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.325 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.325 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:17:15.325 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.325 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.325 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.325 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.325 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522601+0000", 2024-09-12T16:17:15.325 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010702899999999999 2024-09-12T16:17:15.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.326 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.326 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.326 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522605+0000", 2024-09-12T16:17:15.326 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2379999999999999e-06 2024-09-12T16:17:15.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.326 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.326 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.326 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522616+0000", 2024-09-12T16:17:15.326 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1185999999999999e-05 2024-09-12T16:17:15.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.326 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.326 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.327 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522624+0000", 2024-09-12T16:17:15.327 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1099999999999997e-06 2024-09-12T16:17:15.327 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.327 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.327 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.327 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575677+0000", 2024-09-12T16:17:15.327 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053126999999999 2024-09-12T16:17:15.327 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.327 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.327 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.327 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575764+0000", 2024-09-12T16:17:15.327 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7250000000000007e-05 2024-09-12T16:17:15.327 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.328 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.328 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.328 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575889+0000", 2024-09-12T16:17:15.328 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012521200000000001 2024-09-12T16:17:15.328 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.328 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.328 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.328 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.328 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.328 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14039 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5055488~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:15.328 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:17:15.328 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 55.782056289000003, 2024-09-12T16:17:15.328 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053466207000000002, 2024-09-12T16:17:15.329 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.329 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.329 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:15.329 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.329 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:15.329 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:15.329 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14039 2024-09-12T16:17:15.329 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.329 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.329 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.329 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.329 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:17:15.329 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.330 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.330 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:17:15.330 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.330 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.330 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522899+0000", 2024-09-12T16:17:15.330 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026318199999999999 2024-09-12T16:17:15.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.330 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.330 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522903+0000", 2024-09-12T16:17:15.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.929e-06 2024-09-12T16:17:15.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.331 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522913+0000", 2024-09-12T16:17:15.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0162e-05 2024-09-12T16:17:15.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.331 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522921+0000", 2024-09-12T16:17:15.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.14e-06 2024-09-12T16:17:15.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575922+0000", 2024-09-12T16:17:15.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053000712999999998 2024-09-12T16:17:15.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576006+0000", 2024-09-12T16:17:15.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4161999999999998e-05 2024-09-12T16:17:15.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576102+0000", 2024-09-12T16:17:15.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5919000000000001e-05 2024-09-12T16:17:15.333 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.333 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.333 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.333 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14040 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5059584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:15.333 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:17:15.333 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 55.781751393999997, 2024-09-12T16:17:15.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053413258999999998, 2024-09-12T16:17:15.333 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.333 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.333 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:15.333 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.333 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:15.334 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:15.334 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14040 2024-09-12T16:17:15.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.334 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.334 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.334 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.334 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:17:15.334 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.334 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.334 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.334 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:17:15.334 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.335 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.335 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.335 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523059+0000", 2024-09-12T16:17:15.335 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118466 2024-09-12T16:17:15.335 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.335 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.335 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.335 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523062+0000", 2024-09-12T16:17:15.335 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.971e-06 2024-09-12T16:17:15.335 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.335 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.335 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.335 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523069+0000", 2024-09-12T16:17:15.335 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8279999999999997e-06 2024-09-12T16:17:15.335 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.336 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.336 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.336 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523073+0000", 2024-09-12T16:17:15.336 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3019999999999996e-06 2024-09-12T16:17:15.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.336 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.336 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.336 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576155+0000", 2024-09-12T16:17:15.336 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053081962000000003 2024-09-12T16:17:15.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.336 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.336 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576249+0000", 2024-09-12T16:17:15.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3914999999999998e-05 2024-09-12T16:17:15.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.337 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576354+0000", 2024-09-12T16:17:15.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010481500000000001 2024-09-12T16:17:15.337 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.337 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.337 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.337 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14041 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5063680~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:15.338 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:17:15.338 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 55.781601088999999, 2024-09-12T16:17:15.338 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053519111000000001, 2024-09-12T16:17:15.338 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.338 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.338 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:15.338 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.338 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:15.338 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:15.338 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14041 2024-09-12T16:17:15.338 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.338 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.338 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.339 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.339 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:17:15.339 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.339 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.339 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.339 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.339 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:17:15.339 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.339 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.339 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.339 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.339 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523309+0000", 2024-09-12T16:17:15.339 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000218712 2024-09-12T16:17:15.339 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.340 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.340 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.340 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523313+0000", 2024-09-12T16:17:15.340 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.151e-06 2024-09-12T16:17:15.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.340 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.340 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.340 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523320+0000", 2024-09-12T16:17:15.340 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9789999999999993e-06 2024-09-12T16:17:15.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.340 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.340 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.341 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523325+0000", 2024-09-12T16:17:15.341 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:17:15.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.341 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.341 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.341 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576402+0000", 2024-09-12T16:17:15.341 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053076811000000002 2024-09-12T16:17:15.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.341 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.341 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.341 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576491+0000", 2024-09-12T16:17:15.341 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8578999999999993e-05 2024-09-12T16:17:15.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.342 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.342 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.342 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576610+0000", 2024-09-12T16:17:15.342 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119129 2024-09-12T16:17:15.342 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.342 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.342 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.342 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.342 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14042 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5067776~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:15.342 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:17:15.342 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 55.781357655000001, 2024-09-12T16:17:15.342 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053510350999999998, 2024-09-12T16:17:15.342 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.342 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.343 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:15.343 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.343 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:15.343 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:15.343 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14042 2024-09-12T16:17:15.343 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.343 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.343 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.343 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.343 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:17:15.343 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.343 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.343 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.343 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.343 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:17:15.344 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.344 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.344 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.344 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523591+0000", 2024-09-12T16:17:15.344 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025710300000000001 2024-09-12T16:17:15.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.344 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.344 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.344 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523594+0000", 2024-09-12T16:17:15.344 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2229999999999999e-06 2024-09-12T16:17:15.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.344 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.345 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.345 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523602+0000", 2024-09-12T16:17:15.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6930000000000007e-06 2024-09-12T16:17:15.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.345 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.345 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.345 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523607+0000", 2024-09-12T16:17:15.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4789999999999998e-06 2024-09-12T16:17:15.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.345 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.345 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.345 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576661+0000", 2024-09-12T16:17:15.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053973999999997 2024-09-12T16:17:15.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.346 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.346 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576745+0000", 2024-09-12T16:17:15.346 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4660000000000006e-05 2024-09-12T16:17:15.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.346 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.346 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576844+0000", 2024-09-12T16:17:15.346 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9219e-05 2024-09-12T16:17:15.346 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.346 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.346 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.347 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.347 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14043 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5071872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:15.347 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:17:15.347 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 55.781077175999997, 2024-09-12T16:17:15.347 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053475295999999999, 2024-09-12T16:17:15.347 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.347 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.347 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:15.347 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.347 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:15.347 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:15.347 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14043 2024-09-12T16:17:15.347 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.347 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.347 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.348 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.348 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:17:15.348 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.348 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.348 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.348 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.348 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:17:15.348 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.348 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.348 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.348 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.348 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523823+0000", 2024-09-12T16:17:15.348 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020818900000000001 2024-09-12T16:17:15.348 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.349 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.349 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.349 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523826+0000", 2024-09-12T16:17:15.349 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.405e-06 2024-09-12T16:17:15.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.349 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.349 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.349 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523834+0000", 2024-09-12T16:17:15.349 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5499999999999997e-06 2024-09-12T16:17:15.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.349 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.349 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.349 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523838+0000", 2024-09-12T16:17:15.349 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.408e-06 2024-09-12T16:17:15.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576904+0000", 2024-09-12T16:17:15.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053065687 2024-09-12T16:17:15.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576991+0000", 2024-09-12T16:17:15.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7399999999999997e-05 2024-09-12T16:17:15.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.351 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.351 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577090+0000", 2024-09-12T16:17:15.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8657000000000001e-05 2024-09-12T16:17:15.351 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.351 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.351 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.351 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14044 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5075968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:15.351 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:17:15.351 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 55.780845646000003, 2024-09-12T16:17:15.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053442659000000003, 2024-09-12T16:17:15.351 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.352 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.352 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:15.352 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.352 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:15.352 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:15.352 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14044 2024-09-12T16:17:15.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.352 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.352 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.352 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.352 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:17:15.352 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.353 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.353 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.353 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:17:15.353 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.353 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.353 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.353 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523985+0000", 2024-09-12T16:17:15.353 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000138522 2024-09-12T16:17:15.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.353 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.353 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.353 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523988+0000", 2024-09-12T16:17:15.354 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.788e-06 2024-09-12T16:17:15.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.354 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.354 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523998+0000", 2024-09-12T16:17:15.354 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8470000000000008e-06 2024-09-12T16:17:15.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.354 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.354 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524010+0000", 2024-09-12T16:17:15.354 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1348999999999999e-05 2024-09-12T16:17:15.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.354 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.355 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577137+0000", 2024-09-12T16:17:15.355 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053127055999999999 2024-09-12T16:17:15.355 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.355 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.355 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.355 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577210+0000", 2024-09-12T16:17:15.355 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3392000000000005e-05 2024-09-12T16:17:15.355 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.355 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.355 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.355 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577289+0000", 2024-09-12T16:17:15.355 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8704999999999999e-05 2024-09-12T16:17:15.355 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.356 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.356 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.356 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.356 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14045 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5080064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:15.356 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:17:15.356 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 55.780666824999997, 2024-09-12T16:17:15.356 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053497514000000003, 2024-09-12T16:17:15.356 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.356 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.356 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:15.356 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.356 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:15.356 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:15.356 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14045 2024-09-12T16:17:15.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.357 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.357 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.357 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.357 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:17:15.357 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.357 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.357 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.357 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:17:15.357 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.357 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.358 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.358 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524311+0000", 2024-09-12T16:17:15.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028626299999999998 2024-09-12T16:17:15.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.358 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.358 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.358 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524315+0000", 2024-09-12T16:17:15.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0969999999999999e-06 2024-09-12T16:17:15.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.358 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.358 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.358 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524325+0000", 2024-09-12T16:17:15.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6330000000000008e-06 2024-09-12T16:17:15.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.359 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524332+0000", 2024-09-12T16:17:15.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8700000000000003e-06 2024-09-12T16:17:15.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.359 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577334+0000", 2024-09-12T16:17:15.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053001834999999997 2024-09-12T16:17:15.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.359 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577420+0000", 2024-09-12T16:17:15.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6145999999999998e-05 2024-09-12T16:17:15.360 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.360 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.360 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.360 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577522+0000", 2024-09-12T16:17:15.360 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010267 2024-09-12T16:17:15.360 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.360 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.360 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.360 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.360 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.360 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14047 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5088256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:15.360 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:17:15.360 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 55.780181099000004, 2024-09-12T16:17:15.360 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053433340000000003, 2024-09-12T16:17:15.361 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.361 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.364 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:15.364 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.364 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:15.364 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:15.364 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14047 2024-09-12T16:17:15.364 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.364 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.364 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.364 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.364 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:17:15.364 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.365 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.365 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.365 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.365 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:17:15.365 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.365 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.365 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.365 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.365 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524727+0000", 2024-09-12T16:17:15.365 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000216126 2024-09-12T16:17:15.365 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.365 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.365 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.365 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524732+0000", 2024-09-12T16:17:15.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1569999999999999e-06 2024-09-12T16:17:15.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.366 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.366 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.366 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524742+0000", 2024-09-12T16:17:15.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0186999999999999e-05 2024-09-12T16:17:15.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.366 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.366 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.366 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524750+0000", 2024-09-12T16:17:15.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4279999999999999e-06 2024-09-12T16:17:15.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.366 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.367 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.367 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577743+0000", 2024-09-12T16:17:15.367 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052993077 2024-09-12T16:17:15.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.367 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.367 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.367 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577841+0000", 2024-09-12T16:17:15.367 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8369000000000006e-05 2024-09-12T16:17:15.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.367 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.367 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.367 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577944+0000", 2024-09-12T16:17:15.367 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102996 2024-09-12T16:17:15.368 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.368 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.368 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.368 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.368 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.368 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14048 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5092352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:15.368 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:17:15.368 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 55.779929506000002, 2024-09-12T16:17:15.368 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053397515, 2024-09-12T16:17:15.368 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.368 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.368 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:15.369 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.369 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:15.369 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:15.369 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14048 2024-09-12T16:17:15.369 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.369 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.369 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.369 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.369 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:17:15.370 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.370 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.370 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.370 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:17:15.370 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.370 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.370 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.370 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524957+0000", 2024-09-12T16:17:15.370 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019516999999999999 2024-09-12T16:17:15.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.371 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.371 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.371 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524962+0000", 2024-09-12T16:17:15.371 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7709999999999997e-06 2024-09-12T16:17:15.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.371 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.371 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.371 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524973+0000", 2024-09-12T16:17:15.371 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1031e-05 2024-09-12T16:17:15.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.371 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.371 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.371 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524980+0000", 2024-09-12T16:17:15.371 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6100000000000002e-06 2024-09-12T16:17:15.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.372 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.372 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.372 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577977+0000", 2024-09-12T16:17:15.372 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052997481999999999 2024-09-12T16:17:15.372 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.372 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.372 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.372 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578062+0000", 2024-09-12T16:17:15.372 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4851000000000005e-05 2024-09-12T16:17:15.372 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.372 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.372 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.372 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578160+0000", 2024-09-12T16:17:15.373 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7600000000000001e-05 2024-09-12T16:17:15.373 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.373 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.373 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.373 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.373 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.373 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14049 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5096448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:15.373 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:17:15.373 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 55.779700878, 2024-09-12T16:17:15.373 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053439792, 2024-09-12T16:17:15.373 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.373 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.373 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:15.374 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.374 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:15.374 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:15.374 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14049 2024-09-12T16:17:15.374 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.374 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.374 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.374 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.374 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:17:15.374 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.374 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.374 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.374 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.374 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:17:15.374 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.375 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.375 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.375 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.375 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525170+0000", 2024-09-12T16:17:15.375 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017958500000000001 2024-09-12T16:17:15.375 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.375 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.375 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.375 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525174+0000", 2024-09-12T16:17:15.375 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0239999999999999e-06 2024-09-12T16:17:15.375 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.375 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.375 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.376 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525184+0000", 2024-09-12T16:17:15.376 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5950000000000005e-06 2024-09-12T16:17:15.376 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.376 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.376 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.376 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525191+0000", 2024-09-12T16:17:15.376 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8329999999999996e-06 2024-09-12T16:17:15.376 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.376 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.376 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.376 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578240+0000", 2024-09-12T16:17:15.376 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053049236 2024-09-12T16:17:15.376 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.377 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.377 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.377 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578333+0000", 2024-09-12T16:17:15.377 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2806999999999994e-05 2024-09-12T16:17:15.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.377 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.377 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.377 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578431+0000", 2024-09-12T16:17:15.377 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7712000000000002e-05 2024-09-12T16:17:15.377 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.377 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.377 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.378 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.378 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.378 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14055 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5121024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:15.378 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:17:15.378 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 55.778430186999998, 2024-09-12T16:17:15.378 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053399038000000003, 2024-09-12T16:17:15.378 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.378 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.378 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:15.378 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.378 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:15.378 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:15.378 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14055 2024-09-12T16:17:15.379 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.379 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.379 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.379 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.379 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:17:15.379 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.379 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.379 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.379 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.379 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:17:15.379 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.379 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.379 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.379 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.380 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526403+0000", 2024-09-12T16:17:15.380 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141571 2024-09-12T16:17:15.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.380 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.380 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.380 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526406+0000", 2024-09-12T16:17:15.380 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2660000000000002e-06 2024-09-12T16:17:15.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.380 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.380 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.380 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526420+0000", 2024-09-12T16:17:15.380 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3949e-05 2024-09-12T16:17:15.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.380 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.381 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.381 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526428+0000", 2024-09-12T16:17:15.381 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4250000000000001e-06 2024-09-12T16:17:15.381 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.381 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.381 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.381 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579476+0000", 2024-09-12T16:17:15.381 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053048349000000002 2024-09-12T16:17:15.381 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.381 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.381 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.381 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579563+0000", 2024-09-12T16:17:15.381 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6502999999999995e-05 2024-09-12T16:17:15.382 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.382 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.382 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.382 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579661+0000", 2024-09-12T16:17:15.382 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7974999999999996e-05 2024-09-12T16:17:15.382 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.382 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.382 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.382 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.382 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.382 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4806.0:3139 3.1e 3:78d5a095:::rbd_data.11552a37e55b.0000000000000000:head [read 69632~61440] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:17:15.382 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:15.382 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 45.003435936999999, 2024-09-12T16:17:15.383 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057851734000000002, 2024-09-12T16:17:15.383 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.383 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.383 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:15.383 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.383 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4806", 2024-09-12T16:17:15.383 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3959815836", 2024-09-12T16:17:15.383 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 3139 2024-09-12T16:17:15.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.383 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.383 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.383 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.383 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:15.383 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.384 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.384 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:15.384 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.384 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.384 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:15.384 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4799999999999999e-07 2024-09-12T16:17:15.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.384 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.385 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301258+0000", 2024-09-12T16:17:15.385 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.844e-06 2024-09-12T16:17:15.385 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.385 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.385 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.385 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301267+0000", 2024-09-12T16:17:15.385 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2960000000000004e-06 2024-09-12T16:17:15.385 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.385 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.385 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.385 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301276+0000", 2024-09-12T16:17:15.385 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0650000000000005e-06 2024-09-12T16:17:15.385 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.386 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.386 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.386 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301871+0000", 2024-09-12T16:17:15.386 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00059423600000000005 2024-09-12T16:17:15.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.386 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.386 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.386 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301920+0000", 2024-09-12T16:17:15.386 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9067000000000003e-05 2024-09-12T16:17:15.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.386 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.386 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.386 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359108+0000", 2024-09-12T16:17:15.387 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057187877999999998 2024-09-12T16:17:15.387 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.387 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.387 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.387 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.387 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:6428 3.14 3:28a44e54:::rbd_header.11552a37e55b:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:17:15.387 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:17:15.387 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 45.003107343000003, 2024-09-12T16:17:15.387 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057504023000000001, 2024-09-12T16:17:15.387 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.387 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.388 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:15.388 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.388 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:17:15.388 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:17:15.388 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6428 2024-09-12T16:17:15.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.388 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.388 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:17:15.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.388 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.389 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.389 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:17:15.389 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.389 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.389 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.389 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301585+0000", 2024-09-12T16:17:15.389 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6300000000000005e-07 2024-09-12T16:17:15.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.389 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.389 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.389 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301588+0000", 2024-09-12T16:17:15.389 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4149999999999999e-06 2024-09-12T16:17:15.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.390 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.390 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.390 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301597+0000", 2024-09-12T16:17:15.390 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5450000000000003e-06 2024-09-12T16:17:15.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.390 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.390 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.390 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301617+0000", 2024-09-12T16:17:15.390 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9837e-05 2024-09-12T16:17:15.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.390 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.390 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.390 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301779+0000", 2024-09-12T16:17:15.390 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016186799999999999 2024-09-12T16:17:15.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.391 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.391 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.391 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301855+0000", 2024-09-12T16:17:15.391 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5899e-05 2024-09-12T16:17:15.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.391 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.391 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.391 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359088+0000", 2024-09-12T16:17:15.391 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057233895999999999 2024-09-12T16:17:15.391 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.391 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.391 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.391 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.392 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5223.0:1814 3.f 3:f7b1b1c5:::rbd_object_map.1155a1fd27d2:head [read 0~136] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-12T16:17:15.392 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:17:15.392 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 9.0674412790000005, 2024-09-12T16:17:15.392 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.006378226, 2024-09-12T16:17:15.392 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.392 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.392 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:15.392 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.392 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5223", 2024-09-12T16:17:15.392 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/4066330994", 2024-09-12T16:17:15.392 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1814 2024-09-12T16:17:15.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.392 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.392 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.393 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.393 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:17:15.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.393 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.393 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:17:15.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.393 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.393 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237252+0000", 2024-09-12T16:17:15.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.344e-06 2024-09-12T16:17:15.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237258+0000", 2024-09-12T16:17:15.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1070000000000001e-06 2024-09-12T16:17:15.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237270+0000", 2024-09-12T16:17:15.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1758e-05 2024-09-12T16:17:15.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237278+0000", 2024-09-12T16:17:15.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3219999999999993e-06 2024-09-12T16:17:15.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.395 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.395 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.395 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237334+0000", 2024-09-12T16:17:15.395 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6356e-05 2024-09-12T16:17:15.395 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.395 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.395 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:17:15.395 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237345+0000", 2024-09-12T16:17:15.395 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0433e-05 2024-09-12T16:17:15.395 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.395 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.395 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.395 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243426+0000", 2024-09-12T16:17:15.395 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.00608133 2024-09-12T16:17:15.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.396 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.396 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.396 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243534+0000", 2024-09-12T16:17:15.396 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010784 2024-09-12T16:17:15.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.396 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.396 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.396 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243629+0000", 2024-09-12T16:17:15.396 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4735999999999996e-05 2024-09-12T16:17:15.396 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.396 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.396 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.396 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.397 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5328.0:2542 3.16 3:6928f3a1:::rbd_object_map.11551722dd77:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:15.397 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:17:15.397 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 3.2490958490000001, 2024-09-12T16:17:15.397 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.054219934999999997, 2024-09-12T16:17:15.397 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.397 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.397 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:15.397 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.397 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5328", 2024-09-12T16:17:15.397 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:15.397 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2542 2024-09-12T16:17:15.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.397 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.398 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.398 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:17:15.398 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.398 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.398 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:17:15.398 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.398 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.399 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055597+0000", 2024-09-12T16:17:15.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4300000000000001e-07 2024-09-12T16:17:15.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.399 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.399 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.399 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055602+0000", 2024-09-12T16:17:15.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4269999999999999e-06 2024-09-12T16:17:15.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.399 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.399 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.399 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055613+0000", 2024-09-12T16:17:15.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0815000000000001e-05 2024-09-12T16:17:15.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.400 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.400 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.400 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055621+0000", 2024-09-12T16:17:15.400 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4189999999999996e-06 2024-09-12T16:17:15.400 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.400 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.400 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.400 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102196+0000", 2024-09-12T16:17:15.400 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.046575616 2024-09-12T16:17:15.400 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.400 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.400 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.401 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102258+0000", 2024-09-12T16:17:15.401 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1872000000000007e-05 2024-09-12T16:17:15.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.401 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.401 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T16:17:15.401 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102601+0000", 2024-09-12T16:17:15.401 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034285700000000001 2024-09-12T16:17:15.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.401 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.401 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:15.401 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.104431+0000", 2024-09-12T16:17:15.401 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001830524 2024-09-12T16:17:15.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.402 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:17:15.402 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109733+0000", 2024-09-12T16:17:15.402 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0053020089999999999 2024-09-12T16:17:15.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.402 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:15.402 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109777+0000", 2024-09-12T16:17:15.402 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3754000000000002e-05 2024-09-12T16:17:15.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.402 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.402 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109816+0000", 2024-09-12T16:17:15.403 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8699000000000003e-05 2024-09-12T16:17:15.403 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.403 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.403 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.403 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.403 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5328.0:2543 3.16 3:6928f3a1:::rbd_object_map.11551722dd77:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:15.403 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:17:15.403 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 3.2485018700000001, 2024-09-12T16:17:15.403 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053695720000000002, 2024-09-12T16:17:15.403 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.403 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.403 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:15.403 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.404 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5328", 2024-09-12T16:17:15.404 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:15.404 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2543 2024-09-12T16:17:15.404 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.404 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.404 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.404 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.404 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:17:15.404 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.404 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.404 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.404 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.404 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:17:15.404 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.404 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.405 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.405 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.405 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056191+0000", 2024-09-12T16:17:15.405 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.54e-07 2024-09-12T16:17:15.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.405 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.405 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.405 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056195+0000", 2024-09-12T16:17:15.405 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5460000000000002e-06 2024-09-12T16:17:15.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.405 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.405 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.405 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056205+0000", 2024-09-12T16:17:15.405 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7350000000000008e-06 2024-09-12T16:17:15.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.406 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056214+0000", 2024-09-12T16:17:15.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8089999999999999e-06 2024-09-12T16:17:15.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.406 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103317+0000", 2024-09-12T16:17:15.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.047102889000000002 2024-09-12T16:17:15.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.406 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103410+0000", 2024-09-12T16:17:15.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3689000000000004e-05 2024-09-12T16:17:15.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.407 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T16:17:15.407 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103754+0000", 2024-09-12T16:17:15.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034344699999999998 2024-09-12T16:17:15.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.407 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:15.407 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.106487+0000", 2024-09-12T16:17:15.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0027330100000000001 2024-09-12T16:17:15.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.407 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:17:15.407 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109827+0000", 2024-09-12T16:17:15.408 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033406640000000001 2024-09-12T16:17:15.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.408 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.408 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:15.408 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109854+0000", 2024-09-12T16:17:15.408 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6866999999999999e-05 2024-09-12T16:17:15.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.408 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.408 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.408 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109886+0000", 2024-09-12T16:17:15.408 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1309999999999997e-05 2024-09-12T16:17:15.408 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.409 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.409 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.409 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.409 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.409 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:15.410 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #23, image image_client.0-clone23 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent24 2024-09-12T16:17:15.411 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:17:15.411 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:15.409+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:15.423 INFO:teuthology.orchestra.run.smithi204.stdout:3917 read 0x3c5e00 thru 0x3d5795 (0xf996 bytes) 2024-09-12T16:17:15.426 INFO:teuthology.orchestra.run.smithi204.stdout:3921 read 0x2a90200 thru 0x2a9b133 (0xaf34 bytes) 2024-09-12T16:17:15.426 INFO:teuthology.orchestra.run.smithi204.stdout:3924 read 0x130c000 thru 0x1312b1e (0x6b1f bytes) 2024-09-12T16:17:15.426 INFO:teuthology.orchestra.run.smithi204.stdout:3925 punch from 0x24dac00 to 0x24e9000, (0xe400 bytes) 2024-09-12T16:17:15.434 INFO:teuthology.orchestra.run.smithi204.stdout:3926 read 0x221f600 thru 0x2225180 (0x5b81 bytes) 2024-09-12T16:17:15.434 INFO:teuthology.orchestra.run.smithi204.stdout:3927 write 0x496ae00 thru 0x4971838 (0x6a39 bytes) 2024-09-12T16:17:15.436 INFO:teuthology.orchestra.run.smithi204.stdout:3928 trunc from 0x4f48800 to 0x6f53a00 2024-09-12T16:17:15.468 INFO:teuthology.orchestra.run.smithi204.stdout:3936 write 0xd775c00 thru 0xd77fc2b (0xa02c bytes) 2024-09-12T16:17:15.475 INFO:teuthology.orchestra.run.smithi204.stdout:3938 write 0xea6000 thru 0xea960c (0x360d bytes) 2024-09-12T16:17:15.476 INFO:teuthology.orchestra.run.smithi204.stdout:3943 punch from 0x5f62200 to 0x5f69000, (0x6e00 bytes) 2024-09-12T16:17:15.476 INFO:teuthology.orchestra.run.smithi204.stdout:3945 write 0xc928400 thru 0xc92a5d3 (0x21d4 bytes) 2024-09-12T16:17:15.481 INFO:teuthology.orchestra.run.smithi204.stdout:3947 trunc from 0xd77fe00 to 0x950ba00 2024-09-12T16:17:15.510 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:15.509+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:15.535 INFO:teuthology.orchestra.run.smithi204.stdout:3951 trunc from 0x950ba00 to 0x6c1200 2024-09-12T16:17:15.573 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:15.573 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:15.573 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:17:15.573 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:15.581 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:17:15.587 INFO:teuthology.orchestra.run.smithi204.stdout:3953 write 0x423de00 thru 0x424875a (0xa95b bytes) 2024-09-12T16:17:15.589 INFO:teuthology.orchestra.run.smithi204.stdout:3956 read 0x2e22000 thru 0x2e31c17 (0xfc18 bytes) 2024-09-12T16:17:15.589 INFO:teuthology.orchestra.run.smithi204.stdout:3957 write 0x194e000 thru 0x19540c1 (0x60c2 bytes) 2024-09-12T16:17:15.589 INFO:teuthology.orchestra.run.smithi204.stdout:3958 punch from 0x3f1e000 to 0x3f2ca00, (0xea00 bytes) 2024-09-12T16:17:15.590 INFO:teuthology.orchestra.run.smithi204.stdout:3959 read 0x62a600 thru 0x6354e1 (0xaee2 bytes) 2024-09-12T16:17:15.601 INFO:teuthology.orchestra.run.smithi204.stdout:3960 trunc from 0x4248800 to 0x9594600 2024-09-12T16:17:15.612 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:15.611+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:15.624 INFO:teuthology.orchestra.run.smithi204.stdout:3961 write 0xc1c1000 thru 0xc1ce7a5 (0xd7a6 bytes) 2024-09-12T16:17:15.633 INFO:teuthology.orchestra.run.smithi204.stdout:3962 write 0xf91e00 thru 0xf9c495 (0xa696 bytes) 2024-09-12T16:17:15.633 INFO:teuthology.orchestra.run.smithi204.stdout:3966 read 0x209e200 thru 0x209f141 (0xf42 bytes) 2024-09-12T16:17:15.633 INFO:teuthology.orchestra.run.smithi204.stdout:3969 read 0x3383800 thru 0x339181d (0xe01e bytes) 2024-09-12T16:17:15.639 INFO:teuthology.orchestra.run.smithi204.stdout:3970 trunc from 0xc1ce800 to 0x72d6800 2024-09-12T16:17:15.701 INFO:teuthology.orchestra.run.smithi204.stdout:3971 write 0x9271c00 thru 0x9281b48 (0xff49 bytes) 2024-09-12T16:17:15.713 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:15.712+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:15.719 INFO:teuthology.orchestra.run.smithi204.stdout:3972 write 0xc50d600 thru 0xc516150 (0x8b51 bytes) 2024-09-12T16:17:15.721 INFO:teuthology.orchestra.run.smithi204.stdout:3975 read 0x9778000 thru 0x977f1b4 (0x71b5 bytes) 2024-09-12T16:17:15.729 INFO:teuthology.orchestra.run.smithi204.stdout:3978 trunc from 0xc516200 to 0x5535e00 2024-09-12T16:17:15.742 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:15.742 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:15.742 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:17:15.742 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:17:15.742 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:15.751 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:17:15.766 INFO:teuthology.orchestra.run.smithi204.stdout:3979 read 0x1db9800 thru 0x1db9cbd (0x4be bytes) 2024-09-12T16:17:15.766 INFO:teuthology.orchestra.run.smithi204.stdout:3980 write 0x1839000 thru 0x1841544 (0x8545 bytes) 2024-09-12T16:17:15.766 INFO:teuthology.orchestra.run.smithi204.stdout:3981 clone 26 order 18 su 32768 sc 9 2024-09-12T16:17:15.835 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:15.834+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:15.902 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:15.902 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:17:15.903 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:17:15.903 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:17:15.903 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.903 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5599 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4788224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:15.903 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:17:15.903 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 35.604784754000001, 2024-09-12T16:17:15.903 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061192059, 2024-09-12T16:17:15.903 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.903 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.903 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:15.903 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.903 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:15.903 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:15.904 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5599 2024-09-12T16:17:15.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.904 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.904 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.904 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.904 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:17:15.904 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.904 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.904 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.904 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:17:15.904 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.905 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.905 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.905 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296333+0000", 2024-09-12T16:17:15.905 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6599999999999996e-07 2024-09-12T16:17:15.905 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.905 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.905 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.905 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296335+0000", 2024-09-12T16:17:15.905 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5900000000000002e-06 2024-09-12T16:17:15.905 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.905 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.905 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.905 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296344+0000", 2024-09-12T16:17:15.906 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9539999999999993e-06 2024-09-12T16:17:15.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.906 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.906 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.906 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296350+0000", 2024-09-12T16:17:15.906 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5589999999999996e-06 2024-09-12T16:17:15.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.906 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.906 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.906 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357307+0000", 2024-09-12T16:17:15.906 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.060957573000000001 2024-09-12T16:17:15.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.906 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.906 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.907 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357401+0000", 2024-09-12T16:17:15.907 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3512999999999997e-05 2024-09-12T16:17:15.907 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.907 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.907 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.907 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357524+0000", 2024-09-12T16:17:15.907 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000123304 2024-09-12T16:17:15.907 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.907 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.907 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.907 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.907 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.907 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5611 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4730880~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:15.908 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:17:15.908 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 35.60472231, 2024-09-12T16:17:15.908 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061359348000000001, 2024-09-12T16:17:15.908 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.908 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.908 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:15.908 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.908 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:15.908 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:15.908 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5611 2024-09-12T16:17:15.908 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.908 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.908 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.909 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.909 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:17:15.909 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.909 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.909 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.909 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.909 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:17:15.909 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.909 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.909 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.909 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.909 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296395+0000", 2024-09-12T16:17:15.909 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4600000000000003e-07 2024-09-12T16:17:15.910 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.910 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.910 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.910 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296399+0000", 2024-09-12T16:17:15.910 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9430000000000002e-06 2024-09-12T16:17:15.910 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.910 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.910 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.910 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296411+0000", 2024-09-12T16:17:15.910 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1755e-05 2024-09-12T16:17:15.910 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.910 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.910 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.911 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296417+0000", 2024-09-12T16:17:15.911 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3790000000000003e-06 2024-09-12T16:17:15.911 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.911 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.911 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.911 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357572+0000", 2024-09-12T16:17:15.911 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061154871 2024-09-12T16:17:15.911 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.911 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.911 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.911 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357663+0000", 2024-09-12T16:17:15.911 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0389999999999993e-05 2024-09-12T16:17:15.911 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.912 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.912 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.912 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357754+0000", 2024-09-12T16:17:15.912 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1063999999999994e-05 2024-09-12T16:17:15.912 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.912 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.912 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.912 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.912 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5613 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4775936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:15.912 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:15.912 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 35.604681130000003, 2024-09-12T16:17:15.913 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061491777999999997, 2024-09-12T16:17:15.913 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.913 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.913 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:15.913 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.913 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:15.913 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:15.913 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5613 2024-09-12T16:17:15.913 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.913 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.913 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.913 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.913 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:15.914 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.914 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.914 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:15.914 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.914 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.914 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:15.914 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8899999999999999e-07 2024-09-12T16:17:15.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.914 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.915 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296439+0000", 2024-09-12T16:17:15.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8439999999999998e-06 2024-09-12T16:17:15.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.915 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.915 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296452+0000", 2024-09-12T16:17:15.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2639e-05 2024-09-12T16:17:15.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.915 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.915 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296457+0000", 2024-09-12T16:17:15.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5720000000000002e-06 2024-09-12T16:17:15.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.916 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.916 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357773+0000", 2024-09-12T16:17:15.916 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061315500000000002 2024-09-12T16:17:15.916 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.916 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.916 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.916 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357814+0000", 2024-09-12T16:17:15.916 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1448e-05 2024-09-12T16:17:15.916 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.916 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.916 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.916 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357927+0000", 2024-09-12T16:17:15.916 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000113186 2024-09-12T16:17:15.916 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.917 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.917 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.917 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.917 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.917 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5616 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4784128~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:15.917 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:15.917 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 35.604646068000001, 2024-09-12T16:17:15.917 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061725002000000001, 2024-09-12T16:17:15.917 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.917 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.917 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:15.918 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.918 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:15.918 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:15.918 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5616 2024-09-12T16:17:15.918 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.918 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.918 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.918 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.918 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:15.918 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.918 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.918 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.918 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.918 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:15.919 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.919 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.919 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.919 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.919 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:15.919 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5900000000000002e-07 2024-09-12T16:17:15.919 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.919 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.919 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.919 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296473+0000", 2024-09-12T16:17:15.919 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3130000000000001e-06 2024-09-12T16:17:15.919 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.919 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.920 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.920 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296481+0000", 2024-09-12T16:17:15.920 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1389999999999998e-06 2024-09-12T16:17:15.920 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.920 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.920 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.920 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296486+0000", 2024-09-12T16:17:15.920 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3310000000000003e-06 2024-09-12T16:17:15.920 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.920 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.920 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.920 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357981+0000", 2024-09-12T16:17:15.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061494866000000002 2024-09-12T16:17:15.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358082+0000", 2024-09-12T16:17:15.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101424 2024-09-12T16:17:15.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358196+0000", 2024-09-12T16:17:15.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011347 2024-09-12T16:17:15.921 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.922 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.922 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.922 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.922 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.922 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5626 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4739072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:15.922 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:17:15.922 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 35.604568112000003, 2024-09-12T16:17:15.922 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061802430999999998, 2024-09-12T16:17:15.922 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.922 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.922 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:15.922 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.923 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:15.923 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:15.923 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5626 2024-09-12T16:17:15.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.923 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.923 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.923 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.923 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:17:15.923 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.923 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.923 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.923 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:17:15.924 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.924 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.924 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.924 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.924 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296550+0000", 2024-09-12T16:17:15.924 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.215e-06 2024-09-12T16:17:15.924 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.924 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.924 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.924 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296555+0000", 2024-09-12T16:17:15.924 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9590000000000003e-06 2024-09-12T16:17:15.924 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.924 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.925 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.925 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296568+0000", 2024-09-12T16:17:15.925 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3338e-05 2024-09-12T16:17:15.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.925 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.925 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.925 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296576+0000", 2024-09-12T16:17:15.925 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5510000000000002e-06 2024-09-12T16:17:15.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.925 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.925 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.925 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358241+0000", 2024-09-12T16:17:15.925 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.06166576 2024-09-12T16:17:15.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.926 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.926 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.926 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358288+0000", 2024-09-12T16:17:15.926 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6097000000000003e-05 2024-09-12T16:17:15.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.926 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.926 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.926 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358351+0000", 2024-09-12T16:17:15.926 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3510999999999996e-05 2024-09-12T16:17:15.926 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.926 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.926 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.927 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.927 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5628 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4792320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:15.927 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:17:15.927 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 35.604525612000003, 2024-09-12T16:17:15.927 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061961161000000001, 2024-09-12T16:17:15.927 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.927 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.927 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:15.927 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.927 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:15.927 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:15.927 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5628 2024-09-12T16:17:15.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.928 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.928 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.928 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.928 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:17:15.928 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.928 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.928 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.928 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:17:15.928 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.928 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.929 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.929 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296592+0000", 2024-09-12T16:17:15.929 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2099999999999996e-07 2024-09-12T16:17:15.929 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.929 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.929 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.929 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296595+0000", 2024-09-12T16:17:15.929 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0429999999999999e-06 2024-09-12T16:17:15.929 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.929 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.929 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.929 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296603+0000", 2024-09-12T16:17:15.929 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9899999999999997e-06 2024-09-12T16:17:15.930 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.930 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.930 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.930 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296609+0000", 2024-09-12T16:17:15.930 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7259999999999999e-06 2024-09-12T16:17:15.930 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.930 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.930 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.930 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358393+0000", 2024-09-12T16:17:15.930 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061784617 2024-09-12T16:17:15.930 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.930 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.930 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.931 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358460+0000", 2024-09-12T16:17:15.931 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7253000000000001e-05 2024-09-12T16:17:15.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.931 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.931 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.931 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358552+0000", 2024-09-12T16:17:15.931 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1811000000000006e-05 2024-09-12T16:17:15.931 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.931 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.931 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.931 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.931 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5638 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4734976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:15.932 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:15.932 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 35.604053061000002, 2024-09-12T16:17:15.932 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061654460000000001, 2024-09-12T16:17:15.932 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.932 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.932 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:15.932 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.932 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:15.932 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:15.932 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5638 2024-09-12T16:17:15.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.932 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.933 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.933 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.933 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:15.933 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.933 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.933 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.933 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.933 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:15.933 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.933 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.933 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.934 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.934 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:15.934 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.23e-07 2024-09-12T16:17:15.934 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.934 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.934 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.934 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297068+0000", 2024-09-12T16:17:15.934 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0060000000000003e-06 2024-09-12T16:17:15.934 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.934 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.934 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.934 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297080+0000", 2024-09-12T16:17:15.934 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1234e-05 2024-09-12T16:17:15.934 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.935 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.935 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.935 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297095+0000", 2024-09-12T16:17:15.935 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5698000000000001e-05 2024-09-12T16:17:15.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.935 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.935 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.935 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358582+0000", 2024-09-12T16:17:15.935 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061486274 2024-09-12T16:17:15.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.935 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.935 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.935 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358637+0000", 2024-09-12T16:17:15.936 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5439999999999998e-05 2024-09-12T16:17:15.936 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.936 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.936 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.936 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358718+0000", 2024-09-12T16:17:15.936 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0984999999999998e-05 2024-09-12T16:17:15.936 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.936 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.936 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.936 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.936 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.936 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5640 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4780032~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:15.936 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:17:15.937 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 35.603971340999998, 2024-09-12T16:17:15.937 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061746620000000002, 2024-09-12T16:17:15.937 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.937 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.937 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:15.937 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.937 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:15.937 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:15.937 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5640 2024-09-12T16:17:15.937 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.937 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.937 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.937 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.938 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:17:15.938 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.938 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.938 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.938 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.938 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:17:15.938 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.938 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.938 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.938 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.938 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297146+0000", 2024-09-12T16:17:15.938 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3600000000000003e-07 2024-09-12T16:17:15.938 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.939 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.939 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.939 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297150+0000", 2024-09-12T16:17:15.939 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8430000000000003e-06 2024-09-12T16:17:15.939 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.939 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.939 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.939 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297160+0000", 2024-09-12T16:17:15.939 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7229999999999999e-06 2024-09-12T16:17:15.939 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.939 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.939 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.939 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297167+0000", 2024-09-12T16:17:15.940 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0180000000000004e-06 2024-09-12T16:17:15.940 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.940 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.940 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.940 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358750+0000", 2024-09-12T16:17:15.940 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061583104 2024-09-12T16:17:15.940 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.940 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.940 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.940 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358804+0000", 2024-09-12T16:17:15.940 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4277000000000002e-05 2024-09-12T16:17:15.940 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.940 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.941 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.941 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358892+0000", 2024-09-12T16:17:15.941 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7918999999999996e-05 2024-09-12T16:17:15.941 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.941 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.941 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.941 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.941 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.941 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5642 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4788224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:15.941 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:15.941 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 35.603926997000002, 2024-09-12T16:17:15.941 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061860409999999998, 2024-09-12T16:17:15.941 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.942 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.942 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:15.942 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.942 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:15.942 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:15.942 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5642 2024-09-12T16:17:15.942 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.942 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.942 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.942 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.942 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:15.942 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.942 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.943 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.943 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.943 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:15.943 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.943 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.943 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.943 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.943 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:15.943 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7999999999999995e-07 2024-09-12T16:17:15.943 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.943 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.943 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.943 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297193+0000", 2024-09-12T16:17:15.944 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8310000000000001e-06 2024-09-12T16:17:15.944 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.944 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.944 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.944 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297204+0000", 2024-09-12T16:17:15.944 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0832999999999999e-05 2024-09-12T16:17:15.944 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.944 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.944 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.944 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297210+0000", 2024-09-12T16:17:15.944 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1770000000000003e-06 2024-09-12T16:17:15.944 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.944 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.945 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.945 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358928+0000", 2024-09-12T16:17:15.945 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061717826000000003 2024-09-12T16:17:15.945 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.945 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.945 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.945 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358977+0000", 2024-09-12T16:17:15.945 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9514000000000001e-05 2024-09-12T16:17:15.945 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.945 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.945 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.945 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359050+0000", 2024-09-12T16:17:15.946 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2649000000000002e-05 2024-09-12T16:17:15.946 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.946 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.946 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.946 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.946 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.946 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5646 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4743168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:15.946 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:15.946 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 35.603747056000003, 2024-09-12T16:17:15.946 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061822122, 2024-09-12T16:17:15.946 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.946 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.947 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:15.947 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.947 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:15.947 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:15.947 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5646 2024-09-12T16:17:15.947 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.947 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.947 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.947 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.947 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:15.947 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.947 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.947 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.948 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.948 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:15.948 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.948 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.948 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.948 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.948 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:15.948 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3200000000000004e-07 2024-09-12T16:17:15.948 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.948 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.948 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.948 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297374+0000", 2024-09-12T16:17:15.948 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8240000000000001e-06 2024-09-12T16:17:15.948 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.949 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.949 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.949 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297384+0000", 2024-09-12T16:17:15.949 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5710000000000004e-06 2024-09-12T16:17:15.949 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.949 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.949 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.949 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297390+0000", 2024-09-12T16:17:15.949 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5130000000000002e-06 2024-09-12T16:17:15.949 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.949 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.949 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.949 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359080+0000", 2024-09-12T16:17:15.950 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061689569999999999 2024-09-12T16:17:15.950 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.950 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.950 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.950 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359134+0000", 2024-09-12T16:17:15.950 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3838999999999997e-05 2024-09-12T16:17:15.950 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.950 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.950 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.950 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359192+0000", 2024-09-12T16:17:15.950 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8072999999999998e-05 2024-09-12T16:17:15.950 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.950 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.951 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.951 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.951 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.951 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5647 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4751360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:15.951 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:17:15.951 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 35.603710370999998, 2024-09-12T16:17:15.951 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061927569000000002, 2024-09-12T16:17:15.951 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.951 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.951 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:15.951 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.951 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:15.951 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:15.952 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5647 2024-09-12T16:17:15.952 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.952 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.952 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.952 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.952 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:17:15.952 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.952 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.952 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.952 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.952 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:17:15.952 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.953 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.953 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.953 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.953 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297407+0000", 2024-09-12T16:17:15.953 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.46e-07 2024-09-12T16:17:15.953 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.953 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.953 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.953 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297409+0000", 2024-09-12T16:17:15.953 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.469e-06 2024-09-12T16:17:15.953 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.953 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.953 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.954 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297415+0000", 2024-09-12T16:17:15.954 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9259999999999997e-06 2024-09-12T16:17:15.954 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.954 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.954 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.954 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297419+0000", 2024-09-12T16:17:15.954 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3840000000000001e-06 2024-09-12T16:17:15.954 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.954 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.954 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.954 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359224+0000", 2024-09-12T16:17:15.954 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061805367999999999 2024-09-12T16:17:15.954 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.954 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.955 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.955 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359275+0000", 2024-09-12T16:17:15.955 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1338000000000002e-05 2024-09-12T16:17:15.955 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.955 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.955 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.955 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359334+0000", 2024-09-12T16:17:15.955 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8638000000000003e-05 2024-09-12T16:17:15.955 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.955 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.955 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.955 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.955 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.956 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5649 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4796416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:15.956 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:17:15.956 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 35.603655512000003, 2024-09-12T16:17:15.956 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.062018578999999997, 2024-09-12T16:17:15.956 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.956 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.956 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:15.956 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.956 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:15.956 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:15.956 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5649 2024-09-12T16:17:15.956 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.956 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.957 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.957 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.957 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:17:15.957 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.957 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.957 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.957 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.957 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:17:15.957 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.957 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.957 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.957 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.957 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297462+0000", 2024-09-12T16:17:15.958 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2399999999999998e-07 2024-09-12T16:17:15.958 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.958 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.958 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.958 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297465+0000", 2024-09-12T16:17:15.958 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.371e-06 2024-09-12T16:17:15.958 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.958 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.958 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.958 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297473+0000", 2024-09-12T16:17:15.958 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4699999999999996e-06 2024-09-12T16:17:15.958 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.958 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.959 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.959 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297478+0000", 2024-09-12T16:17:15.959 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2780000000000001e-06 2024-09-12T16:17:15.959 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.959 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.959 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.959 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359368+0000", 2024-09-12T16:17:15.959 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061889758000000003 2024-09-12T16:17:15.959 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.959 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.959 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.959 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359420+0000", 2024-09-12T16:17:15.959 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2574999999999997e-05 2024-09-12T16:17:15.960 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.960 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.960 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.960 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359480+0000", 2024-09-12T16:17:15.960 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9503000000000003e-05 2024-09-12T16:17:15.960 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.960 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.960 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.960 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.960 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.960 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5674 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4739072~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:15.960 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:17:15.960 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 35.603251743999998, 2024-09-12T16:17:15.961 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061762989999999997, 2024-09-12T16:17:15.961 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.961 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.961 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:15.961 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.961 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:15.961 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:15.961 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5674 2024-09-12T16:17:15.961 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.961 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.961 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.961 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.961 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:17:15.961 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.962 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.962 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.962 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.962 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:17:15.962 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.962 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.962 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.962 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.962 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297866+0000", 2024-09-12T16:17:15.962 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1900000000000001e-07 2024-09-12T16:17:15.962 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.962 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.962 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.962 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297870+0000", 2024-09-12T16:17:15.963 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3560000000000003e-06 2024-09-12T16:17:15.963 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.963 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.963 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.963 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297888+0000", 2024-09-12T16:17:15.963 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8088999999999999e-05 2024-09-12T16:17:15.963 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.963 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.963 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.963 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297904+0000", 2024-09-12T16:17:15.963 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5971e-05 2024-09-12T16:17:15.963 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.963 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.963 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.964 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359510+0000", 2024-09-12T16:17:15.964 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061605634999999999 2024-09-12T16:17:15.964 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.964 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.964 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.964 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359554+0000", 2024-09-12T16:17:15.964 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4024999999999999e-05 2024-09-12T16:17:15.964 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.964 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.964 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.964 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359628+0000", 2024-09-12T16:17:15.964 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4095000000000001e-05 2024-09-12T16:17:15.964 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.964 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.965 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.965 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.965 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.965 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5676 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4792320~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:15.965 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:17:15.965 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 35.603050664000001, 2024-09-12T16:17:15.965 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061720143999999998, 2024-09-12T16:17:15.965 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.965 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.965 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:15.965 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.965 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:15.965 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:15.966 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5676 2024-09-12T16:17:15.966 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.966 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.966 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.966 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.966 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:17:15.966 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.966 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.966 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.966 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.966 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:17:15.966 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.966 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.967 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.967 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.967 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298067+0000", 2024-09-12T16:17:15.967 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8199999999999999e-07 2024-09-12T16:17:15.967 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.967 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.967 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.967 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298070+0000", 2024-09-12T16:17:15.967 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.743e-06 2024-09-12T16:17:15.967 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.967 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.967 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.968 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298080+0000", 2024-09-12T16:17:15.968 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4059999999999994e-06 2024-09-12T16:17:15.968 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.968 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.968 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.968 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298088+0000", 2024-09-12T16:17:15.968 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0779999999999996e-06 2024-09-12T16:17:15.968 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.968 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.968 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.968 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359659+0000", 2024-09-12T16:17:15.968 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061570688999999998 2024-09-12T16:17:15.968 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.969 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.969 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.969 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359713+0000", 2024-09-12T16:17:15.969 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3939e-05 2024-09-12T16:17:15.969 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.969 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.969 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.969 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359786+0000", 2024-09-12T16:17:15.969 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3607000000000002e-05 2024-09-12T16:17:15.969 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.969 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.969 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.970 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.970 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.970 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5684 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4747264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:15.970 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:17:15.970 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 35.602583371999998, 2024-09-12T16:17:15.970 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061394799, 2024-09-12T16:17:15.970 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.970 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.970 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:15.970 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.970 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:15.970 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:15.970 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5684 2024-09-12T16:17:15.971 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.971 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.971 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.971 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.971 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:17:15.971 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.971 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.971 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.971 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.971 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:17:15.971 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.971 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.971 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.972 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.972 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298534+0000", 2024-09-12T16:17:15.972 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4399999999999999e-07 2024-09-12T16:17:15.972 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.972 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.972 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.972 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298539+0000", 2024-09-12T16:17:15.972 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5360000000000003e-06 2024-09-12T16:17:15.972 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.972 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.972 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.973 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298550+0000", 2024-09-12T16:17:15.973 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1499e-05 2024-09-12T16:17:15.973 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.973 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.973 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.973 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298558+0000", 2024-09-12T16:17:15.973 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3000000000000004e-06 2024-09-12T16:17:15.973 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.973 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.973 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.973 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359815+0000", 2024-09-12T16:17:15.973 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061257952999999997 2024-09-12T16:17:15.973 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.974 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.974 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.974 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359868+0000", 2024-09-12T16:17:15.974 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2317000000000001e-05 2024-09-12T16:17:15.974 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.974 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.974 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.974 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359928+0000", 2024-09-12T16:17:15.974 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0350000000000003e-05 2024-09-12T16:17:15.974 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.974 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.974 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.976 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.976 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.976 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5686 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4755456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:15.976 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:17:15.976 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 35.602415948000001, 2024-09-12T16:17:15.976 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061355082999999998, 2024-09-12T16:17:15.976 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.976 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.976 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:15.976 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.976 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:15.977 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:15.977 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5686 2024-09-12T16:17:15.977 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.977 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.977 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.977 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.977 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:17:15.977 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.977 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.977 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.977 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.977 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:17:15.978 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.978 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.978 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.978 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.978 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298702+0000", 2024-09-12T16:17:15.978 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2399999999999997e-07 2024-09-12T16:17:15.978 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.978 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.978 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.978 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298706+0000", 2024-09-12T16:17:15.978 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5700000000000003e-06 2024-09-12T16:17:15.978 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.978 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.978 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.978 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298718+0000", 2024-09-12T16:17:15.979 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1457999999999999e-05 2024-09-12T16:17:15.979 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.979 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.979 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.979 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298732+0000", 2024-09-12T16:17:15.979 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.452e-05 2024-09-12T16:17:15.979 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.979 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.979 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.979 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359956+0000", 2024-09-12T16:17:15.979 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061223626000000003 2024-09-12T16:17:15.979 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.980 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.980 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.980 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360000+0000", 2024-09-12T16:17:15.980 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3922999999999999e-05 2024-09-12T16:17:15.980 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.980 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.980 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.980 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360056+0000", 2024-09-12T16:17:15.980 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6162000000000002e-05 2024-09-12T16:17:15.980 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.980 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.980 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.980 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.980 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.981 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5688 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4800512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:15.981 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:17:15.981 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 35.602192895000002, 2024-09-12T16:17:15.981 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061270514999999998, 2024-09-12T16:17:15.981 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.981 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.981 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:15.981 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.981 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:15.981 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:15.981 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5688 2024-09-12T16:17:15.981 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.981 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.982 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.982 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.982 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:17:15.982 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.982 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.982 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.982 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.982 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:17:15.982 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.982 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.982 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.982 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.982 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298925+0000", 2024-09-12T16:17:15.982 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4e-07 2024-09-12T16:17:15.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.983 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.983 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.983 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298929+0000", 2024-09-12T16:17:15.983 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9890000000000003e-06 2024-09-12T16:17:15.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.983 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.983 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.983 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298936+0000", 2024-09-12T16:17:15.983 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.52e-06 2024-09-12T16:17:15.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.983 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.983 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.984 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298941+0000", 2024-09-12T16:17:15.984 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4800000000000003e-06 2024-09-12T16:17:15.984 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.984 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.984 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.984 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360087+0000", 2024-09-12T16:17:15.984 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061146143 2024-09-12T16:17:15.984 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.984 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.984 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.984 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360137+0000", 2024-09-12T16:17:15.984 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0584000000000002e-05 2024-09-12T16:17:15.984 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.985 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.985 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.985 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360194+0000", 2024-09-12T16:17:15.985 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6858999999999999e-05 2024-09-12T16:17:15.985 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.985 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.985 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.985 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.985 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.985 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5693 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4751360~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:15.985 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:17:15.985 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 35.601771257999999, 2024-09-12T16:17:15.985 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061139444000000001, 2024-09-12T16:17:15.985 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.986 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.986 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:15.986 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.986 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:15.986 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:15.986 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5693 2024-09-12T16:17:15.986 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.986 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.986 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.986 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.986 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:17:15.986 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.987 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.987 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.987 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.987 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:17:15.987 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.987 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.987 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.987 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.987 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299346+0000", 2024-09-12T16:17:15.987 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2300000000000001e-07 2024-09-12T16:17:15.987 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.987 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.987 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.988 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299349+0000", 2024-09-12T16:17:15.988 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5270000000000001e-06 2024-09-12T16:17:15.988 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.988 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.988 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.988 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299358+0000", 2024-09-12T16:17:15.988 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7030000000000001e-06 2024-09-12T16:17:15.988 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.988 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.988 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.988 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299364+0000", 2024-09-12T16:17:15.988 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7239999999999997e-06 2024-09-12T16:17:15.989 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.989 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.989 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.989 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360369+0000", 2024-09-12T16:17:15.989 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061004713000000002 2024-09-12T16:17:15.989 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.989 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.989 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.989 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360415+0000", 2024-09-12T16:17:15.989 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5926e-05 2024-09-12T16:17:15.989 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.989 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.989 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.990 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360485+0000", 2024-09-12T16:17:15.990 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0327999999999995e-05 2024-09-12T16:17:15.990 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.990 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.990 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.990 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.990 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.990 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5694 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4796416~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:15.990 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:17:15.990 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 35.601742229000003, 2024-09-12T16:17:15.990 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061258034000000003, 2024-09-12T16:17:15.990 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.990 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.990 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:15.991 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.991 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:15.991 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:15.991 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5694 2024-09-12T16:17:15.991 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.991 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.991 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.991 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.991 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:17:15.991 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.991 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.991 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.991 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.992 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:17:15.992 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.992 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.992 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.992 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.992 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301884+0000", 2024-09-12T16:17:15.992 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025090379999999999 2024-09-12T16:17:15.992 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.992 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.992 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.992 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301889+0000", 2024-09-12T16:17:15.992 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5879999999999997e-06 2024-09-12T16:17:15.992 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.993 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.993 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.993 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301901+0000", 2024-09-12T16:17:15.993 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1466e-05 2024-09-12T16:17:15.993 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.993 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.993 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.993 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301908+0000", 2024-09-12T16:17:15.993 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1999999999999997e-06 2024-09-12T16:17:15.993 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.993 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.993 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.994 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360513+0000", 2024-09-12T16:17:15.994 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.058605023999999999 2024-09-12T16:17:15.994 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.994 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.994 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.994 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360562+0000", 2024-09-12T16:17:15.994 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9546000000000003e-05 2024-09-12T16:17:15.994 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.994 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.994 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.994 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360633+0000", 2024-09-12T16:17:15.994 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0172000000000005e-05 2024-09-12T16:17:15.994 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.995 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.995 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.995 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.995 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.995 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5759 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4767744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:15.995 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:17:15.995 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 35.598948694999997, 2024-09-12T16:17:15.995 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061058604000000002, 2024-09-12T16:17:15.995 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:15.995 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:15.995 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:15.995 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:15.995 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:15.995 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:15.996 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5759 2024-09-12T16:17:15.996 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.996 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:15.996 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.996 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:15.996 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:17:15.996 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.996 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.996 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.996 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:15.996 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:17:15.996 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:15.996 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.997 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.997 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:15.997 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302548+0000", 2024-09-12T16:17:15.997 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00038011000000000002 2024-09-12T16:17:15.997 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.997 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.997 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:15.997 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302553+0000", 2024-09-12T16:17:15.997 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1830000000000002e-06 2024-09-12T16:17:15.997 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.997 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.997 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:15.997 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302564+0000", 2024-09-12T16:17:15.998 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1011e-05 2024-09-12T16:17:15.998 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.998 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.998 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:15.998 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302572+0000", 2024-09-12T16:17:15.998 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9009999999999994e-06 2024-09-12T16:17:15.998 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.998 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.998 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:15.998 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363102+0000", 2024-09-12T16:17:15.998 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.060529782999999997 2024-09-12T16:17:15.998 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.998 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.998 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:15.998 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363149+0000", 2024-09-12T16:17:15.999 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7321000000000003e-05 2024-09-12T16:17:15.999 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:15.999 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:15.999 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:15.999 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363227+0000", 2024-09-12T16:17:15.999 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7294999999999998e-05 2024-09-12T16:17:15.999 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.999 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.999 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.999 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:15.999 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:15.999 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:16.001 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:17:16.001 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:15.999+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:16.101 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:16.100+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:16.149 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:16.149 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:16.149 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:17:16.149 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:16.157 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:17:16.202 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:16.200+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:16.264 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:16.265 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:16.265 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:17:16.265 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:17:16.265 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:16.275 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:17:16.280 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T16:17:16.317 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:16.316+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:16.350 INFO:teuthology.orchestra.run.smithi204.stdout:truncating image image_client.0-clone25 from 0x5535e00 (overlap 0x6c1200) to 0x40d600 2024-09-12T16:17:16.404 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:16.403+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:16.437 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:16.437 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:17:16.437 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:17:16.437 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:17:16.438 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.438 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.17 73/72 [PushOp(3:edb83cf9:::rbd_data.1155e1e6c0d8.0000000000000007:d, version: 47'343, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:edb83cf9:::rbd_data.1155e1e6c0d8.0000000000000007:d@47'343, size: 2064384, copy_subset: [(0, 2064384)], clone_subset: {}, snapset: d=[]:{d: [d]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T16:17:16.438 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.057473+0000", 2024-09-12T16:17:16.438 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.377642241, 2024-09-12T16:17:16.438 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017021130000000001, 2024-09-12T16:17:16.438 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:16.438 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:16.438 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:16.438 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:16.438 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.438 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:16.439 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.057473+0000", 2024-09-12T16:17:16.439 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.439 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.439 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.439 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:16.439 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.057473+0000", 2024-09-12T16:17:16.439 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.439 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.439 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.439 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:16.439 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.057474+0000", 2024-09-12T16:17:16.439 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3e-07 2024-09-12T16:17:16.440 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.440 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.440 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:16.440 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.058406+0000", 2024-09-12T16:17:16.440 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00093254899999999996 2024-09-12T16:17:16.440 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.440 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.440 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:16.440 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.058423+0000", 2024-09-12T16:17:16.440 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6656000000000001e-05 2024-09-12T16:17:16.440 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.440 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.440 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:16.441 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.058433+0000", 2024-09-12T16:17:16.441 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0349e-05 2024-09-12T16:17:16.441 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.441 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.441 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:16.441 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.058516+0000", 2024-09-12T16:17:16.441 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2386999999999996e-05 2024-09-12T16:17:16.441 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.441 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.441 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:16.441 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.058524+0000", 2024-09-12T16:17:16.441 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3960000000000006e-06 2024-09-12T16:17:16.441 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.442 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.442 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:16.442 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.059175+0000", 2024-09-12T16:17:16.442 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00065114600000000002 2024-09-12T16:17:16.442 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.442 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:16.442 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.442 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.442 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.442 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.17 73/72 [PushOp(3:e9340267:::rbd_data.1155525b14e3.0000000000000031:f, version: 50'357, data_included: [0~4096,20480~4096,40960~8192,65536~4096,81920~8192,110592~4096,126976~8192,151552~4096,172032~8192,196608~4096,212992~8192,241664~4096,258048~8192,282624~4096,303104~8192,327680~4096,344064~8192,372736~4096,389120~8192,413696~4096,434176~8192,458752~4096,475136~8192,503808~4096,520192~8192,544768~4096,565248~8192,589824~4096,606208~8192,634880~4096,651264~8192,675840~4096,696320~8192,720896~4096,737280~8192,765952~4096,782336~8192,806912~4096,827392~8192,851968~4096,868352~8192,897024~4096,913408~8192,937984~4096,958464~8192,983040~4096,999424~8192,1028096~4096,1044480~4096], data_size: 294912, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:e9340267:::rbd_data.1155525b14e3.0000000000000031:f@50'357, size: 1048576, copy_subset: [(0, 1048576)], clone_subset: {}, snapset: f=[]:{f: [f]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T16:17:16.442 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.067448+0000", 2024-09-12T16:17:16.442 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.367667082000001, 2024-09-12T16:17:16.442 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003036721, 2024-09-12T16:17:16.442 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:16.443 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:16.443 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:16.443 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:16.443 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.443 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:16.443 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067448+0000", 2024-09-12T16:17:16.443 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.443 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.443 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.443 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:16.443 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067448+0000", 2024-09-12T16:17:16.443 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.443 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.443 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.444 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:16.444 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067449+0000", 2024-09-12T16:17:16.444 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2200000000000004e-07 2024-09-12T16:17:16.444 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.444 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.444 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:16.444 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067703+0000", 2024-09-12T16:17:16.444 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025377199999999998 2024-09-12T16:17:16.444 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.444 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.444 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:16.444 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067723+0000", 2024-09-12T16:17:16.444 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.986e-05 2024-09-12T16:17:16.445 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.445 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.445 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:16.445 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067743+0000", 2024-09-12T16:17:16.445 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9942e-05 2024-09-12T16:17:16.445 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.445 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.445 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:16.445 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067860+0000", 2024-09-12T16:17:16.445 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000116959 2024-09-12T16:17:16.446 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.446 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.446 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:16.446 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067872+0000", 2024-09-12T16:17:16.446 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2928000000000001e-05 2024-09-12T16:17:16.446 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.446 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.446 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:16.446 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.070485+0000", 2024-09-12T16:17:16.446 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0026127379999999999 2024-09-12T16:17:16.446 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.446 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:16.446 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.447 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.447 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.447 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.17 73/72 [PushOp(3:eaf8fb13:::rbd_data.1155972f715b.0000000000000009:16, version: 69'415, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:eaf8fb13:::rbd_data.1155972f715b.0000000000000009:16@69'415, size: 15466496, copy_subset: [(0, 15466496)], clone_subset: {}, snapset: 16=[]:{16: [16]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T16:17:16.447 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.110999+0000", 2024-09-12T16:17:16.447 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.324116868000001, 2024-09-12T16:17:16.447 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001744827, 2024-09-12T16:17:16.447 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:16.447 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:16.447 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:16.447 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:16.447 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.447 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:16.447 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.110999+0000", 2024-09-12T16:17:16.447 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.447 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.448 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.448 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:16.448 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.110999+0000", 2024-09-12T16:17:16.448 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.448 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.448 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.448 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:16.448 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.110999+0000", 2024-09-12T16:17:16.448 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2699999999999999e-07 2024-09-12T16:17:16.448 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.448 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.448 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:16.448 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.112026+0000", 2024-09-12T16:17:16.448 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001026424 2024-09-12T16:17:16.449 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.449 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.449 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:16.449 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.112041+0000", 2024-09-12T16:17:16.449 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5599000000000001e-05 2024-09-12T16:17:16.449 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.449 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.449 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:16.449 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.112052+0000", 2024-09-12T16:17:16.449 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0481e-05 2024-09-12T16:17:16.449 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.449 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.449 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:16.449 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.112117+0000", 2024-09-12T16:17:16.450 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5395999999999995e-05 2024-09-12T16:17:16.450 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.450 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.450 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:16.450 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.112125+0000", 2024-09-12T16:17:16.450 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0730000000000005e-06 2024-09-12T16:17:16.450 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.450 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.450 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:16.450 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.112744+0000", 2024-09-12T16:17:16.450 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00061822699999999995 2024-09-12T16:17:16.450 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.450 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:16.451 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.451 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.451 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.451 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.1d 73/72 [PushOp(3:b81abef1:::rbd_data.1155525b14e3.0000000000000032:f, version: 50'956, data_included: [0~4096,20480~4096,40960~4096,65536~4096,81920~8192,126976~8192,151552~4096,172032~4096,196608~4096,212992~8192,258048~8192,282624~4096,303104~4096,327680~4096,344064~8192,389120~8192,413696~4096,434176~4096,458752~4096,475136~8192,520192~8192,544768~4096,565248~4096,589824~4096,606208~8192,651264~8192,675840~4096,696320~4096,720896~4096,737280~8192,782336~8192,806912~4096,827392~4096,851968~4096,868352~8192,913408~8192,937984~4096,958464~4096,983040~4096,999424~8192,1044480~4096], data_size: 229376, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:b81abef1:::rbd_data.1155525b14e3.0000000000000032:f@50'956, size: 1048576, copy_subset: [(0, 1048576)], clone_subset: {}, snapset: f=[]:{f: [f]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T16:17:16.451 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.169142+0000", 2024-09-12T16:17:16.451 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.265973776999999, 2024-09-12T16:17:16.451 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025628640000000002, 2024-09-12T16:17:16.451 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:16.451 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:16.451 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:16.451 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:16.451 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.451 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:16.451 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.169142+0000", 2024-09-12T16:17:16.452 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.452 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.452 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.452 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:16.452 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.169142+0000", 2024-09-12T16:17:16.452 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.452 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.452 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.452 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:16.452 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.169142+0000", 2024-09-12T16:17:16.452 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1799999999999995e-07 2024-09-12T16:17:16.452 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.452 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.452 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:16.452 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.169263+0000", 2024-09-12T16:17:16.453 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000120897 2024-09-12T16:17:16.453 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.453 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.453 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:16.453 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.169292+0000", 2024-09-12T16:17:16.453 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8357999999999999e-05 2024-09-12T16:17:16.453 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.453 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.453 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:16.453 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.169312+0000", 2024-09-12T16:17:16.453 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0239999999999999e-05 2024-09-12T16:17:16.453 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.453 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.453 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:16.453 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.169425+0000", 2024-09-12T16:17:16.454 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000113336 2024-09-12T16:17:16.454 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.454 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.454 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:16.454 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.169438+0000", 2024-09-12T16:17:16.454 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3185e-05 2024-09-12T16:17:16.454 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.454 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.454 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:16.454 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.171705+0000", 2024-09-12T16:17:16.454 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0022662300000000002 2024-09-12T16:17:16.454 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.454 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:16.454 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.454 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.454 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.455 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.16 74/72 [PushOp(3:68db2424:::rbd_data.1155525b14e3.000000000000002a:f, version: 50'736, data_included: [0~352256,368640~4096,385024~12288,413696~4096,430080~8192,458752~4096,471040~12288,499712~4096,516096~12288,544768~4096,561152~8192,589824~4096,602112~12288,630784~4096,647168~12288,675840~4096,692224~8192,720896~4096,733184~12288,761856~4096,778240~12288,806912~4096,823296~8192,851968~4096,868352~8192,892928~4096,913408~8192,937984~4096,958464~4096,983040~4096,999424~8192,1024000~4096,1044480~4096], data_size: 569344, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:68db2424:::rbd_data.1155525b14e3.000000000000002a:f@50'736, size: 1048576, copy_subset: [(0, 1048576)], clone_subset: {}, snapset: f=[]:{f: [f]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T16:17:16.455 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.264309+0000", 2024-09-12T16:17:16.455 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.170806158, 2024-09-12T16:17:16.455 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025728819999999999, 2024-09-12T16:17:16.455 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:16.455 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:16.455 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:16.456 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:16.456 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.456 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:16.456 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.264309+0000", 2024-09-12T16:17:16.456 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.456 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.456 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.456 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:16.456 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.264309+0000", 2024-09-12T16:17:16.456 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.457 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.457 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.457 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:16.457 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.264310+0000", 2024-09-12T16:17:16.457 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5499999999999998e-07 2024-09-12T16:17:16.457 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.457 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.457 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:16.457 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.264565+0000", 2024-09-12T16:17:16.457 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025476399999999999 2024-09-12T16:17:16.457 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.457 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.458 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:16.458 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.264584+0000", 2024-09-12T16:17:16.458 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9349999999999999e-05 2024-09-12T16:17:16.458 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.458 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.458 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:16.458 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.264602+0000", 2024-09-12T16:17:16.458 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8173e-05 2024-09-12T16:17:16.458 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.458 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.458 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:16.458 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.264690+0000", 2024-09-12T16:17:16.458 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7403000000000003e-05 2024-09-12T16:17:16.458 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.458 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.459 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:16.459 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.264701+0000", 2024-09-12T16:17:16.459 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1566000000000001e-05 2024-09-12T16:17:16.459 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.459 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.459 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:16.459 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.266882+0000", 2024-09-12T16:17:16.459 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0021810710000000001 2024-09-12T16:17:16.459 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.459 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:16.459 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.459 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.459 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.460 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5170.0:335 3.5 e77/74 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:head v 77'456, mlcod=76'454)", 2024-09-12T16:17:16.460 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:10.800194+0000", 2024-09-12T16:17:16.460 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.6349220180000001, 2024-09-12T16:17:16.460 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0018788699999999999, 2024-09-12T16:17:16.460 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:16.460 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:16.460 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:16.460 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:16.460 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.460 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:16.460 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:10.800194+0000", 2024-09-12T16:17:16.460 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.460 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.461 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.461 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:16.461 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:10.800194+0000", 2024-09-12T16:17:16.461 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.461 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.461 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.461 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:16.461 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:10.800195+0000", 2024-09-12T16:17:16.461 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.217e-06 2024-09-12T16:17:16.461 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.461 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.461 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:16.462 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:10.800645+0000", 2024-09-12T16:17:16.462 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00044999599999999998 2024-09-12T16:17:16.462 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.462 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.462 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:16.462 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:10.800660+0000", 2024-09-12T16:17:16.462 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4851000000000001e-05 2024-09-12T16:17:16.462 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.462 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.462 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:16.462 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:10.800667+0000", 2024-09-12T16:17:16.462 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9450000000000004e-06 2024-09-12T16:17:16.462 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.463 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.463 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:16.463 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:10.800726+0000", 2024-09-12T16:17:16.463 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9021000000000003e-05 2024-09-12T16:17:16.463 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.463 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.463 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:16.463 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:10.800750+0000", 2024-09-12T16:17:16.463 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4448e-05 2024-09-12T16:17:16.463 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.463 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.463 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:16.463 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:10.801910+0000", 2024-09-12T16:17:16.463 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011604300000000001 2024-09-12T16:17:16.464 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.464 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.464 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:16.464 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:10.802072+0000", 2024-09-12T16:17:16.464 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016196200000000001 2024-09-12T16:17:16.464 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.464 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:16.464 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.464 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.464 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.464 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5328.0:1968 3.e e78/74 3:748f03ca:::rbd_data.11551722dd77.00000000000002b3:head v 78'290, mlcod=76'288)", 2024-09-12T16:17:16.464 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:11.981306+0000", 2024-09-12T16:17:16.464 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.4538095440000003, 2024-09-12T16:17:16.464 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001688218, 2024-09-12T16:17:16.464 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:16.465 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:16.465 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:16.465 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:16.465 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.466 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:16.466 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:11.981306+0000", 2024-09-12T16:17:16.466 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.466 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.466 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.466 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:16.466 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:11.981306+0000", 2024-09-12T16:17:16.466 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.466 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.466 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.466 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:16.466 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:11.981307+0000", 2024-09-12T16:17:16.467 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7100000000000001e-07 2024-09-12T16:17:16.467 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.467 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.467 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:16.467 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:11.981312+0000", 2024-09-12T16:17:16.467 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5840000000000002e-06 2024-09-12T16:17:16.467 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.467 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.467 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:16.467 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:11.981328+0000", 2024-09-12T16:17:16.467 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5184999999999999e-05 2024-09-12T16:17:16.467 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.468 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.468 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:16.468 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:11.981334+0000", 2024-09-12T16:17:16.468 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8220000000000001e-06 2024-09-12T16:17:16.468 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.468 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.468 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:16.468 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:11.981407+0000", 2024-09-12T16:17:16.468 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2949999999999998e-05 2024-09-12T16:17:16.468 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.468 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.468 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:16.469 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:11.981432+0000", 2024-09-12T16:17:16.469 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4434999999999999e-05 2024-09-12T16:17:16.469 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.469 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.469 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:16.469 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:11.982920+0000", 2024-09-12T16:17:16.469 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0014879509999999999 2024-09-12T16:17:16.469 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.469 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.469 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:16.469 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:11.982994+0000", 2024-09-12T16:17:16.469 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4519999999999998e-05 2024-09-12T16:17:16.469 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.470 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:16.470 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.470 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.470 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.470 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5328.0:2477 3.16 e78/75 3:6928f3a1:::rbd_object_map.11551722dd77:head v 78'1005, mlcod=78'1002)", 2024-09-12T16:17:16.470 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.061414+0000", 2024-09-12T16:17:16.470 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.3737014360000002, 2024-09-12T16:17:16.470 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001852388, 2024-09-12T16:17:16.470 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:16.470 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:16.470 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:16.470 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:16.470 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.471 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:16.471 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.061414+0000", 2024-09-12T16:17:16.471 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.471 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.471 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.471 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:16.471 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.061414+0000", 2024-09-12T16:17:16.471 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.471 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.471 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.471 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:16.471 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.061415+0000", 2024-09-12T16:17:16.471 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0900000000000002e-07 2024-09-12T16:17:16.472 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.472 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.472 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:16.472 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.061421+0000", 2024-09-12T16:17:16.472 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4069999999999998e-06 2024-09-12T16:17:16.472 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.472 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.472 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:16.472 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.061430+0000", 2024-09-12T16:17:16.472 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0480000000000004e-06 2024-09-12T16:17:16.472 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.472 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.472 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:16.473 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.061435+0000", 2024-09-12T16:17:16.473 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0760000000000002e-06 2024-09-12T16:17:16.473 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.473 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.473 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:16.473 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.061480+0000", 2024-09-12T16:17:16.473 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4897000000000001e-05 2024-09-12T16:17:16.473 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.473 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.473 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:16.473 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.061500+0000", 2024-09-12T16:17:16.473 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9785000000000001e-05 2024-09-12T16:17:16.474 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.474 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.474 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:16.474 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.063214+0000", 2024-09-12T16:17:16.474 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001714368 2024-09-12T16:17:16.474 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.474 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.474 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:16.474 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.063266+0000", 2024-09-12T16:17:16.474 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2298e-05 2024-09-12T16:17:16.474 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.475 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:16.475 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.475 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.475 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.475 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5328.0:2482 3.16 e78/75 3:6928f3a1:::rbd_object_map.11551722dd77:head v 78'1006, mlcod=78'1003)", 2024-09-12T16:17:16.475 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.062440+0000", 2024-09-12T16:17:16.475 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.372675267, 2024-09-12T16:17:16.475 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017814700000000001, 2024-09-12T16:17:16.475 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:16.475 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:16.475 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:16.475 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:16.476 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.476 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:16.476 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.062440+0000", 2024-09-12T16:17:16.476 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.476 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.476 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.476 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:16.476 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.062440+0000", 2024-09-12T16:17:16.476 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.476 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.476 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.476 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:16.476 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.062441+0000", 2024-09-12T16:17:16.476 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9899999999999999e-07 2024-09-12T16:17:16.477 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.477 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.477 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:16.477 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.062447+0000", 2024-09-12T16:17:16.477 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7490000000000004e-06 2024-09-12T16:17:16.477 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.477 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.477 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:16.477 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.062461+0000", 2024-09-12T16:17:16.477 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4090000000000001e-05 2024-09-12T16:17:16.477 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.477 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.478 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:16.478 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.062472+0000", 2024-09-12T16:17:16.478 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1391e-05 2024-09-12T16:17:16.478 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.478 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.478 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:16.478 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.062549+0000", 2024-09-12T16:17:16.478 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6997999999999997e-05 2024-09-12T16:17:16.478 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.478 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.478 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:16.478 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.062569+0000", 2024-09-12T16:17:16.478 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9126e-05 2024-09-12T16:17:16.478 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.478 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.479 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:16.479 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.064185+0000", 2024-09-12T16:17:16.479 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0016163460000000001 2024-09-12T16:17:16.479 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.479 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.479 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:16.479 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.064222+0000", 2024-09-12T16:17:16.479 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6871e-05 2024-09-12T16:17:16.479 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.479 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:16.479 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.479 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.479 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.480 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5328.0:2494 3.16 e78/75 3:6928f3a1:::rbd_object_map.11551722dd77:head v 78'1017, mlcod=78'1012)", 2024-09-12T16:17:16.480 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.075733+0000", 2024-09-12T16:17:16.480 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.3593824879999996, 2024-09-12T16:17:16.480 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0016902309999999999, 2024-09-12T16:17:16.480 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:16.480 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:16.480 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:16.480 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:16.480 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.480 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:16.480 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.075733+0000", 2024-09-12T16:17:16.480 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.480 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.480 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.481 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:16.481 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.075733+0000", 2024-09-12T16:17:16.481 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.481 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.481 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.481 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:16.481 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.075734+0000", 2024-09-12T16:17:16.481 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.06e-07 2024-09-12T16:17:16.481 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.481 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.481 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:16.481 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.075739+0000", 2024-09-12T16:17:16.481 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2630000000000003e-06 2024-09-12T16:17:16.481 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.481 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.482 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:16.482 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.075750+0000", 2024-09-12T16:17:16.482 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0718e-05 2024-09-12T16:17:16.482 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.482 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.482 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:16.482 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.075757+0000", 2024-09-12T16:17:16.482 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.917e-06 2024-09-12T16:17:16.482 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.482 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.482 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:16.482 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.075817+0000", 2024-09-12T16:17:16.482 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0761000000000003e-05 2024-09-12T16:17:16.482 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.482 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.483 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:16.483 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.075835+0000", 2024-09-12T16:17:16.483 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7469000000000002e-05 2024-09-12T16:17:16.483 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.483 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.483 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:16.483 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.077348+0000", 2024-09-12T16:17:16.483 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015129220000000001 2024-09-12T16:17:16.483 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.483 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.483 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:16.483 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.077423+0000", 2024-09-12T16:17:16.483 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5475000000000005e-05 2024-09-12T16:17:16.483 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.483 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:16.484 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.484 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.484 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.484 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5328.0:2499 3.16 e78/75 3:6928f3a1:::rbd_object_map.11551722dd77:head v 78'1022, mlcod=78'1018)", 2024-09-12T16:17:16.484 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.081730+0000", 2024-09-12T16:17:16.484 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.3533851209999996, 2024-09-12T16:17:16.484 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0022482349999999999, 2024-09-12T16:17:16.484 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:16.484 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:16.484 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:16.484 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:16.484 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.484 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:16.485 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.081730+0000", 2024-09-12T16:17:16.485 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.485 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.485 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.485 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:16.485 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.081730+0000", 2024-09-12T16:17:16.485 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.485 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.485 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.485 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:16.485 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.081731+0000", 2024-09-12T16:17:16.485 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8999999999999996e-07 2024-09-12T16:17:16.486 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.486 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.486 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:16.486 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.081736+0000", 2024-09-12T16:17:16.486 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1379999999999998e-06 2024-09-12T16:17:16.486 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.486 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.486 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:16.486 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.081746+0000", 2024-09-12T16:17:16.486 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6320000000000003e-06 2024-09-12T16:17:16.486 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.486 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.487 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:16.487 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.081752+0000", 2024-09-12T16:17:16.487 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7989999999999999e-06 2024-09-12T16:17:16.487 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.487 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.487 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:16.487 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.082208+0000", 2024-09-12T16:17:16.487 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00045616 2024-09-12T16:17:16.487 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.487 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.487 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:16.487 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.082227+0000", 2024-09-12T16:17:16.487 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8768000000000001e-05 2024-09-12T16:17:16.488 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.488 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.488 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:16.488 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.083939+0000", 2024-09-12T16:17:16.488 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001712646 2024-09-12T16:17:16.488 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.488 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.488 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:16.488 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.083979+0000", 2024-09-12T16:17:16.488 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9502000000000002e-05 2024-09-12T16:17:16.488 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.488 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:16.488 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.489 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.489 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.489 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5328.0:2512 3.16 e78/75 3:6928f3a1:::rbd_object_map.11551722dd77:head v 78'1023, mlcod=78'1019)", 2024-09-12T16:17:16.489 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.083337+0000", 2024-09-12T16:17:16.489 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.3517780740000003, 2024-09-12T16:17:16.489 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017797710000000001, 2024-09-12T16:17:16.489 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:16.489 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:16.489 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:16.489 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:16.489 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.489 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:16.489 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.083337+0000", 2024-09-12T16:17:16.489 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.490 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.490 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.490 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:16.490 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.083337+0000", 2024-09-12T16:17:16.490 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.490 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.490 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.490 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:16.490 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.083338+0000", 2024-09-12T16:17:16.490 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5000000000000003e-07 2024-09-12T16:17:16.490 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.490 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.490 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:16.491 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.083344+0000", 2024-09-12T16:17:16.491 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8529999999999997e-06 2024-09-12T16:17:16.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.491 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.491 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:16.491 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.083354+0000", 2024-09-12T16:17:16.491 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0378e-05 2024-09-12T16:17:16.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.491 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.491 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:16.491 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.083360+0000", 2024-09-12T16:17:16.491 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8050000000000003e-06 2024-09-12T16:17:16.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.492 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.492 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:16.492 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.083407+0000", 2024-09-12T16:17:16.492 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6585000000000002e-05 2024-09-12T16:17:16.492 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.492 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.492 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:16.492 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.083433+0000", 2024-09-12T16:17:16.492 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6407e-05 2024-09-12T16:17:16.492 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.492 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.492 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:16.492 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.085077+0000", 2024-09-12T16:17:16.492 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001644239 2024-09-12T16:17:16.493 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.493 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.493 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:16.493 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.085117+0000", 2024-09-12T16:17:16.493 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9953999999999997e-05 2024-09-12T16:17:16.493 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.493 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:16.493 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.493 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.493 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.493 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5328.0:2520 3.16 e78/75 3:6928f3a1:::rbd_object_map.11551722dd77:head v 78'1026, mlcod=78'1023)", 2024-09-12T16:17:16.493 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.086820+0000", 2024-09-12T16:17:16.493 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.3482952829999997, 2024-09-12T16:17:16.493 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017604039999999999, 2024-09-12T16:17:16.494 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:16.494 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:16.494 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:16.494 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:16.494 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.494 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:16.494 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.086820+0000", 2024-09-12T16:17:16.494 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.494 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.494 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.494 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:16.494 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.086820+0000", 2024-09-12T16:17:16.494 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.494 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.495 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.495 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:16.495 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.086821+0000", 2024-09-12T16:17:16.495 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5600000000000005e-07 2024-09-12T16:17:16.495 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.495 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.495 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:16.495 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.086826+0000", 2024-09-12T16:17:16.495 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0730000000000004e-06 2024-09-12T16:17:16.495 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.495 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.495 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:16.495 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.086839+0000", 2024-09-12T16:17:16.495 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.27e-05 2024-09-12T16:17:16.496 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.496 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.496 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:16.496 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.086845+0000", 2024-09-12T16:17:16.496 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1859999999999997e-06 2024-09-12T16:17:16.496 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.496 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.496 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:16.496 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.086883+0000", 2024-09-12T16:17:16.496 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8290000000000001e-05 2024-09-12T16:17:16.496 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.496 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.497 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:16.497 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.086895+0000", 2024-09-12T16:17:16.497 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1494999999999999e-05 2024-09-12T16:17:16.497 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.497 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.497 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:16.497 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.088501+0000", 2024-09-12T16:17:16.497 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0016066909999999999 2024-09-12T16:17:16.497 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.497 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.497 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:16.497 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.088581+0000", 2024-09-12T16:17:16.497 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9213000000000002e-05 2024-09-12T16:17:16.498 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.498 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:16.498 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.498 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.498 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.498 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5328.0:2532 3.16 e78/75 3:6928f3a1:::rbd_object_map.11551722dd77:head v 78'1032, mlcod=78'1029)", 2024-09-12T16:17:16.498 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.093926+0000", 2024-09-12T16:17:16.498 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.341189913, 2024-09-12T16:17:16.498 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0024101140000000001, 2024-09-12T16:17:16.498 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:16.498 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:16.498 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:16.499 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:16.499 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.499 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:16.499 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.093926+0000", 2024-09-12T16:17:16.499 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.499 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.499 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.499 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:16.499 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.093926+0000", 2024-09-12T16:17:16.499 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.499 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.499 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.499 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:16.500 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.093926+0000", 2024-09-12T16:17:16.500 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6600000000000005e-07 2024-09-12T16:17:16.500 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.500 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.500 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:16.500 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.093932+0000", 2024-09-12T16:17:16.500 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3650000000000003e-06 2024-09-12T16:17:16.500 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.500 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.500 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:16.500 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.093945+0000", 2024-09-12T16:17:16.500 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2999999999999999e-05 2024-09-12T16:17:16.500 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.500 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.500 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:16.501 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.093952+0000", 2024-09-12T16:17:16.501 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7479999999999996e-06 2024-09-12T16:17:16.501 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.501 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.501 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:16.501 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.094022+0000", 2024-09-12T16:17:16.501 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0555999999999993e-05 2024-09-12T16:17:16.501 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.501 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.501 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:16.501 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.094040+0000", 2024-09-12T16:17:16.501 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7377999999999999e-05 2024-09-12T16:17:16.501 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.501 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.502 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:16.502 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.096298+0000", 2024-09-12T16:17:16.502 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0022585690000000002 2024-09-12T16:17:16.502 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.502 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.502 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:16.502 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.096336+0000", 2024-09-12T16:17:16.502 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7632000000000002e-05 2024-09-12T16:17:16.502 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.502 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:16.502 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.502 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.502 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.503 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5328.0:2533 3.16 e78/75 3:6928f3a1:::rbd_object_map.11551722dd77:head v 78'1033, mlcod=78'1029)", 2024-09-12T16:17:16.503 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.094649+0000", 2024-09-12T16:17:16.503 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.3404670410000001, 2024-09-12T16:17:16.503 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017210610000000001, 2024-09-12T16:17:16.503 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:16.503 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:16.503 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:16.503 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:16.503 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.503 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:16.503 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.094649+0000", 2024-09-12T16:17:16.503 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.503 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.503 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.503 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:16.503 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.094649+0000", 2024-09-12T16:17:16.504 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.504 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.504 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.504 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:16.504 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.094649+0000", 2024-09-12T16:17:16.504 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4000000000000001e-07 2024-09-12T16:17:16.504 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.504 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.504 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:16.504 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.094654+0000", 2024-09-12T16:17:16.504 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.578e-06 2024-09-12T16:17:16.504 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.504 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.505 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:16.505 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.094663+0000", 2024-09-12T16:17:16.505 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.482e-06 2024-09-12T16:17:16.505 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.505 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.505 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:16.505 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.094668+0000", 2024-09-12T16:17:16.505 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7430000000000002e-06 2024-09-12T16:17:16.505 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.505 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.505 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:16.505 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.095250+0000", 2024-09-12T16:17:16.505 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00058167199999999998 2024-09-12T16:17:16.505 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.506 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.506 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:16.506 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.095268+0000", 2024-09-12T16:17:16.506 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8031999999999999e-05 2024-09-12T16:17:16.506 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.506 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.506 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:16.506 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.096339+0000", 2024-09-12T16:17:16.506 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0010716650000000001 2024-09-12T16:17:16.506 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.506 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.506 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:16.506 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.096370+0000", 2024-09-12T16:17:16.506 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0249000000000001e-05 2024-09-12T16:17:16.507 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.507 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:16.507 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.507 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.507 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.507 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5328.0:3050 3.1c e78/74 3:39cf7f46:::rbd_data.11551722dd77.0000000000000167:head v 78'181, mlcod=78'179)", 2024-09-12T16:17:16.507 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.135451+0000", 2024-09-12T16:17:16.507 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.2996649439999999, 2024-09-12T16:17:16.507 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017258340000000001, 2024-09-12T16:17:16.507 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:16.507 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:16.507 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:16.508 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:16.508 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.508 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:16.508 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.135451+0000", 2024-09-12T16:17:16.508 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.508 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.508 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.508 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:16.508 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.135451+0000", 2024-09-12T16:17:16.508 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.508 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.508 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.509 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:16.509 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.135451+0000", 2024-09-12T16:17:16.509 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.92e-07 2024-09-12T16:17:16.509 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.509 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.509 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:16.509 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.135475+0000", 2024-09-12T16:17:16.509 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3881000000000001e-05 2024-09-12T16:17:16.509 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.509 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.509 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:16.509 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.135484+0000", 2024-09-12T16:17:16.510 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4600000000000003e-06 2024-09-12T16:17:16.510 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.510 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.510 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:16.510 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.135490+0000", 2024-09-12T16:17:16.510 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7000000000000002e-06 2024-09-12T16:17:16.510 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.510 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.510 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:16.510 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.135547+0000", 2024-09-12T16:17:16.510 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6538e-05 2024-09-12T16:17:16.510 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.511 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.511 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:16.511 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.135566+0000", 2024-09-12T16:17:16.511 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9188e-05 2024-09-12T16:17:16.511 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.511 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.511 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:16.511 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.136564+0000", 2024-09-12T16:17:16.511 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00099755900000000008 2024-09-12T16:17:16.511 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.511 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.511 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:16.512 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.137176+0000", 2024-09-12T16:17:16.512 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00061271600000000002 2024-09-12T16:17:16.512 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.512 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:16.512 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.512 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.512 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.512 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5120.0:3941 3.17 e80/74 3:eff97428:::rbd_data.1155a3b3a26e.0000000000000060:head v 80'442, mlcod=79'439)", 2024-09-12T16:17:16.512 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:17:16.512 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.079326600999999997, 2024-09-12T16:17:16.512 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0035981759999999998, 2024-09-12T16:17:16.512 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:16.512 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:16.512 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:16.513 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:16.513 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.513 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:16.513 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:17:16.513 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.513 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.513 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.513 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:16.513 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:17:16.513 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.513 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.513 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.513 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:16.514 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:17:16.514 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2e-07 2024-09-12T16:17:16.514 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.514 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.514 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:16.514 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355794+0000", 2024-09-12T16:17:16.514 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.865e-06 2024-09-12T16:17:16.514 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.514 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.514 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:16.514 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355956+0000", 2024-09-12T16:17:16.514 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016131699999999999 2024-09-12T16:17:16.514 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.515 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.515 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:16.515 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355964+0000", 2024-09-12T16:17:16.515 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7960000000000001e-06 2024-09-12T16:17:16.515 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.515 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.515 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:16.515 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.356320+0000", 2024-09-12T16:17:16.515 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000355612 2024-09-12T16:17:16.515 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.515 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.515 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:16.515 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.356337+0000", 2024-09-12T16:17:16.516 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6643e-05 2024-09-12T16:17:16.516 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.516 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.516 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:16.516 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.359340+0000", 2024-09-12T16:17:16.516 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003003618 2024-09-12T16:17:16.516 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.516 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.516 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:16.516 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.359387+0000", 2024-09-12T16:17:16.516 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6904999999999999e-05 2024-09-12T16:17:16.516 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.517 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:16.517 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.517 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.517 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.517 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "pg_update_log_missing(3.1d epoch 80/74 rep_tid 2636 entries 80'1179 (0'0) error 3:bc9c2d6b:::rbd_data.1155a3b3a26e.0000000000000018:head by client.5120.0:3931 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 79'1177)", 2024-09-12T16:17:16.517 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:16.355875+0000", 2024-09-12T16:17:16.517 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.079240411999999996, 2024-09-12T16:17:16.517 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0020976279999999998, 2024-09-12T16:17:16.517 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:16.517 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:16.517 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "reached pg", 2024-09-12T16:17:16.517 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:16.517 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.517 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:16.518 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355875+0000", 2024-09-12T16:17:16.518 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.518 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.518 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.518 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:16.518 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355875+0000", 2024-09-12T16:17:16.518 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.518 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.518 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.518 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:16.518 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355876+0000", 2024-09-12T16:17:16.518 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8999999999999995e-07 2024-09-12T16:17:16.518 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.518 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.519 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:16.519 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355886+0000", 2024-09-12T16:17:16.519 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5999999999999996e-06 2024-09-12T16:17:16.519 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.519 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.519 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:16.519 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355910+0000", 2024-09-12T16:17:16.519 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4669999999999999e-05 2024-09-12T16:17:16.519 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.519 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.519 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:16.519 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355932+0000", 2024-09-12T16:17:16.520 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2263999999999999e-05 2024-09-12T16:17:16.520 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.520 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.520 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:16.520 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.356044+0000", 2024-09-12T16:17:16.520 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000111475 2024-09-12T16:17:16.520 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.520 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.520 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:16.520 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.357973+0000", 2024-09-12T16:17:16.520 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001928829 2024-09-12T16:17:16.520 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.520 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:16.521 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.521 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.521 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.521 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5120.0:3935 3.13 e80/74 3:cf7e2daa:::rbd_data.1155a3b3a26e.000000000000001a:head v 80'614, mlcod=79'611)", 2024-09-12T16:17:16.521 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:16.356637+0000", 2024-09-12T16:17:16.521 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.078478553000000006, 2024-09-12T16:17:16.521 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002098071, 2024-09-12T16:17:16.521 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:16.521 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:16.521 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:16.521 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:16.521 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.521 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:16.521 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.356637+0000", 2024-09-12T16:17:16.522 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.522 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.522 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.522 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:16.522 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.356637+0000", 2024-09-12T16:17:16.522 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.522 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.522 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.522 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:16.522 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.356637+0000", 2024-09-12T16:17:16.522 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8299999999999998e-07 2024-09-12T16:17:16.522 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.522 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.522 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:16.523 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.356641+0000", 2024-09-12T16:17:16.523 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6650000000000001e-06 2024-09-12T16:17:16.523 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.523 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.523 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:16.523 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.356647+0000", 2024-09-12T16:17:16.523 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2020000000000001e-06 2024-09-12T16:17:16.523 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.523 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.523 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:16.523 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.356654+0000", 2024-09-12T16:17:16.523 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9879999999999998e-06 2024-09-12T16:17:16.523 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.524 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.524 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:16.524 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.356727+0000", 2024-09-12T16:17:16.524 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3319999999999996e-05 2024-09-12T16:17:16.524 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.524 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.524 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:16.524 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.356775+0000", 2024-09-12T16:17:16.524 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7246999999999997e-05 2024-09-12T16:17:16.524 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.524 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.524 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:16.525 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.358698+0000", 2024-09-12T16:17:16.525 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0019234079999999999 2024-09-12T16:17:16.525 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.525 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.525 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:16.525 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.358735+0000", 2024-09-12T16:17:16.525 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6958000000000001e-05 2024-09-12T16:17:16.525 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.525 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:16.525 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.525 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.525 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.525 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5120.0:3944 3.13 e80/74 3:cbfe070a:::rbd_data.1155a3b3a26e.0000000000000064:head v 80'616, mlcod=79'611)", 2024-09-12T16:17:16.525 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:16.356903+0000", 2024-09-12T16:17:16.525 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.078212079000000004, 2024-09-12T16:17:16.526 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002150323, 2024-09-12T16:17:16.526 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:16.526 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:16.526 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:16.526 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:16.526 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.526 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:16.526 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.356903+0000", 2024-09-12T16:17:16.526 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.526 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.526 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.526 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:16.526 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.356903+0000", 2024-09-12T16:17:16.527 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:16.527 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.527 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.527 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:16.527 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.356904+0000", 2024-09-12T16:17:16.527 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1600000000000001e-07 2024-09-12T16:17:16.527 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.527 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.527 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:16.527 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.356910+0000", 2024-09-12T16:17:16.527 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4319999999999998e-06 2024-09-12T16:17:16.527 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.527 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.527 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:16.528 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.356919+0000", 2024-09-12T16:17:16.528 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7170000000000003e-06 2024-09-12T16:17:16.528 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.528 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.528 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:16.528 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.356925+0000", 2024-09-12T16:17:16.528 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0050000000000001e-06 2024-09-12T16:17:16.528 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.528 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.528 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:16.528 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.357381+0000", 2024-09-12T16:17:16.528 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00045559399999999998 2024-09-12T16:17:16.528 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.528 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.529 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:16.529 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.357408+0000", 2024-09-12T16:17:16.529 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7480000000000001e-05 2024-09-12T16:17:16.529 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.529 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.529 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:16.529 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.359021+0000", 2024-09-12T16:17:16.529 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001612874 2024-09-12T16:17:16.529 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:16.529 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:16.529 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:16.529 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.359054+0000", 2024-09-12T16:17:16.529 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2505000000000001e-05 2024-09-12T16:17:16.530 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.530 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:16.530 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.530 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:16.530 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:16.530 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:16.531 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:16.530+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:16.532 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:17:16.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-12T16:17:16.614+0000 7f2096ffd640 0 --2- 172.21.15.17:0/123513342 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f209809fb70 0x7f2098132be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T16:17:16.632 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:16.631+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:16.662 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:16.663 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:16.663 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:17:16.663 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:16.672 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:17:16.687 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #24, image image_client.0-clone24 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent25 2024-09-12T16:17:16.709 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-12T16:17:16.709 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-12T16:17:16.733 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:16.732+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:16.831 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:16.832 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:16.832 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:17:16.832 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:17:16.832 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:16.834 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:16.833+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:16.844 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:17:16.935 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:16.934+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:17.000 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:17.001 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:17:17.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:17:17.001 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:17:17.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.001 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3703 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14803968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:17.001 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139513+0000", 2024-09-12T16:17:17.001 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.856928101999998, 2024-09-12T16:17:17.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053248794000000002, 2024-09-12T16:17:17.001 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.001 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.001 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:17.001 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.002 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:17.002 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:17.002 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3703 2024-09-12T16:17:17.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.002 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139513+0000", 2024-09-12T16:17:17.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139513+0000", 2024-09-12T16:17:17.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139639+0000", 2024-09-12T16:17:17.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012673299999999999 2024-09-12T16:17:17.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139642+0000", 2024-09-12T16:17:17.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4820000000000001e-06 2024-09-12T16:17:17.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139647+0000", 2024-09-12T16:17:17.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8040000000000001e-06 2024-09-12T16:17:17.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139650+0000", 2024-09-12T16:17:17.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.529e-06 2024-09-12T16:17:17.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:17.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192537+0000", 2024-09-12T16:17:17.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052886503000000001 2024-09-12T16:17:17.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:17.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192627+0000", 2024-09-12T16:17:17.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0183e-05 2024-09-12T16:17:17.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:17.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192761+0000", 2024-09-12T16:17:17.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013456000000000001 2024-09-12T16:17:17.007 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.007 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.007 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.007 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3705 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14812160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:17.007 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:17:17.007 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.856635850000004, 2024-09-12T16:17:17.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053368831999999998, 2024-09-12T16:17:17.007 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.007 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.007 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:17.007 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.008 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:17.008 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:17.008 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3705 2024-09-12T16:17:17.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.008 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:17:17.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:17:17.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139932+0000", 2024-09-12T16:17:17.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012762099999999999 2024-09-12T16:17:17.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139935+0000", 2024-09-12T16:17:17.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.119e-06 2024-09-12T16:17:17.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139939+0000", 2024-09-12T16:17:17.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7999999999999998e-06 2024-09-12T16:17:17.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139953+0000", 2024-09-12T16:17:17.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3923999999999999e-05 2024-09-12T16:17:17.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:17.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192946+0000", 2024-09-12T16:17:17.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052992971 2024-09-12T16:17:17.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:17.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193035+0000", 2024-09-12T16:17:17.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9040000000000001e-05 2024-09-12T16:17:17.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:17.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193174+0000", 2024-09-12T16:17:17.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138357 2024-09-12T16:17:17.011 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.011 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.011 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.012 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3706 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14816256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:17.012 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:17:17.012 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.856480859999998, 2024-09-12T16:17:17.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053341723000000001, 2024-09-12T16:17:17.012 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.012 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.012 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:17.012 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.012 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:17.012 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:17.012 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3706 2024-09-12T16:17:17.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.013 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:17:17.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:17:17.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140090+0000", 2024-09-12T16:17:17.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013020100000000001 2024-09-12T16:17:17.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140097+0000", 2024-09-12T16:17:17.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0709999999999997e-06 2024-09-12T16:17:17.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140103+0000", 2024-09-12T16:17:17.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5450000000000003e-06 2024-09-12T16:17:17.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140106+0000", 2024-09-12T16:17:17.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3739999999999998e-06 2024-09-12T16:17:17.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:17.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193190+0000", 2024-09-12T16:17:17.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053084131999999999 2024-09-12T16:17:17.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:17.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193232+0000", 2024-09-12T16:17:17.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1517000000000002e-05 2024-09-12T16:17:17.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.016 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:17.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193302+0000", 2024-09-12T16:17:17.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9882999999999995e-05 2024-09-12T16:17:17.016 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.016 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.016 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.016 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3707 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14820352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:17.016 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:17:17.016 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.856328871000002, 2024-09-12T16:17:17.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053452771000000003, 2024-09-12T16:17:17.016 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.016 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.017 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:17.017 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.017 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:17.017 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:17.017 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3707 2024-09-12T16:17:17.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.017 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:17:17.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:17:17.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140219+0000", 2024-09-12T16:17:17.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106902 2024-09-12T16:17:17.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140225+0000", 2024-09-12T16:17:17.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3199999999999996e-06 2024-09-12T16:17:17.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140230+0000", 2024-09-12T16:17:17.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8969999999999999e-06 2024-09-12T16:17:17.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140233+0000", 2024-09-12T16:17:17.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2119999999999999e-06 2024-09-12T16:17:17.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:17.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193339+0000", 2024-09-12T16:17:17.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053105556999999998 2024-09-12T16:17:17.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:17.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193431+0000", 2024-09-12T16:17:17.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1837999999999997e-05 2024-09-12T16:17:17.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:17.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193565+0000", 2024-09-12T16:17:17.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013404500000000001 2024-09-12T16:17:17.020 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.020 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.021 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.021 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3708 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14824448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:17.021 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:17:17.021 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.856200029, 2024-09-12T16:17:17.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053468190999999998, 2024-09-12T16:17:17.021 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.021 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.021 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:17.021 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.021 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:17.021 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:17.022 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3708 2024-09-12T16:17:17.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.022 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:17:17.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:17:17.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140351+0000", 2024-09-12T16:17:17.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110096 2024-09-12T16:17:17.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140358+0000", 2024-09-12T16:17:17.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.306e-06 2024-09-12T16:17:17.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140368+0000", 2024-09-12T16:17:17.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0225e-05 2024-09-12T16:17:17.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140372+0000", 2024-09-12T16:17:17.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6169999999999998e-06 2024-09-12T16:17:17.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:17.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193594+0000", 2024-09-12T16:17:17.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053222419999999999 2024-09-12T16:17:17.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:17.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193640+0000", 2024-09-12T16:17:17.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.587e-05 2024-09-12T16:17:17.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:17.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193709+0000", 2024-09-12T16:17:17.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8657000000000004e-05 2024-09-12T16:17:17.025 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.025 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.025 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.025 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3709 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14828544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:17.025 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:17:17.025 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.856063061, 2024-09-12T16:17:17.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594033999999999, 2024-09-12T16:17:17.025 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.025 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.026 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:17.026 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.026 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:17.026 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:17.026 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3709 2024-09-12T16:17:17.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.026 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:17:17.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:17:17.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140499+0000", 2024-09-12T16:17:17.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121019 2024-09-12T16:17:17.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140501+0000", 2024-09-12T16:17:17.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2369999999999999e-06 2024-09-12T16:17:17.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140506+0000", 2024-09-12T16:17:17.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.639e-06 2024-09-12T16:17:17.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140509+0000", 2024-09-12T16:17:17.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3419999999999999e-06 2024-09-12T16:17:17.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:17.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193743+0000", 2024-09-12T16:17:17.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053234311999999999 2024-09-12T16:17:17.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:17.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193833+0000", 2024-09-12T16:17:17.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9883999999999995e-05 2024-09-12T16:17:17.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:17.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193972+0000", 2024-09-12T16:17:17.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138601 2024-09-12T16:17:17.029 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.029 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.029 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.029 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3710 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14832640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:17.030 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:17:17.030 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.855925714999998, 2024-09-12T16:17:17.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053607324999999997, 2024-09-12T16:17:17.030 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.030 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.030 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:17.030 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.030 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:17.030 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:17.030 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3710 2024-09-12T16:17:17.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.030 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:17:17.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:17:17.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140664+0000", 2024-09-12T16:17:17.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014918700000000001 2024-09-12T16:17:17.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140674+0000", 2024-09-12T16:17:17.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8379999999999997e-06 2024-09-12T16:17:17.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140694+0000", 2024-09-12T16:17:17.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0145000000000001e-05 2024-09-12T16:17:17.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140703+0000", 2024-09-12T16:17:17.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5150000000000006e-06 2024-09-12T16:17:17.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:17.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194006+0000", 2024-09-12T16:17:17.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053303370000000003 2024-09-12T16:17:17.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:17.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194051+0000", 2024-09-12T16:17:17.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5012000000000002e-05 2024-09-12T16:17:17.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:17.034 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194122+0000", 2024-09-12T16:17:17.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1258000000000001e-05 2024-09-12T16:17:17.034 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.034 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.034 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.034 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3711 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14836736~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:17.034 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:17:17.034 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.855724266999999, 2024-09-12T16:17:17.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053670799999999998, 2024-09-12T16:17:17.034 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.034 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.034 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:17.035 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.035 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:17.035 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:17.035 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3711 2024-09-12T16:17:17.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.035 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.035 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.035 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:17:17.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.035 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:17:17.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140782+0000", 2024-09-12T16:17:17.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5549999999999994e-05 2024-09-12T16:17:17.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140786+0000", 2024-09-12T16:17:17.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.89e-06 2024-09-12T16:17:17.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140796+0000", 2024-09-12T16:17:17.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0057e-05 2024-09-12T16:17:17.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140819+0000", 2024-09-12T16:17:17.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3005000000000001e-05 2024-09-12T16:17:17.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:17.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194159+0000", 2024-09-12T16:17:17.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053340324000000001 2024-09-12T16:17:17.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:17.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194248+0000", 2024-09-12T16:17:17.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9209000000000006e-05 2024-09-12T16:17:17.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:17.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194387+0000", 2024-09-12T16:17:17.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138765 2024-09-12T16:17:17.039 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.039 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.039 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.039 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3712 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14840832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:17.039 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:17:17.039 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.855609809000001, 2024-09-12T16:17:17.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053699068000000003, 2024-09-12T16:17:17.039 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.039 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.039 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:17.039 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.040 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:17.040 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:17.040 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3712 2024-09-12T16:17:17.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.040 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.040 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.040 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:17:17.040 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.040 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.040 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:17:17.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140900+0000", 2024-09-12T16:17:17.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9014e-05 2024-09-12T16:17:17.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140904+0000", 2024-09-12T16:17:17.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0940000000000001e-06 2024-09-12T16:17:17.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140933+0000", 2024-09-12T16:17:17.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8996000000000002e-05 2024-09-12T16:17:17.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140945+0000", 2024-09-12T16:17:17.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1909000000000001e-05 2024-09-12T16:17:17.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:17.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194415+0000", 2024-09-12T16:17:17.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053470403 2024-09-12T16:17:17.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:17.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194460+0000", 2024-09-12T16:17:17.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5145000000000002e-05 2024-09-12T16:17:17.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:17.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194530+0000", 2024-09-12T16:17:17.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9506999999999997e-05 2024-09-12T16:17:17.043 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.043 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.043 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.044 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3713 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14844928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:17.044 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:17:17.044 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.855476748999997, 2024-09-12T16:17:17.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053821236000000001, 2024-09-12T16:17:17.044 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.044 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.044 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:17.044 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.044 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:17.044 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:17.044 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3713 2024-09-12T16:17:17.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.044 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:17:17.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:17:17.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141078+0000", 2024-09-12T16:17:17.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114162 2024-09-12T16:17:17.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141090+0000", 2024-09-12T16:17:17.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.19e-05 2024-09-12T16:17:17.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141100+0000", 2024-09-12T16:17:17.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0447e-05 2024-09-12T16:17:17.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141108+0000", 2024-09-12T16:17:17.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7190000000000001e-06 2024-09-12T16:17:17.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:17.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194564+0000", 2024-09-12T16:17:17.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053455729 2024-09-12T16:17:17.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:17.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194652+0000", 2024-09-12T16:17:17.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8288999999999994e-05 2024-09-12T16:17:17.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:17.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194785+0000", 2024-09-12T16:17:17.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013299000000000001 2024-09-12T16:17:17.048 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.048 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.048 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.048 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3714 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14849024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:17.048 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:17:17.048 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.855320820000003, 2024-09-12T16:17:17.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053816382000000003, 2024-09-12T16:17:17.048 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.049 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.049 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:17.049 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.049 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:17.049 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:17.049 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3714 2024-09-12T16:17:17.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.049 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:17:17.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:17:17.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141182+0000", 2024-09-12T16:17:17.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1805999999999997e-05 2024-09-12T16:17:17.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141185+0000", 2024-09-12T16:17:17.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5930000000000002e-06 2024-09-12T16:17:17.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.051 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141194+0000", 2024-09-12T16:17:17.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5760000000000006e-06 2024-09-12T16:17:17.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.051 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141222+0000", 2024-09-12T16:17:17.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8034999999999998e-05 2024-09-12T16:17:17.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:17.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194817+0000", 2024-09-12T16:17:17.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594887000000001 2024-09-12T16:17:17.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:17.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194860+0000", 2024-09-12T16:17:17.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3714999999999997e-05 2024-09-12T16:17:17.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:17.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194936+0000", 2024-09-12T16:17:17.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5770000000000001e-05 2024-09-12T16:17:17.052 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.053 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.053 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.053 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3715 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14853120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:17.053 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:17:17.053 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.855197163, 2024-09-12T16:17:17.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053962307000000001, 2024-09-12T16:17:17.053 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.053 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.053 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:17.053 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.053 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:17.053 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:17.054 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3715 2024-09-12T16:17:17.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.054 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:17:17.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:17:17.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141417+0000", 2024-09-12T16:17:17.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017384099999999999 2024-09-12T16:17:17.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141422+0000", 2024-09-12T16:17:17.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7310000000000001e-06 2024-09-12T16:17:17.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141434+0000", 2024-09-12T16:17:17.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2058e-05 2024-09-12T16:17:17.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141442+0000", 2024-09-12T16:17:17.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7610000000000007e-06 2024-09-12T16:17:17.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:17.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194973+0000", 2024-09-12T16:17:17.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053530618000000002 2024-09-12T16:17:17.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:17.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195063+0000", 2024-09-12T16:17:17.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0927000000000005e-05 2024-09-12T16:17:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195206+0000", 2024-09-12T16:17:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142371 2024-09-12T16:17:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3716 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14857216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:17:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.854987313000002, 2024-09-12T16:17:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053916360000000003, 2024-09-12T16:17:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3716 2024-09-12T16:17:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:17:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:17:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142933+0000", 2024-09-12T16:17:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014796290000000001 2024-09-12T16:17:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142937+0000", 2024-09-12T16:17:17.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5760000000000002e-06 2024-09-12T16:17:17.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142946+0000", 2024-09-12T16:17:17.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0380000000000005e-06 2024-09-12T16:17:17.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142951+0000", 2024-09-12T16:17:17.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9749999999999998e-06 2024-09-12T16:17:17.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195246+0000", 2024-09-12T16:17:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052295358 2024-09-12T16:17:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195299+0000", 2024-09-12T16:17:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2976999999999998e-05 2024-09-12T16:17:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195370+0000", 2024-09-12T16:17:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0807000000000002e-05 2024-09-12T16:17:17.062 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.062 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.062 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.062 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3721 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14877696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:17.062 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:17.062 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.853413861999996, 2024-09-12T16:17:17.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053422994000000001, 2024-09-12T16:17:17.062 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.062 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.062 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:17.063 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.063 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:17.063 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:17.063 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3721 2024-09-12T16:17:17.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.063 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:17.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:17.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.064 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.064 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:17.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:17:17.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.064 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.064 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143028+0000", 2024-09-12T16:17:17.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7399999999999991e-07 2024-09-12T16:17:17.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143031+0000", 2024-09-12T16:17:17.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7599999999999998e-06 2024-09-12T16:17:17.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143034+0000", 2024-09-12T16:17:17.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9780000000000001e-06 2024-09-12T16:17:17.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:17.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196220+0000", 2024-09-12T16:17:17.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053186341999999998 2024-09-12T16:17:17.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:17.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196313+0000", 2024-09-12T16:17:17.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2676000000000005e-05 2024-09-12T16:17:17.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:17.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196450+0000", 2024-09-12T16:17:17.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137052 2024-09-12T16:17:17.066 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.066 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.066 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.067 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3722 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14881792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:17.067 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:17.067 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.853403970000002, 2024-09-12T16:17:17.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053556835999999997, 2024-09-12T16:17:17.067 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.067 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.067 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:17.067 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.067 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:17.067 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:17.067 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3722 2024-09-12T16:17:17.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.068 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:17.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:17.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:17.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.11e-07 2024-09-12T16:17:17.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143038+0000", 2024-09-12T16:17:17.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2399999999999996e-07 2024-09-12T16:17:17.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143041+0000", 2024-09-12T16:17:17.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8030000000000001e-06 2024-09-12T16:17:17.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143043+0000", 2024-09-12T16:17:17.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3140000000000002e-06 2024-09-12T16:17:17.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:17.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196481+0000", 2024-09-12T16:17:17.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053437601000000001 2024-09-12T16:17:17.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:17.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196525+0000", 2024-09-12T16:17:17.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4280000000000003e-05 2024-09-12T16:17:17.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:17.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196594+0000", 2024-09-12T16:17:17.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8702999999999996e-05 2024-09-12T16:17:17.071 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.071 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.071 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.071 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3723 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14885888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:17.071 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:17:17.071 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.853394788000003, 2024-09-12T16:17:17.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053815546999999998, 2024-09-12T16:17:17.071 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.071 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.072 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:17.072 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.072 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:17.072 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:17.072 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3723 2024-09-12T16:17:17.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.072 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:17:17.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:17:17.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148994+0000", 2024-09-12T16:17:17.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059481330000000004 2024-09-12T16:17:17.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148999+0000", 2024-09-12T16:17:17.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7140000000000001e-06 2024-09-12T16:17:17.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149008+0000", 2024-09-12T16:17:17.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4350000000000003e-06 2024-09-12T16:17:17.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149021+0000", 2024-09-12T16:17:17.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2514000000000001e-05 2024-09-12T16:17:17.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:17.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196630+0000", 2024-09-12T16:17:17.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047609758000000002 2024-09-12T16:17:17.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:17.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196724+0000", 2024-09-12T16:17:17.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3522000000000003e-05 2024-09-12T16:17:17.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:17.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196861+0000", 2024-09-12T16:17:17.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013747100000000001 2024-09-12T16:17:17.075 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.075 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.075 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.075 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4438 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15719424~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:17.075 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:17.076 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.708514010999998, 2024-09-12T16:17:17.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367981000000002, 2024-09-12T16:17:17.076 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.076 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.076 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:17.076 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.076 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:17.076 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:17.076 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4438 2024-09-12T16:17:17.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.076 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:17.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:17.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:17.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3e-07 2024-09-12T16:17:17.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287930+0000", 2024-09-12T16:17:17.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-12T16:17:17.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287937+0000", 2024-09-12T16:17:17.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.08e-06 2024-09-12T16:17:17.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287943+0000", 2024-09-12T16:17:17.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5709999999999997e-06 2024-09-12T16:17:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341068+0000", 2024-09-12T16:17:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053125101000000001 2024-09-12T16:17:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341154+0000", 2024-09-12T16:17:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6100999999999994e-05 2024-09-12T16:17:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:17.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341295+0000", 2024-09-12T16:17:17.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014087999999999999 2024-09-12T16:17:17.080 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.080 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.080 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.080 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4439 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15723520~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:17.080 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:17.080 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.708489851000003, 2024-09-12T16:17:17.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053526799, 2024-09-12T16:17:17.080 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.080 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.080 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:17.081 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.081 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:17.081 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:17.081 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4439 2024-09-12T16:17:17.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.081 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.081 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.081 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:17.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.081 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.081 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:17.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:17.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-07 2024-09-12T16:17:17.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287953+0000", 2024-09-12T16:17:17.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1349999999999999e-06 2024-09-12T16:17:17.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287960+0000", 2024-09-12T16:17:17.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-12T16:17:17.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287965+0000", 2024-09-12T16:17:17.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1580000000000004e-06 2024-09-12T16:17:17.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:17.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341332+0000", 2024-09-12T16:17:17.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367009 2024-09-12T16:17:17.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:17.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341402+0000", 2024-09-12T16:17:17.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9759999999999996e-05 2024-09-12T16:17:17.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:17.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341478+0000", 2024-09-12T16:17:17.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5412000000000002e-05 2024-09-12T16:17:17.084 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.084 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.084 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.084 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4440 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15727616~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:17.085 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:17.085 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.708468746999998, 2024-09-12T16:17:17.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053761601999999999, 2024-09-12T16:17:17.085 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.085 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.085 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:17.085 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.085 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:17.085 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:17.085 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4440 2024-09-12T16:17:17.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.085 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:17.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:17.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:17.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:17:17.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287974+0000", 2024-09-12T16:17:17.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0540000000000002e-06 2024-09-12T16:17:17.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287980+0000", 2024-09-12T16:17:17.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9440000000000002e-06 2024-09-12T16:17:17.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287987+0000", 2024-09-12T16:17:17.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5889999999999999e-06 2024-09-12T16:17:17.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:17.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341502+0000", 2024-09-12T16:17:17.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053515199999999999 2024-09-12T16:17:17.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:17.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341595+0000", 2024-09-12T16:17:17.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3097000000000007e-05 2024-09-12T16:17:17.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:17.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341734+0000", 2024-09-12T16:17:17.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013832800000000001 2024-09-12T16:17:17.088 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.089 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.089 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.089 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2209 3.1 3:85f36d3b:::rbd_data.1155ccb1894c.0000000000000004:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:17.089 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:17:17.089 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.624783609000001, 2024-09-12T16:17:17.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.060659365, 2024-09-12T16:17:17.089 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.089 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.089 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:17.089 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.089 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:17:17.089 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:17:17.090 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2209 2024-09-12T16:17:17.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.090 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:17:17.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:17:17.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371658+0000", 2024-09-12T16:17:17.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1570000000000001e-06 2024-09-12T16:17:17.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393414+0000", 2024-09-12T16:17:17.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021755495999999999 2024-09-12T16:17:17.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393447+0000", 2024-09-12T16:17:17.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3630000000000002e-05 2024-09-12T16:17:17.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393462+0000", 2024-09-12T16:17:17.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5048999999999999e-05 2024-09-12T16:17:17.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:17.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393556+0000", 2024-09-12T16:17:17.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3549999999999997e-05 2024-09-12T16:17:17.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:17.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393697+0000", 2024-09-12T16:17:17.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000141414 2024-09-12T16:17:17.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T16:17:17.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.394944+0000", 2024-09-12T16:17:17.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012463039999999999 2024-09-12T16:17:17.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:17.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.431803+0000", 2024-09-12T16:17:17.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0368594 2024-09-12T16:17:17.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:17:17.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432268+0000", 2024-09-12T16:17:17.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046457600000000002 2024-09-12T16:17:17.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:17:17.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432293+0000", 2024-09-12T16:17:17.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.527e-05 2024-09-12T16:17:17.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:17.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432316+0000", 2024-09-12T16:17:17.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3519e-05 2024-09-12T16:17:17.094 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.094 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.094 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.095 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.095 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.095 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:17.095 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T16:17:17.096 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:17.095+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:17.097 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:17:17.197 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:17.195+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:17.253 INFO:teuthology.orchestra.run.smithi204.stdout:3982 write 0xb3c00 thru 0xb88d2 (0x4cd3 bytes) 2024-09-12T16:17:17.254 INFO:teuthology.orchestra.run.smithi204.stdout:3985 read 0x524f800 thru 0x525aad5 (0xb2d6 bytes) 2024-09-12T16:17:17.255 INFO:teuthology.orchestra.run.smithi204.stdout:3988 read 0x3ba9200 thru 0x3badb24 (0x4925 bytes) 2024-09-12T16:17:17.255 INFO:teuthology.orchestra.run.smithi204.stdout:3989 punch from 0x2013800 to 0x201de00, (0xa600 bytes) 2024-09-12T16:17:17.272 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2024-09-12T16:17:17.280 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.0 to 1 (10000) 2024-09-12T16:17:17.283 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:17.283 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:17:17.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.284 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:820 3.0 3.f3c0e780 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.284 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.272161+0000", 2024-09-12T16:17:17.284 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0058138189999999996, 2024-09-12T16:17:17.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0058339430000000003, 2024-09-12T16:17:17.284 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.284 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.284 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.284 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.284 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.284 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.285 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 820 2024-09-12T16:17:17.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.285 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272161+0000", 2024-09-12T16:17:17.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272161+0000", 2024-09-12T16:17:17.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272161+0000", 2024-09-12T16:17:17.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6699999999999999e-07 2024-09-12T16:17:17.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272163+0000", 2024-09-12T16:17:17.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.001e-06 2024-09-12T16:17:17.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272169+0000", 2024-09-12T16:17:17.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7799999999999997e-06 2024-09-12T16:17:17.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272174+0000", 2024-09-12T16:17:17.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2290000000000002e-06 2024-09-12T16:17:17.287 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.287 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.287 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.287 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:821 3.0 3.f3c0e780 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.287 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.272181+0000", 2024-09-12T16:17:17.288 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0057938399999999998, 2024-09-12T16:17:17.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0058742070000000002, 2024-09-12T16:17:17.288 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.288 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.288 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.288 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.288 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.288 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.288 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 821 2024-09-12T16:17:17.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.288 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272181+0000", 2024-09-12T16:17:17.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272181+0000", 2024-09-12T16:17:17.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272181+0000", 2024-09-12T16:17:17.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.89e-07 2024-09-12T16:17:17.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272183+0000", 2024-09-12T16:17:17.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2079999999999999e-06 2024-09-12T16:17:17.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272190+0000", 2024-09-12T16:17:17.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2530000000000001e-06 2024-09-12T16:17:17.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272196+0000", 2024-09-12T16:17:17.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4119999999999998e-06 2024-09-12T16:17:17.290 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.291 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.291 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.291 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:824 3.0 3.f3c0e780 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.291 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.272203+0000", 2024-09-12T16:17:17.291 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0057715400000000004, 2024-09-12T16:17:17.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059019169999999996, 2024-09-12T16:17:17.291 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.291 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.291 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.291 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.291 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.291 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.291 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 824 2024-09-12T16:17:17.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.292 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272203+0000", 2024-09-12T16:17:17.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272203+0000", 2024-09-12T16:17:17.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272204+0000", 2024-09-12T16:17:17.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3200000000000001e-07 2024-09-12T16:17:17.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272206+0000", 2024-09-12T16:17:17.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.99e-06 2024-09-12T16:17:17.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272212+0000", 2024-09-12T16:17:17.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1419999999999998e-06 2024-09-12T16:17:17.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272217+0000", 2024-09-12T16:17:17.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8359999999999999e-06 2024-09-12T16:17:17.294 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.294 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.294 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.294 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:826 3.0 3.f3c0e780 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.294 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.272223+0000", 2024-09-12T16:17:17.294 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0057520310000000003, 2024-09-12T16:17:17.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059419770000000002, 2024-09-12T16:17:17.295 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.295 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.295 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.295 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.295 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.295 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.295 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 826 2024-09-12T16:17:17.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.295 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272223+0000", 2024-09-12T16:17:17.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272223+0000", 2024-09-12T16:17:17.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272223+0000", 2024-09-12T16:17:17.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6899999999999998e-07 2024-09-12T16:17:17.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272230+0000", 2024-09-12T16:17:17.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8539999999999999e-06 2024-09-12T16:17:17.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272710+0000", 2024-09-12T16:17:17.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047987300000000002 2024-09-12T16:17:17.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272716+0000", 2024-09-12T16:17:17.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2129999999999996e-06 2024-09-12T16:17:17.297 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.298 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.298 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.298 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:827 3.0 3.f3c0e780 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.298 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.272728+0000", 2024-09-12T16:17:17.298 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0052471339999999997, 2024-09-12T16:17:17.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0054881740000000002, 2024-09-12T16:17:17.298 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.298 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.298 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.298 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.298 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.299 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.299 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 827 2024-09-12T16:17:17.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.299 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272728+0000", 2024-09-12T16:17:17.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272728+0000", 2024-09-12T16:17:17.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.300 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272728+0000", 2024-09-12T16:17:17.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0699999999999997e-07 2024-09-12T16:17:17.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.300 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272732+0000", 2024-09-12T16:17:17.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5990000000000002e-06 2024-09-12T16:17:17.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272738+0000", 2024-09-12T16:17:17.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.686e-06 2024-09-12T16:17:17.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272744+0000", 2024-09-12T16:17:17.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5779999999999998e-06 2024-09-12T16:17:17.301 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.301 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.301 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.302 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:767 3.0 3:01a756e1:::rbd_data.1155a3488f5d.000000000000000b:1a [read 7168~1024 out=1024b] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.302 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.270888+0000", 2024-09-12T16:17:17.302 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0070870990000000003, 2024-09-12T16:17:17.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.007384809, 2024-09-12T16:17:17.302 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.302 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.302 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:17.302 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.302 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.302 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.302 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 767 2024-09-12T16:17:17.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.302 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.270888+0000", 2024-09-12T16:17:17.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.270888+0000", 2024-09-12T16:17:17.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.270888+0000", 2024-09-12T16:17:17.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1100000000000002e-07 2024-09-12T16:17:17.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.304 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.304 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.270890+0000", 2024-09-12T16:17:17.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0650000000000001e-06 2024-09-12T16:17:17.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.304 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.304 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.270896+0000", 2024-09-12T16:17:17.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9800000000000003e-06 2024-09-12T16:17:17.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.270901+0000", 2024-09-12T16:17:17.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9239999999999998e-06 2024-09-12T16:17:17.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:17.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.278119+0000", 2024-09-12T16:17:17.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0072183669999999998 2024-09-12T16:17:17.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:17.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.278195+0000", 2024-09-12T16:17:17.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5375000000000003e-05 2024-09-12T16:17:17.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:17.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.278277+0000", 2024-09-12T16:17:17.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2250999999999996e-05 2024-09-12T16:17:17.306 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.306 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.306 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.306 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:829 3.0 3.f3c0e780 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.306 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.272751+0000", 2024-09-12T16:17:17.306 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0052234070000000002, 2024-09-12T16:17:17.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055830970000000004, 2024-09-12T16:17:17.307 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.307 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.307 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.307 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.307 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.307 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.307 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 829 2024-09-12T16:17:17.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.307 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272751+0000", 2024-09-12T16:17:17.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272751+0000", 2024-09-12T16:17:17.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272752+0000", 2024-09-12T16:17:17.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1600000000000002e-07 2024-09-12T16:17:17.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272754+0000", 2024-09-12T16:17:17.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1770000000000001e-06 2024-09-12T16:17:17.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272760+0000", 2024-09-12T16:17:17.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2979999999999997e-06 2024-09-12T16:17:17.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272765+0000", 2024-09-12T16:17:17.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.13e-06 2024-09-12T16:17:17.310 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.310 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.310 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.310 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:768 3.0 3.876ae580 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.310 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.270908+0000", 2024-09-12T16:17:17.310 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0070667739999999996, 2024-09-12T16:17:17.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0074795080000000002, 2024-09-12T16:17:17.310 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.310 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.310 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.310 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.310 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.311 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.311 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 768 2024-09-12T16:17:17.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.311 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.270908+0000", 2024-09-12T16:17:17.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.270908+0000", 2024-09-12T16:17:17.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.270908+0000", 2024-09-12T16:17:17.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.84e-07 2024-09-12T16:17:17.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.270910+0000", 2024-09-12T16:17:17.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1409999999999999e-06 2024-09-12T16:17:17.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.313 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.313 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.270917+0000", 2024-09-12T16:17:17.313 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1510000000000001e-06 2024-09-12T16:17:17.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.313 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.313 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.270928+0000", 2024-09-12T16:17:17.313 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1438e-05 2024-09-12T16:17:17.313 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.313 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.313 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.314 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:831 3.0 3.f3c0e780 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.314 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.272772+0000", 2024-09-12T16:17:17.314 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.005202801, 2024-09-12T16:17:17.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.005666333, 2024-09-12T16:17:17.314 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.314 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.314 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.314 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.314 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.314 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.315 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 831 2024-09-12T16:17:17.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.315 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272772+0000", 2024-09-12T16:17:17.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272772+0000", 2024-09-12T16:17:17.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272772+0000", 2024-09-12T16:17:17.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.77e-07 2024-09-12T16:17:17.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272774+0000", 2024-09-12T16:17:17.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.08e-06 2024-09-12T16:17:17.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272781+0000", 2024-09-12T16:17:17.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2079999999999997e-06 2024-09-12T16:17:17.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.317 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.317 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272785+0000", 2024-09-12T16:17:17.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8319999999999996e-06 2024-09-12T16:17:17.317 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.317 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.317 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.317 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:769 3.0 3.876ae580 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.317 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.270936+0000", 2024-09-12T16:17:17.317 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0070389500000000004, 2024-09-12T16:17:17.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0075543199999999998, 2024-09-12T16:17:17.318 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.318 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.318 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.318 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.318 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.318 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.318 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 769 2024-09-12T16:17:17.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.318 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.270936+0000", 2024-09-12T16:17:17.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.270936+0000", 2024-09-12T16:17:17.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.270936+0000", 2024-09-12T16:17:17.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3300000000000003e-07 2024-09-12T16:17:17.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.270939+0000", 2024-09-12T16:17:17.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.351e-06 2024-09-12T16:17:17.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.270945+0000", 2024-09-12T16:17:17.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1720000000000004e-06 2024-09-12T16:17:17.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.321 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.321 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.270950+0000", 2024-09-12T16:17:17.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0549999999999999e-06 2024-09-12T16:17:17.321 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.321 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.321 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.321 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:832 3.0 3.f3c0e780 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.321 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.272792+0000", 2024-09-12T16:17:17.321 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0051828969999999997, 2024-09-12T16:17:17.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0057482699999999998, 2024-09-12T16:17:17.321 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.321 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.322 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.322 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.322 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.322 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.322 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 832 2024-09-12T16:17:17.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.322 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.322 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.322 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272792+0000", 2024-09-12T16:17:17.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.322 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.322 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272792+0000", 2024-09-12T16:17:17.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272792+0000", 2024-09-12T16:17:17.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0200000000000003e-07 2024-09-12T16:17:17.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272794+0000", 2024-09-12T16:17:17.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0080000000000001e-06 2024-09-12T16:17:17.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272800+0000", 2024-09-12T16:17:17.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.161e-06 2024-09-12T16:17:17.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272805+0000", 2024-09-12T16:17:17.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7700000000000001e-06 2024-09-12T16:17:17.324 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.324 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.324 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.324 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:770 3.0 3.876ae580 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.325 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.270956+0000", 2024-09-12T16:17:17.325 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0070185689999999997, 2024-09-12T16:17:17.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0076327729999999998, 2024-09-12T16:17:17.325 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.325 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.325 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.325 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.325 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.325 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.325 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 770 2024-09-12T16:17:17.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.325 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.326 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.270956+0000", 2024-09-12T16:17:17.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.326 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.270956+0000", 2024-09-12T16:17:17.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.326 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.270957+0000", 2024-09-12T16:17:17.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8000000000000001e-07 2024-09-12T16:17:17.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.270959+0000", 2024-09-12T16:17:17.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9910000000000001e-06 2024-09-12T16:17:17.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.270965+0000", 2024-09-12T16:17:17.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0129999999999999e-06 2024-09-12T16:17:17.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.270969+0000", 2024-09-12T16:17:17.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5170000000000001e-06 2024-09-12T16:17:17.327 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.327 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.328 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.328 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:834 3.0 3.f3c0e780 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.328 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.272812+0000", 2024-09-12T16:17:17.328 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0051630620000000004, 2024-09-12T16:17:17.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0058249349999999998, 2024-09-12T16:17:17.328 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.328 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.328 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.328 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.328 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.328 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.328 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 834 2024-09-12T16:17:17.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.329 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272812+0000", 2024-09-12T16:17:17.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272812+0000", 2024-09-12T16:17:17.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272812+0000", 2024-09-12T16:17:17.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3700000000000001e-07 2024-09-12T16:17:17.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272814+0000", 2024-09-12T16:17:17.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.03e-06 2024-09-12T16:17:17.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272820+0000", 2024-09-12T16:17:17.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8359999999999997e-06 2024-09-12T16:17:17.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272825+0000", 2024-09-12T16:17:17.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9400000000000001e-06 2024-09-12T16:17:17.331 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.331 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.331 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.331 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:771 3.0 3.876ae580 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.331 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.270975+0000", 2024-09-12T16:17:17.332 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0069992800000000001, 2024-09-12T16:17:17.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0077086610000000003, 2024-09-12T16:17:17.332 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.332 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.332 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.332 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.332 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.332 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.332 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 771 2024-09-12T16:17:17.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.332 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.270975+0000", 2024-09-12T16:17:17.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.270975+0000", 2024-09-12T16:17:17.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.270976+0000", 2024-09-12T16:17:17.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2599999999999998e-07 2024-09-12T16:17:17.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.270978+0000", 2024-09-12T16:17:17.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9800000000000001e-06 2024-09-12T16:17:17.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.270984+0000", 2024-09-12T16:17:17.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2190000000000001e-06 2024-09-12T16:17:17.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.270989+0000", 2024-09-12T16:17:17.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.758e-06 2024-09-12T16:17:17.335 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.335 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.335 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.335 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:835 3.0 3.f3c0e780 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.335 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.272831+0000", 2024-09-12T16:17:17.335 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.005143328, 2024-09-12T16:17:17.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059008539999999996, 2024-09-12T16:17:17.335 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.335 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.336 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.336 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.336 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.336 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.336 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 835 2024-09-12T16:17:17.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.336 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272831+0000", 2024-09-12T16:17:17.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272831+0000", 2024-09-12T16:17:17.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272832+0000", 2024-09-12T16:17:17.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8099999999999998e-07 2024-09-12T16:17:17.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272834+0000", 2024-09-12T16:17:17.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2929999999999999e-06 2024-09-12T16:17:17.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272840+0000", 2024-09-12T16:17:17.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7749999999999998e-06 2024-09-12T16:17:17.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272844+0000", 2024-09-12T16:17:17.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5700000000000003e-06 2024-09-12T16:17:17.338 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.338 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.338 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.339 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:772 3.0 3.876ae580 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.339 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.270997+0000", 2024-09-12T16:17:17.339 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0069773400000000003, 2024-09-12T16:17:17.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0077855700000000003, 2024-09-12T16:17:17.339 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.339 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.339 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.339 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.339 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.339 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.339 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 772 2024-09-12T16:17:17.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.340 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.340 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.270997+0000", 2024-09-12T16:17:17.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.340 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.270997+0000", 2024-09-12T16:17:17.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.341 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.270998+0000", 2024-09-12T16:17:17.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6199999999999999e-07 2024-09-12T16:17:17.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.341 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271000+0000", 2024-09-12T16:17:17.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.052e-06 2024-09-12T16:17:17.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.341 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271007+0000", 2024-09-12T16:17:17.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7179999999999999e-06 2024-09-12T16:17:17.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.342 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271012+0000", 2024-09-12T16:17:17.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1070000000000004e-06 2024-09-12T16:17:17.342 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.342 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.342 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.342 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:836 3.0 3.f3c0e780 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.342 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.272853+0000", 2024-09-12T16:17:17.343 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.005121937, 2024-09-12T16:17:17.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059797289999999996, 2024-09-12T16:17:17.343 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.343 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.343 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.343 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.343 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.343 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.343 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 836 2024-09-12T16:17:17.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.343 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272853+0000", 2024-09-12T16:17:17.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272853+0000", 2024-09-12T16:17:17.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272853+0000", 2024-09-12T16:17:17.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2199999999999999e-07 2024-09-12T16:17:17.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.345 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272855+0000", 2024-09-12T16:17:17.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0679999999999999e-06 2024-09-12T16:17:17.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.345 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272862+0000", 2024-09-12T16:17:17.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2620000000000004e-06 2024-09-12T16:17:17.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272866+0000", 2024-09-12T16:17:17.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9389999999999996e-06 2024-09-12T16:17:17.346 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.346 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.346 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.346 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:773 3.0 3.876ae580 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.346 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.271018+0000", 2024-09-12T16:17:17.346 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0069565959999999998, 2024-09-12T16:17:17.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0078657450000000004, 2024-09-12T16:17:17.347 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.347 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.347 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.347 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.347 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.347 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.347 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 773 2024-09-12T16:17:17.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.347 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.347 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271018+0000", 2024-09-12T16:17:17.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271018+0000", 2024-09-12T16:17:17.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271019+0000", 2024-09-12T16:17:17.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6600000000000002e-07 2024-09-12T16:17:17.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271030+0000", 2024-09-12T16:17:17.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0988999999999999e-05 2024-09-12T16:17:17.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271037+0000", 2024-09-12T16:17:17.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3209999999999999e-06 2024-09-12T16:17:17.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271042+0000", 2024-09-12T16:17:17.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9910000000000002e-06 2024-09-12T16:17:17.349 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.349 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.349 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.350 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:837 3.0 3.f3c0e780 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.350 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.272873+0000", 2024-09-12T16:17:17.350 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0051018139999999997, 2024-09-12T16:17:17.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00606457, 2024-09-12T16:17:17.350 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.350 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.350 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.350 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.350 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.350 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.350 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 837 2024-09-12T16:17:17.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.351 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272873+0000", 2024-09-12T16:17:17.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272873+0000", 2024-09-12T16:17:17.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272873+0000", 2024-09-12T16:17:17.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9799999999999999e-07 2024-09-12T16:17:17.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272876+0000", 2024-09-12T16:17:17.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2579999999999998e-06 2024-09-12T16:17:17.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272881+0000", 2024-09-12T16:17:17.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8499999999999999e-06 2024-09-12T16:17:17.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272886+0000", 2024-09-12T16:17:17.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5709999999999999e-06 2024-09-12T16:17:17.353 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.353 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.353 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.353 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:774 3.0 3.876ae580 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.353 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.271050+0000", 2024-09-12T16:17:17.353 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0069248870000000002, 2024-09-12T16:17:17.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0079367210000000007, 2024-09-12T16:17:17.353 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.354 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.354 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.354 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.354 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.354 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.354 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 774 2024-09-12T16:17:17.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.354 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271050+0000", 2024-09-12T16:17:17.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271050+0000", 2024-09-12T16:17:17.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271050+0000", 2024-09-12T16:17:17.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.01e-07 2024-09-12T16:17:17.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.356 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271052+0000", 2024-09-12T16:17:17.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1500000000000002e-06 2024-09-12T16:17:17.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.356 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.356 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271059+0000", 2024-09-12T16:17:17.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3369999999999996e-06 2024-09-12T16:17:17.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.356 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.356 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271064+0000", 2024-09-12T16:17:17.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8289999999999998e-06 2024-09-12T16:17:17.356 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.357 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.357 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.357 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:838 3.0 3.f3c0e780 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.357 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.272893+0000", 2024-09-12T16:17:17.357 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0050821959999999998, 2024-09-12T16:17:17.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0061425999999999998, 2024-09-12T16:17:17.357 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.357 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.357 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.357 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.357 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.358 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.358 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 838 2024-09-12T16:17:17.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.358 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272893+0000", 2024-09-12T16:17:17.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272893+0000", 2024-09-12T16:17:17.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272893+0000", 2024-09-12T16:17:17.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0999999999999999e-07 2024-09-12T16:17:17.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272895+0000", 2024-09-12T16:17:17.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1399999999999998e-06 2024-09-12T16:17:17.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272901+0000", 2024-09-12T16:17:17.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8019999999999997e-06 2024-09-12T16:17:17.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272906+0000", 2024-09-12T16:17:17.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6070000000000001e-06 2024-09-12T16:17:17.360 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.360 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.360 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.360 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:775 3.0 3.876ae580 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.360 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.271070+0000", 2024-09-12T16:17:17.361 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.006904482, 2024-09-12T16:17:17.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0080126480000000007, 2024-09-12T16:17:17.361 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.361 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.361 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.361 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.361 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.361 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.361 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 775 2024-09-12T16:17:17.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.361 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271070+0000", 2024-09-12T16:17:17.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271070+0000", 2024-09-12T16:17:17.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271071+0000", 2024-09-12T16:17:17.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5100000000000001e-07 2024-09-12T16:17:17.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.363 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271073+0000", 2024-09-12T16:17:17.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.046e-06 2024-09-12T16:17:17.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.363 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271079+0000", 2024-09-12T16:17:17.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2169999999999999e-06 2024-09-12T16:17:17.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.364 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271084+0000", 2024-09-12T16:17:17.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6419999999999998e-06 2024-09-12T16:17:17.364 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.364 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.364 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.364 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:839 3.0 3.f3c0e780 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.364 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.272912+0000", 2024-09-12T16:17:17.364 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0050625230000000002, 2024-09-12T16:17:17.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0062192269999999999, 2024-09-12T16:17:17.365 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.365 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.365 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.365 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.365 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.365 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.365 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 839 2024-09-12T16:17:17.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.365 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272912+0000", 2024-09-12T16:17:17.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272912+0000", 2024-09-12T16:17:17.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272913+0000", 2024-09-12T16:17:17.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:17:17.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272915+0000", 2024-09-12T16:17:17.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2000000000000001e-06 2024-09-12T16:17:17.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.367 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.367 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272926+0000", 2024-09-12T16:17:17.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1174e-05 2024-09-12T16:17:17.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.367 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.367 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272931+0000", 2024-09-12T16:17:17.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.955e-06 2024-09-12T16:17:17.367 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.367 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.368 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.368 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:776 3.0 3.876ae580 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.368 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.271090+0000", 2024-09-12T16:17:17.368 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0068846100000000002, 2024-09-12T16:17:17.368 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0080896149999999997, 2024-09-12T16:17:17.368 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.368 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.368 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.369 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.369 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.369 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.369 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 776 2024-09-12T16:17:17.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.369 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271090+0000", 2024-09-12T16:17:17.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271090+0000", 2024-09-12T16:17:17.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271091+0000", 2024-09-12T16:17:17.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:17:17.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271093+0000", 2024-09-12T16:17:17.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.979e-06 2024-09-12T16:17:17.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271099+0000", 2024-09-12T16:17:17.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0050000000000001e-06 2024-09-12T16:17:17.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271103+0000", 2024-09-12T16:17:17.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7709999999999997e-06 2024-09-12T16:17:17.371 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.371 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.371 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.371 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:840 3.0 3.f3c0e780 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.372 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.272938+0000", 2024-09-12T16:17:17.372 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0050366389999999999, 2024-09-12T16:17:17.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0062894250000000004, 2024-09-12T16:17:17.372 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.372 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.372 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.372 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.372 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.372 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.372 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 840 2024-09-12T16:17:17.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.372 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272938+0000", 2024-09-12T16:17:17.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272938+0000", 2024-09-12T16:17:17.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272939+0000", 2024-09-12T16:17:17.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.39e-07 2024-09-12T16:17:17.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272941+0000", 2024-09-12T16:17:17.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.367e-06 2024-09-12T16:17:17.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272947+0000", 2024-09-12T16:17:17.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8239999999999996e-06 2024-09-12T16:17:17.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.375 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272951+0000", 2024-09-12T16:17:17.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7489999999999998e-06 2024-09-12T16:17:17.375 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.375 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.375 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.375 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:777 3.0 3.876ae580 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.375 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.271110+0000", 2024-09-12T16:17:17.375 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.00686507, 2024-09-12T16:17:17.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0081649099999999992, 2024-09-12T16:17:17.376 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.376 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.376 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.376 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.376 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.376 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.376 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 777 2024-09-12T16:17:17.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.376 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.376 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271110+0000", 2024-09-12T16:17:17.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271110+0000", 2024-09-12T16:17:17.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271110+0000", 2024-09-12T16:17:17.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2e-07 2024-09-12T16:17:17.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.378 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.378 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271112+0000", 2024-09-12T16:17:17.378 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9309999999999998e-06 2024-09-12T16:17:17.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.378 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.378 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271118+0000", 2024-09-12T16:17:17.378 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6679999999999998e-06 2024-09-12T16:17:17.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.378 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.378 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271123+0000", 2024-09-12T16:17:17.378 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0590000000000002e-06 2024-09-12T16:17:17.379 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.379 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.379 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.379 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:841 3.0 3.f3c0e780 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.379 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.272959+0000", 2024-09-12T16:17:17.379 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.005015813, 2024-09-12T16:17:17.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0063630960000000004, 2024-09-12T16:17:17.379 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.379 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.379 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.380 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.380 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.380 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.380 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 841 2024-09-12T16:17:17.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.380 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272959+0000", 2024-09-12T16:17:17.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272959+0000", 2024-09-12T16:17:17.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.381 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272959+0000", 2024-09-12T16:17:17.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.77e-07 2024-09-12T16:17:17.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.381 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272973+0000", 2024-09-12T16:17:17.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3369e-05 2024-09-12T16:17:17.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272980+0000", 2024-09-12T16:17:17.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1409999999999999e-06 2024-09-12T16:17:17.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272985+0000", 2024-09-12T16:17:17.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.417e-06 2024-09-12T16:17:17.382 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.382 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.382 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.383 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:778 3.0 3.876ae580 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.383 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.271132+0000", 2024-09-12T16:17:17.383 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.006842707, 2024-09-12T16:17:17.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0082380530000000004, 2024-09-12T16:17:17.383 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.383 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.383 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.383 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.383 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.383 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.384 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 778 2024-09-12T16:17:17.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.384 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271132+0000", 2024-09-12T16:17:17.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271132+0000", 2024-09-12T16:17:17.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.385 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.385 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271132+0000", 2024-09-12T16:17:17.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4000000000000002e-07 2024-09-12T16:17:17.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.385 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.385 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271135+0000", 2024-09-12T16:17:17.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1600000000000001e-06 2024-09-12T16:17:17.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.385 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.385 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271141+0000", 2024-09-12T16:17:17.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9669999999999998e-06 2024-09-12T16:17:17.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.386 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271145+0000", 2024-09-12T16:17:17.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8219999999999997e-06 2024-09-12T16:17:17.386 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.386 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.386 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.387 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:842 3.0 3.f3c0e780 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.387 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.272993+0000", 2024-09-12T16:17:17.387 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.004981587, 2024-09-12T16:17:17.387 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0064257569999999998, 2024-09-12T16:17:17.387 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.387 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.387 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.387 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.387 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.387 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.387 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 842 2024-09-12T16:17:17.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.387 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272993+0000", 2024-09-12T16:17:17.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272993+0000", 2024-09-12T16:17:17.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272994+0000", 2024-09-12T16:17:17.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9299999999999998e-07 2024-09-12T16:17:17.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.389 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.389 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272996+0000", 2024-09-12T16:17:17.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.176e-06 2024-09-12T16:17:17.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.389 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.389 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273003+0000", 2024-09-12T16:17:17.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.759e-06 2024-09-12T16:17:17.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.389 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.389 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273008+0000", 2024-09-12T16:17:17.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2989999999999996e-06 2024-09-12T16:17:17.390 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.390 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.390 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.390 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:779 3.0 3.876ae580 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.390 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.271152+0000", 2024-09-12T16:17:17.390 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0068229390000000001, 2024-09-12T16:17:17.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0083138350000000003, 2024-09-12T16:17:17.390 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.390 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.390 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.390 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.390 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.391 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.391 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 779 2024-09-12T16:17:17.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.391 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.391 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.391 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271152+0000", 2024-09-12T16:17:17.391 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.391 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.391 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271152+0000", 2024-09-12T16:17:17.391 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.392 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.392 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271152+0000", 2024-09-12T16:17:17.392 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.77e-07 2024-09-12T16:17:17.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.392 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.392 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271154+0000", 2024-09-12T16:17:17.392 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9429999999999999e-06 2024-09-12T16:17:17.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.393 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.393 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.393 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271160+0000", 2024-09-12T16:17:17.393 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9460000000000003e-06 2024-09-12T16:17:17.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.393 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.393 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.393 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271165+0000", 2024-09-12T16:17:17.393 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4900000000000002e-06 2024-09-12T16:17:17.393 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.393 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.393 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.393 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.394 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:843 3.0 3.f3c0e780 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.394 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.273014+0000", 2024-09-12T16:17:17.394 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0049604580000000001, 2024-09-12T16:17:17.394 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.006499299, 2024-09-12T16:17:17.394 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.394 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.394 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.394 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.394 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.394 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.394 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 843 2024-09-12T16:17:17.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.394 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.395 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.395 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273014+0000", 2024-09-12T16:17:17.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.395 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.395 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273014+0000", 2024-09-12T16:17:17.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.395 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.395 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273015+0000", 2024-09-12T16:17:17.396 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9200000000000002e-07 2024-09-12T16:17:17.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.396 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.396 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273017+0000", 2024-09-12T16:17:17.396 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1320000000000001e-06 2024-09-12T16:17:17.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.396 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.396 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273023+0000", 2024-09-12T16:17:17.396 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0769999999999996e-06 2024-09-12T16:17:17.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.396 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.397 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273028+0000", 2024-09-12T16:17:17.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2220000000000001e-06 2024-09-12T16:17:17.397 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.397 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.397 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.397 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:780 3.0 3.876ae580 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.397 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.271855+0000", 2024-09-12T16:17:17.397 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.006120009, 2024-09-12T16:17:17.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0077069540000000002, 2024-09-12T16:17:17.397 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.397 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.397 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.397 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.398 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.398 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.398 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 780 2024-09-12T16:17:17.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.398 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271855+0000", 2024-09-12T16:17:17.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271855+0000", 2024-09-12T16:17:17.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.399 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271855+0000", 2024-09-12T16:17:17.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8999999999999996e-07 2024-09-12T16:17:17.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.399 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271859+0000", 2024-09-12T16:17:17.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8940000000000003e-06 2024-09-12T16:17:17.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.399 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271868+0000", 2024-09-12T16:17:17.400 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4260000000000003e-06 2024-09-12T16:17:17.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.400 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.400 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271874+0000", 2024-09-12T16:17:17.400 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1240000000000002e-06 2024-09-12T16:17:17.400 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.400 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.400 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.400 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:844 3.0 3.f3c0e780 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.400 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.273034+0000", 2024-09-12T16:17:17.401 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0049404849999999997, 2024-09-12T16:17:17.401 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0065756219999999997, 2024-09-12T16:17:17.401 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.401 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.401 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.401 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.401 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.401 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.401 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 844 2024-09-12T16:17:17.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.401 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.401 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273034+0000", 2024-09-12T16:17:17.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273034+0000", 2024-09-12T16:17:17.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273035+0000", 2024-09-12T16:17:17.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4700000000000002e-07 2024-09-12T16:17:17.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273037+0000", 2024-09-12T16:17:17.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0889999999999998e-06 2024-09-12T16:17:17.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273042+0000", 2024-09-12T16:17:17.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6810000000000003e-06 2024-09-12T16:17:17.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273047+0000", 2024-09-12T16:17:17.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6840000000000004e-06 2024-09-12T16:17:17.403 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.403 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.404 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.404 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:781 3.0 3.876ae580 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.404 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.271882+0000", 2024-09-12T16:17:17.404 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0060927530000000002, 2024-09-12T16:17:17.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0077758799999999998, 2024-09-12T16:17:17.404 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.404 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.404 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.404 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.404 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.405 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.405 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 781 2024-09-12T16:17:17.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.405 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.405 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.405 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271882+0000", 2024-09-12T16:17:17.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.405 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.405 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271882+0000", 2024-09-12T16:17:17.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.406 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271882+0000", 2024-09-12T16:17:17.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9799999999999999e-07 2024-09-12T16:17:17.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.406 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271885+0000", 2024-09-12T16:17:17.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.571e-06 2024-09-12T16:17:17.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.407 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271891+0000", 2024-09-12T16:17:17.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0090000000000004e-06 2024-09-12T16:17:17.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.407 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271896+0000", 2024-09-12T16:17:17.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0749999999999997e-06 2024-09-12T16:17:17.407 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.407 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.407 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.408 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:845 3.0 3.f3c0e780 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.408 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.273054+0000", 2024-09-12T16:17:17.408 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0049211560000000003, 2024-09-12T16:17:17.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0066990979999999997, 2024-09-12T16:17:17.408 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.408 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.408 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.408 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.408 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.408 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.408 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 845 2024-09-12T16:17:17.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.409 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273054+0000", 2024-09-12T16:17:17.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273054+0000", 2024-09-12T16:17:17.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273054+0000", 2024-09-12T16:17:17.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4499999999999998e-07 2024-09-12T16:17:17.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273056+0000", 2024-09-12T16:17:17.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1660000000000001e-06 2024-09-12T16:17:17.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273062+0000", 2024-09-12T16:17:17.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1940000000000003e-06 2024-09-12T16:17:17.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273067+0000", 2024-09-12T16:17:17.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8919999999999999e-06 2024-09-12T16:17:17.414 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.414 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.414 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.414 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:782 3.0 3.876ae580 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.414 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.271903+0000", 2024-09-12T16:17:17.414 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0060713980000000004, 2024-09-12T16:17:17.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0078979749999999998, 2024-09-12T16:17:17.414 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.414 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.414 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.414 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.415 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.415 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.415 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 782 2024-09-12T16:17:17.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.415 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.415 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271903+0000", 2024-09-12T16:17:17.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.415 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271903+0000", 2024-09-12T16:17:17.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.416 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271904+0000", 2024-09-12T16:17:17.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2800000000000002e-07 2024-09-12T16:17:17.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.416 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271906+0000", 2024-09-12T16:17:17.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2110000000000001e-06 2024-09-12T16:17:17.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.417 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.417 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271912+0000", 2024-09-12T16:17:17.417 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2319999999999998e-06 2024-09-12T16:17:17.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.417 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.417 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271922+0000", 2024-09-12T16:17:17.417 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5219999999999996e-06 2024-09-12T16:17:17.417 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.417 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.417 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.418 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:846 3.0 3.f3c0e780 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.418 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.273079+0000", 2024-09-12T16:17:17.418 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0048954879999999999, 2024-09-12T16:17:17.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0067751570000000004, 2024-09-12T16:17:17.418 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.418 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.418 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.418 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.418 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.418 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.418 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 846 2024-09-12T16:17:17.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.419 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.419 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273079+0000", 2024-09-12T16:17:17.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.419 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273079+0000", 2024-09-12T16:17:17.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273080+0000", 2024-09-12T16:17:17.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0699999999999998e-07 2024-09-12T16:17:17.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273082+0000", 2024-09-12T16:17:17.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2220000000000001e-06 2024-09-12T16:17:17.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273088+0000", 2024-09-12T16:17:17.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3040000000000001e-06 2024-09-12T16:17:17.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273093+0000", 2024-09-12T16:17:17.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0769999999999998e-06 2024-09-12T16:17:17.421 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.421 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.421 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.421 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:783 3.0 3.876ae580 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.421 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.271930+0000", 2024-09-12T16:17:17.421 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0060450180000000001, 2024-09-12T16:17:17.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0079722590000000006, 2024-09-12T16:17:17.422 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.422 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.422 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.422 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.422 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.422 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.422 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 783 2024-09-12T16:17:17.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.422 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.422 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.422 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271930+0000", 2024-09-12T16:17:17.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.423 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.423 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271930+0000", 2024-09-12T16:17:17.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.423 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.423 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271930+0000", 2024-09-12T16:17:17.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5000000000000002e-07 2024-09-12T16:17:17.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.423 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.423 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271933+0000", 2024-09-12T16:17:17.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4779999999999998e-06 2024-09-12T16:17:17.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.424 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.424 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271939+0000", 2024-09-12T16:17:17.424 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2430000000000002e-06 2024-09-12T16:17:17.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.424 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.424 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271944+0000", 2024-09-12T16:17:17.424 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0679999999999996e-06 2024-09-12T16:17:17.424 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.424 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.424 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.425 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:848 3.0 3.f3c0e780 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.425 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.273100+0000", 2024-09-12T16:17:17.425 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0048744670000000004, 2024-09-12T16:17:17.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0068653919999999997, 2024-09-12T16:17:17.425 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.425 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.425 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.425 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.425 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.425 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.425 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 848 2024-09-12T16:17:17.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.425 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273100+0000", 2024-09-12T16:17:17.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273100+0000", 2024-09-12T16:17:17.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273101+0000", 2024-09-12T16:17:17.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.08e-07 2024-09-12T16:17:17.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273103+0000", 2024-09-12T16:17:17.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2220000000000001e-06 2024-09-12T16:17:17.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273109+0000", 2024-09-12T16:17:17.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5010000000000001e-06 2024-09-12T16:17:17.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273114+0000", 2024-09-12T16:17:17.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0200000000000002e-06 2024-09-12T16:17:17.427 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.428 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.428 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.428 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.428 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:784 3.0 3.876ae580 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.428 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.271951+0000", 2024-09-12T16:17:17.428 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0060233079999999998, 2024-09-12T16:17:17.428 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0080634520000000005, 2024-09-12T16:17:17.428 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.428 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.428 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.428 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.428 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.428 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.428 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 784 2024-09-12T16:17:17.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.429 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.429 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.429 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271951+0000", 2024-09-12T16:17:17.429 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.429 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.429 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271951+0000", 2024-09-12T16:17:17.429 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.429 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.429 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271952+0000", 2024-09-12T16:17:17.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9499999999999998e-07 2024-09-12T16:17:17.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.430 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271954+0000", 2024-09-12T16:17:17.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0389999999999999e-06 2024-09-12T16:17:17.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.430 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271960+0000", 2024-09-12T16:17:17.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9800000000000003e-06 2024-09-12T16:17:17.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271965+0000", 2024-09-12T16:17:17.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.057e-06 2024-09-12T16:17:17.431 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.431 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.431 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.431 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:850 3.0 3.f3c0e780 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.431 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.273121+0000", 2024-09-12T16:17:17.431 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0048542109999999998, 2024-09-12T16:17:17.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0069765110000000003, 2024-09-12T16:17:17.431 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.432 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.432 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.432 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.432 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.432 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.432 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 850 2024-09-12T16:17:17.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.432 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273121+0000", 2024-09-12T16:17:17.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273121+0000", 2024-09-12T16:17:17.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273121+0000", 2024-09-12T16:17:17.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8000000000000001e-07 2024-09-12T16:17:17.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273123+0000", 2024-09-12T16:17:17.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.951e-06 2024-09-12T16:17:17.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.434 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.434 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273129+0000", 2024-09-12T16:17:17.434 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9800000000000003e-06 2024-09-12T16:17:17.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.434 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.434 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273134+0000", 2024-09-12T16:17:17.434 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1329999999999998e-06 2024-09-12T16:17:17.434 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.434 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.434 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.435 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:785 3.0 3.876ae580 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.435 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.271971+0000", 2024-09-12T16:17:17.435 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0060036050000000004, 2024-09-12T16:17:17.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0081882910000000003, 2024-09-12T16:17:17.435 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.435 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.435 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.435 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.435 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.435 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.435 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 785 2024-09-12T16:17:17.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.436 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271971+0000", 2024-09-12T16:17:17.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271971+0000", 2024-09-12T16:17:17.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.437 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271972+0000", 2024-09-12T16:17:17.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0400000000000002e-07 2024-09-12T16:17:17.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.437 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271983+0000", 2024-09-12T16:17:17.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1571e-05 2024-09-12T16:17:17.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.437 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271990+0000", 2024-09-12T16:17:17.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8750000000000002e-06 2024-09-12T16:17:17.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.438 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.438 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.271996+0000", 2024-09-12T16:17:17.438 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.767e-06 2024-09-12T16:17:17.438 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.438 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.438 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.438 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:851 3.0 3.f3c0e780 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.438 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.273140+0000", 2024-09-12T16:17:17.438 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0048343960000000004, 2024-09-12T16:17:17.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0071009189999999998, 2024-09-12T16:17:17.439 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.439 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.439 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.439 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.439 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.439 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.439 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 851 2024-09-12T16:17:17.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.439 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.439 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.439 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273140+0000", 2024-09-12T16:17:17.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.440 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.440 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273140+0000", 2024-09-12T16:17:17.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.440 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.440 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273141+0000", 2024-09-12T16:17:17.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3599999999999999e-07 2024-09-12T16:17:17.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.440 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.440 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273143+0000", 2024-09-12T16:17:17.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.013e-06 2024-09-12T16:17:17.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.441 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.441 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273149+0000", 2024-09-12T16:17:17.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1099999999999999e-06 2024-09-12T16:17:17.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.441 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.441 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.273154+0000", 2024-09-12T16:17:17.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.78e-06 2024-09-12T16:17:17.441 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.441 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.441 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.442 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:804 3.0 3.f3c0e780 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.442 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.272003+0000", 2024-09-12T16:17:17.442 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0059715000000000002, 2024-09-12T16:17:17.442 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0082997420000000006, 2024-09-12T16:17:17.442 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.442 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.442 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.442 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.442 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.442 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.442 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 804 2024-09-12T16:17:17.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.442 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.443 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.443 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272003+0000", 2024-09-12T16:17:17.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.443 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.443 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272003+0000", 2024-09-12T16:17:17.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.443 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.443 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272004+0000", 2024-09-12T16:17:17.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9299999999999999e-07 2024-09-12T16:17:17.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.444 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272006+0000", 2024-09-12T16:17:17.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0480000000000001e-06 2024-09-12T16:17:17.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.444 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272012+0000", 2024-09-12T16:17:17.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.302e-06 2024-09-12T16:17:17.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.444 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272017+0000", 2024-09-12T16:17:17.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8790000000000002e-06 2024-09-12T16:17:17.445 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.445 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.445 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.445 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:807 3.0 3.f3c0e780 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.445 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.272023+0000", 2024-09-12T16:17:17.445 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0059512760000000001, 2024-09-12T16:17:17.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0083395220000000003, 2024-09-12T16:17:17.445 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.445 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.446 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.446 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.446 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.446 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.446 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 807 2024-09-12T16:17:17.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.446 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.446 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.446 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272023+0000", 2024-09-12T16:17:17.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.446 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.446 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272023+0000", 2024-09-12T16:17:17.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.447 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.447 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272024+0000", 2024-09-12T16:17:17.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6800000000000001e-07 2024-09-12T16:17:17.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.447 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.447 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272026+0000", 2024-09-12T16:17:17.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.888e-06 2024-09-12T16:17:17.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.447 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.447 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272032+0000", 2024-09-12T16:17:17.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9909999999999999e-06 2024-09-12T16:17:17.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.448 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.448 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272036+0000", 2024-09-12T16:17:17.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4900000000000002e-06 2024-09-12T16:17:17.448 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.448 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.448 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.448 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:808 3.0 3.f3c0e780 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.449 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.272042+0000", 2024-09-12T16:17:17.449 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0059323479999999996, 2024-09-12T16:17:17.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0083745989999999999, 2024-09-12T16:17:17.449 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.449 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.449 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.449 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.449 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.449 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.449 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 808 2024-09-12T16:17:17.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.449 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.449 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.449 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272042+0000", 2024-09-12T16:17:17.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272042+0000", 2024-09-12T16:17:17.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272043+0000", 2024-09-12T16:17:17.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5400000000000002e-07 2024-09-12T16:17:17.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272045+0000", 2024-09-12T16:17:17.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.967e-06 2024-09-12T16:17:17.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272051+0000", 2024-09-12T16:17:17.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9479999999999996e-06 2024-09-12T16:17:17.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272055+0000", 2024-09-12T16:17:17.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7230000000000004e-06 2024-09-12T16:17:17.451 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.451 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.451 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.452 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:809 3.0 3.f3c0e780 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.452 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.272062+0000", 2024-09-12T16:17:17.452 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0059128999999999996, 2024-09-12T16:17:17.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0084037409999999993, 2024-09-12T16:17:17.452 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.452 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.452 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.452 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.452 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.452 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.452 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 809 2024-09-12T16:17:17.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.452 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272062+0000", 2024-09-12T16:17:17.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272062+0000", 2024-09-12T16:17:17.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272062+0000", 2024-09-12T16:17:17.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8500000000000002e-07 2024-09-12T16:17:17.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272064+0000", 2024-09-12T16:17:17.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9649999999999998e-06 2024-09-12T16:17:17.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272070+0000", 2024-09-12T16:17:17.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2650000000000002e-06 2024-09-12T16:17:17.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272075+0000", 2024-09-12T16:17:17.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5560000000000001e-06 2024-09-12T16:17:17.455 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.455 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.455 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.456 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:811 3.0 3.f3c0e780 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.456 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.272082+0000", 2024-09-12T16:17:17.456 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0058932089999999999, 2024-09-12T16:17:17.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0084374099999999994, 2024-09-12T16:17:17.456 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.456 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.456 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.456 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.456 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.457 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.457 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 811 2024-09-12T16:17:17.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.457 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272082+0000", 2024-09-12T16:17:17.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272082+0000", 2024-09-12T16:17:17.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272082+0000", 2024-09-12T16:17:17.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6699999999999999e-07 2024-09-12T16:17:17.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272084+0000", 2024-09-12T16:17:17.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0360000000000001e-06 2024-09-12T16:17:17.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272090+0000", 2024-09-12T16:17:17.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9100000000000002e-06 2024-09-12T16:17:17.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272095+0000", 2024-09-12T16:17:17.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8779999999999997e-06 2024-09-12T16:17:17.460 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.460 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.460 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.460 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:812 3.0 3.f3c0e780 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.460 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.272101+0000", 2024-09-12T16:17:17.460 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0058734360000000001, 2024-09-12T16:17:17.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0084664159999999992, 2024-09-12T16:17:17.460 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.460 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.461 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.461 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.461 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.461 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.461 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 812 2024-09-12T16:17:17.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.461 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.461 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272101+0000", 2024-09-12T16:17:17.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272101+0000", 2024-09-12T16:17:17.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272102+0000", 2024-09-12T16:17:17.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.96e-07 2024-09-12T16:17:17.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.463 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272104+0000", 2024-09-12T16:17:17.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2180000000000002e-06 2024-09-12T16:17:17.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.463 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.463 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272110+0000", 2024-09-12T16:17:17.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1240000000000002e-06 2024-09-12T16:17:17.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.463 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.463 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272115+0000", 2024-09-12T16:17:17.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1780000000000002e-06 2024-09-12T16:17:17.464 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.464 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.464 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.464 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:816 3.0 3.f3c0e780 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.464 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.272121+0000", 2024-09-12T16:17:17.464 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0058532580000000001, 2024-09-12T16:17:17.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0084993269999999992, 2024-09-12T16:17:17.464 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.464 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.465 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.465 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.465 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.465 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.465 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 816 2024-09-12T16:17:17.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.465 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272121+0000", 2024-09-12T16:17:17.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272121+0000", 2024-09-12T16:17:17.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272122+0000", 2024-09-12T16:17:17.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1899999999999998e-07 2024-09-12T16:17:17.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.467 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.467 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272124+0000", 2024-09-12T16:17:17.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0789999999999999e-06 2024-09-12T16:17:17.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.467 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.467 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272130+0000", 2024-09-12T16:17:17.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9240000000000004e-06 2024-09-12T16:17:17.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.467 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.467 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272134+0000", 2024-09-12T16:17:17.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.437e-06 2024-09-12T16:17:17.468 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.468 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.468 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.468 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:818 3.0 3.f3c0e780 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-12T16:17:17.468 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:17.272141+0000", 2024-09-12T16:17:17.468 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0058340700000000002, 2024-09-12T16:17:17.468 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0085286240000000003, 2024-09-12T16:17:17.468 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:17.468 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:17.469 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:17.469 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:17.469 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:17.469 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:17.469 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 818 2024-09-12T16:17:17.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.469 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:17.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.469 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:17.469 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272141+0000", 2024-09-12T16:17:17.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:17.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272141+0000", 2024-09-12T16:17:17.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:17.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:17.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272141+0000", 2024-09-12T16:17:17.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5100000000000001e-07 2024-09-12T16:17:17.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:17.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272143+0000", 2024-09-12T16:17:17.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.339e-06 2024-09-12T16:17:17.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:17.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272149+0000", 2024-09-12T16:17:17.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9699999999999996e-06 2024-09-12T16:17:17.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:17.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:17.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:17.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:17.272155+0000", 2024-09-12T16:17:17.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.169e-06 2024-09-12T16:17:17.472 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.472 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:17.472 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.472 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:17.472 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-12T16:17:17.472 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 51 2024-09-12T16:17:17.472 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:17.474 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:17.472+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:17.475 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:17:17.477 INFO:teuthology.orchestra.run.smithi204.stdout:3990 read 0x3e80800 thru 0x3e8eaf3 (0xe2f4 bytes) 2024-09-12T16:17:17.477 INFO:teuthology.orchestra.run.smithi204.stdout:3993 write 0x727f000 thru 0x7289ec7 (0xaec8 bytes) 2024-09-12T16:17:17.477 INFO:teuthology.orchestra.run.smithi204.stdout:3995 read 0xe8d000 thru 0xe8f358 (0x2359 bytes) 2024-09-12T16:17:17.477 INFO:teuthology.orchestra.run.smithi204.stdout:3999 punch from 0x31a8800 to 0x31b5200, (0xca00 bytes) 2024-09-12T16:17:17.478 INFO:teuthology.orchestra.run.smithi204.stdout:4000 punch from 0x725ce00 to 0x7269a00, (0xcc00 bytes) 2024-09-12T16:17:17.478 INFO:teuthology.orchestra.run.smithi204.stdout:4001 write 0xb1a6e00 thru 0xb1ae1a9 (0x73aa bytes) 2024-09-12T16:17:17.478 INFO:teuthology.orchestra.run.smithi204.stdout:4003 punch from 0x2331a00 to 0x2338e00, (0x7400 bytes) 2024-09-12T16:17:17.478 INFO:teuthology.orchestra.run.smithi204.stdout:4006 read 0x7f76e00 thru 0x7f7762f (0x830 bytes) 2024-09-12T16:17:17.478 INFO:teuthology.orchestra.run.smithi204.stdout:4008 write 0x2812e00 thru 0x281b23f (0x8440 bytes) 2024-09-12T16:17:17.478 INFO:teuthology.orchestra.run.smithi204.stdout:4010 read 0x1f30c00 thru 0x1f31e3a (0x123b bytes) 2024-09-12T16:17:17.478 INFO:teuthology.orchestra.run.smithi204.stdout:4013 read 0x3042a00 thru 0x3045445 (0x2a46 bytes) 2024-09-12T16:17:17.478 INFO:teuthology.orchestra.run.smithi204.stdout:4014 trunc from 0xb1ae200 to 0x77f0600 2024-09-12T16:17:17.479 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-12T16:17:17.479 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:17:17.480 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:17:17.480 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:17:17.480 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:17:17.481 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:17:17.481 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:17:17.481 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:17:17.481 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:17:17.482 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:17:17.482 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:17:17.482 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:17:17.483 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:17:17.574 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:17.573+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:17.626 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:17.626 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:17.635 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:17:17.677 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:17.676+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:17.776 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:17.775+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:17.783 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:17.783 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:17.791 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:17:17.877 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:17.876+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:17.899 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:17.899 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:17.907 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:17:17.977 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:17.977+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:18.001 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.1 to 1 (10000) 2024-09-12T16:17:18.016 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-12T16:17:18.017 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:18.017 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:18.026 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:17:18.079 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:18.077+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:18.179 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:18.179 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:18.180 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:18.179+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:18.188 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:17:18.280 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:18.279+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:18.308 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:18.308 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:18.317 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:17:18.381 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:18.380+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:18.425 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:18.425 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:18.434 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:17:18.518 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:18.517+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:18.582 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:18.582 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:18.583 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:18.582+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:18.590 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:17:18.683 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:18.682+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:18.737 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:18.737 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:18.746 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:17:18.784 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:18.783+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:18.852 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:18.852 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:18.861 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:17:18.885 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:18.885+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:18.968 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:18.969 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:18.977 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:17:18.986 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:18.986+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:19.002 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.2 to 1 (10000) 2024-09-12T16:17:19.026 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-12T16:17:19.039 INFO:teuthology.orchestra.run.smithi204.stdout:4015 read 0x24c9e00 thru 0x24d67ba (0xc9bb bytes) 2024-09-12T16:17:19.039 INFO:teuthology.orchestra.run.smithi204.stdout:4017 write 0x3ca0800 thru 0x3ca42ae (0x3aaf bytes) 2024-09-12T16:17:19.046 INFO:teuthology.orchestra.run.smithi204.stdout:4019 trunc from 0x77f0600 to 0x3ed7400 2024-09-12T16:17:19.082 INFO:teuthology.orchestra.run.smithi204.stdout:4020 read 0x3129a00 thru 0x3132f96 (0x9597 bytes) 2024-09-12T16:17:19.083 INFO:teuthology.orchestra.run.smithi204.stdout:4023 read 0x304800 thru 0x304d48 (0x549 bytes) 2024-09-12T16:17:19.103 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:19.103 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:19.108 INFO:teuthology.orchestra.run.smithi204.stdout:4024 write 0xc681c00 thru 0xc684242 (0x2643 bytes) 2024-09-12T16:17:19.111 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:19.110+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:19.112 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:17:19.115 INFO:teuthology.orchestra.run.smithi204.stdout:4025 write 0x5198400 thru 0x51a52ef (0xcef0 bytes) 2024-09-12T16:17:19.115 INFO:teuthology.orchestra.run.smithi204.stdout:4026 read 0xaad6a00 thru 0xaae3b11 (0xd112 bytes) 2024-09-12T16:17:19.129 INFO:teuthology.orchestra.run.smithi204.stdout:4028 trunc from 0xc684400 to 0x165f800 2024-09-12T16:17:19.175 INFO:teuthology.orchestra.run.smithi204.stdout:4029 punch from 0xbc00 to 0x16400, (0xa800 bytes) 2024-09-12T16:17:19.180 INFO:teuthology.orchestra.run.smithi204.stdout:4031 read 0x800800 thru 0x80df9b (0xd79c bytes) 2024-09-12T16:17:19.181 INFO:teuthology.orchestra.run.smithi204.stdout:4033 read 0xe8600 thru 0xef154 (0x6b55 bytes) 2024-09-12T16:17:19.189 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:19.188+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:19.224 INFO:teuthology.orchestra.run.smithi204.stdout:4034 punch from 0x1611200 to 0x1617800, (0x6600 bytes) 2024-09-12T16:17:19.224 INFO:teuthology.orchestra.run.smithi204.stdout:4035 read 0xe45000 thru 0xe48eb6 (0x3eb7 bytes) 2024-09-12T16:17:19.240 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:19.240 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:19.245 INFO:teuthology.orchestra.run.smithi204.stdout:4036 write 0x3b58c00 thru 0x3b65785 (0xcb86 bytes) 2024-09-12T16:17:19.248 INFO:teuthology.orchestra.run.smithi204.stdout:4037 punch from 0x14cbe00 to 0x14cf400, (0x3600 bytes) 2024-09-12T16:17:19.249 INFO:teuthology.orchestra.run.smithi204.stdout:4038 punch from 0xf41a00 to 0xf45a00, (0x4000 bytes) 2024-09-12T16:17:19.251 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:17:19.253 INFO:teuthology.orchestra.run.smithi204.stdout:4041 trunc from 0x3b65800 to 0x809e800 2024-09-12T16:17:19.276 INFO:teuthology.orchestra.run.smithi204.stdout:4042 read 0x7317a00 thru 0x731ae7d (0x347e bytes) 2024-09-12T16:17:19.277 INFO:teuthology.orchestra.run.smithi204.stdout:4043 write 0x42fda00 thru 0x430163d (0x3c3e bytes) 2024-09-12T16:17:19.277 INFO:teuthology.orchestra.run.smithi204.stdout:4044 read 0x1b2a000 thru 0x1b2dfa5 (0x3fa6 bytes) 2024-09-12T16:17:19.277 INFO:teuthology.orchestra.run.smithi204.stdout:4046 read 0x7fcd000 thru 0x7fd66d6 (0x96d7 bytes) 2024-09-12T16:17:19.295 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:19.294+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:19.308 INFO:teuthology.orchestra.run.smithi204.stdout:4047 write 0xbdbb000 thru 0xbdc5a2a (0xaa2b bytes) 2024-09-12T16:17:19.309 INFO:teuthology.orchestra.run.smithi204.stdout:4048 punch from 0x2a37800 to 0x2a43c00, (0xc400 bytes) 2024-09-12T16:17:19.309 INFO:teuthology.orchestra.run.smithi204.stdout:4050 read 0xafa0800 thru 0xafac6e9 (0xbeea bytes) 2024-09-12T16:17:19.309 INFO:teuthology.orchestra.run.smithi204.stdout:4053 write 0x19bae00 thru 0x19c7778 (0xc979 bytes) 2024-09-12T16:17:19.309 INFO:teuthology.orchestra.run.smithi204.stdout:4057 write 0x1184c00 thru 0x1184eab (0x2ac bytes) 2024-09-12T16:17:19.309 INFO:teuthology.orchestra.run.smithi204.stdout:4058 write 0x9e57e00 thru 0x9e6254a (0xa74b bytes) 2024-09-12T16:17:19.309 INFO:teuthology.orchestra.run.smithi204.stdout:4059 write 0x559a000 thru 0x55a82df (0xe2e0 bytes) 2024-09-12T16:17:19.309 INFO:teuthology.orchestra.run.smithi204.stdout:4060 read 0x43e6400 thru 0x43f399f (0xd5a0 bytes) 2024-09-12T16:17:19.309 INFO:teuthology.orchestra.run.smithi204.stdout:4061 punch from 0x121c400 to 0x122c200, (0xfe00 bytes) 2024-09-12T16:17:19.310 INFO:teuthology.orchestra.run.smithi204.stdout:4063 write 0x60f0800 thru 0x60febab (0xe3ac bytes) 2024-09-12T16:17:19.310 INFO:teuthology.orchestra.run.smithi204.stdout:4064 read 0xac95c00 thru 0xaca4b7f (0xef80 bytes) 2024-09-12T16:17:19.310 INFO:teuthology.orchestra.run.smithi204.stdout:4066 write 0x5fcd000 thru 0x5fd867e (0xb67f bytes) 2024-09-12T16:17:19.310 INFO:teuthology.orchestra.run.smithi204.stdout:4068 punch from 0x1da9800 to 0x1db0c00, (0x7400 bytes) 2024-09-12T16:17:19.311 INFO:teuthology.orchestra.run.smithi204.stdout:4069 punch from 0x441b600 to 0x4420600, (0x5000 bytes) 2024-09-12T16:17:19.321 INFO:teuthology.orchestra.run.smithi204.stdout:4071 trunc from 0xbdc5c00 to 0x3959e00 2024-09-12T16:17:19.375 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:19.375 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:19.384 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:17:19.385 INFO:teuthology.orchestra.run.smithi204.stdout:4072 read 0x29a4200 thru 0x29ac8df (0x86e0 bytes) 2024-09-12T16:17:19.395 INFO:teuthology.orchestra.run.smithi204.stdout:4073 trunc from 0x3959e00 to 0xc48d800 2024-09-12T16:17:19.419 INFO:teuthology.orchestra.run.smithi204.stdout:4074 read 0x8ece400 thru 0x8ed3acc (0x56cd bytes) 2024-09-12T16:17:19.419 INFO:teuthology.orchestra.run.smithi204.stdout:4077 write 0x7489600 thru 0x748abc4 (0x15c5 bytes) 2024-09-12T16:17:19.419 INFO:teuthology.orchestra.run.smithi204.stdout:4080 punch from 0x1c9bc00 to 0x1ca2000, (0x6400 bytes) 2024-09-12T16:17:19.419 INFO:teuthology.orchestra.run.smithi204.stdout:4082 write 0x65b6e00 thru 0x65bc0b3 (0x52b4 bytes) 2024-09-12T16:17:19.419 INFO:teuthology.orchestra.run.smithi204.stdout:4083 write 0xa67ea00 thru 0xa68013b (0x173c bytes) 2024-09-12T16:17:19.419 INFO:teuthology.orchestra.run.smithi204.stdout:4084 read 0x899c200 thru 0x89a134a (0x514b bytes) 2024-09-12T16:17:19.419 INFO:teuthology.orchestra.run.smithi204.stdout:4085 punch from 0xe04000 to 0xe08000, (0x4000 bytes) 2024-09-12T16:17:19.425 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:19.424+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:19.426 INFO:teuthology.orchestra.run.smithi204.stdout:4086 trunc from 0xc48d800 to 0x6135200 2024-09-12T16:17:19.449 INFO:teuthology.orchestra.run.smithi204.stdout:4088 read 0x3981e00 thru 0x39896d0 (0x78d1 bytes) 2024-09-12T16:17:19.455 INFO:teuthology.orchestra.run.smithi204.stdout:4089 trunc from 0x6135200 to 0x236ce00 2024-09-12T16:17:19.478 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T16:17:19.485 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T16:17:19.488 INFO:teuthology.orchestra.run.smithi204.stdout:4093 read 0x935a00 thru 0x93a93f (0x4f40 bytes) 2024-09-12T16:17:19.489 INFO:teuthology.orchestra.run.smithi204.stdout:4094 flatten 2024-09-12T16:17:19.491 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:19.490+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:19.550 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:19.550 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:19.564 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:17:19.610 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:19.605+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:19.694 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:19.693+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:19.766 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:17:19.766 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:17:19.784 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:19.784 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:19.784 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:17:19.784 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:17:19.784 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:19.785 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:17:19.785 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:17:19.795 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:17:19.795 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:19.793+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:19.803 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:17:19.803 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:17:19.822 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:17:19.822 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:17:19.838 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:17:19.839 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:17:19.855 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:17:19.855 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:17:19.909 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:19.908+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:19.914 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:19.914 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:17:19.914 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:17:19.914 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:17:19.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.914 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3703 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14803968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:19.914 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139513+0000", 2024-09-12T16:17:19.914 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 61.772902117999998, 2024-09-12T16:17:19.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053248794000000002, 2024-09-12T16:17:19.915 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:19.915 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:19.915 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:19.915 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:19.915 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:19.915 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:19.915 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3703 2024-09-12T16:17:19.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.915 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:19.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:19.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139513+0000", 2024-09-12T16:17:19.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:19.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:19.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139513+0000", 2024-09-12T16:17:19.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:19.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:19.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139639+0000", 2024-09-12T16:17:19.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012673299999999999 2024-09-12T16:17:19.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:19.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139642+0000", 2024-09-12T16:17:19.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4820000000000001e-06 2024-09-12T16:17:19.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:19.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139647+0000", 2024-09-12T16:17:19.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8040000000000001e-06 2024-09-12T16:17:19.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:19.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139650+0000", 2024-09-12T16:17:19.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.529e-06 2024-09-12T16:17:19.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:19.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192537+0000", 2024-09-12T16:17:19.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052886503000000001 2024-09-12T16:17:19.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:19.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192627+0000", 2024-09-12T16:17:19.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0183e-05 2024-09-12T16:17:19.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.919 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:19.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192761+0000", 2024-09-12T16:17:19.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013456000000000001 2024-09-12T16:17:19.919 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:19.919 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:19.919 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:19.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.919 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3705 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14812160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:19.920 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:17:19.920 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 61.772609866000003, 2024-09-12T16:17:19.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053368831999999998, 2024-09-12T16:17:19.920 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:19.920 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:19.920 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:19.920 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:19.920 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:19.920 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:19.920 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3705 2024-09-12T16:17:19.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.920 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:19.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:19.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:17:19.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:19.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:19.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:17:19.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:19.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:19.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139932+0000", 2024-09-12T16:17:19.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012762099999999999 2024-09-12T16:17:19.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:19.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139935+0000", 2024-09-12T16:17:19.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.119e-06 2024-09-12T16:17:19.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:19.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139939+0000", 2024-09-12T16:17:19.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7999999999999998e-06 2024-09-12T16:17:19.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:19.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139953+0000", 2024-09-12T16:17:19.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3923999999999999e-05 2024-09-12T16:17:19.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:19.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192946+0000", 2024-09-12T16:17:19.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052992971 2024-09-12T16:17:19.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:19.924 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193035+0000", 2024-09-12T16:17:19.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9040000000000001e-05 2024-09-12T16:17:19.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.924 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:19.924 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193174+0000", 2024-09-12T16:17:19.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138357 2024-09-12T16:17:19.924 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:19.924 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:19.924 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:19.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.925 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3706 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14816256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:19.925 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:17:19.925 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 61.772454875999998, 2024-09-12T16:17:19.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053341723000000001, 2024-09-12T16:17:19.925 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:19.925 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:19.925 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:19.925 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:19.925 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:19.925 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:19.926 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3706 2024-09-12T16:17:19.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.926 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:19.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:19.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:17:19.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:19.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:19.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:17:19.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:19.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:19.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140090+0000", 2024-09-12T16:17:19.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013020100000000001 2024-09-12T16:17:19.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:19.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140097+0000", 2024-09-12T16:17:19.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0709999999999997e-06 2024-09-12T16:17:19.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.928 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:19.928 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140103+0000", 2024-09-12T16:17:19.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5450000000000003e-06 2024-09-12T16:17:19.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.928 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:19.928 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140106+0000", 2024-09-12T16:17:19.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3739999999999998e-06 2024-09-12T16:17:19.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.929 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:19.929 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193190+0000", 2024-09-12T16:17:19.929 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053084131999999999 2024-09-12T16:17:19.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.929 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:19.929 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193232+0000", 2024-09-12T16:17:19.929 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1517000000000002e-05 2024-09-12T16:17:19.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:19.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193302+0000", 2024-09-12T16:17:19.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9882999999999995e-05 2024-09-12T16:17:19.930 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:19.930 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:19.930 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:19.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.930 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3707 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14820352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:19.930 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:17:19.931 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 61.772302887000002, 2024-09-12T16:17:19.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053452771000000003, 2024-09-12T16:17:19.931 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:19.931 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:19.931 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:19.931 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:19.931 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:19.932 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:19.932 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3707 2024-09-12T16:17:19.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.932 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:19.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.932 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:19.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:17:19.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:19.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.932 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:19.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:17:19.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:19.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:19.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140219+0000", 2024-09-12T16:17:19.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106902 2024-09-12T16:17:19.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:19.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140225+0000", 2024-09-12T16:17:19.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3199999999999996e-06 2024-09-12T16:17:19.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:19.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140230+0000", 2024-09-12T16:17:19.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8969999999999999e-06 2024-09-12T16:17:19.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:19.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140233+0000", 2024-09-12T16:17:19.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2119999999999999e-06 2024-09-12T16:17:19.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.935 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:19.935 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193339+0000", 2024-09-12T16:17:19.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053105556999999998 2024-09-12T16:17:19.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.935 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:19.935 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193431+0000", 2024-09-12T16:17:19.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1837999999999997e-05 2024-09-12T16:17:19.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.936 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:19.936 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193565+0000", 2024-09-12T16:17:19.936 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013404500000000001 2024-09-12T16:17:19.936 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:19.936 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:19.936 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:19.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.936 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3708 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14824448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:19.936 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:17:19.936 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 61.772174045, 2024-09-12T16:17:19.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053468190999999998, 2024-09-12T16:17:19.937 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:19.937 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:19.937 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:19.937 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:19.937 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:19.937 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:19.937 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3708 2024-09-12T16:17:19.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.937 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:19.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:19.937 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:17:19.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:19.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:19.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:17:19.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:19.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:19.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140351+0000", 2024-09-12T16:17:19.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110096 2024-09-12T16:17:19.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:19.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140358+0000", 2024-09-12T16:17:19.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.306e-06 2024-09-12T16:17:19.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:19.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140368+0000", 2024-09-12T16:17:19.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0225e-05 2024-09-12T16:17:19.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:19.940 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140372+0000", 2024-09-12T16:17:19.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6169999999999998e-06 2024-09-12T16:17:19.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:19.940 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193594+0000", 2024-09-12T16:17:19.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053222419999999999 2024-09-12T16:17:19.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:19.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193640+0000", 2024-09-12T16:17:19.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.587e-05 2024-09-12T16:17:19.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.941 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:19.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193709+0000", 2024-09-12T16:17:19.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8657000000000004e-05 2024-09-12T16:17:19.941 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:19.941 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:19.941 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:19.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.942 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3709 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14828544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:19.942 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:17:19.943 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 61.772037077, 2024-09-12T16:17:19.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594033999999999, 2024-09-12T16:17:19.943 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:19.943 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:19.943 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:19.943 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:19.943 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:19.943 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:19.943 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3709 2024-09-12T16:17:19.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.943 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:19.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:19.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:17:19.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:19.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:19.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:17:19.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:19.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:19.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140499+0000", 2024-09-12T16:17:19.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121019 2024-09-12T16:17:19.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:19.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140501+0000", 2024-09-12T16:17:19.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2369999999999999e-06 2024-09-12T16:17:19.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:19.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140506+0000", 2024-09-12T16:17:19.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.639e-06 2024-09-12T16:17:19.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:19.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140509+0000", 2024-09-12T16:17:19.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3419999999999999e-06 2024-09-12T16:17:19.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:19.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193743+0000", 2024-09-12T16:17:19.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053234311999999999 2024-09-12T16:17:19.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:19.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193833+0000", 2024-09-12T16:17:19.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9883999999999995e-05 2024-09-12T16:17:19.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:19.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193972+0000", 2024-09-12T16:17:19.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138601 2024-09-12T16:17:19.947 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:19.947 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:19.947 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:19.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.947 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3710 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14832640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:19.947 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:17:19.947 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 61.771899730999998, 2024-09-12T16:17:19.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053607324999999997, 2024-09-12T16:17:19.947 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:19.947 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:19.947 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:19.947 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:19.948 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:19.948 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:19.948 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3710 2024-09-12T16:17:19.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.948 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:19.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:19.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:17:19.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:19.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:19.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:17:19.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:19.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:19.949 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140664+0000", 2024-09-12T16:17:19.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014918700000000001 2024-09-12T16:17:19.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:19.949 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140674+0000", 2024-09-12T16:17:19.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8379999999999997e-06 2024-09-12T16:17:19.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:19.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140694+0000", 2024-09-12T16:17:19.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0145000000000001e-05 2024-09-12T16:17:19.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:19.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140703+0000", 2024-09-12T16:17:19.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5150000000000006e-06 2024-09-12T16:17:19.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:19.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194006+0000", 2024-09-12T16:17:19.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053303370000000003 2024-09-12T16:17:19.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.951 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:19.951 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194051+0000", 2024-09-12T16:17:19.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5012000000000002e-05 2024-09-12T16:17:19.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.951 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:19.951 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194122+0000", 2024-09-12T16:17:19.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1258000000000001e-05 2024-09-12T16:17:19.951 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:19.951 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:19.951 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:19.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.952 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3711 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14836736~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:19.952 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:17:19.952 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 61.771698282999999, 2024-09-12T16:17:19.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053670799999999998, 2024-09-12T16:17:19.952 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:19.952 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:19.952 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:19.952 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:19.952 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:19.952 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:19.952 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3711 2024-09-12T16:17:19.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.952 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:19.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:19.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:17:19.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:19.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:19.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:17:19.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:19.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:19.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140782+0000", 2024-09-12T16:17:19.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5549999999999994e-05 2024-09-12T16:17:19.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:19.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140786+0000", 2024-09-12T16:17:19.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.89e-06 2024-09-12T16:17:19.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:19.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140796+0000", 2024-09-12T16:17:19.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0057e-05 2024-09-12T16:17:19.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:19.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140819+0000", 2024-09-12T16:17:19.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3005000000000001e-05 2024-09-12T16:17:19.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:19.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194159+0000", 2024-09-12T16:17:19.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053340324000000001 2024-09-12T16:17:19.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:19.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194248+0000", 2024-09-12T16:17:19.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9209000000000006e-05 2024-09-12T16:17:19.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:19.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194387+0000", 2024-09-12T16:17:19.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138765 2024-09-12T16:17:19.956 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:19.956 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:19.956 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:19.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.956 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3712 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14840832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:19.956 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:17:19.956 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 61.771583825, 2024-09-12T16:17:19.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053699068000000003, 2024-09-12T16:17:19.957 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:19.957 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:19.957 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:19.957 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:19.957 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:19.957 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:19.957 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3712 2024-09-12T16:17:19.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.957 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:19.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:19.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:17:19.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:19.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:19.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:17:19.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:19.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:19.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140900+0000", 2024-09-12T16:17:19.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9014e-05 2024-09-12T16:17:19.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:19.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140904+0000", 2024-09-12T16:17:19.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0940000000000001e-06 2024-09-12T16:17:19.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:19.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140933+0000", 2024-09-12T16:17:19.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8996000000000002e-05 2024-09-12T16:17:19.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:19.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140945+0000", 2024-09-12T16:17:19.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1909000000000001e-05 2024-09-12T16:17:19.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:19.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194415+0000", 2024-09-12T16:17:19.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053470403 2024-09-12T16:17:19.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:19.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194460+0000", 2024-09-12T16:17:19.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5145000000000002e-05 2024-09-12T16:17:19.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:19.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194530+0000", 2024-09-12T16:17:19.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9506999999999997e-05 2024-09-12T16:17:19.960 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:19.960 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:19.960 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:19.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.960 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3713 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14844928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:19.960 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:17:19.960 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 61.771450764999997, 2024-09-12T16:17:19.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053821236000000001, 2024-09-12T16:17:19.961 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:19.961 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:19.961 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:19.961 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:19.961 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:19.961 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:19.961 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3713 2024-09-12T16:17:19.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.961 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:19.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:19.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:17:19.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:19.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:19.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:17:19.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:19.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:19.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141078+0000", 2024-09-12T16:17:19.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114162 2024-09-12T16:17:19.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:19.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141090+0000", 2024-09-12T16:17:19.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.19e-05 2024-09-12T16:17:19.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.963 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:19.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141100+0000", 2024-09-12T16:17:19.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0447e-05 2024-09-12T16:17:19.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.963 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:19.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141108+0000", 2024-09-12T16:17:19.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7190000000000001e-06 2024-09-12T16:17:19.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.963 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:19.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194564+0000", 2024-09-12T16:17:19.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053455729 2024-09-12T16:17:19.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:19.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194652+0000", 2024-09-12T16:17:19.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8288999999999994e-05 2024-09-12T16:17:19.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:19.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194785+0000", 2024-09-12T16:17:19.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013299000000000001 2024-09-12T16:17:19.964 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:19.964 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:19.964 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:19.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.965 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3714 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14849024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:19.965 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:17:19.965 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 61.771294836000003, 2024-09-12T16:17:19.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053816382000000003, 2024-09-12T16:17:19.965 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:19.965 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:19.965 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:19.965 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:19.965 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:19.965 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:19.965 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3714 2024-09-12T16:17:19.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.965 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:19.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:19.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:17:19.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:19.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:19.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:17:19.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:19.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:19.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141182+0000", 2024-09-12T16:17:19.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1805999999999997e-05 2024-09-12T16:17:19.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:19.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141185+0000", 2024-09-12T16:17:19.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5930000000000002e-06 2024-09-12T16:17:19.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:19.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141194+0000", 2024-09-12T16:17:19.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5760000000000006e-06 2024-09-12T16:17:19.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:19.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141222+0000", 2024-09-12T16:17:19.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8034999999999998e-05 2024-09-12T16:17:19.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:19.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194817+0000", 2024-09-12T16:17:19.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594887000000001 2024-09-12T16:17:19.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:19.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194860+0000", 2024-09-12T16:17:19.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3714999999999997e-05 2024-09-12T16:17:19.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:19.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194936+0000", 2024-09-12T16:17:19.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5770000000000001e-05 2024-09-12T16:17:19.971 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:19.971 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:19.971 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:19.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.971 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3715 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14853120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:19.971 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:17:19.971 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 61.771171179, 2024-09-12T16:17:19.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053962307000000001, 2024-09-12T16:17:19.972 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:19.972 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:19.972 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:19.972 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:19.972 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:19.972 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:19.972 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3715 2024-09-12T16:17:19.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.972 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:17:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:17:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141417+0000", 2024-09-12T16:17:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017384099999999999 2024-09-12T16:17:19.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:19.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141422+0000", 2024-09-12T16:17:19.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7310000000000001e-06 2024-09-12T16:17:19.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:19.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141434+0000", 2024-09-12T16:17:19.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2058e-05 2024-09-12T16:17:19.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141442+0000", 2024-09-12T16:17:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7610000000000007e-06 2024-09-12T16:17:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194973+0000", 2024-09-12T16:17:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053530618000000002 2024-09-12T16:17:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195063+0000", 2024-09-12T16:17:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0927000000000005e-05 2024-09-12T16:17:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195206+0000", 2024-09-12T16:17:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142371 2024-09-12T16:17:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3716 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14857216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:17:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 61.770961329000002, 2024-09-12T16:17:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053916360000000003, 2024-09-12T16:17:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3716 2024-09-12T16:17:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:17:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:17:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142933+0000", 2024-09-12T16:17:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014796290000000001 2024-09-12T16:17:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142937+0000", 2024-09-12T16:17:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5760000000000002e-06 2024-09-12T16:17:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:19.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142946+0000", 2024-09-12T16:17:19.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0380000000000005e-06 2024-09-12T16:17:19.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:19.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142951+0000", 2024-09-12T16:17:19.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9749999999999998e-06 2024-09-12T16:17:19.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:19.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195246+0000", 2024-09-12T16:17:19.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052295358 2024-09-12T16:17:19.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:19.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195299+0000", 2024-09-12T16:17:19.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2976999999999998e-05 2024-09-12T16:17:19.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:19.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195370+0000", 2024-09-12T16:17:19.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0807000000000002e-05 2024-09-12T16:17:19.980 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3721 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14877696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 61.769387878000003, 2024-09-12T16:17:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053422994000000001, 2024-09-12T16:17:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3721 2024-09-12T16:17:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:19.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:19.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:19.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:19.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:19.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:17:19.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:19.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143028+0000", 2024-09-12T16:17:19.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7399999999999991e-07 2024-09-12T16:17:19.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:19.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143031+0000", 2024-09-12T16:17:19.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7599999999999998e-06 2024-09-12T16:17:19.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:19.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143034+0000", 2024-09-12T16:17:19.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9780000000000001e-06 2024-09-12T16:17:19.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:19.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196220+0000", 2024-09-12T16:17:19.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053186341999999998 2024-09-12T16:17:19.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:19.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196313+0000", 2024-09-12T16:17:19.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2676000000000005e-05 2024-09-12T16:17:19.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:19.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196450+0000", 2024-09-12T16:17:19.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137052 2024-09-12T16:17:19.985 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:19.985 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:19.985 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:19.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.986 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3722 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14881792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:19.986 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:19.986 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 61.769377986000002, 2024-09-12T16:17:19.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053556835999999997, 2024-09-12T16:17:19.986 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:19.986 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:19.986 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:19.986 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:19.986 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:19.986 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:19.986 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3722 2024-09-12T16:17:19.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.986 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.11e-07 2024-09-12T16:17:19.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:19.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143038+0000", 2024-09-12T16:17:19.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2399999999999996e-07 2024-09-12T16:17:19.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:19.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143041+0000", 2024-09-12T16:17:19.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8030000000000001e-06 2024-09-12T16:17:19.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:19.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143043+0000", 2024-09-12T16:17:19.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3140000000000002e-06 2024-09-12T16:17:19.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:19.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196481+0000", 2024-09-12T16:17:19.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053437601000000001 2024-09-12T16:17:19.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:19.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196525+0000", 2024-09-12T16:17:19.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4280000000000003e-05 2024-09-12T16:17:19.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196594+0000", 2024-09-12T16:17:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8702999999999996e-05 2024-09-12T16:17:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3723 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14885888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:17:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 61.769368804000003, 2024-09-12T16:17:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053815546999999998, 2024-09-12T16:17:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3723 2024-09-12T16:17:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:17:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:17:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:19.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148994+0000", 2024-09-12T16:17:19.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059481330000000004 2024-09-12T16:17:19.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:19.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148999+0000", 2024-09-12T16:17:19.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7140000000000001e-06 2024-09-12T16:17:19.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:19.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149008+0000", 2024-09-12T16:17:19.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4350000000000003e-06 2024-09-12T16:17:19.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:19.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149021+0000", 2024-09-12T16:17:19.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2514000000000001e-05 2024-09-12T16:17:19.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:19.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196630+0000", 2024-09-12T16:17:19.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047609758000000002 2024-09-12T16:17:19.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:19.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196724+0000", 2024-09-12T16:17:19.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3522000000000003e-05 2024-09-12T16:17:19.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:19.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196861+0000", 2024-09-12T16:17:19.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013747100000000001 2024-09-12T16:17:19.994 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:19.994 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:19.994 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:19.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.995 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4438 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15719424~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:19.995 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:19.995 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 61.624488026999998, 2024-09-12T16:17:19.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367981000000002, 2024-09-12T16:17:19.995 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:19.995 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:19.995 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:19.995 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:19.995 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:19.995 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:19.995 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4438 2024-09-12T16:17:19.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.995 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:19.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:19.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:19.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:19.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:19.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:19.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:19.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:19.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:19.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3e-07 2024-09-12T16:17:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287930+0000", 2024-09-12T16:17:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-12T16:17:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287937+0000", 2024-09-12T16:17:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.08e-06 2024-09-12T16:17:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287943+0000", 2024-09-12T16:17:19.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5709999999999997e-06 2024-09-12T16:17:19.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:19.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341068+0000", 2024-09-12T16:17:19.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053125101000000001 2024-09-12T16:17:19.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:19.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341154+0000", 2024-09-12T16:17:19.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6100999999999994e-05 2024-09-12T16:17:19.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:19.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341295+0000", 2024-09-12T16:17:19.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014087999999999999 2024-09-12T16:17:19.999 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:19.999 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:19.999 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:19.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:19.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:19.999 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4439 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15723520~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:19.999 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:19.999 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 61.624463867000003, 2024-09-12T16:17:19.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053526799, 2024-09-12T16:17:19.999 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:19.999 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:20.000 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:20.000 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:20.000 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:20.000 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:20.000 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4439 2024-09-12T16:17:20.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.000 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:20.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:20.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:20.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:20.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:20.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:20.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:20.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-07 2024-09-12T16:17:20.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:20.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287953+0000", 2024-09-12T16:17:20.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1349999999999999e-06 2024-09-12T16:17:20.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:20.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287960+0000", 2024-09-12T16:17:20.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-12T16:17:20.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:20.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287965+0000", 2024-09-12T16:17:20.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1580000000000004e-06 2024-09-12T16:17:20.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:20.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341332+0000", 2024-09-12T16:17:20.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367009 2024-09-12T16:17:20.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:20.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341402+0000", 2024-09-12T16:17:20.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9759999999999996e-05 2024-09-12T16:17:20.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:20.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341478+0000", 2024-09-12T16:17:20.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5412000000000002e-05 2024-09-12T16:17:20.003 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.003 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:20.003 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.003 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4440 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15727616~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:20.003 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:20.004 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 61.624442762999998, 2024-09-12T16:17:20.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053761601999999999, 2024-09-12T16:17:20.004 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:20.004 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:20.004 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:20.004 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:20.004 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:20.004 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:20.004 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4440 2024-09-12T16:17:20.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.004 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:20.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:20.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:20.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:20.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:20.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:20.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:20.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:17:20.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:20.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287974+0000", 2024-09-12T16:17:20.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0540000000000002e-06 2024-09-12T16:17:20.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:20.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287980+0000", 2024-09-12T16:17:20.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9440000000000002e-06 2024-09-12T16:17:20.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:20.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287987+0000", 2024-09-12T16:17:20.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5889999999999999e-06 2024-09-12T16:17:20.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:20.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341502+0000", 2024-09-12T16:17:20.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053515199999999999 2024-09-12T16:17:20.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:20.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341595+0000", 2024-09-12T16:17:20.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3097000000000007e-05 2024-09-12T16:17:20.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:20.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341734+0000", 2024-09-12T16:17:20.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013832800000000001 2024-09-12T16:17:20.008 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.008 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:20.008 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.008 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2209 3.1 3:85f36d3b:::rbd_data.1155ccb1894c.0000000000000004:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:20.008 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:17:20.008 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.540757625000001, 2024-09-12T16:17:20.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.060659365, 2024-09-12T16:17:20.008 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:20.008 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:20.008 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:20.008 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:20.008 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:17:20.008 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:17:20.009 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2209 2024-09-12T16:17:20.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.009 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:20.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:20.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:17:20.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:20.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:17:20.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:20.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371658+0000", 2024-09-12T16:17:20.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1570000000000001e-06 2024-09-12T16:17:20.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:20.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393414+0000", 2024-09-12T16:17:20.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021755495999999999 2024-09-12T16:17:20.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:20.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393447+0000", 2024-09-12T16:17:20.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3630000000000002e-05 2024-09-12T16:17:20.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:20.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393462+0000", 2024-09-12T16:17:20.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5048999999999999e-05 2024-09-12T16:17:20.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:20.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393556+0000", 2024-09-12T16:17:20.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3549999999999997e-05 2024-09-12T16:17:20.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:20.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393697+0000", 2024-09-12T16:17:20.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000141414 2024-09-12T16:17:20.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T16:17:20.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.394944+0000", 2024-09-12T16:17:20.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012463039999999999 2024-09-12T16:17:20.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:20.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.431803+0000", 2024-09-12T16:17:20.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0368594 2024-09-12T16:17:20.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:17:20.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432268+0000", 2024-09-12T16:17:20.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046457600000000002 2024-09-12T16:17:20.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:17:20.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432293+0000", 2024-09-12T16:17:20.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.527e-05 2024-09-12T16:17:20.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:20.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432316+0000", 2024-09-12T16:17:20.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3519e-05 2024-09-12T16:17:20.013 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.013 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:20.013 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.013 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.013 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:20.013 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:20.016 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:17:20.016 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.4 to 1 (10000) 2024-09-12T16:17:20.016 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2024-09-12T16:17:20.017 INFO:teuthology.orchestra.run.smithi204.stdout:4097 read 0x1fe600 thru 0x1ffeab (0x18ac bytes) 2024-09-12T16:17:20.017 INFO:teuthology.orchestra.run.smithi204.stdout:4101 punch from 0x3f7000 to 0x3f8c00, (0x1c00 bytes) 2024-09-12T16:17:20.017 INFO:teuthology.orchestra.run.smithi204.stdout:4103 trunc from 0x236ce00 to 0xb338400 2024-09-12T16:17:20.017 INFO:teuthology.orchestra.run.smithi204.stdout:4105 punch from 0x321a800 to 0x3228400, (0xdc00 bytes) 2024-09-12T16:17:20.017 INFO:teuthology.orchestra.run.smithi204.stdout:4106 write 0x8ee9400 thru 0x8eef5cc (0x61cd bytes) 2024-09-12T16:17:20.017 INFO:teuthology.orchestra.run.smithi204.stdout:4108 punch from 0x39fe00 to 0x3a9e00, (0xa000 bytes) 2024-09-12T16:17:20.017 INFO:teuthology.orchestra.run.smithi204.stdout:4109 read 0x2792800 thru 0x279a0e0 (0x78e1 bytes) 2024-09-12T16:17:20.017 INFO:teuthology.orchestra.run.smithi204.stdout:4110 trunc from 0xb338400 to 0xded0200 2024-09-12T16:17:20.018 INFO:teuthology.orchestra.run.smithi204.stdout:4111 write 0x97b800 thru 0x980a95 (0x5296 bytes) 2024-09-12T16:17:20.018 INFO:teuthology.orchestra.run.smithi204.stdout:4114 trunc from 0xded0200 to 0x8a8f800 2024-09-12T16:17:20.018 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:20.013+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:20.022 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-12T16:17:20.115 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:20.114+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:20.171 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:20.171 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:20.172 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:17:20.172 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:20.183 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:17:20.224 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:20.223+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:20.318 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:20.317+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:20.330 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:20.330 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:20.330 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:17:20.330 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:17:20.331 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:20.339 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:17:20.419 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:20.418+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:20.448 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:20.448 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:17:20.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:17:20.448 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:17:20.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.448 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2300 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12372992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:20.448 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:17:20.448 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.550784047, 2024-09-12T16:17:20.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037401246999999999, 2024-09-12T16:17:20.449 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:20.449 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:20.449 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:20.449 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:20.449 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:20.449 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:20.449 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2300 2024-09-12T16:17:20.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.449 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:20.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.449 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:20.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:17:20.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:20.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:17:20.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:20.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896024+0000", 2024-09-12T16:17:20.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6100000000000002e-07 2024-09-12T16:17:20.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:20.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896026+0000", 2024-09-12T16:17:20.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9130000000000001e-06 2024-09-12T16:17:20.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:20.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896032+0000", 2024-09-12T16:17:20.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7540000000000003e-06 2024-09-12T16:17:20.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:20.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896036+0000", 2024-09-12T16:17:20.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5750000000000002e-06 2024-09-12T16:17:20.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:20.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933254+0000", 2024-09-12T16:17:20.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037217962 2024-09-12T16:17:20.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:20.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933341+0000", 2024-09-12T16:17:20.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6296000000000002e-05 2024-09-12T16:17:20.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:20.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933425+0000", 2024-09-12T16:17:20.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4386000000000001e-05 2024-09-12T16:17:20.453 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.453 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:20.453 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.453 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2301 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12377088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:20.453 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896043+0000", 2024-09-12T16:17:20.454 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.550764305000001, 2024-09-12T16:17:20.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037486197999999998, 2024-09-12T16:17:20.454 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:20.454 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:20.454 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:20.454 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:20.454 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:20.454 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:20.454 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2301 2024-09-12T16:17:20.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.454 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:20.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:20.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896043+0000", 2024-09-12T16:17:20.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:20.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896043+0000", 2024-09-12T16:17:20.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:20.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896044+0000", 2024-09-12T16:17:20.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.41e-07 2024-09-12T16:17:20.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:20.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896053+0000", 2024-09-12T16:17:20.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8049999999999996e-06 2024-09-12T16:17:20.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:20.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896060+0000", 2024-09-12T16:17:20.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.221e-06 2024-09-12T16:17:20.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:20.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896065+0000", 2024-09-12T16:17:20.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1109999999999999e-06 2024-09-12T16:17:20.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:20.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933452+0000", 2024-09-12T16:17:20.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037386560999999999 2024-09-12T16:17:20.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:20.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933491+0000", 2024-09-12T16:17:20.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9789000000000001e-05 2024-09-12T16:17:20.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:20.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933530+0000", 2024-09-12T16:17:20.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.837e-05 2024-09-12T16:17:20.458 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.458 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:20.458 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.458 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2302 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12381184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:20.458 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:17:20.458 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.550722864999997, 2024-09-12T16:17:20.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037645284000000001, 2024-09-12T16:17:20.458 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:20.458 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:20.458 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:20.458 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:20.459 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:20.459 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:20.459 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2302 2024-09-12T16:17:20.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.459 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:20.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:20.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:17:20.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:20.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:17:20.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.460 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:20.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896085+0000", 2024-09-12T16:17:20.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6800000000000001e-07 2024-09-12T16:17:20.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.460 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:20.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896088+0000", 2024-09-12T16:17:20.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3429999999999998e-06 2024-09-12T16:17:20.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.460 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:20.461 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896096+0000", 2024-09-12T16:17:20.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0860000000000002e-06 2024-09-12T16:17:20.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:20.461 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896102+0000", 2024-09-12T16:17:20.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7610000000000004e-06 2024-09-12T16:17:20.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:20.461 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933563+0000", 2024-09-12T16:17:20.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037461019999999998 2024-09-12T16:17:20.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:20.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933648+0000", 2024-09-12T16:17:20.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5468000000000002e-05 2024-09-12T16:17:20.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:20.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933730+0000", 2024-09-12T16:17:20.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2138000000000005e-05 2024-09-12T16:17:20.462 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.462 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:20.462 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.462 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2303 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12385280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:20.462 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:17:20.463 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.550699063000003, 2024-09-12T16:17:20.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037723083999999997, 2024-09-12T16:17:20.463 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:20.463 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:20.463 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:20.463 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:20.463 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:20.463 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:20.463 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2303 2024-09-12T16:17:20.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.463 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:20.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.463 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:20.463 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:17:20.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.464 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:20.464 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:17:20.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.464 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:20.464 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896109+0000", 2024-09-12T16:17:20.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2500000000000001e-07 2024-09-12T16:17:20.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.464 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:20.464 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896115+0000", 2024-09-12T16:17:20.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.28e-06 2024-09-12T16:17:20.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:20.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896122+0000", 2024-09-12T16:17:20.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4590000000000003e-06 2024-09-12T16:17:20.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:20.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896127+0000", 2024-09-12T16:17:20.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0509999999999996e-06 2024-09-12T16:17:20.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:20.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933755+0000", 2024-09-12T16:17:20.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037627729999999998 2024-09-12T16:17:20.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:20.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933794+0000", 2024-09-12T16:17:20.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9255000000000003e-05 2024-09-12T16:17:20.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:20.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933832+0000", 2024-09-12T16:17:20.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7883999999999998e-05 2024-09-12T16:17:20.466 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.466 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:20.466 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.467 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2304 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12389376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:20.467 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:17:20.467 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.550673713999998, 2024-09-12T16:17:20.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037911010000000002, 2024-09-12T16:17:20.467 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:20.467 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:20.467 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:20.467 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:20.467 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:20.467 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:20.467 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2304 2024-09-12T16:17:20.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.468 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:20.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.468 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:20.468 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:17:20.468 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.468 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:20.468 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:17:20.468 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.469 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:20.469 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896134+0000", 2024-09-12T16:17:20.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9900000000000001e-07 2024-09-12T16:17:20.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.469 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:20.469 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896136+0000", 2024-09-12T16:17:20.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.897e-06 2024-09-12T16:17:20.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.469 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:20.469 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896142+0000", 2024-09-12T16:17:20.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9290000000000003e-06 2024-09-12T16:17:20.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:20.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896154+0000", 2024-09-12T16:17:20.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.201e-05 2024-09-12T16:17:20.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:20.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933865+0000", 2024-09-12T16:17:20.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037710225 2024-09-12T16:17:20.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:20.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.933961+0000", 2024-09-12T16:17:20.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6315000000000002e-05 2024-09-12T16:17:20.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:20.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934045+0000", 2024-09-12T16:17:20.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4234999999999996e-05 2024-09-12T16:17:20.471 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.471 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:20.471 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.471 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2305 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12393472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:20.471 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896175+0000", 2024-09-12T16:17:20.472 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.550632524000001, 2024-09-12T16:17:20.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037976941, 2024-09-12T16:17:20.472 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:20.472 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:20.472 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:20.472 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:20.472 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:20.472 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:20.472 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2305 2024-09-12T16:17:20.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.472 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:20.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:20.473 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896175+0000", 2024-09-12T16:17:20.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.473 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:20.473 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896175+0000", 2024-09-12T16:17:20.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.473 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:20.473 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896176+0000", 2024-09-12T16:17:20.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7400000000000003e-07 2024-09-12T16:17:20.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.474 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:20.474 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896178+0000", 2024-09-12T16:17:20.474 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6709999999999999e-06 2024-09-12T16:17:20.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.474 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:20.474 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896186+0000", 2024-09-12T16:17:20.474 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9319999999999996e-06 2024-09-12T16:17:20.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.474 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:20.476 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896192+0000", 2024-09-12T16:17:20.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0799999999999996e-06 2024-09-12T16:17:20.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.476 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:20.476 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934072+0000", 2024-09-12T16:17:20.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037880888000000001 2024-09-12T16:17:20.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.477 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:20.477 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934113+0000", 2024-09-12T16:17:20.477 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0815999999999997e-05 2024-09-12T16:17:20.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.477 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:20.477 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934152+0000", 2024-09-12T16:17:20.477 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8980000000000003e-05 2024-09-12T16:17:20.477 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.477 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:20.477 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.477 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2306 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12397568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:20.478 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:17:20.478 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.550608246000003, 2024-09-12T16:17:20.478 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038156347, 2024-09-12T16:17:20.478 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:20.478 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:20.478 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:20.478 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:20.478 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:20.478 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:20.478 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2306 2024-09-12T16:17:20.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.478 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:20.478 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.478 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:20.479 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:17:20.479 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.479 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:20.479 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:17:20.479 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.479 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:20.479 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896200+0000", 2024-09-12T16:17:20.479 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.77e-07 2024-09-12T16:17:20.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.480 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:20.480 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896202+0000", 2024-09-12T16:17:20.480 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2359999999999999e-06 2024-09-12T16:17:20.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.480 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:20.480 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896208+0000", 2024-09-12T16:17:20.480 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1430000000000003e-06 2024-09-12T16:17:20.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.480 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:20.480 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896213+0000", 2024-09-12T16:17:20.480 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9339999999999997e-06 2024-09-12T16:17:20.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.481 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:20.481 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934188+0000", 2024-09-12T16:17:20.481 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037974490999999999 2024-09-12T16:17:20.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.481 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:20.481 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934275+0000", 2024-09-12T16:17:20.481 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7639999999999994e-05 2024-09-12T16:17:20.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.481 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:20.482 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934356+0000", 2024-09-12T16:17:20.482 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0525999999999994e-05 2024-09-12T16:17:20.482 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.482 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:20.482 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.482 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2307 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12401664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:20.482 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:17:20.482 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.550588474000001, 2024-09-12T16:17:20.482 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038241450000000003, 2024-09-12T16:17:20.482 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:20.482 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:20.482 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:20.483 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:20.483 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:20.483 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:20.483 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2307 2024-09-12T16:17:20.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.483 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:20.483 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.483 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:20.483 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:17:20.483 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.483 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.483 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:20.483 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:17:20.484 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.484 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:20.484 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896220+0000", 2024-09-12T16:17:20.484 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3500000000000002e-07 2024-09-12T16:17:20.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.484 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:20.484 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896222+0000", 2024-09-12T16:17:20.484 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1720000000000001e-06 2024-09-12T16:17:20.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:20.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896228+0000", 2024-09-12T16:17:20.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0870000000000003e-06 2024-09-12T16:17:20.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:20.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896233+0000", 2024-09-12T16:17:20.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:17:20.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:20.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934382+0000", 2024-09-12T16:17:20.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038149566000000003 2024-09-12T16:17:20.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.486 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:20.486 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934422+0000", 2024-09-12T16:17:20.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0015999999999998e-05 2024-09-12T16:17:20.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.486 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:20.486 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934461+0000", 2024-09-12T16:17:20.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8423999999999997e-05 2024-09-12T16:17:20.486 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.486 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:20.486 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.487 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2308 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12405760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:20.487 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:17:20.487 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.550568777000002, 2024-09-12T16:17:20.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038420745999999999, 2024-09-12T16:17:20.487 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:20.487 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:20.487 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:20.487 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:20.487 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:20.487 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:20.487 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2308 2024-09-12T16:17:20.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.488 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:20.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.488 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:20.488 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:17:20.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.488 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:20.488 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:17:20.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.489 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:20.489 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:17:20.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.58e-07 2024-09-12T16:17:20.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.489 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:20.489 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896241+0000", 2024-09-12T16:17:20.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7940000000000001e-06 2024-09-12T16:17:20.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.489 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:20.489 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896247+0000", 2024-09-12T16:17:20.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1460000000000001e-06 2024-09-12T16:17:20.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:20.490 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896252+0000", 2024-09-12T16:17:20.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6840000000000004e-06 2024-09-12T16:17:20.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:20.490 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934494+0000", 2024-09-12T16:17:20.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038242362000000002 2024-09-12T16:17:20.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:20.490 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934579+0000", 2024-09-12T16:17:20.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5044999999999996e-05 2024-09-12T16:17:20.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.491 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:20.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934660+0000", 2024-09-12T16:17:20.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0357000000000003e-05 2024-09-12T16:17:20.491 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.491 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:20.491 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.491 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2309 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12409856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:20.491 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:17:20.491 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.550548196999998, 2024-09-12T16:17:20.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038504629999999998, 2024-09-12T16:17:20.492 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:20.492 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:20.492 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:20.492 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:20.492 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:20.492 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:20.492 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2309 2024-09-12T16:17:20.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.492 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:20.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.492 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:20.493 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:17:20.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.493 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:20.493 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:17:20.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.493 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:20.493 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:17:20.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5199999999999998e-07 2024-09-12T16:17:20.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.494 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:20.494 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896263+0000", 2024-09-12T16:17:20.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4209999999999999e-06 2024-09-12T16:17:20.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.494 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:20.494 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896269+0000", 2024-09-12T16:17:20.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9449999999999998e-06 2024-09-12T16:17:20.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.494 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:20.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896274+0000", 2024-09-12T16:17:20.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3950000000000003e-06 2024-09-12T16:17:20.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.495 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:20.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934686+0000", 2024-09-12T16:17:20.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038412333999999999 2024-09-12T16:17:20.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.495 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:20.496 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934727+0000", 2024-09-12T16:17:20.496 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0649999999999999e-05 2024-09-12T16:17:20.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.496 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:20.496 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934764+0000", 2024-09-12T16:17:20.496 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7533000000000001e-05 2024-09-12T16:17:20.496 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.496 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:20.496 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.496 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2310 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12413952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:20.497 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:17:20.497 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.550527324999997, 2024-09-12T16:17:20.497 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038694183, 2024-09-12T16:17:20.497 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:20.497 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:20.497 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:20.497 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:20.497 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:20.497 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:20.497 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2310 2024-09-12T16:17:20.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.497 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:20.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:20.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:17:20.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:20.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:17:20.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:20.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896281+0000", 2024-09-12T16:17:20.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1399999999999997e-07 2024-09-12T16:17:20.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:20.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896283+0000", 2024-09-12T16:17:20.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9549999999999999e-06 2024-09-12T16:17:20.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:20.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896289+0000", 2024-09-12T16:17:20.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8669999999999999e-06 2024-09-12T16:17:20.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:20.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896301+0000", 2024-09-12T16:17:20.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1807999999999999e-05 2024-09-12T16:17:20.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:20.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934798+0000", 2024-09-12T16:17:20.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038497591999999997 2024-09-12T16:17:20.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:20.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934885+0000", 2024-09-12T16:17:20.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7149000000000002e-05 2024-09-12T16:17:20.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:20.501 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934975+0000", 2024-09-12T16:17:20.501 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9297999999999998e-05 2024-09-12T16:17:20.501 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.501 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:20.501 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.501 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2311 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12418048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:20.501 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:17:20.501 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.550500069000002, 2024-09-12T16:17:20.501 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038768558000000002, 2024-09-12T16:17:20.501 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:20.501 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:20.502 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:20.502 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:20.502 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:20.502 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:20.502 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2311 2024-09-12T16:17:20.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.502 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:20.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.502 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:20.502 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:17:20.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:20.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:17:20.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:20.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:17:20.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.63e-07 2024-09-12T16:17:20.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:20.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896310+0000", 2024-09-12T16:17:20.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1560000000000002e-06 2024-09-12T16:17:20.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896316+0000", 2024-09-12T16:17:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0249999999999999e-06 2024-09-12T16:17:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896322+0000", 2024-09-12T16:17:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6400000000000002e-06 2024-09-12T16:17:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934997+0000", 2024-09-12T16:17:20.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038674565000000001 2024-09-12T16:17:20.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.505 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:20.505 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935037+0000", 2024-09-12T16:17:20.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0485999999999998e-05 2024-09-12T16:17:20.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.505 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:20.505 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935076+0000", 2024-09-12T16:17:20.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9223e-05 2024-09-12T16:17:20.505 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.505 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:20.505 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.506 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2312 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12422144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:20.506 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:17:20.506 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.550479375999998, 2024-09-12T16:17:20.506 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038856784999999998, 2024-09-12T16:17:20.506 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:20.506 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:20.506 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:20.506 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:20.506 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:20.506 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:20.506 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2312 2024-09-12T16:17:20.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.507 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:20.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.507 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:20.507 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:17:20.507 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.507 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:20.507 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:17:20.507 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.507 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:20.507 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896329+0000", 2024-09-12T16:17:20.508 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5499999999999999e-07 2024-09-12T16:17:20.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.508 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:20.508 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896337+0000", 2024-09-12T16:17:20.508 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0819999999999999e-06 2024-09-12T16:17:20.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.508 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:20.508 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896343+0000", 2024-09-12T16:17:20.508 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.263e-06 2024-09-12T16:17:20.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.509 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:20.509 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896348+0000", 2024-09-12T16:17:20.509 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8860000000000003e-06 2024-09-12T16:17:20.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.509 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:20.509 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935097+0000", 2024-09-12T16:17:20.509 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038748818999999997 2024-09-12T16:17:20.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.509 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:20.509 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935141+0000", 2024-09-12T16:17:20.509 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4175000000000003e-05 2024-09-12T16:17:20.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.510 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:20.510 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935185+0000", 2024-09-12T16:17:20.510 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4205000000000001e-05 2024-09-12T16:17:20.510 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.510 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:20.510 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.510 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2313 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12426240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:20.511 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:17:20.511 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.550453161, 2024-09-12T16:17:20.511 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038928683999999998, 2024-09-12T16:17:20.511 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:20.511 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:20.511 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:20.511 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:20.511 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:20.511 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:20.511 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2313 2024-09-12T16:17:20.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.511 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:20.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.512 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:20.512 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:17:20.512 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.512 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:20.512 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:17:20.512 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.512 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:20.513 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:17:20.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0400000000000002e-07 2024-09-12T16:17:20.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.513 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:20.513 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896357+0000", 2024-09-12T16:17:20.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.097e-06 2024-09-12T16:17:20.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.513 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:20.513 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896363+0000", 2024-09-12T16:17:20.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5119999999999999e-06 2024-09-12T16:17:20.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:20.514 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896374+0000", 2024-09-12T16:17:20.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1381e-05 2024-09-12T16:17:20.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:20.514 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935205+0000", 2024-09-12T16:17:20.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038830549999999998 2024-09-12T16:17:20.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:20.514 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935244+0000", 2024-09-12T16:17:20.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9520000000000001e-05 2024-09-12T16:17:20.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.515 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:20.515 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935283+0000", 2024-09-12T16:17:20.515 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9220000000000001e-05 2024-09-12T16:17:20.515 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.515 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:20.515 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.515 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2314 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12430336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:20.515 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:17:20.515 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.550415991000001, 2024-09-12T16:17:20.515 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039008137999999998, 2024-09-12T16:17:20.515 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:20.516 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:20.516 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:20.516 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:20.516 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:20.516 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:20.516 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2314 2024-09-12T16:17:20.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.516 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:20.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.516 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:20.516 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:17:20.516 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.517 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:20.517 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:17:20.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.517 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:20.517 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:17:20.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6499999999999999e-07 2024-09-12T16:17:20.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.517 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:20.517 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896395+0000", 2024-09-12T16:17:20.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2960000000000001e-06 2024-09-12T16:17:20.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:20.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896402+0000", 2024-09-12T16:17:20.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2280000000000001e-06 2024-09-12T16:17:20.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:20.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896407+0000", 2024-09-12T16:17:20.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3630000000000002e-06 2024-09-12T16:17:20.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:20.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935302+0000", 2024-09-12T16:17:20.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038895181000000001 2024-09-12T16:17:20.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:20.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935343+0000", 2024-09-12T16:17:20.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0590999999999998e-05 2024-09-12T16:17:20.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:20.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935400+0000", 2024-09-12T16:17:20.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7014e-05 2024-09-12T16:17:20.519 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.519 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:20.520 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.520 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2315 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12434432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:20.520 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:17:20.520 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.550393339999999, 2024-09-12T16:17:20.520 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039083892000000002, 2024-09-12T16:17:20.520 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:20.520 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:20.520 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:20.520 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:20.520 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:20.520 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:20.520 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2315 2024-09-12T16:17:20.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.521 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:20.521 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.521 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:20.521 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:17:20.521 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.521 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.521 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:20.521 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:17:20.521 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.521 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.521 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:20.522 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896415+0000", 2024-09-12T16:17:20.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3300000000000002e-07 2024-09-12T16:17:20.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.522 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:20.522 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896421+0000", 2024-09-12T16:17:20.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7579999999999998e-06 2024-09-12T16:17:20.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.522 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:20.522 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896427+0000", 2024-09-12T16:17:20.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3029999999999996e-06 2024-09-12T16:17:20.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.523 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:20.523 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896432+0000", 2024-09-12T16:17:20.523 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.215e-06 2024-09-12T16:17:20.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.523 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:20.523 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935420+0000", 2024-09-12T16:17:20.523 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038987727 2024-09-12T16:17:20.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.523 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:20.524 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935460+0000", 2024-09-12T16:17:20.524 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9817999999999997e-05 2024-09-12T16:17:20.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.524 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.524 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:20.524 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935498+0000", 2024-09-12T16:17:20.524 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8438e-05 2024-09-12T16:17:20.524 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.524 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:20.524 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.524 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.525 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2316 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12438528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:20.525 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:17:20.525 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.550368687999999, 2024-09-12T16:17:20.525 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039160043999999998, 2024-09-12T16:17:20.525 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:20.525 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:20.525 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:20.525 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:20.525 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:20.525 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:20.525 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2316 2024-09-12T16:17:20.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.525 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:20.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.525 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:20.526 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:17:20.526 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.526 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:20.526 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:17:20.526 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.526 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:20.526 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901945+0000", 2024-09-12T16:17:20.526 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055056050000000002 2024-09-12T16:17:20.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.526 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:20.527 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901950+0000", 2024-09-12T16:17:20.527 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2490000000000001e-06 2024-09-12T16:17:20.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.527 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:20.527 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901966+0000", 2024-09-12T16:17:20.527 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6325e-05 2024-09-12T16:17:20.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.527 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:20.527 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901974+0000", 2024-09-12T16:17:20.527 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7570000000000004e-06 2024-09-12T16:17:20.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.528 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:20.528 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935518+0000", 2024-09-12T16:17:20.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033543587999999999 2024-09-12T16:17:20.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.528 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:20.528 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935559+0000", 2024-09-12T16:17:20.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1746000000000003e-05 2024-09-12T16:17:20.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.528 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:20.528 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935599+0000", 2024-09-12T16:17:20.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9774000000000002e-05 2024-09-12T16:17:20.529 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.529 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:20.529 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.529 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1571 3.b 3:d046566d:::rbd_data.1155525b14e3.0000000000000001:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:17:20.529 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:17:20.529 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.294243645999998, 2024-09-12T16:17:20.529 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064439785999999999, 2024-09-12T16:17:20.529 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:20.529 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:20.529 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:20.529 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:20.530 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:17:20.530 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:17:20.530 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1571 2024-09-12T16:17:20.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.530 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:20.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.530 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:20.530 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:17:20.530 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.530 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:20.530 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:17:20.531 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.531 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.531 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:20.531 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:17:20.531 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5400000000000002e-07 2024-09-12T16:17:20.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.531 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.531 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:20.531 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152567+0000", 2024-09-12T16:17:20.531 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.131e-06 2024-09-12T16:17:20.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.531 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.532 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:20.532 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152574+0000", 2024-09-12T16:17:20.532 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1840000000000002e-06 2024-09-12T16:17:20.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.532 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:20.532 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152579+0000", 2024-09-12T16:17:20.532 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.152e-06 2024-09-12T16:17:20.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.532 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:20.532 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153671+0000", 2024-09-12T16:17:20.532 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001092078 2024-09-12T16:17:20.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.533 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:20.533 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153779+0000", 2024-09-12T16:17:20.533 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108461 2024-09-12T16:17:20.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.533 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:20.533 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217004+0000", 2024-09-12T16:17:20.533 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.063224426 2024-09-12T16:17:20.533 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.533 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:20.533 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.534 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1581 3.4 3:22e34893:::rbd_data.1155525b14e3.0000000000000005:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:17:20.534 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:17:20.534 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.294146521000002, 2024-09-12T16:17:20.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064484407999999993, 2024-09-12T16:17:20.534 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:20.534 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:20.534 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:20.534 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:20.534 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:17:20.534 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:17:20.534 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1581 2024-09-12T16:17:20.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.535 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:20.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.535 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:20.535 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:17:20.535 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.535 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:20.535 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:17:20.535 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.535 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:20.535 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152662+0000", 2024-09-12T16:17:20.536 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.65e-07 2024-09-12T16:17:20.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.536 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.536 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:20.536 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152664+0000", 2024-09-12T16:17:20.536 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9829999999999999e-06 2024-09-12T16:17:20.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.536 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.536 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:20.536 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152670+0000", 2024-09-12T16:17:20.536 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2260000000000002e-06 2024-09-12T16:17:20.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.536 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.536 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:20.537 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152675+0000", 2024-09-12T16:17:20.537 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7990000000000001e-06 2024-09-12T16:17:20.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.537 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:20.537 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.216945+0000", 2024-09-12T16:17:20.537 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064270341999999994 2024-09-12T16:17:20.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.537 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:20.537 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217040+0000", 2024-09-12T16:17:20.537 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5242999999999996e-05 2024-09-12T16:17:20.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.538 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:20.538 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217146+0000", 2024-09-12T16:17:20.538 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010545 2024-09-12T16:17:20.538 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.538 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:20.538 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.538 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.538 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2207 3.0 3:05fdc61f:::rbd_data.1155ccb1894c.0000000000000003:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:20.538 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:17:20.538 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.07610296, 2024-09-12T16:17:20.538 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.05105382, 2024-09-12T16:17:20.538 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:20.538 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:20.539 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:20.539 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:20.539 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:17:20.539 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:17:20.539 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2207 2024-09-12T16:17:20.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.539 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:20.539 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.539 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:20.539 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:17:20.539 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.539 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.540 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:20.540 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:17:20.540 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.540 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:20.540 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370706+0000", 2024-09-12T16:17:20.540 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7800000000000001e-07 2024-09-12T16:17:20.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.540 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:20.540 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391581+0000", 2024-09-12T16:17:20.541 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020875624999999998 2024-09-12T16:17:20.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.541 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:20.541 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391608+0000", 2024-09-12T16:17:20.541 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6412999999999999e-05 2024-09-12T16:17:20.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.541 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:20.541 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391618+0000", 2024-09-12T16:17:20.541 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9240000000000002e-06 2024-09-12T16:17:20.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.541 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:20.541 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391705+0000", 2024-09-12T16:17:20.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7489000000000002e-05 2024-09-12T16:17:20.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.542 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:20.542 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391838+0000", 2024-09-12T16:17:20.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132865 2024-09-12T16:17:20.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.542 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 2", 2024-09-12T16:17:20.542 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.392587+0000", 2024-09-12T16:17:20.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074930000000000005 2024-09-12T16:17:20.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.542 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:20.542 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.420095+0000", 2024-09-12T16:17:20.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027507949 2024-09-12T16:17:20.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.543 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:17:20.543 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421610+0000", 2024-09-12T16:17:20.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001515195 2024-09-12T16:17:20.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.543 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:17:20.543 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421681+0000", 2024-09-12T16:17:20.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0320000000000004e-05 2024-09-12T16:17:20.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.544 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:20.544 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421759+0000", 2024-09-12T16:17:20.544 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7961999999999997e-05 2024-09-12T16:17:20.544 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.544 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:20.544 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.544 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.544 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:20.544 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:20.546 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:17:20.546 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:20.544+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:20.646 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:20.646+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:20.653 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:20.653 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:20.653 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:17:20.653 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:20.662 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:17:20.747 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:20.747+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:20.808 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:20.809 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:20.809 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:17:20.809 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:17:20.809 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:20.817 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:17:20.858 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:20.857+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:20.949 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:20.948+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:20.965 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:20.965 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:17:20.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:17:20.965 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:17:20.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.965 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2213 3.18 3:1944e921:::rbd_data.1155ccb1894c.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:20.965 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:17:20.965 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.588173793999999, 2024-09-12T16:17:20.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.055657836000000002, 2024-09-12T16:17:20.965 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:20.966 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:20.966 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:20.966 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:20.966 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:17:20.966 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:17:20.966 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2213 2024-09-12T16:17:20.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.966 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:20.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:20.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:17:20.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:20.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:17:20.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:20.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375351+0000", 2024-09-12T16:17:20.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.556e-06 2024-09-12T16:17:20.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:20.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.399989+0000", 2024-09-12T16:17:20.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024637949999999999 2024-09-12T16:17:20.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:20.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400038+0000", 2024-09-12T16:17:20.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9187999999999997e-05 2024-09-12T16:17:20.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:20.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400056+0000", 2024-09-12T16:17:20.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8451e-05 2024-09-12T16:17:20.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:20.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400151+0000", 2024-09-12T16:17:20.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5026999999999997e-05 2024-09-12T16:17:20.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:20.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400345+0000", 2024-09-12T16:17:20.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019352900000000001 2024-09-12T16:17:20.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 1", 2024-09-12T16:17:20.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.401319+0000", 2024-09-12T16:17:20.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00097419399999999995 2024-09-12T16:17:20.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:17:20.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.429350+0000", 2024-09-12T16:17:20.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028030607999999999 2024-09-12T16:17:20.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:20.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.430907+0000", 2024-09-12T16:17:20.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001557466 2024-09-12T16:17:20.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:17:20.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.430966+0000", 2024-09-12T16:17:20.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9437e-05 2024-09-12T16:17:20.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:20.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.431007+0000", 2024-09-12T16:17:20.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0429999999999997e-05 2024-09-12T16:17:20.970 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.971 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:20.971 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.971 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6725 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2392064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:20.971 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.557452+0000", 2024-09-12T16:17:20.971 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.4060711280000007, 2024-09-12T16:17:20.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045294112999999997, 2024-09-12T16:17:20.971 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:20.971 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:20.971 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:20.971 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:20.971 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:20.971 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:20.972 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6725 2024-09-12T16:17:20.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.972 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:20.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:20.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557452+0000", 2024-09-12T16:17:20.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:20.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557452+0000", 2024-09-12T16:17:20.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:20.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557693+0000", 2024-09-12T16:17:20.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024098699999999999 2024-09-12T16:17:20.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:20.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557697+0000", 2024-09-12T16:17:20.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8489999999999999e-06 2024-09-12T16:17:20.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:20.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557707+0000", 2024-09-12T16:17:20.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0356999999999999e-05 2024-09-12T16:17:20.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:20.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557714+0000", 2024-09-12T16:17:20.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0219999999999999e-06 2024-09-12T16:17:20.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:20.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.602612+0000", 2024-09-12T16:17:20.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044897907000000001 2024-09-12T16:17:20.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:20.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.602683+0000", 2024-09-12T16:17:20.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1171e-05 2024-09-12T16:17:20.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:20.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.602746+0000", 2024-09-12T16:17:20.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2819999999999998e-05 2024-09-12T16:17:20.975 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.975 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:20.975 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.976 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6727 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2422784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:20.976 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.557749+0000", 2024-09-12T16:17:20.976 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.4057735289999993, 2024-09-12T16:17:20.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045329659000000001, 2024-09-12T16:17:20.976 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:20.976 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:20.976 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:20.976 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:20.976 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:20.976 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:20.976 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6727 2024-09-12T16:17:20.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.977 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:20.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:20.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557749+0000", 2024-09-12T16:17:20.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:20.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557749+0000", 2024-09-12T16:17:20.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:20.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557750+0000", 2024-09-12T16:17:20.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6600000000000002e-07 2024-09-12T16:17:20.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:20.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557752+0000", 2024-09-12T16:17:20.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.278e-06 2024-09-12T16:17:20.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:20.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557759+0000", 2024-09-12T16:17:20.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7329999999999997e-06 2024-09-12T16:17:20.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:20.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557764+0000", 2024-09-12T16:17:20.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0390000000000004e-06 2024-09-12T16:17:20.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:20.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.602943+0000", 2024-09-12T16:17:20.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045179035999999999 2024-09-12T16:17:20.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:20.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603016+0000", 2024-09-12T16:17:20.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2999999999999999e-05 2024-09-12T16:17:20.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:20.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603079+0000", 2024-09-12T16:17:20.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3107000000000004e-05 2024-09-12T16:17:20.980 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.980 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:20.980 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.980 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6728 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2439168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:20.980 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.557771+0000", 2024-09-12T16:17:20.980 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.4057516529999994, 2024-09-12T16:17:20.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045474239, 2024-09-12T16:17:20.981 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:20.981 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:20.981 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:20.981 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:20.981 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:20.981 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:20.981 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6728 2024-09-12T16:17:20.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.981 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:20.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:20.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557771+0000", 2024-09-12T16:17:20.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:20.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557771+0000", 2024-09-12T16:17:20.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:20.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557772+0000", 2024-09-12T16:17:20.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5400000000000002e-07 2024-09-12T16:17:20.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:20.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557774+0000", 2024-09-12T16:17:20.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.165e-06 2024-09-12T16:17:20.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:20.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557782+0000", 2024-09-12T16:17:20.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3289999999999994e-06 2024-09-12T16:17:20.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:20.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557787+0000", 2024-09-12T16:17:20.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1909999999999999e-06 2024-09-12T16:17:20.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:20.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603110+0000", 2024-09-12T16:17:20.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045322710000000002 2024-09-12T16:17:20.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:20.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603182+0000", 2024-09-12T16:17:20.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1755999999999995e-05 2024-09-12T16:17:20.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:20.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603245+0000", 2024-09-12T16:17:20.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3633999999999994e-05 2024-09-12T16:17:20.984 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.984 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:20.985 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.985 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6729 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2454528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:20.985 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.557794+0000", 2024-09-12T16:17:20.985 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.4057288719999992, 2024-09-12T16:17:20.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045614517, 2024-09-12T16:17:20.985 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:20.985 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:20.985 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:20.985 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:20.985 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:20.985 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:20.985 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6729 2024-09-12T16:17:20.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.986 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:20.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:20.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557794+0000", 2024-09-12T16:17:20.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:20.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557794+0000", 2024-09-12T16:17:20.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:20.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557879+0000", 2024-09-12T16:17:20.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5130000000000007e-05 2024-09-12T16:17:20.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:20.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557884+0000", 2024-09-12T16:17:20.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2390000000000002e-06 2024-09-12T16:17:20.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:20.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557894+0000", 2024-09-12T16:17:20.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4800000000000007e-06 2024-09-12T16:17:20.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:20.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557900+0000", 2024-09-12T16:17:20.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5610000000000004e-06 2024-09-12T16:17:20.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:20.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603273+0000", 2024-09-12T16:17:20.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045372799999999998 2024-09-12T16:17:20.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:20.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603345+0000", 2024-09-12T16:17:20.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1562000000000004e-05 2024-09-12T16:17:20.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:20.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603408+0000", 2024-09-12T16:17:20.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3744999999999994e-05 2024-09-12T16:17:20.989 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.989 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:20.989 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.989 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6730 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2469888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:20.989 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.557911+0000", 2024-09-12T16:17:20.989 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.4056114750000006, 2024-09-12T16:17:20.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045661090000000001, 2024-09-12T16:17:20.989 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:20.989 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:20.989 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:20.990 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:20.990 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:20.990 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:20.990 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6730 2024-09-12T16:17:20.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.990 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:20.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:20.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557911+0000", 2024-09-12T16:17:20.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:20.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557911+0000", 2024-09-12T16:17:20.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:20.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557912+0000", 2024-09-12T16:17:20.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8299999999999997e-07 2024-09-12T16:17:20.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:20.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557914+0000", 2024-09-12T16:17:20.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.531e-06 2024-09-12T16:17:20.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:20.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557927+0000", 2024-09-12T16:17:20.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2685e-05 2024-09-12T16:17:20.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:20.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557932+0000", 2024-09-12T16:17:20.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3020000000000002e-06 2024-09-12T16:17:20.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:20.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603436+0000", 2024-09-12T16:17:20.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045503210000000002 2024-09-12T16:17:20.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:20.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603508+0000", 2024-09-12T16:17:20.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2792000000000004e-05 2024-09-12T16:17:20.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:20.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603572+0000", 2024-09-12T16:17:20.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4086999999999998e-05 2024-09-12T16:17:20.993 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.993 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:20.993 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.993 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6731 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2485248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:20.993 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.557942+0000", 2024-09-12T16:17:20.994 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.4055812749999994, 2024-09-12T16:17:20.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045794662, 2024-09-12T16:17:20.994 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:20.994 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:20.994 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:20.994 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:20.994 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:20.994 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:20.994 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6731 2024-09-12T16:17:20.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.994 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:20.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:20.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557942+0000", 2024-09-12T16:17:20.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:20.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557942+0000", 2024-09-12T16:17:20.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:20.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559076+0000", 2024-09-12T16:17:20.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011348280000000001 2024-09-12T16:17:20.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:20.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559081+0000", 2024-09-12T16:17:20.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6820000000000002e-06 2024-09-12T16:17:20.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:20.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559089+0000", 2024-09-12T16:17:20.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0469999999999994e-06 2024-09-12T16:17:20.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:20.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559095+0000", 2024-09-12T16:17:20.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.212e-06 2024-09-12T16:17:20.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:20.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603601+0000", 2024-09-12T16:17:20.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044505321 2024-09-12T16:17:20.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:20.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603675+0000", 2024-09-12T16:17:20.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4455000000000005e-05 2024-09-12T16:17:20.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:20.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603736+0000", 2024-09-12T16:17:20.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1117000000000005e-05 2024-09-12T16:17:20.997 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.997 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:20.997 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:20.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.998 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6735 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2547712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:20.998 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.559184+0000", 2024-09-12T16:17:20.998 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.4043384280000009, 2024-09-12T16:17:20.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045228008, 2024-09-12T16:17:20.998 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:20.998 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:20.998 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:20.998 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:20.998 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:20.998 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:20.998 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6735 2024-09-12T16:17:20.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.998 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:20.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:20.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559184+0000", 2024-09-12T16:17:20.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:20.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559184+0000", 2024-09-12T16:17:20.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:20.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:20.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:20.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:21.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559185+0000", 2024-09-12T16:17:21.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8100000000000003e-07 2024-09-12T16:17:21.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:21.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559187+0000", 2024-09-12T16:17:21.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9309999999999998e-06 2024-09-12T16:17:21.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:21.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559193+0000", 2024-09-12T16:17:21.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3629999999999999e-06 2024-09-12T16:17:21.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:21.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559200+0000", 2024-09-12T16:17:21.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6950000000000003e-06 2024-09-12T16:17:21.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:21.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604265+0000", 2024-09-12T16:17:21.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045064924999999999 2024-09-12T16:17:21.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:21.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604344+0000", 2024-09-12T16:17:21.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8830000000000002e-05 2024-09-12T16:17:21.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:21.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604412+0000", 2024-09-12T16:17:21.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8683000000000006e-05 2024-09-12T16:17:21.002 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:21.002 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:21.002 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:21.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.002 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6736 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2564096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:21.002 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.559207+0000", 2024-09-12T16:17:21.003 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.4043154649999998, 2024-09-12T16:17:21.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045365924000000002, 2024-09-12T16:17:21.003 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:21.003 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:21.003 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:21.003 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:21.003 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:21.003 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:21.003 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6736 2024-09-12T16:17:21.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.003 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:21.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:21.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559207+0000", 2024-09-12T16:17:21.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:21.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:21.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559207+0000", 2024-09-12T16:17:21.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:21.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:21.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559208+0000", 2024-09-12T16:17:21.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6800000000000001e-07 2024-09-12T16:17:21.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:21.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559210+0000", 2024-09-12T16:17:21.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0490000000000002e-06 2024-09-12T16:17:21.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:21.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559218+0000", 2024-09-12T16:17:21.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7510000000000008e-06 2024-09-12T16:17:21.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:21.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559223+0000", 2024-09-12T16:17:21.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1229999999999999e-06 2024-09-12T16:17:21.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:21.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604440+0000", 2024-09-12T16:17:21.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045217599999999997 2024-09-12T16:17:21.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:21.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604512+0000", 2024-09-12T16:17:21.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1909000000000006e-05 2024-09-12T16:17:21.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:21.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604573+0000", 2024-09-12T16:17:21.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1023999999999997e-05 2024-09-12T16:17:21.007 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:21.007 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:21.007 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:21.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.007 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6737 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2579456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:21.007 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.559229+0000", 2024-09-12T16:17:21.007 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.4042933390000005, 2024-09-12T16:17:21.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045505640999999999, 2024-09-12T16:17:21.007 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:21.007 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:21.007 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:21.007 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:21.007 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:21.008 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:21.008 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6737 2024-09-12T16:17:21.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.008 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:21.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:21.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559229+0000", 2024-09-12T16:17:21.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:21.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:21.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559229+0000", 2024-09-12T16:17:21.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:21.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:21.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559230+0000", 2024-09-12T16:17:21.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1399999999999997e-07 2024-09-12T16:17:21.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:21.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559232+0000", 2024-09-12T16:17:21.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8360000000000001e-06 2024-09-12T16:17:21.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:21.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559238+0000", 2024-09-12T16:17:21.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2360000000000001e-06 2024-09-12T16:17:21.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:21.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559242+0000", 2024-09-12T16:17:21.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4390000000000002e-06 2024-09-12T16:17:21.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:21.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604599+0000", 2024-09-12T16:17:21.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045356527000000001 2024-09-12T16:17:21.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:21.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604669+0000", 2024-09-12T16:17:21.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0442000000000001e-05 2024-09-12T16:17:21.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:21.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604735+0000", 2024-09-12T16:17:21.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5647000000000004e-05 2024-09-12T16:17:21.011 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:21.011 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:21.011 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:21.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.011 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6738 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2594816~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:21.012 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.559250+0000", 2024-09-12T16:17:21.012 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.4042724759999992, 2024-09-12T16:17:21.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045646834999999997, 2024-09-12T16:17:21.012 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:21.012 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:21.012 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:21.012 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:21.012 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:21.012 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:21.012 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6738 2024-09-12T16:17:21.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.012 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:21.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:21.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559250+0000", 2024-09-12T16:17:21.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:21.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:21.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559250+0000", 2024-09-12T16:17:21.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:21.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:21.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559251+0000", 2024-09-12T16:17:21.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1699999999999999e-07 2024-09-12T16:17:21.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:21.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559253+0000", 2024-09-12T16:17:21.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2910000000000002e-06 2024-09-12T16:17:21.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:21.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559260+0000", 2024-09-12T16:17:21.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2200000000000003e-06 2024-09-12T16:17:21.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:21.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559265+0000", 2024-09-12T16:17:21.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2050000000000001e-06 2024-09-12T16:17:21.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:21.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604763+0000", 2024-09-12T16:17:21.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045497964000000002 2024-09-12T16:17:21.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:21.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604835+0000", 2024-09-12T16:17:21.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1705000000000005e-05 2024-09-12T16:17:21.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:21.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604897+0000", 2024-09-12T16:17:21.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2032999999999994e-05 2024-09-12T16:17:21.016 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:21.016 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:21.016 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:21.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.016 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6739 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2610176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:21.016 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.559273+0000", 2024-09-12T16:17:21.016 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.4042496579999995, 2024-09-12T16:17:21.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.04579105, 2024-09-12T16:17:21.016 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:21.016 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:21.017 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:21.017 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:21.017 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:21.017 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:21.017 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6739 2024-09-12T16:17:21.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.017 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:21.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:21.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559273+0000", 2024-09-12T16:17:21.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:21.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:21.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559273+0000", 2024-09-12T16:17:21.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:21.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:21.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559273+0000", 2024-09-12T16:17:21.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3299999999999998e-07 2024-09-12T16:17:21.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:21.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559276+0000", 2024-09-12T16:17:21.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1490000000000001e-06 2024-09-12T16:17:21.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:21.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559282+0000", 2024-09-12T16:17:21.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3199999999999996e-06 2024-09-12T16:17:21.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:21.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559288+0000", 2024-09-12T16:17:21.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.942e-06 2024-09-12T16:17:21.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:21.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604929+0000", 2024-09-12T16:17:21.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045641317000000001 2024-09-12T16:17:21.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:21.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.605001+0000", 2024-09-12T16:17:21.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1581000000000005e-05 2024-09-12T16:17:21.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:21.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.605064+0000", 2024-09-12T16:17:21.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3408e-05 2024-09-12T16:17:21.020 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:21.021 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:21.021 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:21.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.021 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6977 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2377728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:21.021 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.566114+0000", 2024-09-12T16:17:21.021 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3974085489999997, 2024-09-12T16:17:21.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045737673999999999, 2024-09-12T16:17:21.021 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:21.021 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:21.021 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:21.021 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:21.021 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:21.021 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:21.022 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6977 2024-09-12T16:17:21.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.022 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:21.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:21.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566114+0000", 2024-09-12T16:17:21.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:21.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:21.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566114+0000", 2024-09-12T16:17:21.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:21.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:21.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566115+0000", 2024-09-12T16:17:21.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.71e-07 2024-09-12T16:17:21.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:21.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566119+0000", 2024-09-12T16:17:21.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2749999999999997e-06 2024-09-12T16:17:21.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:21.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566128+0000", 2024-09-12T16:17:21.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9490000000000002e-06 2024-09-12T16:17:21.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:21.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566135+0000", 2024-09-12T16:17:21.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3459999999999999e-06 2024-09-12T16:17:21.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:21.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.610416+0000", 2024-09-12T16:17:21.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044281686000000001 2024-09-12T16:17:21.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:21.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.610536+0000", 2024-09-12T16:17:21.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000119412 2024-09-12T16:17:21.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:21.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.611852+0000", 2024-09-12T16:17:21.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001316135 2024-09-12T16:17:21.025 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:21.025 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:21.025 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:21.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.025 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6986 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2518016~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:21.025 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.566890+0000", 2024-09-12T16:17:21.025 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3966326260000006, 2024-09-12T16:17:21.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045234719999999999, 2024-09-12T16:17:21.026 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:21.026 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:21.026 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:21.026 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:21.026 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:21.026 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:21.026 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6986 2024-09-12T16:17:21.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.026 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:21.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:21.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566890+0000", 2024-09-12T16:17:21.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:21.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:21.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566890+0000", 2024-09-12T16:17:21.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:21.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:21.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566891+0000", 2024-09-12T16:17:21.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2799999999999995e-07 2024-09-12T16:17:21.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:21.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566895+0000", 2024-09-12T16:17:21.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8179999999999997e-06 2024-09-12T16:17:21.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:21.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566904+0000", 2024-09-12T16:17:21.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5179999999999993e-06 2024-09-12T16:17:21.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:21.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566911+0000", 2024-09-12T16:17:21.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1640000000000004e-06 2024-09-12T16:17:21.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:21.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.611985+0000", 2024-09-12T16:17:21.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045073545999999999 2024-09-12T16:17:21.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:21.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612061+0000", 2024-09-12T16:17:21.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5617999999999993e-05 2024-09-12T16:17:21.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:21.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612125+0000", 2024-09-12T16:17:21.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4327999999999998e-05 2024-09-12T16:17:21.029 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:21.030 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:21.030 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:21.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.030 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6987 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2533376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:21.030 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.566982+0000", 2024-09-12T16:17:21.030 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3965406060000003, 2024-09-12T16:17:21.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045308858, 2024-09-12T16:17:21.030 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:21.030 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:21.030 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:21.030 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:21.030 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:21.030 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:21.031 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6987 2024-09-12T16:17:21.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.031 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:21.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:21.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566982+0000", 2024-09-12T16:17:21.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:21.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:21.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566982+0000", 2024-09-12T16:17:21.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:21.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:21.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566983+0000", 2024-09-12T16:17:21.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2500000000000005e-07 2024-09-12T16:17:21.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:21.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566986+0000", 2024-09-12T16:17:21.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3000000000000002e-06 2024-09-12T16:17:21.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:21.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566995+0000", 2024-09-12T16:17:21.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8419999999999994e-06 2024-09-12T16:17:21.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:21.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567001+0000", 2024-09-12T16:17:21.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.161e-06 2024-09-12T16:17:21.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:21.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612154+0000", 2024-09-12T16:17:21.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045152858999999997 2024-09-12T16:17:21.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:21.034 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612229+0000", 2024-09-12T16:17:21.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4958999999999998e-05 2024-09-12T16:17:21.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.034 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:21.034 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612291+0000", 2024-09-12T16:17:21.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2012000000000002e-05 2024-09-12T16:17:21.034 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:21.034 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:21.034 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:21.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.034 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6988 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2548736~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:21.035 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.567055+0000", 2024-09-12T16:17:21.035 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3964681399999996, 2024-09-12T16:17:21.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045400078000000003, 2024-09-12T16:17:21.035 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:21.035 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:21.035 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:21.035 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:21.035 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:21.035 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:21.035 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6988 2024-09-12T16:17:21.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.035 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:21.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:21.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567055+0000", 2024-09-12T16:17:21.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:21.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:21.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567055+0000", 2024-09-12T16:17:21.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:21.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:21.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567055+0000", 2024-09-12T16:17:21.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3e-07 2024-09-12T16:17:21.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:21.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567059+0000", 2024-09-12T16:17:21.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4510000000000001e-06 2024-09-12T16:17:21.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:21.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567070+0000", 2024-09-12T16:17:21.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1477e-05 2024-09-12T16:17:21.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:21.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567077+0000", 2024-09-12T16:17:21.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7880000000000001e-06 2024-09-12T16:17:21.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:21.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612320+0000", 2024-09-12T16:17:21.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045242544000000003 2024-09-12T16:17:21.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:21.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612394+0000", 2024-09-12T16:17:21.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3854000000000001e-05 2024-09-12T16:17:21.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:21.039 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612455+0000", 2024-09-12T16:17:21.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1234000000000004e-05 2024-09-12T16:17:21.039 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:21.039 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:21.039 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:21.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.039 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6989 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2565120~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:21.039 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.567103+0000", 2024-09-12T16:17:21.039 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3964193340000008, 2024-09-12T16:17:21.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045514760000000001, 2024-09-12T16:17:21.039 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:21.039 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:21.039 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:21.039 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:21.040 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:21.040 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:21.040 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6989 2024-09-12T16:17:21.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.040 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:21.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.040 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:21.040 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567103+0000", 2024-09-12T16:17:21.040 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:21.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.040 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:21.040 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567103+0000", 2024-09-12T16:17:21.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:21.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:21.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567104+0000", 2024-09-12T16:17:21.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6400000000000002e-07 2024-09-12T16:17:21.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:21.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567107+0000", 2024-09-12T16:17:21.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.038e-06 2024-09-12T16:17:21.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:21.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567117+0000", 2024-09-12T16:17:21.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0244999999999999e-05 2024-09-12T16:17:21.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:21.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567124+0000", 2024-09-12T16:17:21.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1469999999999998e-06 2024-09-12T16:17:21.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:21.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612483+0000", 2024-09-12T16:17:21.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045359099999999999 2024-09-12T16:17:21.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:21.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612556+0000", 2024-09-12T16:17:21.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2948999999999996e-05 2024-09-12T16:17:21.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:21.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612618+0000", 2024-09-12T16:17:21.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2617e-05 2024-09-12T16:17:21.043 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:21.043 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:21.043 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:21.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.043 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6990 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2580480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:21.044 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.567155+0000", 2024-09-12T16:17:21.044 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3963680969999999, 2024-09-12T16:17:21.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045665681999999999, 2024-09-12T16:17:21.044 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:21.044 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:21.044 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:21.044 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:21.044 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:21.044 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:21.044 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6990 2024-09-12T16:17:21.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.044 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:21.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:21.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567155+0000", 2024-09-12T16:17:21.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:21.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:21.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567155+0000", 2024-09-12T16:17:21.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:21.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:21.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567155+0000", 2024-09-12T16:17:21.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5700000000000002e-07 2024-09-12T16:17:21.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:21.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567159+0000", 2024-09-12T16:17:21.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1729999999999999e-06 2024-09-12T16:17:21.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:21.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567167+0000", 2024-09-12T16:17:21.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3469999999999999e-06 2024-09-12T16:17:21.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:21.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567173+0000", 2024-09-12T16:17:21.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0719999999999996e-06 2024-09-12T16:17:21.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:21.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612651+0000", 2024-09-12T16:17:21.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045478078999999998 2024-09-12T16:17:21.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:21.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612741+0000", 2024-09-12T16:17:21.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0435999999999999e-05 2024-09-12T16:17:21.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:21.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612820+0000", 2024-09-12T16:17:21.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8918000000000006e-05 2024-09-12T16:17:21.048 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:21.048 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:21.048 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:21.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.048 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6991 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2595840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:21.048 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.567220+0000", 2024-09-12T16:17:21.048 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3963030889999999, 2024-09-12T16:17:21.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045811022999999999, 2024-09-12T16:17:21.049 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:21.049 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:21.049 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:21.049 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:21.049 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:21.049 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:21.049 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6991 2024-09-12T16:17:21.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.049 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:21.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:21.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567220+0000", 2024-09-12T16:17:21.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:21.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:21.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567220+0000", 2024-09-12T16:17:21.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:21.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:21.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567221+0000", 2024-09-12T16:17:21.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.16e-07 2024-09-12T16:17:21.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:21.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567225+0000", 2024-09-12T16:17:21.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3950000000000003e-06 2024-09-12T16:17:21.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:21.051 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567243+0000", 2024-09-12T16:17:21.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7734999999999999e-05 2024-09-12T16:17:21.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:21.051 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567253+0000", 2024-09-12T16:17:21.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7540000000000001e-06 2024-09-12T16:17:21.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:21.051 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612854+0000", 2024-09-12T16:17:21.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045601227000000001 2024-09-12T16:17:21.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:21.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612950+0000", 2024-09-12T16:17:21.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6121999999999999e-05 2024-09-12T16:17:21.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:21.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.613031+0000", 2024-09-12T16:17:21.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0873999999999999e-05 2024-09-12T16:17:21.052 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:21.052 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:21.053 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:21.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.053 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6992 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2611200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:21.053 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.567349+0000", 2024-09-12T16:17:21.053 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3961733330000001, 2024-09-12T16:17:21.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045848710000000001, 2024-09-12T16:17:21.053 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:21.053 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:21.053 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:21.053 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:21.053 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:21.053 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:21.054 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6992 2024-09-12T16:17:21.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.054 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:21.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:21.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567349+0000", 2024-09-12T16:17:21.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:21.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:21.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567349+0000", 2024-09-12T16:17:21.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:21.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:21.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567350+0000", 2024-09-12T16:17:21.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8899999999999998e-07 2024-09-12T16:17:21.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:21.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567354+0000", 2024-09-12T16:17:21.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0130000000000004e-06 2024-09-12T16:17:21.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:21.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567364+0000", 2024-09-12T16:17:21.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0158e-05 2024-09-12T16:17:21.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:21.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567369+0000", 2024-09-12T16:17:21.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4839999999999998e-06 2024-09-12T16:17:21.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:21.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.613072+0000", 2024-09-12T16:17:21.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045703195000000002 2024-09-12T16:17:21.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:21.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.613156+0000", 2024-09-12T16:17:21.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3591999999999995e-05 2024-09-12T16:17:21.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:21.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:21.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:21.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.613198+0000", 2024-09-12T16:17:21.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2478999999999998e-05 2024-09-12T16:17:21.057 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:21.057 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:21.057 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:21.057 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:21.057 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:21.057 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:21.059 INFO:teuthology.orchestra.run.smithi204.stdout:4117 punch from 0x628800 to 0x634800, (0xc000 bytes) 2024-09-12T16:17:21.059 INFO:teuthology.orchestra.run.smithi204.stdout:4118 read 0x1544200 thru 0x154653b (0x233c bytes) 2024-09-12T16:17:21.059 INFO:teuthology.orchestra.run.smithi204.stdout:4119 write 0x9653e00 thru 0x965e2b3 (0xa4b4 bytes) 2024-09-12T16:17:21.059 INFO:teuthology.orchestra.run.smithi204.stdout:4120 read 0x901200 thru 0x905105 (0x3f06 bytes) 2024-09-12T16:17:21.060 INFO:teuthology.orchestra.run.smithi204.stdout:4122 trunc from 0x965e400 to 0x844f000 2024-09-12T16:17:21.060 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:17:21.061 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.5 to 1 (10000) 2024-09-12T16:17:21.061 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-12T16:17:21.061 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:21.058+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:21.065 INFO:teuthology.orchestra.run.smithi204.stdout:4124 read 0x1392c00 thru 0x13a0ca2 (0xe0a3 bytes) 2024-09-12T16:17:21.074 INFO:teuthology.orchestra.run.smithi204.stdout:4125 read 0x2944000 thru 0x2948ab0 (0x4ab1 bytes) 2024-09-12T16:17:21.074 INFO:teuthology.orchestra.run.smithi204.stdout:4126 punch from 0x3246a00 to 0x324a000, (0x3600 bytes) 2024-09-12T16:17:21.074 INFO:teuthology.orchestra.run.smithi204.stdout:4127 write 0xa3ae00 thru 0xa4a299 (0xf49a bytes) 2024-09-12T16:17:21.074 INFO:teuthology.orchestra.run.smithi204.stdout:4128 write 0x6d86000 thru 0x6d87f4b (0x1f4c bytes) 2024-09-12T16:17:21.074 INFO:teuthology.orchestra.run.smithi204.stdout:4129 write 0x2f08000 thru 0x2f0ee26 (0x6e27 bytes) 2024-09-12T16:17:21.074 INFO:teuthology.orchestra.run.smithi204.stdout:4132 read 0x1ae1e00 thru 0x1aea62b (0x882c bytes) 2024-09-12T16:17:21.110 INFO:teuthology.orchestra.run.smithi204.stdout:4133 write 0xed2b200 thru 0xed2bef2 (0xcf3 bytes) 2024-09-12T16:17:21.110 INFO:teuthology.orchestra.run.smithi204.stdout:4134 write 0x467e600 thru 0x4688605 (0xa006 bytes) 2024-09-12T16:17:21.110 INFO:teuthology.orchestra.run.smithi204.stdout:4136 clone 27 order 20 su 4096 sc 3 2024-09-12T16:17:21.159 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:21.159+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:21.180 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:21.180 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:21.180 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:17:21.180 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:21.189 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:17:21.260 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:21.259+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:21.296 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:21.296 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:21.297 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:17:21.297 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:17:21.297 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:21.305 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:17:21.361 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:21.360+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:21.454 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:21.454 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:17:21.454 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:17:21.455 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:17:21.455 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.455 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:17:21.455 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:17:21.455 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 99.688393562000002, 2024-09-12T16:17:21.455 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55645454900000002, 2024-09-12T16:17:21.455 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:21.455 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:21.455 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:21.455 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:21.455 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:17:21.455 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:17:21.455 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1 2024-09-12T16:17:21.455 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.455 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:21.456 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.456 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:21.456 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:17:21.456 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.456 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.456 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.456 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:21.456 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:17:21.456 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.456 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.456 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.456 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:21.456 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764440+0000", 2024-09-12T16:17:21.456 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6249999999999999e-06 2024-09-12T16:17:21.456 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.457 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.457 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:21.457 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764447+0000", 2024-09-12T16:17:21.457 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4939999999999997e-06 2024-09-12T16:17:21.457 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.457 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.457 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:21.457 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764459+0000", 2024-09-12T16:17:21.457 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1517e-05 2024-09-12T16:17:21.457 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.457 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.457 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:21.457 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764468+0000", 2024-09-12T16:17:21.458 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7690000000000002e-06 2024-09-12T16:17:21.458 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.458 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.458 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:21.458 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764539+0000", 2024-09-12T16:17:21.458 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1103e-05 2024-09-12T16:17:21.458 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.458 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.458 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:17:21.458 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764551+0000", 2024-09-12T16:17:21.458 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2687999999999999e-05 2024-09-12T16:17:21.458 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.458 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.458 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:21.458 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319497+0000", 2024-09-12T16:17:21.459 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55494560500000001 2024-09-12T16:17:21.459 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.459 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.459 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:21.459 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319688+0000", 2024-09-12T16:17:21.459 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019105599999999999 2024-09-12T16:17:21.459 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.459 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.459 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:17:21.459 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319842+0000", 2024-09-12T16:17:21.459 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015377699999999999 2024-09-12T16:17:21.459 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.459 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.459 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:17:21.459 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320473+0000", 2024-09-12T16:17:21.460 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00063117100000000003 2024-09-12T16:17:21.460 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.460 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.460 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:21.460 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320825+0000", 2024-09-12T16:17:21.460 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00035202500000000001 2024-09-12T16:17:21.460 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.460 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.460 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:21.460 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320867+0000", 2024-09-12T16:17:21.460 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2005000000000002e-05 2024-09-12T16:17:21.460 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.460 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.460 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:21.460 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320893+0000", 2024-09-12T16:17:21.461 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5714000000000001e-05 2024-09-12T16:17:21.461 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.461 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:21.461 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.461 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.461 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.461 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14034 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5035008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:21.461 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:17:21.461 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 61.931335328999999, 2024-09-12T16:17:21.461 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053404082999999998, 2024-09-12T16:17:21.461 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:21.461 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:21.461 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:21.461 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:21.461 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:21.462 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:21.462 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14034 2024-09-12T16:17:21.462 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.462 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:21.462 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.462 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:21.462 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:17:21.462 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.462 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.462 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.462 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:21.462 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:17:21.462 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.462 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.462 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.463 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:21.463 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521740+0000", 2024-09-12T16:17:21.463 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000243976 2024-09-12T16:17:21.463 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.463 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.463 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:21.463 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521745+0000", 2024-09-12T16:17:21.463 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1280000000000001e-06 2024-09-12T16:17:21.463 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.463 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.463 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:21.463 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521757+0000", 2024-09-12T16:17:21.463 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2751e-05 2024-09-12T16:17:21.463 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.463 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.464 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:21.464 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521771+0000", 2024-09-12T16:17:21.464 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3328e-05 2024-09-12T16:17:21.464 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.464 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.464 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:21.464 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574710+0000", 2024-09-12T16:17:21.464 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052939358999999998 2024-09-12T16:17:21.464 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.464 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.464 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:21.464 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574799+0000", 2024-09-12T16:17:21.464 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8893000000000004e-05 2024-09-12T16:17:21.465 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.465 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.465 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:21.465 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574901+0000", 2024-09-12T16:17:21.465 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101648 2024-09-12T16:17:21.465 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.465 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:21.465 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.465 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.465 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.465 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14036 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5043200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:21.465 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:17:21.465 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 61.930876134999998, 2024-09-12T16:17:21.465 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053426247000000003, 2024-09-12T16:17:21.465 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:21.465 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:21.466 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:21.466 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:21.466 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:21.466 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:21.466 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14036 2024-09-12T16:17:21.466 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.466 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:21.466 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.466 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:21.466 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:17:21.466 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.466 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.466 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.466 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:21.466 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:17:21.467 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.467 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.467 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.467 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:21.467 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522208+0000", 2024-09-12T16:17:21.467 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025195300000000002 2024-09-12T16:17:21.467 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.467 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.467 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:21.467 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522211+0000", 2024-09-12T16:17:21.467 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2160000000000002e-06 2024-09-12T16:17:21.467 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.467 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.467 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:21.467 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522223+0000", 2024-09-12T16:17:21.468 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2044e-05 2024-09-12T16:17:21.468 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.468 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.468 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:21.468 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522229+0000", 2024-09-12T16:17:21.468 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8850000000000004e-06 2024-09-12T16:17:21.468 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.468 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.468 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:21.468 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575192+0000", 2024-09-12T16:17:21.468 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052963573 2024-09-12T16:17:21.468 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.468 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.468 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:21.468 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575282+0000", 2024-09-12T16:17:21.469 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9666000000000005e-05 2024-09-12T16:17:21.469 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.469 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.469 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:21.469 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575382+0000", 2024-09-12T16:17:21.469 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9909999999999997e-05 2024-09-12T16:17:21.469 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.469 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:21.469 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.469 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.469 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.469 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14038 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5051392~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:21.469 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:17:21.469 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 61.930337762000001, 2024-09-12T16:17:21.469 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053395152000000001, 2024-09-12T16:17:21.470 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:21.470 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:21.470 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:21.470 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:21.470 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:21.470 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:21.470 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14038 2024-09-12T16:17:21.470 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.470 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:21.470 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.470 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:21.470 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:17:21.470 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.470 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.470 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.471 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:21.471 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:17:21.471 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.471 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.471 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.471 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:21.471 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522601+0000", 2024-09-12T16:17:21.471 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010702899999999999 2024-09-12T16:17:21.471 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.471 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.471 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:21.471 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522605+0000", 2024-09-12T16:17:21.471 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2379999999999999e-06 2024-09-12T16:17:21.471 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.472 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.472 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:21.472 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522616+0000", 2024-09-12T16:17:21.472 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1185999999999999e-05 2024-09-12T16:17:21.472 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.472 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.472 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:21.472 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522624+0000", 2024-09-12T16:17:21.472 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1099999999999997e-06 2024-09-12T16:17:21.472 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.472 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.472 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:21.472 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575677+0000", 2024-09-12T16:17:21.472 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053126999999999 2024-09-12T16:17:21.473 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.473 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.473 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:21.473 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575764+0000", 2024-09-12T16:17:21.473 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7250000000000007e-05 2024-09-12T16:17:21.473 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.473 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.473 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:21.473 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575889+0000", 2024-09-12T16:17:21.473 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012521200000000001 2024-09-12T16:17:21.473 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.473 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:21.473 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.473 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.474 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.474 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14039 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5055488~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:21.474 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:17:21.474 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 61.930196350999999, 2024-09-12T16:17:21.474 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053466207000000002, 2024-09-12T16:17:21.474 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:21.474 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:21.474 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:21.474 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:21.474 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:21.474 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:21.474 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14039 2024-09-12T16:17:21.474 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.475 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:21.475 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.475 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:21.475 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:17:21.475 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.475 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.475 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.475 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:21.475 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:17:21.475 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.475 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.475 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.475 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:21.475 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522899+0000", 2024-09-12T16:17:21.475 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026318199999999999 2024-09-12T16:17:21.476 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.476 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.476 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:21.476 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522903+0000", 2024-09-12T16:17:21.476 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.929e-06 2024-09-12T16:17:21.476 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.476 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.476 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:21.476 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522913+0000", 2024-09-12T16:17:21.476 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0162e-05 2024-09-12T16:17:21.476 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.476 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.476 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:21.476 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522921+0000", 2024-09-12T16:17:21.477 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.14e-06 2024-09-12T16:17:21.477 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.477 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.477 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:21.477 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575922+0000", 2024-09-12T16:17:21.477 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053000712999999998 2024-09-12T16:17:21.477 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.477 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.477 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:21.477 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576006+0000", 2024-09-12T16:17:21.477 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4161999999999998e-05 2024-09-12T16:17:21.477 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.477 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.477 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:21.477 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576102+0000", 2024-09-12T16:17:21.478 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5919000000000001e-05 2024-09-12T16:17:21.478 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.478 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:21.478 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.478 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.478 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.478 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14040 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5059584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:21.478 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:17:21.478 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 61.929891456, 2024-09-12T16:17:21.478 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053413258999999998, 2024-09-12T16:17:21.478 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:21.478 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:21.478 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:21.478 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:21.478 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:21.478 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:21.479 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14040 2024-09-12T16:17:21.479 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.479 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:21.479 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.479 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:21.479 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:17:21.479 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.479 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.479 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.479 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:21.479 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:17:21.479 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.479 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.479 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.479 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:21.480 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523059+0000", 2024-09-12T16:17:21.480 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118466 2024-09-12T16:17:21.480 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.480 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.480 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:21.480 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523062+0000", 2024-09-12T16:17:21.480 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.971e-06 2024-09-12T16:17:21.480 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.480 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.480 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:21.480 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523069+0000", 2024-09-12T16:17:21.482 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8279999999999997e-06 2024-09-12T16:17:21.482 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.482 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.482 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:21.482 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523073+0000", 2024-09-12T16:17:21.483 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3019999999999996e-06 2024-09-12T16:17:21.483 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.483 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.483 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:21.483 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576155+0000", 2024-09-12T16:17:21.483 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053081962000000003 2024-09-12T16:17:21.483 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.483 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.483 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:21.483 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576249+0000", 2024-09-12T16:17:21.483 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3914999999999998e-05 2024-09-12T16:17:21.483 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.483 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.484 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:21.484 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576354+0000", 2024-09-12T16:17:21.484 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010481500000000001 2024-09-12T16:17:21.484 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.484 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:21.484 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.484 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.484 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.484 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14041 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5063680~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:21.484 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:17:21.484 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 61.929741151000002, 2024-09-12T16:17:21.484 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053519111000000001, 2024-09-12T16:17:21.484 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:21.485 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:21.485 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:21.485 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:21.485 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:21.485 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:21.485 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14041 2024-09-12T16:17:21.485 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.485 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:21.485 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.485 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:21.485 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:17:21.485 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.486 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.486 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.486 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:21.486 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:17:21.486 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.486 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.486 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.487 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:21.487 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523309+0000", 2024-09-12T16:17:21.487 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000218712 2024-09-12T16:17:21.487 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.487 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.487 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:21.488 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523313+0000", 2024-09-12T16:17:21.488 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.151e-06 2024-09-12T16:17:21.488 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.488 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.488 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:21.488 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523320+0000", 2024-09-12T16:17:21.488 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9789999999999993e-06 2024-09-12T16:17:21.488 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.488 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.488 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:21.488 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523325+0000", 2024-09-12T16:17:21.488 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:17:21.488 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.489 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.489 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:21.489 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576402+0000", 2024-09-12T16:17:21.489 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053076811000000002 2024-09-12T16:17:21.489 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.489 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.489 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:21.489 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576491+0000", 2024-09-12T16:17:21.489 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8578999999999993e-05 2024-09-12T16:17:21.489 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.489 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.489 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:21.489 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576610+0000", 2024-09-12T16:17:21.489 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119129 2024-09-12T16:17:21.490 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.490 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:21.490 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.490 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.490 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.490 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14042 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5067776~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:21.490 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:17:21.490 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 61.929497716999997, 2024-09-12T16:17:21.490 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053510350999999998, 2024-09-12T16:17:21.490 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:21.490 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:21.490 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:21.490 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:21.490 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:21.491 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:21.491 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14042 2024-09-12T16:17:21.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.491 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:21.491 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.491 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:21.491 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:17:21.491 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.491 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.491 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:21.491 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:17:21.491 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.491 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.492 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:21.492 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523591+0000", 2024-09-12T16:17:21.492 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025710300000000001 2024-09-12T16:17:21.492 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.492 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.492 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:21.492 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523594+0000", 2024-09-12T16:17:21.492 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2229999999999999e-06 2024-09-12T16:17:21.492 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.492 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.492 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:21.492 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523602+0000", 2024-09-12T16:17:21.492 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6930000000000007e-06 2024-09-12T16:17:21.493 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.493 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.496 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:21.496 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523607+0000", 2024-09-12T16:17:21.496 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4789999999999998e-06 2024-09-12T16:17:21.496 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.496 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.496 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:21.496 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576661+0000", 2024-09-12T16:17:21.497 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053973999999997 2024-09-12T16:17:21.497 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.497 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.497 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:21.497 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576745+0000", 2024-09-12T16:17:21.497 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4660000000000006e-05 2024-09-12T16:17:21.497 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.497 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.497 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:21.497 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576844+0000", 2024-09-12T16:17:21.497 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9219e-05 2024-09-12T16:17:21.497 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.498 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:21.498 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.498 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.498 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.498 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14043 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5071872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:21.498 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:17:21.498 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 61.929217238, 2024-09-12T16:17:21.499 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053475295999999999, 2024-09-12T16:17:21.499 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:21.499 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:21.499 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:21.499 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:21.499 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:21.499 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:21.499 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14043 2024-09-12T16:17:21.499 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.499 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:21.499 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.499 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:21.499 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:17:21.499 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.500 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.500 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.500 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:21.500 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:17:21.500 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.500 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.500 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.500 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:21.500 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523823+0000", 2024-09-12T16:17:21.500 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020818900000000001 2024-09-12T16:17:21.500 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.500 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.500 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:21.500 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523826+0000", 2024-09-12T16:17:21.500 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.405e-06 2024-09-12T16:17:21.501 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.501 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.501 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:21.501 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523834+0000", 2024-09-12T16:17:21.501 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5499999999999997e-06 2024-09-12T16:17:21.501 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.501 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.501 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:21.501 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523838+0000", 2024-09-12T16:17:21.501 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.408e-06 2024-09-12T16:17:21.501 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.501 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.501 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:21.501 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576904+0000", 2024-09-12T16:17:21.502 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053065687 2024-09-12T16:17:21.502 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.502 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.502 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:21.502 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576991+0000", 2024-09-12T16:17:21.502 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7399999999999997e-05 2024-09-12T16:17:21.502 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.502 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.502 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:21.502 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577090+0000", 2024-09-12T16:17:21.502 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8657000000000001e-05 2024-09-12T16:17:21.502 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.502 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:21.502 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.502 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.503 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.503 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14044 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5075968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:21.503 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:17:21.503 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 61.928985707999999, 2024-09-12T16:17:21.503 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053442659000000003, 2024-09-12T16:17:21.503 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:21.503 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:21.503 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:21.503 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:21.503 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:21.503 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:21.503 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14044 2024-09-12T16:17:21.503 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.503 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:21.503 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.504 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:21.504 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:17:21.504 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.504 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.504 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.504 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:21.504 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:17:21.504 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.504 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.504 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.504 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:21.504 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523985+0000", 2024-09-12T16:17:21.504 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000138522 2024-09-12T16:17:21.504 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.505 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.505 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:21.505 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523988+0000", 2024-09-12T16:17:21.505 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.788e-06 2024-09-12T16:17:21.505 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.505 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.505 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:21.505 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523998+0000", 2024-09-12T16:17:21.505 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8470000000000008e-06 2024-09-12T16:17:21.505 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.505 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.505 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:21.505 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524010+0000", 2024-09-12T16:17:21.505 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1348999999999999e-05 2024-09-12T16:17:21.506 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.506 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.506 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:21.506 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577137+0000", 2024-09-12T16:17:21.506 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053127055999999999 2024-09-12T16:17:21.506 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.506 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.506 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:21.506 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577210+0000", 2024-09-12T16:17:21.506 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3392000000000005e-05 2024-09-12T16:17:21.506 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.506 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.506 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:21.506 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577289+0000", 2024-09-12T16:17:21.507 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8704999999999999e-05 2024-09-12T16:17:21.507 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.507 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:21.507 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.507 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.507 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.507 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14045 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5080064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:21.507 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:17:21.507 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 61.928806887, 2024-09-12T16:17:21.507 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053497514000000003, 2024-09-12T16:17:21.507 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:21.507 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:21.507 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:21.507 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:21.508 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:21.508 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:21.508 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14045 2024-09-12T16:17:21.508 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.508 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:21.508 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.508 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:21.508 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:17:21.508 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.508 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.508 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.508 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:21.508 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:17:21.508 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.508 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.508 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.509 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:21.509 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524311+0000", 2024-09-12T16:17:21.509 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028626299999999998 2024-09-12T16:17:21.509 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.509 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.509 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:21.509 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524315+0000", 2024-09-12T16:17:21.509 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0969999999999999e-06 2024-09-12T16:17:21.509 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.509 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.509 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:21.509 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524325+0000", 2024-09-12T16:17:21.509 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6330000000000008e-06 2024-09-12T16:17:21.509 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.509 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.510 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:21.510 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524332+0000", 2024-09-12T16:17:21.510 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8700000000000003e-06 2024-09-12T16:17:21.510 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.510 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.510 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:21.510 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577334+0000", 2024-09-12T16:17:21.510 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053001834999999997 2024-09-12T16:17:21.510 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.510 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.510 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:21.510 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577420+0000", 2024-09-12T16:17:21.510 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6145999999999998e-05 2024-09-12T16:17:21.510 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.510 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.510 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:21.511 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577522+0000", 2024-09-12T16:17:21.511 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010267 2024-09-12T16:17:21.511 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.511 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:21.511 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.511 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.511 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.511 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14047 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5088256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:21.511 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:17:21.511 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 61.928321161, 2024-09-12T16:17:21.511 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053433340000000003, 2024-09-12T16:17:21.511 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:21.511 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:21.511 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:21.511 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:21.511 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:21.512 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:21.512 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14047 2024-09-12T16:17:21.512 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.512 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:21.512 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.512 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:21.512 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:17:21.512 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.512 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.512 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.512 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:21.512 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:17:21.512 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.512 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.512 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.513 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:21.513 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524727+0000", 2024-09-12T16:17:21.513 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000216126 2024-09-12T16:17:21.513 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.513 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.513 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:21.513 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524732+0000", 2024-09-12T16:17:21.513 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1569999999999999e-06 2024-09-12T16:17:21.513 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.513 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.513 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:21.513 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524742+0000", 2024-09-12T16:17:21.513 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0186999999999999e-05 2024-09-12T16:17:21.513 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.514 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.514 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:21.514 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524750+0000", 2024-09-12T16:17:21.514 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4279999999999999e-06 2024-09-12T16:17:21.514 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.514 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.514 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:21.514 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577743+0000", 2024-09-12T16:17:21.514 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052993077 2024-09-12T16:17:21.514 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.514 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.514 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:21.514 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577841+0000", 2024-09-12T16:17:21.514 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8369000000000006e-05 2024-09-12T16:17:21.514 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.514 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.515 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:21.515 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577944+0000", 2024-09-12T16:17:21.515 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102996 2024-09-12T16:17:21.515 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.515 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:21.515 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.515 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.515 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.515 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14048 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5092352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:21.515 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:17:21.515 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 61.928069567999998, 2024-09-12T16:17:21.515 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053397515, 2024-09-12T16:17:21.515 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:21.515 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:21.515 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:21.516 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:21.516 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:21.516 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:21.516 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14048 2024-09-12T16:17:21.516 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.516 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:21.516 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.516 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:21.516 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:17:21.516 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.516 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.516 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.517 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:21.517 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:17:21.517 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.517 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.517 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.517 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:21.517 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524957+0000", 2024-09-12T16:17:21.517 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019516999999999999 2024-09-12T16:17:21.517 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.517 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.517 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:21.517 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524962+0000", 2024-09-12T16:17:21.517 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7709999999999997e-06 2024-09-12T16:17:21.517 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.517 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.518 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:21.518 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524973+0000", 2024-09-12T16:17:21.518 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1031e-05 2024-09-12T16:17:21.518 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.518 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.518 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:21.518 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524980+0000", 2024-09-12T16:17:21.518 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6100000000000002e-06 2024-09-12T16:17:21.518 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.518 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.518 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:21.518 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577977+0000", 2024-09-12T16:17:21.518 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052997481999999999 2024-09-12T16:17:21.519 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.519 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.519 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:21.519 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578062+0000", 2024-09-12T16:17:21.519 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4851000000000005e-05 2024-09-12T16:17:21.519 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.519 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.519 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:21.519 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578160+0000", 2024-09-12T16:17:21.519 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7600000000000001e-05 2024-09-12T16:17:21.519 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.519 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:21.519 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.519 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.519 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.519 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14049 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5096448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:21.520 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:17:21.520 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 61.927840940000003, 2024-09-12T16:17:21.520 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053439792, 2024-09-12T16:17:21.520 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:21.520 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:21.520 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:21.520 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:21.520 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:21.520 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:21.520 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14049 2024-09-12T16:17:21.520 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.520 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:21.520 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.520 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:21.521 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:17:21.521 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.521 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.521 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.521 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:21.521 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:17:21.521 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.521 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.521 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.521 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:21.521 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525170+0000", 2024-09-12T16:17:21.521 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017958500000000001 2024-09-12T16:17:21.521 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.521 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.522 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:21.522 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525174+0000", 2024-09-12T16:17:21.522 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0239999999999999e-06 2024-09-12T16:17:21.522 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.522 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.522 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:21.522 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525184+0000", 2024-09-12T16:17:21.522 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5950000000000005e-06 2024-09-12T16:17:21.522 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.522 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.522 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:21.522 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525191+0000", 2024-09-12T16:17:21.522 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8329999999999996e-06 2024-09-12T16:17:21.522 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.522 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.522 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:21.523 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578240+0000", 2024-09-12T16:17:21.523 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053049236 2024-09-12T16:17:21.523 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.523 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.523 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:21.523 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578333+0000", 2024-09-12T16:17:21.523 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2806999999999994e-05 2024-09-12T16:17:21.523 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.523 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.523 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:21.523 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578431+0000", 2024-09-12T16:17:21.523 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7712000000000002e-05 2024-09-12T16:17:21.523 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.524 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:21.524 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.524 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.524 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.524 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14055 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5121024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:21.524 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:17:21.524 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 61.926570249000001, 2024-09-12T16:17:21.524 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053399038000000003, 2024-09-12T16:17:21.524 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:21.524 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:21.524 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:21.524 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:21.524 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:21.524 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:21.524 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14055 2024-09-12T16:17:21.525 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.525 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:21.525 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.525 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:21.525 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:17:21.525 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.525 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.525 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.525 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:21.525 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:17:21.526 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.526 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.526 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.526 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:21.526 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526403+0000", 2024-09-12T16:17:21.526 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141571 2024-09-12T16:17:21.527 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.527 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.527 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:21.527 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526406+0000", 2024-09-12T16:17:21.527 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2660000000000002e-06 2024-09-12T16:17:21.527 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.527 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.527 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:21.527 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526420+0000", 2024-09-12T16:17:21.527 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3949e-05 2024-09-12T16:17:21.527 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.527 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.527 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:21.528 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526428+0000", 2024-09-12T16:17:21.528 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4250000000000001e-06 2024-09-12T16:17:21.528 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.528 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.528 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:21.528 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579476+0000", 2024-09-12T16:17:21.529 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053048349000000002 2024-09-12T16:17:21.529 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.529 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.529 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:21.529 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579563+0000", 2024-09-12T16:17:21.529 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6502999999999995e-05 2024-09-12T16:17:21.529 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.529 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.529 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:21.529 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579661+0000", 2024-09-12T16:17:21.529 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7974999999999996e-05 2024-09-12T16:17:21.529 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.529 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:21.530 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.530 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.530 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.530 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4806.0:3139 3.1e 3:78d5a095:::rbd_data.11552a37e55b.0000000000000000:head [read 69632~61440] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:17:21.530 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:21.530 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 51.151575999000002, 2024-09-12T16:17:21.530 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057851734000000002, 2024-09-12T16:17:21.530 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:21.530 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:21.530 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:21.530 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:21.530 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4806", 2024-09-12T16:17:21.530 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3959815836", 2024-09-12T16:17:21.530 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 3139 2024-09-12T16:17:21.530 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.531 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:21.531 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.531 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:21.531 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:21.531 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.531 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.531 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.531 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:21.531 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:21.531 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.531 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.531 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.531 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:21.531 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:21.531 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4799999999999999e-07 2024-09-12T16:17:21.532 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.532 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.532 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:21.532 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301258+0000", 2024-09-12T16:17:21.532 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.844e-06 2024-09-12T16:17:21.532 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.532 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.532 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:21.532 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301267+0000", 2024-09-12T16:17:21.532 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2960000000000004e-06 2024-09-12T16:17:21.532 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.532 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.532 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:21.532 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301276+0000", 2024-09-12T16:17:21.533 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0650000000000005e-06 2024-09-12T16:17:21.533 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.533 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.533 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:21.533 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301871+0000", 2024-09-12T16:17:21.533 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00059423600000000005 2024-09-12T16:17:21.533 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.533 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.533 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:21.533 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301920+0000", 2024-09-12T16:17:21.533 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9067000000000003e-05 2024-09-12T16:17:21.533 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.534 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.534 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:21.534 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359108+0000", 2024-09-12T16:17:21.534 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057187877999999998 2024-09-12T16:17:21.534 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.534 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:21.534 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.534 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.534 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.534 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:6428 3.14 3:28a44e54:::rbd_header.11552a37e55b:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:17:21.534 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:17:21.534 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 51.151247404999999, 2024-09-12T16:17:21.534 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057504023000000001, 2024-09-12T16:17:21.535 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:21.535 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:21.535 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:21.535 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:21.535 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:17:21.535 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:17:21.535 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6428 2024-09-12T16:17:21.535 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.535 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:21.535 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.535 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:21.535 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:17:21.535 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.535 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.536 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.536 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:21.536 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:17:21.536 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.536 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.536 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.536 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:21.536 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301585+0000", 2024-09-12T16:17:21.536 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6300000000000005e-07 2024-09-12T16:17:21.536 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.536 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.536 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:21.537 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301588+0000", 2024-09-12T16:17:21.537 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4149999999999999e-06 2024-09-12T16:17:21.537 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.537 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.537 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:21.537 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301597+0000", 2024-09-12T16:17:21.537 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5450000000000003e-06 2024-09-12T16:17:21.537 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.537 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.537 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:21.537 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301617+0000", 2024-09-12T16:17:21.537 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9837e-05 2024-09-12T16:17:21.538 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.538 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.538 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:21.538 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301779+0000", 2024-09-12T16:17:21.538 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016186799999999999 2024-09-12T16:17:21.538 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.538 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.538 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:21.538 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301855+0000", 2024-09-12T16:17:21.538 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5899e-05 2024-09-12T16:17:21.538 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.538 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.538 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:21.538 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359088+0000", 2024-09-12T16:17:21.538 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057233895999999999 2024-09-12T16:17:21.538 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.539 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:21.539 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.539 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.539 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.539 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5223.0:1814 3.f 3:f7b1b1c5:::rbd_object_map.1155a1fd27d2:head [read 0~136] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-12T16:17:21.539 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:17:21.539 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.215581341, 2024-09-12T16:17:21.539 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.006378226, 2024-09-12T16:17:21.539 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:21.539 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:21.539 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:21.539 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:21.539 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5223", 2024-09-12T16:17:21.539 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/4066330994", 2024-09-12T16:17:21.539 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1814 2024-09-12T16:17:21.539 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.540 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:21.540 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.540 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:21.540 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:17:21.540 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.540 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.540 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.540 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:21.540 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:17:21.540 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.540 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.540 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.540 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:21.540 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237252+0000", 2024-09-12T16:17:21.540 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.344e-06 2024-09-12T16:17:21.540 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.541 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.541 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:21.541 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237258+0000", 2024-09-12T16:17:21.541 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1070000000000001e-06 2024-09-12T16:17:21.541 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.541 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.541 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:21.541 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237270+0000", 2024-09-12T16:17:21.541 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1758e-05 2024-09-12T16:17:21.541 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.541 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.541 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:21.541 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237278+0000", 2024-09-12T16:17:21.541 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3219999999999993e-06 2024-09-12T16:17:21.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.542 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.542 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:21.542 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237334+0000", 2024-09-12T16:17:21.542 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6356e-05 2024-09-12T16:17:21.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.542 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.542 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:17:21.542 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237345+0000", 2024-09-12T16:17:21.542 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0433e-05 2024-09-12T16:17:21.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.542 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.542 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:21.542 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243426+0000", 2024-09-12T16:17:21.542 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.00608133 2024-09-12T16:17:21.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.543 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.543 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:21.543 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243534+0000", 2024-09-12T16:17:21.543 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010784 2024-09-12T16:17:21.543 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.543 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.543 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:21.543 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243629+0000", 2024-09-12T16:17:21.543 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4735999999999996e-05 2024-09-12T16:17:21.543 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.543 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:21.543 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.543 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.543 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.544 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5328.0:2542 3.16 3:6928f3a1:::rbd_object_map.11551722dd77:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:21.544 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:17:21.544 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 9.3972359109999992, 2024-09-12T16:17:21.544 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.054219934999999997, 2024-09-12T16:17:21.544 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:21.544 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:21.544 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:21.544 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:21.544 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5328", 2024-09-12T16:17:21.544 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:21.544 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2542 2024-09-12T16:17:21.544 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.544 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:21.544 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.544 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:21.545 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:17:21.545 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.545 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.545 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:21.545 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:17:21.545 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.545 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.545 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:21.545 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055597+0000", 2024-09-12T16:17:21.545 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4300000000000001e-07 2024-09-12T16:17:21.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.545 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.546 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:21.546 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055602+0000", 2024-09-12T16:17:21.546 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4269999999999999e-06 2024-09-12T16:17:21.546 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.546 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.546 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:21.546 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055613+0000", 2024-09-12T16:17:21.546 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0815000000000001e-05 2024-09-12T16:17:21.546 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.546 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.546 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:21.546 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055621+0000", 2024-09-12T16:17:21.546 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4189999999999996e-06 2024-09-12T16:17:21.547 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.547 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.547 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:21.547 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102196+0000", 2024-09-12T16:17:21.547 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.046575616 2024-09-12T16:17:21.547 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.547 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.547 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:21.547 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102258+0000", 2024-09-12T16:17:21.547 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1872000000000007e-05 2024-09-12T16:17:21.547 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.547 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.547 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T16:17:21.547 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102601+0000", 2024-09-12T16:17:21.548 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034285700000000001 2024-09-12T16:17:21.548 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.548 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.548 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:21.548 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.104431+0000", 2024-09-12T16:17:21.548 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001830524 2024-09-12T16:17:21.548 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.548 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.548 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:17:21.548 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109733+0000", 2024-09-12T16:17:21.548 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0053020089999999999 2024-09-12T16:17:21.548 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.548 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.548 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:21.548 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109777+0000", 2024-09-12T16:17:21.548 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3754000000000002e-05 2024-09-12T16:17:21.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.549 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.549 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:21.549 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109816+0000", 2024-09-12T16:17:21.549 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8699000000000003e-05 2024-09-12T16:17:21.549 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.549 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:21.549 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.549 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.549 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5328.0:2543 3.16 3:6928f3a1:::rbd_object_map.11551722dd77:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:21.549 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:17:21.549 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 9.3966419319999996, 2024-09-12T16:17:21.549 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053695720000000002, 2024-09-12T16:17:21.549 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:21.550 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:21.550 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:21.550 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:21.550 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5328", 2024-09-12T16:17:21.550 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:21.550 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2543 2024-09-12T16:17:21.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.550 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:21.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.550 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:21.550 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:17:21.550 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.550 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:21.551 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:17:21.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.551 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:21.551 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056191+0000", 2024-09-12T16:17:21.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.54e-07 2024-09-12T16:17:21.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.551 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:21.551 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056195+0000", 2024-09-12T16:17:21.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5460000000000002e-06 2024-09-12T16:17:21.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.552 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:21.552 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056205+0000", 2024-09-12T16:17:21.552 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7350000000000008e-06 2024-09-12T16:17:21.552 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.552 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.552 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:21.552 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056214+0000", 2024-09-12T16:17:21.552 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8089999999999999e-06 2024-09-12T16:17:21.552 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.552 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.552 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:21.552 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103317+0000", 2024-09-12T16:17:21.552 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.047102889000000002 2024-09-12T16:17:21.552 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.552 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.553 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:21.553 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103410+0000", 2024-09-12T16:17:21.553 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3689000000000004e-05 2024-09-12T16:17:21.553 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.553 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T16:17:21.553 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103754+0000", 2024-09-12T16:17:21.553 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034344699999999998 2024-09-12T16:17:21.553 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.553 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:21.553 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.106487+0000", 2024-09-12T16:17:21.553 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0027330100000000001 2024-09-12T16:17:21.553 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.554 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:17:21.554 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109827+0000", 2024-09-12T16:17:21.554 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033406640000000001 2024-09-12T16:17:21.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.554 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.554 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:21.554 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109854+0000", 2024-09-12T16:17:21.554 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6866999999999999e-05 2024-09-12T16:17:21.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.554 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.554 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:21.554 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109886+0000", 2024-09-12T16:17:21.554 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1309999999999997e-05 2024-09-12T16:17:21.554 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.554 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:21.554 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.555 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.555 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:21.555 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:21.556 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:17:21.557 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:21.555+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:21.657 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:21.656+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:21.664 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:21.664 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:21.664 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:17:21.664 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:21.672 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:17:21.758 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:21.757+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:21.818 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:21.819 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:21.819 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:17:21.819 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:17:21.819 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:21.827 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:17:21.867 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T16:17:21.868 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:21.867+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:21.960 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:21.959+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:21.975 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:21.976 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:17:21.976 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:17:21.976 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:17:21.976 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.976 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5599 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4788224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:21.976 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:17:21.976 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 41.677975752000002, 2024-09-12T16:17:21.976 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061192059, 2024-09-12T16:17:21.976 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:21.976 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:21.976 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:21.976 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:21.976 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:21.977 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:21.977 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5599 2024-09-12T16:17:21.977 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.977 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:21.977 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.977 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:21.977 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:17:21.977 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.977 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.977 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.977 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:21.977 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:17:21.977 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.978 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.978 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.978 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:21.978 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296333+0000", 2024-09-12T16:17:21.978 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6599999999999996e-07 2024-09-12T16:17:21.978 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.978 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.978 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:21.978 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296335+0000", 2024-09-12T16:17:21.978 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5900000000000002e-06 2024-09-12T16:17:21.978 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.978 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.978 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:21.979 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296344+0000", 2024-09-12T16:17:21.979 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9539999999999993e-06 2024-09-12T16:17:21.979 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.979 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.979 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:21.979 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296350+0000", 2024-09-12T16:17:21.979 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5589999999999996e-06 2024-09-12T16:17:21.979 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.979 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.979 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:21.979 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357307+0000", 2024-09-12T16:17:21.979 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.060957573000000001 2024-09-12T16:17:21.979 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.980 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.980 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:21.980 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357401+0000", 2024-09-12T16:17:21.980 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3512999999999997e-05 2024-09-12T16:17:21.980 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.980 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.980 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:21.980 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357524+0000", 2024-09-12T16:17:21.980 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000123304 2024-09-12T16:17:21.980 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.980 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:21.980 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.980 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.980 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.981 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5611 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4730880~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:21.981 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:17:21.981 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 41.677913308000001, 2024-09-12T16:17:21.981 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061359348000000001, 2024-09-12T16:17:21.981 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:21.982 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:21.982 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:21.982 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:21.982 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:21.982 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:21.982 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5611 2024-09-12T16:17:21.982 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.982 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:21.982 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.982 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:21.982 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:17:21.982 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.982 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.982 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.982 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:21.983 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:17:21.983 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.983 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.983 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:21.983 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296395+0000", 2024-09-12T16:17:21.983 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4600000000000003e-07 2024-09-12T16:17:21.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.983 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.983 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:21.983 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296399+0000", 2024-09-12T16:17:21.983 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9430000000000002e-06 2024-09-12T16:17:21.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.984 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.984 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:21.984 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296411+0000", 2024-09-12T16:17:21.984 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1755e-05 2024-09-12T16:17:21.984 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.984 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.984 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:21.984 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296417+0000", 2024-09-12T16:17:21.984 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3790000000000003e-06 2024-09-12T16:17:21.984 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.984 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.984 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:21.985 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357572+0000", 2024-09-12T16:17:21.985 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061154871 2024-09-12T16:17:21.985 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.985 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.985 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:21.985 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357663+0000", 2024-09-12T16:17:21.985 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0389999999999993e-05 2024-09-12T16:17:21.985 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.985 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.985 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:21.985 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357754+0000", 2024-09-12T16:17:21.985 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1063999999999994e-05 2024-09-12T16:17:21.985 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.986 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:21.986 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.986 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.986 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.986 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5613 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4775936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:21.986 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:21.986 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 41.677872127999997, 2024-09-12T16:17:21.986 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061491777999999997, 2024-09-12T16:17:21.986 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:21.986 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:21.986 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:21.986 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:21.986 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:21.986 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:21.987 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5613 2024-09-12T16:17:21.987 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.987 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:21.987 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.987 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:21.987 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:21.987 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.987 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.987 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.987 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:21.987 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:21.987 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.987 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.987 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.987 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:21.988 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:21.988 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8899999999999999e-07 2024-09-12T16:17:21.988 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.988 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.988 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:21.988 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296439+0000", 2024-09-12T16:17:21.988 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8439999999999998e-06 2024-09-12T16:17:21.988 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.988 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.988 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:21.988 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296452+0000", 2024-09-12T16:17:21.988 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2639e-05 2024-09-12T16:17:21.988 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.989 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.989 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:21.989 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296457+0000", 2024-09-12T16:17:21.989 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5720000000000002e-06 2024-09-12T16:17:21.989 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.989 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.989 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:21.989 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357773+0000", 2024-09-12T16:17:21.989 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061315500000000002 2024-09-12T16:17:21.989 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.989 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.989 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:21.989 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357814+0000", 2024-09-12T16:17:21.990 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1448e-05 2024-09-12T16:17:21.990 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.990 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.990 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:21.990 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357927+0000", 2024-09-12T16:17:21.990 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000113186 2024-09-12T16:17:21.990 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.990 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:21.990 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.990 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.990 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.990 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5616 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4784128~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:21.990 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:21.990 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 41.677837066000002, 2024-09-12T16:17:21.991 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061725002000000001, 2024-09-12T16:17:21.991 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:21.991 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:21.991 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:21.991 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:21.991 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:21.991 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:21.991 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5616 2024-09-12T16:17:21.991 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.991 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:21.991 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.991 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:21.991 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:21.991 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.992 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.992 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.992 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:21.992 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:21.992 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.992 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.992 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.992 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:21.992 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:21.992 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5900000000000002e-07 2024-09-12T16:17:21.992 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.992 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.993 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:21.993 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296473+0000", 2024-09-12T16:17:21.993 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3130000000000001e-06 2024-09-12T16:17:21.993 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.993 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.993 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:21.993 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296481+0000", 2024-09-12T16:17:21.993 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1389999999999998e-06 2024-09-12T16:17:21.993 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.993 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.993 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:21.993 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296486+0000", 2024-09-12T16:17:21.994 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3310000000000003e-06 2024-09-12T16:17:21.994 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.994 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.994 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:21.994 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357981+0000", 2024-09-12T16:17:21.994 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061494866000000002 2024-09-12T16:17:21.994 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.994 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.994 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:21.994 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358082+0000", 2024-09-12T16:17:21.994 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101424 2024-09-12T16:17:21.994 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.994 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.995 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:21.995 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358196+0000", 2024-09-12T16:17:21.995 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011347 2024-09-12T16:17:21.995 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.995 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:21.995 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:21.995 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.995 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.995 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5626 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4739072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:21.995 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:17:21.995 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 41.677759109999997, 2024-09-12T16:17:21.995 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061802430999999998, 2024-09-12T16:17:21.995 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:21.996 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:21.996 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:21.996 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:21.996 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:21.996 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:21.996 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5626 2024-09-12T16:17:21.996 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.996 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:21.996 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.996 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:21.996 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:17:21.996 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.997 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.997 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.997 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:21.997 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:17:21.997 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:21.997 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.997 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.997 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:21.997 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296550+0000", 2024-09-12T16:17:21.997 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.215e-06 2024-09-12T16:17:21.997 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.997 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.997 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:21.998 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296555+0000", 2024-09-12T16:17:21.998 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9590000000000003e-06 2024-09-12T16:17:21.998 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.998 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.998 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:21.998 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296568+0000", 2024-09-12T16:17:21.998 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3338e-05 2024-09-12T16:17:21.998 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.998 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.999 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:21.999 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296576+0000", 2024-09-12T16:17:21.999 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5510000000000002e-06 2024-09-12T16:17:21.999 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.999 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.999 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:21.999 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358241+0000", 2024-09-12T16:17:21.999 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.06166576 2024-09-12T16:17:21.999 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:21.999 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:21.999 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:21.999 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358288+0000", 2024-09-12T16:17:21.999 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6097000000000003e-05 2024-09-12T16:17:22.000 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.000 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.000 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:22.000 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358351+0000", 2024-09-12T16:17:22.000 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3510999999999996e-05 2024-09-12T16:17:22.000 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:22.000 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:22.000 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:22.000 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.000 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.000 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5628 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4792320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:22.000 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:17:22.000 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 41.677716609999997, 2024-09-12T16:17:22.001 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061961161000000001, 2024-09-12T16:17:22.001 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:22.001 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:22.001 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:22.001 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:22.001 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:22.001 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:22.001 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5628 2024-09-12T16:17:22.001 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.001 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:22.001 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.001 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:22.001 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:17:22.002 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:22.002 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.002 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.002 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:22.002 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:17:22.002 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:22.002 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.002 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.002 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:22.002 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296592+0000", 2024-09-12T16:17:22.002 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2099999999999996e-07 2024-09-12T16:17:22.002 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.002 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.002 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:22.002 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296595+0000", 2024-09-12T16:17:22.003 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0429999999999999e-06 2024-09-12T16:17:22.003 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.003 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.003 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:22.003 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296603+0000", 2024-09-12T16:17:22.003 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9899999999999997e-06 2024-09-12T16:17:22.003 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.003 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.003 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:22.003 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296609+0000", 2024-09-12T16:17:22.003 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7259999999999999e-06 2024-09-12T16:17:22.003 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.003 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.003 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:22.003 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358393+0000", 2024-09-12T16:17:22.003 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061784617 2024-09-12T16:17:22.004 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.004 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.004 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:22.004 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358460+0000", 2024-09-12T16:17:22.004 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7253000000000001e-05 2024-09-12T16:17:22.004 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.004 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.004 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:22.004 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358552+0000", 2024-09-12T16:17:22.004 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1811000000000006e-05 2024-09-12T16:17:22.004 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:22.004 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:22.004 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:22.004 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.005 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.005 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5638 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4734976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:22.005 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:22.005 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 41.677244059000003, 2024-09-12T16:17:22.005 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061654460000000001, 2024-09-12T16:17:22.005 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:22.005 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:22.005 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:22.005 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:22.005 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:22.005 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:22.005 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5638 2024-09-12T16:17:22.005 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.005 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:22.005 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.006 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:22.006 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:22.006 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:22.006 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.006 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.006 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:22.006 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:22.006 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:22.006 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.006 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.006 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:22.006 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:22.006 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.23e-07 2024-09-12T16:17:22.007 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.007 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.007 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:22.007 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297068+0000", 2024-09-12T16:17:22.007 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0060000000000003e-06 2024-09-12T16:17:22.007 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.007 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.007 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:22.007 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297080+0000", 2024-09-12T16:17:22.007 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1234e-05 2024-09-12T16:17:22.007 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.007 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.007 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:22.008 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297095+0000", 2024-09-12T16:17:22.008 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5698000000000001e-05 2024-09-12T16:17:22.008 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.008 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.008 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:22.008 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358582+0000", 2024-09-12T16:17:22.008 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061486274 2024-09-12T16:17:22.008 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.008 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.008 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:22.008 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358637+0000", 2024-09-12T16:17:22.008 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5439999999999998e-05 2024-09-12T16:17:22.008 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.009 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.009 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:22.009 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358718+0000", 2024-09-12T16:17:22.009 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0984999999999998e-05 2024-09-12T16:17:22.009 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:22.009 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:22.009 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:22.009 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.009 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.009 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5640 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4780032~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:22.009 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:17:22.009 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 41.677162338999999, 2024-09-12T16:17:22.010 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061746620000000002, 2024-09-12T16:17:22.010 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:22.010 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:22.010 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:22.010 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:22.010 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:22.010 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:22.010 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5640 2024-09-12T16:17:22.010 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.010 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:22.010 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.010 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:22.010 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:17:22.010 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:22.011 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.011 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.011 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:22.011 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:17:22.011 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:22.011 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.011 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.011 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:22.011 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297146+0000", 2024-09-12T16:17:22.011 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3600000000000003e-07 2024-09-12T16:17:22.011 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.011 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.011 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:22.011 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297150+0000", 2024-09-12T16:17:22.012 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8430000000000003e-06 2024-09-12T16:17:22.012 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.012 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.012 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:22.012 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297160+0000", 2024-09-12T16:17:22.012 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7229999999999999e-06 2024-09-12T16:17:22.012 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.012 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.012 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:22.012 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297167+0000", 2024-09-12T16:17:22.012 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0180000000000004e-06 2024-09-12T16:17:22.012 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.012 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.012 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:22.013 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358750+0000", 2024-09-12T16:17:22.013 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061583104 2024-09-12T16:17:22.013 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.013 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.013 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:22.013 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358804+0000", 2024-09-12T16:17:22.013 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4277000000000002e-05 2024-09-12T16:17:22.013 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.013 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.013 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:22.013 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358892+0000", 2024-09-12T16:17:22.013 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7918999999999996e-05 2024-09-12T16:17:22.013 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:22.013 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:22.014 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:22.014 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.014 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.014 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5642 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4788224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:22.014 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:22.014 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 41.677117995000003, 2024-09-12T16:17:22.014 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061860409999999998, 2024-09-12T16:17:22.014 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:22.014 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:22.014 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:22.014 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:22.014 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:22.014 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:22.015 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5642 2024-09-12T16:17:22.015 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.015 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:22.015 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.015 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:22.015 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:22.015 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:22.015 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.015 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.015 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:22.015 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:22.015 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:22.015 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.016 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.016 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:22.016 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:22.016 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7999999999999995e-07 2024-09-12T16:17:22.016 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.016 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.016 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:22.016 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297193+0000", 2024-09-12T16:17:22.016 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8310000000000001e-06 2024-09-12T16:17:22.016 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.016 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.016 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:22.016 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297204+0000", 2024-09-12T16:17:22.017 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0832999999999999e-05 2024-09-12T16:17:22.017 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.017 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.017 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:22.017 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297210+0000", 2024-09-12T16:17:22.017 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1770000000000003e-06 2024-09-12T16:17:22.017 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.017 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.017 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:22.017 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358928+0000", 2024-09-12T16:17:22.017 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061717826000000003 2024-09-12T16:17:22.017 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.017 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.017 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:22.018 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358977+0000", 2024-09-12T16:17:22.018 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9514000000000001e-05 2024-09-12T16:17:22.018 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.018 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.018 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:22.018 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359050+0000", 2024-09-12T16:17:22.018 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2649000000000002e-05 2024-09-12T16:17:22.018 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:22.018 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:22.018 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:22.018 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.018 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.018 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5646 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4743168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:22.018 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:22.018 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 41.676938053999997, 2024-09-12T16:17:22.019 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061822122, 2024-09-12T16:17:22.019 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:22.019 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:22.019 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:22.019 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:22.019 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:22.019 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:22.019 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5646 2024-09-12T16:17:22.019 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.019 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:22.019 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.019 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:22.019 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:22.019 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:22.020 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.020 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.020 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:22.020 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:22.020 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:22.020 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.020 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.020 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:22.020 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:22.020 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3200000000000004e-07 2024-09-12T16:17:22.020 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.020 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.020 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:22.021 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297374+0000", 2024-09-12T16:17:22.021 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8240000000000001e-06 2024-09-12T16:17:22.021 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.021 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.021 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:22.021 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297384+0000", 2024-09-12T16:17:22.021 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5710000000000004e-06 2024-09-12T16:17:22.021 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.021 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.021 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:22.021 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297390+0000", 2024-09-12T16:17:22.021 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5130000000000002e-06 2024-09-12T16:17:22.021 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.021 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.022 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:22.022 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359080+0000", 2024-09-12T16:17:22.022 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061689569999999999 2024-09-12T16:17:22.022 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.022 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.022 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:22.022 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359134+0000", 2024-09-12T16:17:22.022 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3838999999999997e-05 2024-09-12T16:17:22.022 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.022 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.022 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:22.022 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359192+0000", 2024-09-12T16:17:22.022 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8072999999999998e-05 2024-09-12T16:17:22.022 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:22.022 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:22.023 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:22.023 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.023 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.023 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5647 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4751360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:22.023 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:17:22.023 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 41.676901368999999, 2024-09-12T16:17:22.023 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061927569000000002, 2024-09-12T16:17:22.023 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:22.023 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:22.023 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:22.023 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:22.023 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:22.023 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:22.023 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5647 2024-09-12T16:17:22.023 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.024 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:22.024 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.024 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:22.024 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:17:22.024 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:22.024 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.024 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.024 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:22.024 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:17:22.024 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:22.024 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.024 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.024 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:22.025 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297407+0000", 2024-09-12T16:17:22.025 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.46e-07 2024-09-12T16:17:22.025 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.025 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.025 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:22.025 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297409+0000", 2024-09-12T16:17:22.025 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.469e-06 2024-09-12T16:17:22.025 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.025 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.025 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:22.025 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297415+0000", 2024-09-12T16:17:22.025 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9259999999999997e-06 2024-09-12T16:17:22.025 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.025 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.026 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:22.026 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297419+0000", 2024-09-12T16:17:22.026 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3840000000000001e-06 2024-09-12T16:17:22.026 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.026 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.026 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:22.026 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359224+0000", 2024-09-12T16:17:22.026 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061805367999999999 2024-09-12T16:17:22.026 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.026 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.026 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:22.026 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359275+0000", 2024-09-12T16:17:22.026 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1338000000000002e-05 2024-09-12T16:17:22.026 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.026 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.027 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:22.027 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359334+0000", 2024-09-12T16:17:22.027 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8638000000000003e-05 2024-09-12T16:17:22.027 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:22.027 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:22.027 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:22.027 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.027 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.027 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5649 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4796416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:22.027 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:17:22.027 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 41.676846509999997, 2024-09-12T16:17:22.027 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.062018578999999997, 2024-09-12T16:17:22.027 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:22.028 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:22.028 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:22.028 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:22.028 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:22.028 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:22.028 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5649 2024-09-12T16:17:22.028 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.028 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:22.028 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.028 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:22.028 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:17:22.029 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:22.029 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.029 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.029 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:22.029 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:17:22.029 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:22.029 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.029 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.029 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:22.029 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297462+0000", 2024-09-12T16:17:22.029 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2399999999999998e-07 2024-09-12T16:17:22.029 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.029 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.030 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:22.030 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297465+0000", 2024-09-12T16:17:22.030 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.371e-06 2024-09-12T16:17:22.030 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.030 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.030 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:22.030 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297473+0000", 2024-09-12T16:17:22.030 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4699999999999996e-06 2024-09-12T16:17:22.030 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.030 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.030 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:22.030 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297478+0000", 2024-09-12T16:17:22.030 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2780000000000001e-06 2024-09-12T16:17:22.030 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.030 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.031 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:22.031 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359368+0000", 2024-09-12T16:17:22.031 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061889758000000003 2024-09-12T16:17:22.031 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.031 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.031 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:22.031 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359420+0000", 2024-09-12T16:17:22.031 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2574999999999997e-05 2024-09-12T16:17:22.031 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.031 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.031 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:22.031 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359480+0000", 2024-09-12T16:17:22.031 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9503000000000003e-05 2024-09-12T16:17:22.032 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:22.032 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:22.032 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:22.032 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.032 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.032 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5674 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4739072~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:22.032 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:17:22.032 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 41.676442741999999, 2024-09-12T16:17:22.032 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061762989999999997, 2024-09-12T16:17:22.032 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:22.032 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:22.032 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:22.032 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:22.032 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:22.032 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:22.032 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5674 2024-09-12T16:17:22.033 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.033 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:22.033 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.033 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:22.033 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:17:22.033 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:22.033 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.033 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.033 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:22.033 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:17:22.033 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:22.034 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.034 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.034 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:22.034 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297866+0000", 2024-09-12T16:17:22.034 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1900000000000001e-07 2024-09-12T16:17:22.034 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.034 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.034 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:22.034 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297870+0000", 2024-09-12T16:17:22.034 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3560000000000003e-06 2024-09-12T16:17:22.034 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.034 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.034 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:22.034 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297888+0000", 2024-09-12T16:17:22.034 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8088999999999999e-05 2024-09-12T16:17:22.035 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.035 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.035 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:22.035 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297904+0000", 2024-09-12T16:17:22.035 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5971e-05 2024-09-12T16:17:22.035 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.035 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.035 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:22.035 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359510+0000", 2024-09-12T16:17:22.035 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061605634999999999 2024-09-12T16:17:22.035 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.035 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.036 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:22.036 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359554+0000", 2024-09-12T16:17:22.036 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4024999999999999e-05 2024-09-12T16:17:22.036 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.036 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.036 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:22.036 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359628+0000", 2024-09-12T16:17:22.036 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4095000000000001e-05 2024-09-12T16:17:22.036 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:22.036 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:22.036 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:22.036 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.036 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.036 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5676 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4792320~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:22.037 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:17:22.037 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 41.676241662000002, 2024-09-12T16:17:22.037 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061720143999999998, 2024-09-12T16:17:22.037 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:22.037 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:22.037 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:22.037 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:22.037 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:22.037 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:22.037 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5676 2024-09-12T16:17:22.037 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.037 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:22.037 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.037 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:22.038 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:17:22.038 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:22.038 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.038 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.038 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:22.038 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:17:22.038 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:22.038 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.038 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.038 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:22.038 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298067+0000", 2024-09-12T16:17:22.038 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8199999999999999e-07 2024-09-12T16:17:22.038 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.039 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.039 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:22.039 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298070+0000", 2024-09-12T16:17:22.039 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.743e-06 2024-09-12T16:17:22.039 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.039 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.039 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:22.039 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298080+0000", 2024-09-12T16:17:22.039 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4059999999999994e-06 2024-09-12T16:17:22.039 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.039 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.039 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:22.039 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298088+0000", 2024-09-12T16:17:22.040 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0779999999999996e-06 2024-09-12T16:17:22.040 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.040 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.040 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:22.040 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359659+0000", 2024-09-12T16:17:22.040 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061570688999999998 2024-09-12T16:17:22.040 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.040 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.040 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:22.040 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359713+0000", 2024-09-12T16:17:22.040 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3939e-05 2024-09-12T16:17:22.040 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.041 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.041 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:22.041 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359786+0000", 2024-09-12T16:17:22.041 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3607000000000002e-05 2024-09-12T16:17:22.041 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:22.041 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:22.041 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:22.041 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.041 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.041 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5684 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4747264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:22.041 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:17:22.041 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 41.675774369999999, 2024-09-12T16:17:22.041 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061394799, 2024-09-12T16:17:22.041 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:22.041 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:22.042 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:22.042 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:22.042 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:22.042 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:22.042 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5684 2024-09-12T16:17:22.042 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.042 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:22.042 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.042 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:22.042 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:17:22.042 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:22.042 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.042 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.042 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:22.043 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:17:22.043 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:22.043 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.043 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.043 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:22.043 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298534+0000", 2024-09-12T16:17:22.043 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4399999999999999e-07 2024-09-12T16:17:22.043 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.043 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.043 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:22.043 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298539+0000", 2024-09-12T16:17:22.043 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5360000000000003e-06 2024-09-12T16:17:22.043 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.043 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.043 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:22.044 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298550+0000", 2024-09-12T16:17:22.044 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1499e-05 2024-09-12T16:17:22.044 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.044 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.044 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:22.044 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298558+0000", 2024-09-12T16:17:22.044 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3000000000000004e-06 2024-09-12T16:17:22.044 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.044 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.044 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:22.044 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359815+0000", 2024-09-12T16:17:22.044 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061257952999999997 2024-09-12T16:17:22.044 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.044 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.045 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:22.045 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359868+0000", 2024-09-12T16:17:22.045 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2317000000000001e-05 2024-09-12T16:17:22.045 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.045 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.045 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:22.045 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359928+0000", 2024-09-12T16:17:22.045 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0350000000000003e-05 2024-09-12T16:17:22.045 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:22.045 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:22.045 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:22.045 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.045 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.046 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5686 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4755456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:22.046 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:17:22.046 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 41.675606946000002, 2024-09-12T16:17:22.046 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061355082999999998, 2024-09-12T16:17:22.046 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:22.046 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:22.046 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:22.046 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:22.046 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:22.046 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:22.046 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5686 2024-09-12T16:17:22.046 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.046 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:22.047 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.047 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:22.047 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:17:22.047 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:22.047 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.047 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.047 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:22.047 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:17:22.047 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:22.047 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.047 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.047 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:22.048 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298702+0000", 2024-09-12T16:17:22.048 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2399999999999997e-07 2024-09-12T16:17:22.048 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.048 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.048 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:22.048 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298706+0000", 2024-09-12T16:17:22.048 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5700000000000003e-06 2024-09-12T16:17:22.048 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.048 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.048 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:22.048 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298718+0000", 2024-09-12T16:17:22.048 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1457999999999999e-05 2024-09-12T16:17:22.048 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.049 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.049 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:22.049 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298732+0000", 2024-09-12T16:17:22.049 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.452e-05 2024-09-12T16:17:22.049 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.049 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.049 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:22.049 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359956+0000", 2024-09-12T16:17:22.049 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061223626000000003 2024-09-12T16:17:22.049 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.049 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.049 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:22.049 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360000+0000", 2024-09-12T16:17:22.050 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3922999999999999e-05 2024-09-12T16:17:22.050 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.050 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.050 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:22.050 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360056+0000", 2024-09-12T16:17:22.050 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6162000000000002e-05 2024-09-12T16:17:22.050 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:22.050 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:22.050 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:22.050 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.050 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.050 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5688 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4800512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:22.050 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:17:22.050 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 41.675383893000003, 2024-09-12T16:17:22.051 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061270514999999998, 2024-09-12T16:17:22.051 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:22.051 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:22.051 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:22.051 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:22.051 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:22.051 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:22.051 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5688 2024-09-12T16:17:22.051 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.051 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:22.051 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.051 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:22.052 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:17:22.052 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:22.052 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.052 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.052 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:22.052 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:17:22.052 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:22.052 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.052 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.052 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:22.052 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298925+0000", 2024-09-12T16:17:22.052 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4e-07 2024-09-12T16:17:22.053 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.053 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.053 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:22.053 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298929+0000", 2024-09-12T16:17:22.053 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9890000000000003e-06 2024-09-12T16:17:22.053 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.053 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.053 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:22.053 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298936+0000", 2024-09-12T16:17:22.053 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.52e-06 2024-09-12T16:17:22.053 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.054 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.054 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:22.054 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298941+0000", 2024-09-12T16:17:22.054 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4800000000000003e-06 2024-09-12T16:17:22.054 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.054 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.054 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:22.054 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360087+0000", 2024-09-12T16:17:22.054 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061146143 2024-09-12T16:17:22.054 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.054 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.054 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:22.054 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360137+0000", 2024-09-12T16:17:22.055 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0584000000000002e-05 2024-09-12T16:17:22.055 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.055 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.055 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:22.055 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360194+0000", 2024-09-12T16:17:22.055 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6858999999999999e-05 2024-09-12T16:17:22.055 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:22.055 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:22.055 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:22.055 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.055 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.055 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5693 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4751360~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:22.055 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:17:22.056 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 41.674962256000001, 2024-09-12T16:17:22.056 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061139444000000001, 2024-09-12T16:17:22.056 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:22.056 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:22.056 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:22.056 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:22.056 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:22.056 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:22.056 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5693 2024-09-12T16:17:22.056 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.056 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:22.056 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.056 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:22.056 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:17:22.057 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:22.057 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.057 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.057 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:22.057 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:17:22.057 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:22.057 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.057 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.057 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:22.057 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299346+0000", 2024-09-12T16:17:22.057 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2300000000000001e-07 2024-09-12T16:17:22.057 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.058 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.058 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:22.058 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299349+0000", 2024-09-12T16:17:22.058 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5270000000000001e-06 2024-09-12T16:17:22.058 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.058 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.058 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:22.058 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299358+0000", 2024-09-12T16:17:22.058 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7030000000000001e-06 2024-09-12T16:17:22.058 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.058 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.058 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:22.058 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299364+0000", 2024-09-12T16:17:22.058 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7239999999999997e-06 2024-09-12T16:17:22.059 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.059 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.059 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:22.059 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360369+0000", 2024-09-12T16:17:22.059 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061004713000000002 2024-09-12T16:17:22.059 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.059 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.059 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:22.059 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360415+0000", 2024-09-12T16:17:22.059 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5926e-05 2024-09-12T16:17:22.059 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.059 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.059 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:22.060 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360485+0000", 2024-09-12T16:17:22.060 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0327999999999995e-05 2024-09-12T16:17:22.060 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:22.060 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:22.060 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:22.060 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.060 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.060 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5694 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4796416~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:22.060 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:17:22.060 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 41.674933226999997, 2024-09-12T16:17:22.060 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061258034000000003, 2024-09-12T16:17:22.060 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:22.060 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:22.060 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:22.061 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:22.061 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:22.061 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:22.061 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5694 2024-09-12T16:17:22.061 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.061 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:22.061 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.061 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:22.061 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:17:22.061 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:22.061 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.061 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.061 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:22.062 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:17:22.062 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:22.062 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.062 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.062 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:22.062 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301884+0000", 2024-09-12T16:17:22.062 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025090379999999999 2024-09-12T16:17:22.062 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.062 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.062 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:22.062 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301889+0000", 2024-09-12T16:17:22.062 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5879999999999997e-06 2024-09-12T16:17:22.062 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.062 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.063 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:22.063 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301901+0000", 2024-09-12T16:17:22.063 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1466e-05 2024-09-12T16:17:22.063 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.063 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.063 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:22.063 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301908+0000", 2024-09-12T16:17:22.063 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1999999999999997e-06 2024-09-12T16:17:22.063 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.063 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.063 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:22.063 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360513+0000", 2024-09-12T16:17:22.063 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.058605023999999999 2024-09-12T16:17:22.064 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.064 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.064 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:22.064 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360562+0000", 2024-09-12T16:17:22.064 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9546000000000003e-05 2024-09-12T16:17:22.064 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.064 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.064 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:22.064 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360633+0000", 2024-09-12T16:17:22.064 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0172000000000005e-05 2024-09-12T16:17:22.064 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:22.064 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:22.064 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:22.064 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.065 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.065 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5759 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4767744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:22.065 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:17:22.065 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 41.672139692999998, 2024-09-12T16:17:22.065 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061058604000000002, 2024-09-12T16:17:22.065 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:22.065 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:22.065 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:22.065 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:22.065 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:22.065 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:22.065 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5759 2024-09-12T16:17:22.065 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.065 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:22.066 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.066 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:22.066 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:17:22.066 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:22.066 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.066 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.066 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:22.066 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:17:22.066 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:22.066 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.066 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.066 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:22.066 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302548+0000", 2024-09-12T16:17:22.066 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00038011000000000002 2024-09-12T16:17:22.066 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.066 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.067 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:22.067 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302553+0000", 2024-09-12T16:17:22.067 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1830000000000002e-06 2024-09-12T16:17:22.067 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.067 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.067 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:22.067 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302564+0000", 2024-09-12T16:17:22.067 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1011e-05 2024-09-12T16:17:22.067 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.067 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.067 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:22.067 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302572+0000", 2024-09-12T16:17:22.067 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9009999999999994e-06 2024-09-12T16:17:22.067 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.067 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.068 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:22.068 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363102+0000", 2024-09-12T16:17:22.068 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.060529782999999997 2024-09-12T16:17:22.068 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.068 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.068 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:22.068 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363149+0000", 2024-09-12T16:17:22.068 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7321000000000003e-05 2024-09-12T16:17:22.068 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:22.068 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:22.068 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:22.068 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363227+0000", 2024-09-12T16:17:22.068 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7294999999999998e-05 2024-09-12T16:17:22.069 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:22.069 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:22.069 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:22.069 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:22.069 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:22.069 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:22.069 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T16:17:22.070 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:17:22.071 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:17:22.071 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.3 to 1 (10000) 2024-09-12T16:17:22.072 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:17:22.072 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:17:22.073 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:17:22.073 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:22.069+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:22.074 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-12T16:17:22.074 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T16:17:22.074 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:17:22.075 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:17:22.075 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:17:22.075 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:17:22.075 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:17:22.076 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:17:22.086 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:17:22.086 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:17:22.171 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:22.170+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:22.220 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:22.220 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:22.229 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:17:22.272 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:22.271+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:22.373 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:22.371+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:22.380 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:22.380 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:22.389 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:17:22.397 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:17:22.398 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-12T16:17:22.410 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":132,"stamp":"2024-09-12T16:17:22.006851+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1036738781,"num_objects":1321,"num_object_clones":319,"num_object_copies":2642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1321,"num_whiteouts":481,"num_read":270325,"num_read_kb":929718,"num_write":15604,"num_write_kb":319363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1847,"num_bytes_recovered":97392206,"num_keys_recovered":249,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12785,"ondisk_log_size":12785,"up":82,"acting":81,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":544432,"kb_used_data":325236,"kb_used_omap":19,"kb_used_meta":219052,"kb_avail":565686608,"statfs":{"total":579820584960,"available":579263086592,"internally_reserved":0,"allocated":333041664,"data_stored":405164852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19565,"internal_metadata":224310163},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8716856,"num_objects":103,"num_object_clones":26,"num_object_copies":206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":34,"num_read":23339,"num_read_kb":28506,"num_write":615,"num_write_kb":4075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":256,"num_bytes_recovered":27617982,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.005371"},"pg_stats":[{"pgid":"3.1f","version":"83'305","reported_seq":12226,"reported_epoch":83,"state":"active+remapped","last_fresh":"2024-09-12T16:17:19.349769+0000","last_change":"2024-09-12T16:17:19.311030+0000","last_active":"2024-09-12T16:17:19.349769+0000","last_peered":"2024-09-12T16:17:19.349769+0000","last_clean":"2024-09-12T16:17:16.360341+0000","last_became_active":"2024-09-12T16:17:19.015347+0000","last_became_peered":"2024-09-12T16:17:19.015347+0000","last_unstale":"2024-09-12T16:17:19.349769+0000","last_undegraded":"2024-09-12T16:17:19.349769+0000","last_fullsized":"2024-09-12T16:17:19.349769+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001341074,"stat_sum":{"num_bytes":28327003,"num_objects":45,"num_object_clones":11,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":19,"num_read":11914,"num_read_kb":56908,"num_write":319,"num_write_kb":7346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":2818651,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[2,3],"avail_no_missing":["2","0","3"],"object_location_counts":[{"shards":"2,3","objects":45}],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"83'357","reported_seq":9409,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.680936+0000","last_change":"2024-09-12T16:16:55.203459+0000","last_active":"2024-09-12T16:17:19.680936+0000","last_peered":"2024-09-12T16:17:19.680936+0000","last_clean":"2024-09-12T16:17:19.680936+0000","last_became_active":"2024-09-12T16:16:55.202876+0000","last_became_peered":"2024-09-12T16:16:55.202876+0000","last_unstale":"2024-09-12T16:17:19.680936+0000","last_undegraded":"2024-09-12T16:17:19.680936+0000","last_fullsized":"2024-09-12T16:17:19.680936+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:30.057693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076760299999999995,"stat_sum":{"num_bytes":24617151,"num_objects":59,"num_object_clones":14,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":20,"num_read":9434,"num_read_kb":32444,"num_write":358,"num_write_kb":5955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":3145760,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"83'1191","reported_seq":14680,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.667716+0000","last_change":"2024-09-12T16:17:07.244801+0000","last_active":"2024-09-12T16:17:19.667716+0000","last_peered":"2024-09-12T16:17:19.667716+0000","last_clean":"2024-09-12T16:17:19.667716+0000","last_became_active":"2024-09-12T16:17:07.243733+0000","last_became_peered":"2024-09-12T16:17:07.243733+0000","last_unstale":"2024-09-12T16:17:19.667716+0000","last_undegraded":"2024-09-12T16:17:19.667716+0000","last_fullsized":"2024-09-12T16:17:19.667716+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1191,"log_dups_size":0,"ondisk_log_size":1191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:14.577621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010512060000000001,"stat_sum":{"num_bytes":44757219,"num_objects":49,"num_object_clones":12,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":18,"num_read":17707,"num_read_kb":50480,"num_write":1789,"num_write_kb":13478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":60,"num_bytes_recovered":9304291,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"83'193","reported_seq":1665,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.667712+0000","last_change":"2024-09-12T16:17:07.244095+0000","last_active":"2024-09-12T16:17:19.667712+0000","last_peered":"2024-09-12T16:17:19.667712+0000","last_clean":"2024-09-12T16:17:19.667712+0000","last_became_active":"2024-09-12T16:17:07.243433+0000","last_became_peered":"2024-09-12T16:17:07.243433+0000","last_unstale":"2024-09-12T16:17:19.667712+0000","last_undegraded":"2024-09-12T16:17:19.667712+0000","last_fullsized":"2024-09-12T16:17:19.667712+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:52.692072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011661079999999999,"stat_sum":{"num_bytes":14351376,"num_objects":29,"num_object_clones":8,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":14,"num_read":1290,"num_read_kb":4391,"num_write":203,"num_write_kb":1444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":50,"num_bytes_recovered":579600,"num_keys_recovered":44,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"83'289","reported_seq":4417,"reported_epoch":83,"state":"active+remapped","last_fresh":"2024-09-12T16:17:19.436419+0000","last_change":"2024-09-12T16:17:19.174183+0000","last_active":"2024-09-12T16:17:19.436419+0000","last_peered":"2024-09-12T16:17:19.436419+0000","last_clean":"2024-09-12T16:17:16.266255+0000","last_became_active":"2024-09-12T16:17:19.013666+0000","last_became_peered":"2024-09-12T16:17:19.013666+0000","last_unstale":"2024-09-12T16:17:19.436419+0000","last_undegraded":"2024-09-12T16:17:19.436419+0000","last_fullsized":"2024-09-12T16:17:19.436419+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056160499999999996,"stat_sum":{"num_bytes":41181696,"num_objects":39,"num_object_clones":13,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":19,"num_read":4488,"num_read_kb":22405,"num_write":258,"num_write_kb":8778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":14697984,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[3,4],"avail_no_missing":["3","0","4"],"object_location_counts":[{"shards":"3,4","objects":39}],"blocked_by":[],"up_primary":0,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"83'257","reported_seq":5427,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.488711+0000","last_change":"2024-09-12T16:15:59.013909+0000","last_active":"2024-09-12T16:17:19.488711+0000","last_peered":"2024-09-12T16:17:19.488711+0000","last_clean":"2024-09-12T16:17:19.488711+0000","last_became_active":"2024-09-12T16:15:57.014803+0000","last_became_peered":"2024-09-12T16:15:57.014803+0000","last_unstale":"2024-09-12T16:17:19.488711+0000","last_undegraded":"2024-09-12T16:17:19.488711+0000","last_fullsized":"2024-09-12T16:17:19.488711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:35.133020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056998200000000002,"stat_sum":{"num_bytes":25684632,"num_objects":40,"num_object_clones":7,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":18,"num_read":5576,"num_read_kb":20094,"num_write":320,"num_write_kb":16457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"83'261","reported_seq":6777,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.691659+0000","last_change":"2024-09-12T16:15:59.015220+0000","last_active":"2024-09-12T16:17:19.691659+0000","last_peered":"2024-09-12T16:17:19.691659+0000","last_clean":"2024-09-12T16:17:19.691659+0000","last_became_active":"2024-09-12T16:15:57.016110+0000","last_became_peered":"2024-09-12T16:15:57.016110+0000","last_unstale":"2024-09-12T16:17:19.691659+0000","last_undegraded":"2024-09-12T16:17:19.691659+0000","last_fullsized":"2024-09-12T16:17:19.691659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:53.370475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088668999999999998,"stat_sum":{"num_bytes":21534768,"num_objects":66,"num_object_clones":19,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":25,"num_read":6479,"num_read_kb":21903,"num_write":277,"num_write_kb":4212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"83'475","reported_seq":3364,"reported_epoch":83,"state":"active+undersized+remapped","last_fresh":"2024-09-12T16:17:19.672428+0000","last_change":"2024-09-12T16:17:19.517053+0000","last_active":"2024-09-12T16:17:19.672428+0000","last_peered":"2024-09-12T16:17:19.672428+0000","last_clean":"2024-09-12T16:17:17.211836+0000","last_became_active":"2024-09-12T16:17:19.018165+0000","last_became_peered":"2024-09-12T16:17:19.018165+0000","last_unstale":"2024-09-12T16:17:19.672428+0000","last_undegraded":"2024-09-12T16:17:19.672428+0000","last_fullsized":"2024-09-12T16:17:19.005780+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081349199999999997,"stat_sum":{"num_bytes":40848995,"num_objects":34,"num_object_clones":9,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":9,"num_read":3962,"num_read_kb":36301,"num_write":669,"num_write_kb":31947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":17173091,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","0","1"],"object_location_counts":[{"shards":"2","objects":34}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"83'445","reported_seq":4855,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.385551+0000","last_change":"2024-09-12T16:17:07.246803+0000","last_active":"2024-09-12T16:17:19.385551+0000","last_peered":"2024-09-12T16:17:19.385551+0000","last_clean":"2024-09-12T16:17:19.385551+0000","last_became_active":"2024-09-12T16:17:07.245694+0000","last_became_peered":"2024-09-12T16:17:07.245694+0000","last_unstale":"2024-09-12T16:17:19.385551+0000","last_undegraded":"2024-09-12T16:17:19.385551+0000","last_fullsized":"2024-09-12T16:17:19.385551+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:12.169022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059639700000000003,"stat_sum":{"num_bytes":52874357,"num_objects":45,"num_object_clones":11,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":16,"num_read":5481,"num_read_kb":22832,"num_write":711,"num_write_kb":18196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":54,"num_bytes_recovered":6241830,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"83'1209","reported_seq":6404,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.329801+0000","last_change":"2024-09-12T16:17:08.244554+0000","last_active":"2024-09-12T16:17:19.329801+0000","last_peered":"2024-09-12T16:17:19.329801+0000","last_clean":"2024-09-12T16:17:19.329801+0000","last_became_active":"2024-09-12T16:17:08.243010+0000","last_became_peered":"2024-09-12T16:17:08.243010+0000","last_unstale":"2024-09-12T16:17:19.329801+0000","last_undegraded":"2024-09-12T16:17:19.329801+0000","last_fullsized":"2024-09-12T16:17:19.329801+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1209,"log_dups_size":0,"ondisk_log_size":1209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:25.571405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001237496,"stat_sum":{"num_bytes":31936916,"num_objects":49,"num_object_clones":13,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":19,"num_read":10477,"num_read_kb":19765,"num_write":1918,"num_write_kb":5184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":4849100,"num_keys_recovered":60,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"79'208","reported_seq":2508,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.669590+0000","last_change":"2024-09-12T16:16:55.204162+0000","last_active":"2024-09-12T16:17:19.669590+0000","last_peered":"2024-09-12T16:17:19.669590+0000","last_clean":"2024-09-12T16:17:19.669590+0000","last_became_active":"2024-09-12T16:16:55.203324+0000","last_became_peered":"2024-09-12T16:16:55.203324+0000","last_unstale":"2024-09-12T16:17:19.669590+0000","last_undegraded":"2024-09-12T16:17:19.669590+0000","last_fullsized":"2024-09-12T16:17:19.669590+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:05.120972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010193750000000001,"stat_sum":{"num_bytes":54503473,"num_objects":43,"num_object_clones":12,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":16,"num_read":2093,"num_read_kb":25428,"num_write":190,"num_write_kb":9687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":1054818,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"83'504","reported_seq":5270,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.004155+0000","last_change":"2024-09-12T16:16:53.186573+0000","last_active":"2024-09-12T16:17:19.004155+0000","last_peered":"2024-09-12T16:17:19.004155+0000","last_clean":"2024-09-12T16:17:19.004155+0000","last_became_active":"2024-09-12T16:16:53.185698+0000","last_became_peered":"2024-09-12T16:16:53.185698+0000","last_unstale":"2024-09-12T16:17:19.004155+0000","last_undegraded":"2024-09-12T16:17:19.004155+0000","last_fullsized":"2024-09-12T16:17:19.004155+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:11:34.426110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000729947,"stat_sum":{"num_bytes":45892699,"num_objects":29,"num_object_clones":5,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":10,"num_read":7568,"num_read_kb":39294,"num_write":551,"num_write_kb":17799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.004425+0000","last_change":"2024-09-12T16:16:52.184699+0000","last_active":"2024-09-12T16:17:19.004425+0000","last_peered":"2024-09-12T16:17:19.004425+0000","last_clean":"2024-09-12T16:17:19.004425+0000","last_became_active":"2024-09-12T16:16:52.184420+0000","last_became_peered":"2024-09-12T16:16:52.184420+0000","last_unstale":"2024-09-12T16:17:19.004425+0000","last_undegraded":"2024-09-12T16:17:19.004425+0000","last_fullsized":"2024-09-12T16:17:19.004425+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:50.051152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"83'280","reported_seq":4684,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.668137+0000","last_change":"2024-09-12T16:15:59.311049+0000","last_active":"2024-09-12T16:17:19.668137+0000","last_peered":"2024-09-12T16:17:19.668137+0000","last_clean":"2024-09-12T16:17:19.668137+0000","last_became_active":"2024-09-12T16:15:57.012577+0000","last_became_peered":"2024-09-12T16:15:57.012577+0000","last_unstale":"2024-09-12T16:17:19.668137+0000","last_undegraded":"2024-09-12T16:17:19.668137+0000","last_fullsized":"2024-09-12T16:17:19.668137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:45.002737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063283100000000004,"stat_sum":{"num_bytes":18278446,"num_objects":20,"num_object_clones":5,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":5,"num_read":5590,"num_read_kb":18093,"num_write":195,"num_write_kb":904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":160,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.010140+0000","last_change":"2024-09-12T16:16:52.187010+0000","last_active":"2024-09-12T16:17:19.010140+0000","last_peered":"2024-09-12T16:17:19.010140+0000","last_clean":"2024-09-12T16:17:19.010140+0000","last_became_active":"2024-09-12T16:16:52.186638+0000","last_became_peered":"2024-09-12T16:16:52.186638+0000","last_unstale":"2024-09-12T16:17:19.010140+0000","last_undegraded":"2024-09-12T16:17:19.010140+0000","last_fullsized":"2024-09-12T16:17:19.010140+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:40.681796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066384400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"80'241","reported_seq":8638,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.007221+0000","last_change":"2024-09-12T16:16:34.109977+0000","last_active":"2024-09-12T16:17:19.007221+0000","last_peered":"2024-09-12T16:17:19.007221+0000","last_clean":"2024-09-12T16:17:19.007221+0000","last_became_active":"2024-09-12T16:16:34.108850+0000","last_became_peered":"2024-09-12T16:16:34.108850+0000","last_unstale":"2024-09-12T16:17:19.007221+0000","last_undegraded":"2024-09-12T16:17:19.007221+0000","last_fullsized":"2024-09-12T16:17:19.007221+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:24.503810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012786130000000001,"stat_sum":{"num_bytes":52731904,"num_objects":39,"num_object_clones":10,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":17,"num_read":9054,"num_read_kb":50327,"num_write":222,"num_write_kb":24820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.004121+0000","last_change":"2024-09-12T16:16:52.183981+0000","last_active":"2024-09-12T16:17:19.004121+0000","last_peered":"2024-09-12T16:17:19.004121+0000","last_clean":"2024-09-12T16:17:19.004121+0000","last_became_active":"2024-09-12T16:16:52.183675+0000","last_became_peered":"2024-09-12T16:16:52.183675+0000","last_unstale":"2024-09-12T16:17:19.004121+0000","last_undegraded":"2024-09-12T16:17:19.004121+0000","last_fullsized":"2024-09-12T16:17:19.004121+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:35.267433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"83'504","reported_seq":4951,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.693368+0000","last_change":"2024-09-12T16:15:59.016004+0000","last_active":"2024-09-12T16:17:19.693368+0000","last_peered":"2024-09-12T16:17:19.693368+0000","last_clean":"2024-09-12T16:17:19.693368+0000","last_became_active":"2024-09-12T16:15:57.011381+0000","last_became_peered":"2024-09-12T16:15:57.011381+0000","last_unstale":"2024-09-12T16:17:19.693368+0000","last_undegraded":"2024-09-12T16:17:19.693368+0000","last_fullsized":"2024-09-12T16:17:19.693368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:41.833790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001361543,"stat_sum":{"num_bytes":12709440,"num_objects":36,"num_object_clones":4,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":10,"num_read":7353,"num_read_kb":24597,"num_write":668,"num_write_kb":3573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":148,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.009962+0000","last_change":"2024-09-12T16:15:48.822724+0000","last_active":"2024-09-12T16:17:19.009962+0000","last_peered":"2024-09-12T16:17:19.009962+0000","last_clean":"2024-09-12T16:17:19.009962+0000","last_became_active":"2024-09-12T16:15:46.818676+0000","last_became_peered":"2024-09-12T16:15:46.818676+0000","last_unstale":"2024-09-12T16:17:19.009962+0000","last_undegraded":"2024-09-12T16:17:19.009962+0000","last_fullsized":"2024-09-12T16:17:19.009962+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:11.170806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065522900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"79'473","reported_seq":16917,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.681707+0000","last_change":"2024-09-12T16:17:07.243495+0000","last_active":"2024-09-12T16:17:19.681707+0000","last_peered":"2024-09-12T16:17:19.681707+0000","last_clean":"2024-09-12T16:17:19.681707+0000","last_became_active":"2024-09-12T16:17:07.242597+0000","last_became_peered":"2024-09-12T16:17:07.242597+0000","last_unstale":"2024-09-12T16:17:19.681707+0000","last_undegraded":"2024-09-12T16:17:19.681707+0000","last_fullsized":"2024-09-12T16:17:19.681707+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:56.631877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012959270000000001,"stat_sum":{"num_bytes":14539808,"num_objects":42,"num_object_clones":14,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":15,"num_read":20275,"num_read_kb":32663,"num_write":395,"num_write_kb":2065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":633856,"num_keys_recovered":23,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"83'303","reported_seq":3472,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.667629+0000","last_change":"2024-09-12T16:15:59.014247+0000","last_active":"2024-09-12T16:17:19.667629+0000","last_peered":"2024-09-12T16:17:19.667629+0000","last_clean":"2024-09-12T16:17:19.667629+0000","last_became_active":"2024-09-12T16:15:57.012238+0000","last_became_peered":"2024-09-12T16:15:57.012238+0000","last_unstale":"2024-09-12T16:17:19.667629+0000","last_undegraded":"2024-09-12T16:17:19.667629+0000","last_fullsized":"2024-09-12T16:17:19.667629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:04.134523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077777399999999996,"stat_sum":{"num_bytes":67229260,"num_objects":35,"num_object_clones":11,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":9,"num_read":3356,"num_read_kb":13522,"num_write":330,"num_write_kb":4034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":149,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.010056+0000","last_change":"2024-09-12T16:17:04.233055+0000","last_active":"2024-09-12T16:17:19.010056+0000","last_peered":"2024-09-12T16:17:19.010056+0000","last_clean":"2024-09-12T16:17:19.010056+0000","last_became_active":"2024-09-12T16:17:04.232815+0000","last_became_peered":"2024-09-12T16:17:04.232815+0000","last_unstale":"2024-09-12T16:17:19.010056+0000","last_undegraded":"2024-09-12T16:17:19.010056+0000","last_fullsized":"2024-09-12T16:17:19.010056+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:25:38.460863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"83'572","reported_seq":14131,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.690096+0000","last_change":"2024-09-12T16:15:59.014931+0000","last_active":"2024-09-12T16:17:19.690096+0000","last_peered":"2024-09-12T16:17:19.690096+0000","last_clean":"2024-09-12T16:17:19.690096+0000","last_became_active":"2024-09-12T16:15:57.014294+0000","last_became_peered":"2024-09-12T16:15:57.014294+0000","last_unstale":"2024-09-12T16:17:19.690096+0000","last_undegraded":"2024-09-12T16:17:19.690096+0000","last_fullsized":"2024-09-12T16:17:19.690096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:29.440304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011576030000000001,"stat_sum":{"num_bytes":23398508,"num_objects":42,"num_object_clones":11,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":14,"num_read":15655,"num_read_kb":29661,"num_write":474,"num_write_kb":11061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":126,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.005693+0000","last_change":"2024-09-12T16:16:34.109269+0000","last_active":"2024-09-12T16:17:19.005693+0000","last_peered":"2024-09-12T16:17:19.005693+0000","last_clean":"2024-09-12T16:17:19.005693+0000","last_became_active":"2024-09-12T16:16:34.108999+0000","last_became_peered":"2024-09-12T16:16:34.108999+0000","last_unstale":"2024-09-12T16:17:19.005693+0000","last_undegraded":"2024-09-12T16:17:19.005693+0000","last_fullsized":"2024-09-12T16:17:19.005693+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:02:32.771436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"83'306","reported_seq":2657,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.153653+0000","last_change":"2024-09-12T16:15:59.310828+0000","last_active":"2024-09-12T16:17:19.153653+0000","last_peered":"2024-09-12T16:17:19.153653+0000","last_clean":"2024-09-12T16:17:19.153653+0000","last_became_active":"2024-09-12T16:15:57.015817+0000","last_became_peered":"2024-09-12T16:15:57.015817+0000","last_unstale":"2024-09-12T16:17:19.153653+0000","last_undegraded":"2024-09-12T16:17:19.153653+0000","last_fullsized":"2024-09-12T16:17:19.153653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:54.267886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052214999999999998,"stat_sum":{"num_bytes":20731997,"num_objects":35,"num_object_clones":8,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":16,"num_read":2733,"num_read_kb":21397,"num_write":423,"num_write_kb":18948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.003975+0000","last_change":"2024-09-12T16:16:52.184861+0000","last_active":"2024-09-12T16:17:19.003975+0000","last_peered":"2024-09-12T16:17:19.003975+0000","last_clean":"2024-09-12T16:17:19.003975+0000","last_became_active":"2024-09-12T16:16:52.184555+0000","last_became_peered":"2024-09-12T16:16:52.184555+0000","last_unstale":"2024-09-12T16:17:19.003975+0000","last_undegraded":"2024-09-12T16:17:19.003975+0000","last_fullsized":"2024-09-12T16:17:19.003975+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:32.617153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"83'328","reported_seq":3794,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.684068+0000","last_change":"2024-09-12T16:17:07.243928+0000","last_active":"2024-09-12T16:17:19.684068+0000","last_peered":"2024-09-12T16:17:19.684068+0000","last_clean":"2024-09-12T16:17:19.684068+0000","last_became_active":"2024-09-12T16:17:07.242860+0000","last_became_peered":"2024-09-12T16:17:07.242860+0000","last_unstale":"2024-09-12T16:17:19.684068+0000","last_undegraded":"2024-09-12T16:17:19.684068+0000","last_fullsized":"2024-09-12T16:17:19.684068+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:24.946851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090313600000000002,"stat_sum":{"num_bytes":31362080,"num_objects":40,"num_object_clones":10,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":14,"num_read":4216,"num_read_kb":15130,"num_write":288,"num_write_kb":3906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":52,"num_bytes_recovered":2289680,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":128,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.005824+0000","last_change":"2024-09-12T16:17:04.232204+0000","last_active":"2024-09-12T16:17:19.005824+0000","last_peered":"2024-09-12T16:17:19.005824+0000","last_clean":"2024-09-12T16:17:19.005824+0000","last_became_active":"2024-09-12T16:17:04.231878+0000","last_became_peered":"2024-09-12T16:17:04.231878+0000","last_unstale":"2024-09-12T16:17:19.005824+0000","last_undegraded":"2024-09-12T16:17:19.005824+0000","last_fullsized":"2024-09-12T16:17:19.005824+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:24.273844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":59,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.003981+0000","last_change":"2024-09-12T16:16:52.190735+0000","last_active":"2024-09-12T16:17:19.003981+0000","last_peered":"2024-09-12T16:17:19.003981+0000","last_clean":"2024-09-12T16:17:19.003981+0000","last_became_active":"2024-09-12T16:16:52.183781+0000","last_became_peered":"2024-09-12T16:16:52.183781+0000","last_unstale":"2024-09-12T16:17:19.003981+0000","last_undegraded":"2024-09-12T16:17:19.003981+0000","last_fullsized":"2024-09-12T16:17:19.003981+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:40.751677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:40.751677+0000","last_clean_scrub_stamp":"2024-09-12T16:15:40.751677+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:34.274075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'322","reported_seq":9713,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.671194+0000","last_change":"2024-09-12T16:16:34.109457+0000","last_active":"2024-09-12T16:17:19.671194+0000","last_peered":"2024-09-12T16:17:19.671194+0000","last_clean":"2024-09-12T16:17:19.671194+0000","last_became_active":"2024-09-12T16:16:34.108998+0000","last_became_peered":"2024-09-12T16:16:34.108998+0000","last_unstale":"2024-09-12T16:17:19.671194+0000","last_undegraded":"2024-09-12T16:17:19.671194+0000","last_fullsized":"2024-09-12T16:17:19.671194+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:59.492220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001425398,"stat_sum":{"num_bytes":45012270,"num_objects":42,"num_object_clones":9,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":14,"num_read":9817,"num_read_kb":31909,"num_write":381,"num_write_kb":5537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"83'276","reported_seq":27914,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.351580+0000","last_change":"2024-09-12T16:15:59.014122+0000","last_active":"2024-09-12T16:17:19.351580+0000","last_peered":"2024-09-12T16:17:19.351580+0000","last_clean":"2024-09-12T16:17:19.351580+0000","last_became_active":"2024-09-12T16:15:57.013620+0000","last_became_peered":"2024-09-12T16:15:57.013620+0000","last_unstale":"2024-09-12T16:17:19.351580+0000","last_undegraded":"2024-09-12T16:17:19.351580+0000","last_fullsized":"2024-09-12T16:17:19.351580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:26.135511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074921299999999998,"stat_sum":{"num_bytes":56359440,"num_objects":37,"num_object_clones":9,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":14,"num_read":27590,"num_read_kb":49971,"num_write":304,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"83'334","reported_seq":11298,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.426809+0000","last_change":"2024-09-12T16:16:55.203995+0000","last_active":"2024-09-12T16:17:19.426809+0000","last_peered":"2024-09-12T16:17:19.426809+0000","last_clean":"2024-09-12T16:17:19.426809+0000","last_became_active":"2024-09-12T16:16:55.202934+0000","last_became_peered":"2024-09-12T16:16:55.202934+0000","last_unstale":"2024-09-12T16:17:19.426809+0000","last_undegraded":"2024-09-12T16:17:19.426809+0000","last_fullsized":"2024-09-12T16:17:19.426809+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:45.871504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000830695,"stat_sum":{"num_bytes":39159434,"num_objects":35,"num_object_clones":8,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":11,"num_read":11336,"num_read_kb":32449,"num_write":411,"num_write_kb":5429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":4487368,"num_keys_recovered":26,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"83'247","reported_seq":10009,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.692825+0000","last_change":"2024-09-12T16:15:59.015086+0000","last_active":"2024-09-12T16:17:19.692825+0000","last_peered":"2024-09-12T16:17:19.692825+0000","last_clean":"2024-09-12T16:17:19.692825+0000","last_became_active":"2024-09-12T16:15:57.012845+0000","last_became_peered":"2024-09-12T16:15:57.012845+0000","last_unstale":"2024-09-12T16:17:19.692825+0000","last_undegraded":"2024-09-12T16:17:19.692825+0000","last_fullsized":"2024-09-12T16:17:19.692825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:47.815092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001291885,"stat_sum":{"num_bytes":8566952,"num_objects":36,"num_object_clones":6,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":12,"num_read":10040,"num_read_kb":30766,"num_write":331,"num_write_kb":2939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"83'233","reported_seq":5438,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.669668+0000","last_change":"2024-09-12T16:17:07.245322+0000","last_active":"2024-09-12T16:17:19.669668+0000","last_peered":"2024-09-12T16:17:19.669668+0000","last_clean":"2024-09-12T16:17:19.669668+0000","last_became_active":"2024-09-12T16:17:07.244721+0000","last_became_peered":"2024-09-12T16:17:07.244721+0000","last_unstale":"2024-09-12T16:17:19.669668+0000","last_undegraded":"2024-09-12T16:17:19.669668+0000","last_fullsized":"2024-09-12T16:17:19.669668+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:53.023324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001361817,"stat_sum":{"num_bytes":21934592,"num_objects":50,"num_object_clones":13,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":22,"num_read":4998,"num_read_kb":33389,"num_write":258,"num_write_kb":15768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":58,"num_bytes_recovered":3294720,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"83'441","reported_seq":12975,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.669574+0000","last_change":"2024-09-12T16:16:55.202906+0000","last_active":"2024-09-12T16:17:19.669574+0000","last_peered":"2024-09-12T16:17:19.669574+0000","last_clean":"2024-09-12T16:17:19.669574+0000","last_became_active":"2024-09-12T16:16:55.202102+0000","last_became_peered":"2024-09-12T16:16:55.202102+0000","last_unstale":"2024-09-12T16:17:19.669574+0000","last_undegraded":"2024-09-12T16:17:19.669574+0000","last_fullsized":"2024-09-12T16:17:19.669574+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:54.357991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096169400000000003,"stat_sum":{"num_bytes":26427441,"num_objects":50,"num_object_clones":12,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":16,"num_read":14391,"num_read_kb":30529,"num_write":422,"num_write_kb":5046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":126,"num_bytes_recovered":6078562,"num_keys_recovered":48,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"83'307","reported_seq":3653,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.493184+0000","last_change":"2024-09-12T16:17:07.244128+0000","last_active":"2024-09-12T16:17:19.493184+0000","last_peered":"2024-09-12T16:17:19.493184+0000","last_clean":"2024-09-12T16:17:19.493184+0000","last_became_active":"2024-09-12T16:17:07.243245+0000","last_became_peered":"2024-09-12T16:17:07.243245+0000","last_unstale":"2024-09-12T16:17:19.493184+0000","last_undegraded":"2024-09-12T16:17:19.493184+0000","last_fullsized":"2024-09-12T16:17:19.493184+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:20.338383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013436100000000001,"stat_sum":{"num_bytes":17493008,"num_objects":32,"num_object_clones":4,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":10,"num_read":4547,"num_read_kb":16310,"num_write":296,"num_write_kb":10364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":52,"num_bytes_recovered":1737216,"num_keys_recovered":12,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"83'281","reported_seq":2574,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.004561+0000","last_change":"2024-09-12T16:17:07.243220+0000","last_active":"2024-09-12T16:17:19.004561+0000","last_peered":"2024-09-12T16:17:19.004561+0000","last_clean":"2024-09-12T16:17:19.004561+0000","last_became_active":"2024-09-12T16:17:07.242512+0000","last_became_peered":"2024-09-12T16:17:07.242512+0000","last_unstale":"2024-09-12T16:17:19.004561+0000","last_undegraded":"2024-09-12T16:17:19.004561+0000","last_fullsized":"2024-09-12T16:17:19.004561+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":281,"log_dups_size":0,"ondisk_log_size":281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:53.207419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001280946,"stat_sum":{"num_bytes":11041595,"num_objects":26,"num_object_clones":1,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":12,"num_read":2765,"num_read_kb":19313,"num_write":397,"num_write_kb":12500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":76,"num_bytes_recovered":1444176,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"83'260","reported_seq":6964,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.385525+0000","last_change":"2024-09-12T16:17:07.245303+0000","last_active":"2024-09-12T16:17:19.385525+0000","last_peered":"2024-09-12T16:17:19.385525+0000","last_clean":"2024-09-12T16:17:19.385525+0000","last_became_active":"2024-09-12T16:17:07.244725+0000","last_became_peered":"2024-09-12T16:17:07.244725+0000","last_unstale":"2024-09-12T16:17:19.385525+0000","last_undegraded":"2024-09-12T16:17:19.385525+0000","last_fullsized":"2024-09-12T16:17:19.385525+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:26.314749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049764000000000004,"stat_sum":{"num_bytes":35049754,"num_objects":53,"num_object_clones":13,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":21,"num_read":6534,"num_read_kb":41835,"num_write":337,"num_write_kb":10943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":3272971,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"83'327","reported_seq":7147,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.669873+0000","last_change":"2024-09-12T16:16:55.204075+0000","last_active":"2024-09-12T16:17:19.669873+0000","last_peered":"2024-09-12T16:17:19.669873+0000","last_clean":"2024-09-12T16:17:19.669873+0000","last_became_active":"2024-09-12T16:16:55.202493+0000","last_became_peered":"2024-09-12T16:16:55.202493+0000","last_unstale":"2024-09-12T16:17:19.669873+0000","last_undegraded":"2024-09-12T16:17:19.669873+0000","last_fullsized":"2024-09-12T16:17:19.669873+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:50.376004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058531000000000002,"stat_sum":{"num_bytes":35204765,"num_objects":45,"num_object_clones":12,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":13,"num_read":7223,"num_read_kb":21521,"num_write":441,"num_write_kb":5654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":1725440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"83'354","reported_seq":6447,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.318306+0000","last_change":"2024-09-12T16:16:55.202816+0000","last_active":"2024-09-12T16:17:19.318306+0000","last_peered":"2024-09-12T16:17:19.318306+0000","last_clean":"2024-09-12T16:17:19.318306+0000","last_became_active":"2024-09-12T16:16:55.202220+0000","last_became_peered":"2024-09-12T16:16:55.202220+0000","last_unstale":"2024-09-12T16:17:19.318306+0000","last_undegraded":"2024-09-12T16:17:19.318306+0000","last_fullsized":"2024-09-12T16:17:19.318306+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:09.502332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049753500000000001,"stat_sum":{"num_bytes":36111974,"num_objects":36,"num_object_clones":8,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":12,"num_read":8051,"num_read_kb":28464,"num_write":321,"num_write_kb":8530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":3518540,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"83'627","reported_seq":7697,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.155250+0000","last_change":"2024-09-12T16:17:07.242339+0000","last_active":"2024-09-12T16:17:19.155250+0000","last_peered":"2024-09-12T16:17:19.155250+0000","last_clean":"2024-09-12T16:17:19.155250+0000","last_became_active":"2024-09-12T16:17:07.241494+0000","last_became_peered":"2024-09-12T16:17:07.241494+0000","last_unstale":"2024-09-12T16:17:19.155250+0000","last_undegraded":"2024-09-12T16:17:19.155250+0000","last_fullsized":"2024-09-12T16:17:19.155250+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":627,"log_dups_size":0,"ondisk_log_size":627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:25.946603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050533499999999999,"stat_sum":{"num_bytes":36295441,"num_objects":59,"num_object_clones":17,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":21,"num_read":8266,"num_read_kb":35572,"num_write":1044,"num_write_kb":17021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":136,"num_bytes_recovered":7863816,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1036148394,"num_objects":1317,"num_object_clones":319,"num_object_copies":2634,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1317,"num_whiteouts":481,"num_read":270259,"num_read_kb":929663,"num_write":15501,"num_write_kb":317733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1843,"num_bytes_recovered":96211470,"num_keys_recovered":249,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":345219072,"data_stored":423422482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6949,"internal_metadata":0},"log_size":12710,"ondisk_log_size":12710,"up":64,"acting":63,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":5,"up_from":71,"seq":304942678020,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88160,"kb_used_data":55436,"kb_used_omap":11,"kb_used_meta":32692,"kb_avail":94283680,"statfs":{"total":96636764160,"available":96546488320,"internally_reserved":0,"allocated":56766464,"data_stored":66925920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11593,"internal_metadata":33477303},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640279,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82684,"kb_used_data":51496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94289156,"statfs":{"total":96636764160,"available":96552095744,"internally_reserved":0,"allocated":52731904,"data_stored":64463038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640280,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108884,"kb_used_data":51332,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94262956,"statfs":{"total":96636764160,"available":96525266944,"internally_reserved":0,"allocated":52563968,"data_stored":68066717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640281,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95544,"kb_used_data":60192,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94276296,"statfs":{"total":96636764160,"available":96538927104,"internally_reserved":0,"allocated":61636608,"data_stored":75889042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640279,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84080,"kb_used_data":52884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94287760,"statfs":{"total":96636764160,"available":96550666240,"internally_reserved":0,"allocated":54153216,"data_stored":60852792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640280,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85080,"kb_used_data":53896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94286760,"statfs":{"total":96636764160,"available":96549642240,"internally_reserved":0,"allocated":55189504,"data_stored":68967343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":71188480,"data_stored":88223843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53493760,"data_stored":60763131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61005824,"data_stored":75825592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":51302400,"data_stored":67380548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":52396032,"data_stored":64682502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":55832576,"data_stored":66546866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6949,"internal_metadata":0}]}} 2024-09-12T16:17:22.412 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T16:17:22.457 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #25, image image_client.0-clone25 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent26 2024-09-12T16:17:22.474 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:22.473+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:22.537 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:22.537 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:22.546 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:17:22.591 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:22.589+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:22.654 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:22.654 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:22.663 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:17:22.675 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:22.673+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:22.769 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:17:22.770 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-12T16:17:22.775 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:22.774+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:22.785 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2024-09-12T16:17:22.678443+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1036738781,"num_objects":1321,"num_object_clones":319,"num_object_copies":2642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1321,"num_whiteouts":481,"num_read":270325,"num_read_kb":929718,"num_write":15604,"num_write_kb":319363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1847,"num_bytes_recovered":97392206,"num_keys_recovered":249,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12785,"ondisk_log_size":12785,"up":82,"acting":81,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":549592,"kb_used_data":326224,"kb_used_omap":19,"kb_used_meta":223212,"kb_avail":565681448,"statfs":{"total":579820584960,"available":579257802752,"internally_reserved":0,"allocated":334053376,"data_stored":406119276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19565,"internal_metadata":228570003},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8716856,"num_objects":103,"num_object_clones":26,"num_object_copies":206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":34,"num_read":23339,"num_read_kb":28506,"num_write":615,"num_write_kb":4075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":256,"num_bytes_recovered":27617982,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000671"},"pg_stats":[{"pgid":"3.1f","version":"83'305","reported_seq":12226,"reported_epoch":83,"state":"active+remapped","last_fresh":"2024-09-12T16:17:19.349769+0000","last_change":"2024-09-12T16:17:19.311030+0000","last_active":"2024-09-12T16:17:19.349769+0000","last_peered":"2024-09-12T16:17:19.349769+0000","last_clean":"2024-09-12T16:17:16.360341+0000","last_became_active":"2024-09-12T16:17:19.015347+0000","last_became_peered":"2024-09-12T16:17:19.015347+0000","last_unstale":"2024-09-12T16:17:19.349769+0000","last_undegraded":"2024-09-12T16:17:19.349769+0000","last_fullsized":"2024-09-12T16:17:19.349769+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001341074,"stat_sum":{"num_bytes":28327003,"num_objects":45,"num_object_clones":11,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":19,"num_read":11914,"num_read_kb":56908,"num_write":319,"num_write_kb":7346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":2818651,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[2,3],"avail_no_missing":["2","0","3"],"object_location_counts":[{"shards":"2,3","objects":45}],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"83'357","reported_seq":9409,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.680936+0000","last_change":"2024-09-12T16:16:55.203459+0000","last_active":"2024-09-12T16:17:19.680936+0000","last_peered":"2024-09-12T16:17:19.680936+0000","last_clean":"2024-09-12T16:17:19.680936+0000","last_became_active":"2024-09-12T16:16:55.202876+0000","last_became_peered":"2024-09-12T16:16:55.202876+0000","last_unstale":"2024-09-12T16:17:19.680936+0000","last_undegraded":"2024-09-12T16:17:19.680936+0000","last_fullsized":"2024-09-12T16:17:19.680936+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:30.057693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076760299999999995,"stat_sum":{"num_bytes":24617151,"num_objects":59,"num_object_clones":14,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":20,"num_read":9434,"num_read_kb":32444,"num_write":358,"num_write_kb":5955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":3145760,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"83'1191","reported_seq":14680,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.667716+0000","last_change":"2024-09-12T16:17:07.244801+0000","last_active":"2024-09-12T16:17:19.667716+0000","last_peered":"2024-09-12T16:17:19.667716+0000","last_clean":"2024-09-12T16:17:19.667716+0000","last_became_active":"2024-09-12T16:17:07.243733+0000","last_became_peered":"2024-09-12T16:17:07.243733+0000","last_unstale":"2024-09-12T16:17:19.667716+0000","last_undegraded":"2024-09-12T16:17:19.667716+0000","last_fullsized":"2024-09-12T16:17:19.667716+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1191,"log_dups_size":0,"ondisk_log_size":1191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:14.577621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010512060000000001,"stat_sum":{"num_bytes":44757219,"num_objects":49,"num_object_clones":12,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":18,"num_read":17707,"num_read_kb":50480,"num_write":1789,"num_write_kb":13478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":60,"num_bytes_recovered":9304291,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"83'193","reported_seq":1665,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.667712+0000","last_change":"2024-09-12T16:17:07.244095+0000","last_active":"2024-09-12T16:17:19.667712+0000","last_peered":"2024-09-12T16:17:19.667712+0000","last_clean":"2024-09-12T16:17:19.667712+0000","last_became_active":"2024-09-12T16:17:07.243433+0000","last_became_peered":"2024-09-12T16:17:07.243433+0000","last_unstale":"2024-09-12T16:17:19.667712+0000","last_undegraded":"2024-09-12T16:17:19.667712+0000","last_fullsized":"2024-09-12T16:17:19.667712+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:52.692072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011661079999999999,"stat_sum":{"num_bytes":14351376,"num_objects":29,"num_object_clones":8,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":14,"num_read":1290,"num_read_kb":4391,"num_write":203,"num_write_kb":1444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":50,"num_bytes_recovered":579600,"num_keys_recovered":44,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"83'289","reported_seq":4417,"reported_epoch":83,"state":"active+remapped","last_fresh":"2024-09-12T16:17:19.436419+0000","last_change":"2024-09-12T16:17:19.174183+0000","last_active":"2024-09-12T16:17:19.436419+0000","last_peered":"2024-09-12T16:17:19.436419+0000","last_clean":"2024-09-12T16:17:16.266255+0000","last_became_active":"2024-09-12T16:17:19.013666+0000","last_became_peered":"2024-09-12T16:17:19.013666+0000","last_unstale":"2024-09-12T16:17:19.436419+0000","last_undegraded":"2024-09-12T16:17:19.436419+0000","last_fullsized":"2024-09-12T16:17:19.436419+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056160499999999996,"stat_sum":{"num_bytes":41181696,"num_objects":39,"num_object_clones":13,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":19,"num_read":4488,"num_read_kb":22405,"num_write":258,"num_write_kb":8778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":14697984,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[3,4],"avail_no_missing":["3","0","4"],"object_location_counts":[{"shards":"3,4","objects":39}],"blocked_by":[],"up_primary":0,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"83'257","reported_seq":5427,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.488711+0000","last_change":"2024-09-12T16:15:59.013909+0000","last_active":"2024-09-12T16:17:19.488711+0000","last_peered":"2024-09-12T16:17:19.488711+0000","last_clean":"2024-09-12T16:17:19.488711+0000","last_became_active":"2024-09-12T16:15:57.014803+0000","last_became_peered":"2024-09-12T16:15:57.014803+0000","last_unstale":"2024-09-12T16:17:19.488711+0000","last_undegraded":"2024-09-12T16:17:19.488711+0000","last_fullsized":"2024-09-12T16:17:19.488711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:35.133020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056998200000000002,"stat_sum":{"num_bytes":25684632,"num_objects":40,"num_object_clones":7,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":18,"num_read":5576,"num_read_kb":20094,"num_write":320,"num_write_kb":16457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"83'261","reported_seq":6777,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.691659+0000","last_change":"2024-09-12T16:15:59.015220+0000","last_active":"2024-09-12T16:17:19.691659+0000","last_peered":"2024-09-12T16:17:19.691659+0000","last_clean":"2024-09-12T16:17:19.691659+0000","last_became_active":"2024-09-12T16:15:57.016110+0000","last_became_peered":"2024-09-12T16:15:57.016110+0000","last_unstale":"2024-09-12T16:17:19.691659+0000","last_undegraded":"2024-09-12T16:17:19.691659+0000","last_fullsized":"2024-09-12T16:17:19.691659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:53.370475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088668999999999998,"stat_sum":{"num_bytes":21534768,"num_objects":66,"num_object_clones":19,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":25,"num_read":6479,"num_read_kb":21903,"num_write":277,"num_write_kb":4212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"83'475","reported_seq":3364,"reported_epoch":83,"state":"active+undersized+remapped","last_fresh":"2024-09-12T16:17:19.672428+0000","last_change":"2024-09-12T16:17:19.517053+0000","last_active":"2024-09-12T16:17:19.672428+0000","last_peered":"2024-09-12T16:17:19.672428+0000","last_clean":"2024-09-12T16:17:17.211836+0000","last_became_active":"2024-09-12T16:17:19.018165+0000","last_became_peered":"2024-09-12T16:17:19.018165+0000","last_unstale":"2024-09-12T16:17:19.672428+0000","last_undegraded":"2024-09-12T16:17:19.672428+0000","last_fullsized":"2024-09-12T16:17:19.005780+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081349199999999997,"stat_sum":{"num_bytes":40848995,"num_objects":34,"num_object_clones":9,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":9,"num_read":3962,"num_read_kb":36301,"num_write":669,"num_write_kb":31947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":17173091,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","0","1"],"object_location_counts":[{"shards":"2","objects":34}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"83'445","reported_seq":4855,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.385551+0000","last_change":"2024-09-12T16:17:07.246803+0000","last_active":"2024-09-12T16:17:19.385551+0000","last_peered":"2024-09-12T16:17:19.385551+0000","last_clean":"2024-09-12T16:17:19.385551+0000","last_became_active":"2024-09-12T16:17:07.245694+0000","last_became_peered":"2024-09-12T16:17:07.245694+0000","last_unstale":"2024-09-12T16:17:19.385551+0000","last_undegraded":"2024-09-12T16:17:19.385551+0000","last_fullsized":"2024-09-12T16:17:19.385551+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:12.169022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059639700000000003,"stat_sum":{"num_bytes":52874357,"num_objects":45,"num_object_clones":11,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":16,"num_read":5481,"num_read_kb":22832,"num_write":711,"num_write_kb":18196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":54,"num_bytes_recovered":6241830,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"83'1209","reported_seq":6404,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.329801+0000","last_change":"2024-09-12T16:17:08.244554+0000","last_active":"2024-09-12T16:17:19.329801+0000","last_peered":"2024-09-12T16:17:19.329801+0000","last_clean":"2024-09-12T16:17:19.329801+0000","last_became_active":"2024-09-12T16:17:08.243010+0000","last_became_peered":"2024-09-12T16:17:08.243010+0000","last_unstale":"2024-09-12T16:17:19.329801+0000","last_undegraded":"2024-09-12T16:17:19.329801+0000","last_fullsized":"2024-09-12T16:17:19.329801+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1209,"log_dups_size":0,"ondisk_log_size":1209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:25.571405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001237496,"stat_sum":{"num_bytes":31936916,"num_objects":49,"num_object_clones":13,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":19,"num_read":10477,"num_read_kb":19765,"num_write":1918,"num_write_kb":5184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":4849100,"num_keys_recovered":60,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"79'208","reported_seq":2508,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.669590+0000","last_change":"2024-09-12T16:16:55.204162+0000","last_active":"2024-09-12T16:17:19.669590+0000","last_peered":"2024-09-12T16:17:19.669590+0000","last_clean":"2024-09-12T16:17:19.669590+0000","last_became_active":"2024-09-12T16:16:55.203324+0000","last_became_peered":"2024-09-12T16:16:55.203324+0000","last_unstale":"2024-09-12T16:17:19.669590+0000","last_undegraded":"2024-09-12T16:17:19.669590+0000","last_fullsized":"2024-09-12T16:17:19.669590+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:05.120972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010193750000000001,"stat_sum":{"num_bytes":54503473,"num_objects":43,"num_object_clones":12,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":16,"num_read":2093,"num_read_kb":25428,"num_write":190,"num_write_kb":9687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":1054818,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"83'504","reported_seq":5270,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.004155+0000","last_change":"2024-09-12T16:16:53.186573+0000","last_active":"2024-09-12T16:17:19.004155+0000","last_peered":"2024-09-12T16:17:19.004155+0000","last_clean":"2024-09-12T16:17:19.004155+0000","last_became_active":"2024-09-12T16:16:53.185698+0000","last_became_peered":"2024-09-12T16:16:53.185698+0000","last_unstale":"2024-09-12T16:17:19.004155+0000","last_undegraded":"2024-09-12T16:17:19.004155+0000","last_fullsized":"2024-09-12T16:17:19.004155+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:11:34.426110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000729947,"stat_sum":{"num_bytes":45892699,"num_objects":29,"num_object_clones":5,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":10,"num_read":7568,"num_read_kb":39294,"num_write":551,"num_write_kb":17799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.004425+0000","last_change":"2024-09-12T16:16:52.184699+0000","last_active":"2024-09-12T16:17:19.004425+0000","last_peered":"2024-09-12T16:17:19.004425+0000","last_clean":"2024-09-12T16:17:19.004425+0000","last_became_active":"2024-09-12T16:16:52.184420+0000","last_became_peered":"2024-09-12T16:16:52.184420+0000","last_unstale":"2024-09-12T16:17:19.004425+0000","last_undegraded":"2024-09-12T16:17:19.004425+0000","last_fullsized":"2024-09-12T16:17:19.004425+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:50.051152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"83'280","reported_seq":4684,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.668137+0000","last_change":"2024-09-12T16:15:59.311049+0000","last_active":"2024-09-12T16:17:19.668137+0000","last_peered":"2024-09-12T16:17:19.668137+0000","last_clean":"2024-09-12T16:17:19.668137+0000","last_became_active":"2024-09-12T16:15:57.012577+0000","last_became_peered":"2024-09-12T16:15:57.012577+0000","last_unstale":"2024-09-12T16:17:19.668137+0000","last_undegraded":"2024-09-12T16:17:19.668137+0000","last_fullsized":"2024-09-12T16:17:19.668137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:45.002737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063283100000000004,"stat_sum":{"num_bytes":18278446,"num_objects":20,"num_object_clones":5,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":5,"num_read":5590,"num_read_kb":18093,"num_write":195,"num_write_kb":904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":160,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.010140+0000","last_change":"2024-09-12T16:16:52.187010+0000","last_active":"2024-09-12T16:17:19.010140+0000","last_peered":"2024-09-12T16:17:19.010140+0000","last_clean":"2024-09-12T16:17:19.010140+0000","last_became_active":"2024-09-12T16:16:52.186638+0000","last_became_peered":"2024-09-12T16:16:52.186638+0000","last_unstale":"2024-09-12T16:17:19.010140+0000","last_undegraded":"2024-09-12T16:17:19.010140+0000","last_fullsized":"2024-09-12T16:17:19.010140+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:40.681796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066384400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"80'241","reported_seq":8638,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.007221+0000","last_change":"2024-09-12T16:16:34.109977+0000","last_active":"2024-09-12T16:17:19.007221+0000","last_peered":"2024-09-12T16:17:19.007221+0000","last_clean":"2024-09-12T16:17:19.007221+0000","last_became_active":"2024-09-12T16:16:34.108850+0000","last_became_peered":"2024-09-12T16:16:34.108850+0000","last_unstale":"2024-09-12T16:17:19.007221+0000","last_undegraded":"2024-09-12T16:17:19.007221+0000","last_fullsized":"2024-09-12T16:17:19.007221+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:24.503810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012786130000000001,"stat_sum":{"num_bytes":52731904,"num_objects":39,"num_object_clones":10,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":17,"num_read":9054,"num_read_kb":50327,"num_write":222,"num_write_kb":24820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.004121+0000","last_change":"2024-09-12T16:16:52.183981+0000","last_active":"2024-09-12T16:17:19.004121+0000","last_peered":"2024-09-12T16:17:19.004121+0000","last_clean":"2024-09-12T16:17:19.004121+0000","last_became_active":"2024-09-12T16:16:52.183675+0000","last_became_peered":"2024-09-12T16:16:52.183675+0000","last_unstale":"2024-09-12T16:17:19.004121+0000","last_undegraded":"2024-09-12T16:17:19.004121+0000","last_fullsized":"2024-09-12T16:17:19.004121+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:35.267433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"83'504","reported_seq":4951,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.693368+0000","last_change":"2024-09-12T16:15:59.016004+0000","last_active":"2024-09-12T16:17:19.693368+0000","last_peered":"2024-09-12T16:17:19.693368+0000","last_clean":"2024-09-12T16:17:19.693368+0000","last_became_active":"2024-09-12T16:15:57.011381+0000","last_became_peered":"2024-09-12T16:15:57.011381+0000","last_unstale":"2024-09-12T16:17:19.693368+0000","last_undegraded":"2024-09-12T16:17:19.693368+0000","last_fullsized":"2024-09-12T16:17:19.693368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:41.833790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001361543,"stat_sum":{"num_bytes":12709440,"num_objects":36,"num_object_clones":4,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":10,"num_read":7353,"num_read_kb":24597,"num_write":668,"num_write_kb":3573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":148,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.009962+0000","last_change":"2024-09-12T16:15:48.822724+0000","last_active":"2024-09-12T16:17:19.009962+0000","last_peered":"2024-09-12T16:17:19.009962+0000","last_clean":"2024-09-12T16:17:19.009962+0000","last_became_active":"2024-09-12T16:15:46.818676+0000","last_became_peered":"2024-09-12T16:15:46.818676+0000","last_unstale":"2024-09-12T16:17:19.009962+0000","last_undegraded":"2024-09-12T16:17:19.009962+0000","last_fullsized":"2024-09-12T16:17:19.009962+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:11.170806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065522900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"79'473","reported_seq":16917,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.681707+0000","last_change":"2024-09-12T16:17:07.243495+0000","last_active":"2024-09-12T16:17:19.681707+0000","last_peered":"2024-09-12T16:17:19.681707+0000","last_clean":"2024-09-12T16:17:19.681707+0000","last_became_active":"2024-09-12T16:17:07.242597+0000","last_became_peered":"2024-09-12T16:17:07.242597+0000","last_unstale":"2024-09-12T16:17:19.681707+0000","last_undegraded":"2024-09-12T16:17:19.681707+0000","last_fullsized":"2024-09-12T16:17:19.681707+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:56.631877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012959270000000001,"stat_sum":{"num_bytes":14539808,"num_objects":42,"num_object_clones":14,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":15,"num_read":20275,"num_read_kb":32663,"num_write":395,"num_write_kb":2065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":633856,"num_keys_recovered":23,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"83'303","reported_seq":3472,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.667629+0000","last_change":"2024-09-12T16:15:59.014247+0000","last_active":"2024-09-12T16:17:19.667629+0000","last_peered":"2024-09-12T16:17:19.667629+0000","last_clean":"2024-09-12T16:17:19.667629+0000","last_became_active":"2024-09-12T16:15:57.012238+0000","last_became_peered":"2024-09-12T16:15:57.012238+0000","last_unstale":"2024-09-12T16:17:19.667629+0000","last_undegraded":"2024-09-12T16:17:19.667629+0000","last_fullsized":"2024-09-12T16:17:19.667629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:04.134523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077777399999999996,"stat_sum":{"num_bytes":67229260,"num_objects":35,"num_object_clones":11,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":9,"num_read":3356,"num_read_kb":13522,"num_write":330,"num_write_kb":4034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":149,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.010056+0000","last_change":"2024-09-12T16:17:04.233055+0000","last_active":"2024-09-12T16:17:19.010056+0000","last_peered":"2024-09-12T16:17:19.010056+0000","last_clean":"2024-09-12T16:17:19.010056+0000","last_became_active":"2024-09-12T16:17:04.232815+0000","last_became_peered":"2024-09-12T16:17:04.232815+0000","last_unstale":"2024-09-12T16:17:19.010056+0000","last_undegraded":"2024-09-12T16:17:19.010056+0000","last_fullsized":"2024-09-12T16:17:19.010056+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:25:38.460863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"83'572","reported_seq":14131,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.690096+0000","last_change":"2024-09-12T16:15:59.014931+0000","last_active":"2024-09-12T16:17:19.690096+0000","last_peered":"2024-09-12T16:17:19.690096+0000","last_clean":"2024-09-12T16:17:19.690096+0000","last_became_active":"2024-09-12T16:15:57.014294+0000","last_became_peered":"2024-09-12T16:15:57.014294+0000","last_unstale":"2024-09-12T16:17:19.690096+0000","last_undegraded":"2024-09-12T16:17:19.690096+0000","last_fullsized":"2024-09-12T16:17:19.690096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:29.440304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011576030000000001,"stat_sum":{"num_bytes":23398508,"num_objects":42,"num_object_clones":11,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":14,"num_read":15655,"num_read_kb":29661,"num_write":474,"num_write_kb":11061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":126,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.005693+0000","last_change":"2024-09-12T16:16:34.109269+0000","last_active":"2024-09-12T16:17:19.005693+0000","last_peered":"2024-09-12T16:17:19.005693+0000","last_clean":"2024-09-12T16:17:19.005693+0000","last_became_active":"2024-09-12T16:16:34.108999+0000","last_became_peered":"2024-09-12T16:16:34.108999+0000","last_unstale":"2024-09-12T16:17:19.005693+0000","last_undegraded":"2024-09-12T16:17:19.005693+0000","last_fullsized":"2024-09-12T16:17:19.005693+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:02:32.771436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"83'306","reported_seq":2657,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.153653+0000","last_change":"2024-09-12T16:15:59.310828+0000","last_active":"2024-09-12T16:17:19.153653+0000","last_peered":"2024-09-12T16:17:19.153653+0000","last_clean":"2024-09-12T16:17:19.153653+0000","last_became_active":"2024-09-12T16:15:57.015817+0000","last_became_peered":"2024-09-12T16:15:57.015817+0000","last_unstale":"2024-09-12T16:17:19.153653+0000","last_undegraded":"2024-09-12T16:17:19.153653+0000","last_fullsized":"2024-09-12T16:17:19.153653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:54.267886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052214999999999998,"stat_sum":{"num_bytes":20731997,"num_objects":35,"num_object_clones":8,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":16,"num_read":2733,"num_read_kb":21397,"num_write":423,"num_write_kb":18948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.003975+0000","last_change":"2024-09-12T16:16:52.184861+0000","last_active":"2024-09-12T16:17:19.003975+0000","last_peered":"2024-09-12T16:17:19.003975+0000","last_clean":"2024-09-12T16:17:19.003975+0000","last_became_active":"2024-09-12T16:16:52.184555+0000","last_became_peered":"2024-09-12T16:16:52.184555+0000","last_unstale":"2024-09-12T16:17:19.003975+0000","last_undegraded":"2024-09-12T16:17:19.003975+0000","last_fullsized":"2024-09-12T16:17:19.003975+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:32.617153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"83'328","reported_seq":3794,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.684068+0000","last_change":"2024-09-12T16:17:07.243928+0000","last_active":"2024-09-12T16:17:19.684068+0000","last_peered":"2024-09-12T16:17:19.684068+0000","last_clean":"2024-09-12T16:17:19.684068+0000","last_became_active":"2024-09-12T16:17:07.242860+0000","last_became_peered":"2024-09-12T16:17:07.242860+0000","last_unstale":"2024-09-12T16:17:19.684068+0000","last_undegraded":"2024-09-12T16:17:19.684068+0000","last_fullsized":"2024-09-12T16:17:19.684068+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:24.946851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090313600000000002,"stat_sum":{"num_bytes":31362080,"num_objects":40,"num_object_clones":10,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":14,"num_read":4216,"num_read_kb":15130,"num_write":288,"num_write_kb":3906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":52,"num_bytes_recovered":2289680,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":128,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.005824+0000","last_change":"2024-09-12T16:17:04.232204+0000","last_active":"2024-09-12T16:17:19.005824+0000","last_peered":"2024-09-12T16:17:19.005824+0000","last_clean":"2024-09-12T16:17:19.005824+0000","last_became_active":"2024-09-12T16:17:04.231878+0000","last_became_peered":"2024-09-12T16:17:04.231878+0000","last_unstale":"2024-09-12T16:17:19.005824+0000","last_undegraded":"2024-09-12T16:17:19.005824+0000","last_fullsized":"2024-09-12T16:17:19.005824+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:24.273844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":59,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.003981+0000","last_change":"2024-09-12T16:16:52.190735+0000","last_active":"2024-09-12T16:17:19.003981+0000","last_peered":"2024-09-12T16:17:19.003981+0000","last_clean":"2024-09-12T16:17:19.003981+0000","last_became_active":"2024-09-12T16:16:52.183781+0000","last_became_peered":"2024-09-12T16:16:52.183781+0000","last_unstale":"2024-09-12T16:17:19.003981+0000","last_undegraded":"2024-09-12T16:17:19.003981+0000","last_fullsized":"2024-09-12T16:17:19.003981+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:40.751677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:40.751677+0000","last_clean_scrub_stamp":"2024-09-12T16:15:40.751677+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:34.274075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'322","reported_seq":9713,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.671194+0000","last_change":"2024-09-12T16:16:34.109457+0000","last_active":"2024-09-12T16:17:19.671194+0000","last_peered":"2024-09-12T16:17:19.671194+0000","last_clean":"2024-09-12T16:17:19.671194+0000","last_became_active":"2024-09-12T16:16:34.108998+0000","last_became_peered":"2024-09-12T16:16:34.108998+0000","last_unstale":"2024-09-12T16:17:19.671194+0000","last_undegraded":"2024-09-12T16:17:19.671194+0000","last_fullsized":"2024-09-12T16:17:19.671194+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:59.492220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001425398,"stat_sum":{"num_bytes":45012270,"num_objects":42,"num_object_clones":9,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":14,"num_read":9817,"num_read_kb":31909,"num_write":381,"num_write_kb":5537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"83'276","reported_seq":27914,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.351580+0000","last_change":"2024-09-12T16:15:59.014122+0000","last_active":"2024-09-12T16:17:19.351580+0000","last_peered":"2024-09-12T16:17:19.351580+0000","last_clean":"2024-09-12T16:17:19.351580+0000","last_became_active":"2024-09-12T16:15:57.013620+0000","last_became_peered":"2024-09-12T16:15:57.013620+0000","last_unstale":"2024-09-12T16:17:19.351580+0000","last_undegraded":"2024-09-12T16:17:19.351580+0000","last_fullsized":"2024-09-12T16:17:19.351580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:26.135511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074921299999999998,"stat_sum":{"num_bytes":56359440,"num_objects":37,"num_object_clones":9,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":14,"num_read":27590,"num_read_kb":49971,"num_write":304,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"83'334","reported_seq":11298,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.426809+0000","last_change":"2024-09-12T16:16:55.203995+0000","last_active":"2024-09-12T16:17:19.426809+0000","last_peered":"2024-09-12T16:17:19.426809+0000","last_clean":"2024-09-12T16:17:19.426809+0000","last_became_active":"2024-09-12T16:16:55.202934+0000","last_became_peered":"2024-09-12T16:16:55.202934+0000","last_unstale":"2024-09-12T16:17:19.426809+0000","last_undegraded":"2024-09-12T16:17:19.426809+0000","last_fullsized":"2024-09-12T16:17:19.426809+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:45.871504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000830695,"stat_sum":{"num_bytes":39159434,"num_objects":35,"num_object_clones":8,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":11,"num_read":11336,"num_read_kb":32449,"num_write":411,"num_write_kb":5429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":4487368,"num_keys_recovered":26,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"83'247","reported_seq":10009,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.692825+0000","last_change":"2024-09-12T16:15:59.015086+0000","last_active":"2024-09-12T16:17:19.692825+0000","last_peered":"2024-09-12T16:17:19.692825+0000","last_clean":"2024-09-12T16:17:19.692825+0000","last_became_active":"2024-09-12T16:15:57.012845+0000","last_became_peered":"2024-09-12T16:15:57.012845+0000","last_unstale":"2024-09-12T16:17:19.692825+0000","last_undegraded":"2024-09-12T16:17:19.692825+0000","last_fullsized":"2024-09-12T16:17:19.692825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:47.815092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001291885,"stat_sum":{"num_bytes":8566952,"num_objects":36,"num_object_clones":6,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":12,"num_read":10040,"num_read_kb":30766,"num_write":331,"num_write_kb":2939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"83'233","reported_seq":5438,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.669668+0000","last_change":"2024-09-12T16:17:07.245322+0000","last_active":"2024-09-12T16:17:19.669668+0000","last_peered":"2024-09-12T16:17:19.669668+0000","last_clean":"2024-09-12T16:17:19.669668+0000","last_became_active":"2024-09-12T16:17:07.244721+0000","last_became_peered":"2024-09-12T16:17:07.244721+0000","last_unstale":"2024-09-12T16:17:19.669668+0000","last_undegraded":"2024-09-12T16:17:19.669668+0000","last_fullsized":"2024-09-12T16:17:19.669668+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:53.023324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001361817,"stat_sum":{"num_bytes":21934592,"num_objects":50,"num_object_clones":13,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":22,"num_read":4998,"num_read_kb":33389,"num_write":258,"num_write_kb":15768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":58,"num_bytes_recovered":3294720,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"83'441","reported_seq":12975,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.669574+0000","last_change":"2024-09-12T16:16:55.202906+0000","last_active":"2024-09-12T16:17:19.669574+0000","last_peered":"2024-09-12T16:17:19.669574+0000","last_clean":"2024-09-12T16:17:19.669574+0000","last_became_active":"2024-09-12T16:16:55.202102+0000","last_became_peered":"2024-09-12T16:16:55.202102+0000","last_unstale":"2024-09-12T16:17:19.669574+0000","last_undegraded":"2024-09-12T16:17:19.669574+0000","last_fullsized":"2024-09-12T16:17:19.669574+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:54.357991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096169400000000003,"stat_sum":{"num_bytes":26427441,"num_objects":50,"num_object_clones":12,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":16,"num_read":14391,"num_read_kb":30529,"num_write":422,"num_write_kb":5046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":126,"num_bytes_recovered":6078562,"num_keys_recovered":48,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"83'307","reported_seq":3653,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.493184+0000","last_change":"2024-09-12T16:17:07.244128+0000","last_active":"2024-09-12T16:17:19.493184+0000","last_peered":"2024-09-12T16:17:19.493184+0000","last_clean":"2024-09-12T16:17:19.493184+0000","last_became_active":"2024-09-12T16:17:07.243245+0000","last_became_peered":"2024-09-12T16:17:07.243245+0000","last_unstale":"2024-09-12T16:17:19.493184+0000","last_undegraded":"2024-09-12T16:17:19.493184+0000","last_fullsized":"2024-09-12T16:17:19.493184+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:20.338383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013436100000000001,"stat_sum":{"num_bytes":17493008,"num_objects":32,"num_object_clones":4,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":10,"num_read":4547,"num_read_kb":16310,"num_write":296,"num_write_kb":10364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":52,"num_bytes_recovered":1737216,"num_keys_recovered":12,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"83'281","reported_seq":2574,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.004561+0000","last_change":"2024-09-12T16:17:07.243220+0000","last_active":"2024-09-12T16:17:19.004561+0000","last_peered":"2024-09-12T16:17:19.004561+0000","last_clean":"2024-09-12T16:17:19.004561+0000","last_became_active":"2024-09-12T16:17:07.242512+0000","last_became_peered":"2024-09-12T16:17:07.242512+0000","last_unstale":"2024-09-12T16:17:19.004561+0000","last_undegraded":"2024-09-12T16:17:19.004561+0000","last_fullsized":"2024-09-12T16:17:19.004561+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":281,"log_dups_size":0,"ondisk_log_size":281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:53.207419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001280946,"stat_sum":{"num_bytes":11041595,"num_objects":26,"num_object_clones":1,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":12,"num_read":2765,"num_read_kb":19313,"num_write":397,"num_write_kb":12500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":76,"num_bytes_recovered":1444176,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"83'260","reported_seq":6964,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.385525+0000","last_change":"2024-09-12T16:17:07.245303+0000","last_active":"2024-09-12T16:17:19.385525+0000","last_peered":"2024-09-12T16:17:19.385525+0000","last_clean":"2024-09-12T16:17:19.385525+0000","last_became_active":"2024-09-12T16:17:07.244725+0000","last_became_peered":"2024-09-12T16:17:07.244725+0000","last_unstale":"2024-09-12T16:17:19.385525+0000","last_undegraded":"2024-09-12T16:17:19.385525+0000","last_fullsized":"2024-09-12T16:17:19.385525+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:26.314749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049764000000000004,"stat_sum":{"num_bytes":35049754,"num_objects":53,"num_object_clones":13,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":21,"num_read":6534,"num_read_kb":41835,"num_write":337,"num_write_kb":10943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":3272971,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"83'327","reported_seq":7147,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.669873+0000","last_change":"2024-09-12T16:16:55.204075+0000","last_active":"2024-09-12T16:17:19.669873+0000","last_peered":"2024-09-12T16:17:19.669873+0000","last_clean":"2024-09-12T16:17:19.669873+0000","last_became_active":"2024-09-12T16:16:55.202493+0000","last_became_peered":"2024-09-12T16:16:55.202493+0000","last_unstale":"2024-09-12T16:17:19.669873+0000","last_undegraded":"2024-09-12T16:17:19.669873+0000","last_fullsized":"2024-09-12T16:17:19.669873+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:50.376004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058531000000000002,"stat_sum":{"num_bytes":35204765,"num_objects":45,"num_object_clones":12,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":13,"num_read":7223,"num_read_kb":21521,"num_write":441,"num_write_kb":5654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":1725440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"83'354","reported_seq":6447,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.318306+0000","last_change":"2024-09-12T16:16:55.202816+0000","last_active":"2024-09-12T16:17:19.318306+0000","last_peered":"2024-09-12T16:17:19.318306+0000","last_clean":"2024-09-12T16:17:19.318306+0000","last_became_active":"2024-09-12T16:16:55.202220+0000","last_became_peered":"2024-09-12T16:16:55.202220+0000","last_unstale":"2024-09-12T16:17:19.318306+0000","last_undegraded":"2024-09-12T16:17:19.318306+0000","last_fullsized":"2024-09-12T16:17:19.318306+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:09.502332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049753500000000001,"stat_sum":{"num_bytes":36111974,"num_objects":36,"num_object_clones":8,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":12,"num_read":8051,"num_read_kb":28464,"num_write":321,"num_write_kb":8530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":3518540,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"83'627","reported_seq":7697,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T16:17:19.155250+0000","last_change":"2024-09-12T16:17:07.242339+0000","last_active":"2024-09-12T16:17:19.155250+0000","last_peered":"2024-09-12T16:17:19.155250+0000","last_clean":"2024-09-12T16:17:19.155250+0000","last_became_active":"2024-09-12T16:17:07.241494+0000","last_became_peered":"2024-09-12T16:17:07.241494+0000","last_unstale":"2024-09-12T16:17:19.155250+0000","last_undegraded":"2024-09-12T16:17:19.155250+0000","last_fullsized":"2024-09-12T16:17:19.155250+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":627,"log_dups_size":0,"ondisk_log_size":627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:25.946603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050533499999999999,"stat_sum":{"num_bytes":36295441,"num_objects":59,"num_object_clones":17,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":21,"num_read":8266,"num_read_kb":35572,"num_write":1044,"num_write_kb":17021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":136,"num_bytes_recovered":7863816,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1036148394,"num_objects":1317,"num_object_clones":319,"num_object_copies":2634,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1317,"num_whiteouts":481,"num_read":270259,"num_read_kb":929663,"num_write":15501,"num_write_kb":317733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1843,"num_bytes_recovered":96211470,"num_keys_recovered":249,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":346173440,"data_stored":424351778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6949,"internal_metadata":0},"log_size":12710,"ondisk_log_size":12710,"up":64,"acting":63,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":5,"up_from":71,"seq":304942678021,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93320,"kb_used_data":56424,"kb_used_omap":11,"kb_used_meta":36852,"kb_avail":94278520,"statfs":{"total":96636764160,"available":96541204480,"internally_reserved":0,"allocated":57778176,"data_stored":67880344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11593,"internal_metadata":37737143},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640279,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82684,"kb_used_data":51496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94289156,"statfs":{"total":96636764160,"available":96552095744,"internally_reserved":0,"allocated":52731904,"data_stored":64463038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640280,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108884,"kb_used_data":51332,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94262956,"statfs":{"total":96636764160,"available":96525266944,"internally_reserved":0,"allocated":52563968,"data_stored":68066717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640281,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95544,"kb_used_data":60192,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94276296,"statfs":{"total":96636764160,"available":96538927104,"internally_reserved":0,"allocated":61636608,"data_stored":75889042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640279,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84080,"kb_used_data":52884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94287760,"statfs":{"total":96636764160,"available":96550666240,"internally_reserved":0,"allocated":54153216,"data_stored":60852792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640280,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85080,"kb_used_data":53896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94286760,"statfs":{"total":96636764160,"available":96549642240,"internally_reserved":0,"allocated":55189504,"data_stored":68967343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":71188480,"data_stored":88223843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53493760,"data_stored":60763131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61005824,"data_stored":75825592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":51302400,"data_stored":67380548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":52396032,"data_stored":64682502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":56786944,"data_stored":67476162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6949,"internal_metadata":0}]}} 2024-09-12T16:17:22.787 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-12T16:17:22.787 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T16:17:22.787 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-09-12T16:17:22.787 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 reset_purged_snaps_last 2024-09-12T16:17:22.870 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:22.870 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:22.876 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:22.875+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:22.883 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:17:22.971 INFO:teuthology.orchestra.run.smithi204.stdout:4137 trunc from 0xed2c000 to 0xbaf0400 2024-09-12T16:17:22.976 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:22.976+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:22.994 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 reset_purged_snaps_last 2024-09-12T16:17:23.002 INFO:teuthology.orchestra.run.smithi204.stdout:4138 read 0x8057c00 thru 0x805f4ce (0x78cf bytes) 2024-09-12T16:17:23.021 INFO:teuthology.orchestra.run.smithi204.stdout:4139 write 0xbfcde00 thru 0xbfdd35d (0xf55e bytes) 2024-09-12T16:17:23.021 INFO:teuthology.orchestra.run.smithi204.stdout:4140 write 0x3385800 thru 0x3385d35 (0x536 bytes) 2024-09-12T16:17:23.022 INFO:teuthology.orchestra.run.smithi204.stdout:4141 read 0xac98800 thru 0xaca7266 (0xea67 bytes) 2024-09-12T16:17:23.022 INFO:teuthology.orchestra.run.smithi204.stdout:4143 read 0x1f5d600 thru 0x1f63877 (0x6278 bytes) 2024-09-12T16:17:23.023 INFO:teuthology.orchestra.run.smithi204.stdout:4144 write 0x2b4f600 thru 0x2b5e14d (0xeb4e bytes) 2024-09-12T16:17:23.023 INFO:teuthology.orchestra.run.smithi204.stdout:4145 punch from 0x32ac600 to 0x32af400, (0x2e00 bytes) 2024-09-12T16:17:23.029 INFO:teuthology.orchestra.run.smithi204.stdout:4147 trunc from 0xbfdd400 to 0xb8c6600 2024-09-12T16:17:23.050 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:23.050 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:23.061 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:17:23.068 INFO:teuthology.orchestra.run.smithi204.stdout:4152 trunc from 0xb8c6600 to 0x9d07a00 2024-09-12T16:17:23.098 INFO:teuthology.orchestra.run.smithi204.stdout:4153 write 0x9dec00 thru 0x9eea4e (0xfe4f bytes) 2024-09-12T16:17:23.098 INFO:teuthology.orchestra.run.smithi204.stdout:4154 read 0x5e15800 thru 0x5e1e9b3 (0x91b4 bytes) 2024-09-12T16:17:23.098 INFO:teuthology.orchestra.run.smithi204.stdout:4156 punch from 0x8083200 to 0x808dc00, (0xaa00 bytes) 2024-09-12T16:17:23.102 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:23.101+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:23.103 INFO:teuthology.orchestra.run.smithi204.stdout:4157 write 0x8fd2e00 thru 0x8fde3bb (0xb5bc bytes) 2024-09-12T16:17:23.103 INFO:teuthology.orchestra.run.smithi204.stdout:4158 read 0x6a48600 thru 0x6a5216d (0x9b6e bytes) 2024-09-12T16:17:23.103 INFO:teuthology.orchestra.run.smithi204.stdout:4159 read 0x2b5fa00 thru 0x2b5feca (0x4cb bytes) 2024-09-12T16:17:23.104 INFO:teuthology.orchestra.run.smithi204.stdout:4161 clone 28 order 18 su 16384 sc 13 2024-09-12T16:17:23.179 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:23.177+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:23.191 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 reset_purged_snaps_last 2024-09-12T16:17:23.221 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:23.221 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:23.230 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:17:23.279 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:23.278+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:23.286 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2024-09-12T16:17:23.337 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 reset_purged_snaps_last 2024-09-12T16:17:23.355 INFO:teuthology.orchestra.run.smithi204.stdout:truncating image image_client.0-clone27 from 0x9d07a00 (overlap 0x9d07a00) to 0x0 2024-09-12T16:17:23.380 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:23.379+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:23.409 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:23.409 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:23.425 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:17:23.581 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:23.580+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:23.591 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:23.591 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:23.600 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:17:23.609 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:23.510+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:23.653 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 reset_purged_snaps_last 2024-09-12T16:17:23.683 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:23.681+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:23.724 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:23.724 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:23.733 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:17:23.783 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:23.782+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:23.854 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 reset_purged_snaps_last 2024-09-12T16:17:23.884 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #26, image image_client.0-clone26 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent27 2024-09-12T16:17:23.897 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:23.896+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:23.901 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:23.902 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:23.911 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:17:23.995 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:23.994+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:24.086 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:24.085+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:24.099 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T16:17:24.103 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:24.103 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:24.115 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:17:24.187 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:24.186+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:24.242 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:24.243 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:24.252 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:17:24.259 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:17:24.259 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:17:24.284 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:17:24.285 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:17:24.296 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:24.295+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:24.309 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:17:24.309 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:17:24.335 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:17:24.335 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:17:24.358 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:17:24.358 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:17:24.382 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:24.382 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:24.383 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:17:24.383 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:17:24.383 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:24.383 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:17:24.383 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:17:24.388 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:24.387+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:24.393 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:17:24.490 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:24.488+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:24.550 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:24.551 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:17:24.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:17:24.551 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:17:24.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.551 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:17:24.551 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:17:24.551 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 102.784521955, 2024-09-12T16:17:24.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55645454900000002, 2024-09-12T16:17:24.551 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:24.551 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:24.551 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:24.551 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:24.551 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:17:24.552 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:17:24.552 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1 2024-09-12T16:17:24.552 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.552 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:24.552 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.552 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:24.552 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:17:24.552 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.552 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.552 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.552 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:24.552 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:17:24.552 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.553 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.553 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:24.553 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764440+0000", 2024-09-12T16:17:24.553 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6249999999999999e-06 2024-09-12T16:17:24.553 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.553 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:24.553 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764447+0000", 2024-09-12T16:17:24.553 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4939999999999997e-06 2024-09-12T16:17:24.553 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.553 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:24.554 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764459+0000", 2024-09-12T16:17:24.554 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1517e-05 2024-09-12T16:17:24.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.554 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.554 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:24.554 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764468+0000", 2024-09-12T16:17:24.554 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7690000000000002e-06 2024-09-12T16:17:24.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.554 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.554 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:24.554 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764539+0000", 2024-09-12T16:17:24.554 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1103e-05 2024-09-12T16:17:24.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.554 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.555 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:17:24.555 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764551+0000", 2024-09-12T16:17:24.555 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2687999999999999e-05 2024-09-12T16:17:24.555 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.555 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.555 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:24.555 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319497+0000", 2024-09-12T16:17:24.555 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55494560500000001 2024-09-12T16:17:24.555 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.555 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.555 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:24.555 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319688+0000", 2024-09-12T16:17:24.555 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019105599999999999 2024-09-12T16:17:24.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.556 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.556 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:17:24.556 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319842+0000", 2024-09-12T16:17:24.556 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015377699999999999 2024-09-12T16:17:24.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.556 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.556 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:17:24.556 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320473+0000", 2024-09-12T16:17:24.556 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00063117100000000003 2024-09-12T16:17:24.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.556 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.556 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:24.557 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320825+0000", 2024-09-12T16:17:24.557 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00035202500000000001 2024-09-12T16:17:24.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.557 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.557 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:24.557 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320867+0000", 2024-09-12T16:17:24.558 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2005000000000002e-05 2024-09-12T16:17:24.558 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.558 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.558 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:24.558 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320893+0000", 2024-09-12T16:17:24.558 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5714000000000001e-05 2024-09-12T16:17:24.558 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.558 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:24.558 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.558 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.558 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.558 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14034 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5035008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:24.558 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:17:24.559 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 65.027463721999993, 2024-09-12T16:17:24.559 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053404082999999998, 2024-09-12T16:17:24.559 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:24.559 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:24.559 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:24.559 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:24.559 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:24.559 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:24.559 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14034 2024-09-12T16:17:24.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.559 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:24.559 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.559 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:24.559 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:17:24.560 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.560 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.560 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:24.560 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:17:24.560 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.560 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.560 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:24.560 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521740+0000", 2024-09-12T16:17:24.560 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000243976 2024-09-12T16:17:24.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.560 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.560 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:24.560 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521745+0000", 2024-09-12T16:17:24.561 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1280000000000001e-06 2024-09-12T16:17:24.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.561 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:24.561 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521757+0000", 2024-09-12T16:17:24.561 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2751e-05 2024-09-12T16:17:24.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.561 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:24.561 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521771+0000", 2024-09-12T16:17:24.561 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3328e-05 2024-09-12T16:17:24.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.561 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:24.562 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574710+0000", 2024-09-12T16:17:24.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052939358999999998 2024-09-12T16:17:24.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.562 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.562 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:24.562 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574799+0000", 2024-09-12T16:17:24.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8893000000000004e-05 2024-09-12T16:17:24.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.562 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.562 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:24.562 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574901+0000", 2024-09-12T16:17:24.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101648 2024-09-12T16:17:24.562 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.562 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:24.562 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.563 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.563 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14036 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5043200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:24.563 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:17:24.563 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 65.027004528000006, 2024-09-12T16:17:24.563 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053426247000000003, 2024-09-12T16:17:24.563 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:24.563 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:24.563 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:24.563 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:24.563 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:24.563 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:24.563 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14036 2024-09-12T16:17:24.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.564 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:24.564 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.564 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:24.564 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:17:24.564 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.564 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.564 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:24.564 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:17:24.564 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.564 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.564 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:24.565 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522208+0000", 2024-09-12T16:17:24.565 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025195300000000002 2024-09-12T16:17:24.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.565 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.565 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:24.565 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522211+0000", 2024-09-12T16:17:24.565 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2160000000000002e-06 2024-09-12T16:17:24.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.565 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.565 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:24.565 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522223+0000", 2024-09-12T16:17:24.565 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2044e-05 2024-09-12T16:17:24.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.565 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.566 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:24.566 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522229+0000", 2024-09-12T16:17:24.566 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8850000000000004e-06 2024-09-12T16:17:24.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.566 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:24.566 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575192+0000", 2024-09-12T16:17:24.566 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052963573 2024-09-12T16:17:24.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.566 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:24.566 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575282+0000", 2024-09-12T16:17:24.566 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9666000000000005e-05 2024-09-12T16:17:24.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.567 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:24.567 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575382+0000", 2024-09-12T16:17:24.567 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9909999999999997e-05 2024-09-12T16:17:24.567 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.567 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:24.567 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.567 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.567 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14038 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5051392~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:24.567 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:17:24.567 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 65.026466154999994, 2024-09-12T16:17:24.567 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053395152000000001, 2024-09-12T16:17:24.567 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:24.567 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:24.567 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:24.568 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:24.568 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:24.568 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:24.568 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14038 2024-09-12T16:17:24.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.568 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:24.568 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.568 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:24.568 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:17:24.568 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.568 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.568 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:24.568 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:17:24.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.569 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:24.569 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522601+0000", 2024-09-12T16:17:24.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010702899999999999 2024-09-12T16:17:24.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.569 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:24.569 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522605+0000", 2024-09-12T16:17:24.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2379999999999999e-06 2024-09-12T16:17:24.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.569 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:24.569 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522616+0000", 2024-09-12T16:17:24.570 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1185999999999999e-05 2024-09-12T16:17:24.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.570 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:24.570 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522624+0000", 2024-09-12T16:17:24.570 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1099999999999997e-06 2024-09-12T16:17:24.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.570 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:24.570 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575677+0000", 2024-09-12T16:17:24.570 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053126999999999 2024-09-12T16:17:24.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.570 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:24.570 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575764+0000", 2024-09-12T16:17:24.571 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7250000000000007e-05 2024-09-12T16:17:24.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.571 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.571 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:24.571 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575889+0000", 2024-09-12T16:17:24.571 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012521200000000001 2024-09-12T16:17:24.571 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.571 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:24.571 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.571 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.571 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14039 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5055488~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:24.572 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:17:24.572 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 65.026324743999993, 2024-09-12T16:17:24.572 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053466207000000002, 2024-09-12T16:17:24.572 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:24.572 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:24.572 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:24.572 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:24.572 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:24.572 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:24.572 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14039 2024-09-12T16:17:24.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.572 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:24.572 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.572 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:24.573 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:17:24.573 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.573 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:24.573 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:17:24.573 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.573 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:24.573 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522899+0000", 2024-09-12T16:17:24.573 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026318199999999999 2024-09-12T16:17:24.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:24.574 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522903+0000", 2024-09-12T16:17:24.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.929e-06 2024-09-12T16:17:24.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:24.574 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522913+0000", 2024-09-12T16:17:24.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0162e-05 2024-09-12T16:17:24.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:24.574 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522921+0000", 2024-09-12T16:17:24.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.14e-06 2024-09-12T16:17:24.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.575 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.575 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:24.575 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575922+0000", 2024-09-12T16:17:24.575 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053000712999999998 2024-09-12T16:17:24.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.575 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.575 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:24.575 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576006+0000", 2024-09-12T16:17:24.575 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4161999999999998e-05 2024-09-12T16:17:24.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.575 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.575 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:24.575 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576102+0000", 2024-09-12T16:17:24.575 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5919000000000001e-05 2024-09-12T16:17:24.576 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.576 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:24.576 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.576 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.576 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14040 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5059584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:24.576 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:17:24.576 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 65.026019848999994, 2024-09-12T16:17:24.576 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053413258999999998, 2024-09-12T16:17:24.576 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:24.576 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:24.576 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:24.576 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:24.576 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:24.577 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:24.577 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14040 2024-09-12T16:17:24.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.577 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:24.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.577 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:24.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:17:24.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.577 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:24.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:17:24.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.578 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:24.578 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523059+0000", 2024-09-12T16:17:24.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118466 2024-09-12T16:17:24.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.578 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:24.578 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523062+0000", 2024-09-12T16:17:24.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.971e-06 2024-09-12T16:17:24.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.578 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:24.578 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523069+0000", 2024-09-12T16:17:24.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8279999999999997e-06 2024-09-12T16:17:24.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:24.579 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523073+0000", 2024-09-12T16:17:24.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3019999999999996e-06 2024-09-12T16:17:24.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:24.579 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576155+0000", 2024-09-12T16:17:24.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053081962000000003 2024-09-12T16:17:24.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:24.579 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576249+0000", 2024-09-12T16:17:24.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3914999999999998e-05 2024-09-12T16:17:24.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:24.580 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576354+0000", 2024-09-12T16:17:24.580 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010481500000000001 2024-09-12T16:17:24.580 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.580 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:24.580 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.580 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.580 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14041 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5063680~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:24.580 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:17:24.580 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 65.025869544000003, 2024-09-12T16:17:24.580 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053519111000000001, 2024-09-12T16:17:24.580 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:24.580 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:24.580 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:24.581 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:24.581 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:24.581 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:24.581 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14041 2024-09-12T16:17:24.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.581 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:24.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:24.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:17:24.581 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:24.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:17:24.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:24.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523309+0000", 2024-09-12T16:17:24.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000218712 2024-09-12T16:17:24.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:24.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523313+0000", 2024-09-12T16:17:24.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.151e-06 2024-09-12T16:17:24.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:24.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523320+0000", 2024-09-12T16:17:24.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9789999999999993e-06 2024-09-12T16:17:24.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:24.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523325+0000", 2024-09-12T16:17:24.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:17:24.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:24.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576402+0000", 2024-09-12T16:17:24.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053076811000000002 2024-09-12T16:17:24.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:24.584 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576491+0000", 2024-09-12T16:17:24.584 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8578999999999993e-05 2024-09-12T16:17:24.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.584 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.584 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:24.584 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576610+0000", 2024-09-12T16:17:24.584 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119129 2024-09-12T16:17:24.584 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.584 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:24.584 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.584 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.584 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14042 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5067776~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:24.585 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:17:24.585 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 65.025626110000005, 2024-09-12T16:17:24.585 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053510350999999998, 2024-09-12T16:17:24.585 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:24.585 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:24.585 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:24.585 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:24.585 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:24.585 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:24.585 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14042 2024-09-12T16:17:24.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.586 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:24.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:24.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:17:24.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:24.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:17:24.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:24.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523591+0000", 2024-09-12T16:17:24.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025710300000000001 2024-09-12T16:17:24.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:24.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523594+0000", 2024-09-12T16:17:24.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2229999999999999e-06 2024-09-12T16:17:24.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:24.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523602+0000", 2024-09-12T16:17:24.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6930000000000007e-06 2024-09-12T16:17:24.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.588 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:24.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523607+0000", 2024-09-12T16:17:24.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4789999999999998e-06 2024-09-12T16:17:24.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.588 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:24.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576661+0000", 2024-09-12T16:17:24.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053973999999997 2024-09-12T16:17:24.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.588 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:24.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576745+0000", 2024-09-12T16:17:24.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4660000000000006e-05 2024-09-12T16:17:24.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.589 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:24.589 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576844+0000", 2024-09-12T16:17:24.589 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9219e-05 2024-09-12T16:17:24.589 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.589 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:24.589 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.589 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14043 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5071872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:24.589 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:17:24.589 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 65.025345630999993, 2024-09-12T16:17:24.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053475295999999999, 2024-09-12T16:17:24.590 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:24.590 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:24.590 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:24.590 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:24.590 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:24.590 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:24.590 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14043 2024-09-12T16:17:24.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.590 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:24.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:24.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:17:24.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:24.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:17:24.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:24.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523823+0000", 2024-09-12T16:17:24.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020818900000000001 2024-09-12T16:17:24.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:24.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523826+0000", 2024-09-12T16:17:24.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.405e-06 2024-09-12T16:17:24.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:24.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523834+0000", 2024-09-12T16:17:24.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5499999999999997e-06 2024-09-12T16:17:24.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:24.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523838+0000", 2024-09-12T16:17:24.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.408e-06 2024-09-12T16:17:24.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:24.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576904+0000", 2024-09-12T16:17:24.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053065687 2024-09-12T16:17:24.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.593 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:24.593 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576991+0000", 2024-09-12T16:17:24.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7399999999999997e-05 2024-09-12T16:17:24.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.593 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:24.593 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577090+0000", 2024-09-12T16:17:24.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8657000000000001e-05 2024-09-12T16:17:24.593 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.593 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:24.594 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.594 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.594 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14044 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5075968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:24.594 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:17:24.594 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 65.025114101, 2024-09-12T16:17:24.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053442659000000003, 2024-09-12T16:17:24.594 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:24.594 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:24.594 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:24.594 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:24.594 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:24.594 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:24.594 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14044 2024-09-12T16:17:24.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.595 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:24.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:24.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:17:24.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:24.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:17:24.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:24.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523985+0000", 2024-09-12T16:17:24.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000138522 2024-09-12T16:17:24.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.596 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.596 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:24.596 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523988+0000", 2024-09-12T16:17:24.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.788e-06 2024-09-12T16:17:24.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.596 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.596 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:24.596 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523998+0000", 2024-09-12T16:17:24.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8470000000000008e-06 2024-09-12T16:17:24.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:24.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524010+0000", 2024-09-12T16:17:24.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1348999999999999e-05 2024-09-12T16:17:24.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:24.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577137+0000", 2024-09-12T16:17:24.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053127055999999999 2024-09-12T16:17:24.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:24.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577210+0000", 2024-09-12T16:17:24.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3392000000000005e-05 2024-09-12T16:17:24.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.598 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.598 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:24.598 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577289+0000", 2024-09-12T16:17:24.598 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8704999999999999e-05 2024-09-12T16:17:24.598 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.598 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:24.598 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.598 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.598 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14045 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5080064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:24.598 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:17:24.598 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 65.024935279999994, 2024-09-12T16:17:24.598 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053497514000000003, 2024-09-12T16:17:24.599 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:24.599 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:24.599 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:24.599 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:24.599 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:24.599 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:24.599 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14045 2024-09-12T16:17:24.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.599 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:24.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:24.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:17:24.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:24.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:17:24.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:24.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524311+0000", 2024-09-12T16:17:24.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028626299999999998 2024-09-12T16:17:24.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:24.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524315+0000", 2024-09-12T16:17:24.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0969999999999999e-06 2024-09-12T16:17:24.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:24.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524325+0000", 2024-09-12T16:17:24.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6330000000000008e-06 2024-09-12T16:17:24.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:24.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524332+0000", 2024-09-12T16:17:24.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8700000000000003e-06 2024-09-12T16:17:24.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.602 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:24.602 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577334+0000", 2024-09-12T16:17:24.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053001834999999997 2024-09-12T16:17:24.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.602 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:24.602 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577420+0000", 2024-09-12T16:17:24.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6145999999999998e-05 2024-09-12T16:17:24.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.602 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:24.602 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577522+0000", 2024-09-12T16:17:24.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010267 2024-09-12T16:17:24.602 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.602 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:24.603 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.603 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.603 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14047 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5088256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:24.603 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:17:24.603 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 65.024449554, 2024-09-12T16:17:24.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053433340000000003, 2024-09-12T16:17:24.603 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:24.603 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:24.603 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:24.603 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:24.603 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:24.603 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:24.603 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14047 2024-09-12T16:17:24.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.604 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:24.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.604 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:24.604 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:17:24.604 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.604 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:24.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:17:24.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.605 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:24.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524727+0000", 2024-09-12T16:17:24.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000216126 2024-09-12T16:17:24.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.605 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:24.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524732+0000", 2024-09-12T16:17:24.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1569999999999999e-06 2024-09-12T16:17:24.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:24.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524742+0000", 2024-09-12T16:17:24.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0186999999999999e-05 2024-09-12T16:17:24.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:24.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524750+0000", 2024-09-12T16:17:24.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4279999999999999e-06 2024-09-12T16:17:24.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:24.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577743+0000", 2024-09-12T16:17:24.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052993077 2024-09-12T16:17:24.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:24.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577841+0000", 2024-09-12T16:17:24.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8369000000000006e-05 2024-09-12T16:17:24.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:24.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577944+0000", 2024-09-12T16:17:24.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102996 2024-09-12T16:17:24.607 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.607 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:24.607 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.608 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14048 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5092352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:24.608 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:17:24.608 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 65.024197960999999, 2024-09-12T16:17:24.608 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053397515, 2024-09-12T16:17:24.608 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:24.608 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:24.608 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:24.608 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:24.609 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:24.609 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:24.609 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14048 2024-09-12T16:17:24.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.609 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:24.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:24.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:17:24.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:24.610 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:17:24.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.610 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:24.610 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524957+0000", 2024-09-12T16:17:24.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019516999999999999 2024-09-12T16:17:24.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.610 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:24.610 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524962+0000", 2024-09-12T16:17:24.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7709999999999997e-06 2024-09-12T16:17:24.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.610 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:24.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524973+0000", 2024-09-12T16:17:24.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1031e-05 2024-09-12T16:17:24.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.611 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:24.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524980+0000", 2024-09-12T16:17:24.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6100000000000002e-06 2024-09-12T16:17:24.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.611 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:24.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577977+0000", 2024-09-12T16:17:24.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052997481999999999 2024-09-12T16:17:24.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:24.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578062+0000", 2024-09-12T16:17:24.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4851000000000005e-05 2024-09-12T16:17:24.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:24.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578160+0000", 2024-09-12T16:17:24.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7600000000000001e-05 2024-09-12T16:17:24.612 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.612 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:24.612 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.613 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.613 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14049 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5096448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:24.613 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:17:24.613 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 65.023969332999997, 2024-09-12T16:17:24.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053439792, 2024-09-12T16:17:24.613 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:24.613 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:24.613 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:24.613 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:24.613 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:24.613 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:24.614 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14049 2024-09-12T16:17:24.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.614 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:24.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.614 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:24.614 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:17:24.614 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.614 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:24.614 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:17:24.614 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.615 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:24.615 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525170+0000", 2024-09-12T16:17:24.615 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017958500000000001 2024-09-12T16:17:24.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.615 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.615 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:24.615 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525174+0000", 2024-09-12T16:17:24.615 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0239999999999999e-06 2024-09-12T16:17:24.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.615 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.615 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:24.615 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525184+0000", 2024-09-12T16:17:24.615 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5950000000000005e-06 2024-09-12T16:17:24.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.616 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:24.616 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525191+0000", 2024-09-12T16:17:24.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8329999999999996e-06 2024-09-12T16:17:24.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.616 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:24.616 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578240+0000", 2024-09-12T16:17:24.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053049236 2024-09-12T16:17:24.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.617 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:24.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578333+0000", 2024-09-12T16:17:24.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2806999999999994e-05 2024-09-12T16:17:24.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.617 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:24.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578431+0000", 2024-09-12T16:17:24.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7712000000000002e-05 2024-09-12T16:17:24.617 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.617 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:24.617 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.617 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14055 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5121024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:24.617 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:17:24.618 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 65.022698641999995, 2024-09-12T16:17:24.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053399038000000003, 2024-09-12T16:17:24.618 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:24.618 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:24.618 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:24.618 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:24.618 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:24.618 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:24.618 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14055 2024-09-12T16:17:24.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.618 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:24.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.618 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:24.618 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:17:24.619 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.619 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.619 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:24.619 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:17:24.619 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.619 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.619 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:24.619 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526403+0000", 2024-09-12T16:17:24.619 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141571 2024-09-12T16:17:24.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.619 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.619 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:24.620 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526406+0000", 2024-09-12T16:17:24.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2660000000000002e-06 2024-09-12T16:17:24.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:24.620 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526420+0000", 2024-09-12T16:17:24.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3949e-05 2024-09-12T16:17:24.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:24.620 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526428+0000", 2024-09-12T16:17:24.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4250000000000001e-06 2024-09-12T16:17:24.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.621 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:24.621 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579476+0000", 2024-09-12T16:17:24.621 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053048349000000002 2024-09-12T16:17:24.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.621 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:24.621 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579563+0000", 2024-09-12T16:17:24.621 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6502999999999995e-05 2024-09-12T16:17:24.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.621 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:24.621 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579661+0000", 2024-09-12T16:17:24.622 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7974999999999996e-05 2024-09-12T16:17:24.622 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.622 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:24.622 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.622 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.622 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4806.0:3139 3.1e 3:78d5a095:::rbd_data.11552a37e55b.0000000000000000:head [read 69632~61440] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:17:24.622 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:24.622 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 54.247704392000003, 2024-09-12T16:17:24.622 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057851734000000002, 2024-09-12T16:17:24.622 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:24.622 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:24.623 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:24.623 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:24.623 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4806", 2024-09-12T16:17:24.623 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3959815836", 2024-09-12T16:17:24.623 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 3139 2024-09-12T16:17:24.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.623 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:24.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.623 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:24.623 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:24.623 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.623 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:24.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:24.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.624 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:24.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:24.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4799999999999999e-07 2024-09-12T16:17:24.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.624 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:24.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301258+0000", 2024-09-12T16:17:24.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.844e-06 2024-09-12T16:17:24.625 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.625 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.625 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:24.625 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301267+0000", 2024-09-12T16:17:24.625 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2960000000000004e-06 2024-09-12T16:17:24.625 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.625 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.625 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:24.625 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301276+0000", 2024-09-12T16:17:24.625 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0650000000000005e-06 2024-09-12T16:17:24.625 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.625 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.625 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:24.626 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301871+0000", 2024-09-12T16:17:24.626 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00059423600000000005 2024-09-12T16:17:24.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.626 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.626 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:24.626 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301920+0000", 2024-09-12T16:17:24.626 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9067000000000003e-05 2024-09-12T16:17:24.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.626 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.626 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:24.626 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359108+0000", 2024-09-12T16:17:24.626 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057187877999999998 2024-09-12T16:17:24.626 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.626 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:24.627 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.627 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.627 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:6428 3.14 3:28a44e54:::rbd_header.11552a37e55b:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:17:24.627 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:17:24.627 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 54.247375798, 2024-09-12T16:17:24.627 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057504023000000001, 2024-09-12T16:17:24.627 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:24.627 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:24.627 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:24.627 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:24.627 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:17:24.627 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:17:24.628 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6428 2024-09-12T16:17:24.628 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.628 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:24.628 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.628 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:24.628 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:17:24.628 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.628 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.628 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.628 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:24.628 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:17:24.628 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:24.629 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301585+0000", 2024-09-12T16:17:24.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6300000000000005e-07 2024-09-12T16:17:24.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:24.629 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301588+0000", 2024-09-12T16:17:24.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4149999999999999e-06 2024-09-12T16:17:24.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:24.630 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301597+0000", 2024-09-12T16:17:24.630 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5450000000000003e-06 2024-09-12T16:17:24.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.630 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.630 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:24.630 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301617+0000", 2024-09-12T16:17:24.630 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9837e-05 2024-09-12T16:17:24.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.630 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.630 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:24.630 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301779+0000", 2024-09-12T16:17:24.630 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016186799999999999 2024-09-12T16:17:24.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.631 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.631 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:24.631 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301855+0000", 2024-09-12T16:17:24.631 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5899e-05 2024-09-12T16:17:24.631 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.631 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.631 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:24.631 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359088+0000", 2024-09-12T16:17:24.631 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057233895999999999 2024-09-12T16:17:24.631 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.631 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:24.631 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.631 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.631 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.632 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5223.0:1814 3.f 3:f7b1b1c5:::rbd_object_map.1155a1fd27d2:head [read 0~136] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-12T16:17:24.632 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:17:24.632 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 18.311709734000001, 2024-09-12T16:17:24.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.006378226, 2024-09-12T16:17:24.632 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:24.632 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:24.632 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:24.632 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:24.632 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5223", 2024-09-12T16:17:24.632 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/4066330994", 2024-09-12T16:17:24.632 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1814 2024-09-12T16:17:24.632 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.633 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:24.633 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.633 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:24.633 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:17:24.633 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.633 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.633 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:24.633 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:17:24.633 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.633 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.633 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:24.633 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237252+0000", 2024-09-12T16:17:24.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.344e-06 2024-09-12T16:17:24.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.634 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.634 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:24.634 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237258+0000", 2024-09-12T16:17:24.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1070000000000001e-06 2024-09-12T16:17:24.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.634 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.634 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:24.634 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237270+0000", 2024-09-12T16:17:24.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1758e-05 2024-09-12T16:17:24.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.634 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.634 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:24.635 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237278+0000", 2024-09-12T16:17:24.635 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3219999999999993e-06 2024-09-12T16:17:24.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.635 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.635 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:24.635 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237334+0000", 2024-09-12T16:17:24.635 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6356e-05 2024-09-12T16:17:24.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.635 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.635 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:17:24.635 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237345+0000", 2024-09-12T16:17:24.635 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0433e-05 2024-09-12T16:17:24.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.635 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.636 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:24.636 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243426+0000", 2024-09-12T16:17:24.636 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.00608133 2024-09-12T16:17:24.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.636 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.636 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:24.636 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243534+0000", 2024-09-12T16:17:24.636 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010784 2024-09-12T16:17:24.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.636 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.636 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:24.636 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243629+0000", 2024-09-12T16:17:24.636 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4735999999999996e-05 2024-09-12T16:17:24.636 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.637 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:24.637 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.637 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.637 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.637 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5328.0:2542 3.16 3:6928f3a1:::rbd_object_map.11551722dd77:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:24.637 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:17:24.637 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 12.493364304, 2024-09-12T16:17:24.637 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.054219934999999997, 2024-09-12T16:17:24.637 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:24.637 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:24.637 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:24.637 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:24.638 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5328", 2024-09-12T16:17:24.638 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:24.638 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2542 2024-09-12T16:17:24.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.638 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:24.638 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.638 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:24.638 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:17:24.638 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.638 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.638 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:24.638 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:17:24.638 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.639 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.639 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:24.639 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055597+0000", 2024-09-12T16:17:24.639 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4300000000000001e-07 2024-09-12T16:17:24.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.639 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.639 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:24.639 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055602+0000", 2024-09-12T16:17:24.639 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4269999999999999e-06 2024-09-12T16:17:24.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.639 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.639 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:24.640 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055613+0000", 2024-09-12T16:17:24.640 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0815000000000001e-05 2024-09-12T16:17:24.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.640 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.640 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:24.640 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055621+0000", 2024-09-12T16:17:24.640 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4189999999999996e-06 2024-09-12T16:17:24.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.640 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.640 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:24.640 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102196+0000", 2024-09-12T16:17:24.640 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.046575616 2024-09-12T16:17:24.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.641 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.641 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:24.641 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102258+0000", 2024-09-12T16:17:24.641 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1872000000000007e-05 2024-09-12T16:17:24.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.641 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.641 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T16:17:24.641 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102601+0000", 2024-09-12T16:17:24.641 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034285700000000001 2024-09-12T16:17:24.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.641 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.641 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:24.641 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.104431+0000", 2024-09-12T16:17:24.641 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001830524 2024-09-12T16:17:24.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.642 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.642 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:17:24.642 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109733+0000", 2024-09-12T16:17:24.642 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0053020089999999999 2024-09-12T16:17:24.642 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.642 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.642 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:24.642 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109777+0000", 2024-09-12T16:17:24.642 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3754000000000002e-05 2024-09-12T16:17:24.642 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.642 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.642 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:24.642 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109816+0000", 2024-09-12T16:17:24.643 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8699000000000003e-05 2024-09-12T16:17:24.643 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.643 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:24.643 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.643 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.643 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.643 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5328.0:2543 3.16 3:6928f3a1:::rbd_object_map.11551722dd77:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:24.643 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:17:24.643 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 12.492770325, 2024-09-12T16:17:24.643 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053695720000000002, 2024-09-12T16:17:24.643 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:24.643 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:24.643 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:24.643 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:24.644 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5328", 2024-09-12T16:17:24.644 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:24.644 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2543 2024-09-12T16:17:24.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.644 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:24.644 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.644 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:24.644 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:17:24.644 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.644 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.644 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:24.644 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:17:24.644 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:24.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.645 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.645 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:24.645 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056191+0000", 2024-09-12T16:17:24.645 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.54e-07 2024-09-12T16:17:24.645 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.645 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.645 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:24.645 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056195+0000", 2024-09-12T16:17:24.645 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5460000000000002e-06 2024-09-12T16:17:24.645 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.645 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.645 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:24.645 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056205+0000", 2024-09-12T16:17:24.645 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7350000000000008e-06 2024-09-12T16:17:24.645 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.646 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.646 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:24.646 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056214+0000", 2024-09-12T16:17:24.646 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8089999999999999e-06 2024-09-12T16:17:24.646 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.646 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.646 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:24.646 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103317+0000", 2024-09-12T16:17:24.646 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.047102889000000002 2024-09-12T16:17:24.646 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.646 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.646 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:24.646 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103410+0000", 2024-09-12T16:17:24.647 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3689000000000004e-05 2024-09-12T16:17:24.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.647 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.647 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T16:17:24.647 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103754+0000", 2024-09-12T16:17:24.647 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034344699999999998 2024-09-12T16:17:24.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.647 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.647 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:24.647 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.106487+0000", 2024-09-12T16:17:24.647 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0027330100000000001 2024-09-12T16:17:24.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.647 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.648 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:17:24.648 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109827+0000", 2024-09-12T16:17:24.648 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033406640000000001 2024-09-12T16:17:24.648 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.648 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.648 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:24.648 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109854+0000", 2024-09-12T16:17:24.648 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6866999999999999e-05 2024-09-12T16:17:24.648 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:24.648 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:24.648 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:24.648 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109886+0000", 2024-09-12T16:17:24.648 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1309999999999997e-05 2024-09-12T16:17:24.648 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.649 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:24.649 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.649 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:24.649 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:24.649 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:24.650 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:17:24.651 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:24.649+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:24.699 INFO:teuthology.orchestra.run.smithi204.stdout:4162 read 0x25c0200 thru 0x25c3385 (0x3186 bytes) 2024-09-12T16:17:24.723 INFO:teuthology.orchestra.run.smithi204.stdout:4167 write 0xd99e000 thru 0xd9a01cd (0x21ce bytes) 2024-09-12T16:17:24.723 INFO:teuthology.orchestra.run.smithi204.stdout:4170 punch from 0x79a2200 to 0x79a2400, (0x200 bytes) 2024-09-12T16:17:24.724 INFO:teuthology.orchestra.run.smithi204.stdout:4171 write 0x6b6800 thru 0x6b8875 (0x2076 bytes) 2024-09-12T16:17:24.724 INFO:teuthology.orchestra.run.smithi204.stdout:4172 punch from 0x1db1c00 to 0x1db3c00, (0x2000 bytes) 2024-09-12T16:17:24.725 INFO:teuthology.orchestra.run.smithi204.stdout:4173 write 0x2598a00 thru 0x259cf10 (0x4511 bytes) 2024-09-12T16:17:24.725 INFO:teuthology.orchestra.run.smithi204.stdout:4174 punch from 0x762e00 to 0x763600, (0x800 bytes) 2024-09-12T16:17:24.727 INFO:teuthology.orchestra.run.smithi204.stdout:4175 read 0xca9fe00 thru 0xcaa7d1e (0x7f1f bytes) 2024-09-12T16:17:24.727 INFO:teuthology.orchestra.run.smithi204.stdout:4178 read 0x8fdbc00 thru 0x8fe0c2d (0x502e bytes) 2024-09-12T16:17:24.728 INFO:teuthology.orchestra.run.smithi204.stdout:4180 punch from 0x42b4c00 to 0x42c3800, (0xec00 bytes) 2024-09-12T16:17:24.730 INFO:teuthology.orchestra.run.smithi204.stdout:4182 read 0x6b35400 thru 0x6b37eed (0x2aee bytes) 2024-09-12T16:17:24.730 INFO:teuthology.orchestra.run.smithi204.stdout:4184 punch from 0x9ba3c00 to 0x9bafa00, (0xbe00 bytes) 2024-09-12T16:17:24.751 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:24.750+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:24.759 INFO:teuthology.orchestra.run.smithi204.stdout:4185 write 0xdb84000 thru 0xdb889df (0x49e0 bytes) 2024-09-12T16:17:24.764 INFO:teuthology.orchestra.run.smithi204.stdout:4186 trunc from 0xdb88a00 to 0x8cac000 2024-09-12T16:17:24.820 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:24.820 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:24.820 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:17:24.820 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:24.821 INFO:teuthology.orchestra.run.smithi204.stdout:4187 read 0x8614200 thru 0x8622229 (0xe02a bytes) 2024-09-12T16:17:24.821 INFO:teuthology.orchestra.run.smithi204.stdout:4190 clone 29 order 20 su 16384 sc 10 2024-09-12T16:17:24.830 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:17:24.852 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:24.851+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:24.953 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:24.952+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:24.977 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:24.977 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:24.977 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:17:24.977 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:17:24.978 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:24.985 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:17:25.054 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:25.053+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:25.134 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:25.135 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:17:25.135 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:17:25.135 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:17:25.135 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.135 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5599 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4788224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:25.135 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:17:25.135 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 44.836906933000002, 2024-09-12T16:17:25.135 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061192059, 2024-09-12T16:17:25.135 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.135 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.135 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:25.135 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:25.136 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:25.136 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:25.136 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5599 2024-09-12T16:17:25.136 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.136 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.136 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.136 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.136 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:17:25.136 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.136 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.136 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.136 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.136 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:17:25.136 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.136 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.137 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.137 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.137 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296333+0000", 2024-09-12T16:17:25.137 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6599999999999996e-07 2024-09-12T16:17:25.137 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.137 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.137 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.137 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296335+0000", 2024-09-12T16:17:25.137 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5900000000000002e-06 2024-09-12T16:17:25.137 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.137 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.137 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.137 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296344+0000", 2024-09-12T16:17:25.137 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9539999999999993e-06 2024-09-12T16:17:25.137 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.138 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.138 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.138 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296350+0000", 2024-09-12T16:17:25.138 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5589999999999996e-06 2024-09-12T16:17:25.138 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.138 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.138 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.138 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357307+0000", 2024-09-12T16:17:25.138 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.060957573000000001 2024-09-12T16:17:25.138 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.138 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.138 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.138 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357401+0000", 2024-09-12T16:17:25.139 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3512999999999997e-05 2024-09-12T16:17:25.139 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.139 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.139 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.139 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357524+0000", 2024-09-12T16:17:25.139 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000123304 2024-09-12T16:17:25.139 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.139 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.139 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.139 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.139 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.139 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5611 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4730880~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:25.139 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:17:25.139 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 44.836844489000001, 2024-09-12T16:17:25.140 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061359348000000001, 2024-09-12T16:17:25.140 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.140 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.140 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:25.140 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:25.140 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:25.140 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:25.140 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5611 2024-09-12T16:17:25.140 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.140 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.140 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.140 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.140 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:17:25.140 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.141 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.141 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.141 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.141 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:17:25.141 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.141 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.141 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.141 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.141 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296395+0000", 2024-09-12T16:17:25.141 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4600000000000003e-07 2024-09-12T16:17:25.141 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.141 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.141 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.142 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296399+0000", 2024-09-12T16:17:25.142 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9430000000000002e-06 2024-09-12T16:17:25.142 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.142 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.142 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.142 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296411+0000", 2024-09-12T16:17:25.142 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1755e-05 2024-09-12T16:17:25.142 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.142 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.142 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.142 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296417+0000", 2024-09-12T16:17:25.142 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3790000000000003e-06 2024-09-12T16:17:25.142 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.142 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.142 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.143 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357572+0000", 2024-09-12T16:17:25.143 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061154871 2024-09-12T16:17:25.143 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.143 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.143 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.143 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357663+0000", 2024-09-12T16:17:25.143 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0389999999999993e-05 2024-09-12T16:17:25.143 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.143 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.143 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.143 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357754+0000", 2024-09-12T16:17:25.143 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1063999999999994e-05 2024-09-12T16:17:25.143 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.143 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.143 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.144 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.144 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.144 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5613 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4775936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:25.144 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:25.144 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 44.836803308999997, 2024-09-12T16:17:25.144 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061491777999999997, 2024-09-12T16:17:25.144 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.144 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.144 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:25.144 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:25.144 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:25.144 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:25.144 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5613 2024-09-12T16:17:25.145 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.145 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.145 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.145 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.145 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:25.145 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.145 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.145 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.145 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.145 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:25.145 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.145 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.145 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.145 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.146 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:25.146 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8899999999999999e-07 2024-09-12T16:17:25.146 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.146 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.146 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.146 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296439+0000", 2024-09-12T16:17:25.146 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8439999999999998e-06 2024-09-12T16:17:25.146 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.146 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.146 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.146 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296452+0000", 2024-09-12T16:17:25.146 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2639e-05 2024-09-12T16:17:25.146 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.147 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.147 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.147 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296457+0000", 2024-09-12T16:17:25.147 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5720000000000002e-06 2024-09-12T16:17:25.147 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.147 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.147 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.147 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357773+0000", 2024-09-12T16:17:25.147 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061315500000000002 2024-09-12T16:17:25.147 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.147 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.147 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.147 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357814+0000", 2024-09-12T16:17:25.147 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1448e-05 2024-09-12T16:17:25.148 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.148 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.148 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.148 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357927+0000", 2024-09-12T16:17:25.148 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000113186 2024-09-12T16:17:25.148 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.148 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.148 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.148 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.148 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.148 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5616 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4784128~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:25.149 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:25.149 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 44.836768247000002, 2024-09-12T16:17:25.149 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061725002000000001, 2024-09-12T16:17:25.149 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.149 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.149 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:25.149 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:25.149 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:25.149 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:25.149 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5616 2024-09-12T16:17:25.150 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.150 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.150 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.150 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.150 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:25.150 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.150 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.150 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.150 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.150 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:25.150 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.150 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.151 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.151 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.151 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:25.151 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5900000000000002e-07 2024-09-12T16:17:25.151 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.151 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.151 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.151 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296473+0000", 2024-09-12T16:17:25.151 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3130000000000001e-06 2024-09-12T16:17:25.151 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.151 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.151 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.151 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296481+0000", 2024-09-12T16:17:25.152 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1389999999999998e-06 2024-09-12T16:17:25.152 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.152 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.152 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.152 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296486+0000", 2024-09-12T16:17:25.152 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3310000000000003e-06 2024-09-12T16:17:25.152 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.152 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.152 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.152 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357981+0000", 2024-09-12T16:17:25.152 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061494866000000002 2024-09-12T16:17:25.152 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.152 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.153 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.153 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358082+0000", 2024-09-12T16:17:25.153 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101424 2024-09-12T16:17:25.153 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.153 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.153 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.153 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358196+0000", 2024-09-12T16:17:25.153 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011347 2024-09-12T16:17:25.153 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.153 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.153 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.153 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.153 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.154 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5626 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4739072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:25.154 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:17:25.154 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 44.836690290999996, 2024-09-12T16:17:25.154 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061802430999999998, 2024-09-12T16:17:25.154 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.154 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.154 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:25.154 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:25.154 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:25.154 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:25.154 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5626 2024-09-12T16:17:25.154 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.154 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.155 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.155 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.155 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:17:25.155 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.155 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.155 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.155 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.155 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:17:25.155 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.155 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.155 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.155 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.155 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296550+0000", 2024-09-12T16:17:25.155 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.215e-06 2024-09-12T16:17:25.156 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.156 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.156 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.156 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296555+0000", 2024-09-12T16:17:25.156 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9590000000000003e-06 2024-09-12T16:17:25.156 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.156 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.156 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.156 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296568+0000", 2024-09-12T16:17:25.156 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3338e-05 2024-09-12T16:17:25.156 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.156 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.156 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.156 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296576+0000", 2024-09-12T16:17:25.157 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5510000000000002e-06 2024-09-12T16:17:25.157 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.157 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.157 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.157 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358241+0000", 2024-09-12T16:17:25.157 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.06166576 2024-09-12T16:17:25.157 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.157 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.157 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.157 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358288+0000", 2024-09-12T16:17:25.157 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6097000000000003e-05 2024-09-12T16:17:25.157 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.157 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.157 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.157 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358351+0000", 2024-09-12T16:17:25.158 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3510999999999996e-05 2024-09-12T16:17:25.158 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.158 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.158 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.158 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.158 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.158 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5628 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4792320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:25.158 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:17:25.158 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 44.836647790999997, 2024-09-12T16:17:25.158 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061961161000000001, 2024-09-12T16:17:25.158 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.158 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.158 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:25.158 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:25.158 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:25.159 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:25.159 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5628 2024-09-12T16:17:25.159 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.159 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.159 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.159 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.159 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:17:25.159 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.159 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.159 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.159 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.159 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:17:25.159 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.159 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.160 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.160 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.160 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296592+0000", 2024-09-12T16:17:25.160 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2099999999999996e-07 2024-09-12T16:17:25.160 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.160 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.160 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.160 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296595+0000", 2024-09-12T16:17:25.160 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0429999999999999e-06 2024-09-12T16:17:25.160 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.160 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.160 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.160 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296603+0000", 2024-09-12T16:17:25.160 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9899999999999997e-06 2024-09-12T16:17:25.161 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.161 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.161 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.161 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296609+0000", 2024-09-12T16:17:25.161 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7259999999999999e-06 2024-09-12T16:17:25.161 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.161 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.161 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.161 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358393+0000", 2024-09-12T16:17:25.161 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061784617 2024-09-12T16:17:25.161 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.161 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.161 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.161 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358460+0000", 2024-09-12T16:17:25.162 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7253000000000001e-05 2024-09-12T16:17:25.162 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.162 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.162 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.162 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358552+0000", 2024-09-12T16:17:25.162 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1811000000000006e-05 2024-09-12T16:17:25.162 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.162 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.162 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.162 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.162 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.162 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5638 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4734976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:25.162 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:25.163 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 44.836175240000003, 2024-09-12T16:17:25.163 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061654460000000001, 2024-09-12T16:17:25.163 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.163 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.163 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:25.163 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:25.163 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:25.163 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:25.163 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5638 2024-09-12T16:17:25.163 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.163 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.163 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.163 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.163 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:25.164 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.164 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.164 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.164 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.164 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:25.164 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.164 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.164 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.164 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.164 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:25.164 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.23e-07 2024-09-12T16:17:25.164 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.164 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.164 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.165 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297068+0000", 2024-09-12T16:17:25.165 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0060000000000003e-06 2024-09-12T16:17:25.165 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.165 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.165 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.165 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297080+0000", 2024-09-12T16:17:25.165 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1234e-05 2024-09-12T16:17:25.165 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.165 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.165 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.165 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297095+0000", 2024-09-12T16:17:25.165 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5698000000000001e-05 2024-09-12T16:17:25.165 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.165 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.166 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.166 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358582+0000", 2024-09-12T16:17:25.166 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061486274 2024-09-12T16:17:25.166 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.166 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.166 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.166 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358637+0000", 2024-09-12T16:17:25.166 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5439999999999998e-05 2024-09-12T16:17:25.166 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.166 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.166 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.166 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358718+0000", 2024-09-12T16:17:25.166 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0984999999999998e-05 2024-09-12T16:17:25.166 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.167 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.167 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.167 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.167 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.167 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5640 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4780032~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:25.167 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:17:25.167 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 44.836093519999999, 2024-09-12T16:17:25.167 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061746620000000002, 2024-09-12T16:17:25.167 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.167 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.167 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:25.167 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:25.167 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:25.168 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:25.168 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5640 2024-09-12T16:17:25.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.168 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.168 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.168 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.168 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:17:25.168 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.168 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.168 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.168 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:17:25.168 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.169 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.169 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.169 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.169 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297146+0000", 2024-09-12T16:17:25.169 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3600000000000003e-07 2024-09-12T16:17:25.169 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.169 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.169 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.169 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297150+0000", 2024-09-12T16:17:25.169 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8430000000000003e-06 2024-09-12T16:17:25.169 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.169 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.169 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.170 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297160+0000", 2024-09-12T16:17:25.170 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7229999999999999e-06 2024-09-12T16:17:25.170 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.170 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.170 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.170 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297167+0000", 2024-09-12T16:17:25.170 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0180000000000004e-06 2024-09-12T16:17:25.170 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.170 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.170 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.170 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358750+0000", 2024-09-12T16:17:25.170 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061583104 2024-09-12T16:17:25.170 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.170 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.171 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.171 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358804+0000", 2024-09-12T16:17:25.171 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4277000000000002e-05 2024-09-12T16:17:25.171 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.171 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.171 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.171 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358892+0000", 2024-09-12T16:17:25.171 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7918999999999996e-05 2024-09-12T16:17:25.171 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.171 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.171 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.171 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.171 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.171 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5642 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4788224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:25.171 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:25.171 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 44.836049176000003, 2024-09-12T16:17:25.172 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061860409999999998, 2024-09-12T16:17:25.172 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.172 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.172 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:25.172 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:25.172 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:25.172 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:25.172 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5642 2024-09-12T16:17:25.172 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.172 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.172 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.172 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.172 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:25.172 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.173 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.173 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.173 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.173 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:25.173 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.173 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.173 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.173 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.173 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:25.173 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7999999999999995e-07 2024-09-12T16:17:25.173 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.173 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.173 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.173 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297193+0000", 2024-09-12T16:17:25.173 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8310000000000001e-06 2024-09-12T16:17:25.174 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.174 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.174 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.174 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297204+0000", 2024-09-12T16:17:25.174 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0832999999999999e-05 2024-09-12T16:17:25.174 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.174 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.174 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.174 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297210+0000", 2024-09-12T16:17:25.174 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1770000000000003e-06 2024-09-12T16:17:25.174 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.174 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.174 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.175 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358928+0000", 2024-09-12T16:17:25.175 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061717826000000003 2024-09-12T16:17:25.175 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.175 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.175 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.175 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358977+0000", 2024-09-12T16:17:25.175 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9514000000000001e-05 2024-09-12T16:17:25.175 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.175 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.175 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.175 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359050+0000", 2024-09-12T16:17:25.175 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2649000000000002e-05 2024-09-12T16:17:25.175 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.175 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.176 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.176 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.176 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.176 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5646 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4743168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:25.176 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:25.176 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 44.835869234999997, 2024-09-12T16:17:25.176 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061822122, 2024-09-12T16:17:25.176 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.176 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.176 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:25.176 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:25.176 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:25.176 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:25.176 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5646 2024-09-12T16:17:25.177 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.177 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.177 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.177 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.177 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:25.177 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.177 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.177 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.177 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.177 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:25.177 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.177 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.177 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.177 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.178 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:25.178 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3200000000000004e-07 2024-09-12T16:17:25.178 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.178 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.178 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.178 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297374+0000", 2024-09-12T16:17:25.178 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8240000000000001e-06 2024-09-12T16:17:25.178 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.178 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.178 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.178 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297384+0000", 2024-09-12T16:17:25.178 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5710000000000004e-06 2024-09-12T16:17:25.178 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.178 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.179 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.179 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297390+0000", 2024-09-12T16:17:25.179 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5130000000000002e-06 2024-09-12T16:17:25.179 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.179 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.179 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.179 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359080+0000", 2024-09-12T16:17:25.179 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061689569999999999 2024-09-12T16:17:25.179 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.179 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.179 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.179 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359134+0000", 2024-09-12T16:17:25.179 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3838999999999997e-05 2024-09-12T16:17:25.180 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.180 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.180 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.180 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359192+0000", 2024-09-12T16:17:25.180 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8072999999999998e-05 2024-09-12T16:17:25.180 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.180 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.180 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.180 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.180 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.180 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5647 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4751360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:25.180 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:17:25.180 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 44.835832549999999, 2024-09-12T16:17:25.180 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061927569000000002, 2024-09-12T16:17:25.180 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.181 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.181 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:25.181 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:25.181 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:25.181 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:25.181 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5647 2024-09-12T16:17:25.181 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.181 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.181 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.181 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.181 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:17:25.181 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.181 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.181 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.182 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.182 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:17:25.182 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.182 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.182 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.182 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297407+0000", 2024-09-12T16:17:25.182 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.46e-07 2024-09-12T16:17:25.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.182 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.182 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.182 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297409+0000", 2024-09-12T16:17:25.182 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.469e-06 2024-09-12T16:17:25.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.183 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.183 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.183 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297415+0000", 2024-09-12T16:17:25.183 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9259999999999997e-06 2024-09-12T16:17:25.183 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.183 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.183 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.183 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297419+0000", 2024-09-12T16:17:25.183 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3840000000000001e-06 2024-09-12T16:17:25.183 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.183 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.183 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.183 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359224+0000", 2024-09-12T16:17:25.183 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061805367999999999 2024-09-12T16:17:25.183 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.184 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.184 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.184 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359275+0000", 2024-09-12T16:17:25.184 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1338000000000002e-05 2024-09-12T16:17:25.184 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.184 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.184 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.184 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359334+0000", 2024-09-12T16:17:25.184 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8638000000000003e-05 2024-09-12T16:17:25.184 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.184 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.184 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.184 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.184 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.185 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5649 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4796416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:25.185 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:17:25.185 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 44.835777690999997, 2024-09-12T16:17:25.185 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.062018578999999997, 2024-09-12T16:17:25.185 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.185 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.185 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:25.185 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:25.185 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:25.185 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:25.185 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5649 2024-09-12T16:17:25.185 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.185 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.185 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.186 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.186 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:17:25.186 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.186 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.186 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.186 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:17:25.186 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.186 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.186 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.186 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297462+0000", 2024-09-12T16:17:25.186 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2399999999999998e-07 2024-09-12T16:17:25.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.186 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.187 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.187 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297465+0000", 2024-09-12T16:17:25.187 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.371e-06 2024-09-12T16:17:25.187 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.187 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.187 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.187 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297473+0000", 2024-09-12T16:17:25.187 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4699999999999996e-06 2024-09-12T16:17:25.187 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.187 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.187 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.187 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297478+0000", 2024-09-12T16:17:25.187 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2780000000000001e-06 2024-09-12T16:17:25.187 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.188 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.188 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.188 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359368+0000", 2024-09-12T16:17:25.188 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061889758000000003 2024-09-12T16:17:25.188 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.188 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.188 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.188 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359420+0000", 2024-09-12T16:17:25.188 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2574999999999997e-05 2024-09-12T16:17:25.188 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.188 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.188 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.188 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359480+0000", 2024-09-12T16:17:25.189 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9503000000000003e-05 2024-09-12T16:17:25.189 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.189 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.189 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.189 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.189 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.189 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5674 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4739072~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:25.189 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:17:25.189 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 44.835373922999999, 2024-09-12T16:17:25.189 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061762989999999997, 2024-09-12T16:17:25.189 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.189 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.189 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:25.189 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:25.190 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:25.190 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:25.190 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5674 2024-09-12T16:17:25.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.190 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.190 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.190 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.190 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:17:25.190 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.190 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.190 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.190 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:17:25.191 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.191 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.191 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.191 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.191 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297866+0000", 2024-09-12T16:17:25.191 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1900000000000001e-07 2024-09-12T16:17:25.191 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.191 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.191 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.191 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297870+0000", 2024-09-12T16:17:25.191 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3560000000000003e-06 2024-09-12T16:17:25.191 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.191 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.191 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.192 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297888+0000", 2024-09-12T16:17:25.192 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8088999999999999e-05 2024-09-12T16:17:25.192 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.192 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.192 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.192 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297904+0000", 2024-09-12T16:17:25.192 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5971e-05 2024-09-12T16:17:25.192 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.192 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.192 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.192 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359510+0000", 2024-09-12T16:17:25.192 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061605634999999999 2024-09-12T16:17:25.192 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.193 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.193 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.193 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359554+0000", 2024-09-12T16:17:25.193 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4024999999999999e-05 2024-09-12T16:17:25.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.193 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.193 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.193 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359628+0000", 2024-09-12T16:17:25.193 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4095000000000001e-05 2024-09-12T16:17:25.193 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.193 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.193 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.194 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.194 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5676 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4792320~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:25.194 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:17:25.194 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 44.835172843000002, 2024-09-12T16:17:25.194 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061720143999999998, 2024-09-12T16:17:25.194 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.194 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.194 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:25.194 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:25.194 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:25.194 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:25.194 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5676 2024-09-12T16:17:25.194 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.194 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.194 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:17:25.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:17:25.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298067+0000", 2024-09-12T16:17:25.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8199999999999999e-07 2024-09-12T16:17:25.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.196 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.196 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298070+0000", 2024-09-12T16:17:25.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.743e-06 2024-09-12T16:17:25.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.196 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.196 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298080+0000", 2024-09-12T16:17:25.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4059999999999994e-06 2024-09-12T16:17:25.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.196 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.196 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298088+0000", 2024-09-12T16:17:25.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0779999999999996e-06 2024-09-12T16:17:25.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.197 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.197 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.197 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359659+0000", 2024-09-12T16:17:25.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061570688999999998 2024-09-12T16:17:25.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.197 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.197 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.197 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359713+0000", 2024-09-12T16:17:25.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3939e-05 2024-09-12T16:17:25.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.197 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.197 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.197 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359786+0000", 2024-09-12T16:17:25.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3607000000000002e-05 2024-09-12T16:17:25.198 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.198 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.198 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.198 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.198 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5684 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4747264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:25.198 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:17:25.198 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 44.834705550999999, 2024-09-12T16:17:25.198 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061394799, 2024-09-12T16:17:25.198 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.198 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.198 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:25.198 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:25.198 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:25.198 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:25.199 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5684 2024-09-12T16:17:25.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.199 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.199 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:17:25.199 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.199 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:17:25.199 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298534+0000", 2024-09-12T16:17:25.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4399999999999999e-07 2024-09-12T16:17:25.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298539+0000", 2024-09-12T16:17:25.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5360000000000003e-06 2024-09-12T16:17:25.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298550+0000", 2024-09-12T16:17:25.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1499e-05 2024-09-12T16:17:25.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.201 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298558+0000", 2024-09-12T16:17:25.201 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3000000000000004e-06 2024-09-12T16:17:25.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.201 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.201 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.201 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359815+0000", 2024-09-12T16:17:25.201 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061257952999999997 2024-09-12T16:17:25.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.201 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.201 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.201 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359868+0000", 2024-09-12T16:17:25.201 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2317000000000001e-05 2024-09-12T16:17:25.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.201 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.201 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.202 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359928+0000", 2024-09-12T16:17:25.202 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0350000000000003e-05 2024-09-12T16:17:25.202 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.202 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.202 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.202 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.202 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.202 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5686 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4755456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:25.202 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:17:25.202 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 44.834538127000002, 2024-09-12T16:17:25.202 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061355082999999998, 2024-09-12T16:17:25.202 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.202 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.202 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:25.202 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:25.202 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:25.203 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:25.203 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5686 2024-09-12T16:17:25.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.203 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:17:25.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:17:25.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.204 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298702+0000", 2024-09-12T16:17:25.204 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2399999999999997e-07 2024-09-12T16:17:25.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.204 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.204 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.204 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298706+0000", 2024-09-12T16:17:25.204 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5700000000000003e-06 2024-09-12T16:17:25.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.204 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.204 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.204 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298718+0000", 2024-09-12T16:17:25.204 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1457999999999999e-05 2024-09-12T16:17:25.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.204 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.205 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.205 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298732+0000", 2024-09-12T16:17:25.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.452e-05 2024-09-12T16:17:25.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.205 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.205 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359956+0000", 2024-09-12T16:17:25.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061223626000000003 2024-09-12T16:17:25.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.205 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.205 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360000+0000", 2024-09-12T16:17:25.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3922999999999999e-05 2024-09-12T16:17:25.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.205 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.206 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360056+0000", 2024-09-12T16:17:25.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6162000000000002e-05 2024-09-12T16:17:25.206 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.206 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.206 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.206 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.206 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5688 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4800512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:25.206 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:17:25.206 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 44.834315074000003, 2024-09-12T16:17:25.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061270514999999998, 2024-09-12T16:17:25.206 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.206 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.206 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:25.207 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:25.207 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:25.207 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:25.207 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5688 2024-09-12T16:17:25.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.207 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.207 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.207 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:17:25.207 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.207 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.208 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:17:25.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.208 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.208 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.208 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298925+0000", 2024-09-12T16:17:25.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4e-07 2024-09-12T16:17:25.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.208 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.208 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.208 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298929+0000", 2024-09-12T16:17:25.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9890000000000003e-06 2024-09-12T16:17:25.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.208 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298936+0000", 2024-09-12T16:17:25.209 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.52e-06 2024-09-12T16:17:25.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298941+0000", 2024-09-12T16:17:25.209 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4800000000000003e-06 2024-09-12T16:17:25.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360087+0000", 2024-09-12T16:17:25.209 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061146143 2024-09-12T16:17:25.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.210 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.210 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.210 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360137+0000", 2024-09-12T16:17:25.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0584000000000002e-05 2024-09-12T16:17:25.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.210 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.210 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.210 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360194+0000", 2024-09-12T16:17:25.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6858999999999999e-05 2024-09-12T16:17:25.210 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.210 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.210 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.210 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.211 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5693 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4751360~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:25.211 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:17:25.211 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 44.833893437, 2024-09-12T16:17:25.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061139444000000001, 2024-09-12T16:17:25.211 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.211 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.211 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:25.211 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:25.211 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:25.211 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:25.211 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5693 2024-09-12T16:17:25.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.211 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.211 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:17:25.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:17:25.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299346+0000", 2024-09-12T16:17:25.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2300000000000001e-07 2024-09-12T16:17:25.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.213 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.213 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299349+0000", 2024-09-12T16:17:25.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5270000000000001e-06 2024-09-12T16:17:25.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.213 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.213 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299358+0000", 2024-09-12T16:17:25.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7030000000000001e-06 2024-09-12T16:17:25.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.213 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.213 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299364+0000", 2024-09-12T16:17:25.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7239999999999997e-06 2024-09-12T16:17:25.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.214 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360369+0000", 2024-09-12T16:17:25.214 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061004713000000002 2024-09-12T16:17:25.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.214 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.214 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360415+0000", 2024-09-12T16:17:25.214 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5926e-05 2024-09-12T16:17:25.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.214 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.214 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360485+0000", 2024-09-12T16:17:25.214 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0327999999999995e-05 2024-09-12T16:17:25.214 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.214 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.215 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.215 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5694 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4796416~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:25.215 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:17:25.215 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 44.833864407999997, 2024-09-12T16:17:25.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061258034000000003, 2024-09-12T16:17:25.215 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.215 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.215 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:25.215 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:25.215 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:25.215 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:25.215 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5694 2024-09-12T16:17:25.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.216 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.216 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.216 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:17:25.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.216 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.216 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:17:25.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.216 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301884+0000", 2024-09-12T16:17:25.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025090379999999999 2024-09-12T16:17:25.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301889+0000", 2024-09-12T16:17:25.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5879999999999997e-06 2024-09-12T16:17:25.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301901+0000", 2024-09-12T16:17:25.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1466e-05 2024-09-12T16:17:25.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301908+0000", 2024-09-12T16:17:25.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1999999999999997e-06 2024-09-12T16:17:25.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360513+0000", 2024-09-12T16:17:25.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.058605023999999999 2024-09-12T16:17:25.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360562+0000", 2024-09-12T16:17:25.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9546000000000003e-05 2024-09-12T16:17:25.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360633+0000", 2024-09-12T16:17:25.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0172000000000005e-05 2024-09-12T16:17:25.219 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.219 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.219 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.219 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5759 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4767744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:25.219 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:17:25.219 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 44.831070873999998, 2024-09-12T16:17:25.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061058604000000002, 2024-09-12T16:17:25.219 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.220 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.220 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:25.220 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:25.220 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:25.220 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:25.220 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5759 2024-09-12T16:17:25.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.220 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.220 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.220 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.220 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:17:25.220 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.221 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.221 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.221 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:17:25.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.221 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.221 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.221 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302548+0000", 2024-09-12T16:17:25.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00038011000000000002 2024-09-12T16:17:25.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.221 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.221 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.221 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302553+0000", 2024-09-12T16:17:25.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1830000000000002e-06 2024-09-12T16:17:25.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.222 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302564+0000", 2024-09-12T16:17:25.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1011e-05 2024-09-12T16:17:25.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.222 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302572+0000", 2024-09-12T16:17:25.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9009999999999994e-06 2024-09-12T16:17:25.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.222 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363102+0000", 2024-09-12T16:17:25.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.060529782999999997 2024-09-12T16:17:25.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363149+0000", 2024-09-12T16:17:25.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7321000000000003e-05 2024-09-12T16:17:25.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363227+0000", 2024-09-12T16:17:25.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7294999999999998e-05 2024-09-12T16:17:25.223 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.223 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.223 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.223 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.223 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.223 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:25.225 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:17:25.225 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:25.224+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:25.303 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T16:17:25.349 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:25.348+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:25.373 INFO:teuthology.orchestra.run.smithi204.stdout:flattening image image_client.0-clone28 2024-09-12T16:17:25.384 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:25.384 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:25.385 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:17:25.385 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:25.395 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:17:25.438 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:25.437+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:25.527 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:25.526+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:25.556 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:25.557 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:25.557 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:17:25.557 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:17:25.557 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:25.566 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:17:25.628 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:25.627+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:25.729 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:25.728+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:25.762 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:25.762 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:17:25.763 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:17:25.763 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:17:25.763 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.763 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.17 73/72 [PushOp(3:e9340267:::rbd_data.1155525b14e3.0000000000000031:f, version: 50'357, data_included: [0~4096,20480~4096,40960~8192,65536~4096,81920~8192,110592~4096,126976~8192,151552~4096,172032~8192,196608~4096,212992~8192,241664~4096,258048~8192,282624~4096,303104~8192,327680~4096,344064~8192,372736~4096,389120~8192,413696~4096,434176~8192,458752~4096,475136~8192,503808~4096,520192~8192,544768~4096,565248~8192,589824~4096,606208~8192,634880~4096,651264~8192,675840~4096,696320~8192,720896~4096,737280~8192,765952~4096,782336~8192,806912~4096,827392~8192,851968~4096,868352~8192,897024~4096,913408~8192,937984~4096,958464~8192,983040~4096,999424~8192,1028096~4096,1044480~4096], data_size: 294912, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:e9340267:::rbd_data.1155525b14e3.0000000000000031:f@50'357, size: 1048576, copy_subset: [(0, 1048576)], clone_subset: {}, snapset: f=[]:{f: [f]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T16:17:25.763 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.067448+0000", 2024-09-12T16:17:25.763 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 19.693325133999998, 2024-09-12T16:17:25.763 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003036721, 2024-09-12T16:17:25.763 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.763 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.763 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:25.763 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.763 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.763 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.764 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067448+0000", 2024-09-12T16:17:25.764 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.764 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.764 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.764 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.764 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067448+0000", 2024-09-12T16:17:25.764 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.764 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.764 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.764 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.764 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067449+0000", 2024-09-12T16:17:25.764 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2200000000000004e-07 2024-09-12T16:17:25.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.765 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.765 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.765 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067703+0000", 2024-09-12T16:17:25.765 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025377199999999998 2024-09-12T16:17:25.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.765 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.765 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.765 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067723+0000", 2024-09-12T16:17:25.765 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.986e-05 2024-09-12T16:17:25.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.765 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.765 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067743+0000", 2024-09-12T16:17:25.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9942e-05 2024-09-12T16:17:25.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.766 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067860+0000", 2024-09-12T16:17:25.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000116959 2024-09-12T16:17:25.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.766 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067872+0000", 2024-09-12T16:17:25.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2928000000000001e-05 2024-09-12T16:17:25.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.767 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.767 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.070485+0000", 2024-09-12T16:17:25.767 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0026127379999999999 2024-09-12T16:17:25.767 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.767 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.767 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.767 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.767 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.767 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.1d 73/72 [PushOp(3:b81abef1:::rbd_data.1155525b14e3.0000000000000032:f, version: 50'956, data_included: [0~4096,20480~4096,40960~4096,65536~4096,81920~8192,126976~8192,151552~4096,172032~4096,196608~4096,212992~8192,258048~8192,282624~4096,303104~4096,327680~4096,344064~8192,389120~8192,413696~4096,434176~4096,458752~4096,475136~8192,520192~8192,544768~4096,565248~4096,589824~4096,606208~8192,651264~8192,675840~4096,696320~4096,720896~4096,737280~8192,782336~8192,806912~4096,827392~4096,851968~4096,868352~8192,913408~8192,937984~4096,958464~4096,983040~4096,999424~8192,1044480~4096], data_size: 229376, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:b81abef1:::rbd_data.1155525b14e3.0000000000000032:f@50'956, size: 1048576, copy_subset: [(0, 1048576)], clone_subset: {}, snapset: f=[]:{f: [f]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T16:17:25.767 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.169142+0000", 2024-09-12T16:17:25.767 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 19.591631829000001, 2024-09-12T16:17:25.767 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025628640000000002, 2024-09-12T16:17:25.767 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.767 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.768 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:25.768 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.768 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.768 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.768 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.169142+0000", 2024-09-12T16:17:25.768 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.768 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.768 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.768 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.768 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.169142+0000", 2024-09-12T16:17:25.768 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.768 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.768 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.768 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.769 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.169142+0000", 2024-09-12T16:17:25.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1799999999999995e-07 2024-09-12T16:17:25.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.769 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.769 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.169263+0000", 2024-09-12T16:17:25.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000120897 2024-09-12T16:17:25.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.769 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.769 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.169292+0000", 2024-09-12T16:17:25.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8357999999999999e-05 2024-09-12T16:17:25.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.770 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.770 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.169312+0000", 2024-09-12T16:17:25.770 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0239999999999999e-05 2024-09-12T16:17:25.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.770 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.770 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.169425+0000", 2024-09-12T16:17:25.770 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000113336 2024-09-12T16:17:25.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.770 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.770 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.169438+0000", 2024-09-12T16:17:25.770 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3185e-05 2024-09-12T16:17:25.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.771 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.771 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.771 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.171705+0000", 2024-09-12T16:17:25.771 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0022662300000000002 2024-09-12T16:17:25.771 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.771 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.771 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.771 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.771 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.16 74/72 [PushOp(3:68db2424:::rbd_data.1155525b14e3.000000000000002a:f, version: 50'736, data_included: [0~352256,368640~4096,385024~12288,413696~4096,430080~8192,458752~4096,471040~12288,499712~4096,516096~12288,544768~4096,561152~8192,589824~4096,602112~12288,630784~4096,647168~12288,675840~4096,692224~8192,720896~4096,733184~12288,761856~4096,778240~12288,806912~4096,823296~8192,851968~4096,868352~8192,892928~4096,913408~8192,937984~4096,958464~4096,983040~4096,999424~8192,1024000~4096,1044480~4096], data_size: 569344, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:68db2424:::rbd_data.1155525b14e3.000000000000002a:f@50'736, size: 1048576, copy_subset: [(0, 1048576)], clone_subset: {}, snapset: f=[]:{f: [f]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T16:17:25.771 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.264309+0000", 2024-09-12T16:17:25.771 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 19.496464209999999, 2024-09-12T16:17:25.771 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025728819999999999, 2024-09-12T16:17:25.771 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.772 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.772 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:25.772 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.772 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.772 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.264309+0000", 2024-09-12T16:17:25.772 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.772 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.772 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.264309+0000", 2024-09-12T16:17:25.772 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.773 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.773 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.773 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.773 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.264310+0000", 2024-09-12T16:17:25.773 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5499999999999998e-07 2024-09-12T16:17:25.773 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.773 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.773 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.773 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.264565+0000", 2024-09-12T16:17:25.773 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025476399999999999 2024-09-12T16:17:25.773 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.773 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.773 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.773 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.264584+0000", 2024-09-12T16:17:25.774 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9349999999999999e-05 2024-09-12T16:17:25.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.774 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.774 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.774 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.264602+0000", 2024-09-12T16:17:25.774 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8173e-05 2024-09-12T16:17:25.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.774 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.774 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.774 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.264690+0000", 2024-09-12T16:17:25.774 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7403000000000003e-05 2024-09-12T16:17:25.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.774 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.774 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.775 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.264701+0000", 2024-09-12T16:17:25.775 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1566000000000001e-05 2024-09-12T16:17:25.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.775 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.775 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.266882+0000", 2024-09-12T16:17:25.775 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0021810710000000001 2024-09-12T16:17:25.775 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.775 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.775 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.775 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5328.0:2499 3.16 e78/75 3:6928f3a1:::rbd_object_map.11551722dd77:head v 78'1022, mlcod=78'1018)", 2024-09-12T16:17:25.775 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.081730+0000", 2024-09-12T16:17:25.775 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 13.679043173, 2024-09-12T16:17:25.776 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0022482349999999999, 2024-09-12T16:17:25.776 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.776 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.776 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:25.776 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.776 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.776 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.081730+0000", 2024-09-12T16:17:25.776 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.776 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.777 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.081730+0000", 2024-09-12T16:17:25.777 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.777 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.777 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.777 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.081731+0000", 2024-09-12T16:17:25.777 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8999999999999996e-07 2024-09-12T16:17:25.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.777 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.777 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.777 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.081736+0000", 2024-09-12T16:17:25.777 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1379999999999998e-06 2024-09-12T16:17:25.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.778 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.778 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.081746+0000", 2024-09-12T16:17:25.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6320000000000003e-06 2024-09-12T16:17:25.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.778 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.778 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.081752+0000", 2024-09-12T16:17:25.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7989999999999999e-06 2024-09-12T16:17:25.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.778 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.778 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.082208+0000", 2024-09-12T16:17:25.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00045616 2024-09-12T16:17:25.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.082227+0000", 2024-09-12T16:17:25.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8768000000000001e-05 2024-09-12T16:17:25.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:25.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.083939+0000", 2024-09-12T16:17:25.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001712646 2024-09-12T16:17:25.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.083979+0000", 2024-09-12T16:17:25.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9502000000000002e-05 2024-09-12T16:17:25.779 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.779 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.780 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.780 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.780 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5328.0:2532 3.16 e78/75 3:6928f3a1:::rbd_object_map.11551722dd77:head v 78'1032, mlcod=78'1029)", 2024-09-12T16:17:25.780 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.093926+0000", 2024-09-12T16:17:25.780 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 13.666847965000001, 2024-09-12T16:17:25.780 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0024101140000000001, 2024-09-12T16:17:25.780 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.780 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.780 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:25.780 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.780 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.781 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.781 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.093926+0000", 2024-09-12T16:17:25.781 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.781 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.781 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.781 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.093926+0000", 2024-09-12T16:17:25.781 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.781 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.781 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.781 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.093926+0000", 2024-09-12T16:17:25.781 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6600000000000005e-07 2024-09-12T16:17:25.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.782 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.782 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.782 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.093932+0000", 2024-09-12T16:17:25.782 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3650000000000003e-06 2024-09-12T16:17:25.782 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.782 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.782 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.782 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.093945+0000", 2024-09-12T16:17:25.782 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2999999999999999e-05 2024-09-12T16:17:25.782 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.782 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.782 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.782 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.093952+0000", 2024-09-12T16:17:25.782 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7479999999999996e-06 2024-09-12T16:17:25.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.783 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.783 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.094022+0000", 2024-09-12T16:17:25.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0555999999999993e-05 2024-09-12T16:17:25.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.783 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.783 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.094040+0000", 2024-09-12T16:17:25.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7377999999999999e-05 2024-09-12T16:17:25.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.783 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:25.783 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.096298+0000", 2024-09-12T16:17:25.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0022585690000000002 2024-09-12T16:17:25.784 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.784 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.784 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.784 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.096336+0000", 2024-09-12T16:17:25.784 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7632000000000002e-05 2024-09-12T16:17:25.784 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.784 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.784 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.784 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.784 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.784 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5120.0:3941 3.17 e80/74 3:eff97428:::rbd_data.1155a3b3a26e.0000000000000060:head v 80'442, mlcod=79'439)", 2024-09-12T16:17:25.784 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:17:25.784 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 9.4049846529999996, 2024-09-12T16:17:25.784 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0035981759999999998, 2024-09-12T16:17:25.785 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.785 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.785 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:25.785 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.785 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.785 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.785 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:17:25.785 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.785 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.785 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.785 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:17:25.785 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.786 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.786 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.786 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:17:25.786 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2e-07 2024-09-12T16:17:25.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.786 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.786 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.786 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355794+0000", 2024-09-12T16:17:25.786 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.865e-06 2024-09-12T16:17:25.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.786 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.786 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.786 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355956+0000", 2024-09-12T16:17:25.787 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016131699999999999 2024-09-12T16:17:25.787 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.787 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.787 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.787 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355964+0000", 2024-09-12T16:17:25.787 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7960000000000001e-06 2024-09-12T16:17:25.787 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.787 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.787 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.787 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.356320+0000", 2024-09-12T16:17:25.787 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000355612 2024-09-12T16:17:25.787 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.787 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.787 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.788 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.356337+0000", 2024-09-12T16:17:25.788 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6643e-05 2024-09-12T16:17:25.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.788 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.788 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:25.788 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.359340+0000", 2024-09-12T16:17:25.788 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003003618 2024-09-12T16:17:25.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.788 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.788 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.788 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.359387+0000", 2024-09-12T16:17:25.788 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6904999999999999e-05 2024-09-12T16:17:25.789 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.789 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.789 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.789 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.789 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.789 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2018 3.16 e88/75 3:6a96e931:::rbd_data.11558d85ce23.0000000000000000:head v 88'1245, mlcod=87'1243)", 2024-09-12T16:17:25.789 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.415858+0000", 2024-09-12T16:17:25.789 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.344915254, 2024-09-12T16:17:25.789 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00244042, 2024-09-12T16:17:25.789 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.789 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.789 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:25.789 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.789 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.790 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.790 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.415858+0000", 2024-09-12T16:17:25.790 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.790 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.790 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.790 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.790 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.415858+0000", 2024-09-12T16:17:25.790 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.790 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.790 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.790 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.790 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.415859+0000", 2024-09-12T16:17:25.790 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0049999999999999e-06 2024-09-12T16:17:25.790 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.791 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.791 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.791 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.416017+0000", 2024-09-12T16:17:25.791 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015740200000000001 2024-09-12T16:17:25.791 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.791 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.791 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.791 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.416028+0000", 2024-09-12T16:17:25.791 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0769e-05 2024-09-12T16:17:25.791 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.791 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.791 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.791 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.416034+0000", 2024-09-12T16:17:25.792 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6889999999999998e-06 2024-09-12T16:17:25.792 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.792 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.792 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.792 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.416095+0000", 2024-09-12T16:17:25.792 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0618000000000001e-05 2024-09-12T16:17:25.792 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.792 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.792 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.792 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.416113+0000", 2024-09-12T16:17:25.793 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8417e-05 2024-09-12T16:17:25.793 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.793 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.793 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:25.793 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.418212+0000", 2024-09-12T16:17:25.793 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0020988230000000001 2024-09-12T16:17:25.793 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.793 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.793 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.793 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.418299+0000", 2024-09-12T16:17:25.793 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6697e-05 2024-09-12T16:17:25.793 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.794 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.794 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.794 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.794 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.794 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2020 3.e e88/74 3:71a389a9:::rbd_data.11558d85ce23.0000000000000001:head v 88'325, mlcod=87'323)", 2024-09-12T16:17:25.794 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.416373+0000", 2024-09-12T16:17:25.794 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.34440037000000001, 2024-09-12T16:17:25.794 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0023934329999999999, 2024-09-12T16:17:25.794 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.794 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.794 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:25.794 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.794 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.795 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.795 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.416373+0000", 2024-09-12T16:17:25.795 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.795 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.795 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.795 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.795 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.416373+0000", 2024-09-12T16:17:25.795 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.795 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.795 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.795 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.795 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.416374+0000", 2024-09-12T16:17:25.796 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9299999999999997e-07 2024-09-12T16:17:25.796 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.796 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.796 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.796 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.416543+0000", 2024-09-12T16:17:25.796 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016859700000000001 2024-09-12T16:17:25.796 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.796 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.796 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.796 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.416556+0000", 2024-09-12T16:17:25.796 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3332e-05 2024-09-12T16:17:25.796 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.797 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.797 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.797 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.416563+0000", 2024-09-12T16:17:25.797 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9870000000000002e-06 2024-09-12T16:17:25.797 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.797 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.797 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.797 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.416627+0000", 2024-09-12T16:17:25.797 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3817000000000002e-05 2024-09-12T16:17:25.797 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.797 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.797 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.797 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.416649+0000", 2024-09-12T16:17:25.797 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2478999999999999e-05 2024-09-12T16:17:25.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.798 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.798 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:25.798 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.418693+0000", 2024-09-12T16:17:25.798 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0020436529999999999 2024-09-12T16:17:25.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.798 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.798 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.798 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.418767+0000", 2024-09-12T16:17:25.798 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3775000000000004e-05 2024-09-12T16:17:25.798 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.798 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.798 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.798 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.798 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2126 3.5 e88/74 3:a0edb6e6:::rbd_data.11558d85ce23.0000000000000004:head v 88'495, mlcod=87'493)", 2024-09-12T16:17:25.799 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.428439+0000", 2024-09-12T16:17:25.799 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.33233486499999998, 2024-09-12T16:17:25.799 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0021809720000000002, 2024-09-12T16:17:25.799 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.799 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.799 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:25.799 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.799 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.799 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.799 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.428439+0000", 2024-09-12T16:17:25.799 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.799 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.799 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.800 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.800 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.428439+0000", 2024-09-12T16:17:25.800 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.800 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.800 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.800 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.800 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.428439+0000", 2024-09-12T16:17:25.800 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1699999999999998e-07 2024-09-12T16:17:25.800 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.800 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.800 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.800 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.428771+0000", 2024-09-12T16:17:25.800 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00033182099999999999 2024-09-12T16:17:25.800 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.801 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.801 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.801 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.428780+0000", 2024-09-12T16:17:25.801 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7800000000000006e-06 2024-09-12T16:17:25.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.801 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.801 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.801 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.428785+0000", 2024-09-12T16:17:25.801 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6659999999999999e-06 2024-09-12T16:17:25.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.801 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.801 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.801 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.428849+0000", 2024-09-12T16:17:25.802 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4309999999999999e-05 2024-09-12T16:17:25.802 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.802 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.802 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.802 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.428863+0000", 2024-09-12T16:17:25.802 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3886999999999999e-05 2024-09-12T16:17:25.802 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.802 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.802 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:25.802 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.430582+0000", 2024-09-12T16:17:25.802 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001719751 2024-09-12T16:17:25.802 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.802 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.802 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.803 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.430620+0000", 2024-09-12T16:17:25.803 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7240000000000003e-05 2024-09-12T16:17:25.803 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.803 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.803 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.803 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.803 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.803 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2118 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1219, mlcod=88'1217)", 2024-09-12T16:17:25.803 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440434+0000", 2024-09-12T16:17:25.803 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.320339763, 2024-09-12T16:17:25.803 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003875543, 2024-09-12T16:17:25.803 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.803 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.803 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:25.803 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.804 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.804 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.804 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440434+0000", 2024-09-12T16:17:25.804 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.804 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.804 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.804 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.804 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440434+0000", 2024-09-12T16:17:25.804 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.804 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.804 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.804 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.804 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440435+0000", 2024-09-12T16:17:25.805 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8899999999999998e-07 2024-09-12T16:17:25.805 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.805 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.805 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.805 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440444+0000", 2024-09-12T16:17:25.805 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4599999999999992e-06 2024-09-12T16:17:25.805 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.805 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.805 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.805 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440459+0000", 2024-09-12T16:17:25.805 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4460999999999999e-05 2024-09-12T16:17:25.805 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.805 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.805 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.806 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440466+0000", 2024-09-12T16:17:25.806 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4340000000000003e-06 2024-09-12T16:17:25.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.806 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.806 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.806 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:17:25.806 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9054999999999997e-05 2024-09-12T16:17:25.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.806 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.806 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.806 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440535+0000", 2024-09-12T16:17:25.806 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.98e-05 2024-09-12T16:17:25.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.806 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.806 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:25.807 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444269+0000", 2024-09-12T16:17:25.807 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003734448 2024-09-12T16:17:25.807 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.807 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.807 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.807 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444309+0000", 2024-09-12T16:17:25.807 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0095999999999997e-05 2024-09-12T16:17:25.807 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.807 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.807 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.807 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.807 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.807 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2122 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1220, mlcod=88'1217)", 2024-09-12T16:17:25.808 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440484+0000", 2024-09-12T16:17:25.808 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.32028925699999999, 2024-09-12T16:17:25.808 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0038538029999999998, 2024-09-12T16:17:25.808 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.808 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.808 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:25.808 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.808 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.808 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.808 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440484+0000", 2024-09-12T16:17:25.808 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.808 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.808 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.809 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.809 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440484+0000", 2024-09-12T16:17:25.809 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.809 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.809 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.809 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.809 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440485+0000", 2024-09-12T16:17:25.809 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6100000000000002e-07 2024-09-12T16:17:25.809 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.809 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.809 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.809 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440493+0000", 2024-09-12T16:17:25.809 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0169999999999996e-06 2024-09-12T16:17:25.810 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.810 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.810 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.810 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440501+0000", 2024-09-12T16:17:25.810 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9319999999999996e-06 2024-09-12T16:17:25.810 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.810 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.810 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.810 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440506+0000", 2024-09-12T16:17:25.810 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3510000000000001e-06 2024-09-12T16:17:25.810 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.810 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.810 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.810 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441319+0000", 2024-09-12T16:17:25.810 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00081295300000000005 2024-09-12T16:17:25.811 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.811 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.811 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.811 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441336+0000", 2024-09-12T16:17:25.811 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6897000000000001e-05 2024-09-12T16:17:25.811 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.811 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.811 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:25.811 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444311+0000", 2024-09-12T16:17:25.811 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029754510000000001 2024-09-12T16:17:25.811 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.811 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.811 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.811 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444338+0000", 2024-09-12T16:17:25.811 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6840999999999999e-05 2024-09-12T16:17:25.812 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.812 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.812 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.812 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.812 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.812 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2124 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1221, mlcod=88'1217)", 2024-09-12T16:17:25.812 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:17:25.812 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.32025868499999999, 2024-09-12T16:17:25.812 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0038507229999999999, 2024-09-12T16:17:25.812 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.812 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.812 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:25.812 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.813 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.813 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.813 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:17:25.813 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.813 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.813 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.813 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.813 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:17:25.813 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.813 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.813 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.813 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.813 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:17:25.814 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8799999999999998e-07 2024-09-12T16:17:25.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.814 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.814 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.814 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440519+0000", 2024-09-12T16:17:25.814 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5499999999999999e-06 2024-09-12T16:17:25.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.814 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.814 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.814 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440525+0000", 2024-09-12T16:17:25.814 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1009999999999997e-06 2024-09-12T16:17:25.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.814 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.814 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.815 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440529+0000", 2024-09-12T16:17:25.815 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3749999999999996e-06 2024-09-12T16:17:25.815 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.815 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.815 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.815 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441883+0000", 2024-09-12T16:17:25.815 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0013538249999999999 2024-09-12T16:17:25.815 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.815 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.815 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.815 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441901+0000", 2024-09-12T16:17:25.815 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7972999999999999e-05 2024-09-12T16:17:25.815 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.815 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.815 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:25.816 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444341+0000", 2024-09-12T16:17:25.816 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002439568 2024-09-12T16:17:25.816 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.816 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.816 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.816 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444366+0000", 2024-09-12T16:17:25.816 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5043000000000001e-05 2024-09-12T16:17:25.816 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.816 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.816 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.816 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.816 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.816 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2327 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1222, mlcod=88'1217)", 2024-09-12T16:17:25.816 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440696+0000", 2024-09-12T16:17:25.816 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.32007734300000001, 2024-09-12T16:17:25.817 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0036945739999999999, 2024-09-12T16:17:25.817 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.817 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.817 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:25.817 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.817 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.817 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.817 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440696+0000", 2024-09-12T16:17:25.817 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.817 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.817 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.818 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440696+0000", 2024-09-12T16:17:25.818 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.818 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.818 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.818 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440697+0000", 2024-09-12T16:17:25.818 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5899999999999996e-07 2024-09-12T16:17:25.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.818 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.818 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.818 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440702+0000", 2024-09-12T16:17:25.818 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0969999999999996e-06 2024-09-12T16:17:25.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.819 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.819 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.819 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440713+0000", 2024-09-12T16:17:25.819 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1114000000000001e-05 2024-09-12T16:17:25.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.819 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.819 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.819 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440719+0000", 2024-09-12T16:17:25.819 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1650000000000003e-06 2024-09-12T16:17:25.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.819 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.819 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.819 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.442435+0000", 2024-09-12T16:17:25.819 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017155440000000001 2024-09-12T16:17:25.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.820 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.820 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.820 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.442457+0000", 2024-09-12T16:17:25.820 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1793999999999998e-05 2024-09-12T16:17:25.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.820 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.820 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:25.820 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444367+0000", 2024-09-12T16:17:25.820 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0019101980000000001 2024-09-12T16:17:25.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.820 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.820 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.820 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444391+0000", 2024-09-12T16:17:25.821 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4003e-05 2024-09-12T16:17:25.821 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.821 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.821 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.821 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.821 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2329 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1223, mlcod=88'1217)", 2024-09-12T16:17:25.821 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.441872+0000", 2024-09-12T16:17:25.821 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.318902044, 2024-09-12T16:17:25.821 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025432150000000001, 2024-09-12T16:17:25.821 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.821 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.821 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:25.821 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.822 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.822 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.822 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441872+0000", 2024-09-12T16:17:25.822 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.822 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.822 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.822 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441872+0000", 2024-09-12T16:17:25.822 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.822 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.822 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.822 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441872+0000", 2024-09-12T16:17:25.822 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9299999999999997e-07 2024-09-12T16:17:25.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.823 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.823 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441877+0000", 2024-09-12T16:17:25.823 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.006e-06 2024-09-12T16:17:25.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.823 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.823 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441885+0000", 2024-09-12T16:17:25.823 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0229999999999992e-06 2024-09-12T16:17:25.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.823 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.823 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441891+0000", 2024-09-12T16:17:25.823 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.604e-06 2024-09-12T16:17:25.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.824 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.824 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.824 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.443119+0000", 2024-09-12T16:17:25.824 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0012283000000000001 2024-09-12T16:17:25.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.824 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.824 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.824 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.443147+0000", 2024-09-12T16:17:25.824 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7478999999999999e-05 2024-09-12T16:17:25.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.824 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.824 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:25.824 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444392+0000", 2024-09-12T16:17:25.824 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001245157 2024-09-12T16:17:25.825 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.825 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.825 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.825 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444415+0000", 2024-09-12T16:17:25.825 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2952999999999999e-05 2024-09-12T16:17:25.825 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.825 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.825 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.825 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.825 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.825 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2436 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1224, mlcod=88'1217)", 2024-09-12T16:17:25.825 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.442780+0000", 2024-09-12T16:17:25.825 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.31799318300000001, 2024-09-12T16:17:25.825 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0023658619999999998, 2024-09-12T16:17:25.825 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.826 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.826 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:25.826 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.826 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.826 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.826 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.442780+0000", 2024-09-12T16:17:25.826 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.826 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.826 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.826 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.826 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.442780+0000", 2024-09-12T16:17:25.826 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.826 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.826 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.826 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.827 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.442781+0000", 2024-09-12T16:17:25.827 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2799999999999995e-07 2024-09-12T16:17:25.827 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.827 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.827 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.827 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.442787+0000", 2024-09-12T16:17:25.827 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.733e-06 2024-09-12T16:17:25.827 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.827 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.827 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.827 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.442801+0000", 2024-09-12T16:17:25.827 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4110999999999999e-05 2024-09-12T16:17:25.827 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.828 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.828 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.828 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.442808+0000", 2024-09-12T16:17:25.828 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4869999999999996e-06 2024-09-12T16:17:25.828 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.828 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.828 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.828 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.443721+0000", 2024-09-12T16:17:25.828 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00091211899999999997 2024-09-12T16:17:25.828 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.828 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.828 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.828 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.443750+0000", 2024-09-12T16:17:25.828 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9459999999999999e-05 2024-09-12T16:17:25.829 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.829 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.829 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:25.829 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.445109+0000", 2024-09-12T16:17:25.829 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001358997 2024-09-12T16:17:25.829 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.829 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.829 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.829 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.445146+0000", 2024-09-12T16:17:25.829 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7227000000000001e-05 2024-09-12T16:17:25.829 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.829 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.829 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.829 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.829 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.830 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2487 3.1d e88/74 3:b8c395a6:::rbd_data.11558d85ce23.000000000000000b:head v 88'1225, mlcod=88'1223)", 2024-09-12T16:17:25.830 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:17:25.830 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.314562974, 2024-09-12T16:17:25.830 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033166039999999999, 2024-09-12T16:17:25.830 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.830 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.830 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:25.830 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.830 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.830 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.830 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:17:25.830 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.830 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.830 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.831 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:17:25.831 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.831 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.831 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.831 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.831 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:17:25.831 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9299999999999997e-07 2024-09-12T16:17:25.831 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.831 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.831 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.831 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446295+0000", 2024-09-12T16:17:25.831 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3153999999999997e-05 2024-09-12T16:17:25.831 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.831 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.831 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.832 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446309+0000", 2024-09-12T16:17:25.832 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4015e-05 2024-09-12T16:17:25.832 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.832 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.832 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.832 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446317+0000", 2024-09-12T16:17:25.832 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4880000000000007e-06 2024-09-12T16:17:25.832 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.832 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.832 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.832 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446373+0000", 2024-09-12T16:17:25.832 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5766000000000001e-05 2024-09-12T16:17:25.832 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.833 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.833 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.833 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446395+0000", 2024-09-12T16:17:25.833 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2500000000000001e-05 2024-09-12T16:17:25.833 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.833 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.833 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:25.833 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.449445+0000", 2024-09-12T16:17:25.833 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003049791 2024-09-12T16:17:25.833 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.833 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.833 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.833 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.449527+0000", 2024-09-12T16:17:25.833 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2096999999999997e-05 2024-09-12T16:17:25.833 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.834 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.834 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.834 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.834 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.834 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2488 3.1d e88/74 3:b8c395a6:::rbd_data.11558d85ce23.000000000000000b:head v 88'1227, mlcod=88'1223)", 2024-09-12T16:17:25.834 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.447346+0000", 2024-09-12T16:17:25.834 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.31342764699999998, 2024-09-12T16:17:25.834 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002336496, 2024-09-12T16:17:25.834 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.834 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.834 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:25.834 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.834 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.835 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.835 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447346+0000", 2024-09-12T16:17:25.835 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.835 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.835 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.835 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447346+0000", 2024-09-12T16:17:25.835 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.835 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.835 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.835 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447347+0000", 2024-09-12T16:17:25.835 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3399999999999997e-07 2024-09-12T16:17:25.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.836 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.836 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.836 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447353+0000", 2024-09-12T16:17:25.836 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0159999999999997e-06 2024-09-12T16:17:25.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.836 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.836 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.836 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447367+0000", 2024-09-12T16:17:25.836 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4358e-05 2024-09-12T16:17:25.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.836 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.836 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.836 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447376+0000", 2024-09-12T16:17:25.836 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9940000000000006e-06 2024-09-12T16:17:25.837 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.837 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.837 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.837 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447421+0000", 2024-09-12T16:17:25.837 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5000000000000003e-05 2024-09-12T16:17:25.837 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.837 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.837 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.837 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447448+0000", 2024-09-12T16:17:25.837 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6548999999999999e-05 2024-09-12T16:17:25.837 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.837 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.837 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:25.837 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.449643+0000", 2024-09-12T16:17:25.838 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0021949220000000002 2024-09-12T16:17:25.838 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.838 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.838 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.838 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.449682+0000", 2024-09-12T16:17:25.838 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9722999999999999e-05 2024-09-12T16:17:25.838 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.838 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.838 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.838 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.838 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.838 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2493 3.2 e88/74 3:46cb4ff0:::rbd_data.11558d85ce23.000000000000000e:head v 88'372, mlcod=87'370)", 2024-09-12T16:17:25.838 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.447443+0000", 2024-09-12T16:17:25.839 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.31333103600000001, 2024-09-12T16:17:25.839 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029120330000000001, 2024-09-12T16:17:25.839 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.839 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.839 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:25.839 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.839 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.839 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.839 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447443+0000", 2024-09-12T16:17:25.839 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.839 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.839 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.839 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.839 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447443+0000", 2024-09-12T16:17:25.840 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.840 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.840 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.840 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447443+0000", 2024-09-12T16:17:25.840 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4600000000000001e-07 2024-09-12T16:17:25.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.840 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.840 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.840 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447779+0000", 2024-09-12T16:17:25.840 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00033639800000000001 2024-09-12T16:17:25.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.840 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.840 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.841 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447790+0000", 2024-09-12T16:17:25.841 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0555e-05 2024-09-12T16:17:25.841 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.841 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.841 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.841 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447797+0000", 2024-09-12T16:17:25.841 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1729999999999998e-06 2024-09-12T16:17:25.841 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.841 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.841 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.841 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447862+0000", 2024-09-12T16:17:25.841 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4670000000000003e-05 2024-09-12T16:17:25.841 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.842 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.842 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.842 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447889+0000", 2024-09-12T16:17:25.842 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.773e-05 2024-09-12T16:17:25.842 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.842 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.842 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:25.842 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.450311+0000", 2024-09-12T16:17:25.842 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0024212510000000001 2024-09-12T16:17:25.842 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.842 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.842 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.842 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.450355+0000", 2024-09-12T16:17:25.842 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.401e-05 2024-09-12T16:17:25.843 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.843 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.843 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.843 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.843 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.843 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2494 3.2 e88/74 3:46cb4ff0:::rbd_data.11558d85ce23.000000000000000e:head v 88'374, mlcod=87'370)", 2024-09-12T16:17:25.843 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.448265+0000", 2024-09-12T16:17:25.843 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.31250897399999999, 2024-09-12T16:17:25.843 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002703165, 2024-09-12T16:17:25.843 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.843 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.843 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:25.843 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.843 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.844 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.844 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.448265+0000", 2024-09-12T16:17:25.844 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.844 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.844 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.844 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.844 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.448265+0000", 2024-09-12T16:17:25.844 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.844 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.844 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.844 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.844 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.448265+0000", 2024-09-12T16:17:25.844 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4899999999999995e-07 2024-09-12T16:17:25.844 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.845 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.845 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.845 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.448271+0000", 2024-09-12T16:17:25.845 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4210000000000003e-06 2024-09-12T16:17:25.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.845 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.845 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.845 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.448280+0000", 2024-09-12T16:17:25.845 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5619999999999993e-06 2024-09-12T16:17:25.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.845 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.845 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.845 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.448287+0000", 2024-09-12T16:17:25.845 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4309999999999999e-06 2024-09-12T16:17:25.846 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.846 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.846 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.846 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.448443+0000", 2024-09-12T16:17:25.846 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015667099999999999 2024-09-12T16:17:25.846 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.846 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.846 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.846 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.448478+0000", 2024-09-12T16:17:25.846 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4724000000000002e-05 2024-09-12T16:17:25.846 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.846 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.846 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:25.846 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.450931+0000", 2024-09-12T16:17:25.846 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0024531050000000001 2024-09-12T16:17:25.846 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.847 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.847 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.847 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.450968+0000", 2024-09-12T16:17:25.847 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6602e-05 2024-09-12T16:17:25.847 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.847 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.847 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.847 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.847 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.847 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:6381 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1250, mlcod=88'1247)", 2024-09-12T16:17:25.847 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.618258+0000", 2024-09-12T16:17:25.847 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.142515167, 2024-09-12T16:17:25.847 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00232854, 2024-09-12T16:17:25.847 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:25.847 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:25.848 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:25.848 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:25.848 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.848 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:25.848 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.618258+0000", 2024-09-12T16:17:25.848 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.848 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.848 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.848 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:25.848 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.618258+0000", 2024-09-12T16:17:25.848 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:25.848 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.848 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.848 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:25.848 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.618259+0000", 2024-09-12T16:17:25.849 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7000000000000004e-07 2024-09-12T16:17:25.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.849 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:25.849 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.618265+0000", 2024-09-12T16:17:25.849 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5480000000000001e-06 2024-09-12T16:17:25.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.849 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:25.849 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.618274+0000", 2024-09-12T16:17:25.849 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6930000000000002e-06 2024-09-12T16:17:25.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.849 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:25.849 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.618281+0000", 2024-09-12T16:17:25.849 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4409999999999998e-06 2024-09-12T16:17:25.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:25.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.618351+0000", 2024-09-12T16:17:25.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0316999999999998e-05 2024-09-12T16:17:25.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:25.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.618370+0000", 2024-09-12T16:17:25.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9211e-05 2024-09-12T16:17:25.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:25.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.620487+0000", 2024-09-12T16:17:25.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002116883 2024-09-12T16:17:25.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:25.851 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:25.851 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:25.851 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.620587+0000", 2024-09-12T16:17:25.851 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9677000000000001e-05 2024-09-12T16:17:25.851 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.851 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.851 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.851 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:25.851 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:25.851 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:25.852 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:25.851+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:25.853 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:17:25.953 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:25.952+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:25.961 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:25.961 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:25.961 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:17:25.961 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:25.969 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:17:26.054 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:26.053+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:26.118 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:26.118 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:26.118 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:17:26.118 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:17:26.118 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:26.127 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:17:26.172 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:26.171+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:26.202 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #27, image image_client.0-clone27 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent28 2024-09-12T16:17:26.239 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:26.239 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:17:26.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:17:26.239 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:17:26.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.239 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3705 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14812160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:26.239 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:17:26.239 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.097590339000007, 2024-09-12T16:17:26.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053368831999999998, 2024-09-12T16:17:26.239 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:26.239 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:26.240 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:26.240 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:26.240 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:26.240 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:26.240 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3705 2024-09-12T16:17:26.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.240 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:26.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:26.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:17:26.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:26.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:17:26.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:26.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139932+0000", 2024-09-12T16:17:26.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012762099999999999 2024-09-12T16:17:26.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:26.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139935+0000", 2024-09-12T16:17:26.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.119e-06 2024-09-12T16:17:26.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:26.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139939+0000", 2024-09-12T16:17:26.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7999999999999998e-06 2024-09-12T16:17:26.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:26.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139953+0000", 2024-09-12T16:17:26.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3923999999999999e-05 2024-09-12T16:17:26.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:26.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192946+0000", 2024-09-12T16:17:26.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052992971 2024-09-12T16:17:26.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:26.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193035+0000", 2024-09-12T16:17:26.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9040000000000001e-05 2024-09-12T16:17:26.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:26.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193174+0000", 2024-09-12T16:17:26.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138357 2024-09-12T16:17:26.243 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.243 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:26.243 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.244 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3706 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14816256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:26.244 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:17:26.244 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.097435348999994, 2024-09-12T16:17:26.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053341723000000001, 2024-09-12T16:17:26.244 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:26.244 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:26.244 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:26.244 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:26.244 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:26.244 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:26.244 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3706 2024-09-12T16:17:26.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.245 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:26.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:26.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:17:26.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:26.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:17:26.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:26.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140090+0000", 2024-09-12T16:17:26.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013020100000000001 2024-09-12T16:17:26.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:26.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140097+0000", 2024-09-12T16:17:26.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0709999999999997e-06 2024-09-12T16:17:26.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:26.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140103+0000", 2024-09-12T16:17:26.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5450000000000003e-06 2024-09-12T16:17:26.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:26.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140106+0000", 2024-09-12T16:17:26.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3739999999999998e-06 2024-09-12T16:17:26.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:26.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193190+0000", 2024-09-12T16:17:26.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053084131999999999 2024-09-12T16:17:26.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:26.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193232+0000", 2024-09-12T16:17:26.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1517000000000002e-05 2024-09-12T16:17:26.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:26.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193302+0000", 2024-09-12T16:17:26.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9882999999999995e-05 2024-09-12T16:17:26.248 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.248 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:26.249 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.249 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3707 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14820352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:26.249 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:17:26.249 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.097283360000006, 2024-09-12T16:17:26.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053452771000000003, 2024-09-12T16:17:26.249 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:26.249 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:26.249 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:26.249 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:26.249 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:26.249 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:26.250 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3707 2024-09-12T16:17:26.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.250 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:26.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:26.250 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:17:26.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:26.250 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:17:26.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:26.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140219+0000", 2024-09-12T16:17:26.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106902 2024-09-12T16:17:26.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:26.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140225+0000", 2024-09-12T16:17:26.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3199999999999996e-06 2024-09-12T16:17:26.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:26.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140230+0000", 2024-09-12T16:17:26.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8969999999999999e-06 2024-09-12T16:17:26.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:26.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140233+0000", 2024-09-12T16:17:26.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2119999999999999e-06 2024-09-12T16:17:26.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:26.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193339+0000", 2024-09-12T16:17:26.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053105556999999998 2024-09-12T16:17:26.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:26.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193431+0000", 2024-09-12T16:17:26.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1837999999999997e-05 2024-09-12T16:17:26.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:26.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193565+0000", 2024-09-12T16:17:26.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013404500000000001 2024-09-12T16:17:26.253 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.253 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:26.253 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.253 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3708 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14824448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:26.253 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:17:26.254 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.097154517999996, 2024-09-12T16:17:26.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053468190999999998, 2024-09-12T16:17:26.254 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:26.254 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:26.254 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:26.254 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:26.254 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:26.254 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:26.254 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3708 2024-09-12T16:17:26.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.254 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:26.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:26.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:17:26.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:26.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:17:26.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:26.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140351+0000", 2024-09-12T16:17:26.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110096 2024-09-12T16:17:26.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:26.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140358+0000", 2024-09-12T16:17:26.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.306e-06 2024-09-12T16:17:26.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:26.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140368+0000", 2024-09-12T16:17:26.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0225e-05 2024-09-12T16:17:26.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:26.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140372+0000", 2024-09-12T16:17:26.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6169999999999998e-06 2024-09-12T16:17:26.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:26.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193594+0000", 2024-09-12T16:17:26.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053222419999999999 2024-09-12T16:17:26.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:26.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193640+0000", 2024-09-12T16:17:26.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.587e-05 2024-09-12T16:17:26.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:26.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193709+0000", 2024-09-12T16:17:26.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8657000000000004e-05 2024-09-12T16:17:26.258 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.258 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:26.258 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.258 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3709 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14828544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:26.258 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:17:26.258 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.097017550000004, 2024-09-12T16:17:26.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594033999999999, 2024-09-12T16:17:26.259 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:26.259 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:26.259 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:26.259 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:26.259 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:26.259 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:26.259 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3709 2024-09-12T16:17:26.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.259 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:26.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:26.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:17:26.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:26.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:17:26.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:26.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140499+0000", 2024-09-12T16:17:26.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121019 2024-09-12T16:17:26.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:26.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140501+0000", 2024-09-12T16:17:26.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2369999999999999e-06 2024-09-12T16:17:26.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:26.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140506+0000", 2024-09-12T16:17:26.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.639e-06 2024-09-12T16:17:26.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:26.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140509+0000", 2024-09-12T16:17:26.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3419999999999999e-06 2024-09-12T16:17:26.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:26.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193743+0000", 2024-09-12T16:17:26.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053234311999999999 2024-09-12T16:17:26.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:26.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193833+0000", 2024-09-12T16:17:26.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9883999999999995e-05 2024-09-12T16:17:26.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:26.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193972+0000", 2024-09-12T16:17:26.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138601 2024-09-12T16:17:26.263 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.263 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:26.263 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.263 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3710 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14832640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:26.263 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:17:26.263 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.096880204000001, 2024-09-12T16:17:26.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053607324999999997, 2024-09-12T16:17:26.263 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:26.263 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:26.263 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:26.263 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:26.263 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:26.263 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:26.263 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3710 2024-09-12T16:17:26.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.264 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:26.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:26.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:17:26.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:26.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:17:26.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:26.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140664+0000", 2024-09-12T16:17:26.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014918700000000001 2024-09-12T16:17:26.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:26.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140674+0000", 2024-09-12T16:17:26.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8379999999999997e-06 2024-09-12T16:17:26.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:26.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140694+0000", 2024-09-12T16:17:26.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0145000000000001e-05 2024-09-12T16:17:26.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:26.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140703+0000", 2024-09-12T16:17:26.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5150000000000006e-06 2024-09-12T16:17:26.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:26.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194006+0000", 2024-09-12T16:17:26.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053303370000000003 2024-09-12T16:17:26.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:26.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194051+0000", 2024-09-12T16:17:26.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5012000000000002e-05 2024-09-12T16:17:26.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:26.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194122+0000", 2024-09-12T16:17:26.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1258000000000001e-05 2024-09-12T16:17:26.267 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.267 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:26.267 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.267 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3711 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14836736~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:26.267 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:17:26.268 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.096678756000003, 2024-09-12T16:17:26.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053670799999999998, 2024-09-12T16:17:26.268 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:26.268 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:26.268 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:26.268 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:26.268 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:26.268 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:26.268 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3711 2024-09-12T16:17:26.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.268 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:26.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:26.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:17:26.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:26.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:17:26.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:26.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140782+0000", 2024-09-12T16:17:26.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5549999999999994e-05 2024-09-12T16:17:26.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:26.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140786+0000", 2024-09-12T16:17:26.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.89e-06 2024-09-12T16:17:26.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:26.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140796+0000", 2024-09-12T16:17:26.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0057e-05 2024-09-12T16:17:26.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:26.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140819+0000", 2024-09-12T16:17:26.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3005000000000001e-05 2024-09-12T16:17:26.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:26.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194159+0000", 2024-09-12T16:17:26.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053340324000000001 2024-09-12T16:17:26.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:26.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194248+0000", 2024-09-12T16:17:26.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9209000000000006e-05 2024-09-12T16:17:26.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:26.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194387+0000", 2024-09-12T16:17:26.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138765 2024-09-12T16:17:26.271 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.271 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:26.271 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.272 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3712 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14840832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:26.272 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:17:26.272 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.096564298000004, 2024-09-12T16:17:26.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053699068000000003, 2024-09-12T16:17:26.272 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:26.272 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:26.272 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:26.272 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:26.272 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:26.272 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:26.272 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3712 2024-09-12T16:17:26.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.272 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:26.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:26.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:17:26.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:26.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:17:26.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:26.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140900+0000", 2024-09-12T16:17:26.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9014e-05 2024-09-12T16:17:26.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:26.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140904+0000", 2024-09-12T16:17:26.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0940000000000001e-06 2024-09-12T16:17:26.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:26.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140933+0000", 2024-09-12T16:17:26.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8996000000000002e-05 2024-09-12T16:17:26.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:26.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140945+0000", 2024-09-12T16:17:26.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1909000000000001e-05 2024-09-12T16:17:26.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:26.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194415+0000", 2024-09-12T16:17:26.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053470403 2024-09-12T16:17:26.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:26.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194460+0000", 2024-09-12T16:17:26.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5145000000000002e-05 2024-09-12T16:17:26.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:26.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194530+0000", 2024-09-12T16:17:26.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9506999999999997e-05 2024-09-12T16:17:26.276 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.276 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:26.276 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.276 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3713 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14844928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:26.276 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:17:26.276 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.096431237999994, 2024-09-12T16:17:26.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053821236000000001, 2024-09-12T16:17:26.276 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:26.277 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:26.277 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:26.277 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:26.277 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:26.277 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:26.277 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3713 2024-09-12T16:17:26.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.277 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:26.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:26.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:17:26.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:26.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:17:26.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:26.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141078+0000", 2024-09-12T16:17:26.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114162 2024-09-12T16:17:26.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:26.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141090+0000", 2024-09-12T16:17:26.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.19e-05 2024-09-12T16:17:26.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:26.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141100+0000", 2024-09-12T16:17:26.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0447e-05 2024-09-12T16:17:26.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:26.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141108+0000", 2024-09-12T16:17:26.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7190000000000001e-06 2024-09-12T16:17:26.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:26.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194564+0000", 2024-09-12T16:17:26.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053455729 2024-09-12T16:17:26.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:26.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194652+0000", 2024-09-12T16:17:26.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8288999999999994e-05 2024-09-12T16:17:26.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:26.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194785+0000", 2024-09-12T16:17:26.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013299000000000001 2024-09-12T16:17:26.280 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.281 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:26.281 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.281 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3714 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14849024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:26.281 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:17:26.281 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.096275309000006, 2024-09-12T16:17:26.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053816382000000003, 2024-09-12T16:17:26.281 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:26.281 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:26.281 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:26.281 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:26.281 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:26.281 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:26.282 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3714 2024-09-12T16:17:26.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.282 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:26.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:26.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:17:26.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:26.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:17:26.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:26.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141182+0000", 2024-09-12T16:17:26.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1805999999999997e-05 2024-09-12T16:17:26.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:26.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141185+0000", 2024-09-12T16:17:26.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5930000000000002e-06 2024-09-12T16:17:26.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:26.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141194+0000", 2024-09-12T16:17:26.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5760000000000006e-06 2024-09-12T16:17:26.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:26.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141222+0000", 2024-09-12T16:17:26.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8034999999999998e-05 2024-09-12T16:17:26.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:26.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194817+0000", 2024-09-12T16:17:26.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594887000000001 2024-09-12T16:17:26.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:26.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194860+0000", 2024-09-12T16:17:26.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3714999999999997e-05 2024-09-12T16:17:26.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:26.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194936+0000", 2024-09-12T16:17:26.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5770000000000001e-05 2024-09-12T16:17:26.285 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.285 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:26.285 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.285 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3715 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14853120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:26.286 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:17:26.286 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.096151652000003, 2024-09-12T16:17:26.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053962307000000001, 2024-09-12T16:17:26.286 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:26.286 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:26.286 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:26.286 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:26.286 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:26.286 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:26.286 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3715 2024-09-12T16:17:26.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.286 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:26.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:17:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:17:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141417+0000", 2024-09-12T16:17:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017384099999999999 2024-09-12T16:17:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:26.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141422+0000", 2024-09-12T16:17:26.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7310000000000001e-06 2024-09-12T16:17:26.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:26.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141434+0000", 2024-09-12T16:17:26.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2058e-05 2024-09-12T16:17:26.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:26.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141442+0000", 2024-09-12T16:17:26.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7610000000000007e-06 2024-09-12T16:17:26.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:26.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194973+0000", 2024-09-12T16:17:26.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053530618000000002 2024-09-12T16:17:26.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:26.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195063+0000", 2024-09-12T16:17:26.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0927000000000005e-05 2024-09-12T16:17:26.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:26.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195206+0000", 2024-09-12T16:17:26.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142371 2024-09-12T16:17:26.290 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.290 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:26.290 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.290 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3716 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14857216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:26.290 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:17:26.290 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.095941801999999, 2024-09-12T16:17:26.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053916360000000003, 2024-09-12T16:17:26.290 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:26.290 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:26.290 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:26.290 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:26.291 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:26.291 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:26.291 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3716 2024-09-12T16:17:26.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.291 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:26.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:26.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:17:26.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:26.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:17:26.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:26.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142933+0000", 2024-09-12T16:17:26.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014796290000000001 2024-09-12T16:17:26.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:26.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142937+0000", 2024-09-12T16:17:26.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5760000000000002e-06 2024-09-12T16:17:26.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:26.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142946+0000", 2024-09-12T16:17:26.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0380000000000005e-06 2024-09-12T16:17:26.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:26.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142951+0000", 2024-09-12T16:17:26.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9749999999999998e-06 2024-09-12T16:17:26.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:26.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195246+0000", 2024-09-12T16:17:26.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052295358 2024-09-12T16:17:26.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:26.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195299+0000", 2024-09-12T16:17:26.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2976999999999998e-05 2024-09-12T16:17:26.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:26.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195370+0000", 2024-09-12T16:17:26.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0807000000000002e-05 2024-09-12T16:17:26.294 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.294 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:26.294 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.294 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3721 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14877696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:26.294 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:26.295 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.094368351, 2024-09-12T16:17:26.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053422994000000001, 2024-09-12T16:17:26.295 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:26.295 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:26.295 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:26.295 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:26.295 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:26.295 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:26.295 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3721 2024-09-12T16:17:26.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.295 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:26.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:26.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:26.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:26.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:26.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:26.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:26.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:17:26.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:26.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143028+0000", 2024-09-12T16:17:26.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7399999999999991e-07 2024-09-12T16:17:26.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:26.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143031+0000", 2024-09-12T16:17:26.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7599999999999998e-06 2024-09-12T16:17:26.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:26.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143034+0000", 2024-09-12T16:17:26.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9780000000000001e-06 2024-09-12T16:17:26.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:26.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196220+0000", 2024-09-12T16:17:26.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053186341999999998 2024-09-12T16:17:26.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:26.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196313+0000", 2024-09-12T16:17:26.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2676000000000005e-05 2024-09-12T16:17:26.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:26.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196450+0000", 2024-09-12T16:17:26.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137052 2024-09-12T16:17:26.298 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.299 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:26.299 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.299 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3722 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14881792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:26.299 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:26.299 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.094358459000006, 2024-09-12T16:17:26.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053556835999999997, 2024-09-12T16:17:26.299 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:26.299 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:26.299 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:26.299 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:26.299 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:26.299 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:26.299 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3722 2024-09-12T16:17:26.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.300 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:26.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:26.300 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:26.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:26.300 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:26.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:26.300 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:26.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.11e-07 2024-09-12T16:17:26.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:26.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143038+0000", 2024-09-12T16:17:26.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2399999999999996e-07 2024-09-12T16:17:26.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:26.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143041+0000", 2024-09-12T16:17:26.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8030000000000001e-06 2024-09-12T16:17:26.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:26.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143043+0000", 2024-09-12T16:17:26.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3140000000000002e-06 2024-09-12T16:17:26.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:26.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196481+0000", 2024-09-12T16:17:26.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053437601000000001 2024-09-12T16:17:26.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:26.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196525+0000", 2024-09-12T16:17:26.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4280000000000003e-05 2024-09-12T16:17:26.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:26.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196594+0000", 2024-09-12T16:17:26.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8702999999999996e-05 2024-09-12T16:17:26.303 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.303 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:26.303 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.303 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3723 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14885888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:26.303 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:17:26.303 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.094349277000006, 2024-09-12T16:17:26.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053815546999999998, 2024-09-12T16:17:26.303 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:26.304 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:26.304 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:26.304 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:26.304 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:26.304 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:26.304 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3723 2024-09-12T16:17:26.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.304 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:26.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.304 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:26.304 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:17:26.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:26.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:17:26.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:26.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148994+0000", 2024-09-12T16:17:26.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059481330000000004 2024-09-12T16:17:26.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:26.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148999+0000", 2024-09-12T16:17:26.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7140000000000001e-06 2024-09-12T16:17:26.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:26.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149008+0000", 2024-09-12T16:17:26.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4350000000000003e-06 2024-09-12T16:17:26.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:26.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149021+0000", 2024-09-12T16:17:26.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2514000000000001e-05 2024-09-12T16:17:26.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:26.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196630+0000", 2024-09-12T16:17:26.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047609758000000002 2024-09-12T16:17:26.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:26.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196724+0000", 2024-09-12T16:17:26.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3522000000000003e-05 2024-09-12T16:17:26.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:26.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196861+0000", 2024-09-12T16:17:26.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013747100000000001 2024-09-12T16:17:26.308 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.308 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:26.308 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.308 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4438 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15719424~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:26.308 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:26.308 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 67.949468499999995, 2024-09-12T16:17:26.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367981000000002, 2024-09-12T16:17:26.308 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:26.308 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:26.308 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:26.308 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:26.309 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:26.309 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:26.309 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4438 2024-09-12T16:17:26.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.309 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:26.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:26.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:26.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:26.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:26.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:26.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:26.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3e-07 2024-09-12T16:17:26.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:26.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287930+0000", 2024-09-12T16:17:26.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-12T16:17:26.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:26.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287937+0000", 2024-09-12T16:17:26.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.08e-06 2024-09-12T16:17:26.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:26.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287943+0000", 2024-09-12T16:17:26.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5709999999999997e-06 2024-09-12T16:17:26.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:26.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341068+0000", 2024-09-12T16:17:26.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053125101000000001 2024-09-12T16:17:26.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:26.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341154+0000", 2024-09-12T16:17:26.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6100999999999994e-05 2024-09-12T16:17:26.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:26.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341295+0000", 2024-09-12T16:17:26.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014087999999999999 2024-09-12T16:17:26.312 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.312 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:26.312 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.312 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4439 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15723520~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:26.313 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:26.313 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 67.949444339999999, 2024-09-12T16:17:26.313 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053526799, 2024-09-12T16:17:26.313 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:26.313 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:26.313 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:26.313 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:26.313 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:26.313 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:26.313 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4439 2024-09-12T16:17:26.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.313 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:26.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:26.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:26.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:26.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:26.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:26.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:26.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-07 2024-09-12T16:17:26.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:26.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287953+0000", 2024-09-12T16:17:26.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1349999999999999e-06 2024-09-12T16:17:26.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:26.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287960+0000", 2024-09-12T16:17:26.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-12T16:17:26.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:26.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287965+0000", 2024-09-12T16:17:26.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1580000000000004e-06 2024-09-12T16:17:26.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:26.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341332+0000", 2024-09-12T16:17:26.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367009 2024-09-12T16:17:26.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:26.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341402+0000", 2024-09-12T16:17:26.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9759999999999996e-05 2024-09-12T16:17:26.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.317 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:26.317 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341478+0000", 2024-09-12T16:17:26.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5412000000000002e-05 2024-09-12T16:17:26.317 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.317 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:26.317 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.317 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4440 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15727616~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:26.317 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:26.317 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 67.949423236000001, 2024-09-12T16:17:26.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053761601999999999, 2024-09-12T16:17:26.317 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:26.317 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:26.317 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:26.318 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:26.318 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:26.318 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:26.318 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4440 2024-09-12T16:17:26.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.318 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:26.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:26.318 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:26.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:26.318 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:26.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:26.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:26.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:17:26.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:26.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287974+0000", 2024-09-12T16:17:26.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0540000000000002e-06 2024-09-12T16:17:26.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:26.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287980+0000", 2024-09-12T16:17:26.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9440000000000002e-06 2024-09-12T16:17:26.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:26.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287987+0000", 2024-09-12T16:17:26.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5889999999999999e-06 2024-09-12T16:17:26.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:26.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341502+0000", 2024-09-12T16:17:26.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053515199999999999 2024-09-12T16:17:26.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:26.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341595+0000", 2024-09-12T16:17:26.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3097000000000007e-05 2024-09-12T16:17:26.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.321 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:26.321 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341734+0000", 2024-09-12T16:17:26.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013832800000000001 2024-09-12T16:17:26.321 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.321 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:26.321 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.321 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2209 3.1 3:85f36d3b:::rbd_data.1155ccb1894c.0000000000000004:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:26.321 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:17:26.321 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 28.865738098000001, 2024-09-12T16:17:26.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.060659365, 2024-09-12T16:17:26.321 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:26.322 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:26.322 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:26.322 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:26.322 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:17:26.322 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:17:26.322 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2209 2024-09-12T16:17:26.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.322 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:26.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.322 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:26.322 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:17:26.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.322 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:26.322 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:17:26.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:26.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371658+0000", 2024-09-12T16:17:26.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1570000000000001e-06 2024-09-12T16:17:26.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:26.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393414+0000", 2024-09-12T16:17:26.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021755495999999999 2024-09-12T16:17:26.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:26.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393447+0000", 2024-09-12T16:17:26.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3630000000000002e-05 2024-09-12T16:17:26.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:26.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393462+0000", 2024-09-12T16:17:26.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5048999999999999e-05 2024-09-12T16:17:26.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:26.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393556+0000", 2024-09-12T16:17:26.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3549999999999997e-05 2024-09-12T16:17:26.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:26.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393697+0000", 2024-09-12T16:17:26.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000141414 2024-09-12T16:17:26.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.325 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T16:17:26.325 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.394944+0000", 2024-09-12T16:17:26.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012463039999999999 2024-09-12T16:17:26.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.325 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:26.325 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.431803+0000", 2024-09-12T16:17:26.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0368594 2024-09-12T16:17:26.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.326 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:17:26.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432268+0000", 2024-09-12T16:17:26.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046457600000000002 2024-09-12T16:17:26.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.326 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:17:26.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432293+0000", 2024-09-12T16:17:26.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.527e-05 2024-09-12T16:17:26.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.326 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:26.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432316+0000", 2024-09-12T16:17:26.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3519e-05 2024-09-12T16:17:26.326 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.327 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:26.327 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.327 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:9400 3.1f 3:feea9999:::rbd_data.1155338d0570.0000000000000007:head [read 32768~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-12T16:17:26.327 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:20.012502+0000", 2024-09-12T16:17:26.327 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.2248931059999997, 2024-09-12T16:17:26.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.000678049, 2024-09-12T16:17:26.327 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:26.327 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:26.327 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:26.327 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:26.327 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:26.327 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:26.328 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 9400 2024-09-12T16:17:26.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.328 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:26.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:26.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012502+0000", 2024-09-12T16:17:26.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:26.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012502+0000", 2024-09-12T16:17:26.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:26.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:26.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012504+0000", 2024-09-12T16:17:26.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5939999999999999e-06 2024-09-12T16:17:26.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:26.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012511+0000", 2024-09-12T16:17:26.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0840000000000003e-06 2024-09-12T16:17:26.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:26.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012525+0000", 2024-09-12T16:17:26.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4538999999999999e-05 2024-09-12T16:17:26.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:26.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012532+0000", 2024-09-12T16:17:26.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8310000000000003e-06 2024-09-12T16:17:26.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:26.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012605+0000", 2024-09-12T16:17:26.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2387999999999999e-05 2024-09-12T16:17:26.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T16:17:26.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012617+0000", 2024-09-12T16:17:26.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2167999999999999e-05 2024-09-12T16:17:26.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:26.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:21.012823+0000", 2024-09-12T16:17:26.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0002068230000001 2024-09-12T16:17:26.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:26.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:21.012975+0000", 2024-09-12T16:17:26.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015196200000000001 2024-09-12T16:17:26.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:26.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:26.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:26.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:21.013180+0000", 2024-09-12T16:17:26.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020466000000000001 2024-09-12T16:17:26.331 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.331 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:26.332 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.332 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:26.332 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:26.332 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:26.333 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:26.332+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:26.335 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:17:26.335 INFO:teuthology.orchestra.run.smithi204.stdout:4191 write 0x72fce00 thru 0x73023b8 (0x55b9 bytes) 2024-09-12T16:17:26.336 INFO:teuthology.orchestra.run.smithi204.stdout:4192 write 0x2b0e200 thru 0x2b11362 (0x3163 bytes) 2024-09-12T16:17:26.336 INFO:teuthology.orchestra.run.smithi204.stdout:4193 write 0x4311800 thru 0x4315711 (0x3f12 bytes) 2024-09-12T16:17:26.336 INFO:teuthology.orchestra.run.smithi204.stdout:4196 read 0x7009600 thru 0x701559c (0xbf9d bytes) 2024-09-12T16:17:26.336 INFO:teuthology.orchestra.run.smithi204.stdout:4197 write 0xb979200 thru 0xb97a8c0 (0x16c1 bytes) 2024-09-12T16:17:26.336 INFO:teuthology.orchestra.run.smithi204.stdout:4199 read 0x856d200 thru 0x8575448 (0x8249 bytes) 2024-09-12T16:17:26.336 INFO:teuthology.orchestra.run.smithi204.stdout:4200 read 0x849f000 thru 0x84a7789 (0x878a bytes) 2024-09-12T16:17:26.336 INFO:teuthology.orchestra.run.smithi204.stdout:4201 write 0xd91c800 thru 0xd92a507 (0xdd08 bytes) 2024-09-12T16:17:26.336 INFO:teuthology.orchestra.run.smithi204.stdout:4202 punch from 0xcbdf400 to 0xcbed400, (0xe000 bytes) 2024-09-12T16:17:26.336 INFO:teuthology.orchestra.run.smithi204.stdout:4203 trunc from 0xd92a600 to 0xa218400 2024-09-12T16:17:26.336 INFO:teuthology.orchestra.run.smithi204.stdout:4204 punch from 0x31ff600 to 0x3201200, (0x1c00 bytes) 2024-09-12T16:17:26.337 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-12T16:17:26.341 INFO:teuthology.orchestra.run.smithi204.stdout:4207 trunc from 0xa218400 to 0x6547a00 2024-09-12T16:17:26.369 INFO:teuthology.orchestra.run.smithi204.stdout:4209 trunc from 0x6547a00 to 0x70cb600 2024-09-12T16:17:26.396 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T16:17:26.399 INFO:teuthology.orchestra.run.smithi204.stdout:4210 write 0x9f71e00 thru 0x9f807ad (0xe9ae bytes) 2024-09-12T16:17:26.400 INFO:teuthology.orchestra.run.smithi204.stdout:4213 read 0x3e2400 thru 0x3e8901 (0x6502 bytes) 2024-09-12T16:17:26.401 INFO:teuthology.orchestra.run.smithi204.stdout:4214 read 0x7869600 thru 0x7876421 (0xce22 bytes) 2024-09-12T16:17:26.402 INFO:teuthology.orchestra.run.smithi204.stdout:4215 trunc from 0x9f80800 to 0xaacac00 2024-09-12T16:17:26.419 INFO:teuthology.orchestra.run.smithi204.stdout:4216 read 0x9e38000 thru 0x9e464e7 (0xe4e8 bytes) 2024-09-12T16:17:26.421 INFO:teuthology.orchestra.run.smithi204.stdout:truncating to largest ever: 0xee28400 2024-09-12T16:17:26.426 INFO:teuthology.orchestra.run.smithi204.stdout:4218 trunc from 0xaacac00 to 0xee28400 2024-09-12T16:17:26.437 INFO:teuthology.orchestra.run.smithi204.stdout:4219 write 0xcdc2200 thru 0xcdcf2eb (0xd0ec bytes) 2024-09-12T16:17:26.439 INFO:teuthology.orchestra.run.smithi204.stdout:4221 write 0x530a200 thru 0x531282c (0x862d bytes) 2024-09-12T16:17:26.439 INFO:teuthology.orchestra.run.smithi204.stdout:4222 read 0x38d4800 thru 0x38d57ab (0xfac bytes) 2024-09-12T16:17:26.439 INFO:teuthology.orchestra.run.smithi204.stdout:4223 punch from 0x3148000 to 0x3156200, (0xe200 bytes) 2024-09-12T16:17:26.440 INFO:teuthology.orchestra.run.smithi204.stdout:4224 read 0x9241c00 thru 0x9245da8 (0x41a9 bytes) 2024-09-12T16:17:26.440 INFO:teuthology.orchestra.run.smithi204.stdout:4225 read 0xda99200 thru 0xdaa572f (0xc530 bytes) 2024-09-12T16:17:26.440 INFO:teuthology.orchestra.run.smithi204.stdout:4227 punch from 0x8a20400 to 0x8a2e400, (0xe000 bytes) 2024-09-12T16:17:26.454 INFO:teuthology.orchestra.run.smithi204.stdout:4228 trunc from 0xee28400 to 0x2967000 2024-09-12T16:17:26.462 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:26.461+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:26.488 INFO:teuthology.orchestra.run.smithi204.stdout:4229 write 0x1d8cc00 thru 0x1d99af0 (0xcef1 bytes) 2024-09-12T16:17:26.488 INFO:teuthology.orchestra.run.smithi204.stdout:4230 punch from 0xe4fa00 to 0xe51a00, (0x2000 bytes) 2024-09-12T16:17:26.510 INFO:teuthology.orchestra.run.smithi204.stdout:4234 write 0x687e000 thru 0x6882120 (0x4121 bytes) 2024-09-12T16:17:26.511 INFO:teuthology.orchestra.run.smithi204.stdout:4240 write 0x59c7800 thru 0x59ce1a3 (0x69a4 bytes) 2024-09-12T16:17:26.518 INFO:teuthology.orchestra.run.smithi204.stdout:4241 trunc from 0x6882200 to 0xc457800 2024-09-12T16:17:26.525 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:26.526 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:26.526 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:17:26.526 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:26.535 INFO:teuthology.orchestra.run.smithi204.stdout:4244 read 0x13cb600 thru 0x13d5a3c (0xa43d bytes) 2024-09-12T16:17:26.535 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:26.534+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:26.538 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:17:26.540 INFO:teuthology.orchestra.run.smithi204.stdout:4248 read 0x281da00 thru 0x2827dee (0xa3ef bytes) 2024-09-12T16:17:26.540 INFO:teuthology.orchestra.run.smithi204.stdout:4249 write 0x955ba00 thru 0x955c69a (0xc9b bytes) 2024-09-12T16:17:26.540 INFO:teuthology.orchestra.run.smithi204.stdout:4251 clone 30 order 18 su 1024 sc 8 2024-09-12T16:17:26.576 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:17:26.576 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:17:26.593 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:17:26.593 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:17:26.610 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:17:26.610 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:17:26.627 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:17:26.627 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:17:26.635 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:26.635+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:26.644 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:17:26.645 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:17:26.661 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:17:26.661 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:17:26.684 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:26.684 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:26.693 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:17:26.737 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:26.736+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:26.837 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:26.836+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:26.842 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:26.842 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:26.850 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:17:26.938 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:26.937+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:26.957 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:26.957 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:26.966 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:17:27.038 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:27.038+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:27.113 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:27.113 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:27.121 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:17:27.139 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:27.138+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:27.229 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:27.229 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:27.237 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:17:27.241 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:27.239+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:27.340 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:27.339+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:27.363 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:27.363 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:27.372 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:17:27.376 INFO:teuthology.orchestra.run.smithi204.stdout:truncating image image_client.0-clone29 from 0xc457800 (overlap 0x2967000) to 0x0 2024-09-12T16:17:27.441 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:27.440+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:27.505 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:27.506 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:27.514 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:17:27.542 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:27.541+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:27.643 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:27.642+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:27.673 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:27.673 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:27.679 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #28, image image_client.0-clone28 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent29 2024-09-12T16:17:27.682 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:17:27.744 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:27.742+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:27.814 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:27.814 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:27.824 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:17:27.866 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:27.865+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:27.945 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:27.944+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:27.972 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:27.972 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:27.980 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:17:28.046 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:28.045+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:28.096 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:28.096 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:28.106 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:17:28.148 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:28.147+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:28.247 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:28.246+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:28.287 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:28.288 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:28.299 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:17:28.338 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T16:17:28.348 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:28.347+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:28.418 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:28.418 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:28.427 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:17:28.449 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:28.448+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:28.494 INFO:teuthology.orchestra.run.smithi204.stdout:4252 write 0x1303400 thru 0x13103c6 (0xcfc7 bytes) 2024-09-12T16:17:28.495 INFO:teuthology.orchestra.run.smithi204.stdout:4254 write 0x864f800 thru 0x8653b82 (0x4383 bytes) 2024-09-12T16:17:28.500 INFO:teuthology.orchestra.run.smithi204.stdout:4255 trunc from 0xc457800 to 0x8ab4600 2024-09-12T16:17:28.550 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:28.549+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:28.597 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:28.597 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:28.601 INFO:teuthology.orchestra.run.smithi204.stdout:4258 read 0x5970200 thru 0x597a0ae (0x9eaf bytes) 2024-09-12T16:17:28.604 INFO:teuthology.orchestra.run.smithi204.stdout:4259 read 0x3082600 thru 0x308f12b (0xcb2c bytes) 2024-09-12T16:17:28.607 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:17:28.614 INFO:teuthology.orchestra.run.smithi204.stdout:4260 trunc from 0x8ab4600 to 0x3ee8400 2024-09-12T16:17:28.651 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:28.650+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:28.659 INFO:teuthology.orchestra.run.smithi204.stdout:4263 write 0x5e0a00 thru 0x5ee0c1 (0xd6c2 bytes) 2024-09-12T16:17:28.666 INFO:teuthology.orchestra.run.smithi204.stdout:4264 read 0x18a2400 thru 0x18a4e43 (0x2a44 bytes) 2024-09-12T16:17:28.668 INFO:teuthology.orchestra.run.smithi204.stdout:4265 write 0x2457000 thru 0x245f1ad (0x81ae bytes) 2024-09-12T16:17:28.669 INFO:teuthology.orchestra.run.smithi204.stdout:4267 read 0x25b2c00 thru 0x25b41e2 (0x15e3 bytes) 2024-09-12T16:17:28.669 INFO:teuthology.orchestra.run.smithi204.stdout:4269 read 0xc44c00 thru 0xc4786e (0x2c6f bytes) 2024-09-12T16:17:28.673 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T16:17:28.674 INFO:teuthology.orchestra.run.smithi204.stdout:4271 read 0x3ec0000 thru 0x3ecfd71 (0xfd72 bytes) 2024-09-12T16:17:28.676 INFO:teuthology.orchestra.run.smithi204.stdout:4272 trunc from 0x3ee8400 to 0x4bcbe00 2024-09-12T16:17:28.752 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:28.751+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:28.775 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:28.775 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:28.788 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:17:28.852 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:28.851+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:28.862 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:17:28.862 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:17:28.881 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:17:28.881 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:17:28.897 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:17:28.898 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:17:28.915 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:28.915 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:28.915 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:17:28.915 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:17:28.915 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:28.924 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:17:28.926 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:17:28.926 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:17:28.947 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:17:28.948 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:17:28.953 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:28.952+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:28.961 INFO:teuthology.orchestra.run.smithi204.stdout:4273 write 0x45e1c00 thru 0x45e550e (0x390f bytes) 2024-09-12T16:17:28.968 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:17:28.969 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:17:28.970 INFO:teuthology.orchestra.run.smithi204.stdout:4275 trunc from 0x4bcbe00 to 0xbe48c00 2024-09-12T16:17:28.994 INFO:teuthology.orchestra.run.smithi204.stdout:4276 write 0x75ee400 thru 0x75f4391 (0x5f92 bytes) 2024-09-12T16:17:29.008 INFO:teuthology.orchestra.run.smithi204.stdout:4278 trunc from 0xbe48c00 to 0x1484000 2024-09-12T16:17:29.018 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-12T16:17:29.018 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T16:17:29.018 INFO:tasks.thrashosds.thrasher:inject_pause on osd.5 2024-09-12T16:17:29.019 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-12T16:17:29.019 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-12T16:17:29.019 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok config set filestore_inject_stall 3 2024-09-12T16:17:29.057 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:29.054+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:29.081 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:29.081 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:17:29.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:17:29.082 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:17:29.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.082 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3705 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14812160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:29.082 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:17:29.082 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.939243609000002, 2024-09-12T16:17:29.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053368831999999998, 2024-09-12T16:17:29.082 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.082 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.082 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:29.082 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.082 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:29.082 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:29.083 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3705 2024-09-12T16:17:29.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.083 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:17:29.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:17:29.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139932+0000", 2024-09-12T16:17:29.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012762099999999999 2024-09-12T16:17:29.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139935+0000", 2024-09-12T16:17:29.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.119e-06 2024-09-12T16:17:29.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139939+0000", 2024-09-12T16:17:29.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7999999999999998e-06 2024-09-12T16:17:29.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139953+0000", 2024-09-12T16:17:29.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3923999999999999e-05 2024-09-12T16:17:29.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192946+0000", 2024-09-12T16:17:29.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052992971 2024-09-12T16:17:29.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:29.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193035+0000", 2024-09-12T16:17:29.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9040000000000001e-05 2024-09-12T16:17:29.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193174+0000", 2024-09-12T16:17:29.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138357 2024-09-12T16:17:29.086 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.086 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.086 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.087 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3706 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14816256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:29.087 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:17:29.087 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.939088619000003, 2024-09-12T16:17:29.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053341723000000001, 2024-09-12T16:17:29.087 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.087 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.087 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:29.087 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.087 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:29.087 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:29.088 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3706 2024-09-12T16:17:29.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.088 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:17:29.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:17:29.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140090+0000", 2024-09-12T16:17:29.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013020100000000001 2024-09-12T16:17:29.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140097+0000", 2024-09-12T16:17:29.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0709999999999997e-06 2024-09-12T16:17:29.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140103+0000", 2024-09-12T16:17:29.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5450000000000003e-06 2024-09-12T16:17:29.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140106+0000", 2024-09-12T16:17:29.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3739999999999998e-06 2024-09-12T16:17:29.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193190+0000", 2024-09-12T16:17:29.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053084131999999999 2024-09-12T16:17:29.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:29.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193232+0000", 2024-09-12T16:17:29.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1517000000000002e-05 2024-09-12T16:17:29.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193302+0000", 2024-09-12T16:17:29.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9882999999999995e-05 2024-09-12T16:17:29.091 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.091 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.091 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.092 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3707 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14820352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:29.092 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:17:29.092 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.938936630000001, 2024-09-12T16:17:29.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053452771000000003, 2024-09-12T16:17:29.092 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.092 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.092 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:29.092 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.092 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:29.092 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:29.092 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3707 2024-09-12T16:17:29.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.092 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:17:29.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:17:29.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140219+0000", 2024-09-12T16:17:29.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106902 2024-09-12T16:17:29.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140225+0000", 2024-09-12T16:17:29.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3199999999999996e-06 2024-09-12T16:17:29.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140230+0000", 2024-09-12T16:17:29.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8969999999999999e-06 2024-09-12T16:17:29.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.095 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140233+0000", 2024-09-12T16:17:29.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2119999999999999e-06 2024-09-12T16:17:29.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.095 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193339+0000", 2024-09-12T16:17:29.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053105556999999998 2024-09-12T16:17:29.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:29.096 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193431+0000", 2024-09-12T16:17:29.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1837999999999997e-05 2024-09-12T16:17:29.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.096 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.096 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193565+0000", 2024-09-12T16:17:29.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013404500000000001 2024-09-12T16:17:29.096 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.096 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.096 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.096 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3708 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14824448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:29.097 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:17:29.097 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.938807788000005, 2024-09-12T16:17:29.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053468190999999998, 2024-09-12T16:17:29.097 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.097 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.097 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:29.097 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.097 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:29.097 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:29.097 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3708 2024-09-12T16:17:29.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.097 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:17:29.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:17:29.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140351+0000", 2024-09-12T16:17:29.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110096 2024-09-12T16:17:29.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140358+0000", 2024-09-12T16:17:29.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.306e-06 2024-09-12T16:17:29.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140368+0000", 2024-09-12T16:17:29.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0225e-05 2024-09-12T16:17:29.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140372+0000", 2024-09-12T16:17:29.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6169999999999998e-06 2024-09-12T16:17:29.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193594+0000", 2024-09-12T16:17:29.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053222419999999999 2024-09-12T16:17:29.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:29.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193640+0000", 2024-09-12T16:17:29.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.587e-05 2024-09-12T16:17:29.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193709+0000", 2024-09-12T16:17:29.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8657000000000004e-05 2024-09-12T16:17:29.101 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.101 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.101 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.101 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3709 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14828544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:29.101 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:17:29.102 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.938670819999999, 2024-09-12T16:17:29.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594033999999999, 2024-09-12T16:17:29.102 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.102 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.102 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:29.102 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.102 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:29.102 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:29.102 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3709 2024-09-12T16:17:29.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.102 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:17:29.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:17:29.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140499+0000", 2024-09-12T16:17:29.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121019 2024-09-12T16:17:29.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.104 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.104 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140501+0000", 2024-09-12T16:17:29.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2369999999999999e-06 2024-09-12T16:17:29.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.104 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.104 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140506+0000", 2024-09-12T16:17:29.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.639e-06 2024-09-12T16:17:29.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.105 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140509+0000", 2024-09-12T16:17:29.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3419999999999999e-06 2024-09-12T16:17:29.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.105 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193743+0000", 2024-09-12T16:17:29.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053234311999999999 2024-09-12T16:17:29.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:29.105 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193833+0000", 2024-09-12T16:17:29.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9883999999999995e-05 2024-09-12T16:17:29.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193972+0000", 2024-09-12T16:17:29.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138601 2024-09-12T16:17:29.106 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.106 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.106 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.106 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3710 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14832640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:29.107 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:17:29.107 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.938533473999996, 2024-09-12T16:17:29.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053607324999999997, 2024-09-12T16:17:29.107 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.107 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.107 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:29.107 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.107 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:29.107 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:29.107 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3710 2024-09-12T16:17:29.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.107 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:17:29.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:17:29.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140664+0000", 2024-09-12T16:17:29.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014918700000000001 2024-09-12T16:17:29.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140674+0000", 2024-09-12T16:17:29.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8379999999999997e-06 2024-09-12T16:17:29.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140694+0000", 2024-09-12T16:17:29.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0145000000000001e-05 2024-09-12T16:17:29.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140703+0000", 2024-09-12T16:17:29.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5150000000000006e-06 2024-09-12T16:17:29.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194006+0000", 2024-09-12T16:17:29.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053303370000000003 2024-09-12T16:17:29.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:29.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194051+0000", 2024-09-12T16:17:29.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5012000000000002e-05 2024-09-12T16:17:29.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194122+0000", 2024-09-12T16:17:29.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1258000000000001e-05 2024-09-12T16:17:29.111 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.111 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.111 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.111 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3711 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14836736~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:29.111 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:17:29.111 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.938332025999998, 2024-09-12T16:17:29.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053670799999999998, 2024-09-12T16:17:29.112 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.112 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.112 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:29.112 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.112 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:29.112 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:29.112 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3711 2024-09-12T16:17:29.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.112 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.112 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.112 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:17:29.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:17:29.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140782+0000", 2024-09-12T16:17:29.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5549999999999994e-05 2024-09-12T16:17:29.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140786+0000", 2024-09-12T16:17:29.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.89e-06 2024-09-12T16:17:29.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140796+0000", 2024-09-12T16:17:29.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0057e-05 2024-09-12T16:17:29.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140819+0000", 2024-09-12T16:17:29.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3005000000000001e-05 2024-09-12T16:17:29.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.115 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.115 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194159+0000", 2024-09-12T16:17:29.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053340324000000001 2024-09-12T16:17:29.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.115 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:29.115 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194248+0000", 2024-09-12T16:17:29.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9209000000000006e-05 2024-09-12T16:17:29.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.115 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.115 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194387+0000", 2024-09-12T16:17:29.116 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138765 2024-09-12T16:17:29.116 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.116 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.116 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.116 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3712 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14840832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:29.116 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:17:29.116 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.938217567999999, 2024-09-12T16:17:29.116 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053699068000000003, 2024-09-12T16:17:29.116 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.116 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.116 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:29.116 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.117 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:29.117 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:29.117 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3712 2024-09-12T16:17:29.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.117 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.117 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.117 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:17:29.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.117 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.117 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:17:29.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.118 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.118 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140900+0000", 2024-09-12T16:17:29.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9014e-05 2024-09-12T16:17:29.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.118 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.118 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140904+0000", 2024-09-12T16:17:29.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0940000000000001e-06 2024-09-12T16:17:29.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140933+0000", 2024-09-12T16:17:29.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8996000000000002e-05 2024-09-12T16:17:29.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.120 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140945+0000", 2024-09-12T16:17:29.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1909000000000001e-05 2024-09-12T16:17:29.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.120 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.120 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.120 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194415+0000", 2024-09-12T16:17:29.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053470403 2024-09-12T16:17:29.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.120 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.120 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:29.120 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194460+0000", 2024-09-12T16:17:29.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5145000000000002e-05 2024-09-12T16:17:29.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.121 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194530+0000", 2024-09-12T16:17:29.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9506999999999997e-05 2024-09-12T16:17:29.121 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.121 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.121 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.121 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3713 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14844928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:29.121 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:17:29.121 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.938084508000003, 2024-09-12T16:17:29.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053821236000000001, 2024-09-12T16:17:29.122 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.122 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.122 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:29.122 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.122 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:29.122 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:29.122 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3713 2024-09-12T16:17:29.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.122 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:17:29.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:17:29.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141078+0000", 2024-09-12T16:17:29.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114162 2024-09-12T16:17:29.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141090+0000", 2024-09-12T16:17:29.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.19e-05 2024-09-12T16:17:29.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.124 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.124 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141100+0000", 2024-09-12T16:17:29.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0447e-05 2024-09-12T16:17:29.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.124 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.124 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141108+0000", 2024-09-12T16:17:29.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7190000000000001e-06 2024-09-12T16:17:29.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.125 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194564+0000", 2024-09-12T16:17:29.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053455729 2024-09-12T16:17:29.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:29.125 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194652+0000", 2024-09-12T16:17:29.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8288999999999994e-05 2024-09-12T16:17:29.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.125 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194785+0000", 2024-09-12T16:17:29.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013299000000000001 2024-09-12T16:17:29.125 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.125 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.126 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.126 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3714 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14849024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:29.126 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:17:29.126 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.937928579000001, 2024-09-12T16:17:29.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053816382000000003, 2024-09-12T16:17:29.126 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.126 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.126 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:29.126 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.126 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:29.126 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:29.126 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3714 2024-09-12T16:17:29.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.127 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.127 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.127 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:17:29.127 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.127 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.127 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:17:29.127 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.128 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141182+0000", 2024-09-12T16:17:29.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1805999999999997e-05 2024-09-12T16:17:29.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.128 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141185+0000", 2024-09-12T16:17:29.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5930000000000002e-06 2024-09-12T16:17:29.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.129 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.129 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141194+0000", 2024-09-12T16:17:29.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5760000000000006e-06 2024-09-12T16:17:29.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.129 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.129 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141222+0000", 2024-09-12T16:17:29.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8034999999999998e-05 2024-09-12T16:17:29.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.129 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.129 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194817+0000", 2024-09-12T16:17:29.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594887000000001 2024-09-12T16:17:29.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.130 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:29.130 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194860+0000", 2024-09-12T16:17:29.130 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3714999999999997e-05 2024-09-12T16:17:29.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.130 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.130 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194936+0000", 2024-09-12T16:17:29.130 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5770000000000001e-05 2024-09-12T16:17:29.131 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.131 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.131 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.131 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3715 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14853120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:29.131 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:17:29.131 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.937804921999998, 2024-09-12T16:17:29.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053962307000000001, 2024-09-12T16:17:29.131 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.131 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.131 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:29.132 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.132 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:29.132 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:29.132 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3715 2024-09-12T16:17:29.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.132 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:17:29.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.133 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.133 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:17:29.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.133 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.133 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141417+0000", 2024-09-12T16:17:29.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017384099999999999 2024-09-12T16:17:29.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.133 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.133 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141422+0000", 2024-09-12T16:17:29.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7310000000000001e-06 2024-09-12T16:17:29.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.134 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.134 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141434+0000", 2024-09-12T16:17:29.134 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2058e-05 2024-09-12T16:17:29.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.134 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.134 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141442+0000", 2024-09-12T16:17:29.134 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7610000000000007e-06 2024-09-12T16:17:29.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.134 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.134 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194973+0000", 2024-09-12T16:17:29.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053530618000000002 2024-09-12T16:17:29.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.135 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:29.135 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195063+0000", 2024-09-12T16:17:29.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0927000000000005e-05 2024-09-12T16:17:29.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.135 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.135 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195206+0000", 2024-09-12T16:17:29.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142371 2024-09-12T16:17:29.136 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.136 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.136 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.136 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3716 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14857216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:29.136 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:17:29.136 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.937595071999993, 2024-09-12T16:17:29.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053916360000000003, 2024-09-12T16:17:29.136 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.136 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.136 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:29.137 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.137 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:29.137 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:29.137 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3716 2024-09-12T16:17:29.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.137 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.137 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:17:29.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.138 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.138 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:17:29.138 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.138 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.138 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142933+0000", 2024-09-12T16:17:29.138 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014796290000000001 2024-09-12T16:17:29.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.138 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.138 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142937+0000", 2024-09-12T16:17:29.139 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5760000000000002e-06 2024-09-12T16:17:29.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.139 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.139 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142946+0000", 2024-09-12T16:17:29.139 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0380000000000005e-06 2024-09-12T16:17:29.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.139 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.139 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142951+0000", 2024-09-12T16:17:29.139 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9749999999999998e-06 2024-09-12T16:17:29.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.139 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195246+0000", 2024-09-12T16:17:29.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052295358 2024-09-12T16:17:29.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:29.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195299+0000", 2024-09-12T16:17:29.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2976999999999998e-05 2024-09-12T16:17:29.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195370+0000", 2024-09-12T16:17:29.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0807000000000002e-05 2024-09-12T16:17:29.141 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.141 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.141 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.141 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3721 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14877696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:29.141 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:29.141 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.936021620999995, 2024-09-12T16:17:29.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053422994000000001, 2024-09-12T16:17:29.141 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.141 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.141 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:29.141 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.141 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:29.142 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:29.142 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3721 2024-09-12T16:17:29.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.142 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.142 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.142 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:29.142 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.142 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.142 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:29.142 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.143 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.143 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.143 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:29.143 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:17:29.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.143 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.143 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.143 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143028+0000", 2024-09-12T16:17:29.143 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7399999999999991e-07 2024-09-12T16:17:29.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.143 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.143 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.143 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143031+0000", 2024-09-12T16:17:29.144 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7599999999999998e-06 2024-09-12T16:17:29.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.144 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.144 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143034+0000", 2024-09-12T16:17:29.144 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9780000000000001e-06 2024-09-12T16:17:29.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.144 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.144 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196220+0000", 2024-09-12T16:17:29.144 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053186341999999998 2024-09-12T16:17:29.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.144 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:29.145 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196313+0000", 2024-09-12T16:17:29.145 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2676000000000005e-05 2024-09-12T16:17:29.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.145 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.145 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196450+0000", 2024-09-12T16:17:29.145 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137052 2024-09-12T16:17:29.145 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.145 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.145 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.145 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3722 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14881792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:29.145 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:29.146 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.936011729000001, 2024-09-12T16:17:29.146 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053556835999999997, 2024-09-12T16:17:29.146 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.146 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.146 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:29.146 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.146 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:29.146 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:29.146 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3722 2024-09-12T16:17:29.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.146 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.147 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.147 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:29.147 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.147 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.147 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.147 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:29.147 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.147 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.147 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.147 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:29.148 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.11e-07 2024-09-12T16:17:29.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.148 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.148 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.148 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143038+0000", 2024-09-12T16:17:29.148 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2399999999999996e-07 2024-09-12T16:17:29.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.148 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.148 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.148 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143041+0000", 2024-09-12T16:17:29.148 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8030000000000001e-06 2024-09-12T16:17:29.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.149 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.149 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.149 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143043+0000", 2024-09-12T16:17:29.149 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3140000000000002e-06 2024-09-12T16:17:29.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.149 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.149 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.149 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196481+0000", 2024-09-12T16:17:29.149 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053437601000000001 2024-09-12T16:17:29.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.149 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.149 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:29.149 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196525+0000", 2024-09-12T16:17:29.150 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4280000000000003e-05 2024-09-12T16:17:29.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.150 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.150 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196594+0000", 2024-09-12T16:17:29.150 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8702999999999996e-05 2024-09-12T16:17:29.150 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.150 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.150 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.150 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3723 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14885888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:29.150 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:17:29.150 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.936002547000001, 2024-09-12T16:17:29.151 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053815546999999998, 2024-09-12T16:17:29.151 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.151 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.151 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:29.151 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.151 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:29.151 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:29.151 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3723 2024-09-12T16:17:29.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.151 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.151 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.151 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.151 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:17:29.151 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.152 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.152 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.152 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:17:29.152 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.152 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.152 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.152 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148994+0000", 2024-09-12T16:17:29.152 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059481330000000004 2024-09-12T16:17:29.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.152 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.152 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.152 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148999+0000", 2024-09-12T16:17:29.153 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7140000000000001e-06 2024-09-12T16:17:29.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.153 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.153 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.153 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149008+0000", 2024-09-12T16:17:29.153 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4350000000000003e-06 2024-09-12T16:17:29.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.153 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.153 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.153 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149021+0000", 2024-09-12T16:17:29.153 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2514000000000001e-05 2024-09-12T16:17:29.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.153 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.153 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.154 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196630+0000", 2024-09-12T16:17:29.154 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047609758000000002 2024-09-12T16:17:29.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.154 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.154 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:29.154 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196724+0000", 2024-09-12T16:17:29.154 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3522000000000003e-05 2024-09-12T16:17:29.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.154 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.154 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.154 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196861+0000", 2024-09-12T16:17:29.154 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013747100000000001 2024-09-12T16:17:29.154 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.154 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.155 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.155 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.155 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4438 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15719424~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:29.155 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:29.155 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.791121770000004, 2024-09-12T16:17:29.155 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367981000000002, 2024-09-12T16:17:29.155 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.155 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.155 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:29.155 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.155 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:29.155 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:29.156 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4438 2024-09-12T16:17:29.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.156 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.156 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.156 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.156 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:29.156 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.156 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.156 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.156 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:29.156 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.157 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.157 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.157 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:29.157 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3e-07 2024-09-12T16:17:29.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.157 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.157 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.157 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287930+0000", 2024-09-12T16:17:29.157 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-12T16:17:29.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.157 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.157 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.157 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287937+0000", 2024-09-12T16:17:29.157 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.08e-06 2024-09-12T16:17:29.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.158 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.158 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287943+0000", 2024-09-12T16:17:29.158 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5709999999999997e-06 2024-09-12T16:17:29.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.158 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.158 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341068+0000", 2024-09-12T16:17:29.158 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053125101000000001 2024-09-12T16:17:29.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.158 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:29.158 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341154+0000", 2024-09-12T16:17:29.159 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6100999999999994e-05 2024-09-12T16:17:29.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.159 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.159 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.159 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341295+0000", 2024-09-12T16:17:29.159 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014087999999999999 2024-09-12T16:17:29.159 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.159 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.159 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.159 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.159 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4439 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15723520~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:29.159 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:29.160 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.791097609999994, 2024-09-12T16:17:29.160 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053526799, 2024-09-12T16:17:29.160 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.160 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.160 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:29.160 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.160 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:29.160 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:29.160 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4439 2024-09-12T16:17:29.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.160 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.160 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.160 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:29.161 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.161 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.161 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:29.161 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.161 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.161 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:29.161 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-07 2024-09-12T16:17:29.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.161 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287953+0000", 2024-09-12T16:17:29.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1349999999999999e-06 2024-09-12T16:17:29.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287960+0000", 2024-09-12T16:17:29.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-12T16:17:29.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287965+0000", 2024-09-12T16:17:29.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1580000000000004e-06 2024-09-12T16:17:29.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.163 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341332+0000", 2024-09-12T16:17:29.163 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367009 2024-09-12T16:17:29.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:29.163 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341402+0000", 2024-09-12T16:17:29.163 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9759999999999996e-05 2024-09-12T16:17:29.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.163 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341478+0000", 2024-09-12T16:17:29.163 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5412000000000002e-05 2024-09-12T16:17:29.164 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.164 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.164 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.164 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.164 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4440 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15727616~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:29.164 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:29.164 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.791076505999996, 2024-09-12T16:17:29.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053761601999999999, 2024-09-12T16:17:29.164 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.164 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.164 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:29.164 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.164 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:29.165 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:29.165 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4440 2024-09-12T16:17:29.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.165 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.165 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.165 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.165 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:29.165 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.165 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.165 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.165 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:29.165 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.166 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.166 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.166 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:29.166 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:17:29.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.166 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.166 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.166 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287974+0000", 2024-09-12T16:17:29.166 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0540000000000002e-06 2024-09-12T16:17:29.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.166 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.166 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.166 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287980+0000", 2024-09-12T16:17:29.167 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9440000000000002e-06 2024-09-12T16:17:29.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.167 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.167 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.167 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287987+0000", 2024-09-12T16:17:29.167 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5889999999999999e-06 2024-09-12T16:17:29.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.167 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.167 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.167 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341502+0000", 2024-09-12T16:17:29.167 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053515199999999999 2024-09-12T16:17:29.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.168 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.168 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:29.168 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341595+0000", 2024-09-12T16:17:29.168 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3097000000000007e-05 2024-09-12T16:17:29.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.168 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.168 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.168 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341734+0000", 2024-09-12T16:17:29.168 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013832800000000001 2024-09-12T16:17:29.168 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.168 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.168 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.169 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2209 3.1 3:85f36d3b:::rbd_data.1155ccb1894c.0000000000000004:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:29.169 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:17:29.169 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.707391368, 2024-09-12T16:17:29.169 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.060659365, 2024-09-12T16:17:29.169 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.169 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.169 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:29.169 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.170 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:17:29.170 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:17:29.170 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2209 2024-09-12T16:17:29.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.170 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.170 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.170 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:17:29.170 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.170 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.170 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:17:29.170 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.171 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.171 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.171 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371658+0000", 2024-09-12T16:17:29.171 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1570000000000001e-06 2024-09-12T16:17:29.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.171 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.171 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.171 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393414+0000", 2024-09-12T16:17:29.171 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021755495999999999 2024-09-12T16:17:29.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.171 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.171 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.172 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393447+0000", 2024-09-12T16:17:29.172 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3630000000000002e-05 2024-09-12T16:17:29.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.172 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.172 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393462+0000", 2024-09-12T16:17:29.172 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5048999999999999e-05 2024-09-12T16:17:29.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.172 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.172 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393556+0000", 2024-09-12T16:17:29.172 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3549999999999997e-05 2024-09-12T16:17:29.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.173 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:29.173 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393697+0000", 2024-09-12T16:17:29.173 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000141414 2024-09-12T16:17:29.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.173 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T16:17:29.173 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.394944+0000", 2024-09-12T16:17:29.173 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012463039999999999 2024-09-12T16:17:29.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.173 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:29.173 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.431803+0000", 2024-09-12T16:17:29.174 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0368594 2024-09-12T16:17:29.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.174 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:17:29.174 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432268+0000", 2024-09-12T16:17:29.174 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046457600000000002 2024-09-12T16:17:29.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.174 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:17:29.174 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432293+0000", 2024-09-12T16:17:29.174 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.527e-05 2024-09-12T16:17:29.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.175 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.175 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432316+0000", 2024-09-12T16:17:29.175 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3519e-05 2024-09-12T16:17:29.175 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.175 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.175 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.175 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:9400 3.1f 3:feea9999:::rbd_data.1155338d0570.0000000000000007:head [read 32768~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-12T16:17:29.175 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:20.012502+0000", 2024-09-12T16:17:29.175 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.0665463759999998, 2024-09-12T16:17:29.175 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.000678049, 2024-09-12T16:17:29.175 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.176 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.176 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:29.176 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.176 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:29.176 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:29.176 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 9400 2024-09-12T16:17:29.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.176 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.176 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.176 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.176 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012502+0000", 2024-09-12T16:17:29.176 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.176 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.177 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.177 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012502+0000", 2024-09-12T16:17:29.177 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.177 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.177 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012504+0000", 2024-09-12T16:17:29.177 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5939999999999999e-06 2024-09-12T16:17:29.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.177 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.177 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012511+0000", 2024-09-12T16:17:29.177 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0840000000000003e-06 2024-09-12T16:17:29.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.178 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.178 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012525+0000", 2024-09-12T16:17:29.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4538999999999999e-05 2024-09-12T16:17:29.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.178 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.178 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012532+0000", 2024-09-12T16:17:29.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8310000000000003e-06 2024-09-12T16:17:29.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.178 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.178 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012605+0000", 2024-09-12T16:17:29.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2387999999999999e-05 2024-09-12T16:17:29.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.179 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T16:17:29.179 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012617+0000", 2024-09-12T16:17:29.179 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2167999999999999e-05 2024-09-12T16:17:29.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.179 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.179 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:21.012823+0000", 2024-09-12T16:17:29.179 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0002068230000001 2024-09-12T16:17:29.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.179 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:29.180 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:21.012975+0000", 2024-09-12T16:17:29.180 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015196200000000001 2024-09-12T16:17:29.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.180 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.180 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:21.013180+0000", 2024-09-12T16:17:29.180 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020466000000000001 2024-09-12T16:17:29.180 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.180 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.180 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.180 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.180 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.180 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:29.182 INFO:teuthology.orchestra.run.smithi204.stdout:4279 read 0x995400 thru 0x99c005 (0x6c06 bytes) 2024-09-12T16:17:29.182 INFO:teuthology.orchestra.run.smithi204.stdout:4280 punch from 0x767a00 to 0x774600, (0xcc00 bytes) 2024-09-12T16:17:29.183 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:29.183 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-12T16:17:29.183 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:29.183 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:17:29.184 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:29.180+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:29.201 INFO:teuthology.orchestra.run.smithi204.stdout:4281 read 0x1115200 thru 0x111db26 (0x8927 bytes) 2024-09-12T16:17:29.240 INFO:teuthology.orchestra.run.smithi204.stdout:4282 read 0xd88400 thru 0xd8cc47 (0x4848 bytes) 2024-09-12T16:17:29.244 INFO:teuthology.orchestra.run.smithi204.stdout:4283 read 0x8a3e00 thru 0x8b11db (0xd3dc bytes) 2024-09-12T16:17:29.266 INFO:teuthology.orchestra.run.smithi204.stdout:4284 punch from 0x112bc00 to 0x1130a00, (0x4e00 bytes) 2024-09-12T16:17:29.282 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:29.281+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:29.290 INFO:teuthology.orchestra.run.smithi204.stdout:4285 trunc from 0x1484000 to 0x527f800 2024-09-12T16:17:29.305 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2024-09-12T16:17:29.369 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:29.370 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:17:29.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.370 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5577.0:13102 3.2 3:4197cfea:::rbd_data.11552c69b548.0000000000000002:20 [read 3072~1024 out=1024b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91)", 2024-09-12T16:17:29.370 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:29.368736+0000", 2024-09-12T16:17:29.370 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.00073768800000000002, 2024-09-12T16:17:29.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00075262500000000004, 2024-09-12T16:17:29.370 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.370 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.370 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:29.370 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.370 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5577", 2024-09-12T16:17:29.370 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/4222688771", 2024-09-12T16:17:29.370 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 13102 2024-09-12T16:17:29.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.371 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.368736+0000", 2024-09-12T16:17:29.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.368736+0000", 2024-09-12T16:17:29.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.368737+0000", 2024-09-12T16:17:29.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2500000000000001e-07 2024-09-12T16:17:29.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.368739+0000", 2024-09-12T16:17:29.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.446e-06 2024-09-12T16:17:29.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.368751+0000", 2024-09-12T16:17:29.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1732999999999999e-05 2024-09-12T16:17:29.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.368757+0000", 2024-09-12T16:17:29.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9089999999999997e-06 2024-09-12T16:17:29.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.369342+0000", 2024-09-12T16:17:29.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00058509299999999996 2024-09-12T16:17:29.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:29.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.369389+0000", 2024-09-12T16:17:29.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6668000000000001e-05 2024-09-12T16:17:29.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.369489+0000", 2024-09-12T16:17:29.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000100351 2024-09-12T16:17:29.374 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.374 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.374 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.374 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.374 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-12T16:17:29.374 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 1 2024-09-12T16:17:29.375 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:29.380 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:17:29.383 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:29.382+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:29.386 INFO:teuthology.orchestra.run.smithi204.stdout:4286 write 0xdc86e00 thru 0xdc934fd (0xc6fe bytes) 2024-09-12T16:17:29.387 INFO:teuthology.orchestra.run.smithi204.stdout:4291 punch from 0x425a800 to 0x4268800, (0xe000 bytes) 2024-09-12T16:17:29.400 INFO:teuthology.orchestra.run.smithi204.stdout:4292 trunc from 0xdc93600 to 0x65f0800 2024-09-12T16:17:29.437 INFO:teuthology.orchestra.run.smithi204.stdout:4294 read 0x14d6200 thru 0x14e34e7 (0xd2e8 bytes) 2024-09-12T16:17:29.440 INFO:teuthology.orchestra.run.smithi204.stdout:4297 clone 31 order 22 su 65536 sc 13 2024-09-12T16:17:29.484 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:29.483+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:29.508 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:29.509 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:29.509 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:17:29.509 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:17:29.509 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:29.517 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:17:29.585 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:29.584+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:29.665 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:29.666 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:17:29.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:17:29.666 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:17:29.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.666 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2307 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12401664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:29.666 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:17:29.666 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 71.767802853000006, 2024-09-12T16:17:29.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038241450000000003, 2024-09-12T16:17:29.666 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.666 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.666 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2307 2024-09-12T16:17:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:17:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:17:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896220+0000", 2024-09-12T16:17:29.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3500000000000002e-07 2024-09-12T16:17:29.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896222+0000", 2024-09-12T16:17:29.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1720000000000001e-06 2024-09-12T16:17:29.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896228+0000", 2024-09-12T16:17:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0870000000000003e-06 2024-09-12T16:17:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896233+0000", 2024-09-12T16:17:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:17:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934382+0000", 2024-09-12T16:17:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038149566000000003 2024-09-12T16:17:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:29.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934422+0000", 2024-09-12T16:17:29.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0015999999999998e-05 2024-09-12T16:17:29.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934461+0000", 2024-09-12T16:17:29.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8423999999999997e-05 2024-09-12T16:17:29.670 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.670 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.670 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.670 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2308 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12405760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:17:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 71.767783155999993, 2024-09-12T16:17:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038420745999999999, 2024-09-12T16:17:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2308 2024-09-12T16:17:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:17:29.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:17:29.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:17:29.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.58e-07 2024-09-12T16:17:29.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896241+0000", 2024-09-12T16:17:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7940000000000001e-06 2024-09-12T16:17:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896247+0000", 2024-09-12T16:17:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1460000000000001e-06 2024-09-12T16:17:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896252+0000", 2024-09-12T16:17:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6840000000000004e-06 2024-09-12T16:17:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934494+0000", 2024-09-12T16:17:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038242362000000002 2024-09-12T16:17:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934579+0000", 2024-09-12T16:17:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5044999999999996e-05 2024-09-12T16:17:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934660+0000", 2024-09-12T16:17:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0357000000000003e-05 2024-09-12T16:17:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2309 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12409856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:17:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 71.767762575999996, 2024-09-12T16:17:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038504629999999998, 2024-09-12T16:17:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2309 2024-09-12T16:17:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:17:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:17:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:17:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5199999999999998e-07 2024-09-12T16:17:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896263+0000", 2024-09-12T16:17:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4209999999999999e-06 2024-09-12T16:17:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896269+0000", 2024-09-12T16:17:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9449999999999998e-06 2024-09-12T16:17:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896274+0000", 2024-09-12T16:17:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3950000000000003e-06 2024-09-12T16:17:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934686+0000", 2024-09-12T16:17:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038412333999999999 2024-09-12T16:17:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934727+0000", 2024-09-12T16:17:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0649999999999999e-05 2024-09-12T16:17:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934764+0000", 2024-09-12T16:17:29.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7533000000000001e-05 2024-09-12T16:17:29.679 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.679 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.679 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.679 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2310 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12413952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:29.679 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:17:29.679 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 71.767741704000002, 2024-09-12T16:17:29.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038694183, 2024-09-12T16:17:29.679 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2310 2024-09-12T16:17:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:17:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:17:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896281+0000", 2024-09-12T16:17:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1399999999999997e-07 2024-09-12T16:17:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896283+0000", 2024-09-12T16:17:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9549999999999999e-06 2024-09-12T16:17:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896289+0000", 2024-09-12T16:17:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8669999999999999e-06 2024-09-12T16:17:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896301+0000", 2024-09-12T16:17:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1807999999999999e-05 2024-09-12T16:17:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934798+0000", 2024-09-12T16:17:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038497591999999997 2024-09-12T16:17:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934885+0000", 2024-09-12T16:17:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7149000000000002e-05 2024-09-12T16:17:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934975+0000", 2024-09-12T16:17:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9297999999999998e-05 2024-09-12T16:17:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.684 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2311 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12418048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:29.684 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:17:29.684 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 71.767714448000007, 2024-09-12T16:17:29.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038768558000000002, 2024-09-12T16:17:29.684 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.684 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.684 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:29.684 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.684 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:29.684 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:29.684 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2311 2024-09-12T16:17:29.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.684 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:17:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:17:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:17:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.63e-07 2024-09-12T16:17:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896310+0000", 2024-09-12T16:17:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1560000000000002e-06 2024-09-12T16:17:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896316+0000", 2024-09-12T16:17:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0249999999999999e-06 2024-09-12T16:17:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896322+0000", 2024-09-12T16:17:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6400000000000002e-06 2024-09-12T16:17:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934997+0000", 2024-09-12T16:17:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038674565000000001 2024-09-12T16:17:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935037+0000", 2024-09-12T16:17:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0485999999999998e-05 2024-09-12T16:17:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935076+0000", 2024-09-12T16:17:29.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9223e-05 2024-09-12T16:17:29.688 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.688 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.688 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.688 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2312 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12422144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:29.688 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:17:29.688 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 71.767693754999996, 2024-09-12T16:17:29.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038856784999999998, 2024-09-12T16:17:29.688 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.688 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.688 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:29.688 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2312 2024-09-12T16:17:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:17:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:17:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896329+0000", 2024-09-12T16:17:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5499999999999999e-07 2024-09-12T16:17:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896337+0000", 2024-09-12T16:17:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0819999999999999e-06 2024-09-12T16:17:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896343+0000", 2024-09-12T16:17:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.263e-06 2024-09-12T16:17:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896348+0000", 2024-09-12T16:17:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8860000000000003e-06 2024-09-12T16:17:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935097+0000", 2024-09-12T16:17:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038748818999999997 2024-09-12T16:17:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935141+0000", 2024-09-12T16:17:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4175000000000003e-05 2024-09-12T16:17:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935185+0000", 2024-09-12T16:17:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4205000000000001e-05 2024-09-12T16:17:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2313 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12426240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:17:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 71.767667540000005, 2024-09-12T16:17:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038928683999999998, 2024-09-12T16:17:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.693 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.693 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:29.693 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.693 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:29.693 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:29.693 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2313 2024-09-12T16:17:29.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.693 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:17:29.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:17:29.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:17:29.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0400000000000002e-07 2024-09-12T16:17:29.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896357+0000", 2024-09-12T16:17:29.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.097e-06 2024-09-12T16:17:29.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896363+0000", 2024-09-12T16:17:29.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5119999999999999e-06 2024-09-12T16:17:29.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896374+0000", 2024-09-12T16:17:29.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1381e-05 2024-09-12T16:17:29.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935205+0000", 2024-09-12T16:17:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038830549999999998 2024-09-12T16:17:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935244+0000", 2024-09-12T16:17:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9520000000000001e-05 2024-09-12T16:17:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935283+0000", 2024-09-12T16:17:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9220000000000001e-05 2024-09-12T16:17:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2314 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12430336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:17:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 71.767630370000006, 2024-09-12T16:17:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039008137999999998, 2024-09-12T16:17:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2314 2024-09-12T16:17:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:17:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:17:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:17:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6499999999999999e-07 2024-09-12T16:17:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896395+0000", 2024-09-12T16:17:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2960000000000001e-06 2024-09-12T16:17:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896402+0000", 2024-09-12T16:17:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2280000000000001e-06 2024-09-12T16:17:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896407+0000", 2024-09-12T16:17:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3630000000000002e-06 2024-09-12T16:17:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935302+0000", 2024-09-12T16:17:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038895181000000001 2024-09-12T16:17:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935343+0000", 2024-09-12T16:17:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0590999999999998e-05 2024-09-12T16:17:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935400+0000", 2024-09-12T16:17:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7014e-05 2024-09-12T16:17:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2315 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12434432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:17:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 71.767607718999997, 2024-09-12T16:17:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039083892000000002, 2024-09-12T16:17:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2315 2024-09-12T16:17:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:17:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:17:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896415+0000", 2024-09-12T16:17:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3300000000000002e-07 2024-09-12T16:17:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896421+0000", 2024-09-12T16:17:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7579999999999998e-06 2024-09-12T16:17:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896427+0000", 2024-09-12T16:17:29.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3029999999999996e-06 2024-09-12T16:17:29.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896432+0000", 2024-09-12T16:17:29.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.215e-06 2024-09-12T16:17:29.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935420+0000", 2024-09-12T16:17:29.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038987727 2024-09-12T16:17:29.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935460+0000", 2024-09-12T16:17:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9817999999999997e-05 2024-09-12T16:17:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935498+0000", 2024-09-12T16:17:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8438e-05 2024-09-12T16:17:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2316 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12438528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:17:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 71.767583067000004, 2024-09-12T16:17:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039160043999999998, 2024-09-12T16:17:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2316 2024-09-12T16:17:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:17:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:17:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901945+0000", 2024-09-12T16:17:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055056050000000002 2024-09-12T16:17:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901950+0000", 2024-09-12T16:17:29.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2490000000000001e-06 2024-09-12T16:17:29.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901966+0000", 2024-09-12T16:17:29.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6325e-05 2024-09-12T16:17:29.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901974+0000", 2024-09-12T16:17:29.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7570000000000004e-06 2024-09-12T16:17:29.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935518+0000", 2024-09-12T16:17:29.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033543587999999999 2024-09-12T16:17:29.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:29.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935559+0000", 2024-09-12T16:17:29.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1746000000000003e-05 2024-09-12T16:17:29.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935599+0000", 2024-09-12T16:17:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9774000000000002e-05 2024-09-12T16:17:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1571 3.b 3:d046566d:::rbd_data.1155525b14e3.0000000000000001:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:17:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:17:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.511458025000003, 2024-09-12T16:17:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064439785999999999, 2024-09-12T16:17:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:17:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:17:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1571 2024-09-12T16:17:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:17:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:17:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:17:29.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5400000000000002e-07 2024-09-12T16:17:29.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152567+0000", 2024-09-12T16:17:29.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.131e-06 2024-09-12T16:17:29.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152574+0000", 2024-09-12T16:17:29.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1840000000000002e-06 2024-09-12T16:17:29.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152579+0000", 2024-09-12T16:17:29.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.152e-06 2024-09-12T16:17:29.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153671+0000", 2024-09-12T16:17:29.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001092078 2024-09-12T16:17:29.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153779+0000", 2024-09-12T16:17:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108461 2024-09-12T16:17:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217004+0000", 2024-09-12T16:17:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.063224426 2024-09-12T16:17:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.715 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1581 3.4 3:22e34893:::rbd_data.1155525b14e3.0000000000000005:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:17:29.715 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:17:29.715 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.5113609, 2024-09-12T16:17:29.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064484407999999993, 2024-09-12T16:17:29.715 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.715 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.715 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:29.715 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.715 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:17:29.715 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:17:29.715 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1581 2024-09-12T16:17:29.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.715 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:17:29.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:17:29.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152662+0000", 2024-09-12T16:17:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.65e-07 2024-09-12T16:17:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152664+0000", 2024-09-12T16:17:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9829999999999999e-06 2024-09-12T16:17:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152670+0000", 2024-09-12T16:17:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2260000000000002e-06 2024-09-12T16:17:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152675+0000", 2024-09-12T16:17:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7990000000000001e-06 2024-09-12T16:17:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.216945+0000", 2024-09-12T16:17:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064270341999999994 2024-09-12T16:17:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217040+0000", 2024-09-12T16:17:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5242999999999996e-05 2024-09-12T16:17:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217146+0000", 2024-09-12T16:17:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010545 2024-09-12T16:17:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2207 3.0 3:05fdc61f:::rbd_data.1155ccb1894c.0000000000000003:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:17:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 32.293317338999998, 2024-09-12T16:17:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.05105382, 2024-09-12T16:17:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:17:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:17:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2207 2024-09-12T16:17:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:17:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:17:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370706+0000", 2024-09-12T16:17:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7800000000000001e-07 2024-09-12T16:17:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391581+0000", 2024-09-12T16:17:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020875624999999998 2024-09-12T16:17:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391608+0000", 2024-09-12T16:17:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6412999999999999e-05 2024-09-12T16:17:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391618+0000", 2024-09-12T16:17:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9240000000000002e-06 2024-09-12T16:17:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391705+0000", 2024-09-12T16:17:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7489000000000002e-05 2024-09-12T16:17:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391838+0000", 2024-09-12T16:17:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132865 2024-09-12T16:17:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 2", 2024-09-12T16:17:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.392587+0000", 2024-09-12T16:17:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074930000000000005 2024-09-12T16:17:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.420095+0000", 2024-09-12T16:17:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027507949 2024-09-12T16:17:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:17:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421610+0000", 2024-09-12T16:17:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001515195 2024-09-12T16:17:29.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:17:29.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421681+0000", 2024-09-12T16:17:29.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0320000000000004e-05 2024-09-12T16:17:29.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421759+0000", 2024-09-12T16:17:29.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7961999999999997e-05 2024-09-12T16:17:29.724 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.724 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.724 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5577.0:12725 3.0 3:02074383:::rbd_data.11552c69b548.0000000000000011:20 [read 785408~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-12T16:17:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:29.288770+0000", 2024-09-12T16:17:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.37525232800000002, 2024-09-12T16:17:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038316849, 2024-09-12T16:17:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5577", 2024-09-12T16:17:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/4222688771", 2024-09-12T16:17:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 12725 2024-09-12T16:17:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288770+0000", 2024-09-12T16:17:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288770+0000", 2024-09-12T16:17:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288770+0000", 2024-09-12T16:17:29.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8500000000000002e-07 2024-09-12T16:17:29.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288772+0000", 2024-09-12T16:17:29.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2689999999999998e-06 2024-09-12T16:17:29.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288779+0000", 2024-09-12T16:17:29.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8310000000000003e-06 2024-09-12T16:17:29.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288784+0000", 2024-09-12T16:17:29.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1529999999999996e-06 2024-09-12T16:17:29.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.326899+0000", 2024-09-12T16:17:29.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038114980999999999 2024-09-12T16:17:29.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:29.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.326990+0000", 2024-09-12T16:17:29.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0191000000000004e-05 2024-09-12T16:17:29.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327087+0000", 2024-09-12T16:17:29.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7039000000000004e-05 2024-09-12T16:17:29.729 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.729 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.729 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.729 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5577.0:12726 3.0 3:02074383:::rbd_data.11552c69b548.0000000000000011:20 [read 793600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-12T16:17:29.729 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:29.288794+0000", 2024-09-12T16:17:29.729 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.375228377, 2024-09-12T16:17:29.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038526029000000003, 2024-09-12T16:17:29.729 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.730 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.730 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:29.730 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.730 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5577", 2024-09-12T16:17:29.730 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/4222688771", 2024-09-12T16:17:29.730 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 12726 2024-09-12T16:17:29.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.730 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288794+0000", 2024-09-12T16:17:29.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288794+0000", 2024-09-12T16:17:29.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288794+0000", 2024-09-12T16:17:29.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2799999999999996e-07 2024-09-12T16:17:29.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288797+0000", 2024-09-12T16:17:29.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3920000000000001e-06 2024-09-12T16:17:29.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288804+0000", 2024-09-12T16:17:29.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8430000000000004e-06 2024-09-12T16:17:29.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288809+0000", 2024-09-12T16:17:29.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1460000000000004e-06 2024-09-12T16:17:29.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327130+0000", 2024-09-12T16:17:29.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038320982000000003 2024-09-12T16:17:29.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.733 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:29.733 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327216+0000", 2024-09-12T16:17:29.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5991999999999999e-05 2024-09-12T16:17:29.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.733 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.733 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327320+0000", 2024-09-12T16:17:29.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000104146 2024-09-12T16:17:29.733 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.733 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.733 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.734 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5577.0:12727 3.0 3:02074383:::rbd_data.11552c69b548.0000000000000011:20 [read 801792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-12T16:17:29.734 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:29.288838+0000", 2024-09-12T16:17:29.734 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.37518455299999998, 2024-09-12T16:17:29.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038705804000000003, 2024-09-12T16:17:29.734 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.734 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.734 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:29.734 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.734 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5577", 2024-09-12T16:17:29.734 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/4222688771", 2024-09-12T16:17:29.734 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 12727 2024-09-12T16:17:29.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.734 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288838+0000", 2024-09-12T16:17:29.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288838+0000", 2024-09-12T16:17:29.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288838+0000", 2024-09-12T16:17:29.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8299999999999997e-07 2024-09-12T16:17:29.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288840+0000", 2024-09-12T16:17:29.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.396e-06 2024-09-12T16:17:29.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288851+0000", 2024-09-12T16:17:29.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0312999999999999e-05 2024-09-12T16:17:29.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288857+0000", 2024-09-12T16:17:29.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7570000000000001e-06 2024-09-12T16:17:29.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327361+0000", 2024-09-12T16:17:29.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038504069000000002 2024-09-12T16:17:29.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:29.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327446+0000", 2024-09-12T16:17:29.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5542000000000002e-05 2024-09-12T16:17:29.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327543+0000", 2024-09-12T16:17:29.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7244000000000006e-05 2024-09-12T16:17:29.738 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.738 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.738 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.738 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5577.0:12728 3.0 3:02074383:::rbd_data.11552c69b548.0000000000000011:20 [read 809984~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-12T16:17:29.738 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:29.288864+0000", 2024-09-12T16:17:29.738 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.37515773800000002, 2024-09-12T16:17:29.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038914837000000001, 2024-09-12T16:17:29.738 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.738 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.738 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:29.738 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.738 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5577", 2024-09-12T16:17:29.739 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/4222688771", 2024-09-12T16:17:29.739 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 12728 2024-09-12T16:17:29.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.739 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288864+0000", 2024-09-12T16:17:29.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288864+0000", 2024-09-12T16:17:29.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288865+0000", 2024-09-12T16:17:29.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-07 2024-09-12T16:17:29.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288867+0000", 2024-09-12T16:17:29.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.092e-06 2024-09-12T16:17:29.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288873+0000", 2024-09-12T16:17:29.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0020000000000003e-06 2024-09-12T16:17:29.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288878+0000", 2024-09-12T16:17:29.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2700000000000004e-06 2024-09-12T16:17:29.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327588+0000", 2024-09-12T16:17:29.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038709660999999999 2024-09-12T16:17:29.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:29.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327673+0000", 2024-09-12T16:17:29.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5370000000000004e-05 2024-09-12T16:17:29.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327779+0000", 2024-09-12T16:17:29.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000105957 2024-09-12T16:17:29.742 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.742 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.742 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.742 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5577.0:12729 3.0 3.c1c2e040 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-12T16:17:29.742 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:29.288885+0000", 2024-09-12T16:17:29.742 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.375137412, 2024-09-12T16:17:29.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038952112999999997, 2024-09-12T16:17:29.742 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.743 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.743 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:17:29.743 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.743 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5577", 2024-09-12T16:17:29.743 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/4222688771", 2024-09-12T16:17:29.743 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 12729 2024-09-12T16:17:29.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.743 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288885+0000", 2024-09-12T16:17:29.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288885+0000", 2024-09-12T16:17:29.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288885+0000", 2024-09-12T16:17:29.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9299999999999999e-07 2024-09-12T16:17:29.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288887+0000", 2024-09-12T16:17:29.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9589999999999998e-06 2024-09-12T16:17:29.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288893+0000", 2024-09-12T16:17:29.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8579999999999996e-06 2024-09-12T16:17:29.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288898+0000", 2024-09-12T16:17:29.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-06 2024-09-12T16:17:29.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327827+0000", 2024-09-12T16:17:29.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038928782000000002 2024-09-12T16:17:29.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327837+0000", 2024-09-12T16:17:29.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0271e-05 2024-09-12T16:17:29.746 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.746 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.746 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.746 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5577.0:12730 3.0 3.c1c2e040 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-12T16:17:29.746 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:29.288904+0000", 2024-09-12T16:17:29.746 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.37511810400000001, 2024-09-12T16:17:29.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038984576999999999, 2024-09-12T16:17:29.746 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.747 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.747 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:17:29.747 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.747 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5577", 2024-09-12T16:17:29.747 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/4222688771", 2024-09-12T16:17:29.747 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 12730 2024-09-12T16:17:29.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.747 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288904+0000", 2024-09-12T16:17:29.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288904+0000", 2024-09-12T16:17:29.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288904+0000", 2024-09-12T16:17:29.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.65e-07 2024-09-12T16:17:29.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288906+0000", 2024-09-12T16:17:29.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9549999999999999e-06 2024-09-12T16:17:29.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288912+0000", 2024-09-12T16:17:29.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9460000000000003e-06 2024-09-12T16:17:29.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288926+0000", 2024-09-12T16:17:29.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3540000000000001e-05 2024-09-12T16:17:29.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327882+0000", 2024-09-12T16:17:29.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038956565999999998 2024-09-12T16:17:29.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327889+0000", 2024-09-12T16:17:29.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2049999999999999e-06 2024-09-12T16:17:29.750 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.750 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.750 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.750 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5577.0:12731 3.0 3.c1c2e040 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-12T16:17:29.750 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:29.288934+0000", 2024-09-12T16:17:29.750 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.37508772800000001, 2024-09-12T16:17:29.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039017193999999998, 2024-09-12T16:17:29.751 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:29.751 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:29.751 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:17:29.751 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:29.751 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5577", 2024-09-12T16:17:29.751 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/4222688771", 2024-09-12T16:17:29.751 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 12731 2024-09-12T16:17:29.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.751 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:29.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.751 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:29.751 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288934+0000", 2024-09-12T16:17:29.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:29.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288934+0000", 2024-09-12T16:17:29.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:29.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:29.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288935+0000", 2024-09-12T16:17:29.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7599999999999998e-07 2024-09-12T16:17:29.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:29.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288937+0000", 2024-09-12T16:17:29.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4540000000000001e-06 2024-09-12T16:17:29.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:29.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288944+0000", 2024-09-12T16:17:29.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4980000000000003e-06 2024-09-12T16:17:29.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:29.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288949+0000", 2024-09-12T16:17:29.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1399999999999999e-06 2024-09-12T16:17:29.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:29.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327944+0000", 2024-09-12T16:17:29.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038994859999999999 2024-09-12T16:17:29.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:29.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:29.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:29.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327952+0000", 2024-09-12T16:17:29.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8660000000000006e-06 2024-09-12T16:17:29.754 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.754 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.754 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.754 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:29.754 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:29.754 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:29.756 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:17:29.756 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:29.755+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:29.856 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:29.856+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:29.903 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:29.903 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:29.903 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:17:29.903 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:29.912 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:17:29.957 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:29.956+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:30.018 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:30.019 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:30.019 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:17:30.019 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:17:30.019 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:30.027 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:17:30.071 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:30.070+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:30.136 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:30.136 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:17:30.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:17:30.136 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:17:30.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.136 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2213 3.18 3:1944e921:::rbd_data.1155ccb1894c.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:30.136 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:17:30.136 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 32.759072783999997, 2024-09-12T16:17:30.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.055657836000000002, 2024-09-12T16:17:30.136 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:30.137 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:30.137 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:30.137 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:30.137 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:17:30.137 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:17:30.137 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2213 2024-09-12T16:17:30.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.137 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:30.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.137 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:30.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:17:30.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.138 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:30.138 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:17:30.138 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.138 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:30.138 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375351+0000", 2024-09-12T16:17:30.138 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.556e-06 2024-09-12T16:17:30.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.138 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:30.138 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.399989+0000", 2024-09-12T16:17:30.138 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024637949999999999 2024-09-12T16:17:30.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.139 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:30.139 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400038+0000", 2024-09-12T16:17:30.139 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9187999999999997e-05 2024-09-12T16:17:30.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.139 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.139 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400056+0000", 2024-09-12T16:17:30.139 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8451e-05 2024-09-12T16:17:30.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.139 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:30.139 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400151+0000", 2024-09-12T16:17:30.139 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5026999999999997e-05 2024-09-12T16:17:30.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:30.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400345+0000", 2024-09-12T16:17:30.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019352900000000001 2024-09-12T16:17:30.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 1", 2024-09-12T16:17:30.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.401319+0000", 2024-09-12T16:17:30.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00097419399999999995 2024-09-12T16:17:30.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:17:30.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.429350+0000", 2024-09-12T16:17:30.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028030607999999999 2024-09-12T16:17:30.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:30.141 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.430907+0000", 2024-09-12T16:17:30.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001557466 2024-09-12T16:17:30.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:17:30.141 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.430966+0000", 2024-09-12T16:17:30.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9437e-05 2024-09-12T16:17:30.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.142 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:30.142 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.431007+0000", 2024-09-12T16:17:30.142 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0429999999999997e-05 2024-09-12T16:17:30.142 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.142 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:30.142 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.142 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6725 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2392064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:30.142 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.557452+0000", 2024-09-12T16:17:30.142 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.576970117999998, 2024-09-12T16:17:30.142 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045294112999999997, 2024-09-12T16:17:30.142 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:30.143 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:30.143 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:30.143 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:30.143 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:30.143 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:30.143 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6725 2024-09-12T16:17:30.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.143 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:30.143 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.143 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:30.143 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557452+0000", 2024-09-12T16:17:30.143 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.144 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:30.144 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557452+0000", 2024-09-12T16:17:30.144 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.144 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:30.144 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557693+0000", 2024-09-12T16:17:30.144 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024098699999999999 2024-09-12T16:17:30.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.144 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:30.144 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557697+0000", 2024-09-12T16:17:30.144 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8489999999999999e-06 2024-09-12T16:17:30.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.145 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:30.145 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557707+0000", 2024-09-12T16:17:30.145 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0356999999999999e-05 2024-09-12T16:17:30.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.145 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.145 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557714+0000", 2024-09-12T16:17:30.145 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0219999999999999e-06 2024-09-12T16:17:30.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.145 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:30.145 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.602612+0000", 2024-09-12T16:17:30.146 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044897907000000001 2024-09-12T16:17:30.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.146 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:30.146 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.602683+0000", 2024-09-12T16:17:30.146 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1171e-05 2024-09-12T16:17:30.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.146 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:30.146 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.602746+0000", 2024-09-12T16:17:30.146 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2819999999999998e-05 2024-09-12T16:17:30.146 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.146 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:30.146 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.147 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.147 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6727 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2422784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:30.147 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.557749+0000", 2024-09-12T16:17:30.147 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.576672518999999, 2024-09-12T16:17:30.147 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045329659000000001, 2024-09-12T16:17:30.147 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:30.147 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:30.147 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:30.147 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:30.147 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:30.147 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:30.147 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6727 2024-09-12T16:17:30.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.148 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:30.148 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.148 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:30.148 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557749+0000", 2024-09-12T16:17:30.148 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.148 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.148 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:30.148 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557749+0000", 2024-09-12T16:17:30.148 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.148 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.148 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:30.149 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557750+0000", 2024-09-12T16:17:30.149 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6600000000000002e-07 2024-09-12T16:17:30.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.149 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.149 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:30.149 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557752+0000", 2024-09-12T16:17:30.149 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.278e-06 2024-09-12T16:17:30.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.149 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.149 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:30.149 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557759+0000", 2024-09-12T16:17:30.149 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7329999999999997e-06 2024-09-12T16:17:30.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.150 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.150 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557764+0000", 2024-09-12T16:17:30.150 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0390000000000004e-06 2024-09-12T16:17:30.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.150 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:30.150 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.602943+0000", 2024-09-12T16:17:30.150 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045179035999999999 2024-09-12T16:17:30.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.150 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:30.150 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603016+0000", 2024-09-12T16:17:30.151 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2999999999999999e-05 2024-09-12T16:17:30.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.151 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.151 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:30.151 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603079+0000", 2024-09-12T16:17:30.151 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3107000000000004e-05 2024-09-12T16:17:30.151 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.151 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:30.151 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.152 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.152 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6728 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2439168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:30.152 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.557771+0000", 2024-09-12T16:17:30.152 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.576650643000001, 2024-09-12T16:17:30.152 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045474239, 2024-09-12T16:17:30.152 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:30.152 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:30.152 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:30.152 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:30.152 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:30.152 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:30.152 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6728 2024-09-12T16:17:30.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.152 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:30.153 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.153 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:30.153 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557771+0000", 2024-09-12T16:17:30.153 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.153 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.153 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:30.153 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557771+0000", 2024-09-12T16:17:30.153 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.153 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.153 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:30.153 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557772+0000", 2024-09-12T16:17:30.153 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5400000000000002e-07 2024-09-12T16:17:30.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.154 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.154 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:30.154 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557774+0000", 2024-09-12T16:17:30.154 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.165e-06 2024-09-12T16:17:30.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.154 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.154 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:30.154 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557782+0000", 2024-09-12T16:17:30.154 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3289999999999994e-06 2024-09-12T16:17:30.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.154 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.154 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.154 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557787+0000", 2024-09-12T16:17:30.154 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1909999999999999e-06 2024-09-12T16:17:30.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.154 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.155 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:30.155 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603110+0000", 2024-09-12T16:17:30.155 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045322710000000002 2024-09-12T16:17:30.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.155 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.155 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:30.155 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603182+0000", 2024-09-12T16:17:30.155 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1755999999999995e-05 2024-09-12T16:17:30.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.155 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.155 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:30.155 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603245+0000", 2024-09-12T16:17:30.155 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3633999999999994e-05 2024-09-12T16:17:30.155 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.156 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:30.156 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.156 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.156 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6729 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2454528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:30.156 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.557794+0000", 2024-09-12T16:17:30.156 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.576627861999999, 2024-09-12T16:17:30.156 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045614517, 2024-09-12T16:17:30.156 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:30.156 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:30.156 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:30.156 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:30.156 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:30.157 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:30.157 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6729 2024-09-12T16:17:30.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.157 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:30.157 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.157 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:30.157 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557794+0000", 2024-09-12T16:17:30.157 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.157 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.157 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:30.157 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557794+0000", 2024-09-12T16:17:30.157 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.157 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.158 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:30.158 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557879+0000", 2024-09-12T16:17:30.158 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5130000000000007e-05 2024-09-12T16:17:30.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.158 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:30.158 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557884+0000", 2024-09-12T16:17:30.158 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2390000000000002e-06 2024-09-12T16:17:30.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.158 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:30.158 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557894+0000", 2024-09-12T16:17:30.158 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4800000000000007e-06 2024-09-12T16:17:30.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.158 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.159 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557900+0000", 2024-09-12T16:17:30.159 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5610000000000004e-06 2024-09-12T16:17:30.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.159 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.159 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:30.159 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603273+0000", 2024-09-12T16:17:30.159 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045372799999999998 2024-09-12T16:17:30.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.159 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.159 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:30.159 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603345+0000", 2024-09-12T16:17:30.159 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1562000000000004e-05 2024-09-12T16:17:30.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.160 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:30.160 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603408+0000", 2024-09-12T16:17:30.160 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3744999999999994e-05 2024-09-12T16:17:30.160 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.160 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:30.160 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.160 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6730 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2469888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:30.160 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.557911+0000", 2024-09-12T16:17:30.160 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.576510464999998, 2024-09-12T16:17:30.160 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045661090000000001, 2024-09-12T16:17:30.161 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:30.161 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:30.161 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:30.161 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:30.161 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:30.161 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:30.161 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6730 2024-09-12T16:17:30.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.161 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:30.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.161 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:30.161 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557911+0000", 2024-09-12T16:17:30.161 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:30.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557911+0000", 2024-09-12T16:17:30.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:30.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557912+0000", 2024-09-12T16:17:30.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8299999999999997e-07 2024-09-12T16:17:30.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:30.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557914+0000", 2024-09-12T16:17:30.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.531e-06 2024-09-12T16:17:30.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:30.163 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557927+0000", 2024-09-12T16:17:30.163 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2685e-05 2024-09-12T16:17:30.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.163 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557932+0000", 2024-09-12T16:17:30.163 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3020000000000002e-06 2024-09-12T16:17:30.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:30.163 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603436+0000", 2024-09-12T16:17:30.163 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045503210000000002 2024-09-12T16:17:30.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:30.164 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603508+0000", 2024-09-12T16:17:30.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2792000000000004e-05 2024-09-12T16:17:30.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.164 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.164 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:30.164 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603572+0000", 2024-09-12T16:17:30.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4086999999999998e-05 2024-09-12T16:17:30.164 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.164 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:30.164 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.164 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.164 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6731 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2485248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:30.164 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.557942+0000", 2024-09-12T16:17:30.165 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.576480265000001, 2024-09-12T16:17:30.165 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045794662, 2024-09-12T16:17:30.165 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:30.165 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:30.165 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:30.165 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:30.165 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:30.165 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:30.165 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6731 2024-09-12T16:17:30.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.165 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:30.165 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.165 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:30.165 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557942+0000", 2024-09-12T16:17:30.165 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.166 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.166 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:30.166 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557942+0000", 2024-09-12T16:17:30.166 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.166 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.166 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:30.166 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559076+0000", 2024-09-12T16:17:30.166 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011348280000000001 2024-09-12T16:17:30.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.166 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.166 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:30.167 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559081+0000", 2024-09-12T16:17:30.167 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6820000000000002e-06 2024-09-12T16:17:30.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.167 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.167 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:30.167 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559089+0000", 2024-09-12T16:17:30.167 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0469999999999994e-06 2024-09-12T16:17:30.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.167 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.167 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.167 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559095+0000", 2024-09-12T16:17:30.167 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.212e-06 2024-09-12T16:17:30.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.168 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.168 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:30.168 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603601+0000", 2024-09-12T16:17:30.168 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044505321 2024-09-12T16:17:30.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.168 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.168 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:30.168 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603675+0000", 2024-09-12T16:17:30.168 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4455000000000005e-05 2024-09-12T16:17:30.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.168 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.168 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:30.168 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603736+0000", 2024-09-12T16:17:30.169 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1117000000000005e-05 2024-09-12T16:17:30.169 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.169 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:30.169 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.169 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6735 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2547712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:30.169 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.559184+0000", 2024-09-12T16:17:30.169 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.575237418, 2024-09-12T16:17:30.169 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045228008, 2024-09-12T16:17:30.169 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:30.169 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:30.169 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:30.170 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:30.170 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:30.170 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:30.170 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6735 2024-09-12T16:17:30.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.170 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:30.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.170 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:30.170 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559184+0000", 2024-09-12T16:17:30.170 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.170 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:30.170 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559184+0000", 2024-09-12T16:17:30.171 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.171 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.171 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:30.171 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559185+0000", 2024-09-12T16:17:30.171 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8100000000000003e-07 2024-09-12T16:17:30.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.171 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.171 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:30.171 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559187+0000", 2024-09-12T16:17:30.171 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9309999999999998e-06 2024-09-12T16:17:30.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.171 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.171 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:30.172 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559193+0000", 2024-09-12T16:17:30.172 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3629999999999999e-06 2024-09-12T16:17:30.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.172 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.172 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559200+0000", 2024-09-12T16:17:30.172 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6950000000000003e-06 2024-09-12T16:17:30.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.172 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:30.172 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604265+0000", 2024-09-12T16:17:30.172 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045064924999999999 2024-09-12T16:17:30.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.173 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:30.173 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604344+0000", 2024-09-12T16:17:30.173 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8830000000000002e-05 2024-09-12T16:17:30.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.173 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:30.173 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604412+0000", 2024-09-12T16:17:30.173 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8683000000000006e-05 2024-09-12T16:17:30.173 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.173 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:30.173 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.173 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6736 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2564096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:30.174 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.559207+0000", 2024-09-12T16:17:30.174 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.575214455000001, 2024-09-12T16:17:30.174 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045365924000000002, 2024-09-12T16:17:30.174 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:30.174 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:30.174 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:30.174 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:30.174 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:30.174 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:30.174 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6736 2024-09-12T16:17:30.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.174 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:30.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.174 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:30.175 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559207+0000", 2024-09-12T16:17:30.175 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.175 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:30.175 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559207+0000", 2024-09-12T16:17:30.175 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.175 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:30.175 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559208+0000", 2024-09-12T16:17:30.175 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6800000000000001e-07 2024-09-12T16:17:30.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.175 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:30.176 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559210+0000", 2024-09-12T16:17:30.176 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0490000000000002e-06 2024-09-12T16:17:30.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.176 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.176 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:30.176 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559218+0000", 2024-09-12T16:17:30.176 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7510000000000008e-06 2024-09-12T16:17:30.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.176 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.176 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.176 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559223+0000", 2024-09-12T16:17:30.176 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1229999999999999e-06 2024-09-12T16:17:30.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.176 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.176 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:30.177 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604440+0000", 2024-09-12T16:17:30.177 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045217599999999997 2024-09-12T16:17:30.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.177 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:30.177 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604512+0000", 2024-09-12T16:17:30.177 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1909000000000006e-05 2024-09-12T16:17:30.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.177 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:30.177 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604573+0000", 2024-09-12T16:17:30.177 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1023999999999997e-05 2024-09-12T16:17:30.177 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.178 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:30.178 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.178 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6737 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2579456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:30.178 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.559229+0000", 2024-09-12T16:17:30.178 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.575192329, 2024-09-12T16:17:30.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045505640999999999, 2024-09-12T16:17:30.178 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:30.178 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:30.178 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:30.178 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:30.178 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:30.179 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:30.179 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6737 2024-09-12T16:17:30.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.179 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:30.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.179 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:30.179 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559229+0000", 2024-09-12T16:17:30.179 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.179 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:30.179 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559229+0000", 2024-09-12T16:17:30.179 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.180 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:30.180 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559230+0000", 2024-09-12T16:17:30.180 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1399999999999997e-07 2024-09-12T16:17:30.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.180 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:30.180 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559232+0000", 2024-09-12T16:17:30.180 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8360000000000001e-06 2024-09-12T16:17:30.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.180 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:30.181 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559238+0000", 2024-09-12T16:17:30.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2360000000000001e-06 2024-09-12T16:17:30.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.181 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.181 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559242+0000", 2024-09-12T16:17:30.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4390000000000002e-06 2024-09-12T16:17:30.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.181 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:30.181 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604599+0000", 2024-09-12T16:17:30.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045356527000000001 2024-09-12T16:17:30.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.182 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.182 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:30.182 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604669+0000", 2024-09-12T16:17:30.182 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0442000000000001e-05 2024-09-12T16:17:30.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.182 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.182 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:30.182 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604735+0000", 2024-09-12T16:17:30.182 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5647000000000004e-05 2024-09-12T16:17:30.182 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.182 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:30.182 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.182 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.183 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6738 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2594816~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:30.183 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.559250+0000", 2024-09-12T16:17:30.183 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.575171466, 2024-09-12T16:17:30.183 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045646834999999997, 2024-09-12T16:17:30.183 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:30.183 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:30.183 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:30.183 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:30.183 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:30.183 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:30.183 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6738 2024-09-12T16:17:30.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.183 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:30.184 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.184 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:30.184 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559250+0000", 2024-09-12T16:17:30.184 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.184 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.184 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:30.184 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559250+0000", 2024-09-12T16:17:30.184 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.184 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.184 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:30.184 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559251+0000", 2024-09-12T16:17:30.185 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1699999999999999e-07 2024-09-12T16:17:30.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.185 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.185 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:30.185 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559253+0000", 2024-09-12T16:17:30.185 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2910000000000002e-06 2024-09-12T16:17:30.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.185 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.185 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:30.185 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559260+0000", 2024-09-12T16:17:30.185 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2200000000000003e-06 2024-09-12T16:17:30.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.185 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.185 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.186 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559265+0000", 2024-09-12T16:17:30.186 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2050000000000001e-06 2024-09-12T16:17:30.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.186 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.186 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:30.186 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604763+0000", 2024-09-12T16:17:30.186 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045497964000000002 2024-09-12T16:17:30.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.186 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.186 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:30.186 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604835+0000", 2024-09-12T16:17:30.186 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1705000000000005e-05 2024-09-12T16:17:30.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.186 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.187 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:30.187 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604897+0000", 2024-09-12T16:17:30.187 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2032999999999994e-05 2024-09-12T16:17:30.187 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.187 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:30.187 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.187 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.187 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6739 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2610176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:30.187 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.559273+0000", 2024-09-12T16:17:30.187 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.575148647999999, 2024-09-12T16:17:30.187 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.04579105, 2024-09-12T16:17:30.187 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:30.187 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:30.187 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:30.188 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:30.188 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:30.188 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:30.188 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6739 2024-09-12T16:17:30.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.188 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:30.188 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.188 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:30.188 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559273+0000", 2024-09-12T16:17:30.188 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.188 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.188 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:30.188 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559273+0000", 2024-09-12T16:17:30.188 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.189 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.189 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:30.189 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559273+0000", 2024-09-12T16:17:30.189 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3299999999999998e-07 2024-09-12T16:17:30.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.189 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.189 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:30.189 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559276+0000", 2024-09-12T16:17:30.189 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1490000000000001e-06 2024-09-12T16:17:30.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.189 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.189 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:30.190 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559282+0000", 2024-09-12T16:17:30.190 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3199999999999996e-06 2024-09-12T16:17:30.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.190 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.190 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.190 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559288+0000", 2024-09-12T16:17:30.190 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.942e-06 2024-09-12T16:17:30.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.190 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.190 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:30.190 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604929+0000", 2024-09-12T16:17:30.190 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045641317000000001 2024-09-12T16:17:30.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.190 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.605001+0000", 2024-09-12T16:17:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1581000000000005e-05 2024-09-12T16:17:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.605064+0000", 2024-09-12T16:17:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3408e-05 2024-09-12T16:17:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6977 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2377728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.566114+0000", 2024-09-12T16:17:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.568307538999999, 2024-09-12T16:17:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045737673999999999, 2024-09-12T16:17:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6977 2024-09-12T16:17:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566114+0000", 2024-09-12T16:17:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566114+0000", 2024-09-12T16:17:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566115+0000", 2024-09-12T16:17:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.71e-07 2024-09-12T16:17:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566119+0000", 2024-09-12T16:17:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2749999999999997e-06 2024-09-12T16:17:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566128+0000", 2024-09-12T16:17:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9490000000000002e-06 2024-09-12T16:17:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566135+0000", 2024-09-12T16:17:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3459999999999999e-06 2024-09-12T16:17:30.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:30.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.610416+0000", 2024-09-12T16:17:30.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044281686000000001 2024-09-12T16:17:30.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:30.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.610536+0000", 2024-09-12T16:17:30.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000119412 2024-09-12T16:17:30.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:30.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.611852+0000", 2024-09-12T16:17:30.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001316135 2024-09-12T16:17:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6986 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2518016~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.566890+0000", 2024-09-12T16:17:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.567531616, 2024-09-12T16:17:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045234719999999999, 2024-09-12T16:17:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6986 2024-09-12T16:17:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566890+0000", 2024-09-12T16:17:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566890+0000", 2024-09-12T16:17:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566891+0000", 2024-09-12T16:17:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2799999999999995e-07 2024-09-12T16:17:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566895+0000", 2024-09-12T16:17:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8179999999999997e-06 2024-09-12T16:17:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566904+0000", 2024-09-12T16:17:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5179999999999993e-06 2024-09-12T16:17:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566911+0000", 2024-09-12T16:17:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1640000000000004e-06 2024-09-12T16:17:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.611985+0000", 2024-09-12T16:17:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045073545999999999 2024-09-12T16:17:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612061+0000", 2024-09-12T16:17:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5617999999999993e-05 2024-09-12T16:17:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612125+0000", 2024-09-12T16:17:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4327999999999998e-05 2024-09-12T16:17:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6987 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2533376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.566982+0000", 2024-09-12T16:17:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.567439596, 2024-09-12T16:17:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045308858, 2024-09-12T16:17:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6987 2024-09-12T16:17:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566982+0000", 2024-09-12T16:17:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566982+0000", 2024-09-12T16:17:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566983+0000", 2024-09-12T16:17:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2500000000000005e-07 2024-09-12T16:17:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566986+0000", 2024-09-12T16:17:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3000000000000002e-06 2024-09-12T16:17:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566995+0000", 2024-09-12T16:17:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8419999999999994e-06 2024-09-12T16:17:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567001+0000", 2024-09-12T16:17:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.161e-06 2024-09-12T16:17:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612154+0000", 2024-09-12T16:17:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045152858999999997 2024-09-12T16:17:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612229+0000", 2024-09-12T16:17:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4958999999999998e-05 2024-09-12T16:17:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612291+0000", 2024-09-12T16:17:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2012000000000002e-05 2024-09-12T16:17:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.205 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6988 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2548736~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:30.205 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.567055+0000", 2024-09-12T16:17:30.205 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.567367130000001, 2024-09-12T16:17:30.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045400078000000003, 2024-09-12T16:17:30.205 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:30.205 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:30.205 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:30.205 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:30.206 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:30.206 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:30.206 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6988 2024-09-12T16:17:30.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.206 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:30.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:30.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567055+0000", 2024-09-12T16:17:30.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:30.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567055+0000", 2024-09-12T16:17:30.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567055+0000", 2024-09-12T16:17:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3e-07 2024-09-12T16:17:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567059+0000", 2024-09-12T16:17:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4510000000000001e-06 2024-09-12T16:17:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:30.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567070+0000", 2024-09-12T16:17:30.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1477e-05 2024-09-12T16:17:30.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567077+0000", 2024-09-12T16:17:30.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7880000000000001e-06 2024-09-12T16:17:30.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:30.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612320+0000", 2024-09-12T16:17:30.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045242544000000003 2024-09-12T16:17:30.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:30.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612394+0000", 2024-09-12T16:17:30.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3854000000000001e-05 2024-09-12T16:17:30.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:30.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612455+0000", 2024-09-12T16:17:30.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1234000000000004e-05 2024-09-12T16:17:30.209 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.209 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:30.209 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6989 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2565120~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.567103+0000", 2024-09-12T16:17:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.567318323999999, 2024-09-12T16:17:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045514760000000001, 2024-09-12T16:17:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6989 2024-09-12T16:17:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567103+0000", 2024-09-12T16:17:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567103+0000", 2024-09-12T16:17:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567104+0000", 2024-09-12T16:17:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6400000000000002e-07 2024-09-12T16:17:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567107+0000", 2024-09-12T16:17:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.038e-06 2024-09-12T16:17:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567117+0000", 2024-09-12T16:17:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0244999999999999e-05 2024-09-12T16:17:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567124+0000", 2024-09-12T16:17:30.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1469999999999998e-06 2024-09-12T16:17:30.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:30.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612483+0000", 2024-09-12T16:17:30.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045359099999999999 2024-09-12T16:17:30.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:30.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612556+0000", 2024-09-12T16:17:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2948999999999996e-05 2024-09-12T16:17:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612618+0000", 2024-09-12T16:17:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2617e-05 2024-09-12T16:17:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6990 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2580480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.567155+0000", 2024-09-12T16:17:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.567267087000001, 2024-09-12T16:17:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045665681999999999, 2024-09-12T16:17:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6990 2024-09-12T16:17:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567155+0000", 2024-09-12T16:17:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567155+0000", 2024-09-12T16:17:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567155+0000", 2024-09-12T16:17:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5700000000000002e-07 2024-09-12T16:17:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567159+0000", 2024-09-12T16:17:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1729999999999999e-06 2024-09-12T16:17:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567167+0000", 2024-09-12T16:17:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3469999999999999e-06 2024-09-12T16:17:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567173+0000", 2024-09-12T16:17:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0719999999999996e-06 2024-09-12T16:17:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:30.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612651+0000", 2024-09-12T16:17:30.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045478078999999998 2024-09-12T16:17:30.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:30.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612741+0000", 2024-09-12T16:17:30.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0435999999999999e-05 2024-09-12T16:17:30.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:30.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612820+0000", 2024-09-12T16:17:30.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8918000000000006e-05 2024-09-12T16:17:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6991 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2595840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.567220+0000", 2024-09-12T16:17:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.567202079000001, 2024-09-12T16:17:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045811022999999999, 2024-09-12T16:17:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6991 2024-09-12T16:17:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567220+0000", 2024-09-12T16:17:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567220+0000", 2024-09-12T16:17:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:30.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567221+0000", 2024-09-12T16:17:30.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.16e-07 2024-09-12T16:17:30.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:30.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567225+0000", 2024-09-12T16:17:30.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3950000000000003e-06 2024-09-12T16:17:30.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:30.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567243+0000", 2024-09-12T16:17:30.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7734999999999999e-05 2024-09-12T16:17:30.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567253+0000", 2024-09-12T16:17:30.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7540000000000001e-06 2024-09-12T16:17:30.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:30.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612854+0000", 2024-09-12T16:17:30.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045601227000000001 2024-09-12T16:17:30.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612950+0000", 2024-09-12T16:17:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6121999999999999e-05 2024-09-12T16:17:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.613031+0000", 2024-09-12T16:17:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0873999999999999e-05 2024-09-12T16:17:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6992 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2611200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.567349+0000", 2024-09-12T16:17:30.224 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.567072323000001, 2024-09-12T16:17:30.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045848710000000001, 2024-09-12T16:17:30.224 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:30.224 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:30.224 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:30.224 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:30.224 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:30.224 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:30.224 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6992 2024-09-12T16:17:30.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.224 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:30.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:30.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567349+0000", 2024-09-12T16:17:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567349+0000", 2024-09-12T16:17:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567350+0000", 2024-09-12T16:17:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8899999999999998e-07 2024-09-12T16:17:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567354+0000", 2024-09-12T16:17:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0130000000000004e-06 2024-09-12T16:17:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567364+0000", 2024-09-12T16:17:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0158e-05 2024-09-12T16:17:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567369+0000", 2024-09-12T16:17:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4839999999999998e-06 2024-09-12T16:17:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.613072+0000", 2024-09-12T16:17:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045703195000000002 2024-09-12T16:17:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.613156+0000", 2024-09-12T16:17:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3591999999999995e-05 2024-09-12T16:17:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.613198+0000", 2024-09-12T16:17:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2478999999999998e-05 2024-09-12T16:17:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:30.228 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.228 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:30.228 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:30.228 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:30.229 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:17:30.230 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:30.228+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:30.330 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:30.329+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:30.353 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:30.353 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:30.353 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:17:30.353 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:30.363 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:17:30.402 INFO:teuthology.orchestra.run.smithi204.stdout:truncating image image_client.0-clone30 from 0x65f0800 (overlap 0x1484000) to 0x834c00 2024-09-12T16:17:30.447 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:30.446+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:30.533 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:30.532+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:30.558 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:30.558 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:30.558 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:17:30.558 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:17:30.559 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:30.567 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:17:30.651 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:30.650+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:30.716 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:30.716 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:17:30.716 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:17:30.717 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:17:30.717 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.717 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:17:30.717 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:17:30.717 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 108.95033678599999, 2024-09-12T16:17:30.717 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55645454900000002, 2024-09-12T16:17:30.717 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:30.717 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:30.717 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:30.717 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:30.717 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:17:30.717 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:17:30.717 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1 2024-09-12T16:17:30.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.718 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:30.718 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.718 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:30.718 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:17:30.718 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.718 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.718 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.718 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:30.718 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:17:30.718 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.718 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.718 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.718 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:30.719 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764440+0000", 2024-09-12T16:17:30.719 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6249999999999999e-06 2024-09-12T16:17:30.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.719 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.719 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:30.719 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764447+0000", 2024-09-12T16:17:30.719 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4939999999999997e-06 2024-09-12T16:17:30.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.719 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.719 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:30.719 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764459+0000", 2024-09-12T16:17:30.719 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1517e-05 2024-09-12T16:17:30.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.720 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.720 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.720 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764468+0000", 2024-09-12T16:17:30.720 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7690000000000002e-06 2024-09-12T16:17:30.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.720 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.720 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:30.720 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764539+0000", 2024-09-12T16:17:30.720 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1103e-05 2024-09-12T16:17:30.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.720 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.720 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:17:30.721 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764551+0000", 2024-09-12T16:17:30.721 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2687999999999999e-05 2024-09-12T16:17:30.721 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.721 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.721 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:30.721 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319497+0000", 2024-09-12T16:17:30.721 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55494560500000001 2024-09-12T16:17:30.721 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.721 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.721 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:30.721 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319688+0000", 2024-09-12T16:17:30.721 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019105599999999999 2024-09-12T16:17:30.721 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.721 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.722 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:17:30.722 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319842+0000", 2024-09-12T16:17:30.722 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015377699999999999 2024-09-12T16:17:30.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.722 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.722 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:17:30.722 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320473+0000", 2024-09-12T16:17:30.722 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00063117100000000003 2024-09-12T16:17:30.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.722 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.722 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:30.722 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320825+0000", 2024-09-12T16:17:30.722 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00035202500000000001 2024-09-12T16:17:30.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.723 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.723 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:30.723 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320867+0000", 2024-09-12T16:17:30.723 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2005000000000002e-05 2024-09-12T16:17:30.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.723 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.723 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:30.723 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320893+0000", 2024-09-12T16:17:30.723 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5714000000000001e-05 2024-09-12T16:17:30.723 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.723 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:30.723 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.724 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.724 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.724 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14034 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5035008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:30.724 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:17:30.724 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 71.193278552999999, 2024-09-12T16:17:30.724 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053404082999999998, 2024-09-12T16:17:30.724 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:30.724 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:30.724 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:30.724 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:30.724 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:30.724 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:30.724 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14034 2024-09-12T16:17:30.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.725 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:30.725 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.725 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:30.725 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:17:30.725 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.725 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.725 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:30.725 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:17:30.725 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.725 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.725 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:30.726 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521740+0000", 2024-09-12T16:17:30.726 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000243976 2024-09-12T16:17:30.726 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.726 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.726 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:30.726 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521745+0000", 2024-09-12T16:17:30.726 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1280000000000001e-06 2024-09-12T16:17:30.726 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.726 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.726 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:30.726 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521757+0000", 2024-09-12T16:17:30.726 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2751e-05 2024-09-12T16:17:30.726 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.726 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.727 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521771+0000", 2024-09-12T16:17:30.727 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3328e-05 2024-09-12T16:17:30.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.727 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:30.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574710+0000", 2024-09-12T16:17:30.727 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052939358999999998 2024-09-12T16:17:30.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.727 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:30.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574799+0000", 2024-09-12T16:17:30.727 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8893000000000004e-05 2024-09-12T16:17:30.728 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.728 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.728 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:30.728 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574901+0000", 2024-09-12T16:17:30.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101648 2024-09-12T16:17:30.728 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.728 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:30.728 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.728 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.728 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.728 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14036 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5043200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:30.728 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:17:30.728 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 71.192819358999998, 2024-09-12T16:17:30.729 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053426247000000003, 2024-09-12T16:17:30.729 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:30.729 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:30.729 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:30.729 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:30.729 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:30.729 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:30.729 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14036 2024-09-12T16:17:30.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.729 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:30.729 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.729 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:30.729 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:17:30.730 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.730 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:30.730 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:17:30.730 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.730 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:30.730 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522208+0000", 2024-09-12T16:17:30.730 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025195300000000002 2024-09-12T16:17:30.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.731 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:30.731 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522211+0000", 2024-09-12T16:17:30.731 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2160000000000002e-06 2024-09-12T16:17:30.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.731 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:30.731 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522223+0000", 2024-09-12T16:17:30.731 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2044e-05 2024-09-12T16:17:30.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.731 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.731 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522229+0000", 2024-09-12T16:17:30.731 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8850000000000004e-06 2024-09-12T16:17:30.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:30.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575192+0000", 2024-09-12T16:17:30.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052963573 2024-09-12T16:17:30.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:30.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575282+0000", 2024-09-12T16:17:30.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9666000000000005e-05 2024-09-12T16:17:30.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:30.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575382+0000", 2024-09-12T16:17:30.733 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9909999999999997e-05 2024-09-12T16:17:30.733 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.733 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:30.733 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.733 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.733 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14038 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5051392~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:30.733 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:17:30.733 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 71.192280986, 2024-09-12T16:17:30.733 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053395152000000001, 2024-09-12T16:17:30.733 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:30.733 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:30.733 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:30.733 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:30.734 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:30.734 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:30.734 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14038 2024-09-12T16:17:30.734 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.734 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:30.734 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.734 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:30.734 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:17:30.734 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.734 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.734 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.734 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:30.734 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:17:30.734 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.735 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.735 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.735 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:30.735 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522601+0000", 2024-09-12T16:17:30.735 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010702899999999999 2024-09-12T16:17:30.735 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.735 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.735 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:30.735 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522605+0000", 2024-09-12T16:17:30.735 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2379999999999999e-06 2024-09-12T16:17:30.735 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.735 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.735 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:30.735 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522616+0000", 2024-09-12T16:17:30.735 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1185999999999999e-05 2024-09-12T16:17:30.735 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.736 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.736 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.736 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522624+0000", 2024-09-12T16:17:30.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1099999999999997e-06 2024-09-12T16:17:30.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.736 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.736 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:30.736 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575677+0000", 2024-09-12T16:17:30.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053126999999999 2024-09-12T16:17:30.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.736 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.736 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:30.736 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575764+0000", 2024-09-12T16:17:30.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7250000000000007e-05 2024-09-12T16:17:30.737 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.737 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.737 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:30.737 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575889+0000", 2024-09-12T16:17:30.737 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012521200000000001 2024-09-12T16:17:30.737 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.737 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:30.737 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.737 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.737 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.737 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14039 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5055488~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:30.737 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:17:30.737 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 71.192139574999999, 2024-09-12T16:17:30.737 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053466207000000002, 2024-09-12T16:17:30.738 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:30.738 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:30.738 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:30.738 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:30.738 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:30.738 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:30.738 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14039 2024-09-12T16:17:30.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.738 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:30.738 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.738 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:30.738 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:17:30.738 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:30.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:17:30.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:30.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522899+0000", 2024-09-12T16:17:30.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026318199999999999 2024-09-12T16:17:30.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:30.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522903+0000", 2024-09-12T16:17:30.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.929e-06 2024-09-12T16:17:30.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.740 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:30.740 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522913+0000", 2024-09-12T16:17:30.740 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0162e-05 2024-09-12T16:17:30.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.740 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.740 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.740 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522921+0000", 2024-09-12T16:17:30.740 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.14e-06 2024-09-12T16:17:30.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.740 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.740 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:30.740 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575922+0000", 2024-09-12T16:17:30.740 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053000712999999998 2024-09-12T16:17:30.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.741 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.741 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:30.741 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576006+0000", 2024-09-12T16:17:30.741 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4161999999999998e-05 2024-09-12T16:17:30.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.741 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.741 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:30.741 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576102+0000", 2024-09-12T16:17:30.741 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5919000000000001e-05 2024-09-12T16:17:30.741 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.741 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:30.741 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.742 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14040 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5059584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:30.742 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:17:30.742 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 71.191834679999999, 2024-09-12T16:17:30.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053413258999999998, 2024-09-12T16:17:30.742 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:30.742 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:30.742 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:30.742 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:30.742 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:30.742 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:30.742 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14040 2024-09-12T16:17:30.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.743 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:30.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:30.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:17:30.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.743 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:30.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:17:30.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.743 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:30.744 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523059+0000", 2024-09-12T16:17:30.744 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118466 2024-09-12T16:17:30.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.744 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:30.744 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523062+0000", 2024-09-12T16:17:30.744 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.971e-06 2024-09-12T16:17:30.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.744 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:30.744 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523069+0000", 2024-09-12T16:17:30.744 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8279999999999997e-06 2024-09-12T16:17:30.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.745 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.745 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.745 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523073+0000", 2024-09-12T16:17:30.745 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3019999999999996e-06 2024-09-12T16:17:30.745 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.745 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.745 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:30.745 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576155+0000", 2024-09-12T16:17:30.745 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053081962000000003 2024-09-12T16:17:30.745 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.745 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.745 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:30.745 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576249+0000", 2024-09-12T16:17:30.746 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3914999999999998e-05 2024-09-12T16:17:30.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.746 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.746 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:30.746 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576354+0000", 2024-09-12T16:17:30.746 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010481500000000001 2024-09-12T16:17:30.746 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.746 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:30.746 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.746 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.746 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14041 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5063680~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:30.746 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:17:30.747 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 71.191684374999994, 2024-09-12T16:17:30.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053519111000000001, 2024-09-12T16:17:30.747 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:30.747 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:30.747 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:30.747 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:30.747 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:30.747 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:30.747 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14041 2024-09-12T16:17:30.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.747 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:30.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:30.748 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:17:30.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.748 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:30.748 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:17:30.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.748 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:30.748 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523309+0000", 2024-09-12T16:17:30.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000218712 2024-09-12T16:17:30.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.749 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.749 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:30.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523313+0000", 2024-09-12T16:17:30.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.151e-06 2024-09-12T16:17:30.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.749 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.749 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:30.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523320+0000", 2024-09-12T16:17:30.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9789999999999993e-06 2024-09-12T16:17:30.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.749 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.749 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523325+0000", 2024-09-12T16:17:30.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:17:30.750 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.750 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.750 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:30.750 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576402+0000", 2024-09-12T16:17:30.750 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053076811000000002 2024-09-12T16:17:30.750 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.750 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.750 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:30.750 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576491+0000", 2024-09-12T16:17:30.750 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8578999999999993e-05 2024-09-12T16:17:30.750 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.750 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.750 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:30.750 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576610+0000", 2024-09-12T16:17:30.751 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119129 2024-09-12T16:17:30.751 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.751 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:30.751 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.751 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.751 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.751 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14042 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5067776~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:30.751 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:17:30.751 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 71.191440940999996, 2024-09-12T16:17:30.751 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053510350999999998, 2024-09-12T16:17:30.751 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:30.751 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:30.751 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:30.751 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:30.752 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:30.752 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:30.752 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14042 2024-09-12T16:17:30.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.752 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:30.752 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.752 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:30.752 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:17:30.752 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.752 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.752 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:30.752 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:17:30.752 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.753 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.753 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.753 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:30.753 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523591+0000", 2024-09-12T16:17:30.753 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025710300000000001 2024-09-12T16:17:30.753 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.753 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.753 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:30.753 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523594+0000", 2024-09-12T16:17:30.753 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2229999999999999e-06 2024-09-12T16:17:30.753 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.753 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.753 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:30.754 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523602+0000", 2024-09-12T16:17:30.754 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6930000000000007e-06 2024-09-12T16:17:30.754 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.754 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.754 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.754 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523607+0000", 2024-09-12T16:17:30.754 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4789999999999998e-06 2024-09-12T16:17:30.754 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.754 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.754 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:30.754 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576661+0000", 2024-09-12T16:17:30.754 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053973999999997 2024-09-12T16:17:30.754 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.755 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.755 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:30.755 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576745+0000", 2024-09-12T16:17:30.755 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4660000000000006e-05 2024-09-12T16:17:30.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.755 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.755 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:30.755 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576844+0000", 2024-09-12T16:17:30.755 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9219e-05 2024-09-12T16:17:30.755 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.755 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:30.755 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.755 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.756 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14043 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5071872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:30.756 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:17:30.756 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 71.191160461999999, 2024-09-12T16:17:30.756 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053475295999999999, 2024-09-12T16:17:30.756 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:30.756 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:30.756 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:30.756 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:30.756 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:30.756 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:30.756 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14043 2024-09-12T16:17:30.756 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.756 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:30.757 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.757 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:30.757 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:17:30.757 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.757 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.757 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:30.757 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:17:30.757 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.757 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.757 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:30.757 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523823+0000", 2024-09-12T16:17:30.757 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020818900000000001 2024-09-12T16:17:30.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.758 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.758 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:30.758 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523826+0000", 2024-09-12T16:17:30.758 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.405e-06 2024-09-12T16:17:30.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.758 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.758 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:30.758 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523834+0000", 2024-09-12T16:17:30.758 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5499999999999997e-06 2024-09-12T16:17:30.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.758 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.758 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.758 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523838+0000", 2024-09-12T16:17:30.758 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.408e-06 2024-09-12T16:17:30.759 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.759 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.759 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:30.759 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576904+0000", 2024-09-12T16:17:30.759 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053065687 2024-09-12T16:17:30.759 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.759 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.759 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:30.759 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576991+0000", 2024-09-12T16:17:30.759 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7399999999999997e-05 2024-09-12T16:17:30.759 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.759 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.759 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:30.759 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577090+0000", 2024-09-12T16:17:30.760 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8657000000000001e-05 2024-09-12T16:17:30.760 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.760 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:30.760 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.760 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.760 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.760 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14044 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5075968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:30.760 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:17:30.760 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 71.190928932000006, 2024-09-12T16:17:30.760 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053442659000000003, 2024-09-12T16:17:30.760 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:30.760 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:30.760 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:30.761 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:30.761 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:30.761 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:30.761 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14044 2024-09-12T16:17:30.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.761 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:30.761 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.761 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:30.761 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:17:30.761 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.761 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.761 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:30.761 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:17:30.762 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.762 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.762 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:30.762 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523985+0000", 2024-09-12T16:17:30.762 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000138522 2024-09-12T16:17:30.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.762 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.762 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:30.762 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523988+0000", 2024-09-12T16:17:30.762 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.788e-06 2024-09-12T16:17:30.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.762 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.762 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:30.763 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523998+0000", 2024-09-12T16:17:30.763 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8470000000000008e-06 2024-09-12T16:17:30.763 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.763 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.763 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.763 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524010+0000", 2024-09-12T16:17:30.763 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1348999999999999e-05 2024-09-12T16:17:30.763 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.763 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.763 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:30.763 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577137+0000", 2024-09-12T16:17:30.763 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053127055999999999 2024-09-12T16:17:30.763 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.763 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.764 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:30.764 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577210+0000", 2024-09-12T16:17:30.764 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3392000000000005e-05 2024-09-12T16:17:30.764 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.764 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.764 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:30.764 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577289+0000", 2024-09-12T16:17:30.764 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8704999999999999e-05 2024-09-12T16:17:30.764 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.764 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:30.764 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.764 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.764 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.765 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14045 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5080064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:30.765 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:17:30.765 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 71.190750111, 2024-09-12T16:17:30.765 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053497514000000003, 2024-09-12T16:17:30.765 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:30.765 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:30.765 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:30.765 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:30.765 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:30.765 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:30.765 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14045 2024-09-12T16:17:30.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.766 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:30.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.766 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:30.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:17:30.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.766 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:30.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:17:30.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.766 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:30.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524311+0000", 2024-09-12T16:17:30.767 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028626299999999998 2024-09-12T16:17:30.767 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.767 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.767 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:30.767 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524315+0000", 2024-09-12T16:17:30.767 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0969999999999999e-06 2024-09-12T16:17:30.767 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.767 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.767 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:30.767 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524325+0000", 2024-09-12T16:17:30.767 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6330000000000008e-06 2024-09-12T16:17:30.767 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.767 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.767 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.768 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524332+0000", 2024-09-12T16:17:30.768 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8700000000000003e-06 2024-09-12T16:17:30.768 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.768 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.768 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:30.768 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577334+0000", 2024-09-12T16:17:30.768 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053001834999999997 2024-09-12T16:17:30.768 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.768 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.768 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:30.768 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577420+0000", 2024-09-12T16:17:30.768 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6145999999999998e-05 2024-09-12T16:17:30.768 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.769 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:30.769 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577522+0000", 2024-09-12T16:17:30.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010267 2024-09-12T16:17:30.769 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.769 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:30.769 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.769 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14047 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5088256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:30.769 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:17:30.769 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 71.190264385000006, 2024-09-12T16:17:30.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053433340000000003, 2024-09-12T16:17:30.770 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:30.770 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:30.770 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:30.770 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:30.770 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:30.770 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:30.770 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14047 2024-09-12T16:17:30.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.770 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:30.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.770 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:30.770 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:17:30.770 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.771 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.771 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:30.771 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:17:30.771 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.771 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.771 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:30.771 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524727+0000", 2024-09-12T16:17:30.771 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000216126 2024-09-12T16:17:30.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.771 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.771 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:30.772 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524732+0000", 2024-09-12T16:17:30.772 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1569999999999999e-06 2024-09-12T16:17:30.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.772 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:30.772 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524742+0000", 2024-09-12T16:17:30.772 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0186999999999999e-05 2024-09-12T16:17:30.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.772 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.772 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524750+0000", 2024-09-12T16:17:30.772 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4279999999999999e-06 2024-09-12T16:17:30.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.773 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:30.773 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577743+0000", 2024-09-12T16:17:30.773 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052993077 2024-09-12T16:17:30.773 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.773 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.773 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:30.773 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577841+0000", 2024-09-12T16:17:30.773 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8369000000000006e-05 2024-09-12T16:17:30.773 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.773 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.773 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:30.773 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577944+0000", 2024-09-12T16:17:30.774 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102996 2024-09-12T16:17:30.774 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.774 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:30.774 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.774 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.774 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14048 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5092352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:30.774 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:17:30.774 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 71.190012792000005, 2024-09-12T16:17:30.774 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053397515, 2024-09-12T16:17:30.774 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:30.774 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:30.774 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:30.774 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:30.774 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:30.775 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:30.775 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14048 2024-09-12T16:17:30.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.775 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:30.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.775 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:30.775 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:17:30.775 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.775 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:30.775 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:17:30.775 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.776 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:30.776 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524957+0000", 2024-09-12T16:17:30.776 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019516999999999999 2024-09-12T16:17:30.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.776 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:30.776 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524962+0000", 2024-09-12T16:17:30.776 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7709999999999997e-06 2024-09-12T16:17:30.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.776 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:30.776 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524973+0000", 2024-09-12T16:17:30.777 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1031e-05 2024-09-12T16:17:30.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.777 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.777 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.777 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524980+0000", 2024-09-12T16:17:30.777 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6100000000000002e-06 2024-09-12T16:17:30.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.777 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.777 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:30.777 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577977+0000", 2024-09-12T16:17:30.777 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052997481999999999 2024-09-12T16:17:30.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.777 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.777 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:30.778 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578062+0000", 2024-09-12T16:17:30.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4851000000000005e-05 2024-09-12T16:17:30.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.778 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:30.778 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578160+0000", 2024-09-12T16:17:30.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7600000000000001e-05 2024-09-12T16:17:30.778 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.778 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:30.778 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.778 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14049 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5096448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:30.778 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:17:30.779 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 71.189784164000002, 2024-09-12T16:17:30.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053439792, 2024-09-12T16:17:30.779 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:30.779 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:30.779 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:30.779 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:30.779 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:30.779 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:30.779 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14049 2024-09-12T16:17:30.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.779 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:30.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:30.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:17:30.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.780 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.780 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:30.780 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:17:30.780 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.780 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.780 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:30.780 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525170+0000", 2024-09-12T16:17:30.780 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017958500000000001 2024-09-12T16:17:30.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.780 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.780 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:30.780 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525174+0000", 2024-09-12T16:17:30.781 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0239999999999999e-06 2024-09-12T16:17:30.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.781 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.781 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:30.781 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525184+0000", 2024-09-12T16:17:30.781 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5950000000000005e-06 2024-09-12T16:17:30.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.781 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.781 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.781 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525191+0000", 2024-09-12T16:17:30.781 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8329999999999996e-06 2024-09-12T16:17:30.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.782 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.782 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:30.782 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578240+0000", 2024-09-12T16:17:30.782 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053049236 2024-09-12T16:17:30.782 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.782 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.782 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:30.782 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578333+0000", 2024-09-12T16:17:30.784 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2806999999999994e-05 2024-09-12T16:17:30.784 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.784 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.784 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:30.784 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578431+0000", 2024-09-12T16:17:30.784 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7712000000000002e-05 2024-09-12T16:17:30.784 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.784 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:30.785 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.785 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.785 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14055 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5121024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:30.785 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:17:30.785 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 71.188513473, 2024-09-12T16:17:30.785 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053399038000000003, 2024-09-12T16:17:30.785 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:30.785 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:30.785 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:30.785 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:30.785 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:30.785 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:30.785 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14055 2024-09-12T16:17:30.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.786 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:30.786 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.786 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:30.786 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:17:30.786 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.786 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.786 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:30.786 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:17:30.786 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.787 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.787 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:30.787 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526403+0000", 2024-09-12T16:17:30.787 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141571 2024-09-12T16:17:30.787 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.787 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.787 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:30.787 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526406+0000", 2024-09-12T16:17:30.787 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2660000000000002e-06 2024-09-12T16:17:30.787 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.787 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.787 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:30.787 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526420+0000", 2024-09-12T16:17:30.787 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3949e-05 2024-09-12T16:17:30.787 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.787 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.788 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.788 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526428+0000", 2024-09-12T16:17:30.788 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4250000000000001e-06 2024-09-12T16:17:30.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.788 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.788 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:30.788 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579476+0000", 2024-09-12T16:17:30.788 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053048349000000002 2024-09-12T16:17:30.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.788 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.788 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:30.788 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579563+0000", 2024-09-12T16:17:30.788 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6502999999999995e-05 2024-09-12T16:17:30.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.788 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.789 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:30.789 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579661+0000", 2024-09-12T16:17:30.789 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7974999999999996e-05 2024-09-12T16:17:30.789 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.789 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:30.789 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.789 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.789 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.789 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4806.0:3139 3.1e 3:78d5a095:::rbd_data.11552a37e55b.0000000000000000:head [read 69632~61440] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:17:30.789 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:30.789 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 60.413519223000002, 2024-09-12T16:17:30.789 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057851734000000002, 2024-09-12T16:17:30.790 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:30.790 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:30.790 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:30.790 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:30.790 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4806", 2024-09-12T16:17:30.790 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3959815836", 2024-09-12T16:17:30.790 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 3139 2024-09-12T16:17:30.790 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.790 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:30.790 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.790 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:30.790 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:30.790 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.790 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.791 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.791 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:30.791 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:30.791 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.791 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.791 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.791 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:30.791 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:30.791 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4799999999999999e-07 2024-09-12T16:17:30.791 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.791 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.791 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:30.791 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301258+0000", 2024-09-12T16:17:30.792 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.844e-06 2024-09-12T16:17:30.792 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.792 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.792 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:30.792 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301267+0000", 2024-09-12T16:17:30.792 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2960000000000004e-06 2024-09-12T16:17:30.792 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.792 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.792 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.792 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301276+0000", 2024-09-12T16:17:30.792 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0650000000000005e-06 2024-09-12T16:17:30.792 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.792 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.792 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:30.793 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301871+0000", 2024-09-12T16:17:30.793 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00059423600000000005 2024-09-12T16:17:30.793 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.793 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.793 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:30.793 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301920+0000", 2024-09-12T16:17:30.793 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9067000000000003e-05 2024-09-12T16:17:30.793 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.793 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.793 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:30.793 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359108+0000", 2024-09-12T16:17:30.794 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057187877999999998 2024-09-12T16:17:30.794 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.794 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:30.794 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.794 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.794 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.794 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:6428 3.14 3:28a44e54:::rbd_header.11552a37e55b:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:17:30.794 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:17:30.794 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 60.413190628999999, 2024-09-12T16:17:30.794 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057504023000000001, 2024-09-12T16:17:30.794 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:30.794 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:30.794 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:30.794 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:30.795 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:17:30.795 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:17:30.795 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6428 2024-09-12T16:17:30.795 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.795 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:30.795 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.795 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:30.795 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:17:30.795 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.795 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.795 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.795 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:30.795 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:17:30.795 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.796 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.796 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.796 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:30.796 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301585+0000", 2024-09-12T16:17:30.796 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6300000000000005e-07 2024-09-12T16:17:30.796 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.796 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.796 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:30.796 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301588+0000", 2024-09-12T16:17:30.796 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4149999999999999e-06 2024-09-12T16:17:30.796 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.796 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.796 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:30.796 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301597+0000", 2024-09-12T16:17:30.797 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5450000000000003e-06 2024-09-12T16:17:30.797 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.797 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.797 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.797 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301617+0000", 2024-09-12T16:17:30.797 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9837e-05 2024-09-12T16:17:30.797 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.797 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.797 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:30.797 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301779+0000", 2024-09-12T16:17:30.797 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016186799999999999 2024-09-12T16:17:30.797 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.797 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.798 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:30.798 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301855+0000", 2024-09-12T16:17:30.798 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5899e-05 2024-09-12T16:17:30.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.798 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.798 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:30.798 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359088+0000", 2024-09-12T16:17:30.798 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057233895999999999 2024-09-12T16:17:30.798 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.798 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:30.798 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.798 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.798 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5223.0:1814 3.f 3:f7b1b1c5:::rbd_object_map.1155a1fd27d2:head [read 0~136] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-12T16:17:30.799 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:17:30.799 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 24.477524565, 2024-09-12T16:17:30.799 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.006378226, 2024-09-12T16:17:30.799 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:30.799 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:30.799 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:30.799 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:30.799 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5223", 2024-09-12T16:17:30.799 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/4066330994", 2024-09-12T16:17:30.799 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1814 2024-09-12T16:17:30.799 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.799 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:30.799 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.799 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:30.800 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:17:30.800 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.800 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.800 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.800 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:30.800 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:17:30.800 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.800 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.800 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.800 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:30.800 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237252+0000", 2024-09-12T16:17:30.800 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.344e-06 2024-09-12T16:17:30.800 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.800 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.801 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:30.801 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237258+0000", 2024-09-12T16:17:30.801 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1070000000000001e-06 2024-09-12T16:17:30.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.801 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.801 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:30.801 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237270+0000", 2024-09-12T16:17:30.801 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1758e-05 2024-09-12T16:17:30.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.801 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.801 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.801 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237278+0000", 2024-09-12T16:17:30.801 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3219999999999993e-06 2024-09-12T16:17:30.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.802 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.802 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:30.802 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237334+0000", 2024-09-12T16:17:30.802 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6356e-05 2024-09-12T16:17:30.802 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.802 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.802 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:17:30.802 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237345+0000", 2024-09-12T16:17:30.802 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0433e-05 2024-09-12T16:17:30.802 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.802 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.802 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:30.802 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243426+0000", 2024-09-12T16:17:30.802 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.00608133 2024-09-12T16:17:30.803 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.803 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.803 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:30.803 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243534+0000", 2024-09-12T16:17:30.803 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010784 2024-09-12T16:17:30.803 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.803 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.803 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:30.803 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243629+0000", 2024-09-12T16:17:30.803 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4735999999999996e-05 2024-09-12T16:17:30.803 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.803 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:30.803 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.803 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.803 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.804 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5328.0:2542 3.16 3:6928f3a1:::rbd_object_map.11551722dd77:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:30.804 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:17:30.804 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 18.659179134999999, 2024-09-12T16:17:30.804 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.054219934999999997, 2024-09-12T16:17:30.804 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:30.804 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:30.804 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:30.804 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:30.804 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5328", 2024-09-12T16:17:30.804 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:30.804 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2542 2024-09-12T16:17:30.804 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.804 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:30.804 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.805 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:30.805 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:17:30.805 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.805 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.805 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.805 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:30.805 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:17:30.805 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.805 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.805 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.805 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:30.805 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055597+0000", 2024-09-12T16:17:30.805 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4300000000000001e-07 2024-09-12T16:17:30.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.806 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.806 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:30.806 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055602+0000", 2024-09-12T16:17:30.806 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4269999999999999e-06 2024-09-12T16:17:30.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.806 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.806 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:30.806 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055613+0000", 2024-09-12T16:17:30.806 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0815000000000001e-05 2024-09-12T16:17:30.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.806 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.806 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.807 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055621+0000", 2024-09-12T16:17:30.807 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4189999999999996e-06 2024-09-12T16:17:30.807 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.807 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.807 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:30.807 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102196+0000", 2024-09-12T16:17:30.807 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.046575616 2024-09-12T16:17:30.807 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.807 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.807 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:30.808 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102258+0000", 2024-09-12T16:17:30.808 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1872000000000007e-05 2024-09-12T16:17:30.808 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.808 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.808 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T16:17:30.808 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102601+0000", 2024-09-12T16:17:30.808 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034285700000000001 2024-09-12T16:17:30.808 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.808 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.808 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:30.808 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.104431+0000", 2024-09-12T16:17:30.808 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001830524 2024-09-12T16:17:30.808 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.809 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.809 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:17:30.809 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109733+0000", 2024-09-12T16:17:30.809 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0053020089999999999 2024-09-12T16:17:30.809 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.809 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.809 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:30.809 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109777+0000", 2024-09-12T16:17:30.809 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3754000000000002e-05 2024-09-12T16:17:30.809 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.809 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.809 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:30.809 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109816+0000", 2024-09-12T16:17:30.810 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8699000000000003e-05 2024-09-12T16:17:30.810 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.810 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:30.810 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.810 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.810 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.810 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5328.0:2543 3.16 3:6928f3a1:::rbd_object_map.11551722dd77:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:30.810 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:17:30.810 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 18.658585156000001, 2024-09-12T16:17:30.810 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053695720000000002, 2024-09-12T16:17:30.810 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:30.810 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:30.810 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:30.810 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:30.811 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5328", 2024-09-12T16:17:30.811 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:30.811 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2543 2024-09-12T16:17:30.811 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.811 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:30.811 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.811 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:30.811 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:17:30.811 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.811 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.811 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.811 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:30.811 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:17:30.811 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:30.812 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.812 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.812 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:30.812 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056191+0000", 2024-09-12T16:17:30.812 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.54e-07 2024-09-12T16:17:30.812 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.812 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.812 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:30.812 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056195+0000", 2024-09-12T16:17:30.812 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5460000000000002e-06 2024-09-12T16:17:30.812 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.812 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.812 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:30.813 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056205+0000", 2024-09-12T16:17:30.813 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7350000000000008e-06 2024-09-12T16:17:30.813 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.813 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.813 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:30.813 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056214+0000", 2024-09-12T16:17:30.813 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8089999999999999e-06 2024-09-12T16:17:30.813 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.813 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.813 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:30.813 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103317+0000", 2024-09-12T16:17:30.813 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.047102889000000002 2024-09-12T16:17:30.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.814 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.814 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:30.814 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103410+0000", 2024-09-12T16:17:30.814 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3689000000000004e-05 2024-09-12T16:17:30.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.814 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.814 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T16:17:30.814 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103754+0000", 2024-09-12T16:17:30.814 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034344699999999998 2024-09-12T16:17:30.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.814 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.814 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:30.815 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.106487+0000", 2024-09-12T16:17:30.815 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0027330100000000001 2024-09-12T16:17:30.815 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.815 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.815 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:17:30.815 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109827+0000", 2024-09-12T16:17:30.815 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033406640000000001 2024-09-12T16:17:30.815 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.815 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.815 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:30.815 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109854+0000", 2024-09-12T16:17:30.815 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6866999999999999e-05 2024-09-12T16:17:30.815 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:30.815 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:30.816 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:30.816 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109886+0000", 2024-09-12T16:17:30.816 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1309999999999997e-05 2024-09-12T16:17:30.816 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.816 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:30.816 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.816 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:30.816 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:30.816 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:30.818 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:17:30.818 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:30.817+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:30.918 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:30.917+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:30.966 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:30.966 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:30.966 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:17:30.966 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:30.974 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:17:30.983 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T16:17:31.027 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:31.026+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:31.081 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:31.081 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:31.081 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:17:31.081 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:17:31.081 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:31.089 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:17:31.109 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:17:31.109 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:17:31.126 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:17:31.126 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:17:31.133 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:31.132+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:31.142 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:17:31.142 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:17:31.168 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:17:31.169 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:17:31.188 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:17:31.189 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:17:31.214 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:31.215 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:31.217 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:17:31.217 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:17:31.220 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:31.219+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:31.228 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:17:31.322 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:31.321+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:31.325 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T16:17:31.422 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:31.422+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:31.424 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:31.424 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:31.433 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:17:31.523 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:31.522+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:31.582 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:31.582 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:31.591 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:17:31.632 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:31.631+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:31.701 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #29, image image_client.0-clone29 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent30 2024-09-12T16:17:31.724 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:31.723+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:31.743 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:31.743 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:31.752 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:17:31.770 INFO:teuthology.orchestra.run.smithi204.stdout:4298 write 0xa297c00 thru 0xa299257 (0x1658 bytes) 2024-09-12T16:17:31.770 INFO:teuthology.orchestra.run.smithi204.stdout:4301 read 0x3f19a00 thru 0x3f1ff4a (0x654b bytes) 2024-09-12T16:17:31.771 INFO:teuthology.orchestra.run.smithi204.stdout:4302 read 0x20600 thru 0x2ad0f (0xa710 bytes) 2024-09-12T16:17:31.775 INFO:teuthology.orchestra.run.smithi204.stdout:4303 read 0x91a8800 thru 0x91b12cf (0x8ad0 bytes) 2024-09-12T16:17:31.775 INFO:teuthology.orchestra.run.smithi204.stdout:4304 read 0x15a8000 thru 0x15b1ba2 (0x9ba3 bytes) 2024-09-12T16:17:31.776 INFO:teuthology.orchestra.run.smithi204.stdout:4306 read 0x552000 thru 0x55260d (0x60e bytes) 2024-09-12T16:17:31.777 INFO:teuthology.orchestra.run.smithi204.stdout:4309 read 0x8668c00 thru 0x867754a (0xe94b bytes) 2024-09-12T16:17:31.777 INFO:teuthology.orchestra.run.smithi204.stdout:4311 write 0x4d8800 thru 0x4e524c (0xca4d bytes) 2024-09-12T16:17:31.825 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:31.824+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:31.847 INFO:teuthology.orchestra.run.smithi204.stdout:4312 write 0xb13c000 thru 0xb13ff7b (0x3f7c bytes) 2024-09-12T16:17:31.847 INFO:teuthology.orchestra.run.smithi204.stdout:4313 read 0x8543c00 thru 0x8545a7e (0x1e7f bytes) 2024-09-12T16:17:31.849 INFO:teuthology.orchestra.run.smithi204.stdout:4315 trunc from 0xb140000 to 0xd009800 2024-09-12T16:17:31.873 INFO:teuthology.orchestra.run.smithi204.stdout:4316 punch from 0x21d8600 to 0x21e5400, (0xce00 bytes) 2024-09-12T16:17:31.895 INFO:teuthology.orchestra.run.smithi204.stdout:4317 write 0x9f7e600 thru 0x9f80c45 (0x2646 bytes) 2024-09-12T16:17:31.897 INFO:teuthology.orchestra.run.smithi204.stdout:4318 punch from 0x566a400 to 0x5677c00, (0xd800 bytes) 2024-09-12T16:17:31.903 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:31.903 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:31.915 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:17:31.915 INFO:teuthology.orchestra.run.smithi204.stdout:4320 trunc from 0xd009800 to 0x1a62800 2024-09-12T16:17:31.928 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:31.925+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:32.028 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:32.027+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:32.062 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:32.062 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:32.070 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:17:32.129 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:32.128+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:32.231 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:32.230+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:32.237 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:32.237 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:32.251 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:17:32.328 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2024-09-12T16:17:32.333 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:32.331+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:32.429 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:32.429 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:32.432 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:32.431+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:32.438 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:17:32.439 INFO:teuthology.orchestra.run.smithi204.stdout:4321 write 0xb43ac00 thru 0xb449872 (0xec73 bytes) 2024-09-12T16:17:32.439 INFO:teuthology.orchestra.run.smithi204.stdout:4323 write 0x33a8200 thru 0x33b7a7d (0xf87e bytes) 2024-09-12T16:17:32.445 INFO:teuthology.orchestra.run.smithi204.stdout:4330 trunc from 0xb449a00 to 0x761dc00 2024-09-12T16:17:32.467 INFO:teuthology.orchestra.run.smithi204.stdout:4337 write 0x1d4ee00 thru 0x1d55724 (0x6925 bytes) 2024-09-12T16:17:32.485 INFO:teuthology.orchestra.run.smithi204.stdout:4338 write 0x834d400 thru 0x8353707 (0x6308 bytes) 2024-09-12T16:17:32.507 INFO:teuthology.orchestra.run.smithi204.stdout:4339 write 0xbf61200 thru 0xbf6d164 (0xbf65 bytes) 2024-09-12T16:17:32.508 INFO:teuthology.orchestra.run.smithi204.stdout:4340 write 0x6b4d400 thru 0x6b58159 (0xad5a bytes) 2024-09-12T16:17:32.508 INFO:teuthology.orchestra.run.smithi204.stdout:4343 read 0x4e82600 thru 0x4e8bfd3 (0x99d4 bytes) 2024-09-12T16:17:32.508 INFO:teuthology.orchestra.run.smithi204.stdout:4346 punch from 0x321ca00 to 0x3228800, (0xbe00 bytes) 2024-09-12T16:17:32.508 INFO:teuthology.orchestra.run.smithi204.stdout:4347 write 0x8f57c00 thru 0x8f59375 (0x1776 bytes) 2024-09-12T16:17:32.508 INFO:teuthology.orchestra.run.smithi204.stdout:4348 punch from 0x137dc00 to 0x137f000, (0x1400 bytes) 2024-09-12T16:17:32.508 INFO:teuthology.orchestra.run.smithi204.stdout:4349 read 0x7cdd200 thru 0x7cdd4dd (0x2de bytes) 2024-09-12T16:17:32.509 INFO:teuthology.orchestra.run.smithi204.stdout:4350 write 0xa1f1800 thru 0xa1f9c29 (0x842a bytes) 2024-09-12T16:17:32.509 INFO:teuthology.orchestra.run.smithi204.stdout:4351 punch from 0x6285a00 to 0x6289e00, (0x4400 bytes) 2024-09-12T16:17:32.509 INFO:teuthology.orchestra.run.smithi204.stdout:4352 punch from 0x16b2e00 to 0x16ba200, (0x7400 bytes) 2024-09-12T16:17:32.509 INFO:teuthology.orchestra.run.smithi204.stdout:4356 read 0x97cb200 thru 0x97d0dd3 (0x5bd4 bytes) 2024-09-12T16:17:32.515 INFO:teuthology.orchestra.run.smithi204.stdout:4357 trunc from 0xbf6d200 to 0x6930e00 2024-09-12T16:17:32.533 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:32.533+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:32.537 INFO:teuthology.orchestra.run.smithi204.stdout:4365 read 0x1ee5600 thru 0x1ee6ae3 (0x14e4 bytes) 2024-09-12T16:17:32.553 INFO:teuthology.orchestra.run.smithi204.stdout:4366 write 0x6a3a200 thru 0x6a3b23f (0x1040 bytes) 2024-09-12T16:17:32.553 INFO:teuthology.orchestra.run.smithi204.stdout:4368 punch from 0x1c83c00 to 0x1c87e00, (0x4200 bytes) 2024-09-12T16:17:32.553 INFO:teuthology.orchestra.run.smithi204.stdout:4369 read 0x28a0e00 thru 0x28b0a90 (0xfc91 bytes) 2024-09-12T16:17:32.555 INFO:teuthology.orchestra.run.smithi204.stdout:4370 read 0x34fbe00 thru 0x34fd8bb (0x1abc bytes) 2024-09-12T16:17:32.555 INFO:teuthology.orchestra.run.smithi204.stdout:4371 read 0x557c00 thru 0x562c95 (0xb096 bytes) 2024-09-12T16:17:32.556 INFO:teuthology.orchestra.run.smithi204.stdout:4373 punch from 0x3701800 to 0x370b200, (0x9a00 bytes) 2024-09-12T16:17:32.556 INFO:teuthology.orchestra.run.smithi204.stdout:4374 read 0x2b43600 thru 0x2b43c4d (0x64e bytes) 2024-09-12T16:17:32.560 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:32.560 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:32.569 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:17:32.579 INFO:teuthology.orchestra.run.smithi204.stdout:4375 write 0xca34e00 thru 0xca3d7c2 (0x89c3 bytes) 2024-09-12T16:17:32.579 INFO:teuthology.orchestra.run.smithi204.stdout:4376 read 0xb712e00 thru 0xb71bb46 (0x8d47 bytes) 2024-09-12T16:17:32.579 INFO:teuthology.orchestra.run.smithi204.stdout:4378 read 0xc013a00 thru 0xc022ecc (0xf4cd bytes) 2024-09-12T16:17:32.579 INFO:teuthology.orchestra.run.smithi204.stdout:4380 read 0xac91800 thru 0xac93457 (0x1c58 bytes) 2024-09-12T16:17:32.579 INFO:teuthology.orchestra.run.smithi204.stdout:4384 punch from 0x253c800 to 0x2548e00, (0xc600 bytes) 2024-09-12T16:17:32.580 INFO:teuthology.orchestra.run.smithi204.stdout:4385 write 0x662e800 thru 0x6639f98 (0xb799 bytes) 2024-09-12T16:17:32.580 INFO:teuthology.orchestra.run.smithi204.stdout:4388 read 0xbe08400 thru 0xbe12804 (0xa405 bytes) 2024-09-12T16:17:32.580 INFO:teuthology.orchestra.run.smithi204.stdout:4389 write 0xa86600 thru 0xa8b5f6 (0x4ff7 bytes) 2024-09-12T16:17:32.580 INFO:teuthology.orchestra.run.smithi204.stdout:4393 read 0x376ce00 thru 0x376f99a (0x2b9b bytes) 2024-09-12T16:17:32.580 INFO:teuthology.orchestra.run.smithi204.stdout:4401 read 0x8e2f000 thru 0x8e3d86b (0xe86c bytes) 2024-09-12T16:17:32.581 INFO:teuthology.orchestra.run.smithi204.stdout:4402 write 0x50ed600 thru 0x50f9224 (0xbc25 bytes) 2024-09-12T16:17:32.582 INFO:teuthology.orchestra.run.smithi204.stdout:4403 clone 32 order 22 su 131072 sc 2 2024-09-12T16:17:32.654 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:32.653+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:32.718 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:32.718 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:32.726 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:17:32.735 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:32.734+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:32.836 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:32.835+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:32.874 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:32.874 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:32.883 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:17:32.937 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:32.936+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:33.031 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:33.031 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:33.038 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:33.037+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:33.039 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:17:33.139 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:33.138+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:33.146 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:33.146 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:33.155 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:17:33.232 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T16:17:33.239 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:33.238+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:33.265 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:33.265 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:33.273 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:17:33.357 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:17:33.358 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:17:33.358 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:33.357+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:33.376 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:17:33.376 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:17:33.393 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:17:33.393 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:17:33.409 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:17:33.409 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:17:33.417 INFO:teuthology.orchestra.run.smithi204.stdout:truncating image image_client.0-clone31 from 0xca3d800 (overlap 0x1a62800) to 0xd31400 2024-09-12T16:17:33.428 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:17:33.428 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:17:33.432 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:33.432 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:33.432 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:17:33.432 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:17:33.432 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:33.441 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:33.441+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:33.445 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:17:33.450 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:17:33.450 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:17:33.542 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:33.541+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:33.597 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:33.597 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:17:33.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:17:33.597 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:17:33.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.597 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:17:33.597 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:17:33.597 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 111.83115146199999, 2024-09-12T16:17:33.598 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55645454900000002, 2024-09-12T16:17:33.598 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:33.598 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:33.598 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:33.598 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:33.598 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:17:33.598 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:17:33.598 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1 2024-09-12T16:17:33.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.598 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:33.598 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.598 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:33.598 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:17:33.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:33.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:17:33.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:33.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764440+0000", 2024-09-12T16:17:33.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6249999999999999e-06 2024-09-12T16:17:33.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:33.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764447+0000", 2024-09-12T16:17:33.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4939999999999997e-06 2024-09-12T16:17:33.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:33.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764459+0000", 2024-09-12T16:17:33.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1517e-05 2024-09-12T16:17:33.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:33.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764468+0000", 2024-09-12T16:17:33.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7690000000000002e-06 2024-09-12T16:17:33.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:33.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764539+0000", 2024-09-12T16:17:33.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1103e-05 2024-09-12T16:17:33.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:17:33.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764551+0000", 2024-09-12T16:17:33.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2687999999999999e-05 2024-09-12T16:17:33.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:33.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319497+0000", 2024-09-12T16:17:33.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55494560500000001 2024-09-12T16:17:33.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:33.602 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319688+0000", 2024-09-12T16:17:33.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019105599999999999 2024-09-12T16:17:33.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.602 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:17:33.602 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319842+0000", 2024-09-12T16:17:33.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015377699999999999 2024-09-12T16:17:33.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.602 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:17:33.602 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320473+0000", 2024-09-12T16:17:33.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00063117100000000003 2024-09-12T16:17:33.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.603 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:33.603 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320825+0000", 2024-09-12T16:17:33.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00035202500000000001 2024-09-12T16:17:33.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.603 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.603 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:33.603 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320867+0000", 2024-09-12T16:17:33.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2005000000000002e-05 2024-09-12T16:17:33.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.603 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.603 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:33.603 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320893+0000", 2024-09-12T16:17:33.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5714000000000001e-05 2024-09-12T16:17:33.603 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.604 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:33.604 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.604 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14034 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5035008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:33.604 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:17:33.604 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 74.074093228999999, 2024-09-12T16:17:33.604 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053404082999999998, 2024-09-12T16:17:33.604 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:33.604 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:33.604 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:33.605 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:33.605 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:33.605 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:33.605 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14034 2024-09-12T16:17:33.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.605 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:33.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.605 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:33.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:17:33.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.605 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:33.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:17:33.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:33.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521740+0000", 2024-09-12T16:17:33.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000243976 2024-09-12T16:17:33.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:33.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521745+0000", 2024-09-12T16:17:33.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1280000000000001e-06 2024-09-12T16:17:33.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:33.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521757+0000", 2024-09-12T16:17:33.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2751e-05 2024-09-12T16:17:33.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:33.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521771+0000", 2024-09-12T16:17:33.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3328e-05 2024-09-12T16:17:33.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:33.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574710+0000", 2024-09-12T16:17:33.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052939358999999998 2024-09-12T16:17:33.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.608 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:33.608 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574799+0000", 2024-09-12T16:17:33.608 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8893000000000004e-05 2024-09-12T16:17:33.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.608 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:33.608 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574901+0000", 2024-09-12T16:17:33.608 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101648 2024-09-12T16:17:33.608 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.608 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:33.608 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.608 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14036 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5043200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:33.608 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:17:33.609 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 74.073634034999998, 2024-09-12T16:17:33.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053426247000000003, 2024-09-12T16:17:33.609 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:33.609 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:33.609 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:33.609 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:33.609 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:33.609 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:33.609 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14036 2024-09-12T16:17:33.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.609 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:33.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:33.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:17:33.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.610 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:33.610 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:17:33.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.610 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:33.610 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522208+0000", 2024-09-12T16:17:33.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025195300000000002 2024-09-12T16:17:33.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.610 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:33.610 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522211+0000", 2024-09-12T16:17:33.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2160000000000002e-06 2024-09-12T16:17:33.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.611 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:33.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522223+0000", 2024-09-12T16:17:33.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2044e-05 2024-09-12T16:17:33.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.611 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:33.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522229+0000", 2024-09-12T16:17:33.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8850000000000004e-06 2024-09-12T16:17:33.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.611 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:33.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575192+0000", 2024-09-12T16:17:33.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052963573 2024-09-12T16:17:33.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:33.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575282+0000", 2024-09-12T16:17:33.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9666000000000005e-05 2024-09-12T16:17:33.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:33.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575382+0000", 2024-09-12T16:17:33.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9909999999999997e-05 2024-09-12T16:17:33.612 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.612 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:33.613 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.613 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.613 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14038 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5051392~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:33.613 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:17:33.613 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 74.073095662, 2024-09-12T16:17:33.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053395152000000001, 2024-09-12T16:17:33.613 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:33.613 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:33.613 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:33.613 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:33.613 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:33.613 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:33.613 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14038 2024-09-12T16:17:33.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.614 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:33.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.614 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:33.614 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:17:33.614 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.614 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:33.614 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:17:33.614 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.615 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:33.615 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522601+0000", 2024-09-12T16:17:33.615 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010702899999999999 2024-09-12T16:17:33.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.615 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.615 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:33.615 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522605+0000", 2024-09-12T16:17:33.615 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2379999999999999e-06 2024-09-12T16:17:33.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.615 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.615 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:33.615 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522616+0000", 2024-09-12T16:17:33.615 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1185999999999999e-05 2024-09-12T16:17:33.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.616 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:33.616 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522624+0000", 2024-09-12T16:17:33.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1099999999999997e-06 2024-09-12T16:17:33.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.616 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:33.616 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575677+0000", 2024-09-12T16:17:33.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053126999999999 2024-09-12T16:17:33.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.616 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:33.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575764+0000", 2024-09-12T16:17:33.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7250000000000007e-05 2024-09-12T16:17:33.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.617 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:33.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575889+0000", 2024-09-12T16:17:33.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012521200000000001 2024-09-12T16:17:33.617 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.617 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:33.617 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.617 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14039 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5055488~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:33.617 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:17:33.618 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 74.072954250999999, 2024-09-12T16:17:33.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053466207000000002, 2024-09-12T16:17:33.618 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:33.618 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:33.618 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:33.618 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:33.618 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:33.618 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:33.618 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14039 2024-09-12T16:17:33.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.618 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:33.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.618 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:33.618 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:17:33.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.619 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.619 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:33.619 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:17:33.619 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.619 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.619 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:33.619 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522899+0000", 2024-09-12T16:17:33.619 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026318199999999999 2024-09-12T16:17:33.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.619 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.619 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:33.619 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522903+0000", 2024-09-12T16:17:33.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.929e-06 2024-09-12T16:17:33.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:33.620 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522913+0000", 2024-09-12T16:17:33.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0162e-05 2024-09-12T16:17:33.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:33.620 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522921+0000", 2024-09-12T16:17:33.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.14e-06 2024-09-12T16:17:33.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.621 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:33.621 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575922+0000", 2024-09-12T16:17:33.621 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053000712999999998 2024-09-12T16:17:33.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.621 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:33.621 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576006+0000", 2024-09-12T16:17:33.621 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4161999999999998e-05 2024-09-12T16:17:33.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.622 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:33.622 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576102+0000", 2024-09-12T16:17:33.622 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5919000000000001e-05 2024-09-12T16:17:33.622 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.622 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:33.622 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.622 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.622 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14040 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5059584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:33.622 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:17:33.622 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 74.072649355999999, 2024-09-12T16:17:33.622 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053413258999999998, 2024-09-12T16:17:33.622 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:33.622 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:33.623 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:33.623 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:33.623 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:33.623 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:33.623 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14040 2024-09-12T16:17:33.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.623 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:33.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.623 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:33.623 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:17:33.623 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.623 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:33.623 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:17:33.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.624 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:33.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523059+0000", 2024-09-12T16:17:33.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118466 2024-09-12T16:17:33.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.624 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:33.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523062+0000", 2024-09-12T16:17:33.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.971e-06 2024-09-12T16:17:33.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.625 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.625 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:33.625 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523069+0000", 2024-09-12T16:17:33.625 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8279999999999997e-06 2024-09-12T16:17:33.625 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.625 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.625 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:33.625 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523073+0000", 2024-09-12T16:17:33.625 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3019999999999996e-06 2024-09-12T16:17:33.625 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.625 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.625 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:33.625 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576155+0000", 2024-09-12T16:17:33.626 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053081962000000003 2024-09-12T16:17:33.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.626 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.626 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:33.626 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576249+0000", 2024-09-12T16:17:33.626 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3914999999999998e-05 2024-09-12T16:17:33.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.626 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.626 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:33.626 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576354+0000", 2024-09-12T16:17:33.626 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010481500000000001 2024-09-12T16:17:33.626 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.626 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:33.626 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.627 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.627 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14041 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5063680~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:33.627 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:17:33.627 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 74.072499050999994, 2024-09-12T16:17:33.627 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053519111000000001, 2024-09-12T16:17:33.627 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:33.627 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:33.627 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:33.627 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:33.627 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:33.627 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:33.627 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14041 2024-09-12T16:17:33.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.628 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:33.628 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.628 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:33.628 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:17:33.628 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.628 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.628 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.628 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:33.628 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:17:33.628 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.628 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.628 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.628 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:33.628 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523309+0000", 2024-09-12T16:17:33.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000218712 2024-09-12T16:17:33.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:33.629 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523313+0000", 2024-09-12T16:17:33.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.151e-06 2024-09-12T16:17:33.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:33.629 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523320+0000", 2024-09-12T16:17:33.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9789999999999993e-06 2024-09-12T16:17:33.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:33.630 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523325+0000", 2024-09-12T16:17:33.630 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:17:33.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.630 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.630 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:33.630 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576402+0000", 2024-09-12T16:17:33.630 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053076811000000002 2024-09-12T16:17:33.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.630 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.630 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:33.630 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576491+0000", 2024-09-12T16:17:33.630 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8578999999999993e-05 2024-09-12T16:17:33.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.630 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.630 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:33.630 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576610+0000", 2024-09-12T16:17:33.631 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119129 2024-09-12T16:17:33.631 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.631 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:33.631 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.631 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.631 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.631 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14042 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5067776~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:33.631 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:17:33.631 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 74.072255616999996, 2024-09-12T16:17:33.631 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053510350999999998, 2024-09-12T16:17:33.631 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:33.631 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:33.631 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:33.631 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:33.631 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:33.632 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:33.632 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14042 2024-09-12T16:17:33.632 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.632 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:33.632 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.632 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:33.632 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:17:33.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.632 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.632 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.632 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:33.632 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:17:33.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.632 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.633 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.633 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:33.633 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523591+0000", 2024-09-12T16:17:33.633 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025710300000000001 2024-09-12T16:17:33.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.633 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.633 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:33.633 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523594+0000", 2024-09-12T16:17:33.633 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2229999999999999e-06 2024-09-12T16:17:33.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.633 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.633 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:33.633 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523602+0000", 2024-09-12T16:17:33.633 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6930000000000007e-06 2024-09-12T16:17:33.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.634 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.634 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:33.634 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523607+0000", 2024-09-12T16:17:33.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4789999999999998e-06 2024-09-12T16:17:33.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.634 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.634 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:33.634 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576661+0000", 2024-09-12T16:17:33.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053973999999997 2024-09-12T16:17:33.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.634 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.634 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:33.634 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576745+0000", 2024-09-12T16:17:33.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4660000000000006e-05 2024-09-12T16:17:33.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.635 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.635 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:33.635 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576844+0000", 2024-09-12T16:17:33.635 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9219e-05 2024-09-12T16:17:33.635 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.635 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:33.635 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.635 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.635 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14043 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5071872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:33.635 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:17:33.635 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 74.071975137999999, 2024-09-12T16:17:33.635 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053475295999999999, 2024-09-12T16:17:33.636 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:33.636 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:33.636 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:33.636 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:33.636 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:33.636 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:33.636 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14043 2024-09-12T16:17:33.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.636 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:33.636 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.636 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:33.636 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:17:33.636 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.637 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.637 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.637 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:33.637 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:17:33.637 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.637 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.637 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.637 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:33.637 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523823+0000", 2024-09-12T16:17:33.637 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020818900000000001 2024-09-12T16:17:33.637 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.637 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.637 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:33.637 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523826+0000", 2024-09-12T16:17:33.637 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.405e-06 2024-09-12T16:17:33.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.638 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.638 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:33.638 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523834+0000", 2024-09-12T16:17:33.638 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5499999999999997e-06 2024-09-12T16:17:33.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.638 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.638 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:33.638 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523838+0000", 2024-09-12T16:17:33.638 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.408e-06 2024-09-12T16:17:33.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.638 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.638 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:33.638 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576904+0000", 2024-09-12T16:17:33.638 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053065687 2024-09-12T16:17:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576991+0000", 2024-09-12T16:17:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7399999999999997e-05 2024-09-12T16:17:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577090+0000", 2024-09-12T16:17:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8657000000000001e-05 2024-09-12T16:17:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14044 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5075968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:33.640 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:17:33.640 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 74.071743608000006, 2024-09-12T16:17:33.640 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053442659000000003, 2024-09-12T16:17:33.640 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:33.640 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:33.640 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:33.640 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:33.640 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:33.640 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:33.640 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14044 2024-09-12T16:17:33.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.640 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:33.640 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.641 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:33.641 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:17:33.641 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.641 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.641 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:33.641 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:17:33.641 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.641 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.641 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:33.641 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523985+0000", 2024-09-12T16:17:33.641 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000138522 2024-09-12T16:17:33.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.642 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.642 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:33.642 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523988+0000", 2024-09-12T16:17:33.642 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.788e-06 2024-09-12T16:17:33.642 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.642 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.642 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:33.642 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523998+0000", 2024-09-12T16:17:33.642 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8470000000000008e-06 2024-09-12T16:17:33.642 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.642 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.642 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:33.642 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524010+0000", 2024-09-12T16:17:33.643 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1348999999999999e-05 2024-09-12T16:17:33.643 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.643 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.643 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:33.643 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577137+0000", 2024-09-12T16:17:33.643 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053127055999999999 2024-09-12T16:17:33.643 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.643 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.643 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:33.643 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577210+0000", 2024-09-12T16:17:33.643 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3392000000000005e-05 2024-09-12T16:17:33.643 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.643 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.643 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:33.644 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577289+0000", 2024-09-12T16:17:33.644 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8704999999999999e-05 2024-09-12T16:17:33.644 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.644 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:33.644 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.644 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.644 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14045 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5080064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:33.644 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:17:33.644 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 74.071564787, 2024-09-12T16:17:33.644 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053497514000000003, 2024-09-12T16:17:33.644 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:33.644 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:33.645 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:33.645 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:33.645 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:33.645 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:33.645 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14045 2024-09-12T16:17:33.645 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.645 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:33.645 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.645 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:33.645 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:17:33.645 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.645 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.645 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.645 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:33.646 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:17:33.646 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.646 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.646 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.646 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:33.646 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524311+0000", 2024-09-12T16:17:33.646 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028626299999999998 2024-09-12T16:17:33.646 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.646 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.646 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:33.646 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524315+0000", 2024-09-12T16:17:33.646 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0969999999999999e-06 2024-09-12T16:17:33.646 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.646 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.646 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:33.647 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524325+0000", 2024-09-12T16:17:33.647 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6330000000000008e-06 2024-09-12T16:17:33.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.647 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.647 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:33.647 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524332+0000", 2024-09-12T16:17:33.647 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8700000000000003e-06 2024-09-12T16:17:33.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.647 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.647 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:33.647 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577334+0000", 2024-09-12T16:17:33.647 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053001834999999997 2024-09-12T16:17:33.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.647 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.648 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:33.648 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577420+0000", 2024-09-12T16:17:33.648 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6145999999999998e-05 2024-09-12T16:17:33.648 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.648 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.648 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:33.648 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577522+0000", 2024-09-12T16:17:33.648 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010267 2024-09-12T16:17:33.648 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.648 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:33.648 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.648 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.649 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.649 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14047 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5088256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:33.649 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:17:33.649 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 74.071079061000006, 2024-09-12T16:17:33.649 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053433340000000003, 2024-09-12T16:17:33.649 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:33.649 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:33.649 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:33.649 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:33.649 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:33.649 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:33.649 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14047 2024-09-12T16:17:33.649 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.650 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:33.650 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.650 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:33.650 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:17:33.650 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.650 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.650 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:33.650 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:17:33.650 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.650 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.650 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:33.650 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524727+0000", 2024-09-12T16:17:33.651 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000216126 2024-09-12T16:17:33.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.651 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.651 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:33.651 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524732+0000", 2024-09-12T16:17:33.651 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1569999999999999e-06 2024-09-12T16:17:33.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.651 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.651 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:33.651 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524742+0000", 2024-09-12T16:17:33.651 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0186999999999999e-05 2024-09-12T16:17:33.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.651 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.651 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:33.651 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524750+0000", 2024-09-12T16:17:33.651 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4279999999999999e-06 2024-09-12T16:17:33.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.652 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.652 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:33.652 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577743+0000", 2024-09-12T16:17:33.652 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052993077 2024-09-12T16:17:33.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.652 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.652 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:33.652 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577841+0000", 2024-09-12T16:17:33.652 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8369000000000006e-05 2024-09-12T16:17:33.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.652 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.652 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:33.652 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577944+0000", 2024-09-12T16:17:33.652 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102996 2024-09-12T16:17:33.653 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.653 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:33.653 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.653 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.653 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.653 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14048 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5092352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:33.653 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:17:33.653 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 74.070827468000005, 2024-09-12T16:17:33.653 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053397515, 2024-09-12T16:17:33.653 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:33.653 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:33.653 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:33.653 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:33.653 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:33.653 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:33.653 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14048 2024-09-12T16:17:33.654 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.654 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:33.654 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.654 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:33.654 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:17:33.654 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.654 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.654 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.654 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:33.654 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:17:33.654 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.654 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.654 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.655 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:33.655 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524957+0000", 2024-09-12T16:17:33.655 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019516999999999999 2024-09-12T16:17:33.655 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.655 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.655 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:33.655 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524962+0000", 2024-09-12T16:17:33.655 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7709999999999997e-06 2024-09-12T16:17:33.655 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.655 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.655 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:33.655 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524973+0000", 2024-09-12T16:17:33.655 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1031e-05 2024-09-12T16:17:33.655 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.656 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.656 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:33.656 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524980+0000", 2024-09-12T16:17:33.656 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6100000000000002e-06 2024-09-12T16:17:33.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.656 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.656 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:33.656 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577977+0000", 2024-09-12T16:17:33.656 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052997481999999999 2024-09-12T16:17:33.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.656 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.656 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:33.657 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578062+0000", 2024-09-12T16:17:33.657 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4851000000000005e-05 2024-09-12T16:17:33.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.657 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.657 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:33.657 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578160+0000", 2024-09-12T16:17:33.657 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7600000000000001e-05 2024-09-12T16:17:33.657 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.657 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:33.657 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.657 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.657 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14049 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5096448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:33.657 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:17:33.658 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 74.070598840000002, 2024-09-12T16:17:33.658 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053439792, 2024-09-12T16:17:33.658 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:33.658 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:33.658 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:33.658 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:33.658 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:33.658 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:33.658 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14049 2024-09-12T16:17:33.658 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.658 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:33.658 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.658 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:33.659 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:17:33.659 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.659 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.659 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:33.659 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:17:33.659 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.659 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.659 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:33.659 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525170+0000", 2024-09-12T16:17:33.659 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017958500000000001 2024-09-12T16:17:33.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.659 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.659 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:33.659 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525174+0000", 2024-09-12T16:17:33.660 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0239999999999999e-06 2024-09-12T16:17:33.660 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.660 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.660 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:33.660 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525184+0000", 2024-09-12T16:17:33.660 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5950000000000005e-06 2024-09-12T16:17:33.660 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.660 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.660 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:33.660 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525191+0000", 2024-09-12T16:17:33.660 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8329999999999996e-06 2024-09-12T16:17:33.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.661 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.661 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:33.661 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578240+0000", 2024-09-12T16:17:33.661 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053049236 2024-09-12T16:17:33.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.661 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.661 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:33.661 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578333+0000", 2024-09-12T16:17:33.661 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2806999999999994e-05 2024-09-12T16:17:33.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.661 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.661 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:33.662 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578431+0000", 2024-09-12T16:17:33.662 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7712000000000002e-05 2024-09-12T16:17:33.662 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.662 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:33.662 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.662 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.662 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.662 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14055 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5121024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:33.662 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:17:33.662 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 74.069328149, 2024-09-12T16:17:33.662 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053399038000000003, 2024-09-12T16:17:33.662 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:33.662 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:33.662 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:33.663 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:33.663 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:33.663 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:33.663 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14055 2024-09-12T16:17:33.663 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.663 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:33.663 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.663 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:33.663 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:17:33.663 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.663 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.663 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.663 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:33.663 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:17:33.663 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.664 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.664 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.664 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:33.664 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526403+0000", 2024-09-12T16:17:33.664 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141571 2024-09-12T16:17:33.664 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.664 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.664 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:33.664 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526406+0000", 2024-09-12T16:17:33.664 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2660000000000002e-06 2024-09-12T16:17:33.664 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.664 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.664 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:33.664 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526420+0000", 2024-09-12T16:17:33.664 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3949e-05 2024-09-12T16:17:33.665 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.665 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.665 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:33.665 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526428+0000", 2024-09-12T16:17:33.665 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4250000000000001e-06 2024-09-12T16:17:33.665 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.665 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.665 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:33.665 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579476+0000", 2024-09-12T16:17:33.665 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053048349000000002 2024-09-12T16:17:33.665 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.665 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.665 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:33.665 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579563+0000", 2024-09-12T16:17:33.665 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6502999999999995e-05 2024-09-12T16:17:33.666 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.666 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.666 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:33.666 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579661+0000", 2024-09-12T16:17:33.666 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7974999999999996e-05 2024-09-12T16:17:33.666 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.666 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:33.666 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.666 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.666 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.666 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4806.0:3139 3.1e 3:78d5a095:::rbd_data.11552a37e55b.0000000000000000:head [read 69632~61440] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:17:33.666 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:33.666 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 63.294333899000002, 2024-09-12T16:17:33.666 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057851734000000002, 2024-09-12T16:17:33.666 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:33.667 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:33.667 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:33.667 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:33.667 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4806", 2024-09-12T16:17:33.667 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3959815836", 2024-09-12T16:17:33.667 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 3139 2024-09-12T16:17:33.667 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.667 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:33.667 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.667 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:33.667 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:33.667 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.667 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.667 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.667 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:33.668 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:33.668 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.668 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.668 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.668 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:33.668 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:33.668 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4799999999999999e-07 2024-09-12T16:17:33.668 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.668 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.668 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:33.668 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301258+0000", 2024-09-12T16:17:33.668 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.844e-06 2024-09-12T16:17:33.668 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.668 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.668 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:33.669 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301267+0000", 2024-09-12T16:17:33.669 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2960000000000004e-06 2024-09-12T16:17:33.669 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.669 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.669 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:33.669 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301276+0000", 2024-09-12T16:17:33.669 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0650000000000005e-06 2024-09-12T16:17:33.669 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.669 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.669 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:33.669 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301871+0000", 2024-09-12T16:17:33.669 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00059423600000000005 2024-09-12T16:17:33.669 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.669 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.670 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:33.670 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301920+0000", 2024-09-12T16:17:33.670 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9067000000000003e-05 2024-09-12T16:17:33.670 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.670 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.670 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:33.670 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359108+0000", 2024-09-12T16:17:33.670 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057187877999999998 2024-09-12T16:17:33.670 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.670 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:33.670 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.670 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.670 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.670 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:6428 3.14 3:28a44e54:::rbd_header.11552a37e55b:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:17:33.670 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:17:33.670 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 63.294005304999999, 2024-09-12T16:17:33.671 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057504023000000001, 2024-09-12T16:17:33.671 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:33.671 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:33.671 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:33.671 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:33.671 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:17:33.671 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:17:33.671 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6428 2024-09-12T16:17:33.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.671 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:33.671 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.671 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:33.671 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:17:33.671 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.672 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.672 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:33.672 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:17:33.672 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.672 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.672 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.672 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:33.672 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301585+0000", 2024-09-12T16:17:33.672 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6300000000000005e-07 2024-09-12T16:17:33.672 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.672 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.672 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:33.672 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301588+0000", 2024-09-12T16:17:33.672 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4149999999999999e-06 2024-09-12T16:17:33.673 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.673 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.673 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:33.673 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301597+0000", 2024-09-12T16:17:33.673 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5450000000000003e-06 2024-09-12T16:17:33.673 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.673 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.673 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:33.673 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301617+0000", 2024-09-12T16:17:33.673 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9837e-05 2024-09-12T16:17:33.673 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.673 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.673 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:33.673 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301779+0000", 2024-09-12T16:17:33.673 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016186799999999999 2024-09-12T16:17:33.674 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.674 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.674 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:33.674 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301855+0000", 2024-09-12T16:17:33.674 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5899e-05 2024-09-12T16:17:33.674 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.674 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.674 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:33.674 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359088+0000", 2024-09-12T16:17:33.674 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057233895999999999 2024-09-12T16:17:33.674 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.674 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:33.674 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.674 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.675 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.675 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5223.0:1814 3.f 3:f7b1b1c5:::rbd_object_map.1155a1fd27d2:head [read 0~136] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-12T16:17:33.675 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:17:33.675 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 27.358339240999999, 2024-09-12T16:17:33.675 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.006378226, 2024-09-12T16:17:33.675 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:33.675 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:33.675 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:33.675 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:33.675 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5223", 2024-09-12T16:17:33.675 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/4066330994", 2024-09-12T16:17:33.675 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1814 2024-09-12T16:17:33.675 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.675 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:33.675 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.676 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:33.676 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:17:33.676 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.676 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.676 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.676 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:33.676 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:17:33.676 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.676 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.676 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.676 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:33.676 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237252+0000", 2024-09-12T16:17:33.676 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.344e-06 2024-09-12T16:17:33.677 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.677 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.677 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:33.677 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237258+0000", 2024-09-12T16:17:33.677 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1070000000000001e-06 2024-09-12T16:17:33.677 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.677 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.677 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:33.677 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237270+0000", 2024-09-12T16:17:33.677 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1758e-05 2024-09-12T16:17:33.677 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.677 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.677 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:33.677 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237278+0000", 2024-09-12T16:17:33.678 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3219999999999993e-06 2024-09-12T16:17:33.678 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.678 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.678 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:33.678 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237334+0000", 2024-09-12T16:17:33.678 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6356e-05 2024-09-12T16:17:33.678 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.678 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.678 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:17:33.678 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237345+0000", 2024-09-12T16:17:33.678 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0433e-05 2024-09-12T16:17:33.678 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.678 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.679 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:33.679 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243426+0000", 2024-09-12T16:17:33.679 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.00608133 2024-09-12T16:17:33.679 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.679 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.679 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:33.679 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243534+0000", 2024-09-12T16:17:33.679 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010784 2024-09-12T16:17:33.679 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.679 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.679 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:33.679 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243629+0000", 2024-09-12T16:17:33.679 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4735999999999996e-05 2024-09-12T16:17:33.679 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.680 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:33.680 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.680 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.680 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.680 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5328.0:2542 3.16 3:6928f3a1:::rbd_object_map.11551722dd77:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:33.680 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:17:33.680 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 21.539993810999999, 2024-09-12T16:17:33.680 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.054219934999999997, 2024-09-12T16:17:33.680 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:33.680 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:33.680 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:33.680 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:33.680 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5328", 2024-09-12T16:17:33.681 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:33.681 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2542 2024-09-12T16:17:33.681 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.681 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:33.681 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.681 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:33.681 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:17:33.681 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.681 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.681 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.681 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:33.681 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:17:33.681 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.681 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.681 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.681 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:33.682 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055597+0000", 2024-09-12T16:17:33.682 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4300000000000001e-07 2024-09-12T16:17:33.682 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.682 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.682 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:33.682 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055602+0000", 2024-09-12T16:17:33.682 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4269999999999999e-06 2024-09-12T16:17:33.682 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.682 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.682 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:33.682 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055613+0000", 2024-09-12T16:17:33.682 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0815000000000001e-05 2024-09-12T16:17:33.682 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.682 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.682 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:33.683 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055621+0000", 2024-09-12T16:17:33.683 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4189999999999996e-06 2024-09-12T16:17:33.683 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.683 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.683 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:33.683 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102196+0000", 2024-09-12T16:17:33.683 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.046575616 2024-09-12T16:17:33.683 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.683 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.683 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:33.683 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102258+0000", 2024-09-12T16:17:33.683 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1872000000000007e-05 2024-09-12T16:17:33.683 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.683 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.683 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T16:17:33.684 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102601+0000", 2024-09-12T16:17:33.684 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034285700000000001 2024-09-12T16:17:33.684 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.684 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.684 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:33.684 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.104431+0000", 2024-09-12T16:17:33.684 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001830524 2024-09-12T16:17:33.684 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.684 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.684 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:17:33.684 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109733+0000", 2024-09-12T16:17:33.684 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0053020089999999999 2024-09-12T16:17:33.684 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.684 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.685 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:33.685 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109777+0000", 2024-09-12T16:17:33.685 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3754000000000002e-05 2024-09-12T16:17:33.685 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.685 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.685 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:33.685 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109816+0000", 2024-09-12T16:17:33.685 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8699000000000003e-05 2024-09-12T16:17:33.685 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.685 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:33.685 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.685 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.685 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.686 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5328.0:2543 3.16 3:6928f3a1:::rbd_object_map.11551722dd77:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:33.686 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:17:33.686 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 21.539399832000001, 2024-09-12T16:17:33.686 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053695720000000002, 2024-09-12T16:17:33.686 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:33.686 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:33.686 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:33.686 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:33.686 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5328", 2024-09-12T16:17:33.686 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:33.686 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2543 2024-09-12T16:17:33.686 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.687 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:33.687 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.687 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:33.687 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:17:33.687 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.687 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.687 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.687 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:33.687 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:17:33.687 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:33.687 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.687 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.687 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:33.688 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056191+0000", 2024-09-12T16:17:33.688 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.54e-07 2024-09-12T16:17:33.688 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.688 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.688 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:33.688 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056195+0000", 2024-09-12T16:17:33.688 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5460000000000002e-06 2024-09-12T16:17:33.688 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.688 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.688 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:33.688 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056205+0000", 2024-09-12T16:17:33.688 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7350000000000008e-06 2024-09-12T16:17:33.688 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.689 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.689 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:33.689 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056214+0000", 2024-09-12T16:17:33.689 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8089999999999999e-06 2024-09-12T16:17:33.689 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.689 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.689 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:33.689 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103317+0000", 2024-09-12T16:17:33.689 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.047102889000000002 2024-09-12T16:17:33.689 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.689 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.689 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:33.689 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103410+0000", 2024-09-12T16:17:33.689 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3689000000000004e-05 2024-09-12T16:17:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T16:17:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103754+0000", 2024-09-12T16:17:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034344699999999998 2024-09-12T16:17:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.106487+0000", 2024-09-12T16:17:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0027330100000000001 2024-09-12T16:17:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:17:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109827+0000", 2024-09-12T16:17:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033406640000000001 2024-09-12T16:17:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.691 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.691 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:33.691 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109854+0000", 2024-09-12T16:17:33.691 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6866999999999999e-05 2024-09-12T16:17:33.691 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:33.691 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:33.691 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:33.691 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109886+0000", 2024-09-12T16:17:33.691 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1309999999999997e-05 2024-09-12T16:17:33.691 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.691 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:33.691 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.691 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:33.691 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:33.691 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:33.693 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:17:33.693 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:33.692+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:33.777 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #30, image image_client.0-clone30 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent31 2024-09-12T16:17:33.793 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:33.792+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:33.871 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:33.871 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:33.871 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:17:33.871 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:33.883 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:17:33.894 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:33.893+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:33.980 INFO:teuthology.orchestra.run.smithi204.stdout:4404 read 0xc883c00 thru 0xc89287a (0xec7b bytes) 2024-09-12T16:17:33.980 INFO:teuthology.orchestra.run.smithi204.stdout:4405 read 0x7b03600 thru 0x7b062a9 (0x2caa bytes) 2024-09-12T16:17:33.982 INFO:teuthology.orchestra.run.smithi204.stdout:4406 write 0xbf0da00 thru 0xbf0ed5c (0x135d bytes) 2024-09-12T16:17:33.982 INFO:teuthology.orchestra.run.smithi204.stdout:4407 write 0x668ec00 thru 0x669d34f (0xe750 bytes) 2024-09-12T16:17:33.983 INFO:teuthology.orchestra.run.smithi204.stdout:4408 read 0x998ba00 thru 0x9996385 (0xa986 bytes) 2024-09-12T16:17:33.993 INFO:teuthology.orchestra.run.smithi204.stdout:4409 trunc from 0xca3d800 to 0x53c3e00 2024-09-12T16:17:33.995 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:33.994+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:34.023 INFO:teuthology.orchestra.run.smithi204.stdout:4410 read 0x7f8000 thru 0x7ff625 (0x7626 bytes) 2024-09-12T16:17:34.036 INFO:teuthology.orchestra.run.smithi204.stdout:4411 write 0x7db2400 thru 0x7dc0d8b (0xe98c bytes) 2024-09-12T16:17:34.037 INFO:teuthology.orchestra.run.smithi204.stdout:4412 read 0x18d7600 thru 0x18da5a5 (0x2fa6 bytes) 2024-09-12T16:17:34.038 INFO:teuthology.orchestra.run.smithi204.stdout:4415 read 0x3caba00 thru 0x3cb30e0 (0x76e1 bytes) 2024-09-12T16:17:34.038 INFO:teuthology.orchestra.run.smithi204.stdout:4416 read 0x4c32a00 thru 0x4c3b2a5 (0x88a6 bytes) 2024-09-12T16:17:34.039 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:34.039 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:34.039 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:17:34.039 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:17:34.039 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:34.048 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:17:34.057 INFO:teuthology.orchestra.run.smithi204.stdout:4417 write 0xaf94200 thru 0xafa3019 (0xee1a bytes) 2024-09-12T16:17:34.059 INFO:teuthology.orchestra.run.smithi204.stdout:4418 trunc from 0xafa3200 to 0xc225c00 2024-09-12T16:17:34.072 INFO:teuthology.orchestra.run.smithi204.stdout:4419 read 0xa010e00 thru 0xa018187 (0x7388 bytes) 2024-09-12T16:17:34.073 INFO:teuthology.orchestra.run.smithi204.stdout:4420 write 0x9e72600 thru 0x9e820e1 (0xfae2 bytes) 2024-09-12T16:17:34.073 INFO:teuthology.orchestra.run.smithi204.stdout:4421 punch from 0x3781200 to 0x3784c00, (0x3a00 bytes) 2024-09-12T16:17:34.074 INFO:teuthology.orchestra.run.smithi204.stdout:4422 clone 33 order 22 su 32768 sc 4 2024-09-12T16:17:34.095 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:34.094+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:34.159 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:34.159 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:17:34.159 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:17:34.159 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:17:34.159 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.160 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5599 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4788224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:34.160 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:17:34.160 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 53.861231736000001, 2024-09-12T16:17:34.160 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061192059, 2024-09-12T16:17:34.160 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.160 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.160 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:34.160 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:34.160 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:34.160 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:34.160 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5599 2024-09-12T16:17:34.160 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.160 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.161 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.161 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.161 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:17:34.161 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.161 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.161 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.161 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.161 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:17:34.161 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.161 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.161 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.161 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.161 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296333+0000", 2024-09-12T16:17:34.162 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6599999999999996e-07 2024-09-12T16:17:34.162 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.162 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.162 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.162 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296335+0000", 2024-09-12T16:17:34.162 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5900000000000002e-06 2024-09-12T16:17:34.162 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.162 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.162 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.162 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296344+0000", 2024-09-12T16:17:34.162 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9539999999999993e-06 2024-09-12T16:17:34.164 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.165 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.165 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.165 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296350+0000", 2024-09-12T16:17:34.165 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5589999999999996e-06 2024-09-12T16:17:34.165 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.165 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.165 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.165 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357307+0000", 2024-09-12T16:17:34.165 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.060957573000000001 2024-09-12T16:17:34.165 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.165 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.165 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:34.165 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357401+0000", 2024-09-12T16:17:34.166 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3512999999999997e-05 2024-09-12T16:17:34.166 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.166 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.166 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.166 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357524+0000", 2024-09-12T16:17:34.166 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000123304 2024-09-12T16:17:34.166 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.166 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.166 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.166 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.166 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.166 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5611 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4730880~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:34.166 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:17:34.167 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 53.861169292, 2024-09-12T16:17:34.167 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061359348000000001, 2024-09-12T16:17:34.167 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.167 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.167 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:34.167 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:34.167 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:34.167 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:34.167 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5611 2024-09-12T16:17:34.167 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.167 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.167 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.167 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.168 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:17:34.168 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.168 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.168 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.168 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:17:34.168 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.168 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.168 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.168 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296395+0000", 2024-09-12T16:17:34.168 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4600000000000003e-07 2024-09-12T16:17:34.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.168 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.169 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.169 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296399+0000", 2024-09-12T16:17:34.169 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9430000000000002e-06 2024-09-12T16:17:34.169 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.169 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.169 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.169 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296411+0000", 2024-09-12T16:17:34.169 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1755e-05 2024-09-12T16:17:34.169 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.169 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.169 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.169 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296417+0000", 2024-09-12T16:17:34.169 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3790000000000003e-06 2024-09-12T16:17:34.170 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.170 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.170 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.170 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357572+0000", 2024-09-12T16:17:34.170 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061154871 2024-09-12T16:17:34.170 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.170 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.170 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:34.170 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357663+0000", 2024-09-12T16:17:34.170 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0389999999999993e-05 2024-09-12T16:17:34.170 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.170 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.170 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.170 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357754+0000", 2024-09-12T16:17:34.171 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1063999999999994e-05 2024-09-12T16:17:34.171 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.171 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.171 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.171 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.171 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.171 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5613 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4775936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:34.171 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:34.171 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 53.861128112000003, 2024-09-12T16:17:34.171 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061491777999999997, 2024-09-12T16:17:34.171 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.171 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.171 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:34.171 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:34.171 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:34.172 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:34.172 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5613 2024-09-12T16:17:34.172 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.172 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.172 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.172 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.172 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:34.172 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.172 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.172 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.172 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.172 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:34.172 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.172 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.173 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.173 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.173 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:34.173 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8899999999999999e-07 2024-09-12T16:17:34.173 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.173 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.173 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.173 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296439+0000", 2024-09-12T16:17:34.173 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8439999999999998e-06 2024-09-12T16:17:34.173 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.173 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.173 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.174 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296452+0000", 2024-09-12T16:17:34.174 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2639e-05 2024-09-12T16:17:34.174 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.174 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.174 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.174 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296457+0000", 2024-09-12T16:17:34.174 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5720000000000002e-06 2024-09-12T16:17:34.174 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.174 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.174 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.174 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357773+0000", 2024-09-12T16:17:34.174 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061315500000000002 2024-09-12T16:17:34.174 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.174 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.175 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:34.175 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357814+0000", 2024-09-12T16:17:34.175 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1448e-05 2024-09-12T16:17:34.175 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.175 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.175 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.175 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357927+0000", 2024-09-12T16:17:34.175 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000113186 2024-09-12T16:17:34.175 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.175 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.175 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.175 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.175 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.175 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5616 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4784128~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:34.175 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:34.176 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 53.861093050000001, 2024-09-12T16:17:34.176 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061725002000000001, 2024-09-12T16:17:34.176 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.176 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.176 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:34.176 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:34.176 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:34.176 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:34.176 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5616 2024-09-12T16:17:34.176 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.176 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.176 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.176 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.176 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:34.177 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.177 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.177 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.177 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.177 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:34.178 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.178 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.178 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.178 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.178 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:34.178 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5900000000000002e-07 2024-09-12T16:17:34.179 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.179 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.179 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.179 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296473+0000", 2024-09-12T16:17:34.179 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3130000000000001e-06 2024-09-12T16:17:34.179 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.180 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.180 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.180 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296481+0000", 2024-09-12T16:17:34.180 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1389999999999998e-06 2024-09-12T16:17:34.180 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.180 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.180 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.180 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296486+0000", 2024-09-12T16:17:34.180 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3310000000000003e-06 2024-09-12T16:17:34.180 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.180 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.181 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.181 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357981+0000", 2024-09-12T16:17:34.181 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061494866000000002 2024-09-12T16:17:34.181 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.181 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.181 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:34.181 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358082+0000", 2024-09-12T16:17:34.181 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101424 2024-09-12T16:17:34.181 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.181 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.181 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.181 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358196+0000", 2024-09-12T16:17:34.181 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011347 2024-09-12T16:17:34.182 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.182 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.182 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.182 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.182 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5626 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4739072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:34.182 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:17:34.182 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 53.861015094000003, 2024-09-12T16:17:34.182 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061802430999999998, 2024-09-12T16:17:34.182 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.182 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.182 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:34.182 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:34.183 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:34.183 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:34.183 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5626 2024-09-12T16:17:34.183 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.183 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.183 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.183 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.183 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:17:34.183 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.183 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.183 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.184 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.184 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:17:34.184 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.184 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.184 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.184 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.184 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296550+0000", 2024-09-12T16:17:34.184 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.215e-06 2024-09-12T16:17:34.184 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.184 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.184 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.184 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296555+0000", 2024-09-12T16:17:34.184 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9590000000000003e-06 2024-09-12T16:17:34.185 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.185 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.185 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.185 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296568+0000", 2024-09-12T16:17:34.185 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3338e-05 2024-09-12T16:17:34.185 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.185 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.185 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.185 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296576+0000", 2024-09-12T16:17:34.185 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5510000000000002e-06 2024-09-12T16:17:34.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.186 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.186 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.186 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358241+0000", 2024-09-12T16:17:34.186 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.06166576 2024-09-12T16:17:34.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.186 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.186 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:34.186 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358288+0000", 2024-09-12T16:17:34.186 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6097000000000003e-05 2024-09-12T16:17:34.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.186 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.186 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.186 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358351+0000", 2024-09-12T16:17:34.187 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3510999999999996e-05 2024-09-12T16:17:34.187 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.187 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.187 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.187 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.187 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.187 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5628 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4792320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:34.187 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:17:34.187 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 53.860972594000003, 2024-09-12T16:17:34.187 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061961161000000001, 2024-09-12T16:17:34.187 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.187 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.187 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:34.187 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:34.188 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:34.188 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:34.188 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5628 2024-09-12T16:17:34.188 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.188 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.188 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.188 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.188 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:17:34.188 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.188 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.188 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.188 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.188 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:17:34.188 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.189 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.189 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.189 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.189 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296592+0000", 2024-09-12T16:17:34.189 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2099999999999996e-07 2024-09-12T16:17:34.189 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.189 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.189 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.189 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296595+0000", 2024-09-12T16:17:34.189 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0429999999999999e-06 2024-09-12T16:17:34.189 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.189 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.189 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.189 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296603+0000", 2024-09-12T16:17:34.190 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9899999999999997e-06 2024-09-12T16:17:34.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.190 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.190 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.190 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296609+0000", 2024-09-12T16:17:34.190 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7259999999999999e-06 2024-09-12T16:17:34.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.190 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.190 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.190 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358393+0000", 2024-09-12T16:17:34.190 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061784617 2024-09-12T16:17:34.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.190 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.190 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:34.190 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358460+0000", 2024-09-12T16:17:34.191 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7253000000000001e-05 2024-09-12T16:17:34.191 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.191 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.191 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.191 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358552+0000", 2024-09-12T16:17:34.191 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1811000000000006e-05 2024-09-12T16:17:34.191 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.191 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.191 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.191 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.191 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.191 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5638 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4734976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:34.191 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:34.191 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 53.860500043000002, 2024-09-12T16:17:34.192 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061654460000000001, 2024-09-12T16:17:34.192 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.192 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.192 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:34.192 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:34.192 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:34.192 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:34.192 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5638 2024-09-12T16:17:34.192 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.192 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.192 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.192 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.192 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:34.192 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.193 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.193 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.193 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:34.193 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.193 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.193 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.193 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:34.193 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.23e-07 2024-09-12T16:17:34.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.193 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.193 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.194 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297068+0000", 2024-09-12T16:17:34.194 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0060000000000003e-06 2024-09-12T16:17:34.194 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.194 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.194 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.194 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297080+0000", 2024-09-12T16:17:34.194 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1234e-05 2024-09-12T16:17:34.194 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.194 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.194 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.194 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297095+0000", 2024-09-12T16:17:34.194 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5698000000000001e-05 2024-09-12T16:17:34.194 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.194 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.194 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358582+0000", 2024-09-12T16:17:34.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061486274 2024-09-12T16:17:34.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:34.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358637+0000", 2024-09-12T16:17:34.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5439999999999998e-05 2024-09-12T16:17:34.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358718+0000", 2024-09-12T16:17:34.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0984999999999998e-05 2024-09-12T16:17:34.195 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.195 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.195 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.196 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5640 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4780032~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:34.196 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:17:34.196 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 53.860418322999998, 2024-09-12T16:17:34.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061746620000000002, 2024-09-12T16:17:34.196 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.196 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.196 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:34.196 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:34.196 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:34.196 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:34.196 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5640 2024-09-12T16:17:34.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.196 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.197 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.197 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.197 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:17:34.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.197 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.197 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.197 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:17:34.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.197 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.198 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.198 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297146+0000", 2024-09-12T16:17:34.198 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3600000000000003e-07 2024-09-12T16:17:34.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.198 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.198 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.198 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297150+0000", 2024-09-12T16:17:34.198 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8430000000000003e-06 2024-09-12T16:17:34.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.199 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297160+0000", 2024-09-12T16:17:34.199 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7229999999999999e-06 2024-09-12T16:17:34.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.199 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297167+0000", 2024-09-12T16:17:34.199 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0180000000000004e-06 2024-09-12T16:17:34.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358750+0000", 2024-09-12T16:17:34.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061583104 2024-09-12T16:17:34.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:34.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358804+0000", 2024-09-12T16:17:34.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4277000000000002e-05 2024-09-12T16:17:34.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358892+0000", 2024-09-12T16:17:34.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7918999999999996e-05 2024-09-12T16:17:34.201 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.201 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.201 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.201 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.201 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5642 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4788224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:34.201 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:34.201 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 53.860373979000002, 2024-09-12T16:17:34.201 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061860409999999998, 2024-09-12T16:17:34.201 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.201 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.201 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:34.201 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:34.201 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:34.201 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:34.202 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5642 2024-09-12T16:17:34.202 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.202 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.202 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.202 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.202 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:34.202 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.202 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.202 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.202 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.202 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:34.202 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.202 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.202 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.202 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:34.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7999999999999995e-07 2024-09-12T16:17:34.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297193+0000", 2024-09-12T16:17:34.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8310000000000001e-06 2024-09-12T16:17:34.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297204+0000", 2024-09-12T16:17:34.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0832999999999999e-05 2024-09-12T16:17:34.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.204 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297210+0000", 2024-09-12T16:17:34.204 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1770000000000003e-06 2024-09-12T16:17:34.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.204 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.204 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.204 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358928+0000", 2024-09-12T16:17:34.204 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061717826000000003 2024-09-12T16:17:34.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.204 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.204 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:34.204 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358977+0000", 2024-09-12T16:17:34.204 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9514000000000001e-05 2024-09-12T16:17:34.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.204 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.205 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.205 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359050+0000", 2024-09-12T16:17:34.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2649000000000002e-05 2024-09-12T16:17:34.205 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.205 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.205 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.205 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5646 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4743168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:34.205 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:34.205 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 53.860194038000003, 2024-09-12T16:17:34.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061822122, 2024-09-12T16:17:34.206 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.206 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.206 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:34.206 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:34.206 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:34.206 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:34.206 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5646 2024-09-12T16:17:34.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.206 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.206 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.206 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.206 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:34.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.207 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.207 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:34.207 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.207 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.207 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:34.207 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3200000000000004e-07 2024-09-12T16:17:34.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.207 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.207 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297374+0000", 2024-09-12T16:17:34.207 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8240000000000001e-06 2024-09-12T16:17:34.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.208 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.208 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.208 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297384+0000", 2024-09-12T16:17:34.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5710000000000004e-06 2024-09-12T16:17:34.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.208 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.208 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.208 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297390+0000", 2024-09-12T16:17:34.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5130000000000002e-06 2024-09-12T16:17:34.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.208 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.208 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.208 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359080+0000", 2024-09-12T16:17:34.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061689569999999999 2024-09-12T16:17:34.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:34.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359134+0000", 2024-09-12T16:17:34.209 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3838999999999997e-05 2024-09-12T16:17:34.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359192+0000", 2024-09-12T16:17:34.209 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8072999999999998e-05 2024-09-12T16:17:34.209 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.209 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.209 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.210 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.210 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5647 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4751360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:34.210 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:17:34.210 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 53.860157352999998, 2024-09-12T16:17:34.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061927569000000002, 2024-09-12T16:17:34.210 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.210 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.210 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:34.210 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:34.210 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:34.210 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:34.210 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5647 2024-09-12T16:17:34.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.210 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.211 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.211 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:17:34.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.211 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.211 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:17:34.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.211 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.211 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297407+0000", 2024-09-12T16:17:34.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.46e-07 2024-09-12T16:17:34.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297409+0000", 2024-09-12T16:17:34.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.469e-06 2024-09-12T16:17:34.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297415+0000", 2024-09-12T16:17:34.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9259999999999997e-06 2024-09-12T16:17:34.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.213 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297419+0000", 2024-09-12T16:17:34.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3840000000000001e-06 2024-09-12T16:17:34.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.213 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.213 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359224+0000", 2024-09-12T16:17:34.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061805367999999999 2024-09-12T16:17:34.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.213 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:34.213 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359275+0000", 2024-09-12T16:17:34.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1338000000000002e-05 2024-09-12T16:17:34.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.213 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359334+0000", 2024-09-12T16:17:34.214 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8638000000000003e-05 2024-09-12T16:17:34.214 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.214 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.214 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.214 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.214 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5649 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4796416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:34.214 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:17:34.214 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 53.860102494000003, 2024-09-12T16:17:34.214 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.062018578999999997, 2024-09-12T16:17:34.214 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.214 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.214 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:34.215 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:34.215 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:34.215 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:34.215 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5649 2024-09-12T16:17:34.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.215 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.215 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.215 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:17:34.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.215 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.215 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:17:34.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.216 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.216 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297462+0000", 2024-09-12T16:17:34.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2399999999999998e-07 2024-09-12T16:17:34.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.216 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.216 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297465+0000", 2024-09-12T16:17:34.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.371e-06 2024-09-12T16:17:34.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297473+0000", 2024-09-12T16:17:34.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4699999999999996e-06 2024-09-12T16:17:34.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297478+0000", 2024-09-12T16:17:34.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2780000000000001e-06 2024-09-12T16:17:34.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359368+0000", 2024-09-12T16:17:34.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061889758000000003 2024-09-12T16:17:34.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:34.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359420+0000", 2024-09-12T16:17:34.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2574999999999997e-05 2024-09-12T16:17:34.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359480+0000", 2024-09-12T16:17:34.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9503000000000003e-05 2024-09-12T16:17:34.218 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.218 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.218 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.219 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5674 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4739072~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:34.219 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:17:34.219 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 53.859698725999998, 2024-09-12T16:17:34.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061762989999999997, 2024-09-12T16:17:34.219 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.219 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.219 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:34.219 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:34.219 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:34.219 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:34.219 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5674 2024-09-12T16:17:34.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.219 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.220 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.220 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:17:34.220 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.220 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.220 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.220 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:17:34.220 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.220 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.220 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.220 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297866+0000", 2024-09-12T16:17:34.220 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1900000000000001e-07 2024-09-12T16:17:34.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.221 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.221 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.221 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297870+0000", 2024-09-12T16:17:34.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3560000000000003e-06 2024-09-12T16:17:34.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.221 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.221 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.221 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297888+0000", 2024-09-12T16:17:34.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8088999999999999e-05 2024-09-12T16:17:34.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.222 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297904+0000", 2024-09-12T16:17:34.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5971e-05 2024-09-12T16:17:34.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.222 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359510+0000", 2024-09-12T16:17:34.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061605634999999999 2024-09-12T16:17:34.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:34.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359554+0000", 2024-09-12T16:17:34.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4024999999999999e-05 2024-09-12T16:17:34.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359628+0000", 2024-09-12T16:17:34.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4095000000000001e-05 2024-09-12T16:17:34.223 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.223 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.223 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.223 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5676 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4792320~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:34.224 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:17:34.224 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 53.859497646000001, 2024-09-12T16:17:34.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061720143999999998, 2024-09-12T16:17:34.224 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.224 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.224 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:34.224 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:34.224 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:34.224 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:34.224 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5676 2024-09-12T16:17:34.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.225 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:17:34.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:17:34.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298067+0000", 2024-09-12T16:17:34.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8199999999999999e-07 2024-09-12T16:17:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298070+0000", 2024-09-12T16:17:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.743e-06 2024-09-12T16:17:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298080+0000", 2024-09-12T16:17:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4059999999999994e-06 2024-09-12T16:17:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298088+0000", 2024-09-12T16:17:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0779999999999996e-06 2024-09-12T16:17:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359659+0000", 2024-09-12T16:17:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061570688999999998 2024-09-12T16:17:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359713+0000", 2024-09-12T16:17:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3939e-05 2024-09-12T16:17:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359786+0000", 2024-09-12T16:17:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3607000000000002e-05 2024-09-12T16:17:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5684 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4747264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:17:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 53.859030353999998, 2024-09-12T16:17:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061394799, 2024-09-12T16:17:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5684 2024-09-12T16:17:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:17:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:17:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298534+0000", 2024-09-12T16:17:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4399999999999999e-07 2024-09-12T16:17:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298539+0000", 2024-09-12T16:17:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5360000000000003e-06 2024-09-12T16:17:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298550+0000", 2024-09-12T16:17:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1499e-05 2024-09-12T16:17:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298558+0000", 2024-09-12T16:17:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3000000000000004e-06 2024-09-12T16:17:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359815+0000", 2024-09-12T16:17:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061257952999999997 2024-09-12T16:17:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359868+0000", 2024-09-12T16:17:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2317000000000001e-05 2024-09-12T16:17:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359928+0000", 2024-09-12T16:17:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0350000000000003e-05 2024-09-12T16:17:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5686 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4755456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:17:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 53.858862930000001, 2024-09-12T16:17:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061355082999999998, 2024-09-12T16:17:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5686 2024-09-12T16:17:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:17:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:17:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298702+0000", 2024-09-12T16:17:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2399999999999997e-07 2024-09-12T16:17:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298706+0000", 2024-09-12T16:17:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5700000000000003e-06 2024-09-12T16:17:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298718+0000", 2024-09-12T16:17:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1457999999999999e-05 2024-09-12T16:17:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298732+0000", 2024-09-12T16:17:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.452e-05 2024-09-12T16:17:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359956+0000", 2024-09-12T16:17:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061223626000000003 2024-09-12T16:17:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360000+0000", 2024-09-12T16:17:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3922999999999999e-05 2024-09-12T16:17:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360056+0000", 2024-09-12T16:17:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6162000000000002e-05 2024-09-12T16:17:34.238 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.238 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.238 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.238 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5688 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4800512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:34.239 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:17:34.239 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 53.858639877000002, 2024-09-12T16:17:34.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061270514999999998, 2024-09-12T16:17:34.239 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.239 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.239 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:34.239 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:34.239 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:34.239 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:34.239 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5688 2024-09-12T16:17:34.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.240 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.240 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.240 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.240 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:17:34.240 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.240 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.240 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.240 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.240 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:17:34.240 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.240 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.240 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.241 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.241 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298925+0000", 2024-09-12T16:17:34.241 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4e-07 2024-09-12T16:17:34.241 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.241 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.241 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.241 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298929+0000", 2024-09-12T16:17:34.241 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9890000000000003e-06 2024-09-12T16:17:34.241 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.241 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.241 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.241 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298936+0000", 2024-09-12T16:17:34.241 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.52e-06 2024-09-12T16:17:34.241 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.241 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.242 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.242 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298941+0000", 2024-09-12T16:17:34.242 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4800000000000003e-06 2024-09-12T16:17:34.242 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.242 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.242 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.242 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360087+0000", 2024-09-12T16:17:34.242 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061146143 2024-09-12T16:17:34.242 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.242 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.242 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:34.242 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360137+0000", 2024-09-12T16:17:34.242 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0584000000000002e-05 2024-09-12T16:17:34.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.243 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.243 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360194+0000", 2024-09-12T16:17:34.243 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6858999999999999e-05 2024-09-12T16:17:34.243 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.243 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.243 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.243 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5693 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4751360~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:34.243 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:17:34.243 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 53.858218239999999, 2024-09-12T16:17:34.244 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061139444000000001, 2024-09-12T16:17:34.244 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.244 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.244 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:34.244 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:34.244 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:34.244 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:34.244 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5693 2024-09-12T16:17:34.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.245 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.245 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.245 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.245 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:17:34.245 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.245 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.245 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.245 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:17:34.245 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.246 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.246 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.246 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299346+0000", 2024-09-12T16:17:34.246 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2300000000000001e-07 2024-09-12T16:17:34.246 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.246 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.247 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.247 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299349+0000", 2024-09-12T16:17:34.247 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5270000000000001e-06 2024-09-12T16:17:34.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.247 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.247 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299358+0000", 2024-09-12T16:17:34.247 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7030000000000001e-06 2024-09-12T16:17:34.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.248 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.248 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.248 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299364+0000", 2024-09-12T16:17:34.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7239999999999997e-06 2024-09-12T16:17:34.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.248 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.248 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.248 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360369+0000", 2024-09-12T16:17:34.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061004713000000002 2024-09-12T16:17:34.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.248 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.248 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:34.248 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360415+0000", 2024-09-12T16:17:34.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5926e-05 2024-09-12T16:17:34.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.249 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.249 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360485+0000", 2024-09-12T16:17:34.249 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0327999999999995e-05 2024-09-12T16:17:34.249 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.249 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.249 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.249 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5694 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4796416~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:34.249 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:17:34.249 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 53.858189211000003, 2024-09-12T16:17:34.249 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061258034000000003, 2024-09-12T16:17:34.249 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.250 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.250 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:34.250 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:34.250 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:34.250 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:34.250 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5694 2024-09-12T16:17:34.250 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.250 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.250 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.250 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.250 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:17:34.250 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.251 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.251 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.251 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:17:34.251 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.251 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.251 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.251 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301884+0000", 2024-09-12T16:17:34.251 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025090379999999999 2024-09-12T16:17:34.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.251 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.251 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.251 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301889+0000", 2024-09-12T16:17:34.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5879999999999997e-06 2024-09-12T16:17:34.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.252 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301901+0000", 2024-09-12T16:17:34.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1466e-05 2024-09-12T16:17:34.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.252 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301908+0000", 2024-09-12T16:17:34.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1999999999999997e-06 2024-09-12T16:17:34.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360513+0000", 2024-09-12T16:17:34.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.058605023999999999 2024-09-12T16:17:34.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:34.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360562+0000", 2024-09-12T16:17:34.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9546000000000003e-05 2024-09-12T16:17:34.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360633+0000", 2024-09-12T16:17:34.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0172000000000005e-05 2024-09-12T16:17:34.253 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.253 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.254 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.254 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.254 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.254 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5759 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4767744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:34.254 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:17:34.254 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 53.855395676999997, 2024-09-12T16:17:34.254 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061058604000000002, 2024-09-12T16:17:34.254 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.254 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.254 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:34.254 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:34.254 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:34.254 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:34.254 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5759 2024-09-12T16:17:34.254 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.254 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.255 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.255 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:17:34.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.255 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.255 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:17:34.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.255 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.255 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302548+0000", 2024-09-12T16:17:34.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00038011000000000002 2024-09-12T16:17:34.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.256 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.256 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302553+0000", 2024-09-12T16:17:34.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1830000000000002e-06 2024-09-12T16:17:34.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.256 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.256 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302564+0000", 2024-09-12T16:17:34.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1011e-05 2024-09-12T16:17:34.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.256 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.256 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302572+0000", 2024-09-12T16:17:34.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9009999999999994e-06 2024-09-12T16:17:34.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.257 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.257 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363102+0000", 2024-09-12T16:17:34.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.060529782999999997 2024-09-12T16:17:34.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.257 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:34.257 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363149+0000", 2024-09-12T16:17:34.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7321000000000003e-05 2024-09-12T16:17:34.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.257 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363227+0000", 2024-09-12T16:17:34.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7294999999999998e-05 2024-09-12T16:17:34.258 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.258 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.258 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.258 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.258 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.258 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:34.258 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-12T16:17:34.258 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T16:17:34.258 INFO:tasks.thrashosds.thrasher:inject_pause on osd.5 2024-09-12T16:17:34.259 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-12T16:17:34.259 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-12T16:17:34.259 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok config set filestore_inject_stall 3 2024-09-12T16:17:34.261 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:17:34.261 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:34.260+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:34.350 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T16:17:34.361 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:34.360+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:34.417 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:34.417 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "" 2024-09-12T16:17:34.417 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:34.419 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:34.419 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:34.419 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:17:34.419 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:34.428 INFO:teuthology.orchestra.run.smithi204.stdout:truncating image image_client.0-clone32 from 0xc225c00 (overlap 0x53c3e00) to 0x3242400 2024-09-12T16:17:34.429 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:17:34.462 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:34.461+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:34.563 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:34.562+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:34.578 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:34.578 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:34.578 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:17:34.578 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:17:34.579 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:34.587 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:17:34.664 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:34.662+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:34.701 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:34.701 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:17:34.701 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:17:34.701 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:17:34.701 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.701 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.17 73/72 [PushOp(3:e9340267:::rbd_data.1155525b14e3.0000000000000031:f, version: 50'357, data_included: [0~4096,20480~4096,40960~8192,65536~4096,81920~8192,110592~4096,126976~8192,151552~4096,172032~8192,196608~4096,212992~8192,241664~4096,258048~8192,282624~4096,303104~8192,327680~4096,344064~8192,372736~4096,389120~8192,413696~4096,434176~8192,458752~4096,475136~8192,503808~4096,520192~8192,544768~4096,565248~8192,589824~4096,606208~8192,634880~4096,651264~8192,675840~4096,696320~8192,720896~4096,737280~8192,765952~4096,782336~8192,806912~4096,827392~8192,851968~4096,868352~8192,897024~4096,913408~8192,937984~4096,958464~8192,983040~4096,999424~8192,1028096~4096,1044480~4096], data_size: 294912, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:e9340267:::rbd_data.1155525b14e3.0000000000000031:f@50'357, size: 1048576, copy_subset: [(0, 1048576)], clone_subset: {}, snapset: f=[]:{f: [f]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T16:17:34.701 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.067448+0000", 2024-09-12T16:17:34.701 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 28.631898800999998, 2024-09-12T16:17:34.701 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003036721, 2024-09-12T16:17:34.701 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.701 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.701 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:34.702 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.702 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.702 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.702 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067448+0000", 2024-09-12T16:17:34.702 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.702 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.702 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.702 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.702 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067448+0000", 2024-09-12T16:17:34.702 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.702 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.702 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.702 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.702 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067449+0000", 2024-09-12T16:17:34.703 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2200000000000004e-07 2024-09-12T16:17:34.703 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.703 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.703 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.703 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067703+0000", 2024-09-12T16:17:34.703 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025377199999999998 2024-09-12T16:17:34.703 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.703 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.703 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.703 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067723+0000", 2024-09-12T16:17:34.703 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.986e-05 2024-09-12T16:17:34.703 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.703 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.703 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.703 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067743+0000", 2024-09-12T16:17:34.703 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9942e-05 2024-09-12T16:17:34.704 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.704 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.704 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.704 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067860+0000", 2024-09-12T16:17:34.704 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000116959 2024-09-12T16:17:34.704 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.704 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.704 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:34.704 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067872+0000", 2024-09-12T16:17:34.704 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2928000000000001e-05 2024-09-12T16:17:34.704 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.704 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.704 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.704 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.070485+0000", 2024-09-12T16:17:34.704 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0026127379999999999 2024-09-12T16:17:34.705 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.705 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.705 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.705 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.705 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.705 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.16 74/72 [PushOp(3:68db2424:::rbd_data.1155525b14e3.000000000000002a:f, version: 50'736, data_included: [0~352256,368640~4096,385024~12288,413696~4096,430080~8192,458752~4096,471040~12288,499712~4096,516096~12288,544768~4096,561152~8192,589824~4096,602112~12288,630784~4096,647168~12288,675840~4096,692224~8192,720896~4096,733184~12288,761856~4096,778240~12288,806912~4096,823296~8192,851968~4096,868352~8192,892928~4096,913408~8192,937984~4096,958464~4096,983040~4096,999424~8192,1024000~4096,1044480~4096], data_size: 569344, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:68db2424:::rbd_data.1155525b14e3.000000000000002a:f@50'736, size: 1048576, copy_subset: [(0, 1048576)], clone_subset: {}, snapset: f=[]:{f: [f]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T16:17:34.705 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.264309+0000", 2024-09-12T16:17:34.705 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 28.435037876999999, 2024-09-12T16:17:34.705 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025728819999999999, 2024-09-12T16:17:34.705 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.705 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.705 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:34.705 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.705 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.705 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.706 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.264309+0000", 2024-09-12T16:17:34.706 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.706 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.706 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.706 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.706 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.264309+0000", 2024-09-12T16:17:34.706 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.706 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.706 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.706 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.706 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.264310+0000", 2024-09-12T16:17:34.706 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5499999999999998e-07 2024-09-12T16:17:34.706 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.706 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.706 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.707 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.264565+0000", 2024-09-12T16:17:34.707 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025476399999999999 2024-09-12T16:17:34.707 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.707 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.707 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.707 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.264584+0000", 2024-09-12T16:17:34.707 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9349999999999999e-05 2024-09-12T16:17:34.707 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.707 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.707 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.707 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.264602+0000", 2024-09-12T16:17:34.707 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8173e-05 2024-09-12T16:17:34.707 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.707 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.707 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.708 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.264690+0000", 2024-09-12T16:17:34.708 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7403000000000003e-05 2024-09-12T16:17:34.708 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.708 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.708 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:34.708 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.264701+0000", 2024-09-12T16:17:34.708 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1566000000000001e-05 2024-09-12T16:17:34.708 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.708 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.708 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.708 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.266882+0000", 2024-09-12T16:17:34.708 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0021810710000000001 2024-09-12T16:17:34.708 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.708 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.709 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.709 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.709 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.709 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5120.0:3941 3.17 e80/74 3:eff97428:::rbd_data.1155a3b3a26e.0000000000000060:head v 80'442, mlcod=79'439)", 2024-09-12T16:17:34.709 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:17:34.709 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 18.34355832, 2024-09-12T16:17:34.709 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0035981759999999998, 2024-09-12T16:17:34.709 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.709 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.709 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:34.709 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.709 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.709 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.709 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:17:34.709 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.710 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.710 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.710 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.710 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:17:34.710 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.710 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.710 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.710 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.710 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:17:34.710 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2e-07 2024-09-12T16:17:34.710 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.710 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.710 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.710 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355794+0000", 2024-09-12T16:17:34.710 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.865e-06 2024-09-12T16:17:34.711 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.711 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.711 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.711 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355956+0000", 2024-09-12T16:17:34.711 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016131699999999999 2024-09-12T16:17:34.711 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.711 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.711 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.711 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355964+0000", 2024-09-12T16:17:34.711 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7960000000000001e-06 2024-09-12T16:17:34.711 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.711 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.711 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.711 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.356320+0000", 2024-09-12T16:17:34.711 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000355612 2024-09-12T16:17:34.712 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.712 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.712 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:34.712 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.356337+0000", 2024-09-12T16:17:34.712 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6643e-05 2024-09-12T16:17:34.712 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.712 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.712 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:34.712 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.359340+0000", 2024-09-12T16:17:34.712 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003003618 2024-09-12T16:17:34.712 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.712 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.712 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.712 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.359387+0000", 2024-09-12T16:17:34.712 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6904999999999999e-05 2024-09-12T16:17:34.713 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.713 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.713 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.713 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.713 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.713 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2118 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1219, mlcod=88'1217)", 2024-09-12T16:17:34.713 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440434+0000", 2024-09-12T16:17:34.713 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 9.2589134299999998, 2024-09-12T16:17:34.713 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003875543, 2024-09-12T16:17:34.713 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.713 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.713 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:34.713 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.713 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.713 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.714 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440434+0000", 2024-09-12T16:17:34.714 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.714 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.714 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.714 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440434+0000", 2024-09-12T16:17:34.714 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.714 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.714 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.714 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440435+0000", 2024-09-12T16:17:34.714 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8899999999999998e-07 2024-09-12T16:17:34.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.714 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.714 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.714 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440444+0000", 2024-09-12T16:17:34.715 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4599999999999992e-06 2024-09-12T16:17:34.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.715 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.715 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.715 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440459+0000", 2024-09-12T16:17:34.715 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4460999999999999e-05 2024-09-12T16:17:34.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.715 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.715 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.715 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440466+0000", 2024-09-12T16:17:34.715 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4340000000000003e-06 2024-09-12T16:17:34.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.715 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.715 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.715 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:17:34.716 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9054999999999997e-05 2024-09-12T16:17:34.716 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.716 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.716 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:34.716 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440535+0000", 2024-09-12T16:17:34.716 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.98e-05 2024-09-12T16:17:34.716 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.716 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.716 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:34.716 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444269+0000", 2024-09-12T16:17:34.716 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003734448 2024-09-12T16:17:34.716 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.716 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.716 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.716 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444309+0000", 2024-09-12T16:17:34.717 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0095999999999997e-05 2024-09-12T16:17:34.717 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.717 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.717 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.717 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.717 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2122 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1220, mlcod=88'1217)", 2024-09-12T16:17:34.717 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440484+0000", 2024-09-12T16:17:34.717 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 9.2588629240000007, 2024-09-12T16:17:34.717 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0038538029999999998, 2024-09-12T16:17:34.717 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.717 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.717 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:34.717 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.718 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.718 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.718 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440484+0000", 2024-09-12T16:17:34.718 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.718 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.718 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.718 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.718 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440484+0000", 2024-09-12T16:17:34.718 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.718 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.718 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.718 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.718 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440485+0000", 2024-09-12T16:17:34.718 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6100000000000002e-07 2024-09-12T16:17:34.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.719 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.719 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.719 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440493+0000", 2024-09-12T16:17:34.719 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0169999999999996e-06 2024-09-12T16:17:34.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.719 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.719 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.719 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440501+0000", 2024-09-12T16:17:34.719 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9319999999999996e-06 2024-09-12T16:17:34.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.719 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.720 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.720 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440506+0000", 2024-09-12T16:17:34.720 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3510000000000001e-06 2024-09-12T16:17:34.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.720 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.720 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.720 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441319+0000", 2024-09-12T16:17:34.720 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00081295300000000005 2024-09-12T16:17:34.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.720 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.720 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:34.720 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441336+0000", 2024-09-12T16:17:34.720 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6897000000000001e-05 2024-09-12T16:17:34.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.721 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.721 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:34.721 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444311+0000", 2024-09-12T16:17:34.721 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029754510000000001 2024-09-12T16:17:34.721 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.721 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.721 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.721 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444338+0000", 2024-09-12T16:17:34.721 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6840999999999999e-05 2024-09-12T16:17:34.721 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.721 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.721 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.721 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.721 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.722 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2124 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1221, mlcod=88'1217)", 2024-09-12T16:17:34.722 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:17:34.722 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 9.2588323520000007, 2024-09-12T16:17:34.722 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0038507229999999999, 2024-09-12T16:17:34.722 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.722 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.722 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:34.722 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.722 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.722 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.722 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:17:34.722 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.722 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.723 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.723 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:17:34.723 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.723 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.723 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.723 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:17:34.723 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8799999999999998e-07 2024-09-12T16:17:34.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.723 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.723 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.723 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440519+0000", 2024-09-12T16:17:34.723 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5499999999999999e-06 2024-09-12T16:17:34.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.723 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.724 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.724 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440525+0000", 2024-09-12T16:17:34.724 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1009999999999997e-06 2024-09-12T16:17:34.724 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.724 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.724 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.724 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440529+0000", 2024-09-12T16:17:34.724 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3749999999999996e-06 2024-09-12T16:17:34.724 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.724 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.724 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.724 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441883+0000", 2024-09-12T16:17:34.724 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0013538249999999999 2024-09-12T16:17:34.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.725 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.725 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:34.725 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441901+0000", 2024-09-12T16:17:34.725 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7972999999999999e-05 2024-09-12T16:17:34.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.725 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.725 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:34.725 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444341+0000", 2024-09-12T16:17:34.725 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002439568 2024-09-12T16:17:34.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.725 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.725 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.726 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444366+0000", 2024-09-12T16:17:34.726 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5043000000000001e-05 2024-09-12T16:17:34.726 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.726 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.726 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.726 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.726 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.726 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2327 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1222, mlcod=88'1217)", 2024-09-12T16:17:34.726 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440696+0000", 2024-09-12T16:17:34.726 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 9.2586510099999995, 2024-09-12T16:17:34.726 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0036945739999999999, 2024-09-12T16:17:34.726 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.726 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.726 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:34.726 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.727 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440696+0000", 2024-09-12T16:17:34.727 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.727 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440696+0000", 2024-09-12T16:17:34.727 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.727 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440697+0000", 2024-09-12T16:17:34.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5899999999999996e-07 2024-09-12T16:17:34.728 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.728 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.728 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.728 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440702+0000", 2024-09-12T16:17:34.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0969999999999996e-06 2024-09-12T16:17:34.728 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.728 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.728 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.728 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440713+0000", 2024-09-12T16:17:34.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1114000000000001e-05 2024-09-12T16:17:34.728 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.728 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.729 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.729 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440719+0000", 2024-09-12T16:17:34.729 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1650000000000003e-06 2024-09-12T16:17:34.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.729 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.729 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.729 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.442435+0000", 2024-09-12T16:17:34.729 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017155440000000001 2024-09-12T16:17:34.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.729 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.729 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:34.729 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.442457+0000", 2024-09-12T16:17:34.729 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1793999999999998e-05 2024-09-12T16:17:34.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.730 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:34.730 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444367+0000", 2024-09-12T16:17:34.730 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0019101980000000001 2024-09-12T16:17:34.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.730 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.730 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444391+0000", 2024-09-12T16:17:34.730 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4003e-05 2024-09-12T16:17:34.730 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.730 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.730 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.731 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2487 3.1d e88/74 3:b8c395a6:::rbd_data.11558d85ce23.000000000000000b:head v 88'1225, mlcod=88'1223)", 2024-09-12T16:17:34.731 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:17:34.731 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 9.2531366409999993, 2024-09-12T16:17:34.731 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033166039999999999, 2024-09-12T16:17:34.731 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.731 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.731 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:34.731 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.731 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.731 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:17:34.731 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:17:34.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:17:34.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9299999999999997e-07 2024-09-12T16:17:34.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446295+0000", 2024-09-12T16:17:34.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3153999999999997e-05 2024-09-12T16:17:34.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.733 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.733 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.733 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446309+0000", 2024-09-12T16:17:34.733 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4015e-05 2024-09-12T16:17:34.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.733 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.733 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.733 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446317+0000", 2024-09-12T16:17:34.733 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4880000000000007e-06 2024-09-12T16:17:34.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.733 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.733 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.734 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446373+0000", 2024-09-12T16:17:34.734 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5766000000000001e-05 2024-09-12T16:17:34.734 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.734 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.734 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:34.734 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446395+0000", 2024-09-12T16:17:34.734 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2500000000000001e-05 2024-09-12T16:17:34.734 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.734 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.734 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:34.734 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.449445+0000", 2024-09-12T16:17:34.734 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003049791 2024-09-12T16:17:34.734 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.735 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.735 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.735 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.449527+0000", 2024-09-12T16:17:34.735 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2096999999999997e-05 2024-09-12T16:17:34.735 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.735 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.735 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.735 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.735 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.735 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2493 3.2 e88/74 3:46cb4ff0:::rbd_data.11558d85ce23.000000000000000e:head v 88'372, mlcod=87'370)", 2024-09-12T16:17:34.735 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.447443+0000", 2024-09-12T16:17:34.735 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 9.2519047029999992, 2024-09-12T16:17:34.735 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029120330000000001, 2024-09-12T16:17:34.735 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.736 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.736 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:34.736 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.736 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.736 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.736 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447443+0000", 2024-09-12T16:17:34.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.736 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.736 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.736 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447443+0000", 2024-09-12T16:17:34.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.736 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.736 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.737 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447443+0000", 2024-09-12T16:17:34.737 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4600000000000001e-07 2024-09-12T16:17:34.737 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.737 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.737 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.737 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447779+0000", 2024-09-12T16:17:34.737 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00033639800000000001 2024-09-12T16:17:34.737 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.737 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.737 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.737 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447790+0000", 2024-09-12T16:17:34.737 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0555e-05 2024-09-12T16:17:34.737 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.737 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.737 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.738 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447797+0000", 2024-09-12T16:17:34.738 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1729999999999998e-06 2024-09-12T16:17:34.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.738 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.738 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.738 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447862+0000", 2024-09-12T16:17:34.738 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4670000000000003e-05 2024-09-12T16:17:34.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.738 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.738 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:34.738 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447889+0000", 2024-09-12T16:17:34.738 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.773e-05 2024-09-12T16:17:34.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:34.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.450311+0000", 2024-09-12T16:17:34.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0024212510000000001 2024-09-12T16:17:34.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.450355+0000", 2024-09-12T16:17:34.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.401e-05 2024-09-12T16:17:34.739 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.739 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.739 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.740 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2494 3.2 e88/74 3:46cb4ff0:::rbd_data.11558d85ce23.000000000000000e:head v 88'374, mlcod=87'370)", 2024-09-12T16:17:34.740 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.448265+0000", 2024-09-12T16:17:34.740 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 9.251082641, 2024-09-12T16:17:34.740 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002703165, 2024-09-12T16:17:34.740 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.740 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.740 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:34.740 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.740 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.740 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.740 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.448265+0000", 2024-09-12T16:17:34.740 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.741 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.741 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.741 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.448265+0000", 2024-09-12T16:17:34.741 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.741 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.741 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.741 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.448265+0000", 2024-09-12T16:17:34.741 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4899999999999995e-07 2024-09-12T16:17:34.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.741 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.741 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.741 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.448271+0000", 2024-09-12T16:17:34.741 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4210000000000003e-06 2024-09-12T16:17:34.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.742 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.742 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.448280+0000", 2024-09-12T16:17:34.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5619999999999993e-06 2024-09-12T16:17:34.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.742 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.742 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.448287+0000", 2024-09-12T16:17:34.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4309999999999999e-06 2024-09-12T16:17:34.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.742 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.742 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.448443+0000", 2024-09-12T16:17:34.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015667099999999999 2024-09-12T16:17:34.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:34.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.448478+0000", 2024-09-12T16:17:34.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4724000000000002e-05 2024-09-12T16:17:34.743 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:34.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.450931+0000", 2024-09-12T16:17:34.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0024531050000000001 2024-09-12T16:17:34.743 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.450968+0000", 2024-09-12T16:17:34.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6602e-05 2024-09-12T16:17:34.743 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.744 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.744 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.744 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "pg_update_log_missing(3.5 epoch 92/74 rep_tid 1618 entries 92'520 (0'0) error 3:a46c381c:::rbd_data.1155c757bf36.000000000000002f:head by client.5577.0:14350 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 92'518)", 2024-09-12T16:17:34.744 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.408248+0000", 2024-09-12T16:17:34.744 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.2910988230000005, 2024-09-12T16:17:34.744 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029209660000000001, 2024-09-12T16:17:34.744 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.744 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.744 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "reached pg", 2024-09-12T16:17:34.744 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.744 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.745 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408248+0000", 2024-09-12T16:17:34.745 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.745 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.745 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.745 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.745 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408248+0000", 2024-09-12T16:17:34.745 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.745 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.745 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.745 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.745 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408249+0000", 2024-09-12T16:17:34.745 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9800000000000002e-07 2024-09-12T16:17:34.745 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.746 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.746 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.746 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408259+0000", 2024-09-12T16:17:34.746 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1949999999999992e-06 2024-09-12T16:17:34.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.746 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.746 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.746 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408278+0000", 2024-09-12T16:17:34.746 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9157e-05 2024-09-12T16:17:34.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.746 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.746 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.746 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408291+0000", 2024-09-12T16:17:34.746 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3655000000000001e-05 2024-09-12T16:17:34.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.747 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408369+0000", 2024-09-12T16:17:34.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7804000000000002e-05 2024-09-12T16:17:34.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.747 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411169+0000", 2024-09-12T16:17:34.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002800257 2024-09-12T16:17:34.747 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.747 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.747 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.748 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "pg_update_log_missing(3.1d epoch 92/74 rep_tid 3087 entries 92'1280 (0'0) error 3:bc3c4c0b:::rbd_data.1155c757bf36.000000000000002c:head by client.5577.0:14343 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 90'1278)", 2024-09-12T16:17:34.748 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.408860+0000", 2024-09-12T16:17:34.748 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.2904871949999999, 2024-09-12T16:17:34.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0056480419999999998, 2024-09-12T16:17:34.748 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.748 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.748 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "reached pg", 2024-09-12T16:17:34.748 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.748 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.748 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408860+0000", 2024-09-12T16:17:34.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.749 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.749 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408860+0000", 2024-09-12T16:17:34.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.749 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.749 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408861+0000", 2024-09-12T16:17:34.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6600000000000002e-07 2024-09-12T16:17:34.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.750 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.750 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.750 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408867+0000", 2024-09-12T16:17:34.750 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4150000000000004e-06 2024-09-12T16:17:34.750 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.750 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.750 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.750 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408881+0000", 2024-09-12T16:17:34.750 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4326e-05 2024-09-12T16:17:34.750 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.750 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.750 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.750 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408895+0000", 2024-09-12T16:17:34.751 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3903000000000001e-05 2024-09-12T16:17:34.751 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.751 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.751 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.751 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410566+0000", 2024-09-12T16:17:34.751 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001670822 2024-09-12T16:17:34.751 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.751 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.751 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.751 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414508+0000", 2024-09-12T16:17:34.751 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039421100000000004 2024-09-12T16:17:34.751 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.751 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.751 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.752 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.752 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "pg_update_log_missing(3.5 epoch 92/74 rep_tid 1621 entries 92'521 (0'0) error 3:a759f741:::rbd_data.1155c757bf36.0000000000000036:head by client.5577.0:14364 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 92'518)", 2024-09-12T16:17:34.752 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:17:34.752 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.2895387180000002, 2024-09-12T16:17:34.752 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047586740000000001, 2024-09-12T16:17:34.752 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.752 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.752 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "reached pg", 2024-09-12T16:17:34.752 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.752 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.752 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.752 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:17:34.753 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.753 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.753 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.753 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.753 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:17:34.753 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.753 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.753 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.753 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.753 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:17:34.753 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.54e-07 2024-09-12T16:17:34.753 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.753 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.753 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.754 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409817+0000", 2024-09-12T16:17:34.754 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.028e-06 2024-09-12T16:17:34.754 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.754 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.754 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.754 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410047+0000", 2024-09-12T16:17:34.754 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022964599999999999 2024-09-12T16:17:34.754 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.754 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.754 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.754 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410067+0000", 2024-09-12T16:17:34.754 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0438999999999999e-05 2024-09-12T16:17:34.754 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.754 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.754 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.755 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411223+0000", 2024-09-12T16:17:34.755 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011560229999999999 2024-09-12T16:17:34.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.755 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.755 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.755 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414567+0000", 2024-09-12T16:17:34.755 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033437839999999998 2024-09-12T16:17:34.755 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.755 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.755 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.755 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.755 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14391 3.5 e92/74 3:a5105766:::rbd_data.1155c757bf36.0000000000000044:head v 92'523, mlcod=92'518)", 2024-09-12T16:17:34.755 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.410084+0000", 2024-09-12T16:17:34.755 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.2892628479999999, 2024-09-12T16:17:34.756 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0046720299999999998, 2024-09-12T16:17:34.756 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.756 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.756 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:34.756 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.756 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.756 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.756 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410084+0000", 2024-09-12T16:17:34.756 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.756 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.756 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.756 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.756 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410084+0000", 2024-09-12T16:17:34.756 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.757 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.757 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.757 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410085+0000", 2024-09-12T16:17:34.757 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1900000000000002e-07 2024-09-12T16:17:34.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.757 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.757 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.757 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410091+0000", 2024-09-12T16:17:34.757 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1e-06 2024-09-12T16:17:34.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.757 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.757 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.757 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410100+0000", 2024-09-12T16:17:34.757 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6889999999999993e-06 2024-09-12T16:17:34.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.758 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.758 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.758 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410105+0000", 2024-09-12T16:17:34.758 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3199999999999999e-06 2024-09-12T16:17:34.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.758 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.758 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.758 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411563+0000", 2024-09-12T16:17:34.758 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00145795 2024-09-12T16:17:34.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.758 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.758 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:34.759 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411590+0000", 2024-09-12T16:17:34.759 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6570000000000001e-05 2024-09-12T16:17:34.759 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.759 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.759 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:34.759 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414571+0000", 2024-09-12T16:17:34.759 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029815710000000001 2024-09-12T16:17:34.759 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.759 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.759 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.759 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414756+0000", 2024-09-12T16:17:34.759 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018521100000000001 2024-09-12T16:17:34.759 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.759 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.760 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.760 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.760 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.760 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14405 3.5 e92/74 3:a0797093:::rbd_data.1155c757bf36.000000000000004b:head v 92'525, mlcod=92'518)", 2024-09-12T16:17:34.760 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.410119+0000", 2024-09-12T16:17:34.760 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.289227908, 2024-09-12T16:17:34.760 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047304000000000001, 2024-09-12T16:17:34.760 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.760 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.760 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:34.760 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.760 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.760 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.760 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410119+0000", 2024-09-12T16:17:34.761 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.761 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.761 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.761 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410119+0000", 2024-09-12T16:17:34.761 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.761 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.761 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.761 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410120+0000", 2024-09-12T16:17:34.761 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:17:34.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.761 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.761 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.762 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410126+0000", 2024-09-12T16:17:34.762 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1460000000000001e-06 2024-09-12T16:17:34.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.762 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.762 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.762 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410134+0000", 2024-09-12T16:17:34.762 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8879999999999997e-06 2024-09-12T16:17:34.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.762 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.762 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.762 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410140+0000", 2024-09-12T16:17:34.762 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0839999999999997e-06 2024-09-12T16:17:34.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.763 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.763 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.763 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412146+0000", 2024-09-12T16:17:34.763 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0020057569999999999 2024-09-12T16:17:34.763 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.763 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.763 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:34.763 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412163+0000", 2024-09-12T16:17:34.763 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7742000000000001e-05 2024-09-12T16:17:34.763 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.763 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.763 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:34.763 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414761+0000", 2024-09-12T16:17:34.763 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025979660000000002 2024-09-12T16:17:34.764 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.764 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.764 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.764 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414850+0000", 2024-09-12T16:17:34.764 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8426999999999999e-05 2024-09-12T16:17:34.764 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.764 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.764 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.764 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.764 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.764 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14435 3.1d e92/74 3:b810b250:::rbd_data.1155c757bf36.000000000000010b:head v 92'1282, mlcod=90'1278)", 2024-09-12T16:17:34.764 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:17:34.764 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.2883854389999998, 2024-09-12T16:17:34.764 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039190579999999996, 2024-09-12T16:17:34.765 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.765 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.765 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:34.765 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.765 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.765 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.765 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:17:34.765 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.765 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.765 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.765 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:17:34.765 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.765 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.766 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:17:34.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5199999999999996e-07 2024-09-12T16:17:34.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.766 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410968+0000", 2024-09-12T16:17:34.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.305e-06 2024-09-12T16:17:34.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.766 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410986+0000", 2024-09-12T16:17:34.767 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8213999999999999e-05 2024-09-12T16:17:34.767 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.767 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.767 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.767 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410993+0000", 2024-09-12T16:17:34.767 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2849999999999997e-06 2024-09-12T16:17:34.767 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.767 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.767 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.767 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412228+0000", 2024-09-12T16:17:34.767 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0012347370000000001 2024-09-12T16:17:34.767 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.767 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.767 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:34.767 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412262+0000", 2024-09-12T16:17:34.768 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3531999999999997e-05 2024-09-12T16:17:34.768 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.768 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.768 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:34.768 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414854+0000", 2024-09-12T16:17:34.768 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002592039 2024-09-12T16:17:34.768 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.768 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.768 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.768 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414881+0000", 2024-09-12T16:17:34.768 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7294e-05 2024-09-12T16:17:34.768 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.768 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.769 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.769 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14434 3.5 e92/74 3:a09dd60f:::rbd_data.1155c757bf36.000000000000010a:head v 92'527, mlcod=92'518)", 2024-09-12T16:17:34.769 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.411186+0000", 2024-09-12T16:17:34.769 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.2881612919999998, 2024-09-12T16:17:34.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0037696930000000002, 2024-09-12T16:17:34.769 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.769 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.769 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:34.769 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.769 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.769 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411186+0000", 2024-09-12T16:17:34.770 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.770 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.770 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411186+0000", 2024-09-12T16:17:34.770 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.770 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.770 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411187+0000", 2024-09-12T16:17:34.770 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3799999999999997e-07 2024-09-12T16:17:34.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.771 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.771 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411203+0000", 2024-09-12T16:17:34.771 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6793999999999999e-05 2024-09-12T16:17:34.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.771 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.771 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.771 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411323+0000", 2024-09-12T16:17:34.771 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011975499999999999 2024-09-12T16:17:34.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.771 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.771 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.771 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411332+0000", 2024-09-12T16:17:34.771 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4370000000000007e-06 2024-09-12T16:17:34.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.771 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.772 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.772 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.413073+0000", 2024-09-12T16:17:34.772 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001741827 2024-09-12T16:17:34.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.772 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:34.772 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.413091+0000", 2024-09-12T16:17:34.772 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8011000000000001e-05 2024-09-12T16:17:34.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.772 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:34.772 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414882+0000", 2024-09-12T16:17:34.772 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001790841 2024-09-12T16:17:34.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.773 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.773 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414956+0000", 2024-09-12T16:17:34.773 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.339e-05 2024-09-12T16:17:34.773 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.773 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.773 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.773 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.773 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.773 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14395 3.16 e92/75 3:6d5a7945:::rbd_data.1155c757bf36.0000000000000046:head v 92'1284, mlcod=90'1280)", 2024-09-12T16:17:34.773 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.415185+0000", 2024-09-12T16:17:34.773 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.2841619020000001, 2024-09-12T16:17:34.773 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002612217, 2024-09-12T16:17:34.773 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.774 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.774 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:34.774 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.774 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.774 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.774 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415185+0000", 2024-09-12T16:17:34.774 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.774 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.774 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.774 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415185+0000", 2024-09-12T16:17:34.774 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.774 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.775 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.775 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415186+0000", 2024-09-12T16:17:34.775 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3799999999999998e-07 2024-09-12T16:17:34.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.775 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.775 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415243+0000", 2024-09-12T16:17:34.775 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6956000000000002e-05 2024-09-12T16:17:34.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.775 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.775 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415250+0000", 2024-09-12T16:17:34.775 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9700000000000002e-06 2024-09-12T16:17:34.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.776 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.776 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415256+0000", 2024-09-12T16:17:34.776 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1500000000000004e-06 2024-09-12T16:17:34.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.776 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.776 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415801+0000", 2024-09-12T16:17:34.776 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00054526800000000001 2024-09-12T16:17:34.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.776 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:34.776 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415817+0000", 2024-09-12T16:17:34.776 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6189e-05 2024-09-12T16:17:34.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.777 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.777 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:34.777 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.417715+0000", 2024-09-12T16:17:34.777 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0018981169999999999 2024-09-12T16:17:34.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.777 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.777 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.777 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.417798+0000", 2024-09-12T16:17:34.777 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2128999999999999e-05 2024-09-12T16:17:34.777 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.777 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.777 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.778 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14426 3.13 e92/74 3:c827d1d7:::rbd_data.1155c757bf36.0000000000000056:head v 92'741, mlcod=90'737)", 2024-09-12T16:17:34.778 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:17:34.778 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.284069379, 2024-09-12T16:17:34.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030296030000000001, 2024-09-12T16:17:34.778 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.778 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.778 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:34.778 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.778 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.778 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:17:34.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:17:34.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:17:34.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6300000000000001e-07 2024-09-12T16:17:34.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415282+0000", 2024-09-12T16:17:34.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6289999999999999e-06 2024-09-12T16:17:34.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.780 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.780 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.780 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415288+0000", 2024-09-12T16:17:34.780 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5520000000000001e-06 2024-09-12T16:17:34.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.780 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.780 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.780 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415293+0000", 2024-09-12T16:17:34.780 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6879999999999998e-06 2024-09-12T16:17:34.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.780 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.780 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.781 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415412+0000", 2024-09-12T16:17:34.781 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118579 2024-09-12T16:17:34.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.781 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.781 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:34.781 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415429+0000", 2024-09-12T16:17:34.781 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7501000000000001e-05 2024-09-12T16:17:34.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.781 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.781 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:34.781 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.418270+0000", 2024-09-12T16:17:34.781 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028404860000000001 2024-09-12T16:17:34.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.781 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.782 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.782 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.418307+0000", 2024-09-12T16:17:34.782 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7805000000000001e-05 2024-09-12T16:17:34.782 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.782 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.782 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.782 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.782 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.782 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14399 3.16 e92/75 3:6e4c3dfc:::rbd_data.1155c757bf36.0000000000000048:head v 92'1286, mlcod=90'1280)", 2024-09-12T16:17:34.782 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.415311+0000", 2024-09-12T16:17:34.782 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.2840364649999998, 2024-09-12T16:17:34.782 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028826809999999998, 2024-09-12T16:17:34.782 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:34.782 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:34.783 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:34.783 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:34.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.783 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:34.783 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415311+0000", 2024-09-12T16:17:34.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.783 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:34.783 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415311+0000", 2024-09-12T16:17:34.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:34.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.783 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:34.784 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415311+0000", 2024-09-12T16:17:34.784 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0600000000000001e-07 2024-09-12T16:17:34.784 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.784 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.784 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:34.784 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415315+0000", 2024-09-12T16:17:34.784 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.172e-06 2024-09-12T16:17:34.784 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.784 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.784 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:34.784 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415322+0000", 2024-09-12T16:17:34.784 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0999999999999998e-06 2024-09-12T16:17:34.784 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.785 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.785 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:34.785 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415327+0000", 2024-09-12T16:17:34.785 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6430000000000003e-06 2024-09-12T16:17:34.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.785 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.785 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:34.785 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.416666+0000", 2024-09-12T16:17:34.785 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001338718 2024-09-12T16:17:34.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.785 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.785 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:34.785 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.416683+0000", 2024-09-12T16:17:34.785 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7628000000000001e-05 2024-09-12T16:17:34.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.786 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.786 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:34.786 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.418128+0000", 2024-09-12T16:17:34.786 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0014445440000000001 2024-09-12T16:17:34.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:34.786 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:34.786 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:34.786 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.418193+0000", 2024-09-12T16:17:34.786 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5569999999999997e-05 2024-09-12T16:17:34.786 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.786 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.786 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.787 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:34.787 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:34.787 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:34.788 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:34.787+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:34.789 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:17:34.889 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:34.888+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:34.896 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:34.896 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:34.896 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:17:34.896 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:34.905 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:17:34.989 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:34.988+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:35.025 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #31, image image_client.0-clone31 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent32 2024-09-12T16:17:35.062 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:35.063 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:35.063 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:17:35.063 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:17:35.063 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:35.073 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:17:35.118 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:35.117+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:35.132 INFO:teuthology.orchestra.run.smithi204.stdout:4423 read 0x29d4600 thru 0x29d4bec (0x5ed bytes) 2024-09-12T16:17:35.132 INFO:teuthology.orchestra.run.smithi204.stdout:4424 read 0x7580000 thru 0x758a63e (0xa63f bytes) 2024-09-12T16:17:35.133 INFO:teuthology.orchestra.run.smithi204.stdout:4426 punch from 0xbd66400 to 0xbd6f600, (0x9200 bytes) 2024-09-12T16:17:35.141 INFO:teuthology.orchestra.run.smithi204.stdout:4427 write 0x32cb600 thru 0x32d2671 (0x7072 bytes) 2024-09-12T16:17:35.186 INFO:teuthology.orchestra.run.smithi204.stdout:4430 write 0xdfd5400 thru 0xdfd72ff (0x1f00 bytes) 2024-09-12T16:17:35.187 INFO:teuthology.orchestra.run.smithi204.stdout:4431 punch from 0x4c4a200 to 0x4c4cc00, (0x2a00 bytes) 2024-09-12T16:17:35.189 INFO:teuthology.orchestra.run.smithi204.stdout:4432 read 0x6ec3c00 thru 0x6ed33d6 (0xf7d7 bytes) 2024-09-12T16:17:35.189 INFO:teuthology.orchestra.run.smithi204.stdout:4434 read 0x5b9d600 thru 0x5ba80b7 (0xaab8 bytes) 2024-09-12T16:17:35.190 INFO:teuthology.orchestra.run.smithi204.stdout:4435 read 0xa341600 thru 0xa3469b3 (0x53b4 bytes) 2024-09-12T16:17:35.190 INFO:teuthology.orchestra.run.smithi204.stdout:4436 write 0x770f200 thru 0x771ec65 (0xfa66 bytes) 2024-09-12T16:17:35.191 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:35.191 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:17:35.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:17:35.192 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:17:35.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.192 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3705 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14812160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:35.192 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:17:35.192 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 77.049628061999996, 2024-09-12T16:17:35.192 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053368831999999998, 2024-09-12T16:17:35.192 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:35.192 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:35.192 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:35.192 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:35.192 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:35.192 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:35.192 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3705 2024-09-12T16:17:35.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.193 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:35.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.193 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:35.193 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:17:35.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.193 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:35.193 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:17:35.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:35.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139932+0000", 2024-09-12T16:17:35.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012762099999999999 2024-09-12T16:17:35.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:35.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139935+0000", 2024-09-12T16:17:35.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.119e-06 2024-09-12T16:17:35.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:35.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139939+0000", 2024-09-12T16:17:35.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7999999999999998e-06 2024-09-12T16:17:35.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:35.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139953+0000", 2024-09-12T16:17:35.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3923999999999999e-05 2024-09-12T16:17:35.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:35.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192946+0000", 2024-09-12T16:17:35.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052992971 2024-09-12T16:17:35.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:35.196 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193035+0000", 2024-09-12T16:17:35.196 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9040000000000001e-05 2024-09-12T16:17:35.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.196 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:35.196 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193174+0000", 2024-09-12T16:17:35.196 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138357 2024-09-12T16:17:35.196 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.196 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:35.196 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.197 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3706 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14816256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:35.197 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:17:35.197 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 77.049473071999998, 2024-09-12T16:17:35.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053341723000000001, 2024-09-12T16:17:35.197 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:35.197 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:35.197 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:35.197 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:35.197 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:35.197 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:35.197 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3706 2024-09-12T16:17:35.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.197 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:35.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:35.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:17:35.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:35.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:17:35.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:35.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140090+0000", 2024-09-12T16:17:35.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013020100000000001 2024-09-12T16:17:35.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:35.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140097+0000", 2024-09-12T16:17:35.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0709999999999997e-06 2024-09-12T16:17:35.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:35.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140103+0000", 2024-09-12T16:17:35.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5450000000000003e-06 2024-09-12T16:17:35.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:35.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140106+0000", 2024-09-12T16:17:35.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3739999999999998e-06 2024-09-12T16:17:35.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:35.200 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193190+0000", 2024-09-12T16:17:35.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053084131999999999 2024-09-12T16:17:35.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.200 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.200 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:35.200 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193232+0000", 2024-09-12T16:17:35.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1517000000000002e-05 2024-09-12T16:17:35.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.200 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.200 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:35.200 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193302+0000", 2024-09-12T16:17:35.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9882999999999995e-05 2024-09-12T16:17:35.200 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.200 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:35.201 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.201 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3707 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14820352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:35.201 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:17:35.201 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 77.049321082999995, 2024-09-12T16:17:35.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053452771000000003, 2024-09-12T16:17:35.201 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:35.201 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:35.201 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:35.201 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:35.201 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:35.201 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:35.201 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3707 2024-09-12T16:17:35.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.202 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:35.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.202 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:35.202 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:17:35.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.202 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:35.202 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:17:35.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:35.203 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140219+0000", 2024-09-12T16:17:35.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106902 2024-09-12T16:17:35.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:35.203 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140225+0000", 2024-09-12T16:17:35.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3199999999999996e-06 2024-09-12T16:17:35.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:35.203 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140230+0000", 2024-09-12T16:17:35.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8969999999999999e-06 2024-09-12T16:17:35.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:35.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140233+0000", 2024-09-12T16:17:35.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2119999999999999e-06 2024-09-12T16:17:35.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:35.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193339+0000", 2024-09-12T16:17:35.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053105556999999998 2024-09-12T16:17:35.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:35.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193431+0000", 2024-09-12T16:17:35.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1837999999999997e-05 2024-09-12T16:17:35.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:35.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193565+0000", 2024-09-12T16:17:35.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013404500000000001 2024-09-12T16:17:35.205 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.205 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:35.205 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.205 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3708 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14824448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:35.205 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:17:35.205 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 77.049192241, 2024-09-12T16:17:35.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053468190999999998, 2024-09-12T16:17:35.206 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:35.206 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:35.206 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:35.206 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:35.206 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:35.206 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:35.206 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3708 2024-09-12T16:17:35.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.206 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:35.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:35.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:17:35.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:35.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:17:35.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:35.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140351+0000", 2024-09-12T16:17:35.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110096 2024-09-12T16:17:35.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:35.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140358+0000", 2024-09-12T16:17:35.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.306e-06 2024-09-12T16:17:35.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:35.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140368+0000", 2024-09-12T16:17:35.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0225e-05 2024-09-12T16:17:35.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:35.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140372+0000", 2024-09-12T16:17:35.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6169999999999998e-06 2024-09-12T16:17:35.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:35.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193594+0000", 2024-09-12T16:17:35.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053222419999999999 2024-09-12T16:17:35.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:35.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193640+0000", 2024-09-12T16:17:35.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.587e-05 2024-09-12T16:17:35.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:35.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193709+0000", 2024-09-12T16:17:35.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8657000000000004e-05 2024-09-12T16:17:35.209 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.209 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:35.209 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.210 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3709 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14828544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:35.210 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:17:35.210 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 77.049055272999993, 2024-09-12T16:17:35.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594033999999999, 2024-09-12T16:17:35.210 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:35.210 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:35.210 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:35.210 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:35.210 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:35.210 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:35.210 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3709 2024-09-12T16:17:35.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.210 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:35.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:35.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:17:35.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:35.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:17:35.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:35.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140499+0000", 2024-09-12T16:17:35.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121019 2024-09-12T16:17:35.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:35.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140501+0000", 2024-09-12T16:17:35.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2369999999999999e-06 2024-09-12T16:17:35.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:35.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140506+0000", 2024-09-12T16:17:35.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.639e-06 2024-09-12T16:17:35.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:35.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140509+0000", 2024-09-12T16:17:35.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3419999999999999e-06 2024-09-12T16:17:35.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:35.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193743+0000", 2024-09-12T16:17:35.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053234311999999999 2024-09-12T16:17:35.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:35.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193833+0000", 2024-09-12T16:17:35.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9883999999999995e-05 2024-09-12T16:17:35.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:35.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193972+0000", 2024-09-12T16:17:35.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138601 2024-09-12T16:17:35.214 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.214 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:35.214 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.214 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3710 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14832640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:35.214 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:17:35.214 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 77.048917927000005, 2024-09-12T16:17:35.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053607324999999997, 2024-09-12T16:17:35.214 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:35.214 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:35.214 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:35.214 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:35.214 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:35.214 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:35.215 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3710 2024-09-12T16:17:35.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.215 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:35.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:35.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:17:35.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:35.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:17:35.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:35.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140664+0000", 2024-09-12T16:17:35.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014918700000000001 2024-09-12T16:17:35.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:35.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140674+0000", 2024-09-12T16:17:35.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8379999999999997e-06 2024-09-12T16:17:35.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:35.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140694+0000", 2024-09-12T16:17:35.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0145000000000001e-05 2024-09-12T16:17:35.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:35.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140703+0000", 2024-09-12T16:17:35.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5150000000000006e-06 2024-09-12T16:17:35.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:35.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194006+0000", 2024-09-12T16:17:35.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053303370000000003 2024-09-12T16:17:35.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:35.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194051+0000", 2024-09-12T16:17:35.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5012000000000002e-05 2024-09-12T16:17:35.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:35.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194122+0000", 2024-09-12T16:17:35.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1258000000000001e-05 2024-09-12T16:17:35.218 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.218 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:35.218 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.218 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3711 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14836736~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:35.218 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:17:35.218 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 77.048716479000007, 2024-09-12T16:17:35.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053670799999999998, 2024-09-12T16:17:35.218 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:35.219 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:35.219 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:35.219 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:35.219 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:35.219 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:35.219 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3711 2024-09-12T16:17:35.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.219 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:35.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:35.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:17:35.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:35.220 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:17:35.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.220 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:35.220 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140782+0000", 2024-09-12T16:17:35.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5549999999999994e-05 2024-09-12T16:17:35.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.220 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:35.220 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140786+0000", 2024-09-12T16:17:35.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.89e-06 2024-09-12T16:17:35.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.220 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:35.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140796+0000", 2024-09-12T16:17:35.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0057e-05 2024-09-12T16:17:35.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:35.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140819+0000", 2024-09-12T16:17:35.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3005000000000001e-05 2024-09-12T16:17:35.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:35.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194159+0000", 2024-09-12T16:17:35.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053340324000000001 2024-09-12T16:17:35.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:35.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194248+0000", 2024-09-12T16:17:35.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9209000000000006e-05 2024-09-12T16:17:35.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:35.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194387+0000", 2024-09-12T16:17:35.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138765 2024-09-12T16:17:35.222 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.222 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:35.222 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.223 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3712 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14840832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:35.223 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:17:35.223 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 77.048602020999994, 2024-09-12T16:17:35.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053699068000000003, 2024-09-12T16:17:35.223 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:35.223 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:35.223 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:35.223 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:35.223 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:35.223 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:35.223 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3712 2024-09-12T16:17:35.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.223 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:35.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:35.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:17:35.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:35.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:17:35.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:35.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140900+0000", 2024-09-12T16:17:35.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9014e-05 2024-09-12T16:17:35.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:35.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140904+0000", 2024-09-12T16:17:35.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0940000000000001e-06 2024-09-12T16:17:35.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:35.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140933+0000", 2024-09-12T16:17:35.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8996000000000002e-05 2024-09-12T16:17:35.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:35.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140945+0000", 2024-09-12T16:17:35.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1909000000000001e-05 2024-09-12T16:17:35.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:35.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194415+0000", 2024-09-12T16:17:35.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053470403 2024-09-12T16:17:35.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:35.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194460+0000", 2024-09-12T16:17:35.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5145000000000002e-05 2024-09-12T16:17:35.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:35.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194530+0000", 2024-09-12T16:17:35.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9506999999999997e-05 2024-09-12T16:17:35.227 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.227 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:35.227 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.227 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3713 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14844928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:35.227 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:17:35.227 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 77.048468960999998, 2024-09-12T16:17:35.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053821236000000001, 2024-09-12T16:17:35.227 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:35.228 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:35.228 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:35.228 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:35.228 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:35.228 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:35.228 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3713 2024-09-12T16:17:35.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.228 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:35.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:35.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:17:35.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:35.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:17:35.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:35.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141078+0000", 2024-09-12T16:17:35.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114162 2024-09-12T16:17:35.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:35.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141090+0000", 2024-09-12T16:17:35.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.19e-05 2024-09-12T16:17:35.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:35.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141100+0000", 2024-09-12T16:17:35.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0447e-05 2024-09-12T16:17:35.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:35.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141108+0000", 2024-09-12T16:17:35.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7190000000000001e-06 2024-09-12T16:17:35.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:35.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194564+0000", 2024-09-12T16:17:35.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053455729 2024-09-12T16:17:35.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:35.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194652+0000", 2024-09-12T16:17:35.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8288999999999994e-05 2024-09-12T16:17:35.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:35.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194785+0000", 2024-09-12T16:17:35.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013299000000000001 2024-09-12T16:17:35.231 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.231 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:35.231 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.232 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3714 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14849024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:35.232 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:17:35.232 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 77.048313031999996, 2024-09-12T16:17:35.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053816382000000003, 2024-09-12T16:17:35.232 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:35.232 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:35.232 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:35.232 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:35.232 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:35.232 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:35.232 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3714 2024-09-12T16:17:35.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.232 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:35.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:35.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:17:35.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:35.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:17:35.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:35.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141182+0000", 2024-09-12T16:17:35.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1805999999999997e-05 2024-09-12T16:17:35.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:35.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141185+0000", 2024-09-12T16:17:35.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5930000000000002e-06 2024-09-12T16:17:35.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:35.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141194+0000", 2024-09-12T16:17:35.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5760000000000006e-06 2024-09-12T16:17:35.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:35.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141222+0000", 2024-09-12T16:17:35.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8034999999999998e-05 2024-09-12T16:17:35.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:35.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194817+0000", 2024-09-12T16:17:35.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594887000000001 2024-09-12T16:17:35.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:35.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194860+0000", 2024-09-12T16:17:35.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3714999999999997e-05 2024-09-12T16:17:35.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:35.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194936+0000", 2024-09-12T16:17:35.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5770000000000001e-05 2024-09-12T16:17:35.236 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.236 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:35.236 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.236 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3715 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14853120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:35.236 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:17:35.236 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 77.048189375000007, 2024-09-12T16:17:35.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053962307000000001, 2024-09-12T16:17:35.236 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:35.236 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:35.237 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:35.237 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:35.237 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:35.237 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:35.237 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3715 2024-09-12T16:17:35.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.237 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:35.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.237 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:35.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:17:35.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:35.238 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:17:35.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:35.238 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141417+0000", 2024-09-12T16:17:35.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017384099999999999 2024-09-12T16:17:35.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:35.238 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141422+0000", 2024-09-12T16:17:35.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7310000000000001e-06 2024-09-12T16:17:35.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:35.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141434+0000", 2024-09-12T16:17:35.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2058e-05 2024-09-12T16:17:35.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:35.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141442+0000", 2024-09-12T16:17:35.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7610000000000007e-06 2024-09-12T16:17:35.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:35.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194973+0000", 2024-09-12T16:17:35.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053530618000000002 2024-09-12T16:17:35.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:35.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195063+0000", 2024-09-12T16:17:35.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0927000000000005e-05 2024-09-12T16:17:35.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:35.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195206+0000", 2024-09-12T16:17:35.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142371 2024-09-12T16:17:35.240 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.240 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:35.240 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.240 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3716 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14857216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:35.241 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:17:35.241 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 77.047979525000002, 2024-09-12T16:17:35.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053916360000000003, 2024-09-12T16:17:35.241 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:35.241 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:35.241 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:35.241 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:35.241 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:35.241 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:35.241 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3716 2024-09-12T16:17:35.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.241 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:35.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:35.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:17:35.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:35.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:17:35.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:35.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142933+0000", 2024-09-12T16:17:35.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014796290000000001 2024-09-12T16:17:35.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:35.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142937+0000", 2024-09-12T16:17:35.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5760000000000002e-06 2024-09-12T16:17:35.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:35.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142946+0000", 2024-09-12T16:17:35.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0380000000000005e-06 2024-09-12T16:17:35.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:35.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142951+0000", 2024-09-12T16:17:35.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9749999999999998e-06 2024-09-12T16:17:35.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:35.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195246+0000", 2024-09-12T16:17:35.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052295358 2024-09-12T16:17:35.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.244 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:35.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195299+0000", 2024-09-12T16:17:35.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2976999999999998e-05 2024-09-12T16:17:35.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.244 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:35.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195370+0000", 2024-09-12T16:17:35.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0807000000000002e-05 2024-09-12T16:17:35.244 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.245 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:35.245 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.245 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3721 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14877696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:35.245 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:35.245 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 77.046406074000004, 2024-09-12T16:17:35.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053422994000000001, 2024-09-12T16:17:35.245 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:35.245 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:35.245 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:35.245 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:35.245 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:35.245 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:35.246 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3721 2024-09-12T16:17:35.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.246 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:35.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:35.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:35.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:35.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:35.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:35.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:35.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:17:35.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:35.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143028+0000", 2024-09-12T16:17:35.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7399999999999991e-07 2024-09-12T16:17:35.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:35.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143031+0000", 2024-09-12T16:17:35.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7599999999999998e-06 2024-09-12T16:17:35.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:35.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143034+0000", 2024-09-12T16:17:35.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9780000000000001e-06 2024-09-12T16:17:35.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:35.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196220+0000", 2024-09-12T16:17:35.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053186341999999998 2024-09-12T16:17:35.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:35.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196313+0000", 2024-09-12T16:17:35.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2676000000000005e-05 2024-09-12T16:17:35.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:35.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196450+0000", 2024-09-12T16:17:35.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137052 2024-09-12T16:17:35.249 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.249 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:35.249 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.249 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3722 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14881792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:35.249 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:35.249 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 77.046396181999995, 2024-09-12T16:17:35.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053556835999999997, 2024-09-12T16:17:35.249 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:35.249 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:35.249 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:35.250 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:35.250 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:35.250 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:35.250 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3722 2024-09-12T16:17:35.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.250 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:35.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:35.250 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:35.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:35.250 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:35.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:35.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:35.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.11e-07 2024-09-12T16:17:35.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:35.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143038+0000", 2024-09-12T16:17:35.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2399999999999996e-07 2024-09-12T16:17:35.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:35.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143041+0000", 2024-09-12T16:17:35.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8030000000000001e-06 2024-09-12T16:17:35.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:35.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143043+0000", 2024-09-12T16:17:35.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3140000000000002e-06 2024-09-12T16:17:35.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:35.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196481+0000", 2024-09-12T16:17:35.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053437601000000001 2024-09-12T16:17:35.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:35.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196525+0000", 2024-09-12T16:17:35.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4280000000000003e-05 2024-09-12T16:17:35.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:35.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196594+0000", 2024-09-12T16:17:35.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8702999999999996e-05 2024-09-12T16:17:35.253 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.253 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:35.253 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.253 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3723 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14885888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:35.253 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:17:35.253 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 77.046386999999996, 2024-09-12T16:17:35.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053815546999999998, 2024-09-12T16:17:35.253 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:35.253 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:35.254 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:35.254 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:35.254 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:35.254 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:35.254 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3723 2024-09-12T16:17:35.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.254 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:35.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:35.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:17:35.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:35.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:17:35.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:35.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148994+0000", 2024-09-12T16:17:35.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059481330000000004 2024-09-12T16:17:35.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:35.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148999+0000", 2024-09-12T16:17:35.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7140000000000001e-06 2024-09-12T16:17:35.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:35.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149008+0000", 2024-09-12T16:17:35.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4350000000000003e-06 2024-09-12T16:17:35.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:35.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149021+0000", 2024-09-12T16:17:35.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2514000000000001e-05 2024-09-12T16:17:35.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:35.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196630+0000", 2024-09-12T16:17:35.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047609758000000002 2024-09-12T16:17:35.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:35.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196724+0000", 2024-09-12T16:17:35.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3522000000000003e-05 2024-09-12T16:17:35.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:35.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196861+0000", 2024-09-12T16:17:35.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013747100000000001 2024-09-12T16:17:35.258 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.258 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:35.258 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.258 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4438 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15719424~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:35.258 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:35.258 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 76.901506222999998, 2024-09-12T16:17:35.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367981000000002, 2024-09-12T16:17:35.258 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:35.258 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:35.258 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:35.258 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:35.259 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:35.259 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:35.259 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4438 2024-09-12T16:17:35.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.259 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:35.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:35.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:35.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:35.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:35.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:35.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:35.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3e-07 2024-09-12T16:17:35.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:35.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287930+0000", 2024-09-12T16:17:35.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-12T16:17:35.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:35.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287937+0000", 2024-09-12T16:17:35.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.08e-06 2024-09-12T16:17:35.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:35.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287943+0000", 2024-09-12T16:17:35.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5709999999999997e-06 2024-09-12T16:17:35.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:35.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341068+0000", 2024-09-12T16:17:35.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053125101000000001 2024-09-12T16:17:35.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:35.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341154+0000", 2024-09-12T16:17:35.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6100999999999994e-05 2024-09-12T16:17:35.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:35.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341295+0000", 2024-09-12T16:17:35.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014087999999999999 2024-09-12T16:17:35.262 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.262 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:35.262 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.263 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4439 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15723520~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:35.263 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:35.263 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 76.901482063000003, 2024-09-12T16:17:35.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053526799, 2024-09-12T16:17:35.263 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:35.263 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:35.263 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:35.263 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:35.263 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:35.263 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:35.263 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4439 2024-09-12T16:17:35.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.263 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:35.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:35.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:35.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:35.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:35.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:35.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:35.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-07 2024-09-12T16:17:35.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:35.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287953+0000", 2024-09-12T16:17:35.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1349999999999999e-06 2024-09-12T16:17:35.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:35.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287960+0000", 2024-09-12T16:17:35.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-12T16:17:35.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:35.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287965+0000", 2024-09-12T16:17:35.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1580000000000004e-06 2024-09-12T16:17:35.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:35.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341332+0000", 2024-09-12T16:17:35.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367009 2024-09-12T16:17:35.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:35.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341402+0000", 2024-09-12T16:17:35.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9759999999999996e-05 2024-09-12T16:17:35.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:35.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341478+0000", 2024-09-12T16:17:35.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5412000000000002e-05 2024-09-12T16:17:35.267 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.267 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:35.267 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.267 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4440 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15727616~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:35.267 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:35.267 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 76.901460959000005, 2024-09-12T16:17:35.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053761601999999999, 2024-09-12T16:17:35.268 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:35.268 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:35.268 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:35.268 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:35.268 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:35.268 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:35.268 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4440 2024-09-12T16:17:35.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.268 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:35.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:35.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:35.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:35.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:35.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:35.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:35.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:17:35.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:35.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287974+0000", 2024-09-12T16:17:35.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0540000000000002e-06 2024-09-12T16:17:35.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:35.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287980+0000", 2024-09-12T16:17:35.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9440000000000002e-06 2024-09-12T16:17:35.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:35.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287987+0000", 2024-09-12T16:17:35.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5889999999999999e-06 2024-09-12T16:17:35.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:35.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341502+0000", 2024-09-12T16:17:35.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053515199999999999 2024-09-12T16:17:35.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:35.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341595+0000", 2024-09-12T16:17:35.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3097000000000007e-05 2024-09-12T16:17:35.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:35.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341734+0000", 2024-09-12T16:17:35.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013832800000000001 2024-09-12T16:17:35.271 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.271 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:35.271 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.271 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2209 3.1 3:85f36d3b:::rbd_data.1155ccb1894c.0000000000000004:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:35.272 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:17:35.272 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.817775820999998, 2024-09-12T16:17:35.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.060659365, 2024-09-12T16:17:35.272 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:35.272 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:35.272 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:35.272 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:35.272 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:17:35.272 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:17:35.272 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2209 2024-09-12T16:17:35.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.272 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:35.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:35.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:17:35.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:35.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:17:35.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:35.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371658+0000", 2024-09-12T16:17:35.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1570000000000001e-06 2024-09-12T16:17:35.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:35.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393414+0000", 2024-09-12T16:17:35.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021755495999999999 2024-09-12T16:17:35.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:35.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393447+0000", 2024-09-12T16:17:35.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3630000000000002e-05 2024-09-12T16:17:35.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:35.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393462+0000", 2024-09-12T16:17:35.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5048999999999999e-05 2024-09-12T16:17:35.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:35.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393556+0000", 2024-09-12T16:17:35.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3549999999999997e-05 2024-09-12T16:17:35.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:35.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393697+0000", 2024-09-12T16:17:35.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000141414 2024-09-12T16:17:35.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T16:17:35.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.394944+0000", 2024-09-12T16:17:35.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012463039999999999 2024-09-12T16:17:35.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:35.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.431803+0000", 2024-09-12T16:17:35.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0368594 2024-09-12T16:17:35.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:17:35.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432268+0000", 2024-09-12T16:17:35.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046457600000000002 2024-09-12T16:17:35.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:17:35.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432293+0000", 2024-09-12T16:17:35.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.527e-05 2024-09-12T16:17:35.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:35.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432316+0000", 2024-09-12T16:17:35.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3519e-05 2024-09-12T16:17:35.276 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.277 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:35.277 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.277 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:9400 3.1f 3:feea9999:::rbd_data.1155338d0570.0000000000000007:head [read 32768~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-12T16:17:35.277 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:20.012502+0000", 2024-09-12T16:17:35.277 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.176930829, 2024-09-12T16:17:35.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.000678049, 2024-09-12T16:17:35.277 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:35.277 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:35.277 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:35.277 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:35.277 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:35.277 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:35.277 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 9400 2024-09-12T16:17:35.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.278 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:35.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:35.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012502+0000", 2024-09-12T16:17:35.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:35.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012502+0000", 2024-09-12T16:17:35.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:35.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:35.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012504+0000", 2024-09-12T16:17:35.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5939999999999999e-06 2024-09-12T16:17:35.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:35.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012511+0000", 2024-09-12T16:17:35.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0840000000000003e-06 2024-09-12T16:17:35.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:35.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012525+0000", 2024-09-12T16:17:35.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4538999999999999e-05 2024-09-12T16:17:35.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:35.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012532+0000", 2024-09-12T16:17:35.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8310000000000003e-06 2024-09-12T16:17:35.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:35.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012605+0000", 2024-09-12T16:17:35.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2387999999999999e-05 2024-09-12T16:17:35.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T16:17:35.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012617+0000", 2024-09-12T16:17:35.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2167999999999999e-05 2024-09-12T16:17:35.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:35.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:21.012823+0000", 2024-09-12T16:17:35.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0002068230000001 2024-09-12T16:17:35.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:35.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:21.012975+0000", 2024-09-12T16:17:35.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015196200000000001 2024-09-12T16:17:35.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:35.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:35.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:35.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:21.013180+0000", 2024-09-12T16:17:35.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020466000000000001 2024-09-12T16:17:35.281 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.281 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:35.281 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.281 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:35.282 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:35.282 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:35.282 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:35.190+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:35.284 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:17:35.284 INFO:teuthology.orchestra.run.smithi204.stdout:4437 read 0x9683000 thru 0x968afaa (0x7fab bytes) 2024-09-12T16:17:35.285 INFO:teuthology.orchestra.run.smithi204.stdout:4439 read 0x6161800 thru 0x616cec1 (0xb6c2 bytes) 2024-09-12T16:17:35.285 INFO:teuthology.orchestra.run.smithi204.stdout:4440 read 0xac32800 thru 0xac3c4bd (0x9cbe bytes) 2024-09-12T16:17:35.285 INFO:teuthology.orchestra.run.smithi204.stdout:4441 read 0x1291200 thru 0x12a093c (0xf73d bytes) 2024-09-12T16:17:35.285 INFO:teuthology.orchestra.run.smithi204.stdout:4442 punch from 0x70e7400 to 0x70e7800, (0x400 bytes) 2024-09-12T16:17:35.285 INFO:teuthology.orchestra.run.smithi204.stdout:4445 write 0x3bcfc00 thru 0x3bd2894 (0x2c95 bytes) 2024-09-12T16:17:35.285 INFO:teuthology.orchestra.run.smithi204.stdout:4446 read 0x588a200 thru 0x588d325 (0x3126 bytes) 2024-09-12T16:17:35.285 INFO:teuthology.orchestra.run.smithi204.stdout:4447 write 0x63da000 thru 0x63e7fd5 (0xdfd6 bytes) 2024-09-12T16:17:35.285 INFO:teuthology.orchestra.run.smithi204.stdout:4448 trunc from 0xdfd7400 to 0x4208e00 2024-09-12T16:17:35.285 INFO:teuthology.orchestra.run.smithi204.stdout:4449 read 0xcd3e00 thru 0xcd7b78 (0x3d79 bytes) 2024-09-12T16:17:35.285 INFO:teuthology.orchestra.run.smithi204.stdout:4450 punch from 0x138b400 to 0x1395200, (0x9e00 bytes) 2024-09-12T16:17:35.285 INFO:teuthology.orchestra.run.smithi204.stdout:4453 trunc from 0x4208e00 to 0xbc59400 2024-09-12T16:17:35.291 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:35.290+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:35.298 INFO:teuthology.orchestra.run.smithi204.stdout:4455 read 0x2f0cc00 thru 0x2f1b65d (0xea5e bytes) 2024-09-12T16:17:35.299 INFO:teuthology.orchestra.run.smithi204.stdout:4457 read 0xaaf5c00 thru 0xab01156 (0xb557 bytes) 2024-09-12T16:17:35.299 INFO:teuthology.orchestra.run.smithi204.stdout:4459 write 0x7948a00 thru 0x7953e7b (0xb47c bytes) 2024-09-12T16:17:35.309 INFO:teuthology.orchestra.run.smithi204.stdout:4465 trunc from 0xbc59400 to 0x3426c00 2024-09-12T16:17:35.334 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2024-09-12T16:17:35.358 INFO:teuthology.orchestra.run.smithi204.stdout:4467 trunc from 0x3426c00 to 0xac42000 2024-09-12T16:17:35.367 INFO:teuthology.orchestra.run.smithi204.stdout:4469 punch from 0xa529a00 to 0xa52c200, (0x2800 bytes) 2024-09-12T16:17:35.374 INFO:teuthology.orchestra.run.smithi204.stdout:4473 punch from 0x6ce4a00 to 0x6cea000, (0x5600 bytes) 2024-09-12T16:17:35.374 INFO:teuthology.orchestra.run.smithi204.stdout:4475 punch from 0x59f7200 to 0x5a00200, (0x9000 bytes) 2024-09-12T16:17:35.374 INFO:teuthology.orchestra.run.smithi204.stdout:4478 write 0x503da00 thru 0x50432cd (0x58ce bytes) 2024-09-12T16:17:35.375 INFO:teuthology.orchestra.run.smithi204.stdout:4481 write 0x5278c00 thru 0x528579a (0xcb9b bytes) 2024-09-12T16:17:35.375 INFO:teuthology.orchestra.run.smithi204.stdout:4484 write 0x815ca00 thru 0x8165e14 (0x9415 bytes) 2024-09-12T16:17:35.375 INFO:teuthology.orchestra.run.smithi204.stdout:4486 read 0x9e6d000 thru 0x9e6da2a (0xa2b bytes) 2024-09-12T16:17:35.375 INFO:teuthology.orchestra.run.smithi204.stdout:4487 read 0x7e3b400 thru 0x7e46e69 (0xba6a bytes) 2024-09-12T16:17:35.384 INFO:teuthology.orchestra.run.smithi204.stdout:4488 trunc from 0xac42000 to 0x26b1800 2024-09-12T16:17:35.393 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:35.391+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:35.431 INFO:teuthology.orchestra.run.smithi204.stdout:4489 punch from 0x1162e00 to 0x1168600, (0x5800 bytes) 2024-09-12T16:17:35.452 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:35.453 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:35.453 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:17:35.453 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:35.462 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:17:35.462 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T16:17:35.469 INFO:teuthology.orchestra.run.smithi204.stdout:4490 write 0x2cc1200 thru 0x2cc2f6f (0x1d70 bytes) 2024-09-12T16:17:35.469 INFO:teuthology.orchestra.run.smithi204.stdout:4496 read 0x2696200 thru 0x2698c6a (0x2a6b bytes) 2024-09-12T16:17:35.480 INFO:teuthology.orchestra.run.smithi204.stdout:4497 trunc from 0x2cc3000 to 0xbf2d400 2024-09-12T16:17:35.496 INFO:teuthology.orchestra.run.smithi204.stdout:4505 write 0x7b36800 thru 0x7b44772 (0xdf73 bytes) 2024-09-12T16:17:35.496 INFO:teuthology.orchestra.run.smithi204.stdout:4507 write 0x69caa00 thru 0x69cbb79 (0x117a bytes) 2024-09-12T16:17:35.505 INFO:teuthology.orchestra.run.smithi204.stdout:4509 trunc from 0xbf2d400 to 0x40abc00 2024-09-12T16:17:35.506 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:35.505+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:35.533 INFO:teuthology.orchestra.run.smithi204.stdout:4511 trunc from 0x40abc00 to 0x151c000 2024-09-12T16:17:35.570 INFO:teuthology.orchestra.run.smithi204.stdout:4512 trunc from 0x151c000 to 0x4a61a00 2024-09-12T16:17:35.578 INFO:teuthology.orchestra.run.smithi204.stdout:4514 trunc from 0x4a61a00 to 0x4303800 2024-09-12T16:17:35.586 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:35.586 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:35.586 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:17:35.586 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:17:35.586 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:35.588 INFO:teuthology.orchestra.run.smithi204.stdout:4515 punch from 0x2f54c00 to 0x2f5a600, (0x5a00 bytes) 2024-09-12T16:17:35.593 INFO:teuthology.orchestra.run.smithi204.stdout:4516 read 0x3346200 thru 0x334862b (0x242c bytes) 2024-09-12T16:17:35.594 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:35.593+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:35.599 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:17:35.603 INFO:teuthology.orchestra.run.smithi204.stdout:4518 write 0x5948800 thru 0x59492bc (0xabd bytes) 2024-09-12T16:17:35.605 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:17:35.605 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:17:35.612 INFO:teuthology.orchestra.run.smithi204.stdout:4521 punch from 0x28c0c00 to 0x28cbc00, (0xb000 bytes) 2024-09-12T16:17:35.614 INFO:teuthology.orchestra.run.smithi204.stdout:4522 read 0x4f04200 thru 0x4f0f407 (0xb208 bytes) 2024-09-12T16:17:35.619 INFO:teuthology.orchestra.run.smithi204.stdout:4523 trunc from 0x5949400 to 0x9c9a800 2024-09-12T16:17:35.624 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:17:35.624 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:17:35.633 INFO:teuthology.orchestra.run.smithi204.stdout:4524 read 0x8f9a400 thru 0x8fa1744 (0x7345 bytes) 2024-09-12T16:17:35.633 INFO:teuthology.orchestra.run.smithi204.stdout:4526 read 0x6261600 thru 0x626a5c9 (0x8fca bytes) 2024-09-12T16:17:35.633 INFO:teuthology.orchestra.run.smithi204.stdout:4529 read 0x97ba400 thru 0x97bac84 (0x885 bytes) 2024-09-12T16:17:35.634 INFO:teuthology.orchestra.run.smithi204.stdout:4535 trunc from 0x9c9a800 to 0x8e2b400 2024-09-12T16:17:35.643 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:17:35.643 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:17:35.644 INFO:teuthology.orchestra.run.smithi204.stdout:4536 read 0x7ce0200 thru 0x7ce5eb2 (0x5cb3 bytes) 2024-09-12T16:17:35.645 INFO:teuthology.orchestra.run.smithi204.stdout:4538 write 0x5c7c400 thru 0x5c8a1d0 (0xddd1 bytes) 2024-09-12T16:17:35.645 INFO:teuthology.orchestra.run.smithi204.stdout:4540 read 0x2d6a00 thru 0x2e5703 (0xed04 bytes) 2024-09-12T16:17:35.649 INFO:teuthology.orchestra.run.smithi204.stdout:4542 punch from 0x58d4400 to 0x58df000, (0xac00 bytes) 2024-09-12T16:17:35.649 INFO:teuthology.orchestra.run.smithi204.stdout:4544 punch from 0x519c600 to 0x51a9e00, (0xd800 bytes) 2024-09-12T16:17:35.665 INFO:teuthology.orchestra.run.smithi204.stdout:4549 write 0xa804600 thru 0xa80dbc5 (0x95c6 bytes) 2024-09-12T16:17:35.665 INFO:teuthology.orchestra.run.smithi204.stdout:4550 write 0x557a600 thru 0x557f6bf (0x50c0 bytes) 2024-09-12T16:17:35.666 INFO:teuthology.orchestra.run.smithi204.stdout:4551 write 0x18cf600 thru 0x18d4f10 (0x5911 bytes) 2024-09-12T16:17:35.666 INFO:teuthology.orchestra.run.smithi204.stdout:4554 read 0x72e000 thru 0x72e47b (0x47c bytes) 2024-09-12T16:17:35.667 INFO:teuthology.orchestra.run.smithi204.stdout:4555 write 0x5441800 thru 0x5447b8a (0x638b bytes) 2024-09-12T16:17:35.671 INFO:teuthology.orchestra.run.smithi204.stdout:4558 trunc from 0xa80dc00 to 0xd69b800 2024-09-12T16:17:35.676 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:17:35.677 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:17:35.685 INFO:teuthology.orchestra.run.smithi204.stdout:4559 write 0x3c59200 thru 0x3c5e475 (0x5276 bytes) 2024-09-12T16:17:35.686 INFO:teuthology.orchestra.run.smithi204.stdout:4561 punch from 0x4206200 to 0x420ec00, (0x8a00 bytes) 2024-09-12T16:17:35.695 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:35.695+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:35.696 INFO:teuthology.orchestra.run.smithi204.stdout:4562 trunc from 0xd69b800 to 0xa11b800 2024-09-12T16:17:35.709 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:17:35.709 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:17:35.719 INFO:teuthology.orchestra.run.smithi204.stdout:4563 write 0xd65f400 thru 0xd66a84b (0xb44c bytes) 2024-09-12T16:17:35.720 INFO:teuthology.orchestra.run.smithi204.stdout:4564 read 0x787b800 thru 0x787fbd1 (0x43d2 bytes) 2024-09-12T16:17:35.735 INFO:teuthology.orchestra.run.smithi204.stdout:4566 write 0xddee400 thru 0xddf3c72 (0x5873 bytes) 2024-09-12T16:17:35.736 INFO:teuthology.orchestra.run.smithi204.stdout:4570 trunc from 0xddf3e00 to 0xed8da00 2024-09-12T16:17:35.741 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:17:35.741 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:17:35.747 INFO:teuthology.orchestra.run.smithi204.stdout:4577 punch from 0xc576000 to 0xc582c00, (0xcc00 bytes) 2024-09-12T16:17:35.751 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:35.751 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:35.753 INFO:teuthology.orchestra.run.smithi204.stdout:4579 read 0xbc56a00 thru 0xbc61ddc (0xb3dd bytes) 2024-09-12T16:17:35.761 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:17:35.763 INFO:teuthology.orchestra.run.smithi204.stdout:4580 trunc from 0xed8da00 to 0x361fa00 2024-09-12T16:17:35.781 INFO:teuthology.orchestra.run.smithi204.stdout:4581 read 0x16c0600 thru 0x16cb859 (0xb25a bytes) 2024-09-12T16:17:35.782 INFO:teuthology.orchestra.run.smithi204.stdout:skipping zero length punch hole 2024-09-12T16:17:35.782 INFO:teuthology.orchestra.run.smithi204.stdout:4583 write 0x516400 thru 0x51cc0b (0x680c bytes) 2024-09-12T16:17:35.786 INFO:teuthology.orchestra.run.smithi204.stdout:4585 read 0x1663800 thru 0x166cb98 (0x9399 bytes) 2024-09-12T16:17:35.786 INFO:teuthology.orchestra.run.smithi204.stdout:4587 read 0x1784000 thru 0x17863c9 (0x23ca bytes) 2024-09-12T16:17:35.786 INFO:teuthology.orchestra.run.smithi204.stdout:4589 read 0x11c7a00 thru 0x11d3dd5 (0xc3d6 bytes) 2024-09-12T16:17:35.793 INFO:teuthology.orchestra.run.smithi204.stdout:4591 trunc from 0x361fa00 to 0xac16a00 2024-09-12T16:17:35.796 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:35.795+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:35.851 INFO:teuthology.orchestra.run.smithi204.stdout:4592 write 0xd097200 thru 0xd09c023 (0x4e24 bytes) 2024-09-12T16:17:35.856 INFO:teuthology.orchestra.run.smithi204.stdout:4594 punch from 0x1ed5000 to 0x1ed9600, (0x4600 bytes) 2024-09-12T16:17:35.863 INFO:teuthology.orchestra.run.smithi204.stdout:4595 trunc from 0xd09c200 to 0x6c7b800 2024-09-12T16:17:35.894 INFO:teuthology.orchestra.run.smithi204.stdout:4597 write 0xbe91600 thru 0xbe9b565 (0x9f66 bytes) 2024-09-12T16:17:35.897 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:35.896+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:35.905 INFO:teuthology.orchestra.run.smithi204.stdout:4600 trunc from 0xbe9b600 to 0x3d43800 2024-09-12T16:17:35.919 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:35.919 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:35.922 INFO:teuthology.orchestra.run.smithi204.stdout:4604 read 0x3709e00 thru 0x371440e (0xa60f bytes) 2024-09-12T16:17:35.928 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:17:35.929 INFO:teuthology.orchestra.run.smithi204.stdout:4606 trunc from 0x3d43800 to 0x2af2600 2024-09-12T16:17:35.946 INFO:teuthology.orchestra.run.smithi204.stdout:4608 read 0x11c1400 thru 0x11d0f24 (0xfb25 bytes) 2024-09-12T16:17:35.951 INFO:teuthology.orchestra.run.smithi204.stdout:4609 read 0x1ce1000 thru 0x1cef46f (0xe470 bytes) 2024-09-12T16:17:35.967 INFO:teuthology.orchestra.run.smithi204.stdout:4611 write 0x7729600 thru 0x7734868 (0xb269 bytes) 2024-09-12T16:17:35.994 INFO:teuthology.orchestra.run.smithi204.stdout:4612 write 0xe047c00 thru 0xe048cd3 (0x10d4 bytes) 2024-09-12T16:17:35.998 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:35.997+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:35.999 INFO:teuthology.orchestra.run.smithi204.stdout:4614 write 0x93f0400 thru 0x93f1b84 (0x1785 bytes) 2024-09-12T16:17:36.000 INFO:teuthology.orchestra.run.smithi204.stdout:4617 punch from 0xae31400 to 0xae38e00, (0x7a00 bytes) 2024-09-12T16:17:36.001 INFO:teuthology.orchestra.run.smithi204.stdout:4618 punch from 0x2190800 to 0x2192800, (0x2000 bytes) 2024-09-12T16:17:36.001 INFO:teuthology.orchestra.run.smithi204.stdout:4621 punch from 0xd01b000 to 0xd024e00, (0x9e00 bytes) 2024-09-12T16:17:36.008 INFO:teuthology.orchestra.run.smithi204.stdout:4624 trunc from 0xe048e00 to 0x7959c00 2024-09-12T16:17:36.029 INFO:teuthology.orchestra.run.smithi204.stdout:4626 write 0x1aac600 thru 0x1ab1436 (0x4e37 bytes) 2024-09-12T16:17:36.030 INFO:teuthology.orchestra.run.smithi204.stdout:4627 read 0x458ce00 thru 0x459037f (0x3580 bytes) 2024-09-12T16:17:36.043 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:36.043 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:36.047 INFO:teuthology.orchestra.run.smithi204.stdout:4628 write 0xaef5200 thru 0xaefd071 (0x7e72 bytes) 2024-09-12T16:17:36.051 INFO:teuthology.orchestra.run.smithi204.stdout:4631 read 0x3c04e00 thru 0x3c11faf (0xd1b0 bytes) 2024-09-12T16:17:36.051 INFO:teuthology.orchestra.run.smithi204.stdout:4632 read 0x6edd600 thru 0x6ee7616 (0xa017 bytes) 2024-09-12T16:17:36.052 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:17:36.060 INFO:teuthology.orchestra.run.smithi204.stdout:4635 trunc from 0xaefd200 to 0x37e2200 2024-09-12T16:17:36.079 INFO:teuthology.orchestra.run.smithi204.stdout:4637 read 0x2cc8a00 thru 0x2ccc883 (0x3e84 bytes) 2024-09-12T16:17:36.080 INFO:teuthology.orchestra.run.smithi204.stdout:4639 read 0x7d7000 thru 0x7d9818 (0x2819 bytes) 2024-09-12T16:17:36.091 INFO:teuthology.orchestra.run.smithi204.stdout:4640 write 0x4a08200 thru 0x4a11fe8 (0x9de9 bytes) 2024-09-12T16:17:36.103 INFO:teuthology.orchestra.run.smithi204.stdout:4642 trunc from 0x4a12000 to 0xdc17a00 2024-09-12T16:17:36.115 INFO:teuthology.orchestra.run.smithi204.stdout:4643 read 0x4752e00 thru 0x47561f2 (0x33f3 bytes) 2024-09-12T16:17:36.131 INFO:teuthology.orchestra.run.smithi204.stdout:4644 trunc from 0xdc17a00 to 0x1cfbe00 2024-09-12T16:17:36.136 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:36.135+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:36.167 INFO:teuthology.orchestra.run.smithi204.stdout:4645 write 0xbd4c200 thru 0xbd58642 (0xc443 bytes) 2024-09-12T16:17:36.168 INFO:teuthology.orchestra.run.smithi204.stdout:4646 read 0x496ce00 thru 0x4973589 (0x678a bytes) 2024-09-12T16:17:36.169 INFO:teuthology.orchestra.run.smithi204.stdout:4649 write 0x68e3e00 thru 0x68f2dbc (0xefbd bytes) 2024-09-12T16:17:36.169 INFO:teuthology.orchestra.run.smithi204.stdout:4651 read 0x6221c00 thru 0x62253f4 (0x37f5 bytes) 2024-09-12T16:17:36.169 INFO:teuthology.orchestra.run.smithi204.stdout:4652 write 0x98a9200 thru 0x98b6528 (0xd329 bytes) 2024-09-12T16:17:36.169 INFO:teuthology.orchestra.run.smithi204.stdout:4656 punch from 0x1248000 to 0x124d200, (0x5200 bytes) 2024-09-12T16:17:36.184 INFO:teuthology.orchestra.run.smithi204.stdout:4657 trunc from 0xbd58800 to 0x2f2600 2024-09-12T16:17:36.199 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:36.198+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:36.214 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:36.214 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:36.220 INFO:teuthology.orchestra.run.smithi204.stdout:4658 punch from 0x138000 to 0x145000, (0xd000 bytes) 2024-09-12T16:17:36.223 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:17:36.238 INFO:teuthology.orchestra.run.smithi204.stdout:4659 write 0x5fab800 thru 0x5fade28 (0x2629 bytes) 2024-09-12T16:17:36.239 INFO:teuthology.orchestra.run.smithi204.stdout:4661 write 0x2740e00 thru 0x274a0af (0x92b0 bytes) 2024-09-12T16:17:36.239 INFO:teuthology.orchestra.run.smithi204.stdout:4662 write 0x3e2f000 thru 0x3e36209 (0x720a bytes) 2024-09-12T16:17:36.239 INFO:teuthology.orchestra.run.smithi204.stdout:4663 read 0xe1d800 thru 0xe27fa4 (0xa7a5 bytes) 2024-09-12T16:17:36.240 INFO:teuthology.orchestra.run.smithi204.stdout:4664 write 0xf86200 thru 0xf959d0 (0xf7d1 bytes) 2024-09-12T16:17:36.245 INFO:teuthology.orchestra.run.smithi204.stdout:4666 trunc from 0x5fae000 to 0x22eb600 2024-09-12T16:17:36.268 INFO:teuthology.orchestra.run.smithi204.stdout:4667 read 0x14ae800 thru 0x14b0126 (0x1927 bytes) 2024-09-12T16:17:36.286 INFO:teuthology.orchestra.run.smithi204.stdout:4670 write 0x718b800 thru 0x7190458 (0x4c59 bytes) 2024-09-12T16:17:36.286 INFO:teuthology.orchestra.run.smithi204.stdout:4673 read 0x450f800 thru 0x45133e8 (0x3be9 bytes) 2024-09-12T16:17:36.294 INFO:teuthology.orchestra.run.smithi204.stdout:4674 trunc from 0x7190600 to 0x654600 2024-09-12T16:17:36.299 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:36.298+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:36.316 INFO:teuthology.orchestra.run.smithi204.stdout:4675 read 0x5fee00 thru 0x606f96 (0x8197 bytes) 2024-09-12T16:17:36.329 INFO:teuthology.orchestra.run.smithi204.stdout:4676 write 0x261d200 thru 0x2624e00 (0x7c01 bytes) 2024-09-12T16:17:36.330 INFO:teuthology.orchestra.run.smithi204.stdout:4677 punch from 0x1620e00 to 0x162dc00, (0xce00 bytes) 2024-09-12T16:17:36.334 INFO:teuthology.orchestra.run.smithi204.stdout:4678 trunc from 0x2625000 to 0x57d1200 2024-09-12T16:17:36.346 INFO:teuthology.orchestra.run.smithi204.stdout:4679 punch from 0xf35200 to 0xf3de00, (0x8c00 bytes) 2024-09-12T16:17:36.347 INFO:teuthology.orchestra.run.smithi204.stdout:4680 write 0x3a45000 thru 0x3a4696e (0x196f bytes) 2024-09-12T16:17:36.347 INFO:teuthology.orchestra.run.smithi204.stdout:4683 punch from 0x2c3200 to 0x2c6200, (0x3000 bytes) 2024-09-12T16:17:36.356 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:36.356 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:36.363 INFO:teuthology.orchestra.run.smithi204.stdout:4684 write 0xafe9600 thru 0xafeb4b2 (0x1eb3 bytes) 2024-09-12T16:17:36.364 INFO:teuthology.orchestra.run.smithi204.stdout:4686 write 0x58aba00 thru 0x58ad8ad (0x1eae bytes) 2024-09-12T16:17:36.364 INFO:teuthology.orchestra.run.smithi204.stdout:4687 write 0xafdbc00 thru 0xafeb3b9 (0xf7ba bytes) 2024-09-12T16:17:36.364 INFO:teuthology.orchestra.run.smithi204.stdout:4688 write 0x8ada00 thru 0x8b7cb4 (0xa2b5 bytes) 2024-09-12T16:17:36.364 INFO:teuthology.orchestra.run.smithi204.stdout:4689 write 0x701e000 thru 0x7029293 (0xb294 bytes) 2024-09-12T16:17:36.367 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:17:36.384 INFO:teuthology.orchestra.run.smithi204.stdout:4692 write 0xe315600 thru 0xe31f078 (0x9a79 bytes) 2024-09-12T16:17:36.385 INFO:teuthology.orchestra.run.smithi204.stdout:4693 read 0x95f1200 thru 0x95f24a6 (0x12a7 bytes) 2024-09-12T16:17:36.385 INFO:teuthology.orchestra.run.smithi204.stdout:4694 write 0x47e0a00 thru 0x47e0bdc (0x1dd bytes) 2024-09-12T16:17:36.385 INFO:teuthology.orchestra.run.smithi204.stdout:4695 write 0x16bd000 thru 0x16c8d80 (0xbd81 bytes) 2024-09-12T16:17:36.386 INFO:teuthology.orchestra.run.smithi204.stdout:4698 read 0xc8f3800 thru 0xc902bfd (0xf3fe bytes) 2024-09-12T16:17:36.401 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:36.400+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:36.401 INFO:teuthology.orchestra.run.smithi204.stdout:4700 write 0xe613000 thru 0xe621422 (0xe423 bytes) 2024-09-12T16:17:36.402 INFO:teuthology.orchestra.run.smithi204.stdout:4701 write 0x83d000 thru 0x841f82 (0x4f83 bytes) 2024-09-12T16:17:36.402 INFO:teuthology.orchestra.run.smithi204.stdout:4702 punch from 0xabd5000 to 0xabe4200, (0xf200 bytes) 2024-09-12T16:17:36.403 INFO:teuthology.orchestra.run.smithi204.stdout:4703 read 0xd70200 thru 0xd783a1 (0x81a2 bytes) 2024-09-12T16:17:36.405 INFO:teuthology.orchestra.run.smithi204.stdout:4704 punch from 0x7d52000 to 0x7d56c00, (0x4c00 bytes) 2024-09-12T16:17:36.405 INFO:teuthology.orchestra.run.smithi204.stdout:4705 read 0x3ac5e00 thru 0x3ad1dda (0xbfdb bytes) 2024-09-12T16:17:36.406 INFO:teuthology.orchestra.run.smithi204.stdout:4706 read 0x53a7400 thru 0x53a9b9b (0x279c bytes) 2024-09-12T16:17:36.406 INFO:teuthology.orchestra.run.smithi204.stdout:4709 read 0xde6be00 thru 0xde78c46 (0xce47 bytes) 2024-09-12T16:17:36.406 INFO:teuthology.orchestra.run.smithi204.stdout:4710 read 0x4479200 thru 0x44806c7 (0x74c8 bytes) 2024-09-12T16:17:36.406 INFO:teuthology.orchestra.run.smithi204.stdout:4711 punch from 0x7413400 to 0x741e400, (0xb000 bytes) 2024-09-12T16:17:36.406 INFO:teuthology.orchestra.run.smithi204.stdout:4712 write 0xd1b7200 thru 0xd1c4c66 (0xda67 bytes) 2024-09-12T16:17:36.407 INFO:teuthology.orchestra.run.smithi204.stdout:4713 punch from 0x3fda400 to 0x3fe5800, (0xb400 bytes) 2024-09-12T16:17:36.407 INFO:teuthology.orchestra.run.smithi204.stdout:4714 write 0x54c0e00 thru 0x54c6f4a (0x614b bytes) 2024-09-12T16:17:36.412 INFO:teuthology.orchestra.run.smithi204.stdout:4716 trunc from 0xe621600 to 0x9bea800 2024-09-12T16:17:36.433 INFO:teuthology.orchestra.run.smithi204.stdout:4717 read 0x3f0ae00 thru 0x3f192be (0xe4bf bytes) 2024-09-12T16:17:36.445 INFO:teuthology.orchestra.run.smithi204.stdout:4718 trunc from 0x9bea800 to 0x335fa00 2024-09-12T16:17:36.494 INFO:teuthology.orchestra.run.smithi204.stdout:4720 write 0xbde8e00 thru 0xbdf2e8c (0xa08d bytes) 2024-09-12T16:17:36.494 INFO:teuthology.orchestra.run.smithi204.stdout:4722 read 0x4bfd000 thru 0x4c0536d (0x836e bytes) 2024-09-12T16:17:36.494 INFO:teuthology.orchestra.run.smithi204.stdout:4724 punch from 0x91c3400 to 0x91cd800, (0xa400 bytes) 2024-09-12T16:17:36.494 INFO:teuthology.orchestra.run.smithi204.stdout:4725 read 0xb152400 thru 0xb161225 (0xee26 bytes) 2024-09-12T16:17:36.494 INFO:teuthology.orchestra.run.smithi204.stdout:4726 punch from 0x5c33600 to 0x5c39c00, (0x6600 bytes) 2024-09-12T16:17:36.494 INFO:teuthology.orchestra.run.smithi204.stdout:4727 read 0x4a4c400 thru 0x4a5b8f7 (0xf4f8 bytes) 2024-09-12T16:17:36.494 INFO:teuthology.orchestra.run.smithi204.stdout:4728 read 0xa62b400 thru 0xa6322bf (0x6ec0 bytes) 2024-09-12T16:17:36.501 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:36.501+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:36.510 INFO:teuthology.orchestra.run.smithi204.stdout:4729 write 0xdeb9c00 thru 0xdec5260 (0xb661 bytes) 2024-09-12T16:17:36.511 INFO:teuthology.orchestra.run.smithi204.stdout:4730 read 0xd00b400 thru 0xd01a7da (0xf3db bytes) 2024-09-12T16:17:36.511 INFO:teuthology.orchestra.run.smithi204.stdout:4731 write 0x814b600 thru 0x8151ac5 (0x64c6 bytes) 2024-09-12T16:17:36.512 INFO:teuthology.orchestra.run.smithi204.stdout:4732 write 0x6cd5000 thru 0x6cdb2ed (0x62ee bytes) 2024-09-12T16:17:36.512 INFO:teuthology.orchestra.run.smithi204.stdout:4733 write 0x9961e00 thru 0x9966ff4 (0x51f5 bytes) 2024-09-12T16:17:36.512 INFO:teuthology.orchestra.run.smithi204.stdout:4737 punch from 0xc808800 to 0xc808c00, (0x400 bytes) 2024-09-12T16:17:36.515 INFO:teuthology.orchestra.run.smithi204.stdout:4738 trunc from 0xdec5400 to 0xbee9a00 2024-09-12T16:17:36.534 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:36.534 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:36.543 INFO:teuthology.orchestra.run.smithi204.stdout:4740 write 0x23a2e00 thru 0x23ab5ac (0x87ad bytes) 2024-09-12T16:17:36.543 INFO:teuthology.orchestra.run.smithi204.stdout:4742 punch from 0x2101800 to 0x2109200, (0x7a00 bytes) 2024-09-12T16:17:36.544 INFO:teuthology.orchestra.run.smithi204.stdout:4743 read 0x2411200 thru 0x2418de5 (0x7be6 bytes) 2024-09-12T16:17:36.544 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:17:36.545 INFO:teuthology.orchestra.run.smithi204.stdout:4745 punch from 0x6182a00 to 0x6184800, (0x1e00 bytes) 2024-09-12T16:17:36.546 INFO:teuthology.orchestra.run.smithi204.stdout:4747 read 0xa426600 thru 0xa4342ba (0xdcbb bytes) 2024-09-12T16:17:36.546 INFO:teuthology.orchestra.run.smithi204.stdout:4750 read 0x4573c00 thru 0x4582f4f (0xf350 bytes) 2024-09-12T16:17:36.546 INFO:teuthology.orchestra.run.smithi204.stdout:4751 read 0x2b4ac00 thru 0x2b58410 (0xd811 bytes) 2024-09-12T16:17:36.546 INFO:teuthology.orchestra.run.smithi204.stdout:4752 read 0xc92400 thru 0xc9bceb (0x98ec bytes) 2024-09-12T16:17:36.547 INFO:teuthology.orchestra.run.smithi204.stdout:4753 write 0x76f6c00 thru 0x76fb412 (0x4813 bytes) 2024-09-12T16:17:36.547 INFO:teuthology.orchestra.run.smithi204.stdout:4754 punch from 0xbe84e00 to 0xbe8d600, (0x8800 bytes) 2024-09-12T16:17:36.547 INFO:teuthology.orchestra.run.smithi204.stdout:4756 write 0x98c400 thru 0x99918f (0xcd90 bytes) 2024-09-12T16:17:36.561 INFO:teuthology.orchestra.run.smithi204.stdout:4757 write 0xd4e7400 thru 0xd4ee8d5 (0x74d6 bytes) 2024-09-12T16:17:36.562 INFO:teuthology.orchestra.run.smithi204.stdout:4759 punch from 0xd202400 to 0xd205a00, (0x3600 bytes) 2024-09-12T16:17:36.563 INFO:teuthology.orchestra.run.smithi204.stdout:4761 write 0x7c16a00 thru 0x7c17244 (0x845 bytes) 2024-09-12T16:17:36.576 INFO:teuthology.orchestra.run.smithi204.stdout:4764 trunc from 0xd4eea00 to 0x2ec0200 2024-09-12T16:17:36.602 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:36.601+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:36.608 INFO:teuthology.orchestra.run.smithi204.stdout:4770 punch from 0xd6a400 to 0xd6a600, (0x200 bytes) 2024-09-12T16:17:36.610 INFO:teuthology.orchestra.run.smithi204.stdout:4771 punch from 0x9adc00 to 0x9b9600, (0xba00 bytes) 2024-09-12T16:17:36.622 INFO:teuthology.orchestra.run.smithi204.stdout:4772 write 0x42fa000 thru 0x42fdc72 (0x3c73 bytes) 2024-09-12T16:17:36.624 INFO:teuthology.orchestra.run.smithi204.stdout:4774 read 0x40cc00 thru 0x415ee9 (0x92ea bytes) 2024-09-12T16:17:36.624 INFO:teuthology.orchestra.run.smithi204.stdout:4776 clone 34 order 19 su 8192 sc 14 2024-09-12T16:17:36.669 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:36.669 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:36.677 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:17:36.703 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:36.703+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:36.784 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:36.784 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:36.792 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:17:36.837 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:36.836+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:36.900 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:36.900 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:36.905 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:36.905+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:36.908 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:17:37.006 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:37.006+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:37.055 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:37.055 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:37.064 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:17:37.107 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:37.107+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:37.171 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:37.171 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:37.180 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:17:37.208 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:37.207+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:37.286 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:37.286 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:37.295 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:17:37.309 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:37.308+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:37.350 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T16:17:37.406 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:37.406 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:37.409 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:37.409+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:37.415 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:17:37.453 INFO:teuthology.orchestra.run.smithi204.stdout:leaving image image_client.0-clone33 intact 2024-09-12T16:17:37.510 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:37.509+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:37.530 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:37.531 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:37.539 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:17:37.624 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:37.623+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:37.689 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:37.689 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:37.698 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:17:37.740 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:37.739+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:37.754 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T16:17:37.826 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:37.825+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:37.852 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:37.852 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:37.861 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:17:37.866 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #32, image image_client.0-clone32 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent33 2024-09-12T16:17:37.914 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:37.913+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:37.920 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:17:37.920 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:17:38.015 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:38.014+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:38.036 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:38.036 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:38.049 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:17:38.116 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:38.116+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:38.139 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:17:38.139 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:17:38.157 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:17:38.158 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:17:38.161 INFO:teuthology.orchestra.run.smithi204.stdout:4777 write 0x62f2800 thru 0x6301876 (0xf077 bytes) 2024-09-12T16:17:38.179 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:17:38.180 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:17:38.189 INFO:teuthology.orchestra.run.smithi204.stdout:4779 write 0xa3a9c00 thru 0xa3b03f3 (0x67f4 bytes) 2024-09-12T16:17:38.201 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:17:38.201 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:17:38.206 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:38.206 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:38.206 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:17:38.206 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:17:38.206 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:38.216 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:17:38.217 INFO:teuthology.orchestra.run.smithi204.stdout:4782 write 0xcab9a00 thru 0xcabb6de (0x1cdf bytes) 2024-09-12T16:17:38.217 INFO:teuthology.orchestra.run.smithi204.stdout:4785 punch from 0x104d000 to 0x105ac00, (0xdc00 bytes) 2024-09-12T16:17:38.218 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:38.216+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:38.222 INFO:teuthology.orchestra.run.smithi204.stdout:4786 read 0x4dabe00 thru 0x4dbab79 (0xed7a bytes) 2024-09-12T16:17:38.222 INFO:teuthology.orchestra.run.smithi204.stdout:4787 read 0x521fc00 thru 0x5222cbe (0x30bf bytes) 2024-09-12T16:17:38.222 INFO:teuthology.orchestra.run.smithi204.stdout:4788 write 0xca0c800 thru 0xca1793c (0xb13d bytes) 2024-09-12T16:17:38.222 INFO:teuthology.orchestra.run.smithi204.stdout:4789 read 0x2906800 thru 0x290ff77 (0x9778 bytes) 2024-09-12T16:17:38.223 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:17:38.223 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:17:38.318 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:38.317+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:38.328 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:38.328 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:17:38.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:17:38.328 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:17:38.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.328 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2307 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12401664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:38.328 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:17:38.328 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 80.430344425000001, 2024-09-12T16:17:38.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038241450000000003, 2024-09-12T16:17:38.328 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:38.328 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:38.329 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:38.329 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:38.329 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:38.329 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:38.329 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2307 2024-09-12T16:17:38.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.329 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:38.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:38.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:17:38.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:38.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:17:38.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:38.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896220+0000", 2024-09-12T16:17:38.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3500000000000002e-07 2024-09-12T16:17:38.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:38.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896222+0000", 2024-09-12T16:17:38.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1720000000000001e-06 2024-09-12T16:17:38.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:38.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896228+0000", 2024-09-12T16:17:38.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0870000000000003e-06 2024-09-12T16:17:38.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:38.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896233+0000", 2024-09-12T16:17:38.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:17:38.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:38.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934382+0000", 2024-09-12T16:17:38.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038149566000000003 2024-09-12T16:17:38.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:38.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934422+0000", 2024-09-12T16:17:38.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0015999999999998e-05 2024-09-12T16:17:38.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:38.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934461+0000", 2024-09-12T16:17:38.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8423999999999997e-05 2024-09-12T16:17:38.333 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.333 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:38.333 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.333 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2308 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12405760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:38.333 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:17:38.333 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 80.430324728000002, 2024-09-12T16:17:38.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038420745999999999, 2024-09-12T16:17:38.333 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:38.334 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:38.334 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:38.334 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:38.334 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:38.334 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:38.334 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2308 2024-09-12T16:17:38.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.334 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:38.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:38.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:17:38.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:38.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:17:38.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:38.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:17:38.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.58e-07 2024-09-12T16:17:38.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:38.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896241+0000", 2024-09-12T16:17:38.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7940000000000001e-06 2024-09-12T16:17:38.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:38.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896247+0000", 2024-09-12T16:17:38.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1460000000000001e-06 2024-09-12T16:17:38.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:38.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896252+0000", 2024-09-12T16:17:38.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6840000000000004e-06 2024-09-12T16:17:38.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:38.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934494+0000", 2024-09-12T16:17:38.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038242362000000002 2024-09-12T16:17:38.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:38.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934579+0000", 2024-09-12T16:17:38.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5044999999999996e-05 2024-09-12T16:17:38.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:38.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934660+0000", 2024-09-12T16:17:38.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0357000000000003e-05 2024-09-12T16:17:38.338 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.338 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:38.338 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.339 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2309 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12409856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:38.339 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:17:38.339 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 80.430304148000005, 2024-09-12T16:17:38.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038504629999999998, 2024-09-12T16:17:38.339 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:38.339 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:38.339 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:38.340 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:38.340 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:38.340 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:38.340 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2309 2024-09-12T16:17:38.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.340 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:38.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:38.340 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:17:38.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:38.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:17:38.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.341 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:38.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:17:38.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5199999999999998e-07 2024-09-12T16:17:38.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.341 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:38.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896263+0000", 2024-09-12T16:17:38.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4209999999999999e-06 2024-09-12T16:17:38.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:38.342 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896269+0000", 2024-09-12T16:17:38.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9449999999999998e-06 2024-09-12T16:17:38.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:38.342 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896274+0000", 2024-09-12T16:17:38.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3950000000000003e-06 2024-09-12T16:17:38.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:38.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934686+0000", 2024-09-12T16:17:38.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038412333999999999 2024-09-12T16:17:38.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:38.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934727+0000", 2024-09-12T16:17:38.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0649999999999999e-05 2024-09-12T16:17:38.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:38.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934764+0000", 2024-09-12T16:17:38.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7533000000000001e-05 2024-09-12T16:17:38.344 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.344 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:38.344 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.344 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2310 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12413952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:38.344 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:17:38.344 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 80.430283275999997, 2024-09-12T16:17:38.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038694183, 2024-09-12T16:17:38.345 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:38.345 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:38.345 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:38.345 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:38.345 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:38.345 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:38.345 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2310 2024-09-12T16:17:38.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.345 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:38.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:38.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:17:38.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:38.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:17:38.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:38.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896281+0000", 2024-09-12T16:17:38.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1399999999999997e-07 2024-09-12T16:17:38.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.347 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:38.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896283+0000", 2024-09-12T16:17:38.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9549999999999999e-06 2024-09-12T16:17:38.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.347 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:38.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896289+0000", 2024-09-12T16:17:38.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8669999999999999e-06 2024-09-12T16:17:38.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:38.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896301+0000", 2024-09-12T16:17:38.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1807999999999999e-05 2024-09-12T16:17:38.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:38.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934798+0000", 2024-09-12T16:17:38.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038497591999999997 2024-09-12T16:17:38.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:38.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934885+0000", 2024-09-12T16:17:38.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7149000000000002e-05 2024-09-12T16:17:38.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:38.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934975+0000", 2024-09-12T16:17:38.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9297999999999998e-05 2024-09-12T16:17:38.349 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.349 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:38.349 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.350 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2311 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12418048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:38.350 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:17:38.350 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 80.430256020000002, 2024-09-12T16:17:38.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038768558000000002, 2024-09-12T16:17:38.350 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:38.350 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:38.350 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:38.350 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:38.350 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:38.350 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:38.350 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2311 2024-09-12T16:17:38.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.351 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:38.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:38.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:17:38.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:38.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:17:38.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:38.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:17:38.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.63e-07 2024-09-12T16:17:38.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:38.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896310+0000", 2024-09-12T16:17:38.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1560000000000002e-06 2024-09-12T16:17:38.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:38.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896316+0000", 2024-09-12T16:17:38.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0249999999999999e-06 2024-09-12T16:17:38.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:38.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896322+0000", 2024-09-12T16:17:38.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6400000000000002e-06 2024-09-12T16:17:38.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:38.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934997+0000", 2024-09-12T16:17:38.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038674565000000001 2024-09-12T16:17:38.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:38.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935037+0000", 2024-09-12T16:17:38.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0485999999999998e-05 2024-09-12T16:17:38.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:38.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935076+0000", 2024-09-12T16:17:38.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9223e-05 2024-09-12T16:17:38.354 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.354 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:38.354 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.355 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2312 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12422144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:38.355 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:17:38.355 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 80.430235327000005, 2024-09-12T16:17:38.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038856784999999998, 2024-09-12T16:17:38.355 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:38.355 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:38.355 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:38.355 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:38.355 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:38.356 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:38.356 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2312 2024-09-12T16:17:38.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.356 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:38.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.356 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:38.356 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:17:38.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.357 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:38.357 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:17:38.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.357 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:38.357 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896329+0000", 2024-09-12T16:17:38.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5499999999999999e-07 2024-09-12T16:17:38.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:38.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896337+0000", 2024-09-12T16:17:38.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0819999999999999e-06 2024-09-12T16:17:38.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:38.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896343+0000", 2024-09-12T16:17:38.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.263e-06 2024-09-12T16:17:38.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:38.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896348+0000", 2024-09-12T16:17:38.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8860000000000003e-06 2024-09-12T16:17:38.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:38.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935097+0000", 2024-09-12T16:17:38.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038748818999999997 2024-09-12T16:17:38.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:38.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935141+0000", 2024-09-12T16:17:38.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4175000000000003e-05 2024-09-12T16:17:38.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:38.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935185+0000", 2024-09-12T16:17:38.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4205000000000001e-05 2024-09-12T16:17:38.361 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.361 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:38.361 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.361 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2313 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12426240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:38.361 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:17:38.361 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 80.430209112, 2024-09-12T16:17:38.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038928683999999998, 2024-09-12T16:17:38.361 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:38.361 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:38.362 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:38.362 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:38.362 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:38.362 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:38.362 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2313 2024-09-12T16:17:38.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.362 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:38.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:38.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:17:38.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.363 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:38.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:17:38.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:38.364 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:17:38.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0400000000000002e-07 2024-09-12T16:17:38.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:38.364 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896357+0000", 2024-09-12T16:17:38.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.097e-06 2024-09-12T16:17:38.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:38.364 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896363+0000", 2024-09-12T16:17:38.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5119999999999999e-06 2024-09-12T16:17:38.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:38.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896374+0000", 2024-09-12T16:17:38.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1381e-05 2024-09-12T16:17:38.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:38.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935205+0000", 2024-09-12T16:17:38.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038830549999999998 2024-09-12T16:17:38.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:38.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935244+0000", 2024-09-12T16:17:38.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9520000000000001e-05 2024-09-12T16:17:38.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:38.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935283+0000", 2024-09-12T16:17:38.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9220000000000001e-05 2024-09-12T16:17:38.366 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.366 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:38.366 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.367 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2314 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12430336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:38.367 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:17:38.367 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 80.430171942000001, 2024-09-12T16:17:38.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039008137999999998, 2024-09-12T16:17:38.367 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:38.367 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:38.367 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:38.367 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:38.367 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:38.368 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:38.368 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2314 2024-09-12T16:17:38.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.368 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:38.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.368 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:38.368 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:17:38.368 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:38.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:17:38.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:38.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:17:38.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6499999999999999e-07 2024-09-12T16:17:38.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:38.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896395+0000", 2024-09-12T16:17:38.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2960000000000001e-06 2024-09-12T16:17:38.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:38.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896402+0000", 2024-09-12T16:17:38.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2280000000000001e-06 2024-09-12T16:17:38.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:38.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896407+0000", 2024-09-12T16:17:38.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3630000000000002e-06 2024-09-12T16:17:38.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:38.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935302+0000", 2024-09-12T16:17:38.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038895181000000001 2024-09-12T16:17:38.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:38.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935343+0000", 2024-09-12T16:17:38.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0590999999999998e-05 2024-09-12T16:17:38.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:38.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935400+0000", 2024-09-12T16:17:38.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7014e-05 2024-09-12T16:17:38.372 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.372 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:38.372 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.373 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2315 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12434432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:38.373 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:17:38.373 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 80.430149291000006, 2024-09-12T16:17:38.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039083892000000002, 2024-09-12T16:17:38.373 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:38.373 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:38.373 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:38.373 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:38.373 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:38.373 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:38.374 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2315 2024-09-12T16:17:38.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.374 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:38.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:38.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:17:38.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:38.375 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:17:38.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:38.375 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896415+0000", 2024-09-12T16:17:38.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3300000000000002e-07 2024-09-12T16:17:38.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:38.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896421+0000", 2024-09-12T16:17:38.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7579999999999998e-06 2024-09-12T16:17:38.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.376 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:38.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896427+0000", 2024-09-12T16:17:38.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3029999999999996e-06 2024-09-12T16:17:38.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.376 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:38.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896432+0000", 2024-09-12T16:17:38.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.215e-06 2024-09-12T16:17:38.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:38.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935420+0000", 2024-09-12T16:17:38.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038987727 2024-09-12T16:17:38.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:38.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935460+0000", 2024-09-12T16:17:38.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9817999999999997e-05 2024-09-12T16:17:38.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.378 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:38.378 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935498+0000", 2024-09-12T16:17:38.378 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8438e-05 2024-09-12T16:17:38.378 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.378 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:38.378 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.379 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2316 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12438528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:38.379 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:17:38.379 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 80.430124638999999, 2024-09-12T16:17:38.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039160043999999998, 2024-09-12T16:17:38.379 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:38.379 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:38.379 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:38.379 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:38.379 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:38.379 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:38.380 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2316 2024-09-12T16:17:38.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.380 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:38.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:38.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:17:38.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:38.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:17:38.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.381 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:38.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901945+0000", 2024-09-12T16:17:38.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055056050000000002 2024-09-12T16:17:38.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.381 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:38.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901950+0000", 2024-09-12T16:17:38.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2490000000000001e-06 2024-09-12T16:17:38.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:38.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901966+0000", 2024-09-12T16:17:38.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6325e-05 2024-09-12T16:17:38.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:38.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901974+0000", 2024-09-12T16:17:38.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7570000000000004e-06 2024-09-12T16:17:38.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:38.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935518+0000", 2024-09-12T16:17:38.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033543587999999999 2024-09-12T16:17:38.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:38.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935559+0000", 2024-09-12T16:17:38.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1746000000000003e-05 2024-09-12T16:17:38.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:38.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935599+0000", 2024-09-12T16:17:38.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9774000000000002e-05 2024-09-12T16:17:38.384 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.384 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:38.384 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.384 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1571 3.b 3:d046566d:::rbd_data.1155525b14e3.0000000000000001:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:17:38.384 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:17:38.384 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.173999596999998, 2024-09-12T16:17:38.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064439785999999999, 2024-09-12T16:17:38.385 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:38.385 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:38.385 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:38.385 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:38.385 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:17:38.385 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:17:38.385 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1571 2024-09-12T16:17:38.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.385 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:38.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.386 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:38.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:17:38.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.386 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:38.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:17:38.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.386 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:38.387 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:17:38.387 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5400000000000002e-07 2024-09-12T16:17:38.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.387 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:38.387 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152567+0000", 2024-09-12T16:17:38.387 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.131e-06 2024-09-12T16:17:38.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.387 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:38.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152574+0000", 2024-09-12T16:17:38.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1840000000000002e-06 2024-09-12T16:17:38.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:38.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152579+0000", 2024-09-12T16:17:38.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.152e-06 2024-09-12T16:17:38.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:38.389 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153671+0000", 2024-09-12T16:17:38.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001092078 2024-09-12T16:17:38.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.389 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:38.389 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153779+0000", 2024-09-12T16:17:38.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108461 2024-09-12T16:17:38.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.389 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:38.389 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217004+0000", 2024-09-12T16:17:38.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.063224426 2024-09-12T16:17:38.390 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.390 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:38.390 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.390 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1581 3.4 3:22e34893:::rbd_data.1155525b14e3.0000000000000005:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:17:38.390 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:17:38.390 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.173902472000002, 2024-09-12T16:17:38.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064484407999999993, 2024-09-12T16:17:38.390 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:38.391 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:38.391 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:38.391 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:38.391 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:17:38.391 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:17:38.391 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1581 2024-09-12T16:17:38.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.391 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:38.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.392 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:38.392 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:17:38.392 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.392 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:38.392 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:17:38.392 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.393 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:38.393 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152662+0000", 2024-09-12T16:17:38.393 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.65e-07 2024-09-12T16:17:38.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.393 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.393 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:38.393 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152664+0000", 2024-09-12T16:17:38.393 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9829999999999999e-06 2024-09-12T16:17:38.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.393 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.393 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:38.393 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152670+0000", 2024-09-12T16:17:38.394 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2260000000000002e-06 2024-09-12T16:17:38.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.394 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:38.394 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152675+0000", 2024-09-12T16:17:38.394 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7990000000000001e-06 2024-09-12T16:17:38.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.394 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:38.394 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.216945+0000", 2024-09-12T16:17:38.394 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064270341999999994 2024-09-12T16:17:38.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.395 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:38.395 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217040+0000", 2024-09-12T16:17:38.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5242999999999996e-05 2024-09-12T16:17:38.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.395 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:38.395 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217146+0000", 2024-09-12T16:17:38.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010545 2024-09-12T16:17:38.395 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.395 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:38.395 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.396 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2207 3.0 3:05fdc61f:::rbd_data.1155ccb1894c.0000000000000003:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:38.396 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:17:38.396 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.955858911, 2024-09-12T16:17:38.396 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.05105382, 2024-09-12T16:17:38.396 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:38.396 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:38.396 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:38.396 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:38.396 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:17:38.396 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:17:38.396 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2207 2024-09-12T16:17:38.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.397 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:38.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.397 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:38.397 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:17:38.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.397 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:38.397 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:17:38.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:38.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370706+0000", 2024-09-12T16:17:38.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7800000000000001e-07 2024-09-12T16:17:38.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:38.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391581+0000", 2024-09-12T16:17:38.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020875624999999998 2024-09-12T16:17:38.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:38.399 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391608+0000", 2024-09-12T16:17:38.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6412999999999999e-05 2024-09-12T16:17:38.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:38.399 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391618+0000", 2024-09-12T16:17:38.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9240000000000002e-06 2024-09-12T16:17:38.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:38.400 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391705+0000", 2024-09-12T16:17:38.400 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7489000000000002e-05 2024-09-12T16:17:38.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.400 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:38.400 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391838+0000", 2024-09-12T16:17:38.400 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132865 2024-09-12T16:17:38.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.400 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 2", 2024-09-12T16:17:38.400 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.392587+0000", 2024-09-12T16:17:38.400 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074930000000000005 2024-09-12T16:17:38.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.401 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:38.401 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.420095+0000", 2024-09-12T16:17:38.401 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027507949 2024-09-12T16:17:38.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.401 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:17:38.401 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421610+0000", 2024-09-12T16:17:38.401 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001515195 2024-09-12T16:17:38.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:17:38.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421681+0000", 2024-09-12T16:17:38.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0320000000000004e-05 2024-09-12T16:17:38.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:38.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421759+0000", 2024-09-12T16:17:38.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7961999999999997e-05 2024-09-12T16:17:38.402 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.402 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:38.403 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.403 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5577.0:12725 3.0 3:02074383:::rbd_data.11552c69b548.0000000000000011:20 [read 785408~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-12T16:17:38.403 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:29.288770+0000", 2024-09-12T16:17:38.403 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.0377939000000005, 2024-09-12T16:17:38.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038316849, 2024-09-12T16:17:38.403 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:38.403 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:38.403 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:38.403 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:38.403 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5577", 2024-09-12T16:17:38.404 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/4222688771", 2024-09-12T16:17:38.404 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 12725 2024-09-12T16:17:38.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.404 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:38.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.404 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:38.404 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288770+0000", 2024-09-12T16:17:38.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.405 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:38.405 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288770+0000", 2024-09-12T16:17:38.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.405 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:38.405 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288770+0000", 2024-09-12T16:17:38.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8500000000000002e-07 2024-09-12T16:17:38.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.405 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:38.405 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288772+0000", 2024-09-12T16:17:38.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2689999999999998e-06 2024-09-12T16:17:38.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:38.406 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288779+0000", 2024-09-12T16:17:38.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8310000000000003e-06 2024-09-12T16:17:38.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:38.406 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288784+0000", 2024-09-12T16:17:38.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1529999999999996e-06 2024-09-12T16:17:38.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.407 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:38.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.326899+0000", 2024-09-12T16:17:38.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038114980999999999 2024-09-12T16:17:38.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.407 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:38.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.326990+0000", 2024-09-12T16:17:38.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0191000000000004e-05 2024-09-12T16:17:38.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.407 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:38.408 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327087+0000", 2024-09-12T16:17:38.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7039000000000004e-05 2024-09-12T16:17:38.408 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.408 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:38.408 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.408 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5577.0:12726 3.0 3:02074383:::rbd_data.11552c69b548.0000000000000011:20 [read 793600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-12T16:17:38.408 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:29.288794+0000", 2024-09-12T16:17:38.408 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.0377699489999994, 2024-09-12T16:17:38.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038526029000000003, 2024-09-12T16:17:38.408 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:38.409 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:38.409 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:38.409 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:38.409 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5577", 2024-09-12T16:17:38.409 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/4222688771", 2024-09-12T16:17:38.409 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 12726 2024-09-12T16:17:38.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.409 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:38.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:38.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288794+0000", 2024-09-12T16:17:38.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.410 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:38.410 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288794+0000", 2024-09-12T16:17:38.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.410 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:38.410 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288794+0000", 2024-09-12T16:17:38.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2799999999999996e-07 2024-09-12T16:17:38.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.411 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:38.411 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288797+0000", 2024-09-12T16:17:38.411 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3920000000000001e-06 2024-09-12T16:17:38.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.411 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:38.411 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288804+0000", 2024-09-12T16:17:38.411 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8430000000000004e-06 2024-09-12T16:17:38.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.411 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:38.411 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288809+0000", 2024-09-12T16:17:38.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1460000000000004e-06 2024-09-12T16:17:38.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:38.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327130+0000", 2024-09-12T16:17:38.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038320982000000003 2024-09-12T16:17:38.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:38.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327216+0000", 2024-09-12T16:17:38.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5991999999999999e-05 2024-09-12T16:17:38.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:38.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327320+0000", 2024-09-12T16:17:38.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000104146 2024-09-12T16:17:38.413 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.413 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:38.413 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.413 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5577.0:12727 3.0 3:02074383:::rbd_data.11552c69b548.0000000000000011:20 [read 801792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-12T16:17:38.413 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:29.288838+0000", 2024-09-12T16:17:38.413 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.0377261250000007, 2024-09-12T16:17:38.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038705804000000003, 2024-09-12T16:17:38.414 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:38.414 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:38.414 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:38.414 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:38.414 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5577", 2024-09-12T16:17:38.414 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/4222688771", 2024-09-12T16:17:38.414 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 12727 2024-09-12T16:17:38.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.414 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:38.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:38.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288838+0000", 2024-09-12T16:17:38.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.415 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:38.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288838+0000", 2024-09-12T16:17:38.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.415 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:38.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288838+0000", 2024-09-12T16:17:38.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8299999999999997e-07 2024-09-12T16:17:38.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.416 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:38.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288840+0000", 2024-09-12T16:17:38.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.396e-06 2024-09-12T16:17:38.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.416 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:38.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288851+0000", 2024-09-12T16:17:38.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0312999999999999e-05 2024-09-12T16:17:38.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.417 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:38.417 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288857+0000", 2024-09-12T16:17:38.417 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7570000000000001e-06 2024-09-12T16:17:38.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.417 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:38.417 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327361+0000", 2024-09-12T16:17:38.417 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038504069000000002 2024-09-12T16:17:38.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.417 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:38.417 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327446+0000", 2024-09-12T16:17:38.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5542000000000002e-05 2024-09-12T16:17:38.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:38.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327543+0000", 2024-09-12T16:17:38.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7244000000000006e-05 2024-09-12T16:17:38.418 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.418 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:38.418 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.418 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5577.0:12728 3.0 3:02074383:::rbd_data.11552c69b548.0000000000000011:20 [read 809984~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-12T16:17:38.419 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:29.288864+0000", 2024-09-12T16:17:38.419 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.0376993100000007, 2024-09-12T16:17:38.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038914837000000001, 2024-09-12T16:17:38.419 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:38.419 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:38.419 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:38.419 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:38.419 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5577", 2024-09-12T16:17:38.419 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/4222688771", 2024-09-12T16:17:38.419 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 12728 2024-09-12T16:17:38.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.420 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:38.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:38.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288864+0000", 2024-09-12T16:17:38.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:38.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288864+0000", 2024-09-12T16:17:38.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:38.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288865+0000", 2024-09-12T16:17:38.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-07 2024-09-12T16:17:38.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:38.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288867+0000", 2024-09-12T16:17:38.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.092e-06 2024-09-12T16:17:38.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:38.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288873+0000", 2024-09-12T16:17:38.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0020000000000003e-06 2024-09-12T16:17:38.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.422 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:38.422 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288878+0000", 2024-09-12T16:17:38.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2700000000000004e-06 2024-09-12T16:17:38.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.422 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:38.422 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327588+0000", 2024-09-12T16:17:38.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038709660999999999 2024-09-12T16:17:38.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.423 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:38.423 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327673+0000", 2024-09-12T16:17:38.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5370000000000004e-05 2024-09-12T16:17:38.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.423 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:38.423 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327779+0000", 2024-09-12T16:17:38.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000105957 2024-09-12T16:17:38.423 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.423 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:38.424 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.424 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5577.0:12729 3.0 3.c1c2e040 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-12T16:17:38.424 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:29.288885+0000", 2024-09-12T16:17:38.424 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.0376789839999994, 2024-09-12T16:17:38.424 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038952112999999997, 2024-09-12T16:17:38.424 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:38.424 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:38.424 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:17:38.424 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:38.425 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5577", 2024-09-12T16:17:38.425 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/4222688771", 2024-09-12T16:17:38.425 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 12729 2024-09-12T16:17:38.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.425 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:38.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:38.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288885+0000", 2024-09-12T16:17:38.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:38.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288885+0000", 2024-09-12T16:17:38.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:38.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288885+0000", 2024-09-12T16:17:38.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9299999999999999e-07 2024-09-12T16:17:38.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:38.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288887+0000", 2024-09-12T16:17:38.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9589999999999998e-06 2024-09-12T16:17:38.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:38.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288893+0000", 2024-09-12T16:17:38.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8579999999999996e-06 2024-09-12T16:17:38.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:38.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288898+0000", 2024-09-12T16:17:38.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-06 2024-09-12T16:17:38.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.428 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.428 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:38.428 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327827+0000", 2024-09-12T16:17:38.428 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038928782000000002 2024-09-12T16:17:38.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.428 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.428 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:38.428 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327837+0000", 2024-09-12T16:17:38.428 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0271e-05 2024-09-12T16:17:38.428 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.428 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:38.429 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.429 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5577.0:12730 3.0 3.c1c2e040 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-12T16:17:38.429 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:29.288904+0000", 2024-09-12T16:17:38.429 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.0376596760000005, 2024-09-12T16:17:38.429 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038984576999999999, 2024-09-12T16:17:38.429 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:38.429 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:38.429 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:17:38.429 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:38.429 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5577", 2024-09-12T16:17:38.430 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/4222688771", 2024-09-12T16:17:38.430 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 12730 2024-09-12T16:17:38.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.430 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:38.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.430 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:38.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288904+0000", 2024-09-12T16:17:38.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.430 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:38.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288904+0000", 2024-09-12T16:17:38.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:38.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288904+0000", 2024-09-12T16:17:38.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.65e-07 2024-09-12T16:17:38.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:38.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288906+0000", 2024-09-12T16:17:38.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9549999999999999e-06 2024-09-12T16:17:38.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:38.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288912+0000", 2024-09-12T16:17:38.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9460000000000003e-06 2024-09-12T16:17:38.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:38.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288926+0000", 2024-09-12T16:17:38.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3540000000000001e-05 2024-09-12T16:17:38.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:38.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327882+0000", 2024-09-12T16:17:38.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038956565999999998 2024-09-12T16:17:38.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:38.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327889+0000", 2024-09-12T16:17:38.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2049999999999999e-06 2024-09-12T16:17:38.433 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.433 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:38.434 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.434 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5577.0:12731 3.0 3.c1c2e040 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-12T16:17:38.434 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:29.288934+0000", 2024-09-12T16:17:38.434 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.0376293000000008, 2024-09-12T16:17:38.434 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039017193999999998, 2024-09-12T16:17:38.434 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:38.434 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:38.434 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:17:38.434 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:38.434 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5577", 2024-09-12T16:17:38.435 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/4222688771", 2024-09-12T16:17:38.435 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 12731 2024-09-12T16:17:38.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.435 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:38.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.435 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:38.435 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288934+0000", 2024-09-12T16:17:38.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.435 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:38.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288934+0000", 2024-09-12T16:17:38.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:38.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288935+0000", 2024-09-12T16:17:38.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7599999999999998e-07 2024-09-12T16:17:38.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:38.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288937+0000", 2024-09-12T16:17:38.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4540000000000001e-06 2024-09-12T16:17:38.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.437 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:38.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288944+0000", 2024-09-12T16:17:38.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4980000000000003e-06 2024-09-12T16:17:38.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.437 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:38.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288949+0000", 2024-09-12T16:17:38.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1399999999999999e-06 2024-09-12T16:17:38.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.438 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:38.438 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327944+0000", 2024-09-12T16:17:38.438 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038994859999999999 2024-09-12T16:17:38.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.438 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:38.438 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327952+0000", 2024-09-12T16:17:38.438 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8660000000000006e-06 2024-09-12T16:17:38.438 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.438 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:38.438 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.438 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.439 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:38.439 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:38.440 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:17:38.441 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-12T16:17:38.442 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:38.439+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:38.445 INFO:teuthology.orchestra.run.smithi204.stdout:4790 punch from 0x78c800 to 0x799600, (0xce00 bytes) 2024-09-12T16:17:38.450 INFO:teuthology.orchestra.run.smithi204.stdout:4791 read 0x2d3f600 thru 0x2d3fc43 (0x644 bytes) 2024-09-12T16:17:38.474 INFO:teuthology.orchestra.run.smithi204.stdout:4792 write 0xbb52600 thru 0xbb5cfdf (0xa9e0 bytes) 2024-09-12T16:17:38.474 INFO:teuthology.orchestra.run.smithi204.stdout:4793 write 0x77ee200 thru 0x77f5f6e (0x7d6f bytes) 2024-09-12T16:17:38.474 INFO:teuthology.orchestra.run.smithi204.stdout:4798 write 0x758fa00 thru 0x759e29d (0xe89e bytes) 2024-09-12T16:17:38.474 INFO:teuthology.orchestra.run.smithi204.stdout:4800 write 0x2df2200 thru 0x2e00955 (0xe756 bytes) 2024-09-12T16:17:38.474 INFO:teuthology.orchestra.run.smithi204.stdout:4801 punch from 0x20dc000 to 0x20ebe00, (0xfe00 bytes) 2024-09-12T16:17:38.482 INFO:teuthology.orchestra.run.smithi204.stdout:4804 punch from 0xc69e400 to 0xc6a9e00, (0xba00 bytes) 2024-09-12T16:17:38.483 INFO:teuthology.orchestra.run.smithi204.stdout:4808 read 0x1caac00 thru 0x1cb06a8 (0x5aa9 bytes) 2024-09-12T16:17:38.522 INFO:teuthology.orchestra.run.smithi204.stdout:4811 trunc from 0xcabb800 to 0x463400 2024-09-12T16:17:38.541 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:38.540+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:38.629 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:38.629 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:38.629 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:17:38.629 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:38.639 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:17:38.680 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:38.679+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:38.715 INFO:teuthology.orchestra.run.smithi204.stdout:4814 punch from 0xbf200 to 0xcc800, (0xd600 bytes) 2024-09-12T16:17:38.731 INFO:teuthology.orchestra.run.smithi204.stdout:4817 trunc from 0x463400 to 0xcac0400 2024-09-12T16:17:38.742 INFO:teuthology.orchestra.run.smithi204.stdout:4819 read 0x64b3e00 thru 0x64bdebe (0xa0bf bytes) 2024-09-12T16:17:38.742 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:38.741+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:38.743 INFO:teuthology.orchestra.run.smithi204.stdout:4822 write 0x7601400 thru 0x7607f12 (0x6b13 bytes) 2024-09-12T16:17:38.743 INFO:teuthology.orchestra.run.smithi204.stdout:4824 read 0xc441e00 thru 0xc44de44 (0xc045 bytes) 2024-09-12T16:17:38.743 INFO:teuthology.orchestra.run.smithi204.stdout:4825 write 0x75ce000 thru 0x75ce4a9 (0x4aa bytes) 2024-09-12T16:17:38.743 INFO:teuthology.orchestra.run.smithi204.stdout:4826 read 0xa3b1000 thru 0xa3b9874 (0x8875 bytes) 2024-09-12T16:17:38.743 INFO:teuthology.orchestra.run.smithi204.stdout:4828 write 0x1f06a00 thru 0x1f0a709 (0x3d0a bytes) 2024-09-12T16:17:38.743 INFO:teuthology.orchestra.run.smithi204.stdout:4829 punch from 0x5757c00 to 0x5762c00, (0xb000 bytes) 2024-09-12T16:17:38.745 INFO:teuthology.orchestra.run.smithi204.stdout:4830 write 0x5a2de00 thru 0x5a3d43e (0xf63f bytes) 2024-09-12T16:17:38.745 INFO:teuthology.orchestra.run.smithi204.stdout:4832 read 0x3280800 thru 0x328f49c (0xec9d bytes) 2024-09-12T16:17:38.750 INFO:teuthology.orchestra.run.smithi204.stdout:4833 trunc from 0xcac0400 to 0x8809000 2024-09-12T16:17:38.789 INFO:teuthology.orchestra.run.smithi204.stdout:4835 trunc from 0x8809000 to 0x16f600 2024-09-12T16:17:38.808 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:38.808 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:38.808 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:17:38.808 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:17:38.808 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:38.817 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:17:38.842 INFO:teuthology.orchestra.run.smithi204.stdout:4836 write 0xdb72000 thru 0xdb7be56 (0x9e57 bytes) 2024-09-12T16:17:38.843 INFO:teuthology.orchestra.run.smithi204.stdout:4837 read 0x8295e00 thru 0x82a3d0c (0xdf0d bytes) 2024-09-12T16:17:38.843 INFO:teuthology.orchestra.run.smithi204.stdout:4838 read 0xbe23200 thru 0xbe30f55 (0xdd56 bytes) 2024-09-12T16:17:38.843 INFO:teuthology.orchestra.run.smithi204.stdout:4839 punch from 0x5ced200 to 0x5cedc00, (0xa00 bytes) 2024-09-12T16:17:38.843 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:38.842+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:38.844 INFO:teuthology.orchestra.run.smithi204.stdout:4840 trunc from 0xdb7c000 to 0xdae8000 2024-09-12T16:17:38.861 INFO:teuthology.orchestra.run.smithi204.stdout:4842 punch from 0x1646e00 to 0x164b800, (0x4a00 bytes) 2024-09-12T16:17:38.862 INFO:teuthology.orchestra.run.smithi204.stdout:4843 write 0x2a1c200 thru 0x2a29819 (0xd61a bytes) 2024-09-12T16:17:38.864 INFO:teuthology.orchestra.run.smithi204.stdout:4845 trunc from 0xdae8000 to 0xc57f400 2024-09-12T16:17:38.888 INFO:teuthology.orchestra.run.smithi204.stdout:4849 read 0x1ce9c00 thru 0x1ce9e91 (0x292 bytes) 2024-09-12T16:17:38.899 INFO:teuthology.orchestra.run.smithi204.stdout:4851 write 0xca77000 thru 0xca791f7 (0x21f8 bytes) 2024-09-12T16:17:38.901 INFO:teuthology.orchestra.run.smithi204.stdout:4853 trunc from 0xca79200 to 0xb1e1e00 2024-09-12T16:17:38.936 INFO:teuthology.orchestra.run.smithi204.stdout:4854 write 0xe5b4200 thru 0xe5c0bdf (0xc9e0 bytes) 2024-09-12T16:17:38.938 INFO:teuthology.orchestra.run.smithi204.stdout:4858 punch from 0x675b400 to 0x675c800, (0x1400 bytes) 2024-09-12T16:17:38.940 INFO:teuthology.orchestra.run.smithi204.stdout:4862 read 0x5ef1e00 thru 0x5ef90de (0x72df bytes) 2024-09-12T16:17:38.940 INFO:teuthology.orchestra.run.smithi204.stdout:4863 write 0x3994800 thru 0x39a37f0 (0xeff1 bytes) 2024-09-12T16:17:38.940 INFO:teuthology.orchestra.run.smithi204.stdout:4865 punch from 0x494b600 to 0x4952800, (0x7200 bytes) 2024-09-12T16:17:38.941 INFO:teuthology.orchestra.run.smithi204.stdout:4867 punch from 0xaaec800 to 0xaaf9000, (0xc800 bytes) 2024-09-12T16:17:38.941 INFO:teuthology.orchestra.run.smithi204.stdout:4870 read 0x870200 thru 0x872814 (0x2615 bytes) 2024-09-12T16:17:38.941 INFO:teuthology.orchestra.run.smithi204.stdout:4871 read 0x3e17a00 thru 0x3e1e3d3 (0x69d4 bytes) 2024-09-12T16:17:38.941 INFO:teuthology.orchestra.run.smithi204.stdout:4877 read 0x94ebe00 thru 0x94f7394 (0xb595 bytes) 2024-09-12T16:17:38.943 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:38.942+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:38.950 INFO:teuthology.orchestra.run.smithi204.stdout:4878 trunc from 0xe5c0c00 to 0x68c5600 2024-09-12T16:17:38.951 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:38.951 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:17:38.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:17:38.952 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:17:38.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.952 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2213 3.18 3:1944e921:::rbd_data.1155ccb1894c.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:38.952 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:17:38.952 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 41.574268893999999, 2024-09-12T16:17:38.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.055657836000000002, 2024-09-12T16:17:38.952 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:38.952 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:38.952 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:38.952 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:38.952 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:17:38.952 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:17:38.953 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2213 2024-09-12T16:17:38.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.953 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:38.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:38.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:17:38.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:38.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:17:38.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:38.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375351+0000", 2024-09-12T16:17:38.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.556e-06 2024-09-12T16:17:38.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:38.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.399989+0000", 2024-09-12T16:17:38.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024637949999999999 2024-09-12T16:17:38.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:38.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400038+0000", 2024-09-12T16:17:38.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9187999999999997e-05 2024-09-12T16:17:38.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:38.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400056+0000", 2024-09-12T16:17:38.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8451e-05 2024-09-12T16:17:38.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:38.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400151+0000", 2024-09-12T16:17:38.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5026999999999997e-05 2024-09-12T16:17:38.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:38.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400345+0000", 2024-09-12T16:17:38.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019352900000000001 2024-09-12T16:17:38.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 1", 2024-09-12T16:17:38.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.401319+0000", 2024-09-12T16:17:38.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00097419399999999995 2024-09-12T16:17:38.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:17:38.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.429350+0000", 2024-09-12T16:17:38.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028030607999999999 2024-09-12T16:17:38.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:38.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.430907+0000", 2024-09-12T16:17:38.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001557466 2024-09-12T16:17:38.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:17:38.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.430966+0000", 2024-09-12T16:17:38.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9437e-05 2024-09-12T16:17:38.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:38.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.431007+0000", 2024-09-12T16:17:38.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0429999999999997e-05 2024-09-12T16:17:38.958 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.958 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:38.958 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.958 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6725 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2392064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:38.958 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.557452+0000", 2024-09-12T16:17:38.958 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.392166228000001, 2024-09-12T16:17:38.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045294112999999997, 2024-09-12T16:17:38.959 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:38.959 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:38.959 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:38.959 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:38.959 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:38.959 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:38.959 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6725 2024-09-12T16:17:38.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.959 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:38.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:38.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557452+0000", 2024-09-12T16:17:38.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:38.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557452+0000", 2024-09-12T16:17:38.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:38.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557693+0000", 2024-09-12T16:17:38.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024098699999999999 2024-09-12T16:17:38.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:38.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557697+0000", 2024-09-12T16:17:38.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8489999999999999e-06 2024-09-12T16:17:38.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:38.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557707+0000", 2024-09-12T16:17:38.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0356999999999999e-05 2024-09-12T16:17:38.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:38.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557714+0000", 2024-09-12T16:17:38.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0219999999999999e-06 2024-09-12T16:17:38.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:38.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.602612+0000", 2024-09-12T16:17:38.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044897907000000001 2024-09-12T16:17:38.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:38.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.602683+0000", 2024-09-12T16:17:38.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1171e-05 2024-09-12T16:17:38.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:38.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.602746+0000", 2024-09-12T16:17:38.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2819999999999998e-05 2024-09-12T16:17:38.963 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.963 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:38.963 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.963 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6727 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2422784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:38.963 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.557749+0000", 2024-09-12T16:17:38.963 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.391868629000001, 2024-09-12T16:17:38.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045329659000000001, 2024-09-12T16:17:38.963 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:38.963 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:38.963 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:38.963 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:38.963 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:38.963 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:38.964 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6727 2024-09-12T16:17:38.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.964 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:38.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:38.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557749+0000", 2024-09-12T16:17:38.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:38.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557749+0000", 2024-09-12T16:17:38.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:38.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557750+0000", 2024-09-12T16:17:38.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6600000000000002e-07 2024-09-12T16:17:38.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:38.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557752+0000", 2024-09-12T16:17:38.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.278e-06 2024-09-12T16:17:38.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:38.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557759+0000", 2024-09-12T16:17:38.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7329999999999997e-06 2024-09-12T16:17:38.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:38.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557764+0000", 2024-09-12T16:17:38.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0390000000000004e-06 2024-09-12T16:17:38.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:38.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.602943+0000", 2024-09-12T16:17:38.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045179035999999999 2024-09-12T16:17:38.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:38.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603016+0000", 2024-09-12T16:17:38.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2999999999999999e-05 2024-09-12T16:17:38.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:38.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603079+0000", 2024-09-12T16:17:38.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3107000000000004e-05 2024-09-12T16:17:38.967 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.967 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:38.967 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.967 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6728 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2439168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:38.968 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.557771+0000", 2024-09-12T16:17:38.968 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.391846752999999, 2024-09-12T16:17:38.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045474239, 2024-09-12T16:17:38.968 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:38.968 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:38.968 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:38.968 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:38.968 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:38.968 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:38.968 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6728 2024-09-12T16:17:38.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.968 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:38.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:38.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557771+0000", 2024-09-12T16:17:38.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:38.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557771+0000", 2024-09-12T16:17:38.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:38.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557772+0000", 2024-09-12T16:17:38.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5400000000000002e-07 2024-09-12T16:17:38.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:38.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557774+0000", 2024-09-12T16:17:38.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.165e-06 2024-09-12T16:17:38.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:38.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557782+0000", 2024-09-12T16:17:38.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3289999999999994e-06 2024-09-12T16:17:38.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:38.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557787+0000", 2024-09-12T16:17:38.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1909999999999999e-06 2024-09-12T16:17:38.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:38.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603110+0000", 2024-09-12T16:17:38.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045322710000000002 2024-09-12T16:17:38.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:38.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603182+0000", 2024-09-12T16:17:38.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1755999999999995e-05 2024-09-12T16:17:38.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:38.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603245+0000", 2024-09-12T16:17:38.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3633999999999994e-05 2024-09-12T16:17:38.972 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.972 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:38.972 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.972 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6729 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2454528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:38.972 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.557794+0000", 2024-09-12T16:17:38.972 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.391823972000001, 2024-09-12T16:17:38.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045614517, 2024-09-12T16:17:38.972 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:38.973 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:38.973 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:38.973 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:38.973 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:38.973 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:38.973 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6729 2024-09-12T16:17:38.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.973 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:38.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:38.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557794+0000", 2024-09-12T16:17:38.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:38.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557794+0000", 2024-09-12T16:17:38.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:38.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557879+0000", 2024-09-12T16:17:38.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5130000000000007e-05 2024-09-12T16:17:38.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:38.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557884+0000", 2024-09-12T16:17:38.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2390000000000002e-06 2024-09-12T16:17:38.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:38.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557894+0000", 2024-09-12T16:17:38.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4800000000000007e-06 2024-09-12T16:17:38.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:38.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557900+0000", 2024-09-12T16:17:38.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5610000000000004e-06 2024-09-12T16:17:38.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:38.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603273+0000", 2024-09-12T16:17:38.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045372799999999998 2024-09-12T16:17:38.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:38.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603345+0000", 2024-09-12T16:17:38.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1562000000000004e-05 2024-09-12T16:17:38.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:38.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603408+0000", 2024-09-12T16:17:38.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3744999999999994e-05 2024-09-12T16:17:38.977 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.977 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:38.977 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.977 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6730 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2469888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:38.977 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.557911+0000", 2024-09-12T16:17:38.977 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.391706575000001, 2024-09-12T16:17:38.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045661090000000001, 2024-09-12T16:17:38.977 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:38.978 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:38.978 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:38.978 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:38.978 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:38.978 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:38.978 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6730 2024-09-12T16:17:38.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.978 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:38.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:38.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557911+0000", 2024-09-12T16:17:38.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:38.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557911+0000", 2024-09-12T16:17:38.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:38.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557912+0000", 2024-09-12T16:17:38.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8299999999999997e-07 2024-09-12T16:17:38.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:38.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557914+0000", 2024-09-12T16:17:38.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.531e-06 2024-09-12T16:17:38.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:38.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557927+0000", 2024-09-12T16:17:38.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2685e-05 2024-09-12T16:17:38.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:38.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557932+0000", 2024-09-12T16:17:38.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3020000000000002e-06 2024-09-12T16:17:38.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:38.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603436+0000", 2024-09-12T16:17:38.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045503210000000002 2024-09-12T16:17:38.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:38.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603508+0000", 2024-09-12T16:17:38.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2792000000000004e-05 2024-09-12T16:17:38.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:38.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603572+0000", 2024-09-12T16:17:38.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4086999999999998e-05 2024-09-12T16:17:38.982 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.982 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:38.982 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.982 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6731 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2485248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:38.982 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.557942+0000", 2024-09-12T16:17:38.982 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.391676374999999, 2024-09-12T16:17:38.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045794662, 2024-09-12T16:17:38.982 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:38.982 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:38.983 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:38.983 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:38.983 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:38.983 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:38.983 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6731 2024-09-12T16:17:38.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.983 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:38.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:38.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557942+0000", 2024-09-12T16:17:38.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:38.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557942+0000", 2024-09-12T16:17:38.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:38.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559076+0000", 2024-09-12T16:17:38.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011348280000000001 2024-09-12T16:17:38.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:38.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559081+0000", 2024-09-12T16:17:38.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6820000000000002e-06 2024-09-12T16:17:38.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:38.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559089+0000", 2024-09-12T16:17:38.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0469999999999994e-06 2024-09-12T16:17:38.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:38.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559095+0000", 2024-09-12T16:17:38.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.212e-06 2024-09-12T16:17:38.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:38.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603601+0000", 2024-09-12T16:17:38.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044505321 2024-09-12T16:17:38.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:38.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603675+0000", 2024-09-12T16:17:38.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4455000000000005e-05 2024-09-12T16:17:38.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:38.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603736+0000", 2024-09-12T16:17:38.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1117000000000005e-05 2024-09-12T16:17:38.988 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.988 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:38.988 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.988 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6735 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2547712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:38.988 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.559184+0000", 2024-09-12T16:17:38.988 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.390433527999999, 2024-09-12T16:17:38.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045228008, 2024-09-12T16:17:38.989 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:38.989 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:38.989 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:38.989 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:38.989 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:38.989 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:38.990 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6735 2024-09-12T16:17:38.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.990 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:38.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:38.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559184+0000", 2024-09-12T16:17:38.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:38.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559184+0000", 2024-09-12T16:17:38.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:38.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559185+0000", 2024-09-12T16:17:38.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8100000000000003e-07 2024-09-12T16:17:38.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:38.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559187+0000", 2024-09-12T16:17:38.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9309999999999998e-06 2024-09-12T16:17:38.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:38.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559193+0000", 2024-09-12T16:17:38.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3629999999999999e-06 2024-09-12T16:17:38.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:38.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559200+0000", 2024-09-12T16:17:38.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6950000000000003e-06 2024-09-12T16:17:38.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:38.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604265+0000", 2024-09-12T16:17:38.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045064924999999999 2024-09-12T16:17:38.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:38.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604344+0000", 2024-09-12T16:17:38.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8830000000000002e-05 2024-09-12T16:17:38.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:38.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604412+0000", 2024-09-12T16:17:38.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8683000000000006e-05 2024-09-12T16:17:38.993 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.993 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:38.993 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.994 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6736 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2564096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:38.994 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.559207+0000", 2024-09-12T16:17:38.994 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.390410565, 2024-09-12T16:17:38.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045365924000000002, 2024-09-12T16:17:38.994 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:38.994 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:38.994 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:38.994 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:38.994 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:38.994 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:38.994 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6736 2024-09-12T16:17:38.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.994 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:38.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:38.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559207+0000", 2024-09-12T16:17:38.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:38.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559207+0000", 2024-09-12T16:17:38.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:38.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:38.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559208+0000", 2024-09-12T16:17:38.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6800000000000001e-07 2024-09-12T16:17:38.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:38.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559210+0000", 2024-09-12T16:17:38.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0490000000000002e-06 2024-09-12T16:17:38.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:38.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559218+0000", 2024-09-12T16:17:38.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7510000000000008e-06 2024-09-12T16:17:38.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:38.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559223+0000", 2024-09-12T16:17:38.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1229999999999999e-06 2024-09-12T16:17:38.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:38.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604440+0000", 2024-09-12T16:17:38.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045217599999999997 2024-09-12T16:17:38.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:38.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604512+0000", 2024-09-12T16:17:38.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1909000000000006e-05 2024-09-12T16:17:38.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:38.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604573+0000", 2024-09-12T16:17:38.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1023999999999997e-05 2024-09-12T16:17:38.998 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.998 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:38.998 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:38.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.998 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6737 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2579456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:38.998 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.559229+0000", 2024-09-12T16:17:38.998 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.390388438999999, 2024-09-12T16:17:38.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045505640999999999, 2024-09-12T16:17:38.999 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:38.999 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:38.999 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:38.999 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:38.999 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:38.999 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:38.999 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6737 2024-09-12T16:17:38.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:38.999 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:38.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:38.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:38.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559229+0000", 2024-09-12T16:17:38.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:39.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:39.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559229+0000", 2024-09-12T16:17:39.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:39.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:39.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559230+0000", 2024-09-12T16:17:39.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1399999999999997e-07 2024-09-12T16:17:39.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:39.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559232+0000", 2024-09-12T16:17:39.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8360000000000001e-06 2024-09-12T16:17:39.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:39.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559238+0000", 2024-09-12T16:17:39.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2360000000000001e-06 2024-09-12T16:17:39.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:39.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559242+0000", 2024-09-12T16:17:39.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4390000000000002e-06 2024-09-12T16:17:39.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:39.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604599+0000", 2024-09-12T16:17:39.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045356527000000001 2024-09-12T16:17:39.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:39.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604669+0000", 2024-09-12T16:17:39.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0442000000000001e-05 2024-09-12T16:17:39.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:39.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604735+0000", 2024-09-12T16:17:39.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5647000000000004e-05 2024-09-12T16:17:39.004 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.004 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.004 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.004 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6738 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2594816~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:39.004 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.559250+0000", 2024-09-12T16:17:39.004 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.390367575999999, 2024-09-12T16:17:39.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045646834999999997, 2024-09-12T16:17:39.004 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:39.004 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:39.004 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:39.004 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:39.005 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:39.005 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:39.005 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6738 2024-09-12T16:17:39.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.005 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:39.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:39.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559250+0000", 2024-09-12T16:17:39.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:39.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:39.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559250+0000", 2024-09-12T16:17:39.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:39.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:39.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559251+0000", 2024-09-12T16:17:39.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1699999999999999e-07 2024-09-12T16:17:39.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:39.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559253+0000", 2024-09-12T16:17:39.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2910000000000002e-06 2024-09-12T16:17:39.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:39.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559260+0000", 2024-09-12T16:17:39.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2200000000000003e-06 2024-09-12T16:17:39.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:39.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559265+0000", 2024-09-12T16:17:39.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2050000000000001e-06 2024-09-12T16:17:39.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:39.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604763+0000", 2024-09-12T16:17:39.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045497964000000002 2024-09-12T16:17:39.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:39.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604835+0000", 2024-09-12T16:17:39.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1705000000000005e-05 2024-09-12T16:17:39.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:39.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604897+0000", 2024-09-12T16:17:39.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2032999999999994e-05 2024-09-12T16:17:39.008 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.009 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.009 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.009 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6739 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2610176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:39.009 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.559273+0000", 2024-09-12T16:17:39.009 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.390344758000001, 2024-09-12T16:17:39.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.04579105, 2024-09-12T16:17:39.009 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:39.009 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:39.009 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:39.009 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:39.009 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:39.010 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:39.010 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6739 2024-09-12T16:17:39.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.010 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:39.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:39.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559273+0000", 2024-09-12T16:17:39.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:39.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:39.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559273+0000", 2024-09-12T16:17:39.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:39.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:39.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559273+0000", 2024-09-12T16:17:39.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3299999999999998e-07 2024-09-12T16:17:39.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:39.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559276+0000", 2024-09-12T16:17:39.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1490000000000001e-06 2024-09-12T16:17:39.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:39.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559282+0000", 2024-09-12T16:17:39.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3199999999999996e-06 2024-09-12T16:17:39.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:39.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559288+0000", 2024-09-12T16:17:39.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.942e-06 2024-09-12T16:17:39.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:39.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604929+0000", 2024-09-12T16:17:39.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045641317000000001 2024-09-12T16:17:39.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:39.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.605001+0000", 2024-09-12T16:17:39.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1581000000000005e-05 2024-09-12T16:17:39.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:39.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.605064+0000", 2024-09-12T16:17:39.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3408e-05 2024-09-12T16:17:39.015 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.015 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.015 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.015 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6977 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2377728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:39.015 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.566114+0000", 2024-09-12T16:17:39.015 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.383503649000001, 2024-09-12T16:17:39.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045737673999999999, 2024-09-12T16:17:39.015 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:39.015 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:39.015 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:39.015 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:39.016 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:39.016 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:39.016 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6977 2024-09-12T16:17:39.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.016 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:39.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.016 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:39.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566114+0000", 2024-09-12T16:17:39.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:39.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:39.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566114+0000", 2024-09-12T16:17:39.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:39.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:39.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566115+0000", 2024-09-12T16:17:39.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.71e-07 2024-09-12T16:17:39.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:39.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566119+0000", 2024-09-12T16:17:39.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2749999999999997e-06 2024-09-12T16:17:39.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:39.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566128+0000", 2024-09-12T16:17:39.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9490000000000002e-06 2024-09-12T16:17:39.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:39.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566135+0000", 2024-09-12T16:17:39.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3459999999999999e-06 2024-09-12T16:17:39.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:39.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.610416+0000", 2024-09-12T16:17:39.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044281686000000001 2024-09-12T16:17:39.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:39.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.610536+0000", 2024-09-12T16:17:39.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000119412 2024-09-12T16:17:39.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:39.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.611852+0000", 2024-09-12T16:17:39.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001316135 2024-09-12T16:17:39.019 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.019 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.019 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.020 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6986 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2518016~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:39.020 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.566890+0000", 2024-09-12T16:17:39.020 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.382727725999999, 2024-09-12T16:17:39.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045234719999999999, 2024-09-12T16:17:39.020 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:39.020 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:39.020 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:39.020 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:39.020 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:39.020 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:39.020 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6986 2024-09-12T16:17:39.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.021 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:39.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:39.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566890+0000", 2024-09-12T16:17:39.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:39.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:39.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566890+0000", 2024-09-12T16:17:39.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:39.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:39.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566891+0000", 2024-09-12T16:17:39.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2799999999999995e-07 2024-09-12T16:17:39.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:39.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566895+0000", 2024-09-12T16:17:39.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8179999999999997e-06 2024-09-12T16:17:39.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:39.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566904+0000", 2024-09-12T16:17:39.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5179999999999993e-06 2024-09-12T16:17:39.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:39.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566911+0000", 2024-09-12T16:17:39.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1640000000000004e-06 2024-09-12T16:17:39.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:39.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.611985+0000", 2024-09-12T16:17:39.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045073545999999999 2024-09-12T16:17:39.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:39.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612061+0000", 2024-09-12T16:17:39.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5617999999999993e-05 2024-09-12T16:17:39.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:39.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612125+0000", 2024-09-12T16:17:39.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4327999999999998e-05 2024-09-12T16:17:39.024 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.024 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.024 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.024 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6987 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2533376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:39.024 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.566982+0000", 2024-09-12T16:17:39.024 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.382635705999999, 2024-09-12T16:17:39.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045308858, 2024-09-12T16:17:39.025 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:39.025 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:39.025 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:39.025 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:39.025 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:39.025 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:39.025 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6987 2024-09-12T16:17:39.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.025 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:39.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:39.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566982+0000", 2024-09-12T16:17:39.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:39.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:39.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566982+0000", 2024-09-12T16:17:39.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:39.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:39.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566983+0000", 2024-09-12T16:17:39.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2500000000000005e-07 2024-09-12T16:17:39.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:39.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566986+0000", 2024-09-12T16:17:39.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3000000000000002e-06 2024-09-12T16:17:39.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:39.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566995+0000", 2024-09-12T16:17:39.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8419999999999994e-06 2024-09-12T16:17:39.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:39.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567001+0000", 2024-09-12T16:17:39.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.161e-06 2024-09-12T16:17:39.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:39.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612154+0000", 2024-09-12T16:17:39.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045152858999999997 2024-09-12T16:17:39.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:39.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612229+0000", 2024-09-12T16:17:39.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4958999999999998e-05 2024-09-12T16:17:39.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:39.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612291+0000", 2024-09-12T16:17:39.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2012000000000002e-05 2024-09-12T16:17:39.029 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.029 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.029 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.029 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6988 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2548736~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:39.029 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.567055+0000", 2024-09-12T16:17:39.029 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.38256324, 2024-09-12T16:17:39.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045400078000000003, 2024-09-12T16:17:39.029 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:39.029 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:39.029 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:39.030 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:39.030 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:39.030 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:39.030 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6988 2024-09-12T16:17:39.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.030 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:39.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:39.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567055+0000", 2024-09-12T16:17:39.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:39.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:39.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567055+0000", 2024-09-12T16:17:39.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:39.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:39.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567055+0000", 2024-09-12T16:17:39.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3e-07 2024-09-12T16:17:39.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:39.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567059+0000", 2024-09-12T16:17:39.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4510000000000001e-06 2024-09-12T16:17:39.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:39.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567070+0000", 2024-09-12T16:17:39.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1477e-05 2024-09-12T16:17:39.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:39.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567077+0000", 2024-09-12T16:17:39.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7880000000000001e-06 2024-09-12T16:17:39.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:39.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612320+0000", 2024-09-12T16:17:39.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045242544000000003 2024-09-12T16:17:39.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:39.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612394+0000", 2024-09-12T16:17:39.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3854000000000001e-05 2024-09-12T16:17:39.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:39.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612455+0000", 2024-09-12T16:17:39.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1234000000000004e-05 2024-09-12T16:17:39.033 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.033 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.033 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.034 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6989 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2565120~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:39.034 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.567103+0000", 2024-09-12T16:17:39.034 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.382514434000001, 2024-09-12T16:17:39.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045514760000000001, 2024-09-12T16:17:39.034 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:39.034 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:39.034 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:39.034 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:39.034 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:39.034 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:39.034 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6989 2024-09-12T16:17:39.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.034 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:39.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.035 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:39.035 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567103+0000", 2024-09-12T16:17:39.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:39.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.035 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:39.035 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567103+0000", 2024-09-12T16:17:39.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:39.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.035 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:39.035 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567104+0000", 2024-09-12T16:17:39.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6400000000000002e-07 2024-09-12T16:17:39.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:39.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567107+0000", 2024-09-12T16:17:39.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.038e-06 2024-09-12T16:17:39.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:39.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567117+0000", 2024-09-12T16:17:39.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0244999999999999e-05 2024-09-12T16:17:39.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:39.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567124+0000", 2024-09-12T16:17:39.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1469999999999998e-06 2024-09-12T16:17:39.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:39.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612483+0000", 2024-09-12T16:17:39.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045359099999999999 2024-09-12T16:17:39.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:39.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612556+0000", 2024-09-12T16:17:39.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2948999999999996e-05 2024-09-12T16:17:39.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:39.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612618+0000", 2024-09-12T16:17:39.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2617e-05 2024-09-12T16:17:39.038 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.038 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.038 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.038 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6990 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2580480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:39.039 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.567155+0000", 2024-09-12T16:17:39.039 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.382463197, 2024-09-12T16:17:39.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045665681999999999, 2024-09-12T16:17:39.039 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:39.039 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:39.039 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:39.039 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:39.039 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:39.040 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:39.040 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6990 2024-09-12T16:17:39.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.040 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:39.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:39.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567155+0000", 2024-09-12T16:17:39.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:39.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:39.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567155+0000", 2024-09-12T16:17:39.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:39.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:39.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567155+0000", 2024-09-12T16:17:39.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5700000000000002e-07 2024-09-12T16:17:39.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:39.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567159+0000", 2024-09-12T16:17:39.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1729999999999999e-06 2024-09-12T16:17:39.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:39.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567167+0000", 2024-09-12T16:17:39.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3469999999999999e-06 2024-09-12T16:17:39.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:39.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567173+0000", 2024-09-12T16:17:39.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0719999999999996e-06 2024-09-12T16:17:39.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:39.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612651+0000", 2024-09-12T16:17:39.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045478078999999998 2024-09-12T16:17:39.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:39.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612741+0000", 2024-09-12T16:17:39.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0435999999999999e-05 2024-09-12T16:17:39.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:39.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612820+0000", 2024-09-12T16:17:39.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8918000000000006e-05 2024-09-12T16:17:39.044 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.044 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.044 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.044 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6991 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2595840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:39.044 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.567220+0000", 2024-09-12T16:17:39.044 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.382398189, 2024-09-12T16:17:39.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045811022999999999, 2024-09-12T16:17:39.044 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:39.045 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:39.045 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:39.045 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:39.045 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:39.045 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:39.045 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6991 2024-09-12T16:17:39.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.045 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:39.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:39.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567220+0000", 2024-09-12T16:17:39.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:39.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:39.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567220+0000", 2024-09-12T16:17:39.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:39.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:39.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567221+0000", 2024-09-12T16:17:39.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.16e-07 2024-09-12T16:17:39.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:39.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567225+0000", 2024-09-12T16:17:39.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3950000000000003e-06 2024-09-12T16:17:39.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:39.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567243+0000", 2024-09-12T16:17:39.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7734999999999999e-05 2024-09-12T16:17:39.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:39.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567253+0000", 2024-09-12T16:17:39.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7540000000000001e-06 2024-09-12T16:17:39.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:39.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612854+0000", 2024-09-12T16:17:39.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045601227000000001 2024-09-12T16:17:39.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:39.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612950+0000", 2024-09-12T16:17:39.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6121999999999999e-05 2024-09-12T16:17:39.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:39.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.613031+0000", 2024-09-12T16:17:39.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0873999999999999e-05 2024-09-12T16:17:39.048 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.048 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.048 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.049 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6992 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2611200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:39.049 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.567349+0000", 2024-09-12T16:17:39.049 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.382268433, 2024-09-12T16:17:39.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045848710000000001, 2024-09-12T16:17:39.049 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:39.049 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:39.049 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:39.049 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:39.049 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:39.049 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:39.050 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6992 2024-09-12T16:17:39.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.050 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:39.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:39.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567349+0000", 2024-09-12T16:17:39.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:39.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:39.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567349+0000", 2024-09-12T16:17:39.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:39.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:39.051 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567350+0000", 2024-09-12T16:17:39.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8899999999999998e-07 2024-09-12T16:17:39.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:39.051 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567354+0000", 2024-09-12T16:17:39.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0130000000000004e-06 2024-09-12T16:17:39.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:39.051 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567364+0000", 2024-09-12T16:17:39.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0158e-05 2024-09-12T16:17:39.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:39.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567369+0000", 2024-09-12T16:17:39.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4839999999999998e-06 2024-09-12T16:17:39.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:39.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.613072+0000", 2024-09-12T16:17:39.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045703195000000002 2024-09-12T16:17:39.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:39.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.613156+0000", 2024-09-12T16:17:39.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3591999999999995e-05 2024-09-12T16:17:39.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:39.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.613198+0000", 2024-09-12T16:17:39.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2478999999999998e-05 2024-09-12T16:17:39.053 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.053 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.053 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.053 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.053 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.053 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:39.055 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:17:39.056 INFO:teuthology.orchestra.run.smithi204.stdout:4880 read 0x10baa00 thru 0x10c6f19 (0xc51a bytes) 2024-09-12T16:17:39.056 INFO:teuthology.orchestra.run.smithi204.stdout:4882 write 0xa592600 thru 0xa5970bc (0x4abd bytes) 2024-09-12T16:17:39.056 INFO:teuthology.orchestra.run.smithi204.stdout:4885 write 0x908b200 thru 0x9096304 (0xb105 bytes) 2024-09-12T16:17:39.056 INFO:teuthology.orchestra.run.smithi204.stdout:4886 read 0x321d800 thru 0x322ccb3 (0xf4b4 bytes) 2024-09-12T16:17:39.056 INFO:teuthology.orchestra.run.smithi204.stdout:4887 punch from 0x1405000 to 0x140dc00, (0x8c00 bytes) 2024-09-12T16:17:39.056 INFO:teuthology.orchestra.run.smithi204.stdout:4888 write 0x4845800 thru 0x48483cd (0x2bce bytes) 2024-09-12T16:17:39.056 INFO:teuthology.orchestra.run.smithi204.stdout:4895 trunc from 0xa597200 to 0x292dc00 2024-09-12T16:17:39.056 INFO:teuthology.orchestra.run.smithi204.stdout:4898 write 0x805e00 thru 0x8157d8 (0xf9d9 bytes) 2024-09-12T16:17:39.056 INFO:teuthology.orchestra.run.smithi204.stdout:4901 punch from 0x857200 to 0x85b200, (0x4000 bytes) 2024-09-12T16:17:39.057 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:39.053+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:39.072 INFO:teuthology.orchestra.run.smithi204.stdout:4902 write 0x86cee00 thru 0x86d32f2 (0x44f3 bytes) 2024-09-12T16:17:39.073 INFO:teuthology.orchestra.run.smithi204.stdout:4904 read 0x1e81a00 thru 0x1e87adb (0x60dc bytes) 2024-09-12T16:17:39.073 INFO:teuthology.orchestra.run.smithi204.stdout:4905 read 0x379c600 thru 0x37a5f7d (0x997e bytes) 2024-09-12T16:17:39.073 INFO:teuthology.orchestra.run.smithi204.stdout:4907 read 0x5519400 thru 0x5528dc2 (0xf9c3 bytes) 2024-09-12T16:17:39.073 INFO:teuthology.orchestra.run.smithi204.stdout:4908 read 0x6af6600 thru 0x6afaa02 (0x4403 bytes) 2024-09-12T16:17:39.073 INFO:teuthology.orchestra.run.smithi204.stdout:4913 read 0x7867e00 thru 0x7874e7d (0xd07e bytes) 2024-09-12T16:17:39.078 INFO:teuthology.orchestra.run.smithi204.stdout:4914 trunc from 0x86d3400 to 0x1a29800 2024-09-12T16:17:39.097 INFO:teuthology.orchestra.run.smithi204.stdout:4918 read 0xc1a800 thru 0xc23343 (0x8b44 bytes) 2024-09-12T16:17:39.099 INFO:teuthology.orchestra.run.smithi204.stdout:4920 read 0x6bfe00 thru 0x6c0302 (0x503 bytes) 2024-09-12T16:17:39.112 INFO:teuthology.orchestra.run.smithi204.stdout:4921 write 0x3917800 thru 0x3918284 (0xa85 bytes) 2024-09-12T16:17:39.114 INFO:teuthology.orchestra.run.smithi204.stdout:4922 trunc from 0x3918400 to 0x49df200 2024-09-12T16:17:39.138 INFO:teuthology.orchestra.run.smithi204.stdout:4923 write 0x5abda00 thru 0x5ac406d (0x666e bytes) 2024-09-12T16:17:39.140 INFO:teuthology.orchestra.run.smithi204.stdout:4924 read 0x5069400 thru 0x5072e9c (0x9a9d bytes) 2024-09-12T16:17:39.140 INFO:teuthology.orchestra.run.smithi204.stdout:truncating to largest ever: 0xee36200 2024-09-12T16:17:39.151 INFO:teuthology.orchestra.run.smithi204.stdout:4929 trunc from 0x5ac4200 to 0xee36200 2024-09-12T16:17:39.155 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:39.154+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:39.166 INFO:teuthology.orchestra.run.smithi204.stdout:4934 read 0x18400 thru 0x185f1 (0x1f2 bytes) 2024-09-12T16:17:39.171 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:39.171 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:39.171 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:17:39.171 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:39.180 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:17:39.181 INFO:teuthology.orchestra.run.smithi204.stdout:4935 trunc from 0xee36200 to 0x3a43c00 2024-09-12T16:17:39.197 INFO:teuthology.orchestra.run.smithi204.stdout:4936 read 0x2a6e800 thru 0x2a7a93c (0xc13d bytes) 2024-09-12T16:17:39.215 INFO:teuthology.orchestra.run.smithi204.stdout:4937 write 0x3c66000 thru 0x3c6e73c (0x873d bytes) 2024-09-12T16:17:39.244 INFO:teuthology.orchestra.run.smithi204.stdout:4939 write 0xd1e8a00 thru 0xd1f70df (0xe6e0 bytes) 2024-09-12T16:17:39.245 INFO:teuthology.orchestra.run.smithi204.stdout:4941 punch from 0x2b31800 to 0x2b36a00, (0x5200 bytes) 2024-09-12T16:17:39.247 INFO:teuthology.orchestra.run.smithi204.stdout:4944 punch from 0x7789600 to 0x778b800, (0x2200 bytes) 2024-09-12T16:17:39.247 INFO:teuthology.orchestra.run.smithi204.stdout:4945 read 0x99f2a00 thru 0x99ffe6d (0xd46e bytes) 2024-09-12T16:17:39.247 INFO:teuthology.orchestra.run.smithi204.stdout:4946 write 0xa539600 thru 0xa543162 (0x9b63 bytes) 2024-09-12T16:17:39.247 INFO:teuthology.orchestra.run.smithi204.stdout:4948 write 0x93c9a00 thru 0x93d8929 (0xef2a bytes) 2024-09-12T16:17:39.247 INFO:teuthology.orchestra.run.smithi204.stdout:4950 write 0x94d9800 thru 0x94dce21 (0x3622 bytes) 2024-09-12T16:17:39.257 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:39.256+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:39.288 INFO:teuthology.orchestra.run.smithi204.stdout:4951 write 0xd8c7200 thru 0xd8cfaa9 (0x88aa bytes) 2024-09-12T16:17:39.295 INFO:teuthology.orchestra.run.smithi204.stdout:4952 punch from 0xaba1a00 to 0xabaf400, (0xda00 bytes) 2024-09-12T16:17:39.297 INFO:teuthology.orchestra.run.smithi204.stdout:4958 read 0x539c200 thru 0x53ac0a2 (0xfea3 bytes) 2024-09-12T16:17:39.297 INFO:teuthology.orchestra.run.smithi204.stdout:4961 punch from 0x19ee00 to 0x1a2a00, (0x3c00 bytes) 2024-09-12T16:17:39.297 INFO:teuthology.orchestra.run.smithi204.stdout:4963 read 0x2156a00 thru 0x215a211 (0x3812 bytes) 2024-09-12T16:17:39.297 INFO:teuthology.orchestra.run.smithi204.stdout:4964 read 0xcb54600 thru 0xcb5e418 (0x9e19 bytes) 2024-09-12T16:17:39.308 INFO:teuthology.orchestra.run.smithi204.stdout:4965 read 0x46e800 thru 0x472908 (0x4109 bytes) 2024-09-12T16:17:39.309 INFO:teuthology.orchestra.run.smithi204.stdout:4966 read 0x3c8e00 thru 0x3d184d (0x8a4e bytes) 2024-09-12T16:17:39.310 INFO:teuthology.orchestra.run.smithi204.stdout:4968 read 0x2475c00 thru 0x2476f2e (0x132f bytes) 2024-09-12T16:17:39.317 INFO:teuthology.orchestra.run.smithi204.stdout:4972 trunc from 0xd8cfc00 to 0x71d3400 2024-09-12T16:17:39.349 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:39.350 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:39.350 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:17:39.350 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:17:39.350 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:39.357 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:39.356+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:39.359 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:17:39.374 INFO:teuthology.orchestra.run.smithi204.stdout:4973 write 0xce6a600 thru 0xce6b554 (0xf55 bytes) 2024-09-12T16:17:39.380 INFO:teuthology.orchestra.run.smithi204.stdout:4977 read 0xc76e400 thru 0xc76ff20 (0x1b21 bytes) 2024-09-12T16:17:39.382 INFO:teuthology.orchestra.run.smithi204.stdout:4979 trunc from 0xce6b600 to 0xaa06800 2024-09-12T16:17:39.398 INFO:teuthology.orchestra.run.smithi204.stdout:4981 write 0x169e200 thru 0x169f8f0 (0x16f1 bytes) 2024-09-12T16:17:39.404 INFO:teuthology.orchestra.run.smithi204.stdout:4985 punch from 0x9586a00 to 0x9595a00, (0xf000 bytes) 2024-09-12T16:17:39.406 INFO:teuthology.orchestra.run.smithi204.stdout:4986 read 0x44d3c00 thru 0x44dd7c1 (0x9bc2 bytes) 2024-09-12T16:17:39.406 INFO:teuthology.orchestra.run.smithi204.stdout:4989 punch from 0x7045c00 to 0x704c400, (0x6800 bytes) 2024-09-12T16:17:39.406 INFO:teuthology.orchestra.run.smithi204.stdout:4990 read 0x765ba00 thru 0x76662d8 (0xa8d9 bytes) 2024-09-12T16:17:39.416 INFO:teuthology.orchestra.run.smithi204.stdout:4991 trunc from 0xaa06800 to 0x190f800 2024-09-12T16:17:39.428 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-12T16:17:39.428 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T16:17:39.428 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-12T16:17:39.428 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T16:17:39.458 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:39.457+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:39.458 INFO:teuthology.orchestra.run.smithi204.stdout:4992 write 0x319ae00 thru 0x319e126 (0x3327 bytes) 2024-09-12T16:17:39.460 INFO:teuthology.orchestra.run.smithi204.stdout:4993 read 0x1744400 thru 0x174cc5e (0x885f bytes) 2024-09-12T16:17:39.460 INFO:teuthology.orchestra.run.smithi204.stdout:4994 trunc from 0x319e200 to 0x3c09200 2024-09-12T16:17:39.480 INFO:teuthology.orchestra.run.smithi204.stdout:4997 read 0x3614200 thru 0x361d934 (0x9735 bytes) 2024-09-12T16:17:39.480 INFO:teuthology.orchestra.run.smithi204.stdout:4999 punch from 0xb30600 to 0xb3d800, (0xd200 bytes) 2024-09-12T16:17:39.481 INFO:teuthology.orchestra.run.smithi204.stdout:5002 read 0x8d6000 thru 0x8df60a (0x960b bytes) 2024-09-12T16:17:39.500 INFO:teuthology.orchestra.run.smithi204.stdout:5003 write 0x814b800 thru 0x8154124 (0x8925 bytes) 2024-09-12T16:17:39.500 INFO:teuthology.orchestra.run.smithi204.stdout:5004 read 0xbbf000 thru 0xbc6052 (0x7053 bytes) 2024-09-12T16:17:39.501 INFO:teuthology.orchestra.run.smithi204.stdout:5005 read 0x3959200 thru 0x39661f0 (0xcff1 bytes) 2024-09-12T16:17:39.501 INFO:teuthology.orchestra.run.smithi204.stdout:5006 punch from 0x6481400 to 0x6486e00, (0x5a00 bytes) 2024-09-12T16:17:39.502 INFO:teuthology.orchestra.run.smithi204.stdout:5008 read 0x53f800 thru 0x546cec (0x74ed bytes) 2024-09-12T16:17:39.502 INFO:teuthology.orchestra.run.smithi204.stdout:5013 read 0x5277800 thru 0x528291a (0xb11b bytes) 2024-09-12T16:17:39.523 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:39.524 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:17:39.524 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:17:39.524 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:17:39.524 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.524 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:17:39.524 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:17:39.524 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 117.75767639199999, 2024-09-12T16:17:39.525 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55645454900000002, 2024-09-12T16:17:39.525 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:39.525 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:39.525 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:39.525 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:39.525 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:17:39.525 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:17:39.525 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1 2024-09-12T16:17:39.525 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.525 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:39.525 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.525 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:39.525 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:17:39.525 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.526 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.526 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.526 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:39.526 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:17:39.526 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.526 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.526 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.526 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:39.526 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764440+0000", 2024-09-12T16:17:39.526 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6249999999999999e-06 2024-09-12T16:17:39.526 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.526 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.526 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:39.526 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764447+0000", 2024-09-12T16:17:39.526 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4939999999999997e-06 2024-09-12T16:17:39.527 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.527 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.527 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:39.527 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764459+0000", 2024-09-12T16:17:39.527 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1517e-05 2024-09-12T16:17:39.527 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.527 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.527 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:39.527 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764468+0000", 2024-09-12T16:17:39.527 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7690000000000002e-06 2024-09-12T16:17:39.527 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.528 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.528 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:39.528 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764539+0000", 2024-09-12T16:17:39.528 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1103e-05 2024-09-12T16:17:39.528 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.528 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.528 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:17:39.528 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764551+0000", 2024-09-12T16:17:39.528 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2687999999999999e-05 2024-09-12T16:17:39.528 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.528 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.528 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:39.529 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319497+0000", 2024-09-12T16:17:39.529 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55494560500000001 2024-09-12T16:17:39.529 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.529 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.529 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:39.529 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319688+0000", 2024-09-12T16:17:39.529 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019105599999999999 2024-09-12T16:17:39.529 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.529 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.529 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:17:39.529 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319842+0000", 2024-09-12T16:17:39.529 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015377699999999999 2024-09-12T16:17:39.529 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.529 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.529 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:17:39.530 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320473+0000", 2024-09-12T16:17:39.530 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00063117100000000003 2024-09-12T16:17:39.530 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.530 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.530 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:39.530 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320825+0000", 2024-09-12T16:17:39.530 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00035202500000000001 2024-09-12T16:17:39.530 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.530 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.530 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:39.530 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320867+0000", 2024-09-12T16:17:39.530 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2005000000000002e-05 2024-09-12T16:17:39.530 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.530 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.530 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:39.531 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320893+0000", 2024-09-12T16:17:39.531 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5714000000000001e-05 2024-09-12T16:17:39.531 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.531 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:39.531 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.531 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.532 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.532 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14034 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5035008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:39.532 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:17:39.532 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 80.000618158999998, 2024-09-12T16:17:39.532 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053404082999999998, 2024-09-12T16:17:39.533 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:39.533 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:39.533 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:39.533 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:39.533 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:39.533 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:39.533 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14034 2024-09-12T16:17:39.533 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.533 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:39.533 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.534 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:39.534 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:17:39.534 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.534 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.534 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.534 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:39.534 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:17:39.534 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.534 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.534 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.535 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:39.535 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521740+0000", 2024-09-12T16:17:39.535 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000243976 2024-09-12T16:17:39.535 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.535 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.535 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:39.535 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521745+0000", 2024-09-12T16:17:39.535 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1280000000000001e-06 2024-09-12T16:17:39.535 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.535 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.535 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:39.535 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521757+0000", 2024-09-12T16:17:39.535 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2751e-05 2024-09-12T16:17:39.535 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.536 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.536 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:39.536 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521771+0000", 2024-09-12T16:17:39.536 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3328e-05 2024-09-12T16:17:39.536 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.536 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.536 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:39.536 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574710+0000", 2024-09-12T16:17:39.536 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052939358999999998 2024-09-12T16:17:39.536 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.536 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.536 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:39.537 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574799+0000", 2024-09-12T16:17:39.537 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8893000000000004e-05 2024-09-12T16:17:39.537 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.537 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.537 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:39.537 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574901+0000", 2024-09-12T16:17:39.537 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101648 2024-09-12T16:17:39.537 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.537 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:39.537 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.537 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.537 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.537 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14036 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5043200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:39.537 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:17:39.538 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 80.000158964999997, 2024-09-12T16:17:39.538 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053426247000000003, 2024-09-12T16:17:39.538 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:39.538 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:39.538 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:39.538 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:39.538 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:39.538 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:39.538 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14036 2024-09-12T16:17:39.538 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.538 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:39.538 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.538 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:39.538 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:17:39.539 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.539 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.539 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.539 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:39.539 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:17:39.539 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.539 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.539 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.539 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:39.539 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522208+0000", 2024-09-12T16:17:39.539 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025195300000000002 2024-09-12T16:17:39.539 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.540 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.540 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:39.540 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522211+0000", 2024-09-12T16:17:39.540 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2160000000000002e-06 2024-09-12T16:17:39.540 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.540 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.540 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:39.540 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522223+0000", 2024-09-12T16:17:39.540 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2044e-05 2024-09-12T16:17:39.541 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.541 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.541 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:39.541 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522229+0000", 2024-09-12T16:17:39.541 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8850000000000004e-06 2024-09-12T16:17:39.541 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.541 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.542 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:39.542 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575192+0000", 2024-09-12T16:17:39.542 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052963573 2024-09-12T16:17:39.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.542 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.542 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:39.542 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575282+0000", 2024-09-12T16:17:39.542 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9666000000000005e-05 2024-09-12T16:17:39.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.542 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.542 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:39.542 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575382+0000", 2024-09-12T16:17:39.542 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9909999999999997e-05 2024-09-12T16:17:39.543 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.543 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:39.543 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.543 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.543 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.543 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14038 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5051392~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:39.543 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:17:39.543 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 79.999620591999999, 2024-09-12T16:17:39.543 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053395152000000001, 2024-09-12T16:17:39.544 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:39.544 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:39.544 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:39.544 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:39.544 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:39.544 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:39.544 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14038 2024-09-12T16:17:39.544 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.544 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:39.544 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.544 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:39.544 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:17:39.544 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.544 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.545 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.545 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:39.545 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:17:39.545 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.545 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.545 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:39.545 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522601+0000", 2024-09-12T16:17:39.545 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010702899999999999 2024-09-12T16:17:39.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.545 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.546 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:39.546 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522605+0000", 2024-09-12T16:17:39.546 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2379999999999999e-06 2024-09-12T16:17:39.546 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.546 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.546 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:39.546 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522616+0000", 2024-09-12T16:17:39.546 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1185999999999999e-05 2024-09-12T16:17:39.546 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.546 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.546 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:39.546 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522624+0000", 2024-09-12T16:17:39.546 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1099999999999997e-06 2024-09-12T16:17:39.547 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.547 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.547 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:39.547 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575677+0000", 2024-09-12T16:17:39.547 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053126999999999 2024-09-12T16:17:39.547 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.547 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.547 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:39.547 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575764+0000", 2024-09-12T16:17:39.547 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7250000000000007e-05 2024-09-12T16:17:39.547 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.547 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.547 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:39.547 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575889+0000", 2024-09-12T16:17:39.547 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012521200000000001 2024-09-12T16:17:39.548 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.548 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:39.548 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.548 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.548 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.548 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14039 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5055488~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:39.548 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:17:39.548 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 79.999479180999998, 2024-09-12T16:17:39.548 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053466207000000002, 2024-09-12T16:17:39.548 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:39.548 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:39.548 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:39.548 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:39.548 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:39.549 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:39.549 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14039 2024-09-12T16:17:39.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.549 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:39.549 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.549 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:39.549 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:17:39.549 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.549 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.549 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:39.549 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:17:39.549 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.550 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:39.550 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522899+0000", 2024-09-12T16:17:39.550 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026318199999999999 2024-09-12T16:17:39.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.550 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:39.550 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522903+0000", 2024-09-12T16:17:39.550 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.929e-06 2024-09-12T16:17:39.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.550 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:39.550 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522913+0000", 2024-09-12T16:17:39.550 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0162e-05 2024-09-12T16:17:39.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.551 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:39.551 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522921+0000", 2024-09-12T16:17:39.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.14e-06 2024-09-12T16:17:39.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.551 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:39.551 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575922+0000", 2024-09-12T16:17:39.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053000712999999998 2024-09-12T16:17:39.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.551 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:39.552 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576006+0000", 2024-09-12T16:17:39.552 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4161999999999998e-05 2024-09-12T16:17:39.552 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.552 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.552 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:39.552 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576102+0000", 2024-09-12T16:17:39.552 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5919000000000001e-05 2024-09-12T16:17:39.552 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.552 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:39.552 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.552 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.552 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.552 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14040 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5059584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:39.552 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:17:39.553 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 79.999174285999999, 2024-09-12T16:17:39.553 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053413258999999998, 2024-09-12T16:17:39.553 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:39.553 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:39.553 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:39.553 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:39.553 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:39.553 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:39.553 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14040 2024-09-12T16:17:39.553 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.553 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:39.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.553 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:39.553 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:17:39.554 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.554 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.554 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:39.554 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:17:39.554 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.554 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.554 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:39.554 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523059+0000", 2024-09-12T16:17:39.554 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118466 2024-09-12T16:17:39.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.554 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.555 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:39.555 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523062+0000", 2024-09-12T16:17:39.555 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.971e-06 2024-09-12T16:17:39.555 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.555 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.555 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:39.555 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523069+0000", 2024-09-12T16:17:39.555 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8279999999999997e-06 2024-09-12T16:17:39.555 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.555 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.555 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:39.555 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523073+0000", 2024-09-12T16:17:39.555 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3019999999999996e-06 2024-09-12T16:17:39.555 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.555 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.556 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:39.556 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576155+0000", 2024-09-12T16:17:39.556 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053081962000000003 2024-09-12T16:17:39.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.556 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.556 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:39.556 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576249+0000", 2024-09-12T16:17:39.556 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3914999999999998e-05 2024-09-12T16:17:39.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.556 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.556 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:39.556 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576354+0000", 2024-09-12T16:17:39.556 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010481500000000001 2024-09-12T16:17:39.556 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.556 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:39.557 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.557 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.557 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14041 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5063680~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:39.557 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:17:39.557 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 79.999023980999993, 2024-09-12T16:17:39.557 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053519111000000001, 2024-09-12T16:17:39.557 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:39.557 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:39.557 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:39.558 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:39.558 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:39.558 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:39.558 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14041 2024-09-12T16:17:39.558 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.558 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:39.558 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.558 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:39.558 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:17:39.558 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.558 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.558 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.558 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:39.558 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:17:39.559 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.559 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.559 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:39.559 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523309+0000", 2024-09-12T16:17:39.559 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000218712 2024-09-12T16:17:39.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.559 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.559 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:39.559 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523313+0000", 2024-09-12T16:17:39.559 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.151e-06 2024-09-12T16:17:39.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.559 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.559 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:39.560 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523320+0000", 2024-09-12T16:17:39.560 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9789999999999993e-06 2024-09-12T16:17:39.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.560 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.560 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:39.560 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523325+0000", 2024-09-12T16:17:39.560 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:17:39.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.560 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.560 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:39.560 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576402+0000", 2024-09-12T16:17:39.560 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053076811000000002 2024-09-12T16:17:39.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.560 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.560 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:39.561 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576491+0000", 2024-09-12T16:17:39.561 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8578999999999993e-05 2024-09-12T16:17:39.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.561 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:39.561 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576610+0000", 2024-09-12T16:17:39.561 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119129 2024-09-12T16:17:39.561 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.561 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:39.561 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.561 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14042 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5067776~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:39.561 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:17:39.562 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 79.998780546999996, 2024-09-12T16:17:39.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053510350999999998, 2024-09-12T16:17:39.562 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:39.562 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:39.562 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:39.562 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:39.562 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:39.562 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:39.562 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14042 2024-09-12T16:17:39.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.562 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:39.562 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.563 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:39.563 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:17:39.563 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.563 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.563 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:39.563 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:17:39.563 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.563 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.563 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:39.563 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523591+0000", 2024-09-12T16:17:39.563 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025710300000000001 2024-09-12T16:17:39.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.564 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.564 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:39.564 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523594+0000", 2024-09-12T16:17:39.564 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2229999999999999e-06 2024-09-12T16:17:39.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.564 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.564 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:39.564 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523602+0000", 2024-09-12T16:17:39.564 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6930000000000007e-06 2024-09-12T16:17:39.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.564 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.564 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:39.565 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523607+0000", 2024-09-12T16:17:39.565 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4789999999999998e-06 2024-09-12T16:17:39.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.565 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.565 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:39.565 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576661+0000", 2024-09-12T16:17:39.565 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053973999999997 2024-09-12T16:17:39.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.565 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.565 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:39.565 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576745+0000", 2024-09-12T16:17:39.565 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4660000000000006e-05 2024-09-12T16:17:39.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.565 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.566 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:39.566 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576844+0000", 2024-09-12T16:17:39.566 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9219e-05 2024-09-12T16:17:39.566 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.566 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:39.566 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.566 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14043 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5071872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:39.566 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:17:39.566 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 79.998500067999998, 2024-09-12T16:17:39.566 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053475295999999999, 2024-09-12T16:17:39.566 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:39.566 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:39.567 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:39.567 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:39.567 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:39.567 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:39.567 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14043 2024-09-12T16:17:39.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.567 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:39.567 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.567 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:39.567 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:17:39.568 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.568 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.568 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:39.568 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:17:39.568 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.568 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.568 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:39.568 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523823+0000", 2024-09-12T16:17:39.568 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020818900000000001 2024-09-12T16:17:39.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.568 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:39.569 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523826+0000", 2024-09-12T16:17:39.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.405e-06 2024-09-12T16:17:39.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.569 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:39.569 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523834+0000", 2024-09-12T16:17:39.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5499999999999997e-06 2024-09-12T16:17:39.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.569 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:39.569 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523838+0000", 2024-09-12T16:17:39.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.408e-06 2024-09-12T16:17:39.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.570 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:39.570 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576904+0000", 2024-09-12T16:17:39.570 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053065687 2024-09-12T16:17:39.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.570 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:39.570 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576991+0000", 2024-09-12T16:17:39.570 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7399999999999997e-05 2024-09-12T16:17:39.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.570 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:39.570 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577090+0000", 2024-09-12T16:17:39.571 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8657000000000001e-05 2024-09-12T16:17:39.571 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.571 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:39.571 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.571 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.571 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14044 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5075968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:39.571 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:17:39.571 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 79.998268538000005, 2024-09-12T16:17:39.571 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053442659000000003, 2024-09-12T16:17:39.571 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:39.571 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:39.571 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:39.572 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:39.572 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:39.572 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:39.572 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14044 2024-09-12T16:17:39.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.572 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:39.572 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.572 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:39.572 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:17:39.572 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.572 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.572 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:39.572 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:17:39.572 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.573 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:39.573 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523985+0000", 2024-09-12T16:17:39.573 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000138522 2024-09-12T16:17:39.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.573 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:39.573 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523988+0000", 2024-09-12T16:17:39.573 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.788e-06 2024-09-12T16:17:39.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.573 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:39.574 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523998+0000", 2024-09-12T16:17:39.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8470000000000008e-06 2024-09-12T16:17:39.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:39.574 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524010+0000", 2024-09-12T16:17:39.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1348999999999999e-05 2024-09-12T16:17:39.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:39.574 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577137+0000", 2024-09-12T16:17:39.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053127055999999999 2024-09-12T16:17:39.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:39.575 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577210+0000", 2024-09-12T16:17:39.575 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3392000000000005e-05 2024-09-12T16:17:39.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.575 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.575 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:39.575 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577289+0000", 2024-09-12T16:17:39.575 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8704999999999999e-05 2024-09-12T16:17:39.575 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.575 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:39.575 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.575 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.575 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14045 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5080064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:39.575 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:17:39.576 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 79.998089716999999, 2024-09-12T16:17:39.576 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053497514000000003, 2024-09-12T16:17:39.576 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:39.576 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:39.576 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:39.576 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:39.576 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:39.576 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:39.576 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14045 2024-09-12T16:17:39.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.576 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:39.576 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.576 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:39.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:17:39.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.577 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:39.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:17:39.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.577 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:39.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524311+0000", 2024-09-12T16:17:39.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028626299999999998 2024-09-12T16:17:39.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.578 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:39.578 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524315+0000", 2024-09-12T16:17:39.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0969999999999999e-06 2024-09-12T16:17:39.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.578 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:39.578 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524325+0000", 2024-09-12T16:17:39.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6330000000000008e-06 2024-09-12T16:17:39.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.578 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:39.578 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524332+0000", 2024-09-12T16:17:39.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8700000000000003e-06 2024-09-12T16:17:39.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:39.579 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577334+0000", 2024-09-12T16:17:39.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053001834999999997 2024-09-12T16:17:39.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:39.579 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577420+0000", 2024-09-12T16:17:39.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6145999999999998e-05 2024-09-12T16:17:39.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:39.579 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577522+0000", 2024-09-12T16:17:39.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010267 2024-09-12T16:17:39.580 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.580 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:39.580 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.580 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.580 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14047 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5088256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:39.580 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:17:39.580 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 79.997603991000005, 2024-09-12T16:17:39.580 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053433340000000003, 2024-09-12T16:17:39.580 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:39.580 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:39.580 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:39.580 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:39.580 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:39.581 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:39.581 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14047 2024-09-12T16:17:39.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.581 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:39.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:39.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:17:39.581 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:39.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:17:39.581 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:39.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524727+0000", 2024-09-12T16:17:39.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000216126 2024-09-12T16:17:39.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:39.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524732+0000", 2024-09-12T16:17:39.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1569999999999999e-06 2024-09-12T16:17:39.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:39.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524742+0000", 2024-09-12T16:17:39.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0186999999999999e-05 2024-09-12T16:17:39.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:39.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524750+0000", 2024-09-12T16:17:39.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4279999999999999e-06 2024-09-12T16:17:39.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:39.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577743+0000", 2024-09-12T16:17:39.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052993077 2024-09-12T16:17:39.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:39.584 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577841+0000", 2024-09-12T16:17:39.584 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8369000000000006e-05 2024-09-12T16:17:39.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.584 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.584 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:39.584 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577944+0000", 2024-09-12T16:17:39.584 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102996 2024-09-12T16:17:39.584 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.584 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:39.584 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.584 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.584 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14048 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5092352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:39.584 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:17:39.585 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 79.997352398000004, 2024-09-12T16:17:39.585 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053397515, 2024-09-12T16:17:39.585 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:39.585 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:39.585 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:39.585 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:39.585 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:39.585 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:39.585 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14048 2024-09-12T16:17:39.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.585 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:39.585 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.585 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:39.585 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:17:39.585 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:39.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:17:39.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:39.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524957+0000", 2024-09-12T16:17:39.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019516999999999999 2024-09-12T16:17:39.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:39.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524962+0000", 2024-09-12T16:17:39.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7709999999999997e-06 2024-09-12T16:17:39.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:39.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524973+0000", 2024-09-12T16:17:39.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1031e-05 2024-09-12T16:17:39.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:39.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524980+0000", 2024-09-12T16:17:39.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6100000000000002e-06 2024-09-12T16:17:39.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:39.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577977+0000", 2024-09-12T16:17:39.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052997481999999999 2024-09-12T16:17:39.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.588 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:39.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578062+0000", 2024-09-12T16:17:39.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4851000000000005e-05 2024-09-12T16:17:39.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.588 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:39.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578160+0000", 2024-09-12T16:17:39.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7600000000000001e-05 2024-09-12T16:17:39.588 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.588 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:39.589 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.589 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14049 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5096448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:39.589 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:17:39.589 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 79.997123770000002, 2024-09-12T16:17:39.589 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053439792, 2024-09-12T16:17:39.589 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:39.589 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:39.589 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:39.589 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:39.589 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:39.589 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:39.589 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14049 2024-09-12T16:17:39.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.590 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:39.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:39.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:17:39.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:39.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:17:39.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:39.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525170+0000", 2024-09-12T16:17:39.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017958500000000001 2024-09-12T16:17:39.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:39.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525174+0000", 2024-09-12T16:17:39.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0239999999999999e-06 2024-09-12T16:17:39.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:39.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525184+0000", 2024-09-12T16:17:39.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5950000000000005e-06 2024-09-12T16:17:39.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:39.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525191+0000", 2024-09-12T16:17:39.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8329999999999996e-06 2024-09-12T16:17:39.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:39.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578240+0000", 2024-09-12T16:17:39.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053049236 2024-09-12T16:17:39.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:39.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578333+0000", 2024-09-12T16:17:39.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2806999999999994e-05 2024-09-12T16:17:39.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.593 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:39.593 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578431+0000", 2024-09-12T16:17:39.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7712000000000002e-05 2024-09-12T16:17:39.593 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.593 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:39.593 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.593 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14055 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5121024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:39.593 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:17:39.593 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 79.995853079, 2024-09-12T16:17:39.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053399038000000003, 2024-09-12T16:17:39.594 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:39.594 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:39.594 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:39.594 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:39.594 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:39.594 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:39.594 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14055 2024-09-12T16:17:39.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.594 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:39.594 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.594 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:39.594 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:17:39.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:39.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:17:39.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:39.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526403+0000", 2024-09-12T16:17:39.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141571 2024-09-12T16:17:39.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:39.596 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526406+0000", 2024-09-12T16:17:39.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2660000000000002e-06 2024-09-12T16:17:39.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.596 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.596 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:39.596 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526420+0000", 2024-09-12T16:17:39.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3949e-05 2024-09-12T16:17:39.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.596 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.596 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:39.596 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526428+0000", 2024-09-12T16:17:39.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4250000000000001e-06 2024-09-12T16:17:39.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:39.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579476+0000", 2024-09-12T16:17:39.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053048349000000002 2024-09-12T16:17:39.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:39.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579563+0000", 2024-09-12T16:17:39.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6502999999999995e-05 2024-09-12T16:17:39.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:39.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579661+0000", 2024-09-12T16:17:39.598 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7974999999999996e-05 2024-09-12T16:17:39.598 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.598 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:39.598 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.598 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.598 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4806.0:3139 3.1e 3:78d5a095:::rbd_data.11552a37e55b.0000000000000000:head [read 69632~61440] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:17:39.598 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:39.598 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 69.220858828999994, 2024-09-12T16:17:39.598 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057851734000000002, 2024-09-12T16:17:39.598 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:39.598 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:39.598 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:39.599 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:39.599 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4806", 2024-09-12T16:17:39.599 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3959815836", 2024-09-12T16:17:39.599 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 3139 2024-09-12T16:17:39.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.599 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:39.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:39.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:39.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:39.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:39.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:39.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:39.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4799999999999999e-07 2024-09-12T16:17:39.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:39.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301258+0000", 2024-09-12T16:17:39.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.844e-06 2024-09-12T16:17:39.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:39.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301267+0000", 2024-09-12T16:17:39.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2960000000000004e-06 2024-09-12T16:17:39.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:39.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301276+0000", 2024-09-12T16:17:39.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0650000000000005e-06 2024-09-12T16:17:39.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:39.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301871+0000", 2024-09-12T16:17:39.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00059423600000000005 2024-09-12T16:17:39.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.602 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:39.602 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301920+0000", 2024-09-12T16:17:39.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9067000000000003e-05 2024-09-12T16:17:39.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.602 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:39.602 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359108+0000", 2024-09-12T16:17:39.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057187877999999998 2024-09-12T16:17:39.602 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.602 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:39.603 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.603 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.603 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:6428 3.14 3:28a44e54:::rbd_header.11552a37e55b:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:17:39.603 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:17:39.603 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 69.220530234999998, 2024-09-12T16:17:39.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057504023000000001, 2024-09-12T16:17:39.603 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:39.603 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:39.603 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:39.604 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:39.604 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:17:39.604 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:17:39.604 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6428 2024-09-12T16:17:39.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.604 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:39.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.604 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:39.604 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:17:39.604 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.605 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:39.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:17:39.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.605 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:39.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301585+0000", 2024-09-12T16:17:39.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6300000000000005e-07 2024-09-12T16:17:39.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.605 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:39.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301588+0000", 2024-09-12T16:17:39.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4149999999999999e-06 2024-09-12T16:17:39.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:39.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301597+0000", 2024-09-12T16:17:39.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5450000000000003e-06 2024-09-12T16:17:39.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:39.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301617+0000", 2024-09-12T16:17:39.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9837e-05 2024-09-12T16:17:39.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:39.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301779+0000", 2024-09-12T16:17:39.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016186799999999999 2024-09-12T16:17:39.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:39.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301855+0000", 2024-09-12T16:17:39.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5899e-05 2024-09-12T16:17:39.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:39.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359088+0000", 2024-09-12T16:17:39.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057233895999999999 2024-09-12T16:17:39.607 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.607 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:39.608 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.608 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5223.0:1814 3.f 3:f7b1b1c5:::rbd_object_map.1155a1fd27d2:head [read 0~136] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-12T16:17:39.608 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:17:39.608 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 33.284864171000002, 2024-09-12T16:17:39.608 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.006378226, 2024-09-12T16:17:39.608 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:39.608 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:39.608 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:39.608 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:39.608 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5223", 2024-09-12T16:17:39.608 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/4066330994", 2024-09-12T16:17:39.609 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1814 2024-09-12T16:17:39.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.609 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:39.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:39.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:17:39.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:39.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:17:39.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.610 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:39.610 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237252+0000", 2024-09-12T16:17:39.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.344e-06 2024-09-12T16:17:39.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.610 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:39.610 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237258+0000", 2024-09-12T16:17:39.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1070000000000001e-06 2024-09-12T16:17:39.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.610 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:39.610 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237270+0000", 2024-09-12T16:17:39.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1758e-05 2024-09-12T16:17:39.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.611 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:39.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237278+0000", 2024-09-12T16:17:39.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3219999999999993e-06 2024-09-12T16:17:39.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.611 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:39.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237334+0000", 2024-09-12T16:17:39.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6356e-05 2024-09-12T16:17:39.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.611 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:17:39.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237345+0000", 2024-09-12T16:17:39.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0433e-05 2024-09-12T16:17:39.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:39.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243426+0000", 2024-09-12T16:17:39.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.00608133 2024-09-12T16:17:39.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:39.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243534+0000", 2024-09-12T16:17:39.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010784 2024-09-12T16:17:39.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:39.613 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243629+0000", 2024-09-12T16:17:39.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4735999999999996e-05 2024-09-12T16:17:39.613 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.613 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:39.613 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.613 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.613 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5328.0:2542 3.16 3:6928f3a1:::rbd_object_map.11551722dd77:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:39.613 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:17:39.613 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 27.466518741000002, 2024-09-12T16:17:39.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.054219934999999997, 2024-09-12T16:17:39.613 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:39.613 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:39.614 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:39.614 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:39.614 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5328", 2024-09-12T16:17:39.614 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:39.614 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2542 2024-09-12T16:17:39.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.614 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:39.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.614 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:39.614 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:17:39.614 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.615 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:39.615 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:17:39.615 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.615 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.615 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:39.615 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055597+0000", 2024-09-12T16:17:39.615 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4300000000000001e-07 2024-09-12T16:17:39.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.615 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.615 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:39.615 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055602+0000", 2024-09-12T16:17:39.615 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4269999999999999e-06 2024-09-12T16:17:39.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.615 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.616 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:39.616 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055613+0000", 2024-09-12T16:17:39.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0815000000000001e-05 2024-09-12T16:17:39.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.616 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:39.616 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055621+0000", 2024-09-12T16:17:39.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4189999999999996e-06 2024-09-12T16:17:39.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.616 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:39.616 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102196+0000", 2024-09-12T16:17:39.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.046575616 2024-09-12T16:17:39.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.617 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:39.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102258+0000", 2024-09-12T16:17:39.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1872000000000007e-05 2024-09-12T16:17:39.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.617 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T16:17:39.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102601+0000", 2024-09-12T16:17:39.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034285700000000001 2024-09-12T16:17:39.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.617 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:39.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.104431+0000", 2024-09-12T16:17:39.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001830524 2024-09-12T16:17:39.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.618 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:17:39.618 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109733+0000", 2024-09-12T16:17:39.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0053020089999999999 2024-09-12T16:17:39.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.618 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:39.618 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109777+0000", 2024-09-12T16:17:39.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3754000000000002e-05 2024-09-12T16:17:39.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.619 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.619 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:39.619 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109816+0000", 2024-09-12T16:17:39.619 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8699000000000003e-05 2024-09-12T16:17:39.619 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.619 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:39.619 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.619 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.619 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5328.0:2543 3.16 3:6928f3a1:::rbd_object_map.11551722dd77:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:39.619 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:17:39.619 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 27.465924762, 2024-09-12T16:17:39.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053695720000000002, 2024-09-12T16:17:39.620 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:39.620 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:39.620 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:39.620 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:39.620 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5328", 2024-09-12T16:17:39.620 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:39.620 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2543 2024-09-12T16:17:39.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.620 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:39.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:39.620 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:17:39.621 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.621 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:39.621 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:17:39.621 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:39.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.621 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:39.621 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056191+0000", 2024-09-12T16:17:39.621 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.54e-07 2024-09-12T16:17:39.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.621 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:39.622 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056195+0000", 2024-09-12T16:17:39.622 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5460000000000002e-06 2024-09-12T16:17:39.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.622 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.622 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:39.622 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056205+0000", 2024-09-12T16:17:39.622 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7350000000000008e-06 2024-09-12T16:17:39.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.622 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.622 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:39.622 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056214+0000", 2024-09-12T16:17:39.622 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8089999999999999e-06 2024-09-12T16:17:39.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.622 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.623 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:39.623 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103317+0000", 2024-09-12T16:17:39.623 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.047102889000000002 2024-09-12T16:17:39.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.623 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:39.623 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103410+0000", 2024-09-12T16:17:39.623 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3689000000000004e-05 2024-09-12T16:17:39.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.623 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T16:17:39.623 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103754+0000", 2024-09-12T16:17:39.623 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034344699999999998 2024-09-12T16:17:39.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.624 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:39.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.106487+0000", 2024-09-12T16:17:39.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0027330100000000001 2024-09-12T16:17:39.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.624 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:17:39.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109827+0000", 2024-09-12T16:17:39.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033406640000000001 2024-09-12T16:17:39.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.624 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:39.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109854+0000", 2024-09-12T16:17:39.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6866999999999999e-05 2024-09-12T16:17:39.625 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:39.625 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:39.625 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:39.625 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109886+0000", 2024-09-12T16:17:39.625 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1309999999999997e-05 2024-09-12T16:17:39.625 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.625 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:39.625 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.625 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:39.625 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:39.625 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:39.627 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:39.626+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:39.628 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:17:39.630 INFO:teuthology.orchestra.run.smithi204.stdout:5014 write 0xca37e00 thru 0xca4398c (0xbb8d bytes) 2024-09-12T16:17:39.630 INFO:teuthology.orchestra.run.smithi204.stdout:5015 read 0x71c6a00 thru 0x71d2d40 (0xc341 bytes) 2024-09-12T16:17:39.630 INFO:teuthology.orchestra.run.smithi204.stdout:5016 read 0x852dc00 thru 0x852e7c6 (0xbc7 bytes) 2024-09-12T16:17:39.630 INFO:teuthology.orchestra.run.smithi204.stdout:5017 punch from 0x627a000 to 0x6288c00, (0xec00 bytes) 2024-09-12T16:17:39.630 INFO:teuthology.orchestra.run.smithi204.stdout:5019 read 0x4fe1a00 thru 0x4fe5a66 (0x4067 bytes) 2024-09-12T16:17:39.630 INFO:teuthology.orchestra.run.smithi204.stdout:5020 write 0xdc13800 thru 0xdc20850 (0xd051 bytes) 2024-09-12T16:17:39.630 INFO:teuthology.orchestra.run.smithi204.stdout:5021 punch from 0x1176e00 to 0x117de00, (0x7000 bytes) 2024-09-12T16:17:39.630 INFO:teuthology.orchestra.run.smithi204.stdout:5022 read 0x5ad7000 thru 0x5ad90c1 (0x20c2 bytes) 2024-09-12T16:17:39.630 INFO:teuthology.orchestra.run.smithi204.stdout:5024 read 0x7304800 thru 0x7313fb3 (0xf7b4 bytes) 2024-09-12T16:17:39.630 INFO:teuthology.orchestra.run.smithi204.stdout:5025 punch from 0x7ed3e00 to 0x7ed4400, (0x600 bytes) 2024-09-12T16:17:39.630 INFO:teuthology.orchestra.run.smithi204.stdout:5026 punch from 0x2fbb600 to 0x2fc4400, (0x8e00 bytes) 2024-09-12T16:17:39.630 INFO:teuthology.orchestra.run.smithi204.stdout:5027 read 0xbe60200 thru 0xbe6d8c1 (0xd6c2 bytes) 2024-09-12T16:17:39.630 INFO:teuthology.orchestra.run.smithi204.stdout:5028 write 0x6add600 thru 0x6ae5c6d (0x866e bytes) 2024-09-12T16:17:39.631 INFO:teuthology.orchestra.run.smithi204.stdout:5029 read 0x2c66400 thru 0x2c66561 (0x162 bytes) 2024-09-12T16:17:39.631 INFO:teuthology.orchestra.run.smithi204.stdout:5030 read 0x4cdb400 thru 0x4ce2ddb (0x79dc bytes) 2024-09-12T16:17:39.631 INFO:teuthology.orchestra.run.smithi204.stdout:skipping zero length punch hole 2024-09-12T16:17:39.631 INFO:teuthology.orchestra.run.smithi204.stdout:5032 read 0xda09400 thru 0xda12cea (0x98eb bytes) 2024-09-12T16:17:39.631 INFO:teuthology.orchestra.run.smithi204.stdout:5033 write 0xdee4800 thru 0xdef03f5 (0xbbf6 bytes) 2024-09-12T16:17:39.631 INFO:teuthology.orchestra.run.smithi204.stdout:5034 trunc from 0xdef0400 to 0x2f57200 2024-09-12T16:17:39.700 INFO:teuthology.orchestra.run.smithi204.stdout:5035 write 0xd8f7000 thru 0xd903508 (0xc509 bytes) 2024-09-12T16:17:39.700 INFO:teuthology.orchestra.run.smithi204.stdout:5036 punch from 0xd1eac00 to 0xd1f7400, (0xc800 bytes) 2024-09-12T16:17:39.701 INFO:teuthology.orchestra.run.smithi204.stdout:5037 read 0x3287600 thru 0x328f213 (0x7c14 bytes) 2024-09-12T16:17:39.701 INFO:teuthology.orchestra.run.smithi204.stdout:5038 read 0x14fe400 thru 0x14ff1d3 (0xdd4 bytes) 2024-09-12T16:17:39.701 INFO:teuthology.orchestra.run.smithi204.stdout:5040 write 0xd504800 thru 0xd50e8e6 (0xa0e7 bytes) 2024-09-12T16:17:39.701 INFO:teuthology.orchestra.run.smithi204.stdout:5041 punch from 0x4434400 to 0x4443200, (0xee00 bytes) 2024-09-12T16:17:39.701 INFO:teuthology.orchestra.run.smithi204.stdout:5042 read 0xb861400 thru 0xb86caf5 (0xb6f6 bytes) 2024-09-12T16:17:39.701 INFO:teuthology.orchestra.run.smithi204.stdout:5045 write 0x99ff600 thru 0x9a0ec08 (0xf609 bytes) 2024-09-12T16:17:39.702 INFO:teuthology.orchestra.run.smithi204.stdout:5050 write 0x2ebee00 thru 0x2ece2ce (0xf4cf bytes) 2024-09-12T16:17:39.703 INFO:teuthology.orchestra.run.smithi204.stdout:5051 read 0x3cbb800 thru 0x3cc96da (0xdedb bytes) 2024-09-12T16:17:39.703 INFO:teuthology.orchestra.run.smithi204.stdout:5052 write 0x9aa2000 thru 0x9aaa6f0 (0x86f1 bytes) 2024-09-12T16:17:39.703 INFO:teuthology.orchestra.run.smithi204.stdout:5053 punch from 0xc0af000 to 0xc0bb000, (0xc000 bytes) 2024-09-12T16:17:39.703 INFO:teuthology.orchestra.run.smithi204.stdout:5055 write 0x760e600 thru 0x7611571 (0x2f72 bytes) 2024-09-12T16:17:39.727 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:39.726+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:39.767 INFO:teuthology.orchestra.run.smithi204.stdout:5058 write 0xe401200 thru 0xe409f0c (0x8d0d bytes) 2024-09-12T16:17:39.767 INFO:teuthology.orchestra.run.smithi204.stdout:5060 punch from 0xe2d0e00 to 0xe2db800, (0xaa00 bytes) 2024-09-12T16:17:39.771 INFO:teuthology.orchestra.run.smithi204.stdout:5061 trunc from 0xe40a000 to 0xae13200 2024-09-12T16:17:39.799 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:39.799 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:39.799 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:17:39.799 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:39.808 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:17:39.826 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:17:39.826 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:39.826 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 98, 2024-09-12T16:17:39.827 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "66dcb8ed-8de5-4784-8071-fd6b3bf3b78f", 2024-09-12T16:17:39.827 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2024-09-12T16:15:28.208893+0000", 2024-09-12T16:17:39.827 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2024-09-12T16:17:38.340222+0000", 2024-09-12T16:17:39.827 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2024-09-12T16:17:03.223056+0000", 2024-09-12T16:17:39.827 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2024-09-12T16:16:51.172229+0000", 2024-09-12T16:17:39.827 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T16:17:39.827 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5804032, 2024-09-12T16:17:39.827 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2024-09-12T16:17:39.827 INFO:teuthology.orchestra.run.smithi017.stdout: "nodeep-scrub", 2024-09-12T16:17:39.827 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2024-09-12T16:17:39.827 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2024-09-12T16:17:39.827 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2024-09-12T16:17:39.828 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2024-09-12T16:17:39.828 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-12T16:17:39.828 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 5, 2024-09-12T16:17:39.828 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T16:17:39.828 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T16:17:39.828 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T16:17:39.828 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2024-09-12T16:17:39.828 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 3, 2024-09-12T16:17:39.828 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 6, 2024-09-12T16:17:39.828 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2024-09-12T16:17:39.828 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "jewel", 2024-09-12T16:17:39.828 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "squid", 2024-09-12T16:17:39.829 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2024-09-12T16:17:39.829 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2024-09-12T16:17:39.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.829 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2024-09-12T16:17:39.829 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2024-09-12T16:17:39.829 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2024-09-12T16:15:40.677216+0000", 2024-09-12T16:17:39.829 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-12T16:17:39.829 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2024-09-12T16:17:39.829 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2024-09-12T16:17:39.829 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2024-09-12T16:17:39.829 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2024-09-12T16:17:39.829 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2024-09-12T16:17:39.829 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2024-09-12T16:17:39.830 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2024-09-12T16:17:39.830 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T16:17:39.830 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T16:17:39.830 INFO:teuthology.orchestra.run.smithi017.stdout: "is_stretch_pool": false, 2024-09-12T16:17:39.830 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2024-09-12T16:17:39.830 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2024-09-12T16:17:39.830 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2024-09-12T16:17:39.830 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2024-09-12T16:17:39.830 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2024-09-12T16:17:39.830 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2024-09-12T16:17:39.830 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2024-09-12T16:17:39.830 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2024-09-12T16:17:39.830 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2024-09-12T16:17:39.830 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2024-09-12T16:17:39.831 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2024-09-12T16:17:39.831 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2024-09-12T16:17:39.831 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2024-09-12T16:17:39.831 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2024-09-12T16:17:39.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.831 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "15", 2024-09-12T16:17:39.831 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2024-09-12T16:17:39.831 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T16:17:39.831 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T16:17:39.831 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2024-09-12T16:17:39.831 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2024-09-12T16:17:39.831 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2024-09-12T16:17:39.832 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2024-09-12T16:17:39.832 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2024-09-12T16:17:39.832 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2024-09-12T16:17:39.832 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2024-09-12T16:17:39.832 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2024-09-12T16:17:39.832 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2024-09-12T16:17:39.832 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2024-09-12T16:17:39.832 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2024-09-12T16:17:39.832 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2024-09-12T16:17:39.832 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2024-09-12T16:17:39.832 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2024-09-12T16:17:39.832 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2024-09-12T16:17:39.832 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T16:17:39.832 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T16:17:39.833 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T16:17:39.833 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2024-09-12T16:17:39.833 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2024-09-12T16:17:39.833 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2024-09-12T16:17:39.833 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2024-09-12T16:17:39.833 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2024-09-12T16:17:39.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.833 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2024-09-12T16:17:39.833 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2024-09-12T16:17:39.833 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2024-09-12T16:17:39.833 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2024-09-12T16:17:39.833 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2024-09-12T16:17:39.833 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T16:17:39.833 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2024-09-12T16:17:39.834 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2024-09-12T16:17:39.834 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2024-09-12T16:17:39.834 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2024-09-12T16:17:39.834 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2024-09-12T16:17:39.834 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2024-09-12T16:17:39.834 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2024-09-12T16:17:39.834 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2024-09-12T16:17:39.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.834 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2024-09-12T16:17:39.834 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2024-09-12T16:17:39.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.834 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2024-09-12T16:17:39.834 INFO:teuthology.orchestra.run.smithi017.stdout: "score_type": "Fair distribution", 2024-09-12T16:17:39.835 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 6.059999942779541, 2024-09-12T16:17:39.835 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 6.059999942779541, 2024-09-12T16:17:39.835 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.33000001311302185, 2024-09-12T16:17:39.835 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2024-09-12T16:17:39.835 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2024-09-12T16:17:39.835 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 0.84821069240570068, 2024-09-12T16:17:39.835 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 0.85000002384185791, 2024-09-12T16:17:39.835 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 0.85000002384185791 2024-09-12T16:17:39.835 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.835 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2024-09-12T16:17:39.836 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2024-09-12T16:17:39.836 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2024-09-12T16:15:45.306180+0000", 2024-09-12T16:17:39.836 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 8193, 2024-09-12T16:17:39.836 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T16:17:39.836 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2024-09-12T16:17:39.836 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2024-09-12T16:17:39.836 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2024-09-12T16:17:39.836 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2024-09-12T16:17:39.836 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2024-09-12T16:17:39.836 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2024-09-12T16:17:39.836 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T16:17:39.836 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T16:17:39.837 INFO:teuthology.orchestra.run.smithi017.stdout: "is_stretch_pool": false, 2024-09-12T16:17:39.837 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2024-09-12T16:17:39.837 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2024-09-12T16:17:39.837 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2024-09-12T16:17:39.837 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2024-09-12T16:17:39.837 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2024-09-12T16:17:39.837 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2024-09-12T16:17:39.837 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2024-09-12T16:17:39.837 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2024-09-12T16:17:39.837 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2024-09-12T16:17:39.837 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2024-09-12T16:17:39.837 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2024-09-12T16:17:39.837 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2024-09-12T16:17:39.837 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2024-09-12T16:17:39.838 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2024-09-12T16:17:39.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.838 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "19", 2024-09-12T16:17:39.838 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2024-09-12T16:17:39.838 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T16:17:39.838 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T16:17:39.838 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2024-09-12T16:17:39.838 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2024-09-12T16:17:39.838 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 2, 2024-09-12T16:17:39.838 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 19, 2024-09-12T16:17:39.838 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2024-09-12T16:17:39.838 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2024-09-12T16:17:39.838 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2024-09-12T16:17:39.838 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2024-09-12T16:17:39.839 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2024-09-12T16:17:39.839 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2024-09-12T16:17:39.839 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2024-09-12T16:17:39.839 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2024-09-12T16:17:39.839 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2024-09-12T16:17:39.839 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2024-09-12T16:17:39.839 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2024-09-12T16:17:39.839 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T16:17:39.839 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T16:17:39.839 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T16:17:39.839 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2024-09-12T16:17:39.839 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2024-09-12T16:17:39.839 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2024-09-12T16:17:39.840 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2024-09-12T16:17:39.840 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2024-09-12T16:17:39.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.840 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2024-09-12T16:17:39.840 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2024-09-12T16:17:39.840 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2024-09-12T16:17:39.840 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2024-09-12T16:17:39.840 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2024-09-12T16:17:39.840 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T16:17:39.840 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2024-09-12T16:17:39.840 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2024-09-12T16:17:39.841 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2024-09-12T16:17:39.841 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2024-09-12T16:17:39.841 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2024-09-12T16:17:39.841 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2024-09-12T16:17:39.841 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2024-09-12T16:17:39.841 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2024-09-12T16:17:39.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.841 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2024-09-12T16:17:39.841 INFO:teuthology.orchestra.run.smithi017.stdout: "score_type": "Fair distribution", 2024-09-12T16:17:39.841 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 2.25, 2024-09-12T16:17:39.841 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 2.25, 2024-09-12T16:17:39.842 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2024-09-12T16:17:39.842 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2.25, 2024-09-12T16:17:39.842 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2.25, 2024-09-12T16:17:39.842 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 0.84821069240570068, 2024-09-12T16:17:39.842 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 0.85000002384185791, 2024-09-12T16:17:39.842 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 0.85000002384185791 2024-09-12T16:17:39.842 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.843 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 3, 2024-09-12T16:17:39.843 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "pool_client.0", 2024-09-12T16:17:39.843 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2024-09-12T16:15:55.082975+0000", 2024-09-12T16:17:39.843 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 8193, 2024-09-12T16:17:39.843 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T16:17:39.843 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2024-09-12T16:17:39.843 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2024-09-12T16:17:39.843 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2024-09-12T16:17:39.843 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2024-09-12T16:17:39.843 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2024-09-12T16:17:39.843 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2024-09-12T16:17:39.844 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T16:17:39.844 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T16:17:39.844 INFO:teuthology.orchestra.run.smithi017.stdout: "is_stretch_pool": false, 2024-09-12T16:17:39.844 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2024-09-12T16:17:39.844 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2024-09-12T16:17:39.844 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2024-09-12T16:17:39.844 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2024-09-12T16:17:39.844 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2024-09-12T16:17:39.844 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2024-09-12T16:17:39.844 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2024-09-12T16:17:39.844 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2024-09-12T16:17:39.845 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2024-09-12T16:17:39.845 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2024-09-12T16:17:39.845 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2024-09-12T16:17:39.845 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2024-09-12T16:17:39.845 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2024-09-12T16:17:39.845 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2024-09-12T16:17:39.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.845 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "97", 2024-09-12T16:17:39.845 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2024-09-12T16:17:39.845 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T16:17:39.846 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T16:17:39.846 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2024-09-12T16:17:39.846 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2024-09-12T16:17:39.846 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 36, 2024-09-12T16:17:39.846 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 97, 2024-09-12T16:17:39.846 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2024-09-12T16:17:39.846 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2024-09-12T16:17:39.846 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2024-09-12T16:17:39.846 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2024-09-12T16:17:39.846 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2024-09-12T16:17:39.846 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2024-09-12T16:17:39.846 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2024-09-12T16:17:39.846 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2024-09-12T16:17:39.846 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2024-09-12T16:17:39.847 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2024-09-12T16:17:39.847 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2024-09-12T16:17:39.847 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T16:17:39.847 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T16:17:39.847 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T16:17:39.847 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2024-09-12T16:17:39.847 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2024-09-12T16:17:39.847 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2024-09-12T16:17:39.847 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2024-09-12T16:17:39.847 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2024-09-12T16:17:39.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.847 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2024-09-12T16:17:39.847 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2024-09-12T16:17:39.848 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2024-09-12T16:17:39.848 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2024-09-12T16:17:39.848 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2024-09-12T16:17:39.848 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T16:17:39.848 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2024-09-12T16:17:39.848 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2024-09-12T16:17:39.848 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2024-09-12T16:17:39.848 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2024-09-12T16:17:39.848 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2024-09-12T16:17:39.848 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2024-09-12T16:17:39.848 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2024-09-12T16:17:39.848 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2024-09-12T16:17:39.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.849 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2024-09-12T16:17:39.849 INFO:teuthology.orchestra.run.smithi017.stdout: "score_type": "Fair distribution", 2024-09-12T16:17:39.849 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.5, 2024-09-12T16:17:39.849 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.5, 2024-09-12T16:17:39.849 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2024-09-12T16:17:39.849 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.5, 2024-09-12T16:17:39.849 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.5, 2024-09-12T16:17:39.849 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 0.84821069240570068, 2024-09-12T16:17:39.849 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 0.85000002384185791, 2024-09-12T16:17:39.849 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 0.85000002384185791 2024-09-12T16:17:39.849 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.849 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.849 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-12T16:17:39.850 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2024-09-12T16:17:39.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.850 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2024-09-12T16:17:39.850 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "aabea24b-3f1f-4555-80c3-5caecf2e2001", 2024-09-12T16:17:39.850 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-12T16:17:39.850 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-12T16:17:39.850 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-12T16:17:39.850 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-12T16:17:39.850 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-12T16:17:39.850 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-12T16:17:39.850 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 11, 2024-09-12T16:17:39.850 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 84, 2024-09-12T16:17:39.850 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-12T16:17:39.851 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-12T16:17:39.851 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-12T16:17:39.851 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:17:39.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.851 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:17:39.851 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2024-09-12T16:17:39.851 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1385915755 2024-09-12T16:17:39.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.851 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:17:39.851 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2024-09-12T16:17:39.851 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1385915755 2024-09-12T16:17:39.851 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.851 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.852 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-12T16:17:39.852 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:17:39.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.852 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:17:39.852 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2024-09-12T16:17:39.852 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1385915755 2024-09-12T16:17:39.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.852 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:17:39.852 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2024-09-12T16:17:39.852 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1385915755 2024-09-12T16:17:39.852 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.853 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.853 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-12T16:17:39.853 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:17:39.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.853 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:17:39.853 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2024-09-12T16:17:39.853 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1385915755 2024-09-12T16:17:39.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.854 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:17:39.854 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2024-09-12T16:17:39.854 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1385915755 2024-09-12T16:17:39.854 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.854 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.854 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-12T16:17:39.854 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:17:39.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.854 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:17:39.854 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2024-09-12T16:17:39.854 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1385915755 2024-09-12T16:17:39.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.855 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:17:39.855 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2024-09-12T16:17:39.855 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1385915755 2024-09-12T16:17:39.855 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.855 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.855 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1385915755", 2024-09-12T16:17:39.855 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1385915755", 2024-09-12T16:17:39.855 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1385915755", 2024-09-12T16:17:39.855 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1385915755", 2024-09-12T16:17:39.855 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-12T16:17:39.855 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-12T16:17:39.855 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-12T16:17:39.855 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.856 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2024-09-12T16:17:39.856 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "7a17ca3b-8e49-4d92-a633-45d3e4a45b4e", 2024-09-12T16:17:39.856 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-12T16:17:39.856 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-12T16:17:39.856 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-12T16:17:39.856 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-12T16:17:39.856 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-12T16:17:39.856 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-12T16:17:39.856 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 11, 2024-09-12T16:17:39.856 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 74, 2024-09-12T16:17:39.857 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-12T16:17:39.857 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-12T16:17:39.857 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-12T16:17:39.857 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:17:39.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.857 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:17:39.857 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2024-09-12T16:17:39.857 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3906173234 2024-09-12T16:17:39.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.857 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:17:39.857 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2024-09-12T16:17:39.857 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3906173234 2024-09-12T16:17:39.858 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.858 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.858 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-12T16:17:39.858 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:17:39.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.858 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:17:39.858 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2024-09-12T16:17:39.858 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3906173234 2024-09-12T16:17:39.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.859 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:17:39.859 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2024-09-12T16:17:39.859 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3906173234 2024-09-12T16:17:39.859 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.859 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.859 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-12T16:17:39.859 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:17:39.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.859 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:17:39.859 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2024-09-12T16:17:39.860 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3906173234 2024-09-12T16:17:39.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.860 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:17:39.860 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2024-09-12T16:17:39.860 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3906173234 2024-09-12T16:17:39.860 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.860 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.860 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-12T16:17:39.860 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:17:39.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.860 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:17:39.861 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2024-09-12T16:17:39.861 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3906173234 2024-09-12T16:17:39.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.861 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:17:39.861 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2024-09-12T16:17:39.861 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3906173234 2024-09-12T16:17:39.861 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.861 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.861 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/3906173234", 2024-09-12T16:17:39.861 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/3906173234", 2024-09-12T16:17:39.861 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/3906173234", 2024-09-12T16:17:39.861 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/3906173234", 2024-09-12T16:17:39.862 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-12T16:17:39.862 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-12T16:17:39.862 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-12T16:17:39.862 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.862 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2024-09-12T16:17:39.862 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "dae09a32-24c6-464c-bee8-04ef2c42f7e4", 2024-09-12T16:17:39.862 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-12T16:17:39.862 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-12T16:17:39.862 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-12T16:17:39.862 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-12T16:17:39.862 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-12T16:17:39.862 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-12T16:17:39.862 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 11, 2024-09-12T16:17:39.863 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 84, 2024-09-12T16:17:39.863 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-12T16:17:39.863 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-12T16:17:39.863 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-12T16:17:39.863 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:17:39.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.863 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:17:39.863 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2024-09-12T16:17:39.863 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1974346628 2024-09-12T16:17:39.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.863 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:17:39.863 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2024-09-12T16:17:39.864 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1974346628 2024-09-12T16:17:39.864 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.864 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.864 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-12T16:17:39.864 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:17:39.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.864 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:17:39.864 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2024-09-12T16:17:39.864 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1974346628 2024-09-12T16:17:39.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.864 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:17:39.865 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2024-09-12T16:17:39.865 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1974346628 2024-09-12T16:17:39.865 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.865 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.865 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-12T16:17:39.865 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:17:39.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.865 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:17:39.865 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2024-09-12T16:17:39.865 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1974346628 2024-09-12T16:17:39.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.866 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:17:39.866 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2024-09-12T16:17:39.866 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1974346628 2024-09-12T16:17:39.866 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.866 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.866 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-12T16:17:39.866 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:17:39.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.866 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:17:39.866 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2024-09-12T16:17:39.866 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1974346628 2024-09-12T16:17:39.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.867 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:17:39.867 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2024-09-12T16:17:39.867 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1974346628 2024-09-12T16:17:39.867 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.867 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.867 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/1974346628", 2024-09-12T16:17:39.867 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/1974346628", 2024-09-12T16:17:39.867 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/1974346628", 2024-09-12T16:17:39.867 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/1974346628", 2024-09-12T16:17:39.867 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-12T16:17:39.867 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-12T16:17:39.867 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-12T16:17:39.867 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.868 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2024-09-12T16:17:39.868 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "9cc5463c-cdb4-4a6a-b526-39a60de417f4", 2024-09-12T16:17:39.868 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-12T16:17:39.868 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-12T16:17:39.868 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-12T16:17:39.868 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-12T16:17:39.868 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-12T16:17:39.868 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-12T16:17:39.868 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 11, 2024-09-12T16:17:39.868 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 83, 2024-09-12T16:17:39.868 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-12T16:17:39.869 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-12T16:17:39.869 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-12T16:17:39.869 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:17:39.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.869 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:17:39.869 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6808", 2024-09-12T16:17:39.869 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3370202675 2024-09-12T16:17:39.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.869 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:17:39.869 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6809", 2024-09-12T16:17:39.870 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3370202675 2024-09-12T16:17:39.870 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.870 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.870 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-12T16:17:39.870 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:17:39.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.870 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:17:39.870 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6810", 2024-09-12T16:17:39.870 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3370202675 2024-09-12T16:17:39.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.870 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:17:39.870 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6811", 2024-09-12T16:17:39.870 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3370202675 2024-09-12T16:17:39.871 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.871 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.871 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-12T16:17:39.871 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:17:39.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.871 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:17:39.871 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6814", 2024-09-12T16:17:39.871 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3370202675 2024-09-12T16:17:39.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.871 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:17:39.871 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6815", 2024-09-12T16:17:39.871 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3370202675 2024-09-12T16:17:39.872 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.872 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.872 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-12T16:17:39.872 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:17:39.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.872 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:17:39.872 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6812", 2024-09-12T16:17:39.872 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3370202675 2024-09-12T16:17:39.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.872 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:17:39.873 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6813", 2024-09-12T16:17:39.873 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3370202675 2024-09-12T16:17:39.873 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.873 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.873 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.47:6809/3370202675", 2024-09-12T16:17:39.873 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.47:6811/3370202675", 2024-09-12T16:17:39.873 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.47:6815/3370202675", 2024-09-12T16:17:39.873 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.47:6813/3370202675", 2024-09-12T16:17:39.873 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-12T16:17:39.873 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-12T16:17:39.873 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-12T16:17:39.873 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.874 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2024-09-12T16:17:39.874 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "1e329af3-a88a-4a95-b822-01519079084b", 2024-09-12T16:17:39.874 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-12T16:17:39.874 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-12T16:17:39.874 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-12T16:17:39.874 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-12T16:17:39.874 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-12T16:17:39.874 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-12T16:17:39.874 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 11, 2024-09-12T16:17:39.874 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 74, 2024-09-12T16:17:39.874 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-12T16:17:39.875 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-12T16:17:39.875 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-12T16:17:39.875 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:17:39.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.875 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:17:39.875 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6816", 2024-09-12T16:17:39.875 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1823488259 2024-09-12T16:17:39.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.875 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:17:39.875 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6817", 2024-09-12T16:17:39.876 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1823488259 2024-09-12T16:17:39.876 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.876 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.876 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-12T16:17:39.876 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:17:39.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.876 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:17:39.876 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6818", 2024-09-12T16:17:39.876 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1823488259 2024-09-12T16:17:39.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.876 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:17:39.877 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6819", 2024-09-12T16:17:39.877 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1823488259 2024-09-12T16:17:39.877 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.877 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.877 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-12T16:17:39.877 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:17:39.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.877 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:17:39.877 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6822", 2024-09-12T16:17:39.877 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1823488259 2024-09-12T16:17:39.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.877 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:17:39.878 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6823", 2024-09-12T16:17:39.878 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1823488259 2024-09-12T16:17:39.878 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.878 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.878 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-12T16:17:39.878 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:17:39.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.878 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:17:39.878 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6820", 2024-09-12T16:17:39.878 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1823488259 2024-09-12T16:17:39.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.878 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:17:39.878 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6821", 2024-09-12T16:17:39.878 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1823488259 2024-09-12T16:17:39.879 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.879 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.879 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.47:6817/1823488259", 2024-09-12T16:17:39.879 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.47:6819/1823488259", 2024-09-12T16:17:39.879 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.47:6823/1823488259", 2024-09-12T16:17:39.879 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.47:6821/1823488259", 2024-09-12T16:17:39.879 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-12T16:17:39.879 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-12T16:17:39.879 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-12T16:17:39.879 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.880 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2024-09-12T16:17:39.880 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "c255a252-3afe-4aad-b44c-85820867c960", 2024-09-12T16:17:39.880 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-12T16:17:39.880 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-12T16:17:39.880 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-12T16:17:39.880 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 0.089263916015625, 2024-09-12T16:17:39.880 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 11, 2024-09-12T16:17:39.880 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 35, 2024-09-12T16:17:39.880 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 71, 2024-09-12T16:17:39.880 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 32, 2024-09-12T16:17:39.880 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 37, 2024-09-12T16:17:39.880 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-12T16:17:39.880 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-12T16:17:39.881 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:17:39.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.881 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:17:39.881 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6800", 2024-09-12T16:17:39.881 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2087971028 2024-09-12T16:17:39.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.881 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:17:39.881 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6801", 2024-09-12T16:17:39.881 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2087971028 2024-09-12T16:17:39.881 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.881 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.882 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-12T16:17:39.882 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:17:39.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.882 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:17:39.882 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6802", 2024-09-12T16:17:39.882 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2087971028 2024-09-12T16:17:39.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.882 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:17:39.882 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6803", 2024-09-12T16:17:39.882 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2087971028 2024-09-12T16:17:39.882 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.882 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.883 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-12T16:17:39.883 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:17:39.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.883 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:17:39.883 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6806", 2024-09-12T16:17:39.883 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2087971028 2024-09-12T16:17:39.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.883 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:17:39.883 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6807", 2024-09-12T16:17:39.883 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2087971028 2024-09-12T16:17:39.883 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.883 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.884 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-12T16:17:39.884 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:17:39.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.884 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:17:39.884 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6804", 2024-09-12T16:17:39.884 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2087971028 2024-09-12T16:17:39.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.884 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:17:39.884 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6805", 2024-09-12T16:17:39.884 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2087971028 2024-09-12T16:17:39.884 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.885 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.888 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.47:6801/2087971028", 2024-09-12T16:17:39.888 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.47:6803/2087971028", 2024-09-12T16:17:39.888 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.47:6807/2087971028", 2024-09-12T16:17:39.888 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.47:6805/2087971028", 2024-09-12T16:17:39.888 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-12T16:17:39.888 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-12T16:17:39.888 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-12T16:17:39.888 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:39.888 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.889 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-12T16:17:39.889 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2024-09-12T16:17:39.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.889 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2024-09-12T16:17:39.889 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-12T16:17:39.889 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-12T16:17:39.889 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-12T16:17:39.889 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540719139924082687, 2024-09-12T16:17:39.889 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-12T16:17:39.889 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-12T16:15:35.752566+0000", 2024-09-12T16:17:39.889 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-12T16:17:39.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.889 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2024-09-12T16:17:39.890 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-12T16:17:39.890 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-12T16:17:39.890 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-12T16:17:39.890 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540719139924082687, 2024-09-12T16:17:39.890 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-12T16:17:39.890 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-12T16:15:36.269665+0000", 2024-09-12T16:17:39.890 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-12T16:17:39.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.890 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2024-09-12T16:17:39.890 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-12T16:17:39.890 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-12T16:17:39.890 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-12T16:17:39.891 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540719139924082687, 2024-09-12T16:17:39.891 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-12T16:17:39.891 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-12T16:15:36.524745+0000", 2024-09-12T16:17:39.891 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-12T16:17:39.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.891 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2024-09-12T16:17:39.891 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-12T16:17:39.891 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-12T16:17:39.891 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-12T16:17:39.891 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540719139924082687, 2024-09-12T16:17:39.891 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-12T16:17:39.892 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-12T16:15:36.095607+0000", 2024-09-12T16:17:39.892 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-12T16:17:39.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.892 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2024-09-12T16:17:39.892 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-12T16:17:39.892 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-12T16:17:39.892 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-12T16:17:39.892 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540719139924082687, 2024-09-12T16:17:39.892 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-12T16:17:39.892 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-12T16:15:36.294055+0000", 2024-09-12T16:17:39.892 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-12T16:17:39.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:39.893 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2024-09-12T16:17:39.893 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-12T16:17:39.893 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-12T16:17:39.893 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-12T16:17:39.893 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540719139924082687, 2024-09-12T16:17:39.893 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-12T16:17:39.893 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-12T16:15:36.092708+0000", 2024-09-12T16:17:39.893 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 37 2024-09-12T16:17:39.893 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.893 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-12T16:17:39.893 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [], 2024-09-12T16:17:39.893 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [], 2024-09-12T16:17:39.894 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2024-09-12T16:17:39.894 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2024-09-12T16:17:39.894 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2024-09-12T16:17:39.894 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2024-09-12T16:17:39.894 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2024-09-12T16:17:39.894 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2024-09-12T16:17:39.894 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2024-09-12T16:17:39.894 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2024-09-12T16:17:39.894 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2024-09-12T16:17:39.894 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2024-09-12T16:17:39.894 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2024-09-12T16:17:39.894 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2024-09-12T16:17:39.894 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:39.895 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [], 2024-09-12T16:17:39.895 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [], 2024-09-12T16:17:39.895 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2024-09-12T16:17:39.895 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2024-09-12T16:17:39.895 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2024-09-12T16:17:39.895 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2024-09-12T16:17:39.895 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2024-09-12T16:17:39.895 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2024-09-12T16:17:39.895 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2024-09-12T16:17:39.895 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2024-09-12T16:17:39.895 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2024-09-12T16:17:39.895 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:39.896 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:39.899 INFO:tasks.thrashosds.thrasher:j is {'epoch': 98, 'fsid': '66dcb8ed-8de5-4784-8071-fd6b3bf3b78f', 'created': '2024-09-12T16:15:28.208893+0000', 'modified': '2024-09-12T16:17:38.340222+0000', 'last_up_change': '2024-09-12T16:17:03.223056+0000', 'last_in_change': '2024-09-12T16:16:51.172229+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 6, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T16:15:40.677216+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8482106924057007, 'average_primary_affinity': 0.8500000238418579, 'average_primary_affinity_weighted': 0.8500000238418579}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T16:15:45.306180+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 19, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.8482106924057007, 'average_primary_affinity': 0.8500000238418579, 'average_primary_affinity_weighted': 0.8500000238418579}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-12T16:15:55.082975+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 36, 'snap_epoch': 97, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.8482106924057007, 'average_primary_affinity': 0.8500000238418579, 'average_primary_affinity_weighted': 0.8500000238418579}}], 'osds': [{'osd': 0, 'uuid': 'aabea24b-3f1f-4555-80c3-5caecf2e2001', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 11, 'up_thru': 84, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6800', 'nonce': 1385915755}, {'type': 'v1', 'addr': '172.21.15.17:6801', 'nonce': 1385915755}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6802', 'nonce': 1385915755}, {'type': 'v1', 'addr': '172.21.15.17:6803', 'nonce': 1385915755}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6806', 'nonce': 1385915755}, {'type': 'v1', 'addr': '172.21.15.17:6807', 'nonce': 1385915755}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6804', 'nonce': 1385915755}, {'type': 'v1', 'addr': '172.21.15.17:6805', 'nonce': 1385915755}]}, 'public_addr': '172.21.15.17:6801/1385915755', 'cluster_addr': '172.21.15.17:6803/1385915755', 'heartbeat_back_addr': '172.21.15.17:6807/1385915755', 'heartbeat_front_addr': '172.21.15.17:6805/1385915755', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '7a17ca3b-8e49-4d92-a633-45d3e4a45b4e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 11, 'up_thru': 74, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6808', 'nonce': 3906173234}, {'type': 'v1', 'addr': '172.21.15.17:6809', 'nonce': 3906173234}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6810', 'nonce': 3906173234}, {'type': 'v1', 'addr': '172.21.15.17:6811', 'nonce': 3906173234}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6814', 'nonce': 3906173234}, {'type': 'v1', 'addr': '172.21.15.17:6815', 'nonce': 3906173234}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6812', 'nonce': 3906173234}, {'type': 'v1', 'addr': '172.21.15.17:6813', 'nonce': 3906173234}]}, 'public_addr': '172.21.15.17:6809/3906173234', 'cluster_addr': '172.21.15.17:6811/3906173234', 'heartbeat_back_addr': '172.21.15.17:6815/3906173234', 'heartbeat_front_addr': '172.21.15.17:6813/3906173234', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'dae09a32-24c6-464c-bee8-04ef2c42f7e4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 11, 'up_thru': 84, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6816', 'nonce': 1974346628}, {'type': 'v1', 'addr': '172.21.15.17:6817', 'nonce': 1974346628}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6818', 'nonce': 1974346628}, {'type': 'v1', 'addr': '172.21.15.17:6819', 'nonce': 1974346628}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6822', 'nonce': 1974346628}, {'type': 'v1', 'addr': '172.21.15.17:6823', 'nonce': 1974346628}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6820', 'nonce': 1974346628}, {'type': 'v1', 'addr': '172.21.15.17:6821', 'nonce': 1974346628}]}, 'public_addr': '172.21.15.17:6817/1974346628', 'cluster_addr': '172.21.15.17:6819/1974346628', 'heartbeat_back_addr': '172.21.15.17:6823/1974346628', 'heartbeat_front_addr': '172.21.15.17:6821/1974346628', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '9cc5463c-cdb4-4a6a-b526-39a60de417f4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 11, 'up_thru': 83, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6808', 'nonce': 3370202675}, {'type': 'v1', 'addr': '172.21.15.47:6809', 'nonce': 3370202675}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6810', 'nonce': 3370202675}, {'type': 'v1', 'addr': '172.21.15.47:6811', 'nonce': 3370202675}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6814', 'nonce': 3370202675}, {'type': 'v1', 'addr': '172.21.15.47:6815', 'nonce': 3370202675}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6812', 'nonce': 3370202675}, {'type': 'v1', 'addr': '172.21.15.47:6813', 'nonce': 3370202675}]}, 'public_addr': '172.21.15.47:6809/3370202675', 'cluster_addr': '172.21.15.47:6811/3370202675', 'heartbeat_back_addr': '172.21.15.47:6815/3370202675', 'heartbeat_front_addr': '172.21.15.47:6813/3370202675', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '1e329af3-a88a-4a95-b822-01519079084b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 11, 'up_thru': 74, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6816', 'nonce': 1823488259}, {'type': 'v1', 'addr': '172.21.15.47:6817', 'nonce': 1823488259}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6818', 'nonce': 1823488259}, {'type': 'v1', 'addr': '172.21.15.47:6819', 'nonce': 1823488259}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6822', 'nonce': 1823488259}, {'type': 'v1', 'addr': '172.21.15.47:6823', 'nonce': 1823488259}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6820', 'nonce': 1823488259}, {'type': 'v1', 'addr': '172.21.15.47:6821', 'nonce': 1823488259}]}, 'public_addr': '172.21.15.47:6817/1823488259', 'cluster_addr': '172.21.15.47:6819/1823488259', 'heartbeat_back_addr': '172.21.15.47:6823/1823488259', 'heartbeat_front_addr': '172.21.15.47:6821/1823488259', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'c255a252-3afe-4aad-b44c-85820867c960', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.089263916015625, 'last_clean_begin': 11, 'last_clean_end': 35, 'up_from': 71, 'up_thru': 32, 'down_at': 37, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6800', 'nonce': 2087971028}, {'type': 'v1', 'addr': '172.21.15.47:6801', 'nonce': 2087971028}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6802', 'nonce': 2087971028}, {'type': 'v1', 'addr': '172.21.15.47:6803', 'nonce': 2087971028}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6806', 'nonce': 2087971028}, {'type': 'v1', 'addr': '172.21.15.47:6807', 'nonce': 2087971028}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6804', 'nonce': 2087971028}, {'type': 'v1', 'addr': '172.21.15.47:6805', 'nonce': 2087971028}]}, 'public_addr': '172.21.15.47:6801/2087971028', 'cluster_addr': '172.21.15.47:6803/2087971028', 'heartbeat_back_addr': '172.21.15.47:6807/2087971028', 'heartbeat_front_addr': '172.21.15.47:6805/2087971028', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T16:15:35.752566+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T16:15:36.269665+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T16:15:36.524745+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T16:15:36.095607+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T16:15:36.294055+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T16:15:36.092708+0000', 'dead_epoch': 37}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T16:17:39.899 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T16:17:39.899 INFO:teuthology.orchestra.run.smithi204.stdout:5062 write 0xc0fea00 thru 0xc101ab3 (0x30b4 bytes) 2024-09-12T16:17:39.899 INFO:teuthology.orchestra.run.smithi204.stdout:5064 read 0x7dafa00 thru 0x7db6560 (0x6b61 bytes) 2024-09-12T16:17:39.899 INFO:teuthology.orchestra.run.smithi204.stdout:5065 read 0x761f400 thru 0x762c024 (0xcc25 bytes) 2024-09-12T16:17:39.899 INFO:teuthology.orchestra.run.smithi204.stdout:5069 punch from 0x9815800 to 0x981ea00, (0x9200 bytes) 2024-09-12T16:17:39.900 INFO:teuthology.orchestra.run.smithi204.stdout:5070 write 0xac2f600 thru 0xac3df2f (0xe930 bytes) 2024-09-12T16:17:39.900 INFO:teuthology.orchestra.run.smithi204.stdout:5071 write 0xea3f000 thru 0xea45415 (0x6416 bytes) 2024-09-12T16:17:39.900 INFO:teuthology.orchestra.run.smithi204.stdout:5078 read 0x4e5c200 thru 0x4e6658f (0xa390 bytes) 2024-09-12T16:17:39.900 INFO:teuthology.orchestra.run.smithi204.stdout:5079 trunc from 0xea45600 to 0x127f200 2024-09-12T16:17:39.900 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:39.895+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:39.952 INFO:teuthology.orchestra.run.smithi204.stdout:5082 write 0xb285c00 thru 0xb288f66 (0x3367 bytes) 2024-09-12T16:17:39.952 INFO:teuthology.orchestra.run.smithi204.stdout:5087 write 0x9fe5800 thru 0x9ff0a6a (0xb26b bytes) 2024-09-12T16:17:39.952 INFO:teuthology.orchestra.run.smithi204.stdout:5088 read 0x33d8e00 thru 0x33db28f (0x2490 bytes) 2024-09-12T16:17:39.963 INFO:teuthology.orchestra.run.smithi204.stdout:5089 trunc from 0xb289000 to 0x27b9a00 2024-09-12T16:17:39.995 INFO:teuthology.orchestra.run.smithi204.stdout:5090 trunc from 0x27b9a00 to 0x1bf9e00 2024-09-12T16:17:39.997 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:39.996+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:40.009 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:40.009 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:40.009 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:17:40.009 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:17:40.009 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:40.009 INFO:teuthology.orchestra.run.smithi204.stdout:5091 punch from 0x10fc800 to 0x1106c00, (0xa400 bytes) 2024-09-12T16:17:40.011 INFO:teuthology.orchestra.run.smithi204.stdout:5093 read 0x825a00 thru 0x82a7ca (0x4dcb bytes) 2024-09-12T16:17:40.019 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:17:40.033 INFO:teuthology.orchestra.run.smithi204.stdout:5094 write 0xa61d000 thru 0xa61e1de (0x11df bytes) 2024-09-12T16:17:40.034 INFO:teuthology.orchestra.run.smithi204.stdout:5096 read 0x3e15200 thru 0x3e1cf4f (0x7d50 bytes) 2024-09-12T16:17:40.034 INFO:teuthology.orchestra.run.smithi204.stdout:5097 read 0x5128c00 thru 0x5131a2e (0x8e2f bytes) 2024-09-12T16:17:40.034 INFO:teuthology.orchestra.run.smithi204.stdout:5099 write 0x8e76a00 thru 0x8e8345f (0xca60 bytes) 2024-09-12T16:17:40.034 INFO:teuthology.orchestra.run.smithi204.stdout:5100 punch from 0x59aa200 to 0x59b6e00, (0xcc00 bytes) 2024-09-12T16:17:40.035 INFO:teuthology.orchestra.run.smithi204.stdout:5103 read 0x6887200 thru 0x6896552 (0xf353 bytes) 2024-09-12T16:17:40.036 INFO:teuthology.orchestra.run.smithi204.stdout:5104 trunc from 0xa61e200 to 0xacd0c00 2024-09-12T16:17:40.062 INFO:teuthology.orchestra.run.smithi204.stdout:5105 read 0x152fa00 thru 0x15378c2 (0x7ec3 bytes) 2024-09-12T16:17:40.063 INFO:teuthology.orchestra.run.smithi204.stdout:5106 write 0x6aaaa00 thru 0x6ab2ba5 (0x81a6 bytes) 2024-09-12T16:17:40.063 INFO:teuthology.orchestra.run.smithi204.stdout:5107 write 0x685b600 thru 0x68664bc (0xaebd bytes) 2024-09-12T16:17:40.063 INFO:teuthology.orchestra.run.smithi204.stdout:5110 read 0x8269a00 thru 0x8276acc (0xd0cd bytes) 2024-09-12T16:17:40.096 INFO:teuthology.orchestra.run.smithi204.stdout:5111 write 0xe8e4600 thru 0xe8f018e (0xbb8f bytes) 2024-09-12T16:17:40.096 INFO:teuthology.orchestra.run.smithi204.stdout:5112 write 0x2656000 thru 0x2665836 (0xf837 bytes) 2024-09-12T16:17:40.102 INFO:teuthology.orchestra.run.smithi204.stdout:5113 trunc from 0xe8f0200 to 0x9e1f200 2024-09-12T16:17:40.102 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:40.101+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:40.140 INFO:teuthology.orchestra.run.smithi204.stdout:5115 trunc from 0x9e1f200 to 0xc850000 2024-09-12T16:17:40.148 INFO:teuthology.orchestra.run.smithi204.stdout:5116 write 0x21c00 thru 0x24cbc (0x30bd bytes) 2024-09-12T16:17:40.152 INFO:teuthology.orchestra.run.smithi204.stdout:5118 write 0x7448c00 thru 0x744b829 (0x2c2a bytes) 2024-09-12T16:17:40.152 INFO:teuthology.orchestra.run.smithi204.stdout:5121 read 0x5dd6000 thru 0x5dd6290 (0x291 bytes) 2024-09-12T16:17:40.154 INFO:teuthology.orchestra.run.smithi204.stdout:5122 read 0x2ec4400 thru 0x2ece8e1 (0xa4e2 bytes) 2024-09-12T16:17:40.154 INFO:teuthology.orchestra.run.smithi204.stdout:5123 read 0xbcb1e00 thru 0xbcbdc83 (0xbe84 bytes) 2024-09-12T16:17:40.154 INFO:teuthology.orchestra.run.smithi204.stdout:5124 write 0x30cec00 thru 0x30cf81a (0xc1b bytes) 2024-09-12T16:17:40.154 INFO:teuthology.orchestra.run.smithi204.stdout:5128 punch from 0x848f000 to 0x848f600, (0x600 bytes) 2024-09-12T16:17:40.155 INFO:teuthology.orchestra.run.smithi204.stdout:5129 read 0x33c8000 thru 0x33d3847 (0xb848 bytes) 2024-09-12T16:17:40.155 INFO:teuthology.orchestra.run.smithi204.stdout:5131 read 0x542b800 thru 0x543b7d5 (0xffd6 bytes) 2024-09-12T16:17:40.168 INFO:teuthology.orchestra.run.smithi204.stdout:5136 trunc from 0xc850000 to 0x1dd5200 2024-09-12T16:17:40.187 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:40.188 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:17:40.188 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:17:40.188 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:17:40.188 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.188 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5599 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4788224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:40.188 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:17:40.188 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 59.889845495000003, 2024-09-12T16:17:40.188 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061192059, 2024-09-12T16:17:40.188 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:40.189 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:40.189 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:40.189 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:40.189 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:40.189 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:40.189 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5599 2024-09-12T16:17:40.189 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.189 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:40.189 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.189 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:40.189 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:17:40.189 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.189 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.190 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.190 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:40.190 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:17:40.190 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.190 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.190 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:40.190 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296333+0000", 2024-09-12T16:17:40.190 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6599999999999996e-07 2024-09-12T16:17:40.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.190 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.190 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:40.190 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296335+0000", 2024-09-12T16:17:40.190 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5900000000000002e-06 2024-09-12T16:17:40.191 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.191 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.191 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:40.191 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296344+0000", 2024-09-12T16:17:40.191 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9539999999999993e-06 2024-09-12T16:17:40.191 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.191 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.191 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:40.191 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296350+0000", 2024-09-12T16:17:40.191 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5589999999999996e-06 2024-09-12T16:17:40.191 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.192 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.192 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:40.192 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357307+0000", 2024-09-12T16:17:40.192 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.060957573000000001 2024-09-12T16:17:40.192 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.192 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.192 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:40.192 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357401+0000", 2024-09-12T16:17:40.192 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3512999999999997e-05 2024-09-12T16:17:40.192 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.192 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.192 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:40.192 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357524+0000", 2024-09-12T16:17:40.193 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000123304 2024-09-12T16:17:40.193 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.193 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:40.193 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.193 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.193 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5611 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4730880~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:40.193 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:17:40.193 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 59.889783051000002, 2024-09-12T16:17:40.193 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061359348000000001, 2024-09-12T16:17:40.193 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:40.193 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:40.193 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:40.193 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:40.194 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:40.194 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:40.194 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5611 2024-09-12T16:17:40.194 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.194 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:40.194 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.194 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:40.194 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:17:40.194 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.194 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.194 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.194 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:40.194 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:17:40.194 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:40.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296395+0000", 2024-09-12T16:17:40.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4600000000000003e-07 2024-09-12T16:17:40.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:40.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296399+0000", 2024-09-12T16:17:40.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9430000000000002e-06 2024-09-12T16:17:40.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:40.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296411+0000", 2024-09-12T16:17:40.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1755e-05 2024-09-12T16:17:40.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.196 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:40.196 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296417+0000", 2024-09-12T16:17:40.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3790000000000003e-06 2024-09-12T16:17:40.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.196 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:40.196 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357572+0000", 2024-09-12T16:17:40.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061154871 2024-09-12T16:17:40.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.196 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:40.197 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357663+0000", 2024-09-12T16:17:40.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0389999999999993e-05 2024-09-12T16:17:40.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.197 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.197 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:40.197 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357754+0000", 2024-09-12T16:17:40.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1063999999999994e-05 2024-09-12T16:17:40.197 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.197 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:40.197 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.197 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.197 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5613 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4775936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:40.197 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:40.198 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 59.889741870999998, 2024-09-12T16:17:40.198 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061491777999999997, 2024-09-12T16:17:40.198 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:40.198 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:40.198 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:40.198 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:40.198 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:40.198 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:40.198 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5613 2024-09-12T16:17:40.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.198 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:40.198 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.198 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:40.198 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:40.198 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:40.199 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:40.199 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:40.199 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:40.199 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8899999999999999e-07 2024-09-12T16:17:40.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:40.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296439+0000", 2024-09-12T16:17:40.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8439999999999998e-06 2024-09-12T16:17:40.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:40.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296452+0000", 2024-09-12T16:17:40.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2639e-05 2024-09-12T16:17:40.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:40.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296457+0000", 2024-09-12T16:17:40.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5720000000000002e-06 2024-09-12T16:17:40.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.201 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:40.201 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357773+0000", 2024-09-12T16:17:40.201 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061315500000000002 2024-09-12T16:17:40.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.201 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.201 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:40.201 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357814+0000", 2024-09-12T16:17:40.201 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1448e-05 2024-09-12T16:17:40.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.201 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.201 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:40.201 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357927+0000", 2024-09-12T16:17:40.201 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000113186 2024-09-12T16:17:40.201 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.202 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:40.202 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.202 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.202 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.202 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5616 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4784128~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:40.202 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:40.202 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 59.889706809000003, 2024-09-12T16:17:40.202 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061725002000000001, 2024-09-12T16:17:40.202 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:40.202 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:40.202 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:40.202 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:40.202 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:40.202 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:40.202 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5616 2024-09-12T16:17:40.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.203 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:40.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:40.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:40.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:40.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:40.204 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.204 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.204 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:40.204 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:40.204 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5900000000000002e-07 2024-09-12T16:17:40.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.204 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.204 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:40.204 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296473+0000", 2024-09-12T16:17:40.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3130000000000001e-06 2024-09-12T16:17:40.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.205 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:40.205 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296481+0000", 2024-09-12T16:17:40.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1389999999999998e-06 2024-09-12T16:17:40.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.205 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:40.205 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296486+0000", 2024-09-12T16:17:40.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3310000000000003e-06 2024-09-12T16:17:40.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.206 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:40.206 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357981+0000", 2024-09-12T16:17:40.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061494866000000002 2024-09-12T16:17:40.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.206 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.206 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:40.206 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358082+0000", 2024-09-12T16:17:40.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101424 2024-09-12T16:17:40.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.206 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.206 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:40.207 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358196+0000", 2024-09-12T16:17:40.207 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011347 2024-09-12T16:17:40.207 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.207 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:40.207 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.207 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5626 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4739072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:40.207 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:17:40.207 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 59.889628852999998, 2024-09-12T16:17:40.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061802430999999998, 2024-09-12T16:17:40.208 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:40.208 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:40.208 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:40.208 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:40.208 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:40.208 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:40.208 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5626 2024-09-12T16:17:40.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.208 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:40.208 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.208 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:40.208 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:17:40.209 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:40.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:17:40.209 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:40.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296550+0000", 2024-09-12T16:17:40.209 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.215e-06 2024-09-12T16:17:40.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:40.210 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296555+0000", 2024-09-12T16:17:40.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9590000000000003e-06 2024-09-12T16:17:40.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.210 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.210 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:40.210 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296568+0000", 2024-09-12T16:17:40.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3338e-05 2024-09-12T16:17:40.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.210 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.210 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:40.210 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296576+0000", 2024-09-12T16:17:40.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5510000000000002e-06 2024-09-12T16:17:40.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.210 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.210 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:40.211 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358241+0000", 2024-09-12T16:17:40.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.06166576 2024-09-12T16:17:40.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.211 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:40.211 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358288+0000", 2024-09-12T16:17:40.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6097000000000003e-05 2024-09-12T16:17:40.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.211 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:40.211 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358351+0000", 2024-09-12T16:17:40.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3510999999999996e-05 2024-09-12T16:17:40.211 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.212 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:40.212 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.212 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5628 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4792320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:40.212 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:17:40.212 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 59.889586352999999, 2024-09-12T16:17:40.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061961161000000001, 2024-09-12T16:17:40.212 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:40.212 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:40.212 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:40.212 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:40.212 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:40.212 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:40.213 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5628 2024-09-12T16:17:40.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.213 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:40.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.213 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:40.213 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:17:40.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.213 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:40.213 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:17:40.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.214 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:40.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296592+0000", 2024-09-12T16:17:40.214 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2099999999999996e-07 2024-09-12T16:17:40.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.214 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.214 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:40.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296595+0000", 2024-09-12T16:17:40.214 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0429999999999999e-06 2024-09-12T16:17:40.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.214 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.214 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:40.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296603+0000", 2024-09-12T16:17:40.214 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9899999999999997e-06 2024-09-12T16:17:40.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.215 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:40.215 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296609+0000", 2024-09-12T16:17:40.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7259999999999999e-06 2024-09-12T16:17:40.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.215 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:40.215 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358393+0000", 2024-09-12T16:17:40.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061784617 2024-09-12T16:17:40.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.215 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:40.216 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358460+0000", 2024-09-12T16:17:40.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7253000000000001e-05 2024-09-12T16:17:40.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.216 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:40.216 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358552+0000", 2024-09-12T16:17:40.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1811000000000006e-05 2024-09-12T16:17:40.216 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.216 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:40.216 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.216 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5638 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4734976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:40.216 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:40.217 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 59.889113801999997, 2024-09-12T16:17:40.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061654460000000001, 2024-09-12T16:17:40.217 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:40.217 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:40.217 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:40.217 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:40.217 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:40.217 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:40.217 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5638 2024-09-12T16:17:40.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.217 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:40.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:40.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:40.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:40.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:40.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:40.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:40.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.23e-07 2024-09-12T16:17:40.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:40.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297068+0000", 2024-09-12T16:17:40.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0060000000000003e-06 2024-09-12T16:17:40.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:40.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297080+0000", 2024-09-12T16:17:40.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1234e-05 2024-09-12T16:17:40.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:40.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297095+0000", 2024-09-12T16:17:40.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5698000000000001e-05 2024-09-12T16:17:40.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:40.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358582+0000", 2024-09-12T16:17:40.220 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061486274 2024-09-12T16:17:40.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.220 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.220 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:40.220 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358637+0000", 2024-09-12T16:17:40.220 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5439999999999998e-05 2024-09-12T16:17:40.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.220 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.220 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:40.220 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358718+0000", 2024-09-12T16:17:40.220 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0984999999999998e-05 2024-09-12T16:17:40.220 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.221 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:40.221 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.221 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.221 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5640 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4780032~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:40.221 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:17:40.221 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 59.889032082, 2024-09-12T16:17:40.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061746620000000002, 2024-09-12T16:17:40.221 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:40.221 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:40.221 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:40.221 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:40.222 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:40.222 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:40.222 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5640 2024-09-12T16:17:40.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.222 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:40.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:40.222 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:17:40.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:40.222 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:17:40.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:40.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297146+0000", 2024-09-12T16:17:40.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3600000000000003e-07 2024-09-12T16:17:40.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:40.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297150+0000", 2024-09-12T16:17:40.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8430000000000003e-06 2024-09-12T16:17:40.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:40.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297160+0000", 2024-09-12T16:17:40.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7229999999999999e-06 2024-09-12T16:17:40.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:40.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297167+0000", 2024-09-12T16:17:40.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0180000000000004e-06 2024-09-12T16:17:40.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:40.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358750+0000", 2024-09-12T16:17:40.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061583104 2024-09-12T16:17:40.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:40.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358804+0000", 2024-09-12T16:17:40.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4277000000000002e-05 2024-09-12T16:17:40.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:40.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358892+0000", 2024-09-12T16:17:40.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7918999999999996e-05 2024-09-12T16:17:40.225 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.225 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:40.225 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.225 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5642 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4788224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:40.226 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:40.226 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 59.888987737999997, 2024-09-12T16:17:40.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061860409999999998, 2024-09-12T16:17:40.226 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:40.226 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:40.226 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:40.226 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:40.226 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:40.226 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:40.226 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5642 2024-09-12T16:17:40.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.226 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:40.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:40.227 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:40.227 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.227 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.227 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:40.227 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:40.227 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.227 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.227 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:40.227 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:40.227 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7999999999999995e-07 2024-09-12T16:17:40.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.227 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.227 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:40.228 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297193+0000", 2024-09-12T16:17:40.228 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8310000000000001e-06 2024-09-12T16:17:40.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.228 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:40.228 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297204+0000", 2024-09-12T16:17:40.228 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0832999999999999e-05 2024-09-12T16:17:40.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.228 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:40.228 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297210+0000", 2024-09-12T16:17:40.228 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1770000000000003e-06 2024-09-12T16:17:40.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:40.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358928+0000", 2024-09-12T16:17:40.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061717826000000003 2024-09-12T16:17:40.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:40.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358977+0000", 2024-09-12T16:17:40.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9514000000000001e-05 2024-09-12T16:17:40.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:40.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359050+0000", 2024-09-12T16:17:40.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2649000000000002e-05 2024-09-12T16:17:40.230 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.230 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:40.230 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.230 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5646 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4743168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:40.230 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:40.230 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 59.888807796999998, 2024-09-12T16:17:40.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061822122, 2024-09-12T16:17:40.230 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:40.230 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:40.230 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:40.231 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:40.231 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:40.231 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:40.231 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5646 2024-09-12T16:17:40.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.231 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:40.231 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.231 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:40.231 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:40.231 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.231 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.231 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:40.231 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:40.232 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:40.232 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:40.232 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3200000000000004e-07 2024-09-12T16:17:40.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:40.232 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297374+0000", 2024-09-12T16:17:40.232 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8240000000000001e-06 2024-09-12T16:17:40.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:40.233 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297384+0000", 2024-09-12T16:17:40.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5710000000000004e-06 2024-09-12T16:17:40.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.233 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:40.233 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297390+0000", 2024-09-12T16:17:40.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5130000000000002e-06 2024-09-12T16:17:40.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.233 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:40.233 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359080+0000", 2024-09-12T16:17:40.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061689569999999999 2024-09-12T16:17:40.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.234 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.234 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:40.234 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359134+0000", 2024-09-12T16:17:40.234 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3838999999999997e-05 2024-09-12T16:17:40.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.234 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.234 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:40.234 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359192+0000", 2024-09-12T16:17:40.234 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8072999999999998e-05 2024-09-12T16:17:40.234 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.234 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:40.234 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.235 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.235 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5647 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4751360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:40.235 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:17:40.235 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 59.888771112000001, 2024-09-12T16:17:40.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061927569000000002, 2024-09-12T16:17:40.235 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:40.235 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:40.235 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:40.235 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:40.235 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:40.235 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:40.235 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5647 2024-09-12T16:17:40.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.236 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:40.236 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.236 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:40.236 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:17:40.236 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.236 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.236 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.236 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:40.236 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:17:40.236 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.236 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.236 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.236 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:40.237 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297407+0000", 2024-09-12T16:17:40.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.46e-07 2024-09-12T16:17:40.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.237 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.237 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:40.237 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297409+0000", 2024-09-12T16:17:40.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.469e-06 2024-09-12T16:17:40.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.237 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.237 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:40.237 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297415+0000", 2024-09-12T16:17:40.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9259999999999997e-06 2024-09-12T16:17:40.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.238 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:40.238 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297419+0000", 2024-09-12T16:17:40.238 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3840000000000001e-06 2024-09-12T16:17:40.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.238 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:40.238 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359224+0000", 2024-09-12T16:17:40.238 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061805367999999999 2024-09-12T16:17:40.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.238 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:40.238 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359275+0000", 2024-09-12T16:17:40.238 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1338000000000002e-05 2024-09-12T16:17:40.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.239 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:40.239 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359334+0000", 2024-09-12T16:17:40.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8638000000000003e-05 2024-09-12T16:17:40.239 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.239 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:40.239 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.239 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5649 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4796416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:40.239 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:17:40.239 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 59.888716252999998, 2024-09-12T16:17:40.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.062018578999999997, 2024-09-12T16:17:40.240 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:40.240 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:40.240 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:40.240 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:40.240 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:40.240 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:40.240 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5649 2024-09-12T16:17:40.240 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.240 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:40.240 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.241 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:40.241 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:17:40.241 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.241 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.241 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.241 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:40.241 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:17:40.241 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.241 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.241 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.241 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:40.241 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297462+0000", 2024-09-12T16:17:40.241 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2399999999999998e-07 2024-09-12T16:17:40.241 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.242 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.242 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:40.242 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297465+0000", 2024-09-12T16:17:40.242 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.371e-06 2024-09-12T16:17:40.242 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.242 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.242 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:40.242 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297473+0000", 2024-09-12T16:17:40.242 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4699999999999996e-06 2024-09-12T16:17:40.242 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.242 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.243 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:40.243 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297478+0000", 2024-09-12T16:17:40.243 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2780000000000001e-06 2024-09-12T16:17:40.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.243 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:40.243 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359368+0000", 2024-09-12T16:17:40.243 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061889758000000003 2024-09-12T16:17:40.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.244 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:40.244 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359420+0000", 2024-09-12T16:17:40.244 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2574999999999997e-05 2024-09-12T16:17:40.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.244 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.244 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:40.244 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359480+0000", 2024-09-12T16:17:40.244 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9503000000000003e-05 2024-09-12T16:17:40.244 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.244 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:40.245 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.245 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.245 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5674 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4739072~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:40.245 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:17:40.245 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 59.888312485, 2024-09-12T16:17:40.245 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061762989999999997, 2024-09-12T16:17:40.245 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:40.245 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:40.245 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:40.245 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:40.245 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:40.246 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:40.246 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5674 2024-09-12T16:17:40.246 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.246 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:40.246 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.246 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:40.246 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:17:40.246 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.246 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.246 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.246 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:40.246 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:17:40.246 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.247 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:40.247 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297866+0000", 2024-09-12T16:17:40.247 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1900000000000001e-07 2024-09-12T16:17:40.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.247 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:40.247 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297870+0000", 2024-09-12T16:17:40.247 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3560000000000003e-06 2024-09-12T16:17:40.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.247 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:40.248 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297888+0000", 2024-09-12T16:17:40.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8088999999999999e-05 2024-09-12T16:17:40.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.248 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.248 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:40.248 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297904+0000", 2024-09-12T16:17:40.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5971e-05 2024-09-12T16:17:40.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.248 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.248 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:40.248 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359510+0000", 2024-09-12T16:17:40.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061605634999999999 2024-09-12T16:17:40.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.249 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:40.249 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359554+0000", 2024-09-12T16:17:40.249 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4024999999999999e-05 2024-09-12T16:17:40.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.249 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:40.249 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359628+0000", 2024-09-12T16:17:40.249 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4095000000000001e-05 2024-09-12T16:17:40.249 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.249 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:40.249 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.250 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5676 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4792320~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:40.250 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:17:40.250 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 59.888111404999997, 2024-09-12T16:17:40.250 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061720143999999998, 2024-09-12T16:17:40.250 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:40.250 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:40.250 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:40.250 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:40.250 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:40.250 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:40.250 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5676 2024-09-12T16:17:40.250 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.250 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:40.250 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.251 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:40.251 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:17:40.251 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.251 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.251 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:40.251 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:17:40.251 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.251 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.251 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:40.251 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298067+0000", 2024-09-12T16:17:40.251 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8199999999999999e-07 2024-09-12T16:17:40.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.251 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:40.252 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298070+0000", 2024-09-12T16:17:40.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.743e-06 2024-09-12T16:17:40.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:40.252 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298080+0000", 2024-09-12T16:17:40.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4059999999999994e-06 2024-09-12T16:17:40.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:40.252 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298088+0000", 2024-09-12T16:17:40.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0779999999999996e-06 2024-09-12T16:17:40.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:40.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359659+0000", 2024-09-12T16:17:40.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061570688999999998 2024-09-12T16:17:40.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:40.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359713+0000", 2024-09-12T16:17:40.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3939e-05 2024-09-12T16:17:40.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:40.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359786+0000", 2024-09-12T16:17:40.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3607000000000002e-05 2024-09-12T16:17:40.254 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.254 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:40.254 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.254 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.254 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.254 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5684 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4747264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:40.254 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:17:40.254 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 59.887644113, 2024-09-12T16:17:40.254 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061394799, 2024-09-12T16:17:40.254 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:40.254 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:40.254 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:40.254 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:40.255 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:40.255 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:40.255 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5684 2024-09-12T16:17:40.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.255 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:40.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.255 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:40.255 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:17:40.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.255 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:40.255 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:17:40.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.256 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:40.256 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298534+0000", 2024-09-12T16:17:40.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4399999999999999e-07 2024-09-12T16:17:40.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.256 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:40.256 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298539+0000", 2024-09-12T16:17:40.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5360000000000003e-06 2024-09-12T16:17:40.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.257 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:40.257 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298550+0000", 2024-09-12T16:17:40.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1499e-05 2024-09-12T16:17:40.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.257 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:40.257 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298558+0000", 2024-09-12T16:17:40.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3000000000000004e-06 2024-09-12T16:17:40.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.257 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:40.257 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359815+0000", 2024-09-12T16:17:40.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061257952999999997 2024-09-12T16:17:40.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.258 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:40.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359868+0000", 2024-09-12T16:17:40.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2317000000000001e-05 2024-09-12T16:17:40.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.258 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:40.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359928+0000", 2024-09-12T16:17:40.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0350000000000003e-05 2024-09-12T16:17:40.258 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.259 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:40.259 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.259 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5686 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4755456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:40.259 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:17:40.259 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 59.887476689000003, 2024-09-12T16:17:40.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061355082999999998, 2024-09-12T16:17:40.259 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:40.259 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:40.259 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:40.259 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:40.260 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:40.260 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:40.260 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5686 2024-09-12T16:17:40.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.260 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:40.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.260 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:40.260 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:17:40.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.261 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:40.261 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:17:40.261 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.261 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:40.261 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298702+0000", 2024-09-12T16:17:40.261 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2399999999999997e-07 2024-09-12T16:17:40.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.261 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:40.261 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298706+0000", 2024-09-12T16:17:40.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5700000000000003e-06 2024-09-12T16:17:40.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:40.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298718+0000", 2024-09-12T16:17:40.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1457999999999999e-05 2024-09-12T16:17:40.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:40.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298732+0000", 2024-09-12T16:17:40.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.452e-05 2024-09-12T16:17:40.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:40.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359956+0000", 2024-09-12T16:17:40.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061223626000000003 2024-09-12T16:17:40.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.263 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.263 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:40.263 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360000+0000", 2024-09-12T16:17:40.263 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3922999999999999e-05 2024-09-12T16:17:40.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.263 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.263 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:40.263 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360056+0000", 2024-09-12T16:17:40.263 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6162000000000002e-05 2024-09-12T16:17:40.263 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.263 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:40.263 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.264 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5688 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4800512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:40.264 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:17:40.264 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 59.887253635999997, 2024-09-12T16:17:40.264 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061270514999999998, 2024-09-12T16:17:40.264 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:40.264 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:40.264 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:40.264 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:40.264 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:40.264 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:40.264 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5688 2024-09-12T16:17:40.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.265 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:40.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:40.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:17:40.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:40.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:17:40.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:40.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298925+0000", 2024-09-12T16:17:40.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4e-07 2024-09-12T16:17:40.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:40.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298929+0000", 2024-09-12T16:17:40.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9890000000000003e-06 2024-09-12T16:17:40.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:40.267 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298936+0000", 2024-09-12T16:17:40.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.52e-06 2024-09-12T16:17:40.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.267 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:40.267 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298941+0000", 2024-09-12T16:17:40.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4800000000000003e-06 2024-09-12T16:17:40.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.267 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:40.267 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360087+0000", 2024-09-12T16:17:40.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061146143 2024-09-12T16:17:40.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.267 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:40.268 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360137+0000", 2024-09-12T16:17:40.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0584000000000002e-05 2024-09-12T16:17:40.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.268 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.268 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:40.268 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360194+0000", 2024-09-12T16:17:40.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6858999999999999e-05 2024-09-12T16:17:40.268 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.268 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:40.268 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.268 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.269 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5693 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4751360~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:40.269 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:17:40.269 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 59.886831999000002, 2024-09-12T16:17:40.269 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061139444000000001, 2024-09-12T16:17:40.269 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:40.269 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:40.269 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:40.269 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:40.269 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:40.269 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:40.269 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5693 2024-09-12T16:17:40.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.269 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:40.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.270 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:40.270 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:17:40.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.270 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:40.270 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:17:40.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.271 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:40.271 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299346+0000", 2024-09-12T16:17:40.271 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2300000000000001e-07 2024-09-12T16:17:40.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.271 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:40.271 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299349+0000", 2024-09-12T16:17:40.271 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5270000000000001e-06 2024-09-12T16:17:40.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.271 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:40.271 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299358+0000", 2024-09-12T16:17:40.271 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7030000000000001e-06 2024-09-12T16:17:40.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.272 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.272 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:40.272 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299364+0000", 2024-09-12T16:17:40.272 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7239999999999997e-06 2024-09-12T16:17:40.272 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.272 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.272 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:40.272 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360369+0000", 2024-09-12T16:17:40.272 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061004713000000002 2024-09-12T16:17:40.272 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.272 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.272 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:40.272 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360415+0000", 2024-09-12T16:17:40.273 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5926e-05 2024-09-12T16:17:40.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.273 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:40.273 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360485+0000", 2024-09-12T16:17:40.273 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0327999999999995e-05 2024-09-12T16:17:40.273 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.273 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:40.273 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.273 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5694 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4796416~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:40.273 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:17:40.274 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 59.886802969999998, 2024-09-12T16:17:40.274 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061258034000000003, 2024-09-12T16:17:40.274 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:40.274 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:40.274 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:40.274 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:40.274 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:40.274 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:40.274 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5694 2024-09-12T16:17:40.274 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.275 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:40.275 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.275 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:40.275 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:17:40.275 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.275 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.276 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.276 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:40.276 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:17:40.276 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.276 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.276 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.276 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:40.277 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301884+0000", 2024-09-12T16:17:40.277 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025090379999999999 2024-09-12T16:17:40.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.277 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.277 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:40.277 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301889+0000", 2024-09-12T16:17:40.277 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5879999999999997e-06 2024-09-12T16:17:40.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.277 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.278 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:40.278 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301901+0000", 2024-09-12T16:17:40.278 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1466e-05 2024-09-12T16:17:40.278 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.278 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.278 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:40.278 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301908+0000", 2024-09-12T16:17:40.278 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1999999999999997e-06 2024-09-12T16:17:40.279 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.279 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.279 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:40.279 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360513+0000", 2024-09-12T16:17:40.279 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.058605023999999999 2024-09-12T16:17:40.279 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.279 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.279 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:40.279 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360562+0000", 2024-09-12T16:17:40.279 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9546000000000003e-05 2024-09-12T16:17:40.279 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.279 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.279 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:40.279 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360633+0000", 2024-09-12T16:17:40.280 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0172000000000005e-05 2024-09-12T16:17:40.280 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.280 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:40.280 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.280 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.280 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.280 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5759 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4767744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:40.280 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:17:40.280 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 59.884009435999999, 2024-09-12T16:17:40.280 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061058604000000002, 2024-09-12T16:17:40.280 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:40.280 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:40.280 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:40.280 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:40.280 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:40.281 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:40.281 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5759 2024-09-12T16:17:40.281 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.281 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:40.281 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.281 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:40.281 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:17:40.281 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.281 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.281 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.281 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:40.281 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:17:40.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:40.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.282 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.282 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:40.282 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302548+0000", 2024-09-12T16:17:40.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00038011000000000002 2024-09-12T16:17:40.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.282 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.282 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:40.282 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302553+0000", 2024-09-12T16:17:40.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1830000000000002e-06 2024-09-12T16:17:40.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.282 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.282 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:40.283 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302564+0000", 2024-09-12T16:17:40.283 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1011e-05 2024-09-12T16:17:40.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.283 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.283 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:40.283 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302572+0000", 2024-09-12T16:17:40.283 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9009999999999994e-06 2024-09-12T16:17:40.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.283 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.283 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:40.283 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363102+0000", 2024-09-12T16:17:40.283 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.060529782999999997 2024-09-12T16:17:40.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.283 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.283 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:40.284 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363149+0000", 2024-09-12T16:17:40.284 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7321000000000003e-05 2024-09-12T16:17:40.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:40.284 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:40.284 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:40.284 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363227+0000", 2024-09-12T16:17:40.284 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7294999999999998e-05 2024-09-12T16:17:40.284 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.284 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:40.284 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.284 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:40.284 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:40.284 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:40.285 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T16:17:40.287 INFO:teuthology.orchestra.run.smithi204.stdout:5140 write 0x7f77200 thru 0x7f80697 (0x9498 bytes) 2024-09-12T16:17:40.287 INFO:teuthology.orchestra.run.smithi204.stdout:5143 punch from 0x5be5a00 to 0x5bf4a00, (0xf000 bytes) 2024-09-12T16:17:40.287 INFO:teuthology.orchestra.run.smithi204.stdout:5145 write 0x94b0000 thru 0x94b8798 (0x8799 bytes) 2024-09-12T16:17:40.287 INFO:teuthology.orchestra.run.smithi204.stdout:5147 write 0xca12000 thru 0xca12024 (0x25 bytes) 2024-09-12T16:17:40.287 INFO:teuthology.orchestra.run.smithi204.stdout:5149 read 0x90ba000 thru 0x90c9a72 (0xfa73 bytes) 2024-09-12T16:17:40.288 INFO:teuthology.orchestra.run.smithi204.stdout:5150 trunc from 0xca12200 to 0x9f54000 2024-09-12T16:17:40.288 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:17:40.288 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:40.284+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:40.309 INFO:teuthology.orchestra.run.smithi204.stdout:5151 trunc from 0x9f54000 to 0xae1fa00 2024-09-12T16:17:40.319 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:17:40.320 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-12T16:17:40.327 INFO:teuthology.orchestra.run.smithi204.stdout:5153 trunc from 0xae1fa00 to 0x5863400 2024-09-12T16:17:40.333 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2024-09-12T16:17:38.681139+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1218202354,"num_objects":2009,"num_object_clones":541,"num_object_copies":4018,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2009,"num_whiteouts":779,"num_read":343297,"num_read_kb":1097825,"num_write":18555,"num_write_kb":376559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1847,"num_bytes_recovered":97392206,"num_keys_recovered":249,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15078,"ondisk_log_size":15078,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":695956,"kb_used_data":424036,"kb_used_omap":19,"kb_used_meta":271788,"kb_avail":565535084,"statfs":{"total":579820584960,"available":579107926016,"internally_reserved":0,"allocated":434212864,"data_stored":545812722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19565,"internal_metadata":278311827},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[32,25,59,121],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":93973301,"num_objects":176,"num_object_clones":91,"num_object_copies":352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":176,"num_whiteouts":82,"num_read":29090,"num_read_kb":53052,"num_write":647,"num_write_kb":23834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.350036"},"pg_stats":[{"pgid":"3.1f","version":"94'492","reported_seq":15616,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.589548+0000","last_change":"2024-09-12T16:17:21.013382+0000","last_active":"2024-09-12T16:17:34.589548+0000","last_peered":"2024-09-12T16:17:34.589548+0000","last_clean":"2024-09-12T16:17:34.589548+0000","last_became_active":"2024-09-12T16:17:21.011550+0000","last_became_peered":"2024-09-12T16:17:21.011550+0000","last_unstale":"2024-09-12T16:17:34.589548+0000","last_undegraded":"2024-09-12T16:17:34.589548+0000","last_fullsized":"2024-09-12T16:17:34.589548+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:23.155248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001341074,"stat_sum":{"num_bytes":33138907,"num_objects":63,"num_object_clones":17,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":25,"num_read":15966,"num_read_kb":63180,"num_write":657,"num_write_kb":8605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":2818651,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"95'406","reported_seq":12552,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.495508+0000","last_change":"2024-09-12T16:16:55.203459+0000","last_active":"2024-09-12T16:17:34.495508+0000","last_peered":"2024-09-12T16:17:34.495508+0000","last_clean":"2024-09-12T16:17:34.495508+0000","last_became_active":"2024-09-12T16:16:55.202876+0000","last_became_peered":"2024-09-12T16:16:55.202876+0000","last_unstale":"2024-09-12T16:17:34.495508+0000","last_undegraded":"2024-09-12T16:17:34.495508+0000","last_fullsized":"2024-09-12T16:17:34.495508+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:17.220093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076760299999999995,"stat_sum":{"num_bytes":32514751,"num_objects":83,"num_object_clones":21,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":32,"num_read":12568,"num_read_kb":37927,"num_write":415,"num_write_kb":7296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":3145760,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"94'1292","reported_seq":17439,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.588787+0000","last_change":"2024-09-12T16:17:07.244801+0000","last_active":"2024-09-12T16:17:34.588787+0000","last_peered":"2024-09-12T16:17:34.588787+0000","last_clean":"2024-09-12T16:17:34.588787+0000","last_became_active":"2024-09-12T16:17:07.243733+0000","last_became_peered":"2024-09-12T16:17:07.243733+0000","last_unstale":"2024-09-12T16:17:34.588787+0000","last_undegraded":"2024-09-12T16:17:34.588787+0000","last_fullsized":"2024-09-12T16:17:34.588787+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1292,"log_dups_size":0,"ondisk_log_size":1292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:26.096190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010512060000000001,"stat_sum":{"num_bytes":57911700,"num_objects":76,"num_object_clones":22,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":31,"num_read":20712,"num_read_kb":57220,"num_write":1955,"num_write_kb":15334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":60,"num_bytes_recovered":9304291,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"95'257","reported_seq":2995,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.664092+0000","last_change":"2024-09-12T16:17:07.244095+0000","last_active":"2024-09-12T16:17:34.664092+0000","last_peered":"2024-09-12T16:17:34.664092+0000","last_clean":"2024-09-12T16:17:34.664092+0000","last_became_active":"2024-09-12T16:17:07.243433+0000","last_became_peered":"2024-09-12T16:17:07.243433+0000","last_unstale":"2024-09-12T16:17:34.664092+0000","last_undegraded":"2024-09-12T16:17:34.664092+0000","last_fullsized":"2024-09-12T16:17:34.664092+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:07.791237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011661079999999999,"stat_sum":{"num_bytes":20791312,"num_objects":51,"num_object_clones":15,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":25,"num_read":2567,"num_read_kb":8445,"num_write":260,"num_write_kb":2361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":50,"num_bytes_recovered":579600,"num_keys_recovered":44,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"95'376","reported_seq":6138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.670617+0000","last_change":"2024-09-12T16:17:21.012961+0000","last_active":"2024-09-12T16:17:34.670617+0000","last_peered":"2024-09-12T16:17:34.670617+0000","last_clean":"2024-09-12T16:17:34.670617+0000","last_became_active":"2024-09-12T16:17:21.011585+0000","last_became_peered":"2024-09-12T16:17:21.011585+0000","last_unstale":"2024-09-12T16:17:34.670617+0000","last_undegraded":"2024-09-12T16:17:34.670617+0000","last_fullsized":"2024-09-12T16:17:34.670617+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:29.965202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056160499999999996,"stat_sum":{"num_bytes":47194687,"num_objects":63,"num_object_clones":19,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":30,"num_read":6729,"num_read_kb":28611,"num_write":328,"num_write_kb":10000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":14697984,"num_keys_recovered":12,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"92'337","reported_seq":7516,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.677806+0000","last_change":"2024-09-12T16:15:59.013909+0000","last_active":"2024-09-12T16:17:34.677806+0000","last_peered":"2024-09-12T16:17:34.677806+0000","last_clean":"2024-09-12T16:17:34.677806+0000","last_became_active":"2024-09-12T16:15:57.014803+0000","last_became_peered":"2024-09-12T16:15:57.014803+0000","last_unstale":"2024-09-12T16:17:34.677806+0000","last_undegraded":"2024-09-12T16:17:34.677806+0000","last_fullsized":"2024-09-12T16:17:34.677806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:48.522559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056998200000000002,"stat_sum":{"num_bytes":28267160,"num_objects":64,"num_object_clones":13,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":29,"num_read":7595,"num_read_kb":26869,"num_write":378,"num_write_kb":18057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"95'292","reported_seq":7622,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.436052+0000","last_change":"2024-09-12T16:15:59.015220+0000","last_active":"2024-09-12T16:17:34.436052+0000","last_peered":"2024-09-12T16:17:34.436052+0000","last_clean":"2024-09-12T16:17:34.436052+0000","last_became_active":"2024-09-12T16:15:57.016110+0000","last_became_peered":"2024-09-12T16:15:57.016110+0000","last_unstale":"2024-09-12T16:17:34.436052+0000","last_undegraded":"2024-09-12T16:17:34.436052+0000","last_fullsized":"2024-09-12T16:17:34.436052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:00.601003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088668999999999998,"stat_sum":{"num_bytes":22642736,"num_objects":82,"num_object_clones":24,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":32,"num_read":7279,"num_read_kb":25143,"num_write":300,"num_write_kb":5090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"92'515","reported_seq":4309,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.332269+0000","last_change":"2024-09-12T16:17:21.010241+0000","last_active":"2024-09-12T16:17:34.332269+0000","last_peered":"2024-09-12T16:17:34.332269+0000","last_clean":"2024-09-12T16:17:34.332269+0000","last_became_active":"2024-09-12T16:17:21.009370+0000","last_became_peered":"2024-09-12T16:17:21.009370+0000","last_unstale":"2024-09-12T16:17:34.332269+0000","last_undegraded":"2024-09-12T16:17:34.332269+0000","last_fullsized":"2024-09-12T16:17:34.332269+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:38:33.906315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081349199999999997,"stat_sum":{"num_bytes":43848291,"num_objects":56,"num_object_clones":17,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":20,"num_read":4668,"num_read_kb":40286,"num_write":719,"num_write_kb":33058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":17173091,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"95'496","reported_seq":5615,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.333215+0000","last_change":"2024-09-12T16:17:07.246803+0000","last_active":"2024-09-12T16:17:34.333215+0000","last_peered":"2024-09-12T16:17:34.333215+0000","last_clean":"2024-09-12T16:17:34.333215+0000","last_became_active":"2024-09-12T16:17:07.245694+0000","last_became_peered":"2024-09-12T16:17:07.245694+0000","last_unstale":"2024-09-12T16:17:34.333215+0000","last_undegraded":"2024-09-12T16:17:34.333215+0000","last_fullsized":"2024-09-12T16:17:34.333215+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:50.443343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059639700000000003,"stat_sum":{"num_bytes":56914549,"num_objects":69,"num_object_clones":17,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":29,"num_read":6192,"num_read_kb":26247,"num_write":756,"num_write_kb":19484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":54,"num_bytes_recovered":6241830,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"94'1299","reported_seq":12203,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.499477+0000","last_change":"2024-09-12T16:17:08.244554+0000","last_active":"2024-09-12T16:17:34.499477+0000","last_peered":"2024-09-12T16:17:34.499477+0000","last_clean":"2024-09-12T16:17:34.499477+0000","last_became_active":"2024-09-12T16:17:08.243010+0000","last_became_peered":"2024-09-12T16:17:08.243010+0000","last_unstale":"2024-09-12T16:17:34.499477+0000","last_undegraded":"2024-09-12T16:17:34.499477+0000","last_fullsized":"2024-09-12T16:17:34.499477+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1299,"log_dups_size":0,"ondisk_log_size":1299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:59.494012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001237496,"stat_sum":{"num_bytes":42880478,"num_objects":83,"num_object_clones":26,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":33,"num_read":16302,"num_read_kb":30529,"num_write":2063,"num_write_kb":9400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":4849100,"num_keys_recovered":60,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"91'241","reported_seq":5235,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.332480+0000","last_change":"2024-09-12T16:16:55.204162+0000","last_active":"2024-09-12T16:17:34.332480+0000","last_peered":"2024-09-12T16:17:34.332480+0000","last_clean":"2024-09-12T16:17:34.332480+0000","last_became_active":"2024-09-12T16:16:55.203324+0000","last_became_peered":"2024-09-12T16:16:55.203324+0000","last_unstale":"2024-09-12T16:17:34.332480+0000","last_undegraded":"2024-09-12T16:17:34.332480+0000","last_fullsized":"2024-09-12T16:17:34.332480+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:07.783545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010193750000000001,"stat_sum":{"num_bytes":57292337,"num_objects":57,"num_object_clones":17,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":24,"num_read":4774,"num_read_kb":29599,"num_write":237,"num_write_kb":10769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":1054818,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"95'570","reported_seq":7208,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.590125+0000","last_change":"2024-09-12T16:16:53.186573+0000","last_active":"2024-09-12T16:17:34.590125+0000","last_peered":"2024-09-12T16:17:34.590125+0000","last_clean":"2024-09-12T16:17:34.590125+0000","last_became_active":"2024-09-12T16:16:53.185698+0000","last_became_peered":"2024-09-12T16:16:53.185698+0000","last_unstale":"2024-09-12T16:17:34.590125+0000","last_undegraded":"2024-09-12T16:17:34.590125+0000","last_fullsized":"2024-09-12T16:17:34.590125+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:59.836698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000729947,"stat_sum":{"num_bytes":52968675,"num_objects":52,"num_object_clones":10,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":21,"num_read":9559,"num_read_kb":43164,"num_write":642,"num_write_kb":18649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":77,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.332758+0000","last_change":"2024-09-12T16:16:52.184699+0000","last_active":"2024-09-12T16:17:34.332758+0000","last_peered":"2024-09-12T16:17:34.332758+0000","last_clean":"2024-09-12T16:17:34.332758+0000","last_became_active":"2024-09-12T16:16:52.184420+0000","last_became_peered":"2024-09-12T16:16:52.184420+0000","last_unstale":"2024-09-12T16:17:34.332758+0000","last_undegraded":"2024-09-12T16:17:34.332758+0000","last_fullsized":"2024-09-12T16:17:34.332758+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:50.051152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"94'323","reported_seq":7771,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.498681+0000","last_change":"2024-09-12T16:15:59.311049+0000","last_active":"2024-09-12T16:17:34.498681+0000","last_peered":"2024-09-12T16:17:34.498681+0000","last_clean":"2024-09-12T16:17:34.498681+0000","last_became_active":"2024-09-12T16:15:57.012577+0000","last_became_peered":"2024-09-12T16:15:57.012577+0000","last_unstale":"2024-09-12T16:17:34.498681+0000","last_undegraded":"2024-09-12T16:17:34.498681+0000","last_fullsized":"2024-09-12T16:17:34.498681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:27.665830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063283100000000004,"stat_sum":{"num_bytes":25480254,"num_objects":42,"num_object_clones":13,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":10,"num_read":8635,"num_read_kb":25119,"num_write":261,"num_write_kb":4944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":184,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.336528+0000","last_change":"2024-09-12T16:16:52.187010+0000","last_active":"2024-09-12T16:17:34.336528+0000","last_peered":"2024-09-12T16:17:34.336528+0000","last_clean":"2024-09-12T16:17:34.336528+0000","last_became_active":"2024-09-12T16:16:52.186638+0000","last_became_peered":"2024-09-12T16:16:52.186638+0000","last_unstale":"2024-09-12T16:17:34.336528+0000","last_undegraded":"2024-09-12T16:17:34.336528+0000","last_fullsized":"2024-09-12T16:17:34.336528+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:40.681796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066384400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"92'276","reported_seq":10905,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.332450+0000","last_change":"2024-09-12T16:16:34.109977+0000","last_active":"2024-09-12T16:17:34.332450+0000","last_peered":"2024-09-12T16:17:34.332450+0000","last_clean":"2024-09-12T16:17:34.332450+0000","last_became_active":"2024-09-12T16:16:34.108850+0000","last_became_peered":"2024-09-12T16:16:34.108850+0000","last_unstale":"2024-09-12T16:17:34.332450+0000","last_undegraded":"2024-09-12T16:17:34.332450+0000","last_fullsized":"2024-09-12T16:17:34.332450+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:44.562322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012786130000000001,"stat_sum":{"num_bytes":54856720,"num_objects":57,"num_object_clones":16,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":25,"num_read":11281,"num_read_kb":53705,"num_write":261,"num_write_kb":25820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":77,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.332595+0000","last_change":"2024-09-12T16:16:52.183981+0000","last_active":"2024-09-12T16:17:34.332595+0000","last_peered":"2024-09-12T16:17:34.332595+0000","last_clean":"2024-09-12T16:17:34.332595+0000","last_became_active":"2024-09-12T16:16:52.183675+0000","last_became_peered":"2024-09-12T16:16:52.183675+0000","last_unstale":"2024-09-12T16:17:34.332595+0000","last_undegraded":"2024-09-12T16:17:34.332595+0000","last_fullsized":"2024-09-12T16:17:34.332595+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:35.267433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"95'546","reported_seq":6113,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.503129+0000","last_change":"2024-09-12T16:15:59.016004+0000","last_active":"2024-09-12T16:17:34.503129+0000","last_peered":"2024-09-12T16:17:34.503129+0000","last_clean":"2024-09-12T16:17:34.503129+0000","last_became_active":"2024-09-12T16:15:57.011381+0000","last_became_peered":"2024-09-12T16:15:57.011381+0000","last_unstale":"2024-09-12T16:17:34.503129+0000","last_undegraded":"2024-09-12T16:17:34.503129+0000","last_fullsized":"2024-09-12T16:17:34.503129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":546,"log_dups_size":0,"ondisk_log_size":546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:32:21.450318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001361543,"stat_sum":{"num_bytes":22388800,"num_objects":57,"num_object_clones":11,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":20,"num_read":8464,"num_read_kb":31188,"num_write":740,"num_write_kb":6478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.336450+0000","last_change":"2024-09-12T16:15:48.822724+0000","last_active":"2024-09-12T16:17:34.336450+0000","last_peered":"2024-09-12T16:17:34.336450+0000","last_clean":"2024-09-12T16:17:34.336450+0000","last_became_active":"2024-09-12T16:15:46.818676+0000","last_became_peered":"2024-09-12T16:15:46.818676+0000","last_unstale":"2024-09-12T16:17:34.336450+0000","last_undegraded":"2024-09-12T16:17:34.336450+0000","last_fullsized":"2024-09-12T16:17:34.336450+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:11.170806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065522900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"94'576","reported_seq":19527,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.654144+0000","last_change":"2024-09-12T16:17:07.243495+0000","last_active":"2024-09-12T16:17:34.654144+0000","last_peered":"2024-09-12T16:17:34.654144+0000","last_clean":"2024-09-12T16:17:34.654144+0000","last_became_active":"2024-09-12T16:17:07.242597+0000","last_became_peered":"2024-09-12T16:17:07.242597+0000","last_unstale":"2024-09-12T16:17:34.654144+0000","last_undegraded":"2024-09-12T16:17:34.654144+0000","last_fullsized":"2024-09-12T16:17:34.654144+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:38.944966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012959270000000001,"stat_sum":{"num_bytes":19473456,"num_objects":74,"num_object_clones":27,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":29,"num_read":23358,"num_read_kb":39454,"num_write":490,"num_write_kb":3823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":633856,"num_keys_recovered":23,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"94'468","reported_seq":4056,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.468107+0000","last_change":"2024-09-12T16:15:59.014247+0000","last_active":"2024-09-12T16:17:34.468107+0000","last_peered":"2024-09-12T16:17:34.468107+0000","last_clean":"2024-09-12T16:17:34.468107+0000","last_became_active":"2024-09-12T16:15:57.012238+0000","last_became_peered":"2024-09-12T16:15:57.012238+0000","last_unstale":"2024-09-12T16:17:34.468107+0000","last_undegraded":"2024-09-12T16:17:34.468107+0000","last_fullsized":"2024-09-12T16:17:34.468107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:55.780725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077777399999999996,"stat_sum":{"num_bytes":70389896,"num_objects":53,"num_object_clones":16,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":16,"num_read":4465,"num_read_kb":16320,"num_write":601,"num_write_kb":6271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.336471+0000","last_change":"2024-09-12T16:17:04.233055+0000","last_active":"2024-09-12T16:17:34.336471+0000","last_peered":"2024-09-12T16:17:34.336471+0000","last_clean":"2024-09-12T16:17:34.336471+0000","last_became_active":"2024-09-12T16:17:04.232815+0000","last_became_peered":"2024-09-12T16:17:04.232815+0000","last_unstale":"2024-09-12T16:17:34.336471+0000","last_undegraded":"2024-09-12T16:17:34.336471+0000","last_fullsized":"2024-09-12T16:17:34.336471+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:25:38.460863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"94'632","reported_seq":16732,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.467324+0000","last_change":"2024-09-12T16:15:59.014931+0000","last_active":"2024-09-12T16:17:34.467324+0000","last_peered":"2024-09-12T16:17:34.467324+0000","last_clean":"2024-09-12T16:17:34.467324+0000","last_became_active":"2024-09-12T16:15:57.014294+0000","last_became_peered":"2024-09-12T16:15:57.014294+0000","last_unstale":"2024-09-12T16:17:34.467324+0000","last_undegraded":"2024-09-12T16:17:34.467324+0000","last_fullsized":"2024-09-12T16:17:34.467324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:48.140257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011576030000000001,"stat_sum":{"num_bytes":33509484,"num_objects":62,"num_object_clones":19,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":24,"num_read":18199,"num_read_kb":33551,"num_write":555,"num_write_kb":15544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.332342+0000","last_change":"2024-09-12T16:16:34.109269+0000","last_active":"2024-09-12T16:17:34.332342+0000","last_peered":"2024-09-12T16:17:34.332342+0000","last_clean":"2024-09-12T16:17:34.332342+0000","last_became_active":"2024-09-12T16:16:34.108999+0000","last_became_peered":"2024-09-12T16:16:34.108999+0000","last_unstale":"2024-09-12T16:17:34.332342+0000","last_undegraded":"2024-09-12T16:17:34.332342+0000","last_fullsized":"2024-09-12T16:17:34.332342+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:02:32.771436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"95'357","reported_seq":4126,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.444149+0000","last_change":"2024-09-12T16:15:59.310828+0000","last_active":"2024-09-12T16:17:34.444149+0000","last_peered":"2024-09-12T16:17:34.444149+0000","last_clean":"2024-09-12T16:17:34.444149+0000","last_became_active":"2024-09-12T16:15:57.015817+0000","last_became_peered":"2024-09-12T16:15:57.015817+0000","last_unstale":"2024-09-12T16:17:34.444149+0000","last_undegraded":"2024-09-12T16:17:34.444149+0000","last_fullsized":"2024-09-12T16:17:34.444149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:01.526497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052214999999999998,"stat_sum":{"num_bytes":29445213,"num_objects":59,"num_object_clones":15,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":25,"num_read":4149,"num_read_kb":26954,"num_write":480,"num_write_kb":21340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":77,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.332485+0000","last_change":"2024-09-12T16:16:52.184861+0000","last_active":"2024-09-12T16:17:34.332485+0000","last_peered":"2024-09-12T16:17:34.332485+0000","last_clean":"2024-09-12T16:17:34.332485+0000","last_became_active":"2024-09-12T16:16:52.184555+0000","last_became_peered":"2024-09-12T16:16:52.184555+0000","last_unstale":"2024-09-12T16:17:34.332485+0000","last_undegraded":"2024-09-12T16:17:34.332485+0000","last_fullsized":"2024-09-12T16:17:34.332485+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:32.617153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"95'396","reported_seq":7275,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.434837+0000","last_change":"2024-09-12T16:17:07.243928+0000","last_active":"2024-09-12T16:17:34.434837+0000","last_peered":"2024-09-12T16:17:34.434837+0000","last_clean":"2024-09-12T16:17:34.434837+0000","last_became_active":"2024-09-12T16:17:07.242860+0000","last_became_peered":"2024-09-12T16:17:07.242860+0000","last_unstale":"2024-09-12T16:17:34.434837+0000","last_undegraded":"2024-09-12T16:17:34.434837+0000","last_fullsized":"2024-09-12T16:17:34.434837+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:59.867123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090313600000000002,"stat_sum":{"num_bytes":34794528,"num_objects":58,"num_object_clones":17,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":21,"num_read":7824,"num_read_kb":21647,"num_write":341,"num_write_kb":5230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":52,"num_bytes_recovered":2289680,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.332458+0000","last_change":"2024-09-12T16:17:04.232204+0000","last_active":"2024-09-12T16:17:34.332458+0000","last_peered":"2024-09-12T16:17:34.332458+0000","last_clean":"2024-09-12T16:17:34.332458+0000","last_became_active":"2024-09-12T16:17:04.231878+0000","last_became_peered":"2024-09-12T16:17:04.231878+0000","last_unstale":"2024-09-12T16:17:34.332458+0000","last_undegraded":"2024-09-12T16:17:34.332458+0000","last_fullsized":"2024-09-12T16:17:34.332458+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:24.273844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":83,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.332372+0000","last_change":"2024-09-12T16:16:52.190735+0000","last_active":"2024-09-12T16:17:34.332372+0000","last_peered":"2024-09-12T16:17:34.332372+0000","last_clean":"2024-09-12T16:17:34.332372+0000","last_became_active":"2024-09-12T16:16:52.183781+0000","last_became_peered":"2024-09-12T16:16:52.183781+0000","last_unstale":"2024-09-12T16:17:34.332372+0000","last_undegraded":"2024-09-12T16:17:34.332372+0000","last_fullsized":"2024-09-12T16:17:34.332372+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:40.751677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:40.751677+0000","last_clean_scrub_stamp":"2024-09-12T16:15:40.751677+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:34.274075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"95'361","reported_seq":11034,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.332443+0000","last_change":"2024-09-12T16:16:34.109457+0000","last_active":"2024-09-12T16:17:34.332443+0000","last_peered":"2024-09-12T16:17:34.332443+0000","last_clean":"2024-09-12T16:17:34.332443+0000","last_became_active":"2024-09-12T16:16:34.108998+0000","last_became_peered":"2024-09-12T16:16:34.108998+0000","last_unstale":"2024-09-12T16:17:34.332443+0000","last_undegraded":"2024-09-12T16:17:34.332443+0000","last_fullsized":"2024-09-12T16:17:34.332443+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:48.786183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001425398,"stat_sum":{"num_bytes":50668350,"num_objects":61,"num_object_clones":14,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":22,"num_read":11092,"num_read_kb":36010,"num_write":417,"num_write_kb":6641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"92'303","reported_seq":28817,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.344433+0000","last_change":"2024-09-12T16:15:59.014122+0000","last_active":"2024-09-12T16:17:34.344433+0000","last_peered":"2024-09-12T16:17:34.344433+0000","last_clean":"2024-09-12T16:17:34.344433+0000","last_became_active":"2024-09-12T16:15:57.013620+0000","last_became_peered":"2024-09-12T16:15:57.013620+0000","last_unstale":"2024-09-12T16:17:34.344433+0000","last_undegraded":"2024-09-12T16:17:34.344433+0000","last_fullsized":"2024-09-12T16:17:34.344433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:34.684423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074921299999999998,"stat_sum":{"num_bytes":58716704,"num_objects":51,"num_object_clones":13,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":18,"num_read":28456,"num_read_kb":53695,"num_write":345,"num_write_kb":9271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"95'471","reported_seq":15673,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.682717+0000","last_change":"2024-09-12T16:16:55.203995+0000","last_active":"2024-09-12T16:17:34.682717+0000","last_peered":"2024-09-12T16:17:34.682717+0000","last_clean":"2024-09-12T16:17:34.682717+0000","last_became_active":"2024-09-12T16:16:55.202934+0000","last_became_peered":"2024-09-12T16:16:55.202934+0000","last_unstale":"2024-09-12T16:17:34.682717+0000","last_undegraded":"2024-09-12T16:17:34.682717+0000","last_fullsized":"2024-09-12T16:17:34.682717+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:04.854276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000830695,"stat_sum":{"num_bytes":47435201,"num_objects":64,"num_object_clones":18,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":24,"num_read":16024,"num_read_kb":38603,"num_write":613,"num_write_kb":7232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":4487368,"num_keys_recovered":26,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"95'310","reported_seq":11813,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.503454+0000","last_change":"2024-09-12T16:15:59.015086+0000","last_active":"2024-09-12T16:17:34.503454+0000","last_peered":"2024-09-12T16:17:34.503454+0000","last_clean":"2024-09-12T16:17:34.503454+0000","last_became_active":"2024-09-12T16:15:57.012845+0000","last_became_peered":"2024-09-12T16:15:57.012845+0000","last_unstale":"2024-09-12T16:17:34.503454+0000","last_undegraded":"2024-09-12T16:17:34.503454+0000","last_fullsized":"2024-09-12T16:17:34.503454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:13.034694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001291885,"stat_sum":{"num_bytes":12044494,"num_objects":49,"num_object_clones":10,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":17,"num_read":11893,"num_read_kb":34850,"num_write":412,"num_write_kb":3736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"95'262","reported_seq":8825,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.497351+0000","last_change":"2024-09-12T16:17:07.245322+0000","last_active":"2024-09-12T16:17:34.497351+0000","last_peered":"2024-09-12T16:17:34.497351+0000","last_clean":"2024-09-12T16:17:34.497351+0000","last_became_active":"2024-09-12T16:17:07.244721+0000","last_became_peered":"2024-09-12T16:17:07.244721+0000","last_unstale":"2024-09-12T16:17:34.497351+0000","last_undegraded":"2024-09-12T16:17:34.497351+0000","last_fullsized":"2024-09-12T16:17:34.497351+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:13.349114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001361817,"stat_sum":{"num_bytes":29076992,"num_objects":65,"num_object_clones":18,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":27,"num_read":8341,"num_read_kb":39433,"num_write":306,"num_write_kb":17015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":58,"num_bytes_recovered":3294720,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"94'480","reported_seq":14394,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.500420+0000","last_change":"2024-09-12T16:16:55.202906+0000","last_active":"2024-09-12T16:17:34.500420+0000","last_peered":"2024-09-12T16:17:34.500420+0000","last_clean":"2024-09-12T16:17:34.500420+0000","last_became_active":"2024-09-12T16:16:55.202102+0000","last_became_peered":"2024-09-12T16:16:55.202102+0000","last_unstale":"2024-09-12T16:17:34.500420+0000","last_undegraded":"2024-09-12T16:17:34.500420+0000","last_fullsized":"2024-09-12T16:17:34.500420+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:09.791645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096169400000000003,"stat_sum":{"num_bytes":33243185,"num_objects":67,"num_object_clones":20,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":22,"num_read":15763,"num_read_kb":35526,"num_write":482,"num_write_kb":8720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":126,"num_bytes_recovered":6078562,"num_keys_recovered":48,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"95'363","reported_seq":4712,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.590640+0000","last_change":"2024-09-12T16:17:07.244128+0000","last_active":"2024-09-12T16:17:34.590640+0000","last_peered":"2024-09-12T16:17:34.590640+0000","last_clean":"2024-09-12T16:17:34.590640+0000","last_became_active":"2024-09-12T16:17:07.243245+0000","last_became_peered":"2024-09-12T16:17:07.243245+0000","last_unstale":"2024-09-12T16:17:34.590640+0000","last_undegraded":"2024-09-12T16:17:34.590640+0000","last_fullsized":"2024-09-12T16:17:34.590640+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:32.763186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013436100000000001,"stat_sum":{"num_bytes":23289919,"num_objects":60,"num_object_clones":12,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":22,"num_read":5558,"num_read_kb":21942,"num_write":352,"num_write_kb":11963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":52,"num_bytes_recovered":1737216,"num_keys_recovered":12,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"92'351","reported_seq":5838,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.678340+0000","last_change":"2024-09-12T16:17:07.243220+0000","last_active":"2024-09-12T16:17:34.678340+0000","last_peered":"2024-09-12T16:17:34.678340+0000","last_clean":"2024-09-12T16:17:34.678340+0000","last_became_active":"2024-09-12T16:17:07.242512+0000","last_became_peered":"2024-09-12T16:17:07.242512+0000","last_unstale":"2024-09-12T16:17:34.678340+0000","last_undegraded":"2024-09-12T16:17:34.678340+0000","last_fullsized":"2024-09-12T16:17:34.678340+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:44.169871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001280946,"stat_sum":{"num_bytes":14618427,"num_objects":45,"num_object_clones":7,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":18,"num_read":4868,"num_read_kb":25570,"num_write":441,"num_write_kb":13775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":76,"num_bytes_recovered":1444176,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"95'361","reported_seq":10004,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.661403+0000","last_change":"2024-09-12T16:17:07.245303+0000","last_active":"2024-09-12T16:17:34.661403+0000","last_peered":"2024-09-12T16:17:34.661403+0000","last_clean":"2024-09-12T16:17:34.661403+0000","last_became_active":"2024-09-12T16:17:07.244725+0000","last_became_peered":"2024-09-12T16:17:07.244725+0000","last_unstale":"2024-09-12T16:17:34.661403+0000","last_undegraded":"2024-09-12T16:17:34.661403+0000","last_fullsized":"2024-09-12T16:17:34.661403+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:36.930025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049764000000000004,"stat_sum":{"num_bytes":40967466,"num_objects":77,"num_object_clones":21,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":32,"num_read":8476,"num_read_kb":46807,"num_write":395,"num_write_kb":12084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":3272971,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"95'419","reported_seq":10982,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.435738+0000","last_change":"2024-09-12T16:16:55.204075+0000","last_active":"2024-09-12T16:17:34.435738+0000","last_peered":"2024-09-12T16:17:34.435738+0000","last_clean":"2024-09-12T16:17:34.435738+0000","last_became_active":"2024-09-12T16:16:55.202493+0000","last_became_peered":"2024-09-12T16:16:55.202493+0000","last_unstale":"2024-09-12T16:17:34.435738+0000","last_undegraded":"2024-09-12T16:17:34.435738+0000","last_fullsized":"2024-09-12T16:17:34.435738+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:22.169682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058531000000000002,"stat_sum":{"num_bytes":39654760,"num_objects":67,"num_object_clones":19,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":23,"num_read":11200,"num_read_kb":29281,"num_write":590,"num_write_kb":7855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":1725440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"95'404","reported_seq":9003,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.591236+0000","last_change":"2024-09-12T16:16:55.202816+0000","last_active":"2024-09-12T16:17:34.591236+0000","last_peered":"2024-09-12T16:17:34.591236+0000","last_clean":"2024-09-12T16:17:34.591236+0000","last_became_active":"2024-09-12T16:16:55.202220+0000","last_became_peered":"2024-09-12T16:16:55.202220+0000","last_unstale":"2024-09-12T16:17:34.591236+0000","last_undegraded":"2024-09-12T16:17:34.591236+0000","last_fullsized":"2024-09-12T16:17:34.591236+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:30.492149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049753500000000001,"stat_sum":{"num_bytes":43895445,"num_objects":64,"num_object_clones":16,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":25,"num_read":10568,"num_read_kb":32461,"num_write":401,"num_write_kb":11082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":3518540,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"95'771","reported_seq":8451,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T16:17:34.646871+0000","last_change":"2024-09-12T16:17:07.242339+0000","last_active":"2024-09-12T16:17:34.646871+0000","last_peered":"2024-09-12T16:17:34.646871+0000","last_clean":"2024-09-12T16:17:34.646871+0000","last_became_active":"2024-09-12T16:17:07.241494+0000","last_became_peered":"2024-09-12T16:17:07.241494+0000","last_unstale":"2024-09-12T16:17:34.646871+0000","last_undegraded":"2024-09-12T16:17:34.646871+0000","last_fullsized":"2024-09-12T16:17:34.646871+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:28.128805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050533499999999999,"stat_sum":{"num_bytes":37297090,"num_objects":74,"num_object_clones":21,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":28,"num_read":9706,"num_read_kb":38434,"num_write":1259,"num_write_kb":18002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":136,"num_bytes_recovered":7863816,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1217611967,"num_objects":2005,"num_object_clones":541,"num_object_copies":4010,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2005,"num_whiteouts":779,"num_read":343231,"num_read_kb":1097770,"num_write":18452,"num_write_kb":374929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1843,"num_bytes_recovered":96211470,"num_keys_recovered":249,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":426860544,"data_stored":542439806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6949,"internal_metadata":0},"log_size":15003,"ondisk_log_size":15003,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":5,"up_from":71,"seq":304942678024,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":109472,"kb_used_data":72592,"kb_used_omap":11,"kb_used_meta":36852,"kb_avail":94262368,"statfs":{"total":96636764160,"available":96524664832,"internally_reserved":0,"allocated":74334208,"data_stored":89581264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11593,"internal_metadata":37737143},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640282,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122228,"kb_used_data":68836,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94249612,"statfs":{"total":96636764160,"available":96511602688,"internally_reserved":0,"allocated":70488064,"data_stored":88544752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640283,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139856,"kb_used_data":64252,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94231984,"statfs":{"total":96636764160,"available":96493551616,"internally_reserved":0,"allocated":65794048,"data_stored":86343779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[32,25,59,121],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640284,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110156,"kb_used_data":74808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94261684,"statfs":{"total":96636764160,"available":96523964416,"internally_reserved":0,"allocated":76603392,"data_stored":97365457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640282,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89240,"kb_used_data":53888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94282600,"statfs":{"total":96636764160,"available":96545382400,"internally_reserved":0,"allocated":55181312,"data_stored":67563582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640283,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125004,"kb_used_data":89660,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94246836,"statfs":{"total":96636764160,"available":96508760064,"internally_reserved":0,"allocated":91811840,"data_stored":116413888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":90202112,"data_stored":115445203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":54095872,"data_stored":67129326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":75603968,"data_stored":97050013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":64188416,"data_stored":85432696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69566464,"data_stored":88262139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73203712,"data_stored":89120429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6949,"internal_metadata":0}]}} 2024-09-12T16:17:40.335 INFO:tasks.thrashosds.thrasher:Setting 3.16 to [0, 5, 4, 3] 2024-09-12T16:17:40.335 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.16', '0', '5', '4', '3'] 2024-09-12T16:17:40.335 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.16 0 5 4 3 2024-09-12T16:17:40.373 INFO:teuthology.orchestra.run.smithi204.stdout:5156 write 0xce35c00 thru 0xce43787 (0xdb88 bytes) 2024-09-12T16:17:40.374 INFO:teuthology.orchestra.run.smithi204.stdout:5158 read 0x5ae5e00 thru 0x5aeec1b (0x8e1c bytes) 2024-09-12T16:17:40.374 INFO:teuthology.orchestra.run.smithi204.stdout:5160 write 0xb4e3c00 thru 0xb4ecb21 (0x8f22 bytes) 2024-09-12T16:17:40.378 INFO:teuthology.orchestra.run.smithi204.stdout:5161 read 0x6c74c00 thru 0x6c775b6 (0x29b7 bytes) 2024-09-12T16:17:40.378 INFO:teuthology.orchestra.run.smithi204.stdout:5162 write 0x3a7b800 thru 0x3a84047 (0x8848 bytes) 2024-09-12T16:17:40.378 INFO:teuthology.orchestra.run.smithi204.stdout:5163 read 0x6b0c200 thru 0x6b0cc49 (0xa4a bytes) 2024-09-12T16:17:40.378 INFO:teuthology.orchestra.run.smithi204.stdout:5164 trunc from 0xce43800 to 0xc9cec00 2024-09-12T16:17:40.386 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:40.385+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:40.421 INFO:teuthology.orchestra.run.smithi204.stdout:5168 write 0x1025400 thru 0x102bfda (0x6bdb bytes) 2024-09-12T16:17:40.427 INFO:teuthology.orchestra.run.smithi204.stdout:5170 write 0x7e8f600 thru 0x7e9d7ea (0xe1eb bytes) 2024-09-12T16:17:40.427 INFO:teuthology.orchestra.run.smithi204.stdout:5173 read 0x8d31600 thru 0x8d34e01 (0x3802 bytes) 2024-09-12T16:17:40.427 INFO:teuthology.orchestra.run.smithi204.stdout:5176 read 0x6a60a00 thru 0x6a6c80e (0xbe0f bytes) 2024-09-12T16:17:40.427 INFO:teuthology.orchestra.run.smithi204.stdout:5180 punch from 0x741c00 to 0x742800, (0xc00 bytes) 2024-09-12T16:17:40.428 INFO:teuthology.orchestra.run.smithi204.stdout:5181 read 0x174200 thru 0x181012 (0xce13 bytes) 2024-09-12T16:17:40.442 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T16:17:40.445 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:17:40.445 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:17:40.451 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:40.451 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:40.451 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:17:40.452 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:40.452 INFO:teuthology.orchestra.run.smithi204.stdout:5183 write 0xd258c00 thru 0xd261ce7 (0x90e8 bytes) 2024-09-12T16:17:40.453 INFO:teuthology.orchestra.run.smithi204.stdout:5185 read 0x89800 thru 0x93948 (0xa149 bytes) 2024-09-12T16:17:40.455 INFO:teuthology.orchestra.run.smithi204.stdout:5186 write 0x7cc8000 thru 0x7cd592b (0xd92c bytes) 2024-09-12T16:17:40.455 INFO:teuthology.orchestra.run.smithi204.stdout:5188 read 0x7807e00 thru 0x7815524 (0xd725 bytes) 2024-09-12T16:17:40.455 INFO:teuthology.orchestra.run.smithi204.stdout:5190 read 0xa65ac00 thru 0xa662fbb (0x83bc bytes) 2024-09-12T16:17:40.455 INFO:teuthology.orchestra.run.smithi204.stdout:5191 punch from 0xc605800 to 0xc60d000, (0x7800 bytes) 2024-09-12T16:17:40.456 INFO:teuthology.orchestra.run.smithi204.stdout:5192 read 0x96cf400 thru 0x96dd54e (0xe14f bytes) 2024-09-12T16:17:40.461 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:17:40.465 INFO:teuthology.orchestra.run.smithi204.stdout:5196 trunc from 0xd261e00 to 0x5236800 2024-09-12T16:17:40.467 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:17:40.468 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:17:40.501 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:17:40.501 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:17:40.502 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:40.501+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:40.519 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:17:40.519 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:17:40.521 INFO:teuthology.orchestra.run.smithi204.stdout:5197 trunc from 0x5236800 to 0xbb16e00 2024-09-12T16:17:40.542 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:17:40.543 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:17:40.543 INFO:teuthology.orchestra.run.smithi204.stdout:5198 read 0xd2ba00 thru 0xd33c60 (0x8261 bytes) 2024-09-12T16:17:40.544 INFO:teuthology.orchestra.run.smithi204.stdout:5199 punch from 0x74be200 to 0x74c1600, (0x3400 bytes) 2024-09-12T16:17:40.544 INFO:teuthology.orchestra.run.smithi204.stdout:5203 write 0x7a0ba00 thru 0x7a1b982 (0xff83 bytes) 2024-09-12T16:17:40.567 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:17:40.567 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:17:40.570 INFO:teuthology.orchestra.run.smithi204.stdout:5205 write 0xdd0d800 thru 0xdd11971 (0x4172 bytes) 2024-09-12T16:17:40.578 INFO:teuthology.orchestra.run.smithi204.stdout:5206 read 0x2284000 thru 0x228cde9 (0x8dea bytes) 2024-09-12T16:17:40.589 INFO:teuthology.orchestra.run.smithi204.stdout:5208 trunc from 0xdd11a00 to 0x474cc00 2024-09-12T16:17:40.612 INFO:teuthology.orchestra.run.smithi204.stdout:5210 read 0xf15a00 thru 0xf1ff06 (0xa507 bytes) 2024-09-12T16:17:40.620 INFO:teuthology.orchestra.run.smithi204.stdout:5211 read 0xadfa00 thru 0xaeabe8 (0xb1e9 bytes) 2024-09-12T16:17:40.621 INFO:teuthology.orchestra.run.smithi204.stdout:5212 write 0x6f4000 thru 0x6f810e (0x410f bytes) 2024-09-12T16:17:40.621 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:40.621 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:40.622 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:40.621+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:40.631 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:17:40.637 INFO:teuthology.orchestra.run.smithi204.stdout:5216 write 0x51a2c00 thru 0x51a4427 (0x1828 bytes) 2024-09-12T16:17:40.643 INFO:teuthology.orchestra.run.smithi204.stdout:5219 write 0xf9b000 thru 0xf9bd12 (0xd13 bytes) 2024-09-12T16:17:40.644 INFO:teuthology.orchestra.run.smithi204.stdout:5220 punch from 0x483ce00 to 0x483de00, (0x1000 bytes) 2024-09-12T16:17:40.645 INFO:teuthology.orchestra.run.smithi204.stdout:5221 read 0x3940c00 thru 0x3945862 (0x4c63 bytes) 2024-09-12T16:17:40.645 INFO:teuthology.orchestra.run.smithi204.stdout:5224 read 0x4bb4000 thru 0x4bbf618 (0xb619 bytes) 2024-09-12T16:17:40.645 INFO:teuthology.orchestra.run.smithi204.stdout:5226 read 0x23de800 thru 0x23e8274 (0x9a75 bytes) 2024-09-12T16:17:40.665 INFO:teuthology.orchestra.run.smithi204.stdout:5227 write 0xc785400 thru 0xc7897cd (0x43ce bytes) 2024-09-12T16:17:40.671 INFO:teuthology.orchestra.run.smithi204.stdout:5229 write 0x4c17e00 thru 0x4c1d0bd (0x52be bytes) 2024-09-12T16:17:40.672 INFO:teuthology.orchestra.run.smithi204.stdout:5231 write 0x2d80000 thru 0x2d812bb (0x12bc bytes) 2024-09-12T16:17:40.672 INFO:teuthology.orchestra.run.smithi204.stdout:5233 read 0x5c2c800 thru 0x5c2db24 (0x1325 bytes) 2024-09-12T16:17:40.672 INFO:teuthology.orchestra.run.smithi204.stdout:5234 read 0x4090400 thru 0x40953fc (0x4ffd bytes) 2024-09-12T16:17:40.672 INFO:teuthology.orchestra.run.smithi204.stdout:5235 write 0x41c5c00 thru 0x41d0862 (0xac63 bytes) 2024-09-12T16:17:40.672 INFO:teuthology.orchestra.run.smithi204.stdout:5238 punch from 0x7630a00 to 0x7631800, (0xe00 bytes) 2024-09-12T16:17:40.673 INFO:teuthology.orchestra.run.smithi204.stdout:5240 punch from 0x82bde00 to 0x82cc600, (0xe800 bytes) 2024-09-12T16:17:40.673 INFO:teuthology.orchestra.run.smithi204.stdout:5242 read 0x4026600 thru 0x4029e26 (0x3827 bytes) 2024-09-12T16:17:40.673 INFO:teuthology.orchestra.run.smithi204.stdout:5243 write 0x6d29200 thru 0x6d2dcde (0x4adf bytes) 2024-09-12T16:17:40.683 INFO:teuthology.orchestra.run.smithi204.stdout:5244 trunc from 0xc789800 to 0x43c3c00 2024-09-12T16:17:40.689 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:40.688+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:40.732 INFO:teuthology.orchestra.run.smithi204.stdout:5246 read 0x3d07400 thru 0x3d0a16c (0x2d6d bytes) 2024-09-12T16:17:40.740 INFO:teuthology.orchestra.run.smithi204.stdout:5248 read 0x14b2200 thru 0x14b558b (0x338c bytes) 2024-09-12T16:17:40.754 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:40.754 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:40.764 INFO:teuthology.orchestra.run.smithi204.stdout:5249 write 0xd847800 thru 0xd854380 (0xcb81 bytes) 2024-09-12T16:17:40.766 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:17:40.778 INFO:teuthology.orchestra.run.smithi204.stdout:5251 read 0x6846400 thru 0x6849d38 (0x3939 bytes) 2024-09-12T16:17:40.780 INFO:teuthology.orchestra.run.smithi204.stdout:5253 write 0x37ffa00 thru 0x380cea2 (0xd4a3 bytes) 2024-09-12T16:17:40.780 INFO:teuthology.orchestra.run.smithi204.stdout:5256 punch from 0xd247200 to 0xd254c00, (0xda00 bytes) 2024-09-12T16:17:40.781 INFO:teuthology.orchestra.run.smithi204.stdout:5258 read 0x34a1600 thru 0x34ab8c5 (0xa2c6 bytes) 2024-09-12T16:17:40.781 INFO:teuthology.orchestra.run.smithi204.stdout:5261 write 0x23b8c00 thru 0x23ba8e0 (0x1ce1 bytes) 2024-09-12T16:17:40.781 INFO:teuthology.orchestra.run.smithi204.stdout:5262 read 0x99db200 thru 0x99e498f (0x9790 bytes) 2024-09-12T16:17:40.781 INFO:teuthology.orchestra.run.smithi204.stdout:5265 punch from 0x2d8fe00 to 0x2d97600, (0x7800 bytes) 2024-09-12T16:17:40.781 INFO:teuthology.orchestra.run.smithi204.stdout:5266 write 0x3abbc00 thru 0x3ac689a (0xac9b bytes) 2024-09-12T16:17:40.781 INFO:teuthology.orchestra.run.smithi204.stdout:5268 write 0x661a400 thru 0x661eeeb (0x4aec bytes) 2024-09-12T16:17:40.781 INFO:teuthology.orchestra.run.smithi204.stdout:5270 read 0x89ab000 thru 0x89b31f2 (0x81f3 bytes) 2024-09-12T16:17:40.781 INFO:teuthology.orchestra.run.smithi204.stdout:5271 write 0x61fc000 thru 0x62082ac (0xc2ad bytes) 2024-09-12T16:17:40.781 INFO:teuthology.orchestra.run.smithi204.stdout:5274 read 0x31e5200 thru 0x31ebe7b (0x6c7c bytes) 2024-09-12T16:17:40.781 INFO:teuthology.orchestra.run.smithi204.stdout:5275 read 0x709aa00 thru 0x709c6b8 (0x1cb9 bytes) 2024-09-12T16:17:40.781 INFO:teuthology.orchestra.run.smithi204.stdout:5283 write 0x37c8c00 thru 0x37ccfda (0x43db bytes) 2024-09-12T16:17:40.781 INFO:teuthology.orchestra.run.smithi204.stdout:5286 read 0x50f4c00 thru 0x5104600 (0xfa01 bytes) 2024-09-12T16:17:40.782 INFO:teuthology.orchestra.run.smithi204.stdout:5287 write 0x1ec600 thru 0x1f9bcf (0xd5d0 bytes) 2024-09-12T16:17:40.782 INFO:teuthology.orchestra.run.smithi204.stdout:5288 write 0xc20be00 thru 0xc20e3d1 (0x25d2 bytes) 2024-09-12T16:17:40.782 INFO:teuthology.orchestra.run.smithi204.stdout:5291 read 0x2de0c00 thru 0x2de6769 (0x5b6a bytes) 2024-09-12T16:17:40.782 INFO:teuthology.orchestra.run.smithi204.stdout:5293 write 0xa058400 thru 0xa062993 (0xa594 bytes) 2024-09-12T16:17:40.782 INFO:teuthology.orchestra.run.smithi204.stdout:5294 read 0x6620400 thru 0x662ae2d (0xaa2e bytes) 2024-09-12T16:17:40.782 INFO:teuthology.orchestra.run.smithi204.stdout:5295 trunc from 0xd854400 to 0xed70e00 2024-09-12T16:17:40.796 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:40.788+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:40.824 INFO:teuthology.orchestra.run.smithi204.stdout:5296 write 0x1da2400 thru 0x1da617d (0x3d7e bytes) 2024-09-12T16:17:40.825 INFO:teuthology.orchestra.run.smithi204.stdout:5299 read 0x192e600 thru 0x192fe7c (0x187d bytes) 2024-09-12T16:17:40.825 INFO:teuthology.orchestra.run.smithi204.stdout:5300 punch from 0xc2eb000 to 0xc2f0000, (0x5000 bytes) 2024-09-12T16:17:40.826 INFO:teuthology.orchestra.run.smithi204.stdout:5301 write 0x7c0cc00 thru 0x7c0ff6d (0x336e bytes) 2024-09-12T16:17:40.826 INFO:teuthology.orchestra.run.smithi204.stdout:5302 write 0x3da6200 thru 0x3daf2f7 (0x90f8 bytes) 2024-09-12T16:17:40.827 INFO:teuthology.orchestra.run.smithi204.stdout:5303 write 0x38f400 thru 0x39c4ab (0xd0ac bytes) 2024-09-12T16:17:40.827 INFO:teuthology.orchestra.run.smithi204.stdout:5305 write 0xe320c00 thru 0xe32b448 (0xa849 bytes) 2024-09-12T16:17:40.828 INFO:teuthology.orchestra.run.smithi204.stdout:5306 flatten 2024-09-12T16:17:40.855 INFO:teuthology.orchestra.run.smithi204.stdout:5311 read 0xd655000 thru 0xd65dcfa (0x8cfb bytes) 2024-09-12T16:17:40.865 INFO:teuthology.orchestra.run.smithi204.stdout:5312 trunc from 0xed70e00 to 0x7c3b400 2024-09-12T16:17:40.890 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:40.889+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:40.910 INFO:teuthology.orchestra.run.smithi204.stdout:5313 write 0xd329a00 thru 0xd338b57 (0xf158 bytes) 2024-09-12T16:17:40.917 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:40.917 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:40.923 INFO:teuthology.orchestra.run.smithi204.stdout:5314 trunc from 0xd338c00 to 0x3136400 2024-09-12T16:17:40.928 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:17:41.010 INFO:teuthology.orchestra.run.smithi204.stdout:5316 write 0xbe7c000 thru 0xbe7e45d (0x245e bytes) 2024-09-12T16:17:41.010 INFO:teuthology.orchestra.run.smithi204.stdout:5319 write 0x3da2400 thru 0x3da9d64 (0x7965 bytes) 2024-09-12T16:17:41.010 INFO:teuthology.orchestra.run.smithi204.stdout:5321 read 0x9692a00 thru 0x9699e01 (0x7402 bytes) 2024-09-12T16:17:41.010 INFO:teuthology.orchestra.run.smithi204.stdout:5323 read 0x1f06400 thru 0x1f06b64 (0x765 bytes) 2024-09-12T16:17:41.010 INFO:teuthology.orchestra.run.smithi204.stdout:5326 punch from 0x3bae800 to 0x3baec00, (0x400 bytes) 2024-09-12T16:17:41.013 INFO:teuthology.orchestra.run.smithi204.stdout:5330 trunc from 0xbe7e600 to 0xec20600 2024-09-12T16:17:41.014 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:41.013+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:41.035 INFO:teuthology.orchestra.run.smithi204.stdout:5336 read 0xaedbc00 thru 0xaedfd5d (0x415e bytes) 2024-09-12T16:17:41.035 INFO:teuthology.orchestra.run.smithi204.stdout:5338 punch from 0x1a55e00 to 0x1a58800, (0x2a00 bytes) 2024-09-12T16:17:41.035 INFO:teuthology.orchestra.run.smithi204.stdout:5339 read 0xa7f7800 thru 0xa8037a1 (0xbfa2 bytes) 2024-09-12T16:17:41.035 INFO:teuthology.orchestra.run.smithi204.stdout:5340 clone 35 order 25 su 1048576 sc 5 2024-09-12T16:17:41.087 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:41.087 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:41.092 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:41.091+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:41.095 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:17:41.192 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:41.192+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:41.242 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:41.242 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:41.251 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:17:41.293 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:41.292+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:41.352 INFO:teuthology.orchestra.run.smithi017.stderr:set 3.16 pg_upmap_items mapping to [0->5,4->3] 2024-09-12T16:17:41.355 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2024-09-12T16:17:41.408 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:41.408 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:41.408 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:41.407+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:41.418 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:17:41.495 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:41.493+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:41.567 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:41.567 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:41.576 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:17:41.595 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:41.594+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:41.687 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:41.687 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:41.696 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:17:41.697 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:41.695+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:41.797 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:41.797+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:41.806 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:41.806 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:41.814 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:17:41.899 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:41.898+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:41.962 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:41.962 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:41.970 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:17:42.012 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:42.011+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:42.063 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #33, image image_client.0-clone33 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent34 2024-09-12T16:17:42.100 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:42.099+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:42.119 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:42.119 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:42.127 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:17:42.201 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:42.200+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:42.274 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:42.274 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:42.284 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:17:42.303 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:42.302+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:42.379 INFO:teuthology.orchestra.run.smithi204.stdout:5342 read 0xcf3c800 thru 0xcf48c6f (0xc470 bytes) 2024-09-12T16:17:42.380 INFO:teuthology.orchestra.run.smithi204.stdout:5343 write 0xe454e00 thru 0xe46377d (0xe97e bytes) 2024-09-12T16:17:42.380 INFO:teuthology.orchestra.run.smithi204.stdout:5344 read 0x3737e00 thru 0x374199e (0x9b9f bytes) 2024-09-12T16:17:42.382 INFO:teuthology.orchestra.run.smithi204.stdout:5346 read 0x6f69c00 thru 0x6f6d2aa (0x36ab bytes) 2024-09-12T16:17:42.382 INFO:teuthology.orchestra.run.smithi204.stdout:5348 write 0xd9c4800 thru 0xd9d0ba0 (0xc3a1 bytes) 2024-09-12T16:17:42.383 INFO:teuthology.orchestra.run.smithi204.stdout:5351 trunc from 0xec20600 to 0xe094000 2024-09-12T16:17:42.403 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:42.402+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:42.421 INFO:teuthology.orchestra.run.smithi204.stdout:5352 write 0xe0ea800 thru 0xe0f2536 (0x7d37 bytes) 2024-09-12T16:17:42.426 INFO:teuthology.orchestra.run.smithi204.stdout:5353 read 0x1746c00 thru 0x1751128 (0xa529 bytes) 2024-09-12T16:17:42.427 INFO:teuthology.orchestra.run.smithi204.stdout:5354 read 0x203600 thru 0x20602a (0x2a2b bytes) 2024-09-12T16:17:42.427 INFO:teuthology.orchestra.run.smithi204.stdout:5359 write 0x3ed000 thru 0x3f1ccb (0x4ccc bytes) 2024-09-12T16:17:42.427 INFO:teuthology.orchestra.run.smithi204.stdout:5360 read 0xba1d200 thru 0xba2af68 (0xdd69 bytes) 2024-09-12T16:17:42.428 INFO:teuthology.orchestra.run.smithi204.stdout:5361 read 0x5405800 thru 0x5406acb (0x12cc bytes) 2024-09-12T16:17:42.428 INFO:teuthology.orchestra.run.smithi204.stdout:5364 read 0x4abc800 thru 0x4ac4454 (0x7c55 bytes) 2024-09-12T16:17:42.437 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:42.437 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:42.443 INFO:teuthology.orchestra.run.smithi204.stdout:5365 trunc from 0xe0f2600 to 0x1fc5600 2024-09-12T16:17:42.447 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:17:42.503 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:42.503+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:42.505 INFO:teuthology.orchestra.run.smithi204.stdout:5366 trunc from 0x1fc5600 to 0x3183200 2024-09-12T16:17:42.514 INFO:teuthology.orchestra.run.smithi204.stdout:5367 read 0x1be2400 thru 0x1bee4b4 (0xc0b5 bytes) 2024-09-12T16:17:42.516 INFO:teuthology.orchestra.run.smithi204.stdout:skipping zero length punch hole 2024-09-12T16:17:42.516 INFO:teuthology.orchestra.run.smithi204.stdout:5370 read 0x1e5e800 thru 0x1e62312 (0x3b13 bytes) 2024-09-12T16:17:42.517 INFO:teuthology.orchestra.run.smithi204.stdout:5371 read 0x239bc00 thru 0x23a1a53 (0x5e54 bytes) 2024-09-12T16:17:42.533 INFO:teuthology.orchestra.run.smithi204.stdout:5372 write 0x91c0000 thru 0x91c4d13 (0x4d14 bytes) 2024-09-12T16:17:42.542 INFO:teuthology.orchestra.run.smithi204.stdout:5373 trunc from 0x91c4e00 to 0x3ace800 2024-09-12T16:17:42.570 INFO:teuthology.orchestra.run.smithi204.stdout:5374 write 0x549ec00 thru 0x54a84ef (0x98f0 bytes) 2024-09-12T16:17:42.571 INFO:teuthology.orchestra.run.smithi204.stdout:5375 read 0x3b94200 thru 0x3ba374a (0xf54b bytes) 2024-09-12T16:17:42.572 INFO:teuthology.orchestra.run.smithi204.stdout:5376 read 0xce5600 thru 0xce770a (0x210b bytes) 2024-09-12T16:17:42.572 INFO:teuthology.orchestra.run.smithi204.stdout:5377 punch from 0x3c8a800 to 0x3c99a00, (0xf200 bytes) 2024-09-12T16:17:42.572 INFO:teuthology.orchestra.run.smithi204.stdout:5379 write 0x3802a00 thru 0x380f0ba (0xc6bb bytes) 2024-09-12T16:17:42.573 INFO:teuthology.orchestra.run.smithi204.stdout:5380 read 0xbb2800 thru 0xbbe9d2 (0xc1d3 bytes) 2024-09-12T16:17:42.573 INFO:teuthology.orchestra.run.smithi204.stdout:5381 read 0x22a8600 thru 0x22aece7 (0x66e8 bytes) 2024-09-12T16:17:42.574 INFO:teuthology.orchestra.run.smithi204.stdout:5384 read 0x26a9000 thru 0x26b3d11 (0xad12 bytes) 2024-09-12T16:17:42.575 INFO:teuthology.orchestra.run.smithi204.stdout:5385 write 0xd40200 thru 0xd4e7ea (0xe5eb bytes) 2024-09-12T16:17:42.575 INFO:teuthology.orchestra.run.smithi204.stdout:5389 read 0x118200 thru 0x1243ee (0xc1ef bytes) 2024-09-12T16:17:42.575 INFO:teuthology.orchestra.run.smithi204.stdout:5391 read 0x1771a00 thru 0x1774732 (0x2d33 bytes) 2024-09-12T16:17:42.576 INFO:teuthology.orchestra.run.smithi204.stdout:5393 read 0x2b51600 thru 0x2b51bc4 (0x5c5 bytes) 2024-09-12T16:17:42.576 INFO:teuthology.orchestra.run.smithi204.stdout:5394 punch from 0x3702c00 to 0x370b400, (0x8800 bytes) 2024-09-12T16:17:42.577 INFO:teuthology.orchestra.run.smithi204.stdout:5395 read 0x270f200 thru 0x271a628 (0xb429 bytes) 2024-09-12T16:17:42.577 INFO:teuthology.orchestra.run.smithi204.stdout:5396 write 0x3466e00 thru 0x347698f (0xfb90 bytes) 2024-09-12T16:17:42.578 INFO:teuthology.orchestra.run.smithi204.stdout:5397 clone 36 order 19 su 32768 sc 9 2024-09-12T16:17:42.581 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T16:17:42.604 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:42.603+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:42.605 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:42.606 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:42.614 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:17:42.703 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:17:42.703 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:17:42.704 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:42.703+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:42.720 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:17:42.720 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:17:42.736 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:17:42.736 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:17:42.753 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:17:42.753 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:17:42.764 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:42.764 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:42.769 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:17:42.770 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:17:42.774 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:17:42.786 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:17:42.787 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:17:42.817 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:42.816+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:42.880 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:42.881 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:42.881 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:17:42.881 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:17:42.881 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:42.889 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:17:42.906 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:42.906+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:43.007 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:43.006+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:43.040 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:43.040 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:17:43.040 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:17:43.040 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:17:43.040 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.040 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5599 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4788224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:43.040 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:17:43.040 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 62.742258315000001, 2024-09-12T16:17:43.040 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061192059, 2024-09-12T16:17:43.041 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.041 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.041 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:43.041 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:43.041 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:43.041 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:43.041 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5599 2024-09-12T16:17:43.041 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.041 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.041 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.041 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.041 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:17:43.041 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.041 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.042 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.042 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.042 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:17:43.042 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.042 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.042 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.042 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.042 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296333+0000", 2024-09-12T16:17:43.042 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6599999999999996e-07 2024-09-12T16:17:43.042 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.042 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.042 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.042 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296335+0000", 2024-09-12T16:17:43.042 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5900000000000002e-06 2024-09-12T16:17:43.042 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.043 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.043 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.043 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296344+0000", 2024-09-12T16:17:43.043 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9539999999999993e-06 2024-09-12T16:17:43.043 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.043 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.043 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.043 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296350+0000", 2024-09-12T16:17:43.043 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5589999999999996e-06 2024-09-12T16:17:43.043 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.043 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.043 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.043 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357307+0000", 2024-09-12T16:17:43.043 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.060957573000000001 2024-09-12T16:17:43.044 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.044 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.044 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:43.044 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357401+0000", 2024-09-12T16:17:43.044 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3512999999999997e-05 2024-09-12T16:17:43.044 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.044 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.044 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.044 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357524+0000", 2024-09-12T16:17:43.044 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000123304 2024-09-12T16:17:43.044 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.044 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.044 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.044 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.045 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.045 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5611 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4730880~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:43.045 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:17:43.045 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 62.742195871, 2024-09-12T16:17:43.045 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061359348000000001, 2024-09-12T16:17:43.045 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.045 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.045 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:43.045 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:43.045 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:43.045 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:43.045 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5611 2024-09-12T16:17:43.045 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.045 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.045 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.046 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.046 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:17:43.046 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.046 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.046 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.046 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.046 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:17:43.046 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.046 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.046 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.047 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.047 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296395+0000", 2024-09-12T16:17:43.047 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4600000000000003e-07 2024-09-12T16:17:43.047 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.047 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.047 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.047 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296399+0000", 2024-09-12T16:17:43.047 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9430000000000002e-06 2024-09-12T16:17:43.048 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.048 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.048 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.048 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296411+0000", 2024-09-12T16:17:43.048 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1755e-05 2024-09-12T16:17:43.048 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.048 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.048 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.048 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296417+0000", 2024-09-12T16:17:43.048 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3790000000000003e-06 2024-09-12T16:17:43.048 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.049 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.049 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.049 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357572+0000", 2024-09-12T16:17:43.049 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061154871 2024-09-12T16:17:43.049 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.049 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.049 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:43.049 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357663+0000", 2024-09-12T16:17:43.049 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0389999999999993e-05 2024-09-12T16:17:43.049 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.049 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.050 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.050 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357754+0000", 2024-09-12T16:17:43.050 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1063999999999994e-05 2024-09-12T16:17:43.050 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.050 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.050 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.050 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.050 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.050 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5613 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4775936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:43.050 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:43.050 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 62.742154691000003, 2024-09-12T16:17:43.050 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061491777999999997, 2024-09-12T16:17:43.050 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.051 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.051 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:43.051 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:43.051 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:43.051 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:43.051 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5613 2024-09-12T16:17:43.051 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.051 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.051 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.051 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.051 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:43.051 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.051 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.051 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.052 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.052 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:43.052 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.052 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.052 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.052 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.052 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:43.052 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8899999999999999e-07 2024-09-12T16:17:43.052 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.052 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.052 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.052 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296439+0000", 2024-09-12T16:17:43.052 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8439999999999998e-06 2024-09-12T16:17:43.053 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.053 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.053 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.053 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296452+0000", 2024-09-12T16:17:43.053 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2639e-05 2024-09-12T16:17:43.053 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.053 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.053 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.053 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296457+0000", 2024-09-12T16:17:43.053 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5720000000000002e-06 2024-09-12T16:17:43.053 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.053 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.053 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.054 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357773+0000", 2024-09-12T16:17:43.054 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061315500000000002 2024-09-12T16:17:43.054 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.054 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.054 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:43.054 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357814+0000", 2024-09-12T16:17:43.054 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1448e-05 2024-09-12T16:17:43.054 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.054 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.054 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.054 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357927+0000", 2024-09-12T16:17:43.054 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000113186 2024-09-12T16:17:43.055 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.055 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.055 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.055 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.055 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.055 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5616 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4784128~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:43.055 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:43.055 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 62.742119629000001, 2024-09-12T16:17:43.055 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061725002000000001, 2024-09-12T16:17:43.055 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.055 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.055 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:43.055 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:43.055 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:43.056 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:43.056 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5616 2024-09-12T16:17:43.056 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.056 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.056 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.056 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.056 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:43.056 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.056 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.056 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.056 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.056 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:43.056 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.056 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.056 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.057 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.057 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:43.057 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5900000000000002e-07 2024-09-12T16:17:43.057 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.057 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.057 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.057 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296473+0000", 2024-09-12T16:17:43.057 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3130000000000001e-06 2024-09-12T16:17:43.057 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.057 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.057 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.057 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296481+0000", 2024-09-12T16:17:43.057 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1389999999999998e-06 2024-09-12T16:17:43.057 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.057 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.058 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.058 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296486+0000", 2024-09-12T16:17:43.058 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3310000000000003e-06 2024-09-12T16:17:43.058 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.058 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.058 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.058 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357981+0000", 2024-09-12T16:17:43.058 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061494866000000002 2024-09-12T16:17:43.058 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.058 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.058 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:43.058 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358082+0000", 2024-09-12T16:17:43.058 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101424 2024-09-12T16:17:43.058 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.058 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.059 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.059 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358196+0000", 2024-09-12T16:17:43.059 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011347 2024-09-12T16:17:43.059 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.059 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.059 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.059 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.059 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.059 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5626 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4739072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:43.059 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:17:43.059 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 62.742041673000003, 2024-09-12T16:17:43.059 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061802430999999998, 2024-09-12T16:17:43.059 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.060 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.060 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:43.060 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:43.060 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:43.060 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:43.060 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5626 2024-09-12T16:17:43.060 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.060 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.060 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.060 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.060 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:17:43.060 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.060 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.061 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.061 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.061 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:17:43.061 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.061 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.061 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.061 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.061 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296550+0000", 2024-09-12T16:17:43.061 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.215e-06 2024-09-12T16:17:43.061 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.061 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.061 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.061 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296555+0000", 2024-09-12T16:17:43.061 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9590000000000003e-06 2024-09-12T16:17:43.061 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.062 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.062 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.062 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296568+0000", 2024-09-12T16:17:43.062 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3338e-05 2024-09-12T16:17:43.062 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.062 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.062 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.062 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296576+0000", 2024-09-12T16:17:43.062 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5510000000000002e-06 2024-09-12T16:17:43.062 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.062 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.062 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.062 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358241+0000", 2024-09-12T16:17:43.062 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.06166576 2024-09-12T16:17:43.062 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.063 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.063 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:43.063 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358288+0000", 2024-09-12T16:17:43.063 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6097000000000003e-05 2024-09-12T16:17:43.063 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.063 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.063 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.063 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358351+0000", 2024-09-12T16:17:43.063 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3510999999999996e-05 2024-09-12T16:17:43.063 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.063 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.063 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.063 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.063 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.064 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5628 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4792320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:43.064 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:17:43.064 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 62.741999172999996, 2024-09-12T16:17:43.064 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061961161000000001, 2024-09-12T16:17:43.064 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.064 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.064 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:43.064 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:43.064 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:43.064 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:43.064 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5628 2024-09-12T16:17:43.064 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.064 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.064 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.065 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.065 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:17:43.065 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.065 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.065 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.065 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.065 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:17:43.065 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.065 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.065 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.065 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.065 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296592+0000", 2024-09-12T16:17:43.065 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2099999999999996e-07 2024-09-12T16:17:43.065 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.066 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.066 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.066 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296595+0000", 2024-09-12T16:17:43.066 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0429999999999999e-06 2024-09-12T16:17:43.066 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.066 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.066 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.066 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296603+0000", 2024-09-12T16:17:43.066 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9899999999999997e-06 2024-09-12T16:17:43.066 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.066 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.066 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.067 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296609+0000", 2024-09-12T16:17:43.067 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7259999999999999e-06 2024-09-12T16:17:43.067 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.067 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.067 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.067 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358393+0000", 2024-09-12T16:17:43.067 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061784617 2024-09-12T16:17:43.067 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.067 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.067 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:43.067 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358460+0000", 2024-09-12T16:17:43.067 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7253000000000001e-05 2024-09-12T16:17:43.067 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.068 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.068 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.068 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358552+0000", 2024-09-12T16:17:43.068 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1811000000000006e-05 2024-09-12T16:17:43.068 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.068 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.068 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.068 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.068 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.068 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5638 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4734976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:43.068 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:43.068 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 62.741526622000002, 2024-09-12T16:17:43.068 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061654460000000001, 2024-09-12T16:17:43.068 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.069 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.069 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:43.069 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:43.069 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:43.069 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:43.069 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5638 2024-09-12T16:17:43.069 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.069 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.069 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.069 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.069 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:43.069 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.069 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.070 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.070 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.070 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:43.070 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.070 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.070 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.070 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.070 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:43.070 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.23e-07 2024-09-12T16:17:43.070 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.070 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.070 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.070 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297068+0000", 2024-09-12T16:17:43.070 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0060000000000003e-06 2024-09-12T16:17:43.071 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.071 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.071 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.071 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297080+0000", 2024-09-12T16:17:43.071 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1234e-05 2024-09-12T16:17:43.071 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.071 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.071 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.071 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297095+0000", 2024-09-12T16:17:43.071 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5698000000000001e-05 2024-09-12T16:17:43.071 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.071 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.071 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.071 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358582+0000", 2024-09-12T16:17:43.071 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061486274 2024-09-12T16:17:43.072 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.072 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.072 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:43.072 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358637+0000", 2024-09-12T16:17:43.072 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5439999999999998e-05 2024-09-12T16:17:43.072 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.072 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.072 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.072 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358718+0000", 2024-09-12T16:17:43.072 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0984999999999998e-05 2024-09-12T16:17:43.072 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.073 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.073 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.073 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.073 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.073 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5640 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4780032~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:43.073 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:17:43.073 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 62.741444901999998, 2024-09-12T16:17:43.073 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061746620000000002, 2024-09-12T16:17:43.073 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.073 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.073 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:43.073 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:43.073 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:43.073 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:43.074 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5640 2024-09-12T16:17:43.074 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.074 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.074 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.074 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.074 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:17:43.074 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.074 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.074 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.074 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.074 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:17:43.074 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.074 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.074 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.074 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.074 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297146+0000", 2024-09-12T16:17:43.075 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3600000000000003e-07 2024-09-12T16:17:43.075 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.075 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.075 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.075 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297150+0000", 2024-09-12T16:17:43.075 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8430000000000003e-06 2024-09-12T16:17:43.075 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.075 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.075 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.075 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297160+0000", 2024-09-12T16:17:43.075 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7229999999999999e-06 2024-09-12T16:17:43.075 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.075 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.075 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.075 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297167+0000", 2024-09-12T16:17:43.076 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0180000000000004e-06 2024-09-12T16:17:43.076 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.076 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.076 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.076 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358750+0000", 2024-09-12T16:17:43.076 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061583104 2024-09-12T16:17:43.076 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.076 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.076 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:43.076 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358804+0000", 2024-09-12T16:17:43.076 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4277000000000002e-05 2024-09-12T16:17:43.076 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.076 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.076 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.077 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358892+0000", 2024-09-12T16:17:43.077 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7918999999999996e-05 2024-09-12T16:17:43.077 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.077 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.077 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.077 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.077 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.077 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5642 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4788224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:43.077 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:43.077 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 62.741400558000002, 2024-09-12T16:17:43.077 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061860409999999998, 2024-09-12T16:17:43.077 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.077 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.077 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:43.078 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:43.078 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:43.078 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:43.078 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5642 2024-09-12T16:17:43.078 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.078 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.078 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.078 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.078 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:43.078 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.078 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.078 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.078 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.078 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:43.078 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.079 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.079 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.079 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.079 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:43.079 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7999999999999995e-07 2024-09-12T16:17:43.079 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.079 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.079 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.079 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297193+0000", 2024-09-12T16:17:43.079 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8310000000000001e-06 2024-09-12T16:17:43.079 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.079 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.079 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.079 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297204+0000", 2024-09-12T16:17:43.079 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0832999999999999e-05 2024-09-12T16:17:43.079 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.080 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.080 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.080 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297210+0000", 2024-09-12T16:17:43.080 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1770000000000003e-06 2024-09-12T16:17:43.080 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.080 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.080 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.080 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358928+0000", 2024-09-12T16:17:43.080 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061717826000000003 2024-09-12T16:17:43.080 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.080 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.080 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:43.080 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358977+0000", 2024-09-12T16:17:43.080 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9514000000000001e-05 2024-09-12T16:17:43.080 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.081 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.081 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.081 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359050+0000", 2024-09-12T16:17:43.081 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2649000000000002e-05 2024-09-12T16:17:43.081 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.081 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.081 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.081 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.081 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.081 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5646 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4743168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:43.081 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:43.081 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 62.741220617000003, 2024-09-12T16:17:43.081 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061822122, 2024-09-12T16:17:43.081 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.082 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.082 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:43.082 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:43.082 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:43.082 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:43.082 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5646 2024-09-12T16:17:43.082 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.082 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.082 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.082 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.082 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:43.082 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.082 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.082 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.082 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.083 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:43.083 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.083 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.083 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.083 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.083 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:43.083 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3200000000000004e-07 2024-09-12T16:17:43.083 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.083 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.083 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.083 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297374+0000", 2024-09-12T16:17:43.083 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8240000000000001e-06 2024-09-12T16:17:43.083 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.084 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.084 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.084 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297384+0000", 2024-09-12T16:17:43.084 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5710000000000004e-06 2024-09-12T16:17:43.084 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.084 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.084 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.084 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297390+0000", 2024-09-12T16:17:43.084 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5130000000000002e-06 2024-09-12T16:17:43.084 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.084 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.084 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.084 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359080+0000", 2024-09-12T16:17:43.085 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061689569999999999 2024-09-12T16:17:43.085 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.085 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.085 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:43.085 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359134+0000", 2024-09-12T16:17:43.085 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3838999999999997e-05 2024-09-12T16:17:43.085 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.085 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.085 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.085 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359192+0000", 2024-09-12T16:17:43.085 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8072999999999998e-05 2024-09-12T16:17:43.085 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.085 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.085 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.085 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.086 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.086 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5647 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4751360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:43.086 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:17:43.086 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 62.741183931999998, 2024-09-12T16:17:43.086 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061927569000000002, 2024-09-12T16:17:43.086 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.086 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.086 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:43.086 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:43.086 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:43.086 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:43.086 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5647 2024-09-12T16:17:43.086 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.086 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.087 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.087 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.087 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:17:43.087 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.087 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.087 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.087 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.087 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:17:43.087 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.087 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.087 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.087 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.087 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297407+0000", 2024-09-12T16:17:43.087 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.46e-07 2024-09-12T16:17:43.087 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.088 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.088 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.088 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297409+0000", 2024-09-12T16:17:43.088 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.469e-06 2024-09-12T16:17:43.088 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.088 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.088 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.088 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297415+0000", 2024-09-12T16:17:43.088 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9259999999999997e-06 2024-09-12T16:17:43.088 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.088 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.088 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.088 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297419+0000", 2024-09-12T16:17:43.088 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3840000000000001e-06 2024-09-12T16:17:43.089 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.089 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.089 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.089 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359224+0000", 2024-09-12T16:17:43.089 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061805367999999999 2024-09-12T16:17:43.089 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.089 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.089 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:43.089 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359275+0000", 2024-09-12T16:17:43.090 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1338000000000002e-05 2024-09-12T16:17:43.090 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.090 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.090 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.090 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359334+0000", 2024-09-12T16:17:43.090 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8638000000000003e-05 2024-09-12T16:17:43.090 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.090 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.090 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.090 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.090 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.090 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5649 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4796416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:43.090 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:17:43.091 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 62.741129073000003, 2024-09-12T16:17:43.091 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.062018578999999997, 2024-09-12T16:17:43.091 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.091 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.091 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:43.091 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:43.091 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:43.091 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:43.091 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5649 2024-09-12T16:17:43.091 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.091 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.091 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.091 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.092 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:17:43.092 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.092 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.092 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.092 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.092 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:17:43.092 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.092 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.092 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.092 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.092 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297462+0000", 2024-09-12T16:17:43.092 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2399999999999998e-07 2024-09-12T16:17:43.092 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.092 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.093 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.093 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297465+0000", 2024-09-12T16:17:43.093 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.371e-06 2024-09-12T16:17:43.093 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.093 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.093 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.093 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297473+0000", 2024-09-12T16:17:43.093 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4699999999999996e-06 2024-09-12T16:17:43.093 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.093 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.093 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.093 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297478+0000", 2024-09-12T16:17:43.094 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2780000000000001e-06 2024-09-12T16:17:43.094 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.094 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.094 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.094 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359368+0000", 2024-09-12T16:17:43.094 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061889758000000003 2024-09-12T16:17:43.094 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.094 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.094 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:43.094 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359420+0000", 2024-09-12T16:17:43.094 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2574999999999997e-05 2024-09-12T16:17:43.094 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.094 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.095 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.095 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359480+0000", 2024-09-12T16:17:43.095 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9503000000000003e-05 2024-09-12T16:17:43.095 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.095 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.095 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.095 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.095 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.095 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5674 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4739072~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:43.095 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:17:43.095 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 62.740725304999998, 2024-09-12T16:17:43.095 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061762989999999997, 2024-09-12T16:17:43.095 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.095 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.096 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:43.096 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:43.096 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:43.096 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:43.096 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5674 2024-09-12T16:17:43.096 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.096 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.096 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.096 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.096 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:17:43.096 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.096 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.096 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.096 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.097 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:17:43.097 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.097 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.097 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.097 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.097 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297866+0000", 2024-09-12T16:17:43.097 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1900000000000001e-07 2024-09-12T16:17:43.097 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.097 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.097 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.097 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297870+0000", 2024-09-12T16:17:43.097 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3560000000000003e-06 2024-09-12T16:17:43.097 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.098 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.098 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.098 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297888+0000", 2024-09-12T16:17:43.098 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8088999999999999e-05 2024-09-12T16:17:43.098 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.098 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.098 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.098 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297904+0000", 2024-09-12T16:17:43.098 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5971e-05 2024-09-12T16:17:43.098 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.098 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.098 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.098 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359510+0000", 2024-09-12T16:17:43.099 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061605634999999999 2024-09-12T16:17:43.099 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.099 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.099 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:43.099 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359554+0000", 2024-09-12T16:17:43.099 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4024999999999999e-05 2024-09-12T16:17:43.099 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.099 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.099 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.099 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359628+0000", 2024-09-12T16:17:43.099 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4095000000000001e-05 2024-09-12T16:17:43.099 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.099 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.100 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.100 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.100 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.100 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5676 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4792320~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:43.100 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:17:43.100 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 62.740524225000001, 2024-09-12T16:17:43.100 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061720143999999998, 2024-09-12T16:17:43.100 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.100 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.100 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:43.100 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:43.100 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:43.101 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:43.101 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5676 2024-09-12T16:17:43.101 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.101 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.101 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.101 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.101 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:17:43.101 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.101 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.101 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.101 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.102 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:17:43.102 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.102 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.102 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.102 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.102 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298067+0000", 2024-09-12T16:17:43.102 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8199999999999999e-07 2024-09-12T16:17:43.102 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.102 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.102 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.102 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298070+0000", 2024-09-12T16:17:43.102 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.743e-06 2024-09-12T16:17:43.102 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.103 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.103 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.103 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298080+0000", 2024-09-12T16:17:43.103 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4059999999999994e-06 2024-09-12T16:17:43.103 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.103 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.103 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.103 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298088+0000", 2024-09-12T16:17:43.103 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0779999999999996e-06 2024-09-12T16:17:43.103 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.103 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.103 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.104 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359659+0000", 2024-09-12T16:17:43.104 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061570688999999998 2024-09-12T16:17:43.104 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.104 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.104 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:43.104 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359713+0000", 2024-09-12T16:17:43.104 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3939e-05 2024-09-12T16:17:43.104 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.104 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.104 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.104 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359786+0000", 2024-09-12T16:17:43.104 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3607000000000002e-05 2024-09-12T16:17:43.104 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.104 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.104 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.105 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.105 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.105 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5684 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4747264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:43.105 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:17:43.105 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 62.740056932999998, 2024-09-12T16:17:43.105 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061394799, 2024-09-12T16:17:43.105 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.105 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.105 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:43.105 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:43.106 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:43.106 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:43.106 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5684 2024-09-12T16:17:43.106 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.106 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.106 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.106 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.106 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:17:43.106 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.106 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.106 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.106 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.106 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:17:43.106 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.107 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.107 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.107 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.107 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298534+0000", 2024-09-12T16:17:43.107 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4399999999999999e-07 2024-09-12T16:17:43.107 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.107 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.107 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.107 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298539+0000", 2024-09-12T16:17:43.107 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5360000000000003e-06 2024-09-12T16:17:43.107 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.108 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.108 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.108 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298550+0000", 2024-09-12T16:17:43.108 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1499e-05 2024-09-12T16:17:43.108 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.108 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.108 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.108 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298558+0000", 2024-09-12T16:17:43.108 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3000000000000004e-06 2024-09-12T16:17:43.108 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.108 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.108 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.108 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359815+0000", 2024-09-12T16:17:43.109 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061257952999999997 2024-09-12T16:17:43.109 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.109 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.109 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:43.109 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359868+0000", 2024-09-12T16:17:43.109 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2317000000000001e-05 2024-09-12T16:17:43.109 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.109 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.109 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.109 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359928+0000", 2024-09-12T16:17:43.109 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0350000000000003e-05 2024-09-12T16:17:43.109 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.109 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.109 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.109 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.110 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.110 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5686 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4755456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:43.110 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:17:43.110 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 62.739889509000001, 2024-09-12T16:17:43.110 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061355082999999998, 2024-09-12T16:17:43.110 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.110 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.110 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:43.110 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:43.110 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:43.110 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:43.110 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5686 2024-09-12T16:17:43.110 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.111 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.111 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.111 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.111 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:17:43.111 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.111 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.111 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.111 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.111 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:17:43.111 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.111 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.111 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.111 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.112 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298702+0000", 2024-09-12T16:17:43.112 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2399999999999997e-07 2024-09-12T16:17:43.112 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.112 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.112 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.112 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298706+0000", 2024-09-12T16:17:43.112 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5700000000000003e-06 2024-09-12T16:17:43.112 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.112 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.112 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.112 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298718+0000", 2024-09-12T16:17:43.112 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1457999999999999e-05 2024-09-12T16:17:43.112 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.112 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.112 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.113 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298732+0000", 2024-09-12T16:17:43.113 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.452e-05 2024-09-12T16:17:43.113 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.113 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.113 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.113 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359956+0000", 2024-09-12T16:17:43.113 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061223626000000003 2024-09-12T16:17:43.113 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.113 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.113 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:43.113 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360000+0000", 2024-09-12T16:17:43.113 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3922999999999999e-05 2024-09-12T16:17:43.113 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.113 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.114 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.114 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360056+0000", 2024-09-12T16:17:43.114 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6162000000000002e-05 2024-09-12T16:17:43.114 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.114 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.114 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.114 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.114 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.114 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5688 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4800512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:43.114 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:17:43.115 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 62.739666456000002, 2024-09-12T16:17:43.115 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061270514999999998, 2024-09-12T16:17:43.115 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.115 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.115 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:43.115 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:43.115 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:43.115 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:43.115 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5688 2024-09-12T16:17:43.115 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.115 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.115 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.115 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.116 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:17:43.116 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.116 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.116 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.116 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.116 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:17:43.116 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.116 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.116 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.116 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.116 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298925+0000", 2024-09-12T16:17:43.116 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4e-07 2024-09-12T16:17:43.116 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.117 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.117 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.117 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298929+0000", 2024-09-12T16:17:43.117 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9890000000000003e-06 2024-09-12T16:17:43.117 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.117 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.117 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.117 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298936+0000", 2024-09-12T16:17:43.117 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.52e-06 2024-09-12T16:17:43.117 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.117 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.117 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.117 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298941+0000", 2024-09-12T16:17:43.117 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4800000000000003e-06 2024-09-12T16:17:43.117 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.118 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.118 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.118 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360087+0000", 2024-09-12T16:17:43.118 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061146143 2024-09-12T16:17:43.118 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.118 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.118 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:43.118 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360137+0000", 2024-09-12T16:17:43.118 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0584000000000002e-05 2024-09-12T16:17:43.118 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.118 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.118 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.118 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360194+0000", 2024-09-12T16:17:43.118 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6858999999999999e-05 2024-09-12T16:17:43.118 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.118 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.119 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.119 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.119 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.119 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5693 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4751360~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:43.119 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:17:43.119 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 62.739244819, 2024-09-12T16:17:43.119 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061139444000000001, 2024-09-12T16:17:43.119 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.119 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.119 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:43.119 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:43.119 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:43.120 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:43.120 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5693 2024-09-12T16:17:43.120 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.120 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.120 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.120 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.120 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:17:43.120 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.120 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.120 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.120 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.120 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:17:43.120 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.121 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.121 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.121 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.121 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299346+0000", 2024-09-12T16:17:43.121 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2300000000000001e-07 2024-09-12T16:17:43.121 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.121 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.121 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.121 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299349+0000", 2024-09-12T16:17:43.121 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5270000000000001e-06 2024-09-12T16:17:43.121 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.121 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.121 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.121 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299358+0000", 2024-09-12T16:17:43.122 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7030000000000001e-06 2024-09-12T16:17:43.122 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.122 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.122 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.122 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299364+0000", 2024-09-12T16:17:43.122 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7239999999999997e-06 2024-09-12T16:17:43.122 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.122 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.122 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.122 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360369+0000", 2024-09-12T16:17:43.122 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061004713000000002 2024-09-12T16:17:43.122 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.122 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.122 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:43.123 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360415+0000", 2024-09-12T16:17:43.123 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5926e-05 2024-09-12T16:17:43.123 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.123 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.123 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.123 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360485+0000", 2024-09-12T16:17:43.123 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0327999999999995e-05 2024-09-12T16:17:43.123 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.123 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.123 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.123 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.123 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.123 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5694 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4796416~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:43.123 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:17:43.124 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 62.739215790000003, 2024-09-12T16:17:43.124 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061258034000000003, 2024-09-12T16:17:43.124 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.124 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.124 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:43.124 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:43.124 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:43.124 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:43.124 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5694 2024-09-12T16:17:43.124 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.124 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.124 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.125 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.125 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:17:43.125 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.125 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.125 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.125 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.125 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:17:43.125 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.125 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.125 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.125 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.125 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301884+0000", 2024-09-12T16:17:43.125 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025090379999999999 2024-09-12T16:17:43.125 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.125 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.126 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.126 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301889+0000", 2024-09-12T16:17:43.126 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5879999999999997e-06 2024-09-12T16:17:43.126 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.126 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.126 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.126 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301901+0000", 2024-09-12T16:17:43.126 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1466e-05 2024-09-12T16:17:43.126 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.126 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.126 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.127 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301908+0000", 2024-09-12T16:17:43.127 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1999999999999997e-06 2024-09-12T16:17:43.127 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.127 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.127 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.127 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360513+0000", 2024-09-12T16:17:43.127 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.058605023999999999 2024-09-12T16:17:43.127 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.127 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.127 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:43.127 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360562+0000", 2024-09-12T16:17:43.127 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9546000000000003e-05 2024-09-12T16:17:43.127 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.127 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.127 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.128 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360633+0000", 2024-09-12T16:17:43.128 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0172000000000005e-05 2024-09-12T16:17:43.128 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.128 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.128 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.128 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.128 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.128 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5759 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4767744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:43.128 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:17:43.128 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 62.736422255999997, 2024-09-12T16:17:43.128 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061058604000000002, 2024-09-12T16:17:43.128 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.129 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.129 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:43.129 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:43.129 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:43.129 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:43.129 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5759 2024-09-12T16:17:43.129 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.129 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.129 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.129 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.129 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:17:43.129 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.129 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.129 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.130 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.130 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:17:43.130 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.130 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.130 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.130 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.130 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302548+0000", 2024-09-12T16:17:43.130 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00038011000000000002 2024-09-12T16:17:43.130 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.130 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.130 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.130 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302553+0000", 2024-09-12T16:17:43.130 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1830000000000002e-06 2024-09-12T16:17:43.130 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.130 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.131 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.131 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302564+0000", 2024-09-12T16:17:43.131 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1011e-05 2024-09-12T16:17:43.131 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.131 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.131 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.131 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302572+0000", 2024-09-12T16:17:43.131 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9009999999999994e-06 2024-09-12T16:17:43.131 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.131 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.131 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.131 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363102+0000", 2024-09-12T16:17:43.132 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.060529782999999997 2024-09-12T16:17:43.132 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.132 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.132 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:43.132 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363149+0000", 2024-09-12T16:17:43.132 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7321000000000003e-05 2024-09-12T16:17:43.132 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.132 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.132 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.132 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363227+0000", 2024-09-12T16:17:43.132 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7294999999999998e-05 2024-09-12T16:17:43.132 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.132 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.132 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.133 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.133 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.133 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:43.134 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:17:43.135 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:43.133+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:43.235 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:43.234+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:43.283 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:43.283 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:43.284 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:17:43.284 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:43.291 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:17:43.336 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:43.335+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:43.373 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T16:17:43.400 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:43.400 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:43.400 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:17:43.400 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:17:43.401 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:43.409 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:17:43.436 INFO:teuthology.orchestra.run.smithi204.stdout:truncating image image_client.0-clone35 from 0x54a8600 (overlap 0x1fc5600) to 0x0 2024-09-12T16:17:43.453 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:43.452+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:43.520 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:43.520 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:17:43.520 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:17:43.521 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:17:43.521 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.521 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.17 73/72 [PushOp(3:e9340267:::rbd_data.1155525b14e3.0000000000000031:f, version: 50'357, data_included: [0~4096,20480~4096,40960~8192,65536~4096,81920~8192,110592~4096,126976~8192,151552~4096,172032~8192,196608~4096,212992~8192,241664~4096,258048~8192,282624~4096,303104~8192,327680~4096,344064~8192,372736~4096,389120~8192,413696~4096,434176~8192,458752~4096,475136~8192,503808~4096,520192~8192,544768~4096,565248~8192,589824~4096,606208~8192,634880~4096,651264~8192,675840~4096,696320~8192,720896~4096,737280~8192,765952~4096,782336~8192,806912~4096,827392~8192,851968~4096,868352~8192,897024~4096,913408~8192,937984~4096,958464~8192,983040~4096,999424~8192,1028096~4096,1044480~4096], data_size: 294912, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:e9340267:::rbd_data.1155525b14e3.0000000000000031:f@50'357, size: 1048576, copy_subset: [(0, 1048576)], clone_subset: {}, snapset: f=[]:{f: [f]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T16:17:43.521 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.067448+0000", 2024-09-12T16:17:43.521 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 37.451489823000003, 2024-09-12T16:17:43.521 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003036721, 2024-09-12T16:17:43.521 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.521 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.521 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:43.521 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.521 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.521 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.522 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067448+0000", 2024-09-12T16:17:43.522 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.522 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.522 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.522 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.522 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067448+0000", 2024-09-12T16:17:43.522 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.522 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.522 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.522 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.522 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067449+0000", 2024-09-12T16:17:43.522 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2200000000000004e-07 2024-09-12T16:17:43.522 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.523 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.523 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.523 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067703+0000", 2024-09-12T16:17:43.523 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025377199999999998 2024-09-12T16:17:43.523 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.523 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.523 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.523 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067723+0000", 2024-09-12T16:17:43.523 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.986e-05 2024-09-12T16:17:43.523 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.523 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.523 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.523 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067743+0000", 2024-09-12T16:17:43.524 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9942e-05 2024-09-12T16:17:43.524 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.524 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.524 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.524 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067860+0000", 2024-09-12T16:17:43.524 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000116959 2024-09-12T16:17:43.524 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.524 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.524 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:43.524 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067872+0000", 2024-09-12T16:17:43.524 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2928000000000001e-05 2024-09-12T16:17:43.524 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.524 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.524 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.525 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.070485+0000", 2024-09-12T16:17:43.525 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0026127379999999999 2024-09-12T16:17:43.525 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.525 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.525 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.525 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.525 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.525 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5120.0:3941 3.17 e80/74 3:eff97428:::rbd_data.1155a3b3a26e.0000000000000060:head v 80'442, mlcod=79'439)", 2024-09-12T16:17:43.525 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:17:43.525 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 27.163149342000001, 2024-09-12T16:17:43.525 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0035981759999999998, 2024-09-12T16:17:43.525 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.526 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.526 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:43.526 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.526 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.526 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.526 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:17:43.526 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.526 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.526 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.526 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.526 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:17:43.526 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.526 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.526 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.526 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.527 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:17:43.527 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2e-07 2024-09-12T16:17:43.527 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.527 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.527 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.527 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355794+0000", 2024-09-12T16:17:43.527 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.865e-06 2024-09-12T16:17:43.527 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.527 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.527 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.527 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355956+0000", 2024-09-12T16:17:43.527 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016131699999999999 2024-09-12T16:17:43.527 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.527 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.528 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.528 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355964+0000", 2024-09-12T16:17:43.528 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7960000000000001e-06 2024-09-12T16:17:43.528 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.528 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.528 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.528 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.356320+0000", 2024-09-12T16:17:43.528 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000355612 2024-09-12T16:17:43.528 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.528 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.528 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:43.528 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.356337+0000", 2024-09-12T16:17:43.528 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6643e-05 2024-09-12T16:17:43.529 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.529 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.529 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:43.529 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.359340+0000", 2024-09-12T16:17:43.529 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003003618 2024-09-12T16:17:43.529 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.529 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.529 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.529 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.359387+0000", 2024-09-12T16:17:43.529 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6904999999999999e-05 2024-09-12T16:17:43.529 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.529 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.529 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.529 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.529 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.530 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2118 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1219, mlcod=88'1217)", 2024-09-12T16:17:43.530 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440434+0000", 2024-09-12T16:17:43.530 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 18.078504452000001, 2024-09-12T16:17:43.530 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003875543, 2024-09-12T16:17:43.530 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.530 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.530 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:43.530 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.530 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.530 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.530 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440434+0000", 2024-09-12T16:17:43.530 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.530 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.530 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.531 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.531 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440434+0000", 2024-09-12T16:17:43.531 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.531 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.531 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.531 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.531 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440435+0000", 2024-09-12T16:17:43.531 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8899999999999998e-07 2024-09-12T16:17:43.531 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.531 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.531 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.531 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440444+0000", 2024-09-12T16:17:43.531 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4599999999999992e-06 2024-09-12T16:17:43.532 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.532 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.532 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.532 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440459+0000", 2024-09-12T16:17:43.532 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4460999999999999e-05 2024-09-12T16:17:43.532 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.532 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.532 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.532 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440466+0000", 2024-09-12T16:17:43.532 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4340000000000003e-06 2024-09-12T16:17:43.532 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.532 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.532 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.533 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:17:43.533 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9054999999999997e-05 2024-09-12T16:17:43.533 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.533 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.533 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:43.533 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440535+0000", 2024-09-12T16:17:43.533 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.98e-05 2024-09-12T16:17:43.533 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.533 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.533 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:43.533 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444269+0000", 2024-09-12T16:17:43.533 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003734448 2024-09-12T16:17:43.533 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.534 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.534 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.534 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444309+0000", 2024-09-12T16:17:43.534 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0095999999999997e-05 2024-09-12T16:17:43.534 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.534 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.534 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.534 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.534 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.534 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2122 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1220, mlcod=88'1217)", 2024-09-12T16:17:43.534 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440484+0000", 2024-09-12T16:17:43.534 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 18.078453946, 2024-09-12T16:17:43.534 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0038538029999999998, 2024-09-12T16:17:43.534 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.535 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.535 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:43.535 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.535 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.535 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.535 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440484+0000", 2024-09-12T16:17:43.535 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.535 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.535 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.535 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.535 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440484+0000", 2024-09-12T16:17:43.535 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.536 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.536 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.536 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.536 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440485+0000", 2024-09-12T16:17:43.536 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6100000000000002e-07 2024-09-12T16:17:43.536 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.536 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.536 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.536 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440493+0000", 2024-09-12T16:17:43.536 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0169999999999996e-06 2024-09-12T16:17:43.537 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.537 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.537 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.537 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440501+0000", 2024-09-12T16:17:43.537 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9319999999999996e-06 2024-09-12T16:17:43.537 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.537 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.537 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.537 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440506+0000", 2024-09-12T16:17:43.537 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3510000000000001e-06 2024-09-12T16:17:43.537 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.537 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.537 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.538 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441319+0000", 2024-09-12T16:17:43.538 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00081295300000000005 2024-09-12T16:17:43.538 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.538 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.538 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:43.538 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441336+0000", 2024-09-12T16:17:43.538 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6897000000000001e-05 2024-09-12T16:17:43.538 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.538 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.538 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:43.538 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444311+0000", 2024-09-12T16:17:43.538 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029754510000000001 2024-09-12T16:17:43.538 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.538 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.539 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.539 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444338+0000", 2024-09-12T16:17:43.539 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6840999999999999e-05 2024-09-12T16:17:43.539 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.539 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.539 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.539 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.539 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.539 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2124 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1221, mlcod=88'1217)", 2024-09-12T16:17:43.539 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:17:43.539 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 18.078423374, 2024-09-12T16:17:43.539 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0038507229999999999, 2024-09-12T16:17:43.539 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.539 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.539 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:43.540 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.540 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.540 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.540 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:17:43.540 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.540 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.540 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.540 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.540 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:17:43.540 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.540 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.540 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.540 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.540 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:17:43.540 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8799999999999998e-07 2024-09-12T16:17:43.541 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.541 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.541 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.541 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440519+0000", 2024-09-12T16:17:43.541 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5499999999999999e-06 2024-09-12T16:17:43.541 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.541 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.541 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.541 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440525+0000", 2024-09-12T16:17:43.541 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1009999999999997e-06 2024-09-12T16:17:43.541 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.541 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.541 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.541 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440529+0000", 2024-09-12T16:17:43.541 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3749999999999996e-06 2024-09-12T16:17:43.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.542 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.542 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.542 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441883+0000", 2024-09-12T16:17:43.542 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0013538249999999999 2024-09-12T16:17:43.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.542 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.542 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:43.542 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441901+0000", 2024-09-12T16:17:43.542 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7972999999999999e-05 2024-09-12T16:17:43.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.542 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.542 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:43.543 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444341+0000", 2024-09-12T16:17:43.543 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002439568 2024-09-12T16:17:43.543 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.543 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.543 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.543 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444366+0000", 2024-09-12T16:17:43.543 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5043000000000001e-05 2024-09-12T16:17:43.543 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.543 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.543 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.543 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.543 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.543 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2327 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1222, mlcod=88'1217)", 2024-09-12T16:17:43.543 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440696+0000", 2024-09-12T16:17:43.543 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 18.078242031999999, 2024-09-12T16:17:43.544 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0036945739999999999, 2024-09-12T16:17:43.544 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.544 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.544 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:43.544 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.544 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.544 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.544 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440696+0000", 2024-09-12T16:17:43.544 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.544 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.544 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.544 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.544 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440696+0000", 2024-09-12T16:17:43.544 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.545 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.545 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.545 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440697+0000", 2024-09-12T16:17:43.545 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5899999999999996e-07 2024-09-12T16:17:43.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.545 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.545 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.545 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440702+0000", 2024-09-12T16:17:43.545 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0969999999999996e-06 2024-09-12T16:17:43.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.545 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.545 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.546 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440713+0000", 2024-09-12T16:17:43.546 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1114000000000001e-05 2024-09-12T16:17:43.546 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.546 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.546 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.546 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440719+0000", 2024-09-12T16:17:43.546 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1650000000000003e-06 2024-09-12T16:17:43.546 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.546 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.546 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.546 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.442435+0000", 2024-09-12T16:17:43.546 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017155440000000001 2024-09-12T16:17:43.546 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.546 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.547 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:43.547 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.442457+0000", 2024-09-12T16:17:43.547 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1793999999999998e-05 2024-09-12T16:17:43.547 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.547 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.547 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:43.547 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444367+0000", 2024-09-12T16:17:43.547 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0019101980000000001 2024-09-12T16:17:43.547 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.547 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.547 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.547 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444391+0000", 2024-09-12T16:17:43.547 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4003e-05 2024-09-12T16:17:43.548 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.548 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.548 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.548 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.548 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.548 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2487 3.1d e88/74 3:b8c395a6:::rbd_data.11558d85ce23.000000000000000b:head v 88'1225, mlcod=88'1223)", 2024-09-12T16:17:43.548 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:17:43.548 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 18.072727662999998, 2024-09-12T16:17:43.548 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033166039999999999, 2024-09-12T16:17:43.548 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.548 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.548 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:43.549 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.549 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.549 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.549 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:17:43.549 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.549 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.549 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.549 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:17:43.549 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.549 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.549 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.549 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:17:43.550 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9299999999999997e-07 2024-09-12T16:17:43.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.550 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.550 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446295+0000", 2024-09-12T16:17:43.550 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3153999999999997e-05 2024-09-12T16:17:43.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.550 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.550 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446309+0000", 2024-09-12T16:17:43.550 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4015e-05 2024-09-12T16:17:43.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.551 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.551 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446317+0000", 2024-09-12T16:17:43.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4880000000000007e-06 2024-09-12T16:17:43.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.551 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.551 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446373+0000", 2024-09-12T16:17:43.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5766000000000001e-05 2024-09-12T16:17:43.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.551 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:43.551 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446395+0000", 2024-09-12T16:17:43.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2500000000000001e-05 2024-09-12T16:17:43.552 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.552 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.552 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:43.552 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.449445+0000", 2024-09-12T16:17:43.552 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003049791 2024-09-12T16:17:43.552 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.552 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.552 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.552 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.449527+0000", 2024-09-12T16:17:43.552 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2096999999999997e-05 2024-09-12T16:17:43.552 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.552 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.553 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.553 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.553 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2493 3.2 e88/74 3:46cb4ff0:::rbd_data.11558d85ce23.000000000000000e:head v 88'372, mlcod=87'370)", 2024-09-12T16:17:43.553 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.447443+0000", 2024-09-12T16:17:43.553 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 18.071495724999998, 2024-09-12T16:17:43.553 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029120330000000001, 2024-09-12T16:17:43.553 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.553 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.553 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:43.553 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.553 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.553 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447443+0000", 2024-09-12T16:17:43.554 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.554 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.554 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.554 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447443+0000", 2024-09-12T16:17:43.554 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.554 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.554 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.554 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447443+0000", 2024-09-12T16:17:43.554 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4600000000000001e-07 2024-09-12T16:17:43.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.555 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.555 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.555 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447779+0000", 2024-09-12T16:17:43.555 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00033639800000000001 2024-09-12T16:17:43.555 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.555 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.555 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.555 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447790+0000", 2024-09-12T16:17:43.555 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0555e-05 2024-09-12T16:17:43.555 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.555 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.555 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.556 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447797+0000", 2024-09-12T16:17:43.556 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1729999999999998e-06 2024-09-12T16:17:43.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.556 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.556 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.556 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447862+0000", 2024-09-12T16:17:43.556 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4670000000000003e-05 2024-09-12T16:17:43.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.556 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.556 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:43.556 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447889+0000", 2024-09-12T16:17:43.556 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.773e-05 2024-09-12T16:17:43.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.557 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.557 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:43.557 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.450311+0000", 2024-09-12T16:17:43.557 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0024212510000000001 2024-09-12T16:17:43.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.557 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.557 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.560 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.450355+0000", 2024-09-12T16:17:43.560 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.401e-05 2024-09-12T16:17:43.560 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.560 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.560 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.560 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.560 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "pg_update_log_missing(3.5 epoch 92/74 rep_tid 1618 entries 92'520 (0'0) error 3:a46c381c:::rbd_data.1155c757bf36.000000000000002f:head by client.5577.0:14350 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 92'518)", 2024-09-12T16:17:43.561 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.408248+0000", 2024-09-12T16:17:43.561 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 13.110689845, 2024-09-12T16:17:43.561 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029209660000000001, 2024-09-12T16:17:43.561 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.561 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.561 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "reached pg", 2024-09-12T16:17:43.561 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.561 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.561 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408248+0000", 2024-09-12T16:17:43.561 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.561 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.562 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408248+0000", 2024-09-12T16:17:43.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.562 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.562 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.562 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408249+0000", 2024-09-12T16:17:43.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9800000000000002e-07 2024-09-12T16:17:43.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.562 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.562 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.562 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408259+0000", 2024-09-12T16:17:43.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1949999999999992e-06 2024-09-12T16:17:43.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.563 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.563 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.563 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408278+0000", 2024-09-12T16:17:43.563 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9157e-05 2024-09-12T16:17:43.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.563 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.563 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.563 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408291+0000", 2024-09-12T16:17:43.563 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3655000000000001e-05 2024-09-12T16:17:43.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.563 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.563 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.563 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408369+0000", 2024-09-12T16:17:43.563 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7804000000000002e-05 2024-09-12T16:17:43.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.564 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.564 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.564 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411169+0000", 2024-09-12T16:17:43.564 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002800257 2024-09-12T16:17:43.564 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.564 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.564 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.564 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.564 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "pg_update_log_missing(3.1d epoch 92/74 rep_tid 3087 entries 92'1280 (0'0) error 3:bc3c4c0b:::rbd_data.1155c757bf36.000000000000002c:head by client.5577.0:14343 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 90'1278)", 2024-09-12T16:17:43.564 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.408860+0000", 2024-09-12T16:17:43.565 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 13.110078217, 2024-09-12T16:17:43.565 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0056480419999999998, 2024-09-12T16:17:43.565 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.565 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.565 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "reached pg", 2024-09-12T16:17:43.565 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.565 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.565 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.565 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408860+0000", 2024-09-12T16:17:43.565 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.565 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.565 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.566 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408860+0000", 2024-09-12T16:17:43.566 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.566 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.566 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408861+0000", 2024-09-12T16:17:43.566 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6600000000000002e-07 2024-09-12T16:17:43.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.566 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.566 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408867+0000", 2024-09-12T16:17:43.566 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4150000000000004e-06 2024-09-12T16:17:43.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.567 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.567 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.567 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408881+0000", 2024-09-12T16:17:43.567 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4326e-05 2024-09-12T16:17:43.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.567 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.567 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.567 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408895+0000", 2024-09-12T16:17:43.567 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3903000000000001e-05 2024-09-12T16:17:43.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.567 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.567 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.567 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410566+0000", 2024-09-12T16:17:43.568 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001670822 2024-09-12T16:17:43.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.568 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.568 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.568 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414508+0000", 2024-09-12T16:17:43.568 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039421100000000004 2024-09-12T16:17:43.568 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.568 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.568 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.568 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.568 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "pg_update_log_missing(3.5 epoch 92/74 rep_tid 1621 entries 92'521 (0'0) error 3:a759f741:::rbd_data.1155c757bf36.0000000000000036:head by client.5577.0:14364 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 92'518)", 2024-09-12T16:17:43.568 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:17:43.569 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 13.10912974, 2024-09-12T16:17:43.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047586740000000001, 2024-09-12T16:17:43.569 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.569 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.569 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "reached pg", 2024-09-12T16:17:43.569 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.569 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.569 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:17:43.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.569 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.570 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:17:43.570 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.570 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.570 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:17:43.570 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.54e-07 2024-09-12T16:17:43.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.570 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.570 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409817+0000", 2024-09-12T16:17:43.570 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.028e-06 2024-09-12T16:17:43.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.570 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.571 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410047+0000", 2024-09-12T16:17:43.571 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022964599999999999 2024-09-12T16:17:43.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.571 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.571 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.571 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410067+0000", 2024-09-12T16:17:43.571 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0438999999999999e-05 2024-09-12T16:17:43.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.571 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.571 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.571 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411223+0000", 2024-09-12T16:17:43.571 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011560229999999999 2024-09-12T16:17:43.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.571 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.571 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.572 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414567+0000", 2024-09-12T16:17:43.572 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033437839999999998 2024-09-12T16:17:43.572 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.572 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.572 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.572 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.572 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14391 3.5 e92/74 3:a5105766:::rbd_data.1155c757bf36.0000000000000044:head v 92'523, mlcod=92'518)", 2024-09-12T16:17:43.572 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.410084+0000", 2024-09-12T16:17:43.572 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 13.108853870000001, 2024-09-12T16:17:43.572 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0046720299999999998, 2024-09-12T16:17:43.572 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.572 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.572 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:43.572 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.573 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.573 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410084+0000", 2024-09-12T16:17:43.573 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.573 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.573 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410084+0000", 2024-09-12T16:17:43.573 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.573 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.573 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410085+0000", 2024-09-12T16:17:43.573 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1900000000000002e-07 2024-09-12T16:17:43.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.574 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410091+0000", 2024-09-12T16:17:43.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1e-06 2024-09-12T16:17:43.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.574 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410100+0000", 2024-09-12T16:17:43.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6889999999999993e-06 2024-09-12T16:17:43.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.574 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410105+0000", 2024-09-12T16:17:43.575 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3199999999999999e-06 2024-09-12T16:17:43.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.575 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.575 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.575 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411563+0000", 2024-09-12T16:17:43.575 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00145795 2024-09-12T16:17:43.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.575 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.575 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:43.575 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411590+0000", 2024-09-12T16:17:43.575 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6570000000000001e-05 2024-09-12T16:17:43.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.576 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.576 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:43.576 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414571+0000", 2024-09-12T16:17:43.576 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029815710000000001 2024-09-12T16:17:43.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.576 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.576 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.576 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414756+0000", 2024-09-12T16:17:43.576 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018521100000000001 2024-09-12T16:17:43.576 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.576 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.576 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.576 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.577 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14405 3.5 e92/74 3:a0797093:::rbd_data.1155c757bf36.000000000000004b:head v 92'525, mlcod=92'518)", 2024-09-12T16:17:43.577 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.410119+0000", 2024-09-12T16:17:43.577 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 13.10881893, 2024-09-12T16:17:43.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047304000000000001, 2024-09-12T16:17:43.577 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.577 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.577 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:43.577 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.577 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410119+0000", 2024-09-12T16:17:43.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.578 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.578 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410119+0000", 2024-09-12T16:17:43.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.578 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.578 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410120+0000", 2024-09-12T16:17:43.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:17:43.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.578 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.579 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410126+0000", 2024-09-12T16:17:43.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1460000000000001e-06 2024-09-12T16:17:43.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.579 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410134+0000", 2024-09-12T16:17:43.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8879999999999997e-06 2024-09-12T16:17:43.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.579 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410140+0000", 2024-09-12T16:17:43.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0839999999999997e-06 2024-09-12T16:17:43.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.580 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.580 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.580 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412146+0000", 2024-09-12T16:17:43.580 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0020057569999999999 2024-09-12T16:17:43.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.580 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.580 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:43.580 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412163+0000", 2024-09-12T16:17:43.580 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7742000000000001e-05 2024-09-12T16:17:43.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.580 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.580 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:43.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414761+0000", 2024-09-12T16:17:43.581 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025979660000000002 2024-09-12T16:17:43.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414850+0000", 2024-09-12T16:17:43.581 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8426999999999999e-05 2024-09-12T16:17:43.581 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.581 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.581 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.581 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14435 3.1d e92/74 3:b810b250:::rbd_data.1155c757bf36.000000000000010b:head v 92'1282, mlcod=90'1278)", 2024-09-12T16:17:43.581 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:17:43.582 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 13.107976461, 2024-09-12T16:17:43.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039190579999999996, 2024-09-12T16:17:43.582 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.582 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.582 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:43.582 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:17:43.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:17:43.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:17:43.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5199999999999996e-07 2024-09-12T16:17:43.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.584 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.584 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.584 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410968+0000", 2024-09-12T16:17:43.584 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.305e-06 2024-09-12T16:17:43.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.584 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.584 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.584 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410986+0000", 2024-09-12T16:17:43.584 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8213999999999999e-05 2024-09-12T16:17:43.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.584 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.585 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.585 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410993+0000", 2024-09-12T16:17:43.585 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2849999999999997e-06 2024-09-12T16:17:43.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.585 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.585 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.585 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412228+0000", 2024-09-12T16:17:43.585 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0012347370000000001 2024-09-12T16:17:43.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.585 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.585 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:43.585 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412262+0000", 2024-09-12T16:17:43.585 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3531999999999997e-05 2024-09-12T16:17:43.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:43.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414854+0000", 2024-09-12T16:17:43.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002592039 2024-09-12T16:17:43.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414881+0000", 2024-09-12T16:17:43.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7294e-05 2024-09-12T16:17:43.586 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.586 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.586 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.587 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14434 3.5 e92/74 3:a09dd60f:::rbd_data.1155c757bf36.000000000000010a:head v 92'527, mlcod=92'518)", 2024-09-12T16:17:43.587 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.411186+0000", 2024-09-12T16:17:43.587 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 13.107752314000001, 2024-09-12T16:17:43.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0037696930000000002, 2024-09-12T16:17:43.587 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.587 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.587 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:43.587 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411186+0000", 2024-09-12T16:17:43.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.588 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411186+0000", 2024-09-12T16:17:43.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.588 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411187+0000", 2024-09-12T16:17:43.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3799999999999997e-07 2024-09-12T16:17:43.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.588 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411203+0000", 2024-09-12T16:17:43.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6793999999999999e-05 2024-09-12T16:17:43.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.589 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.589 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411323+0000", 2024-09-12T16:17:43.589 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011975499999999999 2024-09-12T16:17:43.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.589 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.589 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411332+0000", 2024-09-12T16:17:43.589 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4370000000000007e-06 2024-09-12T16:17:43.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.589 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.413073+0000", 2024-09-12T16:17:43.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001741827 2024-09-12T16:17:43.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:43.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.413091+0000", 2024-09-12T16:17:43.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8011000000000001e-05 2024-09-12T16:17:43.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:43.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414882+0000", 2024-09-12T16:17:43.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001790841 2024-09-12T16:17:43.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414956+0000", 2024-09-12T16:17:43.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.339e-05 2024-09-12T16:17:43.591 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.591 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.591 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.591 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14426 3.13 e92/74 3:c827d1d7:::rbd_data.1155c757bf36.0000000000000056:head v 92'741, mlcod=90'737)", 2024-09-12T16:17:43.591 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:17:43.591 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 13.103660401000001, 2024-09-12T16:17:43.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030296030000000001, 2024-09-12T16:17:43.592 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.592 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.592 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:43.592 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:17:43.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:17:43.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.593 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.593 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:17:43.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6300000000000001e-07 2024-09-12T16:17:43.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.593 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.593 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415282+0000", 2024-09-12T16:17:43.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6289999999999999e-06 2024-09-12T16:17:43.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.593 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.593 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415288+0000", 2024-09-12T16:17:43.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5520000000000001e-06 2024-09-12T16:17:43.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.594 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.594 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.594 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415293+0000", 2024-09-12T16:17:43.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6879999999999998e-06 2024-09-12T16:17:43.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.594 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.594 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.594 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415412+0000", 2024-09-12T16:17:43.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118579 2024-09-12T16:17:43.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.594 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.594 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:43.594 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415429+0000", 2024-09-12T16:17:43.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7501000000000001e-05 2024-09-12T16:17:43.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:43.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.418270+0000", 2024-09-12T16:17:43.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028404860000000001 2024-09-12T16:17:43.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.418307+0000", 2024-09-12T16:17:43.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7805000000000001e-05 2024-09-12T16:17:43.595 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.595 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.595 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.596 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.596 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14399 3.16 e92/75 3:6e4c3dfc:::rbd_data.1155c757bf36.0000000000000048:head v 92'1286, mlcod=90'1280)", 2024-09-12T16:17:43.596 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.415311+0000", 2024-09-12T16:17:43.596 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 13.103627487000001, 2024-09-12T16:17:43.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028826809999999998, 2024-09-12T16:17:43.596 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.596 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.596 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:43.596 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.596 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.596 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415311+0000", 2024-09-12T16:17:43.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415311+0000", 2024-09-12T16:17:43.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415311+0000", 2024-09-12T16:17:43.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0600000000000001e-07 2024-09-12T16:17:43.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.598 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.598 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.598 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415315+0000", 2024-09-12T16:17:43.598 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.172e-06 2024-09-12T16:17:43.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.598 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.598 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.598 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415322+0000", 2024-09-12T16:17:43.598 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0999999999999998e-06 2024-09-12T16:17:43.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.598 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.598 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415327+0000", 2024-09-12T16:17:43.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6430000000000003e-06 2024-09-12T16:17:43.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.416666+0000", 2024-09-12T16:17:43.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001338718 2024-09-12T16:17:43.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:43.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.416683+0000", 2024-09-12T16:17:43.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7628000000000001e-05 2024-09-12T16:17:43.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:43.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.418128+0000", 2024-09-12T16:17:43.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0014445440000000001 2024-09-12T16:17:43.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.418193+0000", 2024-09-12T16:17:43.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5569999999999997e-05 2024-09-12T16:17:43.600 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.600 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.600 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.600 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5384.0:1241 3.16 e95/75 3:6ee670ce:::rbd_data.1155b9894cdc.0000000000000005:head v 95'1303, mlcod=95'1301)", 2024-09-12T16:17:43.600 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:35.272164+0000", 2024-09-12T16:17:43.601 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.2467745449999992, 2024-09-12T16:17:43.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015008743, 2024-09-12T16:17:43.601 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.601 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.601 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:43.601 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.272164+0000", 2024-09-12T16:17:43.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.272164+0000", 2024-09-12T16:17:43.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.602 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.602 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.272165+0000", 2024-09-12T16:17:43.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.311e-06 2024-09-12T16:17:43.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.602 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.602 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275503+0000", 2024-09-12T16:17:43.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003337881 2024-09-12T16:17:43.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.603 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.603 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.603 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275530+0000", 2024-09-12T16:17:43.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6797000000000001e-05 2024-09-12T16:17:43.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.603 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.603 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.603 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275541+0000", 2024-09-12T16:17:43.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1634000000000001e-05 2024-09-12T16:17:43.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.603 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.603 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.603 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275618+0000", 2024-09-12T16:17:43.604 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6811999999999996e-05 2024-09-12T16:17:43.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.604 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:43.604 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275642+0000", 2024-09-12T16:17:43.604 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4111999999999999e-05 2024-09-12T16:17:43.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.604 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:43.604 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287116+0000", 2024-09-12T16:17:43.604 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01147395 2024-09-12T16:17:43.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.605 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287172+0000", 2024-09-12T16:17:43.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6246000000000003e-05 2024-09-12T16:17:43.605 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.605 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.605 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.605 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5384.0:1246 3.f e95/74 3:f0725c44:::rbd_data.1155b9894cdc.0000000000000006:head v 95'356, mlcod=95'354)", 2024-09-12T16:17:43.605 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:35.276304+0000", 2024-09-12T16:17:43.605 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.2426346180000003, 2024-09-12T16:17:43.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011209733, 2024-09-12T16:17:43.605 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.605 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.606 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:43.606 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.276304+0000", 2024-09-12T16:17:43.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.276304+0000", 2024-09-12T16:17:43.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.276305+0000", 2024-09-12T16:17:43.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2500000000000001e-06 2024-09-12T16:17:43.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279256+0000", 2024-09-12T16:17:43.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002951076 2024-09-12T16:17:43.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279281+0000", 2024-09-12T16:17:43.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4779000000000001e-05 2024-09-12T16:17:43.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.608 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279294+0000", 2024-09-12T16:17:43.608 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3614e-05 2024-09-12T16:17:43.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.608 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.608 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279366+0000", 2024-09-12T16:17:43.608 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2094000000000005e-05 2024-09-12T16:17:43.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.608 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:43.608 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279395+0000", 2024-09-12T16:17:43.608 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8337999999999999e-05 2024-09-12T16:17:43.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.608 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:43.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287479+0000", 2024-09-12T16:17:43.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0080844799999999998 2024-09-12T16:17:43.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287513+0000", 2024-09-12T16:17:43.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4102e-05 2024-09-12T16:17:43.609 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.609 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.609 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.609 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5578.0:2433 3.16 e98/75 3:691860ab:::rbd_data.11557f9bd67f.0000000000000014:head v 98'1330, mlcod=97'1328)", 2024-09-12T16:17:43.609 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:38.524867+0000", 2024-09-12T16:17:43.609 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.9940709930000002, 2024-09-12T16:17:43.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028147279999999998, 2024-09-12T16:17:43.610 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:43.610 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:43.610 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:43.610 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:43.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.610 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:43.610 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.524867+0000", 2024-09-12T16:17:43.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.610 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:43.610 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.524867+0000", 2024-09-12T16:17:43.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:43.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.611 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:43.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.524868+0000", 2024-09-12T16:17:43.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4600000000000003e-07 2024-09-12T16:17:43.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.611 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:43.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.525251+0000", 2024-09-12T16:17:43.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00038322299999999997 2024-09-12T16:17:43.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.611 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:43.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.525266+0000", 2024-09-12T16:17:43.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4934e-05 2024-09-12T16:17:43.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:43.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.525274+0000", 2024-09-12T16:17:43.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.328e-06 2024-09-12T16:17:43.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:43.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.525363+0000", 2024-09-12T16:17:43.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9149999999999999e-05 2024-09-12T16:17:43.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:43.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.525383+0000", 2024-09-12T16:17:43.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0197e-05 2024-09-12T16:17:43.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.613 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:43.613 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.527638+0000", 2024-09-12T16:17:43.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0022551210000000001 2024-09-12T16:17:43.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:43.613 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:43.613 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:43.613 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.527682+0000", 2024-09-12T16:17:43.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3928999999999999e-05 2024-09-12T16:17:43.613 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.613 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.613 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.613 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:43.613 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:43.613 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:43.615 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:43.614+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:43.615 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:17:43.710 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #34, image image_client.0-clone34 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent35 2024-09-12T16:17:43.715 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:43.714+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:43.730 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:43.730 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:43.730 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:17:43.730 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:43.739 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:17:43.816 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:43.815+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:43.893 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:43.893 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:43.893 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:17:43.894 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:17:43.894 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:43.903 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:17:43.947 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:43.946+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:44.011 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:44.012 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:17:44.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:17:44.012 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:17:44.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.012 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3705 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14812160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:44.012 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:17:44.012 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 85.870492665, 2024-09-12T16:17:44.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053368831999999998, 2024-09-12T16:17:44.012 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.012 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.012 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:44.012 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.013 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:44.013 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:44.013 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3705 2024-09-12T16:17:44.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.013 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:17:44.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:17:44.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139932+0000", 2024-09-12T16:17:44.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012762099999999999 2024-09-12T16:17:44.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139935+0000", 2024-09-12T16:17:44.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.119e-06 2024-09-12T16:17:44.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139939+0000", 2024-09-12T16:17:44.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7999999999999998e-06 2024-09-12T16:17:44.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139953+0000", 2024-09-12T16:17:44.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3923999999999999e-05 2024-09-12T16:17:44.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192946+0000", 2024-09-12T16:17:44.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052992971 2024-09-12T16:17:44.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:44.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193035+0000", 2024-09-12T16:17:44.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9040000000000001e-05 2024-09-12T16:17:44.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.016 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193174+0000", 2024-09-12T16:17:44.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138357 2024-09-12T16:17:44.016 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.016 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.016 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.016 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3706 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14816256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:44.016 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:17:44.016 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 85.870337675000002, 2024-09-12T16:17:44.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053341723000000001, 2024-09-12T16:17:44.017 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.017 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.017 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:44.017 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.017 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:44.017 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:44.017 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3706 2024-09-12T16:17:44.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.017 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:17:44.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:17:44.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140090+0000", 2024-09-12T16:17:44.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013020100000000001 2024-09-12T16:17:44.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140097+0000", 2024-09-12T16:17:44.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0709999999999997e-06 2024-09-12T16:17:44.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140103+0000", 2024-09-12T16:17:44.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5450000000000003e-06 2024-09-12T16:17:44.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140106+0000", 2024-09-12T16:17:44.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3739999999999998e-06 2024-09-12T16:17:44.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193190+0000", 2024-09-12T16:17:44.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053084131999999999 2024-09-12T16:17:44.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:44.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193232+0000", 2024-09-12T16:17:44.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1517000000000002e-05 2024-09-12T16:17:44.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193302+0000", 2024-09-12T16:17:44.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9882999999999995e-05 2024-09-12T16:17:44.021 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.021 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.021 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.021 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3707 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14820352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:44.021 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:17:44.021 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 85.870185685999999, 2024-09-12T16:17:44.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053452771000000003, 2024-09-12T16:17:44.021 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.021 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.021 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:44.022 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.022 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:44.022 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:44.022 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3707 2024-09-12T16:17:44.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.022 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:17:44.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:17:44.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140219+0000", 2024-09-12T16:17:44.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106902 2024-09-12T16:17:44.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140225+0000", 2024-09-12T16:17:44.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3199999999999996e-06 2024-09-12T16:17:44.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140230+0000", 2024-09-12T16:17:44.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8969999999999999e-06 2024-09-12T16:17:44.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140233+0000", 2024-09-12T16:17:44.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2119999999999999e-06 2024-09-12T16:17:44.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193339+0000", 2024-09-12T16:17:44.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053105556999999998 2024-09-12T16:17:44.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:44.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193431+0000", 2024-09-12T16:17:44.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1837999999999997e-05 2024-09-12T16:17:44.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193565+0000", 2024-09-12T16:17:44.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013404500000000001 2024-09-12T16:17:44.025 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.025 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.025 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.025 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3708 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14824448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:44.026 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:17:44.026 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 85.870056844000004, 2024-09-12T16:17:44.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053468190999999998, 2024-09-12T16:17:44.026 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.026 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.026 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:44.026 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.026 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:44.026 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:44.026 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3708 2024-09-12T16:17:44.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.026 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:17:44.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:17:44.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140351+0000", 2024-09-12T16:17:44.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110096 2024-09-12T16:17:44.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140358+0000", 2024-09-12T16:17:44.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.306e-06 2024-09-12T16:17:44.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140368+0000", 2024-09-12T16:17:44.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0225e-05 2024-09-12T16:17:44.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140372+0000", 2024-09-12T16:17:44.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6169999999999998e-06 2024-09-12T16:17:44.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193594+0000", 2024-09-12T16:17:44.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053222419999999999 2024-09-12T16:17:44.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:44.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193640+0000", 2024-09-12T16:17:44.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.587e-05 2024-09-12T16:17:44.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193709+0000", 2024-09-12T16:17:44.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8657000000000004e-05 2024-09-12T16:17:44.030 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.030 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.030 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.030 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3709 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14828544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:44.030 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:17:44.030 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 85.869919875999997, 2024-09-12T16:17:44.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594033999999999, 2024-09-12T16:17:44.030 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.030 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.030 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:44.030 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.030 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:44.031 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:44.031 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3709 2024-09-12T16:17:44.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.031 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:17:44.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:17:44.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140499+0000", 2024-09-12T16:17:44.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121019 2024-09-12T16:17:44.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140501+0000", 2024-09-12T16:17:44.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2369999999999999e-06 2024-09-12T16:17:44.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140506+0000", 2024-09-12T16:17:44.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.639e-06 2024-09-12T16:17:44.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.034 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.034 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140509+0000", 2024-09-12T16:17:44.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3419999999999999e-06 2024-09-12T16:17:44.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.034 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.034 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193743+0000", 2024-09-12T16:17:44.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053234311999999999 2024-09-12T16:17:44.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.034 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:44.034 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193833+0000", 2024-09-12T16:17:44.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9883999999999995e-05 2024-09-12T16:17:44.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.035 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.035 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193972+0000", 2024-09-12T16:17:44.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138601 2024-09-12T16:17:44.035 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.035 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.035 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.035 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3710 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14832640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:44.035 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:17:44.035 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 85.869782529999995, 2024-09-12T16:17:44.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053607324999999997, 2024-09-12T16:17:44.036 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.036 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.036 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:44.036 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.036 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:44.036 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:44.036 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3710 2024-09-12T16:17:44.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.036 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:17:44.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:17:44.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140664+0000", 2024-09-12T16:17:44.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014918700000000001 2024-09-12T16:17:44.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140674+0000", 2024-09-12T16:17:44.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8379999999999997e-06 2024-09-12T16:17:44.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140694+0000", 2024-09-12T16:17:44.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0145000000000001e-05 2024-09-12T16:17:44.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.039 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140703+0000", 2024-09-12T16:17:44.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5150000000000006e-06 2024-09-12T16:17:44.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.039 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194006+0000", 2024-09-12T16:17:44.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053303370000000003 2024-09-12T16:17:44.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:44.039 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194051+0000", 2024-09-12T16:17:44.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5012000000000002e-05 2024-09-12T16:17:44.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.040 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194122+0000", 2024-09-12T16:17:44.040 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1258000000000001e-05 2024-09-12T16:17:44.040 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.040 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.040 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.040 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3711 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14836736~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:44.040 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:17:44.040 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 85.869581081999996, 2024-09-12T16:17:44.040 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053670799999999998, 2024-09-12T16:17:44.040 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.040 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.040 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:44.041 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.041 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:44.041 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:44.041 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3711 2024-09-12T16:17:44.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.041 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:17:44.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:17:44.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140782+0000", 2024-09-12T16:17:44.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5549999999999994e-05 2024-09-12T16:17:44.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140786+0000", 2024-09-12T16:17:44.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.89e-06 2024-09-12T16:17:44.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140796+0000", 2024-09-12T16:17:44.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0057e-05 2024-09-12T16:17:44.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140819+0000", 2024-09-12T16:17:44.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3005000000000001e-05 2024-09-12T16:17:44.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194159+0000", 2024-09-12T16:17:44.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053340324000000001 2024-09-12T16:17:44.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:44.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194248+0000", 2024-09-12T16:17:44.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9209000000000006e-05 2024-09-12T16:17:44.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194387+0000", 2024-09-12T16:17:44.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138765 2024-09-12T16:17:44.044 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.044 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.044 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.044 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3712 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14840832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:44.044 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:17:44.044 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 85.869466623999998, 2024-09-12T16:17:44.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053699068000000003, 2024-09-12T16:17:44.045 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.045 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.045 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:44.045 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.045 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:44.045 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:44.045 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3712 2024-09-12T16:17:44.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.045 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:17:44.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:17:44.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140900+0000", 2024-09-12T16:17:44.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9014e-05 2024-09-12T16:17:44.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140904+0000", 2024-09-12T16:17:44.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0940000000000001e-06 2024-09-12T16:17:44.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140933+0000", 2024-09-12T16:17:44.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8996000000000002e-05 2024-09-12T16:17:44.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140945+0000", 2024-09-12T16:17:44.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1909000000000001e-05 2024-09-12T16:17:44.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194415+0000", 2024-09-12T16:17:44.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053470403 2024-09-12T16:17:44.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:44.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194460+0000", 2024-09-12T16:17:44.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5145000000000002e-05 2024-09-12T16:17:44.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194530+0000", 2024-09-12T16:17:44.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9506999999999997e-05 2024-09-12T16:17:44.049 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.049 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.049 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.049 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3713 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14844928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:44.049 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:17:44.049 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 85.869333564000002, 2024-09-12T16:17:44.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053821236000000001, 2024-09-12T16:17:44.050 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.050 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.050 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:44.050 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.050 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:44.050 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:44.050 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3713 2024-09-12T16:17:44.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.050 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:17:44.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.051 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:17:44.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.051 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141078+0000", 2024-09-12T16:17:44.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114162 2024-09-12T16:17:44.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141090+0000", 2024-09-12T16:17:44.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.19e-05 2024-09-12T16:17:44.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141100+0000", 2024-09-12T16:17:44.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0447e-05 2024-09-12T16:17:44.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141108+0000", 2024-09-12T16:17:44.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7190000000000001e-06 2024-09-12T16:17:44.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194564+0000", 2024-09-12T16:17:44.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053455729 2024-09-12T16:17:44.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:44.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194652+0000", 2024-09-12T16:17:44.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8288999999999994e-05 2024-09-12T16:17:44.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194785+0000", 2024-09-12T16:17:44.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013299000000000001 2024-09-12T16:17:44.053 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.053 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.054 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.054 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3714 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14849024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:44.054 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:17:44.054 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 85.869177635, 2024-09-12T16:17:44.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053816382000000003, 2024-09-12T16:17:44.054 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.054 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.054 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:44.054 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.054 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:44.054 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:44.055 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3714 2024-09-12T16:17:44.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.055 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:17:44.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:17:44.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141182+0000", 2024-09-12T16:17:44.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1805999999999997e-05 2024-09-12T16:17:44.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141185+0000", 2024-09-12T16:17:44.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5930000000000002e-06 2024-09-12T16:17:44.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141194+0000", 2024-09-12T16:17:44.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5760000000000006e-06 2024-09-12T16:17:44.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141222+0000", 2024-09-12T16:17:44.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8034999999999998e-05 2024-09-12T16:17:44.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194817+0000", 2024-09-12T16:17:44.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594887000000001 2024-09-12T16:17:44.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:44.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194860+0000", 2024-09-12T16:17:44.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3714999999999997e-05 2024-09-12T16:17:44.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194936+0000", 2024-09-12T16:17:44.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5770000000000001e-05 2024-09-12T16:17:44.058 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.058 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.058 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.059 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3715 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14853120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:44.059 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:17:44.059 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 85.869053977999997, 2024-09-12T16:17:44.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053962307000000001, 2024-09-12T16:17:44.059 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.059 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.059 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:44.059 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.059 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:44.059 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:44.059 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3715 2024-09-12T16:17:44.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.059 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:17:44.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:17:44.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141417+0000", 2024-09-12T16:17:44.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017384099999999999 2024-09-12T16:17:44.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141422+0000", 2024-09-12T16:17:44.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7310000000000001e-06 2024-09-12T16:17:44.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141434+0000", 2024-09-12T16:17:44.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2058e-05 2024-09-12T16:17:44.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141442+0000", 2024-09-12T16:17:44.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7610000000000007e-06 2024-09-12T16:17:44.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194973+0000", 2024-09-12T16:17:44.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053530618000000002 2024-09-12T16:17:44.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:44.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195063+0000", 2024-09-12T16:17:44.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0927000000000005e-05 2024-09-12T16:17:44.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195206+0000", 2024-09-12T16:17:44.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142371 2024-09-12T16:17:44.063 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.063 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.063 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.063 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3716 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14857216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:44.064 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:17:44.064 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 85.868844128000006, 2024-09-12T16:17:44.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053916360000000003, 2024-09-12T16:17:44.064 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.064 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.064 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:44.064 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.064 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:44.064 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:44.064 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3716 2024-09-12T16:17:44.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.064 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:17:44.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:17:44.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142933+0000", 2024-09-12T16:17:44.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014796290000000001 2024-09-12T16:17:44.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142937+0000", 2024-09-12T16:17:44.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5760000000000002e-06 2024-09-12T16:17:44.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142946+0000", 2024-09-12T16:17:44.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0380000000000005e-06 2024-09-12T16:17:44.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142951+0000", 2024-09-12T16:17:44.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9749999999999998e-06 2024-09-12T16:17:44.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195246+0000", 2024-09-12T16:17:44.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052295358 2024-09-12T16:17:44.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:44.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195299+0000", 2024-09-12T16:17:44.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2976999999999998e-05 2024-09-12T16:17:44.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195370+0000", 2024-09-12T16:17:44.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0807000000000002e-05 2024-09-12T16:17:44.068 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.068 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.068 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.068 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3721 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14877696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:44.068 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:44.068 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 85.867270676999993, 2024-09-12T16:17:44.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053422994000000001, 2024-09-12T16:17:44.068 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.068 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.068 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:44.069 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.069 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:44.069 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:44.069 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3721 2024-09-12T16:17:44.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.069 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:44.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:44.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:44.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:17:44.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143028+0000", 2024-09-12T16:17:44.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7399999999999991e-07 2024-09-12T16:17:44.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143031+0000", 2024-09-12T16:17:44.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7599999999999998e-06 2024-09-12T16:17:44.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143034+0000", 2024-09-12T16:17:44.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9780000000000001e-06 2024-09-12T16:17:44.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196220+0000", 2024-09-12T16:17:44.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053186341999999998 2024-09-12T16:17:44.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:44.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196313+0000", 2024-09-12T16:17:44.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2676000000000005e-05 2024-09-12T16:17:44.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196450+0000", 2024-09-12T16:17:44.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137052 2024-09-12T16:17:44.072 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.072 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.072 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.072 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3722 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14881792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:44.073 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:44.073 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 85.867260784999999, 2024-09-12T16:17:44.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053556835999999997, 2024-09-12T16:17:44.073 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.073 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.073 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:44.073 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.073 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:44.073 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:44.073 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3722 2024-09-12T16:17:44.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.073 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:44.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:44.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:44.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.11e-07 2024-09-12T16:17:44.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143038+0000", 2024-09-12T16:17:44.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2399999999999996e-07 2024-09-12T16:17:44.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143041+0000", 2024-09-12T16:17:44.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8030000000000001e-06 2024-09-12T16:17:44.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143043+0000", 2024-09-12T16:17:44.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3140000000000002e-06 2024-09-12T16:17:44.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.076 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.076 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196481+0000", 2024-09-12T16:17:44.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053437601000000001 2024-09-12T16:17:44.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.076 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:44.076 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196525+0000", 2024-09-12T16:17:44.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4280000000000003e-05 2024-09-12T16:17:44.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.076 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.076 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196594+0000", 2024-09-12T16:17:44.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8702999999999996e-05 2024-09-12T16:17:44.076 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.077 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.077 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.077 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3723 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14885888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:44.077 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:17:44.078 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 85.867251603, 2024-09-12T16:17:44.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053815546999999998, 2024-09-12T16:17:44.078 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.078 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.078 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:44.078 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.078 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:44.078 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:44.078 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3723 2024-09-12T16:17:44.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.078 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:17:44.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:17:44.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148994+0000", 2024-09-12T16:17:44.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059481330000000004 2024-09-12T16:17:44.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148999+0000", 2024-09-12T16:17:44.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7140000000000001e-06 2024-09-12T16:17:44.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149008+0000", 2024-09-12T16:17:44.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4350000000000003e-06 2024-09-12T16:17:44.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.081 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.081 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149021+0000", 2024-09-12T16:17:44.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2514000000000001e-05 2024-09-12T16:17:44.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.081 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.081 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196630+0000", 2024-09-12T16:17:44.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047609758000000002 2024-09-12T16:17:44.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.081 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:44.081 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196724+0000", 2024-09-12T16:17:44.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3522000000000003e-05 2024-09-12T16:17:44.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196861+0000", 2024-09-12T16:17:44.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013747100000000001 2024-09-12T16:17:44.082 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.082 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.082 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.082 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4438 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15719424~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:44.082 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:44.082 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 85.722370826000002, 2024-09-12T16:17:44.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367981000000002, 2024-09-12T16:17:44.082 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.082 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.083 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:44.083 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.083 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:44.083 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:44.083 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4438 2024-09-12T16:17:44.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.083 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:44.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:44.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:44.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3e-07 2024-09-12T16:17:44.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287930+0000", 2024-09-12T16:17:44.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-12T16:17:44.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287937+0000", 2024-09-12T16:17:44.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.08e-06 2024-09-12T16:17:44.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287943+0000", 2024-09-12T16:17:44.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5709999999999997e-06 2024-09-12T16:17:44.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341068+0000", 2024-09-12T16:17:44.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053125101000000001 2024-09-12T16:17:44.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:44.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341154+0000", 2024-09-12T16:17:44.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6100999999999994e-05 2024-09-12T16:17:44.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341295+0000", 2024-09-12T16:17:44.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014087999999999999 2024-09-12T16:17:44.086 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.086 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.086 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.086 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4439 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15723520~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:44.086 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:44.087 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 85.722346665999993, 2024-09-12T16:17:44.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053526799, 2024-09-12T16:17:44.087 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.087 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.087 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:44.087 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.087 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:44.087 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:44.087 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4439 2024-09-12T16:17:44.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.087 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:44.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:44.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:44.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-07 2024-09-12T16:17:44.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287953+0000", 2024-09-12T16:17:44.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1349999999999999e-06 2024-09-12T16:17:44.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287960+0000", 2024-09-12T16:17:44.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-12T16:17:44.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287965+0000", 2024-09-12T16:17:44.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1580000000000004e-06 2024-09-12T16:17:44.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341332+0000", 2024-09-12T16:17:44.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367009 2024-09-12T16:17:44.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:44.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341402+0000", 2024-09-12T16:17:44.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9759999999999996e-05 2024-09-12T16:17:44.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341478+0000", 2024-09-12T16:17:44.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5412000000000002e-05 2024-09-12T16:17:44.091 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.091 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.091 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.091 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4440 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15727616~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:44.091 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:44.091 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 85.722325561999995, 2024-09-12T16:17:44.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053761601999999999, 2024-09-12T16:17:44.091 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.091 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.091 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:44.091 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.092 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:44.092 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:44.092 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4440 2024-09-12T16:17:44.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.092 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:44.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:44.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:44.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:17:44.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287974+0000", 2024-09-12T16:17:44.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0540000000000002e-06 2024-09-12T16:17:44.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287980+0000", 2024-09-12T16:17:44.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9440000000000002e-06 2024-09-12T16:17:44.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287987+0000", 2024-09-12T16:17:44.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5889999999999999e-06 2024-09-12T16:17:44.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.095 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341502+0000", 2024-09-12T16:17:44.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053515199999999999 2024-09-12T16:17:44.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:44.095 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341595+0000", 2024-09-12T16:17:44.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3097000000000007e-05 2024-09-12T16:17:44.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.096 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.096 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341734+0000", 2024-09-12T16:17:44.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013832800000000001 2024-09-12T16:17:44.096 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.096 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.096 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.096 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2209 3.1 3:85f36d3b:::rbd_data.1155ccb1894c.0000000000000004:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:44.096 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:17:44.096 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 46.638640424000002, 2024-09-12T16:17:44.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.060659365, 2024-09-12T16:17:44.096 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.097 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.097 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:44.097 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.097 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:17:44.097 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:17:44.097 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2209 2024-09-12T16:17:44.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.097 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:17:44.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:17:44.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371658+0000", 2024-09-12T16:17:44.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1570000000000001e-06 2024-09-12T16:17:44.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393414+0000", 2024-09-12T16:17:44.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021755495999999999 2024-09-12T16:17:44.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393447+0000", 2024-09-12T16:17:44.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3630000000000002e-05 2024-09-12T16:17:44.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393462+0000", 2024-09-12T16:17:44.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5048999999999999e-05 2024-09-12T16:17:44.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393556+0000", 2024-09-12T16:17:44.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3549999999999997e-05 2024-09-12T16:17:44.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:44.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393697+0000", 2024-09-12T16:17:44.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000141414 2024-09-12T16:17:44.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T16:17:44.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.394944+0000", 2024-09-12T16:17:44.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012463039999999999 2024-09-12T16:17:44.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:44.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.431803+0000", 2024-09-12T16:17:44.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0368594 2024-09-12T16:17:44.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:17:44.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432268+0000", 2024-09-12T16:17:44.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046457600000000002 2024-09-12T16:17:44.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:17:44.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432293+0000", 2024-09-12T16:17:44.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.527e-05 2024-09-12T16:17:44.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432316+0000", 2024-09-12T16:17:44.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3519e-05 2024-09-12T16:17:44.102 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.102 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.102 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.102 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:9400 3.1f 3:feea9999:::rbd_data.1155338d0570.0000000000000007:head [read 32768~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-12T16:17:44.102 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:20.012502+0000", 2024-09-12T16:17:44.102 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.997795432, 2024-09-12T16:17:44.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.000678049, 2024-09-12T16:17:44.103 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.103 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.103 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:44.103 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.103 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:44.103 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:44.103 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 9400 2024-09-12T16:17:44.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.103 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012502+0000", 2024-09-12T16:17:44.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.104 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.104 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012502+0000", 2024-09-12T16:17:44.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.104 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.104 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012504+0000", 2024-09-12T16:17:44.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5939999999999999e-06 2024-09-12T16:17:44.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.105 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012511+0000", 2024-09-12T16:17:44.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0840000000000003e-06 2024-09-12T16:17:44.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.105 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012525+0000", 2024-09-12T16:17:44.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4538999999999999e-05 2024-09-12T16:17:44.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012532+0000", 2024-09-12T16:17:44.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8310000000000003e-06 2024-09-12T16:17:44.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012605+0000", 2024-09-12T16:17:44.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2387999999999999e-05 2024-09-12T16:17:44.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T16:17:44.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012617+0000", 2024-09-12T16:17:44.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2167999999999999e-05 2024-09-12T16:17:44.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:21.012823+0000", 2024-09-12T16:17:44.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0002068230000001 2024-09-12T16:17:44.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:44.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:21.012975+0000", 2024-09-12T16:17:44.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015196200000000001 2024-09-12T16:17:44.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:21.013180+0000", 2024-09-12T16:17:44.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020466000000000001 2024-09-12T16:17:44.108 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.108 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.108 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.108 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.108 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.108 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:44.110 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:17:44.110 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:44.108+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:44.210 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:44.209+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:44.308 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:44.309 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:44.309 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:17:44.309 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:44.311 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:44.310+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:44.321 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:17:44.359 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2024-09-12T16:17:44.421 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:44.420+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:44.478 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:44.478 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:44.478 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:17:44.478 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:17:44.478 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:44.487 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:17:44.513 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:44.511+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:44.613 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:44.612+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:44.689 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:44.689 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:17:44.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:17:44.689 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:17:44.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.689 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2307 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12401664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:44.689 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:17:44.689 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 86.790505885000002, 2024-09-12T16:17:44.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038241450000000003, 2024-09-12T16:17:44.689 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.689 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.689 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:44.690 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.690 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:44.690 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:44.690 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2307 2024-09-12T16:17:44.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.690 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:17:44.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:17:44.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896220+0000", 2024-09-12T16:17:44.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3500000000000002e-07 2024-09-12T16:17:44.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896222+0000", 2024-09-12T16:17:44.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1720000000000001e-06 2024-09-12T16:17:44.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896228+0000", 2024-09-12T16:17:44.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0870000000000003e-06 2024-09-12T16:17:44.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896233+0000", 2024-09-12T16:17:44.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:17:44.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934382+0000", 2024-09-12T16:17:44.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038149566000000003 2024-09-12T16:17:44.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:44.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934422+0000", 2024-09-12T16:17:44.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0015999999999998e-05 2024-09-12T16:17:44.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934461+0000", 2024-09-12T16:17:44.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8423999999999997e-05 2024-09-12T16:17:44.693 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.693 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.693 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.694 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2308 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12405760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:44.694 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:17:44.694 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 86.790486188000003, 2024-09-12T16:17:44.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038420745999999999, 2024-09-12T16:17:44.694 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.694 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.694 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:44.694 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.694 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:44.694 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:44.694 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2308 2024-09-12T16:17:44.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.694 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:17:44.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:17:44.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:17:44.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.58e-07 2024-09-12T16:17:44.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896241+0000", 2024-09-12T16:17:44.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7940000000000001e-06 2024-09-12T16:17:44.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896247+0000", 2024-09-12T16:17:44.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1460000000000001e-06 2024-09-12T16:17:44.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896252+0000", 2024-09-12T16:17:44.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6840000000000004e-06 2024-09-12T16:17:44.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934494+0000", 2024-09-12T16:17:44.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038242362000000002 2024-09-12T16:17:44.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:44.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934579+0000", 2024-09-12T16:17:44.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5044999999999996e-05 2024-09-12T16:17:44.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934660+0000", 2024-09-12T16:17:44.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0357000000000003e-05 2024-09-12T16:17:44.698 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.698 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.699 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.699 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2309 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12409856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:44.699 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:17:44.699 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 86.790465608000005, 2024-09-12T16:17:44.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038504629999999998, 2024-09-12T16:17:44.699 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.699 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.699 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:44.699 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.699 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:44.699 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:44.700 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2309 2024-09-12T16:17:44.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.700 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:17:44.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:17:44.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:17:44.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5199999999999998e-07 2024-09-12T16:17:44.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896263+0000", 2024-09-12T16:17:44.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4209999999999999e-06 2024-09-12T16:17:44.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896269+0000", 2024-09-12T16:17:44.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9449999999999998e-06 2024-09-12T16:17:44.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896274+0000", 2024-09-12T16:17:44.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3950000000000003e-06 2024-09-12T16:17:44.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934686+0000", 2024-09-12T16:17:44.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038412333999999999 2024-09-12T16:17:44.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:44.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934727+0000", 2024-09-12T16:17:44.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0649999999999999e-05 2024-09-12T16:17:44.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934764+0000", 2024-09-12T16:17:44.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7533000000000001e-05 2024-09-12T16:17:44.703 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.703 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.703 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.703 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2310 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12413952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:44.703 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:17:44.703 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 86.790444735999998, 2024-09-12T16:17:44.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038694183, 2024-09-12T16:17:44.704 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.704 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.704 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:44.704 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.704 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:44.704 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:44.704 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2310 2024-09-12T16:17:44.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.704 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:17:44.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:17:44.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896281+0000", 2024-09-12T16:17:44.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1399999999999997e-07 2024-09-12T16:17:44.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896283+0000", 2024-09-12T16:17:44.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9549999999999999e-06 2024-09-12T16:17:44.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896289+0000", 2024-09-12T16:17:44.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8669999999999999e-06 2024-09-12T16:17:44.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896301+0000", 2024-09-12T16:17:44.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1807999999999999e-05 2024-09-12T16:17:44.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934798+0000", 2024-09-12T16:17:44.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038497591999999997 2024-09-12T16:17:44.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:44.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934885+0000", 2024-09-12T16:17:44.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7149000000000002e-05 2024-09-12T16:17:44.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934975+0000", 2024-09-12T16:17:44.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9297999999999998e-05 2024-09-12T16:17:44.707 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.708 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.708 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.708 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2311 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12418048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:44.708 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:17:44.708 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 86.790417480000002, 2024-09-12T16:17:44.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038768558000000002, 2024-09-12T16:17:44.708 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.708 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.708 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:44.708 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.708 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:44.708 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:44.709 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2311 2024-09-12T16:17:44.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.709 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:17:44.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:17:44.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:17:44.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.63e-07 2024-09-12T16:17:44.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896310+0000", 2024-09-12T16:17:44.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1560000000000002e-06 2024-09-12T16:17:44.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896316+0000", 2024-09-12T16:17:44.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0249999999999999e-06 2024-09-12T16:17:44.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896322+0000", 2024-09-12T16:17:44.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6400000000000002e-06 2024-09-12T16:17:44.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934997+0000", 2024-09-12T16:17:44.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038674565000000001 2024-09-12T16:17:44.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:44.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935037+0000", 2024-09-12T16:17:44.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0485999999999998e-05 2024-09-12T16:17:44.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935076+0000", 2024-09-12T16:17:44.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9223e-05 2024-09-12T16:17:44.712 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.712 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.712 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.712 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2312 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12422144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:44.712 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:17:44.712 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 86.790396787000006, 2024-09-12T16:17:44.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038856784999999998, 2024-09-12T16:17:44.713 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.713 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.713 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:44.713 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.713 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:44.713 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:44.713 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2312 2024-09-12T16:17:44.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.713 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:17:44.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:17:44.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896329+0000", 2024-09-12T16:17:44.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5499999999999999e-07 2024-09-12T16:17:44.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896337+0000", 2024-09-12T16:17:44.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0819999999999999e-06 2024-09-12T16:17:44.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896343+0000", 2024-09-12T16:17:44.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.263e-06 2024-09-12T16:17:44.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896348+0000", 2024-09-12T16:17:44.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8860000000000003e-06 2024-09-12T16:17:44.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935097+0000", 2024-09-12T16:17:44.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038748818999999997 2024-09-12T16:17:44.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:44.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935141+0000", 2024-09-12T16:17:44.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4175000000000003e-05 2024-09-12T16:17:44.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935185+0000", 2024-09-12T16:17:44.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4205000000000001e-05 2024-09-12T16:17:44.716 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.716 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.716 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.717 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2313 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12426240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:44.717 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:17:44.717 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 86.790370572, 2024-09-12T16:17:44.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038928683999999998, 2024-09-12T16:17:44.717 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.717 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.717 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:44.717 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.717 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:44.717 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:44.717 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2313 2024-09-12T16:17:44.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.718 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:17:44.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:17:44.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:17:44.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0400000000000002e-07 2024-09-12T16:17:44.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896357+0000", 2024-09-12T16:17:44.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.097e-06 2024-09-12T16:17:44.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896363+0000", 2024-09-12T16:17:44.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5119999999999999e-06 2024-09-12T16:17:44.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896374+0000", 2024-09-12T16:17:44.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1381e-05 2024-09-12T16:17:44.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935205+0000", 2024-09-12T16:17:44.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038830549999999998 2024-09-12T16:17:44.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:44.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935244+0000", 2024-09-12T16:17:44.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9520000000000001e-05 2024-09-12T16:17:44.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935283+0000", 2024-09-12T16:17:44.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9220000000000001e-05 2024-09-12T16:17:44.721 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.721 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.721 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.721 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2314 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12430336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:44.721 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:17:44.722 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 86.790333402000002, 2024-09-12T16:17:44.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039008137999999998, 2024-09-12T16:17:44.722 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.722 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.722 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:44.722 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.722 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:44.722 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:44.722 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2314 2024-09-12T16:17:44.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.722 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:17:44.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:17:44.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:17:44.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6499999999999999e-07 2024-09-12T16:17:44.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896395+0000", 2024-09-12T16:17:44.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2960000000000001e-06 2024-09-12T16:17:44.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896402+0000", 2024-09-12T16:17:44.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2280000000000001e-06 2024-09-12T16:17:44.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896407+0000", 2024-09-12T16:17:44.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3630000000000002e-06 2024-09-12T16:17:44.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935302+0000", 2024-09-12T16:17:44.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038895181000000001 2024-09-12T16:17:44.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:44.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935343+0000", 2024-09-12T16:17:44.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0590999999999998e-05 2024-09-12T16:17:44.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935400+0000", 2024-09-12T16:17:44.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7014e-05 2024-09-12T16:17:44.726 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.726 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.726 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.726 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2315 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12434432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:44.726 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:17:44.726 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 86.790310751000007, 2024-09-12T16:17:44.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039083892000000002, 2024-09-12T16:17:44.726 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.726 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.726 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:44.726 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.726 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:44.727 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:44.727 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2315 2024-09-12T16:17:44.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.727 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:17:44.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:17:44.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896415+0000", 2024-09-12T16:17:44.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3300000000000002e-07 2024-09-12T16:17:44.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896421+0000", 2024-09-12T16:17:44.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7579999999999998e-06 2024-09-12T16:17:44.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896427+0000", 2024-09-12T16:17:44.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3029999999999996e-06 2024-09-12T16:17:44.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896432+0000", 2024-09-12T16:17:44.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.215e-06 2024-09-12T16:17:44.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935420+0000", 2024-09-12T16:17:44.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038987727 2024-09-12T16:17:44.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:44.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935460+0000", 2024-09-12T16:17:44.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9817999999999997e-05 2024-09-12T16:17:44.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935498+0000", 2024-09-12T16:17:44.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8438e-05 2024-09-12T16:17:44.730 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.730 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.730 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.730 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2316 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12438528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:44.730 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:17:44.730 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 86.790286098999999, 2024-09-12T16:17:44.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039160043999999998, 2024-09-12T16:17:44.731 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.731 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.731 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:44.731 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.731 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:44.731 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:44.731 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2316 2024-09-12T16:17:44.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.731 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:17:44.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:17:44.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901945+0000", 2024-09-12T16:17:44.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055056050000000002 2024-09-12T16:17:44.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901950+0000", 2024-09-12T16:17:44.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2490000000000001e-06 2024-09-12T16:17:44.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.733 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.733 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901966+0000", 2024-09-12T16:17:44.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6325e-05 2024-09-12T16:17:44.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.733 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.733 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901974+0000", 2024-09-12T16:17:44.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7570000000000004e-06 2024-09-12T16:17:44.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.733 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935518+0000", 2024-09-12T16:17:44.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033543587999999999 2024-09-12T16:17:44.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:44.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935559+0000", 2024-09-12T16:17:44.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1746000000000003e-05 2024-09-12T16:17:44.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935599+0000", 2024-09-12T16:17:44.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9774000000000002e-05 2024-09-12T16:17:44.734 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.734 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.735 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.735 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1571 3.b 3:d046566d:::rbd_data.1155525b14e3.0000000000000001:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:17:44.735 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:17:44.735 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 63.534161056999999, 2024-09-12T16:17:44.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064439785999999999, 2024-09-12T16:17:44.735 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.735 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.735 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:44.735 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.735 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:17:44.735 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:17:44.735 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1571 2024-09-12T16:17:44.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.736 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:17:44.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:17:44.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:17:44.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5400000000000002e-07 2024-09-12T16:17:44.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152567+0000", 2024-09-12T16:17:44.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.131e-06 2024-09-12T16:17:44.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152574+0000", 2024-09-12T16:17:44.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1840000000000002e-06 2024-09-12T16:17:44.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152579+0000", 2024-09-12T16:17:44.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.152e-06 2024-09-12T16:17:44.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153671+0000", 2024-09-12T16:17:44.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001092078 2024-09-12T16:17:44.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:44.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153779+0000", 2024-09-12T16:17:44.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108461 2024-09-12T16:17:44.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217004+0000", 2024-09-12T16:17:44.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.063224426 2024-09-12T16:17:44.739 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.739 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.739 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.739 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1581 3.4 3:22e34893:::rbd_data.1155525b14e3.0000000000000005:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:17:44.739 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:17:44.739 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 63.534063932000002, 2024-09-12T16:17:44.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064484407999999993, 2024-09-12T16:17:44.740 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.740 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.740 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:44.740 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.740 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:17:44.740 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:17:44.740 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1581 2024-09-12T16:17:44.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.740 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:17:44.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:17:44.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152662+0000", 2024-09-12T16:17:44.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.65e-07 2024-09-12T16:17:44.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152664+0000", 2024-09-12T16:17:44.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9829999999999999e-06 2024-09-12T16:17:44.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152670+0000", 2024-09-12T16:17:44.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2260000000000002e-06 2024-09-12T16:17:44.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152675+0000", 2024-09-12T16:17:44.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7990000000000001e-06 2024-09-12T16:17:44.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.216945+0000", 2024-09-12T16:17:44.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064270341999999994 2024-09-12T16:17:44.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:44.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217040+0000", 2024-09-12T16:17:44.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5242999999999996e-05 2024-09-12T16:17:44.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217146+0000", 2024-09-12T16:17:44.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010545 2024-09-12T16:17:44.744 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.744 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.744 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.744 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2207 3.0 3:05fdc61f:::rbd_data.1155ccb1894c.0000000000000003:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:44.744 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:17:44.744 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 47.316020371, 2024-09-12T16:17:44.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.05105382, 2024-09-12T16:17:44.745 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.745 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.745 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:44.745 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.745 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:17:44.745 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:17:44.745 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2207 2024-09-12T16:17:44.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.745 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:17:44.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:17:44.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370706+0000", 2024-09-12T16:17:44.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7800000000000001e-07 2024-09-12T16:17:44.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391581+0000", 2024-09-12T16:17:44.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020875624999999998 2024-09-12T16:17:44.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391608+0000", 2024-09-12T16:17:44.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6412999999999999e-05 2024-09-12T16:17:44.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391618+0000", 2024-09-12T16:17:44.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9240000000000002e-06 2024-09-12T16:17:44.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391705+0000", 2024-09-12T16:17:44.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7489000000000002e-05 2024-09-12T16:17:44.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:44.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391838+0000", 2024-09-12T16:17:44.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132865 2024-09-12T16:17:44.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 2", 2024-09-12T16:17:44.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.392587+0000", 2024-09-12T16:17:44.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074930000000000005 2024-09-12T16:17:44.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:44.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.420095+0000", 2024-09-12T16:17:44.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027507949 2024-09-12T16:17:44.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:17:44.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421610+0000", 2024-09-12T16:17:44.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001515195 2024-09-12T16:17:44.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:17:44.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421681+0000", 2024-09-12T16:17:44.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0320000000000004e-05 2024-09-12T16:17:44.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421759+0000", 2024-09-12T16:17:44.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7961999999999997e-05 2024-09-12T16:17:44.750 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.750 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.750 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.750 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5577.0:12725 3.0 3:02074383:::rbd_data.11552c69b548.0000000000000011:20 [read 785408~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-12T16:17:44.750 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:29.288770+0000", 2024-09-12T16:17:44.750 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.397955359999999, 2024-09-12T16:17:44.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038316849, 2024-09-12T16:17:44.750 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.750 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.751 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:44.751 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.751 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5577", 2024-09-12T16:17:44.751 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/4222688771", 2024-09-12T16:17:44.751 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 12725 2024-09-12T16:17:44.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.751 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.751 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.751 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288770+0000", 2024-09-12T16:17:44.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288770+0000", 2024-09-12T16:17:44.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288770+0000", 2024-09-12T16:17:44.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8500000000000002e-07 2024-09-12T16:17:44.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288772+0000", 2024-09-12T16:17:44.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2689999999999998e-06 2024-09-12T16:17:44.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288779+0000", 2024-09-12T16:17:44.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8310000000000003e-06 2024-09-12T16:17:44.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288784+0000", 2024-09-12T16:17:44.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1529999999999996e-06 2024-09-12T16:17:44.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.326899+0000", 2024-09-12T16:17:44.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038114980999999999 2024-09-12T16:17:44.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:44.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.326990+0000", 2024-09-12T16:17:44.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0191000000000004e-05 2024-09-12T16:17:44.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327087+0000", 2024-09-12T16:17:44.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7039000000000004e-05 2024-09-12T16:17:44.754 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.754 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.754 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.755 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5577.0:12726 3.0 3:02074383:::rbd_data.11552c69b548.0000000000000011:20 [read 793600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-12T16:17:44.755 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:29.288794+0000", 2024-09-12T16:17:44.755 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.397931409, 2024-09-12T16:17:44.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038526029000000003, 2024-09-12T16:17:44.755 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.755 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.755 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:44.755 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.755 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5577", 2024-09-12T16:17:44.755 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/4222688771", 2024-09-12T16:17:44.755 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 12726 2024-09-12T16:17:44.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.755 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.756 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.756 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288794+0000", 2024-09-12T16:17:44.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.756 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.756 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288794+0000", 2024-09-12T16:17:44.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.756 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.756 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288794+0000", 2024-09-12T16:17:44.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2799999999999996e-07 2024-09-12T16:17:44.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288797+0000", 2024-09-12T16:17:44.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3920000000000001e-06 2024-09-12T16:17:44.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288804+0000", 2024-09-12T16:17:44.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8430000000000004e-06 2024-09-12T16:17:44.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288809+0000", 2024-09-12T16:17:44.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1460000000000004e-06 2024-09-12T16:17:44.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327130+0000", 2024-09-12T16:17:44.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038320982000000003 2024-09-12T16:17:44.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:44.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327216+0000", 2024-09-12T16:17:44.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5991999999999999e-05 2024-09-12T16:17:44.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.759 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327320+0000", 2024-09-12T16:17:44.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000104146 2024-09-12T16:17:44.759 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.759 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.759 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.759 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5577.0:12727 3.0 3:02074383:::rbd_data.11552c69b548.0000000000000011:20 [read 801792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-12T16:17:44.759 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:29.288838+0000", 2024-09-12T16:17:44.759 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.397887584999999, 2024-09-12T16:17:44.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038705804000000003, 2024-09-12T16:17:44.759 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.759 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.759 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:44.759 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.760 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5577", 2024-09-12T16:17:44.760 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/4222688771", 2024-09-12T16:17:44.760 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 12727 2024-09-12T16:17:44.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.760 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.760 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.760 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288838+0000", 2024-09-12T16:17:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288838+0000", 2024-09-12T16:17:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288838+0000", 2024-09-12T16:17:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8299999999999997e-07 2024-09-12T16:17:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288840+0000", 2024-09-12T16:17:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.396e-06 2024-09-12T16:17:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288851+0000", 2024-09-12T16:17:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0312999999999999e-05 2024-09-12T16:17:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288857+0000", 2024-09-12T16:17:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7570000000000001e-06 2024-09-12T16:17:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327361+0000", 2024-09-12T16:17:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038504069000000002 2024-09-12T16:17:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327446+0000", 2024-09-12T16:17:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5542000000000002e-05 2024-09-12T16:17:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327543+0000", 2024-09-12T16:17:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7244000000000006e-05 2024-09-12T16:17:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5577.0:12728 3.0 3:02074383:::rbd_data.11552c69b548.0000000000000011:20 [read 809984~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-12T16:17:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:29.288864+0000", 2024-09-12T16:17:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.397860769999999, 2024-09-12T16:17:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038914837000000001, 2024-09-12T16:17:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5577", 2024-09-12T16:17:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/4222688771", 2024-09-12T16:17:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 12728 2024-09-12T16:17:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288864+0000", 2024-09-12T16:17:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288864+0000", 2024-09-12T16:17:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288865+0000", 2024-09-12T16:17:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-07 2024-09-12T16:17:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288867+0000", 2024-09-12T16:17:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.092e-06 2024-09-12T16:17:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288873+0000", 2024-09-12T16:17:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0020000000000003e-06 2024-09-12T16:17:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288878+0000", 2024-09-12T16:17:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2700000000000004e-06 2024-09-12T16:17:44.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.768 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.768 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327588+0000", 2024-09-12T16:17:44.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038709660999999999 2024-09-12T16:17:44.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.768 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:44.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327673+0000", 2024-09-12T16:17:44.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5370000000000004e-05 2024-09-12T16:17:44.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327779+0000", 2024-09-12T16:17:44.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000105957 2024-09-12T16:17:44.769 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.770 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.770 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.770 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5577.0:12729 3.0 3.c1c2e040 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-12T16:17:44.770 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:29.288885+0000", 2024-09-12T16:17:44.770 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.397840444, 2024-09-12T16:17:44.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038952112999999997, 2024-09-12T16:17:44.770 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.770 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.770 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:17:44.771 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.771 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5577", 2024-09-12T16:17:44.771 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/4222688771", 2024-09-12T16:17:44.771 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 12729 2024-09-12T16:17:44.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.771 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288885+0000", 2024-09-12T16:17:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288885+0000", 2024-09-12T16:17:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288885+0000", 2024-09-12T16:17:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9299999999999999e-07 2024-09-12T16:17:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288887+0000", 2024-09-12T16:17:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9589999999999998e-06 2024-09-12T16:17:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288893+0000", 2024-09-12T16:17:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8579999999999996e-06 2024-09-12T16:17:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288898+0000", 2024-09-12T16:17:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-06 2024-09-12T16:17:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327827+0000", 2024-09-12T16:17:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038928782000000002 2024-09-12T16:17:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327837+0000", 2024-09-12T16:17:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0271e-05 2024-09-12T16:17:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5577.0:12730 3.0 3.c1c2e040 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-12T16:17:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:29.288904+0000", 2024-09-12T16:17:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.397821135999999, 2024-09-12T16:17:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038984576999999999, 2024-09-12T16:17:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:17:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5577", 2024-09-12T16:17:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/4222688771", 2024-09-12T16:17:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 12730 2024-09-12T16:17:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288904+0000", 2024-09-12T16:17:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288904+0000", 2024-09-12T16:17:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288904+0000", 2024-09-12T16:17:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.65e-07 2024-09-12T16:17:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288906+0000", 2024-09-12T16:17:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9549999999999999e-06 2024-09-12T16:17:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288912+0000", 2024-09-12T16:17:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9460000000000003e-06 2024-09-12T16:17:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288926+0000", 2024-09-12T16:17:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3540000000000001e-05 2024-09-12T16:17:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327882+0000", 2024-09-12T16:17:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038956565999999998 2024-09-12T16:17:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327889+0000", 2024-09-12T16:17:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2049999999999999e-06 2024-09-12T16:17:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5577.0:12731 3.0 3.c1c2e040 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-12T16:17:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:29.288934+0000", 2024-09-12T16:17:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.397790759999999, 2024-09-12T16:17:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039017193999999998, 2024-09-12T16:17:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:17:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5577", 2024-09-12T16:17:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/4222688771", 2024-09-12T16:17:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 12731 2024-09-12T16:17:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288934+0000", 2024-09-12T16:17:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288934+0000", 2024-09-12T16:17:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288935+0000", 2024-09-12T16:17:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7599999999999998e-07 2024-09-12T16:17:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288937+0000", 2024-09-12T16:17:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4540000000000001e-06 2024-09-12T16:17:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288944+0000", 2024-09-12T16:17:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4980000000000003e-06 2024-09-12T16:17:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288949+0000", 2024-09-12T16:17:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1399999999999999e-06 2024-09-12T16:17:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.784 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:44.784 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327944+0000", 2024-09-12T16:17:44.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038994859999999999 2024-09-12T16:17:44.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:44.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:44.785 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:44.785 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327952+0000", 2024-09-12T16:17:44.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8660000000000006e-06 2024-09-12T16:17:44.785 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.785 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.785 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.785 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:44.785 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:44.785 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:44.787 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:44.785+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:44.787 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:17:44.798 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T16:17:44.888 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:44.886+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:44.935 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:44.935 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:44.935 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:17:44.935 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:44.945 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:17:44.978 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:17:44.978 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:17:44.989 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:44.988+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:44.997 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:17:44.997 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:17:45.014 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:17:45.014 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:17:45.030 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:17:45.031 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:17:45.047 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:17:45.047 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:17:45.055 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:45.055 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:45.064 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:17:45.065 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:17:45.065 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:17:45.111 INFO:teuthology.orchestra.run.smithi204.stdout:5405 trunc from 0x54a8600 to 0x7ef1c00 2024-09-12T16:17:45.118 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:45.117+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:45.132 INFO:teuthology.orchestra.run.smithi204.stdout:5408 read 0x2d1b400 thru 0x2d2acd2 (0xf8d3 bytes) 2024-09-12T16:17:45.134 INFO:teuthology.orchestra.run.smithi204.stdout:5409 write 0x4054000 thru 0x4058b08 (0x4b09 bytes) 2024-09-12T16:17:45.137 INFO:teuthology.orchestra.run.smithi204.stdout:5410 trunc from 0x7ef1c00 to 0xae81400 2024-09-12T16:17:45.152 INFO:teuthology.orchestra.run.smithi204.stdout:5412 read 0x893c00 thru 0x8a1db5 (0xe1b6 bytes) 2024-09-12T16:17:45.154 INFO:teuthology.orchestra.run.smithi204.stdout:5416 read 0x44cae00 thru 0x44d4520 (0x9721 bytes) 2024-09-12T16:17:45.177 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:45.177 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:45.186 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:17:45.231 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:45.230+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:45.291 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:45.291+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:45.294 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:45.294 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:45.302 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:17:45.392 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:45.391+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:45.420 INFO:teuthology.orchestra.run.smithi204.stdout:5417 write 0xe2ff400 thru 0xe303ad3 (0x46d4 bytes) 2024-09-12T16:17:45.420 INFO:teuthology.orchestra.run.smithi204.stdout:5418 write 0x5118200 thru 0x51208c1 (0x86c2 bytes) 2024-09-12T16:17:45.420 INFO:teuthology.orchestra.run.smithi204.stdout:5420 punch from 0xd3bc200 to 0xd3c1a00, (0x5800 bytes) 2024-09-12T16:17:45.422 INFO:teuthology.orchestra.run.smithi204.stdout:5423 flatten 2024-09-12T16:17:45.464 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:45.465 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:45.478 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:17:45.493 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:45.493+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:45.569 INFO:teuthology.orchestra.run.smithi204.stdout:5424 write 0x9580000 thru 0x95855b3 (0x55b4 bytes) 2024-09-12T16:17:45.585 INFO:teuthology.orchestra.run.smithi204.stdout:5425 trunc from 0xe303c00 to 0x13eb400 2024-09-12T16:17:45.594 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:45.593+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:45.609 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:45.609 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:45.609 INFO:teuthology.orchestra.run.smithi204.stdout:5429 read 0x4dd800 thru 0x4e8932 (0xb133 bytes) 2024-09-12T16:17:45.618 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:17:45.633 INFO:teuthology.orchestra.run.smithi204.stdout:5431 write 0xc9f7c00 thru 0xc9f7d6b (0x16c bytes) 2024-09-12T16:17:45.638 INFO:teuthology.orchestra.run.smithi204.stdout:5433 punch from 0x2893400 to 0x2897a00, (0x4600 bytes) 2024-09-12T16:17:45.640 INFO:teuthology.orchestra.run.smithi204.stdout:5436 write 0xb6a1200 thru 0xb6a4fdb (0x3ddc bytes) 2024-09-12T16:17:45.640 INFO:teuthology.orchestra.run.smithi204.stdout:5437 write 0x84d3c00 thru 0x84ddc69 (0xa06a bytes) 2024-09-12T16:17:45.654 INFO:teuthology.orchestra.run.smithi204.stdout:5438 write 0xd477a00 thru 0xd47b38b (0x398c bytes) 2024-09-12T16:17:45.655 INFO:teuthology.orchestra.run.smithi204.stdout:5439 read 0xcb59c00 thru 0xcb5ad48 (0x1149 bytes) 2024-09-12T16:17:45.655 INFO:teuthology.orchestra.run.smithi204.stdout:5440 read 0xcbfa00 thru 0xccdd9c (0xe39d bytes) 2024-09-12T16:17:45.658 INFO:teuthology.orchestra.run.smithi204.stdout:5441 clone 37 order 23 su 65536 sc 4 2024-09-12T16:17:45.695 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:45.694+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:45.766 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:45.766 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:45.775 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:17:45.795 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:45.795+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:45.882 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:45.914 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:45.915 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:17:45.916 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:45.914+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:46.017 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:46.016+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:46.064 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:46.064 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:46.073 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:17:46.117 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:46.116+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:46.180 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:46.181 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:46.189 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:17:46.230 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:46.229+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:46.319 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:46.318+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:46.336 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:46.336 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:46.345 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:17:46.370 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-12T16:17:46.370 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T16:17:46.370 INFO:tasks.thrashosds.thrasher:Removing osd 5, in_osds are: [0, 1, 2, 4, 5, 3] 2024-09-12T16:17:46.370 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 5 2024-09-12T16:17:46.379 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T16:17:46.429 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:46.428+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:46.495 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:46.495 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:46.503 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:17:46.548 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:46.547+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:46.621 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:46.621 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:46.622 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:46.621+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:46.629 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:17:46.711 INFO:tasks.ceph.mon.a.smithi017.stderr:2024-09-12T16:17:46.710+0000 7f3942a34640 -1 mon.a@0(leader).osd e102 definitely_dead 0 2024-09-12T16:17:46.723 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:46.722+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:46.773 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #35, image image_client.0-clone35 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent36 2024-09-12T16:17:46.781 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:46.781 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:46.790 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:17:46.820 INFO:teuthology.orchestra.run.smithi204.stdout:5442 write 0xb5bc400 thru 0xb5c4433 (0x8034 bytes) 2024-09-12T16:17:46.821 INFO:teuthology.orchestra.run.smithi204.stdout:5443 write 0xc700800 thru 0xc707417 (0x6c18 bytes) 2024-09-12T16:17:46.824 INFO:teuthology.orchestra.run.smithi204.stdout:5444 read 0x43fce00 thru 0x440ba15 (0xec16 bytes) 2024-09-12T16:17:46.826 INFO:teuthology.orchestra.run.smithi204.stdout:5448 trunc from 0xd47b400 to 0xc939400 2024-09-12T16:17:46.832 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:46.831+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:46.853 INFO:teuthology.orchestra.run.smithi204.stdout:5451 read 0x1cd9200 thru 0x1ce83b4 (0xf1b5 bytes) 2024-09-12T16:17:46.855 INFO:teuthology.orchestra.run.smithi204.stdout:5452 write 0xb4a2000 thru 0xb4b0c20 (0xec21 bytes) 2024-09-12T16:17:46.856 INFO:teuthology.orchestra.run.smithi204.stdout:5453 read 0xbb9f800 thru 0xbba7ba5 (0x83a6 bytes) 2024-09-12T16:17:46.856 INFO:teuthology.orchestra.run.smithi204.stdout:5455 punch from 0x6d93200 to 0x6da0400, (0xd200 bytes) 2024-09-12T16:17:46.857 INFO:teuthology.orchestra.run.smithi204.stdout:5457 punch from 0xaef7a00 to 0xaf02200, (0xa800 bytes) 2024-09-12T16:17:46.862 INFO:teuthology.orchestra.run.smithi204.stdout:5460 trunc from 0xc939400 to 0x838dc00 2024-09-12T16:17:46.892 INFO:teuthology.orchestra.run.smithi204.stdout:5462 trunc from 0x838dc00 to 0xca04000 2024-09-12T16:17:46.902 INFO:teuthology.orchestra.run.smithi204.stdout:5464 write 0x94dda00 thru 0x94e3165 (0x5766 bytes) 2024-09-12T16:17:46.903 INFO:teuthology.orchestra.run.smithi204.stdout:5465 read 0x6b4000 thru 0x6c05d7 (0xc5d8 bytes) 2024-09-12T16:17:46.904 INFO:teuthology.orchestra.run.smithi204.stdout:5466 write 0xba2be00 thru 0xba2d93e (0x1b3f bytes) 2024-09-12T16:17:46.904 INFO:teuthology.orchestra.run.smithi204.stdout:5468 write 0x928f200 thru 0x9296cc6 (0x7ac7 bytes) 2024-09-12T16:17:46.904 INFO:teuthology.orchestra.run.smithi204.stdout:5470 punch from 0x5664e00 to 0x5666400, (0x1600 bytes) 2024-09-12T16:17:46.905 INFO:teuthology.orchestra.run.smithi204.stdout:5472 write 0xa462600 thru 0xa46ce60 (0xa861 bytes) 2024-09-12T16:17:46.906 INFO:teuthology.orchestra.run.smithi204.stdout:5475 punch from 0x8a87c00 to 0x8a8e000, (0x6400 bytes) 2024-09-12T16:17:46.906 INFO:teuthology.orchestra.run.smithi204.stdout:5476 read 0x9bca800 thru 0x9bd7dbe (0xd5bf bytes) 2024-09-12T16:17:46.908 INFO:teuthology.orchestra.run.smithi204.stdout:5478 punch from 0x5868800 to 0x5870800, (0x8000 bytes) 2024-09-12T16:17:46.908 INFO:teuthology.orchestra.run.smithi204.stdout:5481 punch from 0xae1d800 to 0xae23e00, (0x6600 bytes) 2024-09-12T16:17:46.908 INFO:teuthology.orchestra.run.smithi204.stdout:5489 write 0x98aba00 thru 0x98b5ccb (0xa2cc bytes) 2024-09-12T16:17:46.909 INFO:teuthology.orchestra.run.smithi204.stdout:5490 punch from 0x68a0600 to 0x68a0800, (0x200 bytes) 2024-09-12T16:17:46.909 INFO:teuthology.orchestra.run.smithi204.stdout:5491 write 0x7bb0600 thru 0x7bb6d58 (0x6759 bytes) 2024-09-12T16:17:46.917 INFO:teuthology.orchestra.run.smithi204.stdout:5496 trunc from 0xca04000 to 0x5deb800 2024-09-12T16:17:46.926 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:46.925+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:46.947 INFO:teuthology.orchestra.run.smithi204.stdout:5497 trunc from 0x5deb800 to 0xaeae800 2024-09-12T16:17:46.951 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:46.951 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:46.961 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:17:46.964 INFO:teuthology.orchestra.run.smithi204.stdout:5498 write 0x5b14600 thru 0x5b15898 (0x1299 bytes) 2024-09-12T16:17:46.966 INFO:teuthology.orchestra.run.smithi204.stdout:5499 trunc from 0xaeae800 to 0xb79e400 2024-09-12T16:17:46.981 INFO:teuthology.orchestra.run.smithi204.stdout:5500 write 0x6e64000 thru 0x6e6cd13 (0x8d14 bytes) 2024-09-12T16:17:46.993 INFO:teuthology.orchestra.run.smithi204.stdout:5501 trunc from 0xb79e400 to 0x2d56a00 2024-09-12T16:17:47.021 INFO:teuthology.orchestra.run.smithi204.stdout:5502 trunc from 0x2d56a00 to 0x77f7c00 2024-09-12T16:17:47.030 INFO:teuthology.orchestra.run.smithi204.stdout:5503 read 0x594a200 thru 0x5951aaa (0x78ab bytes) 2024-09-12T16:17:47.031 INFO:teuthology.orchestra.run.smithi204.stdout:5504 read 0x3914600 thru 0x3920256 (0xbc57 bytes) 2024-09-12T16:17:47.045 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:47.045+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:47.048 INFO:teuthology.orchestra.run.smithi204.stdout:5505 write 0xb560a00 thru 0xb565634 (0x4c35 bytes) 2024-09-12T16:17:47.050 INFO:teuthology.orchestra.run.smithi204.stdout:5508 write 0x97b1800 thru 0x97b2ad1 (0x12d2 bytes) 2024-09-12T16:17:47.050 INFO:teuthology.orchestra.run.smithi204.stdout:5509 punch from 0x670e200 to 0x6719a00, (0xb800 bytes) 2024-09-12T16:17:47.050 INFO:teuthology.orchestra.run.smithi204.stdout:5510 read 0x6d8200 thru 0x6e323d (0xb03e bytes) 2024-09-12T16:17:47.060 INFO:teuthology.orchestra.run.smithi204.stdout:5511 trunc from 0xb565800 to 0x4249a00 2024-09-12T16:17:47.076 INFO:teuthology.orchestra.run.smithi204.stdout:5513 read 0x2688400 thru 0x2691c91 (0x9892 bytes) 2024-09-12T16:17:47.077 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T16:17:47.088 INFO:teuthology.orchestra.run.smithi204.stdout:5514 write 0x4979a00 thru 0x4981303 (0x7904 bytes) 2024-09-12T16:17:47.089 INFO:teuthology.orchestra.run.smithi204.stdout:5515 punch from 0x4934a00 to 0x4939c00, (0x5200 bytes) 2024-09-12T16:17:47.091 INFO:teuthology.orchestra.run.smithi204.stdout:5517 read 0x45d7c00 thru 0x45e44a2 (0xc8a3 bytes) 2024-09-12T16:17:47.091 INFO:teuthology.orchestra.run.smithi204.stdout:5519 read 0x2473600 thru 0x2476579 (0x2f7a bytes) 2024-09-12T16:17:47.091 INFO:teuthology.orchestra.run.smithi204.stdout:5522 read 0x1f04600 thru 0x1f0d6a1 (0x90a2 bytes) 2024-09-12T16:17:47.104 INFO:teuthology.orchestra.run.smithi204.stdout:5524 trunc from 0x4981400 to 0xed97000 2024-09-12T16:17:47.114 INFO:teuthology.orchestra.run.smithi204.stdout:5525 punch from 0x7996c00 to 0x79a5800, (0xec00 bytes) 2024-09-12T16:17:47.116 INFO:teuthology.orchestra.run.smithi204.stdout:5528 read 0xbe9de00 thru 0xbea962f (0xb830 bytes) 2024-09-12T16:17:47.116 INFO:teuthology.orchestra.run.smithi204.stdout:5529 write 0x1ec5200 thru 0x1ed303b (0xde3c bytes) 2024-09-12T16:17:47.116 INFO:teuthology.orchestra.run.smithi204.stdout:5531 write 0x1fc4400 thru 0x1fcd17f (0x8d80 bytes) 2024-09-12T16:17:47.116 INFO:teuthology.orchestra.run.smithi204.stdout:5536 write 0x2f4be00 thru 0x2f56362 (0xa563 bytes) 2024-09-12T16:17:47.117 INFO:teuthology.orchestra.run.smithi204.stdout:5537 write 0x7fd1800 thru 0x7fd635a (0x4b5b bytes) 2024-09-12T16:17:47.117 INFO:teuthology.orchestra.run.smithi204.stdout:5538 read 0xe6b8400 thru 0xe6c257a (0xa17b bytes) 2024-09-12T16:17:47.118 INFO:teuthology.orchestra.run.smithi204.stdout:5539 punch from 0xe55c00 to 0xe5e600, (0x8a00 bytes) 2024-09-12T16:17:47.120 INFO:teuthology.orchestra.run.smithi204.stdout:5541 trunc from 0xed97000 to 0xe38ac00 2024-09-12T16:17:47.126 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:47.126 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:47.129 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:47.128+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:47.135 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:17:47.150 INFO:teuthology.orchestra.run.smithi204.stdout:5542 punch from 0xa55d600 to 0xa55f000, (0x1a00 bytes) 2024-09-12T16:17:47.152 INFO:teuthology.orchestra.run.smithi204.stdout:5543 write 0xa3ed800 thru 0xa3f4d33 (0x7534 bytes) 2024-09-12T16:17:47.152 INFO:teuthology.orchestra.run.smithi204.stdout:5544 punch from 0x4cdc200 to 0x4cdfc00, (0x3a00 bytes) 2024-09-12T16:17:47.152 INFO:teuthology.orchestra.run.smithi204.stdout:5545 write 0x6408e00 thru 0x640d7f5 (0x49f6 bytes) 2024-09-12T16:17:47.156 INFO:teuthology.orchestra.run.smithi204.stdout:5546 trunc from 0xe38ac00 to 0xad94600 2024-09-12T16:17:47.188 INFO:teuthology.orchestra.run.smithi204.stdout:5548 write 0xdd1ac00 thru 0xdd2a2fa (0xf6fb bytes) 2024-09-12T16:17:47.189 INFO:teuthology.orchestra.run.smithi204.stdout:5550 read 0xa600 thru 0xaf22 (0x923 bytes) 2024-09-12T16:17:47.191 INFO:teuthology.orchestra.run.smithi204.stdout:5552 punch from 0xf4ee00 to 0xf52e00, (0x4000 bytes) 2024-09-12T16:17:47.191 INFO:teuthology.orchestra.run.smithi204.stdout:5553 punch from 0x481f600 to 0x4829000, (0x9a00 bytes) 2024-09-12T16:17:47.201 INFO:teuthology.orchestra.run.smithi204.stdout:5554 trunc from 0xdd2a400 to 0x5032a00 2024-09-12T16:17:47.222 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:17:47.223 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:17:47.233 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:47.229+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:47.240 INFO:teuthology.orchestra.run.smithi204.stdout:5555 write 0xc61aa00 thru 0xc6209d1 (0x5fd2 bytes) 2024-09-12T16:17:47.240 INFO:teuthology.orchestra.run.smithi204.stdout:5558 read 0xa7dc000 thru 0xa7e0878 (0x4879 bytes) 2024-09-12T16:17:47.241 INFO:teuthology.orchestra.run.smithi204.stdout:skipping zero length punch hole 2024-09-12T16:17:47.242 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:17:47.242 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:17:47.254 INFO:teuthology.orchestra.run.smithi204.stdout:5561 trunc from 0xc620a00 to 0xf7b600 2024-09-12T16:17:47.259 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:17:47.260 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:17:47.261 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:47.261 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:47.261 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:17:47.262 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:17:47.262 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:47.274 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:17:47.285 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:17:47.285 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:17:47.296 INFO:teuthology.orchestra.run.smithi204.stdout:5562 read 0xbfcc00 thru 0xbfe24f (0x1650 bytes) 2024-09-12T16:17:47.298 INFO:teuthology.orchestra.run.smithi204.stdout:5563 punch from 0xd1d400 to 0xd20800, (0x3400 bytes) 2024-09-12T16:17:47.298 INFO:teuthology.orchestra.run.smithi204.stdout:5565 read 0x3c4800 thru 0x3c8e64 (0x4665 bytes) 2024-09-12T16:17:47.298 INFO:teuthology.orchestra.run.smithi204.stdout:5566 read 0xa24c00 thru 0xa3152b (0xc92c bytes) 2024-09-12T16:17:47.301 INFO:teuthology.orchestra.run.smithi204.stdout:5569 trunc from 0xf7b600 to 0x17b2a00 2024-09-12T16:17:47.306 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:17:47.306 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:17:47.310 INFO:teuthology.orchestra.run.smithi204.stdout:5570 read 0x593a00 thru 0x598d90 (0x5391 bytes) 2024-09-12T16:17:47.311 INFO:teuthology.orchestra.run.smithi204.stdout:5571 read 0xc0ce00 thru 0xc0f24e (0x244f bytes) 2024-09-12T16:17:47.325 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:17:47.325 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:17:47.330 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:47.329+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:47.337 INFO:teuthology.orchestra.run.smithi204.stdout:5572 write 0xd65d400 thru 0xd661119 (0x3d1a bytes) 2024-09-12T16:17:47.337 INFO:teuthology.orchestra.run.smithi204.stdout:5575 read 0x582da00 thru 0x58394b0 (0xbab1 bytes) 2024-09-12T16:17:47.338 INFO:teuthology.orchestra.run.smithi204.stdout:5576 trunc from 0xd661200 to 0xddd2400 2024-09-12T16:17:47.351 INFO:teuthology.orchestra.run.smithi204.stdout:5577 read 0x5d23400 thru 0x5d3188b (0xe48c bytes) 2024-09-12T16:17:47.352 INFO:teuthology.orchestra.run.smithi204.stdout:5579 punch from 0x8c50c00 to 0x8c54600, (0x3a00 bytes) 2024-09-12T16:17:47.354 INFO:teuthology.orchestra.run.smithi204.stdout:5580 write 0x9d74000 thru 0x9d7bbdb (0x7bdc bytes) 2024-09-12T16:17:47.354 INFO:teuthology.orchestra.run.smithi204.stdout:5582 write 0x9242000 thru 0x924201c (0x1d bytes) 2024-09-12T16:17:47.354 INFO:teuthology.orchestra.run.smithi204.stdout:5585 punch from 0x14a1a00 to 0x14a6400, (0x4a00 bytes) 2024-09-12T16:17:47.355 INFO:teuthology.orchestra.run.smithi204.stdout:5586 write 0xdd56000 thru 0xdd589be (0x29bf bytes) 2024-09-12T16:17:47.355 INFO:teuthology.orchestra.run.smithi204.stdout:5587 write 0x3a5dc00 thru 0x3a5f224 (0x1625 bytes) 2024-09-12T16:17:47.355 INFO:teuthology.orchestra.run.smithi204.stdout:5588 read 0x8a7fa00 thru 0x8a86b73 (0x7174 bytes) 2024-09-12T16:17:47.355 INFO:teuthology.orchestra.run.smithi204.stdout:5590 punch from 0x6f91200 to 0x6f92c00, (0x1a00 bytes) 2024-09-12T16:17:47.356 INFO:teuthology.orchestra.run.smithi204.stdout:5593 punch from 0x8f2b000 to 0x8f2fc00, (0x4c00 bytes) 2024-09-12T16:17:47.356 INFO:teuthology.orchestra.run.smithi204.stdout:5594 write 0xb26be00 thru 0xb2798e9 (0xdaea bytes) 2024-09-12T16:17:47.356 INFO:teuthology.orchestra.run.smithi204.stdout:5596 read 0xbfa5600 thru 0xbfac756 (0x7157 bytes) 2024-09-12T16:17:47.356 INFO:teuthology.orchestra.run.smithi204.stdout:5597 read 0x419bc00 thru 0x41a6f88 (0xb389 bytes) 2024-09-12T16:17:47.356 INFO:teuthology.orchestra.run.smithi204.stdout:5598 read 0xbbde400 thru 0xbbe6c2f (0x8830 bytes) 2024-09-12T16:17:47.357 INFO:teuthology.orchestra.run.smithi204.stdout:5600 write 0x2d07600 thru 0x2d10c19 (0x961a bytes) 2024-09-12T16:17:47.357 INFO:teuthology.orchestra.run.smithi204.stdout:5603 read 0x52bb000 thru 0x52c269d (0x769e bytes) 2024-09-12T16:17:47.357 INFO:teuthology.orchestra.run.smithi204.stdout:5607 write 0x2ccc200 thru 0x2cd871c (0xc51d bytes) 2024-09-12T16:17:47.357 INFO:teuthology.orchestra.run.smithi204.stdout:5608 read 0xa2b7e00 thru 0xa2bfdaf (0x7fb0 bytes) 2024-09-12T16:17:47.357 INFO:teuthology.orchestra.run.smithi204.stdout:5609 read 0x7b92600 thru 0x7b9a6a3 (0x80a4 bytes) 2024-09-12T16:17:47.357 INFO:teuthology.orchestra.run.smithi204.stdout:5613 read 0xb2baa00 thru 0xb2c7e27 (0xd428 bytes) 2024-09-12T16:17:47.357 INFO:teuthology.orchestra.run.smithi204.stdout:5615 write 0x9309c00 thru 0x930ff5f (0x6360 bytes) 2024-09-12T16:17:47.363 INFO:teuthology.orchestra.run.smithi204.stdout:5616 trunc from 0xddd2400 to 0x8538200 2024-09-12T16:17:47.372 INFO:teuthology.orchestra.run.smithi017.stderr:marked out osd.5. 2024-09-12T16:17:47.378 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2024-09-12T16:17:47.402 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:47.402 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:17:47.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:17:47.402 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:17:47.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.402 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2307 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12401664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:47.403 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:17:47.403 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 89.504806959000007, 2024-09-12T16:17:47.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038241450000000003, 2024-09-12T16:17:47.403 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:47.403 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:47.403 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:47.403 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:47.403 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:47.403 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:47.403 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2307 2024-09-12T16:17:47.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.403 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:47.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:47.404 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:17:47.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.404 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:47.404 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:17:47.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.404 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:47.404 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896220+0000", 2024-09-12T16:17:47.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3500000000000002e-07 2024-09-12T16:17:47.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.405 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:47.405 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896222+0000", 2024-09-12T16:17:47.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1720000000000001e-06 2024-09-12T16:17:47.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.405 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:47.405 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896228+0000", 2024-09-12T16:17:47.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0870000000000003e-06 2024-09-12T16:17:47.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.405 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:47.405 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896233+0000", 2024-09-12T16:17:47.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:17:47.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:47.406 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934382+0000", 2024-09-12T16:17:47.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038149566000000003 2024-09-12T16:17:47.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:47.406 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934422+0000", 2024-09-12T16:17:47.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0015999999999998e-05 2024-09-12T16:17:47.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:47.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934461+0000", 2024-09-12T16:17:47.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8423999999999997e-05 2024-09-12T16:17:47.407 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.407 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:47.407 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.407 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2308 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12405760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:47.407 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:17:47.407 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 89.504787261999994, 2024-09-12T16:17:47.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038420745999999999, 2024-09-12T16:17:47.407 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:47.407 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:47.408 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:47.408 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:47.408 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:47.408 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:47.408 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2308 2024-09-12T16:17:47.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.408 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:47.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.408 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:47.408 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:17:47.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:47.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:17:47.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:47.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:17:47.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.58e-07 2024-09-12T16:17:47.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.410 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:47.410 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896241+0000", 2024-09-12T16:17:47.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7940000000000001e-06 2024-09-12T16:17:47.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.410 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:47.410 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896247+0000", 2024-09-12T16:17:47.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1460000000000001e-06 2024-09-12T16:17:47.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.410 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:47.410 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896252+0000", 2024-09-12T16:17:47.411 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6840000000000004e-06 2024-09-12T16:17:47.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.411 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:47.411 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934494+0000", 2024-09-12T16:17:47.411 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038242362000000002 2024-09-12T16:17:47.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.411 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:47.411 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934579+0000", 2024-09-12T16:17:47.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5044999999999996e-05 2024-09-12T16:17:47.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:47.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934660+0000", 2024-09-12T16:17:47.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0357000000000003e-05 2024-09-12T16:17:47.412 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.412 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:47.412 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.412 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2309 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12409856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:47.412 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:17:47.412 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 89.504766681999996, 2024-09-12T16:17:47.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038504629999999998, 2024-09-12T16:17:47.413 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:47.413 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:47.413 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:47.413 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:47.413 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:47.413 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:47.413 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2309 2024-09-12T16:17:47.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.413 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:47.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:47.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:17:47.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:47.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:17:47.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:47.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:17:47.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5199999999999998e-07 2024-09-12T16:17:47.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:47.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896263+0000", 2024-09-12T16:17:47.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4209999999999999e-06 2024-09-12T16:17:47.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.415 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:47.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896269+0000", 2024-09-12T16:17:47.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9449999999999998e-06 2024-09-12T16:17:47.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.415 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:47.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896274+0000", 2024-09-12T16:17:47.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3950000000000003e-06 2024-09-12T16:17:47.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.415 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:47.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934686+0000", 2024-09-12T16:17:47.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038412333999999999 2024-09-12T16:17:47.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.416 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:47.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934727+0000", 2024-09-12T16:17:47.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0649999999999999e-05 2024-09-12T16:17:47.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.416 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:47.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934764+0000", 2024-09-12T16:17:47.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7533000000000001e-05 2024-09-12T16:17:47.416 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.416 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:47.417 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.417 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2310 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12413952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:47.417 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:17:47.417 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 89.504745810000003, 2024-09-12T16:17:47.417 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038694183, 2024-09-12T16:17:47.417 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:47.417 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:47.417 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:47.417 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:47.417 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:47.417 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:47.417 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2310 2024-09-12T16:17:47.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.418 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:47.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:47.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:17:47.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:47.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:17:47.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:47.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896281+0000", 2024-09-12T16:17:47.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1399999999999997e-07 2024-09-12T16:17:47.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.419 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:47.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896283+0000", 2024-09-12T16:17:47.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9549999999999999e-06 2024-09-12T16:17:47.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.419 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:47.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896289+0000", 2024-09-12T16:17:47.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8669999999999999e-06 2024-09-12T16:17:47.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:47.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896301+0000", 2024-09-12T16:17:47.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1807999999999999e-05 2024-09-12T16:17:47.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:47.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934798+0000", 2024-09-12T16:17:47.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038497591999999997 2024-09-12T16:17:47.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:47.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934885+0000", 2024-09-12T16:17:47.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7149000000000002e-05 2024-09-12T16:17:47.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:47.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934975+0000", 2024-09-12T16:17:47.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9297999999999998e-05 2024-09-12T16:17:47.421 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.421 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:47.421 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.421 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2311 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12418048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:47.421 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:17:47.421 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 89.504718553999993, 2024-09-12T16:17:47.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038768558000000002, 2024-09-12T16:17:47.422 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:47.422 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:47.422 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:47.422 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:47.422 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:47.422 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:47.422 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2311 2024-09-12T16:17:47.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.422 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:47.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.422 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:47.422 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:17:47.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.423 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:47.423 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:17:47.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.423 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:47.423 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:17:47.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.63e-07 2024-09-12T16:17:47.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.423 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:47.423 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896310+0000", 2024-09-12T16:17:47.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1560000000000002e-06 2024-09-12T16:17:47.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.424 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:47.424 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896316+0000", 2024-09-12T16:17:47.424 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0249999999999999e-06 2024-09-12T16:17:47.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.424 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:47.424 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896322+0000", 2024-09-12T16:17:47.424 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6400000000000002e-06 2024-09-12T16:17:47.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.424 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:47.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934997+0000", 2024-09-12T16:17:47.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038674565000000001 2024-09-12T16:17:47.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:47.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935037+0000", 2024-09-12T16:17:47.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0485999999999998e-05 2024-09-12T16:17:47.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:47.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935076+0000", 2024-09-12T16:17:47.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9223e-05 2024-09-12T16:17:47.425 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.425 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:47.426 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.426 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2312 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12422144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:47.426 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:17:47.426 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 89.504697860999997, 2024-09-12T16:17:47.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038856784999999998, 2024-09-12T16:17:47.426 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:47.426 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:47.426 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:47.426 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:47.426 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:47.426 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:47.426 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2312 2024-09-12T16:17:47.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.427 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:47.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:47.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:17:47.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:47.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:17:47.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:47.428 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896329+0000", 2024-09-12T16:17:47.428 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5499999999999999e-07 2024-09-12T16:17:47.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.428 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.428 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:47.428 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896337+0000", 2024-09-12T16:17:47.428 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0819999999999999e-06 2024-09-12T16:17:47.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.428 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.428 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:47.428 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896343+0000", 2024-09-12T16:17:47.428 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.263e-06 2024-09-12T16:17:47.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.428 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.428 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:47.429 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896348+0000", 2024-09-12T16:17:47.429 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8860000000000003e-06 2024-09-12T16:17:47.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.429 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:47.429 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935097+0000", 2024-09-12T16:17:47.429 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038748818999999997 2024-09-12T16:17:47.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.429 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:47.429 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935141+0000", 2024-09-12T16:17:47.429 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4175000000000003e-05 2024-09-12T16:17:47.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.430 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:47.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935185+0000", 2024-09-12T16:17:47.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4205000000000001e-05 2024-09-12T16:17:47.430 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.430 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:47.430 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.430 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2313 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12426240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:47.430 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:17:47.430 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 89.504671646000006, 2024-09-12T16:17:47.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038928683999999998, 2024-09-12T16:17:47.430 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:47.430 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:47.431 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:47.431 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:47.431 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:47.431 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:47.431 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2313 2024-09-12T16:17:47.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.431 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:47.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:47.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:17:47.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:47.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:17:47.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:47.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:17:47.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0400000000000002e-07 2024-09-12T16:17:47.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:47.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896357+0000", 2024-09-12T16:17:47.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.097e-06 2024-09-12T16:17:47.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:47.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896363+0000", 2024-09-12T16:17:47.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5119999999999999e-06 2024-09-12T16:17:47.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:47.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896374+0000", 2024-09-12T16:17:47.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1381e-05 2024-09-12T16:17:47.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.437 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:47.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935205+0000", 2024-09-12T16:17:47.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038830549999999998 2024-09-12T16:17:47.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.437 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:47.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935244+0000", 2024-09-12T16:17:47.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9520000000000001e-05 2024-09-12T16:17:47.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.438 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:47.438 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935283+0000", 2024-09-12T16:17:47.438 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9220000000000001e-05 2024-09-12T16:17:47.438 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.438 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:47.438 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.438 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2314 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12430336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:47.438 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:17:47.438 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 89.504634476000007, 2024-09-12T16:17:47.438 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039008137999999998, 2024-09-12T16:17:47.438 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:47.438 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:47.439 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:47.439 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:47.439 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:47.439 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:47.439 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2314 2024-09-12T16:17:47.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.439 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:47.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.439 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:47.439 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:17:47.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.440 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:47.440 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:17:47.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.440 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:47.440 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:17:47.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6499999999999999e-07 2024-09-12T16:17:47.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.440 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:47.440 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896395+0000", 2024-09-12T16:17:47.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2960000000000001e-06 2024-09-12T16:17:47.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.441 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:47.441 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896402+0000", 2024-09-12T16:17:47.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2280000000000001e-06 2024-09-12T16:17:47.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.441 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:47.441 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896407+0000", 2024-09-12T16:17:47.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3630000000000002e-06 2024-09-12T16:17:47.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.441 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:47.442 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935302+0000", 2024-09-12T16:17:47.442 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038895181000000001 2024-09-12T16:17:47.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.442 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:47.442 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935343+0000", 2024-09-12T16:17:47.442 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0590999999999998e-05 2024-09-12T16:17:47.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.442 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:47.442 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935400+0000", 2024-09-12T16:17:47.442 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7014e-05 2024-09-12T16:17:47.442 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.442 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:47.443 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.443 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2315 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12434432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:47.443 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:17:47.443 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 89.504611824999998, 2024-09-12T16:17:47.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039083892000000002, 2024-09-12T16:17:47.443 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:47.443 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:47.443 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:47.443 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:47.443 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:47.443 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:47.444 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2315 2024-09-12T16:17:47.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.444 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:47.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:47.444 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:17:47.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:47.444 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:17:47.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.445 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:47.445 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896415+0000", 2024-09-12T16:17:47.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3300000000000002e-07 2024-09-12T16:17:47.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.445 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:47.445 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896421+0000", 2024-09-12T16:17:47.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7579999999999998e-06 2024-09-12T16:17:47.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.445 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:47.445 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896427+0000", 2024-09-12T16:17:47.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3029999999999996e-06 2024-09-12T16:17:47.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.446 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:47.446 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896432+0000", 2024-09-12T16:17:47.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.215e-06 2024-09-12T16:17:47.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.446 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:47.446 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935420+0000", 2024-09-12T16:17:47.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038987727 2024-09-12T16:17:47.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.446 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:47.446 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935460+0000", 2024-09-12T16:17:47.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9817999999999997e-05 2024-09-12T16:17:47.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.447 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:47.447 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935498+0000", 2024-09-12T16:17:47.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8438e-05 2024-09-12T16:17:47.447 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.447 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:47.447 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.447 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2316 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12438528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:47.447 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:17:47.447 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 89.504587173000004, 2024-09-12T16:17:47.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039160043999999998, 2024-09-12T16:17:47.448 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:47.448 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:47.448 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:47.448 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:47.448 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:47.448 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:47.448 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2316 2024-09-12T16:17:47.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.448 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:47.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.448 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:47.449 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:17:47.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.449 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:47.449 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:17:47.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.449 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:47.449 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901945+0000", 2024-09-12T16:17:47.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055056050000000002 2024-09-12T16:17:47.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:47.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901950+0000", 2024-09-12T16:17:47.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2490000000000001e-06 2024-09-12T16:17:47.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:47.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901966+0000", 2024-09-12T16:17:47.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6325e-05 2024-09-12T16:17:47.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:47.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901974+0000", 2024-09-12T16:17:47.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7570000000000004e-06 2024-09-12T16:17:47.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:47.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935518+0000", 2024-09-12T16:17:47.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033543587999999999 2024-09-12T16:17:47.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:47.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935559+0000", 2024-09-12T16:17:47.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1746000000000003e-05 2024-09-12T16:17:47.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:47.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935599+0000", 2024-09-12T16:17:47.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9774000000000002e-05 2024-09-12T16:17:47.452 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.452 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:47.452 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.452 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1571 3.b 3:d046566d:::rbd_data.1155525b14e3.0000000000000001:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:17:47.452 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:17:47.452 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 66.248462130999997, 2024-09-12T16:17:47.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064439785999999999, 2024-09-12T16:17:47.452 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:47.452 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:47.453 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:47.453 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:47.453 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:17:47.453 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:17:47.453 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1571 2024-09-12T16:17:47.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.453 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:47.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:47.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:17:47.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:47.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:17:47.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:47.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:17:47.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5400000000000002e-07 2024-09-12T16:17:47.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:47.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152567+0000", 2024-09-12T16:17:47.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.131e-06 2024-09-12T16:17:47.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:47.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152574+0000", 2024-09-12T16:17:47.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1840000000000002e-06 2024-09-12T16:17:47.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:47.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152579+0000", 2024-09-12T16:17:47.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.152e-06 2024-09-12T16:17:47.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:47.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153671+0000", 2024-09-12T16:17:47.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001092078 2024-09-12T16:17:47.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:47.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153779+0000", 2024-09-12T16:17:47.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108461 2024-09-12T16:17:47.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:47.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217004+0000", 2024-09-12T16:17:47.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.063224426 2024-09-12T16:17:47.456 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.456 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:47.457 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.457 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1581 3.4 3:22e34893:::rbd_data.1155525b14e3.0000000000000005:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:17:47.457 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:17:47.457 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 66.248365006, 2024-09-12T16:17:47.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064484407999999993, 2024-09-12T16:17:47.457 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:47.457 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:47.457 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:47.457 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:47.457 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:17:47.457 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:17:47.457 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1581 2024-09-12T16:17:47.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.458 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:47.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:47.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:17:47.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:47.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:17:47.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:47.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152662+0000", 2024-09-12T16:17:47.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.65e-07 2024-09-12T16:17:47.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:47.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152664+0000", 2024-09-12T16:17:47.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9829999999999999e-06 2024-09-12T16:17:47.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:47.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152670+0000", 2024-09-12T16:17:47.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2260000000000002e-06 2024-09-12T16:17:47.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:47.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152675+0000", 2024-09-12T16:17:47.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7990000000000001e-06 2024-09-12T16:17:47.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.460 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:47.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.216945+0000", 2024-09-12T16:17:47.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064270341999999994 2024-09-12T16:17:47.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.460 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:47.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217040+0000", 2024-09-12T16:17:47.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5242999999999996e-05 2024-09-12T16:17:47.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:47.461 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217146+0000", 2024-09-12T16:17:47.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010545 2024-09-12T16:17:47.461 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.461 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:47.461 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.461 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2207 3.0 3:05fdc61f:::rbd_data.1155ccb1894c.0000000000000003:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:47.461 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:17:47.461 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 50.030321444999998, 2024-09-12T16:17:47.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.05105382, 2024-09-12T16:17:47.462 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:47.462 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:47.462 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:47.462 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:47.462 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:17:47.462 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:17:47.462 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2207 2024-09-12T16:17:47.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.462 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:47.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:47.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:17:47.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.463 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:47.463 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:17:47.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.463 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:47.463 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370706+0000", 2024-09-12T16:17:47.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7800000000000001e-07 2024-09-12T16:17:47.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.463 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:47.463 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391581+0000", 2024-09-12T16:17:47.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020875624999999998 2024-09-12T16:17:47.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.464 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:47.464 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391608+0000", 2024-09-12T16:17:47.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6412999999999999e-05 2024-09-12T16:17:47.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.464 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:47.464 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391618+0000", 2024-09-12T16:17:47.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9240000000000002e-06 2024-09-12T16:17:47.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:47.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391705+0000", 2024-09-12T16:17:47.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7489000000000002e-05 2024-09-12T16:17:47.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:47.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391838+0000", 2024-09-12T16:17:47.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132865 2024-09-12T16:17:47.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 2", 2024-09-12T16:17:47.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.392587+0000", 2024-09-12T16:17:47.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074930000000000005 2024-09-12T16:17:47.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:47.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.420095+0000", 2024-09-12T16:17:47.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027507949 2024-09-12T16:17:47.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:17:47.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421610+0000", 2024-09-12T16:17:47.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001515195 2024-09-12T16:17:47.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:17:47.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421681+0000", 2024-09-12T16:17:47.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0320000000000004e-05 2024-09-12T16:17:47.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.467 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:47.467 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421759+0000", 2024-09-12T16:17:47.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7961999999999997e-05 2024-09-12T16:17:47.467 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.467 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:47.467 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.467 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5577.0:12725 3.0 3:02074383:::rbd_data.11552c69b548.0000000000000011:20 [read 785408~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-12T16:17:47.467 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:29.288770+0000", 2024-09-12T16:17:47.467 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.112256433999999, 2024-09-12T16:17:47.468 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038316849, 2024-09-12T16:17:47.468 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:47.468 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:47.468 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:47.468 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:47.468 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5577", 2024-09-12T16:17:47.468 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/4222688771", 2024-09-12T16:17:47.468 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 12725 2024-09-12T16:17:47.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.468 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:47.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.468 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:47.468 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288770+0000", 2024-09-12T16:17:47.468 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.469 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:47.469 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288770+0000", 2024-09-12T16:17:47.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.469 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:47.469 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288770+0000", 2024-09-12T16:17:47.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8500000000000002e-07 2024-09-12T16:17:47.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.469 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:47.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288772+0000", 2024-09-12T16:17:47.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2689999999999998e-06 2024-09-12T16:17:47.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:47.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288779+0000", 2024-09-12T16:17:47.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8310000000000003e-06 2024-09-12T16:17:47.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:47.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288784+0000", 2024-09-12T16:17:47.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1529999999999996e-06 2024-09-12T16:17:47.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:47.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.326899+0000", 2024-09-12T16:17:47.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038114980999999999 2024-09-12T16:17:47.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:47.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.326990+0000", 2024-09-12T16:17:47.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0191000000000004e-05 2024-09-12T16:17:47.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:47.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327087+0000", 2024-09-12T16:17:47.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7039000000000004e-05 2024-09-12T16:17:47.472 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.472 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:47.472 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.472 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5577.0:12726 3.0 3:02074383:::rbd_data.11552c69b548.0000000000000011:20 [read 793600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-12T16:17:47.472 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:29.288794+0000", 2024-09-12T16:17:47.472 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.112232483, 2024-09-12T16:17:47.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038526029000000003, 2024-09-12T16:17:47.472 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:47.472 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:47.472 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:47.472 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:47.473 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5577", 2024-09-12T16:17:47.473 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/4222688771", 2024-09-12T16:17:47.473 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 12726 2024-09-12T16:17:47.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.473 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:47.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.473 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:47.473 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288794+0000", 2024-09-12T16:17:47.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.473 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:47.473 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288794+0000", 2024-09-12T16:17:47.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.474 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:47.474 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288794+0000", 2024-09-12T16:17:47.474 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2799999999999996e-07 2024-09-12T16:17:47.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.474 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:47.474 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288797+0000", 2024-09-12T16:17:47.474 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3920000000000001e-06 2024-09-12T16:17:47.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.474 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:47.474 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288804+0000", 2024-09-12T16:17:47.475 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8430000000000004e-06 2024-09-12T16:17:47.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.475 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:47.475 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288809+0000", 2024-09-12T16:17:47.475 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1460000000000004e-06 2024-09-12T16:17:47.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.475 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:47.475 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327130+0000", 2024-09-12T16:17:47.475 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038320982000000003 2024-09-12T16:17:47.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.475 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:47.476 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327216+0000", 2024-09-12T16:17:47.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5991999999999999e-05 2024-09-12T16:17:47.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.476 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:47.476 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327320+0000", 2024-09-12T16:17:47.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000104146 2024-09-12T16:17:47.476 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.476 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:47.476 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.476 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5577.0:12727 3.0 3:02074383:::rbd_data.11552c69b548.0000000000000011:20 [read 801792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-12T16:17:47.477 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:29.288838+0000", 2024-09-12T16:17:47.477 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.112188659000001, 2024-09-12T16:17:47.477 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038705804000000003, 2024-09-12T16:17:47.477 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:47.477 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:47.477 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:47.477 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:47.477 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5577", 2024-09-12T16:17:47.477 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/4222688771", 2024-09-12T16:17:47.477 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 12727 2024-09-12T16:17:47.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.477 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:47.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.477 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:47.478 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288838+0000", 2024-09-12T16:17:47.478 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.478 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.478 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:47.478 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288838+0000", 2024-09-12T16:17:47.478 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.478 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.478 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:47.478 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288838+0000", 2024-09-12T16:17:47.478 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8299999999999997e-07 2024-09-12T16:17:47.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.478 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.479 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:47.479 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288840+0000", 2024-09-12T16:17:47.479 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.396e-06 2024-09-12T16:17:47.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.479 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:47.479 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288851+0000", 2024-09-12T16:17:47.479 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0312999999999999e-05 2024-09-12T16:17:47.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.479 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:47.479 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288857+0000", 2024-09-12T16:17:47.479 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7570000000000001e-06 2024-09-12T16:17:47.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.480 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:47.480 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327361+0000", 2024-09-12T16:17:47.480 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038504069000000002 2024-09-12T16:17:47.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.480 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:47.480 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327446+0000", 2024-09-12T16:17:47.480 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5542000000000002e-05 2024-09-12T16:17:47.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.480 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:47.480 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327543+0000", 2024-09-12T16:17:47.480 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7244000000000006e-05 2024-09-12T16:17:47.480 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.481 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:47.481 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.481 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5577.0:12728 3.0 3:02074383:::rbd_data.11552c69b548.0000000000000011:20 [read 809984~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-12T16:17:47.481 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:29.288864+0000", 2024-09-12T16:17:47.481 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.112161843999999, 2024-09-12T16:17:47.481 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038914837000000001, 2024-09-12T16:17:47.481 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:47.481 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:47.481 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:47.481 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:47.481 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5577", 2024-09-12T16:17:47.481 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/4222688771", 2024-09-12T16:17:47.482 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 12728 2024-09-12T16:17:47.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.482 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:47.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.482 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:47.482 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288864+0000", 2024-09-12T16:17:47.482 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.482 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:47.482 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288864+0000", 2024-09-12T16:17:47.482 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.483 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:47.483 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288865+0000", 2024-09-12T16:17:47.483 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-07 2024-09-12T16:17:47.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.483 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.483 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:47.483 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288867+0000", 2024-09-12T16:17:47.483 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.092e-06 2024-09-12T16:17:47.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.483 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.483 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:47.483 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288873+0000", 2024-09-12T16:17:47.483 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0020000000000003e-06 2024-09-12T16:17:47.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.484 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:47.484 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288878+0000", 2024-09-12T16:17:47.484 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2700000000000004e-06 2024-09-12T16:17:47.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.484 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:47.484 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327588+0000", 2024-09-12T16:17:47.484 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038709660999999999 2024-09-12T16:17:47.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.484 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:47.484 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327673+0000", 2024-09-12T16:17:47.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5370000000000004e-05 2024-09-12T16:17:47.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:47.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327779+0000", 2024-09-12T16:17:47.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000105957 2024-09-12T16:17:47.485 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.485 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:47.485 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.485 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5577.0:12729 3.0 3.c1c2e040 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-12T16:17:47.485 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:29.288885+0000", 2024-09-12T16:17:47.486 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.112141518000001, 2024-09-12T16:17:47.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038952112999999997, 2024-09-12T16:17:47.486 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:47.486 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:47.486 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:17:47.486 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:47.486 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5577", 2024-09-12T16:17:47.486 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/4222688771", 2024-09-12T16:17:47.486 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 12729 2024-09-12T16:17:47.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.486 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:47.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.486 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:47.486 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288885+0000", 2024-09-12T16:17:47.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.487 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:47.487 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288885+0000", 2024-09-12T16:17:47.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.487 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:47.487 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288885+0000", 2024-09-12T16:17:47.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9299999999999999e-07 2024-09-12T16:17:47.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.487 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:47.487 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288887+0000", 2024-09-12T16:17:47.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9589999999999998e-06 2024-09-12T16:17:47.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.488 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:47.488 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288893+0000", 2024-09-12T16:17:47.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8579999999999996e-06 2024-09-12T16:17:47.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.488 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:47.488 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288898+0000", 2024-09-12T16:17:47.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-06 2024-09-12T16:17:47.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.489 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:47.489 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327827+0000", 2024-09-12T16:17:47.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038928782000000002 2024-09-12T16:17:47.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.489 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:47.489 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327837+0000", 2024-09-12T16:17:47.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0271e-05 2024-09-12T16:17:47.489 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.489 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:47.489 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.490 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5577.0:12730 3.0 3.c1c2e040 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-12T16:17:47.490 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:29.288904+0000", 2024-09-12T16:17:47.490 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.112122209999999, 2024-09-12T16:17:47.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038984576999999999, 2024-09-12T16:17:47.490 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:47.490 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:47.490 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:17:47.490 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:47.490 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5577", 2024-09-12T16:17:47.490 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/4222688771", 2024-09-12T16:17:47.490 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 12730 2024-09-12T16:17:47.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.490 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:47.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.491 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:47.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288904+0000", 2024-09-12T16:17:47.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.491 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:47.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288904+0000", 2024-09-12T16:17:47.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.491 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:47.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288904+0000", 2024-09-12T16:17:47.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.65e-07 2024-09-12T16:17:47.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.492 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:47.492 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288906+0000", 2024-09-12T16:17:47.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9549999999999999e-06 2024-09-12T16:17:47.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.492 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:47.492 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288912+0000", 2024-09-12T16:17:47.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9460000000000003e-06 2024-09-12T16:17:47.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.492 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:47.492 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288926+0000", 2024-09-12T16:17:47.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3540000000000001e-05 2024-09-12T16:17:47.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.493 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:47.493 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327882+0000", 2024-09-12T16:17:47.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038956565999999998 2024-09-12T16:17:47.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.493 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:47.493 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327889+0000", 2024-09-12T16:17:47.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2049999999999999e-06 2024-09-12T16:17:47.493 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.493 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:47.493 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.494 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5577.0:12731 3.0 3.c1c2e040 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-12T16:17:47.494 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:29.288934+0000", 2024-09-12T16:17:47.494 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.112091834000001, 2024-09-12T16:17:47.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039017193999999998, 2024-09-12T16:17:47.494 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:47.494 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:47.494 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:17:47.494 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:47.494 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5577", 2024-09-12T16:17:47.494 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/4222688771", 2024-09-12T16:17:47.494 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 12731 2024-09-12T16:17:47.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.495 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:47.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.495 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:47.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288934+0000", 2024-09-12T16:17:47.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.495 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:47.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288934+0000", 2024-09-12T16:17:47.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.495 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:47.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288935+0000", 2024-09-12T16:17:47.496 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7599999999999998e-07 2024-09-12T16:17:47.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.496 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:47.496 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288937+0000", 2024-09-12T16:17:47.496 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4540000000000001e-06 2024-09-12T16:17:47.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.496 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:47.496 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288944+0000", 2024-09-12T16:17:47.496 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4980000000000003e-06 2024-09-12T16:17:47.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.496 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:47.497 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288949+0000", 2024-09-12T16:17:47.497 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1399999999999999e-06 2024-09-12T16:17:47.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.497 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:47.497 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327944+0000", 2024-09-12T16:17:47.497 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038994859999999999 2024-09-12T16:17:47.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.497 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:47.497 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327952+0000", 2024-09-12T16:17:47.497 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8660000000000006e-06 2024-09-12T16:17:47.497 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.497 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:47.498 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.498 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.498 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:47.498 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:47.499 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:17:47.500 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:47.499+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:47.599 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:47.599+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:47.648 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:47.648 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:47.648 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:17:47.648 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:47.656 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:17:47.700 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:47.699+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:47.801 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:47.800+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:47.804 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:47.804 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:47.804 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:17:47.804 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:17:47.804 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:47.813 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:17:47.902 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:47.902+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:47.921 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:47.921 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:17:47.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:17:47.921 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:17:47.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.921 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2213 3.18 3:1944e921:::rbd_data.1155ccb1894c.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:47.921 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:17:47.921 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 50.544323532999996, 2024-09-12T16:17:47.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.055657836000000002, 2024-09-12T16:17:47.922 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:47.922 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:47.922 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:47.922 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:47.922 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:17:47.922 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:17:47.922 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2213 2024-09-12T16:17:47.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.922 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:47.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:47.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:17:47.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:47.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:17:47.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:47.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375351+0000", 2024-09-12T16:17:47.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.556e-06 2024-09-12T16:17:47.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:47.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.399989+0000", 2024-09-12T16:17:47.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024637949999999999 2024-09-12T16:17:47.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.924 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:47.924 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400038+0000", 2024-09-12T16:17:47.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9187999999999997e-05 2024-09-12T16:17:47.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.924 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:47.924 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400056+0000", 2024-09-12T16:17:47.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8451e-05 2024-09-12T16:17:47.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:47.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400151+0000", 2024-09-12T16:17:47.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5026999999999997e-05 2024-09-12T16:17:47.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:47.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400345+0000", 2024-09-12T16:17:47.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019352900000000001 2024-09-12T16:17:47.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 1", 2024-09-12T16:17:47.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.401319+0000", 2024-09-12T16:17:47.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00097419399999999995 2024-09-12T16:17:47.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:17:47.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.429350+0000", 2024-09-12T16:17:47.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028030607999999999 2024-09-12T16:17:47.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:47.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.430907+0000", 2024-09-12T16:17:47.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001557466 2024-09-12T16:17:47.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:17:47.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.430966+0000", 2024-09-12T16:17:47.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9437e-05 2024-09-12T16:17:47.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:47.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.431007+0000", 2024-09-12T16:17:47.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0429999999999997e-05 2024-09-12T16:17:47.927 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.927 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:47.927 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.927 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6725 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2392064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:47.928 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.557452+0000", 2024-09-12T16:17:47.928 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.362220866999998, 2024-09-12T16:17:47.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045294112999999997, 2024-09-12T16:17:47.928 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:47.928 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:47.928 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:47.928 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:47.928 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:47.928 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:47.928 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6725 2024-09-12T16:17:47.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.928 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:47.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.929 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:47.929 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557452+0000", 2024-09-12T16:17:47.929 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.929 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:47.929 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557452+0000", 2024-09-12T16:17:47.929 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.929 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:47.929 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557693+0000", 2024-09-12T16:17:47.929 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024098699999999999 2024-09-12T16:17:47.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:47.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557697+0000", 2024-09-12T16:17:47.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8489999999999999e-06 2024-09-12T16:17:47.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:47.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557707+0000", 2024-09-12T16:17:47.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0356999999999999e-05 2024-09-12T16:17:47.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:47.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557714+0000", 2024-09-12T16:17:47.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0219999999999999e-06 2024-09-12T16:17:47.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:47.931 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.602612+0000", 2024-09-12T16:17:47.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044897907000000001 2024-09-12T16:17:47.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:47.931 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.602683+0000", 2024-09-12T16:17:47.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1171e-05 2024-09-12T16:17:47.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:47.931 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.602746+0000", 2024-09-12T16:17:47.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2819999999999998e-05 2024-09-12T16:17:47.932 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.932 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:47.932 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.932 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6727 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2422784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:47.932 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.557749+0000", 2024-09-12T16:17:47.932 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.361923267999998, 2024-09-12T16:17:47.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045329659000000001, 2024-09-12T16:17:47.932 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:47.932 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:47.932 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:47.932 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:47.932 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:47.932 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:47.933 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6727 2024-09-12T16:17:47.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.933 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:47.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:47.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557749+0000", 2024-09-12T16:17:47.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:47.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557749+0000", 2024-09-12T16:17:47.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:47.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557750+0000", 2024-09-12T16:17:47.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6600000000000002e-07 2024-09-12T16:17:47.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:47.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557752+0000", 2024-09-12T16:17:47.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.278e-06 2024-09-12T16:17:47.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:47.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557759+0000", 2024-09-12T16:17:47.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7329999999999997e-06 2024-09-12T16:17:47.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.935 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:47.935 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557764+0000", 2024-09-12T16:17:47.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0390000000000004e-06 2024-09-12T16:17:47.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.935 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:47.935 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.602943+0000", 2024-09-12T16:17:47.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045179035999999999 2024-09-12T16:17:47.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.935 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:47.935 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603016+0000", 2024-09-12T16:17:47.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2999999999999999e-05 2024-09-12T16:17:47.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.936 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:47.936 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603079+0000", 2024-09-12T16:17:47.936 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3107000000000004e-05 2024-09-12T16:17:47.936 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.936 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:47.936 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.936 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6728 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2439168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:47.936 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.557771+0000", 2024-09-12T16:17:47.936 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.361901392, 2024-09-12T16:17:47.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045474239, 2024-09-12T16:17:47.937 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:47.937 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:47.937 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:47.937 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:47.937 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:47.937 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:47.937 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6728 2024-09-12T16:17:47.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.937 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:47.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:47.937 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557771+0000", 2024-09-12T16:17:47.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:47.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557771+0000", 2024-09-12T16:17:47.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:47.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557772+0000", 2024-09-12T16:17:47.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5400000000000002e-07 2024-09-12T16:17:47.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:47.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557774+0000", 2024-09-12T16:17:47.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.165e-06 2024-09-12T16:17:47.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:47.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557782+0000", 2024-09-12T16:17:47.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3289999999999994e-06 2024-09-12T16:17:47.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:47.940 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557787+0000", 2024-09-12T16:17:47.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1909999999999999e-06 2024-09-12T16:17:47.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:47.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603110+0000", 2024-09-12T16:17:47.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045322710000000002 2024-09-12T16:17:47.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.941 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:47.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603182+0000", 2024-09-12T16:17:47.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1755999999999995e-05 2024-09-12T16:17:47.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.941 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:47.942 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603245+0000", 2024-09-12T16:17:47.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3633999999999994e-05 2024-09-12T16:17:47.942 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.942 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:47.942 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.943 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6729 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2454528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:47.943 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.557794+0000", 2024-09-12T16:17:47.943 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.361878611000002, 2024-09-12T16:17:47.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045614517, 2024-09-12T16:17:47.943 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:47.943 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:47.943 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:47.943 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:47.943 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:47.943 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:47.944 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6729 2024-09-12T16:17:47.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.944 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:47.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:47.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557794+0000", 2024-09-12T16:17:47.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:47.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557794+0000", 2024-09-12T16:17:47.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:47.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557879+0000", 2024-09-12T16:17:47.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5130000000000007e-05 2024-09-12T16:17:47.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:47.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557884+0000", 2024-09-12T16:17:47.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2390000000000002e-06 2024-09-12T16:17:47.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:47.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557894+0000", 2024-09-12T16:17:47.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4800000000000007e-06 2024-09-12T16:17:47.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:47.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557900+0000", 2024-09-12T16:17:47.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5610000000000004e-06 2024-09-12T16:17:47.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:47.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603273+0000", 2024-09-12T16:17:47.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045372799999999998 2024-09-12T16:17:47.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:47.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603345+0000", 2024-09-12T16:17:47.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1562000000000004e-05 2024-09-12T16:17:47.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:47.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603408+0000", 2024-09-12T16:17:47.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3744999999999994e-05 2024-09-12T16:17:47.948 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.948 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:47.948 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.948 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6730 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2469888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:47.948 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.557911+0000", 2024-09-12T16:17:47.948 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.361761213999998, 2024-09-12T16:17:47.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045661090000000001, 2024-09-12T16:17:47.948 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:47.948 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:47.948 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:47.948 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:47.949 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:47.949 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:47.949 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6730 2024-09-12T16:17:47.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.949 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:47.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:47.949 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557911+0000", 2024-09-12T16:17:47.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:47.949 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557911+0000", 2024-09-12T16:17:47.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:47.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557912+0000", 2024-09-12T16:17:47.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8299999999999997e-07 2024-09-12T16:17:47.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:47.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557914+0000", 2024-09-12T16:17:47.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.531e-06 2024-09-12T16:17:47.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:47.951 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557927+0000", 2024-09-12T16:17:47.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2685e-05 2024-09-12T16:17:47.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.951 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:47.951 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557932+0000", 2024-09-12T16:17:47.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3020000000000002e-06 2024-09-12T16:17:47.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.951 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:47.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603436+0000", 2024-09-12T16:17:47.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045503210000000002 2024-09-12T16:17:47.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:47.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603508+0000", 2024-09-12T16:17:47.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2792000000000004e-05 2024-09-12T16:17:47.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:47.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603572+0000", 2024-09-12T16:17:47.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4086999999999998e-05 2024-09-12T16:17:47.953 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.953 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:47.953 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.953 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6731 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2485248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:47.953 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.557942+0000", 2024-09-12T16:17:47.953 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.361731014, 2024-09-12T16:17:47.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045794662, 2024-09-12T16:17:47.953 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:47.953 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:47.953 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:47.954 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:47.954 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:47.954 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:47.954 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6731 2024-09-12T16:17:47.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.954 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:47.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:47.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557942+0000", 2024-09-12T16:17:47.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:47.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557942+0000", 2024-09-12T16:17:47.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:47.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559076+0000", 2024-09-12T16:17:47.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011348280000000001 2024-09-12T16:17:47.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:47.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559081+0000", 2024-09-12T16:17:47.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6820000000000002e-06 2024-09-12T16:17:47.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:47.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559089+0000", 2024-09-12T16:17:47.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0469999999999994e-06 2024-09-12T16:17:47.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:47.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559095+0000", 2024-09-12T16:17:47.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.212e-06 2024-09-12T16:17:47.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:47.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603601+0000", 2024-09-12T16:17:47.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044505321 2024-09-12T16:17:47.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:47.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603675+0000", 2024-09-12T16:17:47.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4455000000000005e-05 2024-09-12T16:17:47.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:47.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603736+0000", 2024-09-12T16:17:47.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1117000000000005e-05 2024-09-12T16:17:47.957 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.957 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:47.957 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.958 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6735 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2547712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:47.958 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.559184+0000", 2024-09-12T16:17:47.958 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.360488167, 2024-09-12T16:17:47.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045228008, 2024-09-12T16:17:47.958 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:47.958 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:47.958 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:47.958 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:47.958 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:47.958 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:47.958 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6735 2024-09-12T16:17:47.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.959 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:47.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:47.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559184+0000", 2024-09-12T16:17:47.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:47.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559184+0000", 2024-09-12T16:17:47.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:47.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559185+0000", 2024-09-12T16:17:47.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8100000000000003e-07 2024-09-12T16:17:47.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:47.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559187+0000", 2024-09-12T16:17:47.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9309999999999998e-06 2024-09-12T16:17:47.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:47.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559193+0000", 2024-09-12T16:17:47.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3629999999999999e-06 2024-09-12T16:17:47.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:47.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559200+0000", 2024-09-12T16:17:47.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6950000000000003e-06 2024-09-12T16:17:47.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:47.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604265+0000", 2024-09-12T16:17:47.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045064924999999999 2024-09-12T16:17:47.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:47.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604344+0000", 2024-09-12T16:17:47.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8830000000000002e-05 2024-09-12T16:17:47.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.963 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:47.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604412+0000", 2024-09-12T16:17:47.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8683000000000006e-05 2024-09-12T16:17:47.963 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.963 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:47.964 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.964 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6736 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2564096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:47.964 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.559207+0000", 2024-09-12T16:17:47.964 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.360465204, 2024-09-12T16:17:47.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045365924000000002, 2024-09-12T16:17:47.964 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:47.964 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:47.965 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:47.965 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:47.965 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:47.965 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:47.965 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6736 2024-09-12T16:17:47.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.965 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:47.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:47.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559207+0000", 2024-09-12T16:17:47.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:47.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559207+0000", 2024-09-12T16:17:47.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:47.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559208+0000", 2024-09-12T16:17:47.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6800000000000001e-07 2024-09-12T16:17:47.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:47.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559210+0000", 2024-09-12T16:17:47.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0490000000000002e-06 2024-09-12T16:17:47.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:47.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559218+0000", 2024-09-12T16:17:47.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7510000000000008e-06 2024-09-12T16:17:47.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:47.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559223+0000", 2024-09-12T16:17:47.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1229999999999999e-06 2024-09-12T16:17:47.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:47.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604440+0000", 2024-09-12T16:17:47.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045217599999999997 2024-09-12T16:17:47.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:47.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604512+0000", 2024-09-12T16:17:47.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1909000000000006e-05 2024-09-12T16:17:47.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:47.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604573+0000", 2024-09-12T16:17:47.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1023999999999997e-05 2024-09-12T16:17:47.969 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.969 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:47.969 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.969 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6737 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2579456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:47.970 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.559229+0000", 2024-09-12T16:17:47.970 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.360443078000003, 2024-09-12T16:17:47.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045505640999999999, 2024-09-12T16:17:47.970 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:47.970 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:47.970 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:47.970 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:47.970 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:47.970 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:47.970 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6737 2024-09-12T16:17:47.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.970 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:47.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:47.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559229+0000", 2024-09-12T16:17:47.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:47.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559229+0000", 2024-09-12T16:17:47.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:47.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559230+0000", 2024-09-12T16:17:47.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1399999999999997e-07 2024-09-12T16:17:47.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:47.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559232+0000", 2024-09-12T16:17:47.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8360000000000001e-06 2024-09-12T16:17:47.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:47.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559238+0000", 2024-09-12T16:17:47.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2360000000000001e-06 2024-09-12T16:17:47.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:47.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559242+0000", 2024-09-12T16:17:47.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4390000000000002e-06 2024-09-12T16:17:47.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:47.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604599+0000", 2024-09-12T16:17:47.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045356527000000001 2024-09-12T16:17:47.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:47.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604669+0000", 2024-09-12T16:17:47.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0442000000000001e-05 2024-09-12T16:17:47.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:47.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604735+0000", 2024-09-12T16:17:47.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5647000000000004e-05 2024-09-12T16:17:47.974 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.974 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:47.974 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.975 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6738 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2594816~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:47.975 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.559250+0000", 2024-09-12T16:17:47.975 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.360422215, 2024-09-12T16:17:47.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045646834999999997, 2024-09-12T16:17:47.975 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:47.975 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:47.975 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:47.975 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:47.975 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:47.975 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:47.975 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6738 2024-09-12T16:17:47.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.975 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:47.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:47.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559250+0000", 2024-09-12T16:17:47.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:47.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559250+0000", 2024-09-12T16:17:47.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:47.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559251+0000", 2024-09-12T16:17:47.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1699999999999999e-07 2024-09-12T16:17:47.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:47.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559253+0000", 2024-09-12T16:17:47.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2910000000000002e-06 2024-09-12T16:17:47.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:47.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559260+0000", 2024-09-12T16:17:47.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2200000000000003e-06 2024-09-12T16:17:47.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:47.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559265+0000", 2024-09-12T16:17:47.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2050000000000001e-06 2024-09-12T16:17:47.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:47.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604763+0000", 2024-09-12T16:17:47.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045497964000000002 2024-09-12T16:17:47.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:47.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604835+0000", 2024-09-12T16:17:47.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1705000000000005e-05 2024-09-12T16:17:47.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:47.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604897+0000", 2024-09-12T16:17:47.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2032999999999994e-05 2024-09-12T16:17:47.979 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.979 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:47.979 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.979 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6739 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2610176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:47.979 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.559273+0000", 2024-09-12T16:17:47.980 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.360399397000002, 2024-09-12T16:17:47.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.04579105, 2024-09-12T16:17:47.980 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:47.980 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:47.980 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:47.980 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:47.980 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:47.980 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:47.980 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6739 2024-09-12T16:17:47.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.980 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:47.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:47.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559273+0000", 2024-09-12T16:17:47.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:47.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559273+0000", 2024-09-12T16:17:47.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:47.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559273+0000", 2024-09-12T16:17:47.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3299999999999998e-07 2024-09-12T16:17:47.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:47.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559276+0000", 2024-09-12T16:17:47.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1490000000000001e-06 2024-09-12T16:17:47.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:47.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559282+0000", 2024-09-12T16:17:47.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3199999999999996e-06 2024-09-12T16:17:47.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:47.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559288+0000", 2024-09-12T16:17:47.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.942e-06 2024-09-12T16:17:47.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:47.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604929+0000", 2024-09-12T16:17:47.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045641317000000001 2024-09-12T16:17:47.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:47.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.605001+0000", 2024-09-12T16:17:47.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1581000000000005e-05 2024-09-12T16:17:47.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:47.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.605064+0000", 2024-09-12T16:17:47.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3408e-05 2024-09-12T16:17:47.983 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.984 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:47.984 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.984 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6977 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2377728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:47.984 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.566114+0000", 2024-09-12T16:17:47.984 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.353558288000002, 2024-09-12T16:17:47.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045737673999999999, 2024-09-12T16:17:47.984 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:47.984 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:47.984 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:47.984 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:47.985 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:47.985 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:47.985 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6977 2024-09-12T16:17:47.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.985 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:47.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:47.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566114+0000", 2024-09-12T16:17:47.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:47.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566114+0000", 2024-09-12T16:17:47.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:47.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566115+0000", 2024-09-12T16:17:47.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.71e-07 2024-09-12T16:17:47.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:47.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566119+0000", 2024-09-12T16:17:47.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2749999999999997e-06 2024-09-12T16:17:47.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:47.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566128+0000", 2024-09-12T16:17:47.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9490000000000002e-06 2024-09-12T16:17:47.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:47.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566135+0000", 2024-09-12T16:17:47.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3459999999999999e-06 2024-09-12T16:17:47.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:47.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.610416+0000", 2024-09-12T16:17:47.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044281686000000001 2024-09-12T16:17:47.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:47.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.610536+0000", 2024-09-12T16:17:47.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000119412 2024-09-12T16:17:47.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:47.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.611852+0000", 2024-09-12T16:17:47.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001316135 2024-09-12T16:17:47.988 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.988 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:47.988 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.989 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6986 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2518016~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:47.989 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.566890+0000", 2024-09-12T16:17:47.989 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.352782365000003, 2024-09-12T16:17:47.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045234719999999999, 2024-09-12T16:17:47.989 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:47.989 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:47.989 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:47.989 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:47.989 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:47.989 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:47.989 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6986 2024-09-12T16:17:47.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.990 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:47.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:47.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566890+0000", 2024-09-12T16:17:47.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:47.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566890+0000", 2024-09-12T16:17:47.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:47.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566891+0000", 2024-09-12T16:17:47.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2799999999999995e-07 2024-09-12T16:17:47.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:47.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566895+0000", 2024-09-12T16:17:47.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8179999999999997e-06 2024-09-12T16:17:47.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:47.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566904+0000", 2024-09-12T16:17:47.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5179999999999993e-06 2024-09-12T16:17:47.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:47.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566911+0000", 2024-09-12T16:17:47.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1640000000000004e-06 2024-09-12T16:17:47.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:47.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.611985+0000", 2024-09-12T16:17:47.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045073545999999999 2024-09-12T16:17:47.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:47.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612061+0000", 2024-09-12T16:17:47.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5617999999999993e-05 2024-09-12T16:17:47.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:47.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612125+0000", 2024-09-12T16:17:47.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4327999999999998e-05 2024-09-12T16:17:47.993 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.993 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:47.993 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.993 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6987 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2533376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:47.993 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.566982+0000", 2024-09-12T16:17:47.994 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.352690344999999, 2024-09-12T16:17:47.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045308858, 2024-09-12T16:17:47.994 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:47.994 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:47.994 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:47.994 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:47.994 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:47.994 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:47.994 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6987 2024-09-12T16:17:47.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.994 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:47.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:47.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566982+0000", 2024-09-12T16:17:47.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:47.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566982+0000", 2024-09-12T16:17:47.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:47.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:47.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566983+0000", 2024-09-12T16:17:47.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2500000000000005e-07 2024-09-12T16:17:47.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:47.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566986+0000", 2024-09-12T16:17:47.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3000000000000002e-06 2024-09-12T16:17:47.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:47.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566995+0000", 2024-09-12T16:17:47.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8419999999999994e-06 2024-09-12T16:17:47.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:47.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567001+0000", 2024-09-12T16:17:47.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.161e-06 2024-09-12T16:17:47.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:47.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612154+0000", 2024-09-12T16:17:47.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045152858999999997 2024-09-12T16:17:47.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:47.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612229+0000", 2024-09-12T16:17:47.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4958999999999998e-05 2024-09-12T16:17:47.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:47.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612291+0000", 2024-09-12T16:17:47.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2012000000000002e-05 2024-09-12T16:17:47.998 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.998 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:47.998 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:47.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.998 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6988 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2548736~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:47.998 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.567055+0000", 2024-09-12T16:17:47.998 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.352617879, 2024-09-12T16:17:47.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045400078000000003, 2024-09-12T16:17:47.998 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:47.999 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:47.999 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:47.999 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:47.999 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:47.999 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:47.999 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6988 2024-09-12T16:17:47.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:47.999 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:47.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:47.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:47.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567055+0000", 2024-09-12T16:17:48.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:48.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:48.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567055+0000", 2024-09-12T16:17:48.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:48.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:48.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567055+0000", 2024-09-12T16:17:48.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3e-07 2024-09-12T16:17:48.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:48.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567059+0000", 2024-09-12T16:17:48.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4510000000000001e-06 2024-09-12T16:17:48.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:48.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567070+0000", 2024-09-12T16:17:48.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1477e-05 2024-09-12T16:17:48.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:48.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567077+0000", 2024-09-12T16:17:48.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7880000000000001e-06 2024-09-12T16:17:48.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:48.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612320+0000", 2024-09-12T16:17:48.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045242544000000003 2024-09-12T16:17:48.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:48.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612394+0000", 2024-09-12T16:17:48.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3854000000000001e-05 2024-09-12T16:17:48.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:48.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612455+0000", 2024-09-12T16:17:48.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1234000000000004e-05 2024-09-12T16:17:48.003 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:48.003 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:48.003 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:48.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.003 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6989 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2565120~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:48.003 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.567103+0000", 2024-09-12T16:17:48.003 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.352569072999998, 2024-09-12T16:17:48.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045514760000000001, 2024-09-12T16:17:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6989 2024-09-12T16:17:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567103+0000", 2024-09-12T16:17:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567103+0000", 2024-09-12T16:17:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567104+0000", 2024-09-12T16:17:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6400000000000002e-07 2024-09-12T16:17:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567107+0000", 2024-09-12T16:17:48.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.038e-06 2024-09-12T16:17:48.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:48.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567117+0000", 2024-09-12T16:17:48.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0244999999999999e-05 2024-09-12T16:17:48.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:48.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567124+0000", 2024-09-12T16:17:48.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1469999999999998e-06 2024-09-12T16:17:48.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612483+0000", 2024-09-12T16:17:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045359099999999999 2024-09-12T16:17:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612556+0000", 2024-09-12T16:17:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2948999999999996e-05 2024-09-12T16:17:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612618+0000", 2024-09-12T16:17:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2617e-05 2024-09-12T16:17:48.008 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:48.008 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:48.008 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:48.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.008 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6990 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2580480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:48.008 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.567155+0000", 2024-09-12T16:17:48.008 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.352517835999997, 2024-09-12T16:17:48.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045665681999999999, 2024-09-12T16:17:48.008 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:48.009 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:48.009 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:48.009 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:48.009 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:48.009 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:48.009 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6990 2024-09-12T16:17:48.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.009 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:48.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:48.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567155+0000", 2024-09-12T16:17:48.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:48.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:48.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567155+0000", 2024-09-12T16:17:48.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:48.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:48.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567155+0000", 2024-09-12T16:17:48.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5700000000000002e-07 2024-09-12T16:17:48.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:48.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567159+0000", 2024-09-12T16:17:48.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1729999999999999e-06 2024-09-12T16:17:48.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:48.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567167+0000", 2024-09-12T16:17:48.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3469999999999999e-06 2024-09-12T16:17:48.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567173+0000", 2024-09-12T16:17:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0719999999999996e-06 2024-09-12T16:17:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612651+0000", 2024-09-12T16:17:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045478078999999998 2024-09-12T16:17:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612741+0000", 2024-09-12T16:17:48.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0435999999999999e-05 2024-09-12T16:17:48.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:48.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612820+0000", 2024-09-12T16:17:48.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8918000000000006e-05 2024-09-12T16:17:48.013 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:48.013 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:48.013 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:48.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6991 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2595840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.567220+0000", 2024-09-12T16:17:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.352452827999997, 2024-09-12T16:17:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045811022999999999, 2024-09-12T16:17:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6991 2024-09-12T16:17:48.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.015 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:48.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:48.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567220+0000", 2024-09-12T16:17:48.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:48.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:48.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567220+0000", 2024-09-12T16:17:48.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:48.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.016 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:48.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567221+0000", 2024-09-12T16:17:48.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.16e-07 2024-09-12T16:17:48.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.016 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:48.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567225+0000", 2024-09-12T16:17:48.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3950000000000003e-06 2024-09-12T16:17:48.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:48.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567243+0000", 2024-09-12T16:17:48.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7734999999999999e-05 2024-09-12T16:17:48.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:48.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567253+0000", 2024-09-12T16:17:48.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7540000000000001e-06 2024-09-12T16:17:48.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:48.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612854+0000", 2024-09-12T16:17:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045601227000000001 2024-09-12T16:17:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612950+0000", 2024-09-12T16:17:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6121999999999999e-05 2024-09-12T16:17:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.613031+0000", 2024-09-12T16:17:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0873999999999999e-05 2024-09-12T16:17:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6992 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2611200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.567349+0000", 2024-09-12T16:17:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.352323071999997, 2024-09-12T16:17:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045848710000000001, 2024-09-12T16:17:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6992 2024-09-12T16:17:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.020 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:48.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:48.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567349+0000", 2024-09-12T16:17:48.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:48.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:48.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567349+0000", 2024-09-12T16:17:48.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:48.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567350+0000", 2024-09-12T16:17:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8899999999999998e-07 2024-09-12T16:17:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567354+0000", 2024-09-12T16:17:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0130000000000004e-06 2024-09-12T16:17:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567364+0000", 2024-09-12T16:17:48.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0158e-05 2024-09-12T16:17:48.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:48.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567369+0000", 2024-09-12T16:17:48.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4839999999999998e-06 2024-09-12T16:17:48.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:48.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.613072+0000", 2024-09-12T16:17:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045703195000000002 2024-09-12T16:17:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.613156+0000", 2024-09-12T16:17:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3591999999999995e-05 2024-09-12T16:17:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.613198+0000", 2024-09-12T16:17:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2478999999999998e-05 2024-09-12T16:17:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:48.024 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:48.024 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:48.024 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:48.025 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:17:48.026 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:48.024+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:48.125 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:48.124+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:48.145 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:48.145 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:17:48.145 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.145 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5832.0:1710 3.f 3.84be9b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-12T16:17:48.145 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:17:48.145 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.76080700099999998, 2024-09-12T16:17:48.145 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.76082591499999996, 2024-09-12T16:17:48.145 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:48.145 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:48.145 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "waiting for peered", 2024-09-12T16:17:48.145 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:48.146 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5832", 2024-09-12T16:17:48.146 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/201125203", 2024-09-12T16:17:48.146 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1710 2024-09-12T16:17:48.146 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.146 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:48.146 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.146 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:48.146 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:17:48.146 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.146 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.146 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.146 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:48.146 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:17:48.146 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.147 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.147 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.147 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:48.147 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:17:48.147 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.08e-07 2024-09-12T16:17:48.147 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.147 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.147 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:48.147 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383990+0000", 2024-09-12T16:17:48.147 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.979e-06 2024-09-12T16:17:48.147 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.147 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.147 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:48.147 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383999+0000", 2024-09-12T16:17:48.148 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3240000000000003e-06 2024-09-12T16:17:48.148 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.148 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.148 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:48.148 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.384002+0000", 2024-09-12T16:17:48.148 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5489999999999998e-06 2024-09-12T16:17:48.148 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.148 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.148 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:48.148 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.384037+0000", 2024-09-12T16:17:48.148 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4931000000000001e-05 2024-09-12T16:17:48.148 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.148 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.149 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:17:48.149 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.384043+0000", 2024-09-12T16:17:48.149 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3920000000000002e-06 2024-09-12T16:17:48.149 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.149 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.149 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:48.149 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:48.007976+0000", 2024-09-12T16:17:48.149 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.62393385300000004 2024-09-12T16:17:48.149 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.149 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.150 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:17:48.150 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:48.007992+0000", 2024-09-12T16:17:48.150 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5668e-05 2024-09-12T16:17:48.150 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.150 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:48.150 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.150 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.150 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-12T16:17:48.150 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 1 2024-09-12T16:17:48.150 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:48.154 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:17:48.238 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:48.237+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:48.303 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:48.303 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:48.303 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:17:48.303 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:17:48.303 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:48.311 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:17:48.326 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:48.326+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:48.427 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:48.426+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:48.461 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:48.465 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:17:48.465 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:17:48.465 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:17:48.465 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.465 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:17:48.465 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:17:48.465 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 126.695303298, 2024-09-12T16:17:48.465 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55645454900000002, 2024-09-12T16:17:48.465 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:48.465 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:48.466 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:48.466 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:48.466 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:17:48.466 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:17:48.466 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1 2024-09-12T16:17:48.466 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.466 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:48.466 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.466 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:48.466 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:17:48.466 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.466 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.466 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.466 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:48.466 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:17:48.467 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.467 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.467 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.467 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:48.467 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764440+0000", 2024-09-12T16:17:48.467 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6249999999999999e-06 2024-09-12T16:17:48.467 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.467 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.467 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:48.467 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764447+0000", 2024-09-12T16:17:48.467 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4939999999999997e-06 2024-09-12T16:17:48.467 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.467 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.467 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:48.468 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764459+0000", 2024-09-12T16:17:48.468 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1517e-05 2024-09-12T16:17:48.468 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.468 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.468 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:48.468 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764468+0000", 2024-09-12T16:17:48.468 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7690000000000002e-06 2024-09-12T16:17:48.468 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.468 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.468 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:48.468 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764539+0000", 2024-09-12T16:17:48.468 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1103e-05 2024-09-12T16:17:48.469 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.469 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.469 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:17:48.469 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764551+0000", 2024-09-12T16:17:48.469 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2687999999999999e-05 2024-09-12T16:17:48.469 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.469 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.469 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:48.469 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319497+0000", 2024-09-12T16:17:48.469 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55494560500000001 2024-09-12T16:17:48.470 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.470 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.470 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:48.470 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319688+0000", 2024-09-12T16:17:48.470 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019105599999999999 2024-09-12T16:17:48.470 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.470 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.470 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:17:48.470 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319842+0000", 2024-09-12T16:17:48.470 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015377699999999999 2024-09-12T16:17:48.470 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.470 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.470 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:17:48.471 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320473+0000", 2024-09-12T16:17:48.471 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00063117100000000003 2024-09-12T16:17:48.471 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.471 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.471 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:48.471 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320825+0000", 2024-09-12T16:17:48.471 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00035202500000000001 2024-09-12T16:17:48.471 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.471 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.471 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:48.471 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320867+0000", 2024-09-12T16:17:48.471 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2005000000000002e-05 2024-09-12T16:17:48.471 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.472 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.472 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:48.472 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320893+0000", 2024-09-12T16:17:48.472 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5714000000000001e-05 2024-09-12T16:17:48.472 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.472 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:48.472 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.472 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.472 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.472 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14034 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5035008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:48.472 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:17:48.472 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 88.938245065000004, 2024-09-12T16:17:48.473 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053404082999999998, 2024-09-12T16:17:48.473 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:48.473 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:48.473 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:48.473 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:48.473 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:48.473 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:48.474 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14034 2024-09-12T16:17:48.474 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.474 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:48.474 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.474 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:48.474 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:17:48.474 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.474 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.474 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.475 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:48.475 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:17:48.475 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.475 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.475 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.475 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:48.475 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521740+0000", 2024-09-12T16:17:48.475 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000243976 2024-09-12T16:17:48.475 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.475 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.475 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:48.475 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521745+0000", 2024-09-12T16:17:48.475 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1280000000000001e-06 2024-09-12T16:17:48.475 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.476 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.476 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:48.476 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521757+0000", 2024-09-12T16:17:48.476 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2751e-05 2024-09-12T16:17:48.476 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.476 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.476 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:48.476 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521771+0000", 2024-09-12T16:17:48.476 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3328e-05 2024-09-12T16:17:48.476 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.476 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.476 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:48.476 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574710+0000", 2024-09-12T16:17:48.476 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052939358999999998 2024-09-12T16:17:48.476 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.477 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.477 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:48.477 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574799+0000", 2024-09-12T16:17:48.477 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8893000000000004e-05 2024-09-12T16:17:48.477 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.477 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.477 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:48.477 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574901+0000", 2024-09-12T16:17:48.477 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101648 2024-09-12T16:17:48.477 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.477 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:48.477 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.478 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.478 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.478 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14036 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5043200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:48.478 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:17:48.478 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 88.937785871000003, 2024-09-12T16:17:48.478 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053426247000000003, 2024-09-12T16:17:48.478 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:48.478 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:48.478 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:48.478 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:48.478 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:48.478 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:48.479 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14036 2024-09-12T16:17:48.479 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.479 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:48.479 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.479 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:48.479 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:17:48.479 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.479 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.479 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.479 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:48.479 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:17:48.479 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.479 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.479 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.480 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:48.480 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522208+0000", 2024-09-12T16:17:48.480 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025195300000000002 2024-09-12T16:17:48.480 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.480 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.480 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:48.480 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522211+0000", 2024-09-12T16:17:48.480 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2160000000000002e-06 2024-09-12T16:17:48.480 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.480 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.480 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:48.480 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522223+0000", 2024-09-12T16:17:48.481 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2044e-05 2024-09-12T16:17:48.481 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.481 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.481 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:48.481 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522229+0000", 2024-09-12T16:17:48.481 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8850000000000004e-06 2024-09-12T16:17:48.481 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.481 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.481 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:48.481 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575192+0000", 2024-09-12T16:17:48.481 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052963573 2024-09-12T16:17:48.481 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.481 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.481 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:48.482 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575282+0000", 2024-09-12T16:17:48.482 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9666000000000005e-05 2024-09-12T16:17:48.482 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.482 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.482 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:48.482 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575382+0000", 2024-09-12T16:17:48.482 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9909999999999997e-05 2024-09-12T16:17:48.482 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.482 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:48.482 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.482 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.482 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.482 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14038 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5051392~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:48.482 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:17:48.483 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 88.937247498000005, 2024-09-12T16:17:48.483 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053395152000000001, 2024-09-12T16:17:48.483 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:48.483 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:48.483 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:48.483 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:48.483 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:48.483 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:48.483 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14038 2024-09-12T16:17:48.483 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.484 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:48.484 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.484 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:48.484 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:17:48.484 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.484 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.485 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.485 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:48.485 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522494+0000", 2024-09-12T16:17:48.485 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.485 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.485 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.486 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:48.486 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522601+0000", 2024-09-12T16:17:48.486 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010702899999999999 2024-09-12T16:17:48.486 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.486 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.486 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:48.486 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522605+0000", 2024-09-12T16:17:48.486 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2379999999999999e-06 2024-09-12T16:17:48.486 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.486 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.487 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:48.487 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522616+0000", 2024-09-12T16:17:48.487 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1185999999999999e-05 2024-09-12T16:17:48.487 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.487 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.487 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:48.487 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522624+0000", 2024-09-12T16:17:48.487 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1099999999999997e-06 2024-09-12T16:17:48.487 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.487 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.487 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:48.487 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575677+0000", 2024-09-12T16:17:48.487 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053126999999999 2024-09-12T16:17:48.488 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.488 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.488 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:48.488 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575764+0000", 2024-09-12T16:17:48.488 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7250000000000007e-05 2024-09-12T16:17:48.488 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.488 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.488 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:48.488 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575889+0000", 2024-09-12T16:17:48.488 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012521200000000001 2024-09-12T16:17:48.488 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.488 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:48.488 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.488 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.489 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.489 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14039 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5055488~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:48.489 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:17:48.489 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 88.937106087000004, 2024-09-12T16:17:48.489 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053466207000000002, 2024-09-12T16:17:48.489 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:48.489 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:48.489 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:48.489 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:48.489 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:48.489 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:48.489 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14039 2024-09-12T16:17:48.490 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.490 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:48.490 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.490 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:48.490 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:17:48.490 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.490 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.490 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.490 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:48.490 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:17:48.490 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.490 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.490 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.490 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:48.490 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522899+0000", 2024-09-12T16:17:48.491 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026318199999999999 2024-09-12T16:17:48.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.491 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.491 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:48.491 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522903+0000", 2024-09-12T16:17:48.491 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.929e-06 2024-09-12T16:17:48.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.491 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.491 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:48.491 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522913+0000", 2024-09-12T16:17:48.491 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0162e-05 2024-09-12T16:17:48.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.491 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.491 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:48.491 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522921+0000", 2024-09-12T16:17:48.492 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.14e-06 2024-09-12T16:17:48.492 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.492 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.492 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:48.492 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575922+0000", 2024-09-12T16:17:48.492 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053000712999999998 2024-09-12T16:17:48.492 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.492 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.492 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:48.492 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576006+0000", 2024-09-12T16:17:48.492 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4161999999999998e-05 2024-09-12T16:17:48.492 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.492 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.493 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:48.493 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576102+0000", 2024-09-12T16:17:48.493 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5919000000000001e-05 2024-09-12T16:17:48.493 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.493 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:48.493 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.493 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.493 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.493 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14040 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5059584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:48.493 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:17:48.493 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 88.936801192000004, 2024-09-12T16:17:48.493 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053413258999999998, 2024-09-12T16:17:48.493 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:48.493 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:48.494 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:48.494 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:48.494 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:48.494 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:48.494 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14040 2024-09-12T16:17:48.494 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.494 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:48.494 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.494 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:48.494 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:17:48.494 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.494 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.494 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.494 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:48.494 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:17:48.495 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.495 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.495 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.495 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:48.495 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523059+0000", 2024-09-12T16:17:48.495 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118466 2024-09-12T16:17:48.495 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.495 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.495 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:48.495 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523062+0000", 2024-09-12T16:17:48.495 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.971e-06 2024-09-12T16:17:48.495 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.495 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.496 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:48.496 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523069+0000", 2024-09-12T16:17:48.496 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8279999999999997e-06 2024-09-12T16:17:48.496 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.496 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.496 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:48.496 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523073+0000", 2024-09-12T16:17:48.496 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3019999999999996e-06 2024-09-12T16:17:48.496 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.496 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.496 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:48.496 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576155+0000", 2024-09-12T16:17:48.497 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053081962000000003 2024-09-12T16:17:48.497 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.497 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.497 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:48.497 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576249+0000", 2024-09-12T16:17:48.497 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3914999999999998e-05 2024-09-12T16:17:48.497 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.497 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.497 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:48.497 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576354+0000", 2024-09-12T16:17:48.497 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010481500000000001 2024-09-12T16:17:48.497 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.497 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:48.498 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.498 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.498 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.498 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14041 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5063680~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:48.498 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:17:48.498 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 88.936650886999999, 2024-09-12T16:17:48.498 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053519111000000001, 2024-09-12T16:17:48.498 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:48.498 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:48.498 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:48.498 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:48.498 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:48.498 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:48.499 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14041 2024-09-12T16:17:48.499 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.499 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:48.499 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.499 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:48.499 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:17:48.499 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.499 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.500 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.500 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:48.500 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:17:48.500 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.500 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.500 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.500 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:48.500 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523309+0000", 2024-09-12T16:17:48.500 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000218712 2024-09-12T16:17:48.500 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.500 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.500 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:48.500 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523313+0000", 2024-09-12T16:17:48.501 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.151e-06 2024-09-12T16:17:48.501 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.501 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.501 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:48.501 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523320+0000", 2024-09-12T16:17:48.501 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9789999999999993e-06 2024-09-12T16:17:48.501 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.501 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.502 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:48.502 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523325+0000", 2024-09-12T16:17:48.502 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:17:48.502 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.502 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.502 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:48.502 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576402+0000", 2024-09-12T16:17:48.502 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053076811000000002 2024-09-12T16:17:48.502 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.502 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.502 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:48.503 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576491+0000", 2024-09-12T16:17:48.503 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8578999999999993e-05 2024-09-12T16:17:48.503 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.503 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.503 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:48.503 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576610+0000", 2024-09-12T16:17:48.503 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119129 2024-09-12T16:17:48.503 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.503 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:48.503 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.503 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.503 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.503 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14042 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5067776~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:48.503 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:17:48.504 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 88.936407453000001, 2024-09-12T16:17:48.504 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053510350999999998, 2024-09-12T16:17:48.504 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:48.504 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:48.504 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:48.504 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:48.504 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:48.504 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:48.504 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14042 2024-09-12T16:17:48.504 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.504 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:48.504 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.504 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:48.505 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:17:48.505 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.505 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.505 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.505 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:48.505 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:17:48.505 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.505 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.505 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.505 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:48.505 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523591+0000", 2024-09-12T16:17:48.505 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025710300000000001 2024-09-12T16:17:48.505 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.505 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.506 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:48.506 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523594+0000", 2024-09-12T16:17:48.506 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2229999999999999e-06 2024-09-12T16:17:48.506 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.506 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.506 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:48.506 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523602+0000", 2024-09-12T16:17:48.506 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6930000000000007e-06 2024-09-12T16:17:48.506 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.506 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.506 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:48.506 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523607+0000", 2024-09-12T16:17:48.506 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4789999999999998e-06 2024-09-12T16:17:48.507 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.507 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.507 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:48.507 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576661+0000", 2024-09-12T16:17:48.507 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053973999999997 2024-09-12T16:17:48.507 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.507 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.507 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:48.507 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576745+0000", 2024-09-12T16:17:48.507 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4660000000000006e-05 2024-09-12T16:17:48.507 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.507 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.507 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:48.507 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576844+0000", 2024-09-12T16:17:48.508 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9219e-05 2024-09-12T16:17:48.508 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.508 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:48.508 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.508 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.509 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.509 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14043 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5071872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:48.509 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:17:48.509 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 88.936126974000004, 2024-09-12T16:17:48.509 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053475295999999999, 2024-09-12T16:17:48.510 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:48.510 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:48.510 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:48.510 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:48.510 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:48.510 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:48.511 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14043 2024-09-12T16:17:48.511 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.511 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:48.511 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.511 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:48.511 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:17:48.511 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.511 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.511 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.511 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:48.511 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:17:48.511 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.511 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.512 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.512 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:48.512 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523823+0000", 2024-09-12T16:17:48.512 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020818900000000001 2024-09-12T16:17:48.512 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.512 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.512 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:48.512 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523826+0000", 2024-09-12T16:17:48.512 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.405e-06 2024-09-12T16:17:48.512 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.512 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.512 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:48.512 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523834+0000", 2024-09-12T16:17:48.513 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5499999999999997e-06 2024-09-12T16:17:48.513 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.513 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.513 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:48.513 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523838+0000", 2024-09-12T16:17:48.513 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.408e-06 2024-09-12T16:17:48.513 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.513 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.513 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:48.513 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576904+0000", 2024-09-12T16:17:48.513 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053065687 2024-09-12T16:17:48.513 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.513 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.514 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:48.514 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576991+0000", 2024-09-12T16:17:48.514 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7399999999999997e-05 2024-09-12T16:17:48.514 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.514 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.514 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:48.514 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577090+0000", 2024-09-12T16:17:48.514 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8657000000000001e-05 2024-09-12T16:17:48.514 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.514 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:48.514 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.514 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.515 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.515 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14044 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5075968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:48.515 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:17:48.515 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 88.935895443999996, 2024-09-12T16:17:48.515 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053442659000000003, 2024-09-12T16:17:48.515 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:48.515 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:48.515 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:48.515 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:48.515 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:48.515 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:48.515 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14044 2024-09-12T16:17:48.515 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.516 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:48.516 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.516 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:48.516 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:17:48.516 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.516 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.516 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.516 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:48.517 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:17:48.517 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.517 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.517 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.517 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:48.517 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523985+0000", 2024-09-12T16:17:48.517 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000138522 2024-09-12T16:17:48.517 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.517 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.517 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:48.517 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523988+0000", 2024-09-12T16:17:48.517 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.788e-06 2024-09-12T16:17:48.518 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.518 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.518 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:48.518 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523998+0000", 2024-09-12T16:17:48.518 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8470000000000008e-06 2024-09-12T16:17:48.518 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.518 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.518 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:48.518 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524010+0000", 2024-09-12T16:17:48.518 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1348999999999999e-05 2024-09-12T16:17:48.518 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.518 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.518 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:48.518 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577137+0000", 2024-09-12T16:17:48.519 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053127055999999999 2024-09-12T16:17:48.519 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.519 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.519 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:48.519 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577210+0000", 2024-09-12T16:17:48.519 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3392000000000005e-05 2024-09-12T16:17:48.519 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.519 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.519 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:48.519 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577289+0000", 2024-09-12T16:17:48.519 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8704999999999999e-05 2024-09-12T16:17:48.519 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.519 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:48.520 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.520 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.520 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.520 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14045 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5080064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:48.520 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:17:48.520 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 88.935716623000005, 2024-09-12T16:17:48.520 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053497514000000003, 2024-09-12T16:17:48.520 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:48.520 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:48.520 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:48.520 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:48.520 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:48.520 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:48.520 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14045 2024-09-12T16:17:48.521 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.521 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:48.521 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.521 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:48.521 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:17:48.521 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.521 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.521 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.521 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:48.521 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:17:48.521 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.521 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.521 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.521 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:48.521 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524311+0000", 2024-09-12T16:17:48.522 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028626299999999998 2024-09-12T16:17:48.522 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.522 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.522 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:48.522 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524315+0000", 2024-09-12T16:17:48.522 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0969999999999999e-06 2024-09-12T16:17:48.522 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.522 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.522 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:48.522 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524325+0000", 2024-09-12T16:17:48.522 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6330000000000008e-06 2024-09-12T16:17:48.522 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.523 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.523 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:48.523 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524332+0000", 2024-09-12T16:17:48.523 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8700000000000003e-06 2024-09-12T16:17:48.523 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.523 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.523 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:48.523 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577334+0000", 2024-09-12T16:17:48.523 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053001834999999997 2024-09-12T16:17:48.523 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.523 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.523 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:48.523 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577420+0000", 2024-09-12T16:17:48.524 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6145999999999998e-05 2024-09-12T16:17:48.524 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.524 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.524 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:48.524 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577522+0000", 2024-09-12T16:17:48.524 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010267 2024-09-12T16:17:48.524 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.524 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:48.524 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.524 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.524 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.524 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14047 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5088256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:48.524 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:17:48.524 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 88.935230896999997, 2024-09-12T16:17:48.525 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053433340000000003, 2024-09-12T16:17:48.525 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:48.525 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:48.525 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:48.525 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:48.525 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:48.525 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:48.525 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14047 2024-09-12T16:17:48.525 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.525 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:48.525 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.525 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:48.525 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:17:48.526 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.526 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.526 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.526 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:48.526 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:17:48.526 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.526 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.526 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.526 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:48.526 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524727+0000", 2024-09-12T16:17:48.526 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000216126 2024-09-12T16:17:48.526 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.526 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.526 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:48.526 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524732+0000", 2024-09-12T16:17:48.527 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1569999999999999e-06 2024-09-12T16:17:48.527 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.527 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.527 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:48.527 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524742+0000", 2024-09-12T16:17:48.527 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0186999999999999e-05 2024-09-12T16:17:48.527 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.527 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.527 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:48.527 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524750+0000", 2024-09-12T16:17:48.527 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4279999999999999e-06 2024-09-12T16:17:48.527 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.527 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.527 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:48.527 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577743+0000", 2024-09-12T16:17:48.527 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052993077 2024-09-12T16:17:48.528 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.528 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.528 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:48.528 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577841+0000", 2024-09-12T16:17:48.528 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8369000000000006e-05 2024-09-12T16:17:48.528 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.528 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.528 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:48.528 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577944+0000", 2024-09-12T16:17:48.528 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102996 2024-09-12T16:17:48.528 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.528 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:48.528 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.528 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.529 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.529 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14048 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5092352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:48.529 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:17:48.529 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 88.934979303999995, 2024-09-12T16:17:48.529 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053397515, 2024-09-12T16:17:48.529 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:48.529 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:48.529 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:48.529 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:48.529 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:48.529 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:48.529 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14048 2024-09-12T16:17:48.529 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.529 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:48.530 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.530 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:48.530 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:17:48.530 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.530 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.530 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.530 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:48.530 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:17:48.530 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.530 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.530 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.530 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:48.530 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524957+0000", 2024-09-12T16:17:48.531 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019516999999999999 2024-09-12T16:17:48.531 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.531 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.531 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:48.531 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524962+0000", 2024-09-12T16:17:48.531 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7709999999999997e-06 2024-09-12T16:17:48.531 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.531 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.531 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:48.531 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524973+0000", 2024-09-12T16:17:48.532 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1031e-05 2024-09-12T16:17:48.532 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.532 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.532 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:48.532 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524980+0000", 2024-09-12T16:17:48.532 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6100000000000002e-06 2024-09-12T16:17:48.532 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.532 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.532 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:48.532 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577977+0000", 2024-09-12T16:17:48.532 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052997481999999999 2024-09-12T16:17:48.532 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578062+0000", 2024-09-12T16:17:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4851000000000005e-05 2024-09-12T16:17:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578160+0000", 2024-09-12T16:17:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7600000000000001e-05 2024-09-12T16:17:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.534 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14049 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5096448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:48.534 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:17:48.534 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 88.934750675999993, 2024-09-12T16:17:48.534 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053439792, 2024-09-12T16:17:48.534 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:48.534 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:48.534 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:48.534 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:48.534 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:48.534 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:48.534 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14049 2024-09-12T16:17:48.534 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.534 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:48.534 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.535 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:48.535 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:17:48.535 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.535 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.535 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.535 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:48.535 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:17:48.535 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.535 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.535 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.535 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:48.535 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525170+0000", 2024-09-12T16:17:48.535 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017958500000000001 2024-09-12T16:17:48.535 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.535 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.536 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:48.536 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525174+0000", 2024-09-12T16:17:48.536 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0239999999999999e-06 2024-09-12T16:17:48.536 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.536 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.536 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:48.536 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525184+0000", 2024-09-12T16:17:48.536 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5950000000000005e-06 2024-09-12T16:17:48.536 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.536 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.536 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:48.536 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525191+0000", 2024-09-12T16:17:48.536 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8329999999999996e-06 2024-09-12T16:17:48.537 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.537 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.537 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:48.537 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578240+0000", 2024-09-12T16:17:48.537 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053049236 2024-09-12T16:17:48.537 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.537 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.537 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:48.537 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578333+0000", 2024-09-12T16:17:48.537 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2806999999999994e-05 2024-09-12T16:17:48.537 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.537 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.538 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:48.538 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578431+0000", 2024-09-12T16:17:48.538 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7712000000000002e-05 2024-09-12T16:17:48.538 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.538 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:48.538 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.538 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.538 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.538 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14055 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5121024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:48.538 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:17:48.538 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 88.933479985000005, 2024-09-12T16:17:48.538 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053399038000000003, 2024-09-12T16:17:48.538 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:48.538 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:48.539 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:48.539 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:48.539 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:48.539 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:48.539 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14055 2024-09-12T16:17:48.539 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.539 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:48.539 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.539 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:48.539 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:17:48.539 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.539 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.539 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.539 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:48.540 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:17:48.540 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.540 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.540 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.540 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:48.540 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526403+0000", 2024-09-12T16:17:48.540 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141571 2024-09-12T16:17:48.540 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.540 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.540 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:48.540 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526406+0000", 2024-09-12T16:17:48.540 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2660000000000002e-06 2024-09-12T16:17:48.540 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.541 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.541 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:48.541 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526420+0000", 2024-09-12T16:17:48.541 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3949e-05 2024-09-12T16:17:48.541 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.541 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.541 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:48.541 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526428+0000", 2024-09-12T16:17:48.541 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4250000000000001e-06 2024-09-12T16:17:48.541 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.541 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.541 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:48.542 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579476+0000", 2024-09-12T16:17:48.542 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053048349000000002 2024-09-12T16:17:48.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.542 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.542 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:48.542 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579563+0000", 2024-09-12T16:17:48.542 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6502999999999995e-05 2024-09-12T16:17:48.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.542 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.542 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:48.542 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579661+0000", 2024-09-12T16:17:48.542 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7974999999999996e-05 2024-09-12T16:17:48.542 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.542 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:48.543 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.543 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.543 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.543 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4806.0:3139 3.1e 3:78d5a095:::rbd_data.11552a37e55b.0000000000000000:head [read 69632~61440] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:17:48.543 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:48.543 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 78.158485734999999, 2024-09-12T16:17:48.543 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057851734000000002, 2024-09-12T16:17:48.543 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:48.543 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:48.543 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:48.543 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:48.543 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4806", 2024-09-12T16:17:48.544 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3959815836", 2024-09-12T16:17:48.544 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 3139 2024-09-12T16:17:48.544 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.544 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:48.544 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.544 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:48.544 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:48.544 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.544 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.544 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.544 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:48.544 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:48.545 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.545 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.545 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:48.545 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:48.545 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4799999999999999e-07 2024-09-12T16:17:48.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.545 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.545 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:48.545 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301258+0000", 2024-09-12T16:17:48.545 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.844e-06 2024-09-12T16:17:48.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.546 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.546 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:48.546 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301267+0000", 2024-09-12T16:17:48.546 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2960000000000004e-06 2024-09-12T16:17:48.546 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.546 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.546 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:48.546 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301276+0000", 2024-09-12T16:17:48.546 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0650000000000005e-06 2024-09-12T16:17:48.546 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.546 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.546 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:48.546 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301871+0000", 2024-09-12T16:17:48.546 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00059423600000000005 2024-09-12T16:17:48.547 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.547 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.547 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:48.547 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301920+0000", 2024-09-12T16:17:48.547 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9067000000000003e-05 2024-09-12T16:17:48.547 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.547 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.547 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:48.547 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359108+0000", 2024-09-12T16:17:48.547 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057187877999999998 2024-09-12T16:17:48.547 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.547 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:48.547 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.547 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.547 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.548 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:6428 3.14 3:28a44e54:::rbd_header.11552a37e55b:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:17:48.548 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:17:48.548 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 78.158157141000004, 2024-09-12T16:17:48.548 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057504023000000001, 2024-09-12T16:17:48.548 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:48.548 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:48.548 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:48.548 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:48.548 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:17:48.548 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:17:48.548 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6428 2024-09-12T16:17:48.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.549 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:48.549 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.549 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:48.549 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:17:48.549 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.549 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.549 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:48.549 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:17:48.549 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.550 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:48.550 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301585+0000", 2024-09-12T16:17:48.550 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6300000000000005e-07 2024-09-12T16:17:48.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.550 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:48.550 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301588+0000", 2024-09-12T16:17:48.550 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4149999999999999e-06 2024-09-12T16:17:48.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.551 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:48.551 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301597+0000", 2024-09-12T16:17:48.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5450000000000003e-06 2024-09-12T16:17:48.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.551 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:48.551 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301617+0000", 2024-09-12T16:17:48.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9837e-05 2024-09-12T16:17:48.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.552 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.552 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:48.552 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301779+0000", 2024-09-12T16:17:48.552 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016186799999999999 2024-09-12T16:17:48.552 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.552 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.552 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:48.552 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301855+0000", 2024-09-12T16:17:48.553 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5899e-05 2024-09-12T16:17:48.553 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.553 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:48.553 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359088+0000", 2024-09-12T16:17:48.553 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057233895999999999 2024-09-12T16:17:48.553 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.553 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:48.553 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.553 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.553 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5223.0:1814 3.f 3:f7b1b1c5:::rbd_object_map.1155a1fd27d2:head [read 0~136] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-12T16:17:48.553 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:17:48.554 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 42.222491077000001, 2024-09-12T16:17:48.554 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.006378226, 2024-09-12T16:17:48.554 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:48.554 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:48.554 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:48.554 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:48.554 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5223", 2024-09-12T16:17:48.554 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/4066330994", 2024-09-12T16:17:48.554 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1814 2024-09-12T16:17:48.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.554 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:48.554 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.554 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:48.554 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:17:48.554 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.555 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.555 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.555 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:48.555 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:17:48.555 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.555 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.555 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.555 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:48.555 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237252+0000", 2024-09-12T16:17:48.555 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.344e-06 2024-09-12T16:17:48.555 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.555 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.555 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:48.556 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237258+0000", 2024-09-12T16:17:48.556 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1070000000000001e-06 2024-09-12T16:17:48.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.556 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.556 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:48.556 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237270+0000", 2024-09-12T16:17:48.556 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1758e-05 2024-09-12T16:17:48.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.556 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.556 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:48.556 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237278+0000", 2024-09-12T16:17:48.556 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3219999999999993e-06 2024-09-12T16:17:48.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.557 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.557 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:48.557 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237334+0000", 2024-09-12T16:17:48.557 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6356e-05 2024-09-12T16:17:48.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.557 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.557 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:17:48.557 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237345+0000", 2024-09-12T16:17:48.557 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0433e-05 2024-09-12T16:17:48.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.557 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.557 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:48.557 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243426+0000", 2024-09-12T16:17:48.558 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.00608133 2024-09-12T16:17:48.558 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.558 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.558 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:48.558 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243534+0000", 2024-09-12T16:17:48.558 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010784 2024-09-12T16:17:48.558 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.558 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.558 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:48.558 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243629+0000", 2024-09-12T16:17:48.558 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4735999999999996e-05 2024-09-12T16:17:48.558 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.558 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:48.558 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.559 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.559 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5328.0:2542 3.16 3:6928f3a1:::rbd_object_map.11551722dd77:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:48.559 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:17:48.559 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 36.404145647, 2024-09-12T16:17:48.559 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.054219934999999997, 2024-09-12T16:17:48.559 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:48.559 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:48.559 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:48.559 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:48.559 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5328", 2024-09-12T16:17:48.559 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:48.559 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2542 2024-09-12T16:17:48.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.559 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:48.560 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.560 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:48.560 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:17:48.560 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.560 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.560 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:48.560 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:17:48.560 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.560 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.560 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:48.560 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055597+0000", 2024-09-12T16:17:48.560 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4300000000000001e-07 2024-09-12T16:17:48.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.561 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:48.561 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055602+0000", 2024-09-12T16:17:48.561 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4269999999999999e-06 2024-09-12T16:17:48.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.561 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:48.561 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055613+0000", 2024-09-12T16:17:48.561 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0815000000000001e-05 2024-09-12T16:17:48.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.561 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:48.561 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055621+0000", 2024-09-12T16:17:48.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4189999999999996e-06 2024-09-12T16:17:48.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.562 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.562 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:48.562 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102196+0000", 2024-09-12T16:17:48.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.046575616 2024-09-12T16:17:48.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.562 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.562 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:48.562 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102258+0000", 2024-09-12T16:17:48.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1872000000000007e-05 2024-09-12T16:17:48.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.562 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.563 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T16:17:48.563 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102601+0000", 2024-09-12T16:17:48.563 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034285700000000001 2024-09-12T16:17:48.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.563 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.563 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:48.563 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.104431+0000", 2024-09-12T16:17:48.563 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001830524 2024-09-12T16:17:48.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.563 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.563 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:17:48.563 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109733+0000", 2024-09-12T16:17:48.563 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0053020089999999999 2024-09-12T16:17:48.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.564 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.564 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:48.564 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109777+0000", 2024-09-12T16:17:48.564 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3754000000000002e-05 2024-09-12T16:17:48.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.564 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.564 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:48.564 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109816+0000", 2024-09-12T16:17:48.564 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8699000000000003e-05 2024-09-12T16:17:48.564 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.564 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:48.564 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.565 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.565 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5328.0:2543 3.16 3:6928f3a1:::rbd_object_map.11551722dd77:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:48.565 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:17:48.565 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 36.403551667999999, 2024-09-12T16:17:48.565 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053695720000000002, 2024-09-12T16:17:48.565 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:48.565 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:48.565 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:48.565 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:48.565 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5328", 2024-09-12T16:17:48.565 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:48.565 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2543 2024-09-12T16:17:48.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.566 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:48.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.566 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:48.566 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:17:48.566 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.566 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:48.566 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:17:48.566 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.566 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:48.567 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056191+0000", 2024-09-12T16:17:48.567 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.54e-07 2024-09-12T16:17:48.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.567 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.567 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:48.567 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056195+0000", 2024-09-12T16:17:48.567 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5460000000000002e-06 2024-09-12T16:17:48.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.567 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.567 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:48.567 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056205+0000", 2024-09-12T16:17:48.567 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7350000000000008e-06 2024-09-12T16:17:48.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.567 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.568 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:48.568 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056214+0000", 2024-09-12T16:17:48.568 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8089999999999999e-06 2024-09-12T16:17:48.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.568 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.568 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:48.568 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103317+0000", 2024-09-12T16:17:48.568 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.047102889000000002 2024-09-12T16:17:48.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.568 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.568 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:48.568 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103410+0000", 2024-09-12T16:17:48.568 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3689000000000004e-05 2024-09-12T16:17:48.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.569 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T16:17:48.569 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103754+0000", 2024-09-12T16:17:48.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034344699999999998 2024-09-12T16:17:48.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.569 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:48.569 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.106487+0000", 2024-09-12T16:17:48.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0027330100000000001 2024-09-12T16:17:48.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.569 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:17:48.570 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109827+0000", 2024-09-12T16:17:48.570 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033406640000000001 2024-09-12T16:17:48.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.570 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:48.570 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109854+0000", 2024-09-12T16:17:48.570 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6866999999999999e-05 2024-09-12T16:17:48.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.570 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:48.570 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109886+0000", 2024-09-12T16:17:48.571 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1309999999999997e-05 2024-09-12T16:17:48.571 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.571 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:48.571 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.571 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:48.571 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:48.571 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:48.573 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:17:48.573 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:48.571+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:48.673 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:48.671+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:48.721 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:48.721 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:48.722 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:17:48.722 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:48.730 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:17:48.773 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:48.773+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:48.874 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:48.874+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:48.877 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:48.877 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:48.877 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:17:48.877 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:17:48.877 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:48.886 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:17:48.975 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:48.974+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:48.994 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:48.994 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:17:48.994 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:17:48.994 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:17:48.994 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.994 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5599 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4788224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:48.994 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:17:48.994 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 68.696461184, 2024-09-12T16:17:48.995 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061192059, 2024-09-12T16:17:48.995 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:48.995 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:48.995 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:48.995 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:48.995 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:48.995 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:48.995 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5599 2024-09-12T16:17:48.995 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.995 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:48.995 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.995 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:48.995 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:17:48.995 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.996 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.996 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.996 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:48.996 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:17:48.996 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:48.996 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.996 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.996 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:48.996 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296333+0000", 2024-09-12T16:17:48.996 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6599999999999996e-07 2024-09-12T16:17:48.996 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.996 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.997 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:48.997 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296335+0000", 2024-09-12T16:17:48.997 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5900000000000002e-06 2024-09-12T16:17:48.997 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.997 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.997 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:48.998 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296344+0000", 2024-09-12T16:17:48.998 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9539999999999993e-06 2024-09-12T16:17:48.998 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.998 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.998 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:48.998 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296350+0000", 2024-09-12T16:17:48.998 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5589999999999996e-06 2024-09-12T16:17:48.998 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.999 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.999 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:48.999 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357307+0000", 2024-09-12T16:17:48.999 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.060957573000000001 2024-09-12T16:17:48.999 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.999 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:48.999 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:48.999 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357401+0000", 2024-09-12T16:17:48.999 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3512999999999997e-05 2024-09-12T16:17:48.999 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:48.999 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.000 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.000 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357524+0000", 2024-09-12T16:17:49.000 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000123304 2024-09-12T16:17:49.000 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.000 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.001 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.001 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.001 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.001 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5611 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4730880~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:49.001 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:17:49.001 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 68.696398740000006, 2024-09-12T16:17:49.001 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061359348000000001, 2024-09-12T16:17:49.001 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:49.001 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:49.001 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:49.001 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:49.001 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:49.001 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:49.002 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5611 2024-09-12T16:17:49.002 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.002 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:49.002 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.002 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:49.002 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:17:49.002 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.002 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.002 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.002 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:49.002 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:17:49.002 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.002 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.003 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.003 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:49.003 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296395+0000", 2024-09-12T16:17:49.003 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4600000000000003e-07 2024-09-12T16:17:49.003 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.003 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.003 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:49.004 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296399+0000", 2024-09-12T16:17:49.004 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9430000000000002e-06 2024-09-12T16:17:49.004 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.004 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.004 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:49.004 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296411+0000", 2024-09-12T16:17:49.004 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1755e-05 2024-09-12T16:17:49.004 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.004 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.004 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:49.004 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296417+0000", 2024-09-12T16:17:49.004 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3790000000000003e-06 2024-09-12T16:17:49.004 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.005 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.005 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:49.005 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357572+0000", 2024-09-12T16:17:49.005 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061154871 2024-09-12T16:17:49.005 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.005 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.005 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:49.005 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357663+0000", 2024-09-12T16:17:49.005 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0389999999999993e-05 2024-09-12T16:17:49.005 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.005 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.005 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.005 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357754+0000", 2024-09-12T16:17:49.005 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1063999999999994e-05 2024-09-12T16:17:49.006 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.006 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.006 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.006 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.006 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.006 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5613 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4775936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:49.006 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:49.006 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 68.696357559999996, 2024-09-12T16:17:49.006 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061491777999999997, 2024-09-12T16:17:49.006 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:49.006 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:49.006 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:49.006 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:49.006 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:49.007 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:49.007 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5613 2024-09-12T16:17:49.007 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.007 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:49.007 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.007 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:49.007 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:49.007 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.007 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.007 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.007 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:49.007 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:49.007 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.007 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.007 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.008 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:49.008 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:49.008 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8899999999999999e-07 2024-09-12T16:17:49.008 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.008 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.008 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:49.008 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296439+0000", 2024-09-12T16:17:49.008 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8439999999999998e-06 2024-09-12T16:17:49.008 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.008 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.008 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:49.008 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296452+0000", 2024-09-12T16:17:49.008 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2639e-05 2024-09-12T16:17:49.009 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.009 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.009 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:49.009 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296457+0000", 2024-09-12T16:17:49.009 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5720000000000002e-06 2024-09-12T16:17:49.009 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.009 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.009 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:49.009 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357773+0000", 2024-09-12T16:17:49.009 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061315500000000002 2024-09-12T16:17:49.009 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.009 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.009 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:49.010 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357814+0000", 2024-09-12T16:17:49.010 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1448e-05 2024-09-12T16:17:49.010 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.010 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.010 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.010 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357927+0000", 2024-09-12T16:17:49.010 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000113186 2024-09-12T16:17:49.010 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.010 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.010 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.011 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.011 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.011 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5616 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4784128~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:49.011 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:49.011 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 68.696322498000001, 2024-09-12T16:17:49.011 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061725002000000001, 2024-09-12T16:17:49.011 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:49.011 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:49.012 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:49.012 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:49.012 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:49.012 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:49.012 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5616 2024-09-12T16:17:49.012 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.012 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:49.012 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.012 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:49.012 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:49.012 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.012 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.012 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.013 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:49.013 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:49.013 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.013 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.013 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.013 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:49.013 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:49.013 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5900000000000002e-07 2024-09-12T16:17:49.013 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.013 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.013 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:49.013 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296473+0000", 2024-09-12T16:17:49.013 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3130000000000001e-06 2024-09-12T16:17:49.014 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.014 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.014 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:49.014 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296481+0000", 2024-09-12T16:17:49.014 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1389999999999998e-06 2024-09-12T16:17:49.014 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.014 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.014 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:49.014 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296486+0000", 2024-09-12T16:17:49.014 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3310000000000003e-06 2024-09-12T16:17:49.014 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.014 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.014 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:49.015 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357981+0000", 2024-09-12T16:17:49.015 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061494866000000002 2024-09-12T16:17:49.015 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.015 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.015 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:49.015 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358082+0000", 2024-09-12T16:17:49.015 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101424 2024-09-12T16:17:49.015 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.015 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.015 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.015 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358196+0000", 2024-09-12T16:17:49.015 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011347 2024-09-12T16:17:49.015 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.016 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.016 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.016 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.016 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.016 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5626 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4739072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:49.016 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:17:49.016 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 68.696244542000002, 2024-09-12T16:17:49.016 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061802430999999998, 2024-09-12T16:17:49.016 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:49.016 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:49.017 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:49.017 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:49.017 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:49.017 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:49.017 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5626 2024-09-12T16:17:49.017 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.017 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:49.017 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.017 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:49.017 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:17:49.017 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.017 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.017 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.017 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:49.018 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:17:49.018 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.018 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.018 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.018 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:49.018 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296550+0000", 2024-09-12T16:17:49.018 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.215e-06 2024-09-12T16:17:49.018 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.018 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.018 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:49.018 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296555+0000", 2024-09-12T16:17:49.018 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9590000000000003e-06 2024-09-12T16:17:49.019 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.019 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.019 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:49.019 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296568+0000", 2024-09-12T16:17:49.019 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3338e-05 2024-09-12T16:17:49.019 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.019 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.019 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:49.019 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296576+0000", 2024-09-12T16:17:49.019 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5510000000000002e-06 2024-09-12T16:17:49.019 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.019 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.020 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:49.020 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358241+0000", 2024-09-12T16:17:49.020 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.06166576 2024-09-12T16:17:49.020 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.020 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.020 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:49.020 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358288+0000", 2024-09-12T16:17:49.020 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6097000000000003e-05 2024-09-12T16:17:49.020 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.020 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.020 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.020 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358351+0000", 2024-09-12T16:17:49.020 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3510999999999996e-05 2024-09-12T16:17:49.021 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.021 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.021 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.021 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.021 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.021 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5628 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4792320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:49.021 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:17:49.021 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 68.696202041999996, 2024-09-12T16:17:49.021 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061961161000000001, 2024-09-12T16:17:49.021 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:49.021 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:49.021 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:49.021 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:49.021 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:49.022 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:49.022 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5628 2024-09-12T16:17:49.022 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.022 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:49.022 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.022 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:49.022 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:17:49.022 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.022 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.022 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.022 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:49.022 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:17:49.022 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.022 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.023 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.023 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:49.023 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296592+0000", 2024-09-12T16:17:49.023 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2099999999999996e-07 2024-09-12T16:17:49.023 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.023 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.023 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:49.023 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296595+0000", 2024-09-12T16:17:49.023 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0429999999999999e-06 2024-09-12T16:17:49.023 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.023 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.023 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:49.024 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296603+0000", 2024-09-12T16:17:49.024 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9899999999999997e-06 2024-09-12T16:17:49.024 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.024 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.024 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:49.024 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296609+0000", 2024-09-12T16:17:49.024 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7259999999999999e-06 2024-09-12T16:17:49.024 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.024 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.024 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:49.025 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358393+0000", 2024-09-12T16:17:49.025 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061784617 2024-09-12T16:17:49.025 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.025 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.025 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:49.025 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358460+0000", 2024-09-12T16:17:49.025 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7253000000000001e-05 2024-09-12T16:17:49.025 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.025 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.026 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.026 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358552+0000", 2024-09-12T16:17:49.026 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1811000000000006e-05 2024-09-12T16:17:49.026 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.026 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.027 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.027 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.027 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.027 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5638 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4734976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:49.027 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:49.027 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 68.695729490999994, 2024-09-12T16:17:49.027 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061654460000000001, 2024-09-12T16:17:49.027 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:49.027 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:49.027 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:49.027 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:49.027 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:49.028 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:49.028 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5638 2024-09-12T16:17:49.028 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.028 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:49.028 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.028 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:49.028 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:49.028 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.028 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.028 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.028 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:49.028 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:49.028 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.029 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.029 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.029 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:49.029 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:49.029 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.23e-07 2024-09-12T16:17:49.029 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.029 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.029 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:49.029 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297068+0000", 2024-09-12T16:17:49.029 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0060000000000003e-06 2024-09-12T16:17:49.029 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.029 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.029 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:49.030 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297080+0000", 2024-09-12T16:17:49.030 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1234e-05 2024-09-12T16:17:49.030 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.030 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.030 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:49.030 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297095+0000", 2024-09-12T16:17:49.030 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5698000000000001e-05 2024-09-12T16:17:49.030 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.030 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.030 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:49.030 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358582+0000", 2024-09-12T16:17:49.030 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061486274 2024-09-12T16:17:49.031 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.031 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.031 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:49.031 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358637+0000", 2024-09-12T16:17:49.031 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5439999999999998e-05 2024-09-12T16:17:49.031 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.031 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.031 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.031 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358718+0000", 2024-09-12T16:17:49.031 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0984999999999998e-05 2024-09-12T16:17:49.031 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.032 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.032 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.032 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.032 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.032 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5640 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4780032~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:49.032 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:17:49.032 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 68.695647770999997, 2024-09-12T16:17:49.032 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061746620000000002, 2024-09-12T16:17:49.032 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:49.032 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:49.032 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:49.032 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:49.032 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:49.032 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:49.033 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5640 2024-09-12T16:17:49.033 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.033 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:49.033 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.033 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:49.033 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:17:49.033 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.033 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.033 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.033 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:49.033 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:17:49.033 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.033 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.033 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.034 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:49.034 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297146+0000", 2024-09-12T16:17:49.034 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3600000000000003e-07 2024-09-12T16:17:49.034 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.034 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.034 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:49.034 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297150+0000", 2024-09-12T16:17:49.034 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8430000000000003e-06 2024-09-12T16:17:49.034 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.034 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.034 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:49.034 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297160+0000", 2024-09-12T16:17:49.034 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7229999999999999e-06 2024-09-12T16:17:49.034 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.035 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.035 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:49.035 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297167+0000", 2024-09-12T16:17:49.035 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0180000000000004e-06 2024-09-12T16:17:49.035 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.035 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.035 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:49.035 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358750+0000", 2024-09-12T16:17:49.035 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061583104 2024-09-12T16:17:49.035 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.035 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.035 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:49.035 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358804+0000", 2024-09-12T16:17:49.035 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4277000000000002e-05 2024-09-12T16:17:49.036 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.036 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.036 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.036 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358892+0000", 2024-09-12T16:17:49.036 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7918999999999996e-05 2024-09-12T16:17:49.036 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.036 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.036 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.036 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.036 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.036 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5642 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4788224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:49.037 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:49.037 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 68.695603426999995, 2024-09-12T16:17:49.037 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061860409999999998, 2024-09-12T16:17:49.037 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:49.037 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:49.037 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:49.038 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:49.038 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:49.038 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:49.038 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5642 2024-09-12T16:17:49.038 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.038 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:49.038 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.038 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:49.038 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:49.038 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.039 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.039 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.039 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:49.039 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:49.039 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.039 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.040 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.040 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:49.040 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:49.040 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7999999999999995e-07 2024-09-12T16:17:49.040 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.040 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.040 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:49.040 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297193+0000", 2024-09-12T16:17:49.040 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8310000000000001e-06 2024-09-12T16:17:49.040 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.040 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.040 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:49.041 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297204+0000", 2024-09-12T16:17:49.041 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0832999999999999e-05 2024-09-12T16:17:49.041 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.041 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.041 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:49.041 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297210+0000", 2024-09-12T16:17:49.041 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1770000000000003e-06 2024-09-12T16:17:49.041 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.041 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.041 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:49.041 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358928+0000", 2024-09-12T16:17:49.041 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061717826000000003 2024-09-12T16:17:49.041 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.041 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.042 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:49.042 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358977+0000", 2024-09-12T16:17:49.042 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9514000000000001e-05 2024-09-12T16:17:49.042 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.042 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.042 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.042 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359050+0000", 2024-09-12T16:17:49.042 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2649000000000002e-05 2024-09-12T16:17:49.042 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.042 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.042 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.042 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.042 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.042 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5646 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4743168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:49.042 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:49.043 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 68.695423485999996, 2024-09-12T16:17:49.043 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061822122, 2024-09-12T16:17:49.043 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:49.043 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:49.043 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:49.043 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:49.043 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:49.043 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:49.043 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5646 2024-09-12T16:17:49.043 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.043 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:49.043 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.043 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:49.043 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:49.043 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.043 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.044 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.044 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:49.044 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:49.044 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.044 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.044 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.044 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:49.044 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:49.044 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3200000000000004e-07 2024-09-12T16:17:49.044 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.044 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.044 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:49.044 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297374+0000", 2024-09-12T16:17:49.044 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8240000000000001e-06 2024-09-12T16:17:49.045 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.045 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.045 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:49.045 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297384+0000", 2024-09-12T16:17:49.045 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5710000000000004e-06 2024-09-12T16:17:49.045 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.045 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.045 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:49.045 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297390+0000", 2024-09-12T16:17:49.045 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5130000000000002e-06 2024-09-12T16:17:49.045 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.045 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.045 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:49.046 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359080+0000", 2024-09-12T16:17:49.046 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061689569999999999 2024-09-12T16:17:49.046 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.046 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.046 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:49.046 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359134+0000", 2024-09-12T16:17:49.046 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3838999999999997e-05 2024-09-12T16:17:49.046 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.046 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.046 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.046 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359192+0000", 2024-09-12T16:17:49.046 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8072999999999998e-05 2024-09-12T16:17:49.046 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.046 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.047 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.047 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.047 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.047 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5647 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4751360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:49.047 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:17:49.047 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 68.695386800999998, 2024-09-12T16:17:49.047 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061927569000000002, 2024-09-12T16:17:49.047 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:49.047 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:49.047 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:49.047 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:49.047 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:49.047 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:49.047 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5647 2024-09-12T16:17:49.047 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.048 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:49.048 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.048 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:49.048 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:17:49.048 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.048 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.048 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.048 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:49.048 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:17:49.048 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.048 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.048 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.048 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:49.049 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297407+0000", 2024-09-12T16:17:49.049 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.46e-07 2024-09-12T16:17:49.049 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.049 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.049 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:49.049 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297409+0000", 2024-09-12T16:17:49.049 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.469e-06 2024-09-12T16:17:49.049 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.049 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.049 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:49.049 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297415+0000", 2024-09-12T16:17:49.049 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9259999999999997e-06 2024-09-12T16:17:49.050 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.050 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.050 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:49.050 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297419+0000", 2024-09-12T16:17:49.050 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3840000000000001e-06 2024-09-12T16:17:49.050 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.050 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.050 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:49.050 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359224+0000", 2024-09-12T16:17:49.050 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061805367999999999 2024-09-12T16:17:49.050 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.050 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.050 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:49.050 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359275+0000", 2024-09-12T16:17:49.050 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1338000000000002e-05 2024-09-12T16:17:49.051 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.051 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.051 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.051 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359334+0000", 2024-09-12T16:17:49.051 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8638000000000003e-05 2024-09-12T16:17:49.051 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.051 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.051 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.051 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.051 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.051 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5649 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4796416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:49.051 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:17:49.052 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 68.695331941999996, 2024-09-12T16:17:49.052 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.062018578999999997, 2024-09-12T16:17:49.052 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:49.052 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:49.052 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:49.052 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:49.052 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:49.052 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:49.052 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5649 2024-09-12T16:17:49.053 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.053 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:49.053 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.053 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:49.053 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:17:49.053 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.053 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.054 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.054 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:49.054 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:17:49.054 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.054 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.055 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.055 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:49.055 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297462+0000", 2024-09-12T16:17:49.055 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2399999999999998e-07 2024-09-12T16:17:49.055 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.055 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.055 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:49.055 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297465+0000", 2024-09-12T16:17:49.055 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.371e-06 2024-09-12T16:17:49.055 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.055 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.056 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:49.056 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297473+0000", 2024-09-12T16:17:49.056 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4699999999999996e-06 2024-09-12T16:17:49.056 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.056 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.056 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:49.057 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297478+0000", 2024-09-12T16:17:49.057 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2780000000000001e-06 2024-09-12T16:17:49.057 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.057 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.057 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:49.057 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359368+0000", 2024-09-12T16:17:49.057 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061889758000000003 2024-09-12T16:17:49.057 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.058 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.058 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:49.058 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359420+0000", 2024-09-12T16:17:49.058 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2574999999999997e-05 2024-09-12T16:17:49.058 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.058 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.059 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.059 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359480+0000", 2024-09-12T16:17:49.059 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9503000000000003e-05 2024-09-12T16:17:49.059 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.059 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.060 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.060 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.060 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.060 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5674 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4739072~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:49.060 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:17:49.060 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 68.694928173999998, 2024-09-12T16:17:49.060 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061762989999999997, 2024-09-12T16:17:49.060 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:49.060 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:49.060 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:49.060 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:49.060 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:49.061 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:49.061 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5674 2024-09-12T16:17:49.061 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.061 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:49.061 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.061 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:49.061 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:17:49.061 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.061 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.061 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.061 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:49.062 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:17:49.062 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.062 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.062 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.062 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:49.062 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297866+0000", 2024-09-12T16:17:49.062 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1900000000000001e-07 2024-09-12T16:17:49.062 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.062 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.062 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:49.062 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297870+0000", 2024-09-12T16:17:49.062 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3560000000000003e-06 2024-09-12T16:17:49.062 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.062 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.062 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:49.063 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297888+0000", 2024-09-12T16:17:49.063 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8088999999999999e-05 2024-09-12T16:17:49.063 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.063 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.063 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:49.063 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297904+0000", 2024-09-12T16:17:49.063 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5971e-05 2024-09-12T16:17:49.063 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.063 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.063 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:49.063 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359510+0000", 2024-09-12T16:17:49.063 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061605634999999999 2024-09-12T16:17:49.063 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.063 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.063 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:49.064 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359554+0000", 2024-09-12T16:17:49.064 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4024999999999999e-05 2024-09-12T16:17:49.064 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.064 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.064 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.064 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359628+0000", 2024-09-12T16:17:49.064 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4095000000000001e-05 2024-09-12T16:17:49.064 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.064 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.064 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.064 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.064 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.064 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5676 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4792320~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:49.065 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:17:49.065 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 68.694727094000001, 2024-09-12T16:17:49.065 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061720143999999998, 2024-09-12T16:17:49.065 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:49.065 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:49.065 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:49.065 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:49.065 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:49.065 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:49.065 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5676 2024-09-12T16:17:49.065 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.065 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:49.065 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.065 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:49.066 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:17:49.066 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.066 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.066 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.066 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:49.066 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:17:49.066 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.066 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.066 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.066 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:49.066 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298067+0000", 2024-09-12T16:17:49.066 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8199999999999999e-07 2024-09-12T16:17:49.066 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.067 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.067 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:49.067 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298070+0000", 2024-09-12T16:17:49.067 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.743e-06 2024-09-12T16:17:49.067 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.067 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.067 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:49.067 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298080+0000", 2024-09-12T16:17:49.067 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4059999999999994e-06 2024-09-12T16:17:49.067 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.067 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.067 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:49.068 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298088+0000", 2024-09-12T16:17:49.068 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0779999999999996e-06 2024-09-12T16:17:49.068 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.068 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.068 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:49.068 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359659+0000", 2024-09-12T16:17:49.068 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061570688999999998 2024-09-12T16:17:49.068 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.068 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.068 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:49.068 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359713+0000", 2024-09-12T16:17:49.069 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3939e-05 2024-09-12T16:17:49.069 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.069 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.069 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.069 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359786+0000", 2024-09-12T16:17:49.069 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3607000000000002e-05 2024-09-12T16:17:49.069 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.069 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.069 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.069 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.069 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.069 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5684 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4747264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:49.070 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:17:49.070 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 68.694259802000005, 2024-09-12T16:17:49.070 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061394799, 2024-09-12T16:17:49.070 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:49.070 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:49.070 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:49.070 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:49.070 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:49.070 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:49.070 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5684 2024-09-12T16:17:49.070 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.070 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:49.070 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.071 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:49.071 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:17:49.071 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.071 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.071 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.071 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:49.071 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:17:49.071 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.071 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.071 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.071 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:49.071 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298534+0000", 2024-09-12T16:17:49.071 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4399999999999999e-07 2024-09-12T16:17:49.071 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.071 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.072 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:49.072 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298539+0000", 2024-09-12T16:17:49.072 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5360000000000003e-06 2024-09-12T16:17:49.072 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.072 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.072 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:49.072 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298550+0000", 2024-09-12T16:17:49.072 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1499e-05 2024-09-12T16:17:49.072 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.072 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.072 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:49.072 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298558+0000", 2024-09-12T16:17:49.072 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3000000000000004e-06 2024-09-12T16:17:49.072 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.072 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.073 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:49.073 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359815+0000", 2024-09-12T16:17:49.073 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061257952999999997 2024-09-12T16:17:49.073 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.073 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.073 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:49.073 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359868+0000", 2024-09-12T16:17:49.073 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2317000000000001e-05 2024-09-12T16:17:49.073 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.073 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.073 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.073 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359928+0000", 2024-09-12T16:17:49.074 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0350000000000003e-05 2024-09-12T16:17:49.074 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.074 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.074 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.074 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.074 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.074 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5686 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4755456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:49.074 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:17:49.074 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 68.694092377999993, 2024-09-12T16:17:49.074 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061355082999999998, 2024-09-12T16:17:49.074 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:49.074 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:49.075 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:49.075 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:49.075 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:49.075 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:49.075 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5686 2024-09-12T16:17:49.075 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.076 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:49.076 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.076 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:49.076 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:17:49.076 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.077 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.077 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.077 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:49.077 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:17:49.077 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.077 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.077 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.077 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:49.078 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298702+0000", 2024-09-12T16:17:49.078 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2399999999999997e-07 2024-09-12T16:17:49.078 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.078 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.078 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:49.078 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298706+0000", 2024-09-12T16:17:49.078 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5700000000000003e-06 2024-09-12T16:17:49.078 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.078 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.078 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:49.078 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298718+0000", 2024-09-12T16:17:49.078 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1457999999999999e-05 2024-09-12T16:17:49.078 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.078 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.078 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:49.079 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298732+0000", 2024-09-12T16:17:49.079 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.452e-05 2024-09-12T16:17:49.079 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.079 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.079 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:49.079 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359956+0000", 2024-09-12T16:17:49.079 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061223626000000003 2024-09-12T16:17:49.079 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.079 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.079 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:49.079 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360000+0000", 2024-09-12T16:17:49.079 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3922999999999999e-05 2024-09-12T16:17:49.079 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.079 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.079 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.080 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360056+0000", 2024-09-12T16:17:49.080 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6162000000000002e-05 2024-09-12T16:17:49.080 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.080 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.080 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.080 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.080 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.080 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5688 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4800512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:49.080 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:17:49.080 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 68.693869324999994, 2024-09-12T16:17:49.080 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061270514999999998, 2024-09-12T16:17:49.080 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:49.080 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:49.080 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:49.081 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:49.081 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:49.081 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:49.081 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5688 2024-09-12T16:17:49.081 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.081 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:49.081 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.081 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:49.081 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:17:49.081 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.081 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.081 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.081 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:49.081 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:17:49.082 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.082 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.082 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.082 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:49.082 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298925+0000", 2024-09-12T16:17:49.082 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4e-07 2024-09-12T16:17:49.082 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.082 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.082 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:49.082 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298929+0000", 2024-09-12T16:17:49.082 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9890000000000003e-06 2024-09-12T16:17:49.082 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.082 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.082 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:49.083 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298936+0000", 2024-09-12T16:17:49.083 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.52e-06 2024-09-12T16:17:49.083 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.083 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.083 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:49.083 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298941+0000", 2024-09-12T16:17:49.083 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4800000000000003e-06 2024-09-12T16:17:49.083 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.083 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.083 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:49.083 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360087+0000", 2024-09-12T16:17:49.083 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061146143 2024-09-12T16:17:49.084 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.084 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.084 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:49.084 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360137+0000", 2024-09-12T16:17:49.084 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0584000000000002e-05 2024-09-12T16:17:49.084 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.084 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.084 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.084 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360194+0000", 2024-09-12T16:17:49.084 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6858999999999999e-05 2024-09-12T16:17:49.084 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.084 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.084 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.084 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.085 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.085 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5693 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4751360~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:49.085 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:17:49.085 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 68.693447688000006, 2024-09-12T16:17:49.085 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061139444000000001, 2024-09-12T16:17:49.085 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:49.085 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:49.085 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:49.085 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:49.085 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:49.085 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:49.085 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5693 2024-09-12T16:17:49.086 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.086 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:49.086 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.086 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:49.086 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:17:49.086 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.086 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.086 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.086 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:49.086 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:17:49.086 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.087 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.087 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.087 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:49.087 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299346+0000", 2024-09-12T16:17:49.087 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2300000000000001e-07 2024-09-12T16:17:49.087 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.087 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.087 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:49.087 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299349+0000", 2024-09-12T16:17:49.087 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5270000000000001e-06 2024-09-12T16:17:49.087 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.087 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.087 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:49.088 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299358+0000", 2024-09-12T16:17:49.088 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7030000000000001e-06 2024-09-12T16:17:49.088 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.088 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.088 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:49.088 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299364+0000", 2024-09-12T16:17:49.088 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7239999999999997e-06 2024-09-12T16:17:49.088 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.088 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.088 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:49.088 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360369+0000", 2024-09-12T16:17:49.088 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061004713000000002 2024-09-12T16:17:49.088 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.089 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.089 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:49.089 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360415+0000", 2024-09-12T16:17:49.089 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5926e-05 2024-09-12T16:17:49.089 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.089 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.089 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.089 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360485+0000", 2024-09-12T16:17:49.089 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0327999999999995e-05 2024-09-12T16:17:49.090 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.090 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.090 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.090 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.090 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.090 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5694 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4796416~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:49.090 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:17:49.090 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 68.693418659000002, 2024-09-12T16:17:49.090 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061258034000000003, 2024-09-12T16:17:49.090 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:49.090 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:49.090 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:49.090 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:49.090 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:49.090 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:49.091 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5694 2024-09-12T16:17:49.091 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.091 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:49.091 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.091 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:49.091 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:17:49.091 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.091 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.091 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.091 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:49.091 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:17:49.091 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.091 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.092 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.092 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:49.092 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301884+0000", 2024-09-12T16:17:49.092 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025090379999999999 2024-09-12T16:17:49.092 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.092 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.092 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:49.092 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301889+0000", 2024-09-12T16:17:49.092 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5879999999999997e-06 2024-09-12T16:17:49.092 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.092 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.092 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:49.092 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301901+0000", 2024-09-12T16:17:49.093 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1466e-05 2024-09-12T16:17:49.093 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.093 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.093 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:49.093 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301908+0000", 2024-09-12T16:17:49.093 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1999999999999997e-06 2024-09-12T16:17:49.093 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.093 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.093 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:49.093 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360513+0000", 2024-09-12T16:17:49.093 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.058605023999999999 2024-09-12T16:17:49.093 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.093 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.093 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:49.094 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360562+0000", 2024-09-12T16:17:49.094 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9546000000000003e-05 2024-09-12T16:17:49.094 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.094 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.094 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.094 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360633+0000", 2024-09-12T16:17:49.094 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0172000000000005e-05 2024-09-12T16:17:49.094 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.094 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.094 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.094 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.094 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.094 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5759 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4767744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:49.095 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:17:49.095 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 68.690625124999997, 2024-09-12T16:17:49.095 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061058604000000002, 2024-09-12T16:17:49.095 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:49.095 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:49.095 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:49.095 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:49.095 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:49.095 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:49.095 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5759 2024-09-12T16:17:49.095 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.095 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:49.095 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.095 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:49.095 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:17:49.095 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.096 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.096 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.096 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:49.096 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:17:49.096 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.096 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.096 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.096 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:49.096 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302548+0000", 2024-09-12T16:17:49.096 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00038011000000000002 2024-09-12T16:17:49.096 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.096 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.096 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:49.096 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302553+0000", 2024-09-12T16:17:49.096 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1830000000000002e-06 2024-09-12T16:17:49.097 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.097 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.097 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:49.097 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302564+0000", 2024-09-12T16:17:49.097 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1011e-05 2024-09-12T16:17:49.097 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.097 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.097 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:49.097 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302572+0000", 2024-09-12T16:17:49.097 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9009999999999994e-06 2024-09-12T16:17:49.097 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.097 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.097 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:49.098 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363102+0000", 2024-09-12T16:17:49.098 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.060529782999999997 2024-09-12T16:17:49.098 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.098 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.098 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:49.098 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363149+0000", 2024-09-12T16:17:49.098 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7321000000000003e-05 2024-09-12T16:17:49.098 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.098 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.098 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.098 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363227+0000", 2024-09-12T16:17:49.098 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7294999999999998e-05 2024-09-12T16:17:49.098 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.098 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.098 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.099 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.099 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.099 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:49.101 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:17:49.102 INFO:teuthology.orchestra.run.smithi204.stdout:5618 punch from 0x7673200 to 0x767e400, (0xb200 bytes) 2024-09-12T16:17:49.102 INFO:teuthology.orchestra.run.smithi204.stdout:5620 write 0xce80600 thru 0xce8ba3a (0xb43b bytes) 2024-09-12T16:17:49.102 INFO:teuthology.orchestra.run.smithi204.stdout:5621 write 0x56aa200 thru 0x56b3bb7 (0x99b8 bytes) 2024-09-12T16:17:49.103 INFO:teuthology.orchestra.run.smithi204.stdout:5622 read 0xa14d600 thru 0xa156008 (0x8a09 bytes) 2024-09-12T16:17:49.103 INFO:teuthology.orchestra.run.smithi204.stdout:5623 write 0x912c400 thru 0x913a276 (0xde77 bytes) 2024-09-12T16:17:49.103 INFO:teuthology.orchestra.run.smithi204.stdout:5627 read 0xafdde00 thru 0xafdff98 (0x2199 bytes) 2024-09-12T16:17:49.103 INFO:teuthology.orchestra.run.smithi204.stdout:5628 read 0x300fe00 thru 0x301af72 (0xb173 bytes) 2024-09-12T16:17:49.103 INFO:teuthology.orchestra.run.smithi204.stdout:5629 punch from 0xd01a00 to 0xd0cc00, (0xb200 bytes) 2024-09-12T16:17:49.103 INFO:teuthology.orchestra.run.smithi204.stdout:5630 read 0xc5e400 thru 0xc6d836 (0xf437 bytes) 2024-09-12T16:17:49.103 INFO:teuthology.orchestra.run.smithi204.stdout:5631 write 0xa6d5200 thru 0xa6dda8a (0x888b bytes) 2024-09-12T16:17:49.103 INFO:teuthology.orchestra.run.smithi204.stdout:5632 write 0x878ae00 thru 0x8791e85 (0x7086 bytes) 2024-09-12T16:17:49.103 INFO:teuthology.orchestra.run.smithi204.stdout:5633 write 0x4cfb800 thru 0x4cfcd95 (0x1596 bytes) 2024-09-12T16:17:49.103 INFO:teuthology.orchestra.run.smithi204.stdout:5635 read 0x85f0800 thru 0x85fa3bd (0x9bbe bytes) 2024-09-12T16:17:49.103 INFO:teuthology.orchestra.run.smithi204.stdout:5636 trunc from 0xce8bc00 to 0xe340200 2024-09-12T16:17:49.104 INFO:teuthology.orchestra.run.smithi204.stdout:5639 read 0x15ff000 thru 0x1609d2c (0xad2d bytes) 2024-09-12T16:17:49.104 INFO:teuthology.orchestra.run.smithi204.stdout:5641 write 0x8f8c400 thru 0x8f8cf29 (0xb2a bytes) 2024-09-12T16:17:49.104 INFO:teuthology.orchestra.run.smithi204.stdout:5642 punch from 0x1c04c00 to 0x1c10000, (0xb400 bytes) 2024-09-12T16:17:49.104 INFO:teuthology.orchestra.run.smithi204.stdout:5643 clone 38 order 20 su 4096 sc 12 2024-09-12T16:17:49.105 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:49.099+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:49.200 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:49.199+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:49.236 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:49.236 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:49.236 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:17:49.236 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:49.247 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:17:49.302 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:49.301+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:49.339 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T16:17:49.395 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T16:17:49.402 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:49.401+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:49.417 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:49.417 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:49.418 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:17:49.418 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:17:49.418 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:49.428 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:17:49.494 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:17:49.495 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:17:49.511 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:49.510+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:49.517 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:17:49.518 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:17:49.541 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:17:49.541 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:17:49.565 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:17:49.565 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:17:49.587 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:17:49.587 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:17:49.588 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:49.588 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:17:49.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:17:49.589 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:17:49.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.589 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.17 73/72 [PushOp(3:e9340267:::rbd_data.1155525b14e3.0000000000000031:f, version: 50'357, data_included: [0~4096,20480~4096,40960~8192,65536~4096,81920~8192,110592~4096,126976~8192,151552~4096,172032~8192,196608~4096,212992~8192,241664~4096,258048~8192,282624~4096,303104~8192,327680~4096,344064~8192,372736~4096,389120~8192,413696~4096,434176~8192,458752~4096,475136~8192,503808~4096,520192~8192,544768~4096,565248~8192,589824~4096,606208~8192,634880~4096,651264~8192,675840~4096,696320~8192,720896~4096,737280~8192,765952~4096,782336~8192,806912~4096,827392~8192,851968~4096,868352~8192,897024~4096,913408~8192,937984~4096,958464~8192,983040~4096,999424~8192,1028096~4096,1044480~4096], data_size: 294912, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:e9340267:::rbd_data.1155525b14e3.0000000000000031:f@50'357, size: 1048576, copy_subset: [(0, 1048576)], clone_subset: {}, snapset: f=[]:{f: [f]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T16:17:49.589 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.067448+0000", 2024-09-12T16:17:49.589 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 43.519018686000003, 2024-09-12T16:17:49.589 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003036721, 2024-09-12T16:17:49.589 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:49.589 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:49.589 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:49.589 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:49.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.589 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:49.589 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067448+0000", 2024-09-12T16:17:49.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:49.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067448+0000", 2024-09-12T16:17:49.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:49.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067449+0000", 2024-09-12T16:17:49.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2200000000000004e-07 2024-09-12T16:17:49.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067703+0000", 2024-09-12T16:17:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025377199999999998 2024-09-12T16:17:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067723+0000", 2024-09-12T16:17:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.986e-05 2024-09-12T16:17:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067743+0000", 2024-09-12T16:17:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9942e-05 2024-09-12T16:17:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:49.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067860+0000", 2024-09-12T16:17:49.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000116959 2024-09-12T16:17:49.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:49.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067872+0000", 2024-09-12T16:17:49.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2928000000000001e-05 2024-09-12T16:17:49.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.593 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.070485+0000", 2024-09-12T16:17:49.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0026127379999999999 2024-09-12T16:17:49.593 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.593 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.593 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.593 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5120.0:3941 3.17 e80/74 3:eff97428:::rbd_data.1155a3b3a26e.0000000000000060:head v 80'442, mlcod=79'439)", 2024-09-12T16:17:49.593 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:17:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 33.230678204999997, 2024-09-12T16:17:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0035981759999999998, 2024-09-12T16:17:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:17:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:17:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:17:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2e-07 2024-09-12T16:17:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355794+0000", 2024-09-12T16:17:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.865e-06 2024-09-12T16:17:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355956+0000", 2024-09-12T16:17:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016131699999999999 2024-09-12T16:17:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355964+0000", 2024-09-12T16:17:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7960000000000001e-06 2024-09-12T16:17:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.356320+0000", 2024-09-12T16:17:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000355612 2024-09-12T16:17:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.356337+0000", 2024-09-12T16:17:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6643e-05 2024-09-12T16:17:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.359340+0000", 2024-09-12T16:17:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003003618 2024-09-12T16:17:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.359387+0000", 2024-09-12T16:17:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6904999999999999e-05 2024-09-12T16:17:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2118 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1219, mlcod=88'1217)", 2024-09-12T16:17:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440434+0000", 2024-09-12T16:17:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 24.146033315, 2024-09-12T16:17:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003875543, 2024-09-12T16:17:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440434+0000", 2024-09-12T16:17:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:49.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440434+0000", 2024-09-12T16:17:49.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:49.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440435+0000", 2024-09-12T16:17:49.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8899999999999998e-07 2024-09-12T16:17:49.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440444+0000", 2024-09-12T16:17:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4599999999999992e-06 2024-09-12T16:17:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440459+0000", 2024-09-12T16:17:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4460999999999999e-05 2024-09-12T16:17:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440466+0000", 2024-09-12T16:17:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4340000000000003e-06 2024-09-12T16:17:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:17:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9054999999999997e-05 2024-09-12T16:17:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440535+0000", 2024-09-12T16:17:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.98e-05 2024-09-12T16:17:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444269+0000", 2024-09-12T16:17:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003734448 2024-09-12T16:17:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444309+0000", 2024-09-12T16:17:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0095999999999997e-05 2024-09-12T16:17:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2122 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1220, mlcod=88'1217)", 2024-09-12T16:17:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440484+0000", 2024-09-12T16:17:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 24.145982808999999, 2024-09-12T16:17:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0038538029999999998, 2024-09-12T16:17:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440484+0000", 2024-09-12T16:17:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:49.604 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440484+0000", 2024-09-12T16:17:49.604 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.604 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:49.604 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440485+0000", 2024-09-12T16:17:49.604 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6100000000000002e-07 2024-09-12T16:17:49.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.604 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:49.604 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440493+0000", 2024-09-12T16:17:49.604 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0169999999999996e-06 2024-09-12T16:17:49.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.605 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:49.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440501+0000", 2024-09-12T16:17:49.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9319999999999996e-06 2024-09-12T16:17:49.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.605 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:49.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440506+0000", 2024-09-12T16:17:49.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3510000000000001e-06 2024-09-12T16:17:49.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:49.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441319+0000", 2024-09-12T16:17:49.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00081295300000000005 2024-09-12T16:17:49.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:49.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441336+0000", 2024-09-12T16:17:49.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6897000000000001e-05 2024-09-12T16:17:49.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:49.608 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444311+0000", 2024-09-12T16:17:49.608 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029754510000000001 2024-09-12T16:17:49.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.608 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.608 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444338+0000", 2024-09-12T16:17:49.608 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6840999999999999e-05 2024-09-12T16:17:49.608 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.608 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.608 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.609 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2124 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1221, mlcod=88'1217)", 2024-09-12T16:17:49.609 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:17:49.609 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 24.145952236999999, 2024-09-12T16:17:49.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0038507229999999999, 2024-09-12T16:17:49.609 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:49.609 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:49.609 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:49.609 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:49.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:49.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:17:49.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:49.610 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:17:49.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.610 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:49.610 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:17:49.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8799999999999998e-07 2024-09-12T16:17:49.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.610 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:49.610 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440519+0000", 2024-09-12T16:17:49.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5499999999999999e-06 2024-09-12T16:17:49.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.610 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:49.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440525+0000", 2024-09-12T16:17:49.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1009999999999997e-06 2024-09-12T16:17:49.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.611 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:49.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440529+0000", 2024-09-12T16:17:49.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3749999999999996e-06 2024-09-12T16:17:49.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.611 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:49.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441883+0000", 2024-09-12T16:17:49.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0013538249999999999 2024-09-12T16:17:49.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.611 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:49.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441901+0000", 2024-09-12T16:17:49.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7972999999999999e-05 2024-09-12T16:17:49.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:49.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444341+0000", 2024-09-12T16:17:49.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002439568 2024-09-12T16:17:49.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444366+0000", 2024-09-12T16:17:49.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5043000000000001e-05 2024-09-12T16:17:49.612 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.612 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.612 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.613 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.613 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2327 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1222, mlcod=88'1217)", 2024-09-12T16:17:49.613 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440696+0000", 2024-09-12T16:17:49.613 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 24.145770894999998, 2024-09-12T16:17:49.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0036945739999999999, 2024-09-12T16:17:49.613 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:49.613 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:49.613 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:49.613 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:49.613 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.613 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:49.613 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440696+0000", 2024-09-12T16:17:49.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.613 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.613 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:49.614 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440696+0000", 2024-09-12T16:17:49.614 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.614 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:49.614 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440697+0000", 2024-09-12T16:17:49.614 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5899999999999996e-07 2024-09-12T16:17:49.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.614 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:49.614 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440702+0000", 2024-09-12T16:17:49.614 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0969999999999996e-06 2024-09-12T16:17:49.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.614 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:49.614 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440713+0000", 2024-09-12T16:17:49.615 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1114000000000001e-05 2024-09-12T16:17:49.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.615 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.615 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:49.615 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440719+0000", 2024-09-12T16:17:49.615 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1650000000000003e-06 2024-09-12T16:17:49.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.615 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.615 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:49.615 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.442435+0000", 2024-09-12T16:17:49.615 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017155440000000001 2024-09-12T16:17:49.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.615 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.615 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:49.615 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.442457+0000", 2024-09-12T16:17:49.615 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1793999999999998e-05 2024-09-12T16:17:49.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.616 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:49.616 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444367+0000", 2024-09-12T16:17:49.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0019101980000000001 2024-09-12T16:17:49.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.616 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.616 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444391+0000", 2024-09-12T16:17:49.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4003e-05 2024-09-12T16:17:49.616 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.616 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.616 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.617 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2487 3.1d e88/74 3:b8c395a6:::rbd_data.11558d85ce23.000000000000000b:head v 88'1225, mlcod=88'1223)", 2024-09-12T16:17:49.617 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:17:49.617 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 24.140256526000002, 2024-09-12T16:17:49.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033166039999999999, 2024-09-12T16:17:49.617 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:49.617 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:49.617 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:49.617 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:49.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.617 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:49.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:17:49.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.618 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:49.618 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:17:49.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.618 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:49.618 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:17:49.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9299999999999997e-07 2024-09-12T16:17:49.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.618 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:49.618 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446295+0000", 2024-09-12T16:17:49.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3153999999999997e-05 2024-09-12T16:17:49.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.619 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.619 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:49.619 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446309+0000", 2024-09-12T16:17:49.619 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4015e-05 2024-09-12T16:17:49.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.619 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.619 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:49.619 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446317+0000", 2024-09-12T16:17:49.619 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4880000000000007e-06 2024-09-12T16:17:49.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:49.620 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446373+0000", 2024-09-12T16:17:49.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5766000000000001e-05 2024-09-12T16:17:49.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:49.620 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446395+0000", 2024-09-12T16:17:49.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2500000000000001e-05 2024-09-12T16:17:49.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:49.621 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.449445+0000", 2024-09-12T16:17:49.621 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003049791 2024-09-12T16:17:49.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.621 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.621 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.449527+0000", 2024-09-12T16:17:49.621 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2096999999999997e-05 2024-09-12T16:17:49.621 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.621 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.621 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.621 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2493 3.2 e88/74 3:46cb4ff0:::rbd_data.11558d85ce23.000000000000000e:head v 88'372, mlcod=87'370)", 2024-09-12T16:17:49.621 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.447443+0000", 2024-09-12T16:17:49.621 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 24.139024588000002, 2024-09-12T16:17:49.622 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029120330000000001, 2024-09-12T16:17:49.622 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:49.622 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:49.622 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:49.622 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:49.622 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.622 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:49.622 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447443+0000", 2024-09-12T16:17:49.622 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.622 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.622 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:49.622 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447443+0000", 2024-09-12T16:17:49.622 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.623 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:49.623 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447443+0000", 2024-09-12T16:17:49.623 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4600000000000001e-07 2024-09-12T16:17:49.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.623 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:49.623 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447779+0000", 2024-09-12T16:17:49.623 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00033639800000000001 2024-09-12T16:17:49.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.624 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:49.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447790+0000", 2024-09-12T16:17:49.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0555e-05 2024-09-12T16:17:49.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.624 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:49.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447797+0000", 2024-09-12T16:17:49.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1729999999999998e-06 2024-09-12T16:17:49.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.624 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:49.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447862+0000", 2024-09-12T16:17:49.625 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4670000000000003e-05 2024-09-12T16:17:49.625 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.625 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.625 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:49.625 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447889+0000", 2024-09-12T16:17:49.625 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.773e-05 2024-09-12T16:17:49.625 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.625 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.625 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:49.625 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.450311+0000", 2024-09-12T16:17:49.625 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0024212510000000001 2024-09-12T16:17:49.625 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.625 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.625 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.625 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.450355+0000", 2024-09-12T16:17:49.626 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.401e-05 2024-09-12T16:17:49.626 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.626 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.626 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.626 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.626 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "pg_update_log_missing(3.5 epoch 92/74 rep_tid 1618 entries 92'520 (0'0) error 3:a46c381c:::rbd_data.1155c757bf36.000000000000002f:head by client.5577.0:14350 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 92'518)", 2024-09-12T16:17:49.626 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.408248+0000", 2024-09-12T16:17:49.626 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 19.178218707999999, 2024-09-12T16:17:49.626 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029209660000000001, 2024-09-12T16:17:49.626 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:49.626 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:49.626 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "reached pg", 2024-09-12T16:17:49.626 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:49.627 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.627 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:49.627 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408248+0000", 2024-09-12T16:17:49.627 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.627 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.627 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:49.627 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408248+0000", 2024-09-12T16:17:49.627 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.627 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.627 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:49.627 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408249+0000", 2024-09-12T16:17:49.627 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9800000000000002e-07 2024-09-12T16:17:49.628 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.628 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.628 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:49.628 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408259+0000", 2024-09-12T16:17:49.628 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1949999999999992e-06 2024-09-12T16:17:49.628 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.628 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.628 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:49.628 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408278+0000", 2024-09-12T16:17:49.628 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9157e-05 2024-09-12T16:17:49.628 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:49.629 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408291+0000", 2024-09-12T16:17:49.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3655000000000001e-05 2024-09-12T16:17:49.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:49.629 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408369+0000", 2024-09-12T16:17:49.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7804000000000002e-05 2024-09-12T16:17:49.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.629 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411169+0000", 2024-09-12T16:17:49.630 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002800257 2024-09-12T16:17:49.630 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.630 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.630 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.630 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.630 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "pg_update_log_missing(3.1d epoch 92/74 rep_tid 3087 entries 92'1280 (0'0) error 3:bc3c4c0b:::rbd_data.1155c757bf36.000000000000002c:head by client.5577.0:14343 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 90'1278)", 2024-09-12T16:17:49.630 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.408860+0000", 2024-09-12T16:17:49.630 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 19.177607080000001, 2024-09-12T16:17:49.630 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0056480419999999998, 2024-09-12T16:17:49.630 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:49.630 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:49.630 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "reached pg", 2024-09-12T16:17:49.630 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:49.630 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.631 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:49.631 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408860+0000", 2024-09-12T16:17:49.631 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.631 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.631 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.631 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:49.631 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408860+0000", 2024-09-12T16:17:49.631 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.631 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.631 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.631 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:49.631 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408861+0000", 2024-09-12T16:17:49.631 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6600000000000002e-07 2024-09-12T16:17:49.631 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.631 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.632 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:49.632 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408867+0000", 2024-09-12T16:17:49.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4150000000000004e-06 2024-09-12T16:17:49.632 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.632 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.632 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:49.632 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408881+0000", 2024-09-12T16:17:49.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4326e-05 2024-09-12T16:17:49.632 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.632 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.632 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:49.632 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408895+0000", 2024-09-12T16:17:49.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3903000000000001e-05 2024-09-12T16:17:49.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.633 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.633 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:49.633 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410566+0000", 2024-09-12T16:17:49.633 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001670822 2024-09-12T16:17:49.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.633 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.633 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.633 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414508+0000", 2024-09-12T16:17:49.633 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039421100000000004 2024-09-12T16:17:49.633 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.633 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.633 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.634 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.634 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "pg_update_log_missing(3.5 epoch 92/74 rep_tid 1621 entries 92'521 (0'0) error 3:a759f741:::rbd_data.1155c757bf36.0000000000000036:head by client.5577.0:14364 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 92'518)", 2024-09-12T16:17:49.634 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:17:49.634 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 19.176658603, 2024-09-12T16:17:49.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047586740000000001, 2024-09-12T16:17:49.634 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:49.634 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:49.634 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "reached pg", 2024-09-12T16:17:49.634 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:49.634 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.634 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:49.634 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:17:49.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.634 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.635 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:49.635 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:17:49.635 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.635 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.635 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:49.635 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:17:49.635 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.54e-07 2024-09-12T16:17:49.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.635 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.635 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:49.635 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409817+0000", 2024-09-12T16:17:49.635 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.028e-06 2024-09-12T16:17:49.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.635 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.636 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:49.636 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410047+0000", 2024-09-12T16:17:49.636 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022964599999999999 2024-09-12T16:17:49.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.636 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.636 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:49.636 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410067+0000", 2024-09-12T16:17:49.636 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0438999999999999e-05 2024-09-12T16:17:49.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.636 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.636 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:49.636 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411223+0000", 2024-09-12T16:17:49.636 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011560229999999999 2024-09-12T16:17:49.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.637 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.637 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.637 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414567+0000", 2024-09-12T16:17:49.637 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033437839999999998 2024-09-12T16:17:49.637 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.637 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.637 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.637 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.637 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.637 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14391 3.5 e92/74 3:a5105766:::rbd_data.1155c757bf36.0000000000000044:head v 92'523, mlcod=92'518)", 2024-09-12T16:17:49.637 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.410084+0000", 2024-09-12T16:17:49.637 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 19.176382733000001, 2024-09-12T16:17:49.637 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0046720299999999998, 2024-09-12T16:17:49.637 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:49.637 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:49.638 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:49.638 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:49.638 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.638 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:49.638 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410084+0000", 2024-09-12T16:17:49.638 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.638 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.638 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:49.638 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410084+0000", 2024-09-12T16:17:49.638 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.638 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.638 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:49.638 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410085+0000", 2024-09-12T16:17:49.639 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1900000000000002e-07 2024-09-12T16:17:49.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.639 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.639 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:49.639 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410091+0000", 2024-09-12T16:17:49.639 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1e-06 2024-09-12T16:17:49.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.639 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.639 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:49.639 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410100+0000", 2024-09-12T16:17:49.639 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6889999999999993e-06 2024-09-12T16:17:49.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.639 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.639 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:49.639 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410105+0000", 2024-09-12T16:17:49.639 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3199999999999999e-06 2024-09-12T16:17:49.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.640 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.640 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:49.640 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411563+0000", 2024-09-12T16:17:49.640 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00145795 2024-09-12T16:17:49.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.640 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.640 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:49.640 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411590+0000", 2024-09-12T16:17:49.640 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6570000000000001e-05 2024-09-12T16:17:49.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.640 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.640 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:49.640 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414571+0000", 2024-09-12T16:17:49.640 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029815710000000001 2024-09-12T16:17:49.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.641 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.641 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.641 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414756+0000", 2024-09-12T16:17:49.641 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018521100000000001 2024-09-12T16:17:49.641 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.641 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.641 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.641 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.641 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14405 3.5 e92/74 3:a0797093:::rbd_data.1155c757bf36.000000000000004b:head v 92'525, mlcod=92'518)", 2024-09-12T16:17:49.641 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.410119+0000", 2024-09-12T16:17:49.641 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 19.176347793000001, 2024-09-12T16:17:49.641 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047304000000000001, 2024-09-12T16:17:49.642 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:49.642 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:49.642 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:49.642 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:49.642 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.642 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:49.642 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410119+0000", 2024-09-12T16:17:49.642 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.642 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.642 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.642 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:49.642 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410119+0000", 2024-09-12T16:17:49.642 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.643 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.643 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.643 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:49.643 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410120+0000", 2024-09-12T16:17:49.643 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:17:49.643 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.643 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.643 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:49.643 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410126+0000", 2024-09-12T16:17:49.643 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1460000000000001e-06 2024-09-12T16:17:49.643 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.643 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.643 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:49.643 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410134+0000", 2024-09-12T16:17:49.644 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8879999999999997e-06 2024-09-12T16:17:49.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.644 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.644 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:49.644 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410140+0000", 2024-09-12T16:17:49.644 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0839999999999997e-06 2024-09-12T16:17:49.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.644 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.644 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:49.644 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412146+0000", 2024-09-12T16:17:49.644 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0020057569999999999 2024-09-12T16:17:49.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.644 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.645 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:49.645 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412163+0000", 2024-09-12T16:17:49.645 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7742000000000001e-05 2024-09-12T16:17:49.645 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.645 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.645 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:49.645 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414761+0000", 2024-09-12T16:17:49.645 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025979660000000002 2024-09-12T16:17:49.645 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.645 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.645 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.645 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414850+0000", 2024-09-12T16:17:49.645 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8426999999999999e-05 2024-09-12T16:17:49.645 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.645 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.646 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.646 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.646 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.646 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14435 3.1d e92/74 3:b810b250:::rbd_data.1155c757bf36.000000000000010b:head v 92'1282, mlcod=90'1278)", 2024-09-12T16:17:49.646 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:17:49.646 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 19.175505324, 2024-09-12T16:17:49.646 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039190579999999996, 2024-09-12T16:17:49.646 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:49.646 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:49.646 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:49.646 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:49.646 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.646 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:49.646 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:17:49.647 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.647 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.647 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:49.647 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:17:49.647 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.647 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.647 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:49.647 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:17:49.647 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5199999999999996e-07 2024-09-12T16:17:49.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.647 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.648 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:49.648 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410968+0000", 2024-09-12T16:17:49.648 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.305e-06 2024-09-12T16:17:49.648 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.648 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.648 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:49.648 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410986+0000", 2024-09-12T16:17:49.648 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8213999999999999e-05 2024-09-12T16:17:49.648 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.648 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.648 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:49.648 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410993+0000", 2024-09-12T16:17:49.649 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2849999999999997e-06 2024-09-12T16:17:49.649 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.649 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.649 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:49.649 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412228+0000", 2024-09-12T16:17:49.649 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0012347370000000001 2024-09-12T16:17:49.649 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.649 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.649 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:49.649 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412262+0000", 2024-09-12T16:17:49.649 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3531999999999997e-05 2024-09-12T16:17:49.649 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.650 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.650 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:49.650 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414854+0000", 2024-09-12T16:17:49.650 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002592039 2024-09-12T16:17:49.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.650 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.650 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.650 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414881+0000", 2024-09-12T16:17:49.650 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7294e-05 2024-09-12T16:17:49.650 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.650 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.650 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.650 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.651 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14434 3.5 e92/74 3:a09dd60f:::rbd_data.1155c757bf36.000000000000010a:head v 92'527, mlcod=92'518)", 2024-09-12T16:17:49.651 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.411186+0000", 2024-09-12T16:17:49.651 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 19.175281176999999, 2024-09-12T16:17:49.651 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0037696930000000002, 2024-09-12T16:17:49.651 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:49.651 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:49.651 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:49.651 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:49.651 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.651 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:49.651 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411186+0000", 2024-09-12T16:17:49.651 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.651 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.651 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:49.652 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411186+0000", 2024-09-12T16:17:49.652 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.652 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.652 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:49.652 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411187+0000", 2024-09-12T16:17:49.652 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3799999999999997e-07 2024-09-12T16:17:49.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.652 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.652 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:49.652 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411203+0000", 2024-09-12T16:17:49.652 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6793999999999999e-05 2024-09-12T16:17:49.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.653 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.653 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:49.653 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411323+0000", 2024-09-12T16:17:49.653 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011975499999999999 2024-09-12T16:17:49.653 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.653 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.653 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:49.653 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411332+0000", 2024-09-12T16:17:49.653 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4370000000000007e-06 2024-09-12T16:17:49.653 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.653 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.653 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:49.653 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.413073+0000", 2024-09-12T16:17:49.654 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001741827 2024-09-12T16:17:49.654 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.654 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.654 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:49.654 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.413091+0000", 2024-09-12T16:17:49.654 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8011000000000001e-05 2024-09-12T16:17:49.654 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.654 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.654 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:49.654 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414882+0000", 2024-09-12T16:17:49.654 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001790841 2024-09-12T16:17:49.655 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.655 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.655 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.655 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414956+0000", 2024-09-12T16:17:49.655 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.339e-05 2024-09-12T16:17:49.655 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.655 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.655 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.655 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.655 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.655 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14426 3.13 e92/74 3:c827d1d7:::rbd_data.1155c757bf36.0000000000000056:head v 92'741, mlcod=90'737)", 2024-09-12T16:17:49.655 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:17:49.655 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 19.171189263999999, 2024-09-12T16:17:49.656 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030296030000000001, 2024-09-12T16:17:49.656 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:49.656 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:49.656 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:49.656 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:49.656 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.656 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:49.656 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:17:49.656 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.656 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.656 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:49.656 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:17:49.657 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.657 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.657 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:49.657 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:17:49.657 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6300000000000001e-07 2024-09-12T16:17:49.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.657 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.657 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:49.657 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415282+0000", 2024-09-12T16:17:49.657 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6289999999999999e-06 2024-09-12T16:17:49.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.657 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.657 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:49.658 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415288+0000", 2024-09-12T16:17:49.658 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5520000000000001e-06 2024-09-12T16:17:49.658 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.658 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.658 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:49.658 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415293+0000", 2024-09-12T16:17:49.658 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6879999999999998e-06 2024-09-12T16:17:49.658 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.658 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.658 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:49.658 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415412+0000", 2024-09-12T16:17:49.658 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118579 2024-09-12T16:17:49.658 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.658 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.659 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:49.659 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415429+0000", 2024-09-12T16:17:49.659 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7501000000000001e-05 2024-09-12T16:17:49.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.659 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.659 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:49.659 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.418270+0000", 2024-09-12T16:17:49.659 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028404860000000001 2024-09-12T16:17:49.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.659 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.659 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.659 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.418307+0000", 2024-09-12T16:17:49.659 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7805000000000001e-05 2024-09-12T16:17:49.659 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.660 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.660 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.660 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.660 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.660 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14399 3.16 e92/75 3:6e4c3dfc:::rbd_data.1155c757bf36.0000000000000048:head v 92'1286, mlcod=90'1280)", 2024-09-12T16:17:49.660 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.415311+0000", 2024-09-12T16:17:49.660 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 19.17115635, 2024-09-12T16:17:49.660 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028826809999999998, 2024-09-12T16:17:49.660 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:49.660 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:49.660 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:49.660 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:49.660 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.661 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:49.661 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415311+0000", 2024-09-12T16:17:49.661 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.661 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.661 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:49.661 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415311+0000", 2024-09-12T16:17:49.661 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.661 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.661 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:49.661 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415311+0000", 2024-09-12T16:17:49.661 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0600000000000001e-07 2024-09-12T16:17:49.662 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.662 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.662 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:49.662 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415315+0000", 2024-09-12T16:17:49.662 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.172e-06 2024-09-12T16:17:49.662 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.662 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.662 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:49.662 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415322+0000", 2024-09-12T16:17:49.662 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0999999999999998e-06 2024-09-12T16:17:49.662 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.662 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.662 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:49.662 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415327+0000", 2024-09-12T16:17:49.662 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6430000000000003e-06 2024-09-12T16:17:49.662 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.663 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.663 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:49.663 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.416666+0000", 2024-09-12T16:17:49.663 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001338718 2024-09-12T16:17:49.663 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.663 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.663 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:49.663 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.416683+0000", 2024-09-12T16:17:49.663 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7628000000000001e-05 2024-09-12T16:17:49.663 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.663 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.663 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:49.663 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.418128+0000", 2024-09-12T16:17:49.663 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0014445440000000001 2024-09-12T16:17:49.664 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.664 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.664 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.664 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.418193+0000", 2024-09-12T16:17:49.664 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5569999999999997e-05 2024-09-12T16:17:49.664 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.664 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.664 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.664 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.664 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.664 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5384.0:1241 3.16 e95/75 3:6ee670ce:::rbd_data.1155b9894cdc.0000000000000005:head v 95'1303, mlcod=95'1301)", 2024-09-12T16:17:49.664 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:35.272164+0000", 2024-09-12T16:17:49.665 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.314303408000001, 2024-09-12T16:17:49.665 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015008743, 2024-09-12T16:17:49.665 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:49.665 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:49.665 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:49.665 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:49.665 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.665 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:49.665 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.272164+0000", 2024-09-12T16:17:49.665 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.665 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.665 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.665 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:49.666 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.272164+0000", 2024-09-12T16:17:49.666 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.666 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.666 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.666 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:49.666 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.272165+0000", 2024-09-12T16:17:49.666 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.311e-06 2024-09-12T16:17:49.666 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.666 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.666 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:49.666 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275503+0000", 2024-09-12T16:17:49.666 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003337881 2024-09-12T16:17:49.666 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.666 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.666 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:49.667 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275530+0000", 2024-09-12T16:17:49.667 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6797000000000001e-05 2024-09-12T16:17:49.667 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.667 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.667 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:49.667 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275541+0000", 2024-09-12T16:17:49.667 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1634000000000001e-05 2024-09-12T16:17:49.667 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.667 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.667 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:49.667 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275618+0000", 2024-09-12T16:17:49.667 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6811999999999996e-05 2024-09-12T16:17:49.668 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.668 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.668 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:49.668 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275642+0000", 2024-09-12T16:17:49.668 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4111999999999999e-05 2024-09-12T16:17:49.668 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.668 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.668 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:49.668 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287116+0000", 2024-09-12T16:17:49.668 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01147395 2024-09-12T16:17:49.668 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.668 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.668 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.668 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287172+0000", 2024-09-12T16:17:49.669 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6246000000000003e-05 2024-09-12T16:17:49.669 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.669 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.669 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.669 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.669 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.669 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5384.0:1246 3.f e95/74 3:f0725c44:::rbd_data.1155b9894cdc.0000000000000006:head v 95'356, mlcod=95'354)", 2024-09-12T16:17:49.669 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:35.276304+0000", 2024-09-12T16:17:49.669 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.310163481, 2024-09-12T16:17:49.669 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011209733, 2024-09-12T16:17:49.669 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:49.669 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:49.669 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:49.669 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:49.670 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.670 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:49.670 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.276304+0000", 2024-09-12T16:17:49.670 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.670 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.670 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.670 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:49.670 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.276304+0000", 2024-09-12T16:17:49.670 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.670 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.670 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.670 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:49.670 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.276305+0000", 2024-09-12T16:17:49.670 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2500000000000001e-06 2024-09-12T16:17:49.670 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.671 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.671 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:49.671 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279256+0000", 2024-09-12T16:17:49.671 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002951076 2024-09-12T16:17:49.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.671 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.671 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:49.671 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279281+0000", 2024-09-12T16:17:49.671 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4779000000000001e-05 2024-09-12T16:17:49.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.671 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.671 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:49.671 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279294+0000", 2024-09-12T16:17:49.672 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3614e-05 2024-09-12T16:17:49.672 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.672 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.672 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:49.672 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279366+0000", 2024-09-12T16:17:49.672 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2094000000000005e-05 2024-09-12T16:17:49.672 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.672 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.672 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:49.672 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279395+0000", 2024-09-12T16:17:49.672 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8337999999999999e-05 2024-09-12T16:17:49.672 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.672 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.672 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:49.673 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287479+0000", 2024-09-12T16:17:49.673 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0080844799999999998 2024-09-12T16:17:49.673 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.673 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.673 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.673 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287513+0000", 2024-09-12T16:17:49.673 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4102e-05 2024-09-12T16:17:49.673 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.673 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.673 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.673 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.673 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.673 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5578.0:2433 3.16 e98/75 3:691860ab:::rbd_data.11557f9bd67f.0000000000000014:head v 98'1330, mlcod=97'1328)", 2024-09-12T16:17:49.673 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:38.524867+0000", 2024-09-12T16:17:49.674 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 11.061599856000001, 2024-09-12T16:17:49.674 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028147279999999998, 2024-09-12T16:17:49.674 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:49.674 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:49.674 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:49.674 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:49.674 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.674 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:49.674 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.524867+0000", 2024-09-12T16:17:49.674 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.674 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.674 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.674 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:49.674 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.524867+0000", 2024-09-12T16:17:49.674 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:49.675 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.675 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.675 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:49.675 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.524868+0000", 2024-09-12T16:17:49.675 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4600000000000003e-07 2024-09-12T16:17:49.675 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.675 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.675 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:49.675 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.525251+0000", 2024-09-12T16:17:49.675 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00038322299999999997 2024-09-12T16:17:49.675 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.675 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.675 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:49.676 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.525266+0000", 2024-09-12T16:17:49.676 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4934e-05 2024-09-12T16:17:49.676 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.676 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.676 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:49.676 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.525274+0000", 2024-09-12T16:17:49.676 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.328e-06 2024-09-12T16:17:49.676 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.676 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.676 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:49.676 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.525363+0000", 2024-09-12T16:17:49.676 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9149999999999999e-05 2024-09-12T16:17:49.676 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.677 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.677 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:49.677 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.525383+0000", 2024-09-12T16:17:49.677 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0197e-05 2024-09-12T16:17:49.677 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.677 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.677 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:49.677 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.527638+0000", 2024-09-12T16:17:49.677 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0022551210000000001 2024-09-12T16:17:49.677 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:49.677 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:49.678 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:49.678 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.527682+0000", 2024-09-12T16:17:49.678 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3928999999999999e-05 2024-09-12T16:17:49.678 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.678 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.678 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.678 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:49.678 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:49.678 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:49.679 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:17:49.681 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:17:49.681 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:17:49.681 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:49.678+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:49.780 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:49.780+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:49.859 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:49.859 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:49.871 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:17:49.880 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:49.880+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:49.981 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:49.980+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:49.992 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:49.992 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:50.002 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:17:50.009 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-12T16:17:50.082 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:50.082+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:50.124 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:50.125 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:50.134 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:17:50.183 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:50.182+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:50.243 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:50.243 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:50.252 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:17:50.284 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:50.284+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:50.386 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:50.385+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:50.399 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:50.399 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:50.408 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:17:50.492 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:50.491+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:50.555 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:50.555 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:50.564 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:17:50.605 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:50.604+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:50.689 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:50.688+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:50.711 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:50.712 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:50.720 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:17:50.789 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:50.788+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:50.827 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:50.828 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:50.836 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:17:50.890 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:50.890+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:50.986 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:50.986 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:50.991 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:50.990+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:50.994 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:17:51.075 INFO:teuthology.orchestra.run.smithi204.stdout:truncating image image_client.0-clone37 from 0xe340200 (overlap 0xf7b600) to 0xc62a00 2024-09-12T16:17:51.091 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:51.091+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:51.133 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:51.133 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:51.142 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:17:51.192 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:51.191+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:51.250 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:51.250 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:51.258 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:17:51.293 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:51.292+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:51.394 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:51.394+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:51.405 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:51.405 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:51.413 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:17:51.496 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:51.495+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:51.521 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:51.521 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:51.529 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:17:51.596 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:51.596+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:51.636 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:51.636 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:51.644 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:17:51.682 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T16:17:51.727 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:51.726+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:51.752 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:51.752 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:51.760 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:17:51.797 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:51.797+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:51.818 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:17:51.818 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:17:51.835 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:17:51.836 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:17:51.852 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:17:51.852 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:17:51.867 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:51.867 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:51.869 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:17:51.869 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:17:51.876 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:17:51.885 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:17:51.886 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:17:51.902 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:17:51.902 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:17:51.920 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:51.920+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:51.982 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:51.982 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:51.982 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:17:51.983 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:17:51.983 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:51.991 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:17:52.029 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T16:17:52.032 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:52.032+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:52.101 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:52.101+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:52.142 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:52.142 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:17:52.142 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:17:52.142 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:17:52.142 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.142 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.17 73/72 [PushOp(3:e9340267:::rbd_data.1155525b14e3.0000000000000031:f, version: 50'357, data_included: [0~4096,20480~4096,40960~8192,65536~4096,81920~8192,110592~4096,126976~8192,151552~4096,172032~8192,196608~4096,212992~8192,241664~4096,258048~8192,282624~4096,303104~8192,327680~4096,344064~8192,372736~4096,389120~8192,413696~4096,434176~8192,458752~4096,475136~8192,503808~4096,520192~8192,544768~4096,565248~8192,589824~4096,606208~8192,634880~4096,651264~8192,675840~4096,696320~8192,720896~4096,737280~8192,765952~4096,782336~8192,806912~4096,827392~8192,851968~4096,868352~8192,897024~4096,913408~8192,937984~4096,958464~8192,983040~4096,999424~8192,1028096~4096,1044480~4096], data_size: 294912, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:e9340267:::rbd_data.1155525b14e3.0000000000000031:f@50'357, size: 1048576, copy_subset: [(0, 1048576)], clone_subset: {}, snapset: f=[]:{f: [f]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T16:17:52.143 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.067448+0000", 2024-09-12T16:17:52.143 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 46.07323126, 2024-09-12T16:17:52.143 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003036721, 2024-09-12T16:17:52.143 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:52.143 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:52.143 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:52.143 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:52.143 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.143 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:52.143 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067448+0000", 2024-09-12T16:17:52.143 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.143 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.143 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.143 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:52.143 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067448+0000", 2024-09-12T16:17:52.144 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.144 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.144 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.144 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:52.144 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067449+0000", 2024-09-12T16:17:52.144 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2200000000000004e-07 2024-09-12T16:17:52.144 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.144 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.144 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:52.144 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067703+0000", 2024-09-12T16:17:52.144 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025377199999999998 2024-09-12T16:17:52.144 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.144 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.144 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:52.145 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067723+0000", 2024-09-12T16:17:52.145 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.986e-05 2024-09-12T16:17:52.145 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.145 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.145 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.145 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067743+0000", 2024-09-12T16:17:52.145 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9942e-05 2024-09-12T16:17:52.145 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.145 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.145 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:52.145 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067860+0000", 2024-09-12T16:17:52.145 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000116959 2024-09-12T16:17:52.145 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.146 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.146 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:52.146 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067872+0000", 2024-09-12T16:17:52.146 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2928000000000001e-05 2024-09-12T16:17:52.146 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.146 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.146 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:52.146 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.070485+0000", 2024-09-12T16:17:52.146 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0026127379999999999 2024-09-12T16:17:52.146 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.146 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:52.146 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.146 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.147 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.147 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5120.0:3941 3.17 e80/74 3:eff97428:::rbd_data.1155a3b3a26e.0000000000000060:head v 80'442, mlcod=79'439)", 2024-09-12T16:17:52.147 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:17:52.147 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 35.784890779000001, 2024-09-12T16:17:52.147 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0035981759999999998, 2024-09-12T16:17:52.147 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:52.147 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:52.147 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:52.147 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:52.147 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.147 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:52.147 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:17:52.147 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.147 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.148 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.148 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:52.148 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:17:52.148 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.148 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.148 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.148 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:52.148 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:17:52.148 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2e-07 2024-09-12T16:17:52.148 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.148 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.148 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:52.148 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355794+0000", 2024-09-12T16:17:52.149 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.865e-06 2024-09-12T16:17:52.149 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.149 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.149 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:52.149 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355956+0000", 2024-09-12T16:17:52.149 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016131699999999999 2024-09-12T16:17:52.149 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.149 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.149 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.149 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355964+0000", 2024-09-12T16:17:52.149 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7960000000000001e-06 2024-09-12T16:17:52.149 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.149 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.150 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:52.150 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.356320+0000", 2024-09-12T16:17:52.150 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000355612 2024-09-12T16:17:52.150 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.150 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.150 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:52.150 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.356337+0000", 2024-09-12T16:17:52.150 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6643e-05 2024-09-12T16:17:52.150 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.150 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.150 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:52.150 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.359340+0000", 2024-09-12T16:17:52.151 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003003618 2024-09-12T16:17:52.151 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.151 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.151 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:52.151 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.359387+0000", 2024-09-12T16:17:52.151 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6904999999999999e-05 2024-09-12T16:17:52.151 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.151 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:52.151 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.151 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.151 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.151 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2118 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1219, mlcod=88'1217)", 2024-09-12T16:17:52.151 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440434+0000", 2024-09-12T16:17:52.152 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 26.700245889000001, 2024-09-12T16:17:52.152 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003875543, 2024-09-12T16:17:52.152 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:52.152 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:52.152 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:52.152 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:52.152 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.152 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:52.152 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440434+0000", 2024-09-12T16:17:52.152 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.152 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.152 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.152 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:52.152 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440434+0000", 2024-09-12T16:17:52.153 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.153 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.153 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.153 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:52.153 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440435+0000", 2024-09-12T16:17:52.153 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8899999999999998e-07 2024-09-12T16:17:52.153 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.153 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.153 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:52.153 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440444+0000", 2024-09-12T16:17:52.153 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4599999999999992e-06 2024-09-12T16:17:52.153 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.153 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.153 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:52.154 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440459+0000", 2024-09-12T16:17:52.154 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4460999999999999e-05 2024-09-12T16:17:52.154 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.154 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.154 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.154 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440466+0000", 2024-09-12T16:17:52.154 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4340000000000003e-06 2024-09-12T16:17:52.154 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.154 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.154 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:52.154 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:17:52.154 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9054999999999997e-05 2024-09-12T16:17:52.154 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.154 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.155 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:52.155 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440535+0000", 2024-09-12T16:17:52.155 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.98e-05 2024-09-12T16:17:52.155 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.155 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.155 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:52.155 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444269+0000", 2024-09-12T16:17:52.155 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003734448 2024-09-12T16:17:52.155 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.155 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.155 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:52.155 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444309+0000", 2024-09-12T16:17:52.155 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0095999999999997e-05 2024-09-12T16:17:52.155 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.156 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:52.156 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.156 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.156 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.156 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2122 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1220, mlcod=88'1217)", 2024-09-12T16:17:52.156 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440484+0000", 2024-09-12T16:17:52.156 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 26.700195383000001, 2024-09-12T16:17:52.156 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0038538029999999998, 2024-09-12T16:17:52.156 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:52.156 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:52.156 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:52.156 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:52.156 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.156 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:52.157 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440484+0000", 2024-09-12T16:17:52.157 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.157 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.157 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.157 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:52.157 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440484+0000", 2024-09-12T16:17:52.157 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.157 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.157 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.157 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:52.157 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440485+0000", 2024-09-12T16:17:52.157 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6100000000000002e-07 2024-09-12T16:17:52.157 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.157 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.158 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:52.158 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440493+0000", 2024-09-12T16:17:52.158 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0169999999999996e-06 2024-09-12T16:17:52.158 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.158 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.158 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:52.158 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440501+0000", 2024-09-12T16:17:52.158 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9319999999999996e-06 2024-09-12T16:17:52.158 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.158 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.158 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.158 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440506+0000", 2024-09-12T16:17:52.158 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3510000000000001e-06 2024-09-12T16:17:52.158 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.159 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.159 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:52.159 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441319+0000", 2024-09-12T16:17:52.159 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00081295300000000005 2024-09-12T16:17:52.159 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.159 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.159 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:52.159 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441336+0000", 2024-09-12T16:17:52.159 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6897000000000001e-05 2024-09-12T16:17:52.159 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.159 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.159 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:52.159 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444311+0000", 2024-09-12T16:17:52.160 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029754510000000001 2024-09-12T16:17:52.160 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.160 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.160 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:52.160 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444338+0000", 2024-09-12T16:17:52.160 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6840999999999999e-05 2024-09-12T16:17:52.160 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.160 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:52.160 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.160 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.160 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.160 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2124 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1221, mlcod=88'1217)", 2024-09-12T16:17:52.160 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:17:52.160 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 26.700164811, 2024-09-12T16:17:52.161 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0038507229999999999, 2024-09-12T16:17:52.161 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:52.161 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:52.161 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:52.161 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:52.161 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.161 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:52.161 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:17:52.161 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.161 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.161 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.161 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:52.161 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:17:52.161 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.161 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.161 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.162 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:52.162 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:17:52.162 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8799999999999998e-07 2024-09-12T16:17:52.162 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.162 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.162 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:52.162 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440519+0000", 2024-09-12T16:17:52.162 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5499999999999999e-06 2024-09-12T16:17:52.162 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.162 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.162 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:52.162 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440525+0000", 2024-09-12T16:17:52.162 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1009999999999997e-06 2024-09-12T16:17:52.162 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.163 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.163 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.163 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440529+0000", 2024-09-12T16:17:52.163 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3749999999999996e-06 2024-09-12T16:17:52.163 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.163 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.163 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:52.163 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441883+0000", 2024-09-12T16:17:52.163 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0013538249999999999 2024-09-12T16:17:52.163 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.164 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.164 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:52.164 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441901+0000", 2024-09-12T16:17:52.164 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7972999999999999e-05 2024-09-12T16:17:52.164 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.164 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.164 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:52.164 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444341+0000", 2024-09-12T16:17:52.164 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002439568 2024-09-12T16:17:52.164 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.164 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.164 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:52.164 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444366+0000", 2024-09-12T16:17:52.165 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5043000000000001e-05 2024-09-12T16:17:52.165 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.165 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:52.165 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.165 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.165 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.165 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2327 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1222, mlcod=88'1217)", 2024-09-12T16:17:52.165 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440696+0000", 2024-09-12T16:17:52.165 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 26.699983468999999, 2024-09-12T16:17:52.165 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0036945739999999999, 2024-09-12T16:17:52.165 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:52.165 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:52.165 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:52.166 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:52.166 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.166 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:52.166 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440696+0000", 2024-09-12T16:17:52.166 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.166 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.166 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.166 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:52.166 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440696+0000", 2024-09-12T16:17:52.166 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.166 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.166 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.166 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:52.167 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440697+0000", 2024-09-12T16:17:52.167 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5899999999999996e-07 2024-09-12T16:17:52.167 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.167 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.167 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:52.167 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440702+0000", 2024-09-12T16:17:52.167 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0969999999999996e-06 2024-09-12T16:17:52.167 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.167 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.167 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:52.167 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440713+0000", 2024-09-12T16:17:52.167 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1114000000000001e-05 2024-09-12T16:17:52.167 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.167 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.167 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.168 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440719+0000", 2024-09-12T16:17:52.168 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1650000000000003e-06 2024-09-12T16:17:52.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.168 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.168 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:52.168 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.442435+0000", 2024-09-12T16:17:52.168 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017155440000000001 2024-09-12T16:17:52.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.168 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.168 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:52.168 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.442457+0000", 2024-09-12T16:17:52.168 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1793999999999998e-05 2024-09-12T16:17:52.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.169 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.169 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:52.169 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444367+0000", 2024-09-12T16:17:52.169 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0019101980000000001 2024-09-12T16:17:52.169 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.169 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.169 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:52.169 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444391+0000", 2024-09-12T16:17:52.169 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4003e-05 2024-09-12T16:17:52.169 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.169 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:52.169 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.169 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.170 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.170 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2487 3.1d e88/74 3:b8c395a6:::rbd_data.11558d85ce23.000000000000000b:head v 88'1225, mlcod=88'1223)", 2024-09-12T16:17:52.170 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:17:52.170 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 26.694469099999999, 2024-09-12T16:17:52.170 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033166039999999999, 2024-09-12T16:17:52.170 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:52.170 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:52.170 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:52.170 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:52.170 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.170 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:52.170 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:17:52.170 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.170 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.171 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.171 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:52.171 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:17:52.171 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.171 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.171 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.171 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:52.171 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:17:52.171 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9299999999999997e-07 2024-09-12T16:17:52.171 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.171 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.171 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:52.171 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446295+0000", 2024-09-12T16:17:52.171 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3153999999999997e-05 2024-09-12T16:17:52.172 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.172 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.172 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:52.172 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446309+0000", 2024-09-12T16:17:52.172 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4015e-05 2024-09-12T16:17:52.172 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.172 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.172 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.172 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446317+0000", 2024-09-12T16:17:52.172 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4880000000000007e-06 2024-09-12T16:17:52.172 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.172 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.172 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:52.172 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446373+0000", 2024-09-12T16:17:52.173 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5766000000000001e-05 2024-09-12T16:17:52.173 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.173 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.173 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:52.173 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446395+0000", 2024-09-12T16:17:52.173 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2500000000000001e-05 2024-09-12T16:17:52.173 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.173 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.173 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:52.174 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.449445+0000", 2024-09-12T16:17:52.174 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003049791 2024-09-12T16:17:52.174 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.174 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.174 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:52.174 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.449527+0000", 2024-09-12T16:17:52.174 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2096999999999997e-05 2024-09-12T16:17:52.174 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.174 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:52.174 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.174 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.174 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.175 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2493 3.2 e88/74 3:46cb4ff0:::rbd_data.11558d85ce23.000000000000000e:head v 88'372, mlcod=87'370)", 2024-09-12T16:17:52.175 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.447443+0000", 2024-09-12T16:17:52.175 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 26.693237161999999, 2024-09-12T16:17:52.175 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029120330000000001, 2024-09-12T16:17:52.175 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:52.175 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:52.175 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:52.175 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:52.175 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.175 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:52.175 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447443+0000", 2024-09-12T16:17:52.175 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.175 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.176 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.176 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:52.176 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447443+0000", 2024-09-12T16:17:52.176 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.176 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.176 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.176 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:52.176 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447443+0000", 2024-09-12T16:17:52.176 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4600000000000001e-07 2024-09-12T16:17:52.176 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.176 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.176 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:52.176 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447779+0000", 2024-09-12T16:17:52.176 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00033639800000000001 2024-09-12T16:17:52.177 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.177 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.177 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:52.177 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447790+0000", 2024-09-12T16:17:52.177 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0555e-05 2024-09-12T16:17:52.177 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.177 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.177 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.177 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447797+0000", 2024-09-12T16:17:52.177 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1729999999999998e-06 2024-09-12T16:17:52.177 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.177 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.177 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:52.177 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447862+0000", 2024-09-12T16:17:52.177 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4670000000000003e-05 2024-09-12T16:17:52.178 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.178 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.178 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:52.178 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447889+0000", 2024-09-12T16:17:52.178 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.773e-05 2024-09-12T16:17:52.178 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.178 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.178 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:52.178 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.450311+0000", 2024-09-12T16:17:52.178 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0024212510000000001 2024-09-12T16:17:52.178 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.178 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.178 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:52.178 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.450355+0000", 2024-09-12T16:17:52.179 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.401e-05 2024-09-12T16:17:52.179 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.179 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:52.179 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.179 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.179 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.179 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "pg_update_log_missing(3.5 epoch 92/74 rep_tid 1618 entries 92'520 (0'0) error 3:a46c381c:::rbd_data.1155c757bf36.000000000000002f:head by client.5577.0:14350 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 92'518)", 2024-09-12T16:17:52.179 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.408248+0000", 2024-09-12T16:17:52.179 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 21.732431282, 2024-09-12T16:17:52.179 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029209660000000001, 2024-09-12T16:17:52.179 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:52.179 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:52.179 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "reached pg", 2024-09-12T16:17:52.179 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:52.179 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.180 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:52.180 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408248+0000", 2024-09-12T16:17:52.180 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.180 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.180 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.180 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:52.180 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408248+0000", 2024-09-12T16:17:52.180 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.180 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.180 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.180 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:52.180 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408249+0000", 2024-09-12T16:17:52.180 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9800000000000002e-07 2024-09-12T16:17:52.180 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.180 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.181 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:52.181 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408259+0000", 2024-09-12T16:17:52.181 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1949999999999992e-06 2024-09-12T16:17:52.181 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.181 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.181 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:52.181 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408278+0000", 2024-09-12T16:17:52.181 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9157e-05 2024-09-12T16:17:52.181 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.181 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.181 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.181 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408291+0000", 2024-09-12T16:17:52.181 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3655000000000001e-05 2024-09-12T16:17:52.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.182 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.182 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:52.182 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408369+0000", 2024-09-12T16:17:52.182 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7804000000000002e-05 2024-09-12T16:17:52.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.182 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.182 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:52.182 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411169+0000", 2024-09-12T16:17:52.182 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002800257 2024-09-12T16:17:52.182 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.182 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:52.183 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.183 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.183 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.183 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "pg_update_log_missing(3.1d epoch 92/74 rep_tid 3087 entries 92'1280 (0'0) error 3:bc3c4c0b:::rbd_data.1155c757bf36.000000000000002c:head by client.5577.0:14343 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 90'1278)", 2024-09-12T16:17:52.183 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.408860+0000", 2024-09-12T16:17:52.183 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 21.731819653999999, 2024-09-12T16:17:52.183 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0056480419999999998, 2024-09-12T16:17:52.183 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:52.183 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:52.183 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "reached pg", 2024-09-12T16:17:52.183 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:52.184 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.184 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:52.184 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408860+0000", 2024-09-12T16:17:52.184 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.184 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.184 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.184 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:52.184 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408860+0000", 2024-09-12T16:17:52.184 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.185 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.185 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.185 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:52.185 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408861+0000", 2024-09-12T16:17:52.185 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6600000000000002e-07 2024-09-12T16:17:52.185 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.185 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.185 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:52.185 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408867+0000", 2024-09-12T16:17:52.185 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4150000000000004e-06 2024-09-12T16:17:52.185 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.185 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.185 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:52.186 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408881+0000", 2024-09-12T16:17:52.186 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4326e-05 2024-09-12T16:17:52.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.186 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.186 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.186 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408895+0000", 2024-09-12T16:17:52.186 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3903000000000001e-05 2024-09-12T16:17:52.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.186 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.186 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:52.186 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410566+0000", 2024-09-12T16:17:52.186 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001670822 2024-09-12T16:17:52.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.187 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.187 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:52.187 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414508+0000", 2024-09-12T16:17:52.187 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039421100000000004 2024-09-12T16:17:52.187 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.187 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:52.187 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.187 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.187 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.187 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "pg_update_log_missing(3.5 epoch 92/74 rep_tid 1621 entries 92'521 (0'0) error 3:a759f741:::rbd_data.1155c757bf36.0000000000000036:head by client.5577.0:14364 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 92'518)", 2024-09-12T16:17:52.187 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:17:52.187 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 21.730871177000001, 2024-09-12T16:17:52.187 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047586740000000001, 2024-09-12T16:17:52.188 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:52.188 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:52.188 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "reached pg", 2024-09-12T16:17:52.188 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:52.188 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.188 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:52.188 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:17:52.188 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.188 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.188 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.188 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:52.188 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:17:52.188 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.189 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.189 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.189 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:52.189 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:17:52.189 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.54e-07 2024-09-12T16:17:52.189 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.189 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.189 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:52.189 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409817+0000", 2024-09-12T16:17:52.189 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.028e-06 2024-09-12T16:17:52.189 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.189 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.189 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:52.189 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410047+0000", 2024-09-12T16:17:52.190 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022964599999999999 2024-09-12T16:17:52.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.190 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.190 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.190 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410067+0000", 2024-09-12T16:17:52.190 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0438999999999999e-05 2024-09-12T16:17:52.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.190 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.190 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:52.190 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411223+0000", 2024-09-12T16:17:52.190 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011560229999999999 2024-09-12T16:17:52.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.190 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.190 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:52.190 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414567+0000", 2024-09-12T16:17:52.191 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033437839999999998 2024-09-12T16:17:52.191 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.191 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:52.191 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.191 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.191 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.191 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14391 3.5 e92/74 3:a5105766:::rbd_data.1155c757bf36.0000000000000044:head v 92'523, mlcod=92'518)", 2024-09-12T16:17:52.191 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.410084+0000", 2024-09-12T16:17:52.191 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 21.730595307000002, 2024-09-12T16:17:52.191 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0046720299999999998, 2024-09-12T16:17:52.191 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:52.192 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:52.192 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:52.192 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:52.192 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.192 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:52.192 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410084+0000", 2024-09-12T16:17:52.192 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.192 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.192 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.192 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:52.192 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410084+0000", 2024-09-12T16:17:52.192 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.193 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.193 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:52.193 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410085+0000", 2024-09-12T16:17:52.193 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1900000000000002e-07 2024-09-12T16:17:52.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.193 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.193 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:52.193 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410091+0000", 2024-09-12T16:17:52.193 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1e-06 2024-09-12T16:17:52.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.194 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.194 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:52.194 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410100+0000", 2024-09-12T16:17:52.194 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6889999999999993e-06 2024-09-12T16:17:52.194 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.194 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.194 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.194 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410105+0000", 2024-09-12T16:17:52.194 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3199999999999999e-06 2024-09-12T16:17:52.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:52.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411563+0000", 2024-09-12T16:17:52.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00145795 2024-09-12T16:17:52.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:52.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411590+0000", 2024-09-12T16:17:52.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6570000000000001e-05 2024-09-12T16:17:52.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.196 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:52.196 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414571+0000", 2024-09-12T16:17:52.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029815710000000001 2024-09-12T16:17:52.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.196 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:52.196 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414756+0000", 2024-09-12T16:17:52.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018521100000000001 2024-09-12T16:17:52.196 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.196 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:52.196 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.197 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14405 3.5 e92/74 3:a0797093:::rbd_data.1155c757bf36.000000000000004b:head v 92'525, mlcod=92'518)", 2024-09-12T16:17:52.197 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.410119+0000", 2024-09-12T16:17:52.197 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 21.730560366999999, 2024-09-12T16:17:52.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047304000000000001, 2024-09-12T16:17:52.197 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:52.197 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:52.197 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:52.197 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:52.197 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.197 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:52.197 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410119+0000", 2024-09-12T16:17:52.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.197 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.198 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:52.198 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410119+0000", 2024-09-12T16:17:52.198 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.198 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.198 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:52.198 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410120+0000", 2024-09-12T16:17:52.198 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:17:52.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.198 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.198 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:52.198 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410126+0000", 2024-09-12T16:17:52.198 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1460000000000001e-06 2024-09-12T16:17:52.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:52.199 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410134+0000", 2024-09-12T16:17:52.199 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8879999999999997e-06 2024-09-12T16:17:52.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.199 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410140+0000", 2024-09-12T16:17:52.199 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0839999999999997e-06 2024-09-12T16:17:52.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:52.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412146+0000", 2024-09-12T16:17:52.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0020057569999999999 2024-09-12T16:17:52.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:52.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412163+0000", 2024-09-12T16:17:52.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7742000000000001e-05 2024-09-12T16:17:52.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:52.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414761+0000", 2024-09-12T16:17:52.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025979660000000002 2024-09-12T16:17:52.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:52.201 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414850+0000", 2024-09-12T16:17:52.201 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8426999999999999e-05 2024-09-12T16:17:52.201 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.201 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:52.201 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.201 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.201 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14435 3.1d e92/74 3:b810b250:::rbd_data.1155c757bf36.000000000000010b:head v 92'1282, mlcod=90'1278)", 2024-09-12T16:17:52.201 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:17:52.201 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 21.729717898000001, 2024-09-12T16:17:52.201 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039190579999999996, 2024-09-12T16:17:52.201 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:52.201 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:52.202 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:52.202 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:52.202 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.202 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:52.202 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:17:52.202 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.202 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.202 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.202 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:52.202 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:17:52.202 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.202 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.202 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:52.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:17:52.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5199999999999996e-07 2024-09-12T16:17:52.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:52.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410968+0000", 2024-09-12T16:17:52.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.305e-06 2024-09-12T16:17:52.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:52.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410986+0000", 2024-09-12T16:17:52.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8213999999999999e-05 2024-09-12T16:17:52.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.204 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.204 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.204 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410993+0000", 2024-09-12T16:17:52.204 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2849999999999997e-06 2024-09-12T16:17:52.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.204 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.204 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:52.204 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412228+0000", 2024-09-12T16:17:52.204 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0012347370000000001 2024-09-12T16:17:52.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.204 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.205 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:52.205 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412262+0000", 2024-09-12T16:17:52.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3531999999999997e-05 2024-09-12T16:17:52.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.205 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:52.205 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414854+0000", 2024-09-12T16:17:52.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002592039 2024-09-12T16:17:52.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.205 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:52.205 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414881+0000", 2024-09-12T16:17:52.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7294e-05 2024-09-12T16:17:52.206 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.206 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:52.206 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.206 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.206 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14434 3.5 e92/74 3:a09dd60f:::rbd_data.1155c757bf36.000000000000010a:head v 92'527, mlcod=92'518)", 2024-09-12T16:17:52.206 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.411186+0000", 2024-09-12T16:17:52.206 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 21.729493751, 2024-09-12T16:17:52.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0037696930000000002, 2024-09-12T16:17:52.206 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:52.206 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:52.206 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:52.207 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:52.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.207 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:52.207 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411186+0000", 2024-09-12T16:17:52.207 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.207 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:52.207 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411186+0000", 2024-09-12T16:17:52.207 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.207 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:52.207 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411187+0000", 2024-09-12T16:17:52.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3799999999999997e-07 2024-09-12T16:17:52.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.208 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.208 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:52.208 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411203+0000", 2024-09-12T16:17:52.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6793999999999999e-05 2024-09-12T16:17:52.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.208 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.208 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:52.208 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411323+0000", 2024-09-12T16:17:52.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011975499999999999 2024-09-12T16:17:52.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.208 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.208 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411332+0000", 2024-09-12T16:17:52.209 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4370000000000007e-06 2024-09-12T16:17:52.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:52.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.413073+0000", 2024-09-12T16:17:52.209 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001741827 2024-09-12T16:17:52.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:52.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.413091+0000", 2024-09-12T16:17:52.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8011000000000001e-05 2024-09-12T16:17:52.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.210 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.210 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:52.210 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414882+0000", 2024-09-12T16:17:52.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001790841 2024-09-12T16:17:52.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.210 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.210 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:52.210 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414956+0000", 2024-09-12T16:17:52.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.339e-05 2024-09-12T16:17:52.210 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.210 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:52.210 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.211 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14426 3.13 e92/74 3:c827d1d7:::rbd_data.1155c757bf36.0000000000000056:head v 92'741, mlcod=90'737)", 2024-09-12T16:17:52.211 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:17:52.211 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 21.725401838, 2024-09-12T16:17:52.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030296030000000001, 2024-09-12T16:17:52.211 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:52.211 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:52.211 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:52.211 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:52.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.211 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:52.211 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:17:52.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:52.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:17:52.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:52.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:17:52.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6300000000000001e-07 2024-09-12T16:17:52.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.213 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:52.213 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415282+0000", 2024-09-12T16:17:52.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6289999999999999e-06 2024-09-12T16:17:52.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.213 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:52.213 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415288+0000", 2024-09-12T16:17:52.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5520000000000001e-06 2024-09-12T16:17:52.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.213 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415293+0000", 2024-09-12T16:17:52.214 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6879999999999998e-06 2024-09-12T16:17:52.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.214 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.214 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:52.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415412+0000", 2024-09-12T16:17:52.214 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118579 2024-09-12T16:17:52.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.214 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.214 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:52.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415429+0000", 2024-09-12T16:17:52.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7501000000000001e-05 2024-09-12T16:17:52.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.215 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:52.215 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.418270+0000", 2024-09-12T16:17:52.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028404860000000001 2024-09-12T16:17:52.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.215 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:52.215 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.418307+0000", 2024-09-12T16:17:52.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7805000000000001e-05 2024-09-12T16:17:52.215 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.216 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:52.216 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.216 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14399 3.16 e92/75 3:6e4c3dfc:::rbd_data.1155c757bf36.0000000000000048:head v 92'1286, mlcod=90'1280)", 2024-09-12T16:17:52.216 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.415311+0000", 2024-09-12T16:17:52.216 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 21.725368924000001, 2024-09-12T16:17:52.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028826809999999998, 2024-09-12T16:17:52.216 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:52.216 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:52.216 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:52.216 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:52.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:52.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415311+0000", 2024-09-12T16:17:52.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:52.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415311+0000", 2024-09-12T16:17:52.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:52.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415311+0000", 2024-09-12T16:17:52.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0600000000000001e-07 2024-09-12T16:17:52.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:52.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415315+0000", 2024-09-12T16:17:52.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.172e-06 2024-09-12T16:17:52.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:52.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415322+0000", 2024-09-12T16:17:52.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0999999999999998e-06 2024-09-12T16:17:52.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415327+0000", 2024-09-12T16:17:52.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6430000000000003e-06 2024-09-12T16:17:52.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:52.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.416666+0000", 2024-09-12T16:17:52.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001338718 2024-09-12T16:17:52.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:52.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.416683+0000", 2024-09-12T16:17:52.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7628000000000001e-05 2024-09-12T16:17:52.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.220 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:52.220 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.418128+0000", 2024-09-12T16:17:52.220 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0014445440000000001 2024-09-12T16:17:52.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.220 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.220 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:52.220 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.418193+0000", 2024-09-12T16:17:52.220 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5569999999999997e-05 2024-09-12T16:17:52.220 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.220 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:52.220 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.220 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.221 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5384.0:1241 3.16 e95/75 3:6ee670ce:::rbd_data.1155b9894cdc.0000000000000005:head v 95'1303, mlcod=95'1301)", 2024-09-12T16:17:52.221 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:35.272164+0000", 2024-09-12T16:17:52.221 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 16.868515982000002, 2024-09-12T16:17:52.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015008743, 2024-09-12T16:17:52.221 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:52.221 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:52.221 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:52.221 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:52.221 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.221 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:52.221 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.272164+0000", 2024-09-12T16:17:52.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.221 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:52.222 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.272164+0000", 2024-09-12T16:17:52.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:52.222 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.272165+0000", 2024-09-12T16:17:52.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.311e-06 2024-09-12T16:17:52.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:52.222 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275503+0000", 2024-09-12T16:17:52.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003337881 2024-09-12T16:17:52.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:52.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275530+0000", 2024-09-12T16:17:52.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6797000000000001e-05 2024-09-12T16:17:52.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275541+0000", 2024-09-12T16:17:52.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1634000000000001e-05 2024-09-12T16:17:52.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:52.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275618+0000", 2024-09-12T16:17:52.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6811999999999996e-05 2024-09-12T16:17:52.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:52.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275642+0000", 2024-09-12T16:17:52.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4111999999999999e-05 2024-09-12T16:17:52.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:52.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287116+0000", 2024-09-12T16:17:52.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01147395 2024-09-12T16:17:52.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:52.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287172+0000", 2024-09-12T16:17:52.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6246000000000003e-05 2024-09-12T16:17:52.225 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.225 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:52.225 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.225 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5384.0:1246 3.f e95/74 3:f0725c44:::rbd_data.1155b9894cdc.0000000000000006:head v 95'356, mlcod=95'354)", 2024-09-12T16:17:52.225 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:35.276304+0000", 2024-09-12T16:17:52.225 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 16.864376055000001, 2024-09-12T16:17:52.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011209733, 2024-09-12T16:17:52.225 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:52.225 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:52.225 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:52.225 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:52.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:52.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.276304+0000", 2024-09-12T16:17:52.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:52.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.276304+0000", 2024-09-12T16:17:52.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:52.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.276305+0000", 2024-09-12T16:17:52.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2500000000000001e-06 2024-09-12T16:17:52.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.227 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.227 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:52.227 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279256+0000", 2024-09-12T16:17:52.227 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002951076 2024-09-12T16:17:52.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.227 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.227 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:52.227 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279281+0000", 2024-09-12T16:17:52.227 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4779000000000001e-05 2024-09-12T16:17:52.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.227 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.227 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.227 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279294+0000", 2024-09-12T16:17:52.228 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3614e-05 2024-09-12T16:17:52.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.228 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:52.228 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279366+0000", 2024-09-12T16:17:52.228 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2094000000000005e-05 2024-09-12T16:17:52.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.228 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:52.228 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279395+0000", 2024-09-12T16:17:52.228 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8337999999999999e-05 2024-09-12T16:17:52.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.228 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:52.228 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287479+0000", 2024-09-12T16:17:52.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0080844799999999998 2024-09-12T16:17:52.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:52.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287513+0000", 2024-09-12T16:17:52.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4102e-05 2024-09-12T16:17:52.229 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.229 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:52.229 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.229 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5578.0:2433 3.16 e98/75 3:691860ab:::rbd_data.11557f9bd67f.0000000000000014:head v 98'1330, mlcod=97'1328)", 2024-09-12T16:17:52.229 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:38.524867+0000", 2024-09-12T16:17:52.230 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 13.61581243, 2024-09-12T16:17:52.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028147279999999998, 2024-09-12T16:17:52.230 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:52.230 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:52.230 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:52.230 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:52.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:52.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.524867+0000", 2024-09-12T16:17:52.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:52.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.524867+0000", 2024-09-12T16:17:52.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:52.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.231 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.231 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:52.231 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.524868+0000", 2024-09-12T16:17:52.231 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4600000000000003e-07 2024-09-12T16:17:52.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.231 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.231 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:52.231 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.525251+0000", 2024-09-12T16:17:52.231 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00038322299999999997 2024-09-12T16:17:52.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.231 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.231 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:52.231 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.525266+0000", 2024-09-12T16:17:52.231 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4934e-05 2024-09-12T16:17:52.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.232 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.525274+0000", 2024-09-12T16:17:52.232 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.328e-06 2024-09-12T16:17:52.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:52.232 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.525363+0000", 2024-09-12T16:17:52.232 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9149999999999999e-05 2024-09-12T16:17:52.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:52.232 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.525383+0000", 2024-09-12T16:17:52.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0197e-05 2024-09-12T16:17:52.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.233 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:52.233 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.527638+0000", 2024-09-12T16:17:52.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0022551210000000001 2024-09-12T16:17:52.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:52.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:52.233 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:52.233 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.527682+0000", 2024-09-12T16:17:52.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3928999999999999e-05 2024-09-12T16:17:52.233 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.233 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:52.233 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.233 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:52.234 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:52.234 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:52.235 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:52.234+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:52.235 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:17:52.298 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #36, image image_client.0-clone36 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent37 2024-09-12T16:17:52.336 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:52.335+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:52.349 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:52.349 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:17:52.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.349 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5895.0:93 3.1 3:868f7a32:::rbd_data.11556e063f93.0000000000000008:head [read 32768~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-12T16:17:52.349 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:52.348739+0000", 2024-09-12T16:17:52.349 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.000347194, 2024-09-12T16:17:52.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036797300000000001, 2024-09-12T16:17:52.349 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:52.349 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:52.350 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:52.350 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:52.350 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5895", 2024-09-12T16:17:52.350 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/4064761553", 2024-09-12T16:17:52.350 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 93 2024-09-12T16:17:52.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.350 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:52.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.350 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:52.350 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:52.348739+0000", 2024-09-12T16:17:52.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.350 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:52.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:52.348739+0000", 2024-09-12T16:17:52.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:52.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:52.348739+0000", 2024-09-12T16:17:52.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6700000000000003e-07 2024-09-12T16:17:52.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:52.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:52.348742+0000", 2024-09-12T16:17:52.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9639999999999999e-06 2024-09-12T16:17:52.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:52.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:52.348756+0000", 2024-09-12T16:17:52.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3454e-05 2024-09-12T16:17:52.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:52.348762+0000", 2024-09-12T16:17:52.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.28e-06 2024-09-12T16:17:52.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:52.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:52.349039+0000", 2024-09-12T16:17:52.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00027752099999999997 2024-09-12T16:17:52.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:52.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:52.349094+0000", 2024-09-12T16:17:52.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4175999999999998e-05 2024-09-12T16:17:52.353 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.353 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:52.353 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.353 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.353 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-12T16:17:52.353 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 1 2024-09-12T16:17:52.353 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:52.360 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:17:52.395 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 3] out_osds: [5] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-12T16:17:52.395 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T16:17:52.395 INFO:tasks.thrashosds.thrasher:inject_pause on osd.5 2024-09-12T16:17:52.395 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-12T16:17:52.395 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-12T16:17:52.396 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok config set filestore_inject_stall 3 2024-09-12T16:17:52.440 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:52.440+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:52.532 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:52.533 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "" 2024-09-12T16:17:52.533 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:52.533 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:52.533 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:52.533 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:17:52.533 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:17:52.533 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:52.537 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:52.537+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:52.544 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:17:52.638 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:52.637+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:52.691 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:52.691 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:17:52.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:17:52.691 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:17:52.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.692 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3705 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14812160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:52.692 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:17:52.692 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 94.549696044000001, 2024-09-12T16:17:52.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053368831999999998, 2024-09-12T16:17:52.692 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:52.692 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:52.692 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:52.692 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:52.692 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:52.692 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:52.692 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3705 2024-09-12T16:17:52.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.693 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:52.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:52.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:17:52.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:52.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:17:52.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:52.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139932+0000", 2024-09-12T16:17:52.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012762099999999999 2024-09-12T16:17:52.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:52.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139935+0000", 2024-09-12T16:17:52.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.119e-06 2024-09-12T16:17:52.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:52.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139939+0000", 2024-09-12T16:17:52.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7999999999999998e-06 2024-09-12T16:17:52.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139953+0000", 2024-09-12T16:17:52.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3923999999999999e-05 2024-09-12T16:17:52.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:52.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192946+0000", 2024-09-12T16:17:52.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052992971 2024-09-12T16:17:52.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:52.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193035+0000", 2024-09-12T16:17:52.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9040000000000001e-05 2024-09-12T16:17:52.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:52.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193174+0000", 2024-09-12T16:17:52.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138357 2024-09-12T16:17:52.696 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.696 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:52.697 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.697 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3706 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14816256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:52.697 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:17:52.697 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 94.549541054000002, 2024-09-12T16:17:52.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053341723000000001, 2024-09-12T16:17:52.697 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:52.697 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:52.697 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:52.697 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:52.697 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:52.697 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:52.698 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3706 2024-09-12T16:17:52.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.698 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:52.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:52.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:17:52.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:52.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:17:52.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:52.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140090+0000", 2024-09-12T16:17:52.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013020100000000001 2024-09-12T16:17:52.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:52.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140097+0000", 2024-09-12T16:17:52.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0709999999999997e-06 2024-09-12T16:17:52.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:52.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140103+0000", 2024-09-12T16:17:52.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5450000000000003e-06 2024-09-12T16:17:52.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140106+0000", 2024-09-12T16:17:52.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3739999999999998e-06 2024-09-12T16:17:52.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:52.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193190+0000", 2024-09-12T16:17:52.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053084131999999999 2024-09-12T16:17:52.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:52.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193232+0000", 2024-09-12T16:17:52.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1517000000000002e-05 2024-09-12T16:17:52.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:52.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193302+0000", 2024-09-12T16:17:52.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9882999999999995e-05 2024-09-12T16:17:52.701 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.701 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:52.701 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.701 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3707 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14820352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:52.701 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:17:52.701 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 94.549389065, 2024-09-12T16:17:52.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053452771000000003, 2024-09-12T16:17:52.702 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:52.702 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:52.702 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:52.702 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:52.702 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:52.702 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:52.702 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3707 2024-09-12T16:17:52.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.702 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:52.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:52.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:17:52.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:52.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:17:52.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:52.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140219+0000", 2024-09-12T16:17:52.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106902 2024-09-12T16:17:52.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:52.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140225+0000", 2024-09-12T16:17:52.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3199999999999996e-06 2024-09-12T16:17:52.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:52.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140230+0000", 2024-09-12T16:17:52.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8969999999999999e-06 2024-09-12T16:17:52.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140233+0000", 2024-09-12T16:17:52.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2119999999999999e-06 2024-09-12T16:17:52.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:52.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193339+0000", 2024-09-12T16:17:52.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053105556999999998 2024-09-12T16:17:52.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:52.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193431+0000", 2024-09-12T16:17:52.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1837999999999997e-05 2024-09-12T16:17:52.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:52.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193565+0000", 2024-09-12T16:17:52.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013404500000000001 2024-09-12T16:17:52.706 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.706 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:52.706 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.706 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3708 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14824448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:52.706 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:17:52.706 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 94.549260223000005, 2024-09-12T16:17:52.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053468190999999998, 2024-09-12T16:17:52.706 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:52.706 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:52.706 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:52.707 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:52.707 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:52.707 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:52.707 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3708 2024-09-12T16:17:52.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.707 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:52.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:52.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:17:52.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:52.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:17:52.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:52.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140351+0000", 2024-09-12T16:17:52.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110096 2024-09-12T16:17:52.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:52.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140358+0000", 2024-09-12T16:17:52.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.306e-06 2024-09-12T16:17:52.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:52.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140368+0000", 2024-09-12T16:17:52.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0225e-05 2024-09-12T16:17:52.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140372+0000", 2024-09-12T16:17:52.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6169999999999998e-06 2024-09-12T16:17:52.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:52.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193594+0000", 2024-09-12T16:17:52.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053222419999999999 2024-09-12T16:17:52.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:52.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193640+0000", 2024-09-12T16:17:52.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.587e-05 2024-09-12T16:17:52.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:52.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193709+0000", 2024-09-12T16:17:52.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8657000000000004e-05 2024-09-12T16:17:52.711 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.711 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:52.711 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.711 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3709 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14828544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:52.711 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:17:52.712 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 94.549123254999998, 2024-09-12T16:17:52.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594033999999999, 2024-09-12T16:17:52.712 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:52.712 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:52.712 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:52.712 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:52.712 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:52.712 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:52.712 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3709 2024-09-12T16:17:52.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.712 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:52.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:52.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:17:52.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:52.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:17:52.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:52.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140499+0000", 2024-09-12T16:17:52.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121019 2024-09-12T16:17:52.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:52.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140501+0000", 2024-09-12T16:17:52.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2369999999999999e-06 2024-09-12T16:17:52.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:52.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140506+0000", 2024-09-12T16:17:52.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.639e-06 2024-09-12T16:17:52.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140509+0000", 2024-09-12T16:17:52.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3419999999999999e-06 2024-09-12T16:17:52.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:52.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193743+0000", 2024-09-12T16:17:52.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053234311999999999 2024-09-12T16:17:52.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:52.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193833+0000", 2024-09-12T16:17:52.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9883999999999995e-05 2024-09-12T16:17:52.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:52.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193972+0000", 2024-09-12T16:17:52.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138601 2024-09-12T16:17:52.716 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.716 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:52.716 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.716 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3710 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14832640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:52.716 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:17:52.716 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 94.548985908999995, 2024-09-12T16:17:52.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053607324999999997, 2024-09-12T16:17:52.717 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:52.717 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:52.717 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:52.717 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:52.717 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:52.717 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:52.717 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3710 2024-09-12T16:17:52.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.717 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:52.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:52.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:17:52.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:52.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:17:52.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:52.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140664+0000", 2024-09-12T16:17:52.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014918700000000001 2024-09-12T16:17:52.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:52.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140674+0000", 2024-09-12T16:17:52.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8379999999999997e-06 2024-09-12T16:17:52.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:52.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140694+0000", 2024-09-12T16:17:52.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0145000000000001e-05 2024-09-12T16:17:52.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140703+0000", 2024-09-12T16:17:52.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5150000000000006e-06 2024-09-12T16:17:52.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:52.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194006+0000", 2024-09-12T16:17:52.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053303370000000003 2024-09-12T16:17:52.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:52.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194051+0000", 2024-09-12T16:17:52.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5012000000000002e-05 2024-09-12T16:17:52.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:52.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194122+0000", 2024-09-12T16:17:52.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1258000000000001e-05 2024-09-12T16:17:52.721 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.721 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:52.721 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.721 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3711 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14836736~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:52.721 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:17:52.722 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 94.548784460999997, 2024-09-12T16:17:52.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053670799999999998, 2024-09-12T16:17:52.722 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:52.722 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:52.722 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:52.722 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:52.722 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:52.722 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:52.722 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3711 2024-09-12T16:17:52.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.723 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:52.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:52.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:17:52.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:52.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:17:52.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:52.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140782+0000", 2024-09-12T16:17:52.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5549999999999994e-05 2024-09-12T16:17:52.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:52.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140786+0000", 2024-09-12T16:17:52.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.89e-06 2024-09-12T16:17:52.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:52.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140796+0000", 2024-09-12T16:17:52.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0057e-05 2024-09-12T16:17:52.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140819+0000", 2024-09-12T16:17:52.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3005000000000001e-05 2024-09-12T16:17:52.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:52.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194159+0000", 2024-09-12T16:17:52.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053340324000000001 2024-09-12T16:17:52.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:52.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194248+0000", 2024-09-12T16:17:52.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9209000000000006e-05 2024-09-12T16:17:52.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:52.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194387+0000", 2024-09-12T16:17:52.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138765 2024-09-12T16:17:52.726 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.726 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:52.726 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.727 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3712 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14840832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:52.727 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:17:52.727 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 94.548670002999998, 2024-09-12T16:17:52.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053699068000000003, 2024-09-12T16:17:52.727 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:52.727 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:52.727 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:52.727 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:52.727 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:52.727 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:52.727 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3712 2024-09-12T16:17:52.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.728 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:52.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:52.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:17:52.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:52.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:17:52.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:52.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140900+0000", 2024-09-12T16:17:52.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9014e-05 2024-09-12T16:17:52.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:52.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140904+0000", 2024-09-12T16:17:52.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0940000000000001e-06 2024-09-12T16:17:52.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:52.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140933+0000", 2024-09-12T16:17:52.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8996000000000002e-05 2024-09-12T16:17:52.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140945+0000", 2024-09-12T16:17:52.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1909000000000001e-05 2024-09-12T16:17:52.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:52.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194415+0000", 2024-09-12T16:17:52.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053470403 2024-09-12T16:17:52.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:52.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194460+0000", 2024-09-12T16:17:52.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5145000000000002e-05 2024-09-12T16:17:52.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:52.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194530+0000", 2024-09-12T16:17:52.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9506999999999997e-05 2024-09-12T16:17:52.731 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.731 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:52.731 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.731 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3713 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14844928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:52.731 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:17:52.731 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 94.548536943000002, 2024-09-12T16:17:52.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053821236000000001, 2024-09-12T16:17:52.732 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:52.732 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:52.732 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:52.732 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:52.732 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:52.732 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:52.732 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3713 2024-09-12T16:17:52.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.732 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:52.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:52.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:17:52.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.733 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:52.733 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:17:52.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.733 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:52.733 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141078+0000", 2024-09-12T16:17:52.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114162 2024-09-12T16:17:52.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.733 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:52.733 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141090+0000", 2024-09-12T16:17:52.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.19e-05 2024-09-12T16:17:52.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:52.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141100+0000", 2024-09-12T16:17:52.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0447e-05 2024-09-12T16:17:52.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141108+0000", 2024-09-12T16:17:52.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7190000000000001e-06 2024-09-12T16:17:52.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:52.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194564+0000", 2024-09-12T16:17:52.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053455729 2024-09-12T16:17:52.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:52.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194652+0000", 2024-09-12T16:17:52.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8288999999999994e-05 2024-09-12T16:17:52.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:52.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194785+0000", 2024-09-12T16:17:52.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013299000000000001 2024-09-12T16:17:52.735 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.735 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:52.735 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.736 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3714 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14849024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:52.736 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:17:52.736 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 94.548381014, 2024-09-12T16:17:52.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053816382000000003, 2024-09-12T16:17:52.736 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:52.736 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:52.736 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:52.736 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:52.736 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:52.736 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:52.736 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3714 2024-09-12T16:17:52.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.737 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:52.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:52.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:17:52.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:52.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:17:52.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:52.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141182+0000", 2024-09-12T16:17:52.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1805999999999997e-05 2024-09-12T16:17:52.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:52.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141185+0000", 2024-09-12T16:17:52.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5930000000000002e-06 2024-09-12T16:17:52.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:52.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141194+0000", 2024-09-12T16:17:52.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5760000000000006e-06 2024-09-12T16:17:52.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141222+0000", 2024-09-12T16:17:52.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8034999999999998e-05 2024-09-12T16:17:52.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:52.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194817+0000", 2024-09-12T16:17:52.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594887000000001 2024-09-12T16:17:52.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:52.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194860+0000", 2024-09-12T16:17:52.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3714999999999997e-05 2024-09-12T16:17:52.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:52.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194936+0000", 2024-09-12T16:17:52.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5770000000000001e-05 2024-09-12T16:17:52.740 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.740 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:52.740 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.740 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3715 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14853120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:52.740 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:17:52.740 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 94.548257356999997, 2024-09-12T16:17:52.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053962307000000001, 2024-09-12T16:17:52.741 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:52.741 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:52.741 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:52.741 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:52.741 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:52.741 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:52.741 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3715 2024-09-12T16:17:52.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.741 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:52.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:52.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:17:52.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:52.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:17:52.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:52.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141417+0000", 2024-09-12T16:17:52.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017384099999999999 2024-09-12T16:17:52.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:52.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141422+0000", 2024-09-12T16:17:52.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7310000000000001e-06 2024-09-12T16:17:52.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:52.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141434+0000", 2024-09-12T16:17:52.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2058e-05 2024-09-12T16:17:52.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141442+0000", 2024-09-12T16:17:52.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7610000000000007e-06 2024-09-12T16:17:52.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:52.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194973+0000", 2024-09-12T16:17:52.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053530618000000002 2024-09-12T16:17:52.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:52.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195063+0000", 2024-09-12T16:17:52.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0927000000000005e-05 2024-09-12T16:17:52.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:52.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195206+0000", 2024-09-12T16:17:52.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142371 2024-09-12T16:17:52.744 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.744 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:52.744 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.745 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3716 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14857216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:52.745 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:17:52.745 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 94.548047507000007, 2024-09-12T16:17:52.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053916360000000003, 2024-09-12T16:17:52.745 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:52.745 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:52.745 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:52.745 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:52.745 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:52.745 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:52.745 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3716 2024-09-12T16:17:52.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.746 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:52.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:52.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:17:52.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:52.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:17:52.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:52.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142933+0000", 2024-09-12T16:17:52.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014796290000000001 2024-09-12T16:17:52.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:52.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142937+0000", 2024-09-12T16:17:52.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5760000000000002e-06 2024-09-12T16:17:52.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:52.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142946+0000", 2024-09-12T16:17:52.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0380000000000005e-06 2024-09-12T16:17:52.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142951+0000", 2024-09-12T16:17:52.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9749999999999998e-06 2024-09-12T16:17:52.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:52.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195246+0000", 2024-09-12T16:17:52.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052295358 2024-09-12T16:17:52.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:52.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195299+0000", 2024-09-12T16:17:52.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2976999999999998e-05 2024-09-12T16:17:52.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:52.751 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195370+0000", 2024-09-12T16:17:52.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0807000000000002e-05 2024-09-12T16:17:52.751 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.751 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:52.751 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.751 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3721 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14877696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:52.751 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:52.751 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 94.546474055999994, 2024-09-12T16:17:52.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053422994000000001, 2024-09-12T16:17:52.752 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:52.752 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:52.752 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:52.752 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:52.752 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:52.752 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:52.752 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3721 2024-09-12T16:17:52.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.752 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:52.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:52.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:52.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:52.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:52.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:52.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:52.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:17:52.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:52.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143028+0000", 2024-09-12T16:17:52.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7399999999999991e-07 2024-09-12T16:17:52.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:52.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143031+0000", 2024-09-12T16:17:52.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7599999999999998e-06 2024-09-12T16:17:52.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143034+0000", 2024-09-12T16:17:52.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9780000000000001e-06 2024-09-12T16:17:52.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.755 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:52.755 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196220+0000", 2024-09-12T16:17:52.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053186341999999998 2024-09-12T16:17:52.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.755 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:52.755 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196313+0000", 2024-09-12T16:17:52.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2676000000000005e-05 2024-09-12T16:17:52.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.755 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:52.755 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196450+0000", 2024-09-12T16:17:52.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137052 2024-09-12T16:17:52.755 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.755 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:52.755 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.756 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3722 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14881792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:52.756 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:52.756 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 94.546464164, 2024-09-12T16:17:52.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053556835999999997, 2024-09-12T16:17:52.756 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:52.756 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:52.756 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:52.756 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:52.756 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:52.756 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:52.756 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3722 2024-09-12T16:17:52.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.757 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:52.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:52.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:52.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:52.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:52.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:52.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:52.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.11e-07 2024-09-12T16:17:52.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:52.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143038+0000", 2024-09-12T16:17:52.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2399999999999996e-07 2024-09-12T16:17:52.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:52.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143041+0000", 2024-09-12T16:17:52.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8030000000000001e-06 2024-09-12T16:17:52.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.759 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.759 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143043+0000", 2024-09-12T16:17:52.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3140000000000002e-06 2024-09-12T16:17:52.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.759 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:52.759 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196481+0000", 2024-09-12T16:17:52.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053437601000000001 2024-09-12T16:17:52.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.759 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:52.760 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196525+0000", 2024-09-12T16:17:52.760 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4280000000000003e-05 2024-09-12T16:17:52.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.760 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:52.760 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196594+0000", 2024-09-12T16:17:52.760 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8702999999999996e-05 2024-09-12T16:17:52.760 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.760 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:52.760 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.761 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3723 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14885888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:52.761 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:17:52.761 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 94.546454982, 2024-09-12T16:17:52.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053815546999999998, 2024-09-12T16:17:52.761 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:52.761 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:52.761 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:52.761 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:52.761 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:52.761 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:52.761 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3723 2024-09-12T16:17:52.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.762 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:52.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:52.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:17:52.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:52.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:17:52.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:52.763 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148994+0000", 2024-09-12T16:17:52.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059481330000000004 2024-09-12T16:17:52.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:52.763 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148999+0000", 2024-09-12T16:17:52.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7140000000000001e-06 2024-09-12T16:17:52.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:52.763 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149008+0000", 2024-09-12T16:17:52.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4350000000000003e-06 2024-09-12T16:17:52.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149021+0000", 2024-09-12T16:17:52.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2514000000000001e-05 2024-09-12T16:17:52.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:52.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196630+0000", 2024-09-12T16:17:52.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047609758000000002 2024-09-12T16:17:52.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:52.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196724+0000", 2024-09-12T16:17:52.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3522000000000003e-05 2024-09-12T16:17:52.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:52.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196861+0000", 2024-09-12T16:17:52.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013747100000000001 2024-09-12T16:17:52.765 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.765 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:52.765 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.765 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4438 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15719424~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:52.765 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:52.765 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 94.401574205000003, 2024-09-12T16:17:52.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367981000000002, 2024-09-12T16:17:52.766 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:52.766 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:52.766 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:52.766 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:52.766 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:52.766 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:52.766 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4438 2024-09-12T16:17:52.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.766 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:52.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:52.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:52.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.768 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:52.768 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:52.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:52.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:52.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3e-07 2024-09-12T16:17:52.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:52.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287930+0000", 2024-09-12T16:17:52.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-12T16:17:52.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:52.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287937+0000", 2024-09-12T16:17:52.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.08e-06 2024-09-12T16:17:52.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.770 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.770 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287943+0000", 2024-09-12T16:17:52.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5709999999999997e-06 2024-09-12T16:17:52.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.770 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:52.770 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341068+0000", 2024-09-12T16:17:52.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053125101000000001 2024-09-12T16:17:52.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.770 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:52.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341154+0000", 2024-09-12T16:17:52.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6100999999999994e-05 2024-09-12T16:17:52.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:52.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341295+0000", 2024-09-12T16:17:52.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014087999999999999 2024-09-12T16:17:52.771 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.771 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:52.771 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.771 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4439 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15723520~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:52.772 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:52.772 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 94.401550044999993, 2024-09-12T16:17:52.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053526799, 2024-09-12T16:17:52.772 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:52.772 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:52.772 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:52.772 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:52.772 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:52.772 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:52.772 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4439 2024-09-12T16:17:52.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.772 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:52.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:52.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:52.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:52.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:52.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:52.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:52.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-07 2024-09-12T16:17:52.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:52.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287953+0000", 2024-09-12T16:17:52.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1349999999999999e-06 2024-09-12T16:17:52.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:52.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287960+0000", 2024-09-12T16:17:52.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-12T16:17:52.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.775 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287965+0000", 2024-09-12T16:17:52.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1580000000000004e-06 2024-09-12T16:17:52.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.775 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:52.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341332+0000", 2024-09-12T16:17:52.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367009 2024-09-12T16:17:52.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.775 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:52.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341402+0000", 2024-09-12T16:17:52.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9759999999999996e-05 2024-09-12T16:17:52.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.776 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:52.776 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341478+0000", 2024-09-12T16:17:52.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5412000000000002e-05 2024-09-12T16:17:52.776 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.776 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:52.776 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.776 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4440 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15727616~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:52.776 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:52.776 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 94.401528940999995, 2024-09-12T16:17:52.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053761601999999999, 2024-09-12T16:17:52.776 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:52.777 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:52.777 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:52.777 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:52.777 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:52.777 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:52.777 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4440 2024-09-12T16:17:52.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.777 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:52.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.777 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:52.777 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:52.777 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:52.778 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:52.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:52.778 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:52.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:17:52.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:52.778 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287974+0000", 2024-09-12T16:17:52.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0540000000000002e-06 2024-09-12T16:17:52.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.779 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:52.779 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287980+0000", 2024-09-12T16:17:52.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9440000000000002e-06 2024-09-12T16:17:52.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.779 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.779 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287987+0000", 2024-09-12T16:17:52.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5889999999999999e-06 2024-09-12T16:17:52.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.779 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:52.779 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341502+0000", 2024-09-12T16:17:52.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053515199999999999 2024-09-12T16:17:52.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.780 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:52.780 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341595+0000", 2024-09-12T16:17:52.780 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3097000000000007e-05 2024-09-12T16:17:52.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.780 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:52.780 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341734+0000", 2024-09-12T16:17:52.780 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013832800000000001 2024-09-12T16:17:52.780 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.780 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:52.780 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.780 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2209 3.1 3:85f36d3b:::rbd_data.1155ccb1894c.0000000000000004:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:52.781 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:17:52.781 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.317843803000002, 2024-09-12T16:17:52.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.060659365, 2024-09-12T16:17:52.781 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:52.781 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:52.781 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:52.781 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:52.781 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:17:52.781 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:17:52.781 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2209 2024-09-12T16:17:52.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.781 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:52.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.781 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:52.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:17:52.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:52.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:17:52.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:52.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371658+0000", 2024-09-12T16:17:52.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1570000000000001e-06 2024-09-12T16:17:52.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:52.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393414+0000", 2024-09-12T16:17:52.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021755495999999999 2024-09-12T16:17:52.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:52.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393447+0000", 2024-09-12T16:17:52.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3630000000000002e-05 2024-09-12T16:17:52.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393462+0000", 2024-09-12T16:17:52.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5048999999999999e-05 2024-09-12T16:17:52.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:52.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393556+0000", 2024-09-12T16:17:52.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3549999999999997e-05 2024-09-12T16:17:52.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.784 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:52.784 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393697+0000", 2024-09-12T16:17:52.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000141414 2024-09-12T16:17:52.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.784 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T16:17:52.784 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.394944+0000", 2024-09-12T16:17:52.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012463039999999999 2024-09-12T16:17:52.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.784 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:52.784 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.431803+0000", 2024-09-12T16:17:52.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0368594 2024-09-12T16:17:52.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.785 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:17:52.785 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432268+0000", 2024-09-12T16:17:52.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046457600000000002 2024-09-12T16:17:52.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.785 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:17:52.785 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432293+0000", 2024-09-12T16:17:52.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.527e-05 2024-09-12T16:17:52.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.786 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:52.786 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432316+0000", 2024-09-12T16:17:52.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3519e-05 2024-09-12T16:17:52.786 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.786 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:52.786 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.786 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:9400 3.1f 3:feea9999:::rbd_data.1155338d0570.0000000000000007:head [read 32768~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-12T16:17:52.786 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:20.012502+0000", 2024-09-12T16:17:52.786 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 32.676998810999997, 2024-09-12T16:17:52.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.000678049, 2024-09-12T16:17:52.786 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:52.786 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:52.787 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:52.787 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:52.787 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:52.787 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:52.787 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 9400 2024-09-12T16:17:52.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.787 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:52.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:52.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012502+0000", 2024-09-12T16:17:52.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:52.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012502+0000", 2024-09-12T16:17:52.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:52.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:52.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012504+0000", 2024-09-12T16:17:52.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5939999999999999e-06 2024-09-12T16:17:52.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:52.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012511+0000", 2024-09-12T16:17:52.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0840000000000003e-06 2024-09-12T16:17:52.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:52.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012525+0000", 2024-09-12T16:17:52.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4538999999999999e-05 2024-09-12T16:17:52.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:52.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012532+0000", 2024-09-12T16:17:52.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8310000000000003e-06 2024-09-12T16:17:52.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.790 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:52.790 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012605+0000", 2024-09-12T16:17:52.790 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2387999999999999e-05 2024-09-12T16:17:52.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.790 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T16:17:52.790 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012617+0000", 2024-09-12T16:17:52.790 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2167999999999999e-05 2024-09-12T16:17:52.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.790 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:52.790 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:21.012823+0000", 2024-09-12T16:17:52.790 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0002068230000001 2024-09-12T16:17:52.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:52.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:21.012975+0000", 2024-09-12T16:17:52.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015196200000000001 2024-09-12T16:17:52.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:52.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:52.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:52.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:21.013180+0000", 2024-09-12T16:17:52.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020466000000000001 2024-09-12T16:17:52.791 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.791 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:52.791 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.791 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:52.791 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:52.792 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:52.793 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:52.792+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:52.793 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:17:52.893 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:52.893+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:52.942 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:52.942 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:52.942 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:17:52.942 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:52.951 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:17:52.994 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:52.994+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:53.002 INFO:teuthology.orchestra.run.smithi204.stdout:5644 punch from 0x5d17400 to 0x5d1fc00, (0x8800 bytes) 2024-09-12T16:17:53.024 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2024-09-12T16:17:53.094 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:53.094+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:53.123 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:53.124 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:53.124 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:17:53.124 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:17:53.124 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:53.137 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:17:53.168 INFO:teuthology.orchestra.run.smithi204.stdout:5645 read 0x262d400 thru 0x263c59c (0xf19d bytes) 2024-09-12T16:17:53.168 INFO:teuthology.orchestra.run.smithi204.stdout:5648 read 0x22ca000 thru 0x22cfb1c (0x5b1d bytes) 2024-09-12T16:17:53.169 INFO:teuthology.orchestra.run.smithi204.stdout:5649 read 0xb11ee00 thru 0xb11f5ce (0x7cf bytes) 2024-09-12T16:17:53.177 INFO:teuthology.orchestra.run.smithi204.stdout:5650 trunc from 0xe340200 to 0x858c800 2024-09-12T16:17:53.195 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:53.194+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:53.284 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:53.285 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:17:53.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:17:53.285 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:17:53.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.285 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2307 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12401664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:53.285 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:17:53.285 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 95.386941965000005, 2024-09-12T16:17:53.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038241450000000003, 2024-09-12T16:17:53.285 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.285 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.285 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:53.286 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.286 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:53.286 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:53.286 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2307 2024-09-12T16:17:53.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.286 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:17:53.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896219+0000", 2024-09-12T16:17:53.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896220+0000", 2024-09-12T16:17:53.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3500000000000002e-07 2024-09-12T16:17:53.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896222+0000", 2024-09-12T16:17:53.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1720000000000001e-06 2024-09-12T16:17:53.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896228+0000", 2024-09-12T16:17:53.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0870000000000003e-06 2024-09-12T16:17:53.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896233+0000", 2024-09-12T16:17:53.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:17:53.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934382+0000", 2024-09-12T16:17:53.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038149566000000003 2024-09-12T16:17:53.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:53.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934422+0000", 2024-09-12T16:17:53.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0015999999999998e-05 2024-09-12T16:17:53.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934461+0000", 2024-09-12T16:17:53.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8423999999999997e-05 2024-09-12T16:17:53.290 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.290 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.290 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.290 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2308 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12405760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:53.290 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:17:53.290 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 95.386922268000006, 2024-09-12T16:17:53.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038420745999999999, 2024-09-12T16:17:53.290 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.290 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.291 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:53.291 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.291 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:53.291 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:53.291 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2308 2024-09-12T16:17:53.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.291 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:17:53.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:17:53.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896239+0000", 2024-09-12T16:17:53.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.58e-07 2024-09-12T16:17:53.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896241+0000", 2024-09-12T16:17:53.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7940000000000001e-06 2024-09-12T16:17:53.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896247+0000", 2024-09-12T16:17:53.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1460000000000001e-06 2024-09-12T16:17:53.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896252+0000", 2024-09-12T16:17:53.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6840000000000004e-06 2024-09-12T16:17:53.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934494+0000", 2024-09-12T16:17:53.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038242362000000002 2024-09-12T16:17:53.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:53.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934579+0000", 2024-09-12T16:17:53.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5044999999999996e-05 2024-09-12T16:17:53.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934660+0000", 2024-09-12T16:17:53.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0357000000000003e-05 2024-09-12T16:17:53.294 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.294 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.294 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.295 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2309 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12409856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:53.295 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:17:53.295 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 95.386901687999995, 2024-09-12T16:17:53.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038504629999999998, 2024-09-12T16:17:53.295 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.295 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.295 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:53.295 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.295 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:53.295 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:53.295 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2309 2024-09-12T16:17:53.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.295 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:17:53.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:17:53.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896260+0000", 2024-09-12T16:17:53.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5199999999999998e-07 2024-09-12T16:17:53.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896263+0000", 2024-09-12T16:17:53.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4209999999999999e-06 2024-09-12T16:17:53.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896269+0000", 2024-09-12T16:17:53.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9449999999999998e-06 2024-09-12T16:17:53.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896274+0000", 2024-09-12T16:17:53.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3950000000000003e-06 2024-09-12T16:17:53.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934686+0000", 2024-09-12T16:17:53.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038412333999999999 2024-09-12T16:17:53.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:53.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934727+0000", 2024-09-12T16:17:53.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0649999999999999e-05 2024-09-12T16:17:53.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934764+0000", 2024-09-12T16:17:53.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7533000000000001e-05 2024-09-12T16:17:53.298 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.299 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.299 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.299 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2310 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12413952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:53.299 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:17:53.299 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 95.386880816000001, 2024-09-12T16:17:53.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038694183, 2024-09-12T16:17:53.299 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.299 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.299 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:53.299 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.299 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:53.299 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:53.299 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2310 2024-09-12T16:17:53.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.300 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.300 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:17:53.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.300 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896280+0000", 2024-09-12T16:17:53.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896281+0000", 2024-09-12T16:17:53.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1399999999999997e-07 2024-09-12T16:17:53.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896283+0000", 2024-09-12T16:17:53.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9549999999999999e-06 2024-09-12T16:17:53.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896289+0000", 2024-09-12T16:17:53.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8669999999999999e-06 2024-09-12T16:17:53.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896301+0000", 2024-09-12T16:17:53.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1807999999999999e-05 2024-09-12T16:17:53.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934798+0000", 2024-09-12T16:17:53.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038497591999999997 2024-09-12T16:17:53.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:53.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934885+0000", 2024-09-12T16:17:53.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7149000000000002e-05 2024-09-12T16:17:53.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934975+0000", 2024-09-12T16:17:53.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9297999999999998e-05 2024-09-12T16:17:53.303 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.303 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.303 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.304 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2311 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12418048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:53.304 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:17:53.304 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 95.386853560000006, 2024-09-12T16:17:53.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038768558000000002, 2024-09-12T16:17:53.304 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.304 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.304 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:53.304 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.304 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:53.304 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:53.304 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2311 2024-09-12T16:17:53.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.304 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:17:53.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:17:53.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896308+0000", 2024-09-12T16:17:53.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.63e-07 2024-09-12T16:17:53.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896310+0000", 2024-09-12T16:17:53.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1560000000000002e-06 2024-09-12T16:17:53.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896316+0000", 2024-09-12T16:17:53.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0249999999999999e-06 2024-09-12T16:17:53.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896322+0000", 2024-09-12T16:17:53.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6400000000000002e-06 2024-09-12T16:17:53.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.934997+0000", 2024-09-12T16:17:53.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038674565000000001 2024-09-12T16:17:53.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:53.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935037+0000", 2024-09-12T16:17:53.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0485999999999998e-05 2024-09-12T16:17:53.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935076+0000", 2024-09-12T16:17:53.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9223e-05 2024-09-12T16:17:53.307 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.308 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.308 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.308 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2312 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12422144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:53.308 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:17:53.308 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 95.386832866999995, 2024-09-12T16:17:53.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038856784999999998, 2024-09-12T16:17:53.308 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.308 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.308 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:53.308 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.308 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:53.308 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:53.309 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2312 2024-09-12T16:17:53.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.309 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:17:53.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896328+0000", 2024-09-12T16:17:53.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896329+0000", 2024-09-12T16:17:53.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5499999999999999e-07 2024-09-12T16:17:53.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896337+0000", 2024-09-12T16:17:53.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0819999999999999e-06 2024-09-12T16:17:53.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896343+0000", 2024-09-12T16:17:53.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.263e-06 2024-09-12T16:17:53.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896348+0000", 2024-09-12T16:17:53.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8860000000000003e-06 2024-09-12T16:17:53.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935097+0000", 2024-09-12T16:17:53.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038748818999999997 2024-09-12T16:17:53.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:53.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935141+0000", 2024-09-12T16:17:53.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4175000000000003e-05 2024-09-12T16:17:53.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935185+0000", 2024-09-12T16:17:53.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4205000000000001e-05 2024-09-12T16:17:53.312 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.312 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.312 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.312 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2313 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12426240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:53.312 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:17:53.312 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 95.386806652000004, 2024-09-12T16:17:53.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038928683999999998, 2024-09-12T16:17:53.313 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.313 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.313 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:53.313 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.313 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:53.313 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:53.313 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2313 2024-09-12T16:17:53.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.313 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.313 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.313 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:17:53.313 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:17:53.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896355+0000", 2024-09-12T16:17:53.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0400000000000002e-07 2024-09-12T16:17:53.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896357+0000", 2024-09-12T16:17:53.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.097e-06 2024-09-12T16:17:53.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896363+0000", 2024-09-12T16:17:53.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5119999999999999e-06 2024-09-12T16:17:53.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896374+0000", 2024-09-12T16:17:53.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1381e-05 2024-09-12T16:17:53.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935205+0000", 2024-09-12T16:17:53.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038830549999999998 2024-09-12T16:17:53.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:53.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935244+0000", 2024-09-12T16:17:53.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9520000000000001e-05 2024-09-12T16:17:53.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935283+0000", 2024-09-12T16:17:53.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9220000000000001e-05 2024-09-12T16:17:53.316 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.316 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.317 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.317 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2314 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12430336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:53.317 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:17:53.317 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 95.386769482000005, 2024-09-12T16:17:53.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039008137999999998, 2024-09-12T16:17:53.317 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.317 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.317 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:53.317 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.317 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:53.318 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:53.318 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2314 2024-09-12T16:17:53.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.318 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.318 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:17:53.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.318 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:17:53.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896392+0000", 2024-09-12T16:17:53.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6499999999999999e-07 2024-09-12T16:17:53.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896395+0000", 2024-09-12T16:17:53.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2960000000000001e-06 2024-09-12T16:17:53.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896402+0000", 2024-09-12T16:17:53.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2280000000000001e-06 2024-09-12T16:17:53.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896407+0000", 2024-09-12T16:17:53.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3630000000000002e-06 2024-09-12T16:17:53.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935302+0000", 2024-09-12T16:17:53.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038895181000000001 2024-09-12T16:17:53.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.321 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:53.321 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935343+0000", 2024-09-12T16:17:53.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0590999999999998e-05 2024-09-12T16:17:53.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.321 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.321 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935400+0000", 2024-09-12T16:17:53.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7014e-05 2024-09-12T16:17:53.321 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.321 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.322 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.322 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2315 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12434432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:53.322 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:17:53.322 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 95.386746830999996, 2024-09-12T16:17:53.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039083892000000002, 2024-09-12T16:17:53.322 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.322 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.322 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:53.322 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.322 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:53.322 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:53.323 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2315 2024-09-12T16:17:53.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.323 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:17:53.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896414+0000", 2024-09-12T16:17:53.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896415+0000", 2024-09-12T16:17:53.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3300000000000002e-07 2024-09-12T16:17:53.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896421+0000", 2024-09-12T16:17:53.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7579999999999998e-06 2024-09-12T16:17:53.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.325 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896427+0000", 2024-09-12T16:17:53.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3029999999999996e-06 2024-09-12T16:17:53.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.325 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.325 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896432+0000", 2024-09-12T16:17:53.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.215e-06 2024-09-12T16:17:53.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.325 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.325 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935420+0000", 2024-09-12T16:17:53.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038987727 2024-09-12T16:17:53.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.326 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:53.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935460+0000", 2024-09-12T16:17:53.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9817999999999997e-05 2024-09-12T16:17:53.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.326 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935498+0000", 2024-09-12T16:17:53.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8438e-05 2024-09-12T16:17:53.326 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.327 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.327 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.327 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:2316 3.7 3:e677bcce:::rbd_data.1155627435cb.0000000000000006:9 [read 12438528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:53.327 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:17:53.327 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 95.386722179000003, 2024-09-12T16:17:53.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039160043999999998, 2024-09-12T16:17:53.327 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.327 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.327 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:53.327 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.327 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:53.327 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:53.328 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2316 2024-09-12T16:17:53.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.328 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:17:53.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.896439+0000", 2024-09-12T16:17:53.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901945+0000", 2024-09-12T16:17:53.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055056050000000002 2024-09-12T16:17:53.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901950+0000", 2024-09-12T16:17:53.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2490000000000001e-06 2024-09-12T16:17:53.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901966+0000", 2024-09-12T16:17:53.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6325e-05 2024-09-12T16:17:53.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.901974+0000", 2024-09-12T16:17:53.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7570000000000004e-06 2024-09-12T16:17:53.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935518+0000", 2024-09-12T16:17:53.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033543587999999999 2024-09-12T16:17:53.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:53.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935559+0000", 2024-09-12T16:17:53.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1746000000000003e-05 2024-09-12T16:17:53.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:17.935599+0000", 2024-09-12T16:17:53.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9774000000000002e-05 2024-09-12T16:17:53.331 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.331 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.331 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.331 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1571 3.b 3:d046566d:::rbd_data.1155525b14e3.0000000000000001:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:17:53.331 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:17:53.331 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.130597136999995, 2024-09-12T16:17:53.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064439785999999999, 2024-09-12T16:17:53.331 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.331 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.332 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:53.332 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.332 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:17:53.332 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:17:53.332 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1571 2024-09-12T16:17:53.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.332 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:17:53.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:17:53.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:17:53.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5400000000000002e-07 2024-09-12T16:17:53.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152567+0000", 2024-09-12T16:17:53.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.131e-06 2024-09-12T16:17:53.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152574+0000", 2024-09-12T16:17:53.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1840000000000002e-06 2024-09-12T16:17:53.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152579+0000", 2024-09-12T16:17:53.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.152e-06 2024-09-12T16:17:53.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153671+0000", 2024-09-12T16:17:53.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001092078 2024-09-12T16:17:53.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:53.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153779+0000", 2024-09-12T16:17:53.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108461 2024-09-12T16:17:53.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217004+0000", 2024-09-12T16:17:53.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.063224426 2024-09-12T16:17:53.336 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.336 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.336 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.336 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1581 3.4 3:22e34893:::rbd_data.1155525b14e3.0000000000000005:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:17:53.336 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:17:53.336 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.130500011999999, 2024-09-12T16:17:53.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064484407999999993, 2024-09-12T16:17:53.336 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.336 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.336 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:53.337 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.337 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:17:53.337 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:17:53.337 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1581 2024-09-12T16:17:53.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.337 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:17:53.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:17:53.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152662+0000", 2024-09-12T16:17:53.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.65e-07 2024-09-12T16:17:53.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152664+0000", 2024-09-12T16:17:53.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9829999999999999e-06 2024-09-12T16:17:53.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152670+0000", 2024-09-12T16:17:53.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2260000000000002e-06 2024-09-12T16:17:53.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152675+0000", 2024-09-12T16:17:53.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7990000000000001e-06 2024-09-12T16:17:53.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.340 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.216945+0000", 2024-09-12T16:17:53.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064270341999999994 2024-09-12T16:17:53.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:53.340 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217040+0000", 2024-09-12T16:17:53.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5242999999999996e-05 2024-09-12T16:17:53.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.340 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217146+0000", 2024-09-12T16:17:53.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010545 2024-09-12T16:17:53.340 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.341 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.341 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.341 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2207 3.0 3:05fdc61f:::rbd_data.1155ccb1894c.0000000000000003:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:53.341 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:17:53.341 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.912456450999997, 2024-09-12T16:17:53.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.05105382, 2024-09-12T16:17:53.341 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.341 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.341 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:53.341 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.341 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:17:53.341 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:17:53.342 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2207 2024-09-12T16:17:53.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.342 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.342 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:17:53.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.342 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:17:53.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370706+0000", 2024-09-12T16:17:53.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7800000000000001e-07 2024-09-12T16:17:53.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391581+0000", 2024-09-12T16:17:53.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020875624999999998 2024-09-12T16:17:53.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391608+0000", 2024-09-12T16:17:53.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6412999999999999e-05 2024-09-12T16:17:53.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391618+0000", 2024-09-12T16:17:53.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9240000000000002e-06 2024-09-12T16:17:53.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391705+0000", 2024-09-12T16:17:53.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7489000000000002e-05 2024-09-12T16:17:53.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.345 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:53.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391838+0000", 2024-09-12T16:17:53.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132865 2024-09-12T16:17:53.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.345 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 2", 2024-09-12T16:17:53.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.392587+0000", 2024-09-12T16:17:53.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074930000000000005 2024-09-12T16:17:53.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:53.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.420095+0000", 2024-09-12T16:17:53.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027507949 2024-09-12T16:17:53.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:17:53.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421610+0000", 2024-09-12T16:17:53.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001515195 2024-09-12T16:17:53.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:17:53.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421681+0000", 2024-09-12T16:17:53.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0320000000000004e-05 2024-09-12T16:17:53.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.347 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421759+0000", 2024-09-12T16:17:53.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7961999999999997e-05 2024-09-12T16:17:53.347 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.347 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.347 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.347 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5577.0:12725 3.0 3:02074383:::rbd_data.11552c69b548.0000000000000011:20 [read 785408~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-12T16:17:53.347 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:29.288770+0000", 2024-09-12T16:17:53.348 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.994391440000001, 2024-09-12T16:17:53.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038316849, 2024-09-12T16:17:53.348 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.348 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.348 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:53.348 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.348 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5577", 2024-09-12T16:17:53.348 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/4222688771", 2024-09-12T16:17:53.348 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 12725 2024-09-12T16:17:53.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.348 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288770+0000", 2024-09-12T16:17:53.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288770+0000", 2024-09-12T16:17:53.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288770+0000", 2024-09-12T16:17:53.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8500000000000002e-07 2024-09-12T16:17:53.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.350 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.350 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288772+0000", 2024-09-12T16:17:53.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2689999999999998e-06 2024-09-12T16:17:53.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.350 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.350 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288779+0000", 2024-09-12T16:17:53.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8310000000000003e-06 2024-09-12T16:17:53.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.350 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.350 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288784+0000", 2024-09-12T16:17:53.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1529999999999996e-06 2024-09-12T16:17:53.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.326899+0000", 2024-09-12T16:17:53.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038114980999999999 2024-09-12T16:17:53.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:53.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.326990+0000", 2024-09-12T16:17:53.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0191000000000004e-05 2024-09-12T16:17:53.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327087+0000", 2024-09-12T16:17:53.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7039000000000004e-05 2024-09-12T16:17:53.352 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.352 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.352 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.352 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5577.0:12726 3.0 3:02074383:::rbd_data.11552c69b548.0000000000000011:20 [read 793600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-12T16:17:53.352 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:29.288794+0000", 2024-09-12T16:17:53.352 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.994367488999998, 2024-09-12T16:17:53.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038526029000000003, 2024-09-12T16:17:53.352 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.352 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.352 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:53.352 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.352 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5577", 2024-09-12T16:17:53.353 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/4222688771", 2024-09-12T16:17:53.353 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 12726 2024-09-12T16:17:53.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.353 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288794+0000", 2024-09-12T16:17:53.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288794+0000", 2024-09-12T16:17:53.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288794+0000", 2024-09-12T16:17:53.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2799999999999996e-07 2024-09-12T16:17:53.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288797+0000", 2024-09-12T16:17:53.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3920000000000001e-06 2024-09-12T16:17:53.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288804+0000", 2024-09-12T16:17:53.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8430000000000004e-06 2024-09-12T16:17:53.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288809+0000", 2024-09-12T16:17:53.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1460000000000004e-06 2024-09-12T16:17:53.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327130+0000", 2024-09-12T16:17:53.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038320982000000003 2024-09-12T16:17:53.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:53.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327216+0000", 2024-09-12T16:17:53.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5991999999999999e-05 2024-09-12T16:17:53.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.356 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.356 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327320+0000", 2024-09-12T16:17:53.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000104146 2024-09-12T16:17:53.356 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.356 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.356 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.356 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5577.0:12727 3.0 3:02074383:::rbd_data.11552c69b548.0000000000000011:20 [read 801792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-12T16:17:53.356 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:29.288838+0000", 2024-09-12T16:17:53.356 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.994323665, 2024-09-12T16:17:53.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038705804000000003, 2024-09-12T16:17:53.357 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.357 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.357 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:53.357 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.357 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5577", 2024-09-12T16:17:53.357 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/4222688771", 2024-09-12T16:17:53.357 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 12727 2024-09-12T16:17:53.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.357 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288838+0000", 2024-09-12T16:17:53.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288838+0000", 2024-09-12T16:17:53.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288838+0000", 2024-09-12T16:17:53.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8299999999999997e-07 2024-09-12T16:17:53.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288840+0000", 2024-09-12T16:17:53.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.396e-06 2024-09-12T16:17:53.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288851+0000", 2024-09-12T16:17:53.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0312999999999999e-05 2024-09-12T16:17:53.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288857+0000", 2024-09-12T16:17:53.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7570000000000001e-06 2024-09-12T16:17:53.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327361+0000", 2024-09-12T16:17:53.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038504069000000002 2024-09-12T16:17:53.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:53.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327446+0000", 2024-09-12T16:17:53.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5542000000000002e-05 2024-09-12T16:17:53.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327543+0000", 2024-09-12T16:17:53.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7244000000000006e-05 2024-09-12T16:17:53.361 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.361 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.361 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.361 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5577.0:12728 3.0 3:02074383:::rbd_data.11552c69b548.0000000000000011:20 [read 809984~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-12T16:17:53.362 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:29.288864+0000", 2024-09-12T16:17:53.362 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.994296850000001, 2024-09-12T16:17:53.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038914837000000001, 2024-09-12T16:17:53.362 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.362 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.362 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:53.362 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.362 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5577", 2024-09-12T16:17:53.362 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/4222688771", 2024-09-12T16:17:53.362 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 12728 2024-09-12T16:17:53.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.362 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.363 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288864+0000", 2024-09-12T16:17:53.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.363 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288864+0000", 2024-09-12T16:17:53.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.363 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288865+0000", 2024-09-12T16:17:53.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-07 2024-09-12T16:17:53.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.364 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288867+0000", 2024-09-12T16:17:53.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.092e-06 2024-09-12T16:17:53.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.364 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288873+0000", 2024-09-12T16:17:53.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0020000000000003e-06 2024-09-12T16:17:53.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288878+0000", 2024-09-12T16:17:53.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2700000000000004e-06 2024-09-12T16:17:53.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327588+0000", 2024-09-12T16:17:53.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038709660999999999 2024-09-12T16:17:53.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:53.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327673+0000", 2024-09-12T16:17:53.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5370000000000004e-05 2024-09-12T16:17:53.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327779+0000", 2024-09-12T16:17:53.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000105957 2024-09-12T16:17:53.366 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.366 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.366 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.366 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5577.0:12729 3.0 3.c1c2e040 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-12T16:17:53.366 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:29.288885+0000", 2024-09-12T16:17:53.366 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.994276524, 2024-09-12T16:17:53.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038952112999999997, 2024-09-12T16:17:53.366 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.366 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.367 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:17:53.367 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.367 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5577", 2024-09-12T16:17:53.367 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/4222688771", 2024-09-12T16:17:53.367 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 12729 2024-09-12T16:17:53.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.367 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.367 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.367 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288885+0000", 2024-09-12T16:17:53.368 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.368 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.368 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288885+0000", 2024-09-12T16:17:53.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288885+0000", 2024-09-12T16:17:53.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9299999999999999e-07 2024-09-12T16:17:53.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288887+0000", 2024-09-12T16:17:53.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9589999999999998e-06 2024-09-12T16:17:53.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288893+0000", 2024-09-12T16:17:53.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8579999999999996e-06 2024-09-12T16:17:53.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288898+0000", 2024-09-12T16:17:53.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-06 2024-09-12T16:17:53.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327827+0000", 2024-09-12T16:17:53.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038928782000000002 2024-09-12T16:17:53.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327837+0000", 2024-09-12T16:17:53.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0271e-05 2024-09-12T16:17:53.371 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.371 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.371 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.371 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5577.0:12730 3.0 3.c1c2e040 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-12T16:17:53.371 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:29.288904+0000", 2024-09-12T16:17:53.371 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.994257216000001, 2024-09-12T16:17:53.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038984576999999999, 2024-09-12T16:17:53.371 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.371 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.372 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:17:53.372 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.372 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5577", 2024-09-12T16:17:53.372 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/4222688771", 2024-09-12T16:17:53.372 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 12730 2024-09-12T16:17:53.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.372 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288904+0000", 2024-09-12T16:17:53.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288904+0000", 2024-09-12T16:17:53.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288904+0000", 2024-09-12T16:17:53.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.65e-07 2024-09-12T16:17:53.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288906+0000", 2024-09-12T16:17:53.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9549999999999999e-06 2024-09-12T16:17:53.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288912+0000", 2024-09-12T16:17:53.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9460000000000003e-06 2024-09-12T16:17:53.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288926+0000", 2024-09-12T16:17:53.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3540000000000001e-05 2024-09-12T16:17:53.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327882+0000", 2024-09-12T16:17:53.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038956565999999998 2024-09-12T16:17:53.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327889+0000", 2024-09-12T16:17:53.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2049999999999999e-06 2024-09-12T16:17:53.375 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.375 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.375 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.375 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5577.0:12731 3.0 3.c1c2e040 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-12T16:17:53.375 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:29.288934+0000", 2024-09-12T16:17:53.375 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.99422684, 2024-09-12T16:17:53.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039017193999999998, 2024-09-12T16:17:53.375 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.375 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.375 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:17:53.375 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.375 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5577", 2024-09-12T16:17:53.375 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/4222688771", 2024-09-12T16:17:53.376 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 12731 2024-09-12T16:17:53.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.376 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.376 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288934+0000", 2024-09-12T16:17:53.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288934+0000", 2024-09-12T16:17:53.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288935+0000", 2024-09-12T16:17:53.378 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7599999999999998e-07 2024-09-12T16:17:53.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.378 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.378 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288937+0000", 2024-09-12T16:17:53.378 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4540000000000001e-06 2024-09-12T16:17:53.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.378 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.378 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288944+0000", 2024-09-12T16:17:53.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4980000000000003e-06 2024-09-12T16:17:53.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.379 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.379 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.288949+0000", 2024-09-12T16:17:53.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1399999999999999e-06 2024-09-12T16:17:53.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327944+0000", 2024-09-12T16:17:53.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038994859999999999 2024-09-12T16:17:53.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:29.327952+0000", 2024-09-12T16:17:53.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8660000000000006e-06 2024-09-12T16:17:53.381 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.381 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.381 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.381 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.381 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.381 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:53.382 INFO:teuthology.orchestra.run.smithi204.stdout:5653 trunc from 0x858c800 to 0x5c9b800 2024-09-12T16:17:53.383 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:53.382+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:53.383 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:17:53.423 INFO:teuthology.orchestra.run.smithi204.stdout:5654 write 0xbcb0400 thru 0xbcb2eca (0x2acb bytes) 2024-09-12T16:17:53.424 INFO:teuthology.orchestra.run.smithi204.stdout:5655 write 0x4816600 thru 0x48174b8 (0xeb9 bytes) 2024-09-12T16:17:53.424 INFO:teuthology.orchestra.run.smithi204.stdout:5656 punch from 0x3563800 to 0x3570a00, (0xd200 bytes) 2024-09-12T16:17:53.480 INFO:teuthology.orchestra.run.smithi204.stdout:5664 trunc from 0xbcb3000 to 0x8814800 2024-09-12T16:17:53.483 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:53.482+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:53.564 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:53.565 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:53.565 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:17:53.565 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:53.575 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:17:53.584 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:53.583+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:53.585 INFO:teuthology.orchestra.run.smithi204.stdout:5665 trunc from 0x8814800 to 0x79b9800 2024-09-12T16:17:53.599 INFO:teuthology.orchestra.run.smithi204.stdout:5666 punch from 0x7537a00 to 0x753e200, (0x6800 bytes) 2024-09-12T16:17:53.619 INFO:teuthology.orchestra.run.smithi204.stdout:5667 write 0xdc96a00 thru 0xdc9c107 (0x5708 bytes) 2024-09-12T16:17:53.626 INFO:teuthology.orchestra.run.smithi204.stdout:5669 trunc from 0xdc9c200 to 0x85c9200 2024-09-12T16:17:53.685 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:53.684+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:53.688 INFO:teuthology.orchestra.run.smithi204.stdout:5670 punch from 0x219ae00 to 0x21a7000, (0xc200 bytes) 2024-09-12T16:17:53.693 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:53.693 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:53.693 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:17:53.693 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:17:53.693 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:53.704 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:17:53.763 INFO:teuthology.orchestra.run.smithi204.stdout:5671 read 0x46dd000 thru 0x46dd1db (0x1dc bytes) 2024-09-12T16:17:53.763 INFO:teuthology.orchestra.run.smithi204.stdout:5673 read 0xc85200 thru 0xc8883f (0x3640 bytes) 2024-09-12T16:17:53.790 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:53.789+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:53.792 INFO:teuthology.orchestra.run.smithi204.stdout:5674 write 0xdfd600 thru 0xe0a0c1 (0xcac2 bytes) 2024-09-12T16:17:53.796 INFO:teuthology.orchestra.run.smithi204.stdout:5675 trunc from 0x85c9200 to 0x52fd400 2024-09-12T16:17:53.886 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:53.885+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:53.899 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:53.899 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:17:53.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:17:53.899 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:17:53.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.899 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2213 3.18 3:1944e921:::rbd_data.1155ccb1894c.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:53.899 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:17:53.899 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 56.522079308999999, 2024-09-12T16:17:53.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.055657836000000002, 2024-09-12T16:17:53.899 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.899 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.899 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:53.899 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.899 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:17:53.900 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:17:53.900 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2213 2024-09-12T16:17:53.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.900 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.900 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.900 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:17:53.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.900 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.900 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:17:53.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.901 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.901 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375351+0000", 2024-09-12T16:17:53.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.556e-06 2024-09-12T16:17:53.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.901 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.901 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.399989+0000", 2024-09-12T16:17:53.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024637949999999999 2024-09-12T16:17:53.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.901 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.901 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400038+0000", 2024-09-12T16:17:53.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9187999999999997e-05 2024-09-12T16:17:53.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400056+0000", 2024-09-12T16:17:53.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8451e-05 2024-09-12T16:17:53.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400151+0000", 2024-09-12T16:17:53.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5026999999999997e-05 2024-09-12T16:17:53.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:53.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400345+0000", 2024-09-12T16:17:53.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019352900000000001 2024-09-12T16:17:53.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 1", 2024-09-12T16:17:53.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.401319+0000", 2024-09-12T16:17:53.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00097419399999999995 2024-09-12T16:17:53.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:17:53.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.429350+0000", 2024-09-12T16:17:53.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028030607999999999 2024-09-12T16:17:53.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:53.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.430907+0000", 2024-09-12T16:17:53.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001557466 2024-09-12T16:17:53.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:17:53.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.430966+0000", 2024-09-12T16:17:53.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9437e-05 2024-09-12T16:17:53.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.431007+0000", 2024-09-12T16:17:53.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0429999999999997e-05 2024-09-12T16:17:53.905 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.905 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.905 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.905 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6725 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2392064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:53.905 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.557452+0000", 2024-09-12T16:17:53.905 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 41.339976643, 2024-09-12T16:17:53.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045294112999999997, 2024-09-12T16:17:53.905 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.905 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.906 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:53.906 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.906 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:53.906 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:53.906 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6725 2024-09-12T16:17:53.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.906 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.906 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.906 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557452+0000", 2024-09-12T16:17:53.906 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.906 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557452+0000", 2024-09-12T16:17:53.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557693+0000", 2024-09-12T16:17:53.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024098699999999999 2024-09-12T16:17:53.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557697+0000", 2024-09-12T16:17:53.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8489999999999999e-06 2024-09-12T16:17:53.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557707+0000", 2024-09-12T16:17:53.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0356999999999999e-05 2024-09-12T16:17:53.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557714+0000", 2024-09-12T16:17:53.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0219999999999999e-06 2024-09-12T16:17:53.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.602612+0000", 2024-09-12T16:17:53.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044897907000000001 2024-09-12T16:17:53.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:53.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.602683+0000", 2024-09-12T16:17:53.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1171e-05 2024-09-12T16:17:53.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.602746+0000", 2024-09-12T16:17:53.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2819999999999998e-05 2024-09-12T16:17:53.909 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.909 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.909 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.910 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6727 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2422784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:53.910 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.557749+0000", 2024-09-12T16:17:53.910 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 41.339679044, 2024-09-12T16:17:53.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045329659000000001, 2024-09-12T16:17:53.910 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.910 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.910 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:53.910 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.910 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:53.910 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:53.910 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6727 2024-09-12T16:17:53.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.910 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557749+0000", 2024-09-12T16:17:53.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557749+0000", 2024-09-12T16:17:53.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557750+0000", 2024-09-12T16:17:53.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6600000000000002e-07 2024-09-12T16:17:53.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557752+0000", 2024-09-12T16:17:53.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.278e-06 2024-09-12T16:17:53.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557759+0000", 2024-09-12T16:17:53.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7329999999999997e-06 2024-09-12T16:17:53.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.913 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.913 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557764+0000", 2024-09-12T16:17:53.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0390000000000004e-06 2024-09-12T16:17:53.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.913 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.913 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.602943+0000", 2024-09-12T16:17:53.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045179035999999999 2024-09-12T16:17:53.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.913 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:53.913 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603016+0000", 2024-09-12T16:17:53.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2999999999999999e-05 2024-09-12T16:17:53.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.914 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.914 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603079+0000", 2024-09-12T16:17:53.914 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3107000000000004e-05 2024-09-12T16:17:53.914 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.914 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.914 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.914 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6728 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2439168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:53.914 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.557771+0000", 2024-09-12T16:17:53.914 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 41.339657168000002, 2024-09-12T16:17:53.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045474239, 2024-09-12T16:17:53.915 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.915 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.915 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:53.915 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.915 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:53.915 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:53.915 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6728 2024-09-12T16:17:53.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.915 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.915 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.915 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557771+0000", 2024-09-12T16:17:53.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557771+0000", 2024-09-12T16:17:53.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557772+0000", 2024-09-12T16:17:53.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5400000000000002e-07 2024-09-12T16:17:53.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557774+0000", 2024-09-12T16:17:53.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.165e-06 2024-09-12T16:17:53.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557782+0000", 2024-09-12T16:17:53.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3289999999999994e-06 2024-09-12T16:17:53.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557787+0000", 2024-09-12T16:17:53.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1909999999999999e-06 2024-09-12T16:17:53.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603110+0000", 2024-09-12T16:17:53.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045322710000000002 2024-09-12T16:17:53.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:53.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603182+0000", 2024-09-12T16:17:53.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1755999999999995e-05 2024-09-12T16:17:53.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603245+0000", 2024-09-12T16:17:53.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3633999999999994e-05 2024-09-12T16:17:53.918 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.918 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.919 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.919 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6729 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2454528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:53.919 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.557794+0000", 2024-09-12T16:17:53.919 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 41.339634386999997, 2024-09-12T16:17:53.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045614517, 2024-09-12T16:17:53.919 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.919 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.919 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:53.919 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.919 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:53.919 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:53.920 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6729 2024-09-12T16:17:53.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.920 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557794+0000", 2024-09-12T16:17:53.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557794+0000", 2024-09-12T16:17:53.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557879+0000", 2024-09-12T16:17:53.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5130000000000007e-05 2024-09-12T16:17:53.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557884+0000", 2024-09-12T16:17:53.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2390000000000002e-06 2024-09-12T16:17:53.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557894+0000", 2024-09-12T16:17:53.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4800000000000007e-06 2024-09-12T16:17:53.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557900+0000", 2024-09-12T16:17:53.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5610000000000004e-06 2024-09-12T16:17:53.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603273+0000", 2024-09-12T16:17:53.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045372799999999998 2024-09-12T16:17:53.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:53.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603345+0000", 2024-09-12T16:17:53.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1562000000000004e-05 2024-09-12T16:17:53.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603408+0000", 2024-09-12T16:17:53.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3744999999999994e-05 2024-09-12T16:17:53.923 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.923 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.923 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.924 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6730 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2469888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:53.924 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.557911+0000", 2024-09-12T16:17:53.924 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 41.33951699, 2024-09-12T16:17:53.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045661090000000001, 2024-09-12T16:17:53.924 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.924 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.924 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:53.924 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.924 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:53.924 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:53.924 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6730 2024-09-12T16:17:53.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.924 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557911+0000", 2024-09-12T16:17:53.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557911+0000", 2024-09-12T16:17:53.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557912+0000", 2024-09-12T16:17:53.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8299999999999997e-07 2024-09-12T16:17:53.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557914+0000", 2024-09-12T16:17:53.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.531e-06 2024-09-12T16:17:53.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557927+0000", 2024-09-12T16:17:53.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2685e-05 2024-09-12T16:17:53.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557932+0000", 2024-09-12T16:17:53.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3020000000000002e-06 2024-09-12T16:17:53.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603436+0000", 2024-09-12T16:17:53.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045503210000000002 2024-09-12T16:17:53.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:53.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603508+0000", 2024-09-12T16:17:53.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2792000000000004e-05 2024-09-12T16:17:53.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603572+0000", 2024-09-12T16:17:53.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4086999999999998e-05 2024-09-12T16:17:53.928 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.928 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.928 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.928 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6731 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2485248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:53.928 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.557942+0000", 2024-09-12T16:17:53.928 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 41.339486790000002, 2024-09-12T16:17:53.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045794662, 2024-09-12T16:17:53.928 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.928 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.928 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:53.928 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.929 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:53.929 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:53.929 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6731 2024-09-12T16:17:53.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.929 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.929 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.929 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557942+0000", 2024-09-12T16:17:53.929 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557942+0000", 2024-09-12T16:17:53.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559076+0000", 2024-09-12T16:17:53.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011348280000000001 2024-09-12T16:17:53.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.931 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559081+0000", 2024-09-12T16:17:53.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6820000000000002e-06 2024-09-12T16:17:53.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.931 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559089+0000", 2024-09-12T16:17:53.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0469999999999994e-06 2024-09-12T16:17:53.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.932 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559095+0000", 2024-09-12T16:17:53.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.212e-06 2024-09-12T16:17:53.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.932 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603601+0000", 2024-09-12T16:17:53.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044505321 2024-09-12T16:17:53.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:53.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603675+0000", 2024-09-12T16:17:53.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4455000000000005e-05 2024-09-12T16:17:53.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603736+0000", 2024-09-12T16:17:53.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1117000000000005e-05 2024-09-12T16:17:53.934 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.934 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.934 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.934 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6735 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2547712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:53.935 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.559184+0000", 2024-09-12T16:17:53.935 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 41.338243943000002, 2024-09-12T16:17:53.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045228008, 2024-09-12T16:17:53.935 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.935 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.935 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:53.935 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.935 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:53.935 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:53.935 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6735 2024-09-12T16:17:53.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.935 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.936 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.936 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559184+0000", 2024-09-12T16:17:53.936 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.936 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.936 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559184+0000", 2024-09-12T16:17:53.936 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.936 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.936 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559185+0000", 2024-09-12T16:17:53.936 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8100000000000003e-07 2024-09-12T16:17:53.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.937 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559187+0000", 2024-09-12T16:17:53.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9309999999999998e-06 2024-09-12T16:17:53.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.937 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559193+0000", 2024-09-12T16:17:53.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3629999999999999e-06 2024-09-12T16:17:53.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.937 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559200+0000", 2024-09-12T16:17:53.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6950000000000003e-06 2024-09-12T16:17:53.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604265+0000", 2024-09-12T16:17:53.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045064924999999999 2024-09-12T16:17:53.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:53.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604344+0000", 2024-09-12T16:17:53.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8830000000000002e-05 2024-09-12T16:17:53.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604412+0000", 2024-09-12T16:17:53.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8683000000000006e-05 2024-09-12T16:17:53.938 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.938 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.939 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.939 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6736 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2564096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:53.939 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.559207+0000", 2024-09-12T16:17:53.939 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 41.338220980000003, 2024-09-12T16:17:53.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045365924000000002, 2024-09-12T16:17:53.939 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.939 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.939 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:53.939 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.939 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:53.939 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:53.939 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6736 2024-09-12T16:17:53.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.940 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.940 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559207+0000", 2024-09-12T16:17:53.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.940 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559207+0000", 2024-09-12T16:17:53.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.941 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559208+0000", 2024-09-12T16:17:53.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6800000000000001e-07 2024-09-12T16:17:53.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.941 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559210+0000", 2024-09-12T16:17:53.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0490000000000002e-06 2024-09-12T16:17:53.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.941 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559218+0000", 2024-09-12T16:17:53.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7510000000000008e-06 2024-09-12T16:17:53.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.942 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.942 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559223+0000", 2024-09-12T16:17:53.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1229999999999999e-06 2024-09-12T16:17:53.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.942 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.942 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604440+0000", 2024-09-12T16:17:53.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045217599999999997 2024-09-12T16:17:53.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.942 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:53.943 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604512+0000", 2024-09-12T16:17:53.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1909000000000006e-05 2024-09-12T16:17:53.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.943 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604573+0000", 2024-09-12T16:17:53.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1023999999999997e-05 2024-09-12T16:17:53.943 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.943 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.943 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.944 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6737 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2579456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:53.944 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.559229+0000", 2024-09-12T16:17:53.944 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 41.338198853999998, 2024-09-12T16:17:53.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045505640999999999, 2024-09-12T16:17:53.944 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.944 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.944 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:53.944 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.944 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:53.944 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:53.944 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6737 2024-09-12T16:17:53.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.944 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559229+0000", 2024-09-12T16:17:53.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559229+0000", 2024-09-12T16:17:53.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559230+0000", 2024-09-12T16:17:53.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1399999999999997e-07 2024-09-12T16:17:53.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559232+0000", 2024-09-12T16:17:53.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8360000000000001e-06 2024-09-12T16:17:53.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559238+0000", 2024-09-12T16:17:53.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2360000000000001e-06 2024-09-12T16:17:53.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559242+0000", 2024-09-12T16:17:53.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4390000000000002e-06 2024-09-12T16:17:53.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604599+0000", 2024-09-12T16:17:53.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045356527000000001 2024-09-12T16:17:53.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:53.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604669+0000", 2024-09-12T16:17:53.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0442000000000001e-05 2024-09-12T16:17:53.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604735+0000", 2024-09-12T16:17:53.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5647000000000004e-05 2024-09-12T16:17:53.948 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.948 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.948 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.948 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6738 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2594816~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:53.948 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.559250+0000", 2024-09-12T16:17:53.948 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 41.338177991000002, 2024-09-12T16:17:53.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045646834999999997, 2024-09-12T16:17:53.949 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.949 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.949 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:53.949 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.949 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:53.949 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:53.949 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6738 2024-09-12T16:17:53.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.949 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.949 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559250+0000", 2024-09-12T16:17:53.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559250+0000", 2024-09-12T16:17:53.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559251+0000", 2024-09-12T16:17:53.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1699999999999999e-07 2024-09-12T16:17:53.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559253+0000", 2024-09-12T16:17:53.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2910000000000002e-06 2024-09-12T16:17:53.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.951 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.951 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559260+0000", 2024-09-12T16:17:53.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2200000000000003e-06 2024-09-12T16:17:53.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.951 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.951 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559265+0000", 2024-09-12T16:17:53.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2050000000000001e-06 2024-09-12T16:17:53.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.951 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.951 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604763+0000", 2024-09-12T16:17:53.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045497964000000002 2024-09-12T16:17:53.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:53.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604835+0000", 2024-09-12T16:17:53.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1705000000000005e-05 2024-09-12T16:17:53.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604897+0000", 2024-09-12T16:17:53.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2032999999999994e-05 2024-09-12T16:17:53.952 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.952 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.952 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.953 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6739 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2610176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:53.953 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.559273+0000", 2024-09-12T16:17:53.953 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 41.338155172999997, 2024-09-12T16:17:53.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.04579105, 2024-09-12T16:17:53.953 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.953 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.953 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:53.953 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.953 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:53.953 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:53.953 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6739 2024-09-12T16:17:53.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.953 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559273+0000", 2024-09-12T16:17:53.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559273+0000", 2024-09-12T16:17:53.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559273+0000", 2024-09-12T16:17:53.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3299999999999998e-07 2024-09-12T16:17:53.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559276+0000", 2024-09-12T16:17:53.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1490000000000001e-06 2024-09-12T16:17:53.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559282+0000", 2024-09-12T16:17:53.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3199999999999996e-06 2024-09-12T16:17:53.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559288+0000", 2024-09-12T16:17:53.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.942e-06 2024-09-12T16:17:53.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604929+0000", 2024-09-12T16:17:53.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045641317000000001 2024-09-12T16:17:53.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:53.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.605001+0000", 2024-09-12T16:17:53.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1581000000000005e-05 2024-09-12T16:17:53.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.605064+0000", 2024-09-12T16:17:53.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3408e-05 2024-09-12T16:17:53.957 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.957 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.957 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.957 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6977 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2377728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:53.957 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.566114+0000", 2024-09-12T16:17:53.957 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 41.331314063999997, 2024-09-12T16:17:53.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045737673999999999, 2024-09-12T16:17:53.957 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.957 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.957 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:53.957 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.957 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:53.958 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:53.958 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6977 2024-09-12T16:17:53.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.958 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566114+0000", 2024-09-12T16:17:53.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566114+0000", 2024-09-12T16:17:53.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566115+0000", 2024-09-12T16:17:53.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.71e-07 2024-09-12T16:17:53.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566119+0000", 2024-09-12T16:17:53.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2749999999999997e-06 2024-09-12T16:17:53.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566128+0000", 2024-09-12T16:17:53.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9490000000000002e-06 2024-09-12T16:17:53.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566135+0000", 2024-09-12T16:17:53.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3459999999999999e-06 2024-09-12T16:17:53.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.610416+0000", 2024-09-12T16:17:53.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044281686000000001 2024-09-12T16:17:53.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:53.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.610536+0000", 2024-09-12T16:17:53.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000119412 2024-09-12T16:17:53.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.611852+0000", 2024-09-12T16:17:53.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001316135 2024-09-12T16:17:53.961 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.961 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.961 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.961 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6986 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2518016~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:53.961 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.566890+0000", 2024-09-12T16:17:53.961 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 41.330538140999998, 2024-09-12T16:17:53.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045234719999999999, 2024-09-12T16:17:53.961 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.961 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.962 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:53.962 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.962 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:53.962 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:53.962 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6986 2024-09-12T16:17:53.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.962 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566890+0000", 2024-09-12T16:17:53.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566890+0000", 2024-09-12T16:17:53.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.963 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566891+0000", 2024-09-12T16:17:53.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2799999999999995e-07 2024-09-12T16:17:53.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.963 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566895+0000", 2024-09-12T16:17:53.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8179999999999997e-06 2024-09-12T16:17:53.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566904+0000", 2024-09-12T16:17:53.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5179999999999993e-06 2024-09-12T16:17:53.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566911+0000", 2024-09-12T16:17:53.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1640000000000004e-06 2024-09-12T16:17:53.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.611985+0000", 2024-09-12T16:17:53.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045073545999999999 2024-09-12T16:17:53.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:53.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612061+0000", 2024-09-12T16:17:53.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5617999999999993e-05 2024-09-12T16:17:53.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612125+0000", 2024-09-12T16:17:53.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4327999999999998e-05 2024-09-12T16:17:53.965 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.965 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.966 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.966 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6987 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2533376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:53.966 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.566982+0000", 2024-09-12T16:17:53.966 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 41.330446121000001, 2024-09-12T16:17:53.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045308858, 2024-09-12T16:17:53.966 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.966 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.966 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:53.966 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.966 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:53.966 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:53.967 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6987 2024-09-12T16:17:53.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.967 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566982+0000", 2024-09-12T16:17:53.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566982+0000", 2024-09-12T16:17:53.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566983+0000", 2024-09-12T16:17:53.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2500000000000005e-07 2024-09-12T16:17:53.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566986+0000", 2024-09-12T16:17:53.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3000000000000002e-06 2024-09-12T16:17:53.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566995+0000", 2024-09-12T16:17:53.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8419999999999994e-06 2024-09-12T16:17:53.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567001+0000", 2024-09-12T16:17:53.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.161e-06 2024-09-12T16:17:53.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612154+0000", 2024-09-12T16:17:53.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045152858999999997 2024-09-12T16:17:53.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:53.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612229+0000", 2024-09-12T16:17:53.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4958999999999998e-05 2024-09-12T16:17:53.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612291+0000", 2024-09-12T16:17:53.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2012000000000002e-05 2024-09-12T16:17:53.971 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.971 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.971 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.971 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6988 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2548736~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:53.971 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.567055+0000", 2024-09-12T16:17:53.971 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 41.330373655000002, 2024-09-12T16:17:53.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045400078000000003, 2024-09-12T16:17:53.971 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.971 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.971 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:53.971 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.971 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:53.972 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:53.972 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6988 2024-09-12T16:17:53.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.972 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567055+0000", 2024-09-12T16:17:53.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567055+0000", 2024-09-12T16:17:53.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567055+0000", 2024-09-12T16:17:53.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3e-07 2024-09-12T16:17:53.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567059+0000", 2024-09-12T16:17:53.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4510000000000001e-06 2024-09-12T16:17:53.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567070+0000", 2024-09-12T16:17:53.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1477e-05 2024-09-12T16:17:53.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567077+0000", 2024-09-12T16:17:53.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7880000000000001e-06 2024-09-12T16:17:53.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612320+0000", 2024-09-12T16:17:53.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045242544000000003 2024-09-12T16:17:53.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:53.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612394+0000", 2024-09-12T16:17:53.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3854000000000001e-05 2024-09-12T16:17:53.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612455+0000", 2024-09-12T16:17:53.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1234000000000004e-05 2024-09-12T16:17:53.975 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.975 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.975 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.975 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6989 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2565120~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:53.976 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.567103+0000", 2024-09-12T16:17:53.976 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 41.330324849, 2024-09-12T16:17:53.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045514760000000001, 2024-09-12T16:17:53.976 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.976 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.976 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:53.976 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.976 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:53.976 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:53.976 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6989 2024-09-12T16:17:53.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.976 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567103+0000", 2024-09-12T16:17:53.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567103+0000", 2024-09-12T16:17:53.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567104+0000", 2024-09-12T16:17:53.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6400000000000002e-07 2024-09-12T16:17:53.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567107+0000", 2024-09-12T16:17:53.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.038e-06 2024-09-12T16:17:53.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567117+0000", 2024-09-12T16:17:53.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0244999999999999e-05 2024-09-12T16:17:53.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567124+0000", 2024-09-12T16:17:53.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1469999999999998e-06 2024-09-12T16:17:53.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612483+0000", 2024-09-12T16:17:53.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045359099999999999 2024-09-12T16:17:53.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:53.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612556+0000", 2024-09-12T16:17:53.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2948999999999996e-05 2024-09-12T16:17:53.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612618+0000", 2024-09-12T16:17:53.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2617e-05 2024-09-12T16:17:53.980 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.980 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.980 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.980 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6990 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2580480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:53.980 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.567155+0000", 2024-09-12T16:17:53.980 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 41.330273611999999, 2024-09-12T16:17:53.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045665681999999999, 2024-09-12T16:17:53.980 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.980 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.980 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:53.980 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.981 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:53.981 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:53.981 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6990 2024-09-12T16:17:53.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.981 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567155+0000", 2024-09-12T16:17:53.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567155+0000", 2024-09-12T16:17:53.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567155+0000", 2024-09-12T16:17:53.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5700000000000002e-07 2024-09-12T16:17:53.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567159+0000", 2024-09-12T16:17:53.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1729999999999999e-06 2024-09-12T16:17:53.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567167+0000", 2024-09-12T16:17:53.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3469999999999999e-06 2024-09-12T16:17:53.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567173+0000", 2024-09-12T16:17:53.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0719999999999996e-06 2024-09-12T16:17:53.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612651+0000", 2024-09-12T16:17:53.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045478078999999998 2024-09-12T16:17:53.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:53.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612741+0000", 2024-09-12T16:17:53.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0435999999999999e-05 2024-09-12T16:17:53.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612820+0000", 2024-09-12T16:17:53.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8918000000000006e-05 2024-09-12T16:17:53.984 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.984 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.984 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.984 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6991 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2595840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:53.984 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.567220+0000", 2024-09-12T16:17:53.984 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 41.330208603999999, 2024-09-12T16:17:53.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045811022999999999, 2024-09-12T16:17:53.985 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.985 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.985 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:53.985 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.985 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:53.985 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:53.985 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6991 2024-09-12T16:17:53.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.986 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567220+0000", 2024-09-12T16:17:53.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567220+0000", 2024-09-12T16:17:53.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567221+0000", 2024-09-12T16:17:53.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.16e-07 2024-09-12T16:17:53.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567225+0000", 2024-09-12T16:17:53.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3950000000000003e-06 2024-09-12T16:17:53.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567243+0000", 2024-09-12T16:17:53.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7734999999999999e-05 2024-09-12T16:17:53.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567253+0000", 2024-09-12T16:17:53.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7540000000000001e-06 2024-09-12T16:17:53.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612854+0000", 2024-09-12T16:17:53.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045601227000000001 2024-09-12T16:17:53.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:53.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612950+0000", 2024-09-12T16:17:53.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6121999999999999e-05 2024-09-12T16:17:53.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.613031+0000", 2024-09-12T16:17:53.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0873999999999999e-05 2024-09-12T16:17:53.990 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.990 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.991 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.991 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6992 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2611200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:53.991 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.567349+0000", 2024-09-12T16:17:53.991 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 41.330078847999999, 2024-09-12T16:17:53.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045848710000000001, 2024-09-12T16:17:53.991 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:53.991 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:53.991 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:53.991 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:53.992 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:53.992 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:53.992 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6992 2024-09-12T16:17:53.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.992 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:53.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:53.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567349+0000", 2024-09-12T16:17:53.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:53.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567349+0000", 2024-09-12T16:17:53.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:53.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:53.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567350+0000", 2024-09-12T16:17:53.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8899999999999998e-07 2024-09-12T16:17:53.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:53.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567354+0000", 2024-09-12T16:17:53.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0130000000000004e-06 2024-09-12T16:17:53.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:53.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567364+0000", 2024-09-12T16:17:53.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0158e-05 2024-09-12T16:17:53.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:53.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567369+0000", 2024-09-12T16:17:53.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4839999999999998e-06 2024-09-12T16:17:53.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:53.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.613072+0000", 2024-09-12T16:17:53.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045703195000000002 2024-09-12T16:17:53.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:53.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.613156+0000", 2024-09-12T16:17:53.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3591999999999995e-05 2024-09-12T16:17:53.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:53.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:53.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:53.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.613198+0000", 2024-09-12T16:17:53.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2478999999999998e-05 2024-09-12T16:17:53.996 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.996 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.996 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.996 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:53.996 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:53.996 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:53.996 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T16:17:53.998 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:17:53.998 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:53.997+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:54.098 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:54.098+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:54.108 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:54.108 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:17:54.108 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:54.108 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5883.0:13508 3.1e e109/64 3:7d3a1c73:::rbd_data.11558ed5fb98.0000000000000015:head v 109'452, mlcod=101'450)", 2024-09-12T16:17:54.108 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:54.103688+0000", 2024-09-12T16:17:54.108 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0041863029999999997, 2024-09-12T16:17:54.108 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0042024139999999998, 2024-09-12T16:17:54.108 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:54.108 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:54.108 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:54.108 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:54.109 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:54.109 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:54.109 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:54.103688+0000", 2024-09-12T16:17:54.109 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:54.109 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:54.109 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:54.109 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:54.109 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:54.103688+0000", 2024-09-12T16:17:54.109 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:54.109 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:54.109 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:54.109 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:54.109 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:54.103689+0000", 2024-09-12T16:17:54.109 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8899999999999998e-07 2024-09-12T16:17:54.110 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:54.110 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:54.110 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:54.110 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:54.104221+0000", 2024-09-12T16:17:54.110 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00053193800000000003 2024-09-12T16:17:54.110 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:54.110 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:54.110 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:54.110 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:54.104244+0000", 2024-09-12T16:17:54.110 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2736999999999999e-05 2024-09-12T16:17:54.110 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:54.110 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:54.110 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:54.110 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:54.104252+0000", 2024-09-12T16:17:54.110 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3790000000000006e-06 2024-09-12T16:17:54.111 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:54.111 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:54.111 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:54.111 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:54.104312+0000", 2024-09-12T16:17:54.111 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0293e-05 2024-09-12T16:17:54.111 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:54.111 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:54.111 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:54.111 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:54.104333+0000", 2024-09-12T16:17:54.111 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0727999999999999e-05 2024-09-12T16:17:54.111 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:54.112 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:54.112 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:54.112 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:54.112 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-12T16:17:54.112 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 1 2024-09-12T16:17:54.113 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:54.117 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:17:54.193 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:17:54.193 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:17:54.198 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:54.198+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:54.213 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:17:54.214 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:17:54.238 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:17:54.239 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:17:54.262 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:17:54.262 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:17:54.279 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:17:54.280 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:17:54.282 INFO:teuthology.orchestra.run.smithi204.stdout:5677 read 0x4604200 thru 0x4607f91 (0x3d92 bytes) 2024-09-12T16:17:54.287 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:54.287 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:54.297 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:17:54.298 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:17:54.298 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:17:54.299 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:54.298+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:54.302 INFO:teuthology.orchestra.run.smithi204.stdout:5678 write 0xd99be00 thru 0xd9a3203 (0x7404 bytes) 2024-09-12T16:17:54.317 INFO:teuthology.orchestra.run.smithi204.stdout:5681 trunc from 0xd9a3400 to 0x22f5e00 2024-09-12T16:17:54.384 INFO:teuthology.orchestra.run.smithi204.stdout:5683 write 0x6704800 thru 0x670f3d7 (0xabd8 bytes) 2024-09-12T16:17:54.400 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:54.400+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:54.419 INFO:teuthology.orchestra.run.smithi204.stdout:5685 write 0xa2f0200 thru 0xa2f0f60 (0xd61 bytes) 2024-09-12T16:17:54.419 INFO:teuthology.orchestra.run.smithi204.stdout:5686 write 0x16d1a00 thru 0x16d5cac (0x42ad bytes) 2024-09-12T16:17:54.419 INFO:teuthology.orchestra.run.smithi204.stdout:5687 punch from 0x2552a00 to 0x255bc00, (0x9200 bytes) 2024-09-12T16:17:54.420 INFO:teuthology.orchestra.run.smithi204.stdout:5688 punch from 0x25eca00 to 0x25f3e00, (0x7400 bytes) 2024-09-12T16:17:54.420 INFO:teuthology.orchestra.run.smithi204.stdout:5690 read 0x889400 thru 0x89530f (0xbf10 bytes) 2024-09-12T16:17:54.431 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:54.431 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:54.442 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:17:54.446 INFO:teuthology.orchestra.run.smithi204.stdout:5691 write 0xc3ad600 thru 0xc3b929c (0xbc9d bytes) 2024-09-12T16:17:54.447 INFO:teuthology.orchestra.run.smithi204.stdout:5692 read 0x5217600 thru 0x521a440 (0x2e41 bytes) 2024-09-12T16:17:54.447 INFO:teuthology.orchestra.run.smithi204.stdout:5694 write 0x4cbac00 thru 0x4cbb8e7 (0xce8 bytes) 2024-09-12T16:17:54.447 INFO:teuthology.orchestra.run.smithi204.stdout:5695 write 0x889d800 thru 0x88a0ee9 (0x36ea bytes) 2024-09-12T16:17:54.459 INFO:teuthology.orchestra.run.smithi204.stdout:5699 trunc from 0xc3b9400 to 0x2208600 2024-09-12T16:17:54.500 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:54.499+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:54.525 INFO:teuthology.orchestra.run.smithi204.stdout:5701 write 0x66f4c00 thru 0x66f5529 (0x92a bytes) 2024-09-12T16:17:54.525 INFO:teuthology.orchestra.run.smithi204.stdout:5702 read 0x17e2600 thru 0x17e6607 (0x4008 bytes) 2024-09-12T16:17:54.527 INFO:teuthology.orchestra.run.smithi204.stdout:5704 punch from 0xb54800 to 0xb55e00, (0x1600 bytes) 2024-09-12T16:17:54.531 INFO:teuthology.orchestra.run.smithi204.stdout:5706 read 0xdf5800 thru 0xdfb9b1 (0x61b2 bytes) 2024-09-12T16:17:54.533 INFO:teuthology.orchestra.run.smithi204.stdout:5708 read 0x3499600 thru 0x34a63d2 (0xcdd3 bytes) 2024-09-12T16:17:54.533 INFO:teuthology.orchestra.run.smithi204.stdout:5715 read 0x46c5c00 thru 0x46c8dc0 (0x31c1 bytes) 2024-09-12T16:17:54.591 INFO:teuthology.orchestra.run.smithi204.stdout:5716 write 0xb617200 thru 0xb625715 (0xe516 bytes) 2024-09-12T16:17:54.591 INFO:teuthology.orchestra.run.smithi204.stdout:5718 write 0x5f8f600 thru 0x5f95a61 (0x6462 bytes) 2024-09-12T16:17:54.592 INFO:teuthology.orchestra.run.smithi204.stdout:5719 read 0x5309600 thru 0x5313399 (0x9d9a bytes) 2024-09-12T16:17:54.592 INFO:teuthology.orchestra.run.smithi204.stdout:5720 write 0x83d3400 thru 0x83d4cd1 (0x18d2 bytes) 2024-09-12T16:17:54.592 INFO:teuthology.orchestra.run.smithi204.stdout:5721 write 0xb34a200 thru 0xb352f65 (0x8d66 bytes) 2024-09-12T16:17:54.592 INFO:teuthology.orchestra.run.smithi204.stdout:5722 punch from 0x8d5c00 to 0x8dd400, (0x7800 bytes) 2024-09-12T16:17:54.601 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:54.601+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:54.620 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:54.620 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:54.632 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:17:54.681 INFO:teuthology.orchestra.run.smithi204.stdout:5723 trunc from 0xb625800 to 0x3f8200 2024-09-12T16:17:54.702 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:54.701+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:54.804 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:54.803+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:54.814 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:54.814 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:54.825 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:17:54.887 INFO:teuthology.orchestra.run.smithi204.stdout:5725 trunc from 0x3f8200 to 0x76fc600 2024-09-12T16:17:54.897 INFO:teuthology.orchestra.run.smithi204.stdout:5727 read 0x257a600 thru 0x258497f (0xa380 bytes) 2024-09-12T16:17:54.898 INFO:teuthology.orchestra.run.smithi204.stdout:5728 punch from 0x200d600 to 0x201ba00, (0xe400 bytes) 2024-09-12T16:17:54.899 INFO:teuthology.orchestra.run.smithi204.stdout:5729 write 0x1ed9000 thru 0x1ee06c1 (0x76c2 bytes) 2024-09-12T16:17:54.899 INFO:teuthology.orchestra.run.smithi204.stdout:5731 read 0x6188c00 thru 0x6195b3d (0xcf3e bytes) 2024-09-12T16:17:54.900 INFO:teuthology.orchestra.run.smithi204.stdout:5732 trunc from 0x76fc600 to 0x893a000 2024-09-12T16:17:54.904 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:54.904+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:54.923 INFO:teuthology.orchestra.run.smithi204.stdout:5736 read 0x517a600 thru 0x518a2a0 (0xfca1 bytes) 2024-09-12T16:17:54.933 INFO:teuthology.orchestra.run.smithi204.stdout:5738 trunc from 0x893a000 to 0x144b600 2024-09-12T16:17:54.946 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:54.946 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:54.952 INFO:teuthology.orchestra.run.smithi204.stdout:5739 read 0xf7c00 thru 0x10340f (0xb810 bytes) 2024-09-12T16:17:54.957 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:17:54.959 INFO:teuthology.orchestra.run.smithi204.stdout:5741 read 0x4b9800 thru 0x4bbfb0 (0x27b1 bytes) 2024-09-12T16:17:54.959 INFO:teuthology.orchestra.run.smithi204.stdout:5743 read 0xa75600 thru 0xa7f943 (0xa344 bytes) 2024-09-12T16:17:54.959 INFO:teuthology.orchestra.run.smithi204.stdout:5745 read 0x1098800 thru 0x10a83e9 (0xfbea bytes) 2024-09-12T16:17:54.959 INFO:teuthology.orchestra.run.smithi204.stdout:5746 read 0x689600 thru 0x68e5e8 (0x4fe9 bytes) 2024-09-12T16:17:54.973 INFO:teuthology.orchestra.run.smithi204.stdout:5748 write 0x5e03200 thru 0x5e1066e (0xd46f bytes) 2024-09-12T16:17:54.974 INFO:teuthology.orchestra.run.smithi204.stdout:5750 read 0x3609600 thru 0x36122a4 (0x8ca5 bytes) 2024-09-12T16:17:54.974 INFO:teuthology.orchestra.run.smithi204.stdout:5752 read 0x33cdc00 thru 0x33d2b97 (0x4f98 bytes) 2024-09-12T16:17:54.975 INFO:teuthology.orchestra.run.smithi204.stdout:5753 read 0x5286c00 thru 0x528e8d5 (0x7cd6 bytes) 2024-09-12T16:17:54.975 INFO:teuthology.orchestra.run.smithi204.stdout:5754 punch from 0x3178c00 to 0x3186a00, (0xde00 bytes) 2024-09-12T16:17:55.005 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:55.005+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:55.008 INFO:teuthology.orchestra.run.smithi204.stdout:5756 write 0xc6b3c00 thru 0xc6c2cd5 (0xf0d6 bytes) 2024-09-12T16:17:55.017 INFO:teuthology.orchestra.run.smithi204.stdout:5757 read 0x2256000 thru 0x2262905 (0xc906 bytes) 2024-09-12T16:17:55.017 INFO:teuthology.orchestra.run.smithi204.stdout:5759 read 0x8cfd600 thru 0x8d070ec (0x9aed bytes) 2024-09-12T16:17:55.017 INFO:teuthology.orchestra.run.smithi204.stdout:5760 read 0x1aa1200 thru 0x1aa80bc (0x6ebd bytes) 2024-09-12T16:17:55.017 INFO:teuthology.orchestra.run.smithi204.stdout:5762 write 0x12f1000 thru 0x12fc7ad (0xb7ae bytes) 2024-09-12T16:17:55.018 INFO:teuthology.orchestra.run.smithi204.stdout:5763 read 0xa33bc00 thru 0xa34708a (0xb48b bytes) 2024-09-12T16:17:55.031 INFO:teuthology.orchestra.run.smithi204.stdout:5764 trunc from 0xc6c2e00 to 0x3b6800 2024-09-12T16:17:55.040 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T16:17:55.089 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:55.089 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:55.099 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:17:55.112 INFO:teuthology.orchestra.run.smithi204.stdout:5765 write 0x939ee00 thru 0x93a0f10 (0x2111 bytes) 2024-09-12T16:17:55.113 INFO:teuthology.orchestra.run.smithi204.stdout:5766 write 0x2883200 thru 0x288471e (0x151f bytes) 2024-09-12T16:17:55.113 INFO:teuthology.orchestra.run.smithi204.stdout:5768 read 0x339c800 thru 0x33a7b5d (0xb35e bytes) 2024-09-12T16:17:55.131 INFO:teuthology.orchestra.run.smithi204.stdout:5769 write 0xab00600 thru 0xab05e1f (0x5820 bytes) 2024-09-12T16:17:55.132 INFO:teuthology.orchestra.run.smithi204.stdout:5770 read 0xd27200 thru 0xd30983 (0x9784 bytes) 2024-09-12T16:17:55.132 INFO:teuthology.orchestra.run.smithi204.stdout:5772 write 0x797de00 thru 0x7988a36 (0xac37 bytes) 2024-09-12T16:17:55.133 INFO:teuthology.orchestra.run.smithi204.stdout:5776 punch from 0x7e25000 to 0x7e2b800, (0x6800 bytes) 2024-09-12T16:17:55.142 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:55.142+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:55.167 INFO:teuthology.orchestra.run.smithi204.stdout:5777 write 0xe0c6a00 thru 0xe0d0349 (0x994a bytes) 2024-09-12T16:17:55.168 INFO:teuthology.orchestra.run.smithi204.stdout:5778 read 0xba25800 thru 0xba33c79 (0xe47a bytes) 2024-09-12T16:17:55.168 INFO:teuthology.orchestra.run.smithi204.stdout:5784 punch from 0x6854200 to 0x6858200, (0x4000 bytes) 2024-09-12T16:17:55.184 INFO:teuthology.orchestra.run.smithi204.stdout:5785 trunc from 0xe0d0400 to 0x24e1c00 2024-09-12T16:17:55.208 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:55.208+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:55.221 INFO:teuthology.orchestra.run.smithi204.stdout:5786 trunc from 0x24e1c00 to 0x24f1c00 2024-09-12T16:17:55.229 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:55.229 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:55.235 INFO:teuthology.orchestra.run.smithi204.stdout:5788 trunc from 0x24f1c00 to 0x627b600 2024-09-12T16:17:55.238 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:17:55.251 INFO:teuthology.orchestra.run.smithi204.stdout:5789 read 0xf97c00 thru 0xfa3d5d (0xc15e bytes) 2024-09-12T16:17:55.262 INFO:teuthology.orchestra.run.smithi204.stdout:5790 write 0x814e800 thru 0x8157b00 (0x9301 bytes) 2024-09-12T16:17:55.267 INFO:teuthology.orchestra.run.smithi204.stdout:5791 write 0x65ef000 thru 0x65f7943 (0x8944 bytes) 2024-09-12T16:17:55.304 INFO:teuthology.orchestra.run.smithi204.stdout:5793 write 0xe087400 thru 0xe088bec (0x17ed bytes) 2024-09-12T16:17:55.306 INFO:teuthology.orchestra.run.smithi204.stdout:5795 write 0xb875400 thru 0xb882aac (0xd6ad bytes) 2024-09-12T16:17:55.306 INFO:teuthology.orchestra.run.smithi204.stdout:5796 read 0x3da1c00 thru 0x3da3ab2 (0x1eb3 bytes) 2024-09-12T16:17:55.309 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:55.308+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:55.310 INFO:teuthology.orchestra.run.smithi204.stdout:5799 read 0x9c59e00 thru 0x9c610ee (0x72ef bytes) 2024-09-12T16:17:55.310 INFO:teuthology.orchestra.run.smithi204.stdout:5800 write 0xbc63800 thru 0xbc6389d (0x9e bytes) 2024-09-12T16:17:55.332 INFO:teuthology.orchestra.run.smithi204.stdout:5801 write 0xe789c00 thru 0xe792be2 (0x8fe3 bytes) 2024-09-12T16:17:55.333 INFO:teuthology.orchestra.run.smithi204.stdout:5804 write 0x115e200 thru 0x1160b08 (0x2909 bytes) 2024-09-12T16:17:55.333 INFO:teuthology.orchestra.run.smithi204.stdout:5805 punch from 0xa26b400 to 0xa275600, (0xa200 bytes) 2024-09-12T16:17:55.337 INFO:teuthology.orchestra.run.smithi204.stdout:5808 clone 39 order 24 su 131072 sc 13 2024-09-12T16:17:55.398 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:55.398 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:55.406 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:17:55.410 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:55.409+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:55.510 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:55.510+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:55.513 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:55.513 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:55.522 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:17:55.611 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:55.611+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:55.628 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:55.629 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:55.637 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:17:55.721 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:55.720+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:55.785 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:55.785 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:55.793 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:17:55.813 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:55.813+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:55.914 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:55.914+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:55.941 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:55.941 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:55.950 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:17:56.015 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:56.014+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:56.031 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2024-09-12T16:17:56.061 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:56.061 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:56.070 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:17:56.116 INFO:teuthology.orchestra.run.smithi204.stdout:flattening image image_client.0-clone38 2024-09-12T16:17:56.154 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:56.153+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:56.216 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:56.216+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:56.217 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:56.217 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:56.226 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:17:56.310 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T16:17:56.317 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:56.317+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:56.375 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:56.375 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:56.384 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:17:56.418 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:56.418+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:56.438 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:17:56.438 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:17:56.456 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:17:56.457 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:17:56.474 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:17:56.474 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:17:56.492 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:17:56.492 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:17:56.497 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:56.497 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:56.497 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:17:56.498 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:17:56.498 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:56.507 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:17:56.512 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:17:56.512 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:17:56.518 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:56.518+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:56.527 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #37, image image_client.0-clone37 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent38 2024-09-12T16:17:56.530 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:17:56.530 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:17:56.620 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:56.619+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:56.623 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:56.623 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:17:56.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:17:56.623 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:17:56.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.623 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2213 3.18 3:1944e921:::rbd_data.1155ccb1894c.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:56.623 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:17:56.623 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 59.245936567999998, 2024-09-12T16:17:56.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.055657836000000002, 2024-09-12T16:17:56.623 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:56.623 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:56.623 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:56.623 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:56.624 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:17:56.624 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:17:56.624 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2213 2024-09-12T16:17:56.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.624 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:56.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:56.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:17:56.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:56.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:17:56.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:56.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375351+0000", 2024-09-12T16:17:56.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.556e-06 2024-09-12T16:17:56.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:56.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.399989+0000", 2024-09-12T16:17:56.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024637949999999999 2024-09-12T16:17:56.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:56.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400038+0000", 2024-09-12T16:17:56.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9187999999999997e-05 2024-09-12T16:17:56.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:56.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400056+0000", 2024-09-12T16:17:56.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8451e-05 2024-09-12T16:17:56.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:56.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400151+0000", 2024-09-12T16:17:56.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5026999999999997e-05 2024-09-12T16:17:56.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:56.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400345+0000", 2024-09-12T16:17:56.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019352900000000001 2024-09-12T16:17:56.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 1", 2024-09-12T16:17:56.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.401319+0000", 2024-09-12T16:17:56.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00097419399999999995 2024-09-12T16:17:56.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:17:56.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.429350+0000", 2024-09-12T16:17:56.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028030607999999999 2024-09-12T16:17:56.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:56.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.430907+0000", 2024-09-12T16:17:56.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001557466 2024-09-12T16:17:56.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:17:56.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.430966+0000", 2024-09-12T16:17:56.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9437e-05 2024-09-12T16:17:56.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:56.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.431007+0000", 2024-09-12T16:17:56.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0429999999999997e-05 2024-09-12T16:17:56.631 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.631 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:56.631 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.631 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6725 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2392064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:56.631 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.557452+0000", 2024-09-12T16:17:56.631 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.063833901999999, 2024-09-12T16:17:56.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045294112999999997, 2024-09-12T16:17:56.631 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:56.632 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:56.632 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:56.632 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:56.632 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:56.632 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:56.632 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6725 2024-09-12T16:17:56.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.632 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:56.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:56.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557452+0000", 2024-09-12T16:17:56.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:56.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557452+0000", 2024-09-12T16:17:56.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:56.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557693+0000", 2024-09-12T16:17:56.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024098699999999999 2024-09-12T16:17:56.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:56.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557697+0000", 2024-09-12T16:17:56.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8489999999999999e-06 2024-09-12T16:17:56.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:56.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557707+0000", 2024-09-12T16:17:56.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0356999999999999e-05 2024-09-12T16:17:56.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:56.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557714+0000", 2024-09-12T16:17:56.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0219999999999999e-06 2024-09-12T16:17:56.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:56.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.602612+0000", 2024-09-12T16:17:56.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044897907000000001 2024-09-12T16:17:56.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:56.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.602683+0000", 2024-09-12T16:17:56.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1171e-05 2024-09-12T16:17:56.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:56.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.602746+0000", 2024-09-12T16:17:56.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2819999999999998e-05 2024-09-12T16:17:56.636 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.636 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:56.636 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.636 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6727 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2422784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:56.636 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.557749+0000", 2024-09-12T16:17:56.636 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.063536302999999, 2024-09-12T16:17:56.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045329659000000001, 2024-09-12T16:17:56.637 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:56.637 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:56.637 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:56.637 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:56.637 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:56.637 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:56.637 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6727 2024-09-12T16:17:56.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.637 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:56.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:56.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557749+0000", 2024-09-12T16:17:56.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:56.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557749+0000", 2024-09-12T16:17:56.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:56.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557750+0000", 2024-09-12T16:17:56.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6600000000000002e-07 2024-09-12T16:17:56.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:56.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557752+0000", 2024-09-12T16:17:56.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.278e-06 2024-09-12T16:17:56.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:56.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557759+0000", 2024-09-12T16:17:56.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7329999999999997e-06 2024-09-12T16:17:56.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:56.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557764+0000", 2024-09-12T16:17:56.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0390000000000004e-06 2024-09-12T16:17:56.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:56.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.602943+0000", 2024-09-12T16:17:56.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045179035999999999 2024-09-12T16:17:56.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:56.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603016+0000", 2024-09-12T16:17:56.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2999999999999999e-05 2024-09-12T16:17:56.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:56.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603079+0000", 2024-09-12T16:17:56.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3107000000000004e-05 2024-09-12T16:17:56.641 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.641 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:56.641 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.641 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6728 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2439168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:56.641 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.557771+0000", 2024-09-12T16:17:56.641 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.063514427000001, 2024-09-12T16:17:56.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045474239, 2024-09-12T16:17:56.641 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:56.641 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:56.641 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:56.641 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:56.642 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:56.642 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:56.642 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6728 2024-09-12T16:17:56.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.642 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:56.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:56.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557771+0000", 2024-09-12T16:17:56.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:56.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557771+0000", 2024-09-12T16:17:56.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:56.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557772+0000", 2024-09-12T16:17:56.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5400000000000002e-07 2024-09-12T16:17:56.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:56.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557774+0000", 2024-09-12T16:17:56.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.165e-06 2024-09-12T16:17:56.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:56.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557782+0000", 2024-09-12T16:17:56.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3289999999999994e-06 2024-09-12T16:17:56.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:56.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557787+0000", 2024-09-12T16:17:56.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1909999999999999e-06 2024-09-12T16:17:56.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:56.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603110+0000", 2024-09-12T16:17:56.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045322710000000002 2024-09-12T16:17:56.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:56.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603182+0000", 2024-09-12T16:17:56.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1755999999999995e-05 2024-09-12T16:17:56.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:56.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603245+0000", 2024-09-12T16:17:56.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3633999999999994e-05 2024-09-12T16:17:56.646 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.646 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:56.646 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.646 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6729 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2454528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:56.646 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.557794+0000", 2024-09-12T16:17:56.646 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.063491646000003, 2024-09-12T16:17:56.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045614517, 2024-09-12T16:17:56.646 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:56.646 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:56.647 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:56.647 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:56.647 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:56.647 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:56.647 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6729 2024-09-12T16:17:56.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.648 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:56.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:56.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557794+0000", 2024-09-12T16:17:56.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:56.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557794+0000", 2024-09-12T16:17:56.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:56.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557879+0000", 2024-09-12T16:17:56.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5130000000000007e-05 2024-09-12T16:17:56.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:56.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557884+0000", 2024-09-12T16:17:56.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2390000000000002e-06 2024-09-12T16:17:56.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:56.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557894+0000", 2024-09-12T16:17:56.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4800000000000007e-06 2024-09-12T16:17:56.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:56.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557900+0000", 2024-09-12T16:17:56.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5610000000000004e-06 2024-09-12T16:17:56.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:56.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603273+0000", 2024-09-12T16:17:56.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045372799999999998 2024-09-12T16:17:56.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:56.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603345+0000", 2024-09-12T16:17:56.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1562000000000004e-05 2024-09-12T16:17:56.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:56.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603408+0000", 2024-09-12T16:17:56.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3744999999999994e-05 2024-09-12T16:17:56.652 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.652 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:56.652 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.652 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6730 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2469888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:56.652 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.557911+0000", 2024-09-12T16:17:56.652 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.063374248999999, 2024-09-12T16:17:56.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045661090000000001, 2024-09-12T16:17:56.652 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:56.652 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:56.653 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:56.653 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:56.653 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:56.653 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:56.653 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6730 2024-09-12T16:17:56.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.653 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:56.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:56.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557911+0000", 2024-09-12T16:17:56.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:56.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557911+0000", 2024-09-12T16:17:56.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:56.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557912+0000", 2024-09-12T16:17:56.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8299999999999997e-07 2024-09-12T16:17:56.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:56.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557914+0000", 2024-09-12T16:17:56.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.531e-06 2024-09-12T16:17:56.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:56.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557927+0000", 2024-09-12T16:17:56.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2685e-05 2024-09-12T16:17:56.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:56.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557932+0000", 2024-09-12T16:17:56.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3020000000000002e-06 2024-09-12T16:17:56.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:56.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603436+0000", 2024-09-12T16:17:56.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045503210000000002 2024-09-12T16:17:56.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:56.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603508+0000", 2024-09-12T16:17:56.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2792000000000004e-05 2024-09-12T16:17:56.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:56.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603572+0000", 2024-09-12T16:17:56.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4086999999999998e-05 2024-09-12T16:17:56.656 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.656 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:56.656 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.657 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6731 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2485248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:56.657 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.557942+0000", 2024-09-12T16:17:56.657 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.063344049000001, 2024-09-12T16:17:56.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045794662, 2024-09-12T16:17:56.657 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:56.657 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:56.657 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:56.657 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:56.657 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:56.657 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:56.657 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6731 2024-09-12T16:17:56.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.657 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:56.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:56.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557942+0000", 2024-09-12T16:17:56.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:56.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.557942+0000", 2024-09-12T16:17:56.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:56.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559076+0000", 2024-09-12T16:17:56.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011348280000000001 2024-09-12T16:17:56.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:56.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559081+0000", 2024-09-12T16:17:56.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6820000000000002e-06 2024-09-12T16:17:56.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:56.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559089+0000", 2024-09-12T16:17:56.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0469999999999994e-06 2024-09-12T16:17:56.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:56.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559095+0000", 2024-09-12T16:17:56.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.212e-06 2024-09-12T16:17:56.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:56.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603601+0000", 2024-09-12T16:17:56.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044505321 2024-09-12T16:17:56.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:56.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603675+0000", 2024-09-12T16:17:56.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4455000000000005e-05 2024-09-12T16:17:56.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:56.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.603736+0000", 2024-09-12T16:17:56.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1117000000000005e-05 2024-09-12T16:17:56.661 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.661 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:56.661 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.661 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6735 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2547712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:56.661 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.559184+0000", 2024-09-12T16:17:56.661 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.062101202000001, 2024-09-12T16:17:56.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045228008, 2024-09-12T16:17:56.661 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:56.661 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:56.662 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:56.662 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:56.662 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:56.662 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:56.662 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6735 2024-09-12T16:17:56.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.662 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:56.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:56.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559184+0000", 2024-09-12T16:17:56.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:56.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559184+0000", 2024-09-12T16:17:56.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:56.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559185+0000", 2024-09-12T16:17:56.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8100000000000003e-07 2024-09-12T16:17:56.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:56.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559187+0000", 2024-09-12T16:17:56.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9309999999999998e-06 2024-09-12T16:17:56.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:56.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559193+0000", 2024-09-12T16:17:56.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3629999999999999e-06 2024-09-12T16:17:56.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:56.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559200+0000", 2024-09-12T16:17:56.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6950000000000003e-06 2024-09-12T16:17:56.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:56.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604265+0000", 2024-09-12T16:17:56.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045064924999999999 2024-09-12T16:17:56.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:56.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604344+0000", 2024-09-12T16:17:56.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8830000000000002e-05 2024-09-12T16:17:56.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:56.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604412+0000", 2024-09-12T16:17:56.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8683000000000006e-05 2024-09-12T16:17:56.665 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.665 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:56.665 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.666 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6736 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2564096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:56.666 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.559207+0000", 2024-09-12T16:17:56.666 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.062078239000002, 2024-09-12T16:17:56.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045365924000000002, 2024-09-12T16:17:56.666 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:56.666 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:56.666 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:56.666 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:56.666 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:56.666 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:56.666 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6736 2024-09-12T16:17:56.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.667 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:56.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:56.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559207+0000", 2024-09-12T16:17:56.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:56.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559207+0000", 2024-09-12T16:17:56.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:56.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559208+0000", 2024-09-12T16:17:56.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6800000000000001e-07 2024-09-12T16:17:56.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:56.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559210+0000", 2024-09-12T16:17:56.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0490000000000002e-06 2024-09-12T16:17:56.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:56.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559218+0000", 2024-09-12T16:17:56.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7510000000000008e-06 2024-09-12T16:17:56.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:56.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559223+0000", 2024-09-12T16:17:56.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1229999999999999e-06 2024-09-12T16:17:56.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:56.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604440+0000", 2024-09-12T16:17:56.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045217599999999997 2024-09-12T16:17:56.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:56.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604512+0000", 2024-09-12T16:17:56.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1909000000000006e-05 2024-09-12T16:17:56.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:56.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604573+0000", 2024-09-12T16:17:56.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1023999999999997e-05 2024-09-12T16:17:56.670 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.670 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:56.670 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.670 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6737 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2579456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:56.670 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.559229+0000", 2024-09-12T16:17:56.670 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.062056112999997, 2024-09-12T16:17:56.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045505640999999999, 2024-09-12T16:17:56.671 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:56.671 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:56.671 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:56.671 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:56.671 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:56.671 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:56.671 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6737 2024-09-12T16:17:56.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.671 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:56.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:56.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559229+0000", 2024-09-12T16:17:56.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:56.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559229+0000", 2024-09-12T16:17:56.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:56.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559230+0000", 2024-09-12T16:17:56.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1399999999999997e-07 2024-09-12T16:17:56.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:56.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559232+0000", 2024-09-12T16:17:56.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8360000000000001e-06 2024-09-12T16:17:56.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:56.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559238+0000", 2024-09-12T16:17:56.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2360000000000001e-06 2024-09-12T16:17:56.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:56.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559242+0000", 2024-09-12T16:17:56.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4390000000000002e-06 2024-09-12T16:17:56.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:56.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604599+0000", 2024-09-12T16:17:56.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045356527000000001 2024-09-12T16:17:56.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:56.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604669+0000", 2024-09-12T16:17:56.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0442000000000001e-05 2024-09-12T16:17:56.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:56.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604735+0000", 2024-09-12T16:17:56.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5647000000000004e-05 2024-09-12T16:17:56.675 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.675 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:56.675 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.675 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6738 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2594816~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:56.675 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.559250+0000", 2024-09-12T16:17:56.675 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.062035250000001, 2024-09-12T16:17:56.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045646834999999997, 2024-09-12T16:17:56.675 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:56.675 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:56.675 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:56.675 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:56.676 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:56.676 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:56.676 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6738 2024-09-12T16:17:56.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.676 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:56.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:56.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559250+0000", 2024-09-12T16:17:56.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:56.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559250+0000", 2024-09-12T16:17:56.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:56.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559251+0000", 2024-09-12T16:17:56.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1699999999999999e-07 2024-09-12T16:17:56.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:56.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559253+0000", 2024-09-12T16:17:56.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2910000000000002e-06 2024-09-12T16:17:56.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:56.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559260+0000", 2024-09-12T16:17:56.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2200000000000003e-06 2024-09-12T16:17:56.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:56.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559265+0000", 2024-09-12T16:17:56.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2050000000000001e-06 2024-09-12T16:17:56.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:56.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604763+0000", 2024-09-12T16:17:56.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045497964000000002 2024-09-12T16:17:56.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:56.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604835+0000", 2024-09-12T16:17:56.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1705000000000005e-05 2024-09-12T16:17:56.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:56.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604897+0000", 2024-09-12T16:17:56.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2032999999999994e-05 2024-09-12T16:17:56.679 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.679 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:56.680 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.680 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6739 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2610176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:56.680 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.559273+0000", 2024-09-12T16:17:56.680 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.062012432000003, 2024-09-12T16:17:56.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.04579105, 2024-09-12T16:17:56.680 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:56.680 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:56.680 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:56.680 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:56.680 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:56.680 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:56.681 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6739 2024-09-12T16:17:56.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.681 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:56.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:56.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559273+0000", 2024-09-12T16:17:56.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:56.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559273+0000", 2024-09-12T16:17:56.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:56.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559273+0000", 2024-09-12T16:17:56.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3299999999999998e-07 2024-09-12T16:17:56.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:56.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559276+0000", 2024-09-12T16:17:56.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1490000000000001e-06 2024-09-12T16:17:56.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:56.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559282+0000", 2024-09-12T16:17:56.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3199999999999996e-06 2024-09-12T16:17:56.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:56.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.559288+0000", 2024-09-12T16:17:56.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.942e-06 2024-09-12T16:17:56.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:56.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.604929+0000", 2024-09-12T16:17:56.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045641317000000001 2024-09-12T16:17:56.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:56.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.605001+0000", 2024-09-12T16:17:56.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1581000000000005e-05 2024-09-12T16:17:56.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:56.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.605064+0000", 2024-09-12T16:17:56.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3408e-05 2024-09-12T16:17:56.684 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.684 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:56.684 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.684 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6977 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2377728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:56.684 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.566114+0000", 2024-09-12T16:17:56.685 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.055171323000003, 2024-09-12T16:17:56.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045737673999999999, 2024-09-12T16:17:56.685 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:56.685 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:56.685 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:56.685 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:56.685 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:56.685 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:56.685 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6977 2024-09-12T16:17:56.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.685 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:56.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:56.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566114+0000", 2024-09-12T16:17:56.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:56.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566114+0000", 2024-09-12T16:17:56.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:56.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566115+0000", 2024-09-12T16:17:56.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.71e-07 2024-09-12T16:17:56.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:56.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566119+0000", 2024-09-12T16:17:56.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2749999999999997e-06 2024-09-12T16:17:56.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:56.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566128+0000", 2024-09-12T16:17:56.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9490000000000002e-06 2024-09-12T16:17:56.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:56.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566135+0000", 2024-09-12T16:17:56.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3459999999999999e-06 2024-09-12T16:17:56.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:56.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.610416+0000", 2024-09-12T16:17:56.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044281686000000001 2024-09-12T16:17:56.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:56.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.610536+0000", 2024-09-12T16:17:56.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000119412 2024-09-12T16:17:56.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:56.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.611852+0000", 2024-09-12T16:17:56.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001316135 2024-09-12T16:17:56.688 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.689 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:56.689 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.689 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6986 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2518016~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:56.689 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.566890+0000", 2024-09-12T16:17:56.689 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.054395399999997, 2024-09-12T16:17:56.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045234719999999999, 2024-09-12T16:17:56.689 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:56.689 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:56.689 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:56.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:56.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:56.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:56.689 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6986 2024-09-12T16:17:56.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.690 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:56.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:56.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566890+0000", 2024-09-12T16:17:56.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:56.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566890+0000", 2024-09-12T16:17:56.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:56.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566891+0000", 2024-09-12T16:17:56.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2799999999999995e-07 2024-09-12T16:17:56.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:56.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566895+0000", 2024-09-12T16:17:56.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8179999999999997e-06 2024-09-12T16:17:56.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:56.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566904+0000", 2024-09-12T16:17:56.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5179999999999993e-06 2024-09-12T16:17:56.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:56.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566911+0000", 2024-09-12T16:17:56.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1640000000000004e-06 2024-09-12T16:17:56.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:56.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.611985+0000", 2024-09-12T16:17:56.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045073545999999999 2024-09-12T16:17:56.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:56.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612061+0000", 2024-09-12T16:17:56.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5617999999999993e-05 2024-09-12T16:17:56.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:56.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612125+0000", 2024-09-12T16:17:56.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4327999999999998e-05 2024-09-12T16:17:56.693 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.693 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:56.693 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.694 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6987 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2533376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:56.694 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.566982+0000", 2024-09-12T16:17:56.694 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.05430338, 2024-09-12T16:17:56.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045308858, 2024-09-12T16:17:56.694 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:56.694 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:56.694 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:56.694 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:56.694 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:56.694 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:56.694 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6987 2024-09-12T16:17:56.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.694 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:56.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:56.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566982+0000", 2024-09-12T16:17:56.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:56.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566982+0000", 2024-09-12T16:17:56.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:56.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566983+0000", 2024-09-12T16:17:56.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2500000000000005e-07 2024-09-12T16:17:56.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:56.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566986+0000", 2024-09-12T16:17:56.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3000000000000002e-06 2024-09-12T16:17:56.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:56.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.566995+0000", 2024-09-12T16:17:56.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8419999999999994e-06 2024-09-12T16:17:56.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:56.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567001+0000", 2024-09-12T16:17:56.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.161e-06 2024-09-12T16:17:56.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:56.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612154+0000", 2024-09-12T16:17:56.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045152858999999997 2024-09-12T16:17:56.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:56.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612229+0000", 2024-09-12T16:17:56.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4958999999999998e-05 2024-09-12T16:17:56.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:56.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612291+0000", 2024-09-12T16:17:56.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2012000000000002e-05 2024-09-12T16:17:56.698 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.698 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:56.698 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.698 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6988 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2548736~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:56.698 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.567055+0000", 2024-09-12T16:17:56.698 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.054230914000001, 2024-09-12T16:17:56.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045400078000000003, 2024-09-12T16:17:56.698 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:56.699 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:56.699 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:56.699 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:56.699 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:56.699 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:56.699 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6988 2024-09-12T16:17:56.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.699 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:56.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:56.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567055+0000", 2024-09-12T16:17:56.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:56.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567055+0000", 2024-09-12T16:17:56.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:56.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567055+0000", 2024-09-12T16:17:56.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3e-07 2024-09-12T16:17:56.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:56.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567059+0000", 2024-09-12T16:17:56.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4510000000000001e-06 2024-09-12T16:17:56.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:56.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567070+0000", 2024-09-12T16:17:56.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1477e-05 2024-09-12T16:17:56.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:56.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567077+0000", 2024-09-12T16:17:56.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7880000000000001e-06 2024-09-12T16:17:56.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:56.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612320+0000", 2024-09-12T16:17:56.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045242544000000003 2024-09-12T16:17:56.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:56.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612394+0000", 2024-09-12T16:17:56.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3854000000000001e-05 2024-09-12T16:17:56.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:56.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612455+0000", 2024-09-12T16:17:56.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1234000000000004e-05 2024-09-12T16:17:56.702 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.702 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:56.702 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.703 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6989 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2565120~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:56.703 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.567103+0000", 2024-09-12T16:17:56.703 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.054182107999999, 2024-09-12T16:17:56.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045514760000000001, 2024-09-12T16:17:56.703 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:56.703 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:56.703 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:56.703 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:56.703 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:56.703 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:56.703 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6989 2024-09-12T16:17:56.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.703 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:56.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:56.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567103+0000", 2024-09-12T16:17:56.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:56.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567103+0000", 2024-09-12T16:17:56.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:56.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567104+0000", 2024-09-12T16:17:56.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6400000000000002e-07 2024-09-12T16:17:56.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:56.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567107+0000", 2024-09-12T16:17:56.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.038e-06 2024-09-12T16:17:56.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:56.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567117+0000", 2024-09-12T16:17:56.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0244999999999999e-05 2024-09-12T16:17:56.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:56.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567124+0000", 2024-09-12T16:17:56.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1469999999999998e-06 2024-09-12T16:17:56.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:56.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612483+0000", 2024-09-12T16:17:56.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045359099999999999 2024-09-12T16:17:56.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:56.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612556+0000", 2024-09-12T16:17:56.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2948999999999996e-05 2024-09-12T16:17:56.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:56.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612618+0000", 2024-09-12T16:17:56.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2617e-05 2024-09-12T16:17:56.707 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.707 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:56.707 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.707 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6990 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2580480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:56.707 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.567155+0000", 2024-09-12T16:17:56.707 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.054130870999998, 2024-09-12T16:17:56.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045665681999999999, 2024-09-12T16:17:56.707 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:56.707 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:56.708 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:56.708 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:56.708 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:56.708 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:56.708 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6990 2024-09-12T16:17:56.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.708 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:56.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:56.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567155+0000", 2024-09-12T16:17:56.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:56.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567155+0000", 2024-09-12T16:17:56.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:56.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567155+0000", 2024-09-12T16:17:56.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5700000000000002e-07 2024-09-12T16:17:56.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:56.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567159+0000", 2024-09-12T16:17:56.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1729999999999999e-06 2024-09-12T16:17:56.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:56.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567167+0000", 2024-09-12T16:17:56.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3469999999999999e-06 2024-09-12T16:17:56.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:56.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567173+0000", 2024-09-12T16:17:56.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0719999999999996e-06 2024-09-12T16:17:56.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:56.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612651+0000", 2024-09-12T16:17:56.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045478078999999998 2024-09-12T16:17:56.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:56.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612741+0000", 2024-09-12T16:17:56.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0435999999999999e-05 2024-09-12T16:17:56.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:56.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612820+0000", 2024-09-12T16:17:56.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8918000000000006e-05 2024-09-12T16:17:56.711 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.711 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:56.711 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.712 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6991 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2595840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:56.712 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.567220+0000", 2024-09-12T16:17:56.712 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.054065862999998, 2024-09-12T16:17:56.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045811022999999999, 2024-09-12T16:17:56.712 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:56.712 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:56.712 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:56.712 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:56.712 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:56.712 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:56.712 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6991 2024-09-12T16:17:56.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.713 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:56.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:56.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567220+0000", 2024-09-12T16:17:56.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:56.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567220+0000", 2024-09-12T16:17:56.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:56.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567221+0000", 2024-09-12T16:17:56.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.16e-07 2024-09-12T16:17:56.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:56.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567225+0000", 2024-09-12T16:17:56.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3950000000000003e-06 2024-09-12T16:17:56.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:56.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567243+0000", 2024-09-12T16:17:56.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7734999999999999e-05 2024-09-12T16:17:56.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:56.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567253+0000", 2024-09-12T16:17:56.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7540000000000001e-06 2024-09-12T16:17:56.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:56.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612854+0000", 2024-09-12T16:17:56.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045601227000000001 2024-09-12T16:17:56.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:56.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.612950+0000", 2024-09-12T16:17:56.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6121999999999999e-05 2024-09-12T16:17:56.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:56.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.613031+0000", 2024-09-12T16:17:56.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0873999999999999e-05 2024-09-12T16:17:56.716 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.716 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:56.716 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.716 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5328.0:6992 3.5 3:a6af661a:::rbd_data.1155a3488f5d.0000000000000001:1a [read 2611200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:56.716 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:12.567349+0000", 2024-09-12T16:17:56.716 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.053936106999998, 2024-09-12T16:17:56.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045848710000000001, 2024-09-12T16:17:56.716 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:56.717 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:56.717 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:56.717 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:56.717 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5328", 2024-09-12T16:17:56.717 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:56.717 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6992 2024-09-12T16:17:56.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.717 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:56.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:56.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567349+0000", 2024-09-12T16:17:56.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:56.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567349+0000", 2024-09-12T16:17:56.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:56.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:56.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567350+0000", 2024-09-12T16:17:56.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8899999999999998e-07 2024-09-12T16:17:56.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:56.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567354+0000", 2024-09-12T16:17:56.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0130000000000004e-06 2024-09-12T16:17:56.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:56.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567364+0000", 2024-09-12T16:17:56.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0158e-05 2024-09-12T16:17:56.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:56.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.567369+0000", 2024-09-12T16:17:56.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4839999999999998e-06 2024-09-12T16:17:56.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:56.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.613072+0000", 2024-09-12T16:17:56.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045703195000000002 2024-09-12T16:17:56.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:56.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.613156+0000", 2024-09-12T16:17:56.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3591999999999995e-05 2024-09-12T16:17:56.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:56.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:56.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:56.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:12.613198+0000", 2024-09-12T16:17:56.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2478999999999998e-05 2024-09-12T16:17:56.720 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.720 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:56.720 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.720 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:56.720 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:56.720 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:56.723 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:17:56.723 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:56.721+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:56.724 INFO:teuthology.orchestra.run.smithi204.stdout:5809 write 0xd8edc00 thru 0xd8f39db (0x5ddc bytes) 2024-09-12T16:17:56.724 INFO:teuthology.orchestra.run.smithi204.stdout:5814 write 0x36a2c00 thru 0x36a594c (0x2d4d bytes) 2024-09-12T16:17:56.724 INFO:teuthology.orchestra.run.smithi204.stdout:5817 read 0x3e34a00 thru 0x3e43560 (0xeb61 bytes) 2024-09-12T16:17:56.724 INFO:teuthology.orchestra.run.smithi204.stdout:5818 read 0x7400600 thru 0x740749c (0x6e9d bytes) 2024-09-12T16:17:56.724 INFO:teuthology.orchestra.run.smithi204.stdout:5819 write 0x8fd3000 thru 0x8fdae6d (0x7e6e bytes) 2024-09-12T16:17:56.724 INFO:teuthology.orchestra.run.smithi204.stdout:5820 write 0xd509600 thru 0xd50cec0 (0x38c1 bytes) 2024-09-12T16:17:56.724 INFO:teuthology.orchestra.run.smithi204.stdout:5821 read 0x800ce00 thru 0x800edd7 (0x1fd8 bytes) 2024-09-12T16:17:56.724 INFO:teuthology.orchestra.run.smithi204.stdout:5823 read 0xcbcee00 thru 0xcbdd8fd (0xeafe bytes) 2024-09-12T16:17:56.724 INFO:teuthology.orchestra.run.smithi204.stdout:5824 write 0xe334000 thru 0xe3362d4 (0x22d5 bytes) 2024-09-12T16:17:56.724 INFO:teuthology.orchestra.run.smithi204.stdout:5826 read 0x5118600 thru 0x5120137 (0x7b38 bytes) 2024-09-12T16:17:56.724 INFO:teuthology.orchestra.run.smithi204.stdout:5828 punch from 0x68d9200 to 0x68e8e00, (0xfc00 bytes) 2024-09-12T16:17:56.778 INFO:teuthology.orchestra.run.smithi204.stdout:5830 punch from 0x51d7400 to 0x51dd000, (0x5c00 bytes) 2024-09-12T16:17:56.822 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:56.822+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:56.829 INFO:teuthology.orchestra.run.smithi204.stdout:5831 trunc from 0xe792c00 to 0x54a200 2024-09-12T16:17:56.848 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:56.849 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:17:56.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.849 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5567.0:2514 3.f 3.7739210f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e110)", 2024-09-12T16:17:56.849 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:56.846959+0000", 2024-09-12T16:17:56.849 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.00079014600000000003, 2024-09-12T16:17:56.849 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00080719899999999998, 2024-09-12T16:17:56.849 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:56.849 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:56.849 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:56.849 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:56.849 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5567", 2024-09-12T16:17:56.849 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/637621952", 2024-09-12T16:17:56.849 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2514 2024-09-12T16:17:56.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.850 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:56.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:56.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846959+0000", 2024-09-12T16:17:56.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:56.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:56.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846959+0000", 2024-09-12T16:17:56.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:56.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.851 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:56.851 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846960+0000", 2024-09-12T16:17:56.851 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1399999999999997e-07 2024-09-12T16:17:56.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.851 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.851 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:56.851 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846962+0000", 2024-09-12T16:17:56.851 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1239999999999999e-06 2024-09-12T16:17:56.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.851 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.851 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:56.851 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846968+0000", 2024-09-12T16:17:56.851 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.122e-06 2024-09-12T16:17:56.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.852 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.852 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:56.852 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846974+0000", 2024-09-12T16:17:56.852 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4740000000000002e-06 2024-09-12T16:17:56.852 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:56.852 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:56.852 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:56.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.852 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.852 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5567.0:2515 3.f 3.7739210f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e110)", 2024-09-12T16:17:56.852 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:56.846983+0000", 2024-09-12T16:17:56.852 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.00076649499999999996, 2024-09-12T16:17:56.852 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00082758400000000002, 2024-09-12T16:17:56.853 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:56.853 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:56.853 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:56.853 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:56.853 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5567", 2024-09-12T16:17:56.853 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/637621952", 2024-09-12T16:17:56.853 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2515 2024-09-12T16:17:56.853 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.853 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:56.853 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.853 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:56.853 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846983+0000", 2024-09-12T16:17:56.853 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:56.853 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.854 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.854 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:56.854 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846983+0000", 2024-09-12T16:17:56.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:56.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.854 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.854 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:56.854 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846983+0000", 2024-09-12T16:17:56.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9200000000000001e-07 2024-09-12T16:17:56.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.854 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.854 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:56.854 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846986+0000", 2024-09-12T16:17:56.855 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0370000000000001e-06 2024-09-12T16:17:56.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:56.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846992+0000", 2024-09-12T16:17:56.855 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1589999999999998e-06 2024-09-12T16:17:56.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:56.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846997+0000", 2024-09-12T16:17:56.855 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1930000000000001e-06 2024-09-12T16:17:56.855 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:56.855 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:56.856 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:56.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.856 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5567.0:2465 3.f 3:f517ce71:::rbd_data.11558ed5fb98.00000000000000b5:29 [read 602112~12288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e110)", 2024-09-12T16:17:56.856 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:56.846581+0000", 2024-09-12T16:17:56.856 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0011686260000000001, 2024-09-12T16:17:56.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0012768, 2024-09-12T16:17:56.856 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:56.856 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:56.856 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:56.856 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:56.856 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5567", 2024-09-12T16:17:56.856 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/637621952", 2024-09-12T16:17:56.857 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2465 2024-09-12T16:17:56.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.857 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:56.857 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.857 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:56.857 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846581+0000", 2024-09-12T16:17:56.857 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:56.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.857 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.857 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:56.857 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846581+0000", 2024-09-12T16:17:56.857 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:56.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.857 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.858 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:56.858 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846581+0000", 2024-09-12T16:17:56.858 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5899999999999996e-07 2024-09-12T16:17:56.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.858 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.858 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:56.858 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846583+0000", 2024-09-12T16:17:56.858 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.029e-06 2024-09-12T16:17:56.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.858 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.858 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:56.858 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846589+0000", 2024-09-12T16:17:56.858 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0639999999999999e-06 2024-09-12T16:17:56.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.858 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.859 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:56.859 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846594+0000", 2024-09-12T16:17:56.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9289999999999997e-06 2024-09-12T16:17:56.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.859 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:56.859 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.847777+0000", 2024-09-12T16:17:56.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011827770000000001 2024-09-12T16:17:56.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.859 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:56.859 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.847843+0000", 2024-09-12T16:17:56.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6013000000000006e-05 2024-09-12T16:17:56.860 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:56.860 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:56.860 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:56.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.860 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.860 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5567.0:2466 3.f 3.8e73e8af (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e110)", 2024-09-12T16:17:56.860 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:56.846601+0000", 2024-09-12T16:17:56.860 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0011486249999999999, 2024-09-12T16:17:56.860 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001302332, 2024-09-12T16:17:56.860 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:56.860 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:56.860 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:56.860 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:56.860 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5567", 2024-09-12T16:17:56.860 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/637621952", 2024-09-12T16:17:56.861 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2466 2024-09-12T16:17:56.861 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.861 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:56.861 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.861 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:56.861 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846601+0000", 2024-09-12T16:17:56.861 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:56.861 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.861 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.861 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:56.861 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846601+0000", 2024-09-12T16:17:56.861 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:56.861 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.862 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.862 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:56.862 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846601+0000", 2024-09-12T16:17:56.862 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.08e-07 2024-09-12T16:17:56.862 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.862 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.862 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:56.862 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846603+0000", 2024-09-12T16:17:56.862 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.973e-06 2024-09-12T16:17:56.862 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.862 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.862 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:56.862 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846610+0000", 2024-09-12T16:17:56.862 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3729999999999998e-06 2024-09-12T16:17:56.862 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.863 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.863 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:56.863 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846614+0000", 2024-09-12T16:17:56.863 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6809999999999997e-06 2024-09-12T16:17:56.863 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:56.863 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:56.863 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:56.863 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.863 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.863 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5567.0:2467 3.f 3.8e73e8af (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e110)", 2024-09-12T16:17:56.863 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:56.846621+0000", 2024-09-12T16:17:56.863 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0011285480000000001, 2024-09-12T16:17:56.863 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0013184869999999999, 2024-09-12T16:17:56.863 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:56.864 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:56.864 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:56.864 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:56.864 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5567", 2024-09-12T16:17:56.864 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/637621952", 2024-09-12T16:17:56.864 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2467 2024-09-12T16:17:56.864 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.864 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:56.864 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.864 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:56.864 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846621+0000", 2024-09-12T16:17:56.864 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:56.864 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.865 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.865 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:56.865 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846621+0000", 2024-09-12T16:17:56.865 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:56.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.865 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.865 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:56.865 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846621+0000", 2024-09-12T16:17:56.865 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1100000000000001e-07 2024-09-12T16:17:56.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.865 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.865 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:56.865 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846623+0000", 2024-09-12T16:17:56.865 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9309999999999998e-06 2024-09-12T16:17:56.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.866 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.866 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:56.866 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846629+0000", 2024-09-12T16:17:56.866 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0780000000000001e-06 2024-09-12T16:17:56.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.866 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.866 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:56.866 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846634+0000", 2024-09-12T16:17:56.866 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.797e-06 2024-09-12T16:17:56.866 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:56.866 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:56.866 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:56.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.867 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.867 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5567.0:2468 3.f 3.8e73e8af (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e110)", 2024-09-12T16:17:56.867 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:56.846640+0000", 2024-09-12T16:17:56.867 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.001109205, 2024-09-12T16:17:56.867 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0013338219999999999, 2024-09-12T16:17:56.867 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:56.867 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:56.867 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:56.867 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:56.867 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5567", 2024-09-12T16:17:56.867 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/637621952", 2024-09-12T16:17:56.867 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2468 2024-09-12T16:17:56.868 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.868 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:56.868 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.868 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:56.868 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846640+0000", 2024-09-12T16:17:56.868 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:56.868 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.868 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.868 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:56.868 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846640+0000", 2024-09-12T16:17:56.868 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:56.868 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.868 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.869 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:56.869 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846641+0000", 2024-09-12T16:17:56.869 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0999999999999999e-07 2024-09-12T16:17:56.869 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.869 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.869 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:56.869 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846643+0000", 2024-09-12T16:17:56.869 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9269999999999999e-06 2024-09-12T16:17:56.869 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.869 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.869 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:56.869 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846650+0000", 2024-09-12T16:17:56.869 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1899999999999998e-06 2024-09-12T16:17:56.869 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.870 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.870 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:56.870 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846655+0000", 2024-09-12T16:17:56.870 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.772e-06 2024-09-12T16:17:56.870 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:56.870 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:56.870 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:56.870 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.870 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.870 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5567.0:2509 3.f 3.7739210f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e110)", 2024-09-12T16:17:56.870 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:56.846854+0000", 2024-09-12T16:17:56.870 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.00089577600000000004, 2024-09-12T16:17:56.870 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001157901, 2024-09-12T16:17:56.871 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:56.871 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:56.871 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:56.871 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:56.871 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5567", 2024-09-12T16:17:56.871 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/637621952", 2024-09-12T16:17:56.871 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2509 2024-09-12T16:17:56.871 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.871 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:56.871 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.871 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:56.871 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846854+0000", 2024-09-12T16:17:56.871 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:56.871 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.872 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.872 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:56.872 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846854+0000", 2024-09-12T16:17:56.872 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:56.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.872 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.872 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:56.872 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846854+0000", 2024-09-12T16:17:56.872 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3000000000000001e-07 2024-09-12T16:17:56.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.872 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.872 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:56.872 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846856+0000", 2024-09-12T16:17:56.872 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8220000000000001e-06 2024-09-12T16:17:56.873 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.873 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.873 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:56.873 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846863+0000", 2024-09-12T16:17:56.873 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2350000000000002e-06 2024-09-12T16:17:56.873 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.873 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.873 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:56.873 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846868+0000", 2024-09-12T16:17:56.873 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.169e-06 2024-09-12T16:17:56.873 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:56.873 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:56.873 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:56.873 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.874 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.874 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5567.0:2510 3.f 3.7739210f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e110)", 2024-09-12T16:17:56.874 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:56.846875+0000", 2024-09-12T16:17:56.874 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.00087427200000000005, 2024-09-12T16:17:56.874 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011721380000000001, 2024-09-12T16:17:56.874 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:56.874 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:56.874 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:56.874 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:56.874 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5567", 2024-09-12T16:17:56.874 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/637621952", 2024-09-12T16:17:56.874 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2510 2024-09-12T16:17:56.874 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.874 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:56.875 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.875 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:56.875 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846875+0000", 2024-09-12T16:17:56.875 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:56.875 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.875 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.875 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:56.875 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846875+0000", 2024-09-12T16:17:56.875 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:56.875 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.875 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.875 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:56.875 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846876+0000", 2024-09-12T16:17:56.875 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0699999999999998e-07 2024-09-12T16:17:56.876 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.876 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.876 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:56.876 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846878+0000", 2024-09-12T16:17:56.876 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0600000000000002e-06 2024-09-12T16:17:56.876 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.876 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.876 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:56.876 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846883+0000", 2024-09-12T16:17:56.876 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9209999999999997e-06 2024-09-12T16:17:56.876 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.876 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.876 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:56.876 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846890+0000", 2024-09-12T16:17:56.877 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4230000000000002e-06 2024-09-12T16:17:56.877 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:56.877 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:56.877 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:56.877 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.877 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.877 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5567.0:2511 3.f 3.7739210f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e110)", 2024-09-12T16:17:56.877 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:56.846897+0000", 2024-09-12T16:17:56.877 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.00085263600000000004, 2024-09-12T16:17:56.877 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011862070000000001, 2024-09-12T16:17:56.877 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:56.877 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:56.877 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:56.877 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:56.878 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5567", 2024-09-12T16:17:56.878 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/637621952", 2024-09-12T16:17:56.878 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2511 2024-09-12T16:17:56.878 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.878 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:56.878 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.878 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:56.878 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846897+0000", 2024-09-12T16:17:56.878 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:56.878 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.878 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.878 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:56.878 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846897+0000", 2024-09-12T16:17:56.879 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:56.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.879 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.879 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:56.879 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846897+0000", 2024-09-12T16:17:56.879 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6400000000000002e-07 2024-09-12T16:17:56.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.879 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.879 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:56.879 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846900+0000", 2024-09-12T16:17:56.879 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.418e-06 2024-09-12T16:17:56.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.879 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.880 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:56.880 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846907+0000", 2024-09-12T16:17:56.880 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0790000000000003e-06 2024-09-12T16:17:56.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.880 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.880 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:56.880 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846912+0000", 2024-09-12T16:17:56.880 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.293e-06 2024-09-12T16:17:56.880 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:56.880 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:56.880 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:56.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.881 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.881 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5567.0:2512 3.f 3.7739210f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e110)", 2024-09-12T16:17:56.881 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:56.846919+0000", 2024-09-12T16:17:56.881 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.00083030099999999998, 2024-09-12T16:17:56.881 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001200043, 2024-09-12T16:17:56.881 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:56.881 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:56.881 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:56.881 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:56.881 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5567", 2024-09-12T16:17:56.881 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/637621952", 2024-09-12T16:17:56.881 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2512 2024-09-12T16:17:56.881 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.882 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:56.882 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.882 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:56.882 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846919+0000", 2024-09-12T16:17:56.882 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:56.882 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.882 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.882 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:56.882 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846919+0000", 2024-09-12T16:17:56.882 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:56.882 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.882 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.882 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:56.883 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846920+0000", 2024-09-12T16:17:56.883 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4799999999999998e-07 2024-09-12T16:17:56.883 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.883 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.883 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:56.883 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846922+0000", 2024-09-12T16:17:56.883 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0260000000000002e-06 2024-09-12T16:17:56.883 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.883 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.883 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:56.883 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846928+0000", 2024-09-12T16:17:56.883 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.494e-06 2024-09-12T16:17:56.883 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.883 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.884 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:56.884 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846933+0000", 2024-09-12T16:17:56.884 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7659999999999998e-06 2024-09-12T16:17:56.884 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:56.884 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:56.884 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:56.884 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.884 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.884 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5567.0:2513 3.f 3.7739210f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e110)", 2024-09-12T16:17:56.884 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:56.846939+0000", 2024-09-12T16:17:56.884 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.00080989699999999996, 2024-09-12T16:17:56.884 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0012137199999999999, 2024-09-12T16:17:56.884 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:56.885 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:56.885 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T16:17:56.885 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:56.885 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5567", 2024-09-12T16:17:56.885 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/637621952", 2024-09-12T16:17:56.885 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2513 2024-09-12T16:17:56.885 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.885 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:56.885 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.885 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:56.885 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846939+0000", 2024-09-12T16:17:56.885 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:56.885 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.885 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.886 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:56.886 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846939+0000", 2024-09-12T16:17:56.886 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:56.886 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.886 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.886 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:56.886 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846940+0000", 2024-09-12T16:17:56.886 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.34e-07 2024-09-12T16:17:56.886 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.886 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.886 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:56.886 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846942+0000", 2024-09-12T16:17:56.886 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0509999999999999e-06 2024-09-12T16:17:56.887 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.887 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.887 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:56.887 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846948+0000", 2024-09-12T16:17:56.887 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8989999999999998e-06 2024-09-12T16:17:56.887 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:56.887 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:56.887 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:56.887 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:56.846953+0000", 2024-09-12T16:17:56.887 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.028e-06 2024-09-12T16:17:56.887 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:56.887 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:56.887 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:56.887 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:56.888 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-12T16:17:56.888 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 11 2024-09-12T16:17:56.888 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:56.889 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:17:56.930 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:56.930+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:57.024 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:57.023+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:57.034 INFO:teuthology.orchestra.run.smithi204.stdout:5832 trunc from 0x54a200 to 0xd91a200 2024-09-12T16:17:57.042 INFO:teuthology.orchestra.run.smithi204.stdout:5833 read 0xd319a00 thru 0xd325def (0xc3f0 bytes) 2024-09-12T16:17:57.043 INFO:teuthology.orchestra.run.smithi204.stdout:5835 write 0x2e12e00 thru 0x2e1803c (0x523d bytes) 2024-09-12T16:17:57.044 INFO:teuthology.orchestra.run.smithi204.stdout:5836 read 0xc9ab800 thru 0xc9b3df5 (0x85f6 bytes) 2024-09-12T16:17:57.044 INFO:teuthology.orchestra.run.smithi204.stdout:5837 read 0x6b17c00 thru 0x6b1d1ee (0x55ef bytes) 2024-09-12T16:17:57.045 INFO:teuthology.orchestra.run.smithi204.stdout:5838 write 0x52f1a00 thru 0x52f8584 (0x6b85 bytes) 2024-09-12T16:17:57.045 INFO:teuthology.orchestra.run.smithi204.stdout:5841 clone 40 order 21 su 262144 sc 3 2024-09-12T16:17:57.054 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:57.054 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:57.054 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:17:57.054 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:17:57.054 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:57.063 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:17:57.125 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:57.124+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:57.172 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:57.172 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:17:57.172 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:17:57.172 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:17:57.172 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.172 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:17:57.172 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:17:57.172 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 135.4061116, 2024-09-12T16:17:57.173 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55645454900000002, 2024-09-12T16:17:57.173 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.173 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.173 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:57.173 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.173 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:17:57.173 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:17:57.173 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1 2024-09-12T16:17:57.173 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.173 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.173 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.173 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.173 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:17:57.174 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.174 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.174 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.174 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.174 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:17:57.174 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.174 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.174 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.174 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.174 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764440+0000", 2024-09-12T16:17:57.174 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6249999999999999e-06 2024-09-12T16:17:57.174 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.174 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.174 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.175 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764447+0000", 2024-09-12T16:17:57.175 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4939999999999997e-06 2024-09-12T16:17:57.175 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.175 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.175 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.175 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764459+0000", 2024-09-12T16:17:57.175 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1517e-05 2024-09-12T16:17:57.175 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.175 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.175 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.175 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764468+0000", 2024-09-12T16:17:57.175 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7690000000000002e-06 2024-09-12T16:17:57.175 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.175 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.176 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.176 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764539+0000", 2024-09-12T16:17:57.176 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1103e-05 2024-09-12T16:17:57.176 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.176 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.176 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:17:57.176 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764551+0000", 2024-09-12T16:17:57.176 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2687999999999999e-05 2024-09-12T16:17:57.176 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.176 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.176 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.176 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319497+0000", 2024-09-12T16:17:57.176 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55494560500000001 2024-09-12T16:17:57.176 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.176 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.177 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.177 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319688+0000", 2024-09-12T16:17:57.177 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019105599999999999 2024-09-12T16:17:57.177 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.177 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.177 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:17:57.177 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319842+0000", 2024-09-12T16:17:57.177 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015377699999999999 2024-09-12T16:17:57.177 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.177 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.177 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:17:57.177 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320473+0000", 2024-09-12T16:17:57.177 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00063117100000000003 2024-09-12T16:17:57.178 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.178 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.178 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:57.178 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320825+0000", 2024-09-12T16:17:57.178 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00035202500000000001 2024-09-12T16:17:57.178 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.178 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.178 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:57.178 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320867+0000", 2024-09-12T16:17:57.178 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2005000000000002e-05 2024-09-12T16:17:57.178 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.178 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.178 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.179 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320893+0000", 2024-09-12T16:17:57.179 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5714000000000001e-05 2024-09-12T16:17:57.179 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.179 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.179 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.179 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.179 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.179 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14034 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5035008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:57.179 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:17:57.179 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 97.649053366999993, 2024-09-12T16:17:57.179 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053404082999999998, 2024-09-12T16:17:57.179 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.179 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.180 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:57.180 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.180 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:57.180 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:57.180 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14034 2024-09-12T16:17:57.180 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.180 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.180 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.180 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.180 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:17:57.180 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.180 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.180 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.180 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.181 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:17:57.181 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.181 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.181 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.181 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.181 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521740+0000", 2024-09-12T16:17:57.181 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000243976 2024-09-12T16:17:57.181 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.181 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.181 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.181 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521745+0000", 2024-09-12T16:17:57.181 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1280000000000001e-06 2024-09-12T16:17:57.181 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.181 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.182 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.182 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521757+0000", 2024-09-12T16:17:57.182 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2751e-05 2024-09-12T16:17:57.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.182 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.182 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.182 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521771+0000", 2024-09-12T16:17:57.182 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3328e-05 2024-09-12T16:17:57.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.182 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.182 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.182 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574710+0000", 2024-09-12T16:17:57.182 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052939358999999998 2024-09-12T16:17:57.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.183 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.183 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.183 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574799+0000", 2024-09-12T16:17:57.183 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8893000000000004e-05 2024-09-12T16:17:57.183 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.183 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.183 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.183 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574901+0000", 2024-09-12T16:17:57.183 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101648 2024-09-12T16:17:57.183 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.183 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.183 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.183 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.184 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.184 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14036 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5043200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:57.184 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:17:57.184 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 97.648594173000006, 2024-09-12T16:17:57.184 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053426247000000003, 2024-09-12T16:17:57.184 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.184 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.184 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:57.184 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.184 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:57.184 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:57.184 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14036 2024-09-12T16:17:57.184 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.185 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.185 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.185 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.185 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:17:57.185 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.185 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.185 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.185 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.185 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:17:57.185 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.185 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.185 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.185 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.186 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522208+0000", 2024-09-12T16:17:57.186 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025195300000000002 2024-09-12T16:17:57.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.186 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.186 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.186 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522211+0000", 2024-09-12T16:17:57.186 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2160000000000002e-06 2024-09-12T16:17:57.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.186 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.186 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.186 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522223+0000", 2024-09-12T16:17:57.186 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2044e-05 2024-09-12T16:17:57.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.186 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.187 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.187 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522229+0000", 2024-09-12T16:17:57.187 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8850000000000004e-06 2024-09-12T16:17:57.187 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.187 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.187 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.187 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575192+0000", 2024-09-12T16:17:57.187 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052963573 2024-09-12T16:17:57.187 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.187 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.187 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.187 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575282+0000", 2024-09-12T16:17:57.187 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9666000000000005e-05 2024-09-12T16:17:57.187 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.188 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.188 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.188 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575382+0000", 2024-09-12T16:17:57.188 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9909999999999997e-05 2024-09-12T16:17:57.188 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.188 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.188 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.188 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.188 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.188 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14039 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5055488~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:57.188 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:17:57.188 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 97.647914388999993, 2024-09-12T16:17:57.188 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053466207000000002, 2024-09-12T16:17:57.189 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.189 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.189 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:57.189 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.189 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:57.189 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:57.189 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14039 2024-09-12T16:17:57.189 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.189 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.189 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.189 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.189 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:17:57.189 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.189 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.190 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.190 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.190 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:17:57.190 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.190 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.190 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.190 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522899+0000", 2024-09-12T16:17:57.190 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026318199999999999 2024-09-12T16:17:57.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.190 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.190 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.190 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522903+0000", 2024-09-12T16:17:57.191 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.929e-06 2024-09-12T16:17:57.191 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.191 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.191 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.191 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522913+0000", 2024-09-12T16:17:57.191 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0162e-05 2024-09-12T16:17:57.191 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.191 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.191 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.191 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522921+0000", 2024-09-12T16:17:57.191 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.14e-06 2024-09-12T16:17:57.191 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.191 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.192 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.192 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575922+0000", 2024-09-12T16:17:57.192 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053000712999999998 2024-09-12T16:17:57.192 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.192 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.192 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.192 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576006+0000", 2024-09-12T16:17:57.192 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4161999999999998e-05 2024-09-12T16:17:57.192 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.192 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.192 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.192 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576102+0000", 2024-09-12T16:17:57.193 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5919000000000001e-05 2024-09-12T16:17:57.193 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.193 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.193 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.193 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.193 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14040 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5059584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:57.193 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:17:57.193 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 97.647609493999994, 2024-09-12T16:17:57.193 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053413258999999998, 2024-09-12T16:17:57.193 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.193 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.193 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:57.194 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.194 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:57.194 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:57.194 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14040 2024-09-12T16:17:57.194 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.194 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.194 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.194 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.194 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:17:57.194 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.194 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.194 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.194 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.194 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:17:57.194 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523059+0000", 2024-09-12T16:17:57.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118466 2024-09-12T16:17:57.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523062+0000", 2024-09-12T16:17:57.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.971e-06 2024-09-12T16:17:57.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523069+0000", 2024-09-12T16:17:57.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8279999999999997e-06 2024-09-12T16:17:57.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.196 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.196 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523073+0000", 2024-09-12T16:17:57.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3019999999999996e-06 2024-09-12T16:17:57.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.196 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.196 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576155+0000", 2024-09-12T16:17:57.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053081962000000003 2024-09-12T16:17:57.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.196 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.196 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576249+0000", 2024-09-12T16:17:57.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3914999999999998e-05 2024-09-12T16:17:57.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.197 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.197 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.197 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576354+0000", 2024-09-12T16:17:57.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010481500000000001 2024-09-12T16:17:57.197 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.197 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.197 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.197 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.197 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14041 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5063680~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:57.197 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:17:57.197 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 97.647459189000003, 2024-09-12T16:17:57.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053519111000000001, 2024-09-12T16:17:57.198 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.198 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.198 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:57.198 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.198 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:57.198 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:57.198 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14041 2024-09-12T16:17:57.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.198 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.198 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.198 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.198 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:17:57.198 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.198 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.199 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:17:57.199 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.199 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523309+0000", 2024-09-12T16:17:57.199 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000218712 2024-09-12T16:17:57.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.199 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523313+0000", 2024-09-12T16:17:57.199 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.151e-06 2024-09-12T16:17:57.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523320+0000", 2024-09-12T16:17:57.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9789999999999993e-06 2024-09-12T16:17:57.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523325+0000", 2024-09-12T16:17:57.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:17:57.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576402+0000", 2024-09-12T16:17:57.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053076811000000002 2024-09-12T16:17:57.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.201 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.201 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.201 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576491+0000", 2024-09-12T16:17:57.201 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8578999999999993e-05 2024-09-12T16:17:57.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.201 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.201 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.201 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576610+0000", 2024-09-12T16:17:57.201 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119129 2024-09-12T16:17:57.201 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.201 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.201 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.202 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.202 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14042 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5067776~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:57.202 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:17:57.202 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 97.647215755000005, 2024-09-12T16:17:57.202 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053510350999999998, 2024-09-12T16:17:57.202 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.202 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.202 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:57.202 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.202 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:57.202 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:57.202 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14042 2024-09-12T16:17:57.202 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.202 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:17:57.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:17:57.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523591+0000", 2024-09-12T16:17:57.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025710300000000001 2024-09-12T16:17:57.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.204 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.204 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.204 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523594+0000", 2024-09-12T16:17:57.204 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2229999999999999e-06 2024-09-12T16:17:57.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.204 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.204 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.204 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523602+0000", 2024-09-12T16:17:57.204 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6930000000000007e-06 2024-09-12T16:17:57.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.204 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.205 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.205 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523607+0000", 2024-09-12T16:17:57.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4789999999999998e-06 2024-09-12T16:17:57.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.205 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.205 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576661+0000", 2024-09-12T16:17:57.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053973999999997 2024-09-12T16:17:57.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.205 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.205 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576745+0000", 2024-09-12T16:17:57.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4660000000000006e-05 2024-09-12T16:17:57.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.206 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.206 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.206 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576844+0000", 2024-09-12T16:17:57.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9219e-05 2024-09-12T16:17:57.206 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.206 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.206 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.206 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.206 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14043 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5071872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:57.206 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:17:57.206 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 97.646935275999994, 2024-09-12T16:17:57.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053475295999999999, 2024-09-12T16:17:57.206 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.207 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.207 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:57.207 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.207 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:57.207 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:57.207 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14043 2024-09-12T16:17:57.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.207 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.207 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.207 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:17:57.207 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.208 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.208 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:17:57.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.208 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.208 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.208 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523823+0000", 2024-09-12T16:17:57.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020818900000000001 2024-09-12T16:17:57.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.208 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.208 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.208 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523826+0000", 2024-09-12T16:17:57.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.405e-06 2024-09-12T16:17:57.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523834+0000", 2024-09-12T16:17:57.209 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5499999999999997e-06 2024-09-12T16:17:57.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523838+0000", 2024-09-12T16:17:57.209 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.408e-06 2024-09-12T16:17:57.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576904+0000", 2024-09-12T16:17:57.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053065687 2024-09-12T16:17:57.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.210 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.210 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.210 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576991+0000", 2024-09-12T16:17:57.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7399999999999997e-05 2024-09-12T16:17:57.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.210 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.210 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.210 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577090+0000", 2024-09-12T16:17:57.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8657000000000001e-05 2024-09-12T16:17:57.210 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.210 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.210 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.211 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14044 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5075968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:57.211 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:17:57.211 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 97.646703746, 2024-09-12T16:17:57.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053442659000000003, 2024-09-12T16:17:57.211 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.211 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.211 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:57.211 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.211 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:57.211 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:57.211 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14044 2024-09-12T16:17:57.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.211 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:17:57.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:17:57.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523985+0000", 2024-09-12T16:17:57.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000138522 2024-09-12T16:17:57.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.213 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.213 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523988+0000", 2024-09-12T16:17:57.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.788e-06 2024-09-12T16:17:57.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.213 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.213 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523998+0000", 2024-09-12T16:17:57.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8470000000000008e-06 2024-09-12T16:17:57.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.213 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524010+0000", 2024-09-12T16:17:57.214 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1348999999999999e-05 2024-09-12T16:17:57.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.214 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.214 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577137+0000", 2024-09-12T16:17:57.214 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053127055999999999 2024-09-12T16:17:57.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.214 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.214 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577210+0000", 2024-09-12T16:17:57.214 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3392000000000005e-05 2024-09-12T16:17:57.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.214 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.214 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.215 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577289+0000", 2024-09-12T16:17:57.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8704999999999999e-05 2024-09-12T16:17:57.215 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.215 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.215 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.215 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14045 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5080064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:57.215 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:17:57.215 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 97.646524924999994, 2024-09-12T16:17:57.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053497514000000003, 2024-09-12T16:17:57.215 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.215 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.215 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:57.216 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.216 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:57.216 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:57.216 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14045 2024-09-12T16:17:57.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.216 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.216 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.216 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:17:57.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.216 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:17:57.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524311+0000", 2024-09-12T16:17:57.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028626299999999998 2024-09-12T16:17:57.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524315+0000", 2024-09-12T16:17:57.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0969999999999999e-06 2024-09-12T16:17:57.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524325+0000", 2024-09-12T16:17:57.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6330000000000008e-06 2024-09-12T16:17:57.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524332+0000", 2024-09-12T16:17:57.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8700000000000003e-06 2024-09-12T16:17:57.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577334+0000", 2024-09-12T16:17:57.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053001834999999997 2024-09-12T16:17:57.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577420+0000", 2024-09-12T16:17:57.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6145999999999998e-05 2024-09-12T16:17:57.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577522+0000", 2024-09-12T16:17:57.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010267 2024-09-12T16:17:57.219 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.219 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.219 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.220 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.220 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14047 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5088256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:57.220 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:17:57.220 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 97.646039199000001, 2024-09-12T16:17:57.220 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053433340000000003, 2024-09-12T16:17:57.220 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.220 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.220 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:57.220 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.220 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:57.220 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:57.220 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14047 2024-09-12T16:17:57.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.221 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.221 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.221 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.221 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:17:57.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.221 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.221 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.221 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:17:57.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.221 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.221 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.221 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524727+0000", 2024-09-12T16:17:57.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000216126 2024-09-12T16:17:57.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.222 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524732+0000", 2024-09-12T16:17:57.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1569999999999999e-06 2024-09-12T16:17:57.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.222 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524742+0000", 2024-09-12T16:17:57.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0186999999999999e-05 2024-09-12T16:17:57.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524750+0000", 2024-09-12T16:17:57.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4279999999999999e-06 2024-09-12T16:17:57.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577743+0000", 2024-09-12T16:17:57.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052993077 2024-09-12T16:17:57.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577841+0000", 2024-09-12T16:17:57.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8369000000000006e-05 2024-09-12T16:17:57.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577944+0000", 2024-09-12T16:17:57.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102996 2024-09-12T16:17:57.224 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.224 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.224 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.224 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14048 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5092352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:57.224 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:17:57.224 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 97.645787605999999, 2024-09-12T16:17:57.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053397515, 2024-09-12T16:17:57.225 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.225 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.225 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:57.225 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.225 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:57.225 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:57.225 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14048 2024-09-12T16:17:57.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.225 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:17:57.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:17:57.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524957+0000", 2024-09-12T16:17:57.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019516999999999999 2024-09-12T16:17:57.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524962+0000", 2024-09-12T16:17:57.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7709999999999997e-06 2024-09-12T16:17:57.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.227 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.227 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.227 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524973+0000", 2024-09-12T16:17:57.227 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1031e-05 2024-09-12T16:17:57.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.227 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.227 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.227 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524980+0000", 2024-09-12T16:17:57.227 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6100000000000002e-06 2024-09-12T16:17:57.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.227 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.227 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.227 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577977+0000", 2024-09-12T16:17:57.228 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052997481999999999 2024-09-12T16:17:57.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.228 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.228 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578062+0000", 2024-09-12T16:17:57.228 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4851000000000005e-05 2024-09-12T16:17:57.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.228 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.228 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578160+0000", 2024-09-12T16:17:57.228 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7600000000000001e-05 2024-09-12T16:17:57.228 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.228 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.228 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.229 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14049 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5096448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:57.229 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:17:57.229 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 97.645558977999997, 2024-09-12T16:17:57.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053439792, 2024-09-12T16:17:57.229 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.229 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.229 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:57.229 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.229 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:57.229 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:57.229 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14049 2024-09-12T16:17:57.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.229 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:17:57.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:17:57.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525170+0000", 2024-09-12T16:17:57.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017958500000000001 2024-09-12T16:17:57.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.231 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.231 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.231 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525174+0000", 2024-09-12T16:17:57.231 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0239999999999999e-06 2024-09-12T16:17:57.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.231 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.231 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.231 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525184+0000", 2024-09-12T16:17:57.231 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5950000000000005e-06 2024-09-12T16:17:57.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.231 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.231 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.231 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525191+0000", 2024-09-12T16:17:57.231 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8329999999999996e-06 2024-09-12T16:17:57.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.232 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578240+0000", 2024-09-12T16:17:57.232 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053049236 2024-09-12T16:17:57.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.232 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578333+0000", 2024-09-12T16:17:57.232 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2806999999999994e-05 2024-09-12T16:17:57.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.233 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578431+0000", 2024-09-12T16:17:57.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7712000000000002e-05 2024-09-12T16:17:57.233 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.233 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.233 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.233 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14055 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5121024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:57.233 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:17:57.233 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 97.644288286999995, 2024-09-12T16:17:57.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053399038000000003, 2024-09-12T16:17:57.233 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.233 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.233 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:57.234 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.234 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:17:57.234 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:57.234 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14055 2024-09-12T16:17:57.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.234 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.234 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.234 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.234 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:17:57.234 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.234 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.234 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.234 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:17:57.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.235 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.235 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.235 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526403+0000", 2024-09-12T16:17:57.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141571 2024-09-12T16:17:57.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.235 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.235 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.235 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526406+0000", 2024-09-12T16:17:57.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2660000000000002e-06 2024-09-12T16:17:57.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.235 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.235 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.235 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526420+0000", 2024-09-12T16:17:57.236 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3949e-05 2024-09-12T16:17:57.236 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.236 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.236 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.236 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526428+0000", 2024-09-12T16:17:57.236 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4250000000000001e-06 2024-09-12T16:17:57.236 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.236 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.236 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.236 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579476+0000", 2024-09-12T16:17:57.236 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053048349000000002 2024-09-12T16:17:57.236 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.236 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.237 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.237 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579563+0000", 2024-09-12T16:17:57.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6502999999999995e-05 2024-09-12T16:17:57.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.237 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.237 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.237 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579661+0000", 2024-09-12T16:17:57.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7974999999999996e-05 2024-09-12T16:17:57.237 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.237 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.237 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.237 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.237 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4806.0:3139 3.1e 3:78d5a095:::rbd_data.11552a37e55b.0000000000000000:head [read 69632~61440] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:17:57.238 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:57.238 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 86.869294037000003, 2024-09-12T16:17:57.238 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057851734000000002, 2024-09-12T16:17:57.238 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.238 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.238 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:57.238 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.238 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4806", 2024-09-12T16:17:57.238 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3959815836", 2024-09-12T16:17:57.238 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 3139 2024-09-12T16:17:57.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.238 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.239 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.239 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:57.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.239 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.239 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:57.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.239 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.239 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:17:57.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4799999999999999e-07 2024-09-12T16:17:57.240 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.240 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.240 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.240 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301258+0000", 2024-09-12T16:17:57.240 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.844e-06 2024-09-12T16:17:57.240 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.240 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.240 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.240 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301267+0000", 2024-09-12T16:17:57.240 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2960000000000004e-06 2024-09-12T16:17:57.240 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.240 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.240 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.240 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301276+0000", 2024-09-12T16:17:57.240 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0650000000000005e-06 2024-09-12T16:17:57.241 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.241 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.241 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.241 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301871+0000", 2024-09-12T16:17:57.241 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00059423600000000005 2024-09-12T16:17:57.241 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.241 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.241 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.241 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301920+0000", 2024-09-12T16:17:57.241 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9067000000000003e-05 2024-09-12T16:17:57.241 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.241 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.241 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.241 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359108+0000", 2024-09-12T16:17:57.241 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057187877999999998 2024-09-12T16:17:57.241 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.242 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.242 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.242 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.242 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.242 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:6428 3.14 3:28a44e54:::rbd_header.11552a37e55b:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:17:57.242 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:17:57.242 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 86.868965442999993, 2024-09-12T16:17:57.242 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057504023000000001, 2024-09-12T16:17:57.242 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.242 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.242 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:57.242 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.242 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:17:57.242 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:17:57.243 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6428 2024-09-12T16:17:57.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.243 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.243 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.243 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:17:57.243 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.243 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.243 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:17:57.243 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.243 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.243 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301585+0000", 2024-09-12T16:17:57.244 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6300000000000005e-07 2024-09-12T16:17:57.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.244 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.244 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.244 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301588+0000", 2024-09-12T16:17:57.244 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4149999999999999e-06 2024-09-12T16:17:57.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.244 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.244 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.244 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301597+0000", 2024-09-12T16:17:57.244 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5450000000000003e-06 2024-09-12T16:17:57.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.244 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.244 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.245 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301617+0000", 2024-09-12T16:17:57.245 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9837e-05 2024-09-12T16:17:57.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.245 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.245 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.245 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301779+0000", 2024-09-12T16:17:57.245 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016186799999999999 2024-09-12T16:17:57.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.245 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.245 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.245 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301855+0000", 2024-09-12T16:17:57.245 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5899e-05 2024-09-12T16:17:57.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.245 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.246 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.246 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359088+0000", 2024-09-12T16:17:57.246 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057233895999999999 2024-09-12T16:17:57.246 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.246 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.246 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.246 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.246 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.246 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5223.0:1814 3.f 3:f7b1b1c5:::rbd_object_map.1155a1fd27d2:head [read 0~136] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-12T16:17:57.246 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:17:57.246 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 50.933299378999997, 2024-09-12T16:17:57.246 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.006378226, 2024-09-12T16:17:57.246 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.247 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.247 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:57.247 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.247 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5223", 2024-09-12T16:17:57.247 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/4066330994", 2024-09-12T16:17:57.247 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1814 2024-09-12T16:17:57.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.247 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.247 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.247 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:17:57.247 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.248 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.248 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.248 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:17:57.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.248 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.248 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.248 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237252+0000", 2024-09-12T16:17:57.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.344e-06 2024-09-12T16:17:57.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.248 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.248 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.248 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237258+0000", 2024-09-12T16:17:57.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1070000000000001e-06 2024-09-12T16:17:57.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.249 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.249 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237270+0000", 2024-09-12T16:17:57.249 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1758e-05 2024-09-12T16:17:57.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.249 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.249 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237278+0000", 2024-09-12T16:17:57.249 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3219999999999993e-06 2024-09-12T16:17:57.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.249 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.249 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237334+0000", 2024-09-12T16:17:57.249 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6356e-05 2024-09-12T16:17:57.250 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.250 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.250 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:17:57.250 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237345+0000", 2024-09-12T16:17:57.250 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0433e-05 2024-09-12T16:17:57.250 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.250 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.250 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.250 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243426+0000", 2024-09-12T16:17:57.250 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.00608133 2024-09-12T16:17:57.250 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.250 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.250 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.250 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243534+0000", 2024-09-12T16:17:57.250 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010784 2024-09-12T16:17:57.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.251 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.251 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.251 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243629+0000", 2024-09-12T16:17:57.251 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4735999999999996e-05 2024-09-12T16:17:57.251 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.251 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.251 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.251 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.251 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5328.0:2542 3.16 3:6928f3a1:::rbd_object_map.11551722dd77:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:57.251 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:17:57.251 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 45.114953948999997, 2024-09-12T16:17:57.251 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.054219934999999997, 2024-09-12T16:17:57.252 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.252 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.252 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:57.252 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.252 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5328", 2024-09-12T16:17:57.252 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:57.252 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2542 2024-09-12T16:17:57.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.252 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.252 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:17:57.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:17:57.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055597+0000", 2024-09-12T16:17:57.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4300000000000001e-07 2024-09-12T16:17:57.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055602+0000", 2024-09-12T16:17:57.254 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4269999999999999e-06 2024-09-12T16:17:57.254 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.254 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.254 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.254 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055613+0000", 2024-09-12T16:17:57.254 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0815000000000001e-05 2024-09-12T16:17:57.254 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.254 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.254 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.254 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055621+0000", 2024-09-12T16:17:57.254 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4189999999999996e-06 2024-09-12T16:17:57.254 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.254 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.254 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.255 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102196+0000", 2024-09-12T16:17:57.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.046575616 2024-09-12T16:17:57.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.255 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.255 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102258+0000", 2024-09-12T16:17:57.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1872000000000007e-05 2024-09-12T16:17:57.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.255 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T16:17:57.255 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102601+0000", 2024-09-12T16:17:57.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034285700000000001 2024-09-12T16:17:57.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.255 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:57.256 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.104431+0000", 2024-09-12T16:17:57.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001830524 2024-09-12T16:17:57.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.256 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:17:57.256 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109733+0000", 2024-09-12T16:17:57.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0053020089999999999 2024-09-12T16:17:57.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.256 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:57.256 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109777+0000", 2024-09-12T16:17:57.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3754000000000002e-05 2024-09-12T16:17:57.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.257 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.257 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109816+0000", 2024-09-12T16:17:57.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8699000000000003e-05 2024-09-12T16:17:57.257 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.257 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.257 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.257 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5328.0:2543 3.16 3:6928f3a1:::rbd_object_map.11551722dd77:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:17:57.257 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:17:57.257 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 45.114359970000002, 2024-09-12T16:17:57.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053695720000000002, 2024-09-12T16:17:57.257 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.257 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.258 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:57.258 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.258 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5328", 2024-09-12T16:17:57.258 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:17:57.258 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2543 2024-09-12T16:17:57.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.258 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.258 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:17:57.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.258 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:17:57.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.259 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.259 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056191+0000", 2024-09-12T16:17:57.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.54e-07 2024-09-12T16:17:57.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.259 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.259 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056195+0000", 2024-09-12T16:17:57.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5460000000000002e-06 2024-09-12T16:17:57.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.259 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.259 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056205+0000", 2024-09-12T16:17:57.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7350000000000008e-06 2024-09-12T16:17:57.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.260 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.260 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056214+0000", 2024-09-12T16:17:57.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8089999999999999e-06 2024-09-12T16:17:57.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.260 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.260 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103317+0000", 2024-09-12T16:17:57.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.047102889000000002 2024-09-12T16:17:57.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.260 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.260 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103410+0000", 2024-09-12T16:17:57.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3689000000000004e-05 2024-09-12T16:17:57.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.261 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T16:17:57.261 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103754+0000", 2024-09-12T16:17:57.261 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034344699999999998 2024-09-12T16:17:57.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.261 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:57.261 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.106487+0000", 2024-09-12T16:17:57.261 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0027330100000000001 2024-09-12T16:17:57.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.261 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:17:57.261 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109827+0000", 2024-09-12T16:17:57.261 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033406640000000001 2024-09-12T16:17:57.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:57.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109854+0000", 2024-09-12T16:17:57.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6866999999999999e-05 2024-09-12T16:17:57.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109886+0000", 2024-09-12T16:17:57.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1309999999999997e-05 2024-09-12T16:17:57.262 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.262 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.262 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.263 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.263 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5832.0:1710 3.f 3:f0d97d21:::rbd_data.1155d3b3a2ae.0000000000000012:head [truncate 1376256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-12T16:17:57.263 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:17:57.263 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 9.7865618849999994, 2024-09-12T16:17:57.263 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6441524489999999, 2024-09-12T16:17:57.263 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.263 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.263 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:57.263 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.263 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5832", 2024-09-12T16:17:57.263 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/201125203", 2024-09-12T16:17:57.263 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1710 2024-09-12T16:17:57.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.263 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.264 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.264 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:17:57.264 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.264 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.264 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:17:57.264 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.264 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.264 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:17:57.264 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.08e-07 2024-09-12T16:17:57.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383990+0000", 2024-09-12T16:17:57.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.979e-06 2024-09-12T16:17:57.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383999+0000", 2024-09-12T16:17:57.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3240000000000003e-06 2024-09-12T16:17:57.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.384002+0000", 2024-09-12T16:17:57.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5489999999999998e-06 2024-09-12T16:17:57.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.384037+0000", 2024-09-12T16:17:57.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4931000000000001e-05 2024-09-12T16:17:57.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:17:57.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.384043+0000", 2024-09-12T16:17:57.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3920000000000002e-06 2024-09-12T16:17:57.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.267 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.267 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:48.007976+0000", 2024-09-12T16:17:57.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.62393385300000004 2024-09-12T16:17:57.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.267 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:17:57.267 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:48.007992+0000", 2024-09-12T16:17:57.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5668e-05 2024-09-12T16:17:57.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.267 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.267 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024187+0000", 2024-09-12T16:17:57.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0161951629999999 2024-09-12T16:17:57.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.268 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.268 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.268 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024362+0000", 2024-09-12T16:17:57.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017500600000000001 2024-09-12T16:17:57.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.268 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.268 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:17:57.268 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024453+0000", 2024-09-12T16:17:57.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1055000000000001e-05 2024-09-12T16:17:57.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.268 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.268 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:17:57.268 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024963+0000", 2024-09-12T16:17:57.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000510087 2024-09-12T16:17:57.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.269 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.269 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:57.269 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.027974+0000", 2024-09-12T16:17:57.269 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030107070000000001 2024-09-12T16:17:57.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.269 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.269 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:57.269 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.028022+0000", 2024-09-12T16:17:57.269 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7636000000000003e-05 2024-09-12T16:17:57.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.269 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.269 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.269 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.028140+0000", 2024-09-12T16:17:57.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011869100000000001 2024-09-12T16:17:57.270 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.270 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.270 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.270 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.270 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.270 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:57.271 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:17:57.272 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:57.270+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:57.372 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:57.372+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:57.380 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:57.380 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:57.380 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:17:57.380 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:57.388 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:17:57.474 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:57.473+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:57.535 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:57.535 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:57.535 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:17:57.536 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:17:57.536 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:57.544 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:17:57.544 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 3] out_osds: [5] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-12T16:17:57.544 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T16:17:57.544 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-09-12T16:17:57.544 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-12T16:17:57.544 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-12T16:17:57.545 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-09-12T16:17:57.589 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:57.588+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:57.653 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:57.653 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:17:57.653 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:17:57.653 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:17:57.653 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.653 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5599 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4788224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:57.653 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:17:57.653 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 77.355151414999995, 2024-09-12T16:17:57.654 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061192059, 2024-09-12T16:17:57.654 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.654 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.654 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:57.654 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.654 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:57.654 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:57.654 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5599 2024-09-12T16:17:57.654 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.654 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.654 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.654 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.654 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:17:57.654 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.655 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.655 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.655 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.655 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:17:57.655 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.655 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.655 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.655 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.655 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296333+0000", 2024-09-12T16:17:57.655 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6599999999999996e-07 2024-09-12T16:17:57.655 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.655 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.655 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.656 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296335+0000", 2024-09-12T16:17:57.656 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5900000000000002e-06 2024-09-12T16:17:57.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.656 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.656 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.656 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296344+0000", 2024-09-12T16:17:57.656 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9539999999999993e-06 2024-09-12T16:17:57.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.656 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.656 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.656 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296350+0000", 2024-09-12T16:17:57.656 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5589999999999996e-06 2024-09-12T16:17:57.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.657 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.657 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.657 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357307+0000", 2024-09-12T16:17:57.657 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.060957573000000001 2024-09-12T16:17:57.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.657 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.657 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.657 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357401+0000", 2024-09-12T16:17:57.657 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3512999999999997e-05 2024-09-12T16:17:57.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.657 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.657 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.657 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357524+0000", 2024-09-12T16:17:57.657 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000123304 2024-09-12T16:17:57.658 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.658 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.658 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.658 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.658 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.658 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5611 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4730880~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:57.658 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:17:57.658 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 77.355088971000001, 2024-09-12T16:17:57.658 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061359348000000001, 2024-09-12T16:17:57.658 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.658 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.658 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:57.658 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.658 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:57.659 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:57.659 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5611 2024-09-12T16:17:57.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.659 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.659 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.659 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.659 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:17:57.659 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.659 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.659 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.659 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:17:57.659 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.660 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.660 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.660 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.660 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296395+0000", 2024-09-12T16:17:57.660 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4600000000000003e-07 2024-09-12T16:17:57.660 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.660 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.660 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.660 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296399+0000", 2024-09-12T16:17:57.660 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9430000000000002e-06 2024-09-12T16:17:57.660 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.660 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.660 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.660 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296411+0000", 2024-09-12T16:17:57.661 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1755e-05 2024-09-12T16:17:57.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.661 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.661 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.661 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296417+0000", 2024-09-12T16:17:57.661 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3790000000000003e-06 2024-09-12T16:17:57.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.661 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.661 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.661 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357572+0000", 2024-09-12T16:17:57.661 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061154871 2024-09-12T16:17:57.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.661 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.662 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.662 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357663+0000", 2024-09-12T16:17:57.662 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0389999999999993e-05 2024-09-12T16:17:57.662 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.662 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.662 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.662 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357754+0000", 2024-09-12T16:17:57.662 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1063999999999994e-05 2024-09-12T16:17:57.662 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.662 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.662 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.662 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.662 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.662 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5613 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4775936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:57.663 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:57.663 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 77.355047791000004, 2024-09-12T16:17:57.663 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061491777999999997, 2024-09-12T16:17:57.663 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.663 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.663 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:57.663 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.663 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:57.663 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:57.663 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5613 2024-09-12T16:17:57.663 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.663 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.663 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.664 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.664 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:57.664 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.664 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.664 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.664 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.664 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:57.664 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.664 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.664 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.664 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.664 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:17:57.665 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8899999999999999e-07 2024-09-12T16:17:57.665 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.665 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.665 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.665 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296439+0000", 2024-09-12T16:17:57.665 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8439999999999998e-06 2024-09-12T16:17:57.665 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.665 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.665 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.665 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296452+0000", 2024-09-12T16:17:57.665 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2639e-05 2024-09-12T16:17:57.665 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.665 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.666 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.666 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296457+0000", 2024-09-12T16:17:57.666 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5720000000000002e-06 2024-09-12T16:17:57.666 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.666 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.666 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.666 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357773+0000", 2024-09-12T16:17:57.666 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061315500000000002 2024-09-12T16:17:57.666 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.666 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.666 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.666 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357814+0000", 2024-09-12T16:17:57.666 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1448e-05 2024-09-12T16:17:57.667 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.667 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.667 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.667 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357927+0000", 2024-09-12T16:17:57.667 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000113186 2024-09-12T16:17:57.667 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.667 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.667 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.667 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.667 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.667 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5616 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4784128~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:57.667 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:57.668 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 77.355012728999995, 2024-09-12T16:17:57.668 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061725002000000001, 2024-09-12T16:17:57.668 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.668 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.668 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:57.668 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.668 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:57.668 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:57.668 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5616 2024-09-12T16:17:57.668 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.668 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.668 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.668 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.669 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:57.669 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.669 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.669 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.669 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.669 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:57.669 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.669 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.669 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.669 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.669 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:17:57.669 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5900000000000002e-07 2024-09-12T16:17:57.669 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.670 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.670 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.670 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296473+0000", 2024-09-12T16:17:57.670 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3130000000000001e-06 2024-09-12T16:17:57.670 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.670 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.670 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.670 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296481+0000", 2024-09-12T16:17:57.670 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1389999999999998e-06 2024-09-12T16:17:57.670 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.670 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.670 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.670 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296486+0000", 2024-09-12T16:17:57.671 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3310000000000003e-06 2024-09-12T16:17:57.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.671 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.671 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.671 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357981+0000", 2024-09-12T16:17:57.671 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061494866000000002 2024-09-12T16:17:57.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.671 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.671 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.671 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358082+0000", 2024-09-12T16:17:57.671 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101424 2024-09-12T16:17:57.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.671 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.672 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.672 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358196+0000", 2024-09-12T16:17:57.672 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011347 2024-09-12T16:17:57.672 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.672 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.672 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.672 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.672 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.672 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5626 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4739072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:57.672 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:17:57.672 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 77.354934772999997, 2024-09-12T16:17:57.672 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061802430999999998, 2024-09-12T16:17:57.673 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.673 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.673 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:57.673 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.673 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:57.673 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:57.673 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5626 2024-09-12T16:17:57.673 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.673 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.673 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.673 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.673 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:17:57.673 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.674 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.674 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.674 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.674 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:17:57.674 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.674 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.674 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.674 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.674 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296550+0000", 2024-09-12T16:17:57.674 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.215e-06 2024-09-12T16:17:57.674 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.674 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.674 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.675 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296555+0000", 2024-09-12T16:17:57.675 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9590000000000003e-06 2024-09-12T16:17:57.675 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.675 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.675 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.675 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296568+0000", 2024-09-12T16:17:57.675 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3338e-05 2024-09-12T16:17:57.675 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.675 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.675 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.675 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296576+0000", 2024-09-12T16:17:57.675 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5510000000000002e-06 2024-09-12T16:17:57.675 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.676 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.676 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.676 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358241+0000", 2024-09-12T16:17:57.676 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.06166576 2024-09-12T16:17:57.676 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.676 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.676 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.676 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358288+0000", 2024-09-12T16:17:57.676 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6097000000000003e-05 2024-09-12T16:17:57.676 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.676 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.676 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.677 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358351+0000", 2024-09-12T16:17:57.677 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3510999999999996e-05 2024-09-12T16:17:57.677 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.677 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.677 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.677 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.677 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.677 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5628 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4792320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:57.677 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:17:57.677 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 77.354892273000004, 2024-09-12T16:17:57.677 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061961161000000001, 2024-09-12T16:17:57.677 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.677 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.677 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:57.678 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.678 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:57.678 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:57.678 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5628 2024-09-12T16:17:57.678 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.678 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.678 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.678 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.678 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:17:57.678 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.678 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.678 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.679 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.679 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:17:57.679 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.679 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.679 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.679 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.679 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296592+0000", 2024-09-12T16:17:57.679 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2099999999999996e-07 2024-09-12T16:17:57.679 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.679 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.679 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.679 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296595+0000", 2024-09-12T16:17:57.679 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0429999999999999e-06 2024-09-12T16:17:57.679 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.680 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.680 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.680 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296603+0000", 2024-09-12T16:17:57.680 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9899999999999997e-06 2024-09-12T16:17:57.680 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.680 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.680 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.680 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296609+0000", 2024-09-12T16:17:57.680 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7259999999999999e-06 2024-09-12T16:17:57.680 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.680 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.680 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.681 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358393+0000", 2024-09-12T16:17:57.681 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061784617 2024-09-12T16:17:57.681 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.681 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.681 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.681 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358460+0000", 2024-09-12T16:17:57.681 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7253000000000001e-05 2024-09-12T16:17:57.681 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.681 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.681 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.681 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358552+0000", 2024-09-12T16:17:57.681 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1811000000000006e-05 2024-09-12T16:17:57.681 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.681 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.682 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.682 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.682 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.682 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5638 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4734976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:57.682 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:57.682 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 77.354419722000003, 2024-09-12T16:17:57.682 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061654460000000001, 2024-09-12T16:17:57.682 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.682 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.682 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:57.682 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.682 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:57.682 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:57.683 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5638 2024-09-12T16:17:57.683 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.683 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.683 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.683 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.683 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:57.683 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.683 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.683 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.683 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.683 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:57.684 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.684 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.684 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.684 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.684 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:17:57.684 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.23e-07 2024-09-12T16:17:57.684 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.684 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.684 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.684 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297068+0000", 2024-09-12T16:17:57.684 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0060000000000003e-06 2024-09-12T16:17:57.684 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.684 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.685 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.685 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297080+0000", 2024-09-12T16:17:57.685 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1234e-05 2024-09-12T16:17:57.685 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.685 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.685 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.685 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297095+0000", 2024-09-12T16:17:57.685 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5698000000000001e-05 2024-09-12T16:17:57.685 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.685 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.685 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.685 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358582+0000", 2024-09-12T16:17:57.685 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061486274 2024-09-12T16:17:57.686 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.686 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.686 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.686 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358637+0000", 2024-09-12T16:17:57.686 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5439999999999998e-05 2024-09-12T16:17:57.686 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.686 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.686 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.686 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358718+0000", 2024-09-12T16:17:57.686 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0984999999999998e-05 2024-09-12T16:17:57.686 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.686 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.686 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.686 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.687 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.687 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5640 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4780032~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:57.687 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:17:57.687 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 77.354338002000006, 2024-09-12T16:17:57.687 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061746620000000002, 2024-09-12T16:17:57.687 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.687 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.687 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:57.687 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.687 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:57.687 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:57.687 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5640 2024-09-12T16:17:57.687 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.687 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.688 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.688 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.688 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:17:57.688 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.688 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.688 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.688 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.688 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:17:57.688 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.688 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.688 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.688 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.688 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297146+0000", 2024-09-12T16:17:57.689 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3600000000000003e-07 2024-09-12T16:17:57.689 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.689 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.689 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.689 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297150+0000", 2024-09-12T16:17:57.689 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8430000000000003e-06 2024-09-12T16:17:57.689 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.689 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.689 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.689 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297160+0000", 2024-09-12T16:17:57.689 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7229999999999999e-06 2024-09-12T16:17:57.689 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.689 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.690 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.690 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297167+0000", 2024-09-12T16:17:57.690 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0180000000000004e-06 2024-09-12T16:17:57.690 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.690 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.690 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.690 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358750+0000", 2024-09-12T16:17:57.690 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061583104 2024-09-12T16:17:57.690 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.690 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.690 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.690 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358804+0000", 2024-09-12T16:17:57.690 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4277000000000002e-05 2024-09-12T16:17:57.691 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.691 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.691 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.691 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358892+0000", 2024-09-12T16:17:57.691 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7918999999999996e-05 2024-09-12T16:17:57.691 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.691 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.691 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.691 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.691 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.691 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5642 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4788224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:57.691 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:57.691 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 77.354293658000003, 2024-09-12T16:17:57.692 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061860409999999998, 2024-09-12T16:17:57.692 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.692 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.692 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:57.692 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.692 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:57.692 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:57.692 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5642 2024-09-12T16:17:57.692 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.692 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.692 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.692 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.692 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:57.692 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.693 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.693 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.693 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.693 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:57.693 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.693 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.693 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.693 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.693 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:17:57.693 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7999999999999995e-07 2024-09-12T16:17:57.693 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.693 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.693 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.694 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297193+0000", 2024-09-12T16:17:57.694 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8310000000000001e-06 2024-09-12T16:17:57.694 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.694 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.694 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.694 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297204+0000", 2024-09-12T16:17:57.694 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0832999999999999e-05 2024-09-12T16:17:57.694 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.694 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.694 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.694 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297210+0000", 2024-09-12T16:17:57.694 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1770000000000003e-06 2024-09-12T16:17:57.694 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.694 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.695 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.695 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358928+0000", 2024-09-12T16:17:57.695 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061717826000000003 2024-09-12T16:17:57.695 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.695 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.695 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.695 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358977+0000", 2024-09-12T16:17:57.695 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9514000000000001e-05 2024-09-12T16:17:57.695 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.695 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.695 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.695 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359050+0000", 2024-09-12T16:17:57.695 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2649000000000002e-05 2024-09-12T16:17:57.696 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.696 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.696 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.696 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.696 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.696 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5646 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4743168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:57.696 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:57.696 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 77.354113717000004, 2024-09-12T16:17:57.696 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061822122, 2024-09-12T16:17:57.696 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.696 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.696 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:57.696 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.696 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:57.697 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:57.697 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5646 2024-09-12T16:17:57.697 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.697 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.697 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.697 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.697 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:57.697 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.697 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.697 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.697 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.697 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:57.698 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.698 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.698 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.698 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.698 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:17:57.698 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3200000000000004e-07 2024-09-12T16:17:57.698 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.698 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.698 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.698 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297374+0000", 2024-09-12T16:17:57.698 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8240000000000001e-06 2024-09-12T16:17:57.698 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.698 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.699 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.699 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297384+0000", 2024-09-12T16:17:57.699 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5710000000000004e-06 2024-09-12T16:17:57.699 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.699 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.699 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.699 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297390+0000", 2024-09-12T16:17:57.699 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5130000000000002e-06 2024-09-12T16:17:57.699 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.699 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.699 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.699 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359080+0000", 2024-09-12T16:17:57.699 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061689569999999999 2024-09-12T16:17:57.699 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.700 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.700 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.700 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359134+0000", 2024-09-12T16:17:57.700 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3838999999999997e-05 2024-09-12T16:17:57.700 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.700 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.700 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.700 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359192+0000", 2024-09-12T16:17:57.700 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8072999999999998e-05 2024-09-12T16:17:57.700 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.700 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.700 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.700 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.701 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.701 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5647 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4751360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:57.701 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:17:57.701 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 77.354077032000006, 2024-09-12T16:17:57.701 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061927569000000002, 2024-09-12T16:17:57.701 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.701 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.701 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:57.701 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.701 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:57.701 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:57.701 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5647 2024-09-12T16:17:57.702 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.702 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.702 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.702 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.702 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:17:57.702 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.702 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.702 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.702 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.702 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:17:57.702 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.703 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.703 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.703 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.703 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297407+0000", 2024-09-12T16:17:57.703 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.46e-07 2024-09-12T16:17:57.703 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.703 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.703 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.703 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297409+0000", 2024-09-12T16:17:57.703 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.469e-06 2024-09-12T16:17:57.703 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.703 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.704 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.704 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297415+0000", 2024-09-12T16:17:57.704 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9259999999999997e-06 2024-09-12T16:17:57.704 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.704 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.704 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.704 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297419+0000", 2024-09-12T16:17:57.704 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3840000000000001e-06 2024-09-12T16:17:57.704 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.704 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.705 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.705 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359224+0000", 2024-09-12T16:17:57.705 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061805367999999999 2024-09-12T16:17:57.705 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.705 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.705 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.705 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359275+0000", 2024-09-12T16:17:57.705 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1338000000000002e-05 2024-09-12T16:17:57.705 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.705 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.706 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.706 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359334+0000", 2024-09-12T16:17:57.706 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8638000000000003e-05 2024-09-12T16:17:57.706 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.706 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.706 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.706 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.706 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.706 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5649 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4796416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:57.707 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:17:57.707 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 77.354022173000004, 2024-09-12T16:17:57.707 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.062018578999999997, 2024-09-12T16:17:57.707 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.707 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.707 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:57.707 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.707 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:57.707 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:57.707 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5649 2024-09-12T16:17:57.707 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.708 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.708 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.708 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.708 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:17:57.708 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.708 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.708 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.708 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.708 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:17:57.709 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.709 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.709 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.709 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.709 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297462+0000", 2024-09-12T16:17:57.709 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2399999999999998e-07 2024-09-12T16:17:57.709 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.709 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.709 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.709 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297465+0000", 2024-09-12T16:17:57.710 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.371e-06 2024-09-12T16:17:57.710 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.710 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.710 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.710 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297473+0000", 2024-09-12T16:17:57.710 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4699999999999996e-06 2024-09-12T16:17:57.710 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.710 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.710 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.710 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297478+0000", 2024-09-12T16:17:57.710 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2780000000000001e-06 2024-09-12T16:17:57.711 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.711 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.711 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.711 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359368+0000", 2024-09-12T16:17:57.711 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061889758000000003 2024-09-12T16:17:57.711 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.711 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.711 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.711 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359420+0000", 2024-09-12T16:17:57.711 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2574999999999997e-05 2024-09-12T16:17:57.711 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.711 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.711 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.711 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359480+0000", 2024-09-12T16:17:57.712 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9503000000000003e-05 2024-09-12T16:17:57.712 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.712 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.712 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.712 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.712 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.712 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5674 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4739072~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:57.712 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:17:57.712 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 77.353618405000006, 2024-09-12T16:17:57.712 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061762989999999997, 2024-09-12T16:17:57.712 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.712 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.712 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:57.712 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.713 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:57.713 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:57.713 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5674 2024-09-12T16:17:57.713 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.713 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.713 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.713 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.713 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:17:57.713 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.713 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.713 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.713 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.713 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:17:57.713 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.714 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.714 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.714 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297866+0000", 2024-09-12T16:17:57.714 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1900000000000001e-07 2024-09-12T16:17:57.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.714 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.714 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.714 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297870+0000", 2024-09-12T16:17:57.714 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3560000000000003e-06 2024-09-12T16:17:57.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.714 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.714 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.715 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297888+0000", 2024-09-12T16:17:57.715 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8088999999999999e-05 2024-09-12T16:17:57.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.715 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.715 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.715 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297904+0000", 2024-09-12T16:17:57.715 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5971e-05 2024-09-12T16:17:57.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.715 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.715 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.715 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359510+0000", 2024-09-12T16:17:57.715 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061605634999999999 2024-09-12T16:17:57.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.716 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.716 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.716 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359554+0000", 2024-09-12T16:17:57.716 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4024999999999999e-05 2024-09-12T16:17:57.716 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.716 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.716 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.716 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359628+0000", 2024-09-12T16:17:57.716 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4095000000000001e-05 2024-09-12T16:17:57.716 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.716 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.716 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.716 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.717 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.717 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5676 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4792320~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:57.717 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:17:57.717 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 77.353417324999995, 2024-09-12T16:17:57.717 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061720143999999998, 2024-09-12T16:17:57.717 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.717 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.717 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:57.717 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.717 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:57.717 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:57.717 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5676 2024-09-12T16:17:57.718 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.718 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.718 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.718 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.718 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:17:57.718 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.718 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.718 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.718 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.718 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:17:57.718 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.718 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.718 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.718 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.719 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298067+0000", 2024-09-12T16:17:57.719 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8199999999999999e-07 2024-09-12T16:17:57.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.719 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.719 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.719 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298070+0000", 2024-09-12T16:17:57.719 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.743e-06 2024-09-12T16:17:57.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.719 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.719 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.719 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298080+0000", 2024-09-12T16:17:57.719 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4059999999999994e-06 2024-09-12T16:17:57.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.719 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.720 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.720 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298088+0000", 2024-09-12T16:17:57.720 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0779999999999996e-06 2024-09-12T16:17:57.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.720 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.720 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.720 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359659+0000", 2024-09-12T16:17:57.720 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061570688999999998 2024-09-12T16:17:57.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.720 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.720 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.720 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359713+0000", 2024-09-12T16:17:57.721 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3939e-05 2024-09-12T16:17:57.721 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.721 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.721 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.721 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359786+0000", 2024-09-12T16:17:57.721 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3607000000000002e-05 2024-09-12T16:17:57.721 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.721 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.721 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.721 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.721 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.721 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5684 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4747264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:57.721 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:17:57.721 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 77.352950032999999, 2024-09-12T16:17:57.722 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061394799, 2024-09-12T16:17:57.722 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.722 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.722 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:57.722 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.722 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:57.722 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:57.722 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5684 2024-09-12T16:17:57.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.722 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.722 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.722 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.722 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:17:57.722 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.723 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.723 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.723 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:17:57.723 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.723 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.723 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.723 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298534+0000", 2024-09-12T16:17:57.723 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4399999999999999e-07 2024-09-12T16:17:57.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.723 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.723 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.723 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298539+0000", 2024-09-12T16:17:57.723 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5360000000000003e-06 2024-09-12T16:17:57.724 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.724 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.724 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.724 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298550+0000", 2024-09-12T16:17:57.724 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1499e-05 2024-09-12T16:17:57.724 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.724 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.724 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.724 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298558+0000", 2024-09-12T16:17:57.724 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3000000000000004e-06 2024-09-12T16:17:57.724 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.724 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.724 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.725 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359815+0000", 2024-09-12T16:17:57.725 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061257952999999997 2024-09-12T16:17:57.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.725 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.725 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.725 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359868+0000", 2024-09-12T16:17:57.725 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2317000000000001e-05 2024-09-12T16:17:57.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.725 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.725 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.725 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359928+0000", 2024-09-12T16:17:57.725 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0350000000000003e-05 2024-09-12T16:17:57.725 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.725 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.726 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.726 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.726 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.726 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5686 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4755456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:57.726 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:17:57.726 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 77.352782609000002, 2024-09-12T16:17:57.726 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061355082999999998, 2024-09-12T16:17:57.726 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.726 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.726 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:57.726 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.726 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:57.726 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:57.726 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5686 2024-09-12T16:17:57.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.727 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.727 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:17:57.727 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.727 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:17:57.727 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.727 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298702+0000", 2024-09-12T16:17:57.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2399999999999997e-07 2024-09-12T16:17:57.728 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.728 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.728 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.728 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298706+0000", 2024-09-12T16:17:57.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5700000000000003e-06 2024-09-12T16:17:57.728 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.728 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.728 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.728 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298718+0000", 2024-09-12T16:17:57.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1457999999999999e-05 2024-09-12T16:17:57.728 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.728 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.729 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.729 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298732+0000", 2024-09-12T16:17:57.729 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.452e-05 2024-09-12T16:17:57.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.729 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.729 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.729 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359956+0000", 2024-09-12T16:17:57.729 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061223626000000003 2024-09-12T16:17:57.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.729 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.729 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.729 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360000+0000", 2024-09-12T16:17:57.729 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3922999999999999e-05 2024-09-12T16:17:57.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.730 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.730 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360056+0000", 2024-09-12T16:17:57.730 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6162000000000002e-05 2024-09-12T16:17:57.730 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.730 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.730 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.730 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5688 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4800512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:57.730 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:17:57.730 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 77.352559556000003, 2024-09-12T16:17:57.730 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061270514999999998, 2024-09-12T16:17:57.731 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.731 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.731 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:57.731 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.731 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:57.731 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:57.731 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5688 2024-09-12T16:17:57.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.731 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.731 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.731 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:17:57.731 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:17:57.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298925+0000", 2024-09-12T16:17:57.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4e-07 2024-09-12T16:17:57.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298929+0000", 2024-09-12T16:17:57.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9890000000000003e-06 2024-09-12T16:17:57.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.733 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.733 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.733 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298936+0000", 2024-09-12T16:17:57.733 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.52e-06 2024-09-12T16:17:57.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.733 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.733 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.733 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298941+0000", 2024-09-12T16:17:57.733 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4800000000000003e-06 2024-09-12T16:17:57.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.733 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.733 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.733 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360087+0000", 2024-09-12T16:17:57.734 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061146143 2024-09-12T16:17:57.734 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.734 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.734 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.734 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360137+0000", 2024-09-12T16:17:57.734 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0584000000000002e-05 2024-09-12T16:17:57.734 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.734 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.734 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.734 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360194+0000", 2024-09-12T16:17:57.734 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6858999999999999e-05 2024-09-12T16:17:57.734 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.734 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.735 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.735 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.735 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.735 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5693 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4751360~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:57.735 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:17:57.735 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 77.352137919, 2024-09-12T16:17:57.735 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061139444000000001, 2024-09-12T16:17:57.735 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.735 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.735 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:57.735 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.735 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:57.735 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:57.736 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5693 2024-09-12T16:17:57.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.736 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.736 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.736 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.736 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:17:57.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.736 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.736 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.736 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:17:57.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.737 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.737 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.737 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299346+0000", 2024-09-12T16:17:57.737 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2300000000000001e-07 2024-09-12T16:17:57.737 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.737 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.737 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.737 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299349+0000", 2024-09-12T16:17:57.737 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5270000000000001e-06 2024-09-12T16:17:57.737 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.737 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.737 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.738 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299358+0000", 2024-09-12T16:17:57.738 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7030000000000001e-06 2024-09-12T16:17:57.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.738 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.738 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.738 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299364+0000", 2024-09-12T16:17:57.738 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7239999999999997e-06 2024-09-12T16:17:57.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.738 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.738 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.738 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360369+0000", 2024-09-12T16:17:57.738 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061004713000000002 2024-09-12T16:17:57.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.738 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360415+0000", 2024-09-12T16:17:57.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5926e-05 2024-09-12T16:17:57.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360485+0000", 2024-09-12T16:17:57.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0327999999999995e-05 2024-09-12T16:17:57.739 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.739 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.739 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.740 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5694 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4796416~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:57.740 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:17:57.740 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 77.352108889999997, 2024-09-12T16:17:57.740 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061258034000000003, 2024-09-12T16:17:57.740 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.740 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.740 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:57.740 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.740 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:57.740 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:57.740 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5694 2024-09-12T16:17:57.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.740 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.741 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.741 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.741 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:17:57.741 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.741 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.741 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.741 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:17:57.741 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.741 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.741 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.742 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301884+0000", 2024-09-12T16:17:57.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025090379999999999 2024-09-12T16:17:57.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.742 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.742 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301889+0000", 2024-09-12T16:17:57.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5879999999999997e-06 2024-09-12T16:17:57.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.742 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.742 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301901+0000", 2024-09-12T16:17:57.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1466e-05 2024-09-12T16:17:57.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301908+0000", 2024-09-12T16:17:57.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1999999999999997e-06 2024-09-12T16:17:57.743 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360513+0000", 2024-09-12T16:17:57.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.058605023999999999 2024-09-12T16:17:57.743 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360562+0000", 2024-09-12T16:17:57.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9546000000000003e-05 2024-09-12T16:17:57.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.744 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.744 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360633+0000", 2024-09-12T16:17:57.744 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0172000000000005e-05 2024-09-12T16:17:57.744 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.744 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.744 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.744 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5759 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4767744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:17:57.744 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:17:57.744 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 77.349315356000005, 2024-09-12T16:17:57.745 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061058604000000002, 2024-09-12T16:17:57.745 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:57.745 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:57.745 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:57.745 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:17:57.745 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:17:57.745 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:17:57.745 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5759 2024-09-12T16:17:57.745 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.745 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:57.745 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.745 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:57.745 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:17:57.746 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.746 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.746 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:57.746 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:17:57.746 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:57.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.746 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.746 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:57.746 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302548+0000", 2024-09-12T16:17:57.746 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00038011000000000002 2024-09-12T16:17:57.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.746 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.746 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:57.747 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302553+0000", 2024-09-12T16:17:57.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1830000000000002e-06 2024-09-12T16:17:57.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:57.747 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302564+0000", 2024-09-12T16:17:57.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1011e-05 2024-09-12T16:17:57.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:57.747 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302572+0000", 2024-09-12T16:17:57.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9009999999999994e-06 2024-09-12T16:17:57.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.748 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:57.748 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363102+0000", 2024-09-12T16:17:57.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.060529782999999997 2024-09-12T16:17:57.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.748 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:57.748 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363149+0000", 2024-09-12T16:17:57.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7321000000000003e-05 2024-09-12T16:17:57.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:57.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:57.748 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:57.748 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363227+0000", 2024-09-12T16:17:57.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7294999999999998e-05 2024-09-12T16:17:57.749 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.749 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.749 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.749 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:57.749 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:57.749 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:57.751 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:57.751 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "" 2024-09-12T16:17:57.751 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:57.752 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:17:57.752 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:57.750+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:57.852 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:57.852+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:57.859 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:57.860 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:57.860 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:17:57.860 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:57.868 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:17:57.953 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:57.953+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:57.976 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:57.976 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:17:57.976 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:17:57.976 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:17:57.976 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:57.985 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:17:58.047 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T16:17:58.068 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:58.068+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:58.109 INFO:teuthology.orchestra.run.smithi204.stdout:flattening image image_client.0-clone39 2024-09-12T16:17:58.137 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:17:58.137 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:17:58.137 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:17:58.137 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:17:58.137 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.137 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.17 73/72 [PushOp(3:e9340267:::rbd_data.1155525b14e3.0000000000000031:f, version: 50'357, data_included: [0~4096,20480~4096,40960~8192,65536~4096,81920~8192,110592~4096,126976~8192,151552~4096,172032~8192,196608~4096,212992~8192,241664~4096,258048~8192,282624~4096,303104~8192,327680~4096,344064~8192,372736~4096,389120~8192,413696~4096,434176~8192,458752~4096,475136~8192,503808~4096,520192~8192,544768~4096,565248~8192,589824~4096,606208~8192,634880~4096,651264~8192,675840~4096,696320~8192,720896~4096,737280~8192,765952~4096,782336~8192,806912~4096,827392~8192,851968~4096,868352~8192,897024~4096,913408~8192,937984~4096,958464~8192,983040~4096,999424~8192,1028096~4096,1044480~4096], data_size: 294912, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:e9340267:::rbd_data.1155525b14e3.0000000000000031:f@50'357, size: 1048576, copy_subset: [(0, 1048576)], clone_subset: {}, snapset: f=[]:{f: [f]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T16:17:58.137 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.067448+0000", 2024-09-12T16:17:58.137 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 52.068087351999999, 2024-09-12T16:17:58.137 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003036721, 2024-09-12T16:17:58.137 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:58.138 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:58.138 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:17:58.138 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:58.138 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.138 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:58.138 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067448+0000", 2024-09-12T16:17:58.138 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.138 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.138 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.138 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:58.138 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067448+0000", 2024-09-12T16:17:58.138 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.139 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.139 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.139 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:58.139 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067449+0000", 2024-09-12T16:17:58.139 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2200000000000004e-07 2024-09-12T16:17:58.139 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.139 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.139 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:58.139 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067703+0000", 2024-09-12T16:17:58.139 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025377199999999998 2024-09-12T16:17:58.139 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.139 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.139 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:58.140 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067723+0000", 2024-09-12T16:17:58.140 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.986e-05 2024-09-12T16:17:58.140 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.140 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.140 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.140 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067743+0000", 2024-09-12T16:17:58.140 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9942e-05 2024-09-12T16:17:58.140 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.140 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.140 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:58.140 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067860+0000", 2024-09-12T16:17:58.140 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000116959 2024-09-12T16:17:58.141 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.141 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.141 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:58.141 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067872+0000", 2024-09-12T16:17:58.141 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2928000000000001e-05 2024-09-12T16:17:58.141 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.141 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.141 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:58.141 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.070485+0000", 2024-09-12T16:17:58.141 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0026127379999999999 2024-09-12T16:17:58.141 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.141 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:58.141 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.141 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.142 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.142 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5120.0:3941 3.17 e80/74 3:eff97428:::rbd_data.1155a3b3a26e.0000000000000060:head v 80'442, mlcod=79'439)", 2024-09-12T16:17:58.142 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:17:58.142 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 41.779746871, 2024-09-12T16:17:58.142 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0035981759999999998, 2024-09-12T16:17:58.142 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:58.142 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:58.142 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:58.142 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:58.142 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.142 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:58.142 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:17:58.143 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.143 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.143 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.143 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:58.143 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:17:58.143 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.143 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.143 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.143 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:58.143 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:17:58.143 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2e-07 2024-09-12T16:17:58.143 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.143 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.144 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:58.144 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355794+0000", 2024-09-12T16:17:58.144 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.865e-06 2024-09-12T16:17:58.144 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.144 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.144 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:58.144 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355956+0000", 2024-09-12T16:17:58.144 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016131699999999999 2024-09-12T16:17:58.144 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.144 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.144 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.144 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355964+0000", 2024-09-12T16:17:58.145 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7960000000000001e-06 2024-09-12T16:17:58.145 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.145 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.145 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:58.145 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.356320+0000", 2024-09-12T16:17:58.145 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000355612 2024-09-12T16:17:58.145 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.145 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.145 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:58.145 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.356337+0000", 2024-09-12T16:17:58.145 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6643e-05 2024-09-12T16:17:58.145 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.146 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.146 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:58.146 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.359340+0000", 2024-09-12T16:17:58.146 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003003618 2024-09-12T16:17:58.146 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.146 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.146 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:58.146 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.359387+0000", 2024-09-12T16:17:58.146 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6904999999999999e-05 2024-09-12T16:17:58.146 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.146 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:58.146 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.146 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.146 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.147 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2118 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1219, mlcod=88'1217)", 2024-09-12T16:17:58.147 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440434+0000", 2024-09-12T16:17:58.147 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 32.695101981000001, 2024-09-12T16:17:58.147 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003875543, 2024-09-12T16:17:58.147 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:58.147 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:58.147 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:58.147 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:58.147 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.147 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:58.147 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440434+0000", 2024-09-12T16:17:58.147 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.147 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.148 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.148 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:58.148 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440434+0000", 2024-09-12T16:17:58.148 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.148 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.148 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.148 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:58.148 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440435+0000", 2024-09-12T16:17:58.148 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8899999999999998e-07 2024-09-12T16:17:58.148 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.148 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.148 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:58.148 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440444+0000", 2024-09-12T16:17:58.149 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4599999999999992e-06 2024-09-12T16:17:58.149 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.149 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.149 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:58.149 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440459+0000", 2024-09-12T16:17:58.149 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4460999999999999e-05 2024-09-12T16:17:58.149 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.149 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.149 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.149 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440466+0000", 2024-09-12T16:17:58.149 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4340000000000003e-06 2024-09-12T16:17:58.149 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.149 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.149 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:58.150 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:17:58.150 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9054999999999997e-05 2024-09-12T16:17:58.150 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.150 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.150 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:58.150 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440535+0000", 2024-09-12T16:17:58.150 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.98e-05 2024-09-12T16:17:58.150 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.150 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.150 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:58.150 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444269+0000", 2024-09-12T16:17:58.150 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003734448 2024-09-12T16:17:58.151 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.151 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.151 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:58.151 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444309+0000", 2024-09-12T16:17:58.151 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0095999999999997e-05 2024-09-12T16:17:58.151 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.151 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:58.151 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.151 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.151 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.151 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2122 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1220, mlcod=88'1217)", 2024-09-12T16:17:58.151 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440484+0000", 2024-09-12T16:17:58.151 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 32.695051475, 2024-09-12T16:17:58.151 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0038538029999999998, 2024-09-12T16:17:58.152 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:58.152 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:58.152 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:58.152 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:58.152 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.152 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:58.152 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440484+0000", 2024-09-12T16:17:58.152 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.152 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.152 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.152 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:58.152 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440484+0000", 2024-09-12T16:17:58.152 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.153 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.153 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.153 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:58.153 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440485+0000", 2024-09-12T16:17:58.153 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6100000000000002e-07 2024-09-12T16:17:58.153 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.153 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.153 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:58.153 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440493+0000", 2024-09-12T16:17:58.153 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0169999999999996e-06 2024-09-12T16:17:58.153 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.153 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.153 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:58.154 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440501+0000", 2024-09-12T16:17:58.154 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9319999999999996e-06 2024-09-12T16:17:58.154 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.154 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.154 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.154 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440506+0000", 2024-09-12T16:17:58.154 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3510000000000001e-06 2024-09-12T16:17:58.154 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.154 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.154 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:58.154 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441319+0000", 2024-09-12T16:17:58.154 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00081295300000000005 2024-09-12T16:17:58.154 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.154 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.155 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:58.155 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441336+0000", 2024-09-12T16:17:58.155 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6897000000000001e-05 2024-09-12T16:17:58.155 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.155 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.155 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:58.155 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444311+0000", 2024-09-12T16:17:58.155 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029754510000000001 2024-09-12T16:17:58.155 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.155 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.155 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:58.155 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444338+0000", 2024-09-12T16:17:58.155 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6840999999999999e-05 2024-09-12T16:17:58.156 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.156 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:58.156 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.156 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.156 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.156 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2124 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1221, mlcod=88'1217)", 2024-09-12T16:17:58.156 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:17:58.156 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 32.695020903, 2024-09-12T16:17:58.156 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0038507229999999999, 2024-09-12T16:17:58.156 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:58.156 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:58.156 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:58.157 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:58.157 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.157 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:58.157 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:17:58.157 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.157 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.157 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.157 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:58.157 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:17:58.157 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.157 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.157 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.157 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:58.158 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:17:58.158 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8799999999999998e-07 2024-09-12T16:17:58.158 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.158 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.158 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:58.158 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440519+0000", 2024-09-12T16:17:58.158 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5499999999999999e-06 2024-09-12T16:17:58.158 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.158 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.158 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:58.158 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440525+0000", 2024-09-12T16:17:58.158 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1009999999999997e-06 2024-09-12T16:17:58.158 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.158 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.158 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.159 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440529+0000", 2024-09-12T16:17:58.159 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3749999999999996e-06 2024-09-12T16:17:58.159 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.159 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.159 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:58.159 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441883+0000", 2024-09-12T16:17:58.159 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0013538249999999999 2024-09-12T16:17:58.159 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.159 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.159 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:58.159 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441901+0000", 2024-09-12T16:17:58.159 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7972999999999999e-05 2024-09-12T16:17:58.159 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.159 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.160 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:58.160 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444341+0000", 2024-09-12T16:17:58.160 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002439568 2024-09-12T16:17:58.160 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.160 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.160 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:58.160 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444366+0000", 2024-09-12T16:17:58.160 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5043000000000001e-05 2024-09-12T16:17:58.160 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.160 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:58.160 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.160 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.160 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.160 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2327 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1222, mlcod=88'1217)", 2024-09-12T16:17:58.161 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440696+0000", 2024-09-12T16:17:58.161 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 32.694839561000002, 2024-09-12T16:17:58.161 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0036945739999999999, 2024-09-12T16:17:58.161 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:58.161 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:58.161 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:58.161 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:58.161 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.161 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:58.161 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440696+0000", 2024-09-12T16:17:58.161 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.161 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.161 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.162 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:58.162 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440696+0000", 2024-09-12T16:17:58.162 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.162 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.162 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.162 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:58.162 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440697+0000", 2024-09-12T16:17:58.162 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5899999999999996e-07 2024-09-12T16:17:58.162 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.162 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.162 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:58.162 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440702+0000", 2024-09-12T16:17:58.162 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0969999999999996e-06 2024-09-12T16:17:58.162 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.163 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.163 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:58.163 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440713+0000", 2024-09-12T16:17:58.163 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1114000000000001e-05 2024-09-12T16:17:58.163 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.163 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.163 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.163 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440719+0000", 2024-09-12T16:17:58.163 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1650000000000003e-06 2024-09-12T16:17:58.163 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.163 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.163 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:58.163 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.442435+0000", 2024-09-12T16:17:58.163 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017155440000000001 2024-09-12T16:17:58.164 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.164 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.164 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:58.164 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.442457+0000", 2024-09-12T16:17:58.164 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1793999999999998e-05 2024-09-12T16:17:58.164 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.164 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.164 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:58.164 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444367+0000", 2024-09-12T16:17:58.164 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0019101980000000001 2024-09-12T16:17:58.164 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.164 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.165 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:58.165 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444391+0000", 2024-09-12T16:17:58.165 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4003e-05 2024-09-12T16:17:58.165 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.165 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:58.165 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.165 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.165 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.165 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2487 3.1d e88/74 3:b8c395a6:::rbd_data.11558d85ce23.000000000000000b:head v 88'1225, mlcod=88'1223)", 2024-09-12T16:17:58.165 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:17:58.165 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 32.689325191999998, 2024-09-12T16:17:58.165 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033166039999999999, 2024-09-12T16:17:58.165 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:58.166 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:58.166 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:58.166 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:58.166 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.166 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:58.166 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:17:58.166 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.166 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.166 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.166 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:58.166 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:17:58.166 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.166 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.166 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.167 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:58.167 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:17:58.167 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9299999999999997e-07 2024-09-12T16:17:58.167 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.167 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.167 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:58.167 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446295+0000", 2024-09-12T16:17:58.167 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3153999999999997e-05 2024-09-12T16:17:58.167 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.167 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.167 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:58.167 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446309+0000", 2024-09-12T16:17:58.167 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4015e-05 2024-09-12T16:17:58.167 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.167 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.168 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.168 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446317+0000", 2024-09-12T16:17:58.168 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4880000000000007e-06 2024-09-12T16:17:58.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.168 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.168 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:58.168 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446373+0000", 2024-09-12T16:17:58.168 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5766000000000001e-05 2024-09-12T16:17:58.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.168 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.168 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:58.168 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446395+0000", 2024-09-12T16:17:58.168 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2500000000000001e-05 2024-09-12T16:17:58.169 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.169 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.169 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:58.169 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.449445+0000", 2024-09-12T16:17:58.169 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003049791 2024-09-12T16:17:58.169 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.169 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.169 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:58.169 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.449527+0000", 2024-09-12T16:17:58.169 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2096999999999997e-05 2024-09-12T16:17:58.169 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.169 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:58.170 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.170 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.170 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.170 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2493 3.2 e88/74 3:46cb4ff0:::rbd_data.11558d85ce23.000000000000000e:head v 88'372, mlcod=87'370)", 2024-09-12T16:17:58.170 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.447443+0000", 2024-09-12T16:17:58.170 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 32.688093254000002, 2024-09-12T16:17:58.170 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029120330000000001, 2024-09-12T16:17:58.170 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:58.170 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:58.170 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:58.170 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:58.170 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.170 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:58.170 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447443+0000", 2024-09-12T16:17:58.171 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.171 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.171 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.171 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:58.171 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447443+0000", 2024-09-12T16:17:58.171 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.171 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.171 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.171 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:58.171 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447443+0000", 2024-09-12T16:17:58.171 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4600000000000001e-07 2024-09-12T16:17:58.171 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.171 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.172 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:58.172 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447779+0000", 2024-09-12T16:17:58.172 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00033639800000000001 2024-09-12T16:17:58.172 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.172 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.172 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:58.172 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447790+0000", 2024-09-12T16:17:58.172 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0555e-05 2024-09-12T16:17:58.172 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.172 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.172 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.172 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447797+0000", 2024-09-12T16:17:58.172 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1729999999999998e-06 2024-09-12T16:17:58.172 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.173 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.173 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:58.173 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447862+0000", 2024-09-12T16:17:58.173 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4670000000000003e-05 2024-09-12T16:17:58.173 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.173 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.173 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:58.173 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447889+0000", 2024-09-12T16:17:58.173 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.773e-05 2024-09-12T16:17:58.173 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.173 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.173 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:58.173 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.450311+0000", 2024-09-12T16:17:58.174 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0024212510000000001 2024-09-12T16:17:58.174 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.174 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.174 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:58.174 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.450355+0000", 2024-09-12T16:17:58.174 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.401e-05 2024-09-12T16:17:58.174 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.174 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:58.174 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.174 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.174 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.174 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "pg_update_log_missing(3.5 epoch 92/74 rep_tid 1618 entries 92'520 (0'0) error 3:a46c381c:::rbd_data.1155c757bf36.000000000000002f:head by client.5577.0:14350 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 92'518)", 2024-09-12T16:17:58.174 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.408248+0000", 2024-09-12T16:17:58.175 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 27.727287373999999, 2024-09-12T16:17:58.175 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029209660000000001, 2024-09-12T16:17:58.175 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:58.175 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:58.175 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "reached pg", 2024-09-12T16:17:58.175 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:58.175 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.175 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:58.175 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408248+0000", 2024-09-12T16:17:58.175 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.175 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.175 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.175 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:58.176 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408248+0000", 2024-09-12T16:17:58.176 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.176 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.176 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.176 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:58.176 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408249+0000", 2024-09-12T16:17:58.176 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9800000000000002e-07 2024-09-12T16:17:58.176 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.176 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.176 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:58.176 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408259+0000", 2024-09-12T16:17:58.176 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1949999999999992e-06 2024-09-12T16:17:58.176 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.176 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.177 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:58.177 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408278+0000", 2024-09-12T16:17:58.177 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9157e-05 2024-09-12T16:17:58.177 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.177 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.177 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.177 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408291+0000", 2024-09-12T16:17:58.177 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3655000000000001e-05 2024-09-12T16:17:58.177 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.177 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.177 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:58.177 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408369+0000", 2024-09-12T16:17:58.177 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7804000000000002e-05 2024-09-12T16:17:58.178 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.178 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.178 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:58.178 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411169+0000", 2024-09-12T16:17:58.178 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002800257 2024-09-12T16:17:58.178 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.178 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:58.178 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.178 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.178 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.178 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "pg_update_log_missing(3.1d epoch 92/74 rep_tid 3087 entries 92'1280 (0'0) error 3:bc3c4c0b:::rbd_data.1155c757bf36.000000000000002c:head by client.5577.0:14343 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 90'1278)", 2024-09-12T16:17:58.178 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.408860+0000", 2024-09-12T16:17:58.178 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 27.726675746000002, 2024-09-12T16:17:58.179 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0056480419999999998, 2024-09-12T16:17:58.179 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:58.179 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:58.179 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "reached pg", 2024-09-12T16:17:58.179 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:58.179 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.179 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:58.179 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408860+0000", 2024-09-12T16:17:58.179 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.179 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.179 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.179 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:58.180 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408860+0000", 2024-09-12T16:17:58.180 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.180 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.180 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.180 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:58.180 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408861+0000", 2024-09-12T16:17:58.180 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6600000000000002e-07 2024-09-12T16:17:58.180 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.180 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.180 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:58.180 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408867+0000", 2024-09-12T16:17:58.180 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4150000000000004e-06 2024-09-12T16:17:58.181 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.181 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.181 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:58.181 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408881+0000", 2024-09-12T16:17:58.181 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4326e-05 2024-09-12T16:17:58.181 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.181 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.181 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.181 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408895+0000", 2024-09-12T16:17:58.181 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3903000000000001e-05 2024-09-12T16:17:58.181 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.181 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.181 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:58.181 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410566+0000", 2024-09-12T16:17:58.182 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001670822 2024-09-12T16:17:58.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.182 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.182 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:58.182 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414508+0000", 2024-09-12T16:17:58.182 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039421100000000004 2024-09-12T16:17:58.182 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.182 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:58.182 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.182 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.182 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "pg_update_log_missing(3.5 epoch 92/74 rep_tid 1621 entries 92'521 (0'0) error 3:a759f741:::rbd_data.1155c757bf36.0000000000000036:head by client.5577.0:14364 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 92'518)", 2024-09-12T16:17:58.182 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:17:58.183 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 27.725727269, 2024-09-12T16:17:58.183 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047586740000000001, 2024-09-12T16:17:58.183 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:58.183 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:58.183 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "reached pg", 2024-09-12T16:17:58.183 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:58.183 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.183 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:58.183 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:17:58.183 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.183 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.183 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.184 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:58.184 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:17:58.184 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.184 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.184 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.184 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:58.184 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:17:58.184 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.54e-07 2024-09-12T16:17:58.185 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.185 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.185 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:58.185 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409817+0000", 2024-09-12T16:17:58.185 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.028e-06 2024-09-12T16:17:58.185 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.185 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.185 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:58.185 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410047+0000", 2024-09-12T16:17:58.185 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022964599999999999 2024-09-12T16:17:58.185 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.185 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.185 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.185 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410067+0000", 2024-09-12T16:17:58.186 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0438999999999999e-05 2024-09-12T16:17:58.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.186 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.186 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:58.186 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411223+0000", 2024-09-12T16:17:58.186 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011560229999999999 2024-09-12T16:17:58.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.186 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.186 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:58.186 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414567+0000", 2024-09-12T16:17:58.186 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033437839999999998 2024-09-12T16:17:58.186 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.186 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:58.186 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.187 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.187 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.187 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14391 3.5 e92/74 3:a5105766:::rbd_data.1155c757bf36.0000000000000044:head v 92'523, mlcod=92'518)", 2024-09-12T16:17:58.187 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.410084+0000", 2024-09-12T16:17:58.187 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 27.725451399000001, 2024-09-12T16:17:58.187 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0046720299999999998, 2024-09-12T16:17:58.187 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:58.187 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:58.187 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:58.187 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:58.187 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.187 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:58.187 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410084+0000", 2024-09-12T16:17:58.187 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.188 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.188 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.188 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:58.188 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410084+0000", 2024-09-12T16:17:58.188 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.188 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.188 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.188 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:58.188 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410085+0000", 2024-09-12T16:17:58.188 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1900000000000002e-07 2024-09-12T16:17:58.188 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.188 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.189 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:58.189 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410091+0000", 2024-09-12T16:17:58.189 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1e-06 2024-09-12T16:17:58.189 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.189 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.189 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:58.189 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410100+0000", 2024-09-12T16:17:58.189 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6889999999999993e-06 2024-09-12T16:17:58.189 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.189 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.189 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.189 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410105+0000", 2024-09-12T16:17:58.189 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3199999999999999e-06 2024-09-12T16:17:58.189 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.190 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.190 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:58.190 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411563+0000", 2024-09-12T16:17:58.190 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00145795 2024-09-12T16:17:58.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.190 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.190 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:58.190 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411590+0000", 2024-09-12T16:17:58.190 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6570000000000001e-05 2024-09-12T16:17:58.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.190 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.190 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:58.190 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414571+0000", 2024-09-12T16:17:58.190 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029815710000000001 2024-09-12T16:17:58.191 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.191 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.191 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:58.191 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414756+0000", 2024-09-12T16:17:58.191 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018521100000000001 2024-09-12T16:17:58.191 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.191 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:58.191 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.191 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.191 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.191 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14405 3.5 e92/74 3:a0797093:::rbd_data.1155c757bf36.000000000000004b:head v 92'525, mlcod=92'518)", 2024-09-12T16:17:58.191 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.410119+0000", 2024-09-12T16:17:58.191 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 27.725416459000002, 2024-09-12T16:17:58.191 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047304000000000001, 2024-09-12T16:17:58.191 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:58.192 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:58.192 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:58.192 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:58.192 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.192 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:58.192 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410119+0000", 2024-09-12T16:17:58.192 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.192 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.192 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.192 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:58.192 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410119+0000", 2024-09-12T16:17:58.192 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.192 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.192 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.193 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:58.193 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410120+0000", 2024-09-12T16:17:58.193 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:17:58.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.193 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.193 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:58.193 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410126+0000", 2024-09-12T16:17:58.193 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1460000000000001e-06 2024-09-12T16:17:58.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.193 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.193 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:58.193 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410134+0000", 2024-09-12T16:17:58.193 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8879999999999997e-06 2024-09-12T16:17:58.194 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.194 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.194 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.194 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410140+0000", 2024-09-12T16:17:58.194 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0839999999999997e-06 2024-09-12T16:17:58.194 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.194 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.194 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:58.194 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412146+0000", 2024-09-12T16:17:58.194 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0020057569999999999 2024-09-12T16:17:58.194 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.194 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.194 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:58.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412163+0000", 2024-09-12T16:17:58.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7742000000000001e-05 2024-09-12T16:17:58.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:58.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414761+0000", 2024-09-12T16:17:58.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025979660000000002 2024-09-12T16:17:58.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:58.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414850+0000", 2024-09-12T16:17:58.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8426999999999999e-05 2024-09-12T16:17:58.195 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.196 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:58.196 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.196 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14435 3.1d e92/74 3:b810b250:::rbd_data.1155c757bf36.000000000000010b:head v 92'1282, mlcod=90'1278)", 2024-09-12T16:17:58.196 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:17:58.196 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 27.72457399, 2024-09-12T16:17:58.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039190579999999996, 2024-09-12T16:17:58.196 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:58.196 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:58.196 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:58.196 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:58.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.196 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:58.197 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:17:58.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.197 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.197 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:58.197 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:17:58.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.197 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.197 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:58.197 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:17:58.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5199999999999996e-07 2024-09-12T16:17:58.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.197 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.197 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:58.198 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410968+0000", 2024-09-12T16:17:58.198 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.305e-06 2024-09-12T16:17:58.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.198 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.198 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:58.198 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410986+0000", 2024-09-12T16:17:58.198 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8213999999999999e-05 2024-09-12T16:17:58.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.198 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.198 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.198 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410993+0000", 2024-09-12T16:17:58.198 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2849999999999997e-06 2024-09-12T16:17:58.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:58.199 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412228+0000", 2024-09-12T16:17:58.199 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0012347370000000001 2024-09-12T16:17:58.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:58.199 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412262+0000", 2024-09-12T16:17:58.199 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3531999999999997e-05 2024-09-12T16:17:58.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:58.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414854+0000", 2024-09-12T16:17:58.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002592039 2024-09-12T16:17:58.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:58.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414881+0000", 2024-09-12T16:17:58.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7294e-05 2024-09-12T16:17:58.200 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.200 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:58.200 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.201 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14434 3.5 e92/74 3:a09dd60f:::rbd_data.1155c757bf36.000000000000010a:head v 92'527, mlcod=92'518)", 2024-09-12T16:17:58.201 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.411186+0000", 2024-09-12T16:17:58.201 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 27.724349842999999, 2024-09-12T16:17:58.201 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0037696930000000002, 2024-09-12T16:17:58.201 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:58.201 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:58.201 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:58.201 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:58.201 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.201 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:58.201 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411186+0000", 2024-09-12T16:17:58.201 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.202 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.202 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.202 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:58.202 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411186+0000", 2024-09-12T16:17:58.202 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.202 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.202 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.202 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:58.202 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411187+0000", 2024-09-12T16:17:58.202 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3799999999999997e-07 2024-09-12T16:17:58.202 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.202 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.202 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:58.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411203+0000", 2024-09-12T16:17:58.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6793999999999999e-05 2024-09-12T16:17:58.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:58.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411323+0000", 2024-09-12T16:17:58.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011975499999999999 2024-09-12T16:17:58.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411332+0000", 2024-09-12T16:17:58.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4370000000000007e-06 2024-09-12T16:17:58.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.204 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:58.204 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.413073+0000", 2024-09-12T16:17:58.204 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001741827 2024-09-12T16:17:58.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.204 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.204 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:58.204 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.413091+0000", 2024-09-12T16:17:58.204 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8011000000000001e-05 2024-09-12T16:17:58.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.204 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.204 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:58.204 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414882+0000", 2024-09-12T16:17:58.204 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001790841 2024-09-12T16:17:58.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.205 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:58.205 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414956+0000", 2024-09-12T16:17:58.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.339e-05 2024-09-12T16:17:58.205 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.205 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:58.205 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.205 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14426 3.13 e92/74 3:c827d1d7:::rbd_data.1155c757bf36.0000000000000056:head v 92'741, mlcod=90'737)", 2024-09-12T16:17:58.205 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:17:58.205 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 27.720257929999999, 2024-09-12T16:17:58.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030296030000000001, 2024-09-12T16:17:58.205 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:58.206 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:58.206 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:58.206 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:58.206 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.206 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:58.206 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:17:58.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.206 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.206 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:58.207 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:17:58.207 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.207 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:58.207 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:17:58.207 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6300000000000001e-07 2024-09-12T16:17:58.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.207 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:58.207 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415282+0000", 2024-09-12T16:17:58.207 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6289999999999999e-06 2024-09-12T16:17:58.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.207 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:58.208 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415288+0000", 2024-09-12T16:17:58.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5520000000000001e-06 2024-09-12T16:17:58.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.208 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.208 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.208 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415293+0000", 2024-09-12T16:17:58.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6879999999999998e-06 2024-09-12T16:17:58.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.208 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.208 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:58.208 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415412+0000", 2024-09-12T16:17:58.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118579 2024-09-12T16:17:58.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:58.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415429+0000", 2024-09-12T16:17:58.209 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7501000000000001e-05 2024-09-12T16:17:58.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:58.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.418270+0000", 2024-09-12T16:17:58.209 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028404860000000001 2024-09-12T16:17:58.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:58.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.418307+0000", 2024-09-12T16:17:58.209 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7805000000000001e-05 2024-09-12T16:17:58.210 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.210 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:58.210 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.210 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.210 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14399 3.16 e92/75 3:6e4c3dfc:::rbd_data.1155c757bf36.0000000000000048:head v 92'1286, mlcod=90'1280)", 2024-09-12T16:17:58.210 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.415311+0000", 2024-09-12T16:17:58.210 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 27.720225016000001, 2024-09-12T16:17:58.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028826809999999998, 2024-09-12T16:17:58.210 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:58.210 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:58.210 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:58.210 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:58.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.211 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:58.211 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415311+0000", 2024-09-12T16:17:58.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.211 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:58.211 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415311+0000", 2024-09-12T16:17:58.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.211 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:58.211 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415311+0000", 2024-09-12T16:17:58.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0600000000000001e-07 2024-09-12T16:17:58.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:58.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415315+0000", 2024-09-12T16:17:58.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.172e-06 2024-09-12T16:17:58.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:58.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415322+0000", 2024-09-12T16:17:58.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0999999999999998e-06 2024-09-12T16:17:58.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415327+0000", 2024-09-12T16:17:58.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6430000000000003e-06 2024-09-12T16:17:58.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.213 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:58.213 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.416666+0000", 2024-09-12T16:17:58.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001338718 2024-09-12T16:17:58.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.213 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:58.213 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.416683+0000", 2024-09-12T16:17:58.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7628000000000001e-05 2024-09-12T16:17:58.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.214 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.214 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:58.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.418128+0000", 2024-09-12T16:17:58.214 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0014445440000000001 2024-09-12T16:17:58.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.214 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.214 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:58.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.418193+0000", 2024-09-12T16:17:58.214 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5569999999999997e-05 2024-09-12T16:17:58.214 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.214 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:58.214 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.215 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5384.0:1241 3.16 e95/75 3:6ee670ce:::rbd_data.1155b9894cdc.0000000000000005:head v 95'1303, mlcod=95'1301)", 2024-09-12T16:17:58.215 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:35.272164+0000", 2024-09-12T16:17:58.215 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 22.863372074000001, 2024-09-12T16:17:58.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015008743, 2024-09-12T16:17:58.215 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:58.215 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:58.215 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:58.215 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:58.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.215 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:58.215 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.272164+0000", 2024-09-12T16:17:58.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.216 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:58.216 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.272164+0000", 2024-09-12T16:17:58.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.216 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:58.216 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.272165+0000", 2024-09-12T16:17:58.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.311e-06 2024-09-12T16:17:58.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.216 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:58.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275503+0000", 2024-09-12T16:17:58.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003337881 2024-09-12T16:17:58.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:58.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275530+0000", 2024-09-12T16:17:58.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6797000000000001e-05 2024-09-12T16:17:58.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275541+0000", 2024-09-12T16:17:58.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1634000000000001e-05 2024-09-12T16:17:58.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:58.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275618+0000", 2024-09-12T16:17:58.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6811999999999996e-05 2024-09-12T16:17:58.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:58.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275642+0000", 2024-09-12T16:17:58.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4111999999999999e-05 2024-09-12T16:17:58.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:58.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287116+0000", 2024-09-12T16:17:58.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01147395 2024-09-12T16:17:58.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:58.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287172+0000", 2024-09-12T16:17:58.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6246000000000003e-05 2024-09-12T16:17:58.219 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.219 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:58.219 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.219 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5384.0:1246 3.f e95/74 3:f0725c44:::rbd_data.1155b9894cdc.0000000000000006:head v 95'356, mlcod=95'354)", 2024-09-12T16:17:58.219 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:35.276304+0000", 2024-09-12T16:17:58.219 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 22.859232147, 2024-09-12T16:17:58.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011209733, 2024-09-12T16:17:58.219 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:58.220 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:58.220 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:58.220 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:58.220 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.220 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:58.220 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.276304+0000", 2024-09-12T16:17:58.220 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.220 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.220 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:58.220 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.276304+0000", 2024-09-12T16:17:58.220 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.220 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.221 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:58.221 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.276305+0000", 2024-09-12T16:17:58.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2500000000000001e-06 2024-09-12T16:17:58.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.221 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.221 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:58.221 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279256+0000", 2024-09-12T16:17:58.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002951076 2024-09-12T16:17:58.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.221 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.221 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:58.221 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279281+0000", 2024-09-12T16:17:58.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4779000000000001e-05 2024-09-12T16:17:58.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.222 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279294+0000", 2024-09-12T16:17:58.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3614e-05 2024-09-12T16:17:58.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:58.222 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279366+0000", 2024-09-12T16:17:58.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2094000000000005e-05 2024-09-12T16:17:58.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:58.222 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279395+0000", 2024-09-12T16:17:58.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8337999999999999e-05 2024-09-12T16:17:58.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:58.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287479+0000", 2024-09-12T16:17:58.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0080844799999999998 2024-09-12T16:17:58.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:58.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287513+0000", 2024-09-12T16:17:58.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4102e-05 2024-09-12T16:17:58.223 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.223 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:58.223 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.224 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5578.0:2433 3.16 e98/75 3:691860ab:::rbd_data.11557f9bd67f.0000000000000014:head v 98'1330, mlcod=97'1328)", 2024-09-12T16:17:58.224 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:38.524867+0000", 2024-09-12T16:17:58.224 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 19.610668522000001, 2024-09-12T16:17:58.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028147279999999998, 2024-09-12T16:17:58.224 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:17:58.224 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:17:58.224 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:58.224 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:17:58.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:17:58.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.524867+0000", 2024-09-12T16:17:58.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:17:58.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.524867+0000", 2024-09-12T16:17:58.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:17:58.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:17:58.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.524868+0000", 2024-09-12T16:17:58.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4600000000000003e-07 2024-09-12T16:17:58.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:17:58.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.525251+0000", 2024-09-12T16:17:58.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00038322299999999997 2024-09-12T16:17:58.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:17:58.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.525266+0000", 2024-09-12T16:17:58.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4934e-05 2024-09-12T16:17:58.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.525274+0000", 2024-09-12T16:17:58.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.328e-06 2024-09-12T16:17:58.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.227 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.227 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:17:58.227 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.525363+0000", 2024-09-12T16:17:58.227 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9149999999999999e-05 2024-09-12T16:17:58.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.227 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.227 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:17:58.227 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.525383+0000", 2024-09-12T16:17:58.227 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0197e-05 2024-09-12T16:17:58.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.227 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.227 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:17:58.227 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.527638+0000", 2024-09-12T16:17:58.227 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0022551210000000001 2024-09-12T16:17:58.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:17:58.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:17:58.228 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:17:58.228 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.527682+0000", 2024-09-12T16:17:58.228 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3928999999999999e-05 2024-09-12T16:17:58.228 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.228 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:58.228 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.228 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:17:58.228 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:17:58.228 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:17:58.230 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:17:58.230 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:58.228+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:58.330 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:58.330+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:58.340 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:58.340 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:58.340 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:17:58.340 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:58.349 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:17:58.431 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:58.431+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:58.455 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #38, image image_client.0-clone38 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent39 2024-09-12T16:17:58.459 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:58.459 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:17:58.459 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:17:58.459 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:17:58.459 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:58.469 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:17:58.531 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:58.531+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:58.544 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T16:17:58.619 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:17:58.619 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:17:58.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:17:58.619 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:17:58.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.619 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3705 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14812160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:58.619 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:17:58.619 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 100.476988596, 2024-09-12T16:17:58.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053368831999999998, 2024-09-12T16:17:58.619 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:58.619 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:58.619 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:58.620 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:58.620 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:58.620 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:58.620 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3705 2024-09-12T16:17:58.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.620 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:58.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:58.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:17:58.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:58.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:17:58.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:58.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139932+0000", 2024-09-12T16:17:58.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012762099999999999 2024-09-12T16:17:58.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:58.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139935+0000", 2024-09-12T16:17:58.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.119e-06 2024-09-12T16:17:58.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139939+0000", 2024-09-12T16:17:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7999999999999998e-06 2024-09-12T16:17:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139953+0000", 2024-09-12T16:17:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3923999999999999e-05 2024-09-12T16:17:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192946+0000", 2024-09-12T16:17:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052992971 2024-09-12T16:17:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193035+0000", 2024-09-12T16:17:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9040000000000001e-05 2024-09-12T16:17:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193174+0000", 2024-09-12T16:17:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138357 2024-09-12T16:17:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3706 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14816256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:17:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 100.476833606, 2024-09-12T16:17:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053341723000000001, 2024-09-12T16:17:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3706 2024-09-12T16:17:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:17:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:17:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140090+0000", 2024-09-12T16:17:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013020100000000001 2024-09-12T16:17:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140097+0000", 2024-09-12T16:17:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0709999999999997e-06 2024-09-12T16:17:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140103+0000", 2024-09-12T16:17:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5450000000000003e-06 2024-09-12T16:17:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140106+0000", 2024-09-12T16:17:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3739999999999998e-06 2024-09-12T16:17:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193190+0000", 2024-09-12T16:17:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053084131999999999 2024-09-12T16:17:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193232+0000", 2024-09-12T16:17:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1517000000000002e-05 2024-09-12T16:17:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193302+0000", 2024-09-12T16:17:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9882999999999995e-05 2024-09-12T16:17:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3707 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14820352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:17:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 100.476681617, 2024-09-12T16:17:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053452771000000003, 2024-09-12T16:17:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3707 2024-09-12T16:17:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:17:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:17:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140219+0000", 2024-09-12T16:17:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106902 2024-09-12T16:17:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140225+0000", 2024-09-12T16:17:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3199999999999996e-06 2024-09-12T16:17:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140230+0000", 2024-09-12T16:17:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8969999999999999e-06 2024-09-12T16:17:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140233+0000", 2024-09-12T16:17:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2119999999999999e-06 2024-09-12T16:17:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193339+0000", 2024-09-12T16:17:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053105556999999998 2024-09-12T16:17:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193431+0000", 2024-09-12T16:17:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1837999999999997e-05 2024-09-12T16:17:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193565+0000", 2024-09-12T16:17:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013404500000000001 2024-09-12T16:17:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3708 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14824448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:17:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 100.476552775, 2024-09-12T16:17:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053468190999999998, 2024-09-12T16:17:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3708 2024-09-12T16:17:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:17:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:17:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140351+0000", 2024-09-12T16:17:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110096 2024-09-12T16:17:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140358+0000", 2024-09-12T16:17:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.306e-06 2024-09-12T16:17:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140368+0000", 2024-09-12T16:17:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0225e-05 2024-09-12T16:17:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140372+0000", 2024-09-12T16:17:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6169999999999998e-06 2024-09-12T16:17:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193594+0000", 2024-09-12T16:17:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053222419999999999 2024-09-12T16:17:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193640+0000", 2024-09-12T16:17:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.587e-05 2024-09-12T16:17:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193709+0000", 2024-09-12T16:17:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8657000000000004e-05 2024-09-12T16:17:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3709 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14828544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:17:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 100.476415807, 2024-09-12T16:17:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594033999999999, 2024-09-12T16:17:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3709 2024-09-12T16:17:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:17:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:17:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140499+0000", 2024-09-12T16:17:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121019 2024-09-12T16:17:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140501+0000", 2024-09-12T16:17:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2369999999999999e-06 2024-09-12T16:17:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140506+0000", 2024-09-12T16:17:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.639e-06 2024-09-12T16:17:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140509+0000", 2024-09-12T16:17:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3419999999999999e-06 2024-09-12T16:17:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193743+0000", 2024-09-12T16:17:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053234311999999999 2024-09-12T16:17:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193833+0000", 2024-09-12T16:17:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9883999999999995e-05 2024-09-12T16:17:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193972+0000", 2024-09-12T16:17:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138601 2024-09-12T16:17:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3710 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14832640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:17:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 100.47627846100001, 2024-09-12T16:17:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053607324999999997, 2024-09-12T16:17:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:58.643 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:58.643 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3710 2024-09-12T16:17:58.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.643 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:58.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:58.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:17:58.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:58.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:17:58.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:58.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140664+0000", 2024-09-12T16:17:58.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014918700000000001 2024-09-12T16:17:58.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:58.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140674+0000", 2024-09-12T16:17:58.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8379999999999997e-06 2024-09-12T16:17:58.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:58.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140694+0000", 2024-09-12T16:17:58.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0145000000000001e-05 2024-09-12T16:17:58.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140703+0000", 2024-09-12T16:17:58.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5150000000000006e-06 2024-09-12T16:17:58.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:58.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194006+0000", 2024-09-12T16:17:58.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053303370000000003 2024-09-12T16:17:58.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:58.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194051+0000", 2024-09-12T16:17:58.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5012000000000002e-05 2024-09-12T16:17:58.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:58.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194122+0000", 2024-09-12T16:17:58.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1258000000000001e-05 2024-09-12T16:17:58.646 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.646 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:58.646 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.646 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3711 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14836736~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:58.646 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:17:58.647 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 100.47607701299999, 2024-09-12T16:17:58.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053670799999999998, 2024-09-12T16:17:58.647 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:58.647 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:58.647 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:58.647 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:58.647 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:58.647 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:58.647 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3711 2024-09-12T16:17:58.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.647 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:58.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:58.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:17:58.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:58.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:17:58.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:58.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140782+0000", 2024-09-12T16:17:58.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5549999999999994e-05 2024-09-12T16:17:58.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:58.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140786+0000", 2024-09-12T16:17:58.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.89e-06 2024-09-12T16:17:58.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:58.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140796+0000", 2024-09-12T16:17:58.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0057e-05 2024-09-12T16:17:58.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140819+0000", 2024-09-12T16:17:58.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3005000000000001e-05 2024-09-12T16:17:58.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:58.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194159+0000", 2024-09-12T16:17:58.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053340324000000001 2024-09-12T16:17:58.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:58.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194248+0000", 2024-09-12T16:17:58.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9209000000000006e-05 2024-09-12T16:17:58.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:58.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194387+0000", 2024-09-12T16:17:58.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138765 2024-09-12T16:17:58.651 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.651 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:58.651 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.651 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3712 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14840832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:58.651 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:17:58.651 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 100.475962555, 2024-09-12T16:17:58.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053699068000000003, 2024-09-12T16:17:58.651 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:58.651 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:58.652 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:58.652 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:58.652 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:58.652 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:58.652 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3712 2024-09-12T16:17:58.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.652 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:58.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:58.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:17:58.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:58.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:17:58.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:58.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140900+0000", 2024-09-12T16:17:58.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9014e-05 2024-09-12T16:17:58.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:58.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140904+0000", 2024-09-12T16:17:58.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0940000000000001e-06 2024-09-12T16:17:58.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:58.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140933+0000", 2024-09-12T16:17:58.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8996000000000002e-05 2024-09-12T16:17:58.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140945+0000", 2024-09-12T16:17:58.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1909000000000001e-05 2024-09-12T16:17:58.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:58.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194415+0000", 2024-09-12T16:17:58.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053470403 2024-09-12T16:17:58.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:58.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194460+0000", 2024-09-12T16:17:58.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5145000000000002e-05 2024-09-12T16:17:58.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:58.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194530+0000", 2024-09-12T16:17:58.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9506999999999997e-05 2024-09-12T16:17:58.655 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.655 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:58.655 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.656 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3713 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14844928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:58.656 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:17:58.656 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 100.475829495, 2024-09-12T16:17:58.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053821236000000001, 2024-09-12T16:17:58.656 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:58.656 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:58.656 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:58.656 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:58.656 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:58.656 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:58.656 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3713 2024-09-12T16:17:58.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.657 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:58.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:58.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:17:58.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:58.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:17:58.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:58.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141078+0000", 2024-09-12T16:17:58.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114162 2024-09-12T16:17:58.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:58.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141090+0000", 2024-09-12T16:17:58.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.19e-05 2024-09-12T16:17:58.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:58.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141100+0000", 2024-09-12T16:17:58.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0447e-05 2024-09-12T16:17:58.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141108+0000", 2024-09-12T16:17:58.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7190000000000001e-06 2024-09-12T16:17:58.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:58.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194564+0000", 2024-09-12T16:17:58.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053455729 2024-09-12T16:17:58.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:58.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194652+0000", 2024-09-12T16:17:58.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8288999999999994e-05 2024-09-12T16:17:58.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:58.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194785+0000", 2024-09-12T16:17:58.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013299000000000001 2024-09-12T16:17:58.660 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.660 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:58.660 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.660 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3714 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14849024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:58.660 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:17:58.660 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 100.475673566, 2024-09-12T16:17:58.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053816382000000003, 2024-09-12T16:17:58.660 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:58.660 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:58.661 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:58.661 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:58.661 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:58.661 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:58.661 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3714 2024-09-12T16:17:58.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.661 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:58.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:58.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:17:58.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:58.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:17:58.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:58.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141182+0000", 2024-09-12T16:17:58.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1805999999999997e-05 2024-09-12T16:17:58.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:58.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141185+0000", 2024-09-12T16:17:58.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5930000000000002e-06 2024-09-12T16:17:58.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:58.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141194+0000", 2024-09-12T16:17:58.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5760000000000006e-06 2024-09-12T16:17:58.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141222+0000", 2024-09-12T16:17:58.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8034999999999998e-05 2024-09-12T16:17:58.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:58.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194817+0000", 2024-09-12T16:17:58.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594887000000001 2024-09-12T16:17:58.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:58.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194860+0000", 2024-09-12T16:17:58.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3714999999999997e-05 2024-09-12T16:17:58.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:58.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194936+0000", 2024-09-12T16:17:58.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5770000000000001e-05 2024-09-12T16:17:58.664 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.664 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:58.664 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.665 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3715 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14853120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:58.665 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:17:58.665 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 100.47554990899999, 2024-09-12T16:17:58.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053962307000000001, 2024-09-12T16:17:58.665 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:58.665 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:58.665 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:58.665 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:58.665 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:58.665 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:58.665 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3715 2024-09-12T16:17:58.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.666 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:58.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:58.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:17:58.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:58.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:17:58.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:58.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141417+0000", 2024-09-12T16:17:58.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017384099999999999 2024-09-12T16:17:58.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:58.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141422+0000", 2024-09-12T16:17:58.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7310000000000001e-06 2024-09-12T16:17:58.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:58.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141434+0000", 2024-09-12T16:17:58.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2058e-05 2024-09-12T16:17:58.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141442+0000", 2024-09-12T16:17:58.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7610000000000007e-06 2024-09-12T16:17:58.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:58.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194973+0000", 2024-09-12T16:17:58.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053530618000000002 2024-09-12T16:17:58.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:58.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195063+0000", 2024-09-12T16:17:58.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0927000000000005e-05 2024-09-12T16:17:58.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:58.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195206+0000", 2024-09-12T16:17:58.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142371 2024-09-12T16:17:58.669 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.669 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:58.669 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.669 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3716 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14857216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:58.669 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:17:58.670 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 100.475340059, 2024-09-12T16:17:58.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053916360000000003, 2024-09-12T16:17:58.670 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:58.670 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:58.670 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:58.670 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:58.670 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:58.670 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:58.670 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3716 2024-09-12T16:17:58.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.670 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:58.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:58.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:17:58.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:58.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:17:58.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:58.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142933+0000", 2024-09-12T16:17:58.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014796290000000001 2024-09-12T16:17:58.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:58.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142937+0000", 2024-09-12T16:17:58.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5760000000000002e-06 2024-09-12T16:17:58.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:58.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142946+0000", 2024-09-12T16:17:58.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0380000000000005e-06 2024-09-12T16:17:58.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142951+0000", 2024-09-12T16:17:58.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9749999999999998e-06 2024-09-12T16:17:58.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:58.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195246+0000", 2024-09-12T16:17:58.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052295358 2024-09-12T16:17:58.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:58.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195299+0000", 2024-09-12T16:17:58.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2976999999999998e-05 2024-09-12T16:17:58.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:58.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195370+0000", 2024-09-12T16:17:58.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0807000000000002e-05 2024-09-12T16:17:58.674 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.674 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:58.674 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.674 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3721 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14877696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:58.674 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:58.674 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 100.47376660800001, 2024-09-12T16:17:58.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053422994000000001, 2024-09-12T16:17:58.674 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:58.674 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:58.674 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:58.675 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:58.675 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:58.675 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:58.675 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3721 2024-09-12T16:17:58.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.675 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:58.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:58.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:58.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:17:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:17:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143028+0000", 2024-09-12T16:17:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7399999999999991e-07 2024-09-12T16:17:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143031+0000", 2024-09-12T16:17:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7599999999999998e-06 2024-09-12T16:17:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143034+0000", 2024-09-12T16:17:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9780000000000001e-06 2024-09-12T16:17:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:58.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196220+0000", 2024-09-12T16:17:58.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053186341999999998 2024-09-12T16:17:58.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:58.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196313+0000", 2024-09-12T16:17:58.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2676000000000005e-05 2024-09-12T16:17:58.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:58.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196450+0000", 2024-09-12T16:17:58.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137052 2024-09-12T16:17:58.678 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3722 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14881792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 100.473756716, 2024-09-12T16:17:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053556835999999997, 2024-09-12T16:17:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:58.680 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:58.680 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3722 2024-09-12T16:17:58.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.680 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:58.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:58.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:58.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:58.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:58.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:58.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:17:58.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.11e-07 2024-09-12T16:17:58.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:58.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143038+0000", 2024-09-12T16:17:58.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2399999999999996e-07 2024-09-12T16:17:58.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143041+0000", 2024-09-12T16:17:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8030000000000001e-06 2024-09-12T16:17:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143043+0000", 2024-09-12T16:17:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3140000000000002e-06 2024-09-12T16:17:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196481+0000", 2024-09-12T16:17:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053437601000000001 2024-09-12T16:17:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:58.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196525+0000", 2024-09-12T16:17:58.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4280000000000003e-05 2024-09-12T16:17:58.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:58.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196594+0000", 2024-09-12T16:17:58.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8702999999999996e-05 2024-09-12T16:17:58.683 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.683 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:58.683 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.684 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3723 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14885888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:58.684 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:17:58.684 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 100.473747534, 2024-09-12T16:17:58.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053815546999999998, 2024-09-12T16:17:58.684 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:58.684 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:58.684 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:58.684 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:58.684 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:58.684 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3723 2024-09-12T16:17:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:17:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:17:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148994+0000", 2024-09-12T16:17:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059481330000000004 2024-09-12T16:17:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148999+0000", 2024-09-12T16:17:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7140000000000001e-06 2024-09-12T16:17:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149008+0000", 2024-09-12T16:17:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4350000000000003e-06 2024-09-12T16:17:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149021+0000", 2024-09-12T16:17:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2514000000000001e-05 2024-09-12T16:17:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196630+0000", 2024-09-12T16:17:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047609758000000002 2024-09-12T16:17:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196724+0000", 2024-09-12T16:17:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3522000000000003e-05 2024-09-12T16:17:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196861+0000", 2024-09-12T16:17:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013747100000000001 2024-09-12T16:17:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4438 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15719424~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 100.328866757, 2024-09-12T16:17:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367981000000002, 2024-09-12T16:17:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4438 2024-09-12T16:17:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:17:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3e-07 2024-09-12T16:17:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287930+0000", 2024-09-12T16:17:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-12T16:17:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287937+0000", 2024-09-12T16:17:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.08e-06 2024-09-12T16:17:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287943+0000", 2024-09-12T16:17:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5709999999999997e-06 2024-09-12T16:17:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:58.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341068+0000", 2024-09-12T16:17:58.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053125101000000001 2024-09-12T16:17:58.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:58.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341154+0000", 2024-09-12T16:17:58.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6100999999999994e-05 2024-09-12T16:17:58.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:58.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341295+0000", 2024-09-12T16:17:58.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014087999999999999 2024-09-12T16:17:58.692 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.692 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:58.693 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.693 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4439 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15723520~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:58.693 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:58.693 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 100.328842597, 2024-09-12T16:17:58.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053526799, 2024-09-12T16:17:58.693 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:58.693 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:58.693 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:58.693 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:58.693 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:58.693 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:58.694 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4439 2024-09-12T16:17:58.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.694 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:58.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:58.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:58.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:58.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:58.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:58.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:17:58.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-07 2024-09-12T16:17:58.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:58.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287953+0000", 2024-09-12T16:17:58.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1349999999999999e-06 2024-09-12T16:17:58.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:58.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287960+0000", 2024-09-12T16:17:58.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-12T16:17:58.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287965+0000", 2024-09-12T16:17:58.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1580000000000004e-06 2024-09-12T16:17:58.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:58.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341332+0000", 2024-09-12T16:17:58.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367009 2024-09-12T16:17:58.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341402+0000", 2024-09-12T16:17:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9759999999999996e-05 2024-09-12T16:17:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341478+0000", 2024-09-12T16:17:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5412000000000002e-05 2024-09-12T16:17:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4440 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15727616~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:17:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 100.32882149300001, 2024-09-12T16:17:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053761601999999999, 2024-09-12T16:17:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:17:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:17:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4440 2024-09-12T16:17:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:58.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:58.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:58.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:58.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:17:58.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:17:58.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:58.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287974+0000", 2024-09-12T16:17:58.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0540000000000002e-06 2024-09-12T16:17:58.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:58.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287980+0000", 2024-09-12T16:17:58.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9440000000000002e-06 2024-09-12T16:17:58.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287987+0000", 2024-09-12T16:17:58.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5889999999999999e-06 2024-09-12T16:17:58.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:58.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341502+0000", 2024-09-12T16:17:58.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053515199999999999 2024-09-12T16:17:58.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:58.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341595+0000", 2024-09-12T16:17:58.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3097000000000007e-05 2024-09-12T16:17:58.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341734+0000", 2024-09-12T16:17:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013832800000000001 2024-09-12T16:17:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2209 3.1 3:85f36d3b:::rbd_data.1155ccb1894c.0000000000000004:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:17:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:17:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 61.245136355, 2024-09-12T16:17:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.060659365, 2024-09-12T16:17:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:17:58.703 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:58.703 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:17:58.703 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:17:58.703 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2209 2024-09-12T16:17:58.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.703 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:58.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:58.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:17:58.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:58.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:17:58.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:58.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371658+0000", 2024-09-12T16:17:58.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1570000000000001e-06 2024-09-12T16:17:58.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:58.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393414+0000", 2024-09-12T16:17:58.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021755495999999999 2024-09-12T16:17:58.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393447+0000", 2024-09-12T16:17:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3630000000000002e-05 2024-09-12T16:17:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393462+0000", 2024-09-12T16:17:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5048999999999999e-05 2024-09-12T16:17:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393556+0000", 2024-09-12T16:17:58.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3549999999999997e-05 2024-09-12T16:17:58.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:58.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393697+0000", 2024-09-12T16:17:58.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000141414 2024-09-12T16:17:58.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T16:17:58.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.394944+0000", 2024-09-12T16:17:58.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012463039999999999 2024-09-12T16:17:58.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:17:58.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.431803+0000", 2024-09-12T16:17:58.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0368594 2024-09-12T16:17:58.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:17:58.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432268+0000", 2024-09-12T16:17:58.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046457600000000002 2024-09-12T16:17:58.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:17:58.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432293+0000", 2024-09-12T16:17:58.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.527e-05 2024-09-12T16:17:58.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:58.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432316+0000", 2024-09-12T16:17:58.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3519e-05 2024-09-12T16:17:58.708 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.708 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:58.708 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.709 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:9400 3.1f 3:feea9999:::rbd_data.1155338d0570.0000000000000007:head [read 32768~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-12T16:17:58.709 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:20.012502+0000", 2024-09-12T16:17:58.709 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.604291363000002, 2024-09-12T16:17:58.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.000678049, 2024-09-12T16:17:58.709 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:17:58.709 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:17:58.709 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:17:58.709 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:17:58.709 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:17:58.709 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:17:58.709 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 9400 2024-09-12T16:17:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:17:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:17:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012502+0000", 2024-09-12T16:17:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:17:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012502+0000", 2024-09-12T16:17:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:17:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:17:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012504+0000", 2024-09-12T16:17:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5939999999999999e-06 2024-09-12T16:17:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:17:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012511+0000", 2024-09-12T16:17:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0840000000000003e-06 2024-09-12T16:17:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:17:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012525+0000", 2024-09-12T16:17:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4538999999999999e-05 2024-09-12T16:17:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:17:58.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012532+0000", 2024-09-12T16:17:58.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8310000000000003e-06 2024-09-12T16:17:58.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:58.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012605+0000", 2024-09-12T16:17:58.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2387999999999999e-05 2024-09-12T16:17:58.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T16:17:58.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012617+0000", 2024-09-12T16:17:58.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2167999999999999e-05 2024-09-12T16:17:58.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:17:58.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:21.012823+0000", 2024-09-12T16:17:58.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0002068230000001 2024-09-12T16:17:58.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:17:58.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:21.012975+0000", 2024-09-12T16:17:58.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015196200000000001 2024-09-12T16:17:58.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:17:58.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:17:58.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:17:58.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:21.013180+0000", 2024-09-12T16:17:58.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020466000000000001 2024-09-12T16:17:58.713 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.714 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:58.714 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.714 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:17:58.714 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:17:58.714 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:17:58.716 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:17:58.716 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:58.715+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:58.727 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:17:58.727 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:17:58.753 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:17:58.753 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:17:58.780 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:17:58.780 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:17:58.807 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:17:58.807 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:17:58.816 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:58.816+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:58.835 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:17:58.836 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:17:58.864 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:17:58.865 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:17:58.877 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:58.877 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:58.891 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:17:58.917 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:58.917+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:59.018 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:17:59.017+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:17:59.038 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2024-09-12T16:17:59.090 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:59.090 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:59.101 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:17:59.118 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:59.118+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:59.219 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:17:59.219+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:17:59.295 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:59.295 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:59.307 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:17:59.320 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:59.320+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:59.421 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:59.421+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:59.434 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:59.434 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:59.442 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:17:59.522 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:17:59.521+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:17:59.549 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:59.549 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:59.557 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:17:59.579 INFO:teuthology.orchestra.run.smithi204.stdout:5842 write 0x3264a00 thru 0x3271b61 (0xd162 bytes) 2024-09-12T16:17:59.580 INFO:teuthology.orchestra.run.smithi204.stdout:5843 write 0x9194600 thru 0x91972c4 (0x2cc5 bytes) 2024-09-12T16:17:59.581 INFO:teuthology.orchestra.run.smithi204.stdout:5846 write 0x2eb1c00 thru 0x2ebdb8e (0xbf8f bytes) 2024-09-12T16:17:59.582 INFO:teuthology.orchestra.run.smithi204.stdout:5847 read 0x770e400 thru 0x7715476 (0x7077 bytes) 2024-09-12T16:17:59.583 INFO:teuthology.orchestra.run.smithi204.stdout:5849 write 0x85d9a00 thru 0x85dca93 (0x3094 bytes) 2024-09-12T16:17:59.585 INFO:teuthology.orchestra.run.smithi204.stdout:5852 read 0xd816800 thru 0xd821b93 (0xb394 bytes) 2024-09-12T16:17:59.585 INFO:teuthology.orchestra.run.smithi204.stdout:5853 write 0x61b5000 thru 0x61c0a6d (0xba6e bytes) 2024-09-12T16:17:59.586 INFO:teuthology.orchestra.run.smithi204.stdout:5854 write 0x351c00 thru 0x3555d4 (0x39d5 bytes) 2024-09-12T16:17:59.615 INFO:teuthology.orchestra.run.smithi204.stdout:5856 write 0xdcbe000 thru 0xdccc5f1 (0xe5f2 bytes) 2024-09-12T16:17:59.615 INFO:teuthology.orchestra.run.smithi204.stdout:5858 write 0x6dafe00 thru 0x6db1821 (0x1a22 bytes) 2024-09-12T16:17:59.616 INFO:teuthology.orchestra.run.smithi204.stdout:5860 read 0x2f28600 thru 0x2f2fd42 (0x7743 bytes) 2024-09-12T16:17:59.617 INFO:teuthology.orchestra.run.smithi204.stdout:5861 read 0x6077400 thru 0x6082ded (0xb9ee bytes) 2024-09-12T16:17:59.618 INFO:teuthology.orchestra.run.smithi204.stdout:5862 read 0xc297800 thru 0xc2a21f5 (0xa9f6 bytes) 2024-09-12T16:17:59.619 INFO:teuthology.orchestra.run.smithi204.stdout:5863 write 0x8d4ce00 thru 0x8d5128b (0x448c bytes) 2024-09-12T16:17:59.619 INFO:teuthology.orchestra.run.smithi204.stdout:5864 write 0x6dda600 thru 0x6ddcb23 (0x2524 bytes) 2024-09-12T16:17:59.620 INFO:teuthology.orchestra.run.smithi204.stdout:5865 write 0x6746c00 thru 0x6747576 (0x977 bytes) 2024-09-12T16:17:59.623 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:17:59.623+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:17:59.635 INFO:teuthology.orchestra.run.smithi204.stdout:5866 trunc from 0xdccc600 to 0x112a600 2024-09-12T16:17:59.665 INFO:teuthology.orchestra.run.smithi204.stdout:5867 read 0xa8200 thru 0xb18fc (0x96fd bytes) 2024-09-12T16:17:59.667 INFO:teuthology.orchestra.run.smithi204.stdout:5869 trunc from 0x112a600 to 0x1b66c00 2024-09-12T16:17:59.687 INFO:teuthology.orchestra.run.smithi204.stdout:5871 write 0x28f6600 thru 0x28fe7b8 (0x81b9 bytes) 2024-09-12T16:17:59.688 INFO:teuthology.orchestra.run.smithi204.stdout:5872 read 0x671600 thru 0x676223 (0x4c24 bytes) 2024-09-12T16:17:59.688 INFO:teuthology.orchestra.run.smithi204.stdout:5873 write 0x658200 thru 0x665f3a (0xdd3b bytes) 2024-09-12T16:17:59.689 INFO:teuthology.orchestra.run.smithi204.stdout:5874 write 0x22e4e00 thru 0x22e9f97 (0x5198 bytes) 2024-09-12T16:17:59.715 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:59.715 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:59.718 INFO:teuthology.orchestra.run.smithi204.stdout:5876 write 0xe789800 thru 0xe7916d6 (0x7ed7 bytes) 2024-09-12T16:17:59.719 INFO:teuthology.orchestra.run.smithi204.stdout:5877 punch from 0xddec200 to 0xddf1c00, (0x5a00 bytes) 2024-09-12T16:17:59.720 INFO:teuthology.orchestra.run.smithi204.stdout:5878 read 0x475400 thru 0x48288f (0xd490 bytes) 2024-09-12T16:17:59.721 INFO:teuthology.orchestra.run.smithi204.stdout:5884 read 0x909cc00 thru 0x90a95b0 (0xc9b1 bytes) 2024-09-12T16:17:59.724 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:59.724+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:59.725 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:17:59.728 INFO:teuthology.orchestra.run.smithi204.stdout:5885 trunc from 0xe791800 to 0x84aae00 2024-09-12T16:17:59.742 INFO:teuthology.orchestra.run.smithi204.stdout:5888 read 0x1965600 thru 0x1970770 (0xb171 bytes) 2024-09-12T16:17:59.825 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:17:59.825+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:17:59.835 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:59.835 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:17:59.844 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:17:59.926 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:17:59.925+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:17:59.991 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:17:59.991 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:00.000 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:18:00.008 INFO:teuthology.orchestra.run.smithi204.stdout:5889 write 0xe786e00 thru 0xe78be2d (0x502e bytes) 2024-09-12T16:18:00.008 INFO:teuthology.orchestra.run.smithi204.stdout:5890 clone 41 order 19 su 4096 sc 13 2024-09-12T16:18:00.026 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:00.026+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:00.107 INFO:teuthology.orchestra.run.smithi204.stdout:truncating image image_client.0-clone40 from 0xe78c000 (overlap 0x112a600) to 0x526400 2024-09-12T16:18:00.117 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:00.117 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:00.127 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:00.126+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:00.129 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:18:00.227 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:00.227+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:00.278 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:00.278 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:00.287 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:18:00.329 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:00.328+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:00.359 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #39, image image_client.0-clone39 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent40 2024-09-12T16:18:00.429 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:00.427+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:00.440 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:00.440 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:00.449 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:18:00.533 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:00.532+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:00.605 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:00.606 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:00.615 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:18:00.657 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:00.656+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:00.732 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:00.731+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:00.773 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:00.774 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:00.783 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:18:00.833 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:00.832+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:00.880 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T16:18:00.930 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:00.930 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:00.933 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:00.932+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:00.938 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:18:00.994 INFO:teuthology.orchestra.run.smithi204.stdout:5892 read 0x59d4200 thru 0x59d91ae (0x4faf bytes) 2024-09-12T16:18:00.994 INFO:teuthology.orchestra.run.smithi204.stdout:5893 read 0x29aa200 thru 0x29b3091 (0x8e92 bytes) 2024-09-12T16:18:00.996 INFO:teuthology.orchestra.run.smithi204.stdout:5894 read 0xbfd7800 thru 0xbfdde67 (0x6668 bytes) 2024-09-12T16:18:00.996 INFO:teuthology.orchestra.run.smithi204.stdout:5895 read 0xaa29200 thru 0xaa2b5f6 (0x23f7 bytes) 2024-09-12T16:18:00.997 INFO:teuthology.orchestra.run.smithi204.stdout:5896 write 0x8647400 thru 0x8648015 (0xc16 bytes) 2024-09-12T16:18:00.997 INFO:teuthology.orchestra.run.smithi204.stdout:5897 read 0xcc93800 thru 0xcc98a95 (0x5296 bytes) 2024-09-12T16:18:00.998 INFO:teuthology.orchestra.run.smithi204.stdout:5898 read 0x6d8f600 thru 0x6d945ef (0x4ff0 bytes) 2024-09-12T16:18:00.998 INFO:teuthology.orchestra.run.smithi204.stdout:5903 punch from 0x8826a00 to 0x882f600, (0x8c00 bytes) 2024-09-12T16:18:01.005 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:18:01.005 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:18:01.015 INFO:teuthology.orchestra.run.smithi204.stdout:5905 read 0x4bede00 thru 0x4bfb6e4 (0xd8e5 bytes) 2024-09-12T16:18:01.015 INFO:teuthology.orchestra.run.smithi204.stdout:5906 read 0x33a7000 thru 0x33aa99f (0x39a0 bytes) 2024-09-12T16:18:01.024 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:18:01.024 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:18:01.027 INFO:teuthology.orchestra.run.smithi204.stdout:5908 trunc from 0xe78c000 to 0x4fffa00 2024-09-12T16:18:01.034 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:01.033+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:01.047 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:18:01.048 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:18:01.056 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T16:18:01.056 INFO:teuthology.orchestra.run.smithi204.stdout:5909 punch from 0xad6400 to 0xade600, (0x8200 bytes) 2024-09-12T16:18:01.073 INFO:teuthology.orchestra.run.smithi204.stdout:5914 trunc from 0x4fffa00 to 0xb390c00 2024-09-12T16:18:01.074 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:18:01.074 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:18:01.103 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:18:01.103 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:18:01.115 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:01.115 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:01.125 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:18:01.126 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:18:01.128 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:18:01.149 INFO:teuthology.orchestra.run.smithi204.stdout:5916 trunc from 0xb390c00 to 0x7494200 2024-09-12T16:18:01.166 INFO:teuthology.orchestra.run.smithi204.stdout:5918 read 0x47b8a00 thru 0x47c3475 (0xaa76 bytes) 2024-09-12T16:18:01.169 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:01.168+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:01.192 INFO:teuthology.orchestra.run.smithi204.stdout:5922 write 0xe810e00 thru 0xe81dbd4 (0xcdd5 bytes) 2024-09-12T16:18:01.192 INFO:teuthology.orchestra.run.smithi204.stdout:5923 punch from 0xd48800 to 0xd4c000, (0x3800 bytes) 2024-09-12T16:18:01.198 INFO:teuthology.orchestra.run.smithi204.stdout:5924 trunc from 0xe81dc00 to 0xb630600 2024-09-12T16:18:01.236 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:01.234+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:01.247 INFO:teuthology.orchestra.run.smithi204.stdout:5925 write 0x3f26e00 thru 0x3f2cbc8 (0x5dc9 bytes) 2024-09-12T16:18:01.247 INFO:teuthology.orchestra.run.smithi204.stdout:5926 read 0xe39c00 thru 0xe4712a (0xd52b bytes) 2024-09-12T16:18:01.251 INFO:teuthology.orchestra.run.smithi204.stdout:5928 write 0xa0c0c00 thru 0xa0c938a (0x878b bytes) 2024-09-12T16:18:01.255 INFO:teuthology.orchestra.run.smithi204.stdout:5930 trunc from 0xb630600 to 0xe0f7000 2024-09-12T16:18:01.273 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:01.273 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:01.273 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:18:01.273 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:01.283 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:18:01.284 INFO:teuthology.orchestra.run.smithi204.stdout:5931 write 0x4b7be00 thru 0x4b83027 (0x7228 bytes) 2024-09-12T16:18:01.286 INFO:teuthology.orchestra.run.smithi204.stdout:5932 read 0x675c400 thru 0x675f9d0 (0x35d1 bytes) 2024-09-12T16:18:01.287 INFO:teuthology.orchestra.run.smithi204.stdout:5933 punch from 0x7105000 to 0x7114a00, (0xfa00 bytes) 2024-09-12T16:18:01.289 INFO:teuthology.orchestra.run.smithi204.stdout:5934 read 0xdf49c00 thru 0xdf4e5e3 (0x49e4 bytes) 2024-09-12T16:18:01.297 INFO:teuthology.orchestra.run.smithi204.stdout:5938 trunc from 0xe0f7000 to 0x70c6c00 2024-09-12T16:18:01.334 INFO:teuthology.orchestra.run.smithi204.stdout:5939 punch from 0x58d4000 to 0x58d6000, (0x2000 bytes) 2024-09-12T16:18:01.334 INFO:teuthology.orchestra.run.smithi204.stdout:5940 read 0x6185c00 thru 0x618d082 (0x7483 bytes) 2024-09-12T16:18:01.335 INFO:teuthology.orchestra.run.smithi204.stdout:5946 punch from 0x258d400 to 0x259ca00, (0xf600 bytes) 2024-09-12T16:18:01.337 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:01.336+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:01.340 INFO:teuthology.orchestra.run.smithi204.stdout:5947 read 0x6dbaa00 thru 0x6dc85e7 (0xdbe8 bytes) 2024-09-12T16:18:01.411 INFO:teuthology.orchestra.run.smithi204.stdout:5950 write 0xdd2b000 thru 0xdd2fc27 (0x4c28 bytes) 2024-09-12T16:18:01.417 INFO:teuthology.orchestra.run.smithi204.stdout:5952 punch from 0x90f2400 to 0x90f5800, (0x3400 bytes) 2024-09-12T16:18:01.418 INFO:teuthology.orchestra.run.smithi204.stdout:5955 punch from 0xd8fca00 to 0xd8fcc00, (0x200 bytes) 2024-09-12T16:18:01.425 INFO:teuthology.orchestra.run.smithi204.stdout:5956 trunc from 0xdd2fe00 to 0x7f16800 2024-09-12T16:18:01.438 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:01.437+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:01.447 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:01.447 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:01.448 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:18:01.448 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:18:01.448 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:01.457 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:18:01.477 INFO:teuthology.orchestra.run.smithi204.stdout:5957 write 0xc69a200 thru 0xc6a21cd (0x7fce bytes) 2024-09-12T16:18:01.483 INFO:teuthology.orchestra.run.smithi204.stdout:5960 write 0x2346e00 thru 0x234bc63 (0x4e64 bytes) 2024-09-12T16:18:01.483 INFO:teuthology.orchestra.run.smithi204.stdout:5961 write 0x8b3a200 thru 0x8b3a21b (0x1c bytes) 2024-09-12T16:18:01.484 INFO:teuthology.orchestra.run.smithi204.stdout:5964 read 0x9753e00 thru 0x976111e (0xd31f bytes) 2024-09-12T16:18:01.484 INFO:teuthology.orchestra.run.smithi204.stdout:5966 write 0x4d4c000 thru 0x4d52225 (0x6226 bytes) 2024-09-12T16:18:01.484 INFO:teuthology.orchestra.run.smithi204.stdout:5967 read 0xb2ab400 thru 0xb2b9be2 (0xe7e3 bytes) 2024-09-12T16:18:01.484 INFO:teuthology.orchestra.run.smithi204.stdout:5970 punch from 0x17eb400 to 0x17f6800, (0xb400 bytes) 2024-09-12T16:18:01.502 INFO:teuthology.orchestra.run.smithi204.stdout:5971 trunc from 0xc6a2200 to 0xe80e00 2024-09-12T16:18:01.544 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:01.543+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:01.641 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:01.639+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:01.647 INFO:teuthology.orchestra.run.smithi204.stdout:5972 trunc from 0xe80e00 to 0xec2ec00 2024-09-12T16:18:01.652 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:01.652 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:18:01.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:18:01.652 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:18:01.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.653 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3705 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14812160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:01.653 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:18:01.653 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 103.51054321700001, 2024-09-12T16:18:01.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053368831999999998, 2024-09-12T16:18:01.653 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:01.653 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:01.653 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:01.653 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:01.653 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:01.653 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:01.653 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3705 2024-09-12T16:18:01.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.654 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:01.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:01.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:18:01.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:01.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:18:01.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:01.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139932+0000", 2024-09-12T16:18:01.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012762099999999999 2024-09-12T16:18:01.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:01.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139935+0000", 2024-09-12T16:18:01.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.119e-06 2024-09-12T16:18:01.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:01.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139939+0000", 2024-09-12T16:18:01.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7999999999999998e-06 2024-09-12T16:18:01.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:01.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139953+0000", 2024-09-12T16:18:01.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3923999999999999e-05 2024-09-12T16:18:01.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:01.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192946+0000", 2024-09-12T16:18:01.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052992971 2024-09-12T16:18:01.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:01.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193035+0000", 2024-09-12T16:18:01.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9040000000000001e-05 2024-09-12T16:18:01.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:01.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193174+0000", 2024-09-12T16:18:01.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138357 2024-09-12T16:18:01.657 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.657 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:01.657 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.657 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3706 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14816256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:01.658 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:18:01.658 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 103.51038822699999, 2024-09-12T16:18:01.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053341723000000001, 2024-09-12T16:18:01.658 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:01.658 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:01.658 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:01.658 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:01.658 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:01.658 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:01.658 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3706 2024-09-12T16:18:01.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.658 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:01.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:01.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:18:01.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:01.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:18:01.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:01.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140090+0000", 2024-09-12T16:18:01.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013020100000000001 2024-09-12T16:18:01.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:01.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140097+0000", 2024-09-12T16:18:01.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0709999999999997e-06 2024-09-12T16:18:01.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:01.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140103+0000", 2024-09-12T16:18:01.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5450000000000003e-06 2024-09-12T16:18:01.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:01.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140106+0000", 2024-09-12T16:18:01.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3739999999999998e-06 2024-09-12T16:18:01.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:01.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193190+0000", 2024-09-12T16:18:01.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053084131999999999 2024-09-12T16:18:01.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:01.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193232+0000", 2024-09-12T16:18:01.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1517000000000002e-05 2024-09-12T16:18:01.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:01.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193302+0000", 2024-09-12T16:18:01.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9882999999999995e-05 2024-09-12T16:18:01.662 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.662 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:01.662 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.662 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3707 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14820352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:01.662 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:18:01.662 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 103.510236238, 2024-09-12T16:18:01.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053452771000000003, 2024-09-12T16:18:01.663 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:01.663 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:01.663 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:01.663 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:01.663 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:01.663 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:01.663 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3707 2024-09-12T16:18:01.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.663 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:01.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:01.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:18:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:18:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140219+0000", 2024-09-12T16:18:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106902 2024-09-12T16:18:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140225+0000", 2024-09-12T16:18:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3199999999999996e-06 2024-09-12T16:18:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140230+0000", 2024-09-12T16:18:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8969999999999999e-06 2024-09-12T16:18:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140233+0000", 2024-09-12T16:18:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2119999999999999e-06 2024-09-12T16:18:01.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:01.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193339+0000", 2024-09-12T16:18:01.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053105556999999998 2024-09-12T16:18:01.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:01.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193431+0000", 2024-09-12T16:18:01.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1837999999999997e-05 2024-09-12T16:18:01.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:01.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193565+0000", 2024-09-12T16:18:01.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013404500000000001 2024-09-12T16:18:01.667 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.667 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:01.667 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.667 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3708 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14824448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:01.667 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:18:01.667 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 103.510107396, 2024-09-12T16:18:01.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053468190999999998, 2024-09-12T16:18:01.668 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:01.668 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:01.668 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:01.668 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:01.668 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:01.668 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:01.668 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3708 2024-09-12T16:18:01.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.668 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:01.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:01.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:18:01.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:01.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:18:01.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:01.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140351+0000", 2024-09-12T16:18:01.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110096 2024-09-12T16:18:01.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:01.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140358+0000", 2024-09-12T16:18:01.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.306e-06 2024-09-12T16:18:01.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:01.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140368+0000", 2024-09-12T16:18:01.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0225e-05 2024-09-12T16:18:01.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:01.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140372+0000", 2024-09-12T16:18:01.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6169999999999998e-06 2024-09-12T16:18:01.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:01.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193594+0000", 2024-09-12T16:18:01.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053222419999999999 2024-09-12T16:18:01.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:01.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193640+0000", 2024-09-12T16:18:01.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.587e-05 2024-09-12T16:18:01.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:01.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193709+0000", 2024-09-12T16:18:01.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8657000000000004e-05 2024-09-12T16:18:01.672 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.672 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:01.672 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.672 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3709 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14828544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:01.672 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:18:01.672 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 103.509970428, 2024-09-12T16:18:01.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594033999999999, 2024-09-12T16:18:01.672 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:01.672 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:01.672 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:01.673 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:01.673 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:01.673 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:01.673 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3709 2024-09-12T16:18:01.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.673 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:01.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:01.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:18:01.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:01.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:18:01.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:01.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140499+0000", 2024-09-12T16:18:01.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121019 2024-09-12T16:18:01.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:01.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140501+0000", 2024-09-12T16:18:01.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2369999999999999e-06 2024-09-12T16:18:01.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:01.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140506+0000", 2024-09-12T16:18:01.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.639e-06 2024-09-12T16:18:01.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:01.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140509+0000", 2024-09-12T16:18:01.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3419999999999999e-06 2024-09-12T16:18:01.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:01.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193743+0000", 2024-09-12T16:18:01.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053234311999999999 2024-09-12T16:18:01.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:01.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193833+0000", 2024-09-12T16:18:01.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9883999999999995e-05 2024-09-12T16:18:01.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:01.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193972+0000", 2024-09-12T16:18:01.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138601 2024-09-12T16:18:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3710 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14832640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:18:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 103.509833082, 2024-09-12T16:18:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053607324999999997, 2024-09-12T16:18:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:01.678 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:01.678 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3710 2024-09-12T16:18:01.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.678 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:01.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:01.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:18:01.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:01.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:18:01.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:01.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140664+0000", 2024-09-12T16:18:01.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014918700000000001 2024-09-12T16:18:01.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:01.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140674+0000", 2024-09-12T16:18:01.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8379999999999997e-06 2024-09-12T16:18:01.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:01.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140694+0000", 2024-09-12T16:18:01.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0145000000000001e-05 2024-09-12T16:18:01.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:01.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140703+0000", 2024-09-12T16:18:01.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5150000000000006e-06 2024-09-12T16:18:01.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:01.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194006+0000", 2024-09-12T16:18:01.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053303370000000003 2024-09-12T16:18:01.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194051+0000", 2024-09-12T16:18:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5012000000000002e-05 2024-09-12T16:18:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194122+0000", 2024-09-12T16:18:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1258000000000001e-05 2024-09-12T16:18:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.682 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3711 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14836736~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:01.682 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:18:01.682 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 103.509631634, 2024-09-12T16:18:01.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053670799999999998, 2024-09-12T16:18:01.682 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:01.682 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:01.682 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:01.682 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:01.682 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:01.682 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:01.682 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3711 2024-09-12T16:18:01.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.682 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:01.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:01.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:18:01.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:01.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:18:01.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:01.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140782+0000", 2024-09-12T16:18:01.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5549999999999994e-05 2024-09-12T16:18:01.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:01.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140786+0000", 2024-09-12T16:18:01.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.89e-06 2024-09-12T16:18:01.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:01.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140796+0000", 2024-09-12T16:18:01.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0057e-05 2024-09-12T16:18:01.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:01.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140819+0000", 2024-09-12T16:18:01.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3005000000000001e-05 2024-09-12T16:18:01.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:01.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194159+0000", 2024-09-12T16:18:01.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053340324000000001 2024-09-12T16:18:01.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:01.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194248+0000", 2024-09-12T16:18:01.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9209000000000006e-05 2024-09-12T16:18:01.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:01.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194387+0000", 2024-09-12T16:18:01.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138765 2024-09-12T16:18:01.686 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.686 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:01.686 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.686 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3712 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14840832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:01.687 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:18:01.687 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 103.509517176, 2024-09-12T16:18:01.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053699068000000003, 2024-09-12T16:18:01.687 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:01.687 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:01.687 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:01.687 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:01.687 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:01.687 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:01.687 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3712 2024-09-12T16:18:01.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.687 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:01.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:01.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:18:01.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:01.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:18:01.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:01.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140900+0000", 2024-09-12T16:18:01.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9014e-05 2024-09-12T16:18:01.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140904+0000", 2024-09-12T16:18:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0940000000000001e-06 2024-09-12T16:18:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140933+0000", 2024-09-12T16:18:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8996000000000002e-05 2024-09-12T16:18:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140945+0000", 2024-09-12T16:18:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1909000000000001e-05 2024-09-12T16:18:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194415+0000", 2024-09-12T16:18:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053470403 2024-09-12T16:18:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194460+0000", 2024-09-12T16:18:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5145000000000002e-05 2024-09-12T16:18:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194530+0000", 2024-09-12T16:18:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9506999999999997e-05 2024-09-12T16:18:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:01.691 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.691 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3713 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14844928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:01.691 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:18:01.691 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 103.50938411600001, 2024-09-12T16:18:01.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053821236000000001, 2024-09-12T16:18:01.691 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:01.691 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:01.691 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:01.691 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:01.691 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:01.691 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:01.692 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3713 2024-09-12T16:18:01.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.692 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:01.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:01.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:18:01.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:01.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:18:01.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:01.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141078+0000", 2024-09-12T16:18:01.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114162 2024-09-12T16:18:01.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:01.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141090+0000", 2024-09-12T16:18:01.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.19e-05 2024-09-12T16:18:01.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:01.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141100+0000", 2024-09-12T16:18:01.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0447e-05 2024-09-12T16:18:01.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:01.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141108+0000", 2024-09-12T16:18:01.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7190000000000001e-06 2024-09-12T16:18:01.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:01.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194564+0000", 2024-09-12T16:18:01.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053455729 2024-09-12T16:18:01.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:01.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194652+0000", 2024-09-12T16:18:01.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8288999999999994e-05 2024-09-12T16:18:01.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:01.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194785+0000", 2024-09-12T16:18:01.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013299000000000001 2024-09-12T16:18:01.695 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.695 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:01.695 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3714 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14849024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:18:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 103.50922818700001, 2024-09-12T16:18:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053816382000000003, 2024-09-12T16:18:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3714 2024-09-12T16:18:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:18:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:18:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141182+0000", 2024-09-12T16:18:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1805999999999997e-05 2024-09-12T16:18:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141185+0000", 2024-09-12T16:18:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5930000000000002e-06 2024-09-12T16:18:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141194+0000", 2024-09-12T16:18:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5760000000000006e-06 2024-09-12T16:18:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141222+0000", 2024-09-12T16:18:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8034999999999998e-05 2024-09-12T16:18:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194817+0000", 2024-09-12T16:18:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594887000000001 2024-09-12T16:18:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194860+0000", 2024-09-12T16:18:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3714999999999997e-05 2024-09-12T16:18:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194936+0000", 2024-09-12T16:18:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5770000000000001e-05 2024-09-12T16:18:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3715 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14853120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:01.701 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:18:01.701 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 103.50910453, 2024-09-12T16:18:01.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053962307000000001, 2024-09-12T16:18:01.701 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:01.701 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:01.701 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:01.701 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:01.701 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:01.701 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:01.701 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3715 2024-09-12T16:18:01.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.701 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:01.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:01.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:18:01.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:01.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:18:01.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:01.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141417+0000", 2024-09-12T16:18:01.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017384099999999999 2024-09-12T16:18:01.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:01.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141422+0000", 2024-09-12T16:18:01.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7310000000000001e-06 2024-09-12T16:18:01.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:01.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141434+0000", 2024-09-12T16:18:01.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2058e-05 2024-09-12T16:18:01.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:01.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141442+0000", 2024-09-12T16:18:01.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7610000000000007e-06 2024-09-12T16:18:01.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:01.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194973+0000", 2024-09-12T16:18:01.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053530618000000002 2024-09-12T16:18:01.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:01.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195063+0000", 2024-09-12T16:18:01.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0927000000000005e-05 2024-09-12T16:18:01.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:01.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195206+0000", 2024-09-12T16:18:01.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142371 2024-09-12T16:18:01.705 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.705 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:01.705 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.705 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3716 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14857216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:01.705 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:18:01.705 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 103.50889468, 2024-09-12T16:18:01.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053916360000000003, 2024-09-12T16:18:01.705 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:01.705 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:01.706 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:01.706 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:01.706 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:01.706 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:01.706 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3716 2024-09-12T16:18:01.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.706 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:01.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:01.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:18:01.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:18:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142933+0000", 2024-09-12T16:18:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014796290000000001 2024-09-12T16:18:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142937+0000", 2024-09-12T16:18:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5760000000000002e-06 2024-09-12T16:18:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142946+0000", 2024-09-12T16:18:01.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0380000000000005e-06 2024-09-12T16:18:01.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:01.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142951+0000", 2024-09-12T16:18:01.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9749999999999998e-06 2024-09-12T16:18:01.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:01.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195246+0000", 2024-09-12T16:18:01.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052295358 2024-09-12T16:18:01.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:01.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195299+0000", 2024-09-12T16:18:01.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2976999999999998e-05 2024-09-12T16:18:01.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:01.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195370+0000", 2024-09-12T16:18:01.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0807000000000002e-05 2024-09-12T16:18:01.709 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.709 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:01.709 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.709 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3721 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14877696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:01.709 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:18:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 103.507321229, 2024-09-12T16:18:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053422994000000001, 2024-09-12T16:18:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3721 2024-09-12T16:18:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:18:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:18:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:18:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:18:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143028+0000", 2024-09-12T16:18:01.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7399999999999991e-07 2024-09-12T16:18:01.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:01.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143031+0000", 2024-09-12T16:18:01.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7599999999999998e-06 2024-09-12T16:18:01.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:01.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143034+0000", 2024-09-12T16:18:01.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9780000000000001e-06 2024-09-12T16:18:01.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:01.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196220+0000", 2024-09-12T16:18:01.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053186341999999998 2024-09-12T16:18:01.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:01.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196313+0000", 2024-09-12T16:18:01.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2676000000000005e-05 2024-09-12T16:18:01.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:01.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196450+0000", 2024-09-12T16:18:01.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137052 2024-09-12T16:18:01.713 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.714 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:01.714 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.714 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3722 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14881792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:01.714 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:18:01.714 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 103.507311337, 2024-09-12T16:18:01.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053556835999999997, 2024-09-12T16:18:01.714 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:01.714 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:01.714 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:01.714 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:01.714 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3722 2024-09-12T16:18:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:18:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:18:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:01.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:18:01.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.11e-07 2024-09-12T16:18:01.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:01.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143038+0000", 2024-09-12T16:18:01.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2399999999999996e-07 2024-09-12T16:18:01.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143041+0000", 2024-09-12T16:18:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8030000000000001e-06 2024-09-12T16:18:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143043+0000", 2024-09-12T16:18:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3140000000000002e-06 2024-09-12T16:18:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196481+0000", 2024-09-12T16:18:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053437601000000001 2024-09-12T16:18:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:01.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196525+0000", 2024-09-12T16:18:01.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4280000000000003e-05 2024-09-12T16:18:01.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:01.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196594+0000", 2024-09-12T16:18:01.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8702999999999996e-05 2024-09-12T16:18:01.718 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.718 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:01.718 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.719 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3723 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14885888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:01.719 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:18:01.719 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 103.507302155, 2024-09-12T16:18:01.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053815546999999998, 2024-09-12T16:18:01.719 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:01.719 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:01.719 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:01.719 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:01.719 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:01.719 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:01.719 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3723 2024-09-12T16:18:01.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:18:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:18:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148994+0000", 2024-09-12T16:18:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059481330000000004 2024-09-12T16:18:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148999+0000", 2024-09-12T16:18:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7140000000000001e-06 2024-09-12T16:18:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149008+0000", 2024-09-12T16:18:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4350000000000003e-06 2024-09-12T16:18:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:01.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149021+0000", 2024-09-12T16:18:01.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2514000000000001e-05 2024-09-12T16:18:01.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:01.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196630+0000", 2024-09-12T16:18:01.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047609758000000002 2024-09-12T16:18:01.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:01.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196724+0000", 2024-09-12T16:18:01.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3522000000000003e-05 2024-09-12T16:18:01.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196861+0000", 2024-09-12T16:18:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013747100000000001 2024-09-12T16:18:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4438 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15719424~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:18:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 103.36242137799999, 2024-09-12T16:18:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367981000000002, 2024-09-12T16:18:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:01.724 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:01.724 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:01.724 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:01.724 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:01.724 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:01.724 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4438 2024-09-12T16:18:01.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.724 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:01.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:01.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:18:01.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:01.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:18:01.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:01.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:18:01.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3e-07 2024-09-12T16:18:01.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:01.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287930+0000", 2024-09-12T16:18:01.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-12T16:18:01.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:01.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287937+0000", 2024-09-12T16:18:01.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.08e-06 2024-09-12T16:18:01.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:01.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287943+0000", 2024-09-12T16:18:01.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5709999999999997e-06 2024-09-12T16:18:01.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:01.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341068+0000", 2024-09-12T16:18:01.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053125101000000001 2024-09-12T16:18:01.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:01.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341154+0000", 2024-09-12T16:18:01.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6100999999999994e-05 2024-09-12T16:18:01.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:01.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341295+0000", 2024-09-12T16:18:01.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014087999999999999 2024-09-12T16:18:01.727 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.727 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:01.728 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.728 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4439 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15723520~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:01.728 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:18:01.728 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 103.362397218, 2024-09-12T16:18:01.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053526799, 2024-09-12T16:18:01.728 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:01.728 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:01.728 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:01.728 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:01.728 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:01.729 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:01.729 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4439 2024-09-12T16:18:01.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.729 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:01.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:01.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:18:01.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:01.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:18:01.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:18:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-07 2024-09-12T16:18:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287953+0000", 2024-09-12T16:18:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1349999999999999e-06 2024-09-12T16:18:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287960+0000", 2024-09-12T16:18:01.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-12T16:18:01.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:01.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287965+0000", 2024-09-12T16:18:01.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1580000000000004e-06 2024-09-12T16:18:01.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:01.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341332+0000", 2024-09-12T16:18:01.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367009 2024-09-12T16:18:01.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341402+0000", 2024-09-12T16:18:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9759999999999996e-05 2024-09-12T16:18:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341478+0000", 2024-09-12T16:18:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5412000000000002e-05 2024-09-12T16:18:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4440 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15727616~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:18:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 103.362376114, 2024-09-12T16:18:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053761601999999999, 2024-09-12T16:18:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4440 2024-09-12T16:18:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:18:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:18:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:18:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:18:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287974+0000", 2024-09-12T16:18:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0540000000000002e-06 2024-09-12T16:18:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287980+0000", 2024-09-12T16:18:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9440000000000002e-06 2024-09-12T16:18:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:01.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287987+0000", 2024-09-12T16:18:01.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5889999999999999e-06 2024-09-12T16:18:01.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:01.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341502+0000", 2024-09-12T16:18:01.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053515199999999999 2024-09-12T16:18:01.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:01.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341595+0000", 2024-09-12T16:18:01.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3097000000000007e-05 2024-09-12T16:18:01.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:01.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341734+0000", 2024-09-12T16:18:01.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013832800000000001 2024-09-12T16:18:01.737 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.737 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:01.737 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.737 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2209 3.1 3:85f36d3b:::rbd_data.1155ccb1894c.0000000000000004:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:18:01.737 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:18:01.738 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 64.278690975999993, 2024-09-12T16:18:01.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.060659365, 2024-09-12T16:18:01.738 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:01.738 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:01.738 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:01.738 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:01.738 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:18:01.738 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:18:01.740 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2209 2024-09-12T16:18:01.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.740 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:01.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:01.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:18:01.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:01.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:18:01.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:01.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371658+0000", 2024-09-12T16:18:01.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1570000000000001e-06 2024-09-12T16:18:01.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:01.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393414+0000", 2024-09-12T16:18:01.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021755495999999999 2024-09-12T16:18:01.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:01.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393447+0000", 2024-09-12T16:18:01.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3630000000000002e-05 2024-09-12T16:18:01.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:01.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393462+0000", 2024-09-12T16:18:01.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5048999999999999e-05 2024-09-12T16:18:01.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:01.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393556+0000", 2024-09-12T16:18:01.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3549999999999997e-05 2024-09-12T16:18:01.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:01.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393697+0000", 2024-09-12T16:18:01.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000141414 2024-09-12T16:18:01.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T16:18:01.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.394944+0000", 2024-09-12T16:18:01.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012463039999999999 2024-09-12T16:18:01.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.431803+0000", 2024-09-12T16:18:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0368594 2024-09-12T16:18:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:18:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432268+0000", 2024-09-12T16:18:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046457600000000002 2024-09-12T16:18:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:18:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432293+0000", 2024-09-12T16:18:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.527e-05 2024-09-12T16:18:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432316+0000", 2024-09-12T16:18:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3519e-05 2024-09-12T16:18:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:9400 3.1f 3:feea9999:::rbd_data.1155338d0570.0000000000000007:head [read 32768~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-12T16:18:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:20.012502+0000", 2024-09-12T16:18:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 41.637845984000002, 2024-09-12T16:18:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.000678049, 2024-09-12T16:18:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:18:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:18:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 9400 2024-09-12T16:18:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012502+0000", 2024-09-12T16:18:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:01.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012502+0000", 2024-09-12T16:18:01.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:01.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:01.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012504+0000", 2024-09-12T16:18:01.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5939999999999999e-06 2024-09-12T16:18:01.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:01.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012511+0000", 2024-09-12T16:18:01.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0840000000000003e-06 2024-09-12T16:18:01.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:01.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012525+0000", 2024-09-12T16:18:01.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4538999999999999e-05 2024-09-12T16:18:01.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:01.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012532+0000", 2024-09-12T16:18:01.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8310000000000003e-06 2024-09-12T16:18:01.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.751 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:01.751 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012605+0000", 2024-09-12T16:18:01.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2387999999999999e-05 2024-09-12T16:18:01.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.751 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T16:18:01.751 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012617+0000", 2024-09-12T16:18:01.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2167999999999999e-05 2024-09-12T16:18:01.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:01.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:21.012823+0000", 2024-09-12T16:18:01.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0002068230000001 2024-09-12T16:18:01.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:01.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:21.012975+0000", 2024-09-12T16:18:01.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015196200000000001 2024-09-12T16:18:01.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:01.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:01.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:01.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:21.013180+0000", 2024-09-12T16:18:01.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020466000000000001 2024-09-12T16:18:01.753 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.753 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:01.753 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.753 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:01.753 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:01.753 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:01.756 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:18:01.756 INFO:teuthology.orchestra.run.smithi204.stdout:5974 trunc from 0xec2ec00 to 0xc4a8600 2024-09-12T16:18:01.757 INFO:teuthology.orchestra.run.smithi204.stdout:5976 write 0x4ab8000 thru 0x4ab95b8 (0x15b9 bytes) 2024-09-12T16:18:01.757 INFO:teuthology.orchestra.run.smithi204.stdout:5977 write 0x8702400 thru 0x870265f (0x260 bytes) 2024-09-12T16:18:01.757 INFO:teuthology.orchestra.run.smithi204.stdout:5978 write 0x687d600 thru 0x6882301 (0x4d02 bytes) 2024-09-12T16:18:01.757 INFO:teuthology.orchestra.run.smithi204.stdout:5980 read 0x77d400 thru 0x7835d3 (0x61d4 bytes) 2024-09-12T16:18:01.757 INFO:teuthology.orchestra.run.smithi204.stdout:5982 read 0x995c000 thru 0x99643e8 (0x83e9 bytes) 2024-09-12T16:18:01.757 INFO:teuthology.orchestra.run.smithi204.stdout:5983 write 0xc066c00 thru 0xc0766c4 (0xfac5 bytes) 2024-09-12T16:18:01.757 INFO:teuthology.orchestra.run.smithi204.stdout:5993 trunc from 0xc4a8600 to 0x80ef600 2024-09-12T16:18:01.757 INFO:teuthology.orchestra.run.smithi204.stdout:5994 punch from 0x13e9600 to 0x13f7800, (0xe200 bytes) 2024-09-12T16:18:01.757 INFO:teuthology.orchestra.run.smithi204.stdout:5996 punch from 0x78bca00 to 0x78c9600, (0xcc00 bytes) 2024-09-12T16:18:01.757 INFO:teuthology.orchestra.run.smithi204.stdout:5997 write 0x6ed600 thru 0x6f9319 (0xbd1a bytes) 2024-09-12T16:18:01.757 INFO:teuthology.orchestra.run.smithi204.stdout:5999 trunc from 0x80ef600 to 0x5330800 2024-09-12T16:18:01.758 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:01.753+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:01.855 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:01.855+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:01.902 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:01.903 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:01.903 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:18:01.903 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:01.911 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:18:01.995 INFO:teuthology.orchestra.run.smithi204.stdout:6000 punch from 0x1095c00 to 0x1099c00, (0x4000 bytes) 2024-09-12T16:18:01.995 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:01.994+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:02.045 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-12T16:18:02.058 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:02.056+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:02.070 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:02.070 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:02.071 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:18:02.071 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:18:02.071 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:02.080 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:18:02.139 INFO:teuthology.orchestra.run.smithi204.stdout:checking clone #40, image image_client.0-clone40 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent41 2024-09-12T16:18:02.158 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:02.157+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:02.232 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:02.232 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:18:02.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:18:02.232 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:18:02.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.232 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1571 3.b 3:d046566d:::rbd_data.1155525b14e3.0000000000000001:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:18:02.232 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:18:02.233 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 81.077779626999998, 2024-09-12T16:18:02.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064439785999999999, 2024-09-12T16:18:02.233 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.233 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.233 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:02.233 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.233 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:18:02.233 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:18:02.233 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1571 2024-09-12T16:18:02.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.233 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:18:02.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:18:02.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:18:02.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5400000000000002e-07 2024-09-12T16:18:02.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152567+0000", 2024-09-12T16:18:02.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.131e-06 2024-09-12T16:18:02.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152574+0000", 2024-09-12T16:18:02.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1840000000000002e-06 2024-09-12T16:18:02.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152579+0000", 2024-09-12T16:18:02.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.152e-06 2024-09-12T16:18:02.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153671+0000", 2024-09-12T16:18:02.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001092078 2024-09-12T16:18:02.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153779+0000", 2024-09-12T16:18:02.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108461 2024-09-12T16:18:02.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217004+0000", 2024-09-12T16:18:02.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.063224426 2024-09-12T16:18:02.237 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.237 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.237 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.237 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1581 3.4 3:22e34893:::rbd_data.1155525b14e3.0000000000000005:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:18:02.237 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:18:02.237 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 81.077682502000002, 2024-09-12T16:18:02.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064484407999999993, 2024-09-12T16:18:02.237 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.237 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.238 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:02.238 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.238 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:18:02.238 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:18:02.238 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1581 2024-09-12T16:18:02.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.238 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.238 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:18:02.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:18:02.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152662+0000", 2024-09-12T16:18:02.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.65e-07 2024-09-12T16:18:02.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152664+0000", 2024-09-12T16:18:02.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9829999999999999e-06 2024-09-12T16:18:02.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152670+0000", 2024-09-12T16:18:02.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2260000000000002e-06 2024-09-12T16:18:02.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152675+0000", 2024-09-12T16:18:02.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7990000000000001e-06 2024-09-12T16:18:02.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.216945+0000", 2024-09-12T16:18:02.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064270341999999994 2024-09-12T16:18:02.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217040+0000", 2024-09-12T16:18:02.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5242999999999996e-05 2024-09-12T16:18:02.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217146+0000", 2024-09-12T16:18:02.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010545 2024-09-12T16:18:02.241 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.241 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.241 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.242 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2207 3.0 3:05fdc61f:::rbd_data.1155ccb1894c.0000000000000003:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:18:02.242 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:18:02.242 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 64.859638941, 2024-09-12T16:18:02.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.05105382, 2024-09-12T16:18:02.242 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.242 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.242 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:02.242 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.242 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:18:02.243 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:18:02.243 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2207 2024-09-12T16:18:02.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.243 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:18:02.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.244 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:18:02.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370706+0000", 2024-09-12T16:18:02.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7800000000000001e-07 2024-09-12T16:18:02.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391581+0000", 2024-09-12T16:18:02.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020875624999999998 2024-09-12T16:18:02.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391608+0000", 2024-09-12T16:18:02.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6412999999999999e-05 2024-09-12T16:18:02.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391618+0000", 2024-09-12T16:18:02.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9240000000000002e-06 2024-09-12T16:18:02.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391705+0000", 2024-09-12T16:18:02.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7489000000000002e-05 2024-09-12T16:18:02.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391838+0000", 2024-09-12T16:18:02.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132865 2024-09-12T16:18:02.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 2", 2024-09-12T16:18:02.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.392587+0000", 2024-09-12T16:18:02.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074930000000000005 2024-09-12T16:18:02.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:02.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.420095+0000", 2024-09-12T16:18:02.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027507949 2024-09-12T16:18:02.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:18:02.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421610+0000", 2024-09-12T16:18:02.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001515195 2024-09-12T16:18:02.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:18:02.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421681+0000", 2024-09-12T16:18:02.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0320000000000004e-05 2024-09-12T16:18:02.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421759+0000", 2024-09-12T16:18:02.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7961999999999997e-05 2024-09-12T16:18:02.250 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.250 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.250 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.250 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11082 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 3350528~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:02.250 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.876283+0000", 2024-09-12T16:18:02.250 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3540602849999992, 2024-09-12T16:18:02.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044907159000000002, 2024-09-12T16:18:02.250 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.250 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.251 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:02.251 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.251 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:02.251 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:02.251 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11082 2024-09-12T16:18:02.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.251 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876283+0000", 2024-09-12T16:18:02.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876283+0000", 2024-09-12T16:18:02.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876284+0000", 2024-09-12T16:18:02.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7300000000000002e-07 2024-09-12T16:18:02.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876286+0000", 2024-09-12T16:18:02.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2089999999999999e-06 2024-09-12T16:18:02.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876292+0000", 2024-09-12T16:18:02.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9399999999999999e-06 2024-09-12T16:18:02.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876297+0000", 2024-09-12T16:18:02.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9200000000000003e-06 2024-09-12T16:18:02.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921094+0000", 2024-09-12T16:18:02.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044797311999999999 2024-09-12T16:18:02.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921136+0000", 2024-09-12T16:18:02.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1625000000000002e-05 2024-09-12T16:18:02.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921191+0000", 2024-09-12T16:18:02.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4780000000000001e-05 2024-09-12T16:18:02.254 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.254 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.255 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.255 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11083 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 3399680~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:02.255 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.876304+0000", 2024-09-12T16:18:02.255 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.354039534, 2024-09-12T16:18:02.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045070883999999999, 2024-09-12T16:18:02.255 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.255 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.255 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:02.255 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.255 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:02.255 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:02.256 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11083 2024-09-12T16:18:02.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.256 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876304+0000", 2024-09-12T16:18:02.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876304+0000", 2024-09-12T16:18:02.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876305+0000", 2024-09-12T16:18:02.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4099999999999999e-07 2024-09-12T16:18:02.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876307+0000", 2024-09-12T16:18:02.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9470000000000002e-06 2024-09-12T16:18:02.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876312+0000", 2024-09-12T16:18:02.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7540000000000003e-06 2024-09-12T16:18:02.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876318+0000", 2024-09-12T16:18:02.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3589999999999999e-06 2024-09-12T16:18:02.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921221+0000", 2024-09-12T16:18:02.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044903464999999997 2024-09-12T16:18:02.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921266+0000", 2024-09-12T16:18:02.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4795000000000001e-05 2024-09-12T16:18:02.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921375+0000", 2024-09-12T16:18:02.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000109023 2024-09-12T16:18:02.259 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.259 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.259 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.259 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11084 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 3448832~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:02.260 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.876324+0000", 2024-09-12T16:18:02.260 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3540194169999999, 2024-09-12T16:18:02.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045172474999999997, 2024-09-12T16:18:02.260 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.260 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.260 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:02.260 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.260 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:02.260 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:02.260 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11084 2024-09-12T16:18:02.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.260 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876324+0000", 2024-09-12T16:18:02.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876324+0000", 2024-09-12T16:18:02.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876411+0000", 2024-09-12T16:18:02.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6292000000000007e-05 2024-09-12T16:18:02.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876418+0000", 2024-09-12T16:18:02.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3309999999999998e-06 2024-09-12T16:18:02.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876426+0000", 2024-09-12T16:18:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3850000000000002e-06 2024-09-12T16:18:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876436+0000", 2024-09-12T16:18:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8749999999999995e-06 2024-09-12T16:18:02.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921403+0000", 2024-09-12T16:18:02.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044966385999999997 2024-09-12T16:18:02.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921445+0000", 2024-09-12T16:18:02.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1953000000000003e-05 2024-09-12T16:18:02.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921497+0000", 2024-09-12T16:18:02.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2253000000000003e-05 2024-09-12T16:18:02.265 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.265 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.265 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.266 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11085 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 3497984~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:02.266 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.876449+0000", 2024-09-12T16:18:02.266 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3538949070000008, 2024-09-12T16:18:02.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045173054999999997, 2024-09-12T16:18:02.266 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.266 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.266 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:02.266 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.266 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:02.266 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:02.266 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11085 2024-09-12T16:18:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876449+0000", 2024-09-12T16:18:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876449+0000", 2024-09-12T16:18:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.881997+0000", 2024-09-12T16:18:02.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055481209999999996 2024-09-12T16:18:02.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.882002+0000", 2024-09-12T16:18:02.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8269999999999997e-06 2024-09-12T16:18:02.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.882013+0000", 2024-09-12T16:18:02.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0869999999999999e-05 2024-09-12T16:18:02.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.882020+0000", 2024-09-12T16:18:02.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5839999999999997e-06 2024-09-12T16:18:02.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921523+0000", 2024-09-12T16:18:02.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039502411000000001 2024-09-12T16:18:02.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921566+0000", 2024-09-12T16:18:02.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3353000000000003e-05 2024-09-12T16:18:02.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921622+0000", 2024-09-12T16:18:02.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5889e-05 2024-09-12T16:18:02.270 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.270 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.270 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.271 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11136 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 6004736~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:02.271 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883172+0000", 2024-09-12T16:18:02.271 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3471717299999995, 2024-09-12T16:18:02.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044900554000000002, 2024-09-12T16:18:02.271 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.271 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.271 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:02.271 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.271 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:02.272 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:02.272 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11136 2024-09-12T16:18:02.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.272 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883172+0000", 2024-09-12T16:18:02.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883172+0000", 2024-09-12T16:18:02.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883172+0000", 2024-09-12T16:18:02.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5199999999999998e-07 2024-09-12T16:18:02.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883174+0000", 2024-09-12T16:18:02.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1169999999999998e-06 2024-09-12T16:18:02.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883181+0000", 2024-09-12T16:18:02.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0920000000000003e-06 2024-09-12T16:18:02.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883186+0000", 2024-09-12T16:18:02.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0900000000000004e-06 2024-09-12T16:18:02.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.927988+0000", 2024-09-12T16:18:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044802373999999999 2024-09-12T16:18:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928032+0000", 2024-09-12T16:18:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3717999999999997e-05 2024-09-12T16:18:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928073+0000", 2024-09-12T16:18:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0810999999999999e-05 2024-09-12T16:18:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11137 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 6053888~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883204+0000", 2024-09-12T16:18:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3471395499999996, 2024-09-12T16:18:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044978854999999998, 2024-09-12T16:18:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11137 2024-09-12T16:18:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883204+0000", 2024-09-12T16:18:02.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883204+0000", 2024-09-12T16:18:02.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883205+0000", 2024-09-12T16:18:02.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6700000000000003e-07 2024-09-12T16:18:02.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883207+0000", 2024-09-12T16:18:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4370000000000001e-06 2024-09-12T16:18:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883214+0000", 2024-09-12T16:18:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1840000000000002e-06 2024-09-12T16:18:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883220+0000", 2024-09-12T16:18:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5010000000000004e-06 2024-09-12T16:18:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928098+0000", 2024-09-12T16:18:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044878058999999998 2024-09-12T16:18:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928140+0000", 2024-09-12T16:18:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1990000000000003e-05 2024-09-12T16:18:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928183+0000", 2024-09-12T16:18:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3117000000000001e-05 2024-09-12T16:18:02.280 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.280 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.280 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.280 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11138 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 6103040~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:02.280 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883227+0000", 2024-09-12T16:18:02.280 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3471163169999993, 2024-09-12T16:18:02.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045063931000000002, 2024-09-12T16:18:02.280 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.280 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.281 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:02.281 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.281 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:02.281 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:02.281 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11138 2024-09-12T16:18:02.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.281 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883227+0000", 2024-09-12T16:18:02.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883227+0000", 2024-09-12T16:18:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883228+0000", 2024-09-12T16:18:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5600000000000005e-07 2024-09-12T16:18:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883230+0000", 2024-09-12T16:18:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1210000000000001e-06 2024-09-12T16:18:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883236+0000", 2024-09-12T16:18:02.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1670000000000004e-06 2024-09-12T16:18:02.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883241+0000", 2024-09-12T16:18:02.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9060000000000001e-06 2024-09-12T16:18:02.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928211+0000", 2024-09-12T16:18:02.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044969229999999999 2024-09-12T16:18:02.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928252+0000", 2024-09-12T16:18:02.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1671000000000001e-05 2024-09-12T16:18:02.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928291+0000", 2024-09-12T16:18:02.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9180000000000001e-05 2024-09-12T16:18:02.285 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.285 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.285 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.286 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11139 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 6152192~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:02.286 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883248+0000", 2024-09-12T16:18:02.286 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3470960430000005, 2024-09-12T16:18:02.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045153225999999998, 2024-09-12T16:18:02.286 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.286 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.287 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:02.287 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.287 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:02.287 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:02.287 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11139 2024-09-12T16:18:02.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.287 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883248+0000", 2024-09-12T16:18:02.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883248+0000", 2024-09-12T16:18:02.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883248+0000", 2024-09-12T16:18:02.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9999999999999998e-07 2024-09-12T16:18:02.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883250+0000", 2024-09-12T16:18:02.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0660000000000002e-06 2024-09-12T16:18:02.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883256+0000", 2024-09-12T16:18:02.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8699999999999997e-06 2024-09-12T16:18:02.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883261+0000", 2024-09-12T16:18:02.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0490000000000003e-06 2024-09-12T16:18:02.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928316+0000", 2024-09-12T16:18:02.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045055398000000003 2024-09-12T16:18:02.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928359+0000", 2024-09-12T16:18:02.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2286000000000001e-05 2024-09-12T16:18:02.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928401+0000", 2024-09-12T16:18:02.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2157000000000003e-05 2024-09-12T16:18:02.293 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.293 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.294 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.294 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11140 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 6201344~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:02.294 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883267+0000", 2024-09-12T16:18:02.294 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3470762769999993, 2024-09-12T16:18:02.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045241199000000003, 2024-09-12T16:18:02.294 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.295 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.295 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:02.295 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.295 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:02.295 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:02.295 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11140 2024-09-12T16:18:02.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.295 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883267+0000", 2024-09-12T16:18:02.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883267+0000", 2024-09-12T16:18:02.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883268+0000", 2024-09-12T16:18:02.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8700000000000001e-07 2024-09-12T16:18:02.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883270+0000", 2024-09-12T16:18:02.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3420000000000002e-06 2024-09-12T16:18:02.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883276+0000", 2024-09-12T16:18:02.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0310000000000004e-06 2024-09-12T16:18:02.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883281+0000", 2024-09-12T16:18:02.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1259999999999997e-06 2024-09-12T16:18:02.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928428+0000", 2024-09-12T16:18:02.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045146276999999999 2024-09-12T16:18:02.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928469+0000", 2024-09-12T16:18:02.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1007000000000002e-05 2024-09-12T16:18:02.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928509+0000", 2024-09-12T16:18:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0028999999999999e-05 2024-09-12T16:18:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11141 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 6250496~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883288+0000", 2024-09-12T16:18:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3470556800000004, 2024-09-12T16:18:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045331594000000003, 2024-09-12T16:18:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.300 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:02.300 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.300 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:02.300 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:02.300 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11141 2024-09-12T16:18:02.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.300 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.300 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883288+0000", 2024-09-12T16:18:02.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883288+0000", 2024-09-12T16:18:02.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883288+0000", 2024-09-12T16:18:02.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0200000000000003e-07 2024-09-12T16:18:02.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883290+0000", 2024-09-12T16:18:02.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9350000000000001e-06 2024-09-12T16:18:02.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883296+0000", 2024-09-12T16:18:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.913e-06 2024-09-12T16:18:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883302+0000", 2024-09-12T16:18:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.879e-06 2024-09-12T16:18:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928534+0000", 2024-09-12T16:18:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045231544999999998 2024-09-12T16:18:02.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928577+0000", 2024-09-12T16:18:02.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3676e-05 2024-09-12T16:18:02.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928620+0000", 2024-09-12T16:18:02.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2243999999999997e-05 2024-09-12T16:18:02.303 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.304 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.304 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.304 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11271 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3174400~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:02.304 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883316+0000", 2024-09-12T16:18:02.304 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3470276200000004, 2024-09-12T16:18:02.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045477308000000001, 2024-09-12T16:18:02.304 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.304 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.304 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:02.304 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.304 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:02.304 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:02.305 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11271 2024-09-12T16:18:02.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.305 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883316+0000", 2024-09-12T16:18:02.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883316+0000", 2024-09-12T16:18:02.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883317+0000", 2024-09-12T16:18:02.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9200000000000001e-07 2024-09-12T16:18:02.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883319+0000", 2024-09-12T16:18:02.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2670000000000001e-06 2024-09-12T16:18:02.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883326+0000", 2024-09-12T16:18:02.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6000000000000003e-06 2024-09-12T16:18:02.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883331+0000", 2024-09-12T16:18:02.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1719999999999998e-06 2024-09-12T16:18:02.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928647+0000", 2024-09-12T16:18:02.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045316457999999997 2024-09-12T16:18:02.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928689+0000", 2024-09-12T16:18:02.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1352e-05 2024-09-12T16:18:02.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928793+0000", 2024-09-12T16:18:02.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000104867 2024-09-12T16:18:02.308 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.308 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.308 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.308 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11272 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3223552~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:02.308 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883338+0000", 2024-09-12T16:18:02.308 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3470057600000001, 2024-09-12T16:18:02.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045595268000000001, 2024-09-12T16:18:02.309 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.309 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.309 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:02.309 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.309 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:02.309 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:02.309 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11272 2024-09-12T16:18:02.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.309 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883338+0000", 2024-09-12T16:18:02.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883338+0000", 2024-09-12T16:18:02.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883339+0000", 2024-09-12T16:18:02.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8599999999999998e-07 2024-09-12T16:18:02.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883341+0000", 2024-09-12T16:18:02.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1449999999999998e-06 2024-09-12T16:18:02.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883348+0000", 2024-09-12T16:18:02.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0110000000000003e-06 2024-09-12T16:18:02.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883353+0000", 2024-09-12T16:18:02.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2360000000000004e-06 2024-09-12T16:18:02.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928819+0000", 2024-09-12T16:18:02.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045466392000000001 2024-09-12T16:18:02.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928869+0000", 2024-09-12T16:18:02.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9829e-05 2024-09-12T16:18:02.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928933+0000", 2024-09-12T16:18:02.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3968999999999997e-05 2024-09-12T16:18:02.312 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.312 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.313 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.313 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11273 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3272704~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:02.313 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883359+0000", 2024-09-12T16:18:02.313 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3469844480000006, 2024-09-12T16:18:02.313 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045735142999999999, 2024-09-12T16:18:02.313 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.313 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.313 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:02.313 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.313 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:02.313 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:02.313 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11273 2024-09-12T16:18:02.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.314 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883359+0000", 2024-09-12T16:18:02.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883359+0000", 2024-09-12T16:18:02.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883360+0000", 2024-09-12T16:18:02.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9400000000000001e-07 2024-09-12T16:18:02.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883367+0000", 2024-09-12T16:18:02.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8530000000000003e-06 2024-09-12T16:18:02.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883373+0000", 2024-09-12T16:18:02.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9989999999999997e-06 2024-09-12T16:18:02.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883378+0000", 2024-09-12T16:18:02.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3369999999999999e-06 2024-09-12T16:18:02.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928950+0000", 2024-09-12T16:18:02.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045571751000000001 2024-09-12T16:18:02.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928992+0000", 2024-09-12T16:18:02.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1891000000000003e-05 2024-09-12T16:18:02.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.317 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.317 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929094+0000", 2024-09-12T16:18:02.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010291800000000001 2024-09-12T16:18:02.317 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.317 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.317 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.317 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11274 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3321856~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:02.317 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883385+0000", 2024-09-12T16:18:02.317 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3469589309999996, 2024-09-12T16:18:02.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045864239000000001, 2024-09-12T16:18:02.317 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.318 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.318 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:02.318 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.318 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:02.318 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:02.318 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11274 2024-09-12T16:18:02.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.318 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.318 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883385+0000", 2024-09-12T16:18:02.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883385+0000", 2024-09-12T16:18:02.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883385+0000", 2024-09-12T16:18:02.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4799999999999999e-07 2024-09-12T16:18:02.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883388+0000", 2024-09-12T16:18:02.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3199999999999998e-06 2024-09-12T16:18:02.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883394+0000", 2024-09-12T16:18:02.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2020000000000001e-06 2024-09-12T16:18:02.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883400+0000", 2024-09-12T16:18:02.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8510000000000004e-06 2024-09-12T16:18:02.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929123+0000", 2024-09-12T16:18:02.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045723235000000001 2024-09-12T16:18:02.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.321 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.321 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929166+0000", 2024-09-12T16:18:02.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2769999999999999e-05 2024-09-12T16:18:02.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.321 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.321 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929249+0000", 2024-09-12T16:18:02.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3412999999999996e-05 2024-09-12T16:18:02.321 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.322 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.322 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.322 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11275 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3371008~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:02.322 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883416+0000", 2024-09-12T16:18:02.322 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3469273219999991, 2024-09-12T16:18:02.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.046042315, 2024-09-12T16:18:02.322 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.322 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.323 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:02.323 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.323 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:02.323 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:02.323 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11275 2024-09-12T16:18:02.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.323 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883416+0000", 2024-09-12T16:18:02.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883416+0000", 2024-09-12T16:18:02.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883417+0000", 2024-09-12T16:18:02.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4700000000000001e-07 2024-09-12T16:18:02.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883419+0000", 2024-09-12T16:18:02.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2029999999999999e-06 2024-09-12T16:18:02.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.325 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.325 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883426+0000", 2024-09-12T16:18:02.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.579e-06 2024-09-12T16:18:02.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.325 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.325 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883431+0000", 2024-09-12T16:18:02.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5679999999999999e-06 2024-09-12T16:18:02.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.326 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929290+0000", 2024-09-12T16:18:02.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045858227000000001 2024-09-12T16:18:02.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.326 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929365+0000", 2024-09-12T16:18:02.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5519999999999995e-05 2024-09-12T16:18:02.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929459+0000", 2024-09-12T16:18:02.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3671000000000005e-05 2024-09-12T16:18:02.327 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.327 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.327 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.328 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11276 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3420160~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:02.328 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883439+0000", 2024-09-12T16:18:02.328 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.346904919, 2024-09-12T16:18:02.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.046138991999999997, 2024-09-12T16:18:02.328 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.328 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.328 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:02.328 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.328 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:02.328 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:02.328 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11276 2024-09-12T16:18:02.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.328 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883439+0000", 2024-09-12T16:18:02.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883439+0000", 2024-09-12T16:18:02.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883560+0000", 2024-09-12T16:18:02.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121229 2024-09-12T16:18:02.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883569+0000", 2024-09-12T16:18:02.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9390000000000003e-06 2024-09-12T16:18:02.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883579+0000", 2024-09-12T16:18:02.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8859999999999999e-06 2024-09-12T16:18:02.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883585+0000", 2024-09-12T16:18:02.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.545e-06 2024-09-12T16:18:02.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929486+0000", 2024-09-12T16:18:02.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045900653999999999 2024-09-12T16:18:02.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929527+0000", 2024-09-12T16:18:02.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0707999999999997e-05 2024-09-12T16:18:02.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929578+0000", 2024-09-12T16:18:02.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1031e-05 2024-09-12T16:18:02.332 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.332 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.332 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.332 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11277 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3469312~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:02.332 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883595+0000", 2024-09-12T16:18:02.332 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3467485759999995, 2024-09-12T16:18:02.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.046187702999999997, 2024-09-12T16:18:02.333 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.333 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.333 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:02.333 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.333 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:02.333 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:02.333 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11277 2024-09-12T16:18:02.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.333 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883595+0000", 2024-09-12T16:18:02.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883595+0000", 2024-09-12T16:18:02.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.889065+0000", 2024-09-12T16:18:02.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00547001 2024-09-12T16:18:02.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.889069+0000", 2024-09-12T16:18:02.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1180000000000002e-06 2024-09-12T16:18:02.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.889079+0000", 2024-09-12T16:18:02.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2250000000000006e-06 2024-09-12T16:18:02.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.889084+0000", 2024-09-12T16:18:02.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2680000000000002e-06 2024-09-12T16:18:02.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929612+0000", 2024-09-12T16:18:02.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040528343000000001 2024-09-12T16:18:02.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929691+0000", 2024-09-12T16:18:02.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8541999999999994e-05 2024-09-12T16:18:02.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929783+0000", 2024-09-12T16:18:02.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2196999999999998e-05 2024-09-12T16:18:02.336 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.337 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.337 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.337 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.337 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.337 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:02.338 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:18:02.339 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:02.337+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:02.439 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:02.438+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:02.486 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:02.487 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:02.487 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:18:02.487 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:02.495 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:18:02.540 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:02.539+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:02.641 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:02.641 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:02.641 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:18:02.641 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:18:02.642 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:02.642 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:02.640+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:02.650 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:18:02.741 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:02.740+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:02.753 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 3] out_osds: [5] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-12T16:18:02.753 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T16:18:02.753 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-12T16:18:02.753 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T16:18:02.760 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:02.760 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:18:02.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:18:02.762 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:18:02.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.762 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2213 3.18 3:1944e921:::rbd_data.1155ccb1894c.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:18:02.762 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:18:02.762 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 65.381459308000004, 2024-09-12T16:18:02.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.055657836000000002, 2024-09-12T16:18:02.762 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.762 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.762 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:18:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:18:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2213 2024-09-12T16:18:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:18:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:18:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375351+0000", 2024-09-12T16:18:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.556e-06 2024-09-12T16:18:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.399989+0000", 2024-09-12T16:18:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024637949999999999 2024-09-12T16:18:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400038+0000", 2024-09-12T16:18:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9187999999999997e-05 2024-09-12T16:18:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400056+0000", 2024-09-12T16:18:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8451e-05 2024-09-12T16:18:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400151+0000", 2024-09-12T16:18:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5026999999999997e-05 2024-09-12T16:18:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400345+0000", 2024-09-12T16:18:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019352900000000001 2024-09-12T16:18:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 1", 2024-09-12T16:18:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.401319+0000", 2024-09-12T16:18:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00097419399999999995 2024-09-12T16:18:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:18:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.429350+0000", 2024-09-12T16:18:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028030607999999999 2024-09-12T16:18:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.430907+0000", 2024-09-12T16:18:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001557466 2024-09-12T16:18:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:18:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.430966+0000", 2024-09-12T16:18:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9437e-05 2024-09-12T16:18:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.431007+0000", 2024-09-12T16:18:02.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0429999999999997e-05 2024-09-12T16:18:02.768 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.768 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.768 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.768 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5632 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 585728~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:02.768 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556262+0000", 2024-09-12T16:18:02.768 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.2005462520000001, 2024-09-12T16:18:02.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051267114000000003, 2024-09-12T16:18:02.768 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.768 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.768 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:02.768 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5632 2024-09-12T16:18:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556262+0000", 2024-09-12T16:18:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556262+0000", 2024-09-12T16:18:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556262+0000", 2024-09-12T16:18:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9999999999999998e-07 2024-09-12T16:18:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556269+0000", 2024-09-12T16:18:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4119999999999998e-06 2024-09-12T16:18:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556276+0000", 2024-09-12T16:18:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8549999999999996e-06 2024-09-12T16:18:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556281+0000", 2024-09-12T16:18:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1159999999999998e-06 2024-09-12T16:18:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607438+0000", 2024-09-12T16:18:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.05115695 2024-09-12T16:18:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607478+0000", 2024-09-12T16:18:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0535999999999999e-05 2024-09-12T16:18:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607529+0000", 2024-09-12T16:18:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0844999999999999e-05 2024-09-12T16:18:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5633 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 638976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556288+0000", 2024-09-12T16:18:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.20052022, 2024-09-12T16:18:02.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051384633999999998, 2024-09-12T16:18:02.773 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.773 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.773 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:02.773 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.773 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:02.773 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:02.773 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5633 2024-09-12T16:18:02.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.773 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556288+0000", 2024-09-12T16:18:02.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556288+0000", 2024-09-12T16:18:02.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556289+0000", 2024-09-12T16:18:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4000000000000002e-07 2024-09-12T16:18:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556291+0000", 2024-09-12T16:18:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0470000000000001e-06 2024-09-12T16:18:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556297+0000", 2024-09-12T16:18:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5080000000000002e-06 2024-09-12T16:18:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556302+0000", 2024-09-12T16:18:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2190000000000003e-06 2024-09-12T16:18:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607559+0000", 2024-09-12T16:18:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051256542000000002 2024-09-12T16:18:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.777 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607619+0000", 2024-09-12T16:18:02.777 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0538000000000002e-05 2024-09-12T16:18:02.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.777 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.777 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607673+0000", 2024-09-12T16:18:02.777 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3340000000000001e-05 2024-09-12T16:18:02.777 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.777 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.777 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.777 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5634 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 692224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:02.777 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556324+0000", 2024-09-12T16:18:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.2004845310000001, 2024-09-12T16:18:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.05149252, 2024-09-12T16:18:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5634 2024-09-12T16:18:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556324+0000", 2024-09-12T16:18:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556324+0000", 2024-09-12T16:18:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556324+0000", 2024-09-12T16:18:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1900000000000002e-07 2024-09-12T16:18:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556327+0000", 2024-09-12T16:18:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T16:18:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556334+0000", 2024-09-12T16:18:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3919999999999997e-06 2024-09-12T16:18:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556341+0000", 2024-09-12T16:18:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6000000000000003e-06 2024-09-12T16:18:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607704+0000", 2024-09-12T16:18:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051363233000000001 2024-09-12T16:18:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607764+0000", 2024-09-12T16:18:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9871000000000003e-05 2024-09-12T16:18:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607816+0000", 2024-09-12T16:18:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2374999999999999e-05 2024-09-12T16:18:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5635 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 745472~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556348+0000", 2024-09-12T16:18:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.2004599599999999, 2024-09-12T16:18:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051607838000000003, 2024-09-12T16:18:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5635 2024-09-12T16:18:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556348+0000", 2024-09-12T16:18:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556348+0000", 2024-09-12T16:18:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556349+0000", 2024-09-12T16:18:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.75e-07 2024-09-12T16:18:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556351+0000", 2024-09-12T16:18:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1890000000000001e-06 2024-09-12T16:18:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556358+0000", 2024-09-12T16:18:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.922e-06 2024-09-12T16:18:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556363+0000", 2024-09-12T16:18:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.242e-06 2024-09-12T16:18:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607846+0000", 2024-09-12T16:18:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051482433000000001 2024-09-12T16:18:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607886+0000", 2024-09-12T16:18:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0290999999999998e-05 2024-09-12T16:18:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607956+0000", 2024-09-12T16:18:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0285999999999998e-05 2024-09-12T16:18:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5636 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 806912~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556371+0000", 2024-09-12T16:18:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.2004377820000001, 2024-09-12T16:18:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051725921000000001, 2024-09-12T16:18:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5636 2024-09-12T16:18:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556371+0000", 2024-09-12T16:18:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556371+0000", 2024-09-12T16:18:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556371+0000", 2024-09-12T16:18:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9800000000000004e-07 2024-09-12T16:18:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556373+0000", 2024-09-12T16:18:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0490000000000002e-06 2024-09-12T16:18:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556380+0000", 2024-09-12T16:18:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6050000000000003e-06 2024-09-12T16:18:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556385+0000", 2024-09-12T16:18:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2449999999999998e-06 2024-09-12T16:18:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607993+0000", 2024-09-12T16:18:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051608182000000002 2024-09-12T16:18:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608035+0000", 2024-09-12T16:18:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1698e-05 2024-09-12T16:18:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608096+0000", 2024-09-12T16:18:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1643999999999995e-05 2024-09-12T16:18:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5637 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 860160~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556393+0000", 2024-09-12T16:18:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.200415131, 2024-09-12T16:18:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051839035999999998, 2024-09-12T16:18:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5637 2024-09-12T16:18:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556393+0000", 2024-09-12T16:18:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556393+0000", 2024-09-12T16:18:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556394+0000", 2024-09-12T16:18:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3000000000000001e-07 2024-09-12T16:18:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556396+0000", 2024-09-12T16:18:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0839999999999999e-06 2024-09-12T16:18:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556402+0000", 2024-09-12T16:18:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6919999999999996e-06 2024-09-12T16:18:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556408+0000", 2024-09-12T16:18:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2800000000000003e-06 2024-09-12T16:18:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.794 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608129+0000", 2024-09-12T16:18:02.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051720902999999999 2024-09-12T16:18:02.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.794 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608174+0000", 2024-09-12T16:18:02.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5676000000000001e-05 2024-09-12T16:18:02.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.794 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608232+0000", 2024-09-12T16:18:02.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7970999999999998e-05 2024-09-12T16:18:02.794 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.795 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.795 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.795 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5638 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 913408~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:02.795 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556415+0000", 2024-09-12T16:18:02.795 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.200393737, 2024-09-12T16:18:02.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051949532999999999, 2024-09-12T16:18:02.795 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.796 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.796 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:02.796 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.796 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:02.796 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:02.796 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5638 2024-09-12T16:18:02.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.796 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556415+0000", 2024-09-12T16:18:02.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.797 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.797 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556415+0000", 2024-09-12T16:18:02.797 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.797 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.797 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556415+0000", 2024-09-12T16:18:02.797 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7199999999999999e-07 2024-09-12T16:18:02.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.797 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.797 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556417+0000", 2024-09-12T16:18:02.798 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0279999999999999e-06 2024-09-12T16:18:02.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.798 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.798 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556424+0000", 2024-09-12T16:18:02.798 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6950000000000003e-06 2024-09-12T16:18:02.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.798 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.798 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556429+0000", 2024-09-12T16:18:02.798 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3059999999999997e-06 2024-09-12T16:18:02.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.798 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.798 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608260+0000", 2024-09-12T16:18:02.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051831254 2024-09-12T16:18:02.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608306+0000", 2024-09-12T16:18:02.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5976999999999997e-05 2024-09-12T16:18:02.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608364+0000", 2024-09-12T16:18:02.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7800999999999998e-05 2024-09-12T16:18:02.799 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.799 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.799 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.800 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5639 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 966656~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:02.800 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556436+0000", 2024-09-12T16:18:02.800 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.200372064, 2024-09-12T16:18:02.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052070419, 2024-09-12T16:18:02.800 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.800 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.800 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:02.800 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.800 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:02.800 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:02.800 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5639 2024-09-12T16:18:02.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.801 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556436+0000", 2024-09-12T16:18:02.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556436+0000", 2024-09-12T16:18:02.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556437+0000", 2024-09-12T16:18:02.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1899999999999998e-07 2024-09-12T16:18:02.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556439+0000", 2024-09-12T16:18:02.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.973e-06 2024-09-12T16:18:02.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556445+0000", 2024-09-12T16:18:02.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7769999999999997e-06 2024-09-12T16:18:02.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556451+0000", 2024-09-12T16:18:02.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.31e-06 2024-09-12T16:18:02.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608397+0000", 2024-09-12T16:18:02.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051945829999999998 2024-09-12T16:18:02.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608438+0000", 2024-09-12T16:18:02.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1539000000000003e-05 2024-09-12T16:18:02.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608507+0000", 2024-09-12T16:18:02.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8571000000000005e-05 2024-09-12T16:18:02.804 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.804 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.804 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.804 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5640 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1019904~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:02.804 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556458+0000", 2024-09-12T16:18:02.804 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.200350552, 2024-09-12T16:18:02.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052171423000000001, 2024-09-12T16:18:02.804 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.804 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.804 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:02.805 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.805 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:02.805 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:02.805 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5640 2024-09-12T16:18:02.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.805 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.805 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556458+0000", 2024-09-12T16:18:02.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556458+0000", 2024-09-12T16:18:02.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556458+0000", 2024-09-12T16:18:02.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2500000000000001e-07 2024-09-12T16:18:02.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556460+0000", 2024-09-12T16:18:02.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.934e-06 2024-09-12T16:18:02.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556468+0000", 2024-09-12T16:18:02.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7950000000000008e-06 2024-09-12T16:18:02.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556473+0000", 2024-09-12T16:18:02.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3539999999999999e-06 2024-09-12T16:18:02.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608539+0000", 2024-09-12T16:18:02.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052065974000000001 2024-09-12T16:18:02.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608579+0000", 2024-09-12T16:18:02.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0238999999999999e-05 2024-09-12T16:18:02.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608629+0000", 2024-09-12T16:18:02.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9701999999999999e-05 2024-09-12T16:18:02.808 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.808 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.808 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.808 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5641 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1081344~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:02.808 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556480+0000", 2024-09-12T16:18:02.809 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.200327943, 2024-09-12T16:18:02.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052284826999999999, 2024-09-12T16:18:02.809 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.809 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.809 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:02.809 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.809 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:02.809 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:02.809 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5641 2024-09-12T16:18:02.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.809 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556480+0000", 2024-09-12T16:18:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556480+0000", 2024-09-12T16:18:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556481+0000", 2024-09-12T16:18:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.27e-07 2024-09-12T16:18:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556483+0000", 2024-09-12T16:18:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9379999999999999e-06 2024-09-12T16:18:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556489+0000", 2024-09-12T16:18:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5910000000000001e-06 2024-09-12T16:18:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556495+0000", 2024-09-12T16:18:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5600000000000001e-06 2024-09-12T16:18:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608659+0000", 2024-09-12T16:18:02.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052164489000000001 2024-09-12T16:18:02.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608714+0000", 2024-09-12T16:18:02.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4849999999999998e-05 2024-09-12T16:18:02.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608765+0000", 2024-09-12T16:18:02.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0971999999999999e-05 2024-09-12T16:18:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5642 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1134592~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556502+0000", 2024-09-12T16:18:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.2003060480000001, 2024-09-12T16:18:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052404536000000002, 2024-09-12T16:18:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:02.814 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:02.814 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5642 2024-09-12T16:18:02.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.814 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556502+0000", 2024-09-12T16:18:02.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556502+0000", 2024-09-12T16:18:02.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556503+0000", 2024-09-12T16:18:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8599999999999998e-07 2024-09-12T16:18:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556505+0000", 2024-09-12T16:18:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.097e-06 2024-09-12T16:18:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556512+0000", 2024-09-12T16:18:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8229999999999997e-06 2024-09-12T16:18:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556517+0000", 2024-09-12T16:18:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6289999999999998e-06 2024-09-12T16:18:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608797+0000", 2024-09-12T16:18:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052279651000000003 2024-09-12T16:18:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608852+0000", 2024-09-12T16:18:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4994999999999998e-05 2024-09-12T16:18:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608907+0000", 2024-09-12T16:18:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4755e-05 2024-09-12T16:18:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5643 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1187840~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556525+0000", 2024-09-12T16:18:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.2002838060000001, 2024-09-12T16:18:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052518288000000003, 2024-09-12T16:18:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5643 2024-09-12T16:18:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556525+0000", 2024-09-12T16:18:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556525+0000", 2024-09-12T16:18:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556525+0000", 2024-09-12T16:18:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0400000000000002e-07 2024-09-12T16:18:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556528+0000", 2024-09-12T16:18:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8679999999999999e-06 2024-09-12T16:18:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556536+0000", 2024-09-12T16:18:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3089999999999996e-06 2024-09-12T16:18:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.820 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.820 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556541+0000", 2024-09-12T16:18:02.820 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3120000000000001e-06 2024-09-12T16:18:02.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.820 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.820 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608943+0000", 2024-09-12T16:18:02.820 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052401089999999997 2024-09-12T16:18:02.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.820 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.820 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608991+0000", 2024-09-12T16:18:02.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8633e-05 2024-09-12T16:18:02.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.821 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.821 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609043+0000", 2024-09-12T16:18:02.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1672000000000003e-05 2024-09-12T16:18:02.821 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.821 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.821 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.821 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5644 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1241088~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:02.822 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556548+0000", 2024-09-12T16:18:02.822 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.200260273, 2024-09-12T16:18:02.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052634777000000001, 2024-09-12T16:18:02.822 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.822 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.822 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:02.822 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.822 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:02.822 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:02.822 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5644 2024-09-12T16:18:02.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.822 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.823 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.823 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.823 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556548+0000", 2024-09-12T16:18:02.823 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.823 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.823 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.823 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556548+0000", 2024-09-12T16:18:02.823 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.823 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.823 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.823 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556549+0000", 2024-09-12T16:18:02.823 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1900000000000003e-07 2024-09-12T16:18:02.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.824 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.824 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556555+0000", 2024-09-12T16:18:02.824 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.652e-06 2024-09-12T16:18:02.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.824 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.824 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556562+0000", 2024-09-12T16:18:02.824 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.905e-06 2024-09-12T16:18:02.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.824 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.824 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556567+0000", 2024-09-12T16:18:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1730000000000003e-06 2024-09-12T16:18:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609079+0000", 2024-09-12T16:18:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052511993 2024-09-12T16:18:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609125+0000", 2024-09-12T16:18:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5327000000000002e-05 2024-09-12T16:18:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609183+0000", 2024-09-12T16:18:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8208000000000002e-05 2024-09-12T16:18:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5645 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1294336~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556574+0000", 2024-09-12T16:18:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.2002338749999999, 2024-09-12T16:18:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052876909999999999, 2024-09-12T16:18:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5645 2024-09-12T16:18:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556574+0000", 2024-09-12T16:18:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556574+0000", 2024-09-12T16:18:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556575+0000", 2024-09-12T16:18:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.89e-07 2024-09-12T16:18:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556577+0000", 2024-09-12T16:18:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8700000000000001e-06 2024-09-12T16:18:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.829 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556583+0000", 2024-09-12T16:18:02.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4320000000000004e-06 2024-09-12T16:18:02.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.829 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.829 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556589+0000", 2024-09-12T16:18:02.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3890000000000004e-06 2024-09-12T16:18:02.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.829 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.829 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609236+0000", 2024-09-12T16:18:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052647022000000002 2024-09-12T16:18:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609334+0000", 2024-09-12T16:18:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8039000000000001e-05 2024-09-12T16:18:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609451+0000", 2024-09-12T16:18:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117769 2024-09-12T16:18:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5646 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1355776~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556595+0000", 2024-09-12T16:18:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.2002128940000001, 2024-09-12T16:18:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053088173000000002, 2024-09-12T16:18:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5646 2024-09-12T16:18:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556595+0000", 2024-09-12T16:18:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556595+0000", 2024-09-12T16:18:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556596+0000", 2024-09-12T16:18:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:18:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556598+0000", 2024-09-12T16:18:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0669999999999999e-06 2024-09-12T16:18:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556603+0000", 2024-09-12T16:18:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5210000000000002e-06 2024-09-12T16:18:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556609+0000", 2024-09-12T16:18:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1590000000000001e-06 2024-09-12T16:18:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609499+0000", 2024-09-12T16:18:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052890489999999998 2024-09-12T16:18:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609586+0000", 2024-09-12T16:18:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6681999999999994e-05 2024-09-12T16:18:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609684+0000", 2024-09-12T16:18:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7863999999999997e-05 2024-09-12T16:18:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.835 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.835 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.835 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5647 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1409024~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:02.835 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556616+0000", 2024-09-12T16:18:02.835 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.200192599, 2024-09-12T16:18:02.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053207888000000002, 2024-09-12T16:18:02.835 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.835 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.835 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:02.835 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.835 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:02.835 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5647 2024-09-12T16:18:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556616+0000", 2024-09-12T16:18:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556616+0000", 2024-09-12T16:18:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556616+0000", 2024-09-12T16:18:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3599999999999999e-07 2024-09-12T16:18:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556618+0000", 2024-09-12T16:18:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1550000000000001e-06 2024-09-12T16:18:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556624+0000", 2024-09-12T16:18:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0499999999999997e-06 2024-09-12T16:18:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556629+0000", 2024-09-12T16:18:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8840000000000002e-06 2024-09-12T16:18:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609721+0000", 2024-09-12T16:18:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053091808999999997 2024-09-12T16:18:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609767+0000", 2024-09-12T16:18:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.638e-05 2024-09-12T16:18:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609824+0000", 2024-09-12T16:18:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6174000000000001e-05 2024-09-12T16:18:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5648 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1462272~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556636+0000", 2024-09-12T16:18:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.2001719399999999, 2024-09-12T16:18:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053322131000000002, 2024-09-12T16:18:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5648 2024-09-12T16:18:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556636+0000", 2024-09-12T16:18:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556636+0000", 2024-09-12T16:18:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557015+0000", 2024-09-12T16:18:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000378911 2024-09-12T16:18:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557019+0000", 2024-09-12T16:18:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2100000000000002e-06 2024-09-12T16:18:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557030+0000", 2024-09-12T16:18:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.149e-05 2024-09-12T16:18:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557037+0000", 2024-09-12T16:18:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5719999999999999e-06 2024-09-12T16:18:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609838+0000", 2024-09-12T16:18:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052801305999999999 2024-09-12T16:18:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609880+0000", 2024-09-12T16:18:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2604000000000001e-05 2024-09-12T16:18:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609959+0000", 2024-09-12T16:18:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8038000000000001e-05 2024-09-12T16:18:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5649 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1515520~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.557073+0000", 2024-09-12T16:18:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.1997349390000001, 2024-09-12T16:18:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053030573999999997, 2024-09-12T16:18:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.844 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.844 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:02.844 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.844 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:02.844 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:02.844 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5649 2024-09-12T16:18:02.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.844 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557073+0000", 2024-09-12T16:18:02.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557073+0000", 2024-09-12T16:18:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557074+0000", 2024-09-12T16:18:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5199999999999996e-07 2024-09-12T16:18:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557084+0000", 2024-09-12T16:18:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0349e-05 2024-09-12T16:18:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557092+0000", 2024-09-12T16:18:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9699999999999999e-06 2024-09-12T16:18:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557100+0000", 2024-09-12T16:18:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7049999999999999e-06 2024-09-12T16:18:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609992+0000", 2024-09-12T16:18:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052891821999999998 2024-09-12T16:18:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610034+0000", 2024-09-12T16:18:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2141000000000002e-05 2024-09-12T16:18:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610104+0000", 2024-09-12T16:18:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9935e-05 2024-09-12T16:18:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5650 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1568768~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.557111+0000", 2024-09-12T16:18:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.1996977170000001, 2024-09-12T16:18:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053118023, 2024-09-12T16:18:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5650 2024-09-12T16:18:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:02.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:02.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557111+0000", 2024-09-12T16:18:02.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:02.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557111+0000", 2024-09-12T16:18:02.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:02.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:02.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.562089+0000", 2024-09-12T16:18:02.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0049787410000000001 2024-09-12T16:18:02.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:02.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.562094+0000", 2024-09-12T16:18:02.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7210000000000002e-06 2024-09-12T16:18:02.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:02.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.562105+0000", 2024-09-12T16:18:02.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0458999999999999e-05 2024-09-12T16:18:02.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:02.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.562112+0000", 2024-09-12T16:18:02.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0280000000000003e-06 2024-09-12T16:18:02.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:02.851 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610135+0000", 2024-09-12T16:18:02.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048023374000000001 2024-09-12T16:18:02.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:02.851 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610177+0000", 2024-09-12T16:18:02.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2119000000000001e-05 2024-09-12T16:18:02.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:02.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:02.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:02.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610229+0000", 2024-09-12T16:18:02.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1581e-05 2024-09-12T16:18:02.852 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.852 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.852 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.852 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:02.852 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:02.852 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:02.854 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:18:02.854 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:02.852+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:02.954 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:02.953+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:02.969 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:02.969 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:02.969 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:18:02.969 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:02.978 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:18:03.053 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:18:03.053 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:03.053 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 114, 2024-09-12T16:18:03.053 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "66dcb8ed-8de5-4784-8071-fd6b3bf3b78f", 2024-09-12T16:18:03.053 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2024-09-12T16:15:28.208893+0000", 2024-09-12T16:18:03.053 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2024-09-12T16:18:02.044387+0000", 2024-09-12T16:18:03.053 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2024-09-12T16:17:03.223056+0000", 2024-09-12T16:18:03.053 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2024-09-12T16:17:47.369306+0000", 2024-09-12T16:18:03.053 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T16:18:03.053 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5804032, 2024-09-12T16:18:03.054 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2024-09-12T16:18:03.054 INFO:teuthology.orchestra.run.smithi017.stdout: "nodeep-scrub", 2024-09-12T16:18:03.054 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2024-09-12T16:18:03.054 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2024-09-12T16:18:03.054 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2024-09-12T16:18:03.054 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2024-09-12T16:18:03.054 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-12T16:18:03.054 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 5, 2024-09-12T16:18:03.054 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T16:18:03.054 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T16:18:03.054 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T16:18:03.054 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2024-09-12T16:18:03.054 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 3, 2024-09-12T16:18:03.054 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 6, 2024-09-12T16:18:03.055 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2024-09-12T16:18:03.055 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "jewel", 2024-09-12T16:18:03.055 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "squid", 2024-09-12T16:18:03.055 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2024-09-12T16:18:03.055 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2024-09-12T16:18:03.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.055 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2024-09-12T16:18:03.055 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2024-09-12T16:18:03.055 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2024-09-12T16:15:40.677216+0000", 2024-09-12T16:18:03.055 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-12T16:18:03.055 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2024-09-12T16:18:03.055 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2024-09-12T16:18:03.055 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2024-09-12T16:18:03.055 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2024-09-12T16:18:03.056 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2024-09-12T16:18:03.056 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2024-09-12T16:18:03.056 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2024-09-12T16:18:03.056 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T16:18:03.056 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T16:18:03.056 INFO:teuthology.orchestra.run.smithi017.stdout: "is_stretch_pool": false, 2024-09-12T16:18:03.056 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2024-09-12T16:18:03.056 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2024-09-12T16:18:03.056 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2024-09-12T16:18:03.056 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2024-09-12T16:18:03.056 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2024-09-12T16:18:03.056 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2024-09-12T16:18:03.056 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2024-09-12T16:18:03.056 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2024-09-12T16:18:03.057 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2024-09-12T16:18:03.057 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2024-09-12T16:18:03.057 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2024-09-12T16:18:03.057 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2024-09-12T16:18:03.057 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2024-09-12T16:18:03.057 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2024-09-12T16:18:03.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.057 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "15", 2024-09-12T16:18:03.057 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2024-09-12T16:18:03.057 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T16:18:03.057 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T16:18:03.057 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2024-09-12T16:18:03.057 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2024-09-12T16:18:03.057 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2024-09-12T16:18:03.058 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2024-09-12T16:18:03.058 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2024-09-12T16:18:03.058 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2024-09-12T16:18:03.058 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2024-09-12T16:18:03.058 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2024-09-12T16:18:03.058 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2024-09-12T16:18:03.058 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2024-09-12T16:18:03.058 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2024-09-12T16:18:03.058 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2024-09-12T16:18:03.058 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2024-09-12T16:18:03.058 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2024-09-12T16:18:03.058 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2024-09-12T16:18:03.058 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T16:18:03.058 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T16:18:03.058 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T16:18:03.059 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2024-09-12T16:18:03.059 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2024-09-12T16:18:03.059 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2024-09-12T16:18:03.059 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2024-09-12T16:18:03.059 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2024-09-12T16:18:03.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.059 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2024-09-12T16:18:03.059 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2024-09-12T16:18:03.059 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2024-09-12T16:18:03.059 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2024-09-12T16:18:03.059 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2024-09-12T16:18:03.059 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T16:18:03.059 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2024-09-12T16:18:03.059 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2024-09-12T16:18:03.059 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2024-09-12T16:18:03.059 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2024-09-12T16:18:03.060 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2024-09-12T16:18:03.060 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2024-09-12T16:18:03.060 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2024-09-12T16:18:03.060 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2024-09-12T16:18:03.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.060 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2024-09-12T16:18:03.060 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2024-09-12T16:18:03.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.060 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2024-09-12T16:18:03.060 INFO:teuthology.orchestra.run.smithi017.stdout: "score_type": "Fair distribution", 2024-09-12T16:18:03.060 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 6.059999942779541, 2024-09-12T16:18:03.060 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 6.059999942779541, 2024-09-12T16:18:03.060 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.33000001311302185, 2024-09-12T16:18:03.060 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2024-09-12T16:18:03.061 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2024-09-12T16:18:03.061 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 0.84821069240570068, 2024-09-12T16:18:03.061 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 0.85000002384185791, 2024-09-12T16:18:03.061 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 0.85000002384185791 2024-09-12T16:18:03.061 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:03.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.061 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2024-09-12T16:18:03.061 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2024-09-12T16:18:03.061 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2024-09-12T16:15:45.306180+0000", 2024-09-12T16:18:03.061 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 8193, 2024-09-12T16:18:03.061 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T16:18:03.061 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2024-09-12T16:18:03.061 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2024-09-12T16:18:03.061 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2024-09-12T16:18:03.062 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2024-09-12T16:18:03.062 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2024-09-12T16:18:03.062 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2024-09-12T16:18:03.062 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T16:18:03.062 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T16:18:03.062 INFO:teuthology.orchestra.run.smithi017.stdout: "is_stretch_pool": false, 2024-09-12T16:18:03.062 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2024-09-12T16:18:03.062 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2024-09-12T16:18:03.062 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2024-09-12T16:18:03.062 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2024-09-12T16:18:03.062 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2024-09-12T16:18:03.062 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2024-09-12T16:18:03.062 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2024-09-12T16:18:03.062 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2024-09-12T16:18:03.062 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2024-09-12T16:18:03.063 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2024-09-12T16:18:03.063 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2024-09-12T16:18:03.063 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2024-09-12T16:18:03.063 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2024-09-12T16:18:03.063 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2024-09-12T16:18:03.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.063 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "19", 2024-09-12T16:18:03.063 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2024-09-12T16:18:03.063 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T16:18:03.063 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T16:18:03.063 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2024-09-12T16:18:03.063 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2024-09-12T16:18:03.063 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 2, 2024-09-12T16:18:03.063 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 19, 2024-09-12T16:18:03.063 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2024-09-12T16:18:03.064 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2024-09-12T16:18:03.064 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2024-09-12T16:18:03.064 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2024-09-12T16:18:03.064 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2024-09-12T16:18:03.064 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2024-09-12T16:18:03.064 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2024-09-12T16:18:03.064 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2024-09-12T16:18:03.064 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2024-09-12T16:18:03.064 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2024-09-12T16:18:03.064 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2024-09-12T16:18:03.064 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T16:18:03.064 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T16:18:03.064 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T16:18:03.065 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2024-09-12T16:18:03.065 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2024-09-12T16:18:03.065 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2024-09-12T16:18:03.065 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2024-09-12T16:18:03.065 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2024-09-12T16:18:03.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.065 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2024-09-12T16:18:03.065 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2024-09-12T16:18:03.065 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2024-09-12T16:18:03.065 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2024-09-12T16:18:03.065 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2024-09-12T16:18:03.065 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T16:18:03.065 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2024-09-12T16:18:03.065 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2024-09-12T16:18:03.065 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2024-09-12T16:18:03.066 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2024-09-12T16:18:03.066 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2024-09-12T16:18:03.066 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2024-09-12T16:18:03.066 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2024-09-12T16:18:03.066 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2024-09-12T16:18:03.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.066 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2024-09-12T16:18:03.066 INFO:teuthology.orchestra.run.smithi017.stdout: "score_type": "Fair distribution", 2024-09-12T16:18:03.066 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 2.2699999809265137, 2024-09-12T16:18:03.066 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 2.2699999809265137, 2024-09-12T16:18:03.066 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.82999998331069946, 2024-09-12T16:18:03.066 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.8799999952316284, 2024-09-12T16:18:03.066 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.8799999952316284, 2024-09-12T16:18:03.066 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 0.84821069240570068, 2024-09-12T16:18:03.066 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 0.85000002384185791, 2024-09-12T16:18:03.066 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 0.85000002384185791 2024-09-12T16:18:03.067 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:03.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.067 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 3, 2024-09-12T16:18:03.067 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "pool_client.0", 2024-09-12T16:18:03.067 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2024-09-12T16:15:55.082975+0000", 2024-09-12T16:18:03.067 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 8193, 2024-09-12T16:18:03.067 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T16:18:03.067 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2024-09-12T16:18:03.067 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2024-09-12T16:18:03.067 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2024-09-12T16:18:03.067 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2024-09-12T16:18:03.067 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2024-09-12T16:18:03.067 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2024-09-12T16:18:03.067 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T16:18:03.068 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T16:18:03.068 INFO:teuthology.orchestra.run.smithi017.stdout: "is_stretch_pool": false, 2024-09-12T16:18:03.068 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2024-09-12T16:18:03.068 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2024-09-12T16:18:03.068 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2024-09-12T16:18:03.068 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2024-09-12T16:18:03.068 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2024-09-12T16:18:03.068 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2024-09-12T16:18:03.068 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2024-09-12T16:18:03.068 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2024-09-12T16:18:03.068 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2024-09-12T16:18:03.068 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2024-09-12T16:18:03.068 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2024-09-12T16:18:03.068 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2024-09-12T16:18:03.068 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2024-09-12T16:18:03.069 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2024-09-12T16:18:03.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.069 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "113", 2024-09-12T16:18:03.069 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2024-09-12T16:18:03.069 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T16:18:03.069 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T16:18:03.069 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2024-09-12T16:18:03.069 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2024-09-12T16:18:03.069 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 43, 2024-09-12T16:18:03.069 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 113, 2024-09-12T16:18:03.069 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2024-09-12T16:18:03.069 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2024-09-12T16:18:03.069 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2024-09-12T16:18:03.069 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2024-09-12T16:18:03.070 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2024-09-12T16:18:03.070 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2024-09-12T16:18:03.070 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2024-09-12T16:18:03.070 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2024-09-12T16:18:03.070 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2024-09-12T16:18:03.070 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2024-09-12T16:18:03.070 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2024-09-12T16:18:03.070 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T16:18:03.070 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T16:18:03.070 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T16:18:03.070 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2024-09-12T16:18:03.070 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2024-09-12T16:18:03.070 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2024-09-12T16:18:03.070 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2024-09-12T16:18:03.071 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2024-09-12T16:18:03.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.071 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2024-09-12T16:18:03.071 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2024-09-12T16:18:03.071 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2024-09-12T16:18:03.071 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2024-09-12T16:18:03.071 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2024-09-12T16:18:03.071 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T16:18:03.071 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2024-09-12T16:18:03.071 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2024-09-12T16:18:03.071 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2024-09-12T16:18:03.071 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2024-09-12T16:18:03.071 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2024-09-12T16:18:03.071 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2024-09-12T16:18:03.072 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2024-09-12T16:18:03.072 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2024-09-12T16:18:03.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.072 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2024-09-12T16:18:03.072 INFO:teuthology.orchestra.run.smithi017.stdout: "score_type": "Fair distribution", 2024-09-12T16:18:03.072 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.5099999904632568, 2024-09-12T16:18:03.072 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.5099999904632568, 2024-09-12T16:18:03.072 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.82999998331069946, 2024-09-12T16:18:03.072 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.25, 2024-09-12T16:18:03.072 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.25, 2024-09-12T16:18:03.072 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 0.84821069240570068, 2024-09-12T16:18:03.072 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 0.85000002384185791, 2024-09-12T16:18:03.072 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 0.85000002384185791 2024-09-12T16:18:03.072 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:03.072 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:03.073 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-12T16:18:03.073 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2024-09-12T16:18:03.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.073 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2024-09-12T16:18:03.073 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "aabea24b-3f1f-4555-80c3-5caecf2e2001", 2024-09-12T16:18:03.073 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-12T16:18:03.073 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-12T16:18:03.073 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-12T16:18:03.073 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-12T16:18:03.073 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-12T16:18:03.073 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-12T16:18:03.073 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 11, 2024-09-12T16:18:03.073 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 106, 2024-09-12T16:18:03.073 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-12T16:18:03.074 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-12T16:18:03.074 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-12T16:18:03.074 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:03.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.074 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:03.074 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2024-09-12T16:18:03.074 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1385915755 2024-09-12T16:18:03.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.074 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:03.074 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2024-09-12T16:18:03.074 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1385915755 2024-09-12T16:18:03.074 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:03.074 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:03.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.075 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-12T16:18:03.075 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:03.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.075 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:03.075 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2024-09-12T16:18:03.075 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1385915755 2024-09-12T16:18:03.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.075 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:03.075 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2024-09-12T16:18:03.075 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1385915755 2024-09-12T16:18:03.075 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:03.075 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:03.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.076 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-12T16:18:03.076 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:03.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.076 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:03.076 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2024-09-12T16:18:03.076 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1385915755 2024-09-12T16:18:03.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.076 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:03.076 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2024-09-12T16:18:03.076 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1385915755 2024-09-12T16:18:03.076 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:03.077 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:03.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.077 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-12T16:18:03.077 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:03.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.077 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:03.077 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2024-09-12T16:18:03.077 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1385915755 2024-09-12T16:18:03.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.077 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:03.077 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2024-09-12T16:18:03.077 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1385915755 2024-09-12T16:18:03.077 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:03.078 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:03.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.078 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1385915755", 2024-09-12T16:18:03.078 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1385915755", 2024-09-12T16:18:03.078 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1385915755", 2024-09-12T16:18:03.078 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1385915755", 2024-09-12T16:18:03.078 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-12T16:18:03.078 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-12T16:18:03.078 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-12T16:18:03.078 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:03.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.078 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2024-09-12T16:18:03.078 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "7a17ca3b-8e49-4d92-a633-45d3e4a45b4e", 2024-09-12T16:18:03.078 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-12T16:18:03.079 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-12T16:18:03.079 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-12T16:18:03.079 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-12T16:18:03.079 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-12T16:18:03.079 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-12T16:18:03.079 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 11, 2024-09-12T16:18:03.079 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 106, 2024-09-12T16:18:03.079 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-12T16:18:03.079 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-12T16:18:03.079 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-12T16:18:03.079 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:03.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.079 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:03.079 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2024-09-12T16:18:03.080 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3906173234 2024-09-12T16:18:03.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.080 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:03.080 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2024-09-12T16:18:03.080 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3906173234 2024-09-12T16:18:03.080 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:03.080 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:03.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.080 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-12T16:18:03.080 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:03.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.080 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:03.080 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2024-09-12T16:18:03.081 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3906173234 2024-09-12T16:18:03.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.081 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:03.081 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2024-09-12T16:18:03.081 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3906173234 2024-09-12T16:18:03.081 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:03.081 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:03.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.081 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-12T16:18:03.081 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:03.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.081 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:03.081 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2024-09-12T16:18:03.081 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3906173234 2024-09-12T16:18:03.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.082 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:03.082 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2024-09-12T16:18:03.082 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3906173234 2024-09-12T16:18:03.082 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:03.082 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:03.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.082 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-12T16:18:03.082 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:03.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.082 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:03.082 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2024-09-12T16:18:03.082 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3906173234 2024-09-12T16:18:03.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.083 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:03.083 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2024-09-12T16:18:03.083 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3906173234 2024-09-12T16:18:03.083 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:03.083 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:03.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.083 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/3906173234", 2024-09-12T16:18:03.083 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/3906173234", 2024-09-12T16:18:03.083 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/3906173234", 2024-09-12T16:18:03.083 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/3906173234", 2024-09-12T16:18:03.083 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-12T16:18:03.083 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-12T16:18:03.083 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-12T16:18:03.084 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:03.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.084 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2024-09-12T16:18:03.084 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "dae09a32-24c6-464c-bee8-04ef2c42f7e4", 2024-09-12T16:18:03.084 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-12T16:18:03.084 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-12T16:18:03.084 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-12T16:18:03.084 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-12T16:18:03.084 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-12T16:18:03.084 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-12T16:18:03.084 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 11, 2024-09-12T16:18:03.084 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 106, 2024-09-12T16:18:03.085 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-12T16:18:03.085 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-12T16:18:03.085 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-12T16:18:03.085 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:03.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.085 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:03.085 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2024-09-12T16:18:03.085 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1974346628 2024-09-12T16:18:03.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.085 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:03.085 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2024-09-12T16:18:03.085 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1974346628 2024-09-12T16:18:03.085 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:03.086 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:03.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.086 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-12T16:18:03.086 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:03.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.086 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:03.086 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2024-09-12T16:18:03.086 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1974346628 2024-09-12T16:18:03.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.086 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:03.086 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2024-09-12T16:18:03.086 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1974346628 2024-09-12T16:18:03.086 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:03.086 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:03.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.087 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-12T16:18:03.087 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:03.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.087 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:03.087 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2024-09-12T16:18:03.087 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1974346628 2024-09-12T16:18:03.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.087 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:03.087 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2024-09-12T16:18:03.087 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1974346628 2024-09-12T16:18:03.087 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:03.088 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:03.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.088 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-12T16:18:03.088 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:03.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.088 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:03.088 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2024-09-12T16:18:03.088 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1974346628 2024-09-12T16:18:03.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.088 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:03.088 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2024-09-12T16:18:03.088 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1974346628 2024-09-12T16:18:03.088 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:03.088 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:03.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.089 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/1974346628", 2024-09-12T16:18:03.089 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/1974346628", 2024-09-12T16:18:03.089 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/1974346628", 2024-09-12T16:18:03.089 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/1974346628", 2024-09-12T16:18:03.089 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-12T16:18:03.089 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-12T16:18:03.089 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-12T16:18:03.089 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:03.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.089 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2024-09-12T16:18:03.089 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "9cc5463c-cdb4-4a6a-b526-39a60de417f4", 2024-09-12T16:18:03.089 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-12T16:18:03.089 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-12T16:18:03.090 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-12T16:18:03.090 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-12T16:18:03.090 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-12T16:18:03.090 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-12T16:18:03.090 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 11, 2024-09-12T16:18:03.090 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 106, 2024-09-12T16:18:03.090 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-12T16:18:03.090 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-12T16:18:03.090 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-12T16:18:03.090 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:03.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.090 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:03.090 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6808", 2024-09-12T16:18:03.090 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3370202675 2024-09-12T16:18:03.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.091 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:03.091 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6809", 2024-09-12T16:18:03.091 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3370202675 2024-09-12T16:18:03.091 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:03.091 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:03.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.091 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-12T16:18:03.091 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:03.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.091 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:03.091 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6810", 2024-09-12T16:18:03.091 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3370202675 2024-09-12T16:18:03.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.092 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:03.092 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6811", 2024-09-12T16:18:03.092 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3370202675 2024-09-12T16:18:03.092 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:03.092 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:03.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.093 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-12T16:18:03.093 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:03.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.093 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:03.093 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6814", 2024-09-12T16:18:03.094 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3370202675 2024-09-12T16:18:03.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.094 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:03.094 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6815", 2024-09-12T16:18:03.094 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3370202675 2024-09-12T16:18:03.094 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:03.094 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:03.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.094 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-12T16:18:03.094 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:03.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.095 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:03.095 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6812", 2024-09-12T16:18:03.095 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3370202675 2024-09-12T16:18:03.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.095 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:03.095 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6813", 2024-09-12T16:18:03.095 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3370202675 2024-09-12T16:18:03.095 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:03.095 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:03.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.095 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.47:6809/3370202675", 2024-09-12T16:18:03.095 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.47:6811/3370202675", 2024-09-12T16:18:03.096 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.47:6815/3370202675", 2024-09-12T16:18:03.096 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.47:6813/3370202675", 2024-09-12T16:18:03.096 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-12T16:18:03.096 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-12T16:18:03.096 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-12T16:18:03.096 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:03.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.096 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2024-09-12T16:18:03.096 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "1e329af3-a88a-4a95-b822-01519079084b", 2024-09-12T16:18:03.096 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-12T16:18:03.096 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-12T16:18:03.096 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-12T16:18:03.097 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-12T16:18:03.097 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-12T16:18:03.097 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-12T16:18:03.097 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 11, 2024-09-12T16:18:03.097 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 107, 2024-09-12T16:18:03.097 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-12T16:18:03.097 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-12T16:18:03.097 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-12T16:18:03.097 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:03.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.097 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:03.097 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6816", 2024-09-12T16:18:03.097 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1823488259 2024-09-12T16:18:03.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.098 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:03.098 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6817", 2024-09-12T16:18:03.098 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1823488259 2024-09-12T16:18:03.098 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:03.098 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:03.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.098 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-12T16:18:03.098 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:03.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.098 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:03.098 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6818", 2024-09-12T16:18:03.098 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1823488259 2024-09-12T16:18:03.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.099 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:03.099 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6819", 2024-09-12T16:18:03.099 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1823488259 2024-09-12T16:18:03.099 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:03.099 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:03.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.099 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-12T16:18:03.099 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:03.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.099 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:03.099 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6822", 2024-09-12T16:18:03.099 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1823488259 2024-09-12T16:18:03.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.100 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:03.100 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6823", 2024-09-12T16:18:03.100 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1823488259 2024-09-12T16:18:03.100 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:03.100 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:03.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.100 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-12T16:18:03.100 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:03.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.100 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:03.100 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6820", 2024-09-12T16:18:03.100 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1823488259 2024-09-12T16:18:03.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.101 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:03.101 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6821", 2024-09-12T16:18:03.101 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1823488259 2024-09-12T16:18:03.101 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:03.101 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:03.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.101 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.47:6817/1823488259", 2024-09-12T16:18:03.101 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.47:6819/1823488259", 2024-09-12T16:18:03.101 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.47:6823/1823488259", 2024-09-12T16:18:03.101 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.47:6821/1823488259", 2024-09-12T16:18:03.101 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-12T16:18:03.101 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-12T16:18:03.102 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-12T16:18:03.102 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:03.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.102 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2024-09-12T16:18:03.102 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "c255a252-3afe-4aad-b44c-85820867c960", 2024-09-12T16:18:03.102 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-12T16:18:03.102 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 0, 2024-09-12T16:18:03.102 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 0, 2024-09-12T16:18:03.102 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 0.089263916015625, 2024-09-12T16:18:03.102 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 11, 2024-09-12T16:18:03.102 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 35, 2024-09-12T16:18:03.102 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 71, 2024-09-12T16:18:03.103 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 32, 2024-09-12T16:18:03.103 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 37, 2024-09-12T16:18:03.103 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-12T16:18:03.103 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-12T16:18:03.103 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:03.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.103 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:03.103 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6800", 2024-09-12T16:18:03.103 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2087971028 2024-09-12T16:18:03.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.103 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:03.103 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6801", 2024-09-12T16:18:03.103 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2087971028 2024-09-12T16:18:03.104 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:03.104 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:03.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.104 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-12T16:18:03.104 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:03.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.104 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:03.104 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6802", 2024-09-12T16:18:03.104 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2087971028 2024-09-12T16:18:03.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.104 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:03.105 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6803", 2024-09-12T16:18:03.105 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2087971028 2024-09-12T16:18:03.105 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:03.105 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:03.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.105 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-12T16:18:03.105 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:03.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.105 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:03.105 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6806", 2024-09-12T16:18:03.105 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2087971028 2024-09-12T16:18:03.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.106 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:03.106 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6807", 2024-09-12T16:18:03.106 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2087971028 2024-09-12T16:18:03.106 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:03.106 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:03.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.106 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-12T16:18:03.106 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:03.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.106 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:03.106 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6804", 2024-09-12T16:18:03.106 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2087971028 2024-09-12T16:18:03.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.106 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:03.107 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6805", 2024-09-12T16:18:03.107 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2087971028 2024-09-12T16:18:03.107 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:03.107 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:03.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.107 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.47:6801/2087971028", 2024-09-12T16:18:03.107 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.47:6803/2087971028", 2024-09-12T16:18:03.107 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.47:6807/2087971028", 2024-09-12T16:18:03.107 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.47:6805/2087971028", 2024-09-12T16:18:03.107 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-12T16:18:03.107 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-12T16:18:03.107 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-12T16:18:03.107 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:03.107 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:03.107 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-12T16:18:03.108 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2024-09-12T16:18:03.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.108 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2024-09-12T16:18:03.108 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-12T16:18:03.108 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-12T16:18:03.108 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-12T16:18:03.108 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540719139924082687, 2024-09-12T16:18:03.108 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-12T16:18:03.108 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-12T16:15:35.752566+0000", 2024-09-12T16:18:03.108 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-12T16:18:03.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.108 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2024-09-12T16:18:03.108 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-12T16:18:03.108 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-12T16:18:03.109 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-12T16:18:03.109 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540719139924082687, 2024-09-12T16:18:03.109 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-12T16:18:03.109 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-12T16:15:36.269665+0000", 2024-09-12T16:18:03.109 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-12T16:18:03.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.109 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2024-09-12T16:18:03.109 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-12T16:18:03.109 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-12T16:18:03.109 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-12T16:18:03.109 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540719139924082687, 2024-09-12T16:18:03.109 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-12T16:18:03.110 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-12T16:15:36.524745+0000", 2024-09-12T16:18:03.110 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-12T16:18:03.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.110 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2024-09-12T16:18:03.110 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-12T16:18:03.110 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-12T16:18:03.110 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-12T16:18:03.110 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540719139924082687, 2024-09-12T16:18:03.110 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-12T16:18:03.110 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-12T16:15:36.095607+0000", 2024-09-12T16:18:03.110 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-12T16:18:03.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.110 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2024-09-12T16:18:03.111 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-12T16:18:03.111 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-12T16:18:03.111 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-12T16:18:03.111 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540719139924082687, 2024-09-12T16:18:03.111 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-12T16:18:03.111 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-12T16:15:36.294055+0000", 2024-09-12T16:18:03.111 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-12T16:18:03.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:03.111 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2024-09-12T16:18:03.111 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-12T16:18:03.111 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-12T16:18:03.111 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-12T16:18:03.111 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540719139924082687, 2024-09-12T16:18:03.111 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 65536, 2024-09-12T16:18:03.112 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-12T16:15:36.092708+0000", 2024-09-12T16:18:03.112 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 37 2024-09-12T16:18:03.112 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:03.112 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-12T16:18:03.112 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [], 2024-09-12T16:18:03.112 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [], 2024-09-12T16:18:03.112 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2024-09-12T16:18:03.112 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2024-09-12T16:18:03.112 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2024-09-12T16:18:03.112 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2024-09-12T16:18:03.112 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2024-09-12T16:18:03.112 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2024-09-12T16:18:03.113 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2024-09-12T16:18:03.113 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2024-09-12T16:18:03.113 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2024-09-12T16:18:03.113 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2024-09-12T16:18:03.113 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2024-09-12T16:18:03.113 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2024-09-12T16:18:03.113 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:03.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:03.113 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [], 2024-09-12T16:18:03.113 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [], 2024-09-12T16:18:03.113 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2024-09-12T16:18:03.113 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2024-09-12T16:18:03.113 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2024-09-12T16:18:03.114 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2024-09-12T16:18:03.114 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2024-09-12T16:18:03.114 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2024-09-12T16:18:03.114 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2024-09-12T16:18:03.114 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2024-09-12T16:18:03.114 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2024-09-12T16:18:03.114 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:03.114 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:03.116 INFO:tasks.thrashosds.thrasher:j is {'epoch': 114, 'fsid': '66dcb8ed-8de5-4784-8071-fd6b3bf3b78f', 'created': '2024-09-12T16:15:28.208893+0000', 'modified': '2024-09-12T16:18:02.044387+0000', 'last_up_change': '2024-09-12T16:17:03.223056+0000', 'last_in_change': '2024-09-12T16:17:47.369306+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 6, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T16:15:40.677216+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8482106924057007, 'average_primary_affinity': 0.8500000238418579, 'average_primary_affinity_weighted': 0.8500000238418579}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T16:15:45.306180+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 19, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.2699999809265137, 'score_stable': 2.2699999809265137, 'optimal_score': 0.8299999833106995, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.8482106924057007, 'average_primary_affinity': 0.8500000238418579, 'average_primary_affinity_weighted': 0.8500000238418579}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-12T16:15:55.082975+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '113', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 43, 'snap_epoch': 113, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5099999904632568, 'score_stable': 1.5099999904632568, 'optimal_score': 0.8299999833106995, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 0.8482106924057007, 'average_primary_affinity': 0.8500000238418579, 'average_primary_affinity_weighted': 0.8500000238418579}}], 'osds': [{'osd': 0, 'uuid': 'aabea24b-3f1f-4555-80c3-5caecf2e2001', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 11, 'up_thru': 106, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6800', 'nonce': 1385915755}, {'type': 'v1', 'addr': '172.21.15.17:6801', 'nonce': 1385915755}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6802', 'nonce': 1385915755}, {'type': 'v1', 'addr': '172.21.15.17:6803', 'nonce': 1385915755}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6806', 'nonce': 1385915755}, {'type': 'v1', 'addr': '172.21.15.17:6807', 'nonce': 1385915755}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6804', 'nonce': 1385915755}, {'type': 'v1', 'addr': '172.21.15.17:6805', 'nonce': 1385915755}]}, 'public_addr': '172.21.15.17:6801/1385915755', 'cluster_addr': '172.21.15.17:6803/1385915755', 'heartbeat_back_addr': '172.21.15.17:6807/1385915755', 'heartbeat_front_addr': '172.21.15.17:6805/1385915755', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '7a17ca3b-8e49-4d92-a633-45d3e4a45b4e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 11, 'up_thru': 106, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6808', 'nonce': 3906173234}, {'type': 'v1', 'addr': '172.21.15.17:6809', 'nonce': 3906173234}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6810', 'nonce': 3906173234}, {'type': 'v1', 'addr': '172.21.15.17:6811', 'nonce': 3906173234}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6814', 'nonce': 3906173234}, {'type': 'v1', 'addr': '172.21.15.17:6815', 'nonce': 3906173234}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6812', 'nonce': 3906173234}, {'type': 'v1', 'addr': '172.21.15.17:6813', 'nonce': 3906173234}]}, 'public_addr': '172.21.15.17:6809/3906173234', 'cluster_addr': '172.21.15.17:6811/3906173234', 'heartbeat_back_addr': '172.21.15.17:6815/3906173234', 'heartbeat_front_addr': '172.21.15.17:6813/3906173234', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'dae09a32-24c6-464c-bee8-04ef2c42f7e4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 11, 'up_thru': 106, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6816', 'nonce': 1974346628}, {'type': 'v1', 'addr': '172.21.15.17:6817', 'nonce': 1974346628}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6818', 'nonce': 1974346628}, {'type': 'v1', 'addr': '172.21.15.17:6819', 'nonce': 1974346628}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6822', 'nonce': 1974346628}, {'type': 'v1', 'addr': '172.21.15.17:6823', 'nonce': 1974346628}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6820', 'nonce': 1974346628}, {'type': 'v1', 'addr': '172.21.15.17:6821', 'nonce': 1974346628}]}, 'public_addr': '172.21.15.17:6817/1974346628', 'cluster_addr': '172.21.15.17:6819/1974346628', 'heartbeat_back_addr': '172.21.15.17:6823/1974346628', 'heartbeat_front_addr': '172.21.15.17:6821/1974346628', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '9cc5463c-cdb4-4a6a-b526-39a60de417f4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 11, 'up_thru': 106, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6808', 'nonce': 3370202675}, {'type': 'v1', 'addr': '172.21.15.47:6809', 'nonce': 3370202675}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6810', 'nonce': 3370202675}, {'type': 'v1', 'addr': '172.21.15.47:6811', 'nonce': 3370202675}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6814', 'nonce': 3370202675}, {'type': 'v1', 'addr': '172.21.15.47:6815', 'nonce': 3370202675}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6812', 'nonce': 3370202675}, {'type': 'v1', 'addr': '172.21.15.47:6813', 'nonce': 3370202675}]}, 'public_addr': '172.21.15.47:6809/3370202675', 'cluster_addr': '172.21.15.47:6811/3370202675', 'heartbeat_back_addr': '172.21.15.47:6815/3370202675', 'heartbeat_front_addr': '172.21.15.47:6813/3370202675', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '1e329af3-a88a-4a95-b822-01519079084b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 11, 'up_thru': 107, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6816', 'nonce': 1823488259}, {'type': 'v1', 'addr': '172.21.15.47:6817', 'nonce': 1823488259}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6818', 'nonce': 1823488259}, {'type': 'v1', 'addr': '172.21.15.47:6819', 'nonce': 1823488259}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6822', 'nonce': 1823488259}, {'type': 'v1', 'addr': '172.21.15.47:6823', 'nonce': 1823488259}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6820', 'nonce': 1823488259}, {'type': 'v1', 'addr': '172.21.15.47:6821', 'nonce': 1823488259}]}, 'public_addr': '172.21.15.47:6817/1823488259', 'cluster_addr': '172.21.15.47:6819/1823488259', 'heartbeat_back_addr': '172.21.15.47:6823/1823488259', 'heartbeat_front_addr': '172.21.15.47:6821/1823488259', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'c255a252-3afe-4aad-b44c-85820867c960', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 0.089263916015625, 'last_clean_begin': 11, 'last_clean_end': 35, 'up_from': 71, 'up_thru': 32, 'down_at': 37, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6800', 'nonce': 2087971028}, {'type': 'v1', 'addr': '172.21.15.47:6801', 'nonce': 2087971028}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6802', 'nonce': 2087971028}, {'type': 'v1', 'addr': '172.21.15.47:6803', 'nonce': 2087971028}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6806', 'nonce': 2087971028}, {'type': 'v1', 'addr': '172.21.15.47:6807', 'nonce': 2087971028}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6804', 'nonce': 2087971028}, {'type': 'v1', 'addr': '172.21.15.47:6805', 'nonce': 2087971028}]}, 'public_addr': '172.21.15.47:6801/2087971028', 'cluster_addr': '172.21.15.47:6803/2087971028', 'heartbeat_back_addr': '172.21.15.47:6807/2087971028', 'heartbeat_front_addr': '172.21.15.47:6805/2087971028', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T16:15:35.752566+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T16:15:36.269665+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T16:15:36.524745+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T16:15:36.095607+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T16:15:36.294055+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-12T16:15:36.092708+0000', 'dead_epoch': 37}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T16:18:03.116 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-12T16:18:03.117 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:03.114+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:03.136 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:03.136 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:03.136 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:18:03.136 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:18:03.136 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:03.139 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T16:18:03.145 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:18:03.216 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:03.215+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:03.264 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:18:03.264 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:18:03.280 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:18:03.281 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:18:03.295 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:03.295 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:18:03.295 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:18:03.295 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:18:03.295 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.295 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:18:03.296 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:18:03.296 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 141.529159209, 2024-09-12T16:18:03.296 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55645454900000002, 2024-09-12T16:18:03.296 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:03.296 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:03.296 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:03.296 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:03.296 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:18:03.296 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:18:03.296 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1 2024-09-12T16:18:03.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.296 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:03.297 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.297 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:03.297 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:18:03.297 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.297 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.297 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.297 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:03.297 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:18:03.297 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.297 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.297 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.297 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:03.297 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764440+0000", 2024-09-12T16:18:03.297 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6249999999999999e-06 2024-09-12T16:18:03.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.298 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.298 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:03.298 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764447+0000", 2024-09-12T16:18:03.298 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4939999999999997e-06 2024-09-12T16:18:03.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.298 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.298 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:03.298 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764459+0000", 2024-09-12T16:18:03.298 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1517e-05 2024-09-12T16:18:03.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.298 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.298 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:03.299 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764468+0000", 2024-09-12T16:18:03.299 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7690000000000002e-06 2024-09-12T16:18:03.299 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.299 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.299 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:03.299 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764539+0000", 2024-09-12T16:18:03.299 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1103e-05 2024-09-12T16:18:03.299 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.299 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.299 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:03.299 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764551+0000", 2024-09-12T16:18:03.299 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2687999999999999e-05 2024-09-12T16:18:03.299 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.300 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.300 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:03.300 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319497+0000", 2024-09-12T16:18:03.300 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55494560500000001 2024-09-12T16:18:03.300 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.300 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.300 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:03.300 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319688+0000", 2024-09-12T16:18:03.300 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019105599999999999 2024-09-12T16:18:03.300 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.300 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.300 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:18:03.300 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319842+0000", 2024-09-12T16:18:03.300 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015377699999999999 2024-09-12T16:18:03.301 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.301 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.301 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:18:03.301 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320473+0000", 2024-09-12T16:18:03.301 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00063117100000000003 2024-09-12T16:18:03.301 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.301 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.301 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:03.301 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320825+0000", 2024-09-12T16:18:03.301 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00035202500000000001 2024-09-12T16:18:03.301 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.301 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.301 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:03.302 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320867+0000", 2024-09-12T16:18:03.302 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2005000000000002e-05 2024-09-12T16:18:03.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.302 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.302 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:03.302 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320893+0000", 2024-09-12T16:18:03.302 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5714000000000001e-05 2024-09-12T16:18:03.302 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.302 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:03.302 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.302 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.302 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14034 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5035008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:03.302 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:18:03.303 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 103.772100976, 2024-09-12T16:18:03.303 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053404082999999998, 2024-09-12T16:18:03.303 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:03.303 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:03.303 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:03.303 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:03.303 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:03.303 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:03.303 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14034 2024-09-12T16:18:03.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.303 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:03.303 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.303 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:03.304 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:18:03.304 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.304 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.304 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:03.304 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:18:03.304 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.304 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.304 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:03.304 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521740+0000", 2024-09-12T16:18:03.304 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000243976 2024-09-12T16:18:03.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.304 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.305 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:03.305 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521745+0000", 2024-09-12T16:18:03.305 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1280000000000001e-06 2024-09-12T16:18:03.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.305 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.305 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:03.305 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521757+0000", 2024-09-12T16:18:03.305 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2751e-05 2024-09-12T16:18:03.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.305 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.305 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:03.305 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521771+0000", 2024-09-12T16:18:03.305 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3328e-05 2024-09-12T16:18:03.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.306 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.306 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:03.306 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574710+0000", 2024-09-12T16:18:03.306 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052939358999999998 2024-09-12T16:18:03.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.306 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.306 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:03.306 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574799+0000", 2024-09-12T16:18:03.306 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8893000000000004e-05 2024-09-12T16:18:03.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.306 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.306 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:03.306 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574901+0000", 2024-09-12T16:18:03.307 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101648 2024-09-12T16:18:03.307 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.307 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:03.307 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.307 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.307 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14036 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5043200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:03.307 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:18:03.307 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 103.771641782, 2024-09-12T16:18:03.307 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053426247000000003, 2024-09-12T16:18:03.307 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:03.307 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:03.307 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:03.308 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:03.308 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:03.308 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:03.308 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14036 2024-09-12T16:18:03.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.308 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:03.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:03.308 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:18:03.308 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:03.308 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:18:03.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:03.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522208+0000", 2024-09-12T16:18:03.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025195300000000002 2024-09-12T16:18:03.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:03.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522211+0000", 2024-09-12T16:18:03.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2160000000000002e-06 2024-09-12T16:18:03.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.310 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:03.310 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522223+0000", 2024-09-12T16:18:03.310 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2044e-05 2024-09-12T16:18:03.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.310 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.310 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:03.310 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522229+0000", 2024-09-12T16:18:03.310 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8850000000000004e-06 2024-09-12T16:18:03.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.310 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.310 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:03.310 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575192+0000", 2024-09-12T16:18:03.310 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052963573 2024-09-12T16:18:03.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.311 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.311 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:03.311 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575282+0000", 2024-09-12T16:18:03.311 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9666000000000005e-05 2024-09-12T16:18:03.311 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.311 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.311 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:03.311 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575382+0000", 2024-09-12T16:18:03.311 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9909999999999997e-05 2024-09-12T16:18:03.311 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.311 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:03.311 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.311 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.311 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.312 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14039 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5055488~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:03.312 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:18:03.312 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 103.770961998, 2024-09-12T16:18:03.312 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053466207000000002, 2024-09-12T16:18:03.312 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:03.312 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:03.312 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:03.312 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:03.312 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:03.312 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:03.312 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14039 2024-09-12T16:18:03.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.312 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:03.313 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.313 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:03.313 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:18:03.313 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.313 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.313 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.313 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:03.313 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:18:03.313 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.313 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.313 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.313 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:03.313 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522899+0000", 2024-09-12T16:18:03.313 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026318199999999999 2024-09-12T16:18:03.314 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.314 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.314 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:03.314 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522903+0000", 2024-09-12T16:18:03.314 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.929e-06 2024-09-12T16:18:03.314 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.314 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.314 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:03.314 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522913+0000", 2024-09-12T16:18:03.314 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0162e-05 2024-09-12T16:18:03.314 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.314 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.314 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:03.314 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522921+0000", 2024-09-12T16:18:03.315 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.14e-06 2024-09-12T16:18:03.315 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.315 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.315 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:03.315 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575922+0000", 2024-09-12T16:18:03.315 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053000712999999998 2024-09-12T16:18:03.315 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.315 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.315 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:03.315 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576006+0000", 2024-09-12T16:18:03.315 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4161999999999998e-05 2024-09-12T16:18:03.315 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.315 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.315 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:03.316 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576102+0000", 2024-09-12T16:18:03.316 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5919000000000001e-05 2024-09-12T16:18:03.316 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.316 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:03.316 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.316 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14040 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5059584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:03.316 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:18:03.316 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 103.770657103, 2024-09-12T16:18:03.316 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053413258999999998, 2024-09-12T16:18:03.316 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:03.316 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:03.317 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:03.317 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:03.317 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:03.317 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:03.317 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14040 2024-09-12T16:18:03.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.317 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:03.317 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:03.317 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:18:03.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.317 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:03.318 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:18:03.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.318 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:03.318 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523059+0000", 2024-09-12T16:18:03.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118466 2024-09-12T16:18:03.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.318 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:03.318 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523062+0000", 2024-09-12T16:18:03.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.971e-06 2024-09-12T16:18:03.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.319 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.319 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:03.319 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523069+0000", 2024-09-12T16:18:03.319 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8279999999999997e-06 2024-09-12T16:18:03.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.319 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.319 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:03.319 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523073+0000", 2024-09-12T16:18:03.319 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3019999999999996e-06 2024-09-12T16:18:03.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.319 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.319 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:03.319 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576155+0000", 2024-09-12T16:18:03.319 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053081962000000003 2024-09-12T16:18:03.320 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.320 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.320 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:03.320 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576249+0000", 2024-09-12T16:18:03.320 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3914999999999998e-05 2024-09-12T16:18:03.320 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.320 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.320 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:03.320 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576354+0000", 2024-09-12T16:18:03.320 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010481500000000001 2024-09-12T16:18:03.320 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.320 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:03.320 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.321 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.321 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14041 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5063680~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:03.321 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:18:03.321 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 103.770506798, 2024-09-12T16:18:03.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053519111000000001, 2024-09-12T16:18:03.321 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:03.321 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:03.321 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:03.321 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:03.321 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:03.321 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:03.321 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14041 2024-09-12T16:18:03.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.322 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:03.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:03.322 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:18:03.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:03.322 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:18:03.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:03.323 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523309+0000", 2024-09-12T16:18:03.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000218712 2024-09-12T16:18:03.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.323 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:03.323 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523313+0000", 2024-09-12T16:18:03.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.151e-06 2024-09-12T16:18:03.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.323 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:03.323 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523320+0000", 2024-09-12T16:18:03.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9789999999999993e-06 2024-09-12T16:18:03.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.324 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:03.324 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523325+0000", 2024-09-12T16:18:03.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:18:03.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.324 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.324 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:03.324 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576402+0000", 2024-09-12T16:18:03.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053076811000000002 2024-09-12T16:18:03.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.324 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.324 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:03.324 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576491+0000", 2024-09-12T16:18:03.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8578999999999993e-05 2024-09-12T16:18:03.325 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.325 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.325 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:03.325 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576610+0000", 2024-09-12T16:18:03.325 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119129 2024-09-12T16:18:03.325 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.325 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:03.325 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.325 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.325 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.325 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14042 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5067776~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:03.325 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:18:03.325 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 103.770263364, 2024-09-12T16:18:03.325 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053510350999999998, 2024-09-12T16:18:03.326 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:03.326 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:03.326 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:03.326 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:03.326 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:03.326 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:03.326 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14042 2024-09-12T16:18:03.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.326 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:03.326 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.326 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:03.326 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:18:03.326 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.327 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.327 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.327 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:03.327 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:18:03.327 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.327 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.327 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.327 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:03.327 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523591+0000", 2024-09-12T16:18:03.327 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025710300000000001 2024-09-12T16:18:03.327 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.327 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.327 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:03.327 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523594+0000", 2024-09-12T16:18:03.328 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2229999999999999e-06 2024-09-12T16:18:03.328 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.328 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.328 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:03.328 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523602+0000", 2024-09-12T16:18:03.328 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6930000000000007e-06 2024-09-12T16:18:03.328 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.328 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.328 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:03.328 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523607+0000", 2024-09-12T16:18:03.328 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4789999999999998e-06 2024-09-12T16:18:03.328 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.328 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.328 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:03.329 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576661+0000", 2024-09-12T16:18:03.329 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053973999999997 2024-09-12T16:18:03.329 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.329 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.329 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:03.329 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576745+0000", 2024-09-12T16:18:03.329 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4660000000000006e-05 2024-09-12T16:18:03.329 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.329 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.329 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:03.329 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576844+0000", 2024-09-12T16:18:03.329 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9219e-05 2024-09-12T16:18:03.329 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.329 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:03.330 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.330 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14043 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5071872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:03.330 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:18:03.330 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 103.769982885, 2024-09-12T16:18:03.330 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053475295999999999, 2024-09-12T16:18:03.330 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:03.330 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:03.330 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:03.330 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:03.330 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:03.330 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:03.331 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14043 2024-09-12T16:18:03.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.331 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:03.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:03.331 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:18:03.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:03.331 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:18:03.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:03.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523823+0000", 2024-09-12T16:18:03.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020818900000000001 2024-09-12T16:18:03.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:03.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523826+0000", 2024-09-12T16:18:03.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.405e-06 2024-09-12T16:18:03.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:03.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523834+0000", 2024-09-12T16:18:03.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5499999999999997e-06 2024-09-12T16:18:03.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:03.333 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523838+0000", 2024-09-12T16:18:03.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.408e-06 2024-09-12T16:18:03.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:03.333 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576904+0000", 2024-09-12T16:18:03.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053065687 2024-09-12T16:18:03.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:03.333 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576991+0000", 2024-09-12T16:18:03.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7399999999999997e-05 2024-09-12T16:18:03.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.334 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.334 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:03.334 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577090+0000", 2024-09-12T16:18:03.334 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8657000000000001e-05 2024-09-12T16:18:03.334 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.334 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:03.334 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.334 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.334 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14044 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5075968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:03.334 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:18:03.334 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 103.769751355, 2024-09-12T16:18:03.335 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053442659000000003, 2024-09-12T16:18:03.335 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:03.335 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:03.335 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:03.335 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:03.335 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:03.335 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:03.335 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14044 2024-09-12T16:18:03.335 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.335 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:03.335 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.335 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:03.335 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:18:03.335 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.336 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.336 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:03.336 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:18:03.336 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.336 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.336 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:03.336 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523985+0000", 2024-09-12T16:18:03.336 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000138522 2024-09-12T16:18:03.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.336 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.336 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:03.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523988+0000", 2024-09-12T16:18:03.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.788e-06 2024-09-12T16:18:03.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.337 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:03.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523998+0000", 2024-09-12T16:18:03.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8470000000000008e-06 2024-09-12T16:18:03.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.337 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:03.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524010+0000", 2024-09-12T16:18:03.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1348999999999999e-05 2024-09-12T16:18:03.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.338 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.338 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:03.338 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577137+0000", 2024-09-12T16:18:03.338 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053127055999999999 2024-09-12T16:18:03.338 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.338 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.338 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:03.338 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577210+0000", 2024-09-12T16:18:03.338 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3392000000000005e-05 2024-09-12T16:18:03.338 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.338 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.338 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:03.339 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577289+0000", 2024-09-12T16:18:03.339 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8704999999999999e-05 2024-09-12T16:18:03.339 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.339 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:03.339 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.339 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.339 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.339 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14045 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5080064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:03.339 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:18:03.339 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 103.76957253400001, 2024-09-12T16:18:03.339 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053497514000000003, 2024-09-12T16:18:03.339 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:03.339 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:03.339 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:03.340 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:03.340 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:03.340 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:03.340 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14045 2024-09-12T16:18:03.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.340 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:03.340 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.340 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:03.340 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:18:03.340 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.340 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.340 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:03.341 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:18:03.341 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.341 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.341 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:03.341 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524311+0000", 2024-09-12T16:18:03.341 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028626299999999998 2024-09-12T16:18:03.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.341 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.341 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:03.341 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524315+0000", 2024-09-12T16:18:03.341 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0969999999999999e-06 2024-09-12T16:18:03.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.342 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.342 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:03.342 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524325+0000", 2024-09-12T16:18:03.342 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6330000000000008e-06 2024-09-12T16:18:03.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.342 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.342 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:03.342 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524332+0000", 2024-09-12T16:18:03.342 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8700000000000003e-06 2024-09-12T16:18:03.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.342 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.342 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:03.342 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577334+0000", 2024-09-12T16:18:03.342 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053001834999999997 2024-09-12T16:18:03.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.343 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.343 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:03.343 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577420+0000", 2024-09-12T16:18:03.343 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6145999999999998e-05 2024-09-12T16:18:03.343 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.343 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.343 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:03.343 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577522+0000", 2024-09-12T16:18:03.343 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010267 2024-09-12T16:18:03.343 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.343 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:03.343 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.343 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.343 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.343 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14047 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5088256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:03.344 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:18:03.344 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 103.769086808, 2024-09-12T16:18:03.344 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053433340000000003, 2024-09-12T16:18:03.344 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:03.344 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:03.344 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:03.344 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:03.344 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:03.344 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:03.344 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14047 2024-09-12T16:18:03.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.344 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:03.344 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.345 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:03.345 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:18:03.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.345 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.345 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:03.345 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:18:03.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.345 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.345 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:03.345 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524727+0000", 2024-09-12T16:18:03.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000216126 2024-09-12T16:18:03.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.346 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:03.346 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524732+0000", 2024-09-12T16:18:03.346 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1569999999999999e-06 2024-09-12T16:18:03.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.346 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:03.346 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524742+0000", 2024-09-12T16:18:03.347 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0186999999999999e-05 2024-09-12T16:18:03.347 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.347 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.347 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:03.347 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524750+0000", 2024-09-12T16:18:03.347 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4279999999999999e-06 2024-09-12T16:18:03.347 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.347 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.347 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:03.347 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577743+0000", 2024-09-12T16:18:03.347 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052993077 2024-09-12T16:18:03.347 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.347 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.348 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:03.348 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577841+0000", 2024-09-12T16:18:03.348 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8369000000000006e-05 2024-09-12T16:18:03.348 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.348 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.348 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:03.348 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577944+0000", 2024-09-12T16:18:03.348 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102996 2024-09-12T16:18:03.348 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.348 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:03.348 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.348 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.348 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.349 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14048 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5092352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:03.349 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:18:03.349 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 103.768835215, 2024-09-12T16:18:03.349 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053397515, 2024-09-12T16:18:03.349 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:03.349 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:03.349 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:03.349 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:03.349 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:03.349 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:03.349 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14048 2024-09-12T16:18:03.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.349 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:03.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:03.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:18:03.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:03.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:18:03.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:03.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524957+0000", 2024-09-12T16:18:03.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019516999999999999 2024-09-12T16:18:03.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.351 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:03.351 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524962+0000", 2024-09-12T16:18:03.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7709999999999997e-06 2024-09-12T16:18:03.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.351 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:03.351 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524973+0000", 2024-09-12T16:18:03.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1031e-05 2024-09-12T16:18:03.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.351 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:03.351 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524980+0000", 2024-09-12T16:18:03.352 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6100000000000002e-06 2024-09-12T16:18:03.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.352 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.352 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:03.352 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577977+0000", 2024-09-12T16:18:03.352 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052997481999999999 2024-09-12T16:18:03.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.352 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.352 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:03.352 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578062+0000", 2024-09-12T16:18:03.352 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4851000000000005e-05 2024-09-12T16:18:03.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.352 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.352 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:03.353 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578160+0000", 2024-09-12T16:18:03.353 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7600000000000001e-05 2024-09-12T16:18:03.353 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.353 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:03.353 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.353 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.353 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14049 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5096448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:03.353 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:18:03.353 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 103.76860658699999, 2024-09-12T16:18:03.353 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053439792, 2024-09-12T16:18:03.353 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:03.353 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:03.354 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:03.354 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:03.354 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:03.354 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:03.354 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14049 2024-09-12T16:18:03.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.354 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:03.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.354 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:03.354 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:18:03.355 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.355 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.355 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.355 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:03.355 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:18:03.355 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.355 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.355 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.355 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:03.355 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525170+0000", 2024-09-12T16:18:03.355 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017958500000000001 2024-09-12T16:18:03.355 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.356 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.356 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:03.356 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525174+0000", 2024-09-12T16:18:03.356 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0239999999999999e-06 2024-09-12T16:18:03.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.356 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.356 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:03.356 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525184+0000", 2024-09-12T16:18:03.356 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5950000000000005e-06 2024-09-12T16:18:03.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.356 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.356 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:03.356 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525191+0000", 2024-09-12T16:18:03.357 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8329999999999996e-06 2024-09-12T16:18:03.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.357 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.357 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:03.357 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578240+0000", 2024-09-12T16:18:03.357 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053049236 2024-09-12T16:18:03.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.357 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.357 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:03.357 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578333+0000", 2024-09-12T16:18:03.357 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2806999999999994e-05 2024-09-12T16:18:03.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.357 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.357 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:03.357 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578431+0000", 2024-09-12T16:18:03.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7712000000000002e-05 2024-09-12T16:18:03.358 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.358 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:03.358 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.358 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.358 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14055 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5121024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:03.358 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:18:03.358 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 103.76733589600001, 2024-09-12T16:18:03.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053399038000000003, 2024-09-12T16:18:03.358 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:03.358 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:03.358 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:03.358 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:03.359 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:03.359 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:03.359 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14055 2024-09-12T16:18:03.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.359 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:03.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.359 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:03.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:18:03.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.359 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:03.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:18:03.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.360 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:03.360 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526403+0000", 2024-09-12T16:18:03.360 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141571 2024-09-12T16:18:03.360 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.360 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.360 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:03.360 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526406+0000", 2024-09-12T16:18:03.360 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2660000000000002e-06 2024-09-12T16:18:03.360 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.360 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.360 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:03.360 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526420+0000", 2024-09-12T16:18:03.360 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3949e-05 2024-09-12T16:18:03.360 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.361 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.361 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:03.361 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526428+0000", 2024-09-12T16:18:03.361 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4250000000000001e-06 2024-09-12T16:18:03.361 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.361 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.361 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:03.361 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579476+0000", 2024-09-12T16:18:03.361 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053048349000000002 2024-09-12T16:18:03.361 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.361 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.362 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:03.362 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579563+0000", 2024-09-12T16:18:03.362 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6502999999999995e-05 2024-09-12T16:18:03.362 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.362 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.362 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:03.362 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579661+0000", 2024-09-12T16:18:03.362 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7974999999999996e-05 2024-09-12T16:18:03.362 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.362 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:03.362 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.362 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.362 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.362 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4806.0:3139 3.1e 3:78d5a095:::rbd_data.11552a37e55b.0000000000000000:head [read 69632~61440] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:18:03.362 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:18:03.363 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 92.992341646, 2024-09-12T16:18:03.363 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057851734000000002, 2024-09-12T16:18:03.363 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:03.363 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:03.363 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:03.363 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:03.363 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4806", 2024-09-12T16:18:03.363 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3959815836", 2024-09-12T16:18:03.363 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 3139 2024-09-12T16:18:03.363 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.363 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:03.363 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.363 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:03.363 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:18:03.364 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.364 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.364 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.364 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:03.364 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:18:03.364 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.364 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.364 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.364 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:03.364 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:18:03.364 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4799999999999999e-07 2024-09-12T16:18:03.364 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.364 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.364 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:03.365 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301258+0000", 2024-09-12T16:18:03.365 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.844e-06 2024-09-12T16:18:03.365 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.365 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.365 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:03.365 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301267+0000", 2024-09-12T16:18:03.365 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2960000000000004e-06 2024-09-12T16:18:03.365 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.365 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.365 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:03.365 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301276+0000", 2024-09-12T16:18:03.365 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0650000000000005e-06 2024-09-12T16:18:03.365 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.365 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.366 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:03.366 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301871+0000", 2024-09-12T16:18:03.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00059423600000000005 2024-09-12T16:18:03.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.366 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.366 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:03.366 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301920+0000", 2024-09-12T16:18:03.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9067000000000003e-05 2024-09-12T16:18:03.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.366 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.366 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:03.366 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359108+0000", 2024-09-12T16:18:03.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057187877999999998 2024-09-12T16:18:03.366 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.367 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:03.367 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.367 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.367 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:6428 3.14 3:28a44e54:::rbd_header.11552a37e55b:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:18:03.367 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:18:03.367 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 92.992013052000004, 2024-09-12T16:18:03.367 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057504023000000001, 2024-09-12T16:18:03.367 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:03.367 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:03.367 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:03.367 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:03.367 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:18:03.367 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:18:03.368 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6428 2024-09-12T16:18:03.368 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.368 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:03.368 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.368 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:03.368 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:18:03.368 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.368 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.368 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.368 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:03.368 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:18:03.368 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.368 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.368 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.369 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:03.369 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301585+0000", 2024-09-12T16:18:03.369 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6300000000000005e-07 2024-09-12T16:18:03.369 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.369 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.369 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:03.369 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301588+0000", 2024-09-12T16:18:03.369 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4149999999999999e-06 2024-09-12T16:18:03.369 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.369 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.369 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:03.369 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301597+0000", 2024-09-12T16:18:03.369 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5450000000000003e-06 2024-09-12T16:18:03.369 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.370 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.370 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:03.370 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301617+0000", 2024-09-12T16:18:03.370 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9837e-05 2024-09-12T16:18:03.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.370 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.370 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:03.370 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301779+0000", 2024-09-12T16:18:03.370 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016186799999999999 2024-09-12T16:18:03.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.370 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.370 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:03.370 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301855+0000", 2024-09-12T16:18:03.371 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5899e-05 2024-09-12T16:18:03.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.371 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.371 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:03.371 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359088+0000", 2024-09-12T16:18:03.371 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057233895999999999 2024-09-12T16:18:03.371 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.371 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:03.371 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.371 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.371 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5223.0:1814 3.f 3:f7b1b1c5:::rbd_object_map.1155a1fd27d2:head [read 0~136] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-12T16:18:03.371 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:18:03.371 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 57.056346988000001, 2024-09-12T16:18:03.371 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.006378226, 2024-09-12T16:18:03.372 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:03.372 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:03.372 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:03.372 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:03.372 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5223", 2024-09-12T16:18:03.372 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/4066330994", 2024-09-12T16:18:03.372 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1814 2024-09-12T16:18:03.372 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.372 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:03.372 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.372 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:03.372 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:18:03.372 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.372 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.373 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.373 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:03.373 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:18:03.373 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.373 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.373 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.373 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:03.373 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237252+0000", 2024-09-12T16:18:03.373 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.344e-06 2024-09-12T16:18:03.373 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.373 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.373 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:03.373 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237258+0000", 2024-09-12T16:18:03.374 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1070000000000001e-06 2024-09-12T16:18:03.374 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.374 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.374 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:03.374 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237270+0000", 2024-09-12T16:18:03.374 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1758e-05 2024-09-12T16:18:03.374 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.374 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.374 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:03.374 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237278+0000", 2024-09-12T16:18:03.374 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3219999999999993e-06 2024-09-12T16:18:03.374 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.374 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.374 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:03.375 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237334+0000", 2024-09-12T16:18:03.375 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6356e-05 2024-09-12T16:18:03.375 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.375 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.375 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:03.375 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237345+0000", 2024-09-12T16:18:03.375 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0433e-05 2024-09-12T16:18:03.375 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.375 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.375 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:03.375 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243426+0000", 2024-09-12T16:18:03.375 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.00608133 2024-09-12T16:18:03.375 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.375 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.376 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:03.376 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243534+0000", 2024-09-12T16:18:03.376 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010784 2024-09-12T16:18:03.376 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.376 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.376 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:03.376 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243629+0000", 2024-09-12T16:18:03.376 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4735999999999996e-05 2024-09-12T16:18:03.376 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.376 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:03.376 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.376 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.376 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.377 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5328.0:2542 3.16 3:6928f3a1:::rbd_object_map.11551722dd77:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:18:03.377 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:18:03.377 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 51.238001558000001, 2024-09-12T16:18:03.377 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.054219934999999997, 2024-09-12T16:18:03.377 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:03.377 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:03.377 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:03.377 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:03.377 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5328", 2024-09-12T16:18:03.377 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:18:03.377 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2542 2024-09-12T16:18:03.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.378 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:03.378 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.378 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:03.378 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:18:03.378 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.378 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.378 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.378 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:03.378 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:18:03.378 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.378 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.378 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.378 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:03.379 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055597+0000", 2024-09-12T16:18:03.379 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4300000000000001e-07 2024-09-12T16:18:03.379 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.379 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.379 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:03.379 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055602+0000", 2024-09-12T16:18:03.379 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4269999999999999e-06 2024-09-12T16:18:03.379 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.379 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.380 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:03.380 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055613+0000", 2024-09-12T16:18:03.380 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0815000000000001e-05 2024-09-12T16:18:03.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.380 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.380 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:03.380 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055621+0000", 2024-09-12T16:18:03.380 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4189999999999996e-06 2024-09-12T16:18:03.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.380 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.380 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:03.380 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102196+0000", 2024-09-12T16:18:03.380 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.046575616 2024-09-12T16:18:03.381 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.381 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.381 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:03.381 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102258+0000", 2024-09-12T16:18:03.381 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1872000000000007e-05 2024-09-12T16:18:03.381 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.381 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.381 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T16:18:03.381 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102601+0000", 2024-09-12T16:18:03.381 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034285700000000001 2024-09-12T16:18:03.381 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.381 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.381 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:03.381 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.104431+0000", 2024-09-12T16:18:03.382 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001830524 2024-09-12T16:18:03.382 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.382 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.382 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:18:03.382 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109733+0000", 2024-09-12T16:18:03.382 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0053020089999999999 2024-09-12T16:18:03.382 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.382 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.382 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:03.382 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109777+0000", 2024-09-12T16:18:03.382 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3754000000000002e-05 2024-09-12T16:18:03.382 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.382 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.382 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:03.383 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109816+0000", 2024-09-12T16:18:03.383 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8699000000000003e-05 2024-09-12T16:18:03.383 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.383 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:03.383 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.383 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.383 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5328.0:2543 3.16 3:6928f3a1:::rbd_object_map.11551722dd77:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:18:03.383 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:18:03.383 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 51.237407578999999, 2024-09-12T16:18:03.383 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053695720000000002, 2024-09-12T16:18:03.383 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:03.383 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:03.383 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:03.384 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:03.384 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5328", 2024-09-12T16:18:03.384 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:18:03.384 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2543 2024-09-12T16:18:03.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.384 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:03.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.384 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:03.384 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:18:03.384 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.385 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:03.385 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:18:03.385 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.385 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.385 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.385 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:03.385 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056191+0000", 2024-09-12T16:18:03.385 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.54e-07 2024-09-12T16:18:03.385 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.385 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.385 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:03.385 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056195+0000", 2024-09-12T16:18:03.385 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5460000000000002e-06 2024-09-12T16:18:03.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.386 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.386 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:03.386 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056205+0000", 2024-09-12T16:18:03.386 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7350000000000008e-06 2024-09-12T16:18:03.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.386 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.386 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:03.386 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056214+0000", 2024-09-12T16:18:03.386 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8089999999999999e-06 2024-09-12T16:18:03.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.386 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.386 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:03.386 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103317+0000", 2024-09-12T16:18:03.387 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.047102889000000002 2024-09-12T16:18:03.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.387 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.387 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:03.387 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103410+0000", 2024-09-12T16:18:03.387 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3689000000000004e-05 2024-09-12T16:18:03.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.387 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.387 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T16:18:03.387 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103754+0000", 2024-09-12T16:18:03.387 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034344699999999998 2024-09-12T16:18:03.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.387 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.387 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:03.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.106487+0000", 2024-09-12T16:18:03.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0027330100000000001 2024-09-12T16:18:03.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.388 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:18:03.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109827+0000", 2024-09-12T16:18:03.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033406640000000001 2024-09-12T16:18:03.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.388 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:03.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109854+0000", 2024-09-12T16:18:03.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6866999999999999e-05 2024-09-12T16:18:03.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.388 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:03.389 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109886+0000", 2024-09-12T16:18:03.389 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1309999999999997e-05 2024-09-12T16:18:03.389 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.389 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:03.389 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.389 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.389 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5832.0:1710 3.f 3:f0d97d21:::rbd_data.1155d3b3a2ae.0000000000000012:head [truncate 1376256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-12T16:18:03.389 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:18:03.389 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.909609494, 2024-09-12T16:18:03.389 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6441524489999999, 2024-09-12T16:18:03.389 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:03.389 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:03.389 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:03.390 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:03.390 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5832", 2024-09-12T16:18:03.390 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/201125203", 2024-09-12T16:18:03.390 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1710 2024-09-12T16:18:03.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.390 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:03.390 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.390 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:03.390 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:18:03.390 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.390 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.390 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:03.390 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:18:03.391 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:03.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.391 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.391 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:03.391 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:18:03.391 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.08e-07 2024-09-12T16:18:03.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.391 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.391 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:03.391 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383990+0000", 2024-09-12T16:18:03.391 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.979e-06 2024-09-12T16:18:03.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.391 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.391 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:03.392 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383999+0000", 2024-09-12T16:18:03.392 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3240000000000003e-06 2024-09-12T16:18:03.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.392 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.392 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:03.392 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.384002+0000", 2024-09-12T16:18:03.392 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5489999999999998e-06 2024-09-12T16:18:03.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.392 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.392 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:03.392 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.384037+0000", 2024-09-12T16:18:03.392 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4931000000000001e-05 2024-09-12T16:18:03.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.392 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.393 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:03.393 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.384043+0000", 2024-09-12T16:18:03.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3920000000000002e-06 2024-09-12T16:18:03.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.393 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:03.393 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:48.007976+0000", 2024-09-12T16:18:03.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.62393385300000004 2024-09-12T16:18:03.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.393 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:03.393 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:48.007992+0000", 2024-09-12T16:18:03.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5668e-05 2024-09-12T16:18:03.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:03.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024187+0000", 2024-09-12T16:18:03.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0161951629999999 2024-09-12T16:18:03.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:03.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024362+0000", 2024-09-12T16:18:03.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017500600000000001 2024-09-12T16:18:03.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:18:03.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024453+0000", 2024-09-12T16:18:03.395 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1055000000000001e-05 2024-09-12T16:18:03.395 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.395 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.395 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:18:03.395 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024963+0000", 2024-09-12T16:18:03.395 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000510087 2024-09-12T16:18:03.395 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.395 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.395 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:03.395 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.027974+0000", 2024-09-12T16:18:03.395 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030107070000000001 2024-09-12T16:18:03.395 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.395 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.395 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:03.395 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.028022+0000", 2024-09-12T16:18:03.396 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7636000000000003e-05 2024-09-12T16:18:03.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:03.396 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:03.396 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:03.396 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.028140+0000", 2024-09-12T16:18:03.396 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011869100000000001 2024-09-12T16:18:03.396 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.396 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:03.396 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.396 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:03.396 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:03.396 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:03.397 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:18:03.398 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:18:03.398 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:18:03.399 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:18:03.399 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:18:03.399 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:18:03.400 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:18:03.400 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:18:03.401 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:18:03.401 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:03.397+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:03.498 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:03.498+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:03.508 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:03.508 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:03.517 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:18:03.599 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:03.599+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:03.624 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:03.624 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:03.632 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:18:03.699 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:03.698+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:03.739 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:03.739 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:03.748 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:18:03.801 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:03.801+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:03.896 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:03.896 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:03.901 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:03.901+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:03.904 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:18:04.002 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:04.002+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:04.011 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:04.011 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:04.020 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:18:04.061 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T16:18:04.103 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:04.102+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:04.130 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:04.130 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:04.139 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:18:04.204 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:04.203+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:04.257 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:04.257 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:04.266 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:18:04.310 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:04.309+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:04.374 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:04.374 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:04.383 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:18:04.405 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:04.404+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:04.506 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:04.505+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:04.530 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:04.530 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:04.538 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:18:04.607 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:04.606+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:04.686 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:04.686 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:04.695 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:18:04.739 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:04.737+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:04.802 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:04.802 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:04.808 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:04.807+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:04.810 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:18:04.909 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:04.907+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:04.957 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:04.957 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:04.966 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:18:05.010 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:05.008+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:05.061 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2024-09-12T16:18:05.081 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:05.081 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:05.090 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:18:05.110 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:05.109+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:05.212 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:05.210+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:05.249 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:05.249 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:05.258 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:18:05.342 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:05.340+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:05.402 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T16:18:05.405 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:05.405 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:05.414 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:18:05.415 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:05.412+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:05.514 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:05.513+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:05.525 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:18:05.525 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:18:05.529 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:05.530 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:05.538 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:18:05.542 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:18:05.542 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:18:05.559 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:18:05.559 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:18:05.576 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:18:05.576 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:18:05.592 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:18:05.593 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:18:05.609 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:18:05.610 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:18:05.615 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:05.613+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:05.646 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:05.646 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:05.647 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:18:05.647 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:18:05.647 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:05.655 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:18:05.716 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:05.715+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:05.763 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:05.764 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:18:05.764 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:18:05.764 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:18:05.764 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.764 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:18:05.764 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:18:05.764 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 143.99768561799999, 2024-09-12T16:18:05.764 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55645454900000002, 2024-09-12T16:18:05.764 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:05.764 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:05.764 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:05.764 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:05.764 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:18:05.765 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:18:05.765 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1 2024-09-12T16:18:05.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.765 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:05.765 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.765 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:05.765 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:18:05.765 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.765 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.765 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:05.765 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:18:05.765 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.766 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:05.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764440+0000", 2024-09-12T16:18:05.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6249999999999999e-06 2024-09-12T16:18:05.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.766 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:05.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764447+0000", 2024-09-12T16:18:05.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4939999999999997e-06 2024-09-12T16:18:05.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.766 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:05.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764459+0000", 2024-09-12T16:18:05.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1517e-05 2024-09-12T16:18:05.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.767 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.767 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:05.767 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764468+0000", 2024-09-12T16:18:05.767 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7690000000000002e-06 2024-09-12T16:18:05.767 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.767 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.767 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:05.767 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764539+0000", 2024-09-12T16:18:05.767 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1103e-05 2024-09-12T16:18:05.767 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.767 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.768 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:05.768 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764551+0000", 2024-09-12T16:18:05.768 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2687999999999999e-05 2024-09-12T16:18:05.768 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.768 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.768 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:05.768 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319497+0000", 2024-09-12T16:18:05.768 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55494560500000001 2024-09-12T16:18:05.768 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.768 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.768 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:05.768 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319688+0000", 2024-09-12T16:18:05.768 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019105599999999999 2024-09-12T16:18:05.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.769 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:18:05.769 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319842+0000", 2024-09-12T16:18:05.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015377699999999999 2024-09-12T16:18:05.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.769 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:18:05.769 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320473+0000", 2024-09-12T16:18:05.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00063117100000000003 2024-09-12T16:18:05.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.769 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:05.769 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320825+0000", 2024-09-12T16:18:05.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00035202500000000001 2024-09-12T16:18:05.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.770 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:05.770 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320867+0000", 2024-09-12T16:18:05.770 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2005000000000002e-05 2024-09-12T16:18:05.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.770 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:05.770 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320893+0000", 2024-09-12T16:18:05.770 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5714000000000001e-05 2024-09-12T16:18:05.770 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.770 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:05.770 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.771 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.771 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14034 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5035008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:05.771 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:18:05.771 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 106.240627385, 2024-09-12T16:18:05.771 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053404082999999998, 2024-09-12T16:18:05.771 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:05.771 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:05.771 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:05.771 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:05.771 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:05.771 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:05.771 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14034 2024-09-12T16:18:05.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.771 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:05.771 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.772 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:05.772 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:18:05.772 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.772 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:05.772 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:18:05.772 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.772 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:05.772 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521740+0000", 2024-09-12T16:18:05.772 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000243976 2024-09-12T16:18:05.773 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.773 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.773 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:05.773 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521745+0000", 2024-09-12T16:18:05.773 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1280000000000001e-06 2024-09-12T16:18:05.773 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.773 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.773 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:05.773 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521757+0000", 2024-09-12T16:18:05.773 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2751e-05 2024-09-12T16:18:05.773 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.773 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.773 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:05.773 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521771+0000", 2024-09-12T16:18:05.773 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3328e-05 2024-09-12T16:18:05.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.774 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.774 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:05.774 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574710+0000", 2024-09-12T16:18:05.774 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052939358999999998 2024-09-12T16:18:05.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.774 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.774 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:05.774 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574799+0000", 2024-09-12T16:18:05.774 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8893000000000004e-05 2024-09-12T16:18:05.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.774 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.774 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:05.774 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574901+0000", 2024-09-12T16:18:05.775 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101648 2024-09-12T16:18:05.775 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.775 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:05.775 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.775 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14036 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5043200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:05.775 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:18:05.775 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 106.240168191, 2024-09-12T16:18:05.775 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053426247000000003, 2024-09-12T16:18:05.775 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:05.775 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:05.775 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:05.775 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:05.776 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:05.776 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:05.776 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14036 2024-09-12T16:18:05.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.776 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:05.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.776 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:05.776 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:18:05.776 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.776 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:05.776 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:18:05.776 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.777 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.777 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:05.777 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522208+0000", 2024-09-12T16:18:05.777 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025195300000000002 2024-09-12T16:18:05.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.777 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.777 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:05.777 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522211+0000", 2024-09-12T16:18:05.777 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2160000000000002e-06 2024-09-12T16:18:05.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.777 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.777 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:05.777 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522223+0000", 2024-09-12T16:18:05.777 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2044e-05 2024-09-12T16:18:05.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.778 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:05.778 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522229+0000", 2024-09-12T16:18:05.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8850000000000004e-06 2024-09-12T16:18:05.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.778 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:05.778 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575192+0000", 2024-09-12T16:18:05.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052963573 2024-09-12T16:18:05.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.778 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:05.778 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575282+0000", 2024-09-12T16:18:05.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9666000000000005e-05 2024-09-12T16:18:05.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:05.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575382+0000", 2024-09-12T16:18:05.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9909999999999997e-05 2024-09-12T16:18:05.779 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.779 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:05.779 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.779 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14039 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5055488~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:05.779 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:18:05.779 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 106.239488407, 2024-09-12T16:18:05.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053466207000000002, 2024-09-12T16:18:05.779 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:05.779 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:05.780 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:05.780 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:05.780 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:05.780 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:05.780 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14039 2024-09-12T16:18:05.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.780 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:05.780 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.780 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:05.780 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:18:05.780 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.781 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.781 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:05.781 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:18:05.781 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.781 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.781 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:05.781 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522899+0000", 2024-09-12T16:18:05.781 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026318199999999999 2024-09-12T16:18:05.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.781 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.782 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:05.782 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522903+0000", 2024-09-12T16:18:05.782 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.929e-06 2024-09-12T16:18:05.782 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.782 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.782 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:05.782 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522913+0000", 2024-09-12T16:18:05.782 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0162e-05 2024-09-12T16:18:05.782 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.782 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.782 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:05.782 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522921+0000", 2024-09-12T16:18:05.782 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.14e-06 2024-09-12T16:18:05.782 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.783 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:05.783 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575922+0000", 2024-09-12T16:18:05.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053000712999999998 2024-09-12T16:18:05.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.783 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:05.783 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576006+0000", 2024-09-12T16:18:05.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4161999999999998e-05 2024-09-12T16:18:05.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.783 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:05.783 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576102+0000", 2024-09-12T16:18:05.784 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5919000000000001e-05 2024-09-12T16:18:05.784 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.784 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:05.784 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.784 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.784 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.784 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14040 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5059584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:05.784 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:18:05.784 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 106.239183512, 2024-09-12T16:18:05.784 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053413258999999998, 2024-09-12T16:18:05.784 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:05.784 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:05.784 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:05.784 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:05.785 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:05.785 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:05.785 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14040 2024-09-12T16:18:05.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.785 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:05.785 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.785 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:05.785 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:18:05.785 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.785 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.785 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:05.785 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:18:05.785 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.786 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.786 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:05.786 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523059+0000", 2024-09-12T16:18:05.786 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118466 2024-09-12T16:18:05.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.786 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.786 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:05.786 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523062+0000", 2024-09-12T16:18:05.786 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.971e-06 2024-09-12T16:18:05.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.786 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.786 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:05.786 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523069+0000", 2024-09-12T16:18:05.786 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8279999999999997e-06 2024-09-12T16:18:05.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.787 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.787 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:05.787 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523073+0000", 2024-09-12T16:18:05.787 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3019999999999996e-06 2024-09-12T16:18:05.787 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.787 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.787 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:05.787 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576155+0000", 2024-09-12T16:18:05.787 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053081962000000003 2024-09-12T16:18:05.787 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.787 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.787 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:05.787 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576249+0000", 2024-09-12T16:18:05.788 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3914999999999998e-05 2024-09-12T16:18:05.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.788 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.788 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:05.788 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576354+0000", 2024-09-12T16:18:05.788 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010481500000000001 2024-09-12T16:18:05.788 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.788 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:05.788 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.788 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.788 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14041 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5063680~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:05.788 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:18:05.789 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 106.23903320700001, 2024-09-12T16:18:05.789 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053519111000000001, 2024-09-12T16:18:05.789 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:05.789 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:05.789 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:05.789 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:05.789 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:05.789 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:05.789 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14041 2024-09-12T16:18:05.789 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.789 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:05.789 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.789 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:05.789 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:18:05.789 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.790 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.790 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.790 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:05.790 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:18:05.790 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.790 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.790 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.790 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:05.790 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523309+0000", 2024-09-12T16:18:05.790 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000218712 2024-09-12T16:18:05.790 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.790 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.790 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:05.790 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523313+0000", 2024-09-12T16:18:05.790 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.151e-06 2024-09-12T16:18:05.791 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.791 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.791 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:05.791 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523320+0000", 2024-09-12T16:18:05.791 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9789999999999993e-06 2024-09-12T16:18:05.791 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.791 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.791 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:05.791 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523325+0000", 2024-09-12T16:18:05.791 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:18:05.791 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.791 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.791 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:05.791 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576402+0000", 2024-09-12T16:18:05.791 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053076811000000002 2024-09-12T16:18:05.792 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.792 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.792 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:05.792 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576491+0000", 2024-09-12T16:18:05.792 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8578999999999993e-05 2024-09-12T16:18:05.792 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.792 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.792 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:05.792 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576610+0000", 2024-09-12T16:18:05.792 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119129 2024-09-12T16:18:05.792 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.792 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:05.792 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.792 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.793 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.793 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14042 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5067776~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:05.793 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:18:05.793 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 106.23878977299999, 2024-09-12T16:18:05.793 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053510350999999998, 2024-09-12T16:18:05.793 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:05.793 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:05.793 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:05.793 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:05.793 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:05.793 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:05.793 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14042 2024-09-12T16:18:05.793 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.794 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:05.794 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.794 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:05.794 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:18:05.794 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.794 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.794 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.794 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:05.794 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:18:05.794 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.794 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.794 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.794 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:05.795 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523591+0000", 2024-09-12T16:18:05.795 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025710300000000001 2024-09-12T16:18:05.795 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.795 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.795 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:05.795 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523594+0000", 2024-09-12T16:18:05.795 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2229999999999999e-06 2024-09-12T16:18:05.795 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.795 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.795 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:05.795 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523602+0000", 2024-09-12T16:18:05.795 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6930000000000007e-06 2024-09-12T16:18:05.795 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.795 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.795 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:05.795 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523607+0000", 2024-09-12T16:18:05.796 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4789999999999998e-06 2024-09-12T16:18:05.796 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.796 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.796 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:05.796 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576661+0000", 2024-09-12T16:18:05.796 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053973999999997 2024-09-12T16:18:05.796 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.796 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.796 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:05.796 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576745+0000", 2024-09-12T16:18:05.796 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4660000000000006e-05 2024-09-12T16:18:05.796 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.796 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.796 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:05.796 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576844+0000", 2024-09-12T16:18:05.797 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9219e-05 2024-09-12T16:18:05.797 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.797 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:05.797 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.797 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.797 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.797 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14043 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5071872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:05.797 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:18:05.797 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 106.238509294, 2024-09-12T16:18:05.797 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053475295999999999, 2024-09-12T16:18:05.797 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:05.797 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:05.797 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:05.797 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:05.797 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:05.798 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:05.798 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14043 2024-09-12T16:18:05.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.798 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:05.798 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.798 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:05.798 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:18:05.798 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.798 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.798 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:05.798 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:18:05.798 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.799 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.799 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:05.799 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523823+0000", 2024-09-12T16:18:05.799 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020818900000000001 2024-09-12T16:18:05.799 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.799 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.799 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:05.799 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523826+0000", 2024-09-12T16:18:05.799 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.405e-06 2024-09-12T16:18:05.799 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.799 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.799 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:05.799 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523834+0000", 2024-09-12T16:18:05.799 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5499999999999997e-06 2024-09-12T16:18:05.800 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.800 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.800 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:05.800 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523838+0000", 2024-09-12T16:18:05.800 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.408e-06 2024-09-12T16:18:05.800 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.800 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.800 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:05.800 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576904+0000", 2024-09-12T16:18:05.800 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053065687 2024-09-12T16:18:05.800 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.800 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.800 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:05.800 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576991+0000", 2024-09-12T16:18:05.800 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7399999999999997e-05 2024-09-12T16:18:05.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.801 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.801 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:05.801 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577090+0000", 2024-09-12T16:18:05.801 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8657000000000001e-05 2024-09-12T16:18:05.801 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.801 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:05.801 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.801 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.801 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14044 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5075968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:05.801 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:18:05.801 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 106.238277764, 2024-09-12T16:18:05.801 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053442659000000003, 2024-09-12T16:18:05.801 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:05.802 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:05.802 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:05.802 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:05.802 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:05.802 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:05.802 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14044 2024-09-12T16:18:05.802 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.802 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:05.802 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.802 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:05.802 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:18:05.802 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.802 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.803 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.803 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:05.803 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:18:05.803 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.803 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.803 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.803 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:05.803 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523985+0000", 2024-09-12T16:18:05.803 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000138522 2024-09-12T16:18:05.803 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.803 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.803 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:05.803 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523988+0000", 2024-09-12T16:18:05.803 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.788e-06 2024-09-12T16:18:05.804 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.804 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.804 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:05.804 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523998+0000", 2024-09-12T16:18:05.804 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8470000000000008e-06 2024-09-12T16:18:05.804 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.804 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.804 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:05.804 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524010+0000", 2024-09-12T16:18:05.804 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1348999999999999e-05 2024-09-12T16:18:05.804 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.804 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.804 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:05.804 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577137+0000", 2024-09-12T16:18:05.805 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053127055999999999 2024-09-12T16:18:05.805 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.805 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.805 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:05.805 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577210+0000", 2024-09-12T16:18:05.805 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3392000000000005e-05 2024-09-12T16:18:05.805 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.805 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.805 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:05.805 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577289+0000", 2024-09-12T16:18:05.805 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8704999999999999e-05 2024-09-12T16:18:05.805 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.805 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:05.806 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.806 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.806 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14045 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5080064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:05.806 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:18:05.806 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 106.238098943, 2024-09-12T16:18:05.806 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053497514000000003, 2024-09-12T16:18:05.806 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:05.806 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:05.806 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:05.806 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:05.806 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:05.806 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:05.806 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14045 2024-09-12T16:18:05.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.806 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:05.807 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.807 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:05.807 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:18:05.807 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.807 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.807 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.807 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:05.807 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:18:05.807 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.807 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.807 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.807 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:05.807 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524311+0000", 2024-09-12T16:18:05.807 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028626299999999998 2024-09-12T16:18:05.807 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.808 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.808 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:05.808 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524315+0000", 2024-09-12T16:18:05.808 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0969999999999999e-06 2024-09-12T16:18:05.808 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.808 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.808 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:05.808 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524325+0000", 2024-09-12T16:18:05.808 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6330000000000008e-06 2024-09-12T16:18:05.808 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.808 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.808 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:05.808 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524332+0000", 2024-09-12T16:18:05.808 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8700000000000003e-06 2024-09-12T16:18:05.809 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.809 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.809 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:05.809 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577334+0000", 2024-09-12T16:18:05.809 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053001834999999997 2024-09-12T16:18:05.809 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.809 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.809 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:05.809 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577420+0000", 2024-09-12T16:18:05.809 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6145999999999998e-05 2024-09-12T16:18:05.809 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.809 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.809 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:05.809 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577522+0000", 2024-09-12T16:18:05.809 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010267 2024-09-12T16:18:05.810 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.810 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:05.810 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.810 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.810 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.810 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14047 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5088256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:05.810 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:18:05.810 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 106.237613217, 2024-09-12T16:18:05.810 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053433340000000003, 2024-09-12T16:18:05.810 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:05.810 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:05.810 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:05.810 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:05.810 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:05.810 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:05.811 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14047 2024-09-12T16:18:05.811 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.811 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:05.811 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.811 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:05.811 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:18:05.811 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.811 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.811 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.811 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:05.811 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:18:05.811 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.811 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.811 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.812 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:05.812 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524727+0000", 2024-09-12T16:18:05.812 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000216126 2024-09-12T16:18:05.812 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.812 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.812 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:05.812 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524732+0000", 2024-09-12T16:18:05.812 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1569999999999999e-06 2024-09-12T16:18:05.812 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.812 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.812 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:05.812 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524742+0000", 2024-09-12T16:18:05.812 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0186999999999999e-05 2024-09-12T16:18:05.813 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.813 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.813 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:05.813 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524750+0000", 2024-09-12T16:18:05.813 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4279999999999999e-06 2024-09-12T16:18:05.813 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.813 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.813 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:05.813 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577743+0000", 2024-09-12T16:18:05.813 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052993077 2024-09-12T16:18:05.813 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.813 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.813 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:05.813 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577841+0000", 2024-09-12T16:18:05.814 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8369000000000006e-05 2024-09-12T16:18:05.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.814 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.814 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:05.814 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577944+0000", 2024-09-12T16:18:05.814 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102996 2024-09-12T16:18:05.814 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.814 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:05.814 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.814 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.814 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14048 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5092352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:05.814 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:18:05.815 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 106.237361624, 2024-09-12T16:18:05.815 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053397515, 2024-09-12T16:18:05.815 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:05.815 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:05.815 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:05.815 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:05.815 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:05.815 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:05.815 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14048 2024-09-12T16:18:05.815 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.815 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:05.815 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.815 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:05.816 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:18:05.816 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.816 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.816 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.816 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:05.816 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:18:05.816 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.816 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.816 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.816 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:05.816 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524957+0000", 2024-09-12T16:18:05.816 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019516999999999999 2024-09-12T16:18:05.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.817 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.817 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:05.817 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524962+0000", 2024-09-12T16:18:05.817 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7709999999999997e-06 2024-09-12T16:18:05.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.817 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.817 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:05.817 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524973+0000", 2024-09-12T16:18:05.817 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1031e-05 2024-09-12T16:18:05.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.817 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.818 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:05.818 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524980+0000", 2024-09-12T16:18:05.818 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6100000000000002e-06 2024-09-12T16:18:05.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.818 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.818 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:05.818 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577977+0000", 2024-09-12T16:18:05.818 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052997481999999999 2024-09-12T16:18:05.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.818 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.818 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:05.818 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578062+0000", 2024-09-12T16:18:05.818 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4851000000000005e-05 2024-09-12T16:18:05.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.818 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.819 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:05.819 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578160+0000", 2024-09-12T16:18:05.819 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7600000000000001e-05 2024-09-12T16:18:05.819 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.819 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:05.819 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.819 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.819 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14049 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5096448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:05.819 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:18:05.819 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 106.237132996, 2024-09-12T16:18:05.819 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053439792, 2024-09-12T16:18:05.819 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:05.819 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:05.819 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:05.820 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:05.820 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:05.820 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:05.820 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14049 2024-09-12T16:18:05.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.820 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:05.820 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.820 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:05.820 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:18:05.820 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.820 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.820 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:05.820 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:18:05.820 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.821 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.821 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:05.821 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525170+0000", 2024-09-12T16:18:05.821 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017958500000000001 2024-09-12T16:18:05.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.821 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.821 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:05.821 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525174+0000", 2024-09-12T16:18:05.821 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0239999999999999e-06 2024-09-12T16:18:05.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.821 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.821 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:05.821 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525184+0000", 2024-09-12T16:18:05.821 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5950000000000005e-06 2024-09-12T16:18:05.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.822 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.822 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:05.822 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525191+0000", 2024-09-12T16:18:05.822 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8329999999999996e-06 2024-09-12T16:18:05.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.822 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.822 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:05.822 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578240+0000", 2024-09-12T16:18:05.822 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053049236 2024-09-12T16:18:05.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.822 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.822 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:05.822 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578333+0000", 2024-09-12T16:18:05.822 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2806999999999994e-05 2024-09-12T16:18:05.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.823 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:05.823 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578431+0000", 2024-09-12T16:18:05.823 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7712000000000002e-05 2024-09-12T16:18:05.823 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.823 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:05.823 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.823 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14055 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5121024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:05.823 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:18:05.823 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 106.235862305, 2024-09-12T16:18:05.823 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053399038000000003, 2024-09-12T16:18:05.823 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:05.824 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:05.824 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:05.824 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:05.824 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:05.824 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:05.824 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14055 2024-09-12T16:18:05.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.824 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:05.824 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.824 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:05.824 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:18:05.824 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.824 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.825 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:05.825 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:18:05.825 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.825 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.825 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.825 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:05.825 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526403+0000", 2024-09-12T16:18:05.825 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141571 2024-09-12T16:18:05.825 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.825 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.825 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:05.825 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526406+0000", 2024-09-12T16:18:05.825 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2660000000000002e-06 2024-09-12T16:18:05.825 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.825 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.826 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:05.826 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526420+0000", 2024-09-12T16:18:05.826 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3949e-05 2024-09-12T16:18:05.826 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.826 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.826 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:05.826 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526428+0000", 2024-09-12T16:18:05.826 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4250000000000001e-06 2024-09-12T16:18:05.826 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.826 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.826 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:05.826 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579476+0000", 2024-09-12T16:18:05.826 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053048349000000002 2024-09-12T16:18:05.826 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.826 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.827 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:05.827 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579563+0000", 2024-09-12T16:18:05.827 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6502999999999995e-05 2024-09-12T16:18:05.827 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.827 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.827 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:05.827 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579661+0000", 2024-09-12T16:18:05.827 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7974999999999996e-05 2024-09-12T16:18:05.827 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.827 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:05.827 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.827 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.827 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.827 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4806.0:3139 3.1e 3:78d5a095:::rbd_data.11552a37e55b.0000000000000000:head [read 69632~61440] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:18:05.827 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:18:05.828 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 95.460868055000006, 2024-09-12T16:18:05.828 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057851734000000002, 2024-09-12T16:18:05.828 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:05.828 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:05.828 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:05.828 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:05.828 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4806", 2024-09-12T16:18:05.828 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3959815836", 2024-09-12T16:18:05.828 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 3139 2024-09-12T16:18:05.828 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.828 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:05.828 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.828 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:05.828 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:18:05.829 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.829 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.829 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.829 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:05.829 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:18:05.829 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.829 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.829 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.829 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:05.829 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:18:05.829 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4799999999999999e-07 2024-09-12T16:18:05.829 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.829 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.829 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:05.830 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301258+0000", 2024-09-12T16:18:05.830 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.844e-06 2024-09-12T16:18:05.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.830 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.830 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:05.830 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301267+0000", 2024-09-12T16:18:05.830 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2960000000000004e-06 2024-09-12T16:18:05.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.830 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.830 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:05.830 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301276+0000", 2024-09-12T16:18:05.830 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0650000000000005e-06 2024-09-12T16:18:05.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.831 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.831 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:05.831 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301871+0000", 2024-09-12T16:18:05.831 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00059423600000000005 2024-09-12T16:18:05.831 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.831 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.831 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:05.831 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301920+0000", 2024-09-12T16:18:05.831 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9067000000000003e-05 2024-09-12T16:18:05.831 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.831 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.831 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:05.831 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359108+0000", 2024-09-12T16:18:05.831 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057187877999999998 2024-09-12T16:18:05.831 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.831 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:05.832 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.832 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.832 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.832 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:6428 3.14 3:28a44e54:::rbd_header.11552a37e55b:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:18:05.832 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:18:05.832 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 95.460539460999996, 2024-09-12T16:18:05.832 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057504023000000001, 2024-09-12T16:18:05.832 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:05.832 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:05.832 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:05.832 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:05.832 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:18:05.832 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:18:05.833 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6428 2024-09-12T16:18:05.833 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.833 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:05.833 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.833 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:05.833 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:18:05.833 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.833 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.833 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.833 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:05.833 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:18:05.833 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.833 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.833 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.833 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:05.834 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301585+0000", 2024-09-12T16:18:05.834 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6300000000000005e-07 2024-09-12T16:18:05.834 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.834 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.834 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:05.834 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301588+0000", 2024-09-12T16:18:05.834 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4149999999999999e-06 2024-09-12T16:18:05.834 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.834 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.834 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:05.834 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301597+0000", 2024-09-12T16:18:05.834 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5450000000000003e-06 2024-09-12T16:18:05.834 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.834 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.835 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:05.835 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301617+0000", 2024-09-12T16:18:05.835 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9837e-05 2024-09-12T16:18:05.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.835 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.835 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:05.835 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301779+0000", 2024-09-12T16:18:05.835 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016186799999999999 2024-09-12T16:18:05.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.835 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.835 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:05.835 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301855+0000", 2024-09-12T16:18:05.835 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5899e-05 2024-09-12T16:18:05.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.836 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.836 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:05.836 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359088+0000", 2024-09-12T16:18:05.836 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057233895999999999 2024-09-12T16:18:05.836 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.836 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:05.836 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.836 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.836 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5223.0:1814 3.f 3:f7b1b1c5:::rbd_object_map.1155a1fd27d2:head [read 0~136] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-12T16:18:05.836 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:18:05.836 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 59.524873397, 2024-09-12T16:18:05.836 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.006378226, 2024-09-12T16:18:05.837 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:05.837 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:05.837 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:05.837 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:05.837 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5223", 2024-09-12T16:18:05.837 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/4066330994", 2024-09-12T16:18:05.837 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1814 2024-09-12T16:18:05.837 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.837 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:05.837 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.837 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:05.837 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:18:05.838 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.838 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.838 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.838 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:05.838 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:18:05.838 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.838 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.838 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.838 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:05.838 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237252+0000", 2024-09-12T16:18:05.838 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.344e-06 2024-09-12T16:18:05.838 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.838 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.838 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:05.839 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237258+0000", 2024-09-12T16:18:05.839 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1070000000000001e-06 2024-09-12T16:18:05.839 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.839 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.839 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:05.839 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237270+0000", 2024-09-12T16:18:05.839 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1758e-05 2024-09-12T16:18:05.839 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.839 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.839 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:05.839 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237278+0000", 2024-09-12T16:18:05.839 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3219999999999993e-06 2024-09-12T16:18:05.839 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.839 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.839 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:05.840 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237334+0000", 2024-09-12T16:18:05.840 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6356e-05 2024-09-12T16:18:05.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.840 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.840 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:05.840 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237345+0000", 2024-09-12T16:18:05.840 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0433e-05 2024-09-12T16:18:05.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.840 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.840 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:05.840 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243426+0000", 2024-09-12T16:18:05.840 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.00608133 2024-09-12T16:18:05.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.840 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.841 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:05.841 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243534+0000", 2024-09-12T16:18:05.841 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010784 2024-09-12T16:18:05.841 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.841 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.841 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:05.841 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243629+0000", 2024-09-12T16:18:05.841 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4735999999999996e-05 2024-09-12T16:18:05.841 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.841 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:05.841 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.841 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.841 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.841 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5328.0:2542 3.16 3:6928f3a1:::rbd_object_map.11551722dd77:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:18:05.841 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:18:05.842 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 53.706527967, 2024-09-12T16:18:05.842 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.054219934999999997, 2024-09-12T16:18:05.842 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:05.842 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:05.842 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:05.842 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:05.842 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5328", 2024-09-12T16:18:05.842 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:18:05.842 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2542 2024-09-12T16:18:05.842 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.842 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:05.842 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.842 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:05.842 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:18:05.842 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.843 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.843 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.843 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:05.843 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:18:05.843 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.843 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.843 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.843 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:05.843 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055597+0000", 2024-09-12T16:18:05.843 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4300000000000001e-07 2024-09-12T16:18:05.843 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.843 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.843 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:05.843 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055602+0000", 2024-09-12T16:18:05.843 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4269999999999999e-06 2024-09-12T16:18:05.844 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.844 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.844 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:05.844 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055613+0000", 2024-09-12T16:18:05.844 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0815000000000001e-05 2024-09-12T16:18:05.844 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.844 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.844 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:05.844 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055621+0000", 2024-09-12T16:18:05.844 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4189999999999996e-06 2024-09-12T16:18:05.844 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.844 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.844 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:05.844 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102196+0000", 2024-09-12T16:18:05.845 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.046575616 2024-09-12T16:18:05.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.845 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.845 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:05.845 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102258+0000", 2024-09-12T16:18:05.845 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1872000000000007e-05 2024-09-12T16:18:05.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.845 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.845 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T16:18:05.845 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102601+0000", 2024-09-12T16:18:05.845 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034285700000000001 2024-09-12T16:18:05.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.845 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.845 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:05.846 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.104431+0000", 2024-09-12T16:18:05.846 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001830524 2024-09-12T16:18:05.846 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.846 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.846 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:18:05.846 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109733+0000", 2024-09-12T16:18:05.846 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0053020089999999999 2024-09-12T16:18:05.846 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.846 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.846 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:05.846 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109777+0000", 2024-09-12T16:18:05.846 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3754000000000002e-05 2024-09-12T16:18:05.847 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.847 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.847 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:05.847 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109816+0000", 2024-09-12T16:18:05.847 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8699000000000003e-05 2024-09-12T16:18:05.847 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.847 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:05.847 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.847 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.847 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.847 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5328.0:2543 3.16 3:6928f3a1:::rbd_object_map.11551722dd77:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:18:05.847 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:18:05.847 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 53.705933987999998, 2024-09-12T16:18:05.847 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053695720000000002, 2024-09-12T16:18:05.847 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:05.848 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:05.848 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:05.848 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:05.848 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5328", 2024-09-12T16:18:05.848 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:18:05.848 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2543 2024-09-12T16:18:05.848 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.848 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:05.848 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.848 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:05.848 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:18:05.848 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.848 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.849 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:05.849 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:18:05.849 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.849 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:05.849 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056191+0000", 2024-09-12T16:18:05.849 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.54e-07 2024-09-12T16:18:05.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.849 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:05.849 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056195+0000", 2024-09-12T16:18:05.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5460000000000002e-06 2024-09-12T16:18:05.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:05.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056205+0000", 2024-09-12T16:18:05.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7350000000000008e-06 2024-09-12T16:18:05.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:05.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056214+0000", 2024-09-12T16:18:05.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8089999999999999e-06 2024-09-12T16:18:05.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:05.851 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103317+0000", 2024-09-12T16:18:05.851 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.047102889000000002 2024-09-12T16:18:05.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.851 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.851 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:05.851 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103410+0000", 2024-09-12T16:18:05.851 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3689000000000004e-05 2024-09-12T16:18:05.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.851 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.851 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T16:18:05.851 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103754+0000", 2024-09-12T16:18:05.851 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034344699999999998 2024-09-12T16:18:05.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.851 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.852 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:05.852 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.106487+0000", 2024-09-12T16:18:05.852 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0027330100000000001 2024-09-12T16:18:05.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.852 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.852 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:18:05.852 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109827+0000", 2024-09-12T16:18:05.852 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033406640000000001 2024-09-12T16:18:05.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.852 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.852 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:05.852 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109854+0000", 2024-09-12T16:18:05.852 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6866999999999999e-05 2024-09-12T16:18:05.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.853 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.853 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:05.853 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109886+0000", 2024-09-12T16:18:05.853 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1309999999999997e-05 2024-09-12T16:18:05.853 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.853 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:05.853 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.853 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.853 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.853 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5832.0:1710 3.f 3:f0d97d21:::rbd_data.1155d3b3a2ae.0000000000000012:head [truncate 1376256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-12T16:18:05.853 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:18:05.853 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 18.378135903, 2024-09-12T16:18:05.853 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6441524489999999, 2024-09-12T16:18:05.854 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:05.854 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:05.854 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:05.854 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:05.854 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5832", 2024-09-12T16:18:05.854 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/201125203", 2024-09-12T16:18:05.854 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1710 2024-09-12T16:18:05.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.854 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:05.854 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.854 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:05.854 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:18:05.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:05.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:18:05.855 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:05.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:05.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:18:05.855 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.08e-07 2024-09-12T16:18:05.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:05.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383990+0000", 2024-09-12T16:18:05.855 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.979e-06 2024-09-12T16:18:05.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.856 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:05.856 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383999+0000", 2024-09-12T16:18:05.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3240000000000003e-06 2024-09-12T16:18:05.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.856 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:05.856 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.384002+0000", 2024-09-12T16:18:05.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5489999999999998e-06 2024-09-12T16:18:05.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.857 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:05.857 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.384037+0000", 2024-09-12T16:18:05.857 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4931000000000001e-05 2024-09-12T16:18:05.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.857 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.857 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:05.857 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.384043+0000", 2024-09-12T16:18:05.857 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3920000000000002e-06 2024-09-12T16:18:05.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.857 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.857 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:05.857 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:48.007976+0000", 2024-09-12T16:18:05.857 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.62393385300000004 2024-09-12T16:18:05.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.858 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.858 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:05.858 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:48.007992+0000", 2024-09-12T16:18:05.858 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5668e-05 2024-09-12T16:18:05.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.858 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.858 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:05.858 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024187+0000", 2024-09-12T16:18:05.858 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0161951629999999 2024-09-12T16:18:05.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.858 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.858 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:05.858 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024362+0000", 2024-09-12T16:18:05.858 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017500600000000001 2024-09-12T16:18:05.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.859 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:18:05.859 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024453+0000", 2024-09-12T16:18:05.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1055000000000001e-05 2024-09-12T16:18:05.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.859 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:18:05.859 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024963+0000", 2024-09-12T16:18:05.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000510087 2024-09-12T16:18:05.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.859 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:05.859 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.027974+0000", 2024-09-12T16:18:05.860 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030107070000000001 2024-09-12T16:18:05.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.860 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.860 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:05.860 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.028022+0000", 2024-09-12T16:18:05.860 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7636000000000003e-05 2024-09-12T16:18:05.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:05.860 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:05.860 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:05.860 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.028140+0000", 2024-09-12T16:18:05.860 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011869100000000001 2024-09-12T16:18:05.860 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.860 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:05.861 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.861 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:05.861 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:05.861 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:05.862 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:18:05.863 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:05.861+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:05.963 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:05.962+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:06.010 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:06.010 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:06.010 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:18:06.010 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:06.018 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:18:06.064 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:06.062+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:06.133 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:06.133 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:06.133 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:18:06.134 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:18:06.134 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:06.142 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:18:06.186 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:06.185+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:06.253 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:06.253 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:18:06.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:18:06.253 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:18:06.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.253 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5599 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4788224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:06.254 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:18:06.254 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 85.955214248999994, 2024-09-12T16:18:06.254 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061192059, 2024-09-12T16:18:06.254 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.254 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.254 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:06.254 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:06.254 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:06.254 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:06.254 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5599 2024-09-12T16:18:06.254 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.254 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.254 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.254 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.255 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:18:06.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.255 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.255 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:18:06.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.255 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.255 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296333+0000", 2024-09-12T16:18:06.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6599999999999996e-07 2024-09-12T16:18:06.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.256 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.256 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296335+0000", 2024-09-12T16:18:06.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5900000000000002e-06 2024-09-12T16:18:06.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.256 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.256 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296344+0000", 2024-09-12T16:18:06.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9539999999999993e-06 2024-09-12T16:18:06.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.256 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.256 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296350+0000", 2024-09-12T16:18:06.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5589999999999996e-06 2024-09-12T16:18:06.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.257 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.257 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357307+0000", 2024-09-12T16:18:06.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.060957573000000001 2024-09-12T16:18:06.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.257 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:06.257 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357401+0000", 2024-09-12T16:18:06.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3512999999999997e-05 2024-09-12T16:18:06.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.258 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357524+0000", 2024-09-12T16:18:06.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000123304 2024-09-12T16:18:06.258 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.258 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.258 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.258 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5611 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4730880~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:06.258 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:18:06.258 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 85.955151805, 2024-09-12T16:18:06.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061359348000000001, 2024-09-12T16:18:06.258 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.259 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.259 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:06.259 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:06.259 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:06.259 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:06.259 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5611 2024-09-12T16:18:06.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.259 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.259 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.259 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:18:06.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.260 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.260 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:18:06.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.260 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.260 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296395+0000", 2024-09-12T16:18:06.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4600000000000003e-07 2024-09-12T16:18:06.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.260 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.260 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296399+0000", 2024-09-12T16:18:06.261 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9430000000000002e-06 2024-09-12T16:18:06.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.261 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.261 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296411+0000", 2024-09-12T16:18:06.261 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1755e-05 2024-09-12T16:18:06.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.261 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.261 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296417+0000", 2024-09-12T16:18:06.261 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3790000000000003e-06 2024-09-12T16:18:06.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357572+0000", 2024-09-12T16:18:06.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061154871 2024-09-12T16:18:06.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:06.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357663+0000", 2024-09-12T16:18:06.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0389999999999993e-05 2024-09-12T16:18:06.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357754+0000", 2024-09-12T16:18:06.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1063999999999994e-05 2024-09-12T16:18:06.263 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.263 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.263 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.263 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.263 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5613 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4775936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:06.263 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:18:06.263 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 85.955110625000003, 2024-09-12T16:18:06.263 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061491777999999997, 2024-09-12T16:18:06.263 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.263 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.263 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:06.263 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:06.263 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:06.264 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:06.264 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5613 2024-09-12T16:18:06.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.264 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.264 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.264 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:18:06.264 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.264 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.264 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:18:06.264 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:18:06.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8899999999999999e-07 2024-09-12T16:18:06.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296439+0000", 2024-09-12T16:18:06.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8439999999999998e-06 2024-09-12T16:18:06.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296452+0000", 2024-09-12T16:18:06.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2639e-05 2024-09-12T16:18:06.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296457+0000", 2024-09-12T16:18:06.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5720000000000002e-06 2024-09-12T16:18:06.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357773+0000", 2024-09-12T16:18:06.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061315500000000002 2024-09-12T16:18:06.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.267 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:06.267 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357814+0000", 2024-09-12T16:18:06.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1448e-05 2024-09-12T16:18:06.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.267 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.267 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357927+0000", 2024-09-12T16:18:06.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000113186 2024-09-12T16:18:06.267 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.267 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.267 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.268 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5616 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4784128~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:06.268 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:18:06.268 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 85.955075562999994, 2024-09-12T16:18:06.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061725002000000001, 2024-09-12T16:18:06.268 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.268 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.268 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:06.268 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:06.268 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:06.268 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:06.268 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5616 2024-09-12T16:18:06.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.268 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.269 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.269 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.269 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:18:06.269 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.269 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.269 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.269 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:18:06.269 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.269 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.269 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.269 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:18:06.269 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5900000000000002e-07 2024-09-12T16:18:06.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.270 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.270 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296473+0000", 2024-09-12T16:18:06.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3130000000000001e-06 2024-09-12T16:18:06.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.270 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.270 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296481+0000", 2024-09-12T16:18:06.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1389999999999998e-06 2024-09-12T16:18:06.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.270 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.270 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296486+0000", 2024-09-12T16:18:06.271 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3310000000000003e-06 2024-09-12T16:18:06.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.271 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.271 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357981+0000", 2024-09-12T16:18:06.271 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061494866000000002 2024-09-12T16:18:06.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.271 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:06.271 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358082+0000", 2024-09-12T16:18:06.271 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101424 2024-09-12T16:18:06.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.271 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.272 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358196+0000", 2024-09-12T16:18:06.272 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011347 2024-09-12T16:18:06.272 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.272 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.272 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.272 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.272 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.272 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5626 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4739072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:06.272 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:18:06.272 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 85.954997606999996, 2024-09-12T16:18:06.272 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061802430999999998, 2024-09-12T16:18:06.272 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.272 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.273 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:06.273 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:06.273 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:06.273 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:06.273 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5626 2024-09-12T16:18:06.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.273 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.273 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.273 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:18:06.273 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.273 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.274 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:18:06.274 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.274 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.274 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.274 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.274 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296550+0000", 2024-09-12T16:18:06.274 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.215e-06 2024-09-12T16:18:06.274 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.274 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.274 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.274 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296555+0000", 2024-09-12T16:18:06.274 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9590000000000003e-06 2024-09-12T16:18:06.274 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.274 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.275 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.275 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296568+0000", 2024-09-12T16:18:06.275 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3338e-05 2024-09-12T16:18:06.275 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.275 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.275 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.275 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296576+0000", 2024-09-12T16:18:06.275 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5510000000000002e-06 2024-09-12T16:18:06.275 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.275 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.275 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.275 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358241+0000", 2024-09-12T16:18:06.275 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.06166576 2024-09-12T16:18:06.275 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.276 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.276 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:06.276 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358288+0000", 2024-09-12T16:18:06.276 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6097000000000003e-05 2024-09-12T16:18:06.276 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.276 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.276 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.276 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358351+0000", 2024-09-12T16:18:06.276 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3510999999999996e-05 2024-09-12T16:18:06.276 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.276 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.276 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.276 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.276 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.277 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5628 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4792320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:06.277 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:18:06.277 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 85.954955107000004, 2024-09-12T16:18:06.277 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061961161000000001, 2024-09-12T16:18:06.277 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.277 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.277 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:06.277 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:06.277 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:06.277 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:06.277 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5628 2024-09-12T16:18:06.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.277 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.278 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.278 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.278 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:18:06.278 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.278 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.278 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.278 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.278 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:18:06.278 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.278 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.278 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.278 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.278 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296592+0000", 2024-09-12T16:18:06.278 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2099999999999996e-07 2024-09-12T16:18:06.279 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.279 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.279 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.279 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296595+0000", 2024-09-12T16:18:06.279 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0429999999999999e-06 2024-09-12T16:18:06.279 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.279 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.279 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.279 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296603+0000", 2024-09-12T16:18:06.279 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9899999999999997e-06 2024-09-12T16:18:06.279 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.279 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.279 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.279 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296609+0000", 2024-09-12T16:18:06.279 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7259999999999999e-06 2024-09-12T16:18:06.280 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.280 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.280 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.280 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358393+0000", 2024-09-12T16:18:06.280 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061784617 2024-09-12T16:18:06.280 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.280 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.280 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:06.280 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358460+0000", 2024-09-12T16:18:06.280 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7253000000000001e-05 2024-09-12T16:18:06.280 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.280 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.280 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.280 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358552+0000", 2024-09-12T16:18:06.281 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1811000000000006e-05 2024-09-12T16:18:06.281 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.281 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.281 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.281 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.281 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.281 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5638 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4734976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:06.281 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:18:06.281 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 85.954482556000002, 2024-09-12T16:18:06.281 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061654460000000001, 2024-09-12T16:18:06.281 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.281 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.281 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:06.281 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:06.282 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:06.282 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:06.282 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5638 2024-09-12T16:18:06.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.282 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.282 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.282 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.282 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:18:06.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.282 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.282 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.282 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:18:06.283 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.283 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.283 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.283 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:18:06.283 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.23e-07 2024-09-12T16:18:06.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.283 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.283 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.283 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297068+0000", 2024-09-12T16:18:06.283 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0060000000000003e-06 2024-09-12T16:18:06.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.283 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.283 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.283 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297080+0000", 2024-09-12T16:18:06.284 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1234e-05 2024-09-12T16:18:06.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.284 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.284 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.284 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297095+0000", 2024-09-12T16:18:06.284 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5698000000000001e-05 2024-09-12T16:18:06.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.284 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.284 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.284 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358582+0000", 2024-09-12T16:18:06.284 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061486274 2024-09-12T16:18:06.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.284 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.284 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:06.284 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358637+0000", 2024-09-12T16:18:06.285 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5439999999999998e-05 2024-09-12T16:18:06.285 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.285 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.285 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.285 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358718+0000", 2024-09-12T16:18:06.285 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0984999999999998e-05 2024-09-12T16:18:06.285 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.285 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.285 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.285 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.285 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.285 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5640 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4780032~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:06.285 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:18:06.286 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 85.954400836000005, 2024-09-12T16:18:06.286 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061746620000000002, 2024-09-12T16:18:06.286 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.286 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.286 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:06.286 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:06.286 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:06.286 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:06.286 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5640 2024-09-12T16:18:06.286 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.286 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.286 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.286 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.286 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:18:06.287 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.287 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.287 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.287 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.287 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:18:06.287 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.287 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.287 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.287 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.287 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297146+0000", 2024-09-12T16:18:06.287 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3600000000000003e-07 2024-09-12T16:18:06.287 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.288 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.288 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.288 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297150+0000", 2024-09-12T16:18:06.288 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8430000000000003e-06 2024-09-12T16:18:06.288 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.288 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.288 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.288 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297160+0000", 2024-09-12T16:18:06.288 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7229999999999999e-06 2024-09-12T16:18:06.288 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.288 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.288 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.289 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297167+0000", 2024-09-12T16:18:06.289 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0180000000000004e-06 2024-09-12T16:18:06.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.289 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.289 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.289 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358750+0000", 2024-09-12T16:18:06.289 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061583104 2024-09-12T16:18:06.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.289 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.289 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:06.289 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358804+0000", 2024-09-12T16:18:06.289 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4277000000000002e-05 2024-09-12T16:18:06.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.289 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.290 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.290 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358892+0000", 2024-09-12T16:18:06.290 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7918999999999996e-05 2024-09-12T16:18:06.290 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.290 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.290 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.290 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.290 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.290 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5642 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4788224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:06.290 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:18:06.290 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 85.954356492000002, 2024-09-12T16:18:06.290 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061860409999999998, 2024-09-12T16:18:06.290 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.291 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.291 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:06.291 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:06.291 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:06.291 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:06.291 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5642 2024-09-12T16:18:06.291 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.291 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.291 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.291 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.291 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:18:06.291 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.291 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.292 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.292 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.292 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:18:06.292 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.292 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.292 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.292 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.292 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:18:06.292 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7999999999999995e-07 2024-09-12T16:18:06.292 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.292 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.292 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.292 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297193+0000", 2024-09-12T16:18:06.293 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8310000000000001e-06 2024-09-12T16:18:06.293 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.293 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.293 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.293 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297204+0000", 2024-09-12T16:18:06.293 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0832999999999999e-05 2024-09-12T16:18:06.293 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.293 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.293 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.293 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297210+0000", 2024-09-12T16:18:06.293 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1770000000000003e-06 2024-09-12T16:18:06.293 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.293 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.294 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.294 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358928+0000", 2024-09-12T16:18:06.294 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061717826000000003 2024-09-12T16:18:06.294 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.294 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.294 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:06.294 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358977+0000", 2024-09-12T16:18:06.294 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9514000000000001e-05 2024-09-12T16:18:06.294 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.294 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.294 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.294 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359050+0000", 2024-09-12T16:18:06.294 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2649000000000002e-05 2024-09-12T16:18:06.295 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.295 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.295 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.295 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.295 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5646 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4743168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:06.295 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:18:06.295 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 85.954176551000003, 2024-09-12T16:18:06.295 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061822122, 2024-09-12T16:18:06.295 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.295 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.295 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:06.295 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:06.296 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:06.296 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:06.296 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5646 2024-09-12T16:18:06.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.296 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.296 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.296 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.296 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:18:06.296 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.296 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.296 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.296 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:18:06.296 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.297 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.297 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.297 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:18:06.297 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3200000000000004e-07 2024-09-12T16:18:06.297 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.297 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.297 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.297 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297374+0000", 2024-09-12T16:18:06.297 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8240000000000001e-06 2024-09-12T16:18:06.297 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.297 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.297 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.297 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297384+0000", 2024-09-12T16:18:06.297 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5710000000000004e-06 2024-09-12T16:18:06.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.298 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.298 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.298 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297390+0000", 2024-09-12T16:18:06.298 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5130000000000002e-06 2024-09-12T16:18:06.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.298 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.298 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.298 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359080+0000", 2024-09-12T16:18:06.298 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061689569999999999 2024-09-12T16:18:06.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.298 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.298 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:06.298 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359134+0000", 2024-09-12T16:18:06.298 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3838999999999997e-05 2024-09-12T16:18:06.299 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.299 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.299 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.299 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359192+0000", 2024-09-12T16:18:06.299 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8072999999999998e-05 2024-09-12T16:18:06.299 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.299 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.299 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.299 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.299 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.299 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5647 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4751360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:06.299 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:18:06.299 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 85.954139866000006, 2024-09-12T16:18:06.299 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061927569000000002, 2024-09-12T16:18:06.299 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.300 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.300 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:06.300 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:06.300 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:06.300 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:06.300 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5647 2024-09-12T16:18:06.300 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.300 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.300 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.300 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.300 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:18:06.300 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.300 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.301 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.301 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.301 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:18:06.301 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.301 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.301 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.301 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.301 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297407+0000", 2024-09-12T16:18:06.301 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.46e-07 2024-09-12T16:18:06.301 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.301 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.301 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.301 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297409+0000", 2024-09-12T16:18:06.301 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.469e-06 2024-09-12T16:18:06.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.302 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.302 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.302 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297415+0000", 2024-09-12T16:18:06.302 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9259999999999997e-06 2024-09-12T16:18:06.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.302 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.302 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.302 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297419+0000", 2024-09-12T16:18:06.302 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3840000000000001e-06 2024-09-12T16:18:06.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.302 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.302 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.302 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359224+0000", 2024-09-12T16:18:06.303 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061805367999999999 2024-09-12T16:18:06.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.303 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.303 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:06.303 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359275+0000", 2024-09-12T16:18:06.303 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1338000000000002e-05 2024-09-12T16:18:06.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.303 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.303 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.303 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359334+0000", 2024-09-12T16:18:06.303 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8638000000000003e-05 2024-09-12T16:18:06.303 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.303 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.303 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.304 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.304 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5649 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4796416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:06.304 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:18:06.304 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 85.954085007000003, 2024-09-12T16:18:06.304 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.062018578999999997, 2024-09-12T16:18:06.304 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.304 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.304 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:06.304 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:06.304 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:06.304 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:06.304 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5649 2024-09-12T16:18:06.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.305 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.305 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.305 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.305 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:18:06.305 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.305 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.305 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.305 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:18:06.305 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.305 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.305 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.305 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297462+0000", 2024-09-12T16:18:06.306 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2399999999999998e-07 2024-09-12T16:18:06.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.306 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.306 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.306 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297465+0000", 2024-09-12T16:18:06.306 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.371e-06 2024-09-12T16:18:06.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.306 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.306 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.306 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297473+0000", 2024-09-12T16:18:06.306 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4699999999999996e-06 2024-09-12T16:18:06.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.306 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.307 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.307 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297478+0000", 2024-09-12T16:18:06.307 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2780000000000001e-06 2024-09-12T16:18:06.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.307 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.307 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.307 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359368+0000", 2024-09-12T16:18:06.307 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061889758000000003 2024-09-12T16:18:06.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.307 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.307 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:06.307 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359420+0000", 2024-09-12T16:18:06.307 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2574999999999997e-05 2024-09-12T16:18:06.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.308 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359480+0000", 2024-09-12T16:18:06.308 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9503000000000003e-05 2024-09-12T16:18:06.308 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.308 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.308 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.308 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5674 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4739072~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:06.308 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:18:06.308 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 85.953681239000005, 2024-09-12T16:18:06.308 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061762989999999997, 2024-09-12T16:18:06.309 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.309 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.309 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:06.309 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:06.309 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:06.309 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:06.309 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5674 2024-09-12T16:18:06.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.309 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:18:06.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.310 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.310 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.310 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:18:06.310 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.310 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.310 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.310 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297866+0000", 2024-09-12T16:18:06.310 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1900000000000001e-07 2024-09-12T16:18:06.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.310 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.310 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.311 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297870+0000", 2024-09-12T16:18:06.311 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3560000000000003e-06 2024-09-12T16:18:06.311 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.311 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.311 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.311 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297888+0000", 2024-09-12T16:18:06.311 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8088999999999999e-05 2024-09-12T16:18:06.311 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.311 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.311 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.311 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297904+0000", 2024-09-12T16:18:06.311 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5971e-05 2024-09-12T16:18:06.311 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.312 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.312 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.312 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359510+0000", 2024-09-12T16:18:06.312 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061605634999999999 2024-09-12T16:18:06.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.312 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.312 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:06.312 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359554+0000", 2024-09-12T16:18:06.312 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4024999999999999e-05 2024-09-12T16:18:06.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.312 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.312 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.312 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359628+0000", 2024-09-12T16:18:06.312 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4095000000000001e-05 2024-09-12T16:18:06.313 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.313 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.313 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.313 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.313 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.313 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5676 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4792320~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:06.313 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:18:06.313 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 85.953480158999994, 2024-09-12T16:18:06.313 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061720143999999998, 2024-09-12T16:18:06.313 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.313 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.313 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:06.313 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:06.313 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:06.314 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:06.314 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5676 2024-09-12T16:18:06.314 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.314 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.314 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.314 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.314 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:18:06.314 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.314 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.314 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.314 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.314 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:18:06.314 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.314 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.315 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.315 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.315 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298067+0000", 2024-09-12T16:18:06.315 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8199999999999999e-07 2024-09-12T16:18:06.315 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.315 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.315 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.315 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298070+0000", 2024-09-12T16:18:06.315 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.743e-06 2024-09-12T16:18:06.315 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.315 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.315 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.315 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298080+0000", 2024-09-12T16:18:06.316 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4059999999999994e-06 2024-09-12T16:18:06.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.316 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.316 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298088+0000", 2024-09-12T16:18:06.316 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0779999999999996e-06 2024-09-12T16:18:06.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.316 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.316 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359659+0000", 2024-09-12T16:18:06.316 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061570688999999998 2024-09-12T16:18:06.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:06.317 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359713+0000", 2024-09-12T16:18:06.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3939e-05 2024-09-12T16:18:06.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.317 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.317 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359786+0000", 2024-09-12T16:18:06.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3607000000000002e-05 2024-09-12T16:18:06.317 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.317 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.317 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.317 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.317 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5684 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4747264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:06.318 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:18:06.318 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 85.953012866999998, 2024-09-12T16:18:06.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061394799, 2024-09-12T16:18:06.318 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.318 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.318 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:06.318 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:06.318 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:06.318 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:06.318 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5684 2024-09-12T16:18:06.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.318 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.318 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.319 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:18:06.319 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.319 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.319 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.319 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:18:06.319 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.319 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.319 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.319 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298534+0000", 2024-09-12T16:18:06.319 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4399999999999999e-07 2024-09-12T16:18:06.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.319 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.320 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.320 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298539+0000", 2024-09-12T16:18:06.320 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5360000000000003e-06 2024-09-12T16:18:06.320 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.320 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.320 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.320 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298550+0000", 2024-09-12T16:18:06.320 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1499e-05 2024-09-12T16:18:06.320 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.320 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.320 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.320 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298558+0000", 2024-09-12T16:18:06.320 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3000000000000004e-06 2024-09-12T16:18:06.320 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.321 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.321 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.321 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359815+0000", 2024-09-12T16:18:06.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061257952999999997 2024-09-12T16:18:06.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.321 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.321 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:06.321 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359868+0000", 2024-09-12T16:18:06.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2317000000000001e-05 2024-09-12T16:18:06.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.321 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.321 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.321 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359928+0000", 2024-09-12T16:18:06.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0350000000000003e-05 2024-09-12T16:18:06.322 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.322 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.322 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.322 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5686 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4755456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:06.322 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:18:06.322 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 85.952845443000001, 2024-09-12T16:18:06.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061355082999999998, 2024-09-12T16:18:06.322 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.322 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.322 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:06.322 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:06.322 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:06.322 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:06.323 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5686 2024-09-12T16:18:06.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.323 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.323 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.323 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:18:06.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.323 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.323 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:18:06.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.323 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.324 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298702+0000", 2024-09-12T16:18:06.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2399999999999997e-07 2024-09-12T16:18:06.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.324 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.324 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.324 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298706+0000", 2024-09-12T16:18:06.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5700000000000003e-06 2024-09-12T16:18:06.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.324 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.324 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.324 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298718+0000", 2024-09-12T16:18:06.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1457999999999999e-05 2024-09-12T16:18:06.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.324 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.325 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.325 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298732+0000", 2024-09-12T16:18:06.325 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.452e-05 2024-09-12T16:18:06.325 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.325 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.325 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.325 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359956+0000", 2024-09-12T16:18:06.325 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061223626000000003 2024-09-12T16:18:06.325 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.325 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.325 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:06.325 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360000+0000", 2024-09-12T16:18:06.325 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3922999999999999e-05 2024-09-12T16:18:06.325 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.325 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.326 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.326 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360056+0000", 2024-09-12T16:18:06.326 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6162000000000002e-05 2024-09-12T16:18:06.326 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.326 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.326 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.326 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.326 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5688 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4800512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:06.326 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:18:06.326 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 85.952622390000002, 2024-09-12T16:18:06.326 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061270514999999998, 2024-09-12T16:18:06.326 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.326 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.326 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:06.327 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:06.327 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:06.327 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:06.327 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5688 2024-09-12T16:18:06.327 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.327 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.327 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.327 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.327 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:18:06.327 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.327 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.327 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.327 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.328 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:18:06.328 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.328 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.328 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.328 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.328 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298925+0000", 2024-09-12T16:18:06.328 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4e-07 2024-09-12T16:18:06.328 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.328 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.328 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.328 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298929+0000", 2024-09-12T16:18:06.328 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9890000000000003e-06 2024-09-12T16:18:06.328 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.328 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.329 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.329 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298936+0000", 2024-09-12T16:18:06.329 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.52e-06 2024-09-12T16:18:06.329 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.329 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.329 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.329 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298941+0000", 2024-09-12T16:18:06.329 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4800000000000003e-06 2024-09-12T16:18:06.329 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.329 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.329 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.329 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360087+0000", 2024-09-12T16:18:06.329 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061146143 2024-09-12T16:18:06.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.330 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:06.330 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360137+0000", 2024-09-12T16:18:06.330 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0584000000000002e-05 2024-09-12T16:18:06.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.330 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.330 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360194+0000", 2024-09-12T16:18:06.330 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6858999999999999e-05 2024-09-12T16:18:06.330 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.330 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.330 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.331 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5693 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4751360~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:06.331 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:18:06.331 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 85.952200753, 2024-09-12T16:18:06.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061139444000000001, 2024-09-12T16:18:06.331 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.331 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.331 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:06.331 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:06.331 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:06.331 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:06.331 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5693 2024-09-12T16:18:06.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.332 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:18:06.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:18:06.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299346+0000", 2024-09-12T16:18:06.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2300000000000001e-07 2024-09-12T16:18:06.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.333 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299349+0000", 2024-09-12T16:18:06.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5270000000000001e-06 2024-09-12T16:18:06.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.333 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299358+0000", 2024-09-12T16:18:06.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7030000000000001e-06 2024-09-12T16:18:06.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.334 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.334 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299364+0000", 2024-09-12T16:18:06.334 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7239999999999997e-06 2024-09-12T16:18:06.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.334 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.334 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.334 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360369+0000", 2024-09-12T16:18:06.334 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061004713000000002 2024-09-12T16:18:06.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.334 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.334 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:06.334 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360415+0000", 2024-09-12T16:18:06.334 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5926e-05 2024-09-12T16:18:06.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.335 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.335 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.335 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360485+0000", 2024-09-12T16:18:06.335 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0327999999999995e-05 2024-09-12T16:18:06.335 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.335 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.335 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.335 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.335 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.335 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5694 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4796416~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:06.335 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:18:06.335 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 85.952171723999996, 2024-09-12T16:18:06.335 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061258034000000003, 2024-09-12T16:18:06.335 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.336 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.336 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:06.336 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:06.336 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:06.336 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:06.336 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5694 2024-09-12T16:18:06.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.336 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.336 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.336 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.336 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:18:06.336 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.337 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:18:06.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.337 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301884+0000", 2024-09-12T16:18:06.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025090379999999999 2024-09-12T16:18:06.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.337 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301889+0000", 2024-09-12T16:18:06.338 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5879999999999997e-06 2024-09-12T16:18:06.338 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.338 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.338 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.338 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301901+0000", 2024-09-12T16:18:06.338 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1466e-05 2024-09-12T16:18:06.338 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.338 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.338 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.338 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301908+0000", 2024-09-12T16:18:06.338 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1999999999999997e-06 2024-09-12T16:18:06.338 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.339 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.339 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.339 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360513+0000", 2024-09-12T16:18:06.339 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.058605023999999999 2024-09-12T16:18:06.339 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.339 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.339 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:06.339 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360562+0000", 2024-09-12T16:18:06.339 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9546000000000003e-05 2024-09-12T16:18:06.339 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.339 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.339 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.339 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360633+0000", 2024-09-12T16:18:06.340 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0172000000000005e-05 2024-09-12T16:18:06.340 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.340 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.340 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.340 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.340 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5759 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4767744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:06.340 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:18:06.340 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 85.949378190000004, 2024-09-12T16:18:06.340 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061058604000000002, 2024-09-12T16:18:06.340 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.340 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.341 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:06.341 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:06.341 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:06.341 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:06.341 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5759 2024-09-12T16:18:06.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.341 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.341 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.341 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.341 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:18:06.341 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.341 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.341 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.342 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:18:06.342 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.342 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.342 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.342 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302548+0000", 2024-09-12T16:18:06.342 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00038011000000000002 2024-09-12T16:18:06.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.342 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.342 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.342 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302553+0000", 2024-09-12T16:18:06.342 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1830000000000002e-06 2024-09-12T16:18:06.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.342 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.343 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.343 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302564+0000", 2024-09-12T16:18:06.343 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1011e-05 2024-09-12T16:18:06.343 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.343 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.343 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.343 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302572+0000", 2024-09-12T16:18:06.343 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9009999999999994e-06 2024-09-12T16:18:06.343 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.343 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.343 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.343 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363102+0000", 2024-09-12T16:18:06.343 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.060529782999999997 2024-09-12T16:18:06.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.344 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.344 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:06.344 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363149+0000", 2024-09-12T16:18:06.344 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7321000000000003e-05 2024-09-12T16:18:06.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.344 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.344 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.344 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363227+0000", 2024-09-12T16:18:06.344 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7294999999999998e-05 2024-09-12T16:18:06.344 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.344 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.344 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.344 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.345 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.345 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:06.346 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:18:06.347 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:06.345+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:06.447 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:06.446+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:06.495 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:06.495 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:06.495 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:18:06.495 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:06.503 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:18:06.548 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:06.547+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:06.649 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:06.647+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:06.649 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:06.649 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:06.649 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:18:06.650 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:18:06.650 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:06.659 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:18:06.749 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:06.748+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:06.768 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:06.768 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:18:06.768 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:18:06.768 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:18:06.768 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.768 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.17 73/72 [PushOp(3:e9340267:::rbd_data.1155525b14e3.0000000000000031:f, version: 50'357, data_included: [0~4096,20480~4096,40960~8192,65536~4096,81920~8192,110592~4096,126976~8192,151552~4096,172032~8192,196608~4096,212992~8192,241664~4096,258048~8192,282624~4096,303104~8192,327680~4096,344064~8192,372736~4096,389120~8192,413696~4096,434176~8192,458752~4096,475136~8192,503808~4096,520192~8192,544768~4096,565248~8192,589824~4096,606208~8192,634880~4096,651264~8192,675840~4096,696320~8192,720896~4096,737280~8192,765952~4096,782336~8192,806912~4096,827392~8192,851968~4096,868352~8192,897024~4096,913408~8192,937984~4096,958464~8192,983040~4096,999424~8192,1028096~4096,1044480~4096], data_size: 294912, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:e9340267:::rbd_data.1155525b14e3.0000000000000031:f@50'357, size: 1048576, copy_subset: [(0, 1048576)], clone_subset: {}, snapset: f=[]:{f: [f]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T16:18:06.768 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.067448+0000", 2024-09-12T16:18:06.768 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 60.699353850999998, 2024-09-12T16:18:06.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003036721, 2024-09-12T16:18:06.769 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.769 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.769 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:06.769 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.769 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.769 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067448+0000", 2024-09-12T16:18:06.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.769 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.769 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067448+0000", 2024-09-12T16:18:06.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.770 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.770 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067449+0000", 2024-09-12T16:18:06.770 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2200000000000004e-07 2024-09-12T16:18:06.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.770 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.770 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067703+0000", 2024-09-12T16:18:06.770 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025377199999999998 2024-09-12T16:18:06.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.770 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.771 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067723+0000", 2024-09-12T16:18:06.771 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.986e-05 2024-09-12T16:18:06.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.771 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.771 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.771 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067743+0000", 2024-09-12T16:18:06.771 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9942e-05 2024-09-12T16:18:06.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.771 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.771 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.771 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067860+0000", 2024-09-12T16:18:06.771 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000116959 2024-09-12T16:18:06.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.772 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:06.772 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067872+0000", 2024-09-12T16:18:06.772 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2928000000000001e-05 2024-09-12T16:18:06.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.772 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.772 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.070485+0000", 2024-09-12T16:18:06.772 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0026127379999999999 2024-09-12T16:18:06.772 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.772 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.772 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.773 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.773 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.773 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5120.0:3941 3.17 e80/74 3:eff97428:::rbd_data.1155a3b3a26e.0000000000000060:head v 80'442, mlcod=79'439)", 2024-09-12T16:18:06.773 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:18:06.773 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 50.411013369999999, 2024-09-12T16:18:06.773 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0035981759999999998, 2024-09-12T16:18:06.773 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.773 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.773 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:06.773 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.773 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.773 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.773 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:18:06.773 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.774 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.774 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.774 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:18:06.774 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.774 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.774 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.774 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:18:06.774 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2e-07 2024-09-12T16:18:06.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.774 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.774 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.774 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355794+0000", 2024-09-12T16:18:06.774 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.865e-06 2024-09-12T16:18:06.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.775 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.775 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355956+0000", 2024-09-12T16:18:06.775 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016131699999999999 2024-09-12T16:18:06.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.775 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.775 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355964+0000", 2024-09-12T16:18:06.775 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7960000000000001e-06 2024-09-12T16:18:06.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.775 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.775 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.356320+0000", 2024-09-12T16:18:06.775 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000355612 2024-09-12T16:18:06.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.776 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:06.776 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.356337+0000", 2024-09-12T16:18:06.776 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6643e-05 2024-09-12T16:18:06.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.776 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:06.776 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.359340+0000", 2024-09-12T16:18:06.776 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003003618 2024-09-12T16:18:06.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.776 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.777 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.359387+0000", 2024-09-12T16:18:06.777 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6904999999999999e-05 2024-09-12T16:18:06.777 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.777 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.777 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.777 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.777 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2118 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1219, mlcod=88'1217)", 2024-09-12T16:18:06.777 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440434+0000", 2024-09-12T16:18:06.777 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 41.326368479999999, 2024-09-12T16:18:06.777 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003875543, 2024-09-12T16:18:06.777 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.777 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.777 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:06.777 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.778 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.778 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440434+0000", 2024-09-12T16:18:06.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.778 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.778 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440434+0000", 2024-09-12T16:18:06.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.778 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.778 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440435+0000", 2024-09-12T16:18:06.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8899999999999998e-07 2024-09-12T16:18:06.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440444+0000", 2024-09-12T16:18:06.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4599999999999992e-06 2024-09-12T16:18:06.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440459+0000", 2024-09-12T16:18:06.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4460999999999999e-05 2024-09-12T16:18:06.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440466+0000", 2024-09-12T16:18:06.780 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4340000000000003e-06 2024-09-12T16:18:06.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.780 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.780 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.780 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:18:06.780 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9054999999999997e-05 2024-09-12T16:18:06.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.780 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.780 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:06.780 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440535+0000", 2024-09-12T16:18:06.780 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.98e-05 2024-09-12T16:18:06.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.780 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.781 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:06.781 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444269+0000", 2024-09-12T16:18:06.781 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003734448 2024-09-12T16:18:06.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.781 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.781 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.781 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444309+0000", 2024-09-12T16:18:06.781 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0095999999999997e-05 2024-09-12T16:18:06.781 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.781 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.781 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.781 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.782 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2122 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1220, mlcod=88'1217)", 2024-09-12T16:18:06.782 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440484+0000", 2024-09-12T16:18:06.782 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 41.326317973999998, 2024-09-12T16:18:06.782 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0038538029999999998, 2024-09-12T16:18:06.782 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.782 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.782 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:06.782 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.782 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.782 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.782 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440484+0000", 2024-09-12T16:18:06.782 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.782 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.782 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.782 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.783 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440484+0000", 2024-09-12T16:18:06.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.783 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.783 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440485+0000", 2024-09-12T16:18:06.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6100000000000002e-07 2024-09-12T16:18:06.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.783 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.783 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440493+0000", 2024-09-12T16:18:06.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0169999999999996e-06 2024-09-12T16:18:06.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.784 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.784 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.784 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440501+0000", 2024-09-12T16:18:06.784 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9319999999999996e-06 2024-09-12T16:18:06.784 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.784 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.784 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.784 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440506+0000", 2024-09-12T16:18:06.784 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3510000000000001e-06 2024-09-12T16:18:06.784 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.784 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.784 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.785 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441319+0000", 2024-09-12T16:18:06.785 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00081295300000000005 2024-09-12T16:18:06.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.785 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.785 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:06.785 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441336+0000", 2024-09-12T16:18:06.785 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6897000000000001e-05 2024-09-12T16:18:06.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.785 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.785 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:06.785 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444311+0000", 2024-09-12T16:18:06.785 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029754510000000001 2024-09-12T16:18:06.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.786 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.786 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.786 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444338+0000", 2024-09-12T16:18:06.786 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6840999999999999e-05 2024-09-12T16:18:06.786 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.786 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.786 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.786 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.786 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2124 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1221, mlcod=88'1217)", 2024-09-12T16:18:06.786 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:18:06.786 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 41.326287401999998, 2024-09-12T16:18:06.786 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0038507229999999999, 2024-09-12T16:18:06.786 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.787 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.787 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:06.787 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.787 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.787 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.787 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:18:06.787 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.787 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.787 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.787 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.787 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:18:06.787 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.787 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.788 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.788 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.788 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:18:06.788 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8799999999999998e-07 2024-09-12T16:18:06.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.788 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.788 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.788 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440519+0000", 2024-09-12T16:18:06.788 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5499999999999999e-06 2024-09-12T16:18:06.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.788 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.788 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.788 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440525+0000", 2024-09-12T16:18:06.788 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1009999999999997e-06 2024-09-12T16:18:06.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.789 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.789 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.789 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440529+0000", 2024-09-12T16:18:06.789 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3749999999999996e-06 2024-09-12T16:18:06.789 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.789 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.789 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.789 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441883+0000", 2024-09-12T16:18:06.789 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0013538249999999999 2024-09-12T16:18:06.789 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.789 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.789 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:06.789 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441901+0000", 2024-09-12T16:18:06.789 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7972999999999999e-05 2024-09-12T16:18:06.789 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.790 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.790 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:06.790 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444341+0000", 2024-09-12T16:18:06.790 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002439568 2024-09-12T16:18:06.790 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.790 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.790 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.790 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444366+0000", 2024-09-12T16:18:06.790 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5043000000000001e-05 2024-09-12T16:18:06.790 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.790 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.790 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.790 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.790 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.790 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2327 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1222, mlcod=88'1217)", 2024-09-12T16:18:06.791 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440696+0000", 2024-09-12T16:18:06.791 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 41.326106060000001, 2024-09-12T16:18:06.791 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0036945739999999999, 2024-09-12T16:18:06.791 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.791 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.791 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:06.791 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.791 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.791 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.791 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440696+0000", 2024-09-12T16:18:06.791 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.791 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.791 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.791 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.791 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440696+0000", 2024-09-12T16:18:06.791 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.792 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.792 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.792 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.792 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440697+0000", 2024-09-12T16:18:06.792 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5899999999999996e-07 2024-09-12T16:18:06.792 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.792 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.792 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.792 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440702+0000", 2024-09-12T16:18:06.792 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0969999999999996e-06 2024-09-12T16:18:06.792 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.792 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.792 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.793 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440713+0000", 2024-09-12T16:18:06.793 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1114000000000001e-05 2024-09-12T16:18:06.793 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.793 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.793 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.793 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440719+0000", 2024-09-12T16:18:06.793 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1650000000000003e-06 2024-09-12T16:18:06.793 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.793 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.793 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.793 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.442435+0000", 2024-09-12T16:18:06.793 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017155440000000001 2024-09-12T16:18:06.793 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.794 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.794 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:06.794 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.442457+0000", 2024-09-12T16:18:06.794 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1793999999999998e-05 2024-09-12T16:18:06.794 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.794 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.794 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:06.794 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444367+0000", 2024-09-12T16:18:06.794 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0019101980000000001 2024-09-12T16:18:06.794 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.794 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.794 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.794 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444391+0000", 2024-09-12T16:18:06.794 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4003e-05 2024-09-12T16:18:06.795 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.795 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.795 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.795 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.795 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.795 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2487 3.1d e88/74 3:b8c395a6:::rbd_data.11558d85ce23.000000000000000b:head v 88'1225, mlcod=88'1223)", 2024-09-12T16:18:06.795 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:18:06.795 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 41.320591690999997, 2024-09-12T16:18:06.795 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033166039999999999, 2024-09-12T16:18:06.795 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.795 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.795 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:06.795 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.796 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.796 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.796 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:18:06.796 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.796 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.796 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.796 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.796 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:18:06.796 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.796 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.796 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.796 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.796 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:18:06.796 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9299999999999997e-07 2024-09-12T16:18:06.797 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.797 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.797 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.797 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446295+0000", 2024-09-12T16:18:06.797 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3153999999999997e-05 2024-09-12T16:18:06.797 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.797 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.797 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.797 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446309+0000", 2024-09-12T16:18:06.797 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4015e-05 2024-09-12T16:18:06.797 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.797 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.797 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.798 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446317+0000", 2024-09-12T16:18:06.798 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4880000000000007e-06 2024-09-12T16:18:06.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.798 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.798 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.798 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446373+0000", 2024-09-12T16:18:06.798 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5766000000000001e-05 2024-09-12T16:18:06.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.798 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.798 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:06.798 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446395+0000", 2024-09-12T16:18:06.798 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2500000000000001e-05 2024-09-12T16:18:06.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.799 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.799 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:06.799 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.449445+0000", 2024-09-12T16:18:06.799 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003049791 2024-09-12T16:18:06.799 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.799 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.799 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.799 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.449527+0000", 2024-09-12T16:18:06.799 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2096999999999997e-05 2024-09-12T16:18:06.799 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.799 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.799 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.799 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.800 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.800 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2493 3.2 e88/74 3:46cb4ff0:::rbd_data.11558d85ce23.000000000000000e:head v 88'372, mlcod=87'370)", 2024-09-12T16:18:06.800 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.447443+0000", 2024-09-12T16:18:06.800 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 41.319359753000001, 2024-09-12T16:18:06.800 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029120330000000001, 2024-09-12T16:18:06.800 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.800 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.800 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:06.800 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.800 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.800 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.800 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447443+0000", 2024-09-12T16:18:06.800 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.800 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.801 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.801 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.801 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447443+0000", 2024-09-12T16:18:06.801 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.801 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.801 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.801 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447443+0000", 2024-09-12T16:18:06.801 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4600000000000001e-07 2024-09-12T16:18:06.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.801 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.801 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.801 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447779+0000", 2024-09-12T16:18:06.802 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00033639800000000001 2024-09-12T16:18:06.802 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.802 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.802 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.802 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447790+0000", 2024-09-12T16:18:06.802 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0555e-05 2024-09-12T16:18:06.802 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.802 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.802 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.802 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447797+0000", 2024-09-12T16:18:06.802 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1729999999999998e-06 2024-09-12T16:18:06.802 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.802 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.802 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.803 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447862+0000", 2024-09-12T16:18:06.803 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4670000000000003e-05 2024-09-12T16:18:06.803 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.803 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.803 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:06.803 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447889+0000", 2024-09-12T16:18:06.803 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.773e-05 2024-09-12T16:18:06.803 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.803 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.803 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:06.803 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.450311+0000", 2024-09-12T16:18:06.803 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0024212510000000001 2024-09-12T16:18:06.804 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.804 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.804 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.804 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.450355+0000", 2024-09-12T16:18:06.804 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.401e-05 2024-09-12T16:18:06.804 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.804 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.804 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.804 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.804 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.804 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "pg_update_log_missing(3.5 epoch 92/74 rep_tid 1618 entries 92'520 (0'0) error 3:a46c381c:::rbd_data.1155c757bf36.000000000000002f:head by client.5577.0:14350 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 92'518)", 2024-09-12T16:18:06.804 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.408248+0000", 2024-09-12T16:18:06.805 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 36.358553872999998, 2024-09-12T16:18:06.805 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029209660000000001, 2024-09-12T16:18:06.805 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.805 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.805 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "reached pg", 2024-09-12T16:18:06.805 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.805 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.805 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.805 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408248+0000", 2024-09-12T16:18:06.805 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.805 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.805 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.805 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.806 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408248+0000", 2024-09-12T16:18:06.806 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.806 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.806 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.806 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408249+0000", 2024-09-12T16:18:06.806 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9800000000000002e-07 2024-09-12T16:18:06.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.806 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.806 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.806 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408259+0000", 2024-09-12T16:18:06.806 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1949999999999992e-06 2024-09-12T16:18:06.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.806 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.807 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.807 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408278+0000", 2024-09-12T16:18:06.807 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9157e-05 2024-09-12T16:18:06.807 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.807 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.807 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.807 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408291+0000", 2024-09-12T16:18:06.807 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3655000000000001e-05 2024-09-12T16:18:06.807 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.807 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.807 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.807 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408369+0000", 2024-09-12T16:18:06.807 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7804000000000002e-05 2024-09-12T16:18:06.808 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.808 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.808 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.808 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411169+0000", 2024-09-12T16:18:06.808 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002800257 2024-09-12T16:18:06.808 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.808 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.808 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.808 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.808 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.808 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "pg_update_log_missing(3.1d epoch 92/74 rep_tid 3087 entries 92'1280 (0'0) error 3:bc3c4c0b:::rbd_data.1155c757bf36.000000000000002c:head by client.5577.0:14343 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 90'1278)", 2024-09-12T16:18:06.808 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.408860+0000", 2024-09-12T16:18:06.808 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 36.357942244999997, 2024-09-12T16:18:06.808 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0056480419999999998, 2024-09-12T16:18:06.809 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.809 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.809 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "reached pg", 2024-09-12T16:18:06.809 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.809 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.809 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.809 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408860+0000", 2024-09-12T16:18:06.809 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.809 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.809 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.809 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.809 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408860+0000", 2024-09-12T16:18:06.809 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.810 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.810 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.810 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.810 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408861+0000", 2024-09-12T16:18:06.810 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6600000000000002e-07 2024-09-12T16:18:06.810 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.810 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.810 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.810 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408867+0000", 2024-09-12T16:18:06.810 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4150000000000004e-06 2024-09-12T16:18:06.810 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.811 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.811 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.811 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408881+0000", 2024-09-12T16:18:06.811 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4326e-05 2024-09-12T16:18:06.811 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.811 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.811 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.811 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408895+0000", 2024-09-12T16:18:06.811 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3903000000000001e-05 2024-09-12T16:18:06.811 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.811 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.811 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.811 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410566+0000", 2024-09-12T16:18:06.812 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001670822 2024-09-12T16:18:06.812 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.812 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.812 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.812 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414508+0000", 2024-09-12T16:18:06.812 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039421100000000004 2024-09-12T16:18:06.812 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.812 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.812 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.812 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.812 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.812 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "pg_update_log_missing(3.5 epoch 92/74 rep_tid 1621 entries 92'521 (0'0) error 3:a759f741:::rbd_data.1155c757bf36.0000000000000036:head by client.5577.0:14364 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 92'518)", 2024-09-12T16:18:06.812 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:18:06.813 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 36.356993768000002, 2024-09-12T16:18:06.813 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047586740000000001, 2024-09-12T16:18:06.813 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.813 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.813 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "reached pg", 2024-09-12T16:18:06.813 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.813 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.813 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.813 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:18:06.813 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.813 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.813 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.813 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.813 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:18:06.814 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.814 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.814 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.814 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:18:06.814 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.54e-07 2024-09-12T16:18:06.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.814 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.814 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.814 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409817+0000", 2024-09-12T16:18:06.814 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.028e-06 2024-09-12T16:18:06.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.814 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.814 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.814 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410047+0000", 2024-09-12T16:18:06.815 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022964599999999999 2024-09-12T16:18:06.815 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.815 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.815 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.815 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410067+0000", 2024-09-12T16:18:06.815 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0438999999999999e-05 2024-09-12T16:18:06.815 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.815 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.815 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.815 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411223+0000", 2024-09-12T16:18:06.815 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011560229999999999 2024-09-12T16:18:06.815 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.815 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.815 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.815 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414567+0000", 2024-09-12T16:18:06.816 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033437839999999998 2024-09-12T16:18:06.816 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.816 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.816 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.816 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.816 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.816 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14391 3.5 e92/74 3:a5105766:::rbd_data.1155c757bf36.0000000000000044:head v 92'523, mlcod=92'518)", 2024-09-12T16:18:06.816 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.410084+0000", 2024-09-12T16:18:06.816 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 36.356717897999999, 2024-09-12T16:18:06.816 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0046720299999999998, 2024-09-12T16:18:06.816 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.816 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.816 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:06.816 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.817 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.817 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.817 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410084+0000", 2024-09-12T16:18:06.817 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.817 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.817 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.817 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410084+0000", 2024-09-12T16:18:06.817 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.817 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.817 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.817 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410085+0000", 2024-09-12T16:18:06.817 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1900000000000002e-07 2024-09-12T16:18:06.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.818 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.818 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.818 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410091+0000", 2024-09-12T16:18:06.818 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1e-06 2024-09-12T16:18:06.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.818 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.818 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.818 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410100+0000", 2024-09-12T16:18:06.818 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6889999999999993e-06 2024-09-12T16:18:06.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.818 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.818 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.818 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410105+0000", 2024-09-12T16:18:06.819 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3199999999999999e-06 2024-09-12T16:18:06.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.819 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.819 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.819 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411563+0000", 2024-09-12T16:18:06.819 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00145795 2024-09-12T16:18:06.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.819 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.819 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:06.819 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411590+0000", 2024-09-12T16:18:06.819 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6570000000000001e-05 2024-09-12T16:18:06.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.819 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.819 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:06.820 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414571+0000", 2024-09-12T16:18:06.820 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029815710000000001 2024-09-12T16:18:06.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.820 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.820 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.820 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414756+0000", 2024-09-12T16:18:06.820 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018521100000000001 2024-09-12T16:18:06.820 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.820 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.820 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.820 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.820 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14405 3.5 e92/74 3:a0797093:::rbd_data.1155c757bf36.000000000000004b:head v 92'525, mlcod=92'518)", 2024-09-12T16:18:06.820 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.410119+0000", 2024-09-12T16:18:06.821 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 36.356682958, 2024-09-12T16:18:06.821 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047304000000000001, 2024-09-12T16:18:06.821 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.821 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.821 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:06.821 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.821 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.821 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.821 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410119+0000", 2024-09-12T16:18:06.821 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.821 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.821 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.821 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410119+0000", 2024-09-12T16:18:06.822 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.822 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.822 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.822 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410120+0000", 2024-09-12T16:18:06.822 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:18:06.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.822 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.822 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.822 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410126+0000", 2024-09-12T16:18:06.822 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1460000000000001e-06 2024-09-12T16:18:06.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.822 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.822 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.822 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410134+0000", 2024-09-12T16:18:06.823 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8879999999999997e-06 2024-09-12T16:18:06.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.823 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.823 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410140+0000", 2024-09-12T16:18:06.823 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0839999999999997e-06 2024-09-12T16:18:06.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.823 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.823 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412146+0000", 2024-09-12T16:18:06.823 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0020057569999999999 2024-09-12T16:18:06.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.823 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:06.824 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412163+0000", 2024-09-12T16:18:06.824 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7742000000000001e-05 2024-09-12T16:18:06.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.824 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.824 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:06.824 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414761+0000", 2024-09-12T16:18:06.824 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025979660000000002 2024-09-12T16:18:06.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.824 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.824 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.824 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414850+0000", 2024-09-12T16:18:06.824 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8426999999999999e-05 2024-09-12T16:18:06.824 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.825 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.825 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.825 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.825 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.825 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14435 3.1d e92/74 3:b810b250:::rbd_data.1155c757bf36.000000000000010b:head v 92'1282, mlcod=90'1278)", 2024-09-12T16:18:06.825 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:18:06.825 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 36.355840489000002, 2024-09-12T16:18:06.825 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039190579999999996, 2024-09-12T16:18:06.825 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.825 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.825 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:06.825 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.825 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.825 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.826 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:18:06.826 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.826 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.826 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.826 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.826 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:18:06.826 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.826 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.826 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.826 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.826 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:18:06.826 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5199999999999996e-07 2024-09-12T16:18:06.826 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.826 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.826 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.826 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410968+0000", 2024-09-12T16:18:06.827 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.305e-06 2024-09-12T16:18:06.827 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.827 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.827 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.827 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410986+0000", 2024-09-12T16:18:06.827 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8213999999999999e-05 2024-09-12T16:18:06.827 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.827 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.827 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.827 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410993+0000", 2024-09-12T16:18:06.827 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2849999999999997e-06 2024-09-12T16:18:06.827 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.827 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.827 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.827 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412228+0000", 2024-09-12T16:18:06.828 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0012347370000000001 2024-09-12T16:18:06.828 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.828 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.828 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:06.828 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412262+0000", 2024-09-12T16:18:06.828 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3531999999999997e-05 2024-09-12T16:18:06.828 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.828 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.828 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:06.828 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414854+0000", 2024-09-12T16:18:06.828 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002592039 2024-09-12T16:18:06.828 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.828 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.828 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.828 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414881+0000", 2024-09-12T16:18:06.829 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7294e-05 2024-09-12T16:18:06.829 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.829 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.829 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.829 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.829 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.829 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14434 3.5 e92/74 3:a09dd60f:::rbd_data.1155c757bf36.000000000000010a:head v 92'527, mlcod=92'518)", 2024-09-12T16:18:06.829 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.411186+0000", 2024-09-12T16:18:06.829 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 36.355616341999998, 2024-09-12T16:18:06.829 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0037696930000000002, 2024-09-12T16:18:06.829 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.829 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.829 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:06.829 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.829 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.829 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.830 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411186+0000", 2024-09-12T16:18:06.830 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.830 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.830 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.830 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411186+0000", 2024-09-12T16:18:06.830 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.830 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.830 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.830 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411187+0000", 2024-09-12T16:18:06.830 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3799999999999997e-07 2024-09-12T16:18:06.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.830 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.830 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.831 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411203+0000", 2024-09-12T16:18:06.831 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6793999999999999e-05 2024-09-12T16:18:06.831 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.831 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.831 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.831 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411323+0000", 2024-09-12T16:18:06.831 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011975499999999999 2024-09-12T16:18:06.831 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.831 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.831 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.831 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411332+0000", 2024-09-12T16:18:06.831 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4370000000000007e-06 2024-09-12T16:18:06.831 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.832 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.832 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.832 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.413073+0000", 2024-09-12T16:18:06.832 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001741827 2024-09-12T16:18:06.832 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.832 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.832 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:06.832 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.413091+0000", 2024-09-12T16:18:06.832 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8011000000000001e-05 2024-09-12T16:18:06.832 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.832 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.832 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:06.833 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414882+0000", 2024-09-12T16:18:06.833 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001790841 2024-09-12T16:18:06.833 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.833 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.833 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.833 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414956+0000", 2024-09-12T16:18:06.833 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.339e-05 2024-09-12T16:18:06.833 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.833 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.833 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.833 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.833 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.833 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14426 3.13 e92/74 3:c827d1d7:::rbd_data.1155c757bf36.0000000000000056:head v 92'741, mlcod=90'737)", 2024-09-12T16:18:06.833 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:18:06.834 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 36.351524429000001, 2024-09-12T16:18:06.834 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030296030000000001, 2024-09-12T16:18:06.834 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.834 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.834 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:06.834 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.834 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.834 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.834 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:18:06.834 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.834 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.834 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.834 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.834 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:18:06.834 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.834 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.835 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.835 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.835 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:18:06.835 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6300000000000001e-07 2024-09-12T16:18:06.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.835 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.835 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.835 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415282+0000", 2024-09-12T16:18:06.835 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6289999999999999e-06 2024-09-12T16:18:06.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.835 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.835 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.835 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415288+0000", 2024-09-12T16:18:06.835 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5520000000000001e-06 2024-09-12T16:18:06.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.836 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.836 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.836 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415293+0000", 2024-09-12T16:18:06.836 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6879999999999998e-06 2024-09-12T16:18:06.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.836 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.836 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.836 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415412+0000", 2024-09-12T16:18:06.836 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118579 2024-09-12T16:18:06.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.836 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.836 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:06.836 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415429+0000", 2024-09-12T16:18:06.836 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7501000000000001e-05 2024-09-12T16:18:06.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.837 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.837 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:06.837 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.418270+0000", 2024-09-12T16:18:06.837 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028404860000000001 2024-09-12T16:18:06.837 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.837 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.837 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.837 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.418307+0000", 2024-09-12T16:18:06.837 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7805000000000001e-05 2024-09-12T16:18:06.837 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.837 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.837 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.837 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.837 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.837 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14399 3.16 e92/75 3:6e4c3dfc:::rbd_data.1155c757bf36.0000000000000048:head v 92'1286, mlcod=90'1280)", 2024-09-12T16:18:06.838 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.415311+0000", 2024-09-12T16:18:06.838 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 36.351491514999999, 2024-09-12T16:18:06.838 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028826809999999998, 2024-09-12T16:18:06.838 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.838 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.838 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:06.838 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.838 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.838 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.838 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415311+0000", 2024-09-12T16:18:06.838 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.839 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.839 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.839 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.839 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415311+0000", 2024-09-12T16:18:06.839 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.839 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.839 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.839 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.839 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415311+0000", 2024-09-12T16:18:06.839 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0600000000000001e-07 2024-09-12T16:18:06.839 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.839 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.839 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.839 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415315+0000", 2024-09-12T16:18:06.840 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.172e-06 2024-09-12T16:18:06.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.840 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.840 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.840 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415322+0000", 2024-09-12T16:18:06.840 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0999999999999998e-06 2024-09-12T16:18:06.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.840 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.840 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.840 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415327+0000", 2024-09-12T16:18:06.840 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6430000000000003e-06 2024-09-12T16:18:06.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.840 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.841 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.841 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.416666+0000", 2024-09-12T16:18:06.841 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001338718 2024-09-12T16:18:06.841 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.841 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.841 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:06.841 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.416683+0000", 2024-09-12T16:18:06.841 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7628000000000001e-05 2024-09-12T16:18:06.841 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.841 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.841 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:06.841 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.418128+0000", 2024-09-12T16:18:06.841 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0014445440000000001 2024-09-12T16:18:06.842 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.842 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.842 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.842 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.418193+0000", 2024-09-12T16:18:06.842 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5569999999999997e-05 2024-09-12T16:18:06.842 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.842 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.842 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.842 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.842 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.842 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5384.0:1241 3.16 e95/75 3:6ee670ce:::rbd_data.1155b9894cdc.0000000000000005:head v 95'1303, mlcod=95'1301)", 2024-09-12T16:18:06.842 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:35.272164+0000", 2024-09-12T16:18:06.842 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 31.494638573, 2024-09-12T16:18:06.842 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015008743, 2024-09-12T16:18:06.842 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.843 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.843 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:06.843 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.843 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.843 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.843 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.272164+0000", 2024-09-12T16:18:06.843 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.843 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.843 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.843 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.843 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.272164+0000", 2024-09-12T16:18:06.843 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.843 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.843 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.843 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.843 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.272165+0000", 2024-09-12T16:18:06.844 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.311e-06 2024-09-12T16:18:06.844 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.844 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.844 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.844 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275503+0000", 2024-09-12T16:18:06.844 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003337881 2024-09-12T16:18:06.844 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.844 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.844 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.844 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275530+0000", 2024-09-12T16:18:06.844 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6797000000000001e-05 2024-09-12T16:18:06.844 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.844 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.844 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.845 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275541+0000", 2024-09-12T16:18:06.845 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1634000000000001e-05 2024-09-12T16:18:06.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.845 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.845 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.845 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275618+0000", 2024-09-12T16:18:06.845 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6811999999999996e-05 2024-09-12T16:18:06.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.845 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.845 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:06.845 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275642+0000", 2024-09-12T16:18:06.845 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4111999999999999e-05 2024-09-12T16:18:06.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.845 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.846 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:06.846 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287116+0000", 2024-09-12T16:18:06.846 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01147395 2024-09-12T16:18:06.846 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.846 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.846 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.846 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287172+0000", 2024-09-12T16:18:06.847 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6246000000000003e-05 2024-09-12T16:18:06.847 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.848 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.848 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.848 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.848 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.848 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5384.0:1246 3.f e95/74 3:f0725c44:::rbd_data.1155b9894cdc.0000000000000006:head v 95'356, mlcod=95'354)", 2024-09-12T16:18:06.848 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:35.276304+0000", 2024-09-12T16:18:06.848 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 31.490498645999999, 2024-09-12T16:18:06.848 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011209733, 2024-09-12T16:18:06.848 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.848 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.848 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:06.848 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.849 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.849 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.276304+0000", 2024-09-12T16:18:06.849 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.849 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.849 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.276304+0000", 2024-09-12T16:18:06.849 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.849 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.849 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.276305+0000", 2024-09-12T16:18:06.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2500000000000001e-06 2024-09-12T16:18:06.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279256+0000", 2024-09-12T16:18:06.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002951076 2024-09-12T16:18:06.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279281+0000", 2024-09-12T16:18:06.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4779000000000001e-05 2024-09-12T16:18:06.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.851 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.851 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279294+0000", 2024-09-12T16:18:06.851 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3614e-05 2024-09-12T16:18:06.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.851 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.851 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.851 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279366+0000", 2024-09-12T16:18:06.851 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2094000000000005e-05 2024-09-12T16:18:06.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.851 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.851 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:06.851 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279395+0000", 2024-09-12T16:18:06.852 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8337999999999999e-05 2024-09-12T16:18:06.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.852 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.852 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:06.852 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287479+0000", 2024-09-12T16:18:06.852 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0080844799999999998 2024-09-12T16:18:06.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.852 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.852 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.852 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287513+0000", 2024-09-12T16:18:06.852 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4102e-05 2024-09-12T16:18:06.852 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.853 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.853 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.853 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.853 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.853 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5578.0:2433 3.16 e98/75 3:691860ab:::rbd_data.11557f9bd67f.0000000000000014:head v 98'1330, mlcod=97'1328)", 2024-09-12T16:18:06.853 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:38.524867+0000", 2024-09-12T16:18:06.853 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 28.241935021, 2024-09-12T16:18:06.853 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028147279999999998, 2024-09-12T16:18:06.853 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:06.853 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:06.853 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:06.853 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:06.854 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.854 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:06.854 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.524867+0000", 2024-09-12T16:18:06.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.854 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.854 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:06.854 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.524867+0000", 2024-09-12T16:18:06.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:06.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.854 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.854 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:06.854 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.524868+0000", 2024-09-12T16:18:06.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4600000000000003e-07 2024-09-12T16:18:06.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:06.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.525251+0000", 2024-09-12T16:18:06.855 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00038322299999999997 2024-09-12T16:18:06.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:06.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.525266+0000", 2024-09-12T16:18:06.855 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4934e-05 2024-09-12T16:18:06.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:06.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.525274+0000", 2024-09-12T16:18:06.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.328e-06 2024-09-12T16:18:06.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.856 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:06.856 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.525363+0000", 2024-09-12T16:18:06.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9149999999999999e-05 2024-09-12T16:18:06.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.856 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:06.856 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.525383+0000", 2024-09-12T16:18:06.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0197e-05 2024-09-12T16:18:06.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.857 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:06.857 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.527638+0000", 2024-09-12T16:18:06.857 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0022551210000000001 2024-09-12T16:18:06.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:06.857 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:06.857 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:06.857 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.527682+0000", 2024-09-12T16:18:06.857 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3928999999999999e-05 2024-09-12T16:18:06.857 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.857 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.857 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.857 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:06.857 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:06.858 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:06.859 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:18:06.860 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:06.858+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:06.959 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:06.958+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:06.979 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:06.979 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:06.979 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:18:06.980 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:06.989 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:18:07.073 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:07.071+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:07.079 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T16:18:07.154 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:07.154 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:07.154 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:18:07.154 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:18:07.154 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:07.161 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:07.160+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:07.166 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:18:07.263 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:07.262+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:07.279 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:07.280 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:18:07.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:18:07.280 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:18:07.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.280 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3705 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14812160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:07.280 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:18:07.280 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 109.138485031, 2024-09-12T16:18:07.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053368831999999998, 2024-09-12T16:18:07.280 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.280 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.280 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:07.280 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.281 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:07.281 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:07.281 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3705 2024-09-12T16:18:07.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.281 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:18:07.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:18:07.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139932+0000", 2024-09-12T16:18:07.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012762099999999999 2024-09-12T16:18:07.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139935+0000", 2024-09-12T16:18:07.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.119e-06 2024-09-12T16:18:07.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139939+0000", 2024-09-12T16:18:07.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7999999999999998e-06 2024-09-12T16:18:07.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139953+0000", 2024-09-12T16:18:07.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3923999999999999e-05 2024-09-12T16:18:07.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192946+0000", 2024-09-12T16:18:07.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052992971 2024-09-12T16:18:07.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193035+0000", 2024-09-12T16:18:07.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9040000000000001e-05 2024-09-12T16:18:07.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193174+0000", 2024-09-12T16:18:07.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138357 2024-09-12T16:18:07.284 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.284 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.284 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.285 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3706 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14816256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:07.285 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:18:07.285 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 109.138330041, 2024-09-12T16:18:07.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053341723000000001, 2024-09-12T16:18:07.285 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.285 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.285 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:07.285 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.285 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:07.285 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:07.285 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3706 2024-09-12T16:18:07.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.285 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:18:07.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:18:07.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140090+0000", 2024-09-12T16:18:07.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013020100000000001 2024-09-12T16:18:07.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140097+0000", 2024-09-12T16:18:07.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0709999999999997e-06 2024-09-12T16:18:07.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140103+0000", 2024-09-12T16:18:07.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5450000000000003e-06 2024-09-12T16:18:07.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140106+0000", 2024-09-12T16:18:07.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3739999999999998e-06 2024-09-12T16:18:07.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193190+0000", 2024-09-12T16:18:07.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053084131999999999 2024-09-12T16:18:07.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193232+0000", 2024-09-12T16:18:07.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1517000000000002e-05 2024-09-12T16:18:07.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193302+0000", 2024-09-12T16:18:07.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9882999999999995e-05 2024-09-12T16:18:07.289 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.289 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.289 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.289 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3707 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14820352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:07.289 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:18:07.289 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 109.138178052, 2024-09-12T16:18:07.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053452771000000003, 2024-09-12T16:18:07.289 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.290 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.290 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:07.290 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.290 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:07.290 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:07.290 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3707 2024-09-12T16:18:07.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.290 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:18:07.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:18:07.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140219+0000", 2024-09-12T16:18:07.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106902 2024-09-12T16:18:07.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140225+0000", 2024-09-12T16:18:07.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3199999999999996e-06 2024-09-12T16:18:07.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140230+0000", 2024-09-12T16:18:07.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8969999999999999e-06 2024-09-12T16:18:07.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140233+0000", 2024-09-12T16:18:07.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2119999999999999e-06 2024-09-12T16:18:07.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193339+0000", 2024-09-12T16:18:07.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053105556999999998 2024-09-12T16:18:07.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193431+0000", 2024-09-12T16:18:07.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1837999999999997e-05 2024-09-12T16:18:07.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193565+0000", 2024-09-12T16:18:07.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013404500000000001 2024-09-12T16:18:07.293 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.293 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3708 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14824448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:18:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 109.13804921000001, 2024-09-12T16:18:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053468190999999998, 2024-09-12T16:18:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3708 2024-09-12T16:18:07.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.295 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:18:07.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:18:07.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140351+0000", 2024-09-12T16:18:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110096 2024-09-12T16:18:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140358+0000", 2024-09-12T16:18:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.306e-06 2024-09-12T16:18:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140368+0000", 2024-09-12T16:18:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0225e-05 2024-09-12T16:18:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140372+0000", 2024-09-12T16:18:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6169999999999998e-06 2024-09-12T16:18:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193594+0000", 2024-09-12T16:18:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053222419999999999 2024-09-12T16:18:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193640+0000", 2024-09-12T16:18:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.587e-05 2024-09-12T16:18:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193709+0000", 2024-09-12T16:18:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8657000000000004e-05 2024-09-12T16:18:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3709 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14828544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:18:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 109.137912242, 2024-09-12T16:18:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594033999999999, 2024-09-12T16:18:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3709 2024-09-12T16:18:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:18:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:18:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140499+0000", 2024-09-12T16:18:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121019 2024-09-12T16:18:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140501+0000", 2024-09-12T16:18:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2369999999999999e-06 2024-09-12T16:18:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140506+0000", 2024-09-12T16:18:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.639e-06 2024-09-12T16:18:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140509+0000", 2024-09-12T16:18:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3419999999999999e-06 2024-09-12T16:18:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193743+0000", 2024-09-12T16:18:07.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053234311999999999 2024-09-12T16:18:07.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193833+0000", 2024-09-12T16:18:07.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9883999999999995e-05 2024-09-12T16:18:07.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193972+0000", 2024-09-12T16:18:07.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138601 2024-09-12T16:18:07.303 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.303 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.303 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.303 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3710 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14832640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:07.303 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:18:07.303 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 109.137774896, 2024-09-12T16:18:07.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053607324999999997, 2024-09-12T16:18:07.303 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.303 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.303 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3710 2024-09-12T16:18:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:18:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:18:07.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140664+0000", 2024-09-12T16:18:07.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014918700000000001 2024-09-12T16:18:07.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140674+0000", 2024-09-12T16:18:07.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8379999999999997e-06 2024-09-12T16:18:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140694+0000", 2024-09-12T16:18:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0145000000000001e-05 2024-09-12T16:18:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140703+0000", 2024-09-12T16:18:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5150000000000006e-06 2024-09-12T16:18:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194006+0000", 2024-09-12T16:18:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053303370000000003 2024-09-12T16:18:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194051+0000", 2024-09-12T16:18:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5012000000000002e-05 2024-09-12T16:18:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194122+0000", 2024-09-12T16:18:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1258000000000001e-05 2024-09-12T16:18:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.308 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3711 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14836736~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:07.308 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:18:07.308 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 109.137573448, 2024-09-12T16:18:07.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053670799999999998, 2024-09-12T16:18:07.308 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.308 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.308 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:07.308 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.308 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:07.308 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3711 2024-09-12T16:18:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:18:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:18:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140782+0000", 2024-09-12T16:18:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5549999999999994e-05 2024-09-12T16:18:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140786+0000", 2024-09-12T16:18:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.89e-06 2024-09-12T16:18:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140796+0000", 2024-09-12T16:18:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0057e-05 2024-09-12T16:18:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140819+0000", 2024-09-12T16:18:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3005000000000001e-05 2024-09-12T16:18:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194159+0000", 2024-09-12T16:18:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053340324000000001 2024-09-12T16:18:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194248+0000", 2024-09-12T16:18:07.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9209000000000006e-05 2024-09-12T16:18:07.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194387+0000", 2024-09-12T16:18:07.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138765 2024-09-12T16:18:07.312 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.312 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.312 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.313 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3712 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14840832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:07.313 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:18:07.313 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 109.13745899, 2024-09-12T16:18:07.313 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053699068000000003, 2024-09-12T16:18:07.313 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.313 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.313 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:07.313 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.313 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:07.313 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:07.313 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3712 2024-09-12T16:18:07.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.313 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:18:07.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:18:07.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140900+0000", 2024-09-12T16:18:07.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9014e-05 2024-09-12T16:18:07.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140904+0000", 2024-09-12T16:18:07.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0940000000000001e-06 2024-09-12T16:18:07.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140933+0000", 2024-09-12T16:18:07.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8996000000000002e-05 2024-09-12T16:18:07.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140945+0000", 2024-09-12T16:18:07.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1909000000000001e-05 2024-09-12T16:18:07.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194415+0000", 2024-09-12T16:18:07.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053470403 2024-09-12T16:18:07.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194460+0000", 2024-09-12T16:18:07.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5145000000000002e-05 2024-09-12T16:18:07.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.317 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.317 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194530+0000", 2024-09-12T16:18:07.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9506999999999997e-05 2024-09-12T16:18:07.317 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.317 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.317 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.317 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3713 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14844928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:07.317 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:18:07.317 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 109.13732593, 2024-09-12T16:18:07.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053821236000000001, 2024-09-12T16:18:07.317 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.317 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.318 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:07.318 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.318 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:07.318 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:07.318 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3713 2024-09-12T16:18:07.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.318 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.318 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:18:07.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.318 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:18:07.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141078+0000", 2024-09-12T16:18:07.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114162 2024-09-12T16:18:07.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141090+0000", 2024-09-12T16:18:07.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.19e-05 2024-09-12T16:18:07.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141100+0000", 2024-09-12T16:18:07.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0447e-05 2024-09-12T16:18:07.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141108+0000", 2024-09-12T16:18:07.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7190000000000001e-06 2024-09-12T16:18:07.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194564+0000", 2024-09-12T16:18:07.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053455729 2024-09-12T16:18:07.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.321 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.321 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194652+0000", 2024-09-12T16:18:07.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8288999999999994e-05 2024-09-12T16:18:07.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.321 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.321 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194785+0000", 2024-09-12T16:18:07.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013299000000000001 2024-09-12T16:18:07.321 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.321 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.321 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.322 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3714 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14849024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:07.322 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:18:07.322 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 109.137170001, 2024-09-12T16:18:07.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053816382000000003, 2024-09-12T16:18:07.322 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.322 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.322 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:07.322 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.322 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:07.322 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:07.322 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3714 2024-09-12T16:18:07.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.323 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:18:07.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:18:07.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141182+0000", 2024-09-12T16:18:07.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1805999999999997e-05 2024-09-12T16:18:07.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141185+0000", 2024-09-12T16:18:07.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5930000000000002e-06 2024-09-12T16:18:07.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.325 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141194+0000", 2024-09-12T16:18:07.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5760000000000006e-06 2024-09-12T16:18:07.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.325 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.325 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141222+0000", 2024-09-12T16:18:07.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8034999999999998e-05 2024-09-12T16:18:07.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.325 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.325 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194817+0000", 2024-09-12T16:18:07.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594887000000001 2024-09-12T16:18:07.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.326 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194860+0000", 2024-09-12T16:18:07.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3714999999999997e-05 2024-09-12T16:18:07.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.326 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194936+0000", 2024-09-12T16:18:07.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5770000000000001e-05 2024-09-12T16:18:07.326 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.326 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.326 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.327 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3715 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14853120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:07.327 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:18:07.327 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 109.137046344, 2024-09-12T16:18:07.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053962307000000001, 2024-09-12T16:18:07.327 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.327 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.327 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:07.327 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.327 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:07.327 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:07.327 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3715 2024-09-12T16:18:07.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.327 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:18:07.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:18:07.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141417+0000", 2024-09-12T16:18:07.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017384099999999999 2024-09-12T16:18:07.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141422+0000", 2024-09-12T16:18:07.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7310000000000001e-06 2024-09-12T16:18:07.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141434+0000", 2024-09-12T16:18:07.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2058e-05 2024-09-12T16:18:07.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141442+0000", 2024-09-12T16:18:07.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7610000000000007e-06 2024-09-12T16:18:07.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194973+0000", 2024-09-12T16:18:07.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053530618000000002 2024-09-12T16:18:07.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195063+0000", 2024-09-12T16:18:07.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0927000000000005e-05 2024-09-12T16:18:07.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195206+0000", 2024-09-12T16:18:07.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142371 2024-09-12T16:18:07.331 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.331 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.331 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.331 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3716 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14857216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:07.331 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:18:07.331 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 109.13683649399999, 2024-09-12T16:18:07.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053916360000000003, 2024-09-12T16:18:07.331 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.331 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.331 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:07.332 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.332 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:07.332 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:07.332 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3716 2024-09-12T16:18:07.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.332 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:18:07.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:18:07.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142933+0000", 2024-09-12T16:18:07.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014796290000000001 2024-09-12T16:18:07.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142937+0000", 2024-09-12T16:18:07.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5760000000000002e-06 2024-09-12T16:18:07.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142946+0000", 2024-09-12T16:18:07.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0380000000000005e-06 2024-09-12T16:18:07.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142951+0000", 2024-09-12T16:18:07.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9749999999999998e-06 2024-09-12T16:18:07.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195246+0000", 2024-09-12T16:18:07.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052295358 2024-09-12T16:18:07.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195299+0000", 2024-09-12T16:18:07.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2976999999999998e-05 2024-09-12T16:18:07.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195370+0000", 2024-09-12T16:18:07.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0807000000000002e-05 2024-09-12T16:18:07.335 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.335 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.335 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.336 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3721 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14877696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:07.336 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:18:07.336 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 109.13526304299999, 2024-09-12T16:18:07.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053422994000000001, 2024-09-12T16:18:07.336 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.336 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.336 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:07.336 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.336 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:07.336 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:07.336 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3721 2024-09-12T16:18:07.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.336 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:18:07.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:18:07.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:18:07.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:18:07.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143028+0000", 2024-09-12T16:18:07.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7399999999999991e-07 2024-09-12T16:18:07.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143031+0000", 2024-09-12T16:18:07.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7599999999999998e-06 2024-09-12T16:18:07.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143034+0000", 2024-09-12T16:18:07.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9780000000000001e-06 2024-09-12T16:18:07.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196220+0000", 2024-09-12T16:18:07.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053186341999999998 2024-09-12T16:18:07.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196313+0000", 2024-09-12T16:18:07.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2676000000000005e-05 2024-09-12T16:18:07.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.340 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196450+0000", 2024-09-12T16:18:07.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137052 2024-09-12T16:18:07.340 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.340 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.340 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.340 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3722 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14881792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:07.340 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:18:07.340 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 109.135253151, 2024-09-12T16:18:07.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053556835999999997, 2024-09-12T16:18:07.340 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.340 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.341 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:07.341 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.341 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:07.341 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:07.341 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3722 2024-09-12T16:18:07.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.341 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.341 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:18:07.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.341 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.342 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:18:07.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.342 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:18:07.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.11e-07 2024-09-12T16:18:07.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.342 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143038+0000", 2024-09-12T16:18:07.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2399999999999996e-07 2024-09-12T16:18:07.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143041+0000", 2024-09-12T16:18:07.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8030000000000001e-06 2024-09-12T16:18:07.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143043+0000", 2024-09-12T16:18:07.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3140000000000002e-06 2024-09-12T16:18:07.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196481+0000", 2024-09-12T16:18:07.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053437601000000001 2024-09-12T16:18:07.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196525+0000", 2024-09-12T16:18:07.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4280000000000003e-05 2024-09-12T16:18:07.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196594+0000", 2024-09-12T16:18:07.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8702999999999996e-05 2024-09-12T16:18:07.344 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.344 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.345 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.345 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3723 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14885888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:07.345 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:18:07.345 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 109.135243969, 2024-09-12T16:18:07.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053815546999999998, 2024-09-12T16:18:07.345 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.345 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.345 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:07.345 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.345 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:07.345 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:07.345 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3723 2024-09-12T16:18:07.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.346 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:18:07.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:18:07.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.347 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148994+0000", 2024-09-12T16:18:07.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059481330000000004 2024-09-12T16:18:07.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.347 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148999+0000", 2024-09-12T16:18:07.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7140000000000001e-06 2024-09-12T16:18:07.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.347 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149008+0000", 2024-09-12T16:18:07.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4350000000000003e-06 2024-09-12T16:18:07.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149021+0000", 2024-09-12T16:18:07.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2514000000000001e-05 2024-09-12T16:18:07.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196630+0000", 2024-09-12T16:18:07.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047609758000000002 2024-09-12T16:18:07.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196724+0000", 2024-09-12T16:18:07.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3522000000000003e-05 2024-09-12T16:18:07.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196861+0000", 2024-09-12T16:18:07.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013747100000000001 2024-09-12T16:18:07.349 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.349 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.349 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.349 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4438 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15719424~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:07.349 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:18:07.349 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 108.990363192, 2024-09-12T16:18:07.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367981000000002, 2024-09-12T16:18:07.350 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.350 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.350 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:07.350 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.350 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:07.350 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:07.350 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4438 2024-09-12T16:18:07.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.350 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.350 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.350 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:18:07.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:18:07.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:18:07.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3e-07 2024-09-12T16:18:07.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287930+0000", 2024-09-12T16:18:07.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-12T16:18:07.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287937+0000", 2024-09-12T16:18:07.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.08e-06 2024-09-12T16:18:07.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287943+0000", 2024-09-12T16:18:07.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5709999999999997e-06 2024-09-12T16:18:07.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341068+0000", 2024-09-12T16:18:07.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053125101000000001 2024-09-12T16:18:07.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341154+0000", 2024-09-12T16:18:07.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6100999999999994e-05 2024-09-12T16:18:07.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341295+0000", 2024-09-12T16:18:07.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014087999999999999 2024-09-12T16:18:07.354 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.354 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.354 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.354 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4439 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15723520~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:07.354 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:18:07.354 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 108.99033903199999, 2024-09-12T16:18:07.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053526799, 2024-09-12T16:18:07.354 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.355 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.355 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:07.355 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.355 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:07.355 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:07.355 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4439 2024-09-12T16:18:07.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.355 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:18:07.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.356 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.356 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:18:07.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.356 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.356 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:18:07.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-07 2024-09-12T16:18:07.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.356 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.356 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287953+0000", 2024-09-12T16:18:07.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1349999999999999e-06 2024-09-12T16:18:07.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.357 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.357 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287960+0000", 2024-09-12T16:18:07.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-12T16:18:07.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.357 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.357 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287965+0000", 2024-09-12T16:18:07.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1580000000000004e-06 2024-09-12T16:18:07.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341332+0000", 2024-09-12T16:18:07.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367009 2024-09-12T16:18:07.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341402+0000", 2024-09-12T16:18:07.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9759999999999996e-05 2024-09-12T16:18:07.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341478+0000", 2024-09-12T16:18:07.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5412000000000002e-05 2024-09-12T16:18:07.358 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.358 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.359 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.359 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4440 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15727616~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:07.359 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:18:07.359 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 108.990317928, 2024-09-12T16:18:07.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053761601999999999, 2024-09-12T16:18:07.359 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.359 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.359 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:07.359 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.359 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:07.359 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:07.360 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4440 2024-09-12T16:18:07.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.360 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:18:07.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:18:07.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:18:07.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:18:07.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287974+0000", 2024-09-12T16:18:07.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0540000000000002e-06 2024-09-12T16:18:07.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287980+0000", 2024-09-12T16:18:07.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9440000000000002e-06 2024-09-12T16:18:07.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287987+0000", 2024-09-12T16:18:07.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5889999999999999e-06 2024-09-12T16:18:07.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341502+0000", 2024-09-12T16:18:07.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053515199999999999 2024-09-12T16:18:07.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341595+0000", 2024-09-12T16:18:07.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3097000000000007e-05 2024-09-12T16:18:07.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.363 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341734+0000", 2024-09-12T16:18:07.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013832800000000001 2024-09-12T16:18:07.363 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.363 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.363 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.363 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2209 3.1 3:85f36d3b:::rbd_data.1155ccb1894c.0000000000000004:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:18:07.363 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:18:07.363 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 69.906632790000003, 2024-09-12T16:18:07.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.060659365, 2024-09-12T16:18:07.364 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.364 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.364 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:07.364 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.364 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:18:07.364 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:18:07.364 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2209 2024-09-12T16:18:07.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.364 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.364 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:18:07.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:18:07.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371658+0000", 2024-09-12T16:18:07.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1570000000000001e-06 2024-09-12T16:18:07.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393414+0000", 2024-09-12T16:18:07.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021755495999999999 2024-09-12T16:18:07.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393447+0000", 2024-09-12T16:18:07.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3630000000000002e-05 2024-09-12T16:18:07.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.367 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393462+0000", 2024-09-12T16:18:07.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5048999999999999e-05 2024-09-12T16:18:07.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.367 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.367 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393556+0000", 2024-09-12T16:18:07.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3549999999999997e-05 2024-09-12T16:18:07.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.367 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.367 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393697+0000", 2024-09-12T16:18:07.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000141414 2024-09-12T16:18:07.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.368 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T16:18:07.368 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.394944+0000", 2024-09-12T16:18:07.368 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012463039999999999 2024-09-12T16:18:07.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.368 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:07.368 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.431803+0000", 2024-09-12T16:18:07.368 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0368594 2024-09-12T16:18:07.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.368 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:18:07.368 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432268+0000", 2024-09-12T16:18:07.368 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046457600000000002 2024-09-12T16:18:07.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:18:07.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432293+0000", 2024-09-12T16:18:07.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.527e-05 2024-09-12T16:18:07.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432316+0000", 2024-09-12T16:18:07.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3519e-05 2024-09-12T16:18:07.369 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.369 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.369 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.370 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:9400 3.1f 3:feea9999:::rbd_data.1155338d0570.0000000000000007:head [read 32768~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-12T16:18:07.370 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:20.012502+0000", 2024-09-12T16:18:07.370 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 47.265787797999998, 2024-09-12T16:18:07.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.000678049, 2024-09-12T16:18:07.370 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.370 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.370 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:07.370 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.370 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:18:07.370 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:18:07.370 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 9400 2024-09-12T16:18:07.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.371 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012502+0000", 2024-09-12T16:18:07.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012502+0000", 2024-09-12T16:18:07.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012504+0000", 2024-09-12T16:18:07.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5939999999999999e-06 2024-09-12T16:18:07.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012511+0000", 2024-09-12T16:18:07.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0840000000000003e-06 2024-09-12T16:18:07.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012525+0000", 2024-09-12T16:18:07.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4538999999999999e-05 2024-09-12T16:18:07.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012532+0000", 2024-09-12T16:18:07.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8310000000000003e-06 2024-09-12T16:18:07.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012605+0000", 2024-09-12T16:18:07.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2387999999999999e-05 2024-09-12T16:18:07.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T16:18:07.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012617+0000", 2024-09-12T16:18:07.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2167999999999999e-05 2024-09-12T16:18:07.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:21.012823+0000", 2024-09-12T16:18:07.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0002068230000001 2024-09-12T16:18:07.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:21.012975+0000", 2024-09-12T16:18:07.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015196200000000001 2024-09-12T16:18:07.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.375 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:21.013180+0000", 2024-09-12T16:18:07.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020466000000000001 2024-09-12T16:18:07.375 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.375 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.375 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.375 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.375 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.375 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:07.377 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:18:07.377 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:07.375+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:07.478 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:07.476+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:07.484 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:07.484 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:07.484 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:18:07.484 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:07.493 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:18:07.579 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:07.577+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:07.600 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:07.600 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:07.600 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:18:07.600 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:18:07.600 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:07.608 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:18:07.621 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T16:18:07.680 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:07.678+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:07.760 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:07.760 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:18:07.760 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:18:07.761 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:18:07.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.761 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1571 3.b 3:d046566d:::rbd_data.1155525b14e3.0000000000000001:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:18:07.761 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:18:07.761 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 86.606455905999994, 2024-09-12T16:18:07.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064439785999999999, 2024-09-12T16:18:07.761 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.761 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.761 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:07.761 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.761 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:18:07.761 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:18:07.761 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1571 2024-09-12T16:18:07.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.762 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:18:07.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:18:07.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.763 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:18:07.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5400000000000002e-07 2024-09-12T16:18:07.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.763 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152567+0000", 2024-09-12T16:18:07.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.131e-06 2024-09-12T16:18:07.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.763 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152574+0000", 2024-09-12T16:18:07.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1840000000000002e-06 2024-09-12T16:18:07.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152579+0000", 2024-09-12T16:18:07.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.152e-06 2024-09-12T16:18:07.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153671+0000", 2024-09-12T16:18:07.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001092078 2024-09-12T16:18:07.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153779+0000", 2024-09-12T16:18:07.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108461 2024-09-12T16:18:07.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217004+0000", 2024-09-12T16:18:07.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.063224426 2024-09-12T16:18:07.765 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.765 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.765 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.765 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1581 3.4 3:22e34893:::rbd_data.1155525b14e3.0000000000000005:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:18:07.765 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:18:07.765 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 86.606358780999997, 2024-09-12T16:18:07.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064484407999999993, 2024-09-12T16:18:07.766 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.766 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.766 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:07.766 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.766 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:18:07.766 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:18:07.766 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1581 2024-09-12T16:18:07.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.766 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:18:07.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:18:07.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152662+0000", 2024-09-12T16:18:07.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.65e-07 2024-09-12T16:18:07.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152664+0000", 2024-09-12T16:18:07.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9829999999999999e-06 2024-09-12T16:18:07.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.768 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.768 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152670+0000", 2024-09-12T16:18:07.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2260000000000002e-06 2024-09-12T16:18:07.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.768 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.768 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152675+0000", 2024-09-12T16:18:07.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7990000000000001e-06 2024-09-12T16:18:07.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.768 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.216945+0000", 2024-09-12T16:18:07.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064270341999999994 2024-09-12T16:18:07.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217040+0000", 2024-09-12T16:18:07.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5242999999999996e-05 2024-09-12T16:18:07.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217146+0000", 2024-09-12T16:18:07.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010545 2024-09-12T16:18:07.769 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.769 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.770 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.770 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2207 3.0 3:05fdc61f:::rbd_data.1155ccb1894c.0000000000000003:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:18:07.770 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:18:07.770 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.388315219999996, 2024-09-12T16:18:07.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.05105382, 2024-09-12T16:18:07.770 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.770 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.770 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:07.770 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.770 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:18:07.770 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:18:07.771 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2207 2024-09-12T16:18:07.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.771 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:18:07.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:18:07.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.772 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.772 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370706+0000", 2024-09-12T16:18:07.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7800000000000001e-07 2024-09-12T16:18:07.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.772 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.772 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391581+0000", 2024-09-12T16:18:07.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020875624999999998 2024-09-12T16:18:07.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.772 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.772 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391608+0000", 2024-09-12T16:18:07.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6412999999999999e-05 2024-09-12T16:18:07.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391618+0000", 2024-09-12T16:18:07.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9240000000000002e-06 2024-09-12T16:18:07.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391705+0000", 2024-09-12T16:18:07.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7489000000000002e-05 2024-09-12T16:18:07.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391838+0000", 2024-09-12T16:18:07.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132865 2024-09-12T16:18:07.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 2", 2024-09-12T16:18:07.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.392587+0000", 2024-09-12T16:18:07.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074930000000000005 2024-09-12T16:18:07.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:07.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.420095+0000", 2024-09-12T16:18:07.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027507949 2024-09-12T16:18:07.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:18:07.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421610+0000", 2024-09-12T16:18:07.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001515195 2024-09-12T16:18:07.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.775 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:18:07.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421681+0000", 2024-09-12T16:18:07.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0320000000000004e-05 2024-09-12T16:18:07.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.775 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421759+0000", 2024-09-12T16:18:07.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7961999999999997e-05 2024-09-12T16:18:07.775 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.775 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.776 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.776 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11082 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 3350528~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:07.776 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.876283+0000", 2024-09-12T16:18:07.776 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.882736564, 2024-09-12T16:18:07.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044907159000000002, 2024-09-12T16:18:07.776 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.776 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.776 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:07.776 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.776 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:07.776 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:07.776 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11082 2024-09-12T16:18:07.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.777 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.777 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.777 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876283+0000", 2024-09-12T16:18:07.777 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.777 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.777 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876283+0000", 2024-09-12T16:18:07.777 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.777 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.777 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876284+0000", 2024-09-12T16:18:07.777 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7300000000000002e-07 2024-09-12T16:18:07.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.778 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876286+0000", 2024-09-12T16:18:07.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2089999999999999e-06 2024-09-12T16:18:07.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.778 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876292+0000", 2024-09-12T16:18:07.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9399999999999999e-06 2024-09-12T16:18:07.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.779 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876297+0000", 2024-09-12T16:18:07.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9200000000000003e-06 2024-09-12T16:18:07.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.779 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.779 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921094+0000", 2024-09-12T16:18:07.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044797311999999999 2024-09-12T16:18:07.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.779 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.779 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921136+0000", 2024-09-12T16:18:07.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1625000000000002e-05 2024-09-12T16:18:07.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.779 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.780 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921191+0000", 2024-09-12T16:18:07.780 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4780000000000001e-05 2024-09-12T16:18:07.780 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.780 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.780 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.780 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11083 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 3399680~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:07.780 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.876304+0000", 2024-09-12T16:18:07.780 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.882715813000001, 2024-09-12T16:18:07.780 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045070883999999999, 2024-09-12T16:18:07.780 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.780 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.780 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:07.781 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.781 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:07.781 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:07.781 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11083 2024-09-12T16:18:07.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.781 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.781 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876304+0000", 2024-09-12T16:18:07.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.781 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876304+0000", 2024-09-12T16:18:07.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876305+0000", 2024-09-12T16:18:07.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4099999999999999e-07 2024-09-12T16:18:07.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876307+0000", 2024-09-12T16:18:07.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9470000000000002e-06 2024-09-12T16:18:07.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876312+0000", 2024-09-12T16:18:07.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7540000000000003e-06 2024-09-12T16:18:07.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876318+0000", 2024-09-12T16:18:07.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3589999999999999e-06 2024-09-12T16:18:07.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921221+0000", 2024-09-12T16:18:07.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044903464999999997 2024-09-12T16:18:07.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.784 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.784 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921266+0000", 2024-09-12T16:18:07.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4795000000000001e-05 2024-09-12T16:18:07.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.784 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.784 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921375+0000", 2024-09-12T16:18:07.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000109023 2024-09-12T16:18:07.784 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.784 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.784 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.785 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11084 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 3448832~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:07.785 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.876324+0000", 2024-09-12T16:18:07.785 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.882695696000001, 2024-09-12T16:18:07.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045172474999999997, 2024-09-12T16:18:07.785 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.785 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.785 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:07.785 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.785 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:07.785 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:07.785 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11084 2024-09-12T16:18:07.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.785 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.786 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.786 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876324+0000", 2024-09-12T16:18:07.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.786 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.786 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876324+0000", 2024-09-12T16:18:07.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.786 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.786 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876411+0000", 2024-09-12T16:18:07.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6292000000000007e-05 2024-09-12T16:18:07.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876418+0000", 2024-09-12T16:18:07.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3309999999999998e-06 2024-09-12T16:18:07.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876426+0000", 2024-09-12T16:18:07.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3850000000000002e-06 2024-09-12T16:18:07.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876436+0000", 2024-09-12T16:18:07.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8749999999999995e-06 2024-09-12T16:18:07.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921403+0000", 2024-09-12T16:18:07.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044966385999999997 2024-09-12T16:18:07.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921445+0000", 2024-09-12T16:18:07.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1953000000000003e-05 2024-09-12T16:18:07.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921497+0000", 2024-09-12T16:18:07.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2253000000000003e-05 2024-09-12T16:18:07.789 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.789 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.789 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.789 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11085 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 3497984~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:07.789 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.876449+0000", 2024-09-12T16:18:07.789 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.882571186, 2024-09-12T16:18:07.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045173054999999997, 2024-09-12T16:18:07.789 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.789 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.789 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:07.789 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.790 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:07.790 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:07.790 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11085 2024-09-12T16:18:07.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.790 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.790 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.790 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876449+0000", 2024-09-12T16:18:07.790 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.790 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.790 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876449+0000", 2024-09-12T16:18:07.790 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.881997+0000", 2024-09-12T16:18:07.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055481209999999996 2024-09-12T16:18:07.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.882002+0000", 2024-09-12T16:18:07.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8269999999999997e-06 2024-09-12T16:18:07.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.882013+0000", 2024-09-12T16:18:07.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0869999999999999e-05 2024-09-12T16:18:07.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.792 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.792 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.882020+0000", 2024-09-12T16:18:07.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5839999999999997e-06 2024-09-12T16:18:07.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.792 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.792 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921523+0000", 2024-09-12T16:18:07.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039502411000000001 2024-09-12T16:18:07.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.792 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.792 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921566+0000", 2024-09-12T16:18:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3353000000000003e-05 2024-09-12T16:18:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921622+0000", 2024-09-12T16:18:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5889e-05 2024-09-12T16:18:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11136 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 6004736~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883172+0000", 2024-09-12T16:18:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.875848009, 2024-09-12T16:18:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044900554000000002, 2024-09-12T16:18:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11136 2024-09-12T16:18:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883172+0000", 2024-09-12T16:18:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883172+0000", 2024-09-12T16:18:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883172+0000", 2024-09-12T16:18:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5199999999999998e-07 2024-09-12T16:18:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883174+0000", 2024-09-12T16:18:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1169999999999998e-06 2024-09-12T16:18:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883181+0000", 2024-09-12T16:18:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0920000000000003e-06 2024-09-12T16:18:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883186+0000", 2024-09-12T16:18:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0900000000000004e-06 2024-09-12T16:18:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.927988+0000", 2024-09-12T16:18:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044802373999999999 2024-09-12T16:18:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928032+0000", 2024-09-12T16:18:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3717999999999997e-05 2024-09-12T16:18:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928073+0000", 2024-09-12T16:18:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0810999999999999e-05 2024-09-12T16:18:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11137 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 6053888~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883204+0000", 2024-09-12T16:18:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.875815829, 2024-09-12T16:18:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044978854999999998, 2024-09-12T16:18:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.799 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:07.799 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:07.799 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11137 2024-09-12T16:18:07.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.799 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883204+0000", 2024-09-12T16:18:07.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883204+0000", 2024-09-12T16:18:07.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.800 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883205+0000", 2024-09-12T16:18:07.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6700000000000003e-07 2024-09-12T16:18:07.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.800 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883207+0000", 2024-09-12T16:18:07.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4370000000000001e-06 2024-09-12T16:18:07.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883214+0000", 2024-09-12T16:18:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1840000000000002e-06 2024-09-12T16:18:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883220+0000", 2024-09-12T16:18:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5010000000000004e-06 2024-09-12T16:18:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928098+0000", 2024-09-12T16:18:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044878058999999998 2024-09-12T16:18:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928140+0000", 2024-09-12T16:18:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1990000000000003e-05 2024-09-12T16:18:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928183+0000", 2024-09-12T16:18:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3117000000000001e-05 2024-09-12T16:18:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11138 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 6103040~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883227+0000", 2024-09-12T16:18:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.875792596, 2024-09-12T16:18:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045063931000000002, 2024-09-12T16:18:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11138 2024-09-12T16:18:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883227+0000", 2024-09-12T16:18:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883227+0000", 2024-09-12T16:18:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883228+0000", 2024-09-12T16:18:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5600000000000005e-07 2024-09-12T16:18:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883230+0000", 2024-09-12T16:18:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1210000000000001e-06 2024-09-12T16:18:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883236+0000", 2024-09-12T16:18:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1670000000000004e-06 2024-09-12T16:18:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883241+0000", 2024-09-12T16:18:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9060000000000001e-06 2024-09-12T16:18:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928211+0000", 2024-09-12T16:18:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044969229999999999 2024-09-12T16:18:07.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928252+0000", 2024-09-12T16:18:07.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1671000000000001e-05 2024-09-12T16:18:07.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928291+0000", 2024-09-12T16:18:07.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9180000000000001e-05 2024-09-12T16:18:07.806 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.806 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.806 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.807 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11139 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 6152192~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:07.807 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883248+0000", 2024-09-12T16:18:07.807 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.875772322, 2024-09-12T16:18:07.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045153225999999998, 2024-09-12T16:18:07.807 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.807 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.807 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:07.807 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.807 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:07.807 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:07.807 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11139 2024-09-12T16:18:07.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.808 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883248+0000", 2024-09-12T16:18:07.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883248+0000", 2024-09-12T16:18:07.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883248+0000", 2024-09-12T16:18:07.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9999999999999998e-07 2024-09-12T16:18:07.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883250+0000", 2024-09-12T16:18:07.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0660000000000002e-06 2024-09-12T16:18:07.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883256+0000", 2024-09-12T16:18:07.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8699999999999997e-06 2024-09-12T16:18:07.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.810 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883261+0000", 2024-09-12T16:18:07.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0490000000000003e-06 2024-09-12T16:18:07.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.810 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928316+0000", 2024-09-12T16:18:07.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045055398000000003 2024-09-12T16:18:07.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.810 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928359+0000", 2024-09-12T16:18:07.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2286000000000001e-05 2024-09-12T16:18:07.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928401+0000", 2024-09-12T16:18:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2157000000000003e-05 2024-09-12T16:18:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11140 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 6201344~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883267+0000", 2024-09-12T16:18:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.875752556, 2024-09-12T16:18:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045241199000000003, 2024-09-12T16:18:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11140 2024-09-12T16:18:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883267+0000", 2024-09-12T16:18:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883267+0000", 2024-09-12T16:18:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883268+0000", 2024-09-12T16:18:07.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8700000000000001e-07 2024-09-12T16:18:07.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883270+0000", 2024-09-12T16:18:07.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3420000000000002e-06 2024-09-12T16:18:07.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883276+0000", 2024-09-12T16:18:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0310000000000004e-06 2024-09-12T16:18:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883281+0000", 2024-09-12T16:18:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1259999999999997e-06 2024-09-12T16:18:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928428+0000", 2024-09-12T16:18:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045146276999999999 2024-09-12T16:18:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928469+0000", 2024-09-12T16:18:07.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1007000000000002e-05 2024-09-12T16:18:07.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.815 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.815 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928509+0000", 2024-09-12T16:18:07.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0028999999999999e-05 2024-09-12T16:18:07.815 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.815 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.815 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.815 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11141 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 6250496~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:07.816 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883288+0000", 2024-09-12T16:18:07.816 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.875731958999999, 2024-09-12T16:18:07.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045331594000000003, 2024-09-12T16:18:07.816 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.816 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.816 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:07.816 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.816 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:07.816 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:07.816 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11141 2024-09-12T16:18:07.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.816 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883288+0000", 2024-09-12T16:18:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883288+0000", 2024-09-12T16:18:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883288+0000", 2024-09-12T16:18:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0200000000000003e-07 2024-09-12T16:18:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883290+0000", 2024-09-12T16:18:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9350000000000001e-06 2024-09-12T16:18:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883296+0000", 2024-09-12T16:18:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.913e-06 2024-09-12T16:18:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883302+0000", 2024-09-12T16:18:07.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.879e-06 2024-09-12T16:18:07.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928534+0000", 2024-09-12T16:18:07.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045231544999999998 2024-09-12T16:18:07.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928577+0000", 2024-09-12T16:18:07.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3676e-05 2024-09-12T16:18:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928620+0000", 2024-09-12T16:18:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2243999999999997e-05 2024-09-12T16:18:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11271 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3174400~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883316+0000", 2024-09-12T16:18:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.875703898999999, 2024-09-12T16:18:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045477308000000001, 2024-09-12T16:18:07.821 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.821 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.821 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:07.821 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.821 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:07.821 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:07.821 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11271 2024-09-12T16:18:07.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.821 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.821 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.821 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883316+0000", 2024-09-12T16:18:07.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883316+0000", 2024-09-12T16:18:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883317+0000", 2024-09-12T16:18:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9200000000000001e-07 2024-09-12T16:18:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883319+0000", 2024-09-12T16:18:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2670000000000001e-06 2024-09-12T16:18:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883326+0000", 2024-09-12T16:18:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6000000000000003e-06 2024-09-12T16:18:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883331+0000", 2024-09-12T16:18:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1719999999999998e-06 2024-09-12T16:18:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928647+0000", 2024-09-12T16:18:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045316457999999997 2024-09-12T16:18:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928689+0000", 2024-09-12T16:18:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1352e-05 2024-09-12T16:18:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928793+0000", 2024-09-12T16:18:07.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000104867 2024-09-12T16:18:07.825 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.825 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.825 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.825 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11272 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3223552~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:07.825 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883338+0000", 2024-09-12T16:18:07.825 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.875682039000001, 2024-09-12T16:18:07.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045595268000000001, 2024-09-12T16:18:07.825 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.825 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.825 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:07.825 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.826 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:07.826 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:07.826 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11272 2024-09-12T16:18:07.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.826 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883338+0000", 2024-09-12T16:18:07.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883338+0000", 2024-09-12T16:18:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883339+0000", 2024-09-12T16:18:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8599999999999998e-07 2024-09-12T16:18:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883341+0000", 2024-09-12T16:18:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1449999999999998e-06 2024-09-12T16:18:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883348+0000", 2024-09-12T16:18:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0110000000000003e-06 2024-09-12T16:18:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883353+0000", 2024-09-12T16:18:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2360000000000004e-06 2024-09-12T16:18:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928819+0000", 2024-09-12T16:18:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045466392000000001 2024-09-12T16:18:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928869+0000", 2024-09-12T16:18:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9829e-05 2024-09-12T16:18:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928933+0000", 2024-09-12T16:18:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3968999999999997e-05 2024-09-12T16:18:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11273 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3272704~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883359+0000", 2024-09-12T16:18:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.875660727, 2024-09-12T16:18:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045735142999999999, 2024-09-12T16:18:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11273 2024-09-12T16:18:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883359+0000", 2024-09-12T16:18:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883359+0000", 2024-09-12T16:18:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883360+0000", 2024-09-12T16:18:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9400000000000001e-07 2024-09-12T16:18:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883367+0000", 2024-09-12T16:18:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8530000000000003e-06 2024-09-12T16:18:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883373+0000", 2024-09-12T16:18:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9989999999999997e-06 2024-09-12T16:18:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883378+0000", 2024-09-12T16:18:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3369999999999999e-06 2024-09-12T16:18:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928950+0000", 2024-09-12T16:18:07.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045571751000000001 2024-09-12T16:18:07.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928992+0000", 2024-09-12T16:18:07.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1891000000000003e-05 2024-09-12T16:18:07.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929094+0000", 2024-09-12T16:18:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010291800000000001 2024-09-12T16:18:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11274 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3321856~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883385+0000", 2024-09-12T16:18:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.87563521, 2024-09-12T16:18:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045864239000000001, 2024-09-12T16:18:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:07.835 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.835 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:07.835 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:07.835 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11274 2024-09-12T16:18:07.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.835 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883385+0000", 2024-09-12T16:18:07.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883385+0000", 2024-09-12T16:18:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883385+0000", 2024-09-12T16:18:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4799999999999999e-07 2024-09-12T16:18:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883388+0000", 2024-09-12T16:18:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3199999999999998e-06 2024-09-12T16:18:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883394+0000", 2024-09-12T16:18:07.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2020000000000001e-06 2024-09-12T16:18:07.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883400+0000", 2024-09-12T16:18:07.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8510000000000004e-06 2024-09-12T16:18:07.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929123+0000", 2024-09-12T16:18:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045723235000000001 2024-09-12T16:18:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929166+0000", 2024-09-12T16:18:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2769999999999999e-05 2024-09-12T16:18:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929249+0000", 2024-09-12T16:18:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3412999999999996e-05 2024-09-12T16:18:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11275 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3371008~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883416+0000", 2024-09-12T16:18:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.875603601, 2024-09-12T16:18:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.046042315, 2024-09-12T16:18:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11275 2024-09-12T16:18:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883416+0000", 2024-09-12T16:18:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883416+0000", 2024-09-12T16:18:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883417+0000", 2024-09-12T16:18:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4700000000000001e-07 2024-09-12T16:18:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883419+0000", 2024-09-12T16:18:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2029999999999999e-06 2024-09-12T16:18:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883426+0000", 2024-09-12T16:18:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.579e-06 2024-09-12T16:18:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883431+0000", 2024-09-12T16:18:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5679999999999999e-06 2024-09-12T16:18:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929290+0000", 2024-09-12T16:18:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045858227000000001 2024-09-12T16:18:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929365+0000", 2024-09-12T16:18:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5519999999999995e-05 2024-09-12T16:18:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929459+0000", 2024-09-12T16:18:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3671000000000005e-05 2024-09-12T16:18:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11276 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3420160~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883439+0000", 2024-09-12T16:18:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.875581198000001, 2024-09-12T16:18:07.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.046138991999999997, 2024-09-12T16:18:07.844 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.844 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.844 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:07.844 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.844 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:07.844 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:07.844 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11276 2024-09-12T16:18:07.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.844 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883439+0000", 2024-09-12T16:18:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883439+0000", 2024-09-12T16:18:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883560+0000", 2024-09-12T16:18:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121229 2024-09-12T16:18:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883569+0000", 2024-09-12T16:18:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9390000000000003e-06 2024-09-12T16:18:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883579+0000", 2024-09-12T16:18:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8859999999999999e-06 2024-09-12T16:18:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883585+0000", 2024-09-12T16:18:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.545e-06 2024-09-12T16:18:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929486+0000", 2024-09-12T16:18:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045900653999999999 2024-09-12T16:18:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929527+0000", 2024-09-12T16:18:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0707999999999997e-05 2024-09-12T16:18:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.848 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929578+0000", 2024-09-12T16:18:07.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1031e-05 2024-09-12T16:18:07.848 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.848 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.848 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.848 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11277 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3469312~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:07.848 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883595+0000", 2024-09-12T16:18:07.848 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.875424855, 2024-09-12T16:18:07.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.046187702999999997, 2024-09-12T16:18:07.848 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:07.848 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11277 2024-09-12T16:18:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883595+0000", 2024-09-12T16:18:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883595+0000", 2024-09-12T16:18:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.889065+0000", 2024-09-12T16:18:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00547001 2024-09-12T16:18:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.889069+0000", 2024-09-12T16:18:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1180000000000002e-06 2024-09-12T16:18:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.889079+0000", 2024-09-12T16:18:07.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2250000000000006e-06 2024-09-12T16:18:07.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:07.851 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.889084+0000", 2024-09-12T16:18:07.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2680000000000002e-06 2024-09-12T16:18:07.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:07.851 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929612+0000", 2024-09-12T16:18:07.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040528343000000001 2024-09-12T16:18:07.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929691+0000", 2024-09-12T16:18:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8541999999999994e-05 2024-09-12T16:18:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929783+0000", 2024-09-12T16:18:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2196999999999998e-05 2024-09-12T16:18:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:07.853 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:07.854 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:18:07.854 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:18:07.855 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:18:07.855 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:18:07.855 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:18:07.856 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:18:07.856 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:18:07.856 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:18:07.856 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:18:07.857 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:18:07.857 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:18:07.857 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:07.853+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:07.859 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:18:07.859 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:18:07.955 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:07.953+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:07.963 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:07.964 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:07.972 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:18:08.006 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2024-09-12T16:18:08.069 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:08.067+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:08.117 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 3] out_osds: [5] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-12T16:18:08.117 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T16:18:08.118 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-09-12T16:18:08.118 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-12T16:18:08.118 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-12T16:18:08.118 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-09-12T16:18:08.125 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:08.125 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:08.135 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:18:08.176 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:08.174+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:08.228 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:08.228 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-12T16:18:08.228 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:08.257 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:08.256+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:08.283 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:08.283 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:08.291 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:18:08.358 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:08.357+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:08.411 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:08.411 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:08.420 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:18:08.459 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:08.458+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:08.527 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:08.528 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:08.536 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:18:08.560 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:08.560+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:08.643 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:08.643 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:08.652 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:18:08.661 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:08.660+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:08.759 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:08.759 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:08.761 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:08.760+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:08.768 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:18:08.862 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:08.861+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:08.874 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:08.874 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:08.883 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:18:08.967 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:08.966+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:09.030 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:09.030 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:09.039 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:18:09.080 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:09.079+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:09.166 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:09.164+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:09.197 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:09.197 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:09.207 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:18:09.292 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:09.291+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:09.355 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:09.355 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:09.364 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:18:09.404 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:09.403+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:09.469 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:09.467+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:09.511 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:09.511 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:09.519 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:18:09.569 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:09.568+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:09.634 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:09.634 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:09.643 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:18:09.687 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:09.685+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:09.751 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:09.751 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:09.759 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:18:09.771 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:09.770+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:09.871 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T16:18:09.872 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:09.871+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:09.908 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:09.908 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:09.917 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:18:09.996 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:18:09.996 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:18:09.997 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:09.995+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:10.013 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:18:10.014 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:18:10.027 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T16:18:10.030 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:18:10.030 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:18:10.049 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:18:10.049 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:18:10.067 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:18:10.068 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:18:10.068 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:10.068 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:10.068 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:18:10.068 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:10.073 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:10.072+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:10.079 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:18:10.091 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:18:10.092 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:18:10.174 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:10.173+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:10.207 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:10.207 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:10.207 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:18:10.207 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:18:10.208 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:10.216 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:18:10.275 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:10.273+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:10.328 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:10.328 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:18:10.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:18:10.328 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:18:10.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.328 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1571 3.b 3:d046566d:::rbd_data.1155525b14e3.0000000000000001:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:18:10.328 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:18:10.328 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 89.173689941999996, 2024-09-12T16:18:10.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064439785999999999, 2024-09-12T16:18:10.328 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.329 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.329 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:10.329 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.329 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:18:10.329 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:18:10.329 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1571 2024-09-12T16:18:10.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.329 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:18:10.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:18:10.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:18:10.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5400000000000002e-07 2024-09-12T16:18:10.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152567+0000", 2024-09-12T16:18:10.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.131e-06 2024-09-12T16:18:10.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152574+0000", 2024-09-12T16:18:10.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1840000000000002e-06 2024-09-12T16:18:10.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152579+0000", 2024-09-12T16:18:10.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.152e-06 2024-09-12T16:18:10.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153671+0000", 2024-09-12T16:18:10.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001092078 2024-09-12T16:18:10.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153779+0000", 2024-09-12T16:18:10.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108461 2024-09-12T16:18:10.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217004+0000", 2024-09-12T16:18:10.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.063224426 2024-09-12T16:18:10.332 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.332 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.332 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.333 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1581 3.4 3:22e34893:::rbd_data.1155525b14e3.0000000000000005:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:18:10.333 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:18:10.333 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 89.173592816999999, 2024-09-12T16:18:10.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064484407999999993, 2024-09-12T16:18:10.333 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.333 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.333 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:10.333 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.333 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:18:10.333 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:18:10.333 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1581 2024-09-12T16:18:10.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.333 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:18:10.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:18:10.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152662+0000", 2024-09-12T16:18:10.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.65e-07 2024-09-12T16:18:10.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152664+0000", 2024-09-12T16:18:10.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9829999999999999e-06 2024-09-12T16:18:10.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152670+0000", 2024-09-12T16:18:10.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2260000000000002e-06 2024-09-12T16:18:10.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152675+0000", 2024-09-12T16:18:10.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7990000000000001e-06 2024-09-12T16:18:10.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.216945+0000", 2024-09-12T16:18:10.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064270341999999994 2024-09-12T16:18:10.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217040+0000", 2024-09-12T16:18:10.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5242999999999996e-05 2024-09-12T16:18:10.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217146+0000", 2024-09-12T16:18:10.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010545 2024-09-12T16:18:10.337 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.337 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.337 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.337 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2207 3.0 3:05fdc61f:::rbd_data.1155ccb1894c.0000000000000003:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:18:10.337 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:18:10.337 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.955549255999998, 2024-09-12T16:18:10.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.05105382, 2024-09-12T16:18:10.337 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.337 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.337 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:10.337 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.337 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:18:10.338 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:18:10.338 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2207 2024-09-12T16:18:10.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.338 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:18:10.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:18:10.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370706+0000", 2024-09-12T16:18:10.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7800000000000001e-07 2024-09-12T16:18:10.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391581+0000", 2024-09-12T16:18:10.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020875624999999998 2024-09-12T16:18:10.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391608+0000", 2024-09-12T16:18:10.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6412999999999999e-05 2024-09-12T16:18:10.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391618+0000", 2024-09-12T16:18:10.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9240000000000002e-06 2024-09-12T16:18:10.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.340 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391705+0000", 2024-09-12T16:18:10.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7489000000000002e-05 2024-09-12T16:18:10.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.340 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391838+0000", 2024-09-12T16:18:10.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132865 2024-09-12T16:18:10.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 2", 2024-09-12T16:18:10.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.392587+0000", 2024-09-12T16:18:10.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074930000000000005 2024-09-12T16:18:10.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.341 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:10.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.420095+0000", 2024-09-12T16:18:10.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027507949 2024-09-12T16:18:10.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.341 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:18:10.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421610+0000", 2024-09-12T16:18:10.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001515195 2024-09-12T16:18:10.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.341 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:18:10.342 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421681+0000", 2024-09-12T16:18:10.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0320000000000004e-05 2024-09-12T16:18:10.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.342 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421759+0000", 2024-09-12T16:18:10.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7961999999999997e-05 2024-09-12T16:18:10.342 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.342 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.342 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.342 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11082 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 3350528~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:10.342 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.876283+0000", 2024-09-12T16:18:10.342 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 16.4499706, 2024-09-12T16:18:10.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044907159000000002, 2024-09-12T16:18:10.343 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.343 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.343 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:10.343 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.343 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:10.343 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:10.343 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11082 2024-09-12T16:18:10.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.343 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876283+0000", 2024-09-12T16:18:10.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876283+0000", 2024-09-12T16:18:10.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876284+0000", 2024-09-12T16:18:10.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7300000000000002e-07 2024-09-12T16:18:10.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876286+0000", 2024-09-12T16:18:10.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2089999999999999e-06 2024-09-12T16:18:10.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876292+0000", 2024-09-12T16:18:10.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9399999999999999e-06 2024-09-12T16:18:10.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.345 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876297+0000", 2024-09-12T16:18:10.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9200000000000003e-06 2024-09-12T16:18:10.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.345 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921094+0000", 2024-09-12T16:18:10.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044797311999999999 2024-09-12T16:18:10.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921136+0000", 2024-09-12T16:18:10.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1625000000000002e-05 2024-09-12T16:18:10.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921191+0000", 2024-09-12T16:18:10.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4780000000000001e-05 2024-09-12T16:18:10.346 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.346 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.346 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.346 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11083 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 3399680~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:10.347 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.876304+0000", 2024-09-12T16:18:10.347 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 16.449949848999999, 2024-09-12T16:18:10.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045070883999999999, 2024-09-12T16:18:10.347 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.347 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.347 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:10.347 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.347 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:10.347 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:10.347 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11083 2024-09-12T16:18:10.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.347 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876304+0000", 2024-09-12T16:18:10.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876304+0000", 2024-09-12T16:18:10.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876305+0000", 2024-09-12T16:18:10.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4099999999999999e-07 2024-09-12T16:18:10.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876307+0000", 2024-09-12T16:18:10.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9470000000000002e-06 2024-09-12T16:18:10.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876312+0000", 2024-09-12T16:18:10.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7540000000000003e-06 2024-09-12T16:18:10.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876318+0000", 2024-09-12T16:18:10.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3589999999999999e-06 2024-09-12T16:18:10.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.350 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.350 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921221+0000", 2024-09-12T16:18:10.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044903464999999997 2024-09-12T16:18:10.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.350 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.350 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921266+0000", 2024-09-12T16:18:10.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4795000000000001e-05 2024-09-12T16:18:10.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.350 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.350 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921375+0000", 2024-09-12T16:18:10.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000109023 2024-09-12T16:18:10.351 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.351 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.351 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.351 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11084 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 3448832~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:10.351 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.876324+0000", 2024-09-12T16:18:10.351 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 16.449929732000001, 2024-09-12T16:18:10.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045172474999999997, 2024-09-12T16:18:10.351 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.351 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.351 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:10.351 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.351 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:10.352 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:10.352 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11084 2024-09-12T16:18:10.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.352 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876324+0000", 2024-09-12T16:18:10.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876324+0000", 2024-09-12T16:18:10.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876411+0000", 2024-09-12T16:18:10.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6292000000000007e-05 2024-09-12T16:18:10.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876418+0000", 2024-09-12T16:18:10.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3309999999999998e-06 2024-09-12T16:18:10.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876426+0000", 2024-09-12T16:18:10.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3850000000000002e-06 2024-09-12T16:18:10.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876436+0000", 2024-09-12T16:18:10.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8749999999999995e-06 2024-09-12T16:18:10.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921403+0000", 2024-09-12T16:18:10.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044966385999999997 2024-09-12T16:18:10.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921445+0000", 2024-09-12T16:18:10.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1953000000000003e-05 2024-09-12T16:18:10.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921497+0000", 2024-09-12T16:18:10.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2253000000000003e-05 2024-09-12T16:18:10.355 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.355 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.355 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.355 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11085 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 3497984~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:10.355 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.876449+0000", 2024-09-12T16:18:10.356 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 16.449805221999998, 2024-09-12T16:18:10.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045173054999999997, 2024-09-12T16:18:10.356 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.356 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.356 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:10.356 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.356 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:10.356 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:10.356 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11085 2024-09-12T16:18:10.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.356 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.356 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.356 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876449+0000", 2024-09-12T16:18:10.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.357 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.357 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876449+0000", 2024-09-12T16:18:10.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.357 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.357 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.881997+0000", 2024-09-12T16:18:10.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055481209999999996 2024-09-12T16:18:10.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.357 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.882002+0000", 2024-09-12T16:18:10.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8269999999999997e-06 2024-09-12T16:18:10.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.882013+0000", 2024-09-12T16:18:10.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0869999999999999e-05 2024-09-12T16:18:10.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.882020+0000", 2024-09-12T16:18:10.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5839999999999997e-06 2024-09-12T16:18:10.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921523+0000", 2024-09-12T16:18:10.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039502411000000001 2024-09-12T16:18:10.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921566+0000", 2024-09-12T16:18:10.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3353000000000003e-05 2024-09-12T16:18:10.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921622+0000", 2024-09-12T16:18:10.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5889e-05 2024-09-12T16:18:10.359 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.359 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.360 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.360 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11136 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 6004736~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:10.360 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883172+0000", 2024-09-12T16:18:10.360 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 16.443082045000001, 2024-09-12T16:18:10.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044900554000000002, 2024-09-12T16:18:10.360 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.360 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.360 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:10.360 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.360 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:10.360 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:10.360 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11136 2024-09-12T16:18:10.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.361 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883172+0000", 2024-09-12T16:18:10.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883172+0000", 2024-09-12T16:18:10.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883172+0000", 2024-09-12T16:18:10.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5199999999999998e-07 2024-09-12T16:18:10.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883174+0000", 2024-09-12T16:18:10.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1169999999999998e-06 2024-09-12T16:18:10.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883181+0000", 2024-09-12T16:18:10.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0920000000000003e-06 2024-09-12T16:18:10.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.363 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883186+0000", 2024-09-12T16:18:10.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0900000000000004e-06 2024-09-12T16:18:10.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.363 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.927988+0000", 2024-09-12T16:18:10.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044802373999999999 2024-09-12T16:18:10.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.363 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928032+0000", 2024-09-12T16:18:10.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3717999999999997e-05 2024-09-12T16:18:10.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.364 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928073+0000", 2024-09-12T16:18:10.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0810999999999999e-05 2024-09-12T16:18:10.364 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.364 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.364 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.364 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11137 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 6053888~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:10.364 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883204+0000", 2024-09-12T16:18:10.364 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 16.443049864999999, 2024-09-12T16:18:10.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044978854999999998, 2024-09-12T16:18:10.365 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.365 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.365 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:10.365 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.365 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:10.365 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:10.365 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11137 2024-09-12T16:18:10.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.365 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883204+0000", 2024-09-12T16:18:10.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883204+0000", 2024-09-12T16:18:10.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883205+0000", 2024-09-12T16:18:10.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6700000000000003e-07 2024-09-12T16:18:10.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883207+0000", 2024-09-12T16:18:10.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4370000000000001e-06 2024-09-12T16:18:10.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.367 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.367 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883214+0000", 2024-09-12T16:18:10.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1840000000000002e-06 2024-09-12T16:18:10.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.367 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.367 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883220+0000", 2024-09-12T16:18:10.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5010000000000004e-06 2024-09-12T16:18:10.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.367 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.367 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928098+0000", 2024-09-12T16:18:10.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044878058999999998 2024-09-12T16:18:10.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.368 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.368 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928140+0000", 2024-09-12T16:18:10.368 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1990000000000003e-05 2024-09-12T16:18:10.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.368 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.368 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928183+0000", 2024-09-12T16:18:10.368 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3117000000000001e-05 2024-09-12T16:18:10.368 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.368 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.368 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.369 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11138 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 6103040~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:10.369 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883227+0000", 2024-09-12T16:18:10.369 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 16.443026631999999, 2024-09-12T16:18:10.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045063931000000002, 2024-09-12T16:18:10.369 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.369 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.369 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:10.369 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.369 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:10.369 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:10.369 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11138 2024-09-12T16:18:10.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.369 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883227+0000", 2024-09-12T16:18:10.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883227+0000", 2024-09-12T16:18:10.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883228+0000", 2024-09-12T16:18:10.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5600000000000005e-07 2024-09-12T16:18:10.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883230+0000", 2024-09-12T16:18:10.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1210000000000001e-06 2024-09-12T16:18:10.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883236+0000", 2024-09-12T16:18:10.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1670000000000004e-06 2024-09-12T16:18:10.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883241+0000", 2024-09-12T16:18:10.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9060000000000001e-06 2024-09-12T16:18:10.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928211+0000", 2024-09-12T16:18:10.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044969229999999999 2024-09-12T16:18:10.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928252+0000", 2024-09-12T16:18:10.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1671000000000001e-05 2024-09-12T16:18:10.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928291+0000", 2024-09-12T16:18:10.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9180000000000001e-05 2024-09-12T16:18:10.373 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.373 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.373 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.373 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11139 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 6152192~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:10.373 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883248+0000", 2024-09-12T16:18:10.374 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 16.443006358000002, 2024-09-12T16:18:10.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045153225999999998, 2024-09-12T16:18:10.374 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.374 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.374 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:10.374 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.374 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:10.374 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:10.374 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11139 2024-09-12T16:18:10.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.374 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883248+0000", 2024-09-12T16:18:10.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.375 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883248+0000", 2024-09-12T16:18:10.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.375 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883248+0000", 2024-09-12T16:18:10.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9999999999999998e-07 2024-09-12T16:18:10.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.375 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883250+0000", 2024-09-12T16:18:10.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0660000000000002e-06 2024-09-12T16:18:10.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.376 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883256+0000", 2024-09-12T16:18:10.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8699999999999997e-06 2024-09-12T16:18:10.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.376 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883261+0000", 2024-09-12T16:18:10.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0490000000000003e-06 2024-09-12T16:18:10.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928316+0000", 2024-09-12T16:18:10.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045055398000000003 2024-09-12T16:18:10.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928359+0000", 2024-09-12T16:18:10.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2286000000000001e-05 2024-09-12T16:18:10.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928401+0000", 2024-09-12T16:18:10.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2157000000000003e-05 2024-09-12T16:18:10.378 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.378 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.378 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.378 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11140 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 6201344~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:10.378 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883267+0000", 2024-09-12T16:18:10.378 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 16.442986592, 2024-09-12T16:18:10.378 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045241199000000003, 2024-09-12T16:18:10.378 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.378 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.378 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:10.378 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.378 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:10.378 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:10.379 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11140 2024-09-12T16:18:10.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.379 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.379 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.379 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883267+0000", 2024-09-12T16:18:10.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.379 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.379 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883267+0000", 2024-09-12T16:18:10.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.379 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883268+0000", 2024-09-12T16:18:10.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8700000000000001e-07 2024-09-12T16:18:10.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883270+0000", 2024-09-12T16:18:10.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3420000000000002e-06 2024-09-12T16:18:10.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883276+0000", 2024-09-12T16:18:10.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0310000000000004e-06 2024-09-12T16:18:10.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883281+0000", 2024-09-12T16:18:10.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1259999999999997e-06 2024-09-12T16:18:10.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.381 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928428+0000", 2024-09-12T16:18:10.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045146276999999999 2024-09-12T16:18:10.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.381 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928469+0000", 2024-09-12T16:18:10.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1007000000000002e-05 2024-09-12T16:18:10.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928509+0000", 2024-09-12T16:18:10.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0028999999999999e-05 2024-09-12T16:18:10.382 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.382 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.382 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.382 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11141 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 6250496~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:10.382 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883288+0000", 2024-09-12T16:18:10.382 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 16.442965995000002, 2024-09-12T16:18:10.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045331594000000003, 2024-09-12T16:18:10.382 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.383 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.383 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:10.383 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.383 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:10.383 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:10.383 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11141 2024-09-12T16:18:10.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.383 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883288+0000", 2024-09-12T16:18:10.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883288+0000", 2024-09-12T16:18:10.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883288+0000", 2024-09-12T16:18:10.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0200000000000003e-07 2024-09-12T16:18:10.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883290+0000", 2024-09-12T16:18:10.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9350000000000001e-06 2024-09-12T16:18:10.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.385 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.385 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883296+0000", 2024-09-12T16:18:10.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.913e-06 2024-09-12T16:18:10.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.385 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.385 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883302+0000", 2024-09-12T16:18:10.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.879e-06 2024-09-12T16:18:10.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.385 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.385 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928534+0000", 2024-09-12T16:18:10.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045231544999999998 2024-09-12T16:18:10.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.386 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928577+0000", 2024-09-12T16:18:10.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3676e-05 2024-09-12T16:18:10.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.386 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928620+0000", 2024-09-12T16:18:10.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2243999999999997e-05 2024-09-12T16:18:10.386 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.386 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.386 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.387 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11271 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3174400~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:10.387 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883316+0000", 2024-09-12T16:18:10.387 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 16.442937935, 2024-09-12T16:18:10.387 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045477308000000001, 2024-09-12T16:18:10.387 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.387 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.387 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:10.387 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.387 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:10.387 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:10.387 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11271 2024-09-12T16:18:10.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.388 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883316+0000", 2024-09-12T16:18:10.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883316+0000", 2024-09-12T16:18:10.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883317+0000", 2024-09-12T16:18:10.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9200000000000001e-07 2024-09-12T16:18:10.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.389 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.389 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883319+0000", 2024-09-12T16:18:10.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2670000000000001e-06 2024-09-12T16:18:10.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.389 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.389 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883326+0000", 2024-09-12T16:18:10.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6000000000000003e-06 2024-09-12T16:18:10.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883331+0000", 2024-09-12T16:18:10.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1719999999999998e-06 2024-09-12T16:18:10.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928647+0000", 2024-09-12T16:18:10.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045316457999999997 2024-09-12T16:18:10.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928689+0000", 2024-09-12T16:18:10.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1352e-05 2024-09-12T16:18:10.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.391 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.391 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928793+0000", 2024-09-12T16:18:10.391 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000104867 2024-09-12T16:18:10.391 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.391 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.391 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.391 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11272 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3223552~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:10.391 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883338+0000", 2024-09-12T16:18:10.391 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 16.442916074999999, 2024-09-12T16:18:10.391 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045595268000000001, 2024-09-12T16:18:10.392 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.392 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.392 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:10.392 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.392 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:10.392 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:10.392 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11272 2024-09-12T16:18:10.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.392 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.392 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.392 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883338+0000", 2024-09-12T16:18:10.393 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.393 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.393 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.393 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883338+0000", 2024-09-12T16:18:10.393 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.393 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.393 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.393 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883339+0000", 2024-09-12T16:18:10.393 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8599999999999998e-07 2024-09-12T16:18:10.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.393 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.393 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.394 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883341+0000", 2024-09-12T16:18:10.394 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1449999999999998e-06 2024-09-12T16:18:10.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.394 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.394 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883348+0000", 2024-09-12T16:18:10.394 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0110000000000003e-06 2024-09-12T16:18:10.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.394 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.394 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883353+0000", 2024-09-12T16:18:10.394 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2360000000000004e-06 2024-09-12T16:18:10.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.394 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.394 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928819+0000", 2024-09-12T16:18:10.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045466392000000001 2024-09-12T16:18:10.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.395 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.395 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928869+0000", 2024-09-12T16:18:10.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9829e-05 2024-09-12T16:18:10.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.395 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.395 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928933+0000", 2024-09-12T16:18:10.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3968999999999997e-05 2024-09-12T16:18:10.395 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.395 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.395 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.396 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11273 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3272704~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:10.396 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883359+0000", 2024-09-12T16:18:10.396 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 16.442894763000002, 2024-09-12T16:18:10.396 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045735142999999999, 2024-09-12T16:18:10.396 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.396 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.396 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:10.396 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.396 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:10.396 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:10.396 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11273 2024-09-12T16:18:10.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.397 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.397 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.397 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883359+0000", 2024-09-12T16:18:10.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.397 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.397 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883359+0000", 2024-09-12T16:18:10.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.397 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.397 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883360+0000", 2024-09-12T16:18:10.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9400000000000001e-07 2024-09-12T16:18:10.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883367+0000", 2024-09-12T16:18:10.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8530000000000003e-06 2024-09-12T16:18:10.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883373+0000", 2024-09-12T16:18:10.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9989999999999997e-06 2024-09-12T16:18:10.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883378+0000", 2024-09-12T16:18:10.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3369999999999999e-06 2024-09-12T16:18:10.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.399 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928950+0000", 2024-09-12T16:18:10.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045571751000000001 2024-09-12T16:18:10.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.399 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928992+0000", 2024-09-12T16:18:10.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1891000000000003e-05 2024-09-12T16:18:10.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.399 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929094+0000", 2024-09-12T16:18:10.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010291800000000001 2024-09-12T16:18:10.400 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.400 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.400 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.400 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11274 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3321856~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:10.400 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883385+0000", 2024-09-12T16:18:10.400 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 16.442869246000001, 2024-09-12T16:18:10.400 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045864239000000001, 2024-09-12T16:18:10.400 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.400 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.400 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:10.400 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.400 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:10.400 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:10.401 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11274 2024-09-12T16:18:10.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.401 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.401 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.401 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883385+0000", 2024-09-12T16:18:10.401 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.401 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.401 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883385+0000", 2024-09-12T16:18:10.401 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.401 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883385+0000", 2024-09-12T16:18:10.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4799999999999999e-07 2024-09-12T16:18:10.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883388+0000", 2024-09-12T16:18:10.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3199999999999998e-06 2024-09-12T16:18:10.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883394+0000", 2024-09-12T16:18:10.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2020000000000001e-06 2024-09-12T16:18:10.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883400+0000", 2024-09-12T16:18:10.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8510000000000004e-06 2024-09-12T16:18:10.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929123+0000", 2024-09-12T16:18:10.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045723235000000001 2024-09-12T16:18:10.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929166+0000", 2024-09-12T16:18:10.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2769999999999999e-05 2024-09-12T16:18:10.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.404 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929249+0000", 2024-09-12T16:18:10.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3412999999999996e-05 2024-09-12T16:18:10.404 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.404 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.404 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.404 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11275 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3371008~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:10.404 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883416+0000", 2024-09-12T16:18:10.404 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 16.442837637, 2024-09-12T16:18:10.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.046042315, 2024-09-12T16:18:10.404 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.404 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.404 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:10.405 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.405 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:10.405 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:10.405 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11275 2024-09-12T16:18:10.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.405 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.405 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.405 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883416+0000", 2024-09-12T16:18:10.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.405 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.405 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883416+0000", 2024-09-12T16:18:10.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.406 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883417+0000", 2024-09-12T16:18:10.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4700000000000001e-07 2024-09-12T16:18:10.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.406 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883419+0000", 2024-09-12T16:18:10.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2029999999999999e-06 2024-09-12T16:18:10.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.406 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883426+0000", 2024-09-12T16:18:10.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.579e-06 2024-09-12T16:18:10.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.407 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883431+0000", 2024-09-12T16:18:10.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5679999999999999e-06 2024-09-12T16:18:10.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.407 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929290+0000", 2024-09-12T16:18:10.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045858227000000001 2024-09-12T16:18:10.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.407 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929365+0000", 2024-09-12T16:18:10.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5519999999999995e-05 2024-09-12T16:18:10.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.408 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.408 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929459+0000", 2024-09-12T16:18:10.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3671000000000005e-05 2024-09-12T16:18:10.408 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.408 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.408 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.408 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11276 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3420160~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:10.408 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883439+0000", 2024-09-12T16:18:10.408 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 16.442815234000001, 2024-09-12T16:18:10.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.046138991999999997, 2024-09-12T16:18:10.408 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.409 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.409 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:10.409 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.409 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:10.409 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:10.409 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11276 2024-09-12T16:18:10.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.409 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883439+0000", 2024-09-12T16:18:10.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.410 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.410 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883439+0000", 2024-09-12T16:18:10.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.410 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.410 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883560+0000", 2024-09-12T16:18:10.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121229 2024-09-12T16:18:10.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.410 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.410 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883569+0000", 2024-09-12T16:18:10.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9390000000000003e-06 2024-09-12T16:18:10.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.410 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.411 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883579+0000", 2024-09-12T16:18:10.411 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8859999999999999e-06 2024-09-12T16:18:10.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.411 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.411 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883585+0000", 2024-09-12T16:18:10.411 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.545e-06 2024-09-12T16:18:10.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.411 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.411 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929486+0000", 2024-09-12T16:18:10.411 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045900653999999999 2024-09-12T16:18:10.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929527+0000", 2024-09-12T16:18:10.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0707999999999997e-05 2024-09-12T16:18:10.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929578+0000", 2024-09-12T16:18:10.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1031e-05 2024-09-12T16:18:10.412 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.412 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.412 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.412 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11277 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3469312~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:10.413 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883595+0000", 2024-09-12T16:18:10.413 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 16.442658891000001, 2024-09-12T16:18:10.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.046187702999999997, 2024-09-12T16:18:10.413 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.413 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.413 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:10.413 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.413 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:10.413 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:10.413 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11277 2024-09-12T16:18:10.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.413 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883595+0000", 2024-09-12T16:18:10.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883595+0000", 2024-09-12T16:18:10.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.889065+0000", 2024-09-12T16:18:10.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00547001 2024-09-12T16:18:10.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.889069+0000", 2024-09-12T16:18:10.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1180000000000002e-06 2024-09-12T16:18:10.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.415 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.889079+0000", 2024-09-12T16:18:10.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2250000000000006e-06 2024-09-12T16:18:10.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.415 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.889084+0000", 2024-09-12T16:18:10.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2680000000000002e-06 2024-09-12T16:18:10.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.415 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929612+0000", 2024-09-12T16:18:10.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040528343000000001 2024-09-12T16:18:10.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.416 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929691+0000", 2024-09-12T16:18:10.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8541999999999994e-05 2024-09-12T16:18:10.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.416 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929783+0000", 2024-09-12T16:18:10.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2196999999999998e-05 2024-09-12T16:18:10.416 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.416 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.417 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.417 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.417 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.417 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:10.418 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:18:10.419 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:10.417+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:10.519 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:10.518+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:10.566 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:10.566 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:10.566 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:18:10.567 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:10.575 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:18:10.619 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:10.619+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:10.682 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:10.682 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:10.682 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:18:10.682 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:18:10.682 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:10.690 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:18:10.732 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:10.731+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:10.822 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:10.820+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:10.839 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:10.840 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:18:10.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:18:10.840 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:18:10.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.840 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2213 3.18 3:1944e921:::rbd_data.1155ccb1894c.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:18:10.840 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:18:10.840 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 73.462881433999996, 2024-09-12T16:18:10.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.055657836000000002, 2024-09-12T16:18:10.840 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.840 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.840 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:10.840 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.841 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:18:10.841 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:18:10.841 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2213 2024-09-12T16:18:10.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.841 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:18:10.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:18:10.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375351+0000", 2024-09-12T16:18:10.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.556e-06 2024-09-12T16:18:10.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.399989+0000", 2024-09-12T16:18:10.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024637949999999999 2024-09-12T16:18:10.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400038+0000", 2024-09-12T16:18:10.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9187999999999997e-05 2024-09-12T16:18:10.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.843 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400056+0000", 2024-09-12T16:18:10.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8451e-05 2024-09-12T16:18:10.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.843 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400151+0000", 2024-09-12T16:18:10.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5026999999999997e-05 2024-09-12T16:18:10.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.843 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400345+0000", 2024-09-12T16:18:10.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019352900000000001 2024-09-12T16:18:10.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 1", 2024-09-12T16:18:10.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.401319+0000", 2024-09-12T16:18:10.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00097419399999999995 2024-09-12T16:18:10.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:18:10.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.429350+0000", 2024-09-12T16:18:10.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028030607999999999 2024-09-12T16:18:10.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:10.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.430907+0000", 2024-09-12T16:18:10.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001557466 2024-09-12T16:18:10.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:18:10.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.430966+0000", 2024-09-12T16:18:10.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9437e-05 2024-09-12T16:18:10.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.431007+0000", 2024-09-12T16:18:10.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0429999999999997e-05 2024-09-12T16:18:10.845 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.845 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.845 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.846 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5632 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 585728~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:10.846 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556262+0000", 2024-09-12T16:18:10.846 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.2819683780000002, 2024-09-12T16:18:10.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051267114000000003, 2024-09-12T16:18:10.846 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.846 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.846 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:10.846 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.846 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:10.846 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:10.846 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5632 2024-09-12T16:18:10.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.847 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556262+0000", 2024-09-12T16:18:10.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556262+0000", 2024-09-12T16:18:10.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556262+0000", 2024-09-12T16:18:10.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9999999999999998e-07 2024-09-12T16:18:10.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.848 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556269+0000", 2024-09-12T16:18:10.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4119999999999998e-06 2024-09-12T16:18:10.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.848 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556276+0000", 2024-09-12T16:18:10.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8549999999999996e-06 2024-09-12T16:18:10.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.848 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556281+0000", 2024-09-12T16:18:10.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1159999999999998e-06 2024-09-12T16:18:10.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607438+0000", 2024-09-12T16:18:10.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.05115695 2024-09-12T16:18:10.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607478+0000", 2024-09-12T16:18:10.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0535999999999999e-05 2024-09-12T16:18:10.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607529+0000", 2024-09-12T16:18:10.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0844999999999999e-05 2024-09-12T16:18:10.850 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.850 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.850 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.850 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5633 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 638976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:10.850 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556288+0000", 2024-09-12T16:18:10.850 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.2819423459999992, 2024-09-12T16:18:10.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051384633999999998, 2024-09-12T16:18:10.850 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.850 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.850 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:10.850 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.850 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:10.851 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:10.851 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5633 2024-09-12T16:18:10.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.851 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.851 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556288+0000", 2024-09-12T16:18:10.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.851 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556288+0000", 2024-09-12T16:18:10.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556289+0000", 2024-09-12T16:18:10.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4000000000000002e-07 2024-09-12T16:18:10.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556291+0000", 2024-09-12T16:18:10.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0470000000000001e-06 2024-09-12T16:18:10.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556297+0000", 2024-09-12T16:18:10.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5080000000000002e-06 2024-09-12T16:18:10.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556302+0000", 2024-09-12T16:18:10.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2190000000000003e-06 2024-09-12T16:18:10.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607559+0000", 2024-09-12T16:18:10.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051256542000000002 2024-09-12T16:18:10.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607619+0000", 2024-09-12T16:18:10.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0538000000000002e-05 2024-09-12T16:18:10.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607673+0000", 2024-09-12T16:18:10.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3340000000000001e-05 2024-09-12T16:18:10.854 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.854 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5634 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 692224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556324+0000", 2024-09-12T16:18:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.2819066570000004, 2024-09-12T16:18:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.05149252, 2024-09-12T16:18:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5634 2024-09-12T16:18:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.856 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.856 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.856 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556324+0000", 2024-09-12T16:18:10.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.856 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.856 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556324+0000", 2024-09-12T16:18:10.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.856 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.856 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556324+0000", 2024-09-12T16:18:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1900000000000002e-07 2024-09-12T16:18:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556327+0000", 2024-09-12T16:18:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T16:18:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556334+0000", 2024-09-12T16:18:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3919999999999997e-06 2024-09-12T16:18:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556341+0000", 2024-09-12T16:18:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6000000000000003e-06 2024-09-12T16:18:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607704+0000", 2024-09-12T16:18:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051363233000000001 2024-09-12T16:18:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607764+0000", 2024-09-12T16:18:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9871000000000003e-05 2024-09-12T16:18:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607816+0000", 2024-09-12T16:18:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2374999999999999e-05 2024-09-12T16:18:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5635 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 745472~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556348+0000", 2024-09-12T16:18:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.2818820859999995, 2024-09-12T16:18:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051607838000000003, 2024-09-12T16:18:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5635 2024-09-12T16:18:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556348+0000", 2024-09-12T16:18:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556348+0000", 2024-09-12T16:18:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556349+0000", 2024-09-12T16:18:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.75e-07 2024-09-12T16:18:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556351+0000", 2024-09-12T16:18:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1890000000000001e-06 2024-09-12T16:18:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556358+0000", 2024-09-12T16:18:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.922e-06 2024-09-12T16:18:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556363+0000", 2024-09-12T16:18:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.242e-06 2024-09-12T16:18:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607846+0000", 2024-09-12T16:18:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051482433000000001 2024-09-12T16:18:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607886+0000", 2024-09-12T16:18:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0290999999999998e-05 2024-09-12T16:18:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607956+0000", 2024-09-12T16:18:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0285999999999998e-05 2024-09-12T16:18:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5636 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 806912~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556371+0000", 2024-09-12T16:18:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.2818599079999995, 2024-09-12T16:18:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051725921000000001, 2024-09-12T16:18:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5636 2024-09-12T16:18:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556371+0000", 2024-09-12T16:18:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556371+0000", 2024-09-12T16:18:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556371+0000", 2024-09-12T16:18:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9800000000000004e-07 2024-09-12T16:18:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556373+0000", 2024-09-12T16:18:10.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0490000000000002e-06 2024-09-12T16:18:10.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556380+0000", 2024-09-12T16:18:10.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6050000000000003e-06 2024-09-12T16:18:10.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556385+0000", 2024-09-12T16:18:10.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2449999999999998e-06 2024-09-12T16:18:10.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607993+0000", 2024-09-12T16:18:10.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051608182000000002 2024-09-12T16:18:10.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608035+0000", 2024-09-12T16:18:10.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1698e-05 2024-09-12T16:18:10.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608096+0000", 2024-09-12T16:18:10.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1643999999999995e-05 2024-09-12T16:18:10.867 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.868 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.868 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.868 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5637 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 860160~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:10.868 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556393+0000", 2024-09-12T16:18:10.868 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.2818372569999994, 2024-09-12T16:18:10.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051839035999999998, 2024-09-12T16:18:10.868 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.868 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.868 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:10.868 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.868 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:10.868 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:10.868 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5637 2024-09-12T16:18:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556393+0000", 2024-09-12T16:18:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556393+0000", 2024-09-12T16:18:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556394+0000", 2024-09-12T16:18:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3000000000000001e-07 2024-09-12T16:18:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556396+0000", 2024-09-12T16:18:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0839999999999999e-06 2024-09-12T16:18:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556402+0000", 2024-09-12T16:18:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6919999999999996e-06 2024-09-12T16:18:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556408+0000", 2024-09-12T16:18:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2800000000000003e-06 2024-09-12T16:18:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608129+0000", 2024-09-12T16:18:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051720902999999999 2024-09-12T16:18:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608174+0000", 2024-09-12T16:18:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5676000000000001e-05 2024-09-12T16:18:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608232+0000", 2024-09-12T16:18:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7970999999999998e-05 2024-09-12T16:18:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5638 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 913408~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556415+0000", 2024-09-12T16:18:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.2818158630000003, 2024-09-12T16:18:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051949532999999999, 2024-09-12T16:18:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.873 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:10.873 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.873 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:10.873 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:10.873 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5638 2024-09-12T16:18:10.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.873 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556415+0000", 2024-09-12T16:18:10.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.874 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.874 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556415+0000", 2024-09-12T16:18:10.874 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.874 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.874 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556415+0000", 2024-09-12T16:18:10.874 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7199999999999999e-07 2024-09-12T16:18:10.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.874 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.874 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556417+0000", 2024-09-12T16:18:10.874 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0279999999999999e-06 2024-09-12T16:18:10.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.875 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556424+0000", 2024-09-12T16:18:10.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6950000000000003e-06 2024-09-12T16:18:10.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.875 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556429+0000", 2024-09-12T16:18:10.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3059999999999997e-06 2024-09-12T16:18:10.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.875 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608260+0000", 2024-09-12T16:18:10.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051831254 2024-09-12T16:18:10.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.876 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.876 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608306+0000", 2024-09-12T16:18:10.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5976999999999997e-05 2024-09-12T16:18:10.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.876 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.876 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608364+0000", 2024-09-12T16:18:10.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7800999999999998e-05 2024-09-12T16:18:10.876 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.876 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.876 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.877 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5639 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 966656~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:10.877 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556436+0000", 2024-09-12T16:18:10.877 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.2817941899999994, 2024-09-12T16:18:10.877 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052070419, 2024-09-12T16:18:10.877 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.877 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.877 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:10.877 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.877 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:10.877 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:10.877 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5639 2024-09-12T16:18:10.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.877 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.878 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.878 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556436+0000", 2024-09-12T16:18:10.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.878 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.878 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556436+0000", 2024-09-12T16:18:10.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.878 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.878 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556437+0000", 2024-09-12T16:18:10.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1899999999999998e-07 2024-09-12T16:18:10.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556439+0000", 2024-09-12T16:18:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.973e-06 2024-09-12T16:18:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556445+0000", 2024-09-12T16:18:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7769999999999997e-06 2024-09-12T16:18:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556451+0000", 2024-09-12T16:18:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.31e-06 2024-09-12T16:18:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608397+0000", 2024-09-12T16:18:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051945829999999998 2024-09-12T16:18:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608438+0000", 2024-09-12T16:18:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1539000000000003e-05 2024-09-12T16:18:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608507+0000", 2024-09-12T16:18:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8571000000000005e-05 2024-09-12T16:18:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5640 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1019904~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556458+0000", 2024-09-12T16:18:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.2817726779999994, 2024-09-12T16:18:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052171423000000001, 2024-09-12T16:18:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5640 2024-09-12T16:18:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556458+0000", 2024-09-12T16:18:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556458+0000", 2024-09-12T16:18:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556458+0000", 2024-09-12T16:18:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2500000000000001e-07 2024-09-12T16:18:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556460+0000", 2024-09-12T16:18:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.934e-06 2024-09-12T16:18:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556468+0000", 2024-09-12T16:18:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7950000000000008e-06 2024-09-12T16:18:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556473+0000", 2024-09-12T16:18:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3539999999999999e-06 2024-09-12T16:18:10.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.884 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.884 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608539+0000", 2024-09-12T16:18:10.884 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052065974000000001 2024-09-12T16:18:10.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.884 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.884 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608579+0000", 2024-09-12T16:18:10.884 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0238999999999999e-05 2024-09-12T16:18:10.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608629+0000", 2024-09-12T16:18:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9701999999999999e-05 2024-09-12T16:18:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5641 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1081344~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556480+0000", 2024-09-12T16:18:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.2817500689999992, 2024-09-12T16:18:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052284826999999999, 2024-09-12T16:18:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5641 2024-09-12T16:18:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556480+0000", 2024-09-12T16:18:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556480+0000", 2024-09-12T16:18:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556481+0000", 2024-09-12T16:18:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.27e-07 2024-09-12T16:18:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556483+0000", 2024-09-12T16:18:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9379999999999999e-06 2024-09-12T16:18:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556489+0000", 2024-09-12T16:18:10.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5910000000000001e-06 2024-09-12T16:18:10.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.888 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.888 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556495+0000", 2024-09-12T16:18:10.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5600000000000001e-06 2024-09-12T16:18:10.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.888 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.888 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608659+0000", 2024-09-12T16:18:10.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052164489000000001 2024-09-12T16:18:10.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.888 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608714+0000", 2024-09-12T16:18:10.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4849999999999998e-05 2024-09-12T16:18:10.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608765+0000", 2024-09-12T16:18:10.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0971999999999999e-05 2024-09-12T16:18:10.889 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.889 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.889 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.889 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5642 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1134592~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:10.889 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556502+0000", 2024-09-12T16:18:10.889 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.2817281739999995, 2024-09-12T16:18:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052404536000000002, 2024-09-12T16:18:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5642 2024-09-12T16:18:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556502+0000", 2024-09-12T16:18:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556502+0000", 2024-09-12T16:18:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556503+0000", 2024-09-12T16:18:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8599999999999998e-07 2024-09-12T16:18:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556505+0000", 2024-09-12T16:18:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.097e-06 2024-09-12T16:18:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.892 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.892 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556512+0000", 2024-09-12T16:18:10.892 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8229999999999997e-06 2024-09-12T16:18:10.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.892 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.892 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556517+0000", 2024-09-12T16:18:10.892 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6289999999999998e-06 2024-09-12T16:18:10.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.892 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.892 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608797+0000", 2024-09-12T16:18:10.892 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052279651000000003 2024-09-12T16:18:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608852+0000", 2024-09-12T16:18:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4994999999999998e-05 2024-09-12T16:18:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608907+0000", 2024-09-12T16:18:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4755e-05 2024-09-12T16:18:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5643 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1187840~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556525+0000", 2024-09-12T16:18:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.2817059319999995, 2024-09-12T16:18:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052518288000000003, 2024-09-12T16:18:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5643 2024-09-12T16:18:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556525+0000", 2024-09-12T16:18:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556525+0000", 2024-09-12T16:18:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556525+0000", 2024-09-12T16:18:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0400000000000002e-07 2024-09-12T16:18:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556528+0000", 2024-09-12T16:18:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8679999999999999e-06 2024-09-12T16:18:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556536+0000", 2024-09-12T16:18:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3089999999999996e-06 2024-09-12T16:18:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556541+0000", 2024-09-12T16:18:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3120000000000001e-06 2024-09-12T16:18:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608943+0000", 2024-09-12T16:18:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052401089999999997 2024-09-12T16:18:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608991+0000", 2024-09-12T16:18:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8633e-05 2024-09-12T16:18:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609043+0000", 2024-09-12T16:18:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1672000000000003e-05 2024-09-12T16:18:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5644 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1241088~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556548+0000", 2024-09-12T16:18:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.2816823989999993, 2024-09-12T16:18:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052634777000000001, 2024-09-12T16:18:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5644 2024-09-12T16:18:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.899 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556548+0000", 2024-09-12T16:18:10.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.899 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556548+0000", 2024-09-12T16:18:10.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.899 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556549+0000", 2024-09-12T16:18:10.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1900000000000003e-07 2024-09-12T16:18:10.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556555+0000", 2024-09-12T16:18:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.652e-06 2024-09-12T16:18:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556562+0000", 2024-09-12T16:18:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.905e-06 2024-09-12T16:18:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556567+0000", 2024-09-12T16:18:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1730000000000003e-06 2024-09-12T16:18:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609079+0000", 2024-09-12T16:18:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052511993 2024-09-12T16:18:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609125+0000", 2024-09-12T16:18:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5327000000000002e-05 2024-09-12T16:18:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609183+0000", 2024-09-12T16:18:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8208000000000002e-05 2024-09-12T16:18:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5645 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1294336~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556574+0000", 2024-09-12T16:18:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.281656001, 2024-09-12T16:18:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052876909999999999, 2024-09-12T16:18:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5645 2024-09-12T16:18:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556574+0000", 2024-09-12T16:18:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556574+0000", 2024-09-12T16:18:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556575+0000", 2024-09-12T16:18:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.89e-07 2024-09-12T16:18:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556577+0000", 2024-09-12T16:18:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8700000000000001e-06 2024-09-12T16:18:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556583+0000", 2024-09-12T16:18:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4320000000000004e-06 2024-09-12T16:18:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556589+0000", 2024-09-12T16:18:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3890000000000004e-06 2024-09-12T16:18:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609236+0000", 2024-09-12T16:18:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052647022000000002 2024-09-12T16:18:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609334+0000", 2024-09-12T16:18:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8039000000000001e-05 2024-09-12T16:18:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609451+0000", 2024-09-12T16:18:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117769 2024-09-12T16:18:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5646 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1355776~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556595+0000", 2024-09-12T16:18:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.2816350199999995, 2024-09-12T16:18:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053088173000000002, 2024-09-12T16:18:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5646 2024-09-12T16:18:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556595+0000", 2024-09-12T16:18:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556595+0000", 2024-09-12T16:18:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556596+0000", 2024-09-12T16:18:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:18:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556598+0000", 2024-09-12T16:18:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0669999999999999e-06 2024-09-12T16:18:10.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556603+0000", 2024-09-12T16:18:10.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5210000000000002e-06 2024-09-12T16:18:10.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556609+0000", 2024-09-12T16:18:10.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1590000000000001e-06 2024-09-12T16:18:10.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609499+0000", 2024-09-12T16:18:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052890489999999998 2024-09-12T16:18:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609586+0000", 2024-09-12T16:18:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6681999999999994e-05 2024-09-12T16:18:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609684+0000", 2024-09-12T16:18:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7863999999999997e-05 2024-09-12T16:18:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5647 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1409024~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556616+0000", 2024-09-12T16:18:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.2816147250000007, 2024-09-12T16:18:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053207888000000002, 2024-09-12T16:18:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5647 2024-09-12T16:18:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556616+0000", 2024-09-12T16:18:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556616+0000", 2024-09-12T16:18:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556616+0000", 2024-09-12T16:18:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3599999999999999e-07 2024-09-12T16:18:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556618+0000", 2024-09-12T16:18:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1550000000000001e-06 2024-09-12T16:18:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556624+0000", 2024-09-12T16:18:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0499999999999997e-06 2024-09-12T16:18:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556629+0000", 2024-09-12T16:18:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8840000000000002e-06 2024-09-12T16:18:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609721+0000", 2024-09-12T16:18:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053091808999999997 2024-09-12T16:18:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609767+0000", 2024-09-12T16:18:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.638e-05 2024-09-12T16:18:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609824+0000", 2024-09-12T16:18:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6174000000000001e-05 2024-09-12T16:18:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5648 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1462272~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556636+0000", 2024-09-12T16:18:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.2815940660000003, 2024-09-12T16:18:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053322131000000002, 2024-09-12T16:18:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5648 2024-09-12T16:18:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556636+0000", 2024-09-12T16:18:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556636+0000", 2024-09-12T16:18:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557015+0000", 2024-09-12T16:18:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000378911 2024-09-12T16:18:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557019+0000", 2024-09-12T16:18:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2100000000000002e-06 2024-09-12T16:18:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557030+0000", 2024-09-12T16:18:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.149e-05 2024-09-12T16:18:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557037+0000", 2024-09-12T16:18:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5719999999999999e-06 2024-09-12T16:18:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609838+0000", 2024-09-12T16:18:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052801305999999999 2024-09-12T16:18:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609880+0000", 2024-09-12T16:18:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2604000000000001e-05 2024-09-12T16:18:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609959+0000", 2024-09-12T16:18:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8038000000000001e-05 2024-09-12T16:18:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5649 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1515520~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.557073+0000", 2024-09-12T16:18:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.2811570650000004, 2024-09-12T16:18:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053030573999999997, 2024-09-12T16:18:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:10.920 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:10.920 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5649 2024-09-12T16:18:10.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.920 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557073+0000", 2024-09-12T16:18:10.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557073+0000", 2024-09-12T16:18:10.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557074+0000", 2024-09-12T16:18:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5199999999999996e-07 2024-09-12T16:18:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557084+0000", 2024-09-12T16:18:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0349e-05 2024-09-12T16:18:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557092+0000", 2024-09-12T16:18:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9699999999999999e-06 2024-09-12T16:18:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557100+0000", 2024-09-12T16:18:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7049999999999999e-06 2024-09-12T16:18:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609992+0000", 2024-09-12T16:18:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052891821999999998 2024-09-12T16:18:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610034+0000", 2024-09-12T16:18:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2141000000000002e-05 2024-09-12T16:18:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610104+0000", 2024-09-12T16:18:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9935e-05 2024-09-12T16:18:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5650 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1568768~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.557111+0000", 2024-09-12T16:18:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.2811198430000008, 2024-09-12T16:18:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053118023, 2024-09-12T16:18:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:10.924 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:10.924 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:10.924 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:10.924 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:10.924 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:10.924 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5650 2024-09-12T16:18:10.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.924 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:10.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.924 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:10.924 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557111+0000", 2024-09-12T16:18:10.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.924 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:10.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557111+0000", 2024-09-12T16:18:10.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:10.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:10.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.562089+0000", 2024-09-12T16:18:10.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0049787410000000001 2024-09-12T16:18:10.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:10.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.562094+0000", 2024-09-12T16:18:10.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7210000000000002e-06 2024-09-12T16:18:10.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:10.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.562105+0000", 2024-09-12T16:18:10.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0458999999999999e-05 2024-09-12T16:18:10.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:10.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.562112+0000", 2024-09-12T16:18:10.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0280000000000003e-06 2024-09-12T16:18:10.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:10.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610135+0000", 2024-09-12T16:18:10.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048023374000000001 2024-09-12T16:18:10.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:10.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610177+0000", 2024-09-12T16:18:10.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2119000000000001e-05 2024-09-12T16:18:10.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:10.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:10.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:10.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610229+0000", 2024-09-12T16:18:10.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1581e-05 2024-09-12T16:18:10.927 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.927 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.927 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.927 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:10.927 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:10.927 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:10.929 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:18:10.930 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:10.928+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:11.030 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:11.029+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:11.049 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:11.049 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:11.049 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:18:11.049 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:11.058 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:18:11.084 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2024-09-12T16:18:11.131 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:11.130+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:11.212 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:11.212 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:11.212 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:18:11.212 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:18:11.212 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:11.221 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:18:11.264 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:11.263+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:11.331 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:11.331 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:18:11.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:18:11.331 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:18:11.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.331 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:18:11.331 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:18:11.332 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 149.564870235, 2024-09-12T16:18:11.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55645454900000002, 2024-09-12T16:18:11.332 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.332 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.332 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:11.332 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.332 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:18:11.332 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:18:11.332 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1 2024-09-12T16:18:11.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.332 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.333 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:18:11.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.333 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:18:11.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.333 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764440+0000", 2024-09-12T16:18:11.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6249999999999999e-06 2024-09-12T16:18:11.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.334 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.334 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.334 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764447+0000", 2024-09-12T16:18:11.334 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4939999999999997e-06 2024-09-12T16:18:11.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.334 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.334 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.334 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764459+0000", 2024-09-12T16:18:11.334 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1517e-05 2024-09-12T16:18:11.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.335 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.335 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.335 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764468+0000", 2024-09-12T16:18:11.335 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7690000000000002e-06 2024-09-12T16:18:11.335 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.335 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.335 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.335 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764539+0000", 2024-09-12T16:18:11.335 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1103e-05 2024-09-12T16:18:11.335 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.335 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.335 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:11.335 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764551+0000", 2024-09-12T16:18:11.336 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2687999999999999e-05 2024-09-12T16:18:11.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.336 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.336 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.336 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319497+0000", 2024-09-12T16:18:11.336 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55494560500000001 2024-09-12T16:18:11.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.336 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.336 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.336 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319688+0000", 2024-09-12T16:18:11.336 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019105599999999999 2024-09-12T16:18:11.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.336 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.337 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:18:11.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319842+0000", 2024-09-12T16:18:11.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015377699999999999 2024-09-12T16:18:11.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.337 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:18:11.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320473+0000", 2024-09-12T16:18:11.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00063117100000000003 2024-09-12T16:18:11.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.337 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:11.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320825+0000", 2024-09-12T16:18:11.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00035202500000000001 2024-09-12T16:18:11.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.338 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.338 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:11.338 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320867+0000", 2024-09-12T16:18:11.338 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2005000000000002e-05 2024-09-12T16:18:11.338 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.338 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.338 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.338 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320893+0000", 2024-09-12T16:18:11.338 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5714000000000001e-05 2024-09-12T16:18:11.338 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.338 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.338 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.338 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.339 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.339 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14034 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5035008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:11.339 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:18:11.339 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 111.80781200200001, 2024-09-12T16:18:11.339 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053404082999999998, 2024-09-12T16:18:11.339 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.339 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.339 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:11.339 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.339 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:11.339 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:11.339 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14034 2024-09-12T16:18:11.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.340 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.340 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.340 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.340 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:18:11.340 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.340 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.340 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.340 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:18:11.340 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.341 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.341 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.341 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521740+0000", 2024-09-12T16:18:11.341 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000243976 2024-09-12T16:18:11.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.341 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.341 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.341 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521745+0000", 2024-09-12T16:18:11.341 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1280000000000001e-06 2024-09-12T16:18:11.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.341 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.341 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.341 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521757+0000", 2024-09-12T16:18:11.342 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2751e-05 2024-09-12T16:18:11.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.342 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.342 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.342 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521771+0000", 2024-09-12T16:18:11.342 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3328e-05 2024-09-12T16:18:11.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.342 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.342 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.342 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574710+0000", 2024-09-12T16:18:11.342 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052939358999999998 2024-09-12T16:18:11.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.342 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.343 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.343 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574799+0000", 2024-09-12T16:18:11.343 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8893000000000004e-05 2024-09-12T16:18:11.343 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.343 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.343 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.343 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574901+0000", 2024-09-12T16:18:11.343 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101648 2024-09-12T16:18:11.343 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.343 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.343 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.343 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.343 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.344 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14036 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5043200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:11.344 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:18:11.344 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 111.807352808, 2024-09-12T16:18:11.344 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053426247000000003, 2024-09-12T16:18:11.344 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.344 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.344 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:11.344 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.344 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:11.344 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:11.344 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14036 2024-09-12T16:18:11.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.344 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.344 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.344 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.345 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:18:11.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.345 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.345 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.345 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:18:11.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.345 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.345 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.345 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522208+0000", 2024-09-12T16:18:11.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025195300000000002 2024-09-12T16:18:11.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.346 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.346 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522211+0000", 2024-09-12T16:18:11.346 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2160000000000002e-06 2024-09-12T16:18:11.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.346 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.346 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522223+0000", 2024-09-12T16:18:11.346 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2044e-05 2024-09-12T16:18:11.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.347 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.347 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522229+0000", 2024-09-12T16:18:11.347 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8850000000000004e-06 2024-09-12T16:18:11.347 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.347 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.347 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.347 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575192+0000", 2024-09-12T16:18:11.347 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052963573 2024-09-12T16:18:11.347 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.347 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.347 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.347 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575282+0000", 2024-09-12T16:18:11.348 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9666000000000005e-05 2024-09-12T16:18:11.348 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.348 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.348 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.348 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575382+0000", 2024-09-12T16:18:11.348 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9909999999999997e-05 2024-09-12T16:18:11.348 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.348 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.348 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.348 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.348 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.348 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14039 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5055488~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:11.348 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:18:11.349 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 111.80667302400001, 2024-09-12T16:18:11.349 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053466207000000002, 2024-09-12T16:18:11.349 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.349 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.349 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:11.349 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.349 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:11.349 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:11.349 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14039 2024-09-12T16:18:11.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.350 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:18:11.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:18:11.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.351 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.351 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522899+0000", 2024-09-12T16:18:11.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026318199999999999 2024-09-12T16:18:11.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.351 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.351 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522903+0000", 2024-09-12T16:18:11.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.929e-06 2024-09-12T16:18:11.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.352 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.352 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522913+0000", 2024-09-12T16:18:11.352 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0162e-05 2024-09-12T16:18:11.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.352 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.352 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.352 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522921+0000", 2024-09-12T16:18:11.352 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.14e-06 2024-09-12T16:18:11.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.352 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.352 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.352 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575922+0000", 2024-09-12T16:18:11.352 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053000712999999998 2024-09-12T16:18:11.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.353 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.353 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.353 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576006+0000", 2024-09-12T16:18:11.353 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4161999999999998e-05 2024-09-12T16:18:11.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.353 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.353 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.353 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576102+0000", 2024-09-12T16:18:11.353 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5919000000000001e-05 2024-09-12T16:18:11.353 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.353 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.354 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.354 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14040 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5059584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:11.354 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:18:11.354 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 111.80636812900001, 2024-09-12T16:18:11.354 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053413258999999998, 2024-09-12T16:18:11.354 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.354 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.354 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:11.355 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.355 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:11.355 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:11.355 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14040 2024-09-12T16:18:11.355 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.355 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.355 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.355 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.355 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:18:11.355 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.355 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.356 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.356 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.356 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:18:11.356 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.356 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.356 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.356 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523059+0000", 2024-09-12T16:18:11.356 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118466 2024-09-12T16:18:11.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.356 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.357 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.357 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523062+0000", 2024-09-12T16:18:11.357 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.971e-06 2024-09-12T16:18:11.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.357 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.357 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.357 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523069+0000", 2024-09-12T16:18:11.357 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8279999999999997e-06 2024-09-12T16:18:11.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.357 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.357 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.357 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523073+0000", 2024-09-12T16:18:11.357 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3019999999999996e-06 2024-09-12T16:18:11.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.358 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.358 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.358 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576155+0000", 2024-09-12T16:18:11.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053081962000000003 2024-09-12T16:18:11.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.358 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.358 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.358 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576249+0000", 2024-09-12T16:18:11.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3914999999999998e-05 2024-09-12T16:18:11.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.358 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.358 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.358 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576354+0000", 2024-09-12T16:18:11.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010481500000000001 2024-09-12T16:18:11.359 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.359 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.359 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.359 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14041 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5063680~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:11.359 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:18:11.359 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 111.806217824, 2024-09-12T16:18:11.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053519111000000001, 2024-09-12T16:18:11.359 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.359 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.359 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:11.359 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.360 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:11.360 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:11.360 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14041 2024-09-12T16:18:11.360 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.360 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.360 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.360 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.360 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:18:11.360 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.360 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.360 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.360 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.361 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:18:11.361 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.361 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.361 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.361 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.361 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523309+0000", 2024-09-12T16:18:11.361 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000218712 2024-09-12T16:18:11.361 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.361 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.361 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.361 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523313+0000", 2024-09-12T16:18:11.361 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.151e-06 2024-09-12T16:18:11.361 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.362 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.362 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.362 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523320+0000", 2024-09-12T16:18:11.362 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9789999999999993e-06 2024-09-12T16:18:11.362 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.362 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.362 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.362 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523325+0000", 2024-09-12T16:18:11.362 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:18:11.362 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.362 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.362 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.362 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576402+0000", 2024-09-12T16:18:11.363 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053076811000000002 2024-09-12T16:18:11.363 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.363 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.363 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.363 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576491+0000", 2024-09-12T16:18:11.363 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8578999999999993e-05 2024-09-12T16:18:11.363 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.363 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.363 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.363 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576610+0000", 2024-09-12T16:18:11.363 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119129 2024-09-12T16:18:11.363 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.363 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.364 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.364 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.364 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.364 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14042 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5067776~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:11.364 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:18:11.364 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 111.80597439, 2024-09-12T16:18:11.364 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053510350999999998, 2024-09-12T16:18:11.364 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.364 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.364 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:11.364 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.364 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:11.365 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:11.365 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14042 2024-09-12T16:18:11.365 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.365 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.365 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.365 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.365 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:18:11.365 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.365 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.365 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.365 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.365 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:18:11.365 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.366 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.366 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.366 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523591+0000", 2024-09-12T16:18:11.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025710300000000001 2024-09-12T16:18:11.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.366 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.366 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.366 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523594+0000", 2024-09-12T16:18:11.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2229999999999999e-06 2024-09-12T16:18:11.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.366 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.366 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.366 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523602+0000", 2024-09-12T16:18:11.367 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6930000000000007e-06 2024-09-12T16:18:11.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.367 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.367 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.367 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523607+0000", 2024-09-12T16:18:11.367 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4789999999999998e-06 2024-09-12T16:18:11.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.367 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.367 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.367 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576661+0000", 2024-09-12T16:18:11.367 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053973999999997 2024-09-12T16:18:11.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.368 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.368 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.368 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576745+0000", 2024-09-12T16:18:11.368 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4660000000000006e-05 2024-09-12T16:18:11.368 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.368 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.368 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.368 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576844+0000", 2024-09-12T16:18:11.368 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9219e-05 2024-09-12T16:18:11.368 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.368 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.368 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.368 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.368 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.369 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14043 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5071872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:11.369 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:18:11.369 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 111.80569391100001, 2024-09-12T16:18:11.369 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053475295999999999, 2024-09-12T16:18:11.369 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.369 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.369 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:11.369 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.369 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:11.369 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:11.369 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14043 2024-09-12T16:18:11.369 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.369 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.370 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.370 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.370 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:18:11.370 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.370 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.370 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.370 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:18:11.370 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.370 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.370 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.370 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523823+0000", 2024-09-12T16:18:11.371 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020818900000000001 2024-09-12T16:18:11.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.371 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.371 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.371 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523826+0000", 2024-09-12T16:18:11.371 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.405e-06 2024-09-12T16:18:11.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.371 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.371 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.371 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523834+0000", 2024-09-12T16:18:11.371 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5499999999999997e-06 2024-09-12T16:18:11.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.371 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.372 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.372 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523838+0000", 2024-09-12T16:18:11.372 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.408e-06 2024-09-12T16:18:11.372 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.372 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.372 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.372 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576904+0000", 2024-09-12T16:18:11.372 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053065687 2024-09-12T16:18:11.372 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.372 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.372 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.372 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576991+0000", 2024-09-12T16:18:11.372 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7399999999999997e-05 2024-09-12T16:18:11.373 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.373 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.373 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.373 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577090+0000", 2024-09-12T16:18:11.373 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8657000000000001e-05 2024-09-12T16:18:11.373 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.373 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.373 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.373 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.373 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.373 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14044 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5075968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:11.373 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:18:11.373 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 111.805462381, 2024-09-12T16:18:11.373 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053442659000000003, 2024-09-12T16:18:11.373 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.374 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.374 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:11.374 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.374 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:11.374 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:11.374 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14044 2024-09-12T16:18:11.374 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.374 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.374 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.374 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.374 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:18:11.374 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.374 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.374 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.374 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.375 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:18:11.375 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.375 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.375 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.375 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.375 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523985+0000", 2024-09-12T16:18:11.375 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000138522 2024-09-12T16:18:11.375 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.375 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.375 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.375 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523988+0000", 2024-09-12T16:18:11.375 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.788e-06 2024-09-12T16:18:11.375 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.375 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.376 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.376 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523998+0000", 2024-09-12T16:18:11.376 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8470000000000008e-06 2024-09-12T16:18:11.376 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.376 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.376 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.376 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524010+0000", 2024-09-12T16:18:11.376 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1348999999999999e-05 2024-09-12T16:18:11.376 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.376 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.376 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.376 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577137+0000", 2024-09-12T16:18:11.376 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053127055999999999 2024-09-12T16:18:11.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.377 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.377 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.377 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577210+0000", 2024-09-12T16:18:11.377 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3392000000000005e-05 2024-09-12T16:18:11.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.377 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.377 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.377 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577289+0000", 2024-09-12T16:18:11.377 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8704999999999999e-05 2024-09-12T16:18:11.377 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.377 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.378 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.378 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.378 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.378 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14045 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5080064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:11.378 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:18:11.378 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 111.80528356000001, 2024-09-12T16:18:11.378 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053497514000000003, 2024-09-12T16:18:11.378 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.378 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.378 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:11.378 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.378 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:11.378 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:11.378 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14045 2024-09-12T16:18:11.379 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.379 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.379 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.379 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.379 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:18:11.379 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.379 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.379 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.379 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.379 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:18:11.379 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.379 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.379 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.380 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.380 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524311+0000", 2024-09-12T16:18:11.380 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028626299999999998 2024-09-12T16:18:11.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.380 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.380 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.380 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524315+0000", 2024-09-12T16:18:11.380 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0969999999999999e-06 2024-09-12T16:18:11.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.380 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.380 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.380 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524325+0000", 2024-09-12T16:18:11.381 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6330000000000008e-06 2024-09-12T16:18:11.381 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.381 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.381 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.381 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524332+0000", 2024-09-12T16:18:11.381 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8700000000000003e-06 2024-09-12T16:18:11.381 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.381 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.381 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.381 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577334+0000", 2024-09-12T16:18:11.381 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053001834999999997 2024-09-12T16:18:11.381 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.381 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.382 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.382 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577420+0000", 2024-09-12T16:18:11.382 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6145999999999998e-05 2024-09-12T16:18:11.382 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.382 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.382 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.382 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577522+0000", 2024-09-12T16:18:11.382 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010267 2024-09-12T16:18:11.382 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.382 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.382 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.382 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.382 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.383 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14047 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5088256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:11.383 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:18:11.383 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 111.804797834, 2024-09-12T16:18:11.383 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053433340000000003, 2024-09-12T16:18:11.383 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.383 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.383 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:11.383 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.383 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:11.383 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:11.383 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14047 2024-09-12T16:18:11.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.383 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.384 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.384 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:18:11.384 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.384 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.384 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:18:11.384 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.384 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.384 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524727+0000", 2024-09-12T16:18:11.385 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000216126 2024-09-12T16:18:11.385 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.385 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.385 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.385 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524732+0000", 2024-09-12T16:18:11.385 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1569999999999999e-06 2024-09-12T16:18:11.385 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.385 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.385 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.385 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524742+0000", 2024-09-12T16:18:11.385 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0186999999999999e-05 2024-09-12T16:18:11.385 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.385 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.386 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.386 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524750+0000", 2024-09-12T16:18:11.386 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4279999999999999e-06 2024-09-12T16:18:11.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.386 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.386 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.386 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577743+0000", 2024-09-12T16:18:11.386 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052993077 2024-09-12T16:18:11.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.386 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.386 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.386 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577841+0000", 2024-09-12T16:18:11.386 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8369000000000006e-05 2024-09-12T16:18:11.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.387 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.387 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.387 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577944+0000", 2024-09-12T16:18:11.387 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102996 2024-09-12T16:18:11.387 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.387 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.387 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.387 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.387 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14048 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5092352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:11.387 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:18:11.387 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 111.804546241, 2024-09-12T16:18:11.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053397515, 2024-09-12T16:18:11.388 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.388 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.388 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:11.388 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.388 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:11.388 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:11.388 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14048 2024-09-12T16:18:11.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.388 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.388 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:18:11.389 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.389 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.389 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.389 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:18:11.389 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.389 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.389 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.389 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524957+0000", 2024-09-12T16:18:11.389 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019516999999999999 2024-09-12T16:18:11.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.389 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.390 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.390 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524962+0000", 2024-09-12T16:18:11.390 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7709999999999997e-06 2024-09-12T16:18:11.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.390 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.390 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.390 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524973+0000", 2024-09-12T16:18:11.390 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1031e-05 2024-09-12T16:18:11.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.390 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.390 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.390 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524980+0000", 2024-09-12T16:18:11.390 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6100000000000002e-06 2024-09-12T16:18:11.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.390 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.390 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.391 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577977+0000", 2024-09-12T16:18:11.391 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052997481999999999 2024-09-12T16:18:11.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.391 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.391 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.391 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578062+0000", 2024-09-12T16:18:11.391 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4851000000000005e-05 2024-09-12T16:18:11.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.391 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.391 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.391 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578160+0000", 2024-09-12T16:18:11.391 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7600000000000001e-05 2024-09-12T16:18:11.391 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.392 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.392 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.392 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.392 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14049 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5096448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:11.392 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:18:11.392 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 111.80431761299999, 2024-09-12T16:18:11.392 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053439792, 2024-09-12T16:18:11.392 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.392 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.392 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:11.392 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.392 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:11.392 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:11.393 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14049 2024-09-12T16:18:11.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.393 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.393 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.393 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:18:11.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.393 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.393 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:18:11.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.393 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525170+0000", 2024-09-12T16:18:11.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017958500000000001 2024-09-12T16:18:11.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525174+0000", 2024-09-12T16:18:11.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0239999999999999e-06 2024-09-12T16:18:11.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525184+0000", 2024-09-12T16:18:11.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5950000000000005e-06 2024-09-12T16:18:11.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525191+0000", 2024-09-12T16:18:11.395 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8329999999999996e-06 2024-09-12T16:18:11.395 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.395 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.395 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.395 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578240+0000", 2024-09-12T16:18:11.395 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053049236 2024-09-12T16:18:11.395 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.395 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.395 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.395 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578333+0000", 2024-09-12T16:18:11.395 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2806999999999994e-05 2024-09-12T16:18:11.395 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.395 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.395 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.395 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578431+0000", 2024-09-12T16:18:11.396 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7712000000000002e-05 2024-09-12T16:18:11.396 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.396 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.396 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.396 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.396 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14055 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5121024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:11.396 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:18:11.396 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 111.80304692199999, 2024-09-12T16:18:11.396 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053399038000000003, 2024-09-12T16:18:11.396 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.396 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.396 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:11.397 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.397 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:11.397 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:11.397 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14055 2024-09-12T16:18:11.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.397 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.397 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.397 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.397 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:18:11.397 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.397 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.397 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.397 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:18:11.397 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.398 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.398 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526403+0000", 2024-09-12T16:18:11.398 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141571 2024-09-12T16:18:11.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.398 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.398 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526406+0000", 2024-09-12T16:18:11.398 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2660000000000002e-06 2024-09-12T16:18:11.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.399 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.399 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526420+0000", 2024-09-12T16:18:11.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3949e-05 2024-09-12T16:18:11.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.399 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.399 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.399 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526428+0000", 2024-09-12T16:18:11.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4250000000000001e-06 2024-09-12T16:18:11.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.399 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.399 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.399 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579476+0000", 2024-09-12T16:18:11.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053048349000000002 2024-09-12T16:18:11.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.400 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.400 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.400 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579563+0000", 2024-09-12T16:18:11.400 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6502999999999995e-05 2024-09-12T16:18:11.400 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.400 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.400 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.400 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579661+0000", 2024-09-12T16:18:11.400 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7974999999999996e-05 2024-09-12T16:18:11.400 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.400 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.400 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.401 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.401 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4806.0:3139 3.1e 3:78d5a095:::rbd_data.11552a37e55b.0000000000000000:head [read 69632~61440] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:18:11.401 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:18:11.401 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 101.028052672, 2024-09-12T16:18:11.401 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057851734000000002, 2024-09-12T16:18:11.401 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.401 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.401 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:11.401 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.401 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4806", 2024-09-12T16:18:11.401 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3959815836", 2024-09-12T16:18:11.401 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 3139 2024-09-12T16:18:11.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.402 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.402 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.402 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:18:11.402 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.402 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.402 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:18:11.402 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.402 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.403 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:18:11.403 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4799999999999999e-07 2024-09-12T16:18:11.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.403 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.403 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.403 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301258+0000", 2024-09-12T16:18:11.403 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.844e-06 2024-09-12T16:18:11.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.403 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.403 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.403 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301267+0000", 2024-09-12T16:18:11.403 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2960000000000004e-06 2024-09-12T16:18:11.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.404 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.404 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.404 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301276+0000", 2024-09-12T16:18:11.404 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0650000000000005e-06 2024-09-12T16:18:11.404 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.404 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.404 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.404 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301871+0000", 2024-09-12T16:18:11.404 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00059423600000000005 2024-09-12T16:18:11.404 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.404 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.404 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.404 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301920+0000", 2024-09-12T16:18:11.404 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9067000000000003e-05 2024-09-12T16:18:11.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.405 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.405 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.405 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359108+0000", 2024-09-12T16:18:11.405 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057187877999999998 2024-09-12T16:18:11.405 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.405 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.405 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.405 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.405 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:6428 3.14 3:28a44e54:::rbd_header.11552a37e55b:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:18:11.405 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:18:11.405 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 101.02772407800001, 2024-09-12T16:18:11.405 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057504023000000001, 2024-09-12T16:18:11.405 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.406 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.406 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:11.406 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.406 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:18:11.406 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:18:11.406 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6428 2024-09-12T16:18:11.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.406 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.406 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:18:11.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.407 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:18:11.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.407 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.407 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301585+0000", 2024-09-12T16:18:11.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6300000000000005e-07 2024-09-12T16:18:11.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.407 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.407 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301588+0000", 2024-09-12T16:18:11.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4149999999999999e-06 2024-09-12T16:18:11.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.407 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.408 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301597+0000", 2024-09-12T16:18:11.408 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5450000000000003e-06 2024-09-12T16:18:11.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.408 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.408 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.408 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301617+0000", 2024-09-12T16:18:11.408 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9837e-05 2024-09-12T16:18:11.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.408 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.408 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.408 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301779+0000", 2024-09-12T16:18:11.408 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016186799999999999 2024-09-12T16:18:11.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.408 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.409 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.409 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301855+0000", 2024-09-12T16:18:11.409 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5899e-05 2024-09-12T16:18:11.409 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.409 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.409 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.409 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359088+0000", 2024-09-12T16:18:11.409 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057233895999999999 2024-09-12T16:18:11.409 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.409 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.409 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.409 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.409 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.410 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5223.0:1814 3.f 3:f7b1b1c5:::rbd_object_map.1155a1fd27d2:head [read 0~136] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-12T16:18:11.410 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:18:11.410 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 65.092058014000003, 2024-09-12T16:18:11.410 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.006378226, 2024-09-12T16:18:11.410 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.410 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.410 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:11.410 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.410 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5223", 2024-09-12T16:18:11.410 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/4066330994", 2024-09-12T16:18:11.410 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1814 2024-09-12T16:18:11.410 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.410 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.410 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.411 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:18:11.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.411 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.411 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:18:11.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.411 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.411 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237252+0000", 2024-09-12T16:18:11.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.344e-06 2024-09-12T16:18:11.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.412 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.412 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237258+0000", 2024-09-12T16:18:11.412 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1070000000000001e-06 2024-09-12T16:18:11.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.412 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.412 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237270+0000", 2024-09-12T16:18:11.412 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1758e-05 2024-09-12T16:18:11.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.412 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.413 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237278+0000", 2024-09-12T16:18:11.413 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3219999999999993e-06 2024-09-12T16:18:11.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.413 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.413 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237334+0000", 2024-09-12T16:18:11.413 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6356e-05 2024-09-12T16:18:11.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.413 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:11.413 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237345+0000", 2024-09-12T16:18:11.413 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0433e-05 2024-09-12T16:18:11.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.414 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.414 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243426+0000", 2024-09-12T16:18:11.414 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.00608133 2024-09-12T16:18:11.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.414 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.414 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.414 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243534+0000", 2024-09-12T16:18:11.414 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010784 2024-09-12T16:18:11.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.414 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.414 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.414 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243629+0000", 2024-09-12T16:18:11.414 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4735999999999996e-05 2024-09-12T16:18:11.415 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.415 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.415 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.415 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.415 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5328.0:2542 3.16 3:6928f3a1:::rbd_object_map.11551722dd77:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:18:11.415 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:18:11.415 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 59.273712584000002, 2024-09-12T16:18:11.415 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.054219934999999997, 2024-09-12T16:18:11.415 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.415 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.415 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:11.415 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.415 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5328", 2024-09-12T16:18:11.415 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:18:11.415 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2542 2024-09-12T16:18:11.416 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.416 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.416 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.416 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.416 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:18:11.416 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.416 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.416 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.416 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.416 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:18:11.416 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.416 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.416 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.416 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.417 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055597+0000", 2024-09-12T16:18:11.417 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4300000000000001e-07 2024-09-12T16:18:11.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.417 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.417 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.417 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055602+0000", 2024-09-12T16:18:11.417 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4269999999999999e-06 2024-09-12T16:18:11.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.417 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.417 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.417 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055613+0000", 2024-09-12T16:18:11.417 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0815000000000001e-05 2024-09-12T16:18:11.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.417 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.417 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.418 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055621+0000", 2024-09-12T16:18:11.418 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4189999999999996e-06 2024-09-12T16:18:11.418 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.418 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.418 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.418 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102196+0000", 2024-09-12T16:18:11.418 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.046575616 2024-09-12T16:18:11.418 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.418 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.418 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.418 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102258+0000", 2024-09-12T16:18:11.418 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1872000000000007e-05 2024-09-12T16:18:11.418 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.419 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.419 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T16:18:11.419 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102601+0000", 2024-09-12T16:18:11.419 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034285700000000001 2024-09-12T16:18:11.419 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.419 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.419 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:11.419 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.104431+0000", 2024-09-12T16:18:11.419 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001830524 2024-09-12T16:18:11.419 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.419 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.419 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:18:11.419 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109733+0000", 2024-09-12T16:18:11.419 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0053020089999999999 2024-09-12T16:18:11.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.420 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.420 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:11.420 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109777+0000", 2024-09-12T16:18:11.420 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3754000000000002e-05 2024-09-12T16:18:11.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.420 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.420 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.420 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109816+0000", 2024-09-12T16:18:11.420 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8699000000000003e-05 2024-09-12T16:18:11.420 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.420 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.420 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.421 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.421 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.421 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5328.0:2543 3.16 3:6928f3a1:::rbd_object_map.11551722dd77:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:18:11.421 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:18:11.421 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 59.273118605000001, 2024-09-12T16:18:11.421 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053695720000000002, 2024-09-12T16:18:11.421 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.421 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.421 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:11.421 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.421 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5328", 2024-09-12T16:18:11.421 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:18:11.421 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2543 2024-09-12T16:18:11.421 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.422 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.422 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.422 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.422 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:18:11.422 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.422 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.422 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.422 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:18:11.422 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.422 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.423 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.423 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056191+0000", 2024-09-12T16:18:11.423 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.54e-07 2024-09-12T16:18:11.423 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.423 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.423 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.423 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056195+0000", 2024-09-12T16:18:11.423 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5460000000000002e-06 2024-09-12T16:18:11.423 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.423 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.423 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.423 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056205+0000", 2024-09-12T16:18:11.423 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7350000000000008e-06 2024-09-12T16:18:11.424 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.424 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.424 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.424 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056214+0000", 2024-09-12T16:18:11.424 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8089999999999999e-06 2024-09-12T16:18:11.424 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.424 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.424 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.424 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103317+0000", 2024-09-12T16:18:11.424 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.047102889000000002 2024-09-12T16:18:11.424 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.424 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.425 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.425 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103410+0000", 2024-09-12T16:18:11.425 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3689000000000004e-05 2024-09-12T16:18:11.425 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.425 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.425 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T16:18:11.425 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103754+0000", 2024-09-12T16:18:11.425 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034344699999999998 2024-09-12T16:18:11.425 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.425 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.425 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:11.425 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.106487+0000", 2024-09-12T16:18:11.425 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0027330100000000001 2024-09-12T16:18:11.426 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.426 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.426 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:18:11.426 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109827+0000", 2024-09-12T16:18:11.426 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033406640000000001 2024-09-12T16:18:11.426 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.426 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.426 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:11.426 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109854+0000", 2024-09-12T16:18:11.426 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6866999999999999e-05 2024-09-12T16:18:11.426 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.426 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.426 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.426 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109886+0000", 2024-09-12T16:18:11.427 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1309999999999997e-05 2024-09-12T16:18:11.427 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.427 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.427 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.427 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.427 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.427 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5832.0:1710 3.f 3:f0d97d21:::rbd_data.1155d3b3a2ae.0000000000000012:head [truncate 1376256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-12T16:18:11.427 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:18:11.427 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 23.945320519999999, 2024-09-12T16:18:11.427 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6441524489999999, 2024-09-12T16:18:11.427 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.427 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.427 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:11.428 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.428 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5832", 2024-09-12T16:18:11.428 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/201125203", 2024-09-12T16:18:11.428 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1710 2024-09-12T16:18:11.428 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.428 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.428 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.428 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.428 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:18:11.428 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.428 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.428 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.429 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.429 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:18:11.429 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.429 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.429 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.429 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:18:11.429 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.08e-07 2024-09-12T16:18:11.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.429 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.429 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.429 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383990+0000", 2024-09-12T16:18:11.430 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.979e-06 2024-09-12T16:18:11.430 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.430 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.430 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.430 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383999+0000", 2024-09-12T16:18:11.430 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3240000000000003e-06 2024-09-12T16:18:11.430 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.430 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.430 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.430 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.384002+0000", 2024-09-12T16:18:11.430 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5489999999999998e-06 2024-09-12T16:18:11.430 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.430 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.431 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.431 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.384037+0000", 2024-09-12T16:18:11.431 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4931000000000001e-05 2024-09-12T16:18:11.431 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.431 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.431 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:11.431 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.384043+0000", 2024-09-12T16:18:11.431 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3920000000000002e-06 2024-09-12T16:18:11.431 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.431 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.431 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.431 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:48.007976+0000", 2024-09-12T16:18:11.431 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.62393385300000004 2024-09-12T16:18:11.431 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.431 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.432 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:11.432 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:48.007992+0000", 2024-09-12T16:18:11.432 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5668e-05 2024-09-12T16:18:11.432 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.432 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.432 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.432 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024187+0000", 2024-09-12T16:18:11.432 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0161951629999999 2024-09-12T16:18:11.432 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.432 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.432 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.432 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024362+0000", 2024-09-12T16:18:11.432 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017500600000000001 2024-09-12T16:18:11.433 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.433 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.433 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:18:11.433 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024453+0000", 2024-09-12T16:18:11.433 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1055000000000001e-05 2024-09-12T16:18:11.433 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.433 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.433 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:18:11.433 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024963+0000", 2024-09-12T16:18:11.433 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000510087 2024-09-12T16:18:11.433 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.433 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.433 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:11.434 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.027974+0000", 2024-09-12T16:18:11.434 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030107070000000001 2024-09-12T16:18:11.434 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.434 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.434 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:11.434 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.028022+0000", 2024-09-12T16:18:11.434 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7636000000000003e-05 2024-09-12T16:18:11.434 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.434 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.434 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.434 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.028140+0000", 2024-09-12T16:18:11.434 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011869100000000001 2024-09-12T16:18:11.434 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.435 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.435 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.435 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.435 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.435 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:11.437 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:18:11.437 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:11.435+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:11.537 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:11.536+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:11.585 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:11.586 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:11.586 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:18:11.586 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:11.594 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:18:11.638 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:11.637+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:11.738 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:11.737+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:11.742 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:11.742 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:11.742 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:18:11.742 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:18:11.742 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:11.751 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:18:11.839 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:11.838+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:11.900 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:11.900 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:18:11.900 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:18:11.900 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:18:11.900 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.900 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5599 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4788224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:11.901 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:18:11.901 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 91.602305447999996, 2024-09-12T16:18:11.901 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061192059, 2024-09-12T16:18:11.901 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.901 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.901 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:11.901 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.901 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:11.901 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:11.901 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5599 2024-09-12T16:18:11.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.901 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.901 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.902 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.902 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:18:11.902 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.902 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.902 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.902 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:18:11.902 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.902 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.902 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.902 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296333+0000", 2024-09-12T16:18:11.902 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6599999999999996e-07 2024-09-12T16:18:11.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.903 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.903 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.903 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296335+0000", 2024-09-12T16:18:11.903 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5900000000000002e-06 2024-09-12T16:18:11.903 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.903 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.903 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.903 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296344+0000", 2024-09-12T16:18:11.903 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9539999999999993e-06 2024-09-12T16:18:11.903 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.903 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.903 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.903 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296350+0000", 2024-09-12T16:18:11.904 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5589999999999996e-06 2024-09-12T16:18:11.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.904 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.904 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.904 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357307+0000", 2024-09-12T16:18:11.904 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.060957573000000001 2024-09-12T16:18:11.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.904 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.904 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.904 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357401+0000", 2024-09-12T16:18:11.904 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3512999999999997e-05 2024-09-12T16:18:11.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.904 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.905 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.905 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357524+0000", 2024-09-12T16:18:11.905 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000123304 2024-09-12T16:18:11.905 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.905 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.905 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.905 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.905 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.905 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5611 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4730880~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:11.905 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:18:11.905 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 91.602243004000002, 2024-09-12T16:18:11.905 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061359348000000001, 2024-09-12T16:18:11.906 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.906 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.906 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:11.906 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.906 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:11.906 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:11.906 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5611 2024-09-12T16:18:11.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.906 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.906 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.906 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.906 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:18:11.906 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.907 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.907 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.907 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.907 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:18:11.907 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.907 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.907 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.907 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.907 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296395+0000", 2024-09-12T16:18:11.907 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4600000000000003e-07 2024-09-12T16:18:11.907 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.907 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.908 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.908 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296399+0000", 2024-09-12T16:18:11.908 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9430000000000002e-06 2024-09-12T16:18:11.908 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.908 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.908 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.908 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296411+0000", 2024-09-12T16:18:11.908 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1755e-05 2024-09-12T16:18:11.908 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.908 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.908 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.908 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296417+0000", 2024-09-12T16:18:11.909 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3790000000000003e-06 2024-09-12T16:18:11.909 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.909 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.909 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.909 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357572+0000", 2024-09-12T16:18:11.909 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061154871 2024-09-12T16:18:11.909 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.909 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.909 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.909 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357663+0000", 2024-09-12T16:18:11.909 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0389999999999993e-05 2024-09-12T16:18:11.909 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.909 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.910 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.910 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357754+0000", 2024-09-12T16:18:11.910 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1063999999999994e-05 2024-09-12T16:18:11.910 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.910 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.910 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.910 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.910 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.910 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5613 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4775936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:11.910 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:18:11.911 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 91.602201824000005, 2024-09-12T16:18:11.911 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061491777999999997, 2024-09-12T16:18:11.911 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.911 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.911 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:11.911 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.911 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:11.911 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:11.911 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5613 2024-09-12T16:18:11.911 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.911 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.911 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.911 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.911 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:18:11.912 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.912 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.912 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.912 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:18:11.912 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.912 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.912 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.912 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:18:11.912 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8899999999999999e-07 2024-09-12T16:18:11.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.913 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.913 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.913 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296439+0000", 2024-09-12T16:18:11.913 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8439999999999998e-06 2024-09-12T16:18:11.913 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.913 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.913 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.913 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296452+0000", 2024-09-12T16:18:11.913 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2639e-05 2024-09-12T16:18:11.913 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.913 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.913 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.913 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296457+0000", 2024-09-12T16:18:11.913 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5720000000000002e-06 2024-09-12T16:18:11.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.914 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.914 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357773+0000", 2024-09-12T16:18:11.914 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061315500000000002 2024-09-12T16:18:11.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.914 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.914 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357814+0000", 2024-09-12T16:18:11.914 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1448e-05 2024-09-12T16:18:11.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.914 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.914 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357927+0000", 2024-09-12T16:18:11.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000113186 2024-09-12T16:18:11.915 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.915 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.915 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.915 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5616 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4784128~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:11.915 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:18:11.915 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 91.602166761999996, 2024-09-12T16:18:11.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061725002000000001, 2024-09-12T16:18:11.915 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.916 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.916 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:11.916 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.916 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:11.916 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:11.916 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5616 2024-09-12T16:18:11.916 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.916 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.916 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.916 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.916 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:18:11.916 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.916 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.917 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.917 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.917 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:18:11.917 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.917 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.917 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.917 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.917 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:18:11.917 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5900000000000002e-07 2024-09-12T16:18:11.917 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.917 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.917 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.918 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296473+0000", 2024-09-12T16:18:11.918 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3130000000000001e-06 2024-09-12T16:18:11.918 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.918 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.918 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.918 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296481+0000", 2024-09-12T16:18:11.918 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1389999999999998e-06 2024-09-12T16:18:11.918 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.918 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.918 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.918 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296486+0000", 2024-09-12T16:18:11.918 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3310000000000003e-06 2024-09-12T16:18:11.918 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.919 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.919 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.919 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357981+0000", 2024-09-12T16:18:11.919 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061494866000000002 2024-09-12T16:18:11.919 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.919 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.919 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.919 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358082+0000", 2024-09-12T16:18:11.919 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101424 2024-09-12T16:18:11.919 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.919 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.919 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.919 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358196+0000", 2024-09-12T16:18:11.919 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011347 2024-09-12T16:18:11.920 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.920 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.920 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.920 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.920 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.920 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5626 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4739072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:11.920 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:18:11.920 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 91.602088805999998, 2024-09-12T16:18:11.920 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061802430999999998, 2024-09-12T16:18:11.920 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.920 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.920 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:11.920 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.920 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:11.921 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:11.921 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5626 2024-09-12T16:18:11.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.921 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:18:11.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:18:11.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.922 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.922 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.922 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296550+0000", 2024-09-12T16:18:11.922 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.215e-06 2024-09-12T16:18:11.922 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.922 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.922 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.922 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296555+0000", 2024-09-12T16:18:11.922 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9590000000000003e-06 2024-09-12T16:18:11.922 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.922 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.922 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.922 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296568+0000", 2024-09-12T16:18:11.923 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3338e-05 2024-09-12T16:18:11.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.923 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.923 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.923 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296576+0000", 2024-09-12T16:18:11.923 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5510000000000002e-06 2024-09-12T16:18:11.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.923 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.923 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.923 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358241+0000", 2024-09-12T16:18:11.923 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.06166576 2024-09-12T16:18:11.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.923 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.924 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.924 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358288+0000", 2024-09-12T16:18:11.924 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6097000000000003e-05 2024-09-12T16:18:11.924 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.924 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.924 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.924 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358351+0000", 2024-09-12T16:18:11.924 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3510999999999996e-05 2024-09-12T16:18:11.924 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.924 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.924 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.924 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.924 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.925 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5628 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4792320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:11.925 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:18:11.925 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 91.602046306000005, 2024-09-12T16:18:11.925 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061961161000000001, 2024-09-12T16:18:11.925 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.925 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.925 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:11.925 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.925 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:11.925 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:11.925 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5628 2024-09-12T16:18:11.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.925 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.925 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.926 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.926 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:18:11.926 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.926 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.926 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.926 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:18:11.926 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.926 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.926 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.926 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296592+0000", 2024-09-12T16:18:11.926 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2099999999999996e-07 2024-09-12T16:18:11.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.927 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.927 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.927 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296595+0000", 2024-09-12T16:18:11.927 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0429999999999999e-06 2024-09-12T16:18:11.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.927 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.927 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.927 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296603+0000", 2024-09-12T16:18:11.927 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9899999999999997e-06 2024-09-12T16:18:11.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.927 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.927 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.927 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296609+0000", 2024-09-12T16:18:11.927 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7259999999999999e-06 2024-09-12T16:18:11.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.928 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.928 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.928 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358393+0000", 2024-09-12T16:18:11.928 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061784617 2024-09-12T16:18:11.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.928 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.928 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.928 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358460+0000", 2024-09-12T16:18:11.928 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7253000000000001e-05 2024-09-12T16:18:11.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.928 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.928 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.928 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358552+0000", 2024-09-12T16:18:11.929 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1811000000000006e-05 2024-09-12T16:18:11.929 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.929 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.929 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.929 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.929 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.929 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5638 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4734976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:11.929 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:18:11.929 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 91.601573755000004, 2024-09-12T16:18:11.929 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061654460000000001, 2024-09-12T16:18:11.929 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.929 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.929 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:11.929 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.930 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:11.930 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:11.930 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5638 2024-09-12T16:18:11.930 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.930 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.930 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.930 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.930 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:18:11.930 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.930 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.930 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.930 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.930 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:18:11.931 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.931 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.931 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.931 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:18:11.931 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.23e-07 2024-09-12T16:18:11.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.931 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.931 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.931 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297068+0000", 2024-09-12T16:18:11.931 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0060000000000003e-06 2024-09-12T16:18:11.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.931 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.931 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.932 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297080+0000", 2024-09-12T16:18:11.932 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1234e-05 2024-09-12T16:18:11.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.932 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.932 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.932 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297095+0000", 2024-09-12T16:18:11.932 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5698000000000001e-05 2024-09-12T16:18:11.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.932 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.932 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.932 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358582+0000", 2024-09-12T16:18:11.932 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061486274 2024-09-12T16:18:11.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.932 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.933 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.933 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358637+0000", 2024-09-12T16:18:11.933 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5439999999999998e-05 2024-09-12T16:18:11.933 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.933 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.933 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.933 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358718+0000", 2024-09-12T16:18:11.933 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0984999999999998e-05 2024-09-12T16:18:11.933 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.933 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.933 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.933 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.933 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.934 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5640 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4780032~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:11.934 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:18:11.934 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 91.601492035000007, 2024-09-12T16:18:11.934 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061746620000000002, 2024-09-12T16:18:11.934 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.934 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.934 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:11.934 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.934 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:11.934 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:11.934 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5640 2024-09-12T16:18:11.934 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.934 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.934 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.935 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.935 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:18:11.935 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.935 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.935 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.935 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:18:11.935 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.935 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.935 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.935 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297146+0000", 2024-09-12T16:18:11.936 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3600000000000003e-07 2024-09-12T16:18:11.936 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.936 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.936 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.936 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297150+0000", 2024-09-12T16:18:11.936 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8430000000000003e-06 2024-09-12T16:18:11.936 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.936 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.936 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.936 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297160+0000", 2024-09-12T16:18:11.936 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7229999999999999e-06 2024-09-12T16:18:11.937 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.937 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.937 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.937 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297167+0000", 2024-09-12T16:18:11.937 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0180000000000004e-06 2024-09-12T16:18:11.937 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.937 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.937 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.937 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358750+0000", 2024-09-12T16:18:11.937 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061583104 2024-09-12T16:18:11.937 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.938 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.938 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.938 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358804+0000", 2024-09-12T16:18:11.938 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4277000000000002e-05 2024-09-12T16:18:11.938 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.938 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.938 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.938 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358892+0000", 2024-09-12T16:18:11.938 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7918999999999996e-05 2024-09-12T16:18:11.938 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.938 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.938 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.939 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.939 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.939 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5642 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4788224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:11.939 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:18:11.939 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 91.601447691000004, 2024-09-12T16:18:11.939 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061860409999999998, 2024-09-12T16:18:11.939 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.939 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.939 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:11.939 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.939 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:11.939 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:11.939 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5642 2024-09-12T16:18:11.939 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.940 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.940 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.940 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.940 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:18:11.940 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.940 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.940 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.940 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.940 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:18:11.940 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.940 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.940 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.940 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.941 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:18:11.941 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7999999999999995e-07 2024-09-12T16:18:11.941 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.941 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.941 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.941 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297193+0000", 2024-09-12T16:18:11.941 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8310000000000001e-06 2024-09-12T16:18:11.941 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.941 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.941 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.941 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297204+0000", 2024-09-12T16:18:11.941 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0832999999999999e-05 2024-09-12T16:18:11.941 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.942 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.942 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.942 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297210+0000", 2024-09-12T16:18:11.942 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1770000000000003e-06 2024-09-12T16:18:11.942 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.942 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.942 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.942 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358928+0000", 2024-09-12T16:18:11.942 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061717826000000003 2024-09-12T16:18:11.942 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.942 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.942 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.942 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358977+0000", 2024-09-12T16:18:11.942 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9514000000000001e-05 2024-09-12T16:18:11.943 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.943 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.943 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.943 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359050+0000", 2024-09-12T16:18:11.943 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2649000000000002e-05 2024-09-12T16:18:11.943 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.943 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.943 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.943 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.943 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.943 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5646 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4743168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:11.943 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:18:11.943 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 91.601267750000005, 2024-09-12T16:18:11.944 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061822122, 2024-09-12T16:18:11.944 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.944 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.944 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:11.944 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.944 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:11.944 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:11.944 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5646 2024-09-12T16:18:11.944 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.944 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.944 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.944 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.944 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:18:11.945 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.945 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.945 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.945 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.945 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:18:11.945 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.945 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.945 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.945 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.945 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:18:11.945 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3200000000000004e-07 2024-09-12T16:18:11.946 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.946 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.946 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.946 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297374+0000", 2024-09-12T16:18:11.946 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8240000000000001e-06 2024-09-12T16:18:11.946 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.946 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.946 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.946 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297384+0000", 2024-09-12T16:18:11.946 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5710000000000004e-06 2024-09-12T16:18:11.946 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.946 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.947 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.947 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297390+0000", 2024-09-12T16:18:11.947 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5130000000000002e-06 2024-09-12T16:18:11.947 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.947 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.947 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.947 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359080+0000", 2024-09-12T16:18:11.947 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061689569999999999 2024-09-12T16:18:11.947 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.947 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.947 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.947 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359134+0000", 2024-09-12T16:18:11.948 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3838999999999997e-05 2024-09-12T16:18:11.948 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.948 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.948 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.948 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359192+0000", 2024-09-12T16:18:11.948 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8072999999999998e-05 2024-09-12T16:18:11.948 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.948 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.948 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.948 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.948 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.948 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5647 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4751360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:11.948 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:18:11.949 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 91.601231064999993, 2024-09-12T16:18:11.949 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061927569000000002, 2024-09-12T16:18:11.949 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.949 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.949 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:11.949 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.949 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:11.949 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:11.949 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5647 2024-09-12T16:18:11.949 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.949 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.949 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.949 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.950 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:18:11.950 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.950 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.950 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.950 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.950 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:18:11.950 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.950 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.950 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.950 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.950 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297407+0000", 2024-09-12T16:18:11.950 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.46e-07 2024-09-12T16:18:11.950 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.951 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.951 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.951 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297409+0000", 2024-09-12T16:18:11.951 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.469e-06 2024-09-12T16:18:11.951 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.951 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.951 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.951 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297415+0000", 2024-09-12T16:18:11.951 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9259999999999997e-06 2024-09-12T16:18:11.951 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.951 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.951 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.951 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297419+0000", 2024-09-12T16:18:11.951 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3840000000000001e-06 2024-09-12T16:18:11.952 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.952 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.952 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.952 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359224+0000", 2024-09-12T16:18:11.952 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061805367999999999 2024-09-12T16:18:11.952 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.952 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.952 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.952 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359275+0000", 2024-09-12T16:18:11.952 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1338000000000002e-05 2024-09-12T16:18:11.952 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.952 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.952 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.953 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359334+0000", 2024-09-12T16:18:11.953 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8638000000000003e-05 2024-09-12T16:18:11.953 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.953 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.953 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.953 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.953 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.953 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5649 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4796416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:11.953 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:18:11.953 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 91.601176206000005, 2024-09-12T16:18:11.953 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.062018578999999997, 2024-09-12T16:18:11.953 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.953 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.954 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:11.954 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.954 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:11.954 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:11.954 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5649 2024-09-12T16:18:11.954 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.954 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.954 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.954 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.954 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:18:11.954 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.954 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.954 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.955 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.955 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:18:11.955 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.955 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.955 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.955 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.955 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297462+0000", 2024-09-12T16:18:11.955 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2399999999999998e-07 2024-09-12T16:18:11.955 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.955 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.955 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.955 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297465+0000", 2024-09-12T16:18:11.955 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.371e-06 2024-09-12T16:18:11.955 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.956 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.956 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.956 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297473+0000", 2024-09-12T16:18:11.956 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4699999999999996e-06 2024-09-12T16:18:11.956 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.956 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.956 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.956 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297478+0000", 2024-09-12T16:18:11.956 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2780000000000001e-06 2024-09-12T16:18:11.956 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.956 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.956 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.956 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359368+0000", 2024-09-12T16:18:11.957 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061889758000000003 2024-09-12T16:18:11.957 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.957 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.957 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.957 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359420+0000", 2024-09-12T16:18:11.957 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2574999999999997e-05 2024-09-12T16:18:11.957 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.957 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.957 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.957 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359480+0000", 2024-09-12T16:18:11.957 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9503000000000003e-05 2024-09-12T16:18:11.957 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.957 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.957 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.958 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.958 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.958 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5674 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4739072~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:11.958 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:18:11.958 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 91.600772438000007, 2024-09-12T16:18:11.958 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061762989999999997, 2024-09-12T16:18:11.958 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.958 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.958 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:11.958 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.958 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:11.958 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:11.958 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5674 2024-09-12T16:18:11.958 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.959 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.959 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.959 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.959 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:18:11.959 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.959 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.959 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.959 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.959 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:18:11.959 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.959 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.959 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.960 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.960 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297866+0000", 2024-09-12T16:18:11.960 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1900000000000001e-07 2024-09-12T16:18:11.960 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.960 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.960 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.960 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297870+0000", 2024-09-12T16:18:11.960 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3560000000000003e-06 2024-09-12T16:18:11.960 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.960 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.960 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.960 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297888+0000", 2024-09-12T16:18:11.960 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8088999999999999e-05 2024-09-12T16:18:11.961 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.961 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.961 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.961 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297904+0000", 2024-09-12T16:18:11.961 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5971e-05 2024-09-12T16:18:11.961 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.961 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.961 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.961 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359510+0000", 2024-09-12T16:18:11.961 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061605634999999999 2024-09-12T16:18:11.961 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.961 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.961 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.962 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359554+0000", 2024-09-12T16:18:11.962 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4024999999999999e-05 2024-09-12T16:18:11.962 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.962 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.962 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.962 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359628+0000", 2024-09-12T16:18:11.962 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4095000000000001e-05 2024-09-12T16:18:11.962 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.962 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.962 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.962 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.962 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.962 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5676 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4792320~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:11.963 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:18:11.963 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 91.600571357999996, 2024-09-12T16:18:11.963 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061720143999999998, 2024-09-12T16:18:11.963 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.963 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.963 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:11.963 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.963 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:11.963 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:11.963 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5676 2024-09-12T16:18:11.963 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.963 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.963 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.963 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.964 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:18:11.964 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.964 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.964 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.964 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.964 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:18:11.964 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.964 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.964 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.964 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.964 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298067+0000", 2024-09-12T16:18:11.964 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8199999999999999e-07 2024-09-12T16:18:11.964 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.965 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.965 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.965 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298070+0000", 2024-09-12T16:18:11.965 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.743e-06 2024-09-12T16:18:11.965 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.965 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.965 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.965 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298080+0000", 2024-09-12T16:18:11.965 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4059999999999994e-06 2024-09-12T16:18:11.965 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.965 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.965 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.965 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298088+0000", 2024-09-12T16:18:11.966 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0779999999999996e-06 2024-09-12T16:18:11.966 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.966 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.966 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.966 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359659+0000", 2024-09-12T16:18:11.966 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061570688999999998 2024-09-12T16:18:11.966 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.966 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.966 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.966 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359713+0000", 2024-09-12T16:18:11.966 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3939e-05 2024-09-12T16:18:11.966 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.966 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.966 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.966 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359786+0000", 2024-09-12T16:18:11.967 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3607000000000002e-05 2024-09-12T16:18:11.967 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.967 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.967 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.967 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.967 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.967 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5684 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4747264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:11.967 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:18:11.967 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 91.600104066, 2024-09-12T16:18:11.967 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061394799, 2024-09-12T16:18:11.967 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.967 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.967 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:11.968 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.968 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:11.968 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:11.968 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5684 2024-09-12T16:18:11.968 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.968 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.968 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.968 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.968 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:18:11.968 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.968 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.968 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.968 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.968 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:18:11.969 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.969 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.969 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.969 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.969 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298534+0000", 2024-09-12T16:18:11.969 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4399999999999999e-07 2024-09-12T16:18:11.969 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.969 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.969 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.969 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298539+0000", 2024-09-12T16:18:11.969 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5360000000000003e-06 2024-09-12T16:18:11.969 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.969 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.970 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.970 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298550+0000", 2024-09-12T16:18:11.970 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1499e-05 2024-09-12T16:18:11.970 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.970 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.970 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.970 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298558+0000", 2024-09-12T16:18:11.970 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3000000000000004e-06 2024-09-12T16:18:11.970 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.970 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.970 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.970 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359815+0000", 2024-09-12T16:18:11.971 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061257952999999997 2024-09-12T16:18:11.971 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.971 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.971 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.971 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359868+0000", 2024-09-12T16:18:11.971 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2317000000000001e-05 2024-09-12T16:18:11.971 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.971 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.971 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.971 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359928+0000", 2024-09-12T16:18:11.971 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0350000000000003e-05 2024-09-12T16:18:11.971 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.971 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.972 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.972 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.972 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.972 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5686 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4755456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:11.972 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:18:11.972 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 91.599936642000003, 2024-09-12T16:18:11.972 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061355082999999998, 2024-09-12T16:18:11.972 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.972 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.972 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:11.972 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.972 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:11.973 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:11.973 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5686 2024-09-12T16:18:11.973 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.973 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.973 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.973 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.973 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:18:11.973 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.973 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.973 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.973 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.973 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:18:11.973 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.973 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.974 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.974 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.974 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298702+0000", 2024-09-12T16:18:11.974 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2399999999999997e-07 2024-09-12T16:18:11.974 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.974 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.974 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.974 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298706+0000", 2024-09-12T16:18:11.974 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5700000000000003e-06 2024-09-12T16:18:11.974 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.974 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.974 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.974 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298718+0000", 2024-09-12T16:18:11.974 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1457999999999999e-05 2024-09-12T16:18:11.975 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.975 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.975 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.975 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298732+0000", 2024-09-12T16:18:11.975 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.452e-05 2024-09-12T16:18:11.975 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.975 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.975 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.975 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359956+0000", 2024-09-12T16:18:11.975 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061223626000000003 2024-09-12T16:18:11.975 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.975 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.975 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.975 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360000+0000", 2024-09-12T16:18:11.976 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3922999999999999e-05 2024-09-12T16:18:11.976 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.976 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.976 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.976 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360056+0000", 2024-09-12T16:18:11.976 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6162000000000002e-05 2024-09-12T16:18:11.976 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.976 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.976 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.976 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.976 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.976 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5688 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4800512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:11.976 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:18:11.977 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 91.599713589000004, 2024-09-12T16:18:11.977 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061270514999999998, 2024-09-12T16:18:11.977 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.977 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.977 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:11.977 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.977 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:11.977 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:11.977 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5688 2024-09-12T16:18:11.977 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.977 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.977 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.978 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.978 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:18:11.978 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.978 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.978 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.978 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.978 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:18:11.978 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.978 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.978 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.978 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.978 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298925+0000", 2024-09-12T16:18:11.979 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4e-07 2024-09-12T16:18:11.979 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.979 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.979 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.979 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298929+0000", 2024-09-12T16:18:11.979 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9890000000000003e-06 2024-09-12T16:18:11.979 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.979 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.979 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.979 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298936+0000", 2024-09-12T16:18:11.979 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.52e-06 2024-09-12T16:18:11.979 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.979 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.980 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.980 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298941+0000", 2024-09-12T16:18:11.980 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4800000000000003e-06 2024-09-12T16:18:11.980 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.980 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.980 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.980 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360087+0000", 2024-09-12T16:18:11.980 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061146143 2024-09-12T16:18:11.980 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.980 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.980 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.980 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360137+0000", 2024-09-12T16:18:11.980 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0584000000000002e-05 2024-09-12T16:18:11.980 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.981 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.981 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.981 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360194+0000", 2024-09-12T16:18:11.981 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6858999999999999e-05 2024-09-12T16:18:11.981 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.981 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.981 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.981 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.981 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.981 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5693 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4751360~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:11.981 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:18:11.981 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 91.599291952000002, 2024-09-12T16:18:11.981 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061139444000000001, 2024-09-12T16:18:11.981 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.982 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.982 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:11.982 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.982 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:11.982 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:11.982 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5693 2024-09-12T16:18:11.982 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.982 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.982 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.982 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.982 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:18:11.982 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.982 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.983 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.983 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.983 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:18:11.983 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.983 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.983 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.983 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299346+0000", 2024-09-12T16:18:11.983 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2300000000000001e-07 2024-09-12T16:18:11.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.983 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.983 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.983 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299349+0000", 2024-09-12T16:18:11.984 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5270000000000001e-06 2024-09-12T16:18:11.984 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.984 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.984 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.984 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299358+0000", 2024-09-12T16:18:11.984 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7030000000000001e-06 2024-09-12T16:18:11.984 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.984 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.984 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.984 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299364+0000", 2024-09-12T16:18:11.984 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7239999999999997e-06 2024-09-12T16:18:11.984 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.985 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.985 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.985 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360369+0000", 2024-09-12T16:18:11.985 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061004713000000002 2024-09-12T16:18:11.985 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.985 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.985 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.985 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360415+0000", 2024-09-12T16:18:11.985 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5926e-05 2024-09-12T16:18:11.985 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.985 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.985 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.985 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360485+0000", 2024-09-12T16:18:11.985 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0327999999999995e-05 2024-09-12T16:18:11.986 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.986 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.986 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.986 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.986 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.986 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5694 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4796416~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:11.986 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:18:11.986 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 91.599262922999998, 2024-09-12T16:18:11.986 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061258034000000003, 2024-09-12T16:18:11.986 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.986 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.986 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:11.986 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.987 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:11.987 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:11.987 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5694 2024-09-12T16:18:11.987 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.987 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.987 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.987 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.987 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:18:11.987 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.987 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.987 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.987 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.987 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:18:11.987 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.987 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.988 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.988 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.988 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301884+0000", 2024-09-12T16:18:11.988 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025090379999999999 2024-09-12T16:18:11.988 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.988 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.988 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.988 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301889+0000", 2024-09-12T16:18:11.988 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5879999999999997e-06 2024-09-12T16:18:11.988 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.988 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.988 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.988 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301901+0000", 2024-09-12T16:18:11.989 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1466e-05 2024-09-12T16:18:11.989 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.989 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.989 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.989 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301908+0000", 2024-09-12T16:18:11.989 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1999999999999997e-06 2024-09-12T16:18:11.989 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.989 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.989 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.989 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360513+0000", 2024-09-12T16:18:11.989 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.058605023999999999 2024-09-12T16:18:11.989 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.989 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.989 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.990 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360562+0000", 2024-09-12T16:18:11.990 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9546000000000003e-05 2024-09-12T16:18:11.990 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.990 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.990 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.990 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360633+0000", 2024-09-12T16:18:11.990 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0172000000000005e-05 2024-09-12T16:18:11.990 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.990 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.990 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.990 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.990 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.990 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5759 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4767744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:11.990 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:18:11.990 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 91.596469389000006, 2024-09-12T16:18:11.991 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061058604000000002, 2024-09-12T16:18:11.991 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:11.991 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:11.991 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:11.991 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:11.991 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:11.991 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:11.991 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5759 2024-09-12T16:18:11.991 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.991 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:11.991 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.991 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:11.992 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:18:11.992 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.992 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.992 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.992 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:11.992 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:18:11.992 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:11.992 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.992 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.992 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:11.992 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302548+0000", 2024-09-12T16:18:11.992 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00038011000000000002 2024-09-12T16:18:11.993 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.993 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.993 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:11.993 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302553+0000", 2024-09-12T16:18:11.993 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1830000000000002e-06 2024-09-12T16:18:11.993 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.993 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.993 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:11.993 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302564+0000", 2024-09-12T16:18:11.993 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1011e-05 2024-09-12T16:18:11.993 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.993 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.993 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:11.993 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302572+0000", 2024-09-12T16:18:11.994 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9009999999999994e-06 2024-09-12T16:18:11.994 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.994 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.994 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:11.994 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363102+0000", 2024-09-12T16:18:11.994 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.060529782999999997 2024-09-12T16:18:11.994 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.994 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.994 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:11.994 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363149+0000", 2024-09-12T16:18:11.994 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7321000000000003e-05 2024-09-12T16:18:11.994 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:11.994 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:11.994 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:11.994 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363227+0000", 2024-09-12T16:18:11.995 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7294999999999998e-05 2024-09-12T16:18:11.995 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.995 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.995 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.995 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:11.995 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:11.995 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:11.996 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:18:11.997 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:11.995+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:12.097 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:12.097+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:12.103 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T16:18:12.111 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:12.112 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:12.112 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:18:12.112 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:12.121 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:18:12.198 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:12.197+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:12.235 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:12.235 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:12.236 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:18:12.236 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:18:12.236 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:12.245 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:18:12.250 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:18:12.250 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:18:12.268 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:18:12.268 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:18:12.284 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:18:12.285 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:18:12.301 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:18:12.301 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:18:12.318 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:18:12.318 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:18:12.330 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:12.329+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:12.336 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:18:12.336 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:18:12.395 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:12.395 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:12.400 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:12.399+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:12.403 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:18:12.501 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:12.500+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:12.510 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:12.510 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:12.519 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:18:12.603 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:12.602+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:12.666 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:12.666 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:12.674 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:18:12.702 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:12.701+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:12.802 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:12.801+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:12.822 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:12.822 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:12.830 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:18:12.903 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:12.902+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:12.978 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:12.979 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:12.987 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:18:13.004 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:13.003+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:13.104 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T16:18:13.105 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:13.104+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:13.117 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:13.117 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:13.129 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:18:13.206 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:13.205+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:13.238 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 3] out_osds: [5] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-12T16:18:13.238 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T16:18:13.238 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-12T16:18:13.239 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T16:18:13.280 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:13.280 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:13.289 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:18:13.330 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:13.329+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:13.407 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:13.406+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:13.439 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:13.439 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:13.448 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:18:13.508 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:13.507+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:13.540 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:18:13.541 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:13.541 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 125, 2024-09-12T16:18:13.541 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "66dcb8ed-8de5-4784-8071-fd6b3bf3b78f", 2024-09-12T16:18:13.541 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2024-09-12T16:15:28.208893+0000", 2024-09-12T16:18:13.541 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2024-09-12T16:18:13.005849+0000", 2024-09-12T16:18:13.541 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2024-09-12T16:17:03.223056+0000", 2024-09-12T16:18:13.541 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2024-09-12T16:17:47.369306+0000", 2024-09-12T16:18:13.541 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T16:18:13.541 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5806080, 2024-09-12T16:18:13.541 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2024-09-12T16:18:13.541 INFO:teuthology.orchestra.run.smithi017.stdout: "nodeep-scrub", 2024-09-12T16:18:13.542 INFO:teuthology.orchestra.run.smithi017.stdout: "noscrub", 2024-09-12T16:18:13.542 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2024-09-12T16:18:13.542 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2024-09-12T16:18:13.542 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2024-09-12T16:18:13.542 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2024-09-12T16:18:13.542 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-12T16:18:13.542 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 5, 2024-09-12T16:18:13.542 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T16:18:13.542 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T16:18:13.542 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T16:18:13.542 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2024-09-12T16:18:13.542 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 3, 2024-09-12T16:18:13.542 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 6, 2024-09-12T16:18:13.543 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2024-09-12T16:18:13.543 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "jewel", 2024-09-12T16:18:13.543 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "squid", 2024-09-12T16:18:13.543 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2024-09-12T16:18:13.543 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2024-09-12T16:18:13.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.543 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2024-09-12T16:18:13.543 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2024-09-12T16:18:13.543 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2024-09-12T16:15:40.677216+0000", 2024-09-12T16:18:13.543 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-12T16:18:13.543 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2024-09-12T16:18:13.543 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2024-09-12T16:18:13.544 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2024-09-12T16:18:13.544 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2024-09-12T16:18:13.544 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2024-09-12T16:18:13.544 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2024-09-12T16:18:13.544 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2024-09-12T16:18:13.544 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T16:18:13.544 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T16:18:13.544 INFO:teuthology.orchestra.run.smithi017.stdout: "is_stretch_pool": false, 2024-09-12T16:18:13.544 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2024-09-12T16:18:13.544 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2024-09-12T16:18:13.544 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2024-09-12T16:18:13.544 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2024-09-12T16:18:13.544 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2024-09-12T16:18:13.545 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2024-09-12T16:18:13.545 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2024-09-12T16:18:13.545 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2024-09-12T16:18:13.545 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2024-09-12T16:18:13.545 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2024-09-12T16:18:13.545 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2024-09-12T16:18:13.545 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2024-09-12T16:18:13.545 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2024-09-12T16:18:13.545 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2024-09-12T16:18:13.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.545 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "15", 2024-09-12T16:18:13.545 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2024-09-12T16:18:13.545 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T16:18:13.546 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T16:18:13.546 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2024-09-12T16:18:13.546 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2024-09-12T16:18:13.546 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2024-09-12T16:18:13.546 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2024-09-12T16:18:13.546 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2024-09-12T16:18:13.546 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2024-09-12T16:18:13.546 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2024-09-12T16:18:13.546 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2024-09-12T16:18:13.546 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2024-09-12T16:18:13.546 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2024-09-12T16:18:13.546 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2024-09-12T16:18:13.546 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2024-09-12T16:18:13.547 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2024-09-12T16:18:13.547 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2024-09-12T16:18:13.547 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2024-09-12T16:18:13.547 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T16:18:13.547 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T16:18:13.547 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T16:18:13.547 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2024-09-12T16:18:13.547 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2024-09-12T16:18:13.547 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2024-09-12T16:18:13.547 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2024-09-12T16:18:13.547 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2024-09-12T16:18:13.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.547 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2024-09-12T16:18:13.547 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2024-09-12T16:18:13.548 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2024-09-12T16:18:13.548 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2024-09-12T16:18:13.548 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2024-09-12T16:18:13.548 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T16:18:13.548 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2024-09-12T16:18:13.548 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2024-09-12T16:18:13.548 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2024-09-12T16:18:13.548 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2024-09-12T16:18:13.548 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2024-09-12T16:18:13.548 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2024-09-12T16:18:13.548 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2024-09-12T16:18:13.548 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2024-09-12T16:18:13.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.549 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2024-09-12T16:18:13.549 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2024-09-12T16:18:13.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.549 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2024-09-12T16:18:13.550 INFO:teuthology.orchestra.run.smithi017.stdout: "score_type": "Fair distribution", 2024-09-12T16:18:13.550 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 6.059999942779541, 2024-09-12T16:18:13.550 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 6.059999942779541, 2024-09-12T16:18:13.550 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.33000001311302185, 2024-09-12T16:18:13.550 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2024-09-12T16:18:13.550 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2024-09-12T16:18:13.550 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 0.84821069240570068, 2024-09-12T16:18:13.550 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 0.85000002384185791, 2024-09-12T16:18:13.550 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 0.85000002384185791 2024-09-12T16:18:13.550 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:13.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.551 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2024-09-12T16:18:13.551 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2024-09-12T16:18:13.551 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2024-09-12T16:15:45.306180+0000", 2024-09-12T16:18:13.551 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 8193, 2024-09-12T16:18:13.551 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T16:18:13.551 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2024-09-12T16:18:13.551 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2024-09-12T16:18:13.551 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2024-09-12T16:18:13.551 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2024-09-12T16:18:13.551 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2024-09-12T16:18:13.551 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2024-09-12T16:18:13.551 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T16:18:13.551 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T16:18:13.552 INFO:teuthology.orchestra.run.smithi017.stdout: "is_stretch_pool": false, 2024-09-12T16:18:13.552 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2024-09-12T16:18:13.552 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2024-09-12T16:18:13.552 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2024-09-12T16:18:13.552 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2024-09-12T16:18:13.552 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2024-09-12T16:18:13.552 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2024-09-12T16:18:13.552 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2024-09-12T16:18:13.552 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2024-09-12T16:18:13.552 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2024-09-12T16:18:13.552 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2024-09-12T16:18:13.552 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2024-09-12T16:18:13.553 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2024-09-12T16:18:13.553 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2024-09-12T16:18:13.553 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2024-09-12T16:18:13.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.553 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "19", 2024-09-12T16:18:13.553 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2024-09-12T16:18:13.553 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T16:18:13.553 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T16:18:13.553 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2024-09-12T16:18:13.553 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2024-09-12T16:18:13.553 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 2, 2024-09-12T16:18:13.553 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 19, 2024-09-12T16:18:13.553 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2024-09-12T16:18:13.553 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2024-09-12T16:18:13.554 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2024-09-12T16:18:13.554 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2024-09-12T16:18:13.554 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2024-09-12T16:18:13.554 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2024-09-12T16:18:13.554 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2024-09-12T16:18:13.554 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2024-09-12T16:18:13.554 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2024-09-12T16:18:13.554 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2024-09-12T16:18:13.554 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2024-09-12T16:18:13.554 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T16:18:13.554 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T16:18:13.554 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T16:18:13.554 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2024-09-12T16:18:13.555 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2024-09-12T16:18:13.555 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2024-09-12T16:18:13.555 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2024-09-12T16:18:13.555 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2024-09-12T16:18:13.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.555 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2024-09-12T16:18:13.555 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2024-09-12T16:18:13.555 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2024-09-12T16:18:13.555 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2024-09-12T16:18:13.555 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2024-09-12T16:18:13.555 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T16:18:13.555 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2024-09-12T16:18:13.556 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2024-09-12T16:18:13.556 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2024-09-12T16:18:13.556 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2024-09-12T16:18:13.556 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2024-09-12T16:18:13.556 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2024-09-12T16:18:13.556 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2024-09-12T16:18:13.556 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2024-09-12T16:18:13.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.556 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2024-09-12T16:18:13.556 INFO:teuthology.orchestra.run.smithi017.stdout: "score_type": "Fair distribution", 2024-09-12T16:18:13.556 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 2.2699999809265137, 2024-09-12T16:18:13.556 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 2.2699999809265137, 2024-09-12T16:18:13.556 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.82999998331069946, 2024-09-12T16:18:13.556 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.8799999952316284, 2024-09-12T16:18:13.557 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.8799999952316284, 2024-09-12T16:18:13.557 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 0.84821069240570068, 2024-09-12T16:18:13.557 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 0.85000002384185791, 2024-09-12T16:18:13.557 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 0.85000002384185791 2024-09-12T16:18:13.557 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:13.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.557 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 3, 2024-09-12T16:18:13.557 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "pool_client.0", 2024-09-12T16:18:13.557 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2024-09-12T16:15:55.082975+0000", 2024-09-12T16:18:13.557 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 8193, 2024-09-12T16:18:13.557 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T16:18:13.557 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2024-09-12T16:18:13.557 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2024-09-12T16:18:13.558 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2024-09-12T16:18:13.558 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2024-09-12T16:18:13.558 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2024-09-12T16:18:13.558 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2024-09-12T16:18:13.558 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T16:18:13.558 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T16:18:13.558 INFO:teuthology.orchestra.run.smithi017.stdout: "is_stretch_pool": false, 2024-09-12T16:18:13.558 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2024-09-12T16:18:13.558 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2024-09-12T16:18:13.558 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2024-09-12T16:18:13.558 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2024-09-12T16:18:13.558 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2024-09-12T16:18:13.558 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2024-09-12T16:18:13.558 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2024-09-12T16:18:13.559 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2024-09-12T16:18:13.559 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2024-09-12T16:18:13.559 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2024-09-12T16:18:13.559 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2024-09-12T16:18:13.559 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2024-09-12T16:18:13.559 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2024-09-12T16:18:13.559 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2024-09-12T16:18:13.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.559 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "125", 2024-09-12T16:18:13.559 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2024-09-12T16:18:13.559 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T16:18:13.559 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T16:18:13.559 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2024-09-12T16:18:13.559 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2024-09-12T16:18:13.560 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 43, 2024-09-12T16:18:13.560 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 125, 2024-09-12T16:18:13.560 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2024-09-12T16:18:13.560 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2024-09-12T16:18:13.560 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2024-09-12T16:18:13.560 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2024-09-12T16:18:13.560 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2024-09-12T16:18:13.560 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2024-09-12T16:18:13.560 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2024-09-12T16:18:13.560 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2024-09-12T16:18:13.560 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2024-09-12T16:18:13.560 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2024-09-12T16:18:13.560 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2024-09-12T16:18:13.560 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T16:18:13.561 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T16:18:13.561 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T16:18:13.561 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2024-09-12T16:18:13.561 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2024-09-12T16:18:13.561 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2024-09-12T16:18:13.561 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2024-09-12T16:18:13.561 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2024-09-12T16:18:13.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.561 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2024-09-12T16:18:13.561 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2024-09-12T16:18:13.561 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2024-09-12T16:18:13.561 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2024-09-12T16:18:13.561 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2024-09-12T16:18:13.561 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T16:18:13.562 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2024-09-12T16:18:13.562 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2024-09-12T16:18:13.562 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2024-09-12T16:18:13.562 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2024-09-12T16:18:13.562 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2024-09-12T16:18:13.562 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2024-09-12T16:18:13.562 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2024-09-12T16:18:13.562 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2024-09-12T16:18:13.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.562 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2024-09-12T16:18:13.562 INFO:teuthology.orchestra.run.smithi017.stdout: "score_type": "Fair distribution", 2024-09-12T16:18:13.562 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.5099999904632568, 2024-09-12T16:18:13.562 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.5099999904632568, 2024-09-12T16:18:13.563 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.82999998331069946, 2024-09-12T16:18:13.563 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.25, 2024-09-12T16:18:13.563 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.25, 2024-09-12T16:18:13.563 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 0.84821069240570068, 2024-09-12T16:18:13.563 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 0.85000002384185791, 2024-09-12T16:18:13.563 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 0.85000002384185791 2024-09-12T16:18:13.563 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:13.563 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:13.563 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-12T16:18:13.563 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2024-09-12T16:18:13.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.563 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2024-09-12T16:18:13.563 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "aabea24b-3f1f-4555-80c3-5caecf2e2001", 2024-09-12T16:18:13.563 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-12T16:18:13.563 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-12T16:18:13.564 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-12T16:18:13.564 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-12T16:18:13.564 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-12T16:18:13.564 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-12T16:18:13.564 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 11, 2024-09-12T16:18:13.564 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 106, 2024-09-12T16:18:13.564 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-12T16:18:13.564 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-12T16:18:13.565 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-12T16:18:13.565 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:13.565 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.565 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:13.565 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2024-09-12T16:18:13.565 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1385915755 2024-09-12T16:18:13.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.565 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.565 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:13.565 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2024-09-12T16:18:13.565 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1385915755 2024-09-12T16:18:13.565 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:13.565 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:13.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.566 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-12T16:18:13.566 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:13.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.566 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:13.566 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2024-09-12T16:18:13.566 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1385915755 2024-09-12T16:18:13.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.566 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:13.566 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2024-09-12T16:18:13.566 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1385915755 2024-09-12T16:18:13.566 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:13.566 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:13.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.566 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-12T16:18:13.567 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:13.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.567 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:13.567 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2024-09-12T16:18:13.567 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1385915755 2024-09-12T16:18:13.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.567 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:13.567 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2024-09-12T16:18:13.567 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1385915755 2024-09-12T16:18:13.567 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:13.567 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:13.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.567 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-12T16:18:13.567 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:13.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.568 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:13.568 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2024-09-12T16:18:13.568 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1385915755 2024-09-12T16:18:13.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.568 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:13.568 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2024-09-12T16:18:13.568 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1385915755 2024-09-12T16:18:13.568 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:13.568 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:13.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.568 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1385915755", 2024-09-12T16:18:13.568 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1385915755", 2024-09-12T16:18:13.569 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1385915755", 2024-09-12T16:18:13.569 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1385915755", 2024-09-12T16:18:13.569 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-12T16:18:13.569 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-12T16:18:13.569 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-12T16:18:13.569 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:13.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.569 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2024-09-12T16:18:13.569 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "7a17ca3b-8e49-4d92-a633-45d3e4a45b4e", 2024-09-12T16:18:13.569 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-12T16:18:13.569 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-12T16:18:13.569 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-12T16:18:13.569 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-12T16:18:13.570 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-12T16:18:13.570 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-12T16:18:13.570 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 11, 2024-09-12T16:18:13.570 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 106, 2024-09-12T16:18:13.570 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-12T16:18:13.570 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-12T16:18:13.570 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-12T16:18:13.570 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:13.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.570 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:13.570 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2024-09-12T16:18:13.570 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3906173234 2024-09-12T16:18:13.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.570 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:13.571 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2024-09-12T16:18:13.571 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3906173234 2024-09-12T16:18:13.571 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:13.571 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:13.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.571 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-12T16:18:13.571 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:13.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.571 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:13.571 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2024-09-12T16:18:13.571 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3906173234 2024-09-12T16:18:13.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.571 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:13.571 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2024-09-12T16:18:13.572 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3906173234 2024-09-12T16:18:13.572 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:13.572 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:13.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.572 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-12T16:18:13.572 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:13.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.572 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:13.572 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2024-09-12T16:18:13.572 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3906173234 2024-09-12T16:18:13.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.572 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:13.573 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2024-09-12T16:18:13.573 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3906173234 2024-09-12T16:18:13.573 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:13.573 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:13.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.573 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-12T16:18:13.573 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:13.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.573 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:13.573 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2024-09-12T16:18:13.573 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3906173234 2024-09-12T16:18:13.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.573 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:13.573 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2024-09-12T16:18:13.574 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3906173234 2024-09-12T16:18:13.574 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:13.574 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:13.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.574 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/3906173234", 2024-09-12T16:18:13.574 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/3906173234", 2024-09-12T16:18:13.574 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/3906173234", 2024-09-12T16:18:13.574 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/3906173234", 2024-09-12T16:18:13.574 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-12T16:18:13.574 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-12T16:18:13.574 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-12T16:18:13.574 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:13.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.575 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2024-09-12T16:18:13.575 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "dae09a32-24c6-464c-bee8-04ef2c42f7e4", 2024-09-12T16:18:13.575 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-12T16:18:13.575 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-12T16:18:13.575 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-12T16:18:13.575 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-12T16:18:13.575 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-12T16:18:13.575 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-12T16:18:13.575 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 11, 2024-09-12T16:18:13.575 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 106, 2024-09-12T16:18:13.575 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-12T16:18:13.575 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-12T16:18:13.575 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-12T16:18:13.576 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:13.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.576 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:13.576 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2024-09-12T16:18:13.576 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1974346628 2024-09-12T16:18:13.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.576 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:13.576 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2024-09-12T16:18:13.576 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1974346628 2024-09-12T16:18:13.576 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:13.576 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:13.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.577 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-12T16:18:13.577 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:13.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.577 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:13.577 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2024-09-12T16:18:13.577 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1974346628 2024-09-12T16:18:13.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.577 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:13.577 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2024-09-12T16:18:13.577 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1974346628 2024-09-12T16:18:13.577 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:13.577 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:13.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.578 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-12T16:18:13.578 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:13.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.578 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:13.578 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2024-09-12T16:18:13.578 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1974346628 2024-09-12T16:18:13.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.578 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:13.578 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2024-09-12T16:18:13.578 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1974346628 2024-09-12T16:18:13.578 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:13.578 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:13.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.579 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-12T16:18:13.579 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:13.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.579 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:13.579 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2024-09-12T16:18:13.579 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1974346628 2024-09-12T16:18:13.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.579 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:13.579 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2024-09-12T16:18:13.579 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1974346628 2024-09-12T16:18:13.579 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:13.579 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:13.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.579 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/1974346628", 2024-09-12T16:18:13.580 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/1974346628", 2024-09-12T16:18:13.580 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/1974346628", 2024-09-12T16:18:13.580 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/1974346628", 2024-09-12T16:18:13.580 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-12T16:18:13.580 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-12T16:18:13.580 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-12T16:18:13.580 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:13.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.580 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2024-09-12T16:18:13.580 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "9cc5463c-cdb4-4a6a-b526-39a60de417f4", 2024-09-12T16:18:13.580 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-12T16:18:13.580 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-12T16:18:13.581 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-12T16:18:13.581 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-12T16:18:13.581 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-12T16:18:13.581 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-12T16:18:13.581 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 11, 2024-09-12T16:18:13.581 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 106, 2024-09-12T16:18:13.581 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-12T16:18:13.581 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-12T16:18:13.581 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-12T16:18:13.581 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:13.581 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.581 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:13.581 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6808", 2024-09-12T16:18:13.582 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3370202675 2024-09-12T16:18:13.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.582 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:13.582 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6809", 2024-09-12T16:18:13.582 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3370202675 2024-09-12T16:18:13.582 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:13.582 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:13.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.582 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-12T16:18:13.582 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:13.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.583 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:13.583 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6810", 2024-09-12T16:18:13.583 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3370202675 2024-09-12T16:18:13.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.583 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:13.583 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6811", 2024-09-12T16:18:13.583 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3370202675 2024-09-12T16:18:13.583 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:13.583 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:13.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.583 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-12T16:18:13.583 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:13.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.584 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:13.584 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6814", 2024-09-12T16:18:13.584 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3370202675 2024-09-12T16:18:13.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.584 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.584 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:13.584 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6815", 2024-09-12T16:18:13.584 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3370202675 2024-09-12T16:18:13.584 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:13.584 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:13.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.584 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-12T16:18:13.584 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:13.585 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.585 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:13.585 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6812", 2024-09-12T16:18:13.585 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3370202675 2024-09-12T16:18:13.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.585 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.585 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:13.585 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6813", 2024-09-12T16:18:13.585 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3370202675 2024-09-12T16:18:13.585 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:13.585 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:13.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.585 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.47:6809/3370202675", 2024-09-12T16:18:13.585 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.47:6811/3370202675", 2024-09-12T16:18:13.586 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.47:6815/3370202675", 2024-09-12T16:18:13.586 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.47:6813/3370202675", 2024-09-12T16:18:13.586 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-12T16:18:13.586 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-12T16:18:13.586 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-12T16:18:13.586 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:13.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.586 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2024-09-12T16:18:13.586 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "1e329af3-a88a-4a95-b822-01519079084b", 2024-09-12T16:18:13.586 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-12T16:18:13.586 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-12T16:18:13.586 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-12T16:18:13.586 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-12T16:18:13.587 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-12T16:18:13.587 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-12T16:18:13.587 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 11, 2024-09-12T16:18:13.587 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 107, 2024-09-12T16:18:13.587 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-12T16:18:13.587 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-12T16:18:13.587 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-12T16:18:13.587 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:13.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.587 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:13.587 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6816", 2024-09-12T16:18:13.587 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1823488259 2024-09-12T16:18:13.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.587 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:13.587 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6817", 2024-09-12T16:18:13.588 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1823488259 2024-09-12T16:18:13.588 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:13.588 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:13.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.588 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-12T16:18:13.588 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:13.588 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.588 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:13.588 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6818", 2024-09-12T16:18:13.588 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1823488259 2024-09-12T16:18:13.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.588 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.588 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:13.588 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6819", 2024-09-12T16:18:13.589 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1823488259 2024-09-12T16:18:13.589 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:13.589 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:13.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.589 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-12T16:18:13.589 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:13.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.589 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:13.589 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6822", 2024-09-12T16:18:13.589 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1823488259 2024-09-12T16:18:13.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.589 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:13.589 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6823", 2024-09-12T16:18:13.590 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1823488259 2024-09-12T16:18:13.590 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:13.590 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:13.590 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.590 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-12T16:18:13.590 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:13.590 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.590 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:13.590 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6820", 2024-09-12T16:18:13.590 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1823488259 2024-09-12T16:18:13.590 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.590 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.590 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:13.591 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6821", 2024-09-12T16:18:13.591 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1823488259 2024-09-12T16:18:13.591 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:13.591 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:13.591 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.591 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.47:6817/1823488259", 2024-09-12T16:18:13.591 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.47:6819/1823488259", 2024-09-12T16:18:13.591 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.47:6823/1823488259", 2024-09-12T16:18:13.591 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.47:6821/1823488259", 2024-09-12T16:18:13.591 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-12T16:18:13.591 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-12T16:18:13.591 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-12T16:18:13.591 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:13.591 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.592 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.592 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2024-09-12T16:18:13.592 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "c255a252-3afe-4aad-b44c-85820867c960", 2024-09-12T16:18:13.592 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-12T16:18:13.592 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 0, 2024-09-12T16:18:13.592 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 0, 2024-09-12T16:18:13.592 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 0.089263916015625, 2024-09-12T16:18:13.592 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 11, 2024-09-12T16:18:13.592 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 35, 2024-09-12T16:18:13.592 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 71, 2024-09-12T16:18:13.592 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 32, 2024-09-12T16:18:13.592 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 37, 2024-09-12T16:18:13.592 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-12T16:18:13.593 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-12T16:18:13.593 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:13.593 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.593 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:13.593 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6800", 2024-09-12T16:18:13.593 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2087971028 2024-09-12T16:18:13.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.593 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.593 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:13.593 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6801", 2024-09-12T16:18:13.593 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2087971028 2024-09-12T16:18:13.593 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:13.593 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:13.594 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.594 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-12T16:18:13.594 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:13.594 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.594 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:13.594 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6802", 2024-09-12T16:18:13.594 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2087971028 2024-09-12T16:18:13.594 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.594 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.594 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:13.594 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6803", 2024-09-12T16:18:13.594 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2087971028 2024-09-12T16:18:13.594 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:13.594 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:13.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.595 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-12T16:18:13.595 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:13.595 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.595 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:13.595 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6806", 2024-09-12T16:18:13.595 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2087971028 2024-09-12T16:18:13.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.595 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.595 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:13.595 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6807", 2024-09-12T16:18:13.595 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2087971028 2024-09-12T16:18:13.595 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:13.595 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:13.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.596 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-12T16:18:13.596 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:13.596 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.596 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:13.596 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6804", 2024-09-12T16:18:13.596 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2087971028 2024-09-12T16:18:13.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.596 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.596 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:13.596 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6805", 2024-09-12T16:18:13.596 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2087971028 2024-09-12T16:18:13.597 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:13.597 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:13.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.597 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.47:6801/2087971028", 2024-09-12T16:18:13.597 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.47:6803/2087971028", 2024-09-12T16:18:13.597 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.47:6807/2087971028", 2024-09-12T16:18:13.597 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.47:6805/2087971028", 2024-09-12T16:18:13.597 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-12T16:18:13.597 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-12T16:18:13.597 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-12T16:18:13.597 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:13.597 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:13.598 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-12T16:18:13.598 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2024-09-12T16:18:13.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.598 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2024-09-12T16:18:13.598 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-12T16:18:13.598 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-12T16:18:13.598 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-12T16:18:13.598 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540719139924082687, 2024-09-12T16:18:13.600 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-12T16:18:13.600 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-12T16:15:35.752566+0000", 2024-09-12T16:18:13.600 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-12T16:18:13.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.600 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.600 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2024-09-12T16:18:13.600 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-12T16:18:13.600 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-12T16:18:13.600 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-12T16:18:13.600 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540719139924082687, 2024-09-12T16:18:13.600 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-12T16:18:13.600 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-12T16:15:36.269665+0000", 2024-09-12T16:18:13.601 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-12T16:18:13.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.601 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.601 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2024-09-12T16:18:13.601 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-12T16:18:13.601 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-12T16:18:13.601 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-12T16:18:13.601 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540719139924082687, 2024-09-12T16:18:13.601 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-12T16:18:13.601 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-12T16:15:36.524745+0000", 2024-09-12T16:18:13.601 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-12T16:18:13.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.601 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.601 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2024-09-12T16:18:13.602 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-12T16:18:13.602 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-12T16:18:13.602 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-12T16:18:13.602 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540719139924082687, 2024-09-12T16:18:13.602 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-12T16:18:13.602 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-12T16:15:36.095607+0000", 2024-09-12T16:18:13.602 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-12T16:18:13.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.602 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.602 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2024-09-12T16:18:13.602 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-12T16:18:13.602 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-12T16:18:13.602 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-12T16:18:13.602 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540719139924082687, 2024-09-12T16:18:13.602 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-12T16:18:13.603 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-12T16:15:36.294055+0000", 2024-09-12T16:18:13.603 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-12T16:18:13.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.603 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.603 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2024-09-12T16:18:13.603 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-12T16:18:13.603 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-12T16:18:13.603 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-12T16:18:13.603 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540719139924082687, 2024-09-12T16:18:13.603 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 65536, 2024-09-12T16:18:13.603 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-12T16:15:36.092708+0000", 2024-09-12T16:18:13.603 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 37 2024-09-12T16:18:13.603 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:13.603 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-12T16:18:13.603 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [], 2024-09-12T16:18:13.604 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [], 2024-09-12T16:18:13.604 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2024-09-12T16:18:13.604 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2024-09-12T16:18:13.604 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2024-09-12T16:18:13.604 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2024-09-12T16:18:13.604 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2024-09-12T16:18:13.604 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2024-09-12T16:18:13.604 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2024-09-12T16:18:13.604 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2024-09-12T16:18:13.604 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2024-09-12T16:18:13.604 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2024-09-12T16:18:13.604 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2024-09-12T16:18:13.604 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2024-09-12T16:18:13.605 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:13.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:13.605 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [ 2024-09-12T16:18:13.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.605 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 3, 2024-09-12T16:18:13.605 INFO:teuthology.orchestra.run.smithi017.stdout: "snaps": [ 2024-09-12T16:18:13.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.605 INFO:teuthology.orchestra.run.smithi017.stdout: "begin": 33, 2024-09-12T16:18:13.605 INFO:teuthology.orchestra.run.smithi017.stdout: "length": 4 2024-09-12T16:18:13.605 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:13.605 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:13.605 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:13.605 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-12T16:18:13.605 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [ 2024-09-12T16:18:13.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.606 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 3, 2024-09-12T16:18:13.606 INFO:teuthology.orchestra.run.smithi017.stdout: "snaps": [ 2024-09-12T16:18:13.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.606 INFO:teuthology.orchestra.run.smithi017.stdout: "begin": 33, 2024-09-12T16:18:13.606 INFO:teuthology.orchestra.run.smithi017.stdout: "length": 1 2024-09-12T16:18:13.606 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:13.606 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:13.606 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:13.606 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-12T16:18:13.606 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [ 2024-09-12T16:18:13.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.606 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 3, 2024-09-12T16:18:13.606 INFO:teuthology.orchestra.run.smithi017.stdout: "snaps": [ 2024-09-12T16:18:13.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:13.607 INFO:teuthology.orchestra.run.smithi017.stdout: "begin": 37, 2024-09-12T16:18:13.607 INFO:teuthology.orchestra.run.smithi017.stdout: "length": 5 2024-09-12T16:18:13.607 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:13.607 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:13.607 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:13.607 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-12T16:18:13.607 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2024-09-12T16:18:13.607 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2024-09-12T16:18:13.607 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2024-09-12T16:18:13.607 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2024-09-12T16:18:13.607 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2024-09-12T16:18:13.607 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2024-09-12T16:18:13.607 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2024-09-12T16:18:13.607 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2024-09-12T16:18:13.608 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:13.608 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:13.609 INFO:tasks.thrashosds.thrasher:j is {'epoch': 125, 'fsid': '66dcb8ed-8de5-4784-8071-fd6b3bf3b78f', 'created': '2024-09-12T16:15:28.208893+0000', 'modified': '2024-09-12T16:18:13.005849+0000', 'last_up_change': '2024-09-12T16:17:03.223056+0000', 'last_in_change': '2024-09-12T16:17:47.369306+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 6, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T16:15:40.677216+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8482106924057007, 'average_primary_affinity': 0.8500000238418579, 'average_primary_affinity_weighted': 0.8500000238418579}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T16:15:45.306180+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 19, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.2699999809265137, 'score_stable': 2.2699999809265137, 'optimal_score': 0.8299999833106995, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.8482106924057007, 'average_primary_affinity': 0.8500000238418579, 'average_primary_affinity_weighted': 0.8500000238418579}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-12T16:15:55.082975+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '125', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 43, 'snap_epoch': 125, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5099999904632568, 'score_stable': 1.5099999904632568, 'optimal_score': 0.8299999833106995, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 0.8482106924057007, 'average_primary_affinity': 0.8500000238418579, 'average_primary_affinity_weighted': 0.8500000238418579}}], 'osds': [{'osd': 0, 'uuid': 'aabea24b-3f1f-4555-80c3-5caecf2e2001', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 11, 'up_thru': 106, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6800', 'nonce': 1385915755}, {'type': 'v1', 'addr': '172.21.15.17:6801', 'nonce': 1385915755}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6802', 'nonce': 1385915755}, {'type': 'v1', 'addr': '172.21.15.17:6803', 'nonce': 1385915755}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6806', 'nonce': 1385915755}, {'type': 'v1', 'addr': '172.21.15.17:6807', 'nonce': 1385915755}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6804', 'nonce': 1385915755}, {'type': 'v1', 'addr': '172.21.15.17:6805', 'nonce': 1385915755}]}, 'public_addr': '172.21.15.17:6801/1385915755', 'cluster_addr': '172.21.15.17:6803/1385915755', 'heartbeat_back_addr': '172.21.15.17:6807/1385915755', 'heartbeat_front_addr': '172.21.15.17:6805/1385915755', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '7a17ca3b-8e49-4d92-a633-45d3e4a45b4e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 11, 'up_thru': 106, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6808', 'nonce': 3906173234}, {'type': 'v1', 'addr': '172.21.15.17:6809', 'nonce': 3906173234}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6810', 'nonce': 3906173234}, {'type': 'v1', 'addr': '172.21.15.17:6811', 'nonce': 3906173234}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6814', 'nonce': 3906173234}, {'type': 'v1', 'addr': '172.21.15.17:6815', 'nonce': 3906173234}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6812', 'nonce': 3906173234}, {'type': 'v1', 'addr': '172.21.15.17:6813', 'nonce': 3906173234}]}, 'public_addr': '172.21.15.17:6809/3906173234', 'cluster_addr': '172.21.15.17:6811/3906173234', 'heartbeat_back_addr': '172.21.15.17:6815/3906173234', 'heartbeat_front_addr': '172.21.15.17:6813/3906173234', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'dae09a32-24c6-464c-bee8-04ef2c42f7e4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 11, 'up_thru': 106, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6816', 'nonce': 1974346628}, {'type': 'v1', 'addr': '172.21.15.17:6817', 'nonce': 1974346628}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6818', 'nonce': 1974346628}, {'type': 'v1', 'addr': '172.21.15.17:6819', 'nonce': 1974346628}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6822', 'nonce': 1974346628}, {'type': 'v1', 'addr': '172.21.15.17:6823', 'nonce': 1974346628}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6820', 'nonce': 1974346628}, {'type': 'v1', 'addr': '172.21.15.17:6821', 'nonce': 1974346628}]}, 'public_addr': '172.21.15.17:6817/1974346628', 'cluster_addr': '172.21.15.17:6819/1974346628', 'heartbeat_back_addr': '172.21.15.17:6823/1974346628', 'heartbeat_front_addr': '172.21.15.17:6821/1974346628', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '9cc5463c-cdb4-4a6a-b526-39a60de417f4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 11, 'up_thru': 106, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6808', 'nonce': 3370202675}, {'type': 'v1', 'addr': '172.21.15.47:6809', 'nonce': 3370202675}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6810', 'nonce': 3370202675}, {'type': 'v1', 'addr': '172.21.15.47:6811', 'nonce': 3370202675}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6814', 'nonce': 3370202675}, {'type': 'v1', 'addr': '172.21.15.47:6815', 'nonce': 3370202675}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6812', 'nonce': 3370202675}, {'type': 'v1', 'addr': '172.21.15.47:6813', 'nonce': 3370202675}]}, 'public_addr': '172.21.15.47:6809/3370202675', 'cluster_addr': '172.21.15.47:6811/3370202675', 'heartbeat_back_addr': '172.21.15.47:6815/3370202675', 'heartbeat_front_addr': '172.21.15.47:6813/3370202675', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '1e329af3-a88a-4a95-b822-01519079084b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 11, 'up_thru': 107, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6816', 'nonce': 1823488259}, {'type': 'v1', 'addr': '172.21.15.47:6817', 'nonce': 1823488259}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6818', 'nonce': 1823488259}, {'type': 'v1', 'addr': '172.21.15.47:6819', 'nonce': 1823488259}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6822', 'nonce': 1823488259}, {'type': 'v1', 'addr': '172.21.15.47:6823', 'nonce': 1823488259}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6820', 'nonce': 1823488259}, {'type': 'v1', 'addr': '172.21.15.47:6821', 'nonce': 1823488259}]}, 'public_addr': '172.21.15.47:6817/1823488259', 'cluster_addr': '172.21.15.47:6819/1823488259', 'heartbeat_back_addr': '172.21.15.47:6823/1823488259', 'heartbeat_front_addr': '172.21.15.47:6821/1823488259', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'c255a252-3afe-4aad-b44c-85820867c960', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 0.089263916015625, 'last_clean_begin': 11, 'last_clean_end': 35, 'up_from': 71, 'up_thru': 32, 'down_at': 37, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6800', 'nonce': 2087971028}, {'type': 'v1', 'addr': '172.21.15.47:6801', 'nonce': 2087971028}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6802', 'nonce': 2087971028}, {'type': 'v1', 'addr': '172.21.15.47:6803', 'nonce': 2087971028}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6806', 'nonce': 2087971028}, {'type': 'v1', 'addr': '172.21.15.47:6807', 'nonce': 2087971028}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6804', 'nonce': 2087971028}, {'type': 'v1', 'addr': '172.21.15.47:6805', 'nonce': 2087971028}]}, 'public_addr': '172.21.15.47:6801/2087971028', 'cluster_addr': '172.21.15.47:6803/2087971028', 'heartbeat_back_addr': '172.21.15.47:6807/2087971028', 'heartbeat_front_addr': '172.21.15.47:6805/2087971028', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T16:15:35.752566+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T16:15:36.269665+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T16:15:36.524745+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T16:15:36.095607+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T16:15:36.294055+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-12T16:15:36.092708+0000', 'dead_epoch': 37}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 33, 'length': 4}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 33, 'length': 1}]}], 'new_purged_snaps': [{'pool': 3, 'snaps': [{'begin': 37, 'length': 5}]}], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T16:18:13.610 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T16:18:13.611 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:13.611 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:13.611 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:18:13.612 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:13.608+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:13.710 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:13.709+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:13.759 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:13.759 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:13.769 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:18:13.813 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:13.812+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:13.889 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:13.889 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:13.898 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:18:13.911 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:13.910+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:13.946 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:18:13.947 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-12T16:18:13.958 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":197,"stamp":"2024-09-12T16:18:13.007847+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1249599210,"num_objects":2023,"num_object_clones":541,"num_object_copies":4046,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2023,"num_whiteouts":781,"num_read":443800,"num_read_kb":1616239,"num_write":27640,"num_write_kb":480169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3320,"num_bytes_recovered":155908421,"num_keys_recovered":513,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21524,"ondisk_log_size":21524,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":5,"num_per_pool_osds":5,"num_per_pool_omap_osds":5,"kb":471859200,"kb_used":702328,"kb_used_data":415860,"kb_used_omap":7,"kb_used_meta":286328,"kb_avail":471156872,"statfs":{"total":483183820800,"available":482464636928,"internally_reserved":0,"allocated":425840640,"data_stored":536982874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7972,"internal_metadata":293200092},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-193074098,"num_objects":-217,"num_object_clones":-21,"num_object_copies":-434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-217,"num_whiteouts":-17,"num_read":1338,"num_read_kb":1144,"num_write":350,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.933100"},"pg_stats":[{"pgid":"3.1f","version":"121'580","reported_seq":18551,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.167485+0000","last_change":"2024-09-12T16:18:09.079119+0000","last_active":"2024-09-12T16:18:09.167485+0000","last_peered":"2024-09-12T16:18:09.167485+0000","last_clean":"2024-09-12T16:18:09.167485+0000","last_became_active":"2024-09-12T16:17:21.011550+0000","last_became_peered":"2024-09-12T16:17:21.011550+0000","last_unstale":"2024-09-12T16:18:09.167485+0000","last_undegraded":"2024-09-12T16:18:09.167485+0000","last_fullsized":"2024-09-12T16:18:09.167485+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:58.569451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088044200000000005,"stat_sum":{"num_bytes":33138907,"num_objects":63,"num_object_clones":17,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":25,"num_read":18759,"num_read_kb":74193,"num_write":813,"num_write_kb":11018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":2818651,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.1e","version":"117'504","reported_seq":13582,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.077023+0000","last_change":"2024-09-12T16:18:09.077390+0000","last_active":"2024-09-12T16:18:09.077023+0000","last_peered":"2024-09-12T16:18:09.077023+0000","last_clean":"2024-09-12T16:18:09.077023+0000","last_became_active":"2024-09-12T16:16:55.202876+0000","last_became_peered":"2024-09-12T16:16:55.202876+0000","last_unstale":"2024-09-12T16:18:09.077023+0000","last_undegraded":"2024-09-12T16:18:09.077023+0000","last_fullsized":"2024-09-12T16:18:09.077023+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:05.640640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080362499999999998,"stat_sum":{"num_bytes":32514751,"num_objects":83,"num_object_clones":21,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":32,"num_read":13427,"num_read_kb":46697,"num_write":569,"num_write_kb":8462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":3145760,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.1d","version":"121'1397","reported_seq":19436,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.178458+0000","last_change":"2024-09-12T16:18:09.084933+0000","last_active":"2024-09-12T16:18:09.178458+0000","last_peered":"2024-09-12T16:18:09.178458+0000","last_clean":"2024-09-12T16:18:09.178458+0000","last_became_active":"2024-09-12T16:17:51.016561+0000","last_became_peered":"2024-09-12T16:17:51.016561+0000","last_unstale":"2024-09-12T16:18:09.178458+0000","last_undegraded":"2024-09-12T16:18:09.178458+0000","last_fullsized":"2024-09-12T16:18:09.178458+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1397,"log_dups_size":0,"ondisk_log_size":1397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:23.053359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035175799999999998,"stat_sum":{"num_bytes":57911700,"num_objects":76,"num_object_clones":22,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":31,"num_read":22220,"num_read_kb":66638,"num_write":2061,"num_write_kb":16159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":212,"num_bytes_recovered":21230199,"num_keys_recovered":23,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.1c","version":"121'777","reported_seq":8415,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.233675+0000","last_change":"2024-09-12T16:18:09.085222+0000","last_active":"2024-09-12T16:18:09.233675+0000","last_peered":"2024-09-12T16:18:09.233675+0000","last_clean":"2024-09-12T16:18:09.233675+0000","last_became_active":"2024-09-12T16:17:51.014793+0000","last_became_peered":"2024-09-12T16:17:51.014793+0000","last_unstale":"2024-09-12T16:18:09.233675+0000","last_undegraded":"2024-09-12T16:18:09.233675+0000","last_fullsized":"2024-09-12T16:18:09.233675+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:41.640566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056061100000000003,"stat_sum":{"num_bytes":26828816,"num_objects":53,"num_object_clones":15,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":25,"num_read":9490,"num_read_kb":27675,"num_write":1037,"num_write_kb":6805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":2903584,"num_keys_recovered":120,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.1b","version":"121'1151","reported_seq":8341,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.266747+0000","last_change":"2024-09-12T16:18:09.078775+0000","last_active":"2024-09-12T16:18:09.266747+0000","last_peered":"2024-09-12T16:18:09.266747+0000","last_clean":"2024-09-12T16:18:09.266747+0000","last_became_active":"2024-09-12T16:17:21.011585+0000","last_became_peered":"2024-09-12T16:17:21.011585+0000","last_unstale":"2024-09-12T16:18:09.266747+0000","last_undegraded":"2024-09-12T16:18:09.266747+0000","last_fullsized":"2024-09-12T16:18:09.266747+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1151,"log_dups_size":0,"ondisk_log_size":1151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:19:28.361319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013855219999999999,"stat_sum":{"num_bytes":47194679,"num_objects":63,"num_object_clones":19,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":30,"num_read":11870,"num_read_kb":37751,"num_write":1672,"num_write_kb":15345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":14697984,"num_keys_recovered":12,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.1a","version":"121'1223","reported_seq":11278,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.248346+0000","last_change":"2024-09-12T16:18:09.086126+0000","last_active":"2024-09-12T16:18:09.248346+0000","last_peered":"2024-09-12T16:18:09.248346+0000","last_clean":"2024-09-12T16:18:09.248346+0000","last_became_active":"2024-09-12T16:15:57.014803+0000","last_became_peered":"2024-09-12T16:15:57.014803+0000","last_unstale":"2024-09-12T16:18:09.248346+0000","last_undegraded":"2024-09-12T16:18:09.248346+0000","last_fullsized":"2024-09-12T16:18:09.248346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1223,"log_dups_size":0,"ondisk_log_size":1223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:50.749048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014953169999999999,"stat_sum":{"num_bytes":28267160,"num_objects":64,"num_object_clones":13,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":29,"num_read":14736,"num_read_kb":53804,"num_write":1956,"num_write_kb":21856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.19","version":"121'469","reported_seq":14623,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.167895+0000","last_change":"2024-09-12T16:18:09.082074+0000","last_active":"2024-09-12T16:18:09.167895+0000","last_peered":"2024-09-12T16:18:09.167895+0000","last_clean":"2024-09-12T16:18:09.167895+0000","last_became_active":"2024-09-12T16:15:57.016110+0000","last_became_peered":"2024-09-12T16:15:57.016110+0000","last_unstale":"2024-09-12T16:18:09.167895+0000","last_undegraded":"2024-09-12T16:18:09.167895+0000","last_fullsized":"2024-09-12T16:18:09.167895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:09.572517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094936,"stat_sum":{"num_bytes":22642736,"num_objects":82,"num_object_clones":24,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":32,"num_read":14624,"num_read_kb":54217,"num_write":540,"num_write_kb":10346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.18","version":"119'708","reported_seq":6075,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.076559+0000","last_change":"2024-09-12T16:18:09.076857+0000","last_active":"2024-09-12T16:18:09.076559+0000","last_peered":"2024-09-12T16:18:09.076559+0000","last_clean":"2024-09-12T16:18:09.076559+0000","last_became_active":"2024-09-12T16:17:21.009370+0000","last_became_peered":"2024-09-12T16:17:21.009370+0000","last_unstale":"2024-09-12T16:18:09.076559+0000","last_undegraded":"2024-09-12T16:18:09.076559+0000","last_fullsized":"2024-09-12T16:18:09.076559+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:50.451624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059055499999999999,"stat_sum":{"num_bytes":43848291,"num_objects":56,"num_object_clones":17,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":20,"num_read":7089,"num_read_kb":45462,"num_write":874,"num_write_kb":34056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":17173091,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.17","version":"121'611","reported_seq":7700,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.079374+0000","last_change":"2024-09-12T16:18:09.079374+0000","last_active":"2024-09-12T16:18:09.079374+0000","last_peered":"2024-09-12T16:18:09.079374+0000","last_clean":"2024-09-12T16:18:09.079374+0000","last_became_active":"2024-09-12T16:17:51.012237+0000","last_became_peered":"2024-09-12T16:17:51.012237+0000","last_unstale":"2024-09-12T16:18:09.079374+0000","last_undegraded":"2024-09-12T16:18:09.079374+0000","last_fullsized":"2024-09-12T16:18:09.079374+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":611,"log_dups_size":0,"ondisk_log_size":611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:23.209057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082362600000000005,"stat_sum":{"num_bytes":56914549,"num_objects":69,"num_object_clones":17,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":29,"num_read":7819,"num_read_kb":33803,"num_write":875,"num_write_kb":21940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":13974683,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.16","version":"121'1427","reported_seq":14818,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.174913+0000","last_change":"2024-09-12T16:18:09.076602+0000","last_active":"2024-09-12T16:18:09.174913+0000","last_peered":"2024-09-12T16:18:09.174913+0000","last_clean":"2024-09-12T16:18:09.174913+0000","last_became_active":"2024-09-12T16:17:51.013799+0000","last_became_peered":"2024-09-12T16:17:51.013799+0000","last_unstale":"2024-09-12T16:18:09.174913+0000","last_undegraded":"2024-09-12T16:18:09.174913+0000","last_fullsized":"2024-09-12T16:18:09.174913+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1427,"log_dups_size":0,"ondisk_log_size":1427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:10.105568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061102200000000002,"stat_sum":{"num_bytes":44654046,"num_objects":84,"num_object_clones":26,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":33,"num_read":18387,"num_read_kb":49374,"num_write":2242,"num_write_kb":15618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":11625898,"num_keys_recovered":96,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.15","version":"119'336","reported_seq":7541,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.076691+0000","last_change":"2024-09-12T16:18:09.076841+0000","last_active":"2024-09-12T16:18:09.076691+0000","last_peered":"2024-09-12T16:18:09.076691+0000","last_clean":"2024-09-12T16:18:09.076691+0000","last_became_active":"2024-09-12T16:16:55.203324+0000","last_became_peered":"2024-09-12T16:16:55.203324+0000","last_unstale":"2024-09-12T16:18:09.076691+0000","last_undegraded":"2024-09-12T16:18:09.076691+0000","last_fullsized":"2024-09-12T16:18:09.076691+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:35.670714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064493000000000005,"stat_sum":{"num_bytes":61281329,"num_objects":58,"num_object_clones":17,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":24,"num_read":6918,"num_read_kb":49308,"num_write":403,"num_write_kb":20795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":1054818,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.14","version":"121'805","reported_seq":8922,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.178817+0000","last_change":"2024-09-12T16:18:09.076854+0000","last_active":"2024-09-12T16:18:09.178817+0000","last_peered":"2024-09-12T16:18:09.178817+0000","last_clean":"2024-09-12T16:18:09.178817+0000","last_became_active":"2024-09-12T16:16:53.185698+0000","last_became_peered":"2024-09-12T16:16:53.185698+0000","last_unstale":"2024-09-12T16:18:09.178817+0000","last_undegraded":"2024-09-12T16:18:09.178817+0000","last_fullsized":"2024-09-12T16:18:09.178817+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:56.444139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081793199999999995,"stat_sum":{"num_bytes":52968675,"num_objects":52,"num_object_clones":10,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":21,"num_read":11582,"num_read_kb":49873,"num_write":1094,"num_write_kb":23381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"2.7","version":"0'0","reported_seq":129,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.076028+0000","last_change":"2024-09-12T16:16:52.184699+0000","last_active":"2024-09-12T16:18:09.076028+0000","last_peered":"2024-09-12T16:18:09.076028+0000","last_clean":"2024-09-12T16:18:09.076028+0000","last_became_active":"2024-09-12T16:16:52.184420+0000","last_became_peered":"2024-09-12T16:16:52.184420+0000","last_unstale":"2024-09-12T16:18:09.076028+0000","last_undegraded":"2024-09-12T16:18:09.076028+0000","last_fullsized":"2024-09-12T16:18:09.076028+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:50.051152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"121'431","reported_seq":9472,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.193633+0000","last_change":"2024-09-12T16:18:09.078707+0000","last_active":"2024-09-12T16:18:09.193633+0000","last_peered":"2024-09-12T16:18:09.193633+0000","last_clean":"2024-09-12T16:18:09.193633+0000","last_became_active":"2024-09-12T16:15:57.012577+0000","last_became_peered":"2024-09-12T16:15:57.012577+0000","last_unstale":"2024-09-12T16:18:09.193633+0000","last_undegraded":"2024-09-12T16:18:09.193633+0000","last_fullsized":"2024-09-12T16:18:09.193633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:57.826354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090507999999999995,"stat_sum":{"num_bytes":25480254,"num_objects":42,"num_object_clones":13,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":10,"num_read":10166,"num_read_kb":43937,"num_write":444,"num_write_kb":9188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"2.6","version":"0'0","reported_seq":237,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.081004+0000","last_change":"2024-09-12T16:16:52.187010+0000","last_active":"2024-09-12T16:18:09.081004+0000","last_peered":"2024-09-12T16:18:09.081004+0000","last_clean":"2024-09-12T16:18:09.081004+0000","last_became_active":"2024-09-12T16:16:52.186638+0000","last_became_peered":"2024-09-12T16:16:52.186638+0000","last_unstale":"2024-09-12T16:18:09.081004+0000","last_undegraded":"2024-09-12T16:18:09.081004+0000","last_fullsized":"2024-09-12T16:18:09.081004+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:40.681796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066384400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"121'694","reported_seq":16376,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.190025+0000","last_change":"2024-09-12T16:18:09.079574+0000","last_active":"2024-09-12T16:18:09.190025+0000","last_peered":"2024-09-12T16:18:09.190025+0000","last_clean":"2024-09-12T16:18:09.190025+0000","last_became_active":"2024-09-12T16:16:34.108850+0000","last_became_peered":"2024-09-12T16:16:34.108850+0000","last_unstale":"2024-09-12T16:18:09.190025+0000","last_undegraded":"2024-09-12T16:18:09.190025+0000","last_fullsized":"2024-09-12T16:18:09.190025+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:51.625108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019734129999999998,"stat_sum":{"num_bytes":54856720,"num_objects":57,"num_object_clones":16,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":25,"num_read":17493,"num_read_kb":60949,"num_write":633,"num_write_kb":27109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"2.5","version":"0'0","reported_seq":129,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.076102+0000","last_change":"2024-09-12T16:16:52.183981+0000","last_active":"2024-09-12T16:18:09.076102+0000","last_peered":"2024-09-12T16:18:09.076102+0000","last_clean":"2024-09-12T16:18:09.076102+0000","last_became_active":"2024-09-12T16:16:52.183675+0000","last_became_peered":"2024-09-12T16:16:52.183675+0000","last_unstale":"2024-09-12T16:18:09.076102+0000","last_undegraded":"2024-09-12T16:18:09.076102+0000","last_fullsized":"2024-09-12T16:18:09.076102+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:35.267433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"121'667","reported_seq":7893,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.171786+0000","last_change":"2024-09-12T16:18:09.081905+0000","last_active":"2024-09-12T16:18:09.171786+0000","last_peered":"2024-09-12T16:18:09.171786+0000","last_clean":"2024-09-12T16:18:09.171786+0000","last_became_active":"2024-09-12T16:15:57.011381+0000","last_became_peered":"2024-09-12T16:15:57.011381+0000","last_unstale":"2024-09-12T16:18:09.171786+0000","last_undegraded":"2024-09-12T16:18:09.171786+0000","last_fullsized":"2024-09-12T16:18:09.171786+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:48.884303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000934865,"stat_sum":{"num_bytes":22388800,"num_objects":57,"num_object_clones":11,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":20,"num_read":10055,"num_read_kb":43825,"num_write":881,"num_write_kb":7773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"2.4","version":"0'0","reported_seq":225,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.080727+0000","last_change":"2024-09-12T16:15:48.822724+0000","last_active":"2024-09-12T16:18:09.080727+0000","last_peered":"2024-09-12T16:18:09.080727+0000","last_clean":"2024-09-12T16:18:09.080727+0000","last_became_active":"2024-09-12T16:15:46.818676+0000","last_became_peered":"2024-09-12T16:15:46.818676+0000","last_unstale":"2024-09-12T16:18:09.080727+0000","last_undegraded":"2024-09-12T16:18:09.080727+0000","last_fullsized":"2024-09-12T16:18:09.080727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:11.170806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065522900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"121'690","reported_seq":21207,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.221932+0000","last_change":"2024-09-12T16:18:09.077745+0000","last_active":"2024-09-12T16:18:09.221932+0000","last_peered":"2024-09-12T16:18:09.221932+0000","last_clean":"2024-09-12T16:18:09.221932+0000","last_became_active":"2024-09-12T16:17:51.016347+0000","last_became_peered":"2024-09-12T16:17:51.016347+0000","last_unstale":"2024-09-12T16:18:09.221932+0000","last_undegraded":"2024-09-12T16:18:09.221932+0000","last_fullsized":"2024-09-12T16:18:09.221932+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":690,"log_dups_size":0,"ondisk_log_size":690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:18.160520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095462100000000001,"stat_sum":{"num_bytes":20251184,"num_objects":76,"num_object_clones":27,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":30,"num_read":24811,"num_read_kb":48071,"num_write":656,"num_write_kb":4771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":2957360,"num_keys_recovered":70,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.3","version":"121'625","reported_seq":5955,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.195219+0000","last_change":"2024-09-12T16:18:09.085713+0000","last_active":"2024-09-12T16:18:09.195219+0000","last_peered":"2024-09-12T16:18:09.195219+0000","last_clean":"2024-09-12T16:18:09.195219+0000","last_became_active":"2024-09-12T16:15:57.012238+0000","last_became_peered":"2024-09-12T16:15:57.012238+0000","last_unstale":"2024-09-12T16:18:09.195219+0000","last_undegraded":"2024-09-12T16:18:09.195219+0000","last_fullsized":"2024-09-12T16:18:09.195219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:17:13.273096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077467900000000001,"stat_sum":{"num_bytes":70389896,"num_objects":54,"num_object_clones":16,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":16,"num_read":6283,"num_read_kb":41279,"num_write":837,"num_write_kb":9166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"2.2","version":"19'2","reported_seq":236,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.080837+0000","last_change":"2024-09-12T16:17:48.012662+0000","last_active":"2024-09-12T16:18:09.080837+0000","last_peered":"2024-09-12T16:18:09.080837+0000","last_clean":"2024-09-12T16:18:09.080837+0000","last_became_active":"2024-09-12T16:17:48.010294+0000","last_became_peered":"2024-09-12T16:17:48.010294+0000","last_unstale":"2024-09-12T16:18:09.080837+0000","last_undegraded":"2024-09-12T16:18:09.080837+0000","last_fullsized":"2024-09-12T16:18:09.080837+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:01.372827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"121'686","reported_seq":18304,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.081448+0000","last_change":"2024-09-12T16:18:09.081448+0000","last_active":"2024-09-12T16:18:09.081448+0000","last_peered":"2024-09-12T16:18:09.081448+0000","last_clean":"2024-09-12T16:18:09.081448+0000","last_became_active":"2024-09-12T16:15:57.014294+0000","last_became_peered":"2024-09-12T16:15:57.014294+0000","last_unstale":"2024-09-12T16:18:09.081448+0000","last_undegraded":"2024-09-12T16:18:09.081448+0000","last_fullsized":"2024-09-12T16:18:09.081448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":686,"log_dups_size":0,"ondisk_log_size":686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:04.879243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071073100000000004,"stat_sum":{"num_bytes":33509484,"num_objects":62,"num_object_clones":19,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":24,"num_read":19631,"num_read_kb":52701,"num_write":623,"num_write_kb":17119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"2.1","version":"0'0","reported_seq":203,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.076637+0000","last_change":"2024-09-12T16:16:34.109269+0000","last_active":"2024-09-12T16:18:09.076637+0000","last_peered":"2024-09-12T16:18:09.076637+0000","last_clean":"2024-09-12T16:18:09.076637+0000","last_became_active":"2024-09-12T16:16:34.108999+0000","last_became_peered":"2024-09-12T16:16:34.108999+0000","last_unstale":"2024-09-12T16:18:09.076637+0000","last_undegraded":"2024-09-12T16:18:09.076637+0000","last_fullsized":"2024-09-12T16:18:09.076637+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:02:32.771436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"119'438","reported_seq":5546,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.077558+0000","last_change":"2024-09-12T16:18:09.077817+0000","last_active":"2024-09-12T16:18:09.077558+0000","last_peered":"2024-09-12T16:18:09.077558+0000","last_clean":"2024-09-12T16:18:09.077558+0000","last_became_active":"2024-09-12T16:15:57.015817+0000","last_became_peered":"2024-09-12T16:15:57.015817+0000","last_unstale":"2024-09-12T16:18:09.077558+0000","last_undegraded":"2024-09-12T16:18:09.077558+0000","last_fullsized":"2024-09-12T16:18:09.077558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:36.846646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014974859999999999,"stat_sum":{"num_bytes":29445213,"num_objects":59,"num_object_clones":15,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":25,"num_read":5407,"num_read_kb":44101,"num_write":619,"num_write_kb":24794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"2.0","version":"0'0","reported_seq":129,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.075658+0000","last_change":"2024-09-12T16:16:52.184861+0000","last_active":"2024-09-12T16:18:09.075658+0000","last_peered":"2024-09-12T16:18:09.075658+0000","last_clean":"2024-09-12T16:18:09.075658+0000","last_became_active":"2024-09-12T16:16:52.184555+0000","last_became_peered":"2024-09-12T16:16:52.184555+0000","last_unstale":"2024-09-12T16:18:09.075658+0000","last_undegraded":"2024-09-12T16:18:09.075658+0000","last_fullsized":"2024-09-12T16:18:09.075658+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:32.617153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"121'489","reported_seq":9424,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.174299+0000","last_change":"2024-09-12T16:18:09.081707+0000","last_active":"2024-09-12T16:18:09.174299+0000","last_peered":"2024-09-12T16:18:09.174299+0000","last_clean":"2024-09-12T16:18:09.174299+0000","last_became_active":"2024-09-12T16:17:51.013330+0000","last_became_peered":"2024-09-12T16:17:51.013330+0000","last_unstale":"2024-09-12T16:18:09.174299+0000","last_undegraded":"2024-09-12T16:18:09.174299+0000","last_fullsized":"2024-09-12T16:18:09.174299+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:27.370417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084752199999999997,"stat_sum":{"num_bytes":34794528,"num_objects":58,"num_object_clones":17,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":21,"num_read":9541,"num_read_kb":35804,"num_write":442,"num_write_kb":7456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":6101552,"num_keys_recovered":23,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"2.3","version":"17'1","reported_seq":215,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.076315+0000","last_change":"2024-09-12T16:17:48.011718+0000","last_active":"2024-09-12T16:18:09.076315+0000","last_peered":"2024-09-12T16:18:09.076315+0000","last_clean":"2024-09-12T16:18:09.076315+0000","last_became_active":"2024-09-12T16:17:48.009327+0000","last_became_peered":"2024-09-12T16:17:48.009327+0000","last_unstale":"2024-09-12T16:18:09.076315+0000","last_undegraded":"2024-09-12T16:18:09.076315+0000","last_fullsized":"2024-09-12T16:18:09.076315+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:01.466194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":135,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.075662+0000","last_change":"2024-09-12T16:16:52.190735+0000","last_active":"2024-09-12T16:18:09.075662+0000","last_peered":"2024-09-12T16:18:09.075662+0000","last_clean":"2024-09-12T16:18:09.075662+0000","last_became_active":"2024-09-12T16:16:52.183781+0000","last_became_peered":"2024-09-12T16:16:52.183781+0000","last_unstale":"2024-09-12T16:18:09.075662+0000","last_undegraded":"2024-09-12T16:18:09.075662+0000","last_fullsized":"2024-09-12T16:18:09.075662+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:40.751677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:40.751677+0000","last_clean_scrub_stamp":"2024-09-12T16:15:40.751677+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:34.274075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"121'512","reported_seq":13299,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.180233+0000","last_change":"2024-09-12T16:18:09.077360+0000","last_active":"2024-09-12T16:18:09.180233+0000","last_peered":"2024-09-12T16:18:09.180233+0000","last_clean":"2024-09-12T16:18:09.180233+0000","last_became_active":"2024-09-12T16:16:34.108998+0000","last_became_peered":"2024-09-12T16:16:34.108998+0000","last_unstale":"2024-09-12T16:18:09.180233+0000","last_undegraded":"2024-09-12T16:18:09.180233+0000","last_fullsized":"2024-09-12T16:18:09.180233+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:12.392277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084305899999999995,"stat_sum":{"num_bytes":50668350,"num_objects":62,"num_object_clones":14,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":23,"num_read":13128,"num_read_kb":49374,"num_write":626,"num_write_kb":7937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.9","version":"121'438","reported_seq":31288,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.171442+0000","last_change":"2024-09-12T16:18:09.085966+0000","last_active":"2024-09-12T16:18:09.171442+0000","last_peered":"2024-09-12T16:18:09.171442+0000","last_clean":"2024-09-12T16:18:09.171442+0000","last_became_active":"2024-09-12T16:15:57.013620+0000","last_became_peered":"2024-09-12T16:15:57.013620+0000","last_unstale":"2024-09-12T16:18:09.171442+0000","last_undegraded":"2024-09-12T16:18:09.171442+0000","last_fullsized":"2024-09-12T16:18:09.171442+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:21.356925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096693799999999998,"stat_sum":{"num_bytes":58716704,"num_objects":51,"num_object_clones":13,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":18,"num_read":30737,"num_read_kb":77487,"num_write":543,"num_write_kb":11505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.a","version":"121'769","reported_seq":20404,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.268881+0000","last_change":"2024-09-12T16:18:09.076336+0000","last_active":"2024-09-12T16:18:09.268881+0000","last_peered":"2024-09-12T16:18:09.268881+0000","last_clean":"2024-09-12T16:18:09.268881+0000","last_became_active":"2024-09-12T16:16:55.202934+0000","last_became_peered":"2024-09-12T16:16:55.202934+0000","last_unstale":"2024-09-12T16:18:09.268881+0000","last_undegraded":"2024-09-12T16:18:09.268881+0000","last_fullsized":"2024-09-12T16:18:09.268881+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:38.970068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047302999999999999,"stat_sum":{"num_bytes":55168961,"num_objects":66,"num_object_clones":18,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":24,"num_read":21737,"num_read_kb":59437,"num_write":860,"num_write_kb":8215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":4487368,"num_keys_recovered":26,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.b","version":"121'460","reported_seq":15307,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.179108+0000","last_change":"2024-09-12T16:18:09.081389+0000","last_active":"2024-09-12T16:18:09.179108+0000","last_peered":"2024-09-12T16:18:09.179108+0000","last_clean":"2024-09-12T16:18:09.179108+0000","last_became_active":"2024-09-12T16:15:57.012845+0000","last_became_peered":"2024-09-12T16:15:57.012845+0000","last_unstale":"2024-09-12T16:18:09.179108+0000","last_undegraded":"2024-09-12T16:18:09.179108+0000","last_fullsized":"2024-09-12T16:18:09.179108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:52.519315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072307600000000001,"stat_sum":{"num_bytes":12044494,"num_objects":49,"num_object_clones":10,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":17,"num_read":15224,"num_read_kb":48827,"num_write":538,"num_write_kb":5107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.c","version":"121'394","reported_seq":10941,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.171723+0000","last_change":"2024-09-12T16:18:09.079080+0000","last_active":"2024-09-12T16:18:09.171723+0000","last_peered":"2024-09-12T16:18:09.171723+0000","last_clean":"2024-09-12T16:18:09.171723+0000","last_became_active":"2024-09-12T16:17:51.014029+0000","last_became_peered":"2024-09-12T16:17:51.014029+0000","last_unstale":"2024-09-12T16:18:09.171723+0000","last_undegraded":"2024-09-12T16:18:09.171723+0000","last_fullsized":"2024-09-12T16:18:09.171723+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:47.651743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088408099999999999,"stat_sum":{"num_bytes":29076992,"num_objects":65,"num_object_clones":18,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":27,"num_read":9857,"num_read_kb":46208,"num_write":401,"num_write_kb":17232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":8133632,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.d","version":"120'552","reported_seq":16746,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.076951+0000","last_change":"2024-09-12T16:18:09.077151+0000","last_active":"2024-09-12T16:18:09.076951+0000","last_peered":"2024-09-12T16:18:09.076951+0000","last_clean":"2024-09-12T16:18:09.076951+0000","last_became_active":"2024-09-12T16:16:55.202102+0000","last_became_peered":"2024-09-12T16:16:55.202102+0000","last_unstale":"2024-09-12T16:18:09.076951+0000","last_undegraded":"2024-09-12T16:18:09.076951+0000","last_fullsized":"2024-09-12T16:18:09.076951+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:49.128951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065812399999999995,"stat_sum":{"num_bytes":35045425,"num_objects":68,"num_object_clones":20,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":22,"num_read":17966,"num_read_kb":58016,"num_write":554,"num_write_kb":13608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":126,"num_bytes_recovered":6078562,"num_keys_recovered":48,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.e","version":"118'497","reported_seq":6931,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.085457+0000","last_change":"2024-09-12T16:18:09.085457+0000","last_active":"2024-09-12T16:18:09.085457+0000","last_peered":"2024-09-12T16:18:09.085457+0000","last_clean":"2024-09-12T16:18:09.085457+0000","last_became_active":"2024-09-12T16:17:52.020417+0000","last_became_peered":"2024-09-12T16:17:52.020417+0000","last_unstale":"2024-09-12T16:18:09.085457+0000","last_undegraded":"2024-09-12T16:18:09.085457+0000","last_fullsized":"2024-09-12T16:18:09.085457+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:49.983316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000747479,"stat_sum":{"num_bytes":23289919,"num_objects":60,"num_object_clones":12,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":22,"num_read":7452,"num_read_kb":29733,"num_write":503,"num_write_kb":13250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":4949567,"num_keys_recovered":36,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.f","version":"121'574","reported_seq":11512,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.248899+0000","last_change":"2024-09-12T16:18:09.077073+0000","last_active":"2024-09-12T16:18:09.248899+0000","last_peered":"2024-09-12T16:18:09.248899+0000","last_clean":"2024-09-12T16:18:09.248899+0000","last_became_active":"2024-09-12T16:17:51.015904+0000","last_became_peered":"2024-09-12T16:17:51.015904+0000","last_unstale":"2024-09-12T16:18:09.248899+0000","last_undegraded":"2024-09-12T16:18:09.248899+0000","last_fullsized":"2024-09-12T16:18:09.248899+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":574,"log_dups_size":0,"ondisk_log_size":574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:56.862594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085685899999999996,"stat_sum":{"num_bytes":14618427,"num_objects":45,"num_object_clones":7,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":18,"num_read":10528,"num_read_kb":48835,"num_write":766,"num_write_kb":21646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":5585051,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.10","version":"121'543","reported_seq":14407,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.270073+0000","last_change":"2024-09-12T16:18:09.078017+0000","last_active":"2024-09-12T16:18:09.270073+0000","last_peered":"2024-09-12T16:18:09.270073+0000","last_clean":"2024-09-12T16:18:09.270073+0000","last_became_active":"2024-09-12T16:17:51.012241+0000","last_became_peered":"2024-09-12T16:17:51.012241+0000","last_unstale":"2024-09-12T16:18:09.270073+0000","last_undegraded":"2024-09-12T16:18:09.270073+0000","last_fullsized":"2024-09-12T16:18:09.270073+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:02.071935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001517443,"stat_sum":{"num_bytes":40967466,"num_objects":77,"num_object_clones":21,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":32,"num_read":12545,"num_read_kb":72965,"num_write":744,"num_write_kb":17165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":229,"num_bytes_recovered":9167452,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.11","version":"121'568","reported_seq":16673,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.178182+0000","last_change":"2024-09-12T16:18:09.076285+0000","last_active":"2024-09-12T16:18:09.178182+0000","last_peered":"2024-09-12T16:18:09.178182+0000","last_clean":"2024-09-12T16:18:09.178182+0000","last_became_active":"2024-09-12T16:16:55.202493+0000","last_became_peered":"2024-09-12T16:16:55.202493+0000","last_unstale":"2024-09-12T16:18:09.178182+0000","last_undegraded":"2024-09-12T16:18:09.178182+0000","last_fullsized":"2024-09-12T16:18:09.178182+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:06.098467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044233400000000001,"stat_sum":{"num_bytes":47168360,"num_objects":69,"num_object_clones":19,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":23,"num_read":16684,"num_read_kb":61460,"num_write":758,"num_write_kb":15880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":1725440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.12","version":"121'565","reported_seq":14601,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.174520+0000","last_change":"2024-09-12T16:18:09.078275+0000","last_active":"2024-09-12T16:18:09.174520+0000","last_peered":"2024-09-12T16:18:09.174520+0000","last_clean":"2024-09-12T16:18:09.174520+0000","last_became_active":"2024-09-12T16:16:55.202220+0000","last_became_peered":"2024-09-12T16:16:55.202220+0000","last_unstale":"2024-09-12T16:18:09.174520+0000","last_undegraded":"2024-09-12T16:18:09.174520+0000","last_fullsized":"2024-09-12T16:18:09.174520+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:03.441504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001615778,"stat_sum":{"num_bytes":45664917,"num_objects":65,"num_object_clones":16,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":25,"num_read":15957,"num_read_kb":59818,"num_write":618,"num_write_kb":14663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":3518540,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.13","version":"121'869","reported_seq":10646,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T16:18:09.212475+0000","last_change":"2024-09-12T16:18:09.076575+0000","last_active":"2024-09-12T16:18:09.212475+0000","last_peered":"2024-09-12T16:18:09.212475+0000","last_clean":"2024-09-12T16:18:09.212475+0000","last_became_active":"2024-09-12T16:17:51.014097+0000","last_became_peered":"2024-09-12T16:17:51.014097+0000","last_unstale":"2024-09-12T16:18:09.212475+0000","last_undegraded":"2024-09-12T16:18:09.212475+0000","last_fullsized":"2024-09-12T16:18:09.212475+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:51.801272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063719000000000004,"stat_sum":{"num_bytes":37297090,"num_objects":74,"num_object_clones":21,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":28,"num_read":11611,"num_read_kb":44562,"num_write":1355,"num_write_kb":19174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":282,"num_bytes_recovered":13398474,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"25","length":"5"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1249008823,"num_objects":2019,"num_object_clones":541,"num_object_copies":4038,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2019,"num_whiteouts":781,"num_read":443734,"num_read_kb":1616184,"num_write":27537,"num_write_kb":478539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3314,"num_bytes_recovered":154727666,"num_keys_recovered":513,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417628160,"data_stored":534216621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6949,"internal_metadata":0},"log_size":21449,"ondisk_log_size":21449,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":5,"up_from":0,"seq":304942678031,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640289,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":143788,"kb_used_data":72340,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94228052,"statfs":{"total":96636764160,"available":96489525248,"internally_reserved":0,"allocated":74076160,"data_stored":91891197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640290,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149496,"kb_used_data":78044,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94222344,"statfs":{"total":96636764160,"available":96483680256,"internally_reserved":0,"allocated":79917056,"data_stored":104550468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73136583},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640291,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":133316,"kb_used_data":88236,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94238524,"statfs":{"total":96636764160,"available":96500248576,"internally_reserved":0,"allocated":90353664,"data_stored":114953776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640289,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136776,"kb_used_data":83372,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94235064,"statfs":{"total":96636764160,"available":96496705536,"internally_reserved":0,"allocated":85372928,"data_stored":104720157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640290,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138952,"kb_used_data":93868,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94232888,"statfs":{"total":96636764160,"available":96494477312,"internally_reserved":0,"allocated":96120832,"data_stored":120867276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93159424,"data_stored":118806790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":82751488,"data_stored":102987993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":88387584,"data_stored":113853908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77889536,"data_stored":103368648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":72179712,"data_stored":90851827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3260416,"data_stored":4347455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6949,"internal_metadata":0}]}} 2024-09-12T16:18:13.960 INFO:tasks.thrashosds.thrasher:Setting 3.1 to [1, 0] 2024-09-12T16:18:13.960 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.1', '1', '0'] 2024-09-12T16:18:13.960 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.1 1 0 2024-09-12T16:18:14.013 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:14.011+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:14.047 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:14.047 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:14.056 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:18:14.095 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-12T16:18:14.114 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:14.113+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:14.215 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:14.214+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:14.219 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:14.219 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:14.228 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:18:14.316 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:14.315+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:14.336 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:14.336 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:14.344 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:18:14.348 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T16:18:14.417 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:14.416+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:14.452 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:14.452 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:14.461 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:18:14.471 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:18:14.471 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:18:14.488 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:18:14.489 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:18:14.505 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:18:14.505 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:18:14.518 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:14.517+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:14.521 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:18:14.521 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:18:14.538 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:18:14.538 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:18:14.555 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:18:14.555 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:18:14.570 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:14.570 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:18:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:18:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:18:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5599 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4788224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:18:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 94.272927668999998, 2024-09-12T16:18:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061192059, 2024-09-12T16:18:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5599 2024-09-12T16:18:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:18:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:18:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296333+0000", 2024-09-12T16:18:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6599999999999996e-07 2024-09-12T16:18:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296335+0000", 2024-09-12T16:18:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5900000000000002e-06 2024-09-12T16:18:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296344+0000", 2024-09-12T16:18:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9539999999999993e-06 2024-09-12T16:18:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296350+0000", 2024-09-12T16:18:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5589999999999996e-06 2024-09-12T16:18:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357307+0000", 2024-09-12T16:18:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.060957573000000001 2024-09-12T16:18:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357401+0000", 2024-09-12T16:18:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3512999999999997e-05 2024-09-12T16:18:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357524+0000", 2024-09-12T16:18:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000123304 2024-09-12T16:18:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5611 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4730880~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:18:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 94.272865225000004, 2024-09-12T16:18:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061359348000000001, 2024-09-12T16:18:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:14.576 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:14.576 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:14.576 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:14.576 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5611 2024-09-12T16:18:14.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.576 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:14.576 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.576 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:14.576 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:18:14.576 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.576 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.576 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:14.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:18:14.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.577 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:14.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296395+0000", 2024-09-12T16:18:14.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4600000000000003e-07 2024-09-12T16:18:14.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.577 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:14.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296399+0000", 2024-09-12T16:18:14.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9430000000000002e-06 2024-09-12T16:18:14.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296411+0000", 2024-09-12T16:18:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1755e-05 2024-09-12T16:18:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296417+0000", 2024-09-12T16:18:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3790000000000003e-06 2024-09-12T16:18:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357572+0000", 2024-09-12T16:18:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061154871 2024-09-12T16:18:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357663+0000", 2024-09-12T16:18:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0389999999999993e-05 2024-09-12T16:18:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357754+0000", 2024-09-12T16:18:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1063999999999994e-05 2024-09-12T16:18:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5613 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4775936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:18:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 94.272824044999993, 2024-09-12T16:18:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061491777999999997, 2024-09-12T16:18:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5613 2024-09-12T16:18:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:18:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:18:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:18:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8899999999999999e-07 2024-09-12T16:18:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:14.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296439+0000", 2024-09-12T16:18:14.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8439999999999998e-06 2024-09-12T16:18:14.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:14.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296452+0000", 2024-09-12T16:18:14.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2639e-05 2024-09-12T16:18:14.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:14.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296457+0000", 2024-09-12T16:18:14.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5720000000000002e-06 2024-09-12T16:18:14.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:14.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357773+0000", 2024-09-12T16:18:14.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061315500000000002 2024-09-12T16:18:14.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:14.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357814+0000", 2024-09-12T16:18:14.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1448e-05 2024-09-12T16:18:14.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:14.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357927+0000", 2024-09-12T16:18:14.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000113186 2024-09-12T16:18:14.583 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.584 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:14.584 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.584 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.584 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5616 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4784128~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:14.584 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:18:14.584 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 94.272788982999998, 2024-09-12T16:18:14.584 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061725002000000001, 2024-09-12T16:18:14.584 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:14.584 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:14.584 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:14.584 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:14.584 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:14.584 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:14.585 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5616 2024-09-12T16:18:14.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.585 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:14.585 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.585 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:14.585 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:18:14.585 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.585 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.585 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:14.585 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:18:14.585 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.585 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:14.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:18:14.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5900000000000002e-07 2024-09-12T16:18:14.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:14.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296473+0000", 2024-09-12T16:18:14.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3130000000000001e-06 2024-09-12T16:18:14.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:14.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296481+0000", 2024-09-12T16:18:14.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1389999999999998e-06 2024-09-12T16:18:14.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:14.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296486+0000", 2024-09-12T16:18:14.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3310000000000003e-06 2024-09-12T16:18:14.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:14.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357981+0000", 2024-09-12T16:18:14.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061494866000000002 2024-09-12T16:18:14.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:14.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358082+0000", 2024-09-12T16:18:14.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101424 2024-09-12T16:18:14.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.588 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:14.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358196+0000", 2024-09-12T16:18:14.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011347 2024-09-12T16:18:14.588 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.588 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:14.588 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.588 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5626 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4739072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:14.588 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:18:14.589 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 94.272711027, 2024-09-12T16:18:14.589 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061802430999999998, 2024-09-12T16:18:14.589 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:14.589 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:14.589 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:14.589 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:14.589 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:14.589 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:14.589 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5626 2024-09-12T16:18:14.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.589 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:14.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.589 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:14.589 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:18:14.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:14.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:18:14.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:14.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296550+0000", 2024-09-12T16:18:14.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.215e-06 2024-09-12T16:18:14.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:14.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296555+0000", 2024-09-12T16:18:14.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9590000000000003e-06 2024-09-12T16:18:14.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:14.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296568+0000", 2024-09-12T16:18:14.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3338e-05 2024-09-12T16:18:14.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:14.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296576+0000", 2024-09-12T16:18:14.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5510000000000002e-06 2024-09-12T16:18:14.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:14.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358241+0000", 2024-09-12T16:18:14.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.06166576 2024-09-12T16:18:14.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:14.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358288+0000", 2024-09-12T16:18:14.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6097000000000003e-05 2024-09-12T16:18:14.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:14.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358351+0000", 2024-09-12T16:18:14.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3510999999999996e-05 2024-09-12T16:18:14.592 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.592 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:14.593 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.593 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5628 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4792320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:14.593 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:18:14.593 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 94.272668526999993, 2024-09-12T16:18:14.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061961161000000001, 2024-09-12T16:18:14.593 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:14.593 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:14.593 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:14.593 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:14.593 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:14.593 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:14.594 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5628 2024-09-12T16:18:14.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.594 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:14.594 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.594 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:14.594 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:18:14.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.594 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.594 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:14.594 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:18:14.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.594 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296592+0000", 2024-09-12T16:18:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2099999999999996e-07 2024-09-12T16:18:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296595+0000", 2024-09-12T16:18:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0429999999999999e-06 2024-09-12T16:18:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296603+0000", 2024-09-12T16:18:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9899999999999997e-06 2024-09-12T16:18:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:14.596 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296609+0000", 2024-09-12T16:18:14.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7259999999999999e-06 2024-09-12T16:18:14.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.596 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.596 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:14.596 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358393+0000", 2024-09-12T16:18:14.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061784617 2024-09-12T16:18:14.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.596 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.596 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:14.596 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358460+0000", 2024-09-12T16:18:14.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7253000000000001e-05 2024-09-12T16:18:14.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.596 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:14.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358552+0000", 2024-09-12T16:18:14.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1811000000000006e-05 2024-09-12T16:18:14.597 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.597 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:14.597 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.597 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5638 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4734976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:14.597 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:18:14.597 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 94.272195976000006, 2024-09-12T16:18:14.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061654460000000001, 2024-09-12T16:18:14.597 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:14.597 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:14.598 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:14.598 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:14.598 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:14.598 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:14.598 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5638 2024-09-12T16:18:14.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.598 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:14.598 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.598 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:14.598 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:18:14.598 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.598 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.598 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:14.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:18:14.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:14.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:18:14.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.23e-07 2024-09-12T16:18:14.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:14.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297068+0000", 2024-09-12T16:18:14.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0060000000000003e-06 2024-09-12T16:18:14.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:14.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297080+0000", 2024-09-12T16:18:14.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1234e-05 2024-09-12T16:18:14.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:14.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297095+0000", 2024-09-12T16:18:14.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5698000000000001e-05 2024-09-12T16:18:14.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:14.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358582+0000", 2024-09-12T16:18:14.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061486274 2024-09-12T16:18:14.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:14.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358637+0000", 2024-09-12T16:18:14.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5439999999999998e-05 2024-09-12T16:18:14.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:14.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358718+0000", 2024-09-12T16:18:14.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0984999999999998e-05 2024-09-12T16:18:14.601 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.601 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:14.601 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.602 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5640 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4780032~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:14.602 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:18:14.602 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 94.272114255999995, 2024-09-12T16:18:14.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061746620000000002, 2024-09-12T16:18:14.602 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:14.602 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:14.602 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:14.602 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:14.602 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:14.602 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:14.602 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5640 2024-09-12T16:18:14.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.602 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:14.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.602 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:14.603 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:18:14.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.603 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.603 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:14.603 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:18:14.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.603 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.603 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:14.603 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297146+0000", 2024-09-12T16:18:14.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3600000000000003e-07 2024-09-12T16:18:14.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.603 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.603 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:14.604 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297150+0000", 2024-09-12T16:18:14.604 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8430000000000003e-06 2024-09-12T16:18:14.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.604 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:14.604 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297160+0000", 2024-09-12T16:18:14.604 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7229999999999999e-06 2024-09-12T16:18:14.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.604 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:14.604 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297167+0000", 2024-09-12T16:18:14.604 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0180000000000004e-06 2024-09-12T16:18:14.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.604 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:14.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358750+0000", 2024-09-12T16:18:14.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061583104 2024-09-12T16:18:14.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.605 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:14.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358804+0000", 2024-09-12T16:18:14.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4277000000000002e-05 2024-09-12T16:18:14.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.605 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:14.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358892+0000", 2024-09-12T16:18:14.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7918999999999996e-05 2024-09-12T16:18:14.605 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.606 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:14.606 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.606 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5642 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4788224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:14.606 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:18:14.606 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 94.272069912000006, 2024-09-12T16:18:14.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061860409999999998, 2024-09-12T16:18:14.606 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:14.606 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:14.606 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:14.606 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:14.606 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:14.606 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:14.606 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5642 2024-09-12T16:18:14.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.607 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:14.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:14.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:18:14.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:14.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:18:14.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:14.608 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:18:14.608 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7999999999999995e-07 2024-09-12T16:18:14.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.608 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:14.608 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297193+0000", 2024-09-12T16:18:14.608 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8310000000000001e-06 2024-09-12T16:18:14.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.608 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:14.608 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297204+0000", 2024-09-12T16:18:14.608 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0832999999999999e-05 2024-09-12T16:18:14.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.608 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:14.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297210+0000", 2024-09-12T16:18:14.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1770000000000003e-06 2024-09-12T16:18:14.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:14.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358928+0000", 2024-09-12T16:18:14.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061717826000000003 2024-09-12T16:18:14.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:14.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358977+0000", 2024-09-12T16:18:14.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9514000000000001e-05 2024-09-12T16:18:14.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:14.610 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359050+0000", 2024-09-12T16:18:14.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2649000000000002e-05 2024-09-12T16:18:14.610 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.610 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:14.610 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.610 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5646 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4743168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:14.610 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:18:14.610 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 94.271889970999993, 2024-09-12T16:18:14.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061822122, 2024-09-12T16:18:14.610 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:14.610 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:14.610 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:14.610 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:14.610 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:14.611 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:14.611 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5646 2024-09-12T16:18:14.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.611 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:14.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.611 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:14.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:18:14.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.611 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:14.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:18:14.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:14.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:18:14.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3200000000000004e-07 2024-09-12T16:18:14.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:14.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297374+0000", 2024-09-12T16:18:14.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8240000000000001e-06 2024-09-12T16:18:14.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:14.613 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297384+0000", 2024-09-12T16:18:14.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5710000000000004e-06 2024-09-12T16:18:14.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.613 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.613 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:14.613 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297390+0000", 2024-09-12T16:18:14.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5130000000000002e-06 2024-09-12T16:18:14.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.613 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.613 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:14.613 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359080+0000", 2024-09-12T16:18:14.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061689569999999999 2024-09-12T16:18:14.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.613 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.614 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:14.614 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359134+0000", 2024-09-12T16:18:14.614 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3838999999999997e-05 2024-09-12T16:18:14.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.614 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:14.614 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359192+0000", 2024-09-12T16:18:14.614 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8072999999999998e-05 2024-09-12T16:18:14.614 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.614 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:14.614 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.614 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5647 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4751360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:14.614 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:18:14.615 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 94.271853285999995, 2024-09-12T16:18:14.615 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061927569000000002, 2024-09-12T16:18:14.615 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:14.615 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:14.615 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:14.615 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:14.615 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:14.615 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:14.615 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5647 2024-09-12T16:18:14.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.615 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:14.615 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.615 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:14.615 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:18:14.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.616 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:14.616 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:18:14.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.616 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:14.616 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297407+0000", 2024-09-12T16:18:14.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.46e-07 2024-09-12T16:18:14.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.617 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:14.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297409+0000", 2024-09-12T16:18:14.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.469e-06 2024-09-12T16:18:14.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.617 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:14.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297415+0000", 2024-09-12T16:18:14.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9259999999999997e-06 2024-09-12T16:18:14.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.617 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:14.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297419+0000", 2024-09-12T16:18:14.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3840000000000001e-06 2024-09-12T16:18:14.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.618 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:14.618 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359224+0000", 2024-09-12T16:18:14.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061805367999999999 2024-09-12T16:18:14.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.618 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:14.618 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359275+0000", 2024-09-12T16:18:14.619 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1338000000000002e-05 2024-09-12T16:18:14.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.619 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:14.620 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359334+0000", 2024-09-12T16:18:14.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8638000000000003e-05 2024-09-12T16:18:14.620 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.620 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:14.620 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.620 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5649 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4796416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:14.620 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:18:14.620 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 94.271798426999993, 2024-09-12T16:18:14.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.062018578999999997, 2024-09-12T16:18:14.620 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:14.621 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:14.621 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:14.621 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:14.621 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:14.621 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:14.621 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5649 2024-09-12T16:18:14.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.621 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:14.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.621 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:14.621 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:18:14.621 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.622 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.622 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:14.622 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:18:14.622 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.622 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.622 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:14.622 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297462+0000", 2024-09-12T16:18:14.622 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2399999999999998e-07 2024-09-12T16:18:14.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.622 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.622 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:14.622 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297465+0000", 2024-09-12T16:18:14.622 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.371e-06 2024-09-12T16:18:14.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.623 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:14.623 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297473+0000", 2024-09-12T16:18:14.623 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4699999999999996e-06 2024-09-12T16:18:14.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.623 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:14.623 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297478+0000", 2024-09-12T16:18:14.623 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2780000000000001e-06 2024-09-12T16:18:14.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.623 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:14.623 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359368+0000", 2024-09-12T16:18:14.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061889758000000003 2024-09-12T16:18:14.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.624 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:14.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359420+0000", 2024-09-12T16:18:14.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2574999999999997e-05 2024-09-12T16:18:14.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.624 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:14.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359480+0000", 2024-09-12T16:18:14.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9503000000000003e-05 2024-09-12T16:18:14.624 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.624 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:14.624 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.625 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.625 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.625 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5674 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4739072~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:14.625 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:18:14.625 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 94.271394658999995, 2024-09-12T16:18:14.625 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061762989999999997, 2024-09-12T16:18:14.625 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:14.625 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:14.625 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:14.626 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:14.626 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:14.626 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:14.626 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5674 2024-09-12T16:18:14.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.626 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:14.626 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.626 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:14.626 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:18:14.626 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.626 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.626 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:14.626 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:18:14.627 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.627 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.627 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:14.627 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297866+0000", 2024-09-12T16:18:14.627 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1900000000000001e-07 2024-09-12T16:18:14.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.627 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.627 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:14.627 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297870+0000", 2024-09-12T16:18:14.627 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3560000000000003e-06 2024-09-12T16:18:14.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.627 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.627 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:14.628 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297888+0000", 2024-09-12T16:18:14.628 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8088999999999999e-05 2024-09-12T16:18:14.628 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.628 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.628 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:14.628 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297904+0000", 2024-09-12T16:18:14.628 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5971e-05 2024-09-12T16:18:14.628 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.628 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.628 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:14.628 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359510+0000", 2024-09-12T16:18:14.628 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061605634999999999 2024-09-12T16:18:14.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:14.629 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359554+0000", 2024-09-12T16:18:14.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4024999999999999e-05 2024-09-12T16:18:14.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:14.629 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359628+0000", 2024-09-12T16:18:14.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4095000000000001e-05 2024-09-12T16:18:14.629 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.629 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:14.629 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.630 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.630 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5676 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4792320~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:14.630 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:18:14.630 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 94.271193578999998, 2024-09-12T16:18:14.630 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061720143999999998, 2024-09-12T16:18:14.630 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:14.630 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:14.630 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:14.630 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:14.630 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:14.630 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:14.630 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5676 2024-09-12T16:18:14.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.631 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:14.631 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.631 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:14.631 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:18:14.631 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.631 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.631 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.631 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:14.631 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:18:14.631 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.631 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.631 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.631 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:14.631 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298067+0000", 2024-09-12T16:18:14.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8199999999999999e-07 2024-09-12T16:18:14.632 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.632 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.632 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:14.632 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298070+0000", 2024-09-12T16:18:14.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.743e-06 2024-09-12T16:18:14.632 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.632 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.632 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:14.632 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298080+0000", 2024-09-12T16:18:14.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4059999999999994e-06 2024-09-12T16:18:14.632 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.632 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.633 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:14.633 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298088+0000", 2024-09-12T16:18:14.633 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0779999999999996e-06 2024-09-12T16:18:14.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.633 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.633 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:14.633 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359659+0000", 2024-09-12T16:18:14.633 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061570688999999998 2024-09-12T16:18:14.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.633 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.633 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:14.633 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359713+0000", 2024-09-12T16:18:14.633 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3939e-05 2024-09-12T16:18:14.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.634 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.634 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:14.634 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359786+0000", 2024-09-12T16:18:14.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3607000000000002e-05 2024-09-12T16:18:14.634 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.634 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:14.634 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.634 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.634 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5684 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4747264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:14.634 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:18:14.634 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 94.270726287000002, 2024-09-12T16:18:14.635 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061394799, 2024-09-12T16:18:14.635 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:14.635 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:14.635 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:14.635 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:14.635 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:14.635 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:14.635 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5684 2024-09-12T16:18:14.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.635 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:14.635 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.635 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:14.635 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:18:14.636 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.636 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.636 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:14.636 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:18:14.636 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.636 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.636 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:14.636 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298534+0000", 2024-09-12T16:18:14.636 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4399999999999999e-07 2024-09-12T16:18:14.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.637 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.637 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:14.637 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298539+0000", 2024-09-12T16:18:14.637 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5360000000000003e-06 2024-09-12T16:18:14.637 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.637 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.637 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:14.637 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298550+0000", 2024-09-12T16:18:14.637 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1499e-05 2024-09-12T16:18:14.637 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.637 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.637 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:14.637 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298558+0000", 2024-09-12T16:18:14.637 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3000000000000004e-06 2024-09-12T16:18:14.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.638 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.638 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:14.638 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359815+0000", 2024-09-12T16:18:14.638 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061257952999999997 2024-09-12T16:18:14.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.638 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.638 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:14.638 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359868+0000", 2024-09-12T16:18:14.638 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2317000000000001e-05 2024-09-12T16:18:14.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.638 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.638 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:14.639 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359928+0000", 2024-09-12T16:18:14.639 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0350000000000003e-05 2024-09-12T16:18:14.639 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.639 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:14.639 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.639 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.639 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5686 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4755456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:14.639 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:18:14.639 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 94.270558863000005, 2024-09-12T16:18:14.639 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061355082999999998, 2024-09-12T16:18:14.639 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:14.639 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:14.640 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:14.640 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:14.640 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:14.640 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:14.640 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5686 2024-09-12T16:18:14.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.640 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:14.640 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.640 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:14.640 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:18:14.640 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.640 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.641 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:14.641 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:18:14.641 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.641 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.641 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:14.641 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298702+0000", 2024-09-12T16:18:14.641 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2399999999999997e-07 2024-09-12T16:18:14.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.641 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.641 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:14.641 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298706+0000", 2024-09-12T16:18:14.641 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5700000000000003e-06 2024-09-12T16:18:14.642 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.642 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.642 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:14.642 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298718+0000", 2024-09-12T16:18:14.642 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1457999999999999e-05 2024-09-12T16:18:14.642 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.642 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.642 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:14.642 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298732+0000", 2024-09-12T16:18:14.642 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.452e-05 2024-09-12T16:18:14.642 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.642 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.643 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:14.643 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359956+0000", 2024-09-12T16:18:14.643 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061223626000000003 2024-09-12T16:18:14.643 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.643 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.643 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:14.643 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360000+0000", 2024-09-12T16:18:14.643 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3922999999999999e-05 2024-09-12T16:18:14.643 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.643 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.643 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:14.643 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360056+0000", 2024-09-12T16:18:14.643 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6162000000000002e-05 2024-09-12T16:18:14.643 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.643 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:14.644 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.644 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.644 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5688 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4800512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:14.644 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:18:14.644 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 94.270335810000006, 2024-09-12T16:18:14.644 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061270514999999998, 2024-09-12T16:18:14.644 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:14.644 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:14.644 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:14.644 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:14.644 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:14.645 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:14.645 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5688 2024-09-12T16:18:14.645 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.645 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:14.645 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.645 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:14.645 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:18:14.645 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.645 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.645 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.645 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:14.645 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:18:14.645 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.646 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.646 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.646 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:14.646 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298925+0000", 2024-09-12T16:18:14.646 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4e-07 2024-09-12T16:18:14.646 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.646 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.646 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:14.646 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298929+0000", 2024-09-12T16:18:14.646 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9890000000000003e-06 2024-09-12T16:18:14.646 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.646 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.646 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:14.646 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298936+0000", 2024-09-12T16:18:14.647 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.52e-06 2024-09-12T16:18:14.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.647 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.647 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:14.647 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298941+0000", 2024-09-12T16:18:14.647 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4800000000000003e-06 2024-09-12T16:18:14.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.647 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.647 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:14.647 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360087+0000", 2024-09-12T16:18:14.647 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061146143 2024-09-12T16:18:14.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.647 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.648 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:14.648 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360137+0000", 2024-09-12T16:18:14.648 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0584000000000002e-05 2024-09-12T16:18:14.648 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.648 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.648 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:14.648 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360194+0000", 2024-09-12T16:18:14.648 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6858999999999999e-05 2024-09-12T16:18:14.648 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.648 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:14.648 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.648 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.648 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.649 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5693 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4751360~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:14.649 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:18:14.649 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 94.269914173000004, 2024-09-12T16:18:14.649 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061139444000000001, 2024-09-12T16:18:14.649 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:14.649 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:14.649 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:14.649 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:14.649 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:14.649 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:14.649 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5693 2024-09-12T16:18:14.649 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.649 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:14.649 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.650 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:14.650 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:18:14.650 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.650 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.650 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:14.650 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:18:14.650 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.650 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.650 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:14.650 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299346+0000", 2024-09-12T16:18:14.650 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2300000000000001e-07 2024-09-12T16:18:14.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.650 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.651 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:14.651 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299349+0000", 2024-09-12T16:18:14.651 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5270000000000001e-06 2024-09-12T16:18:14.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.651 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.651 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:14.651 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299358+0000", 2024-09-12T16:18:14.651 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7030000000000001e-06 2024-09-12T16:18:14.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.651 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.651 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:14.651 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299364+0000", 2024-09-12T16:18:14.651 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7239999999999997e-06 2024-09-12T16:18:14.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.652 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.652 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:14.652 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360369+0000", 2024-09-12T16:18:14.652 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061004713000000002 2024-09-12T16:18:14.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.652 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.652 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:14.652 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360415+0000", 2024-09-12T16:18:14.652 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5926e-05 2024-09-12T16:18:14.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.652 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.652 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:14.652 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360485+0000", 2024-09-12T16:18:14.652 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0327999999999995e-05 2024-09-12T16:18:14.653 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.653 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:14.653 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.653 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.653 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.653 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5694 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4796416~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:14.653 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:18:14.653 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 94.269885144, 2024-09-12T16:18:14.653 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061258034000000003, 2024-09-12T16:18:14.653 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:14.653 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:14.653 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:14.653 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:14.654 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:14.654 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:14.654 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5694 2024-09-12T16:18:14.654 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.654 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:14.654 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.654 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:14.654 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:18:14.654 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.654 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.654 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.654 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:14.654 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:18:14.654 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.655 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.655 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.655 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:14.655 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301884+0000", 2024-09-12T16:18:14.655 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025090379999999999 2024-09-12T16:18:14.655 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.655 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.655 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:14.655 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301889+0000", 2024-09-12T16:18:14.655 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5879999999999997e-06 2024-09-12T16:18:14.655 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.655 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.655 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:14.655 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301901+0000", 2024-09-12T16:18:14.656 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1466e-05 2024-09-12T16:18:14.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.656 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.656 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:14.656 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301908+0000", 2024-09-12T16:18:14.656 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1999999999999997e-06 2024-09-12T16:18:14.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.656 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.656 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:14.656 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360513+0000", 2024-09-12T16:18:14.656 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.058605023999999999 2024-09-12T16:18:14.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.656 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.657 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:14.657 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360562+0000", 2024-09-12T16:18:14.657 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9546000000000003e-05 2024-09-12T16:18:14.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.657 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.657 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:14.657 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360633+0000", 2024-09-12T16:18:14.657 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0172000000000005e-05 2024-09-12T16:18:14.657 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.657 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:14.657 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.657 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.657 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5759 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4767744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:14.658 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:18:14.658 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 94.267091609999994, 2024-09-12T16:18:14.658 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061058604000000002, 2024-09-12T16:18:14.658 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:14.658 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:14.658 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:14.658 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:14.658 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:14.658 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:14.658 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5759 2024-09-12T16:18:14.658 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.658 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:14.658 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.658 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:14.659 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:18:14.659 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.659 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.659 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:14.659 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:18:14.659 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:14.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.659 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.659 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:14.659 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302548+0000", 2024-09-12T16:18:14.659 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00038011000000000002 2024-09-12T16:18:14.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.659 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.660 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:14.660 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302553+0000", 2024-09-12T16:18:14.660 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1830000000000002e-06 2024-09-12T16:18:14.660 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.660 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.660 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:14.660 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302564+0000", 2024-09-12T16:18:14.660 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1011e-05 2024-09-12T16:18:14.660 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.660 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.660 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:14.660 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302572+0000", 2024-09-12T16:18:14.660 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9009999999999994e-06 2024-09-12T16:18:14.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.661 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.661 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:14.661 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363102+0000", 2024-09-12T16:18:14.661 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.060529782999999997 2024-09-12T16:18:14.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.661 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.661 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:14.661 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363149+0000", 2024-09-12T16:18:14.661 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7321000000000003e-05 2024-09-12T16:18:14.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:14.661 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:14.661 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:14.661 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363227+0000", 2024-09-12T16:18:14.662 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7294999999999998e-05 2024-09-12T16:18:14.662 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.662 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:14.662 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.662 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:14.662 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:14.662 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:14.663 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:18:14.664 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:14.662+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:14.764 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:14.763+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:14.813 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:14.814 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:14.814 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:18:14.814 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:14.822 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:18:14.867 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:14.866+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:14.929 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:14.929 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:14.930 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:18:14.930 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:18:14.930 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:14.938 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:18:14.966 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:14.965+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:15.066 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:15.065+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:15.087 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:15.088 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:18:15.088 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:18:15.088 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:18:15.088 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.088 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.17 73/72 [PushOp(3:e9340267:::rbd_data.1155525b14e3.0000000000000031:f, version: 50'357, data_included: [0~4096,20480~4096,40960~8192,65536~4096,81920~8192,110592~4096,126976~8192,151552~4096,172032~8192,196608~4096,212992~8192,241664~4096,258048~8192,282624~4096,303104~8192,327680~4096,344064~8192,372736~4096,389120~8192,413696~4096,434176~8192,458752~4096,475136~8192,503808~4096,520192~8192,544768~4096,565248~8192,589824~4096,606208~8192,634880~4096,651264~8192,675840~4096,696320~8192,720896~4096,737280~8192,765952~4096,782336~8192,806912~4096,827392~8192,851968~4096,868352~8192,897024~4096,913408~8192,937984~4096,958464~8192,983040~4096,999424~8192,1028096~4096,1044480~4096], data_size: 294912, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:e9340267:::rbd_data.1155525b14e3.0000000000000031:f@50'357, size: 1048576, copy_subset: [(0, 1048576)], clone_subset: {}, snapset: f=[]:{f: [f]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T16:18:15.088 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.067448+0000", 2024-09-12T16:18:15.088 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 69.018748264999999, 2024-09-12T16:18:15.088 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003036721, 2024-09-12T16:18:15.088 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:15.088 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:15.088 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:15.088 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:15.089 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.089 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:15.089 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067448+0000", 2024-09-12T16:18:15.089 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.089 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.089 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.089 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:15.089 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067448+0000", 2024-09-12T16:18:15.089 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.089 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.089 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.089 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:15.089 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067449+0000", 2024-09-12T16:18:15.090 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2200000000000004e-07 2024-09-12T16:18:15.090 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.090 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.090 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:15.090 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067703+0000", 2024-09-12T16:18:15.090 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025377199999999998 2024-09-12T16:18:15.090 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.090 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.090 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:15.090 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067723+0000", 2024-09-12T16:18:15.090 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.986e-05 2024-09-12T16:18:15.090 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.090 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.091 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.091 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067743+0000", 2024-09-12T16:18:15.091 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9942e-05 2024-09-12T16:18:15.091 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.091 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.091 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:15.091 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067860+0000", 2024-09-12T16:18:15.091 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000116959 2024-09-12T16:18:15.091 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.091 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.091 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:15.091 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067872+0000", 2024-09-12T16:18:15.091 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2928000000000001e-05 2024-09-12T16:18:15.091 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.092 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.092 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:15.092 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.070485+0000", 2024-09-12T16:18:15.092 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0026127379999999999 2024-09-12T16:18:15.092 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.092 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:15.092 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.092 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.092 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.092 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5120.0:3941 3.17 e80/74 3:eff97428:::rbd_data.1155a3b3a26e.0000000000000060:head v 80'442, mlcod=79'439)", 2024-09-12T16:18:15.092 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:18:15.092 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 58.730407784000001, 2024-09-12T16:18:15.092 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0035981759999999998, 2024-09-12T16:18:15.093 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:15.093 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:15.093 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:15.093 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:15.093 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.093 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:15.093 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:18:15.093 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.093 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.093 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.093 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:15.093 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:18:15.094 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.094 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.094 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.094 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:15.094 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:18:15.094 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2e-07 2024-09-12T16:18:15.094 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.094 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.094 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:15.094 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355794+0000", 2024-09-12T16:18:15.094 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.865e-06 2024-09-12T16:18:15.094 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.094 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.094 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:15.094 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355956+0000", 2024-09-12T16:18:15.095 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016131699999999999 2024-09-12T16:18:15.095 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.095 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.095 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.095 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355964+0000", 2024-09-12T16:18:15.095 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7960000000000001e-06 2024-09-12T16:18:15.095 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.095 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.095 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:15.095 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.356320+0000", 2024-09-12T16:18:15.095 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000355612 2024-09-12T16:18:15.095 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.095 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.095 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:15.096 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.356337+0000", 2024-09-12T16:18:15.096 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6643e-05 2024-09-12T16:18:15.096 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.096 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.096 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:15.096 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.359340+0000", 2024-09-12T16:18:15.096 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003003618 2024-09-12T16:18:15.096 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.096 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.096 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:15.096 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.359387+0000", 2024-09-12T16:18:15.096 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6904999999999999e-05 2024-09-12T16:18:15.096 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.096 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:15.097 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.097 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.097 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.097 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2118 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1219, mlcod=88'1217)", 2024-09-12T16:18:15.097 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440434+0000", 2024-09-12T16:18:15.097 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 49.645762894000001, 2024-09-12T16:18:15.097 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003875543, 2024-09-12T16:18:15.097 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:15.097 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:15.097 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:15.097 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:15.097 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.097 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:15.097 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440434+0000", 2024-09-12T16:18:15.098 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.098 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.098 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.098 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:15.098 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440434+0000", 2024-09-12T16:18:15.098 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.098 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.098 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.098 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:15.098 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440435+0000", 2024-09-12T16:18:15.098 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8899999999999998e-07 2024-09-12T16:18:15.098 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.098 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.098 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:15.098 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440444+0000", 2024-09-12T16:18:15.099 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4599999999999992e-06 2024-09-12T16:18:15.099 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.099 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.099 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:15.099 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440459+0000", 2024-09-12T16:18:15.099 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4460999999999999e-05 2024-09-12T16:18:15.099 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.099 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.099 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.099 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440466+0000", 2024-09-12T16:18:15.099 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4340000000000003e-06 2024-09-12T16:18:15.099 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.100 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.100 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:15.100 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:18:15.100 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9054999999999997e-05 2024-09-12T16:18:15.100 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.100 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.100 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:15.100 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440535+0000", 2024-09-12T16:18:15.100 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.98e-05 2024-09-12T16:18:15.100 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.100 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.101 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:15.101 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444269+0000", 2024-09-12T16:18:15.101 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003734448 2024-09-12T16:18:15.101 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.101 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.101 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:15.101 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444309+0000", 2024-09-12T16:18:15.101 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0095999999999997e-05 2024-09-12T16:18:15.101 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.101 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:15.101 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.101 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.101 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.101 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2122 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1220, mlcod=88'1217)", 2024-09-12T16:18:15.102 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440484+0000", 2024-09-12T16:18:15.102 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 49.645712388, 2024-09-12T16:18:15.102 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0038538029999999998, 2024-09-12T16:18:15.102 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:15.102 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:15.102 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:15.102 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:15.102 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.102 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:15.102 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440484+0000", 2024-09-12T16:18:15.102 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.102 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.102 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.102 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:15.102 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440484+0000", 2024-09-12T16:18:15.103 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.103 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.103 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.103 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:15.103 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440485+0000", 2024-09-12T16:18:15.103 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6100000000000002e-07 2024-09-12T16:18:15.103 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.103 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.103 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:15.103 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440493+0000", 2024-09-12T16:18:15.103 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0169999999999996e-06 2024-09-12T16:18:15.103 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.103 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.103 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:15.104 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440501+0000", 2024-09-12T16:18:15.104 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9319999999999996e-06 2024-09-12T16:18:15.104 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.104 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.104 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.104 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440506+0000", 2024-09-12T16:18:15.104 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3510000000000001e-06 2024-09-12T16:18:15.104 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.104 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.104 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:15.104 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441319+0000", 2024-09-12T16:18:15.104 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00081295300000000005 2024-09-12T16:18:15.104 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.104 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.105 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:15.105 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441336+0000", 2024-09-12T16:18:15.105 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6897000000000001e-05 2024-09-12T16:18:15.105 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.105 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.105 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:15.105 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444311+0000", 2024-09-12T16:18:15.105 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029754510000000001 2024-09-12T16:18:15.105 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.105 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.105 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:15.105 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444338+0000", 2024-09-12T16:18:15.105 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6840999999999999e-05 2024-09-12T16:18:15.105 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.105 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:15.106 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.106 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.106 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.106 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2124 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1221, mlcod=88'1217)", 2024-09-12T16:18:15.106 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:18:15.106 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 49.645681816, 2024-09-12T16:18:15.106 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0038507229999999999, 2024-09-12T16:18:15.106 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:15.106 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:15.106 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:15.106 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:15.106 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.106 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:15.106 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:18:15.106 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.106 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.107 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.107 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:15.107 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:18:15.107 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.107 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.107 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.107 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:15.107 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:18:15.107 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8799999999999998e-07 2024-09-12T16:18:15.107 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.107 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.107 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:15.107 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440519+0000", 2024-09-12T16:18:15.107 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5499999999999999e-06 2024-09-12T16:18:15.107 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.108 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.108 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:15.108 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440525+0000", 2024-09-12T16:18:15.108 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1009999999999997e-06 2024-09-12T16:18:15.108 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.108 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.108 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.108 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440529+0000", 2024-09-12T16:18:15.108 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3749999999999996e-06 2024-09-12T16:18:15.108 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.108 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.108 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:15.108 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441883+0000", 2024-09-12T16:18:15.108 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0013538249999999999 2024-09-12T16:18:15.108 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.109 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.109 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:15.109 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441901+0000", 2024-09-12T16:18:15.109 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7972999999999999e-05 2024-09-12T16:18:15.109 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.109 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.109 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:15.109 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444341+0000", 2024-09-12T16:18:15.109 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002439568 2024-09-12T16:18:15.109 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.109 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.109 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:15.109 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444366+0000", 2024-09-12T16:18:15.109 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5043000000000001e-05 2024-09-12T16:18:15.109 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.109 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:15.110 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.110 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.110 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.110 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2327 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1222, mlcod=88'1217)", 2024-09-12T16:18:15.110 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440696+0000", 2024-09-12T16:18:15.110 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 49.645500474000002, 2024-09-12T16:18:15.110 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0036945739999999999, 2024-09-12T16:18:15.110 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:15.110 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:15.110 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:15.110 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:15.110 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.110 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:15.110 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440696+0000", 2024-09-12T16:18:15.110 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.110 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.111 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.111 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:15.111 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440696+0000", 2024-09-12T16:18:15.111 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.111 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.111 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.111 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:15.111 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440697+0000", 2024-09-12T16:18:15.111 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5899999999999996e-07 2024-09-12T16:18:15.111 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.111 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.111 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:15.111 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440702+0000", 2024-09-12T16:18:15.111 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0969999999999996e-06 2024-09-12T16:18:15.111 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.112 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.112 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:15.112 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440713+0000", 2024-09-12T16:18:15.112 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1114000000000001e-05 2024-09-12T16:18:15.112 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.112 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.112 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.112 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440719+0000", 2024-09-12T16:18:15.112 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1650000000000003e-06 2024-09-12T16:18:15.112 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.112 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.112 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:15.112 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.442435+0000", 2024-09-12T16:18:15.112 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017155440000000001 2024-09-12T16:18:15.113 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.113 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.113 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:15.113 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.442457+0000", 2024-09-12T16:18:15.113 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1793999999999998e-05 2024-09-12T16:18:15.113 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.113 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.113 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:15.113 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444367+0000", 2024-09-12T16:18:15.113 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0019101980000000001 2024-09-12T16:18:15.113 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.113 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.113 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:15.113 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444391+0000", 2024-09-12T16:18:15.113 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4003e-05 2024-09-12T16:18:15.114 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.114 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:15.114 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.114 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.114 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.114 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2487 3.1d e88/74 3:b8c395a6:::rbd_data.11558d85ce23.000000000000000b:head v 88'1225, mlcod=88'1223)", 2024-09-12T16:18:15.114 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:18:15.114 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 49.639986104999998, 2024-09-12T16:18:15.114 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033166039999999999, 2024-09-12T16:18:15.114 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:15.114 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:15.114 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:15.114 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:15.114 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.114 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:15.114 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:18:15.115 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.115 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.115 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.115 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:15.115 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:18:15.115 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.115 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.115 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.115 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:15.115 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:18:15.115 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9299999999999997e-07 2024-09-12T16:18:15.115 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.115 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.115 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:15.115 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446295+0000", 2024-09-12T16:18:15.115 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3153999999999997e-05 2024-09-12T16:18:15.116 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.116 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.116 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:15.116 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446309+0000", 2024-09-12T16:18:15.116 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4015e-05 2024-09-12T16:18:15.116 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.116 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.116 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.116 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446317+0000", 2024-09-12T16:18:15.116 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4880000000000007e-06 2024-09-12T16:18:15.116 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.116 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.116 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:15.116 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446373+0000", 2024-09-12T16:18:15.116 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5766000000000001e-05 2024-09-12T16:18:15.117 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.117 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.117 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:15.117 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446395+0000", 2024-09-12T16:18:15.117 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2500000000000001e-05 2024-09-12T16:18:15.117 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.117 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.117 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:15.117 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.449445+0000", 2024-09-12T16:18:15.117 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003049791 2024-09-12T16:18:15.117 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.117 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.117 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:15.117 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.449527+0000", 2024-09-12T16:18:15.117 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2096999999999997e-05 2024-09-12T16:18:15.118 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.118 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:15.118 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.118 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.118 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.118 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2493 3.2 e88/74 3:46cb4ff0:::rbd_data.11558d85ce23.000000000000000e:head v 88'372, mlcod=87'370)", 2024-09-12T16:18:15.118 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.447443+0000", 2024-09-12T16:18:15.118 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 49.638754167000002, 2024-09-12T16:18:15.118 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029120330000000001, 2024-09-12T16:18:15.118 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:15.118 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:15.118 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:15.118 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:15.118 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.118 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:15.118 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447443+0000", 2024-09-12T16:18:15.119 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.119 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.119 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.119 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:15.119 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447443+0000", 2024-09-12T16:18:15.119 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.119 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.119 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.119 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:15.119 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447443+0000", 2024-09-12T16:18:15.119 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4600000000000001e-07 2024-09-12T16:18:15.119 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.119 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.119 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:15.119 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447779+0000", 2024-09-12T16:18:15.120 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00033639800000000001 2024-09-12T16:18:15.120 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.120 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.120 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:15.120 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447790+0000", 2024-09-12T16:18:15.120 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0555e-05 2024-09-12T16:18:15.120 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.120 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.120 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.120 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447797+0000", 2024-09-12T16:18:15.120 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1729999999999998e-06 2024-09-12T16:18:15.120 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.120 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.120 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:15.120 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447862+0000", 2024-09-12T16:18:15.121 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4670000000000003e-05 2024-09-12T16:18:15.121 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.121 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.121 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:15.121 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447889+0000", 2024-09-12T16:18:15.121 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.773e-05 2024-09-12T16:18:15.121 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.121 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.121 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:15.121 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.450311+0000", 2024-09-12T16:18:15.121 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0024212510000000001 2024-09-12T16:18:15.121 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.121 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.122 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:15.122 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.450355+0000", 2024-09-12T16:18:15.122 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.401e-05 2024-09-12T16:18:15.122 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.122 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:15.122 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.122 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.122 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.122 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "pg_update_log_missing(3.5 epoch 92/74 rep_tid 1618 entries 92'520 (0'0) error 3:a46c381c:::rbd_data.1155c757bf36.000000000000002f:head by client.5577.0:14350 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 92'518)", 2024-09-12T16:18:15.122 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.408248+0000", 2024-09-12T16:18:15.122 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 44.677948287, 2024-09-12T16:18:15.122 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029209660000000001, 2024-09-12T16:18:15.122 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:15.122 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:15.122 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "reached pg", 2024-09-12T16:18:15.122 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:15.123 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.123 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:15.123 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408248+0000", 2024-09-12T16:18:15.123 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.123 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.123 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.123 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:15.123 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408248+0000", 2024-09-12T16:18:15.123 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.123 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.123 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.123 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:15.123 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408249+0000", 2024-09-12T16:18:15.123 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9800000000000002e-07 2024-09-12T16:18:15.124 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.124 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.124 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:15.124 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408259+0000", 2024-09-12T16:18:15.124 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1949999999999992e-06 2024-09-12T16:18:15.124 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.124 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.124 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:15.124 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408278+0000", 2024-09-12T16:18:15.124 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9157e-05 2024-09-12T16:18:15.124 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.124 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.124 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.124 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408291+0000", 2024-09-12T16:18:15.124 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3655000000000001e-05 2024-09-12T16:18:15.124 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.125 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.125 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:15.125 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408369+0000", 2024-09-12T16:18:15.125 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7804000000000002e-05 2024-09-12T16:18:15.125 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.125 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.125 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:15.125 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411169+0000", 2024-09-12T16:18:15.125 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002800257 2024-09-12T16:18:15.125 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.125 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:15.125 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.125 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.125 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.125 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "pg_update_log_missing(3.1d epoch 92/74 rep_tid 3087 entries 92'1280 (0'0) error 3:bc3c4c0b:::rbd_data.1155c757bf36.000000000000002c:head by client.5577.0:14343 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 90'1278)", 2024-09-12T16:18:15.126 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.408860+0000", 2024-09-12T16:18:15.126 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 44.677336658999998, 2024-09-12T16:18:15.126 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0056480419999999998, 2024-09-12T16:18:15.126 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:15.126 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:15.126 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "reached pg", 2024-09-12T16:18:15.126 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:15.126 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.126 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:15.126 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408860+0000", 2024-09-12T16:18:15.126 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.126 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.126 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.127 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:15.127 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408860+0000", 2024-09-12T16:18:15.127 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.127 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.127 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.127 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:15.127 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408861+0000", 2024-09-12T16:18:15.127 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6600000000000002e-07 2024-09-12T16:18:15.127 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.127 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.127 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:15.127 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408867+0000", 2024-09-12T16:18:15.127 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4150000000000004e-06 2024-09-12T16:18:15.128 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.128 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.128 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:15.128 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408881+0000", 2024-09-12T16:18:15.128 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4326e-05 2024-09-12T16:18:15.128 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.128 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.128 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.128 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408895+0000", 2024-09-12T16:18:15.128 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3903000000000001e-05 2024-09-12T16:18:15.128 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.128 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.128 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:15.128 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410566+0000", 2024-09-12T16:18:15.128 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001670822 2024-09-12T16:18:15.129 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.129 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.129 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:15.129 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414508+0000", 2024-09-12T16:18:15.129 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039421100000000004 2024-09-12T16:18:15.129 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.129 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:15.129 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.129 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.129 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.129 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "pg_update_log_missing(3.5 epoch 92/74 rep_tid 1621 entries 92'521 (0'0) error 3:a759f741:::rbd_data.1155c757bf36.0000000000000036:head by client.5577.0:14364 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 92'518)", 2024-09-12T16:18:15.129 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:18:15.129 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 44.676388181999997, 2024-09-12T16:18:15.129 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047586740000000001, 2024-09-12T16:18:15.129 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:15.130 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:15.130 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "reached pg", 2024-09-12T16:18:15.130 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:15.130 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.130 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:15.130 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:18:15.130 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.130 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.130 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.130 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:15.130 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:18:15.130 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.130 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.130 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.131 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:15.131 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:18:15.131 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.54e-07 2024-09-12T16:18:15.131 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.131 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.131 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:15.131 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409817+0000", 2024-09-12T16:18:15.131 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.028e-06 2024-09-12T16:18:15.131 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.131 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.131 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:15.131 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410047+0000", 2024-09-12T16:18:15.131 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022964599999999999 2024-09-12T16:18:15.131 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.132 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.132 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.132 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410067+0000", 2024-09-12T16:18:15.132 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0438999999999999e-05 2024-09-12T16:18:15.132 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.132 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.132 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:15.132 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411223+0000", 2024-09-12T16:18:15.132 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011560229999999999 2024-09-12T16:18:15.132 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.132 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.132 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:15.132 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414567+0000", 2024-09-12T16:18:15.132 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033437839999999998 2024-09-12T16:18:15.132 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.133 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:15.133 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.133 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.133 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.133 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14391 3.5 e92/74 3:a5105766:::rbd_data.1155c757bf36.0000000000000044:head v 92'523, mlcod=92'518)", 2024-09-12T16:18:15.133 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.410084+0000", 2024-09-12T16:18:15.133 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 44.676112312000001, 2024-09-12T16:18:15.133 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0046720299999999998, 2024-09-12T16:18:15.133 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:15.133 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:15.133 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:15.133 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:15.133 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.133 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:15.134 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410084+0000", 2024-09-12T16:18:15.134 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.134 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.134 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.135 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:15.135 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410084+0000", 2024-09-12T16:18:15.135 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.135 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.136 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.136 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:15.136 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410085+0000", 2024-09-12T16:18:15.136 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1900000000000002e-07 2024-09-12T16:18:15.136 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.136 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.136 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:15.136 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410091+0000", 2024-09-12T16:18:15.136 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1e-06 2024-09-12T16:18:15.136 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.136 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.136 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:15.136 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410100+0000", 2024-09-12T16:18:15.137 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6889999999999993e-06 2024-09-12T16:18:15.137 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.137 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.137 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.137 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410105+0000", 2024-09-12T16:18:15.137 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3199999999999999e-06 2024-09-12T16:18:15.137 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.137 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.137 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:15.137 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411563+0000", 2024-09-12T16:18:15.137 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00145795 2024-09-12T16:18:15.137 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.137 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.137 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:15.137 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411590+0000", 2024-09-12T16:18:15.138 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6570000000000001e-05 2024-09-12T16:18:15.138 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.138 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.138 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:15.138 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414571+0000", 2024-09-12T16:18:15.138 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029815710000000001 2024-09-12T16:18:15.138 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.138 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.138 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:15.138 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414756+0000", 2024-09-12T16:18:15.138 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018521100000000001 2024-09-12T16:18:15.138 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.138 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:15.139 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.139 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.139 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.139 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14405 3.5 e92/74 3:a0797093:::rbd_data.1155c757bf36.000000000000004b:head v 92'525, mlcod=92'518)", 2024-09-12T16:18:15.139 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.410119+0000", 2024-09-12T16:18:15.139 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 44.676077372000002, 2024-09-12T16:18:15.139 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047304000000000001, 2024-09-12T16:18:15.139 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:15.139 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:15.139 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:15.139 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:15.139 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.139 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:15.139 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410119+0000", 2024-09-12T16:18:15.139 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.140 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.140 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.140 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:15.140 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410119+0000", 2024-09-12T16:18:15.140 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.140 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.140 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.140 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:15.140 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410120+0000", 2024-09-12T16:18:15.140 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:18:15.140 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.140 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.140 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:15.140 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410126+0000", 2024-09-12T16:18:15.141 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1460000000000001e-06 2024-09-12T16:18:15.141 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.141 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.141 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:15.141 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410134+0000", 2024-09-12T16:18:15.141 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8879999999999997e-06 2024-09-12T16:18:15.141 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.141 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.141 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.141 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410140+0000", 2024-09-12T16:18:15.141 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0839999999999997e-06 2024-09-12T16:18:15.141 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.141 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.141 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:15.141 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412146+0000", 2024-09-12T16:18:15.142 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0020057569999999999 2024-09-12T16:18:15.142 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.142 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.142 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:15.142 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412163+0000", 2024-09-12T16:18:15.142 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7742000000000001e-05 2024-09-12T16:18:15.142 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.142 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.142 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:15.142 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414761+0000", 2024-09-12T16:18:15.142 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025979660000000002 2024-09-12T16:18:15.142 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.142 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.142 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:15.142 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414850+0000", 2024-09-12T16:18:15.143 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8426999999999999e-05 2024-09-12T16:18:15.143 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.143 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:15.143 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.143 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.143 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.143 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14435 3.1d e92/74 3:b810b250:::rbd_data.1155c757bf36.000000000000010b:head v 92'1282, mlcod=90'1278)", 2024-09-12T16:18:15.143 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:18:15.143 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 44.675234903000003, 2024-09-12T16:18:15.143 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039190579999999996, 2024-09-12T16:18:15.143 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:15.143 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:15.143 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:15.144 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:15.144 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.144 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:15.144 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:18:15.144 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.144 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.144 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.144 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:15.144 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:18:15.144 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.144 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.144 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.145 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:15.145 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:18:15.145 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5199999999999996e-07 2024-09-12T16:18:15.145 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.145 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.145 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:15.145 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410968+0000", 2024-09-12T16:18:15.145 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.305e-06 2024-09-12T16:18:15.145 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.145 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.145 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:15.145 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410986+0000", 2024-09-12T16:18:15.145 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8213999999999999e-05 2024-09-12T16:18:15.145 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.146 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.146 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.146 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410993+0000", 2024-09-12T16:18:15.146 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2849999999999997e-06 2024-09-12T16:18:15.146 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.146 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.146 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:15.146 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412228+0000", 2024-09-12T16:18:15.146 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0012347370000000001 2024-09-12T16:18:15.146 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.146 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.146 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:15.146 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412262+0000", 2024-09-12T16:18:15.147 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3531999999999997e-05 2024-09-12T16:18:15.147 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.147 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.147 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:15.147 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414854+0000", 2024-09-12T16:18:15.147 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002592039 2024-09-12T16:18:15.147 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.147 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.147 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:15.147 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414881+0000", 2024-09-12T16:18:15.147 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7294e-05 2024-09-12T16:18:15.147 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.147 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:15.147 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.148 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.148 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.148 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14434 3.5 e92/74 3:a09dd60f:::rbd_data.1155c757bf36.000000000000010a:head v 92'527, mlcod=92'518)", 2024-09-12T16:18:15.148 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.411186+0000", 2024-09-12T16:18:15.148 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 44.675010755999999, 2024-09-12T16:18:15.148 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0037696930000000002, 2024-09-12T16:18:15.148 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:15.148 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:15.148 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:15.148 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:15.148 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.148 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:15.149 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411186+0000", 2024-09-12T16:18:15.149 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.149 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.149 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.149 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:15.149 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411186+0000", 2024-09-12T16:18:15.149 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.149 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.149 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.149 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:15.149 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411187+0000", 2024-09-12T16:18:15.149 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3799999999999997e-07 2024-09-12T16:18:15.149 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.150 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.150 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:15.150 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411203+0000", 2024-09-12T16:18:15.150 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6793999999999999e-05 2024-09-12T16:18:15.150 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.150 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.150 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:15.150 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411323+0000", 2024-09-12T16:18:15.150 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011975499999999999 2024-09-12T16:18:15.150 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.150 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.150 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.150 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411332+0000", 2024-09-12T16:18:15.150 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4370000000000007e-06 2024-09-12T16:18:15.151 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.151 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.151 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:15.151 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.413073+0000", 2024-09-12T16:18:15.151 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001741827 2024-09-12T16:18:15.151 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.151 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.151 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:15.151 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.413091+0000", 2024-09-12T16:18:15.151 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8011000000000001e-05 2024-09-12T16:18:15.151 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.151 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.151 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:15.151 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414882+0000", 2024-09-12T16:18:15.152 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001790841 2024-09-12T16:18:15.152 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.152 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.152 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:15.152 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414956+0000", 2024-09-12T16:18:15.152 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.339e-05 2024-09-12T16:18:15.152 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.152 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:15.152 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.152 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.152 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.152 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14426 3.13 e92/74 3:c827d1d7:::rbd_data.1155c757bf36.0000000000000056:head v 92'741, mlcod=90'737)", 2024-09-12T16:18:15.152 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:18:15.152 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 44.670918843000003, 2024-09-12T16:18:15.152 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030296030000000001, 2024-09-12T16:18:15.153 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:15.153 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:15.153 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:15.153 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:15.153 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.153 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:15.153 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:18:15.153 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.153 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.153 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.153 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:15.153 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:18:15.153 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.153 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.153 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.154 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:15.154 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:18:15.154 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6300000000000001e-07 2024-09-12T16:18:15.154 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.154 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.154 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:15.154 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415282+0000", 2024-09-12T16:18:15.154 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6289999999999999e-06 2024-09-12T16:18:15.154 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.154 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.154 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:15.154 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415288+0000", 2024-09-12T16:18:15.154 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5520000000000001e-06 2024-09-12T16:18:15.154 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.154 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.155 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.155 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415293+0000", 2024-09-12T16:18:15.155 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6879999999999998e-06 2024-09-12T16:18:15.155 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.155 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.155 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:15.155 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415412+0000", 2024-09-12T16:18:15.155 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118579 2024-09-12T16:18:15.155 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.155 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.155 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:15.155 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415429+0000", 2024-09-12T16:18:15.155 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7501000000000001e-05 2024-09-12T16:18:15.155 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.155 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.156 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:15.156 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.418270+0000", 2024-09-12T16:18:15.156 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028404860000000001 2024-09-12T16:18:15.156 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.156 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.156 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:15.156 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.418307+0000", 2024-09-12T16:18:15.156 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7805000000000001e-05 2024-09-12T16:18:15.156 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.156 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:15.156 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.156 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.156 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.156 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14399 3.16 e92/75 3:6e4c3dfc:::rbd_data.1155c757bf36.0000000000000048:head v 92'1286, mlcod=90'1280)", 2024-09-12T16:18:15.156 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.415311+0000", 2024-09-12T16:18:15.157 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 44.670885929000001, 2024-09-12T16:18:15.157 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028826809999999998, 2024-09-12T16:18:15.157 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:15.157 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:15.157 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:15.157 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:15.157 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.157 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:15.157 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415311+0000", 2024-09-12T16:18:15.157 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.157 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.157 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.157 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:15.158 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415311+0000", 2024-09-12T16:18:15.158 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.158 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.158 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.158 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:15.158 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415311+0000", 2024-09-12T16:18:15.158 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0600000000000001e-07 2024-09-12T16:18:15.158 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.158 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.158 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:15.158 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415315+0000", 2024-09-12T16:18:15.158 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.172e-06 2024-09-12T16:18:15.158 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.158 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.159 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:15.159 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415322+0000", 2024-09-12T16:18:15.159 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0999999999999998e-06 2024-09-12T16:18:15.159 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.159 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.159 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.159 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415327+0000", 2024-09-12T16:18:15.159 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6430000000000003e-06 2024-09-12T16:18:15.159 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.159 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.159 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:15.160 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.416666+0000", 2024-09-12T16:18:15.160 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001338718 2024-09-12T16:18:15.160 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.160 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.160 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:15.160 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.416683+0000", 2024-09-12T16:18:15.160 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7628000000000001e-05 2024-09-12T16:18:15.160 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.160 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.160 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:15.160 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.418128+0000", 2024-09-12T16:18:15.160 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0014445440000000001 2024-09-12T16:18:15.160 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.161 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.161 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:15.161 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.418193+0000", 2024-09-12T16:18:15.161 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5569999999999997e-05 2024-09-12T16:18:15.161 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.161 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:15.161 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.161 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.161 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.161 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5384.0:1241 3.16 e95/75 3:6ee670ce:::rbd_data.1155b9894cdc.0000000000000005:head v 95'1303, mlcod=95'1301)", 2024-09-12T16:18:15.161 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:35.272164+0000", 2024-09-12T16:18:15.161 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.814032986999997, 2024-09-12T16:18:15.161 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015008743, 2024-09-12T16:18:15.161 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:15.162 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:15.162 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:15.162 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:15.162 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.162 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:15.162 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.272164+0000", 2024-09-12T16:18:15.162 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.162 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.162 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.162 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:15.162 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.272164+0000", 2024-09-12T16:18:15.162 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.162 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.162 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.162 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:15.163 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.272165+0000", 2024-09-12T16:18:15.163 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.311e-06 2024-09-12T16:18:15.163 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.163 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.163 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:15.163 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275503+0000", 2024-09-12T16:18:15.163 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003337881 2024-09-12T16:18:15.163 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.163 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.163 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:15.163 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275530+0000", 2024-09-12T16:18:15.163 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6797000000000001e-05 2024-09-12T16:18:15.163 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.163 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.164 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.164 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275541+0000", 2024-09-12T16:18:15.164 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1634000000000001e-05 2024-09-12T16:18:15.164 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.164 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.164 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:15.164 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275618+0000", 2024-09-12T16:18:15.164 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6811999999999996e-05 2024-09-12T16:18:15.164 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.164 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.164 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:15.164 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275642+0000", 2024-09-12T16:18:15.164 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4111999999999999e-05 2024-09-12T16:18:15.164 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.164 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.165 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:15.165 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287116+0000", 2024-09-12T16:18:15.165 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01147395 2024-09-12T16:18:15.165 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.165 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.165 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:15.165 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287172+0000", 2024-09-12T16:18:15.165 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6246000000000003e-05 2024-09-12T16:18:15.165 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.165 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:15.165 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.165 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.165 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.165 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5384.0:1246 3.f e95/74 3:f0725c44:::rbd_data.1155b9894cdc.0000000000000006:head v 95'356, mlcod=95'354)", 2024-09-12T16:18:15.166 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:35.276304+0000", 2024-09-12T16:18:15.166 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.80989306, 2024-09-12T16:18:15.166 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011209733, 2024-09-12T16:18:15.166 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:15.166 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:15.166 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:15.166 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:15.166 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.166 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:15.166 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.276304+0000", 2024-09-12T16:18:15.166 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.166 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.166 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.166 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:15.167 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.276304+0000", 2024-09-12T16:18:15.167 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.167 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.167 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.167 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:15.167 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.276305+0000", 2024-09-12T16:18:15.167 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2500000000000001e-06 2024-09-12T16:18:15.167 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.167 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.167 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:15.167 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279256+0000", 2024-09-12T16:18:15.167 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002951076 2024-09-12T16:18:15.167 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.167 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.167 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:15.168 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279281+0000", 2024-09-12T16:18:15.168 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4779000000000001e-05 2024-09-12T16:18:15.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.168 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.168 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.168 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279294+0000", 2024-09-12T16:18:15.168 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3614e-05 2024-09-12T16:18:15.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.168 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.168 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:15.168 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279366+0000", 2024-09-12T16:18:15.168 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2094000000000005e-05 2024-09-12T16:18:15.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.168 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.169 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:15.169 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279395+0000", 2024-09-12T16:18:15.169 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8337999999999999e-05 2024-09-12T16:18:15.169 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.169 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.169 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:15.169 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287479+0000", 2024-09-12T16:18:15.169 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0080844799999999998 2024-09-12T16:18:15.169 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.169 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.169 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:15.169 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287513+0000", 2024-09-12T16:18:15.169 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4102e-05 2024-09-12T16:18:15.169 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.170 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:15.170 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.170 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.170 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.170 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5578.0:2433 3.16 e98/75 3:691860ab:::rbd_data.11557f9bd67f.0000000000000014:head v 98'1330, mlcod=97'1328)", 2024-09-12T16:18:15.170 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:38.524867+0000", 2024-09-12T16:18:15.170 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 36.561329434999998, 2024-09-12T16:18:15.170 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028147279999999998, 2024-09-12T16:18:15.170 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:15.170 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:15.170 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:15.170 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:15.170 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.170 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:15.170 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.524867+0000", 2024-09-12T16:18:15.171 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.171 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.171 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.171 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:15.171 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.524867+0000", 2024-09-12T16:18:15.171 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:15.171 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.171 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.171 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:15.171 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.524868+0000", 2024-09-12T16:18:15.171 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4600000000000003e-07 2024-09-12T16:18:15.171 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.171 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.171 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:15.171 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.525251+0000", 2024-09-12T16:18:15.172 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00038322299999999997 2024-09-12T16:18:15.172 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.172 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.172 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:15.172 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.525266+0000", 2024-09-12T16:18:15.172 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4934e-05 2024-09-12T16:18:15.172 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.172 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.172 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.172 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.525274+0000", 2024-09-12T16:18:15.172 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.328e-06 2024-09-12T16:18:15.172 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.172 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.173 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:15.173 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.525363+0000", 2024-09-12T16:18:15.173 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9149999999999999e-05 2024-09-12T16:18:15.173 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.173 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.173 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:15.173 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.525383+0000", 2024-09-12T16:18:15.173 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0197e-05 2024-09-12T16:18:15.173 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.173 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.173 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:15.173 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.527638+0000", 2024-09-12T16:18:15.173 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0022551210000000001 2024-09-12T16:18:15.173 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:15.173 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:15.174 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:15.174 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.527682+0000", 2024-09-12T16:18:15.174 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3928999999999999e-05 2024-09-12T16:18:15.174 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.174 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:15.174 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.174 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:15.174 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:15.174 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:15.176 INFO:teuthology.orchestra.run.smithi017.stderr:set 3.1 pg_upmap mapping to [1,0] 2024-09-12T16:18:15.176 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:15.174+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:15.177 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:18:15.276 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:15.275+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:15.324 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:15.324 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:15.324 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:18:15.324 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:15.333 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:18:15.377 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:15.376+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:15.440 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:15.440 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:15.440 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:18:15.440 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:18:15.440 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:15.448 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:18:15.490 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:15.489+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:15.580 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:15.579+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:15.597 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:15.597 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:18:15.597 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:18:15.597 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:18:15.597 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.597 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3705 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14812160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:15.597 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:18:15.597 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 117.455954311, 2024-09-12T16:18:15.598 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053368831999999998, 2024-09-12T16:18:15.598 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:15.598 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:15.598 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:15.598 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:15.598 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:15.598 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:15.598 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3705 2024-09-12T16:18:15.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.598 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:15.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.598 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:15.598 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:18:15.599 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.599 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.599 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:15.599 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:18:15.599 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.599 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.599 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:15.599 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139932+0000", 2024-09-12T16:18:15.599 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012762099999999999 2024-09-12T16:18:15.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.599 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.600 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:15.600 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139935+0000", 2024-09-12T16:18:15.600 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.119e-06 2024-09-12T16:18:15.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.600 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.600 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:15.600 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139939+0000", 2024-09-12T16:18:15.600 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7999999999999998e-06 2024-09-12T16:18:15.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.600 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.601 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.601 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139953+0000", 2024-09-12T16:18:15.601 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3923999999999999e-05 2024-09-12T16:18:15.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.601 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.601 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:15.601 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192946+0000", 2024-09-12T16:18:15.601 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052992971 2024-09-12T16:18:15.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.601 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.601 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:15.601 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193035+0000", 2024-09-12T16:18:15.601 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9040000000000001e-05 2024-09-12T16:18:15.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.602 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.602 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:15.602 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193174+0000", 2024-09-12T16:18:15.602 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138357 2024-09-12T16:18:15.602 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.602 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:15.602 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.602 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.602 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3706 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14816256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:15.602 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:18:15.602 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 117.455799321, 2024-09-12T16:18:15.602 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053341723000000001, 2024-09-12T16:18:15.603 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:15.603 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:15.603 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:15.603 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:15.603 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:15.603 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:15.603 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3706 2024-09-12T16:18:15.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.603 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:15.603 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.603 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:15.603 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:18:15.603 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.604 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.604 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:15.604 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:18:15.604 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.604 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.604 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:15.604 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140090+0000", 2024-09-12T16:18:15.604 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013020100000000001 2024-09-12T16:18:15.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.604 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.604 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:15.604 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140097+0000", 2024-09-12T16:18:15.604 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0709999999999997e-06 2024-09-12T16:18:15.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.605 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:15.605 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140103+0000", 2024-09-12T16:18:15.605 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5450000000000003e-06 2024-09-12T16:18:15.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.605 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.605 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140106+0000", 2024-09-12T16:18:15.605 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3739999999999998e-06 2024-09-12T16:18:15.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.605 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:15.605 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193190+0000", 2024-09-12T16:18:15.605 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053084131999999999 2024-09-12T16:18:15.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.606 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:15.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193232+0000", 2024-09-12T16:18:15.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1517000000000002e-05 2024-09-12T16:18:15.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.606 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:15.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193302+0000", 2024-09-12T16:18:15.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9882999999999995e-05 2024-09-12T16:18:15.606 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.606 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:15.606 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.607 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3707 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14820352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:15.607 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:18:15.607 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 117.455647332, 2024-09-12T16:18:15.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053452771000000003, 2024-09-12T16:18:15.607 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:15.607 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:15.607 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:15.607 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:15.607 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:15.607 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:15.607 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3707 2024-09-12T16:18:15.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.607 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:15.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.607 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:15.608 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:18:15.608 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.608 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:15.608 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:18:15.608 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.608 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:15.608 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140219+0000", 2024-09-12T16:18:15.608 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106902 2024-09-12T16:18:15.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.608 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:15.609 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140225+0000", 2024-09-12T16:18:15.609 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3199999999999996e-06 2024-09-12T16:18:15.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.609 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.609 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:15.609 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140230+0000", 2024-09-12T16:18:15.609 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8969999999999999e-06 2024-09-12T16:18:15.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.609 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.609 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.609 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140233+0000", 2024-09-12T16:18:15.609 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2119999999999999e-06 2024-09-12T16:18:15.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.609 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.610 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:15.610 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193339+0000", 2024-09-12T16:18:15.610 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053105556999999998 2024-09-12T16:18:15.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.610 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:15.610 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193431+0000", 2024-09-12T16:18:15.610 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1837999999999997e-05 2024-09-12T16:18:15.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.610 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:15.610 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193565+0000", 2024-09-12T16:18:15.610 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013404500000000001 2024-09-12T16:18:15.610 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.611 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:15.611 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.611 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3708 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14824448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:15.611 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:18:15.611 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 117.45551849, 2024-09-12T16:18:15.611 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053468190999999998, 2024-09-12T16:18:15.611 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:15.611 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:15.611 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:15.611 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:15.611 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:15.611 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:15.612 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3708 2024-09-12T16:18:15.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.612 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:15.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.612 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:15.612 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:18:15.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.612 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:15.612 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:18:15.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.613 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:15.613 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140351+0000", 2024-09-12T16:18:15.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110096 2024-09-12T16:18:15.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.613 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:15.613 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140358+0000", 2024-09-12T16:18:15.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.306e-06 2024-09-12T16:18:15.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.613 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:15.613 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140368+0000", 2024-09-12T16:18:15.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0225e-05 2024-09-12T16:18:15.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.614 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140372+0000", 2024-09-12T16:18:15.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6169999999999998e-06 2024-09-12T16:18:15.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.614 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:15.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193594+0000", 2024-09-12T16:18:15.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053222419999999999 2024-09-12T16:18:15.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.614 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:15.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193640+0000", 2024-09-12T16:18:15.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.587e-05 2024-09-12T16:18:15.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:15.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193709+0000", 2024-09-12T16:18:15.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8657000000000004e-05 2024-09-12T16:18:15.615 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.615 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:15.615 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.615 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3709 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14828544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:15.615 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:18:15.615 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 117.455381522, 2024-09-12T16:18:15.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594033999999999, 2024-09-12T16:18:15.615 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:15.616 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:15.616 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:15.616 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:15.616 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:15.616 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:15.616 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3709 2024-09-12T16:18:15.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.616 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:15.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:15.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:18:15.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:15.617 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:18:15.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:15.617 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140499+0000", 2024-09-12T16:18:15.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121019 2024-09-12T16:18:15.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:15.617 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140501+0000", 2024-09-12T16:18:15.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2369999999999999e-06 2024-09-12T16:18:15.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.618 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:15.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140506+0000", 2024-09-12T16:18:15.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.639e-06 2024-09-12T16:18:15.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.618 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140509+0000", 2024-09-12T16:18:15.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3419999999999999e-06 2024-09-12T16:18:15.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.618 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:15.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193743+0000", 2024-09-12T16:18:15.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053234311999999999 2024-09-12T16:18:15.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:15.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193833+0000", 2024-09-12T16:18:15.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9883999999999995e-05 2024-09-12T16:18:15.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:15.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193972+0000", 2024-09-12T16:18:15.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138601 2024-09-12T16:18:15.619 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.619 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:15.619 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.620 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3710 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14832640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:15.620 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:18:15.620 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 117.45524417599999, 2024-09-12T16:18:15.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053607324999999997, 2024-09-12T16:18:15.620 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:15.620 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:15.620 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:15.620 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:15.620 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:15.620 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:15.620 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3710 2024-09-12T16:18:15.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.621 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:15.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:15.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:18:15.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:15.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:18:15.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:15.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140664+0000", 2024-09-12T16:18:15.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014918700000000001 2024-09-12T16:18:15.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:15.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140674+0000", 2024-09-12T16:18:15.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8379999999999997e-06 2024-09-12T16:18:15.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:15.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140694+0000", 2024-09-12T16:18:15.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0145000000000001e-05 2024-09-12T16:18:15.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140703+0000", 2024-09-12T16:18:15.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5150000000000006e-06 2024-09-12T16:18:15.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:15.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194006+0000", 2024-09-12T16:18:15.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053303370000000003 2024-09-12T16:18:15.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:15.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194051+0000", 2024-09-12T16:18:15.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5012000000000002e-05 2024-09-12T16:18:15.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:15.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194122+0000", 2024-09-12T16:18:15.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1258000000000001e-05 2024-09-12T16:18:15.624 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.624 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:15.624 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.624 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3711 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14836736~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:15.624 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:18:15.624 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 117.455042728, 2024-09-12T16:18:15.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053670799999999998, 2024-09-12T16:18:15.624 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:15.624 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:15.624 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:15.624 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:15.625 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:15.625 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:15.625 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3711 2024-09-12T16:18:15.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.625 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:15.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:15.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:18:15.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:15.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:18:15.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:15.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140782+0000", 2024-09-12T16:18:15.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5549999999999994e-05 2024-09-12T16:18:15.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:15.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140786+0000", 2024-09-12T16:18:15.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.89e-06 2024-09-12T16:18:15.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:15.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140796+0000", 2024-09-12T16:18:15.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0057e-05 2024-09-12T16:18:15.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140819+0000", 2024-09-12T16:18:15.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3005000000000001e-05 2024-09-12T16:18:15.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:15.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194159+0000", 2024-09-12T16:18:15.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053340324000000001 2024-09-12T16:18:15.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:15.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194248+0000", 2024-09-12T16:18:15.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9209000000000006e-05 2024-09-12T16:18:15.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:15.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194387+0000", 2024-09-12T16:18:15.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138765 2024-09-12T16:18:15.628 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.628 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:15.628 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.628 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3712 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14840832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:15.628 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:18:15.629 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 117.45492827, 2024-09-12T16:18:15.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053699068000000003, 2024-09-12T16:18:15.629 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:15.629 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:15.629 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:15.629 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:15.629 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:15.629 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:15.629 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3712 2024-09-12T16:18:15.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.629 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:15.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:15.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:18:15.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:15.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:18:15.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:15.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140900+0000", 2024-09-12T16:18:15.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9014e-05 2024-09-12T16:18:15.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:15.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140904+0000", 2024-09-12T16:18:15.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0940000000000001e-06 2024-09-12T16:18:15.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:15.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140933+0000", 2024-09-12T16:18:15.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8996000000000002e-05 2024-09-12T16:18:15.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140945+0000", 2024-09-12T16:18:15.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1909000000000001e-05 2024-09-12T16:18:15.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:15.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194415+0000", 2024-09-12T16:18:15.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053470403 2024-09-12T16:18:15.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:15.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194460+0000", 2024-09-12T16:18:15.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5145000000000002e-05 2024-09-12T16:18:15.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:15.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194530+0000", 2024-09-12T16:18:15.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9506999999999997e-05 2024-09-12T16:18:15.633 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.633 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:15.633 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.633 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3713 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14844928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:15.633 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:18:15.633 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 117.45479521, 2024-09-12T16:18:15.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053821236000000001, 2024-09-12T16:18:15.633 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:15.633 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:15.633 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:15.633 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:15.633 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:15.633 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:15.634 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3713 2024-09-12T16:18:15.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.634 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:15.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:15.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:18:15.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:15.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:18:15.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:15.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141078+0000", 2024-09-12T16:18:15.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114162 2024-09-12T16:18:15.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:15.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141090+0000", 2024-09-12T16:18:15.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.19e-05 2024-09-12T16:18:15.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:15.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141100+0000", 2024-09-12T16:18:15.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0447e-05 2024-09-12T16:18:15.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141108+0000", 2024-09-12T16:18:15.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7190000000000001e-06 2024-09-12T16:18:15.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:15.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194564+0000", 2024-09-12T16:18:15.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053455729 2024-09-12T16:18:15.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:15.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194652+0000", 2024-09-12T16:18:15.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8288999999999994e-05 2024-09-12T16:18:15.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:15.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194785+0000", 2024-09-12T16:18:15.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013299000000000001 2024-09-12T16:18:15.637 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.637 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:15.637 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.637 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3714 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14849024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:15.637 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:18:15.637 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 117.454639281, 2024-09-12T16:18:15.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053816382000000003, 2024-09-12T16:18:15.637 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:15.637 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:15.637 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:15.637 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:15.638 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:15.638 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:15.638 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3714 2024-09-12T16:18:15.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.638 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:15.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:15.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:18:15.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:15.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:18:15.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:15.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141182+0000", 2024-09-12T16:18:15.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1805999999999997e-05 2024-09-12T16:18:15.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:15.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141185+0000", 2024-09-12T16:18:15.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5930000000000002e-06 2024-09-12T16:18:15.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:15.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141194+0000", 2024-09-12T16:18:15.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5760000000000006e-06 2024-09-12T16:18:15.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141222+0000", 2024-09-12T16:18:15.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8034999999999998e-05 2024-09-12T16:18:15.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:15.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194817+0000", 2024-09-12T16:18:15.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594887000000001 2024-09-12T16:18:15.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:15.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194860+0000", 2024-09-12T16:18:15.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3714999999999997e-05 2024-09-12T16:18:15.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:15.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194936+0000", 2024-09-12T16:18:15.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5770000000000001e-05 2024-09-12T16:18:15.641 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.641 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:15.641 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.641 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3715 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14853120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:15.642 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:18:15.642 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 117.454515624, 2024-09-12T16:18:15.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053962307000000001, 2024-09-12T16:18:15.642 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:15.642 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:15.642 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:15.642 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:15.642 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:15.642 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:15.642 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3715 2024-09-12T16:18:15.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.642 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:15.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:15.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:18:15.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:15.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:18:15.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:15.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141417+0000", 2024-09-12T16:18:15.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017384099999999999 2024-09-12T16:18:15.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:15.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141422+0000", 2024-09-12T16:18:15.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7310000000000001e-06 2024-09-12T16:18:15.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:15.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141434+0000", 2024-09-12T16:18:15.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2058e-05 2024-09-12T16:18:15.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141442+0000", 2024-09-12T16:18:15.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7610000000000007e-06 2024-09-12T16:18:15.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:15.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194973+0000", 2024-09-12T16:18:15.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053530618000000002 2024-09-12T16:18:15.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:15.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195063+0000", 2024-09-12T16:18:15.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0927000000000005e-05 2024-09-12T16:18:15.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:15.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195206+0000", 2024-09-12T16:18:15.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142371 2024-09-12T16:18:15.646 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.646 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:15.646 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.646 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3716 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14857216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:15.646 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:18:15.646 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 117.45430577400001, 2024-09-12T16:18:15.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053916360000000003, 2024-09-12T16:18:15.647 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:15.647 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:15.647 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:15.647 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:15.647 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:15.647 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:15.647 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3716 2024-09-12T16:18:15.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.647 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:15.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:15.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:18:15.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:15.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:18:15.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:15.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142933+0000", 2024-09-12T16:18:15.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014796290000000001 2024-09-12T16:18:15.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:15.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142937+0000", 2024-09-12T16:18:15.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5760000000000002e-06 2024-09-12T16:18:15.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:15.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142946+0000", 2024-09-12T16:18:15.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0380000000000005e-06 2024-09-12T16:18:15.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142951+0000", 2024-09-12T16:18:15.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9749999999999998e-06 2024-09-12T16:18:15.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:15.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195246+0000", 2024-09-12T16:18:15.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052295358 2024-09-12T16:18:15.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:15.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195299+0000", 2024-09-12T16:18:15.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2976999999999998e-05 2024-09-12T16:18:15.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:15.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195370+0000", 2024-09-12T16:18:15.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0807000000000002e-05 2024-09-12T16:18:15.651 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.652 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:15.652 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.652 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3721 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14877696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:15.652 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:18:15.652 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 117.45273232300001, 2024-09-12T16:18:15.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053422994000000001, 2024-09-12T16:18:15.652 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:15.652 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:15.652 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:15.652 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:15.652 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:15.652 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:15.653 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3721 2024-09-12T16:18:15.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.653 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:15.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:15.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:18:15.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:15.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:18:15.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:15.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:18:15.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:18:15.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:15.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143028+0000", 2024-09-12T16:18:15.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7399999999999991e-07 2024-09-12T16:18:15.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:15.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143031+0000", 2024-09-12T16:18:15.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7599999999999998e-06 2024-09-12T16:18:15.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143034+0000", 2024-09-12T16:18:15.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9780000000000001e-06 2024-09-12T16:18:15.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:15.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196220+0000", 2024-09-12T16:18:15.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053186341999999998 2024-09-12T16:18:15.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:15.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196313+0000", 2024-09-12T16:18:15.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2676000000000005e-05 2024-09-12T16:18:15.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:15.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196450+0000", 2024-09-12T16:18:15.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137052 2024-09-12T16:18:15.657 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.657 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:15.657 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.657 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3722 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14881792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:15.657 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:18:15.657 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 117.452722431, 2024-09-12T16:18:15.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053556835999999997, 2024-09-12T16:18:15.657 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:15.657 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:15.657 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:15.658 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:15.658 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:15.658 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:15.658 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3722 2024-09-12T16:18:15.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.658 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:15.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:15.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:18:15.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:15.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:18:15.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:15.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:18:15.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.11e-07 2024-09-12T16:18:15.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:15.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143038+0000", 2024-09-12T16:18:15.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2399999999999996e-07 2024-09-12T16:18:15.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:15.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143041+0000", 2024-09-12T16:18:15.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8030000000000001e-06 2024-09-12T16:18:15.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143043+0000", 2024-09-12T16:18:15.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3140000000000002e-06 2024-09-12T16:18:15.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:15.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196481+0000", 2024-09-12T16:18:15.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053437601000000001 2024-09-12T16:18:15.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:15.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196525+0000", 2024-09-12T16:18:15.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4280000000000003e-05 2024-09-12T16:18:15.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:15.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196594+0000", 2024-09-12T16:18:15.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8702999999999996e-05 2024-09-12T16:18:15.661 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.661 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:15.661 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.661 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3723 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14885888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:15.662 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:18:15.662 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 117.452713249, 2024-09-12T16:18:15.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053815546999999998, 2024-09-12T16:18:15.662 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:15.662 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:15.662 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:15.662 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:15.662 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:15.662 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:15.662 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3723 2024-09-12T16:18:15.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.662 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:15.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:15.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:18:15.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:15.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:18:15.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:15.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148994+0000", 2024-09-12T16:18:15.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059481330000000004 2024-09-12T16:18:15.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:15.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148999+0000", 2024-09-12T16:18:15.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7140000000000001e-06 2024-09-12T16:18:15.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:15.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149008+0000", 2024-09-12T16:18:15.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4350000000000003e-06 2024-09-12T16:18:15.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149021+0000", 2024-09-12T16:18:15.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2514000000000001e-05 2024-09-12T16:18:15.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:15.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196630+0000", 2024-09-12T16:18:15.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047609758000000002 2024-09-12T16:18:15.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:15.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196724+0000", 2024-09-12T16:18:15.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3522000000000003e-05 2024-09-12T16:18:15.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:15.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196861+0000", 2024-09-12T16:18:15.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013747100000000001 2024-09-12T16:18:15.665 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.665 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:15.665 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.666 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4438 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15719424~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:15.666 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:18:15.666 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 117.307832472, 2024-09-12T16:18:15.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367981000000002, 2024-09-12T16:18:15.666 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:15.666 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:15.666 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:15.666 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:15.666 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:15.666 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:15.666 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4438 2024-09-12T16:18:15.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.667 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:15.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:15.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:18:15.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:15.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:18:15.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:15.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:18:15.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3e-07 2024-09-12T16:18:15.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:15.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287930+0000", 2024-09-12T16:18:15.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-12T16:18:15.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:15.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287937+0000", 2024-09-12T16:18:15.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.08e-06 2024-09-12T16:18:15.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287943+0000", 2024-09-12T16:18:15.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5709999999999997e-06 2024-09-12T16:18:15.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:15.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341068+0000", 2024-09-12T16:18:15.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053125101000000001 2024-09-12T16:18:15.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:15.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341154+0000", 2024-09-12T16:18:15.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6100999999999994e-05 2024-09-12T16:18:15.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:15.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341295+0000", 2024-09-12T16:18:15.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014087999999999999 2024-09-12T16:18:15.670 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.671 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:15.671 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.671 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4439 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15723520~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:15.671 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:18:15.671 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 117.30780831200001, 2024-09-12T16:18:15.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053526799, 2024-09-12T16:18:15.671 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:15.671 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:15.672 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:15.672 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:15.672 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:15.672 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:15.672 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4439 2024-09-12T16:18:15.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.672 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:15.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:15.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:18:15.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:15.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:18:15.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:15.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:18:15.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-07 2024-09-12T16:18:15.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:15.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287953+0000", 2024-09-12T16:18:15.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1349999999999999e-06 2024-09-12T16:18:15.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:15.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287960+0000", 2024-09-12T16:18:15.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-12T16:18:15.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287965+0000", 2024-09-12T16:18:15.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1580000000000004e-06 2024-09-12T16:18:15.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:15.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341332+0000", 2024-09-12T16:18:15.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367009 2024-09-12T16:18:15.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:15.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341402+0000", 2024-09-12T16:18:15.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9759999999999996e-05 2024-09-12T16:18:15.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:15.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341478+0000", 2024-09-12T16:18:15.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5412000000000002e-05 2024-09-12T16:18:15.675 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.675 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:15.675 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.675 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4440 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15727616~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:15.676 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:18:15.676 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 117.30778720799999, 2024-09-12T16:18:15.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053761601999999999, 2024-09-12T16:18:15.676 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:15.676 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:15.676 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:15.676 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:15.676 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:15.676 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:15.676 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4440 2024-09-12T16:18:15.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.676 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:15.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:15.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:18:15.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:15.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:18:15.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:15.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:18:15.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:18:15.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:15.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287974+0000", 2024-09-12T16:18:15.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0540000000000002e-06 2024-09-12T16:18:15.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:15.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287980+0000", 2024-09-12T16:18:15.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9440000000000002e-06 2024-09-12T16:18:15.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287987+0000", 2024-09-12T16:18:15.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5889999999999999e-06 2024-09-12T16:18:15.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:15.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341502+0000", 2024-09-12T16:18:15.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053515199999999999 2024-09-12T16:18:15.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:15.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341595+0000", 2024-09-12T16:18:15.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3097000000000007e-05 2024-09-12T16:18:15.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:15.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341734+0000", 2024-09-12T16:18:15.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013832800000000001 2024-09-12T16:18:15.680 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.680 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:15.680 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.680 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2209 3.1 3:85f36d3b:::rbd_data.1155ccb1894c.0000000000000004:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:18:15.680 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:18:15.680 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 78.224102070000001, 2024-09-12T16:18:15.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.060659365, 2024-09-12T16:18:15.680 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:15.681 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:15.681 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:15.681 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:15.681 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:18:15.681 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:18:15.681 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2209 2024-09-12T16:18:15.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.681 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:15.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:15.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:18:15.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:15.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:18:15.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:15.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371658+0000", 2024-09-12T16:18:15.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1570000000000001e-06 2024-09-12T16:18:15.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:15.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393414+0000", 2024-09-12T16:18:15.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021755495999999999 2024-09-12T16:18:15.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:15.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393447+0000", 2024-09-12T16:18:15.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3630000000000002e-05 2024-09-12T16:18:15.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393462+0000", 2024-09-12T16:18:15.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5048999999999999e-05 2024-09-12T16:18:15.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:15.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393556+0000", 2024-09-12T16:18:15.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3549999999999997e-05 2024-09-12T16:18:15.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:15.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393697+0000", 2024-09-12T16:18:15.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000141414 2024-09-12T16:18:15.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T16:18:15.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.394944+0000", 2024-09-12T16:18:15.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012463039999999999 2024-09-12T16:18:15.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:15.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.431803+0000", 2024-09-12T16:18:15.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0368594 2024-09-12T16:18:15.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:18:15.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432268+0000", 2024-09-12T16:18:15.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046457600000000002 2024-09-12T16:18:15.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:18:15.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432293+0000", 2024-09-12T16:18:15.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.527e-05 2024-09-12T16:18:15.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:15.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432316+0000", 2024-09-12T16:18:15.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3519e-05 2024-09-12T16:18:15.686 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.686 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:15.686 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.686 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:9400 3.1f 3:feea9999:::rbd_data.1155338d0570.0000000000000007:head [read 32768~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-12T16:18:15.686 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:20.012502+0000", 2024-09-12T16:18:15.686 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.583257078000003, 2024-09-12T16:18:15.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.000678049, 2024-09-12T16:18:15.686 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:15.686 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:15.686 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:15.686 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:15.687 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:18:15.687 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:18:15.687 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 9400 2024-09-12T16:18:15.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.687 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:15.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:15.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012502+0000", 2024-09-12T16:18:15.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:15.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012502+0000", 2024-09-12T16:18:15.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:15.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012504+0000", 2024-09-12T16:18:15.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5939999999999999e-06 2024-09-12T16:18:15.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:15.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012511+0000", 2024-09-12T16:18:15.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0840000000000003e-06 2024-09-12T16:18:15.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:15.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012525+0000", 2024-09-12T16:18:15.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4538999999999999e-05 2024-09-12T16:18:15.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012532+0000", 2024-09-12T16:18:15.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8310000000000003e-06 2024-09-12T16:18:15.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:15.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012605+0000", 2024-09-12T16:18:15.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2387999999999999e-05 2024-09-12T16:18:15.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T16:18:15.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012617+0000", 2024-09-12T16:18:15.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2167999999999999e-05 2024-09-12T16:18:15.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:15.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:21.012823+0000", 2024-09-12T16:18:15.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0002068230000001 2024-09-12T16:18:15.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:15.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:21.012975+0000", 2024-09-12T16:18:15.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015196200000000001 2024-09-12T16:18:15.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:15.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:21.013180+0000", 2024-09-12T16:18:15.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020466000000000001 2024-09-12T16:18:15.691 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.691 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:15.691 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.691 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.691 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:15.691 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:15.692 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:18:15.693 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:15.691+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:15.793 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:15.792+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:15.800 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:15.800 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:18:15.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.800 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:27683 3.1 3.d6dd1621 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e127)", 2024-09-12T16:18:15.800 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:15.196201+0000", 2024-09-12T16:18:15.800 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.60365940200000001, 2024-09-12T16:18:15.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.60367702400000001, 2024-09-12T16:18:15.801 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:15.801 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:15.801 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "waiting for peered", 2024-09-12T16:18:15.801 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:15.801 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:18:15.801 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:18:15.801 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 27683 2024-09-12T16:18:15.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.801 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:15.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:15.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196201+0000", 2024-09-12T16:18:15.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:15.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196201+0000", 2024-09-12T16:18:15.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:15.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196202+0000", 2024-09-12T16:18:15.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4929999999999999e-06 2024-09-12T16:18:15.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:15.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196209+0000", 2024-09-12T16:18:15.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2269999999999998e-06 2024-09-12T16:18:15.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:15.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196221+0000", 2024-09-12T16:18:15.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2517000000000001e-05 2024-09-12T16:18:15.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196229+0000", 2024-09-12T16:18:15.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3250000000000008e-06 2024-09-12T16:18:15.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:15.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196293+0000", 2024-09-12T16:18:15.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3975999999999999e-05 2024-09-12T16:18:15.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T16:18:15.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196299+0000", 2024-09-12T16:18:15.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3000000000000001e-06 2024-09-12T16:18:15.805 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.805 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:15.805 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.805 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:27740 3.1 3.859365c1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e127)", 2024-09-12T16:18:15.805 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:15.209778+0000", 2024-09-12T16:18:15.805 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.59008227300000005, 2024-09-12T16:18:15.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.59013791199999999, 2024-09-12T16:18:15.805 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:15.805 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:15.805 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "waiting for peered", 2024-09-12T16:18:15.805 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:15.805 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:18:15.805 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:18:15.806 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 27740 2024-09-12T16:18:15.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.806 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:15.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:15.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209778+0000", 2024-09-12T16:18:15.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:15.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209778+0000", 2024-09-12T16:18:15.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:15.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209779+0000", 2024-09-12T16:18:15.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.274e-06 2024-09-12T16:18:15.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:15.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209785+0000", 2024-09-12T16:18:15.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3310000000000003e-06 2024-09-12T16:18:15.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:15.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209799+0000", 2024-09-12T16:18:15.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.448e-05 2024-09-12T16:18:15.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209806+0000", 2024-09-12T16:18:15.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3479999999999998e-06 2024-09-12T16:18:15.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:15.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209864+0000", 2024-09-12T16:18:15.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7395999999999997e-05 2024-09-12T16:18:15.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T16:18:15.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209871+0000", 2024-09-12T16:18:15.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1149999999999996e-06 2024-09-12T16:18:15.809 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.809 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:15.809 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.809 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:27742 3.1 3.d09829a1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e127)", 2024-09-12T16:18:15.809 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:15.210634+0000", 2024-09-12T16:18:15.810 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.58922577700000001, 2024-09-12T16:18:15.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.58931916699999998, 2024-09-12T16:18:15.810 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:15.810 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:15.810 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "waiting for peered", 2024-09-12T16:18:15.810 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:15.810 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:18:15.810 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:18:15.810 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 27742 2024-09-12T16:18:15.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.810 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:15.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.810 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:15.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210634+0000", 2024-09-12T16:18:15.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.811 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.811 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:15.811 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210634+0000", 2024-09-12T16:18:15.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.811 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.811 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:15.811 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210635+0000", 2024-09-12T16:18:15.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8100000000000001e-07 2024-09-12T16:18:15.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.811 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:15.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210641+0000", 2024-09-12T16:18:15.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.429e-06 2024-09-12T16:18:15.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:15.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210656+0000", 2024-09-12T16:18:15.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5557e-05 2024-09-12T16:18:15.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210663+0000", 2024-09-12T16:18:15.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5930000000000002e-06 2024-09-12T16:18:15.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:15.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210713+0000", 2024-09-12T16:18:15.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0488000000000002e-05 2024-09-12T16:18:15.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T16:18:15.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210722+0000", 2024-09-12T16:18:15.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0790000000000001e-06 2024-09-12T16:18:15.813 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.813 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:15.813 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.814 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:27745 3.1 3.36f5b621 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e127)", 2024-09-12T16:18:15.814 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:15.211355+0000", 2024-09-12T16:18:15.814 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.58850517499999999, 2024-09-12T16:18:15.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.58862704099999996, 2024-09-12T16:18:15.814 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:15.814 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:15.814 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "waiting for peered", 2024-09-12T16:18:15.814 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:15.814 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:18:15.814 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:18:15.814 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 27745 2024-09-12T16:18:15.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.814 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:15.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.815 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:15.815 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211355+0000", 2024-09-12T16:18:15.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.815 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:15.815 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211355+0000", 2024-09-12T16:18:15.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:15.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.815 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:15.815 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211356+0000", 2024-09-12T16:18:15.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9599999999999998e-07 2024-09-12T16:18:15.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.816 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:15.816 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211360+0000", 2024-09-12T16:18:15.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0419999999999996e-06 2024-09-12T16:18:15.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.816 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:15.816 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211373+0000", 2024-09-12T16:18:15.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3183000000000001e-05 2024-09-12T16:18:15.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.816 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:15.816 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211381+0000", 2024-09-12T16:18:15.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0499999999999992e-06 2024-09-12T16:18:15.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:15.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211438+0000", 2024-09-12T16:18:15.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6576999999999997e-05 2024-09-12T16:18:15.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:15.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:15.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T16:18:15.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211445+0000", 2024-09-12T16:18:15.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.391e-06 2024-09-12T16:18:15.817 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.817 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:15.817 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.817 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:15.817 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-12T16:18:15.817 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 4 2024-09-12T16:18:15.818 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:15.819 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:18:15.894 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:15.893+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:15.925 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:15.925 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:15.925 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:18:15.925 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:18:15.925 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:15.934 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:18:15.995 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:15.994+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:16.042 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:16.042 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:18:16.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:18:16.042 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:18:16.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.042 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1571 3.b 3:d046566d:::rbd_data.1155525b14e3.0000000000000001:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:18:16.042 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:18:16.042 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 94.887742630999995, 2024-09-12T16:18:16.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064439785999999999, 2024-09-12T16:18:16.042 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.043 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.043 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:16.043 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.043 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:18:16.043 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:18:16.043 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1571 2024-09-12T16:18:16.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.043 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:18:16.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:18:16.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:18:16.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5400000000000002e-07 2024-09-12T16:18:16.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152567+0000", 2024-09-12T16:18:16.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.131e-06 2024-09-12T16:18:16.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152574+0000", 2024-09-12T16:18:16.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1840000000000002e-06 2024-09-12T16:18:16.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152579+0000", 2024-09-12T16:18:16.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.152e-06 2024-09-12T16:18:16.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153671+0000", 2024-09-12T16:18:16.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001092078 2024-09-12T16:18:16.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153779+0000", 2024-09-12T16:18:16.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108461 2024-09-12T16:18:16.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217004+0000", 2024-09-12T16:18:16.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.063224426 2024-09-12T16:18:16.046 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.046 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.046 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.047 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1581 3.4 3:22e34893:::rbd_data.1155525b14e3.0000000000000005:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:18:16.047 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:18:16.047 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 94.887645505999998, 2024-09-12T16:18:16.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064484407999999993, 2024-09-12T16:18:16.047 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.047 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.047 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:16.047 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.047 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:18:16.047 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:18:16.047 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1581 2024-09-12T16:18:16.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.047 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:18:16.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:18:16.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152662+0000", 2024-09-12T16:18:16.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.65e-07 2024-09-12T16:18:16.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152664+0000", 2024-09-12T16:18:16.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9829999999999999e-06 2024-09-12T16:18:16.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152670+0000", 2024-09-12T16:18:16.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2260000000000002e-06 2024-09-12T16:18:16.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152675+0000", 2024-09-12T16:18:16.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7990000000000001e-06 2024-09-12T16:18:16.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.216945+0000", 2024-09-12T16:18:16.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064270341999999994 2024-09-12T16:18:16.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217040+0000", 2024-09-12T16:18:16.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5242999999999996e-05 2024-09-12T16:18:16.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217146+0000", 2024-09-12T16:18:16.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010545 2024-09-12T16:18:16.051 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.051 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.051 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.051 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2207 3.0 3:05fdc61f:::rbd_data.1155ccb1894c.0000000000000003:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:18:16.051 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:18:16.051 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 78.669601944999997, 2024-09-12T16:18:16.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.05105382, 2024-09-12T16:18:16.051 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.051 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.051 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:16.051 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.052 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:18:16.052 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:18:16.052 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2207 2024-09-12T16:18:16.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.052 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:18:16.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:18:16.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370706+0000", 2024-09-12T16:18:16.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7800000000000001e-07 2024-09-12T16:18:16.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391581+0000", 2024-09-12T16:18:16.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020875624999999998 2024-09-12T16:18:16.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391608+0000", 2024-09-12T16:18:16.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6412999999999999e-05 2024-09-12T16:18:16.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391618+0000", 2024-09-12T16:18:16.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9240000000000002e-06 2024-09-12T16:18:16.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391705+0000", 2024-09-12T16:18:16.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7489000000000002e-05 2024-09-12T16:18:16.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391838+0000", 2024-09-12T16:18:16.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132865 2024-09-12T16:18:16.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 2", 2024-09-12T16:18:16.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.392587+0000", 2024-09-12T16:18:16.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074930000000000005 2024-09-12T16:18:16.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:16.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.420095+0000", 2024-09-12T16:18:16.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027507949 2024-09-12T16:18:16.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:18:16.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421610+0000", 2024-09-12T16:18:16.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001515195 2024-09-12T16:18:16.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:18:16.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421681+0000", 2024-09-12T16:18:16.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0320000000000004e-05 2024-09-12T16:18:16.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421759+0000", 2024-09-12T16:18:16.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7961999999999997e-05 2024-09-12T16:18:16.057 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.057 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.057 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.057 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11082 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 3350528~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:16.057 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.876283+0000", 2024-09-12T16:18:16.057 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.164023288999999, 2024-09-12T16:18:16.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044907159000000002, 2024-09-12T16:18:16.057 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.057 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.058 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:16.058 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.058 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:16.058 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:16.058 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11082 2024-09-12T16:18:16.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.058 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876283+0000", 2024-09-12T16:18:16.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876283+0000", 2024-09-12T16:18:16.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876284+0000", 2024-09-12T16:18:16.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7300000000000002e-07 2024-09-12T16:18:16.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876286+0000", 2024-09-12T16:18:16.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2089999999999999e-06 2024-09-12T16:18:16.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876292+0000", 2024-09-12T16:18:16.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9399999999999999e-06 2024-09-12T16:18:16.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876297+0000", 2024-09-12T16:18:16.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9200000000000003e-06 2024-09-12T16:18:16.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921094+0000", 2024-09-12T16:18:16.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044797311999999999 2024-09-12T16:18:16.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921136+0000", 2024-09-12T16:18:16.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1625000000000002e-05 2024-09-12T16:18:16.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921191+0000", 2024-09-12T16:18:16.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4780000000000001e-05 2024-09-12T16:18:16.061 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.061 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.061 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.062 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11083 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 3399680~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:16.062 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.876304+0000", 2024-09-12T16:18:16.062 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.164002537999998, 2024-09-12T16:18:16.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045070883999999999, 2024-09-12T16:18:16.062 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.062 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.062 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:16.062 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.062 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:16.062 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:16.062 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11083 2024-09-12T16:18:16.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.062 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876304+0000", 2024-09-12T16:18:16.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876304+0000", 2024-09-12T16:18:16.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876305+0000", 2024-09-12T16:18:16.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4099999999999999e-07 2024-09-12T16:18:16.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.064 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.064 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876307+0000", 2024-09-12T16:18:16.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9470000000000002e-06 2024-09-12T16:18:16.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.064 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.064 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876312+0000", 2024-09-12T16:18:16.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7540000000000003e-06 2024-09-12T16:18:16.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.064 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.064 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876318+0000", 2024-09-12T16:18:16.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3589999999999999e-06 2024-09-12T16:18:16.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921221+0000", 2024-09-12T16:18:16.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044903464999999997 2024-09-12T16:18:16.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921266+0000", 2024-09-12T16:18:16.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4795000000000001e-05 2024-09-12T16:18:16.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921375+0000", 2024-09-12T16:18:16.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000109023 2024-09-12T16:18:16.066 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.066 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.066 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.066 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11084 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 3448832~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:16.066 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.876324+0000", 2024-09-12T16:18:16.066 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.163982421, 2024-09-12T16:18:16.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045172474999999997, 2024-09-12T16:18:16.066 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.066 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.067 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:16.067 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.067 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:16.067 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:16.067 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11084 2024-09-12T16:18:16.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.067 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876324+0000", 2024-09-12T16:18:16.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876324+0000", 2024-09-12T16:18:16.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876411+0000", 2024-09-12T16:18:16.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6292000000000007e-05 2024-09-12T16:18:16.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876418+0000", 2024-09-12T16:18:16.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3309999999999998e-06 2024-09-12T16:18:16.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876426+0000", 2024-09-12T16:18:16.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3850000000000002e-06 2024-09-12T16:18:16.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876436+0000", 2024-09-12T16:18:16.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8749999999999995e-06 2024-09-12T16:18:16.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921403+0000", 2024-09-12T16:18:16.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044966385999999997 2024-09-12T16:18:16.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921445+0000", 2024-09-12T16:18:16.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1953000000000003e-05 2024-09-12T16:18:16.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921497+0000", 2024-09-12T16:18:16.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2253000000000003e-05 2024-09-12T16:18:16.070 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.070 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.070 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.071 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11085 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 3497984~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:16.071 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.876449+0000", 2024-09-12T16:18:16.071 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.163857911000001, 2024-09-12T16:18:16.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045173054999999997, 2024-09-12T16:18:16.071 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.071 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.071 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:16.071 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.071 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:16.071 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:16.071 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11085 2024-09-12T16:18:16.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.071 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876449+0000", 2024-09-12T16:18:16.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876449+0000", 2024-09-12T16:18:16.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.881997+0000", 2024-09-12T16:18:16.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055481209999999996 2024-09-12T16:18:16.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.882002+0000", 2024-09-12T16:18:16.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8269999999999997e-06 2024-09-12T16:18:16.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.882013+0000", 2024-09-12T16:18:16.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0869999999999999e-05 2024-09-12T16:18:16.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.882020+0000", 2024-09-12T16:18:16.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5839999999999997e-06 2024-09-12T16:18:16.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921523+0000", 2024-09-12T16:18:16.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039502411000000001 2024-09-12T16:18:16.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921566+0000", 2024-09-12T16:18:16.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3353000000000003e-05 2024-09-12T16:18:16.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921622+0000", 2024-09-12T16:18:16.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5889e-05 2024-09-12T16:18:16.075 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.075 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.075 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.075 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11136 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 6004736~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:16.075 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883172+0000", 2024-09-12T16:18:16.075 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.157134734, 2024-09-12T16:18:16.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044900554000000002, 2024-09-12T16:18:16.076 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.076 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.076 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:16.076 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.076 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:16.076 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:16.076 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11136 2024-09-12T16:18:16.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.076 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.076 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.076 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883172+0000", 2024-09-12T16:18:16.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883172+0000", 2024-09-12T16:18:16.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883172+0000", 2024-09-12T16:18:16.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5199999999999998e-07 2024-09-12T16:18:16.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883174+0000", 2024-09-12T16:18:16.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1169999999999998e-06 2024-09-12T16:18:16.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883181+0000", 2024-09-12T16:18:16.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0920000000000003e-06 2024-09-12T16:18:16.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883186+0000", 2024-09-12T16:18:16.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0900000000000004e-06 2024-09-12T16:18:16.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.927988+0000", 2024-09-12T16:18:16.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044802373999999999 2024-09-12T16:18:16.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928032+0000", 2024-09-12T16:18:16.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3717999999999997e-05 2024-09-12T16:18:16.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928073+0000", 2024-09-12T16:18:16.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0810999999999999e-05 2024-09-12T16:18:16.079 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.079 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.080 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.080 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11137 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 6053888~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:16.080 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883204+0000", 2024-09-12T16:18:16.080 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.157102554000002, 2024-09-12T16:18:16.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044978854999999998, 2024-09-12T16:18:16.080 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.080 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.080 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:16.080 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.080 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:16.080 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:16.081 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11137 2024-09-12T16:18:16.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.081 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.081 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.081 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883204+0000", 2024-09-12T16:18:16.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.081 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.081 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883204+0000", 2024-09-12T16:18:16.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883205+0000", 2024-09-12T16:18:16.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6700000000000003e-07 2024-09-12T16:18:16.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883207+0000", 2024-09-12T16:18:16.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4370000000000001e-06 2024-09-12T16:18:16.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883214+0000", 2024-09-12T16:18:16.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1840000000000002e-06 2024-09-12T16:18:16.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883220+0000", 2024-09-12T16:18:16.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5010000000000004e-06 2024-09-12T16:18:16.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928098+0000", 2024-09-12T16:18:16.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044878058999999998 2024-09-12T16:18:16.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928140+0000", 2024-09-12T16:18:16.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1990000000000003e-05 2024-09-12T16:18:16.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928183+0000", 2024-09-12T16:18:16.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3117000000000001e-05 2024-09-12T16:18:16.084 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.084 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.084 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.085 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11138 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 6103040~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:16.085 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883227+0000", 2024-09-12T16:18:16.085 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.157079321000001, 2024-09-12T16:18:16.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045063931000000002, 2024-09-12T16:18:16.085 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.085 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.085 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:16.085 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.085 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:16.085 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:16.085 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11138 2024-09-12T16:18:16.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.085 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883227+0000", 2024-09-12T16:18:16.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883227+0000", 2024-09-12T16:18:16.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883228+0000", 2024-09-12T16:18:16.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5600000000000005e-07 2024-09-12T16:18:16.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883230+0000", 2024-09-12T16:18:16.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1210000000000001e-06 2024-09-12T16:18:16.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883236+0000", 2024-09-12T16:18:16.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1670000000000004e-06 2024-09-12T16:18:16.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883241+0000", 2024-09-12T16:18:16.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9060000000000001e-06 2024-09-12T16:18:16.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928211+0000", 2024-09-12T16:18:16.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044969229999999999 2024-09-12T16:18:16.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928252+0000", 2024-09-12T16:18:16.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1671000000000001e-05 2024-09-12T16:18:16.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928291+0000", 2024-09-12T16:18:16.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9180000000000001e-05 2024-09-12T16:18:16.089 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.089 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.089 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.089 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11139 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 6152192~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:16.089 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883248+0000", 2024-09-12T16:18:16.089 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.157059047000001, 2024-09-12T16:18:16.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045153225999999998, 2024-09-12T16:18:16.089 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.089 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.089 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:16.089 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.089 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:16.090 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:16.090 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11139 2024-09-12T16:18:16.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.090 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883248+0000", 2024-09-12T16:18:16.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883248+0000", 2024-09-12T16:18:16.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883248+0000", 2024-09-12T16:18:16.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9999999999999998e-07 2024-09-12T16:18:16.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883250+0000", 2024-09-12T16:18:16.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0660000000000002e-06 2024-09-12T16:18:16.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883256+0000", 2024-09-12T16:18:16.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8699999999999997e-06 2024-09-12T16:18:16.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883261+0000", 2024-09-12T16:18:16.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0490000000000003e-06 2024-09-12T16:18:16.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928316+0000", 2024-09-12T16:18:16.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045055398000000003 2024-09-12T16:18:16.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928359+0000", 2024-09-12T16:18:16.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2286000000000001e-05 2024-09-12T16:18:16.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928401+0000", 2024-09-12T16:18:16.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2157000000000003e-05 2024-09-12T16:18:16.093 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.093 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.093 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.094 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11140 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 6201344~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:16.094 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883267+0000", 2024-09-12T16:18:16.094 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.157039280999999, 2024-09-12T16:18:16.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045241199000000003, 2024-09-12T16:18:16.094 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.094 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.094 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:16.094 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.094 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:16.094 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:16.094 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11140 2024-09-12T16:18:16.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.094 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.095 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883267+0000", 2024-09-12T16:18:16.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.095 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883267+0000", 2024-09-12T16:18:16.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.095 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883268+0000", 2024-09-12T16:18:16.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8700000000000001e-07 2024-09-12T16:18:16.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.096 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.096 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883270+0000", 2024-09-12T16:18:16.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3420000000000002e-06 2024-09-12T16:18:16.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.096 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.096 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883276+0000", 2024-09-12T16:18:16.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0310000000000004e-06 2024-09-12T16:18:16.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.096 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883281+0000", 2024-09-12T16:18:16.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1259999999999997e-06 2024-09-12T16:18:16.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928428+0000", 2024-09-12T16:18:16.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045146276999999999 2024-09-12T16:18:16.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928469+0000", 2024-09-12T16:18:16.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1007000000000002e-05 2024-09-12T16:18:16.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928509+0000", 2024-09-12T16:18:16.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0028999999999999e-05 2024-09-12T16:18:16.098 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.098 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.098 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.098 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11141 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 6250496~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:16.098 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883288+0000", 2024-09-12T16:18:16.098 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.157018684000001, 2024-09-12T16:18:16.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045331594000000003, 2024-09-12T16:18:16.098 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.099 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.099 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:16.099 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.099 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:16.099 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:16.099 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11141 2024-09-12T16:18:16.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.099 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883288+0000", 2024-09-12T16:18:16.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883288+0000", 2024-09-12T16:18:16.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883288+0000", 2024-09-12T16:18:16.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0200000000000003e-07 2024-09-12T16:18:16.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883290+0000", 2024-09-12T16:18:16.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9350000000000001e-06 2024-09-12T16:18:16.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883296+0000", 2024-09-12T16:18:16.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.913e-06 2024-09-12T16:18:16.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883302+0000", 2024-09-12T16:18:16.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.879e-06 2024-09-12T16:18:16.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928534+0000", 2024-09-12T16:18:16.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045231544999999998 2024-09-12T16:18:16.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928577+0000", 2024-09-12T16:18:16.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3676e-05 2024-09-12T16:18:16.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928620+0000", 2024-09-12T16:18:16.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2243999999999997e-05 2024-09-12T16:18:16.102 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.103 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.103 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.103 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11271 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3174400~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:16.103 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883316+0000", 2024-09-12T16:18:16.103 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.156990623999999, 2024-09-12T16:18:16.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045477308000000001, 2024-09-12T16:18:16.103 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.103 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.103 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:16.103 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.103 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:16.103 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:16.104 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11271 2024-09-12T16:18:16.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.104 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.104 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.104 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883316+0000", 2024-09-12T16:18:16.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.104 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.104 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883316+0000", 2024-09-12T16:18:16.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.105 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883317+0000", 2024-09-12T16:18:16.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9200000000000001e-07 2024-09-12T16:18:16.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.105 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883319+0000", 2024-09-12T16:18:16.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2670000000000001e-06 2024-09-12T16:18:16.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.105 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883326+0000", 2024-09-12T16:18:16.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6000000000000003e-06 2024-09-12T16:18:16.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883331+0000", 2024-09-12T16:18:16.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1719999999999998e-06 2024-09-12T16:18:16.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928647+0000", 2024-09-12T16:18:16.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045316457999999997 2024-09-12T16:18:16.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928689+0000", 2024-09-12T16:18:16.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1352e-05 2024-09-12T16:18:16.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928793+0000", 2024-09-12T16:18:16.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000104867 2024-09-12T16:18:16.107 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.107 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.107 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.107 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11272 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3223552~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:16.107 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883338+0000", 2024-09-12T16:18:16.107 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.156968763999998, 2024-09-12T16:18:16.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045595268000000001, 2024-09-12T16:18:16.108 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.108 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.108 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:16.108 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.108 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:16.108 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:16.108 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11272 2024-09-12T16:18:16.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.108 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883338+0000", 2024-09-12T16:18:16.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883338+0000", 2024-09-12T16:18:16.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883339+0000", 2024-09-12T16:18:16.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8599999999999998e-07 2024-09-12T16:18:16.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883341+0000", 2024-09-12T16:18:16.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1449999999999998e-06 2024-09-12T16:18:16.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883348+0000", 2024-09-12T16:18:16.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0110000000000003e-06 2024-09-12T16:18:16.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883353+0000", 2024-09-12T16:18:16.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2360000000000004e-06 2024-09-12T16:18:16.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928819+0000", 2024-09-12T16:18:16.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045466392000000001 2024-09-12T16:18:16.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928869+0000", 2024-09-12T16:18:16.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9829e-05 2024-09-12T16:18:16.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928933+0000", 2024-09-12T16:18:16.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3968999999999997e-05 2024-09-12T16:18:16.111 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.111 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.111 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.111 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11273 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3272704~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:16.111 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883359+0000", 2024-09-12T16:18:16.112 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.156947452000001, 2024-09-12T16:18:16.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045735142999999999, 2024-09-12T16:18:16.112 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.112 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.112 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:16.112 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.112 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:16.112 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:16.112 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11273 2024-09-12T16:18:16.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.112 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.112 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.112 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883359+0000", 2024-09-12T16:18:16.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883359+0000", 2024-09-12T16:18:16.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883360+0000", 2024-09-12T16:18:16.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9400000000000001e-07 2024-09-12T16:18:16.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883367+0000", 2024-09-12T16:18:16.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8530000000000003e-06 2024-09-12T16:18:16.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883373+0000", 2024-09-12T16:18:16.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9989999999999997e-06 2024-09-12T16:18:16.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883378+0000", 2024-09-12T16:18:16.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3369999999999999e-06 2024-09-12T16:18:16.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928950+0000", 2024-09-12T16:18:16.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045571751000000001 2024-09-12T16:18:16.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.115 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.115 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928992+0000", 2024-09-12T16:18:16.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1891000000000003e-05 2024-09-12T16:18:16.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.115 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.115 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929094+0000", 2024-09-12T16:18:16.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010291800000000001 2024-09-12T16:18:16.115 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.115 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.115 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.115 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11274 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3321856~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:16.116 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883385+0000", 2024-09-12T16:18:16.116 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.156921935, 2024-09-12T16:18:16.116 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045864239000000001, 2024-09-12T16:18:16.116 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.116 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.116 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:16.116 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.116 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:16.116 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:16.116 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11274 2024-09-12T16:18:16.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.116 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883385+0000", 2024-09-12T16:18:16.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.117 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.117 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883385+0000", 2024-09-12T16:18:16.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.117 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.117 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883385+0000", 2024-09-12T16:18:16.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4799999999999999e-07 2024-09-12T16:18:16.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.117 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.117 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883388+0000", 2024-09-12T16:18:16.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3199999999999998e-06 2024-09-12T16:18:16.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.118 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.118 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883394+0000", 2024-09-12T16:18:16.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2020000000000001e-06 2024-09-12T16:18:16.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.118 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.118 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883400+0000", 2024-09-12T16:18:16.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8510000000000004e-06 2024-09-12T16:18:16.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.118 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929123+0000", 2024-09-12T16:18:16.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045723235000000001 2024-09-12T16:18:16.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929166+0000", 2024-09-12T16:18:16.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2769999999999999e-05 2024-09-12T16:18:16.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929249+0000", 2024-09-12T16:18:16.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3412999999999996e-05 2024-09-12T16:18:16.119 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.119 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.120 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.120 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.120 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11275 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3371008~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:16.120 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883416+0000", 2024-09-12T16:18:16.120 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.156890325999999, 2024-09-12T16:18:16.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.046042315, 2024-09-12T16:18:16.120 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.120 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.120 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:16.120 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.120 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:16.120 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:16.121 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11275 2024-09-12T16:18:16.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.121 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.121 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883416+0000", 2024-09-12T16:18:16.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.121 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883416+0000", 2024-09-12T16:18:16.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883417+0000", 2024-09-12T16:18:16.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4700000000000001e-07 2024-09-12T16:18:16.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883419+0000", 2024-09-12T16:18:16.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2029999999999999e-06 2024-09-12T16:18:16.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883426+0000", 2024-09-12T16:18:16.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.579e-06 2024-09-12T16:18:16.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883431+0000", 2024-09-12T16:18:16.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5679999999999999e-06 2024-09-12T16:18:16.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929290+0000", 2024-09-12T16:18:16.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045858227000000001 2024-09-12T16:18:16.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929365+0000", 2024-09-12T16:18:16.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5519999999999995e-05 2024-09-12T16:18:16.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.124 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.124 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929459+0000", 2024-09-12T16:18:16.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3671000000000005e-05 2024-09-12T16:18:16.124 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.124 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.124 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.124 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11276 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3420160~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:16.124 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883439+0000", 2024-09-12T16:18:16.125 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.156867923, 2024-09-12T16:18:16.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.046138991999999997, 2024-09-12T16:18:16.125 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.125 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.125 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:16.125 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.125 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:16.125 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:16.125 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11276 2024-09-12T16:18:16.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.125 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.125 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883439+0000", 2024-09-12T16:18:16.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.126 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.126 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883439+0000", 2024-09-12T16:18:16.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.126 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.126 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883560+0000", 2024-09-12T16:18:16.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121229 2024-09-12T16:18:16.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.126 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.127 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883569+0000", 2024-09-12T16:18:16.127 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9390000000000003e-06 2024-09-12T16:18:16.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.127 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.127 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883579+0000", 2024-09-12T16:18:16.127 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8859999999999999e-06 2024-09-12T16:18:16.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.127 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.127 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883585+0000", 2024-09-12T16:18:16.127 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.545e-06 2024-09-12T16:18:16.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.128 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929486+0000", 2024-09-12T16:18:16.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045900653999999999 2024-09-12T16:18:16.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.128 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929527+0000", 2024-09-12T16:18:16.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0707999999999997e-05 2024-09-12T16:18:16.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.128 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929578+0000", 2024-09-12T16:18:16.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1031e-05 2024-09-12T16:18:16.129 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.129 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.129 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.129 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11277 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3469312~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:16.129 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883595+0000", 2024-09-12T16:18:16.129 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.15671158, 2024-09-12T16:18:16.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.046187702999999997, 2024-09-12T16:18:16.129 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.129 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.129 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:16.129 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.130 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:16.130 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:16.130 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11277 2024-09-12T16:18:16.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.130 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.130 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.130 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883595+0000", 2024-09-12T16:18:16.130 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.130 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.130 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883595+0000", 2024-09-12T16:18:16.130 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.131 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.131 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.889065+0000", 2024-09-12T16:18:16.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00547001 2024-09-12T16:18:16.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.131 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.131 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.889069+0000", 2024-09-12T16:18:16.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1180000000000002e-06 2024-09-12T16:18:16.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.131 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.131 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.889079+0000", 2024-09-12T16:18:16.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2250000000000006e-06 2024-09-12T16:18:16.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.889084+0000", 2024-09-12T16:18:16.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2680000000000002e-06 2024-09-12T16:18:16.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929612+0000", 2024-09-12T16:18:16.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040528343000000001 2024-09-12T16:18:16.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.133 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929691+0000", 2024-09-12T16:18:16.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8541999999999994e-05 2024-09-12T16:18:16.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.133 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.133 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929783+0000", 2024-09-12T16:18:16.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2196999999999998e-05 2024-09-12T16:18:16.133 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.133 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.133 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.133 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.133 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.133 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:16.134 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T16:18:16.135 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:16.134+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:16.136 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:18:16.235 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:16.234+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:16.285 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:16.286 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:16.286 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:18:16.286 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:16.295 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:18:16.336 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:16.335+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:16.437 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:16.436+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:16.441 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:16.442 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:16.442 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:18:16.442 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:18:16.442 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:16.450 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:18:16.537 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:16.537+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:16.600 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T16:18:16.602 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:16.602 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:18:16.602 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:18:16.602 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:18:16.602 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.602 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2213 3.18 3:1944e921:::rbd_data.1155ccb1894c.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:18:16.602 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:18:16.602 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 79.223218439999997, 2024-09-12T16:18:16.602 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.055657836000000002, 2024-09-12T16:18:16.603 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.603 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.603 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:16.603 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.603 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:18:16.603 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:18:16.603 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2213 2024-09-12T16:18:16.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.603 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.603 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.603 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.603 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:18:16.603 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.604 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.604 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.604 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:18:16.604 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.604 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.604 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.604 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375351+0000", 2024-09-12T16:18:16.604 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.556e-06 2024-09-12T16:18:16.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.604 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.604 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.604 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.399989+0000", 2024-09-12T16:18:16.605 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024637949999999999 2024-09-12T16:18:16.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.605 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.605 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400038+0000", 2024-09-12T16:18:16.605 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9187999999999997e-05 2024-09-12T16:18:16.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.605 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.605 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400056+0000", 2024-09-12T16:18:16.605 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8451e-05 2024-09-12T16:18:16.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.605 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400151+0000", 2024-09-12T16:18:16.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5026999999999997e-05 2024-09-12T16:18:16.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.606 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400345+0000", 2024-09-12T16:18:16.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019352900000000001 2024-09-12T16:18:16.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.606 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 1", 2024-09-12T16:18:16.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.401319+0000", 2024-09-12T16:18:16.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00097419399999999995 2024-09-12T16:18:16.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.607 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:18:16.607 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.429350+0000", 2024-09-12T16:18:16.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028030607999999999 2024-09-12T16:18:16.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.607 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:16.607 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.430907+0000", 2024-09-12T16:18:16.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001557466 2024-09-12T16:18:16.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.607 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:18:16.607 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.430966+0000", 2024-09-12T16:18:16.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9437e-05 2024-09-12T16:18:16.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.608 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.608 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.431007+0000", 2024-09-12T16:18:16.608 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0429999999999997e-05 2024-09-12T16:18:16.608 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.608 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.608 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.608 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5632 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 585728~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:16.608 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556262+0000", 2024-09-12T16:18:16.608 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.042305384000001, 2024-09-12T16:18:16.609 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051267114000000003, 2024-09-12T16:18:16.609 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.609 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.609 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:16.609 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.609 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:16.609 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:16.609 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5632 2024-09-12T16:18:16.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.609 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.609 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.609 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.609 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556262+0000", 2024-09-12T16:18:16.609 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.610 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.610 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556262+0000", 2024-09-12T16:18:16.610 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.610 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.610 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556262+0000", 2024-09-12T16:18:16.610 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9999999999999998e-07 2024-09-12T16:18:16.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.610 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.610 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556269+0000", 2024-09-12T16:18:16.611 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4119999999999998e-06 2024-09-12T16:18:16.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.611 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.611 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556276+0000", 2024-09-12T16:18:16.611 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8549999999999996e-06 2024-09-12T16:18:16.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.611 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.611 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556281+0000", 2024-09-12T16:18:16.611 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1159999999999998e-06 2024-09-12T16:18:16.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.611 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.612 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607438+0000", 2024-09-12T16:18:16.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.05115695 2024-09-12T16:18:16.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.612 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.612 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607478+0000", 2024-09-12T16:18:16.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0535999999999999e-05 2024-09-12T16:18:16.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.612 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.612 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607529+0000", 2024-09-12T16:18:16.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0844999999999999e-05 2024-09-12T16:18:16.612 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.613 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.613 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.613 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5633 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 638976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:16.613 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556288+0000", 2024-09-12T16:18:16.613 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.042279352, 2024-09-12T16:18:16.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051384633999999998, 2024-09-12T16:18:16.613 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.613 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.613 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:16.613 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.613 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:16.613 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:16.614 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5633 2024-09-12T16:18:16.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.614 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.614 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556288+0000", 2024-09-12T16:18:16.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.614 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556288+0000", 2024-09-12T16:18:16.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556289+0000", 2024-09-12T16:18:16.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4000000000000002e-07 2024-09-12T16:18:16.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556291+0000", 2024-09-12T16:18:16.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0470000000000001e-06 2024-09-12T16:18:16.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556297+0000", 2024-09-12T16:18:16.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5080000000000002e-06 2024-09-12T16:18:16.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556302+0000", 2024-09-12T16:18:16.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2190000000000003e-06 2024-09-12T16:18:16.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607559+0000", 2024-09-12T16:18:16.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051256542000000002 2024-09-12T16:18:16.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607619+0000", 2024-09-12T16:18:16.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0538000000000002e-05 2024-09-12T16:18:16.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.617 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607673+0000", 2024-09-12T16:18:16.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3340000000000001e-05 2024-09-12T16:18:16.617 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.617 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.617 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.617 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5634 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 692224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:16.617 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556324+0000", 2024-09-12T16:18:16.617 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.042243663000001, 2024-09-12T16:18:16.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.05149252, 2024-09-12T16:18:16.618 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.618 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.618 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:16.618 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.618 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:16.618 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:16.618 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5634 2024-09-12T16:18:16.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.618 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.618 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556324+0000", 2024-09-12T16:18:16.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556324+0000", 2024-09-12T16:18:16.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556324+0000", 2024-09-12T16:18:16.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1900000000000002e-07 2024-09-12T16:18:16.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556327+0000", 2024-09-12T16:18:16.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T16:18:16.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556334+0000", 2024-09-12T16:18:16.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3919999999999997e-06 2024-09-12T16:18:16.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556341+0000", 2024-09-12T16:18:16.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6000000000000003e-06 2024-09-12T16:18:16.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607704+0000", 2024-09-12T16:18:16.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051363233000000001 2024-09-12T16:18:16.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607764+0000", 2024-09-12T16:18:16.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9871000000000003e-05 2024-09-12T16:18:16.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607816+0000", 2024-09-12T16:18:16.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2374999999999999e-05 2024-09-12T16:18:16.622 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.622 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.622 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.622 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5635 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 745472~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:16.622 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556348+0000", 2024-09-12T16:18:16.622 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.042219092, 2024-09-12T16:18:16.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051607838000000003, 2024-09-12T16:18:16.622 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.622 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.622 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:16.622 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.623 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:16.623 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:16.623 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5635 2024-09-12T16:18:16.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.623 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556348+0000", 2024-09-12T16:18:16.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556348+0000", 2024-09-12T16:18:16.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556349+0000", 2024-09-12T16:18:16.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.75e-07 2024-09-12T16:18:16.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556351+0000", 2024-09-12T16:18:16.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1890000000000001e-06 2024-09-12T16:18:16.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556358+0000", 2024-09-12T16:18:16.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.922e-06 2024-09-12T16:18:16.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556363+0000", 2024-09-12T16:18:16.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.242e-06 2024-09-12T16:18:16.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607846+0000", 2024-09-12T16:18:16.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051482433000000001 2024-09-12T16:18:16.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607886+0000", 2024-09-12T16:18:16.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0290999999999998e-05 2024-09-12T16:18:16.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607956+0000", 2024-09-12T16:18:16.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0285999999999998e-05 2024-09-12T16:18:16.626 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.626 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.626 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.627 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5636 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 806912~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:16.627 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556371+0000", 2024-09-12T16:18:16.627 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.042196914, 2024-09-12T16:18:16.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051725921000000001, 2024-09-12T16:18:16.627 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.627 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.627 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:16.627 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.627 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:16.627 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:16.627 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5636 2024-09-12T16:18:16.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.627 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556371+0000", 2024-09-12T16:18:16.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556371+0000", 2024-09-12T16:18:16.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556371+0000", 2024-09-12T16:18:16.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9800000000000004e-07 2024-09-12T16:18:16.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556373+0000", 2024-09-12T16:18:16.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0490000000000002e-06 2024-09-12T16:18:16.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556380+0000", 2024-09-12T16:18:16.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6050000000000003e-06 2024-09-12T16:18:16.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556385+0000", 2024-09-12T16:18:16.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2449999999999998e-06 2024-09-12T16:18:16.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607993+0000", 2024-09-12T16:18:16.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051608182000000002 2024-09-12T16:18:16.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608035+0000", 2024-09-12T16:18:16.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1698e-05 2024-09-12T16:18:16.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608096+0000", 2024-09-12T16:18:16.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1643999999999995e-05 2024-09-12T16:18:16.631 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.631 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.631 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.631 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5637 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 860160~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:16.631 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556393+0000", 2024-09-12T16:18:16.631 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.042174263, 2024-09-12T16:18:16.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051839035999999998, 2024-09-12T16:18:16.631 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.631 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.631 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:16.632 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.632 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:16.632 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:16.632 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5637 2024-09-12T16:18:16.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.632 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556393+0000", 2024-09-12T16:18:16.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556393+0000", 2024-09-12T16:18:16.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556394+0000", 2024-09-12T16:18:16.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3000000000000001e-07 2024-09-12T16:18:16.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556396+0000", 2024-09-12T16:18:16.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0839999999999999e-06 2024-09-12T16:18:16.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556402+0000", 2024-09-12T16:18:16.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6919999999999996e-06 2024-09-12T16:18:16.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556408+0000", 2024-09-12T16:18:16.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2800000000000003e-06 2024-09-12T16:18:16.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608129+0000", 2024-09-12T16:18:16.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051720902999999999 2024-09-12T16:18:16.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608174+0000", 2024-09-12T16:18:16.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5676000000000001e-05 2024-09-12T16:18:16.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608232+0000", 2024-09-12T16:18:16.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7970999999999998e-05 2024-09-12T16:18:16.635 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.635 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.635 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.636 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5638 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 913408~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:16.636 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556415+0000", 2024-09-12T16:18:16.636 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.042152869000001, 2024-09-12T16:18:16.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051949532999999999, 2024-09-12T16:18:16.636 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.636 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.636 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:16.636 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.636 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:16.636 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:16.636 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5638 2024-09-12T16:18:16.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.637 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556415+0000", 2024-09-12T16:18:16.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556415+0000", 2024-09-12T16:18:16.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556415+0000", 2024-09-12T16:18:16.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7199999999999999e-07 2024-09-12T16:18:16.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556417+0000", 2024-09-12T16:18:16.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0279999999999999e-06 2024-09-12T16:18:16.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556424+0000", 2024-09-12T16:18:16.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6950000000000003e-06 2024-09-12T16:18:16.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556429+0000", 2024-09-12T16:18:16.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3059999999999997e-06 2024-09-12T16:18:16.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608260+0000", 2024-09-12T16:18:16.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051831254 2024-09-12T16:18:16.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608306+0000", 2024-09-12T16:18:16.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5976999999999997e-05 2024-09-12T16:18:16.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608364+0000", 2024-09-12T16:18:16.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7800999999999998e-05 2024-09-12T16:18:16.640 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.640 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.640 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.640 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5639 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 966656~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:16.640 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556436+0000", 2024-09-12T16:18:16.640 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.042131196, 2024-09-12T16:18:16.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052070419, 2024-09-12T16:18:16.641 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.641 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.641 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:16.641 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.641 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:16.641 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:16.641 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5639 2024-09-12T16:18:16.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.641 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556436+0000", 2024-09-12T16:18:16.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556436+0000", 2024-09-12T16:18:16.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556437+0000", 2024-09-12T16:18:16.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1899999999999998e-07 2024-09-12T16:18:16.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556439+0000", 2024-09-12T16:18:16.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.973e-06 2024-09-12T16:18:16.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556445+0000", 2024-09-12T16:18:16.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7769999999999997e-06 2024-09-12T16:18:16.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556451+0000", 2024-09-12T16:18:16.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.31e-06 2024-09-12T16:18:16.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608397+0000", 2024-09-12T16:18:16.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051945829999999998 2024-09-12T16:18:16.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608438+0000", 2024-09-12T16:18:16.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1539000000000003e-05 2024-09-12T16:18:16.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608507+0000", 2024-09-12T16:18:16.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8571000000000005e-05 2024-09-12T16:18:16.645 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.645 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.645 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.645 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5640 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1019904~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:16.645 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556458+0000", 2024-09-12T16:18:16.645 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.042109684, 2024-09-12T16:18:16.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052171423000000001, 2024-09-12T16:18:16.645 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.645 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.645 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:16.645 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.646 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:16.646 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:16.646 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5640 2024-09-12T16:18:16.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.646 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556458+0000", 2024-09-12T16:18:16.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556458+0000", 2024-09-12T16:18:16.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556458+0000", 2024-09-12T16:18:16.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2500000000000001e-07 2024-09-12T16:18:16.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556460+0000", 2024-09-12T16:18:16.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.934e-06 2024-09-12T16:18:16.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556468+0000", 2024-09-12T16:18:16.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7950000000000008e-06 2024-09-12T16:18:16.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556473+0000", 2024-09-12T16:18:16.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3539999999999999e-06 2024-09-12T16:18:16.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608539+0000", 2024-09-12T16:18:16.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052065974000000001 2024-09-12T16:18:16.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608579+0000", 2024-09-12T16:18:16.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0238999999999999e-05 2024-09-12T16:18:16.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608629+0000", 2024-09-12T16:18:16.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9701999999999999e-05 2024-09-12T16:18:16.649 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.649 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.649 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.650 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5641 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1081344~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:16.650 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556480+0000", 2024-09-12T16:18:16.650 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.042087075, 2024-09-12T16:18:16.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052284826999999999, 2024-09-12T16:18:16.650 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.650 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.650 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:16.650 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.650 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:16.650 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:16.650 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5641 2024-09-12T16:18:16.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.651 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556480+0000", 2024-09-12T16:18:16.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556480+0000", 2024-09-12T16:18:16.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556481+0000", 2024-09-12T16:18:16.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.27e-07 2024-09-12T16:18:16.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556483+0000", 2024-09-12T16:18:16.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9379999999999999e-06 2024-09-12T16:18:16.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556489+0000", 2024-09-12T16:18:16.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5910000000000001e-06 2024-09-12T16:18:16.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556495+0000", 2024-09-12T16:18:16.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5600000000000001e-06 2024-09-12T16:18:16.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608659+0000", 2024-09-12T16:18:16.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052164489000000001 2024-09-12T16:18:16.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608714+0000", 2024-09-12T16:18:16.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4849999999999998e-05 2024-09-12T16:18:16.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608765+0000", 2024-09-12T16:18:16.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0971999999999999e-05 2024-09-12T16:18:16.654 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.654 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.654 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.654 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5642 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1134592~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:16.655 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556502+0000", 2024-09-12T16:18:16.655 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.04206518, 2024-09-12T16:18:16.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052404536000000002, 2024-09-12T16:18:16.655 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.655 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.655 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:16.655 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.655 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:16.655 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:16.655 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5642 2024-09-12T16:18:16.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.655 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556502+0000", 2024-09-12T16:18:16.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556502+0000", 2024-09-12T16:18:16.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556503+0000", 2024-09-12T16:18:16.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8599999999999998e-07 2024-09-12T16:18:16.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556505+0000", 2024-09-12T16:18:16.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.097e-06 2024-09-12T16:18:16.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556512+0000", 2024-09-12T16:18:16.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8229999999999997e-06 2024-09-12T16:18:16.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556517+0000", 2024-09-12T16:18:16.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6289999999999998e-06 2024-09-12T16:18:16.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608797+0000", 2024-09-12T16:18:16.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052279651000000003 2024-09-12T16:18:16.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608852+0000", 2024-09-12T16:18:16.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4994999999999998e-05 2024-09-12T16:18:16.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608907+0000", 2024-09-12T16:18:16.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4755e-05 2024-09-12T16:18:16.659 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.659 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.659 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.659 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5643 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1187840~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:16.659 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556525+0000", 2024-09-12T16:18:16.659 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.042042938, 2024-09-12T16:18:16.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052518288000000003, 2024-09-12T16:18:16.659 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.659 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.659 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:16.659 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.659 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:16.659 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:16.660 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5643 2024-09-12T16:18:16.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.660 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556525+0000", 2024-09-12T16:18:16.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556525+0000", 2024-09-12T16:18:16.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556525+0000", 2024-09-12T16:18:16.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0400000000000002e-07 2024-09-12T16:18:16.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556528+0000", 2024-09-12T16:18:16.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8679999999999999e-06 2024-09-12T16:18:16.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556536+0000", 2024-09-12T16:18:16.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3089999999999996e-06 2024-09-12T16:18:16.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556541+0000", 2024-09-12T16:18:16.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3120000000000001e-06 2024-09-12T16:18:16.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608943+0000", 2024-09-12T16:18:16.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052401089999999997 2024-09-12T16:18:16.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608991+0000", 2024-09-12T16:18:16.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8633e-05 2024-09-12T16:18:16.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609043+0000", 2024-09-12T16:18:16.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1672000000000003e-05 2024-09-12T16:18:16.664 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.664 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.664 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.665 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5644 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1241088~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:16.665 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556548+0000", 2024-09-12T16:18:16.665 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.042019405, 2024-09-12T16:18:16.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052634777000000001, 2024-09-12T16:18:16.665 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.665 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.665 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:16.665 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.665 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:16.665 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:16.665 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5644 2024-09-12T16:18:16.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.666 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556548+0000", 2024-09-12T16:18:16.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556548+0000", 2024-09-12T16:18:16.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556549+0000", 2024-09-12T16:18:16.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1900000000000003e-07 2024-09-12T16:18:16.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556555+0000", 2024-09-12T16:18:16.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.652e-06 2024-09-12T16:18:16.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556562+0000", 2024-09-12T16:18:16.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.905e-06 2024-09-12T16:18:16.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556567+0000", 2024-09-12T16:18:16.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1730000000000003e-06 2024-09-12T16:18:16.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609079+0000", 2024-09-12T16:18:16.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052511993 2024-09-12T16:18:16.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609125+0000", 2024-09-12T16:18:16.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5327000000000002e-05 2024-09-12T16:18:16.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609183+0000", 2024-09-12T16:18:16.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8208000000000002e-05 2024-09-12T16:18:16.669 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.669 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.669 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.669 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5645 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1294336~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:16.669 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556574+0000", 2024-09-12T16:18:16.670 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.041993007, 2024-09-12T16:18:16.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052876909999999999, 2024-09-12T16:18:16.670 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.670 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.670 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:16.670 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.670 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:16.670 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:16.670 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5645 2024-09-12T16:18:16.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.670 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556574+0000", 2024-09-12T16:18:16.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556574+0000", 2024-09-12T16:18:16.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556575+0000", 2024-09-12T16:18:16.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.89e-07 2024-09-12T16:18:16.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556577+0000", 2024-09-12T16:18:16.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8700000000000001e-06 2024-09-12T16:18:16.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556583+0000", 2024-09-12T16:18:16.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4320000000000004e-06 2024-09-12T16:18:16.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556589+0000", 2024-09-12T16:18:16.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3890000000000004e-06 2024-09-12T16:18:16.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609236+0000", 2024-09-12T16:18:16.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052647022000000002 2024-09-12T16:18:16.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609334+0000", 2024-09-12T16:18:16.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8039000000000001e-05 2024-09-12T16:18:16.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609451+0000", 2024-09-12T16:18:16.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117769 2024-09-12T16:18:16.673 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.673 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.674 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.674 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5646 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1355776~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:16.674 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556595+0000", 2024-09-12T16:18:16.674 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.041972026, 2024-09-12T16:18:16.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053088173000000002, 2024-09-12T16:18:16.674 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.674 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.674 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:16.674 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.674 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:16.675 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:16.675 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5646 2024-09-12T16:18:16.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.675 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556595+0000", 2024-09-12T16:18:16.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556595+0000", 2024-09-12T16:18:16.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556596+0000", 2024-09-12T16:18:16.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:18:16.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556598+0000", 2024-09-12T16:18:16.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0669999999999999e-06 2024-09-12T16:18:16.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556603+0000", 2024-09-12T16:18:16.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5210000000000002e-06 2024-09-12T16:18:16.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556609+0000", 2024-09-12T16:18:16.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1590000000000001e-06 2024-09-12T16:18:16.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609499+0000", 2024-09-12T16:18:16.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052890489999999998 2024-09-12T16:18:16.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609586+0000", 2024-09-12T16:18:16.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6681999999999994e-05 2024-09-12T16:18:16.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609684+0000", 2024-09-12T16:18:16.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7863999999999997e-05 2024-09-12T16:18:16.678 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.678 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.678 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.679 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5647 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1409024~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:16.679 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556616+0000", 2024-09-12T16:18:16.679 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.041951730999999, 2024-09-12T16:18:16.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053207888000000002, 2024-09-12T16:18:16.679 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.679 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.679 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:16.679 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.679 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:16.679 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:16.679 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5647 2024-09-12T16:18:16.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.680 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556616+0000", 2024-09-12T16:18:16.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556616+0000", 2024-09-12T16:18:16.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556616+0000", 2024-09-12T16:18:16.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3599999999999999e-07 2024-09-12T16:18:16.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556618+0000", 2024-09-12T16:18:16.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1550000000000001e-06 2024-09-12T16:18:16.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556624+0000", 2024-09-12T16:18:16.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0499999999999997e-06 2024-09-12T16:18:16.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556629+0000", 2024-09-12T16:18:16.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8840000000000002e-06 2024-09-12T16:18:16.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609721+0000", 2024-09-12T16:18:16.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053091808999999997 2024-09-12T16:18:16.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609767+0000", 2024-09-12T16:18:16.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.638e-05 2024-09-12T16:18:16.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609824+0000", 2024-09-12T16:18:16.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6174000000000001e-05 2024-09-12T16:18:16.683 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.683 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.683 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.683 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5648 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1462272~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:16.683 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556636+0000", 2024-09-12T16:18:16.684 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.041931072000001, 2024-09-12T16:18:16.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053322131000000002, 2024-09-12T16:18:16.684 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.684 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.684 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:16.684 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.684 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:16.684 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:16.684 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5648 2024-09-12T16:18:16.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.684 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556636+0000", 2024-09-12T16:18:16.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556636+0000", 2024-09-12T16:18:16.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557015+0000", 2024-09-12T16:18:16.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000378911 2024-09-12T16:18:16.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557019+0000", 2024-09-12T16:18:16.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2100000000000002e-06 2024-09-12T16:18:16.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557030+0000", 2024-09-12T16:18:16.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.149e-05 2024-09-12T16:18:16.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557037+0000", 2024-09-12T16:18:16.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5719999999999999e-06 2024-09-12T16:18:16.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609838+0000", 2024-09-12T16:18:16.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052801305999999999 2024-09-12T16:18:16.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609880+0000", 2024-09-12T16:18:16.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2604000000000001e-05 2024-09-12T16:18:16.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609959+0000", 2024-09-12T16:18:16.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8038000000000001e-05 2024-09-12T16:18:16.688 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.688 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.688 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.688 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5649 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1515520~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:16.688 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.557073+0000", 2024-09-12T16:18:16.688 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.041494071000001, 2024-09-12T16:18:16.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053030573999999997, 2024-09-12T16:18:16.688 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.688 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.688 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:16.688 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:16.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:16.689 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5649 2024-09-12T16:18:16.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.689 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557073+0000", 2024-09-12T16:18:16.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557073+0000", 2024-09-12T16:18:16.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557074+0000", 2024-09-12T16:18:16.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5199999999999996e-07 2024-09-12T16:18:16.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557084+0000", 2024-09-12T16:18:16.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0349e-05 2024-09-12T16:18:16.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557092+0000", 2024-09-12T16:18:16.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9699999999999999e-06 2024-09-12T16:18:16.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557100+0000", 2024-09-12T16:18:16.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7049999999999999e-06 2024-09-12T16:18:16.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609992+0000", 2024-09-12T16:18:16.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052891821999999998 2024-09-12T16:18:16.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610034+0000", 2024-09-12T16:18:16.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2141000000000002e-05 2024-09-12T16:18:16.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610104+0000", 2024-09-12T16:18:16.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9935e-05 2024-09-12T16:18:16.692 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.692 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.692 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.692 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5650 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1568768~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:16.692 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.557111+0000", 2024-09-12T16:18:16.692 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.041456848999999, 2024-09-12T16:18:16.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053118023, 2024-09-12T16:18:16.693 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:16.693 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:16.693 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:16.693 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:16.693 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:16.693 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:16.693 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5650 2024-09-12T16:18:16.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.693 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:16.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:16.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557111+0000", 2024-09-12T16:18:16.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:16.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557111+0000", 2024-09-12T16:18:16.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:16.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:16.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.562089+0000", 2024-09-12T16:18:16.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0049787410000000001 2024-09-12T16:18:16.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:16.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.562094+0000", 2024-09-12T16:18:16.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7210000000000002e-06 2024-09-12T16:18:16.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:16.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.562105+0000", 2024-09-12T16:18:16.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0458999999999999e-05 2024-09-12T16:18:16.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:16.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.562112+0000", 2024-09-12T16:18:16.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0280000000000003e-06 2024-09-12T16:18:16.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:16.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610135+0000", 2024-09-12T16:18:16.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048023374000000001 2024-09-12T16:18:16.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:16.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610177+0000", 2024-09-12T16:18:16.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2119000000000001e-05 2024-09-12T16:18:16.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:16.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:16.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:16.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610229+0000", 2024-09-12T16:18:16.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1581e-05 2024-09-12T16:18:16.696 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.696 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.696 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.696 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:16.697 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:16.697 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:16.698 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:18:16.699 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:16.697+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:16.799 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:16.798+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:16.819 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:16.819 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:16.819 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:18:16.819 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:16.819 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:18:16.820 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:18:16.828 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:18:16.836 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:18:16.836 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:18:16.852 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:18:16.852 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:18:16.869 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:18:16.869 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:18:16.887 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:18:16.887 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:18:16.899 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:16.899+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:16.904 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:18:16.905 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:18:16.938 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:16.938 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:16.947 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:18:17.000 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:16.999+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:17.054 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:17.055 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:17.063 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:18:17.107 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2024-09-12T16:18:17.107 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:17.106+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:17.178 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:17.178 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:17.187 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:18:17.201 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:17.201+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:17.303 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:17.301+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:17.334 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:17.334 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:17.343 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:18:17.427 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:17.426+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:17.490 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:17.490 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:17.499 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:18:17.504 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:17.503+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:17.605 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:17.604+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:17.646 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:17.646 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:17.655 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:18:17.705 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:17.704+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:17.761 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:17.761 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:17.770 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:18:17.811 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:17.810+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:17.908 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:17.907+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:17.917 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:17.917 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:17.926 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:18:18.009 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:18.008+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:18.056 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:18.057 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:18.066 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:18:18.109 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:18.108+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:18.210 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:18.209+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:18.217 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:18.217 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:18.226 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:18:18.311 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:18.311+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:18.373 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:18.373 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:18.382 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:18:18.423 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:18.422+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:18.513 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:18.512+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:18.530 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:18.530 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:18.538 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:18:18.614 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:18.613+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:18.686 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:18.686 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:18.695 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:18:18.715 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:18.714+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:18.802 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:18.802 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:18.810 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:18:18.854 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:18.853+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:18.916 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T16:18:18.918 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:18.918 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:18.918 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:18.917+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:18.926 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:18:19.018 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:19.017+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:19.049 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:18:19.049 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:18:19.067 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:18:19.067 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:18:19.104 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:18:19.104 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:18:19.106 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:19.106 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:19.106 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:18:19.106 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:18:19.106 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:19.118 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:18:19.119 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:19.118+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:19.126 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:18:19.126 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:18:19.127 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T16:18:19.146 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:18:19.146 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:18:19.180 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:18:19.180 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:18:19.238 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:19.237+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:19.247 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:19.248 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:18:19.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:18:19.248 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:18:19.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.248 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2213 3.18 3:1944e921:::rbd_data.1155ccb1894c.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:18:19.248 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:18:19.248 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 81.870867216999997, 2024-09-12T16:18:19.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.055657836000000002, 2024-09-12T16:18:19.248 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:19.248 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:19.249 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:19.249 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:19.249 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:18:19.249 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:18:19.249 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2213 2024-09-12T16:18:19.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.249 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:19.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:19.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:18:19.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:19.250 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:18:19.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:19.250 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375351+0000", 2024-09-12T16:18:19.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.556e-06 2024-09-12T16:18:19.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:19.250 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.399989+0000", 2024-09-12T16:18:19.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024637949999999999 2024-09-12T16:18:19.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:19.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400038+0000", 2024-09-12T16:18:19.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9187999999999997e-05 2024-09-12T16:18:19.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400056+0000", 2024-09-12T16:18:19.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8451e-05 2024-09-12T16:18:19.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:19.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400151+0000", 2024-09-12T16:18:19.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5026999999999997e-05 2024-09-12T16:18:19.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:19.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400345+0000", 2024-09-12T16:18:19.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019352900000000001 2024-09-12T16:18:19.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 1", 2024-09-12T16:18:19.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.401319+0000", 2024-09-12T16:18:19.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00097419399999999995 2024-09-12T16:18:19.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:18:19.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.429350+0000", 2024-09-12T16:18:19.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028030607999999999 2024-09-12T16:18:19.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:19.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.430907+0000", 2024-09-12T16:18:19.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001557466 2024-09-12T16:18:19.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:18:19.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.430966+0000", 2024-09-12T16:18:19.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9437e-05 2024-09-12T16:18:19.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:19.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.431007+0000", 2024-09-12T16:18:19.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0429999999999997e-05 2024-09-12T16:18:19.253 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.254 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:19.254 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.254 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5632 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 585728~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:19.254 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556262+0000", 2024-09-12T16:18:19.254 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.689954160999999, 2024-09-12T16:18:19.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051267114000000003, 2024-09-12T16:18:19.254 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:19.254 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:19.254 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:19.254 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:19.255 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:19.255 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:19.255 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5632 2024-09-12T16:18:19.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.255 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:19.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:19.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556262+0000", 2024-09-12T16:18:19.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:19.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556262+0000", 2024-09-12T16:18:19.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:19.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556262+0000", 2024-09-12T16:18:19.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9999999999999998e-07 2024-09-12T16:18:19.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:19.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556269+0000", 2024-09-12T16:18:19.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4119999999999998e-06 2024-09-12T16:18:19.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:19.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556276+0000", 2024-09-12T16:18:19.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8549999999999996e-06 2024-09-12T16:18:19.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556281+0000", 2024-09-12T16:18:19.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1159999999999998e-06 2024-09-12T16:18:19.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:19.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607438+0000", 2024-09-12T16:18:19.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.05115695 2024-09-12T16:18:19.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:19.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607478+0000", 2024-09-12T16:18:19.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0535999999999999e-05 2024-09-12T16:18:19.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:19.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607529+0000", 2024-09-12T16:18:19.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0844999999999999e-05 2024-09-12T16:18:19.258 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.258 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:19.258 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.258 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5633 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 638976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:19.258 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556288+0000", 2024-09-12T16:18:19.258 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.689928128999998, 2024-09-12T16:18:19.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051384633999999998, 2024-09-12T16:18:19.258 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:19.259 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:19.259 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:19.259 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:19.259 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:19.259 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:19.259 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5633 2024-09-12T16:18:19.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.259 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:19.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:19.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556288+0000", 2024-09-12T16:18:19.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:19.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556288+0000", 2024-09-12T16:18:19.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:19.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556289+0000", 2024-09-12T16:18:19.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4000000000000002e-07 2024-09-12T16:18:19.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:19.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556291+0000", 2024-09-12T16:18:19.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0470000000000001e-06 2024-09-12T16:18:19.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:19.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556297+0000", 2024-09-12T16:18:19.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5080000000000002e-06 2024-09-12T16:18:19.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556302+0000", 2024-09-12T16:18:19.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2190000000000003e-06 2024-09-12T16:18:19.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:19.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607559+0000", 2024-09-12T16:18:19.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051256542000000002 2024-09-12T16:18:19.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:19.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607619+0000", 2024-09-12T16:18:19.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0538000000000002e-05 2024-09-12T16:18:19.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:19.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607673+0000", 2024-09-12T16:18:19.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3340000000000001e-05 2024-09-12T16:18:19.262 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.262 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:19.263 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.263 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5634 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 692224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:19.263 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556324+0000", 2024-09-12T16:18:19.263 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.689892440000001, 2024-09-12T16:18:19.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.05149252, 2024-09-12T16:18:19.263 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:19.263 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:19.263 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:19.263 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:19.263 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:19.263 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:19.263 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5634 2024-09-12T16:18:19.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.264 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:19.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:19.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556324+0000", 2024-09-12T16:18:19.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:19.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556324+0000", 2024-09-12T16:18:19.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:19.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556324+0000", 2024-09-12T16:18:19.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1900000000000002e-07 2024-09-12T16:18:19.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:19.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556327+0000", 2024-09-12T16:18:19.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T16:18:19.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:19.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556334+0000", 2024-09-12T16:18:19.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3919999999999997e-06 2024-09-12T16:18:19.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556341+0000", 2024-09-12T16:18:19.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6000000000000003e-06 2024-09-12T16:18:19.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:19.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607704+0000", 2024-09-12T16:18:19.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051363233000000001 2024-09-12T16:18:19.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:19.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607764+0000", 2024-09-12T16:18:19.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9871000000000003e-05 2024-09-12T16:18:19.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:19.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607816+0000", 2024-09-12T16:18:19.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2374999999999999e-05 2024-09-12T16:18:19.267 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.267 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:19.267 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.267 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5635 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 745472~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:19.267 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556348+0000", 2024-09-12T16:18:19.267 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.689867869, 2024-09-12T16:18:19.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051607838000000003, 2024-09-12T16:18:19.268 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:19.268 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:19.268 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:19.268 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:19.268 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:19.268 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:19.268 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5635 2024-09-12T16:18:19.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.268 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:19.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:19.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556348+0000", 2024-09-12T16:18:19.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:19.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556348+0000", 2024-09-12T16:18:19.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:19.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556349+0000", 2024-09-12T16:18:19.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.75e-07 2024-09-12T16:18:19.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:19.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556351+0000", 2024-09-12T16:18:19.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1890000000000001e-06 2024-09-12T16:18:19.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:19.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556358+0000", 2024-09-12T16:18:19.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.922e-06 2024-09-12T16:18:19.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556363+0000", 2024-09-12T16:18:19.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.242e-06 2024-09-12T16:18:19.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:19.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607846+0000", 2024-09-12T16:18:19.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051482433000000001 2024-09-12T16:18:19.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:19.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607886+0000", 2024-09-12T16:18:19.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0290999999999998e-05 2024-09-12T16:18:19.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:19.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607956+0000", 2024-09-12T16:18:19.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0285999999999998e-05 2024-09-12T16:18:19.271 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.271 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:19.271 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.272 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5636 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 806912~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:19.272 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556371+0000", 2024-09-12T16:18:19.272 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.689845690999999, 2024-09-12T16:18:19.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051725921000000001, 2024-09-12T16:18:19.272 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:19.272 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:19.272 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:19.272 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:19.272 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:19.272 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:19.272 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5636 2024-09-12T16:18:19.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.272 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:19.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:19.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556371+0000", 2024-09-12T16:18:19.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:19.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556371+0000", 2024-09-12T16:18:19.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:19.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556371+0000", 2024-09-12T16:18:19.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9800000000000004e-07 2024-09-12T16:18:19.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:19.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556373+0000", 2024-09-12T16:18:19.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0490000000000002e-06 2024-09-12T16:18:19.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:19.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556380+0000", 2024-09-12T16:18:19.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6050000000000003e-06 2024-09-12T16:18:19.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556385+0000", 2024-09-12T16:18:19.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2449999999999998e-06 2024-09-12T16:18:19.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:19.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607993+0000", 2024-09-12T16:18:19.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051608182000000002 2024-09-12T16:18:19.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:19.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608035+0000", 2024-09-12T16:18:19.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1698e-05 2024-09-12T16:18:19.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:19.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608096+0000", 2024-09-12T16:18:19.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1643999999999995e-05 2024-09-12T16:18:19.276 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.276 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:19.276 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.276 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5637 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 860160~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:19.276 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556393+0000", 2024-09-12T16:18:19.276 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.68982304, 2024-09-12T16:18:19.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051839035999999998, 2024-09-12T16:18:19.276 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:19.276 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:19.277 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:19.277 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:19.277 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:19.277 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:19.277 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5637 2024-09-12T16:18:19.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.277 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:19.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:19.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556393+0000", 2024-09-12T16:18:19.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:19.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556393+0000", 2024-09-12T16:18:19.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:19.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556394+0000", 2024-09-12T16:18:19.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3000000000000001e-07 2024-09-12T16:18:19.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:19.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556396+0000", 2024-09-12T16:18:19.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0839999999999999e-06 2024-09-12T16:18:19.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:19.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556402+0000", 2024-09-12T16:18:19.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6919999999999996e-06 2024-09-12T16:18:19.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556408+0000", 2024-09-12T16:18:19.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2800000000000003e-06 2024-09-12T16:18:19.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:19.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608129+0000", 2024-09-12T16:18:19.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051720902999999999 2024-09-12T16:18:19.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:19.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608174+0000", 2024-09-12T16:18:19.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5676000000000001e-05 2024-09-12T16:18:19.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:19.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608232+0000", 2024-09-12T16:18:19.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7970999999999998e-05 2024-09-12T16:18:19.280 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.280 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:19.280 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.280 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5638 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 913408~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:19.281 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556415+0000", 2024-09-12T16:18:19.281 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.689801645999999, 2024-09-12T16:18:19.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051949532999999999, 2024-09-12T16:18:19.281 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:19.281 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:19.281 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:19.281 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:19.281 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:19.281 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:19.281 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5638 2024-09-12T16:18:19.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.281 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:19.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:19.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556415+0000", 2024-09-12T16:18:19.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:19.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556415+0000", 2024-09-12T16:18:19.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:19.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556415+0000", 2024-09-12T16:18:19.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7199999999999999e-07 2024-09-12T16:18:19.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:19.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556417+0000", 2024-09-12T16:18:19.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0279999999999999e-06 2024-09-12T16:18:19.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:19.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556424+0000", 2024-09-12T16:18:19.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6950000000000003e-06 2024-09-12T16:18:19.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556429+0000", 2024-09-12T16:18:19.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3059999999999997e-06 2024-09-12T16:18:19.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:19.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608260+0000", 2024-09-12T16:18:19.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051831254 2024-09-12T16:18:19.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:19.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608306+0000", 2024-09-12T16:18:19.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5976999999999997e-05 2024-09-12T16:18:19.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:19.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608364+0000", 2024-09-12T16:18:19.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7800999999999998e-05 2024-09-12T16:18:19.285 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.285 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:19.285 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.285 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5639 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 966656~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:19.285 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556436+0000", 2024-09-12T16:18:19.285 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.689779973, 2024-09-12T16:18:19.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052070419, 2024-09-12T16:18:19.285 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:19.285 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:19.286 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:19.286 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:19.286 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:19.286 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:19.286 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5639 2024-09-12T16:18:19.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.286 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:19.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:19.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556436+0000", 2024-09-12T16:18:19.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:19.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556436+0000", 2024-09-12T16:18:19.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:19.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556437+0000", 2024-09-12T16:18:19.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1899999999999998e-07 2024-09-12T16:18:19.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:19.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556439+0000", 2024-09-12T16:18:19.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.973e-06 2024-09-12T16:18:19.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:19.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556445+0000", 2024-09-12T16:18:19.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7769999999999997e-06 2024-09-12T16:18:19.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556451+0000", 2024-09-12T16:18:19.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.31e-06 2024-09-12T16:18:19.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:19.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608397+0000", 2024-09-12T16:18:19.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051945829999999998 2024-09-12T16:18:19.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:19.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608438+0000", 2024-09-12T16:18:19.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1539000000000003e-05 2024-09-12T16:18:19.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:19.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608507+0000", 2024-09-12T16:18:19.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8571000000000005e-05 2024-09-12T16:18:19.289 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.289 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:19.289 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.290 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5640 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1019904~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:19.290 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556458+0000", 2024-09-12T16:18:19.290 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.689758461, 2024-09-12T16:18:19.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052171423000000001, 2024-09-12T16:18:19.290 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:19.290 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:19.290 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:19.290 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:19.290 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:19.290 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:19.290 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5640 2024-09-12T16:18:19.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.291 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:19.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:19.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556458+0000", 2024-09-12T16:18:19.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:19.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556458+0000", 2024-09-12T16:18:19.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:19.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556458+0000", 2024-09-12T16:18:19.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2500000000000001e-07 2024-09-12T16:18:19.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:19.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556460+0000", 2024-09-12T16:18:19.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.934e-06 2024-09-12T16:18:19.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:19.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556468+0000", 2024-09-12T16:18:19.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7950000000000008e-06 2024-09-12T16:18:19.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556473+0000", 2024-09-12T16:18:19.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3539999999999999e-06 2024-09-12T16:18:19.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:19.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608539+0000", 2024-09-12T16:18:19.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052065974000000001 2024-09-12T16:18:19.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:19.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608579+0000", 2024-09-12T16:18:19.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0238999999999999e-05 2024-09-12T16:18:19.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:19.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608629+0000", 2024-09-12T16:18:19.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9701999999999999e-05 2024-09-12T16:18:19.294 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.294 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:19.294 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.294 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5641 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1081344~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:19.294 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556480+0000", 2024-09-12T16:18:19.294 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.689735851999998, 2024-09-12T16:18:19.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052284826999999999, 2024-09-12T16:18:19.294 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:19.295 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:19.295 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:19.295 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:19.295 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:19.295 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:19.295 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5641 2024-09-12T16:18:19.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.295 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:19.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:19.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556480+0000", 2024-09-12T16:18:19.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:19.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556480+0000", 2024-09-12T16:18:19.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:19.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556481+0000", 2024-09-12T16:18:19.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.27e-07 2024-09-12T16:18:19.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:19.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556483+0000", 2024-09-12T16:18:19.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9379999999999999e-06 2024-09-12T16:18:19.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:19.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556489+0000", 2024-09-12T16:18:19.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5910000000000001e-06 2024-09-12T16:18:19.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556495+0000", 2024-09-12T16:18:19.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5600000000000001e-06 2024-09-12T16:18:19.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:19.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608659+0000", 2024-09-12T16:18:19.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052164489000000001 2024-09-12T16:18:19.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:19.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608714+0000", 2024-09-12T16:18:19.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4849999999999998e-05 2024-09-12T16:18:19.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:19.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608765+0000", 2024-09-12T16:18:19.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0971999999999999e-05 2024-09-12T16:18:19.298 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.298 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:19.298 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.299 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5642 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1134592~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:19.299 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556502+0000", 2024-09-12T16:18:19.299 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.689713956999999, 2024-09-12T16:18:19.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052404536000000002, 2024-09-12T16:18:19.299 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:19.299 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:19.299 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:19.299 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:19.299 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:19.299 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:19.299 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5642 2024-09-12T16:18:19.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.299 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:19.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:19.300 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556502+0000", 2024-09-12T16:18:19.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:19.300 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556502+0000", 2024-09-12T16:18:19.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:19.300 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556503+0000", 2024-09-12T16:18:19.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8599999999999998e-07 2024-09-12T16:18:19.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:19.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556505+0000", 2024-09-12T16:18:19.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.097e-06 2024-09-12T16:18:19.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:19.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556512+0000", 2024-09-12T16:18:19.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8229999999999997e-06 2024-09-12T16:18:19.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556517+0000", 2024-09-12T16:18:19.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6289999999999998e-06 2024-09-12T16:18:19.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:19.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608797+0000", 2024-09-12T16:18:19.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052279651000000003 2024-09-12T16:18:19.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:19.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608852+0000", 2024-09-12T16:18:19.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4994999999999998e-05 2024-09-12T16:18:19.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:19.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608907+0000", 2024-09-12T16:18:19.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4755e-05 2024-09-12T16:18:19.302 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.302 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:19.302 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.303 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5643 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1187840~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:19.303 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556525+0000", 2024-09-12T16:18:19.303 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.689691714999999, 2024-09-12T16:18:19.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052518288000000003, 2024-09-12T16:18:19.303 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:19.303 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:19.303 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:19.303 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:19.303 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:19.303 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:19.303 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5643 2024-09-12T16:18:19.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.303 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:19.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.304 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:19.304 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556525+0000", 2024-09-12T16:18:19.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.304 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:19.304 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556525+0000", 2024-09-12T16:18:19.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.304 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:19.304 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556525+0000", 2024-09-12T16:18:19.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0400000000000002e-07 2024-09-12T16:18:19.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:19.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556528+0000", 2024-09-12T16:18:19.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8679999999999999e-06 2024-09-12T16:18:19.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:19.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556536+0000", 2024-09-12T16:18:19.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3089999999999996e-06 2024-09-12T16:18:19.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556541+0000", 2024-09-12T16:18:19.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3120000000000001e-06 2024-09-12T16:18:19.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:19.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608943+0000", 2024-09-12T16:18:19.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052401089999999997 2024-09-12T16:18:19.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:19.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608991+0000", 2024-09-12T16:18:19.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8633e-05 2024-09-12T16:18:19.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:19.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609043+0000", 2024-09-12T16:18:19.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1672000000000003e-05 2024-09-12T16:18:19.307 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.307 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:19.307 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.307 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5644 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1241088~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:19.307 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556548+0000", 2024-09-12T16:18:19.307 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.689668181999998, 2024-09-12T16:18:19.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052634777000000001, 2024-09-12T16:18:19.307 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:19.307 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:19.307 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:19.307 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:19.307 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:19.308 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:19.308 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5644 2024-09-12T16:18:19.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.308 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:19.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:19.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556548+0000", 2024-09-12T16:18:19.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:19.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556548+0000", 2024-09-12T16:18:19.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:19.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556549+0000", 2024-09-12T16:18:19.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1900000000000003e-07 2024-09-12T16:18:19.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:19.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556555+0000", 2024-09-12T16:18:19.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.652e-06 2024-09-12T16:18:19.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:19.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556562+0000", 2024-09-12T16:18:19.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.905e-06 2024-09-12T16:18:19.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556567+0000", 2024-09-12T16:18:19.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1730000000000003e-06 2024-09-12T16:18:19.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:19.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609079+0000", 2024-09-12T16:18:19.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052511993 2024-09-12T16:18:19.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:19.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609125+0000", 2024-09-12T16:18:19.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5327000000000002e-05 2024-09-12T16:18:19.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:19.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609183+0000", 2024-09-12T16:18:19.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8208000000000002e-05 2024-09-12T16:18:19.311 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.311 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:19.311 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.312 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5645 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1294336~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:19.312 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556574+0000", 2024-09-12T16:18:19.312 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.689641783999999, 2024-09-12T16:18:19.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052876909999999999, 2024-09-12T16:18:19.312 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:19.312 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:19.312 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:19.312 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:19.312 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:19.312 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:19.312 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5645 2024-09-12T16:18:19.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.313 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:19.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.313 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:19.313 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556574+0000", 2024-09-12T16:18:19.313 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.313 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:19.313 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556574+0000", 2024-09-12T16:18:19.313 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.313 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:19.313 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556575+0000", 2024-09-12T16:18:19.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.89e-07 2024-09-12T16:18:19.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:19.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556577+0000", 2024-09-12T16:18:19.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8700000000000001e-06 2024-09-12T16:18:19.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:19.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556583+0000", 2024-09-12T16:18:19.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4320000000000004e-06 2024-09-12T16:18:19.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556589+0000", 2024-09-12T16:18:19.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3890000000000004e-06 2024-09-12T16:18:19.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:19.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609236+0000", 2024-09-12T16:18:19.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052647022000000002 2024-09-12T16:18:19.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:19.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609334+0000", 2024-09-12T16:18:19.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8039000000000001e-05 2024-09-12T16:18:19.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:19.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609451+0000", 2024-09-12T16:18:19.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117769 2024-09-12T16:18:19.316 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.316 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:19.316 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.316 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5646 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1355776~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:19.316 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556595+0000", 2024-09-12T16:18:19.316 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.689620803, 2024-09-12T16:18:19.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053088173000000002, 2024-09-12T16:18:19.317 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:19.317 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:19.317 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:19.317 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:19.317 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:19.317 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:19.317 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5646 2024-09-12T16:18:19.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.317 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:19.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.317 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:19.317 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556595+0000", 2024-09-12T16:18:19.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:19.318 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556595+0000", 2024-09-12T16:18:19.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:19.318 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556596+0000", 2024-09-12T16:18:19.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:18:19.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:19.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556598+0000", 2024-09-12T16:18:19.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0669999999999999e-06 2024-09-12T16:18:19.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:19.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556603+0000", 2024-09-12T16:18:19.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5210000000000002e-06 2024-09-12T16:18:19.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556609+0000", 2024-09-12T16:18:19.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1590000000000001e-06 2024-09-12T16:18:19.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:19.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609499+0000", 2024-09-12T16:18:19.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052890489999999998 2024-09-12T16:18:19.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:19.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609586+0000", 2024-09-12T16:18:19.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6681999999999994e-05 2024-09-12T16:18:19.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:19.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609684+0000", 2024-09-12T16:18:19.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7863999999999997e-05 2024-09-12T16:18:19.320 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.320 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:19.321 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.321 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5647 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1409024~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:19.321 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556616+0000", 2024-09-12T16:18:19.321 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.689600508000002, 2024-09-12T16:18:19.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053207888000000002, 2024-09-12T16:18:19.321 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:19.321 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:19.321 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:19.321 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:19.321 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:19.321 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:19.322 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5647 2024-09-12T16:18:19.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.322 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:19.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.322 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:19.322 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556616+0000", 2024-09-12T16:18:19.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.322 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:19.322 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556616+0000", 2024-09-12T16:18:19.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:19.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556616+0000", 2024-09-12T16:18:19.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3599999999999999e-07 2024-09-12T16:18:19.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:19.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556618+0000", 2024-09-12T16:18:19.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1550000000000001e-06 2024-09-12T16:18:19.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:19.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556624+0000", 2024-09-12T16:18:19.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0499999999999997e-06 2024-09-12T16:18:19.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556629+0000", 2024-09-12T16:18:19.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8840000000000002e-06 2024-09-12T16:18:19.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:19.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609721+0000", 2024-09-12T16:18:19.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053091808999999997 2024-09-12T16:18:19.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:19.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609767+0000", 2024-09-12T16:18:19.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.638e-05 2024-09-12T16:18:19.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.325 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:19.325 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609824+0000", 2024-09-12T16:18:19.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6174000000000001e-05 2024-09-12T16:18:19.325 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.325 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:19.325 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.325 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5648 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1462272~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:19.325 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556636+0000", 2024-09-12T16:18:19.325 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.689579849000001, 2024-09-12T16:18:19.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053322131000000002, 2024-09-12T16:18:19.326 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:19.326 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:19.326 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:19.326 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:19.326 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:19.326 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:19.326 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5648 2024-09-12T16:18:19.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.326 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:19.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.326 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:19.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556636+0000", 2024-09-12T16:18:19.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:19.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556636+0000", 2024-09-12T16:18:19.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:19.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557015+0000", 2024-09-12T16:18:19.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000378911 2024-09-12T16:18:19.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:19.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557019+0000", 2024-09-12T16:18:19.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2100000000000002e-06 2024-09-12T16:18:19.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:19.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557030+0000", 2024-09-12T16:18:19.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.149e-05 2024-09-12T16:18:19.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557037+0000", 2024-09-12T16:18:19.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5719999999999999e-06 2024-09-12T16:18:19.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:19.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609838+0000", 2024-09-12T16:18:19.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052801305999999999 2024-09-12T16:18:19.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:19.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609880+0000", 2024-09-12T16:18:19.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2604000000000001e-05 2024-09-12T16:18:19.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:19.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609959+0000", 2024-09-12T16:18:19.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8038000000000001e-05 2024-09-12T16:18:19.329 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.329 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:19.329 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.330 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5649 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1515520~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:19.330 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.557073+0000", 2024-09-12T16:18:19.330 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.689142847999999, 2024-09-12T16:18:19.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053030573999999997, 2024-09-12T16:18:19.330 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:19.330 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:19.330 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:19.330 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:19.330 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:19.330 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:19.330 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5649 2024-09-12T16:18:19.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.330 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:19.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:19.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557073+0000", 2024-09-12T16:18:19.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:19.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557073+0000", 2024-09-12T16:18:19.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:19.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557074+0000", 2024-09-12T16:18:19.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5199999999999996e-07 2024-09-12T16:18:19.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:19.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557084+0000", 2024-09-12T16:18:19.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0349e-05 2024-09-12T16:18:19.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:19.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557092+0000", 2024-09-12T16:18:19.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9699999999999999e-06 2024-09-12T16:18:19.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557100+0000", 2024-09-12T16:18:19.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7049999999999999e-06 2024-09-12T16:18:19.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:19.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609992+0000", 2024-09-12T16:18:19.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052891821999999998 2024-09-12T16:18:19.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:19.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610034+0000", 2024-09-12T16:18:19.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2141000000000002e-05 2024-09-12T16:18:19.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:19.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610104+0000", 2024-09-12T16:18:19.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9935e-05 2024-09-12T16:18:19.334 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.334 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:19.334 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.334 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5650 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1568768~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:19.334 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.557111+0000", 2024-09-12T16:18:19.334 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.689105626, 2024-09-12T16:18:19.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053118023, 2024-09-12T16:18:19.334 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:19.334 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:19.335 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:19.335 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:19.335 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:19.335 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:19.335 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5650 2024-09-12T16:18:19.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.335 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:19.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:19.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557111+0000", 2024-09-12T16:18:19.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:19.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557111+0000", 2024-09-12T16:18:19.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:19.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:19.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.562089+0000", 2024-09-12T16:18:19.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0049787410000000001 2024-09-12T16:18:19.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:19.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.562094+0000", 2024-09-12T16:18:19.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7210000000000002e-06 2024-09-12T16:18:19.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:19.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.562105+0000", 2024-09-12T16:18:19.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0458999999999999e-05 2024-09-12T16:18:19.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.562112+0000", 2024-09-12T16:18:19.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0280000000000003e-06 2024-09-12T16:18:19.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:19.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610135+0000", 2024-09-12T16:18:19.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048023374000000001 2024-09-12T16:18:19.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:19.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610177+0000", 2024-09-12T16:18:19.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2119000000000001e-05 2024-09-12T16:18:19.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:19.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:19.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:19.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610229+0000", 2024-09-12T16:18:19.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1581e-05 2024-09-12T16:18:19.338 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.338 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:19.338 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.338 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:19.338 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:19.338 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:19.340 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:18:19.340 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:19.339+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:19.441 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:19.439+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:19.452 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:19.452 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:19.452 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:18:19.452 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:19.461 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:18:19.542 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:19.541+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:19.608 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:19.608 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:19.608 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:18:19.608 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:18:19.608 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:19.617 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:18:19.643 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:19.642+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:19.728 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:19.728 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:18:19.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:18:19.728 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:18:19.728 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.728 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:18:19.729 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:18:19.729 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 157.95976516600001, 2024-09-12T16:18:19.729 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55645454900000002, 2024-09-12T16:18:19.729 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:19.729 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:19.729 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:19.729 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:19.729 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:18:19.729 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:18:19.729 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1 2024-09-12T16:18:19.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.729 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:19.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.730 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:19.730 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:18:19.730 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.730 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:19.730 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:18:19.730 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.730 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:19.730 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764440+0000", 2024-09-12T16:18:19.730 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6249999999999999e-06 2024-09-12T16:18:19.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.731 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:19.731 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764447+0000", 2024-09-12T16:18:19.731 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4939999999999997e-06 2024-09-12T16:18:19.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.731 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:19.731 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764459+0000", 2024-09-12T16:18:19.731 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1517e-05 2024-09-12T16:18:19.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.731 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.731 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764468+0000", 2024-09-12T16:18:19.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7690000000000002e-06 2024-09-12T16:18:19.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:19.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764539+0000", 2024-09-12T16:18:19.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1103e-05 2024-09-12T16:18:19.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:19.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764551+0000", 2024-09-12T16:18:19.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2687999999999999e-05 2024-09-12T16:18:19.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.733 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.733 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:19.733 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319497+0000", 2024-09-12T16:18:19.733 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55494560500000001 2024-09-12T16:18:19.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.733 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.733 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:19.733 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319688+0000", 2024-09-12T16:18:19.733 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019105599999999999 2024-09-12T16:18:19.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.733 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.733 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:18:19.733 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319842+0000", 2024-09-12T16:18:19.733 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015377699999999999 2024-09-12T16:18:19.734 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.734 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.734 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:18:19.734 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320473+0000", 2024-09-12T16:18:19.734 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00063117100000000003 2024-09-12T16:18:19.734 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.734 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.734 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:19.734 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320825+0000", 2024-09-12T16:18:19.734 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00035202500000000001 2024-09-12T16:18:19.734 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.734 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.734 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:19.735 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320867+0000", 2024-09-12T16:18:19.735 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2005000000000002e-05 2024-09-12T16:18:19.735 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.735 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.735 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:19.735 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320893+0000", 2024-09-12T16:18:19.735 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5714000000000001e-05 2024-09-12T16:18:19.735 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.735 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:19.735 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.735 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.735 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.735 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14034 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5035008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:19.736 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:18:19.736 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 120.202706933, 2024-09-12T16:18:19.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053404082999999998, 2024-09-12T16:18:19.736 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:19.736 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:19.736 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:19.736 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:19.736 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:19.736 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:19.736 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14034 2024-09-12T16:18:19.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.736 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:19.736 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.737 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:19.737 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:18:19.737 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.737 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.737 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.737 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:19.737 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:18:19.737 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.737 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.737 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.737 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:19.737 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521740+0000", 2024-09-12T16:18:19.737 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000243976 2024-09-12T16:18:19.737 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.738 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.738 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:19.738 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521745+0000", 2024-09-12T16:18:19.738 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1280000000000001e-06 2024-09-12T16:18:19.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.738 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.738 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:19.738 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521757+0000", 2024-09-12T16:18:19.738 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2751e-05 2024-09-12T16:18:19.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.738 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.738 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.738 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521771+0000", 2024-09-12T16:18:19.738 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3328e-05 2024-09-12T16:18:19.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:19.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574710+0000", 2024-09-12T16:18:19.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052939358999999998 2024-09-12T16:18:19.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:19.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574799+0000", 2024-09-12T16:18:19.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8893000000000004e-05 2024-09-12T16:18:19.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:19.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574901+0000", 2024-09-12T16:18:19.740 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101648 2024-09-12T16:18:19.740 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.740 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:19.740 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.740 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.740 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14036 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5043200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:19.740 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:18:19.740 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 120.202247739, 2024-09-12T16:18:19.740 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053426247000000003, 2024-09-12T16:18:19.740 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:19.740 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:19.740 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:19.741 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:19.741 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:19.741 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:19.741 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14036 2024-09-12T16:18:19.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.741 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:19.741 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.741 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:19.741 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:18:19.741 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.741 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.741 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:19.741 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:18:19.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.742 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:19.742 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522208+0000", 2024-09-12T16:18:19.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025195300000000002 2024-09-12T16:18:19.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.742 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:19.742 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522211+0000", 2024-09-12T16:18:19.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2160000000000002e-06 2024-09-12T16:18:19.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.742 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:19.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522223+0000", 2024-09-12T16:18:19.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2044e-05 2024-09-12T16:18:19.743 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522229+0000", 2024-09-12T16:18:19.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8850000000000004e-06 2024-09-12T16:18:19.743 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:19.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575192+0000", 2024-09-12T16:18:19.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052963573 2024-09-12T16:18:19.743 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.744 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:19.744 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575282+0000", 2024-09-12T16:18:19.744 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9666000000000005e-05 2024-09-12T16:18:19.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.744 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:19.744 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575382+0000", 2024-09-12T16:18:19.744 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9909999999999997e-05 2024-09-12T16:18:19.744 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.744 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:19.744 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.745 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14039 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5055488~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:19.745 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:18:19.745 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 120.201567955, 2024-09-12T16:18:19.745 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053466207000000002, 2024-09-12T16:18:19.745 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:19.745 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:19.745 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:19.745 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:19.745 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:19.745 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:19.745 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14039 2024-09-12T16:18:19.745 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.745 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:19.746 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.746 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:19.746 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:18:19.746 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.746 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.746 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:19.746 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:18:19.746 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.746 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.746 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:19.746 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522899+0000", 2024-09-12T16:18:19.746 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026318199999999999 2024-09-12T16:18:19.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:19.747 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522903+0000", 2024-09-12T16:18:19.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.929e-06 2024-09-12T16:18:19.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:19.747 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522913+0000", 2024-09-12T16:18:19.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0162e-05 2024-09-12T16:18:19.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.747 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522921+0000", 2024-09-12T16:18:19.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.14e-06 2024-09-12T16:18:19.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.748 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:19.748 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575922+0000", 2024-09-12T16:18:19.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053000712999999998 2024-09-12T16:18:19.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.748 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:19.748 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576006+0000", 2024-09-12T16:18:19.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4161999999999998e-05 2024-09-12T16:18:19.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.749 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.749 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:19.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576102+0000", 2024-09-12T16:18:19.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5919000000000001e-05 2024-09-12T16:18:19.749 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.749 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:19.749 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.749 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.749 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14040 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5059584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:19.749 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:18:19.749 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 120.20126306, 2024-09-12T16:18:19.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053413258999999998, 2024-09-12T16:18:19.749 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:19.750 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:19.750 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:19.750 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:19.750 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:19.750 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:19.750 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14040 2024-09-12T16:18:19.750 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.750 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:19.750 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.750 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:19.750 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:18:19.750 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.750 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.751 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.751 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:19.751 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:18:19.751 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.751 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.751 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.751 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:19.751 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523059+0000", 2024-09-12T16:18:19.751 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118466 2024-09-12T16:18:19.751 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.751 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.751 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:19.751 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523062+0000", 2024-09-12T16:18:19.752 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.971e-06 2024-09-12T16:18:19.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.752 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.752 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:19.752 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523069+0000", 2024-09-12T16:18:19.752 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8279999999999997e-06 2024-09-12T16:18:19.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.752 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.752 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.752 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523073+0000", 2024-09-12T16:18:19.752 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3019999999999996e-06 2024-09-12T16:18:19.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.752 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.753 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:19.753 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576155+0000", 2024-09-12T16:18:19.753 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053081962000000003 2024-09-12T16:18:19.753 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.753 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.753 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:19.753 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576249+0000", 2024-09-12T16:18:19.753 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3914999999999998e-05 2024-09-12T16:18:19.753 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.753 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.753 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:19.753 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576354+0000", 2024-09-12T16:18:19.753 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010481500000000001 2024-09-12T16:18:19.754 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.754 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:19.754 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.754 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.754 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.754 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14041 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5063680~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:19.754 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:18:19.754 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 120.201112755, 2024-09-12T16:18:19.754 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053519111000000001, 2024-09-12T16:18:19.754 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:19.754 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:19.754 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:19.754 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:19.754 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:19.755 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:19.755 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14041 2024-09-12T16:18:19.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.755 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:19.755 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.755 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:19.755 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:18:19.755 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.755 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.755 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:19.755 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:18:19.755 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.756 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.756 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:19.756 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523309+0000", 2024-09-12T16:18:19.756 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000218712 2024-09-12T16:18:19.756 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.756 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.756 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:19.756 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523313+0000", 2024-09-12T16:18:19.756 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.151e-06 2024-09-12T16:18:19.756 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.756 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.756 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:19.756 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523320+0000", 2024-09-12T16:18:19.757 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9789999999999993e-06 2024-09-12T16:18:19.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.757 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.757 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.757 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523325+0000", 2024-09-12T16:18:19.757 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:18:19.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.757 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.757 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:19.757 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576402+0000", 2024-09-12T16:18:19.757 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053076811000000002 2024-09-12T16:18:19.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.757 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.758 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:19.758 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576491+0000", 2024-09-12T16:18:19.758 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8578999999999993e-05 2024-09-12T16:18:19.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.758 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.758 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:19.758 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576610+0000", 2024-09-12T16:18:19.758 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119129 2024-09-12T16:18:19.758 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.758 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:19.758 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.758 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.759 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14042 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5067776~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:19.759 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:18:19.759 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 120.200869321, 2024-09-12T16:18:19.759 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053510350999999998, 2024-09-12T16:18:19.759 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:19.759 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:19.759 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:19.759 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:19.759 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:19.759 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:19.759 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14042 2024-09-12T16:18:19.759 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.759 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:19.759 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.760 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:19.760 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:18:19.760 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.760 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.760 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.760 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:19.760 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:18:19.760 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.760 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.760 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.760 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:19.760 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523591+0000", 2024-09-12T16:18:19.760 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025710300000000001 2024-09-12T16:18:19.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.761 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.761 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:19.761 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523594+0000", 2024-09-12T16:18:19.761 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2229999999999999e-06 2024-09-12T16:18:19.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.761 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.761 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:19.761 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523602+0000", 2024-09-12T16:18:19.761 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6930000000000007e-06 2024-09-12T16:18:19.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.761 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.761 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.762 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523607+0000", 2024-09-12T16:18:19.762 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4789999999999998e-06 2024-09-12T16:18:19.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.762 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.762 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:19.762 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576661+0000", 2024-09-12T16:18:19.762 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053973999999997 2024-09-12T16:18:19.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.762 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.762 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:19.762 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576745+0000", 2024-09-12T16:18:19.762 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4660000000000006e-05 2024-09-12T16:18:19.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.762 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.762 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:19.763 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576844+0000", 2024-09-12T16:18:19.763 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9219e-05 2024-09-12T16:18:19.763 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.763 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:19.763 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.763 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.763 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.763 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14043 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5071872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:19.763 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:18:19.763 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 120.200588842, 2024-09-12T16:18:19.763 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053475295999999999, 2024-09-12T16:18:19.763 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:19.763 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:19.763 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:19.763 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:19.763 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:19.764 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:19.764 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14043 2024-09-12T16:18:19.764 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.764 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:19.764 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.764 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:19.764 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:18:19.764 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.764 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.764 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.764 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:19.764 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:18:19.765 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.765 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.765 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:19.765 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523823+0000", 2024-09-12T16:18:19.765 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020818900000000001 2024-09-12T16:18:19.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.765 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.765 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:19.765 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523826+0000", 2024-09-12T16:18:19.765 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.405e-06 2024-09-12T16:18:19.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.765 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.765 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:19.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523834+0000", 2024-09-12T16:18:19.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5499999999999997e-06 2024-09-12T16:18:19.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.766 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523838+0000", 2024-09-12T16:18:19.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.408e-06 2024-09-12T16:18:19.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.766 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:19.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576904+0000", 2024-09-12T16:18:19.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053065687 2024-09-12T16:18:19.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.767 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:19.767 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576991+0000", 2024-09-12T16:18:19.767 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7399999999999997e-05 2024-09-12T16:18:19.767 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.767 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.767 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:19.767 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577090+0000", 2024-09-12T16:18:19.767 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8657000000000001e-05 2024-09-12T16:18:19.767 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.767 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:19.767 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.767 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.767 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.767 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14044 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5075968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:19.767 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:18:19.768 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 120.20035731199999, 2024-09-12T16:18:19.768 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053442659000000003, 2024-09-12T16:18:19.768 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:19.768 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:19.768 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:19.768 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:19.768 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:19.768 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:19.768 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14044 2024-09-12T16:18:19.768 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.768 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:19.768 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.768 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:19.768 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:18:19.768 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.769 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:19.769 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:18:19.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.769 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:19.769 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523985+0000", 2024-09-12T16:18:19.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000138522 2024-09-12T16:18:19.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.769 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:19.769 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523988+0000", 2024-09-12T16:18:19.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.788e-06 2024-09-12T16:18:19.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.770 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:19.770 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523998+0000", 2024-09-12T16:18:19.770 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8470000000000008e-06 2024-09-12T16:18:19.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.770 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.770 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524010+0000", 2024-09-12T16:18:19.770 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1348999999999999e-05 2024-09-12T16:18:19.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.770 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:19.771 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577137+0000", 2024-09-12T16:18:19.771 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053127055999999999 2024-09-12T16:18:19.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.771 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.771 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:19.771 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577210+0000", 2024-09-12T16:18:19.771 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3392000000000005e-05 2024-09-12T16:18:19.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.771 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.771 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:19.771 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577289+0000", 2024-09-12T16:18:19.771 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8704999999999999e-05 2024-09-12T16:18:19.772 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.772 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:19.772 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.772 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14045 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5080064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:19.772 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:18:19.772 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 120.200178491, 2024-09-12T16:18:19.772 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053497514000000003, 2024-09-12T16:18:19.772 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:19.772 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:19.772 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:19.772 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:19.773 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:19.773 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:19.773 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14045 2024-09-12T16:18:19.773 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.773 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:19.773 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.773 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:19.773 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:18:19.773 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.773 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.773 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.773 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:19.773 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:18:19.774 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.774 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.774 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:19.774 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524311+0000", 2024-09-12T16:18:19.774 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028626299999999998 2024-09-12T16:18:19.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.774 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.774 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:19.774 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524315+0000", 2024-09-12T16:18:19.774 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0969999999999999e-06 2024-09-12T16:18:19.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.775 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:19.775 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524325+0000", 2024-09-12T16:18:19.775 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6330000000000008e-06 2024-09-12T16:18:19.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.775 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.775 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524332+0000", 2024-09-12T16:18:19.775 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8700000000000003e-06 2024-09-12T16:18:19.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.775 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:19.775 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577334+0000", 2024-09-12T16:18:19.775 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053001834999999997 2024-09-12T16:18:19.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.776 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:19.776 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577420+0000", 2024-09-12T16:18:19.776 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6145999999999998e-05 2024-09-12T16:18:19.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.776 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:19.776 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577522+0000", 2024-09-12T16:18:19.776 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010267 2024-09-12T16:18:19.776 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.776 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:19.776 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.777 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.777 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14047 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5088256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:19.777 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:18:19.777 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 120.19969276499999, 2024-09-12T16:18:19.777 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053433340000000003, 2024-09-12T16:18:19.777 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:19.777 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:19.777 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:19.777 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:19.777 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:19.777 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:19.777 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14047 2024-09-12T16:18:19.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.778 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:19.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.778 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:19.778 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:18:19.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.778 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:19.778 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:18:19.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.778 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:19.778 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524727+0000", 2024-09-12T16:18:19.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000216126 2024-09-12T16:18:19.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:19.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524732+0000", 2024-09-12T16:18:19.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1569999999999999e-06 2024-09-12T16:18:19.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:19.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524742+0000", 2024-09-12T16:18:19.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0186999999999999e-05 2024-09-12T16:18:19.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524750+0000", 2024-09-12T16:18:19.780 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4279999999999999e-06 2024-09-12T16:18:19.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.780 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.780 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:19.780 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577743+0000", 2024-09-12T16:18:19.780 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052993077 2024-09-12T16:18:19.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.780 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.780 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:19.780 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577841+0000", 2024-09-12T16:18:19.780 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8369000000000006e-05 2024-09-12T16:18:19.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.780 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.780 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:19.781 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577944+0000", 2024-09-12T16:18:19.781 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102996 2024-09-12T16:18:19.781 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.781 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:19.781 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.781 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.781 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14048 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5092352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:19.781 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:18:19.781 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 120.19944117199999, 2024-09-12T16:18:19.781 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053397515, 2024-09-12T16:18:19.781 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:19.781 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:19.781 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:19.782 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:19.782 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:19.782 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:19.782 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14048 2024-09-12T16:18:19.782 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.782 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:19.782 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.782 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:19.782 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:18:19.782 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.782 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.782 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.782 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:19.783 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:18:19.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.783 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:19.783 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524957+0000", 2024-09-12T16:18:19.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019516999999999999 2024-09-12T16:18:19.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.783 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:19.783 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524962+0000", 2024-09-12T16:18:19.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7709999999999997e-06 2024-09-12T16:18:19.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.784 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:19.784 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524973+0000", 2024-09-12T16:18:19.784 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1031e-05 2024-09-12T16:18:19.784 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.784 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.784 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.784 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524980+0000", 2024-09-12T16:18:19.784 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6100000000000002e-06 2024-09-12T16:18:19.784 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.784 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.784 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:19.784 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577977+0000", 2024-09-12T16:18:19.784 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052997481999999999 2024-09-12T16:18:19.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.785 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.785 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:19.785 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578062+0000", 2024-09-12T16:18:19.785 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4851000000000005e-05 2024-09-12T16:18:19.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.785 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.786 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:19.786 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578160+0000", 2024-09-12T16:18:19.786 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7600000000000001e-05 2024-09-12T16:18:19.786 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.786 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:19.786 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.786 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.786 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14049 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5096448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:19.786 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:18:19.786 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 120.19921254400001, 2024-09-12T16:18:19.786 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053439792, 2024-09-12T16:18:19.786 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:19.787 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:19.787 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:19.787 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:19.787 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:19.787 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:19.787 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14049 2024-09-12T16:18:19.787 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.787 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:19.787 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.787 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:19.787 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:18:19.787 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.787 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.788 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.788 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:19.788 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:18:19.788 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.788 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.788 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:19.788 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525170+0000", 2024-09-12T16:18:19.788 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017958500000000001 2024-09-12T16:18:19.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.788 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.788 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:19.788 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525174+0000", 2024-09-12T16:18:19.789 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0239999999999999e-06 2024-09-12T16:18:19.789 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.789 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.789 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:19.789 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525184+0000", 2024-09-12T16:18:19.789 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5950000000000005e-06 2024-09-12T16:18:19.789 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.789 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.789 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.789 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525191+0000", 2024-09-12T16:18:19.789 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8329999999999996e-06 2024-09-12T16:18:19.789 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.789 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.790 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:19.790 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578240+0000", 2024-09-12T16:18:19.790 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053049236 2024-09-12T16:18:19.790 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.790 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.790 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:19.790 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578333+0000", 2024-09-12T16:18:19.790 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2806999999999994e-05 2024-09-12T16:18:19.790 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.790 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.790 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:19.790 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578431+0000", 2024-09-12T16:18:19.790 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7712000000000002e-05 2024-09-12T16:18:19.790 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.790 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:19.791 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.791 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.791 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.791 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14055 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5121024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:19.791 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:18:19.791 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 120.197941853, 2024-09-12T16:18:19.791 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053399038000000003, 2024-09-12T16:18:19.791 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:19.791 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:19.791 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:19.791 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:19.791 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:19.791 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:19.791 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14055 2024-09-12T16:18:19.792 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.792 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:19.792 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.792 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:19.792 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:18:19.792 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.792 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.792 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.792 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:19.792 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:18:19.792 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.792 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.792 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.792 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:19.793 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526403+0000", 2024-09-12T16:18:19.793 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141571 2024-09-12T16:18:19.793 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.793 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.793 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:19.793 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526406+0000", 2024-09-12T16:18:19.793 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2660000000000002e-06 2024-09-12T16:18:19.793 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.793 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.793 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:19.793 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526420+0000", 2024-09-12T16:18:19.793 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3949e-05 2024-09-12T16:18:19.793 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.794 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.794 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.794 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526428+0000", 2024-09-12T16:18:19.794 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4250000000000001e-06 2024-09-12T16:18:19.794 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.794 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.794 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:19.794 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579476+0000", 2024-09-12T16:18:19.794 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053048349000000002 2024-09-12T16:18:19.794 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.794 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.794 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:19.794 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579563+0000", 2024-09-12T16:18:19.795 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6502999999999995e-05 2024-09-12T16:18:19.795 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.795 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.795 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:19.795 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579661+0000", 2024-09-12T16:18:19.795 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7974999999999996e-05 2024-09-12T16:18:19.795 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.795 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:19.795 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.795 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.795 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.795 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4806.0:3139 3.1e 3:78d5a095:::rbd_data.11552a37e55b.0000000000000000:head [read 69632~61440] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:18:19.795 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:18:19.795 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 109.422947603, 2024-09-12T16:18:19.795 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057851734000000002, 2024-09-12T16:18:19.796 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:19.796 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:19.796 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:19.796 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:19.796 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4806", 2024-09-12T16:18:19.796 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3959815836", 2024-09-12T16:18:19.796 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 3139 2024-09-12T16:18:19.796 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.796 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:19.796 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.796 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:19.796 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:18:19.796 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.796 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.796 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.797 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:19.797 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:18:19.797 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.797 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.797 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.797 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:19.797 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:18:19.797 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4799999999999999e-07 2024-09-12T16:18:19.797 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.797 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.797 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:19.797 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301258+0000", 2024-09-12T16:18:19.797 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.844e-06 2024-09-12T16:18:19.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.798 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.798 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:19.798 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301267+0000", 2024-09-12T16:18:19.798 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2960000000000004e-06 2024-09-12T16:18:19.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.798 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.798 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.798 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301276+0000", 2024-09-12T16:18:19.798 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0650000000000005e-06 2024-09-12T16:18:19.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.798 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.798 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:19.798 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301871+0000", 2024-09-12T16:18:19.799 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00059423600000000005 2024-09-12T16:18:19.799 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.799 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.799 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:19.799 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301920+0000", 2024-09-12T16:18:19.799 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9067000000000003e-05 2024-09-12T16:18:19.799 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.799 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.799 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:19.799 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359108+0000", 2024-09-12T16:18:19.799 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057187877999999998 2024-09-12T16:18:19.799 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.799 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:19.800 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.800 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.800 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.800 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:6428 3.14 3:28a44e54:::rbd_header.11552a37e55b:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:18:19.800 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:18:19.800 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 109.422619009, 2024-09-12T16:18:19.800 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057504023000000001, 2024-09-12T16:18:19.800 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:19.800 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:19.800 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:19.800 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:19.800 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:18:19.800 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:18:19.800 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6428 2024-09-12T16:18:19.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.801 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:19.801 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.801 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:19.801 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:18:19.801 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.801 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.801 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:19.801 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:18:19.801 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.801 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.802 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:19.802 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301585+0000", 2024-09-12T16:18:19.802 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6300000000000005e-07 2024-09-12T16:18:19.802 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.802 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.802 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:19.802 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301588+0000", 2024-09-12T16:18:19.802 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4149999999999999e-06 2024-09-12T16:18:19.802 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.802 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.802 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:19.802 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301597+0000", 2024-09-12T16:18:19.802 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5450000000000003e-06 2024-09-12T16:18:19.802 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.803 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.803 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.803 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301617+0000", 2024-09-12T16:18:19.803 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9837e-05 2024-09-12T16:18:19.803 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.803 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.803 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:19.803 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301779+0000", 2024-09-12T16:18:19.803 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016186799999999999 2024-09-12T16:18:19.803 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.803 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.803 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:19.803 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301855+0000", 2024-09-12T16:18:19.804 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5899e-05 2024-09-12T16:18:19.804 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.804 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.804 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:19.804 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359088+0000", 2024-09-12T16:18:19.804 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057233895999999999 2024-09-12T16:18:19.804 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.804 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:19.804 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.804 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.804 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.804 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5223.0:1814 3.f 3:f7b1b1c5:::rbd_object_map.1155a1fd27d2:head [read 0~136] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-12T16:18:19.804 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:18:19.805 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 73.486952944999999, 2024-09-12T16:18:19.805 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.006378226, 2024-09-12T16:18:19.805 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:19.805 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:19.805 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:19.805 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:19.805 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5223", 2024-09-12T16:18:19.805 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/4066330994", 2024-09-12T16:18:19.805 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1814 2024-09-12T16:18:19.805 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.805 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:19.805 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.805 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:19.805 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:18:19.806 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.806 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.806 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:19.806 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:18:19.806 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.806 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.806 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:19.806 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237252+0000", 2024-09-12T16:18:19.806 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.344e-06 2024-09-12T16:18:19.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.806 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.806 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:19.806 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237258+0000", 2024-09-12T16:18:19.807 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1070000000000001e-06 2024-09-12T16:18:19.807 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.807 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.807 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:19.807 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237270+0000", 2024-09-12T16:18:19.807 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1758e-05 2024-09-12T16:18:19.807 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.807 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.807 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.807 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237278+0000", 2024-09-12T16:18:19.807 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3219999999999993e-06 2024-09-12T16:18:19.807 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.807 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.808 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:19.808 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237334+0000", 2024-09-12T16:18:19.808 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6356e-05 2024-09-12T16:18:19.808 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.808 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.808 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:19.808 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237345+0000", 2024-09-12T16:18:19.808 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0433e-05 2024-09-12T16:18:19.808 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.808 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.808 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:19.808 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243426+0000", 2024-09-12T16:18:19.808 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.00608133 2024-09-12T16:18:19.809 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.809 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.809 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:19.809 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243534+0000", 2024-09-12T16:18:19.809 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010784 2024-09-12T16:18:19.809 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.809 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.809 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:19.809 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243629+0000", 2024-09-12T16:18:19.809 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4735999999999996e-05 2024-09-12T16:18:19.809 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.809 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:19.809 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.809 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.809 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.810 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5328.0:2542 3.16 3:6928f3a1:::rbd_object_map.11551722dd77:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:18:19.810 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:18:19.810 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 67.668607515000005, 2024-09-12T16:18:19.810 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.054219934999999997, 2024-09-12T16:18:19.810 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:19.810 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:19.810 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:19.810 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:19.810 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5328", 2024-09-12T16:18:19.810 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:18:19.810 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2542 2024-09-12T16:18:19.810 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.810 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:19.810 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.810 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:19.810 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:18:19.811 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.811 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.811 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.811 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:19.811 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:18:19.811 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.811 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.811 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.811 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:19.811 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055597+0000", 2024-09-12T16:18:19.811 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4300000000000001e-07 2024-09-12T16:18:19.811 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.811 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.811 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:19.812 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055602+0000", 2024-09-12T16:18:19.812 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4269999999999999e-06 2024-09-12T16:18:19.812 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.812 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.812 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:19.812 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055613+0000", 2024-09-12T16:18:19.812 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0815000000000001e-05 2024-09-12T16:18:19.812 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.812 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.812 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.812 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055621+0000", 2024-09-12T16:18:19.812 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4189999999999996e-06 2024-09-12T16:18:19.812 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.812 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.812 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:19.813 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102196+0000", 2024-09-12T16:18:19.813 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.046575616 2024-09-12T16:18:19.813 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.813 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.813 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:19.813 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102258+0000", 2024-09-12T16:18:19.813 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1872000000000007e-05 2024-09-12T16:18:19.813 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.813 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.813 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T16:18:19.813 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102601+0000", 2024-09-12T16:18:19.813 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034285700000000001 2024-09-12T16:18:19.813 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.813 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.813 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:19.814 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.104431+0000", 2024-09-12T16:18:19.814 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001830524 2024-09-12T16:18:19.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.814 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.814 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:18:19.814 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109733+0000", 2024-09-12T16:18:19.814 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0053020089999999999 2024-09-12T16:18:19.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.814 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.814 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:19.814 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109777+0000", 2024-09-12T16:18:19.814 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3754000000000002e-05 2024-09-12T16:18:19.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.814 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.815 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:19.815 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109816+0000", 2024-09-12T16:18:19.815 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8699000000000003e-05 2024-09-12T16:18:19.815 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.815 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:19.815 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.815 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.815 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.815 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5328.0:2543 3.16 3:6928f3a1:::rbd_object_map.11551722dd77:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:18:19.815 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:18:19.815 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 67.668013536000004, 2024-09-12T16:18:19.815 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053695720000000002, 2024-09-12T16:18:19.815 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:19.815 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:19.816 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:19.816 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:19.816 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5328", 2024-09-12T16:18:19.816 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:18:19.816 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2543 2024-09-12T16:18:19.816 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.816 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:19.816 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.816 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:19.816 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:18:19.816 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.816 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.816 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.816 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:19.817 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:18:19.817 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.817 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.817 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:19.817 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056191+0000", 2024-09-12T16:18:19.817 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.54e-07 2024-09-12T16:18:19.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.817 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.817 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:19.817 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056195+0000", 2024-09-12T16:18:19.817 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5460000000000002e-06 2024-09-12T16:18:19.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.818 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.818 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:19.818 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056205+0000", 2024-09-12T16:18:19.818 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7350000000000008e-06 2024-09-12T16:18:19.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.818 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.818 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.818 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056214+0000", 2024-09-12T16:18:19.818 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8089999999999999e-06 2024-09-12T16:18:19.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.818 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.818 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:19.818 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103317+0000", 2024-09-12T16:18:19.818 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.047102889000000002 2024-09-12T16:18:19.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.818 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.819 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:19.819 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103410+0000", 2024-09-12T16:18:19.819 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3689000000000004e-05 2024-09-12T16:18:19.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.819 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.819 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T16:18:19.819 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103754+0000", 2024-09-12T16:18:19.819 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034344699999999998 2024-09-12T16:18:19.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.819 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.819 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:19.819 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.106487+0000", 2024-09-12T16:18:19.819 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0027330100000000001 2024-09-12T16:18:19.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.819 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.820 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:18:19.820 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109827+0000", 2024-09-12T16:18:19.820 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033406640000000001 2024-09-12T16:18:19.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.820 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.820 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:19.820 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109854+0000", 2024-09-12T16:18:19.820 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6866999999999999e-05 2024-09-12T16:18:19.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.820 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.820 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:19.820 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109886+0000", 2024-09-12T16:18:19.820 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1309999999999997e-05 2024-09-12T16:18:19.820 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.820 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:19.821 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.821 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.821 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5832.0:1710 3.f 3:f0d97d21:::rbd_data.1155d3b3a2ae.0000000000000012:head [truncate 1376256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-12T16:18:19.821 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:18:19.821 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 32.340215450999999, 2024-09-12T16:18:19.821 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6441524489999999, 2024-09-12T16:18:19.821 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:19.821 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:19.821 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:19.821 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:19.821 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5832", 2024-09-12T16:18:19.821 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/201125203", 2024-09-12T16:18:19.821 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1710 2024-09-12T16:18:19.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.821 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:19.822 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.822 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:19.822 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:18:19.822 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.822 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.822 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:19.822 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:18:19.822 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:19.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.822 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.822 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:19.822 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:18:19.823 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.08e-07 2024-09-12T16:18:19.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.823 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:19.823 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383990+0000", 2024-09-12T16:18:19.823 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.979e-06 2024-09-12T16:18:19.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.823 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:19.823 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383999+0000", 2024-09-12T16:18:19.823 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3240000000000003e-06 2024-09-12T16:18:19.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.823 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:19.823 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.384002+0000", 2024-09-12T16:18:19.824 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5489999999999998e-06 2024-09-12T16:18:19.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.824 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.824 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:19.824 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.384037+0000", 2024-09-12T16:18:19.824 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4931000000000001e-05 2024-09-12T16:18:19.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.824 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.824 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:19.824 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.384043+0000", 2024-09-12T16:18:19.824 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3920000000000002e-06 2024-09-12T16:18:19.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.824 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.824 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:19.825 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:48.007976+0000", 2024-09-12T16:18:19.825 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.62393385300000004 2024-09-12T16:18:19.825 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.825 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.825 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:19.825 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:48.007992+0000", 2024-09-12T16:18:19.825 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5668e-05 2024-09-12T16:18:19.825 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.825 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.825 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:19.825 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024187+0000", 2024-09-12T16:18:19.825 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0161951629999999 2024-09-12T16:18:19.825 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.825 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.826 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:19.826 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024362+0000", 2024-09-12T16:18:19.826 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017500600000000001 2024-09-12T16:18:19.826 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.826 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.826 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:18:19.826 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024453+0000", 2024-09-12T16:18:19.826 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1055000000000001e-05 2024-09-12T16:18:19.826 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.826 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.826 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:18:19.826 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024963+0000", 2024-09-12T16:18:19.826 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000510087 2024-09-12T16:18:19.826 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.826 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.826 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:19.827 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.027974+0000", 2024-09-12T16:18:19.827 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030107070000000001 2024-09-12T16:18:19.827 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.827 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.827 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:19.827 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.028022+0000", 2024-09-12T16:18:19.827 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7636000000000003e-05 2024-09-12T16:18:19.827 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:19.827 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:19.827 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:19.827 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.028140+0000", 2024-09-12T16:18:19.827 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011869100000000001 2024-09-12T16:18:19.827 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.827 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:19.828 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.828 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:19.828 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:19.828 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:19.829 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:18:19.830 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:19.828+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:19.932 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:19.932+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:19.977 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:19.977 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:19.977 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:18:19.977 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:19.986 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:18:20.033 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:20.032+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:20.093 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:20.093 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:20.093 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:18:20.093 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:18:20.093 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:20.102 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:18:20.117 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2024-09-12T16:18:20.143 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:20.142+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:20.177 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 3] out_osds: [5] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-12T16:18:20.177 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T16:18:20.177 INFO:tasks.thrashosds.thrasher:Adding osd 5 2024-09-12T16:18:20.177 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 5 2024-09-12T16:18:20.235 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:20.234+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:20.259 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:20.259 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:18:20.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:18:20.259 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:18:20.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.260 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5599 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4788224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:20.260 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:18:20.260 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 99.961476609000002, 2024-09-12T16:18:20.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061192059, 2024-09-12T16:18:20.260 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.260 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.260 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:20.260 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:20.260 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:20.260 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:20.260 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5599 2024-09-12T16:18:20.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.260 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.260 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.261 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:18:20.261 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.261 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.261 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:18:20.261 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.261 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.261 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296333+0000", 2024-09-12T16:18:20.261 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6599999999999996e-07 2024-09-12T16:18:20.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296335+0000", 2024-09-12T16:18:20.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5900000000000002e-06 2024-09-12T16:18:20.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296344+0000", 2024-09-12T16:18:20.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9539999999999993e-06 2024-09-12T16:18:20.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296350+0000", 2024-09-12T16:18:20.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5589999999999996e-06 2024-09-12T16:18:20.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.263 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.263 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357307+0000", 2024-09-12T16:18:20.263 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.060957573000000001 2024-09-12T16:18:20.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.263 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.263 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:20.263 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357401+0000", 2024-09-12T16:18:20.263 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3512999999999997e-05 2024-09-12T16:18:20.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.263 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.263 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.263 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357524+0000", 2024-09-12T16:18:20.263 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000123304 2024-09-12T16:18:20.263 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.264 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.264 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.264 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5611 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4730880~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:20.264 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:18:20.264 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 99.961414164999994, 2024-09-12T16:18:20.264 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061359348000000001, 2024-09-12T16:18:20.264 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.264 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.264 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:20.265 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:20.265 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:20.265 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:20.265 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5611 2024-09-12T16:18:20.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.265 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:18:20.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:18:20.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296395+0000", 2024-09-12T16:18:20.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4600000000000003e-07 2024-09-12T16:18:20.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296399+0000", 2024-09-12T16:18:20.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9430000000000002e-06 2024-09-12T16:18:20.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.267 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.267 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296411+0000", 2024-09-12T16:18:20.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1755e-05 2024-09-12T16:18:20.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.267 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.267 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296417+0000", 2024-09-12T16:18:20.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3790000000000003e-06 2024-09-12T16:18:20.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.267 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.267 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357572+0000", 2024-09-12T16:18:20.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061154871 2024-09-12T16:18:20.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.268 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.268 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:20.268 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357663+0000", 2024-09-12T16:18:20.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0389999999999993e-05 2024-09-12T16:18:20.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.268 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.268 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.268 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357754+0000", 2024-09-12T16:18:20.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1063999999999994e-05 2024-09-12T16:18:20.268 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.268 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.269 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.269 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.269 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5613 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4775936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:20.269 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:18:20.269 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 99.961372984999997, 2024-09-12T16:18:20.269 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061491777999999997, 2024-09-12T16:18:20.269 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.269 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.269 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:20.269 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:20.269 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:20.269 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:20.269 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5613 2024-09-12T16:18:20.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.270 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.270 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.270 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:18:20.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.270 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.270 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:18:20.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.271 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.271 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:18:20.271 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8899999999999999e-07 2024-09-12T16:18:20.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.271 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.271 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296439+0000", 2024-09-12T16:18:20.271 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8439999999999998e-06 2024-09-12T16:18:20.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.271 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.271 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296452+0000", 2024-09-12T16:18:20.271 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2639e-05 2024-09-12T16:18:20.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.272 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.272 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.272 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296457+0000", 2024-09-12T16:18:20.272 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5720000000000002e-06 2024-09-12T16:18:20.272 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.272 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.272 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.272 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357773+0000", 2024-09-12T16:18:20.272 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061315500000000002 2024-09-12T16:18:20.272 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.272 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.272 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:20.272 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357814+0000", 2024-09-12T16:18:20.272 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1448e-05 2024-09-12T16:18:20.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.273 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.273 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357927+0000", 2024-09-12T16:18:20.273 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000113186 2024-09-12T16:18:20.273 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.273 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.273 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.273 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5616 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4784128~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:20.273 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:18:20.273 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 99.961337923000002, 2024-09-12T16:18:20.274 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061725002000000001, 2024-09-12T16:18:20.274 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.274 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.274 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:20.274 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:20.274 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:20.274 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:20.274 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5616 2024-09-12T16:18:20.274 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.274 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.274 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.274 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.274 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:18:20.274 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.275 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.275 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.275 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.275 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:18:20.275 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.275 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.275 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.275 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.275 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:18:20.275 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5900000000000002e-07 2024-09-12T16:18:20.275 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.275 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.276 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.276 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296473+0000", 2024-09-12T16:18:20.276 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3130000000000001e-06 2024-09-12T16:18:20.276 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.276 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.276 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.276 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296481+0000", 2024-09-12T16:18:20.276 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1389999999999998e-06 2024-09-12T16:18:20.276 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.276 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.276 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.276 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296486+0000", 2024-09-12T16:18:20.276 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3310000000000003e-06 2024-09-12T16:18:20.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.277 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.277 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.277 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357981+0000", 2024-09-12T16:18:20.277 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061494866000000002 2024-09-12T16:18:20.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.277 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.277 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:20.277 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358082+0000", 2024-09-12T16:18:20.277 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101424 2024-09-12T16:18:20.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.277 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.277 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.278 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358196+0000", 2024-09-12T16:18:20.278 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011347 2024-09-12T16:18:20.278 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.278 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.278 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.278 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.278 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.278 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5626 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4739072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:20.278 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:18:20.278 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 99.961259967000004, 2024-09-12T16:18:20.278 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061802430999999998, 2024-09-12T16:18:20.278 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.278 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.279 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:20.279 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:20.279 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:20.279 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:20.279 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5626 2024-09-12T16:18:20.279 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.279 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.279 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.279 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.279 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:18:20.279 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.279 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.279 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.279 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.280 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:18:20.280 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.280 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.280 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.280 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.280 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296550+0000", 2024-09-12T16:18:20.280 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.215e-06 2024-09-12T16:18:20.280 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.280 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.280 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.280 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296555+0000", 2024-09-12T16:18:20.280 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9590000000000003e-06 2024-09-12T16:18:20.280 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.281 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.281 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.281 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296568+0000", 2024-09-12T16:18:20.281 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3338e-05 2024-09-12T16:18:20.281 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.281 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.281 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.281 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296576+0000", 2024-09-12T16:18:20.281 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5510000000000002e-06 2024-09-12T16:18:20.281 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.281 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.281 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.282 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358241+0000", 2024-09-12T16:18:20.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.06166576 2024-09-12T16:18:20.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.282 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.282 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:20.282 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358288+0000", 2024-09-12T16:18:20.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6097000000000003e-05 2024-09-12T16:18:20.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.282 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.282 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.282 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358351+0000", 2024-09-12T16:18:20.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3510999999999996e-05 2024-09-12T16:18:20.282 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.282 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.283 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.283 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.283 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5628 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4792320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:20.283 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:18:20.283 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 99.961217466999997, 2024-09-12T16:18:20.283 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061961161000000001, 2024-09-12T16:18:20.283 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.283 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.283 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:20.283 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:20.283 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:20.283 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:20.284 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5628 2024-09-12T16:18:20.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.284 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.284 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.284 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.284 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:18:20.284 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.284 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.284 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.284 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:18:20.284 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.285 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.285 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.285 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296592+0000", 2024-09-12T16:18:20.285 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2099999999999996e-07 2024-09-12T16:18:20.285 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.285 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.285 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.285 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296595+0000", 2024-09-12T16:18:20.285 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0429999999999999e-06 2024-09-12T16:18:20.285 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.285 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.285 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.285 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296603+0000", 2024-09-12T16:18:20.285 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9899999999999997e-06 2024-09-12T16:18:20.286 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.286 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.286 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.286 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296609+0000", 2024-09-12T16:18:20.286 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7259999999999999e-06 2024-09-12T16:18:20.286 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.286 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.286 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.286 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358393+0000", 2024-09-12T16:18:20.286 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061784617 2024-09-12T16:18:20.286 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.286 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.286 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:20.287 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358460+0000", 2024-09-12T16:18:20.287 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7253000000000001e-05 2024-09-12T16:18:20.287 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.287 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.287 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.287 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358552+0000", 2024-09-12T16:18:20.287 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1811000000000006e-05 2024-09-12T16:18:20.287 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.287 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.287 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.287 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.287 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.287 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5638 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4734976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:20.288 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:18:20.288 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 99.960744915999996, 2024-09-12T16:18:20.288 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061654460000000001, 2024-09-12T16:18:20.288 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.288 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.288 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:20.288 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:20.288 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:20.288 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:20.288 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5638 2024-09-12T16:18:20.288 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.288 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.289 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.289 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.289 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:18:20.289 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.289 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.289 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.289 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:18:20.289 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.289 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.289 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.289 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:18:20.289 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.23e-07 2024-09-12T16:18:20.290 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.290 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.290 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.290 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297068+0000", 2024-09-12T16:18:20.290 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0060000000000003e-06 2024-09-12T16:18:20.290 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.290 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.290 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.290 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297080+0000", 2024-09-12T16:18:20.290 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1234e-05 2024-09-12T16:18:20.290 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.290 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.290 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.290 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297095+0000", 2024-09-12T16:18:20.291 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5698000000000001e-05 2024-09-12T16:18:20.291 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.291 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.291 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.291 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358582+0000", 2024-09-12T16:18:20.291 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061486274 2024-09-12T16:18:20.291 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.291 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.291 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:20.291 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358637+0000", 2024-09-12T16:18:20.291 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5439999999999998e-05 2024-09-12T16:18:20.291 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.291 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.292 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.292 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358718+0000", 2024-09-12T16:18:20.292 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0984999999999998e-05 2024-09-12T16:18:20.292 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.292 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.292 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.292 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.292 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.292 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5640 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4780032~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:20.292 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:18:20.292 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 99.960663195999999, 2024-09-12T16:18:20.292 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061746620000000002, 2024-09-12T16:18:20.292 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.292 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.293 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:20.293 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:20.293 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:20.293 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:20.293 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5640 2024-09-12T16:18:20.293 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.293 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.293 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.293 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.293 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:18:20.293 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.293 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.294 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.294 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.294 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:18:20.294 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.294 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.294 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.294 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.294 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297146+0000", 2024-09-12T16:18:20.294 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3600000000000003e-07 2024-09-12T16:18:20.294 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.294 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.294 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.294 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297150+0000", 2024-09-12T16:18:20.294 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8430000000000003e-06 2024-09-12T16:18:20.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.295 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.295 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.295 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297160+0000", 2024-09-12T16:18:20.295 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7229999999999999e-06 2024-09-12T16:18:20.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.295 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.295 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.295 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297167+0000", 2024-09-12T16:18:20.295 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0180000000000004e-06 2024-09-12T16:18:20.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.295 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.295 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.296 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358750+0000", 2024-09-12T16:18:20.296 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061583104 2024-09-12T16:18:20.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.296 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.296 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:20.296 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358804+0000", 2024-09-12T16:18:20.296 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4277000000000002e-05 2024-09-12T16:18:20.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.296 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.296 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.296 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358892+0000", 2024-09-12T16:18:20.296 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7918999999999996e-05 2024-09-12T16:18:20.296 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.296 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.297 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.297 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.297 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.297 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5642 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4788224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:20.297 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:18:20.297 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 99.960618851999996, 2024-09-12T16:18:20.297 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061860409999999998, 2024-09-12T16:18:20.297 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.297 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.297 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:20.297 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:20.297 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:20.297 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:20.298 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5642 2024-09-12T16:18:20.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.298 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.298 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.298 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.298 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:18:20.298 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.298 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.298 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.298 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:18:20.298 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.299 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.299 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.299 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:18:20.299 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7999999999999995e-07 2024-09-12T16:18:20.299 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.299 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.299 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.299 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297193+0000", 2024-09-12T16:18:20.299 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8310000000000001e-06 2024-09-12T16:18:20.299 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.299 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.299 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.299 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297204+0000", 2024-09-12T16:18:20.300 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0832999999999999e-05 2024-09-12T16:18:20.300 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.300 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.300 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.300 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297210+0000", 2024-09-12T16:18:20.300 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1770000000000003e-06 2024-09-12T16:18:20.300 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.300 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.300 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.300 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358928+0000", 2024-09-12T16:18:20.300 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061717826000000003 2024-09-12T16:18:20.300 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.300 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.301 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:20.301 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358977+0000", 2024-09-12T16:18:20.301 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9514000000000001e-05 2024-09-12T16:18:20.301 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.301 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.301 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.301 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359050+0000", 2024-09-12T16:18:20.301 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2649000000000002e-05 2024-09-12T16:18:20.301 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.301 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.301 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.301 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.301 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.301 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5646 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4743168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:20.302 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:18:20.302 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 99.960438910999997, 2024-09-12T16:18:20.302 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061822122, 2024-09-12T16:18:20.302 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.302 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.302 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:20.302 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:20.302 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:20.302 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:20.302 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5646 2024-09-12T16:18:20.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.302 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.302 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.302 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.302 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:18:20.303 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.303 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.303 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.303 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:18:20.303 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.303 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.303 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.303 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:18:20.303 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3200000000000004e-07 2024-09-12T16:18:20.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.303 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.303 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.304 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297374+0000", 2024-09-12T16:18:20.304 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8240000000000001e-06 2024-09-12T16:18:20.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.304 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.304 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.304 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297384+0000", 2024-09-12T16:18:20.304 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5710000000000004e-06 2024-09-12T16:18:20.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.304 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.304 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.304 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297390+0000", 2024-09-12T16:18:20.304 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5130000000000002e-06 2024-09-12T16:18:20.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.305 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.305 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.305 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359080+0000", 2024-09-12T16:18:20.305 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061689569999999999 2024-09-12T16:18:20.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.305 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.305 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:20.305 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359134+0000", 2024-09-12T16:18:20.305 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3838999999999997e-05 2024-09-12T16:18:20.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.305 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.305 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.306 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359192+0000", 2024-09-12T16:18:20.306 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8072999999999998e-05 2024-09-12T16:18:20.306 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.306 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.306 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.306 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.306 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5647 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4751360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:20.306 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:18:20.306 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 99.960402225999999, 2024-09-12T16:18:20.306 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061927569000000002, 2024-09-12T16:18:20.306 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.306 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.306 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:20.306 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:20.307 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:20.307 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:20.307 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5647 2024-09-12T16:18:20.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.307 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.307 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.307 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.307 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:18:20.307 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.307 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.307 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.307 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:18:20.307 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.308 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297407+0000", 2024-09-12T16:18:20.308 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.46e-07 2024-09-12T16:18:20.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.308 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297409+0000", 2024-09-12T16:18:20.308 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.469e-06 2024-09-12T16:18:20.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.308 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297415+0000", 2024-09-12T16:18:20.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9259999999999997e-06 2024-09-12T16:18:20.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297419+0000", 2024-09-12T16:18:20.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3840000000000001e-06 2024-09-12T16:18:20.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359224+0000", 2024-09-12T16:18:20.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061805367999999999 2024-09-12T16:18:20.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.310 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.310 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:20.310 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359275+0000", 2024-09-12T16:18:20.310 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1338000000000002e-05 2024-09-12T16:18:20.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.310 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.310 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.310 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359334+0000", 2024-09-12T16:18:20.310 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8638000000000003e-05 2024-09-12T16:18:20.310 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.310 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.310 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.310 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.310 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5649 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4796416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:20.310 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:18:20.311 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 99.960347366999997, 2024-09-12T16:18:20.311 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.062018578999999997, 2024-09-12T16:18:20.311 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.311 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.311 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:20.311 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:20.311 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:20.311 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:20.311 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5649 2024-09-12T16:18:20.311 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.311 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.311 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.311 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.311 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:18:20.311 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.312 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.312 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.312 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:18:20.312 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.312 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.312 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.312 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297462+0000", 2024-09-12T16:18:20.312 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2399999999999998e-07 2024-09-12T16:18:20.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.313 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.313 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.313 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297465+0000", 2024-09-12T16:18:20.313 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.371e-06 2024-09-12T16:18:20.313 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.313 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.313 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.313 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297473+0000", 2024-09-12T16:18:20.313 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4699999999999996e-06 2024-09-12T16:18:20.313 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.313 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.313 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.313 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297478+0000", 2024-09-12T16:18:20.313 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2780000000000001e-06 2024-09-12T16:18:20.314 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.314 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.314 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.314 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359368+0000", 2024-09-12T16:18:20.314 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061889758000000003 2024-09-12T16:18:20.314 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.314 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.314 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:20.314 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359420+0000", 2024-09-12T16:18:20.314 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2574999999999997e-05 2024-09-12T16:18:20.314 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.314 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.314 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.314 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359480+0000", 2024-09-12T16:18:20.314 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9503000000000003e-05 2024-09-12T16:18:20.315 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.315 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.315 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.315 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.315 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.315 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5674 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4739072~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:20.315 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:18:20.315 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 99.959943598999999, 2024-09-12T16:18:20.315 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061762989999999997, 2024-09-12T16:18:20.315 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.315 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.315 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:20.315 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:20.315 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:20.316 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:20.316 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5674 2024-09-12T16:18:20.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.316 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.316 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.316 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:18:20.316 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.316 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.316 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:18:20.316 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.317 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.317 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297866+0000", 2024-09-12T16:18:20.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1900000000000001e-07 2024-09-12T16:18:20.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.317 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.317 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297870+0000", 2024-09-12T16:18:20.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3560000000000003e-06 2024-09-12T16:18:20.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.317 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.317 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297888+0000", 2024-09-12T16:18:20.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8088999999999999e-05 2024-09-12T16:18:20.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.318 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.318 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297904+0000", 2024-09-12T16:18:20.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5971e-05 2024-09-12T16:18:20.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.318 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.318 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359510+0000", 2024-09-12T16:18:20.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061605634999999999 2024-09-12T16:18:20.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.318 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:20.319 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359554+0000", 2024-09-12T16:18:20.319 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4024999999999999e-05 2024-09-12T16:18:20.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.319 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.319 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.319 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359628+0000", 2024-09-12T16:18:20.319 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4095000000000001e-05 2024-09-12T16:18:20.319 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.319 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.319 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.319 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.319 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5676 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4792320~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:20.319 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:18:20.320 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 99.959742519000002, 2024-09-12T16:18:20.320 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061720143999999998, 2024-09-12T16:18:20.320 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.320 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.320 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:20.320 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:20.320 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:20.320 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:20.320 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5676 2024-09-12T16:18:20.320 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.320 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.320 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.320 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.321 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:18:20.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.321 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.321 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.321 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:18:20.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.321 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.321 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.321 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298067+0000", 2024-09-12T16:18:20.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8199999999999999e-07 2024-09-12T16:18:20.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.321 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.322 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298070+0000", 2024-09-12T16:18:20.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.743e-06 2024-09-12T16:18:20.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.322 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298080+0000", 2024-09-12T16:18:20.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4059999999999994e-06 2024-09-12T16:18:20.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.322 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298088+0000", 2024-09-12T16:18:20.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0779999999999996e-06 2024-09-12T16:18:20.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.323 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.323 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359659+0000", 2024-09-12T16:18:20.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061570688999999998 2024-09-12T16:18:20.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.323 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:20.323 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359713+0000", 2024-09-12T16:18:20.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3939e-05 2024-09-12T16:18:20.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.323 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.323 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359786+0000", 2024-09-12T16:18:20.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3607000000000002e-05 2024-09-12T16:18:20.324 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.324 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.324 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.324 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.324 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5684 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4747264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:20.324 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:18:20.324 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 99.959275227000006, 2024-09-12T16:18:20.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061394799, 2024-09-12T16:18:20.324 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.324 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.324 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:20.325 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:20.325 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:20.325 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:20.325 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5684 2024-09-12T16:18:20.325 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.325 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.325 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.325 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.325 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:18:20.325 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.325 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.325 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.325 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.325 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:18:20.326 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.326 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.326 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.326 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298534+0000", 2024-09-12T16:18:20.326 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4399999999999999e-07 2024-09-12T16:18:20.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.326 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.326 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.326 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298539+0000", 2024-09-12T16:18:20.326 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5360000000000003e-06 2024-09-12T16:18:20.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.326 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.327 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.327 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298550+0000", 2024-09-12T16:18:20.327 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1499e-05 2024-09-12T16:18:20.327 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.327 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.327 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.327 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298558+0000", 2024-09-12T16:18:20.327 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3000000000000004e-06 2024-09-12T16:18:20.327 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.327 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.327 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.327 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359815+0000", 2024-09-12T16:18:20.327 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061257952999999997 2024-09-12T16:18:20.328 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.328 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.328 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:20.328 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359868+0000", 2024-09-12T16:18:20.328 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2317000000000001e-05 2024-09-12T16:18:20.328 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.328 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.328 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.328 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359928+0000", 2024-09-12T16:18:20.328 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0350000000000003e-05 2024-09-12T16:18:20.328 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.328 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.328 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.329 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.329 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.329 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5686 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4755456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:20.329 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:18:20.329 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 99.959107802999995, 2024-09-12T16:18:20.329 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061355082999999998, 2024-09-12T16:18:20.329 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.329 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.329 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:20.329 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:20.329 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:20.329 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:20.329 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5686 2024-09-12T16:18:20.329 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.330 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.330 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.330 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:18:20.330 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.330 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.330 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:18:20.330 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.330 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.330 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298702+0000", 2024-09-12T16:18:20.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2399999999999997e-07 2024-09-12T16:18:20.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.331 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298706+0000", 2024-09-12T16:18:20.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5700000000000003e-06 2024-09-12T16:18:20.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.331 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298718+0000", 2024-09-12T16:18:20.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1457999999999999e-05 2024-09-12T16:18:20.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298732+0000", 2024-09-12T16:18:20.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.452e-05 2024-09-12T16:18:20.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359956+0000", 2024-09-12T16:18:20.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061223626000000003 2024-09-12T16:18:20.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:20.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360000+0000", 2024-09-12T16:18:20.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3922999999999999e-05 2024-09-12T16:18:20.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.333 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360056+0000", 2024-09-12T16:18:20.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6162000000000002e-05 2024-09-12T16:18:20.333 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.333 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.333 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.333 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5688 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4800512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:20.333 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:18:20.333 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 99.958884749999996, 2024-09-12T16:18:20.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061270514999999998, 2024-09-12T16:18:20.334 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.334 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.334 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:20.334 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:20.334 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:20.334 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:20.334 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5688 2024-09-12T16:18:20.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.334 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.334 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.334 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.334 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:18:20.334 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.335 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.335 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.335 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.335 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:18:20.335 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.335 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.335 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.335 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.335 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298925+0000", 2024-09-12T16:18:20.335 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4e-07 2024-09-12T16:18:20.335 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.335 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.335 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.335 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298929+0000", 2024-09-12T16:18:20.336 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9890000000000003e-06 2024-09-12T16:18:20.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.336 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.336 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.336 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298936+0000", 2024-09-12T16:18:20.336 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.52e-06 2024-09-12T16:18:20.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.336 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.336 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.336 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298941+0000", 2024-09-12T16:18:20.336 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4800000000000003e-06 2024-09-12T16:18:20.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.337 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360087+0000", 2024-09-12T16:18:20.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061146143 2024-09-12T16:18:20.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.337 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:20.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360137+0000", 2024-09-12T16:18:20.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0584000000000002e-05 2024-09-12T16:18:20.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.337 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360194+0000", 2024-09-12T16:18:20.338 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6858999999999999e-05 2024-09-12T16:18:20.338 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.338 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.338 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.338 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.338 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.338 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5693 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4751360~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:20.338 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:18:20.338 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 99.958463112999993, 2024-09-12T16:18:20.338 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061139444000000001, 2024-09-12T16:18:20.338 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.338 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.338 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:20.339 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:20.339 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:20.339 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:20.339 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5693 2024-09-12T16:18:20.339 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.339 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.339 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.339 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.339 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:18:20.339 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.339 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.339 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.339 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.340 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:18:20.340 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.340 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.340 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.340 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299346+0000", 2024-09-12T16:18:20.340 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2300000000000001e-07 2024-09-12T16:18:20.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.340 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.340 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.340 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299349+0000", 2024-09-12T16:18:20.340 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5270000000000001e-06 2024-09-12T16:18:20.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.340 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.341 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.341 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299358+0000", 2024-09-12T16:18:20.341 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7030000000000001e-06 2024-09-12T16:18:20.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.341 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.341 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.341 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299364+0000", 2024-09-12T16:18:20.341 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7239999999999997e-06 2024-09-12T16:18:20.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.341 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.341 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.341 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360369+0000", 2024-09-12T16:18:20.341 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061004713000000002 2024-09-12T16:18:20.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.342 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.342 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:20.342 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360415+0000", 2024-09-12T16:18:20.342 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5926e-05 2024-09-12T16:18:20.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.342 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.342 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.342 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360485+0000", 2024-09-12T16:18:20.342 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0327999999999995e-05 2024-09-12T16:18:20.342 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.342 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.342 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.343 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.343 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5694 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4796416~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:20.343 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:18:20.343 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 99.958434084000004, 2024-09-12T16:18:20.343 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061258034000000003, 2024-09-12T16:18:20.343 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.343 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.343 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:20.343 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:20.343 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:20.343 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:20.343 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5694 2024-09-12T16:18:20.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.344 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.344 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.344 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.344 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:18:20.344 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.344 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.344 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.344 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:18:20.344 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.344 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.345 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.345 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301884+0000", 2024-09-12T16:18:20.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025090379999999999 2024-09-12T16:18:20.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.345 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.345 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.345 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301889+0000", 2024-09-12T16:18:20.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5879999999999997e-06 2024-09-12T16:18:20.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.345 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.345 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.345 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301901+0000", 2024-09-12T16:18:20.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1466e-05 2024-09-12T16:18:20.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.345 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.346 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.346 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301908+0000", 2024-09-12T16:18:20.346 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1999999999999997e-06 2024-09-12T16:18:20.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.346 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.346 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360513+0000", 2024-09-12T16:18:20.346 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.058605023999999999 2024-09-12T16:18:20.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.346 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:20.346 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360562+0000", 2024-09-12T16:18:20.346 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9546000000000003e-05 2024-09-12T16:18:20.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.347 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.347 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360633+0000", 2024-09-12T16:18:20.347 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0172000000000005e-05 2024-09-12T16:18:20.347 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.347 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.347 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.347 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.347 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.347 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5759 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4767744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:20.347 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:18:20.347 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 99.955640549999998, 2024-09-12T16:18:20.347 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061058604000000002, 2024-09-12T16:18:20.347 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.348 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.348 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:20.348 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:20.348 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:20.348 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:20.348 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5759 2024-09-12T16:18:20.348 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.348 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.348 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.348 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.348 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:18:20.348 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.348 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.348 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.349 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.349 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302168+0000", 2024-09-12T16:18:20.349 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.349 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.349 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.349 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302548+0000", 2024-09-12T16:18:20.349 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00038011000000000002 2024-09-12T16:18:20.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.349 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.349 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.349 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302553+0000", 2024-09-12T16:18:20.349 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1830000000000002e-06 2024-09-12T16:18:20.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.349 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302564+0000", 2024-09-12T16:18:20.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1011e-05 2024-09-12T16:18:20.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.302572+0000", 2024-09-12T16:18:20.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9009999999999994e-06 2024-09-12T16:18:20.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363102+0000", 2024-09-12T16:18:20.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.060529782999999997 2024-09-12T16:18:20.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.351 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:20.351 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363149+0000", 2024-09-12T16:18:20.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7321000000000003e-05 2024-09-12T16:18:20.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.351 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.351 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.363227+0000", 2024-09-12T16:18:20.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7294999999999998e-05 2024-09-12T16:18:20.351 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.351 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.351 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.351 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.351 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.351 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:20.353 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:18:20.353 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:20.352+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:20.453 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:20.452+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:20.496 INFO:tasks.ceph.mon.a.smithi017.stderr:2024-09-12T16:18:20.495+0000 7f3942a34640 -1 mon.a@0(leader).osd e132 definitely_dead 0 2024-09-12T16:18:20.501 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:20.502 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:20.502 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:18:20.502 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:20.510 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:18:20.594 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:20.593+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:20.654 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:20.654+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:20.657 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:20.657 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:20.657 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:18:20.657 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:18:20.658 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:20.666 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:18:20.756 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:20.754+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:20.815 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:20.815 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:18:20.816 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:18:20.816 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:18:20.816 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.816 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.17 73/72 [PushOp(3:e9340267:::rbd_data.1155525b14e3.0000000000000031:f, version: 50'357, data_included: [0~4096,20480~4096,40960~8192,65536~4096,81920~8192,110592~4096,126976~8192,151552~4096,172032~8192,196608~4096,212992~8192,241664~4096,258048~8192,282624~4096,303104~8192,327680~4096,344064~8192,372736~4096,389120~8192,413696~4096,434176~8192,458752~4096,475136~8192,503808~4096,520192~8192,544768~4096,565248~8192,589824~4096,606208~8192,634880~4096,651264~8192,675840~4096,696320~8192,720896~4096,737280~8192,765952~4096,782336~8192,806912~4096,827392~8192,851968~4096,868352~8192,897024~4096,913408~8192,937984~4096,958464~8192,983040~4096,999424~8192,1028096~4096,1044480~4096], data_size: 294912, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:e9340267:::rbd_data.1155525b14e3.0000000000000031:f@50'357, size: 1048576, copy_subset: [(0, 1048576)], clone_subset: {}, snapset: f=[]:{f: [f]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T16:18:20.816 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.067448+0000", 2024-09-12T16:18:20.816 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 74.746180975000001, 2024-09-12T16:18:20.816 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003036721, 2024-09-12T16:18:20.816 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.817 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.817 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:20.817 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.817 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.817 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.817 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067448+0000", 2024-09-12T16:18:20.817 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.818 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.818 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.818 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067448+0000", 2024-09-12T16:18:20.818 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.818 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.818 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.819 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067449+0000", 2024-09-12T16:18:20.819 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2200000000000004e-07 2024-09-12T16:18:20.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.819 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.819 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.819 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067703+0000", 2024-09-12T16:18:20.819 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025377199999999998 2024-09-12T16:18:20.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.819 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.819 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.819 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067723+0000", 2024-09-12T16:18:20.819 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.986e-05 2024-09-12T16:18:20.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.819 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.820 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.820 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067743+0000", 2024-09-12T16:18:20.820 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9942e-05 2024-09-12T16:18:20.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.820 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.820 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.820 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067860+0000", 2024-09-12T16:18:20.820 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000116959 2024-09-12T16:18:20.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.820 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.820 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:20.820 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067872+0000", 2024-09-12T16:18:20.820 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2928000000000001e-05 2024-09-12T16:18:20.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.821 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.821 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.821 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.070485+0000", 2024-09-12T16:18:20.821 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0026127379999999999 2024-09-12T16:18:20.821 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.821 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.821 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.821 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.822 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5120.0:3941 3.17 e80/74 3:eff97428:::rbd_data.1155a3b3a26e.0000000000000060:head v 80'442, mlcod=79'439)", 2024-09-12T16:18:20.822 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:18:20.822 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 64.457840493999996, 2024-09-12T16:18:20.822 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0035981759999999998, 2024-09-12T16:18:20.822 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.822 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.822 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:20.822 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.822 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.823 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.823 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:18:20.823 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.823 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.823 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:18:20.823 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.824 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.824 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.824 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:18:20.824 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2e-07 2024-09-12T16:18:20.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.824 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.824 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.824 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355794+0000", 2024-09-12T16:18:20.825 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.865e-06 2024-09-12T16:18:20.825 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.825 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.825 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.825 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355956+0000", 2024-09-12T16:18:20.825 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016131699999999999 2024-09-12T16:18:20.825 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.825 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.825 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.826 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355964+0000", 2024-09-12T16:18:20.826 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7960000000000001e-06 2024-09-12T16:18:20.826 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.826 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.826 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.826 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.356320+0000", 2024-09-12T16:18:20.826 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000355612 2024-09-12T16:18:20.826 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.826 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.826 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:20.826 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.356337+0000", 2024-09-12T16:18:20.826 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6643e-05 2024-09-12T16:18:20.826 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.826 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.827 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:20.827 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.359340+0000", 2024-09-12T16:18:20.827 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003003618 2024-09-12T16:18:20.827 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.827 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.827 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.827 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.359387+0000", 2024-09-12T16:18:20.827 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6904999999999999e-05 2024-09-12T16:18:20.827 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.827 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.827 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.827 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.827 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.827 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2118 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1219, mlcod=88'1217)", 2024-09-12T16:18:20.828 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440434+0000", 2024-09-12T16:18:20.828 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 55.373195604000003, 2024-09-12T16:18:20.828 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003875543, 2024-09-12T16:18:20.828 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.828 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.828 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:20.828 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.828 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.828 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.828 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440434+0000", 2024-09-12T16:18:20.828 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.828 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.828 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.829 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.829 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440434+0000", 2024-09-12T16:18:20.829 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.829 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.829 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.829 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.829 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440435+0000", 2024-09-12T16:18:20.829 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8899999999999998e-07 2024-09-12T16:18:20.829 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.829 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.829 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.829 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440444+0000", 2024-09-12T16:18:20.829 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4599999999999992e-06 2024-09-12T16:18:20.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.830 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.830 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.830 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440459+0000", 2024-09-12T16:18:20.830 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4460999999999999e-05 2024-09-12T16:18:20.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.830 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.830 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.830 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440466+0000", 2024-09-12T16:18:20.830 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4340000000000003e-06 2024-09-12T16:18:20.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.830 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.830 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.830 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:18:20.831 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9054999999999997e-05 2024-09-12T16:18:20.831 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.831 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.831 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:20.831 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440535+0000", 2024-09-12T16:18:20.831 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.98e-05 2024-09-12T16:18:20.831 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.831 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.831 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:20.831 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444269+0000", 2024-09-12T16:18:20.831 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003734448 2024-09-12T16:18:20.831 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.832 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.832 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.832 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444309+0000", 2024-09-12T16:18:20.832 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0095999999999997e-05 2024-09-12T16:18:20.832 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.832 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.832 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.832 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.832 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.832 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2122 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1220, mlcod=88'1217)", 2024-09-12T16:18:20.832 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440484+0000", 2024-09-12T16:18:20.832 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 55.373145098000002, 2024-09-12T16:18:20.832 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0038538029999999998, 2024-09-12T16:18:20.833 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.833 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.833 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:20.833 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.833 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.833 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.833 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440484+0000", 2024-09-12T16:18:20.833 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.833 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.833 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.833 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.834 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440484+0000", 2024-09-12T16:18:20.834 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.834 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.834 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.834 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.834 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440485+0000", 2024-09-12T16:18:20.834 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6100000000000002e-07 2024-09-12T16:18:20.834 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.834 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.834 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.834 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440493+0000", 2024-09-12T16:18:20.834 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0169999999999996e-06 2024-09-12T16:18:20.834 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.835 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.835 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.835 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440501+0000", 2024-09-12T16:18:20.835 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9319999999999996e-06 2024-09-12T16:18:20.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.835 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.835 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.835 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440506+0000", 2024-09-12T16:18:20.835 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3510000000000001e-06 2024-09-12T16:18:20.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.835 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.835 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.835 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441319+0000", 2024-09-12T16:18:20.836 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00081295300000000005 2024-09-12T16:18:20.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.836 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.836 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:20.836 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441336+0000", 2024-09-12T16:18:20.836 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6897000000000001e-05 2024-09-12T16:18:20.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.836 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.836 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:20.836 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444311+0000", 2024-09-12T16:18:20.836 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029754510000000001 2024-09-12T16:18:20.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.836 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.837 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.837 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444338+0000", 2024-09-12T16:18:20.837 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6840999999999999e-05 2024-09-12T16:18:20.837 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.837 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.837 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.837 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.837 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.837 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2124 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1221, mlcod=88'1217)", 2024-09-12T16:18:20.837 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:18:20.837 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 55.373114526000002, 2024-09-12T16:18:20.837 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0038507229999999999, 2024-09-12T16:18:20.837 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.837 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.838 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:20.838 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.838 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.838 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.838 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:18:20.838 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.838 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.838 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.838 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.838 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:18:20.838 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.838 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.838 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.838 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.839 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:18:20.839 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8799999999999998e-07 2024-09-12T16:18:20.839 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.839 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.839 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.839 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440519+0000", 2024-09-12T16:18:20.839 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5499999999999999e-06 2024-09-12T16:18:20.839 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.839 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.839 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.839 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440525+0000", 2024-09-12T16:18:20.839 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1009999999999997e-06 2024-09-12T16:18:20.839 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.839 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.840 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.840 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440529+0000", 2024-09-12T16:18:20.840 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3749999999999996e-06 2024-09-12T16:18:20.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.840 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.840 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.840 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441883+0000", 2024-09-12T16:18:20.840 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0013538249999999999 2024-09-12T16:18:20.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.840 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.840 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:20.840 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441901+0000", 2024-09-12T16:18:20.840 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7972999999999999e-05 2024-09-12T16:18:20.841 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.841 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.841 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:20.841 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444341+0000", 2024-09-12T16:18:20.841 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002439568 2024-09-12T16:18:20.841 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.841 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.841 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.841 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444366+0000", 2024-09-12T16:18:20.841 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5043000000000001e-05 2024-09-12T16:18:20.841 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.841 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.842 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.842 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.842 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.842 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2327 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1222, mlcod=88'1217)", 2024-09-12T16:18:20.842 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440696+0000", 2024-09-12T16:18:20.842 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 55.372933183999997, 2024-09-12T16:18:20.842 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0036945739999999999, 2024-09-12T16:18:20.842 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.842 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.843 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:20.843 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.843 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.843 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.843 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440696+0000", 2024-09-12T16:18:20.843 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.843 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.843 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.843 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.844 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440696+0000", 2024-09-12T16:18:20.844 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.844 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.844 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.844 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.844 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440697+0000", 2024-09-12T16:18:20.844 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5899999999999996e-07 2024-09-12T16:18:20.844 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.845 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.845 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.845 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440702+0000", 2024-09-12T16:18:20.845 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0969999999999996e-06 2024-09-12T16:18:20.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.845 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.845 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.845 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440713+0000", 2024-09-12T16:18:20.845 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1114000000000001e-05 2024-09-12T16:18:20.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.845 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.845 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.845 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440719+0000", 2024-09-12T16:18:20.846 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1650000000000003e-06 2024-09-12T16:18:20.846 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.846 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.846 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.846 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.442435+0000", 2024-09-12T16:18:20.846 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017155440000000001 2024-09-12T16:18:20.846 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.846 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.846 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:20.846 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.442457+0000", 2024-09-12T16:18:20.846 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1793999999999998e-05 2024-09-12T16:18:20.846 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.846 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.847 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:20.847 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444367+0000", 2024-09-12T16:18:20.847 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0019101980000000001 2024-09-12T16:18:20.847 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.847 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.847 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.847 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444391+0000", 2024-09-12T16:18:20.847 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4003e-05 2024-09-12T16:18:20.847 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.847 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.847 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.847 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.847 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.848 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2487 3.1d e88/74 3:b8c395a6:::rbd_data.11558d85ce23.000000000000000b:head v 88'1225, mlcod=88'1223)", 2024-09-12T16:18:20.848 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:18:20.848 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 55.367418815000001, 2024-09-12T16:18:20.848 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033166039999999999, 2024-09-12T16:18:20.848 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.848 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.848 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:20.848 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.848 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.848 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.848 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:18:20.848 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.848 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.848 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.849 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.849 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:18:20.849 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.849 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.849 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:18:20.849 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9299999999999997e-07 2024-09-12T16:18:20.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.849 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.849 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446295+0000", 2024-09-12T16:18:20.849 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3153999999999997e-05 2024-09-12T16:18:20.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446309+0000", 2024-09-12T16:18:20.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4015e-05 2024-09-12T16:18:20.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446317+0000", 2024-09-12T16:18:20.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4880000000000007e-06 2024-09-12T16:18:20.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.851 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446373+0000", 2024-09-12T16:18:20.851 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5766000000000001e-05 2024-09-12T16:18:20.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.851 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.851 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:20.851 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446395+0000", 2024-09-12T16:18:20.851 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2500000000000001e-05 2024-09-12T16:18:20.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.851 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.851 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:20.851 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.449445+0000", 2024-09-12T16:18:20.851 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003049791 2024-09-12T16:18:20.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.851 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.852 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.852 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.449527+0000", 2024-09-12T16:18:20.852 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2096999999999997e-05 2024-09-12T16:18:20.852 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.852 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.852 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.852 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.852 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2493 3.2 e88/74 3:46cb4ff0:::rbd_data.11558d85ce23.000000000000000e:head v 88'372, mlcod=87'370)", 2024-09-12T16:18:20.853 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.447443+0000", 2024-09-12T16:18:20.853 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 55.366186876999997, 2024-09-12T16:18:20.853 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029120330000000001, 2024-09-12T16:18:20.853 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.853 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.853 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:20.853 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.853 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.854 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.854 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447443+0000", 2024-09-12T16:18:20.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.854 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.854 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.854 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447443+0000", 2024-09-12T16:18:20.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447443+0000", 2024-09-12T16:18:20.855 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4600000000000001e-07 2024-09-12T16:18:20.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447779+0000", 2024-09-12T16:18:20.855 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00033639800000000001 2024-09-12T16:18:20.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.856 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.856 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447790+0000", 2024-09-12T16:18:20.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0555e-05 2024-09-12T16:18:20.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.856 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.857 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447797+0000", 2024-09-12T16:18:20.857 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1729999999999998e-06 2024-09-12T16:18:20.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.857 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.857 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.857 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447862+0000", 2024-09-12T16:18:20.857 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4670000000000003e-05 2024-09-12T16:18:20.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.857 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.857 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:20.857 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.447889+0000", 2024-09-12T16:18:20.857 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.773e-05 2024-09-12T16:18:20.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.857 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.858 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:20.858 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.450311+0000", 2024-09-12T16:18:20.858 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0024212510000000001 2024-09-12T16:18:20.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.858 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.858 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.858 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.450355+0000", 2024-09-12T16:18:20.858 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.401e-05 2024-09-12T16:18:20.858 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.858 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.858 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.858 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.859 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "pg_update_log_missing(3.5 epoch 92/74 rep_tid 1618 entries 92'520 (0'0) error 3:a46c381c:::rbd_data.1155c757bf36.000000000000002f:head by client.5577.0:14350 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 92'518)", 2024-09-12T16:18:20.859 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.408248+0000", 2024-09-12T16:18:20.859 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 50.405380997000002, 2024-09-12T16:18:20.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029209660000000001, 2024-09-12T16:18:20.859 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.859 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.859 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "reached pg", 2024-09-12T16:18:20.859 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.859 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.859 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408248+0000", 2024-09-12T16:18:20.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.860 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.860 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408248+0000", 2024-09-12T16:18:20.860 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.860 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.860 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.860 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408249+0000", 2024-09-12T16:18:20.860 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9800000000000002e-07 2024-09-12T16:18:20.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.861 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.861 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.861 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408259+0000", 2024-09-12T16:18:20.861 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1949999999999992e-06 2024-09-12T16:18:20.861 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.861 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.861 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.861 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408278+0000", 2024-09-12T16:18:20.861 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9157e-05 2024-09-12T16:18:20.862 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.862 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.862 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.862 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408291+0000", 2024-09-12T16:18:20.862 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3655000000000001e-05 2024-09-12T16:18:20.862 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.862 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.862 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.863 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408369+0000", 2024-09-12T16:18:20.863 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7804000000000002e-05 2024-09-12T16:18:20.863 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.863 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.863 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.863 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411169+0000", 2024-09-12T16:18:20.863 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002800257 2024-09-12T16:18:20.863 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.863 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.863 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.863 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.864 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.864 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "pg_update_log_missing(3.1d epoch 92/74 rep_tid 3087 entries 92'1280 (0'0) error 3:bc3c4c0b:::rbd_data.1155c757bf36.000000000000002c:head by client.5577.0:14343 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 90'1278)", 2024-09-12T16:18:20.864 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.408860+0000", 2024-09-12T16:18:20.864 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 50.404769369, 2024-09-12T16:18:20.864 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0056480419999999998, 2024-09-12T16:18:20.864 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.864 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.864 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "reached pg", 2024-09-12T16:18:20.864 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.864 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.864 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.864 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408860+0000", 2024-09-12T16:18:20.865 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.865 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.865 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.865 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408860+0000", 2024-09-12T16:18:20.865 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.865 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.865 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.865 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408861+0000", 2024-09-12T16:18:20.865 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6600000000000002e-07 2024-09-12T16:18:20.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.865 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.866 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.866 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408867+0000", 2024-09-12T16:18:20.866 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4150000000000004e-06 2024-09-12T16:18:20.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.866 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.866 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.866 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408881+0000", 2024-09-12T16:18:20.866 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4326e-05 2024-09-12T16:18:20.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.866 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.866 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.866 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408895+0000", 2024-09-12T16:18:20.866 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3903000000000001e-05 2024-09-12T16:18:20.867 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.867 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.867 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.867 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410566+0000", 2024-09-12T16:18:20.867 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001670822 2024-09-12T16:18:20.867 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.867 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.867 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.867 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414508+0000", 2024-09-12T16:18:20.867 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039421100000000004 2024-09-12T16:18:20.867 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.867 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.867 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.867 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.868 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.868 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "pg_update_log_missing(3.5 epoch 92/74 rep_tid 1621 entries 92'521 (0'0) error 3:a759f741:::rbd_data.1155c757bf36.0000000000000036:head by client.5577.0:14364 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 92'518)", 2024-09-12T16:18:20.868 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:18:20.868 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 50.403820891999999, 2024-09-12T16:18:20.868 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047586740000000001, 2024-09-12T16:18:20.868 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.868 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.868 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "reached pg", 2024-09-12T16:18:20.868 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.868 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.868 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.868 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:18:20.868 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.869 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.869 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.869 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.869 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:18:20.869 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.869 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.869 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.869 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.869 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:18:20.869 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.54e-07 2024-09-12T16:18:20.869 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.869 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.869 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.870 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409817+0000", 2024-09-12T16:18:20.870 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.028e-06 2024-09-12T16:18:20.870 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.870 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.870 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.870 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410047+0000", 2024-09-12T16:18:20.870 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022964599999999999 2024-09-12T16:18:20.870 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.870 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.870 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.870 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410067+0000", 2024-09-12T16:18:20.870 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0438999999999999e-05 2024-09-12T16:18:20.871 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.871 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.871 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.871 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411223+0000", 2024-09-12T16:18:20.871 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011560229999999999 2024-09-12T16:18:20.871 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.871 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.871 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.871 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414567+0000", 2024-09-12T16:18:20.871 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033437839999999998 2024-09-12T16:18:20.871 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.872 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.872 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.872 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.872 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14391 3.5 e92/74 3:a5105766:::rbd_data.1155c757bf36.0000000000000044:head v 92'523, mlcod=92'518)", 2024-09-12T16:18:20.872 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.410084+0000", 2024-09-12T16:18:20.872 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 50.403545022000003, 2024-09-12T16:18:20.872 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0046720299999999998, 2024-09-12T16:18:20.873 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.873 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.873 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:20.873 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.873 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.873 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.873 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410084+0000", 2024-09-12T16:18:20.874 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.874 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.874 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.874 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.874 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410084+0000", 2024-09-12T16:18:20.874 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.875 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.875 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.875 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.875 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410085+0000", 2024-09-12T16:18:20.875 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1900000000000002e-07 2024-09-12T16:18:20.875 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.875 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.876 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.876 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410091+0000", 2024-09-12T16:18:20.876 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1e-06 2024-09-12T16:18:20.876 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.876 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.876 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.876 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410100+0000", 2024-09-12T16:18:20.876 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6889999999999993e-06 2024-09-12T16:18:20.876 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.876 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.876 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.876 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410105+0000", 2024-09-12T16:18:20.876 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3199999999999999e-06 2024-09-12T16:18:20.877 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.877 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.877 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.877 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411563+0000", 2024-09-12T16:18:20.877 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00145795 2024-09-12T16:18:20.877 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.877 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.877 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:20.877 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411590+0000", 2024-09-12T16:18:20.877 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6570000000000001e-05 2024-09-12T16:18:20.877 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.877 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.877 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:20.877 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414571+0000", 2024-09-12T16:18:20.878 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029815710000000001 2024-09-12T16:18:20.878 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.878 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.878 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.878 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414756+0000", 2024-09-12T16:18:20.878 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018521100000000001 2024-09-12T16:18:20.878 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.878 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.878 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.878 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.878 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.878 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14405 3.5 e92/74 3:a0797093:::rbd_data.1155c757bf36.000000000000004b:head v 92'525, mlcod=92'518)", 2024-09-12T16:18:20.878 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.410119+0000", 2024-09-12T16:18:20.878 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 50.403510081999997, 2024-09-12T16:18:20.879 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047304000000000001, 2024-09-12T16:18:20.879 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.879 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.879 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:20.879 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.879 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.879 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.879 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410119+0000", 2024-09-12T16:18:20.879 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.879 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.879 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.879 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410119+0000", 2024-09-12T16:18:20.879 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.880 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.880 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.880 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410120+0000", 2024-09-12T16:18:20.880 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:18:20.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.880 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.880 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.880 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410126+0000", 2024-09-12T16:18:20.880 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1460000000000001e-06 2024-09-12T16:18:20.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.881 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.881 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.881 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410134+0000", 2024-09-12T16:18:20.881 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8879999999999997e-06 2024-09-12T16:18:20.881 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.881 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.881 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.881 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410140+0000", 2024-09-12T16:18:20.881 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0839999999999997e-06 2024-09-12T16:18:20.881 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.881 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.881 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.881 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412146+0000", 2024-09-12T16:18:20.881 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0020057569999999999 2024-09-12T16:18:20.882 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.882 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.882 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:20.882 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412163+0000", 2024-09-12T16:18:20.882 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7742000000000001e-05 2024-09-12T16:18:20.882 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.882 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.882 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:20.882 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414761+0000", 2024-09-12T16:18:20.882 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025979660000000002 2024-09-12T16:18:20.882 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.882 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.882 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.883 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414850+0000", 2024-09-12T16:18:20.883 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8426999999999999e-05 2024-09-12T16:18:20.883 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.883 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.883 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.883 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.883 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.883 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14435 3.1d e92/74 3:b810b250:::rbd_data.1155c757bf36.000000000000010b:head v 92'1282, mlcod=90'1278)", 2024-09-12T16:18:20.883 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:18:20.883 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 50.402667612999998, 2024-09-12T16:18:20.883 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039190579999999996, 2024-09-12T16:18:20.883 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.883 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.883 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:20.884 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.884 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.884 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.884 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:18:20.884 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.884 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.884 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.884 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.884 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:18:20.884 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.884 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.884 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.884 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.884 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:18:20.885 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5199999999999996e-07 2024-09-12T16:18:20.885 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.885 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.885 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.885 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410968+0000", 2024-09-12T16:18:20.885 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.305e-06 2024-09-12T16:18:20.885 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.885 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.885 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.885 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410986+0000", 2024-09-12T16:18:20.885 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8213999999999999e-05 2024-09-12T16:18:20.885 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.885 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.885 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.886 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410993+0000", 2024-09-12T16:18:20.886 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2849999999999997e-06 2024-09-12T16:18:20.886 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.886 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.886 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.886 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412228+0000", 2024-09-12T16:18:20.886 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0012347370000000001 2024-09-12T16:18:20.886 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.886 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.886 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:20.886 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412262+0000", 2024-09-12T16:18:20.886 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3531999999999997e-05 2024-09-12T16:18:20.886 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.886 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.887 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:20.887 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414854+0000", 2024-09-12T16:18:20.887 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002592039 2024-09-12T16:18:20.887 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.887 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.887 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.887 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414881+0000", 2024-09-12T16:18:20.887 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7294e-05 2024-09-12T16:18:20.887 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.887 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.887 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.887 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.887 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.887 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14434 3.5 e92/74 3:a09dd60f:::rbd_data.1155c757bf36.000000000000010a:head v 92'527, mlcod=92'518)", 2024-09-12T16:18:20.888 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.411186+0000", 2024-09-12T16:18:20.888 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 50.402443466000001, 2024-09-12T16:18:20.888 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0037696930000000002, 2024-09-12T16:18:20.888 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.888 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.888 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:20.888 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.888 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.888 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.888 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411186+0000", 2024-09-12T16:18:20.888 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.888 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.888 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.889 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.889 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411186+0000", 2024-09-12T16:18:20.889 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.889 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.889 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.889 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.889 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411187+0000", 2024-09-12T16:18:20.889 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3799999999999997e-07 2024-09-12T16:18:20.889 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.889 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.889 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.890 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411203+0000", 2024-09-12T16:18:20.890 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6793999999999999e-05 2024-09-12T16:18:20.890 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.890 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.890 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.890 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411323+0000", 2024-09-12T16:18:20.890 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011975499999999999 2024-09-12T16:18:20.890 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.890 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.891 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.891 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411332+0000", 2024-09-12T16:18:20.891 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4370000000000007e-06 2024-09-12T16:18:20.891 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.891 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.891 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.891 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.413073+0000", 2024-09-12T16:18:20.891 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001741827 2024-09-12T16:18:20.891 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.892 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.892 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:20.892 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.413091+0000", 2024-09-12T16:18:20.892 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8011000000000001e-05 2024-09-12T16:18:20.892 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.892 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.892 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:20.892 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414882+0000", 2024-09-12T16:18:20.893 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001790841 2024-09-12T16:18:20.893 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.893 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.893 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.893 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414956+0000", 2024-09-12T16:18:20.893 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.339e-05 2024-09-12T16:18:20.893 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.893 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.893 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.894 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.894 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.894 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14426 3.13 e92/74 3:c827d1d7:::rbd_data.1155c757bf36.0000000000000056:head v 92'741, mlcod=90'737)", 2024-09-12T16:18:20.894 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:18:20.894 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 50.398351552999998, 2024-09-12T16:18:20.894 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030296030000000001, 2024-09-12T16:18:20.894 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.894 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.895 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:20.895 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.895 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.895 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.895 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:18:20.895 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.895 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.895 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.895 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.895 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:18:20.895 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.895 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.895 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.895 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.896 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:18:20.896 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6300000000000001e-07 2024-09-12T16:18:20.896 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.896 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.896 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.896 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415282+0000", 2024-09-12T16:18:20.896 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6289999999999999e-06 2024-09-12T16:18:20.896 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.896 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.896 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.896 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415288+0000", 2024-09-12T16:18:20.896 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5520000000000001e-06 2024-09-12T16:18:20.896 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.896 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.897 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.897 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415293+0000", 2024-09-12T16:18:20.897 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6879999999999998e-06 2024-09-12T16:18:20.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.897 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.897 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.897 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415412+0000", 2024-09-12T16:18:20.897 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118579 2024-09-12T16:18:20.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.897 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.897 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:20.897 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415429+0000", 2024-09-12T16:18:20.897 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7501000000000001e-05 2024-09-12T16:18:20.898 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.898 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.898 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:20.898 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.418270+0000", 2024-09-12T16:18:20.898 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028404860000000001 2024-09-12T16:18:20.898 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.898 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.898 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.898 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.418307+0000", 2024-09-12T16:18:20.898 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7805000000000001e-05 2024-09-12T16:18:20.898 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.898 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.899 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.899 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.899 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.899 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14399 3.16 e92/75 3:6e4c3dfc:::rbd_data.1155c757bf36.0000000000000048:head v 92'1286, mlcod=90'1280)", 2024-09-12T16:18:20.899 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.415311+0000", 2024-09-12T16:18:20.899 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 50.398318639000003, 2024-09-12T16:18:20.899 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028826809999999998, 2024-09-12T16:18:20.899 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.899 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.900 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:20.900 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.900 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.900 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.900 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415311+0000", 2024-09-12T16:18:20.900 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.900 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.900 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.900 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.901 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415311+0000", 2024-09-12T16:18:20.901 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.901 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.901 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.901 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415311+0000", 2024-09-12T16:18:20.901 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0600000000000001e-07 2024-09-12T16:18:20.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.901 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.902 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.902 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415315+0000", 2024-09-12T16:18:20.902 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.172e-06 2024-09-12T16:18:20.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.902 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.902 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.902 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415322+0000", 2024-09-12T16:18:20.902 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0999999999999998e-06 2024-09-12T16:18:20.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.903 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.903 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.903 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415327+0000", 2024-09-12T16:18:20.903 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6430000000000003e-06 2024-09-12T16:18:20.903 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.903 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.903 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.903 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.416666+0000", 2024-09-12T16:18:20.903 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001338718 2024-09-12T16:18:20.903 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.903 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.903 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:20.903 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.416683+0000", 2024-09-12T16:18:20.903 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7628000000000001e-05 2024-09-12T16:18:20.903 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.904 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.904 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:20.904 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.418128+0000", 2024-09-12T16:18:20.904 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0014445440000000001 2024-09-12T16:18:20.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.904 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.904 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.904 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.418193+0000", 2024-09-12T16:18:20.904 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5569999999999997e-05 2024-09-12T16:18:20.904 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.904 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.904 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.905 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.905 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5384.0:1241 3.16 e95/75 3:6ee670ce:::rbd_data.1155b9894cdc.0000000000000005:head v 95'1303, mlcod=95'1301)", 2024-09-12T16:18:20.905 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:35.272164+0000", 2024-09-12T16:18:20.905 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 45.541465697, 2024-09-12T16:18:20.905 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015008743, 2024-09-12T16:18:20.905 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.905 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.905 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:20.905 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.905 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.905 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.905 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.272164+0000", 2024-09-12T16:18:20.905 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.905 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.906 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.906 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.906 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.272164+0000", 2024-09-12T16:18:20.906 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.906 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.906 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.906 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.272165+0000", 2024-09-12T16:18:20.906 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.311e-06 2024-09-12T16:18:20.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.906 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.906 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.906 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275503+0000", 2024-09-12T16:18:20.907 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003337881 2024-09-12T16:18:20.907 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.907 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.907 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.907 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275530+0000", 2024-09-12T16:18:20.907 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6797000000000001e-05 2024-09-12T16:18:20.907 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.907 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.907 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.907 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275541+0000", 2024-09-12T16:18:20.907 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1634000000000001e-05 2024-09-12T16:18:20.907 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.907 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.908 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.908 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275618+0000", 2024-09-12T16:18:20.908 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6811999999999996e-05 2024-09-12T16:18:20.908 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.908 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.908 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:20.908 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275642+0000", 2024-09-12T16:18:20.908 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4111999999999999e-05 2024-09-12T16:18:20.908 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.908 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.908 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:20.908 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287116+0000", 2024-09-12T16:18:20.908 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01147395 2024-09-12T16:18:20.909 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.909 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.909 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.909 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287172+0000", 2024-09-12T16:18:20.909 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6246000000000003e-05 2024-09-12T16:18:20.909 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.909 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.909 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.909 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.910 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.910 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5384.0:1246 3.f e95/74 3:f0725c44:::rbd_data.1155b9894cdc.0000000000000006:head v 95'356, mlcod=95'354)", 2024-09-12T16:18:20.910 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:35.276304+0000", 2024-09-12T16:18:20.910 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 45.537325770000002, 2024-09-12T16:18:20.910 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011209733, 2024-09-12T16:18:20.910 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.910 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.910 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:20.910 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.911 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.911 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.911 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.276304+0000", 2024-09-12T16:18:20.911 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.911 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.911 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.911 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.911 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.276304+0000", 2024-09-12T16:18:20.912 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.912 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.912 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.912 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.276305+0000", 2024-09-12T16:18:20.912 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2500000000000001e-06 2024-09-12T16:18:20.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.912 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.913 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.913 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279256+0000", 2024-09-12T16:18:20.913 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002951076 2024-09-12T16:18:20.913 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.913 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.913 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.913 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279281+0000", 2024-09-12T16:18:20.913 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4779000000000001e-05 2024-09-12T16:18:20.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.914 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.914 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279294+0000", 2024-09-12T16:18:20.914 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3614e-05 2024-09-12T16:18:20.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.914 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.914 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279366+0000", 2024-09-12T16:18:20.914 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2094000000000005e-05 2024-09-12T16:18:20.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.914 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:20.914 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279395+0000", 2024-09-12T16:18:20.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8337999999999999e-05 2024-09-12T16:18:20.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.915 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:20.915 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287479+0000", 2024-09-12T16:18:20.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0080844799999999998 2024-09-12T16:18:20.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.915 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.915 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287513+0000", 2024-09-12T16:18:20.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4102e-05 2024-09-12T16:18:20.915 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.915 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.915 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.916 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.916 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.916 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5578.0:2433 3.16 e98/75 3:691860ab:::rbd_data.11557f9bd67f.0000000000000014:head v 98'1330, mlcod=97'1328)", 2024-09-12T16:18:20.916 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:38.524867+0000", 2024-09-12T16:18:20.916 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 42.288762145, 2024-09-12T16:18:20.916 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028147279999999998, 2024-09-12T16:18:20.916 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:20.916 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:20.916 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:20.916 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:20.916 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.916 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:20.916 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.524867+0000", 2024-09-12T16:18:20.917 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.917 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.917 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.917 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:20.917 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.524867+0000", 2024-09-12T16:18:20.917 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:20.917 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.917 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.917 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:20.917 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.524868+0000", 2024-09-12T16:18:20.917 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4600000000000003e-07 2024-09-12T16:18:20.917 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.917 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.918 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:20.918 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.525251+0000", 2024-09-12T16:18:20.918 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00038322299999999997 2024-09-12T16:18:20.918 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.918 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.918 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:20.918 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.525266+0000", 2024-09-12T16:18:20.918 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4934e-05 2024-09-12T16:18:20.918 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.919 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.919 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:20.919 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.525274+0000", 2024-09-12T16:18:20.919 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.328e-06 2024-09-12T16:18:20.919 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.919 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.919 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:20.919 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.525363+0000", 2024-09-12T16:18:20.919 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9149999999999999e-05 2024-09-12T16:18:20.920 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.920 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.920 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:20.920 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.525383+0000", 2024-09-12T16:18:20.920 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0197e-05 2024-09-12T16:18:20.920 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.920 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.920 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:20.920 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.527638+0000", 2024-09-12T16:18:20.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0022551210000000001 2024-09-12T16:18:20.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:20.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:20.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:20.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:38.527682+0000", 2024-09-12T16:18:20.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3928999999999999e-05 2024-09-12T16:18:20.921 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.921 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.922 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.922 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:20.922 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:20.922 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:20.923 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:20.922+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:20.923 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:18:21.024 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:21.023+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:21.034 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:21.034 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:21.034 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:18:21.034 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:21.043 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:18:21.125 INFO:teuthology.orchestra.run.smithi017.stderr:marked in osd.5. 2024-09-12T16:18:21.127 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:21.126+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:21.146 INFO:tasks.thrashosds.thrasher:Added osd 5 2024-09-12T16:18:21.196 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T16:18:21.199 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:21.199 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:21.199 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:18:21.200 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:18:21.200 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:21.207 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:18:21.227 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:21.225+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:21.321 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:18:21.321 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:18:21.327 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:21.326+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:21.338 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:18:21.338 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:18:21.355 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:18:21.355 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:18:21.357 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:21.357 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:21.366 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:18:21.372 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:18:21.372 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:18:21.389 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:18:21.389 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:18:21.406 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:18:21.406 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:18:21.428 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:21.427+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:21.480 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:21.480 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:21.488 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:18:21.528 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:21.528+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:21.595 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:21.595 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:21.603 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:18:21.648 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:21.647+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:21.710 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:21.711 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:21.719 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:18:21.729 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:21.729+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:21.831 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:21.830+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:21.867 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:21.867 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:21.875 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:18:21.931 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:21.931+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:22.023 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:22.023 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:22.031 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:18:22.033 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:22.032+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:22.133 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:22.132+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:22.140 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T16:18:22.144 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:22.144 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:22.153 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:18:22.234 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:22.233+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:22.273 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:22.273 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:22.282 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:18:22.335 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:22.334+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:22.390 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:22.390 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:22.398 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:18:22.437 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:22.436+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:22.538 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:22.537+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:22.546 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:22.546 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:22.555 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:18:22.639 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:22.638+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:22.703 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:22.704 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:22.712 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:18:22.741 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:22.740+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:22.842 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:22.841+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:22.860 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:22.860 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:22.869 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:18:22.943 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:22.942+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:22.976 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:22.976 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:22.985 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:18:23.009 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2024-09-12T16:18:23.044 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:23.043+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:23.125 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:23.125 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:23.138 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:18:23.144 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:23.143+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:23.245 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:23.244+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:23.296 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:23.296 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:23.306 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:18:23.347 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:23.346+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:23.418 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T16:18:23.447 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:23.446+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:23.470 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:23.470 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:23.481 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:18:23.544 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:18:23.544 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:18:23.548 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:23.547+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:23.561 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:18:23.562 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:18:23.578 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:18:23.578 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:18:23.592 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:23.592 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:23.592 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:18:23.592 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:23.595 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:18:23.595 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:18:23.601 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:18:23.612 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:18:23.612 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:18:23.629 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:18:23.629 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:18:23.682 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:23.681+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:23.719 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:23.719 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:23.719 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:18:23.719 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:18:23.719 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:23.727 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:18:23.769 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:23.768+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:23.850 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:23.849+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:23.886 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:23.887 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:18:23.887 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:18:23.887 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:18:23.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.887 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3705 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14812160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:23.887 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:18:23.887 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 125.74530632299999, 2024-09-12T16:18:23.887 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053368831999999998, 2024-09-12T16:18:23.887 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:23.887 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:23.887 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:23.887 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:23.887 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:23.887 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:23.887 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3705 2024-09-12T16:18:23.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.888 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:23.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.888 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:23.888 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:18:23.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.888 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:23.888 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:18:23.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:23.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139932+0000", 2024-09-12T16:18:23.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012762099999999999 2024-09-12T16:18:23.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:23.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139935+0000", 2024-09-12T16:18:23.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.119e-06 2024-09-12T16:18:23.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:23.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139939+0000", 2024-09-12T16:18:23.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7999999999999998e-06 2024-09-12T16:18:23.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.890 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:23.890 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139953+0000", 2024-09-12T16:18:23.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3923999999999999e-05 2024-09-12T16:18:23.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.890 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:23.890 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192946+0000", 2024-09-12T16:18:23.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052992971 2024-09-12T16:18:23.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.890 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:23.890 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193035+0000", 2024-09-12T16:18:23.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9040000000000001e-05 2024-09-12T16:18:23.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.891 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:23.891 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193174+0000", 2024-09-12T16:18:23.891 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138357 2024-09-12T16:18:23.891 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.891 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:23.891 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.891 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3706 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14816256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:23.891 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:18:23.891 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 125.745151333, 2024-09-12T16:18:23.891 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053341723000000001, 2024-09-12T16:18:23.891 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:23.892 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:23.892 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:23.892 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:23.892 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:23.892 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:23.892 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3706 2024-09-12T16:18:23.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.892 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:23.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.892 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:23.892 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:18:23.892 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.892 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:23.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:18:23.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.893 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:23.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140090+0000", 2024-09-12T16:18:23.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013020100000000001 2024-09-12T16:18:23.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.893 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:23.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140097+0000", 2024-09-12T16:18:23.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0709999999999997e-06 2024-09-12T16:18:23.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.894 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:23.894 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140103+0000", 2024-09-12T16:18:23.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5450000000000003e-06 2024-09-12T16:18:23.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.894 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:23.894 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140106+0000", 2024-09-12T16:18:23.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3739999999999998e-06 2024-09-12T16:18:23.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.894 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:23.894 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193190+0000", 2024-09-12T16:18:23.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053084131999999999 2024-09-12T16:18:23.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.895 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:23.895 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193232+0000", 2024-09-12T16:18:23.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1517000000000002e-05 2024-09-12T16:18:23.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.895 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:23.895 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193302+0000", 2024-09-12T16:18:23.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9882999999999995e-05 2024-09-12T16:18:23.895 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.895 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:23.895 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.896 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3707 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14820352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:23.896 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:18:23.896 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 125.74499934400001, 2024-09-12T16:18:23.896 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053452771000000003, 2024-09-12T16:18:23.896 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:23.896 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:23.896 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:23.896 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:23.896 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:23.896 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:23.896 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3707 2024-09-12T16:18:23.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.897 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:23.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.897 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:23.897 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:18:23.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.897 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:23.897 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:18:23.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.897 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:23.897 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140219+0000", 2024-09-12T16:18:23.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106902 2024-09-12T16:18:23.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:23.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140225+0000", 2024-09-12T16:18:23.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3199999999999996e-06 2024-09-12T16:18:23.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:23.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140230+0000", 2024-09-12T16:18:23.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8969999999999999e-06 2024-09-12T16:18:23.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:23.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140233+0000", 2024-09-12T16:18:23.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2119999999999999e-06 2024-09-12T16:18:23.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:23.899 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193339+0000", 2024-09-12T16:18:23.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053105556999999998 2024-09-12T16:18:23.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:23.899 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193431+0000", 2024-09-12T16:18:23.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1837999999999997e-05 2024-09-12T16:18:23.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:23.900 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193565+0000", 2024-09-12T16:18:23.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013404500000000001 2024-09-12T16:18:23.900 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.900 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:23.900 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.900 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3708 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14824448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:23.900 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:18:23.900 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 125.744870502, 2024-09-12T16:18:23.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053468190999999998, 2024-09-12T16:18:23.900 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:23.900 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:23.901 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:23.901 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:23.901 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:23.901 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:23.901 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3708 2024-09-12T16:18:23.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.901 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:23.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.901 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:23.901 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:18:23.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:23.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:18:23.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:23.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140351+0000", 2024-09-12T16:18:23.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110096 2024-09-12T16:18:23.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:23.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140358+0000", 2024-09-12T16:18:23.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.306e-06 2024-09-12T16:18:23.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:23.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140368+0000", 2024-09-12T16:18:23.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0225e-05 2024-09-12T16:18:23.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:23.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140372+0000", 2024-09-12T16:18:23.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6169999999999998e-06 2024-09-12T16:18:23.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:23.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193594+0000", 2024-09-12T16:18:23.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053222419999999999 2024-09-12T16:18:23.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:23.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193640+0000", 2024-09-12T16:18:23.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.587e-05 2024-09-12T16:18:23.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:23.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193709+0000", 2024-09-12T16:18:23.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8657000000000004e-05 2024-09-12T16:18:23.904 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.904 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:23.904 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.905 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3709 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14828544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:23.905 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:18:23.905 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 125.74473353400001, 2024-09-12T16:18:23.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594033999999999, 2024-09-12T16:18:23.905 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:23.905 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:23.905 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:23.905 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:23.905 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:23.905 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:23.905 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3709 2024-09-12T16:18:23.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.905 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:23.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.906 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:23.906 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:18:23.906 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.906 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:23.906 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:18:23.906 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.906 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:23.906 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140499+0000", 2024-09-12T16:18:23.906 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121019 2024-09-12T16:18:23.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:23.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140501+0000", 2024-09-12T16:18:23.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2369999999999999e-06 2024-09-12T16:18:23.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:23.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140506+0000", 2024-09-12T16:18:23.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.639e-06 2024-09-12T16:18:23.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:23.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140509+0000", 2024-09-12T16:18:23.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3419999999999999e-06 2024-09-12T16:18:23.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:23.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193743+0000", 2024-09-12T16:18:23.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053234311999999999 2024-09-12T16:18:23.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:23.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193833+0000", 2024-09-12T16:18:23.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9883999999999995e-05 2024-09-12T16:18:23.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:23.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193972+0000", 2024-09-12T16:18:23.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138601 2024-09-12T16:18:23.909 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.909 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:23.909 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.909 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3710 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14832640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:23.909 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:18:23.909 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 125.744596188, 2024-09-12T16:18:23.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053607324999999997, 2024-09-12T16:18:23.909 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:23.909 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:23.910 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:23.910 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:23.910 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:23.910 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:23.910 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3710 2024-09-12T16:18:23.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.910 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:23.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:23.910 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:18:23.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:23.910 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:18:23.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:23.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140664+0000", 2024-09-12T16:18:23.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014918700000000001 2024-09-12T16:18:23.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:23.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140674+0000", 2024-09-12T16:18:23.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8379999999999997e-06 2024-09-12T16:18:23.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:23.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140694+0000", 2024-09-12T16:18:23.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0145000000000001e-05 2024-09-12T16:18:23.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:23.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140703+0000", 2024-09-12T16:18:23.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5150000000000006e-06 2024-09-12T16:18:23.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:23.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194006+0000", 2024-09-12T16:18:23.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053303370000000003 2024-09-12T16:18:23.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:23.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194051+0000", 2024-09-12T16:18:23.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5012000000000002e-05 2024-09-12T16:18:23.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.913 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:23.913 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194122+0000", 2024-09-12T16:18:23.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1258000000000001e-05 2024-09-12T16:18:23.913 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.913 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:23.913 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.913 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3711 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14836736~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:23.913 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:18:23.913 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 125.74439474, 2024-09-12T16:18:23.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053670799999999998, 2024-09-12T16:18:23.914 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:23.914 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:23.914 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:23.914 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:23.914 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:23.914 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:23.914 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3711 2024-09-12T16:18:23.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.914 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:23.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.914 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:23.914 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:18:23.914 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.915 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:23.915 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:18:23.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.915 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:23.915 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140782+0000", 2024-09-12T16:18:23.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5549999999999994e-05 2024-09-12T16:18:23.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.915 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:23.915 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140786+0000", 2024-09-12T16:18:23.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.89e-06 2024-09-12T16:18:23.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:23.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140796+0000", 2024-09-12T16:18:23.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0057e-05 2024-09-12T16:18:23.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:23.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140819+0000", 2024-09-12T16:18:23.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3005000000000001e-05 2024-09-12T16:18:23.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:23.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194159+0000", 2024-09-12T16:18:23.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053340324000000001 2024-09-12T16:18:23.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:23.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194248+0000", 2024-09-12T16:18:23.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9209000000000006e-05 2024-09-12T16:18:23.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:23.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194387+0000", 2024-09-12T16:18:23.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138765 2024-09-12T16:18:23.918 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.918 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:23.918 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.918 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3712 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14840832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:23.918 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:18:23.918 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 125.74428028200001, 2024-09-12T16:18:23.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053699068000000003, 2024-09-12T16:18:23.918 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:23.918 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:23.918 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:23.919 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:23.919 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:23.919 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:23.919 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3712 2024-09-12T16:18:23.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.919 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:23.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.919 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:23.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:18:23.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.919 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:23.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:18:23.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:23.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140900+0000", 2024-09-12T16:18:23.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9014e-05 2024-09-12T16:18:23.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:23.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140904+0000", 2024-09-12T16:18:23.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0940000000000001e-06 2024-09-12T16:18:23.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:23.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140933+0000", 2024-09-12T16:18:23.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8996000000000002e-05 2024-09-12T16:18:23.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:23.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140945+0000", 2024-09-12T16:18:23.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1909000000000001e-05 2024-09-12T16:18:23.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:23.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194415+0000", 2024-09-12T16:18:23.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053470403 2024-09-12T16:18:23.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:23.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194460+0000", 2024-09-12T16:18:23.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5145000000000002e-05 2024-09-12T16:18:23.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:23.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194530+0000", 2024-09-12T16:18:23.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9506999999999997e-05 2024-09-12T16:18:23.922 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.922 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:23.922 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.922 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3713 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14844928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:23.922 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:18:23.923 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 125.744147222, 2024-09-12T16:18:23.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053821236000000001, 2024-09-12T16:18:23.923 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:23.923 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:23.923 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:23.923 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:23.923 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:23.923 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:23.923 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3713 2024-09-12T16:18:23.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.923 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:23.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:23.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:18:23.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.924 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:23.924 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:18:23.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.924 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:23.924 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141078+0000", 2024-09-12T16:18:23.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114162 2024-09-12T16:18:23.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.924 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:23.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141090+0000", 2024-09-12T16:18:23.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.19e-05 2024-09-12T16:18:23.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:23.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141100+0000", 2024-09-12T16:18:23.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0447e-05 2024-09-12T16:18:23.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:23.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141108+0000", 2024-09-12T16:18:23.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7190000000000001e-06 2024-09-12T16:18:23.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:23.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194564+0000", 2024-09-12T16:18:23.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053455729 2024-09-12T16:18:23.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:23.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194652+0000", 2024-09-12T16:18:23.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8288999999999994e-05 2024-09-12T16:18:23.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:23.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194785+0000", 2024-09-12T16:18:23.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013299000000000001 2024-09-12T16:18:23.926 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.926 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:23.927 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.927 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3714 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14849024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:23.927 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:18:23.927 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 125.74399129299999, 2024-09-12T16:18:23.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053816382000000003, 2024-09-12T16:18:23.927 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:23.927 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:23.927 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:23.927 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:23.927 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:23.927 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:23.927 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3714 2024-09-12T16:18:23.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.928 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:23.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.928 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:23.928 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:18:23.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.928 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:23.928 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:18:23.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.928 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:23.929 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141182+0000", 2024-09-12T16:18:23.929 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1805999999999997e-05 2024-09-12T16:18:23.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.929 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:23.929 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141185+0000", 2024-09-12T16:18:23.929 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5930000000000002e-06 2024-09-12T16:18:23.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.929 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:23.929 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141194+0000", 2024-09-12T16:18:23.929 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5760000000000006e-06 2024-09-12T16:18:23.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:23.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141222+0000", 2024-09-12T16:18:23.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8034999999999998e-05 2024-09-12T16:18:23.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:23.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194817+0000", 2024-09-12T16:18:23.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594887000000001 2024-09-12T16:18:23.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:23.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194860+0000", 2024-09-12T16:18:23.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3714999999999997e-05 2024-09-12T16:18:23.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:23.931 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194936+0000", 2024-09-12T16:18:23.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5770000000000001e-05 2024-09-12T16:18:23.931 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.931 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:23.931 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.931 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3715 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14853120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:23.931 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:18:23.931 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 125.743867636, 2024-09-12T16:18:23.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053962307000000001, 2024-09-12T16:18:23.931 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:23.932 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:23.932 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:23.932 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:23.932 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:23.932 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:23.932 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3715 2024-09-12T16:18:23.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.932 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:23.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.932 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:23.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:18:23.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:23.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:18:23.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:23.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141417+0000", 2024-09-12T16:18:23.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017384099999999999 2024-09-12T16:18:23.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:23.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141422+0000", 2024-09-12T16:18:23.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7310000000000001e-06 2024-09-12T16:18:23.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:23.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141434+0000", 2024-09-12T16:18:23.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2058e-05 2024-09-12T16:18:23.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:23.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141442+0000", 2024-09-12T16:18:23.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7610000000000007e-06 2024-09-12T16:18:23.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:23.935 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194973+0000", 2024-09-12T16:18:23.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053530618000000002 2024-09-12T16:18:23.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.935 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:23.935 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195063+0000", 2024-09-12T16:18:23.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0927000000000005e-05 2024-09-12T16:18:23.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.935 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:23.935 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195206+0000", 2024-09-12T16:18:23.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142371 2024-09-12T16:18:23.935 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.935 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:23.935 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.936 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3716 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14857216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:23.936 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:18:23.936 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 125.743657786, 2024-09-12T16:18:23.936 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053916360000000003, 2024-09-12T16:18:23.936 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:23.936 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:23.936 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:23.936 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:23.936 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:23.936 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:23.936 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3716 2024-09-12T16:18:23.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.937 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:23.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:23.937 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:18:23.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:23.937 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:18:23.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:23.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142933+0000", 2024-09-12T16:18:23.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014796290000000001 2024-09-12T16:18:23.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:23.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142937+0000", 2024-09-12T16:18:23.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5760000000000002e-06 2024-09-12T16:18:23.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:23.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142946+0000", 2024-09-12T16:18:23.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0380000000000005e-06 2024-09-12T16:18:23.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:23.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142951+0000", 2024-09-12T16:18:23.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9749999999999998e-06 2024-09-12T16:18:23.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:23.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195246+0000", 2024-09-12T16:18:23.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052295358 2024-09-12T16:18:23.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:23.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195299+0000", 2024-09-12T16:18:23.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2976999999999998e-05 2024-09-12T16:18:23.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:23.940 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195370+0000", 2024-09-12T16:18:23.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0807000000000002e-05 2024-09-12T16:18:23.940 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.940 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:23.940 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.940 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3721 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14877696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:23.940 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:18:23.940 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 125.742084335, 2024-09-12T16:18:23.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053422994000000001, 2024-09-12T16:18:23.940 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:23.941 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:23.941 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:23.941 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:23.941 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:23.941 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:23.941 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3721 2024-09-12T16:18:23.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.941 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:23.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.941 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:23.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:18:23.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.942 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:23.942 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:18:23.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.942 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:23.942 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:18:23.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:18:23.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.942 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:23.942 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143028+0000", 2024-09-12T16:18:23.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7399999999999991e-07 2024-09-12T16:18:23.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:23.943 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143031+0000", 2024-09-12T16:18:23.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7599999999999998e-06 2024-09-12T16:18:23.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:23.943 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143034+0000", 2024-09-12T16:18:23.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9780000000000001e-06 2024-09-12T16:18:23.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:23.943 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196220+0000", 2024-09-12T16:18:23.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053186341999999998 2024-09-12T16:18:23.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:23.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196313+0000", 2024-09-12T16:18:23.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2676000000000005e-05 2024-09-12T16:18:23.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:23.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196450+0000", 2024-09-12T16:18:23.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137052 2024-09-12T16:18:23.944 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.944 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:23.944 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.945 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3722 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14881792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:23.945 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:18:23.945 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 125.74207444300001, 2024-09-12T16:18:23.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053556835999999997, 2024-09-12T16:18:23.945 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:23.945 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:23.945 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:23.945 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:23.945 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:23.945 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:23.945 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3722 2024-09-12T16:18:23.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.945 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:23.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:23.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:18:23.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:23.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:18:23.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:23.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:18:23.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.11e-07 2024-09-12T16:18:23.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:23.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143038+0000", 2024-09-12T16:18:23.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2399999999999996e-07 2024-09-12T16:18:23.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:23.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143041+0000", 2024-09-12T16:18:23.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8030000000000001e-06 2024-09-12T16:18:23.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:23.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143043+0000", 2024-09-12T16:18:23.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3140000000000002e-06 2024-09-12T16:18:23.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:23.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196481+0000", 2024-09-12T16:18:23.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053437601000000001 2024-09-12T16:18:23.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:23.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196525+0000", 2024-09-12T16:18:23.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4280000000000003e-05 2024-09-12T16:18:23.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:23.949 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196594+0000", 2024-09-12T16:18:23.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8702999999999996e-05 2024-09-12T16:18:23.949 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.949 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:23.949 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.949 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3723 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14885888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:23.949 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:18:23.949 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 125.74206526099999, 2024-09-12T16:18:23.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053815546999999998, 2024-09-12T16:18:23.949 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:23.949 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:23.949 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:23.950 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:23.950 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:23.950 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:23.950 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3723 2024-09-12T16:18:23.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.950 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:23.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:23.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:18:23.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:23.951 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:18:23.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.951 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:23.951 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148994+0000", 2024-09-12T16:18:23.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059481330000000004 2024-09-12T16:18:23.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.951 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:23.951 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148999+0000", 2024-09-12T16:18:23.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7140000000000001e-06 2024-09-12T16:18:23.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:23.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149008+0000", 2024-09-12T16:18:23.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4350000000000003e-06 2024-09-12T16:18:23.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:23.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149021+0000", 2024-09-12T16:18:23.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2514000000000001e-05 2024-09-12T16:18:23.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:23.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196630+0000", 2024-09-12T16:18:23.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047609758000000002 2024-09-12T16:18:23.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:23.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196724+0000", 2024-09-12T16:18:23.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3522000000000003e-05 2024-09-12T16:18:23.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:23.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196861+0000", 2024-09-12T16:18:23.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013747100000000001 2024-09-12T16:18:23.953 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.953 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:23.953 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.954 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4438 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15719424~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:23.954 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:18:23.954 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 125.597184484, 2024-09-12T16:18:23.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367981000000002, 2024-09-12T16:18:23.954 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:23.954 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:23.954 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:23.954 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:23.954 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:23.954 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:23.954 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4438 2024-09-12T16:18:23.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.954 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:23.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:23.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:18:23.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:23.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:18:23.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:23.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:18:23.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3e-07 2024-09-12T16:18:23.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:23.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287930+0000", 2024-09-12T16:18:23.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-12T16:18:23.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:23.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287937+0000", 2024-09-12T16:18:23.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.08e-06 2024-09-12T16:18:23.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:23.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287943+0000", 2024-09-12T16:18:23.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5709999999999997e-06 2024-09-12T16:18:23.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:23.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341068+0000", 2024-09-12T16:18:23.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053125101000000001 2024-09-12T16:18:23.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:23.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341154+0000", 2024-09-12T16:18:23.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6100999999999994e-05 2024-09-12T16:18:23.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:23.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341295+0000", 2024-09-12T16:18:23.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014087999999999999 2024-09-12T16:18:23.958 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.958 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:23.958 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.958 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4439 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15723520~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:23.958 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:18:23.958 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 125.597160324, 2024-09-12T16:18:23.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053526799, 2024-09-12T16:18:23.958 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:23.959 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:23.959 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:23.959 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:23.959 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:23.959 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:23.959 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4439 2024-09-12T16:18:23.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.959 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:23.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:23.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:18:23.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:23.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:18:23.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:23.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:18:23.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-07 2024-09-12T16:18:23.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:23.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287953+0000", 2024-09-12T16:18:23.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1349999999999999e-06 2024-09-12T16:18:23.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:23.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287960+0000", 2024-09-12T16:18:23.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-12T16:18:23.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:23.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287965+0000", 2024-09-12T16:18:23.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1580000000000004e-06 2024-09-12T16:18:23.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:23.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341332+0000", 2024-09-12T16:18:23.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367009 2024-09-12T16:18:23.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:23.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341402+0000", 2024-09-12T16:18:23.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9759999999999996e-05 2024-09-12T16:18:23.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:23.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341478+0000", 2024-09-12T16:18:23.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5412000000000002e-05 2024-09-12T16:18:23.962 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.962 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:23.963 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.963 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4440 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15727616~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:23.963 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:18:23.963 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 125.59713922, 2024-09-12T16:18:23.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053761601999999999, 2024-09-12T16:18:23.963 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:23.963 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:23.963 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:23.963 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:23.963 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:23.964 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:23.964 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4440 2024-09-12T16:18:23.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.964 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:23.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:23.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:18:23.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:23.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:18:23.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:23.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:18:23.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:18:23.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:23.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287974+0000", 2024-09-12T16:18:23.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0540000000000002e-06 2024-09-12T16:18:23.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:23.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287980+0000", 2024-09-12T16:18:23.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9440000000000002e-06 2024-09-12T16:18:23.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:23.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287987+0000", 2024-09-12T16:18:23.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5889999999999999e-06 2024-09-12T16:18:23.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:23.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341502+0000", 2024-09-12T16:18:23.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053515199999999999 2024-09-12T16:18:23.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:23.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341595+0000", 2024-09-12T16:18:23.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3097000000000007e-05 2024-09-12T16:18:23.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:23.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341734+0000", 2024-09-12T16:18:23.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013832800000000001 2024-09-12T16:18:23.967 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.967 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:23.967 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.967 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2209 3.1 3:85f36d3b:::rbd_data.1155ccb1894c.0000000000000004:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:18:23.967 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:18:23.967 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 86.513454081999996, 2024-09-12T16:18:23.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.060659365, 2024-09-12T16:18:23.968 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:23.968 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:23.968 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:23.968 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:23.968 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:18:23.968 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:18:23.968 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2209 2024-09-12T16:18:23.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.968 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:23.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:23.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:18:23.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:23.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:18:23.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:23.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371658+0000", 2024-09-12T16:18:23.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1570000000000001e-06 2024-09-12T16:18:23.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:23.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393414+0000", 2024-09-12T16:18:23.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021755495999999999 2024-09-12T16:18:23.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:23.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393447+0000", 2024-09-12T16:18:23.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3630000000000002e-05 2024-09-12T16:18:23.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:23.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393462+0000", 2024-09-12T16:18:23.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5048999999999999e-05 2024-09-12T16:18:23.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:23.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393556+0000", 2024-09-12T16:18:23.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3549999999999997e-05 2024-09-12T16:18:23.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:23.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393697+0000", 2024-09-12T16:18:23.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000141414 2024-09-12T16:18:23.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T16:18:23.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.394944+0000", 2024-09-12T16:18:23.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012463039999999999 2024-09-12T16:18:23.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:23.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.431803+0000", 2024-09-12T16:18:23.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0368594 2024-09-12T16:18:23.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:18:23.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432268+0000", 2024-09-12T16:18:23.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046457600000000002 2024-09-12T16:18:23.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:18:23.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432293+0000", 2024-09-12T16:18:23.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.527e-05 2024-09-12T16:18:23.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:23.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432316+0000", 2024-09-12T16:18:23.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3519e-05 2024-09-12T16:18:23.973 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.973 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:23.973 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.973 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:9400 3.1f 3:feea9999:::rbd_data.1155338d0570.0000000000000007:head [read 32768~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-12T16:18:23.973 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:20.012502+0000", 2024-09-12T16:18:23.973 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 63.872609089999997, 2024-09-12T16:18:23.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.000678049, 2024-09-12T16:18:23.974 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:23.974 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:23.974 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:23.974 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:23.974 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:18:23.974 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:18:23.974 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 9400 2024-09-12T16:18:23.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.974 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:23.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:23.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012502+0000", 2024-09-12T16:18:23.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:23.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012502+0000", 2024-09-12T16:18:23.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:23.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:23.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012504+0000", 2024-09-12T16:18:23.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5939999999999999e-06 2024-09-12T16:18:23.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:23.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012511+0000", 2024-09-12T16:18:23.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0840000000000003e-06 2024-09-12T16:18:23.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:23.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012525+0000", 2024-09-12T16:18:23.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4538999999999999e-05 2024-09-12T16:18:23.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:23.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012532+0000", 2024-09-12T16:18:23.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8310000000000003e-06 2024-09-12T16:18:23.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:23.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012605+0000", 2024-09-12T16:18:23.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2387999999999999e-05 2024-09-12T16:18:23.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T16:18:23.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012617+0000", 2024-09-12T16:18:23.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2167999999999999e-05 2024-09-12T16:18:23.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:23.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:21.012823+0000", 2024-09-12T16:18:23.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0002068230000001 2024-09-12T16:18:23.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:23.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:21.012975+0000", 2024-09-12T16:18:23.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015196200000000001 2024-09-12T16:18:23.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:23.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:23.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:23.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:21.013180+0000", 2024-09-12T16:18:23.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020466000000000001 2024-09-12T16:18:23.978 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.978 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:23.978 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.978 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:23.978 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:23.978 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:23.980 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:18:23.980 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:23.978+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:24.080 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:24.079+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:24.089 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:24.089 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:24.089 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:18:24.089 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:24.098 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:18:24.181 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:24.179+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:24.219 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:24.220 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:24.220 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:18:24.220 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:18:24.220 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:24.228 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:18:24.281 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:24.281+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:24.337 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:24.337 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:18:24.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:18:24.337 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:18:24.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.337 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1571 3.b 3:d046566d:::rbd_data.1155525b14e3.0000000000000001:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:18:24.337 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:18:24.337 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 103.18294128300001, 2024-09-12T16:18:24.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064439785999999999, 2024-09-12T16:18:24.337 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.337 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.338 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:24.338 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.338 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:18:24.338 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:18:24.338 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1571 2024-09-12T16:18:24.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.338 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:18:24.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:18:24.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:18:24.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5400000000000002e-07 2024-09-12T16:18:24.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152567+0000", 2024-09-12T16:18:24.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.131e-06 2024-09-12T16:18:24.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.340 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152574+0000", 2024-09-12T16:18:24.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1840000000000002e-06 2024-09-12T16:18:24.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.340 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152579+0000", 2024-09-12T16:18:24.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.152e-06 2024-09-12T16:18:24.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.340 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153671+0000", 2024-09-12T16:18:24.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001092078 2024-09-12T16:18:24.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.341 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:24.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153779+0000", 2024-09-12T16:18:24.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108461 2024-09-12T16:18:24.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.341 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217004+0000", 2024-09-12T16:18:24.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.063224426 2024-09-12T16:18:24.341 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.342 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.342 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.342 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1581 3.4 3:22e34893:::rbd_data.1155525b14e3.0000000000000005:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:18:24.342 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:18:24.342 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 103.18284415799999, 2024-09-12T16:18:24.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064484407999999993, 2024-09-12T16:18:24.342 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.342 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.342 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:24.342 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.342 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:18:24.343 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:18:24.343 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1581 2024-09-12T16:18:24.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.343 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:18:24.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:18:24.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152662+0000", 2024-09-12T16:18:24.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.65e-07 2024-09-12T16:18:24.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152664+0000", 2024-09-12T16:18:24.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9829999999999999e-06 2024-09-12T16:18:24.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.345 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152670+0000", 2024-09-12T16:18:24.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2260000000000002e-06 2024-09-12T16:18:24.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.345 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152675+0000", 2024-09-12T16:18:24.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7990000000000001e-06 2024-09-12T16:18:24.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.345 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.216945+0000", 2024-09-12T16:18:24.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064270341999999994 2024-09-12T16:18:24.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:24.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217040+0000", 2024-09-12T16:18:24.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5242999999999996e-05 2024-09-12T16:18:24.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217146+0000", 2024-09-12T16:18:24.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010545 2024-09-12T16:18:24.346 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.346 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.346 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.347 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2207 3.0 3:05fdc61f:::rbd_data.1155ccb1894c.0000000000000003:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:18:24.347 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:18:24.347 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 86.964800596999993, 2024-09-12T16:18:24.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.05105382, 2024-09-12T16:18:24.347 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.347 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.347 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:24.347 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.347 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:18:24.347 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:18:24.347 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2207 2024-09-12T16:18:24.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.347 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:18:24.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:18:24.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370706+0000", 2024-09-12T16:18:24.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7800000000000001e-07 2024-09-12T16:18:24.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391581+0000", 2024-09-12T16:18:24.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020875624999999998 2024-09-12T16:18:24.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391608+0000", 2024-09-12T16:18:24.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6412999999999999e-05 2024-09-12T16:18:24.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391618+0000", 2024-09-12T16:18:24.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9240000000000002e-06 2024-09-12T16:18:24.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.350 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.350 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391705+0000", 2024-09-12T16:18:24.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7489000000000002e-05 2024-09-12T16:18:24.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.350 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:24.350 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391838+0000", 2024-09-12T16:18:24.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132865 2024-09-12T16:18:24.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.350 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 2", 2024-09-12T16:18:24.350 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.392587+0000", 2024-09-12T16:18:24.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074930000000000005 2024-09-12T16:18:24.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:24.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.420095+0000", 2024-09-12T16:18:24.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027507949 2024-09-12T16:18:24.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:18:24.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421610+0000", 2024-09-12T16:18:24.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001515195 2024-09-12T16:18:24.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:18:24.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421681+0000", 2024-09-12T16:18:24.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0320000000000004e-05 2024-09-12T16:18:24.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421759+0000", 2024-09-12T16:18:24.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7961999999999997e-05 2024-09-12T16:18:24.352 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.352 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.352 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.352 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11083 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 3399680~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:24.353 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.876304+0000", 2024-09-12T16:18:24.353 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.459201190000002, 2024-09-12T16:18:24.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045070883999999999, 2024-09-12T16:18:24.353 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.353 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.353 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:24.353 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.353 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:24.353 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:24.353 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11083 2024-09-12T16:18:24.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.353 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876304+0000", 2024-09-12T16:18:24.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876304+0000", 2024-09-12T16:18:24.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876305+0000", 2024-09-12T16:18:24.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4099999999999999e-07 2024-09-12T16:18:24.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876307+0000", 2024-09-12T16:18:24.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9470000000000002e-06 2024-09-12T16:18:24.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876312+0000", 2024-09-12T16:18:24.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7540000000000003e-06 2024-09-12T16:18:24.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876318+0000", 2024-09-12T16:18:24.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3589999999999999e-06 2024-09-12T16:18:24.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.356 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.356 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921221+0000", 2024-09-12T16:18:24.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044903464999999997 2024-09-12T16:18:24.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.356 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:24.356 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921266+0000", 2024-09-12T16:18:24.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4795000000000001e-05 2024-09-12T16:18:24.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.356 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.356 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921375+0000", 2024-09-12T16:18:24.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000109023 2024-09-12T16:18:24.357 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.357 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.357 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.357 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11084 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 3448832~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:24.357 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.876324+0000", 2024-09-12T16:18:24.357 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.459181073, 2024-09-12T16:18:24.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045172474999999997, 2024-09-12T16:18:24.357 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.357 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.357 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:24.357 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.358 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:24.358 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:24.358 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11084 2024-09-12T16:18:24.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.358 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876324+0000", 2024-09-12T16:18:24.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876324+0000", 2024-09-12T16:18:24.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876411+0000", 2024-09-12T16:18:24.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6292000000000007e-05 2024-09-12T16:18:24.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876418+0000", 2024-09-12T16:18:24.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3309999999999998e-06 2024-09-12T16:18:24.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876426+0000", 2024-09-12T16:18:24.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3850000000000002e-06 2024-09-12T16:18:24.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876436+0000", 2024-09-12T16:18:24.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8749999999999995e-06 2024-09-12T16:18:24.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921403+0000", 2024-09-12T16:18:24.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044966385999999997 2024-09-12T16:18:24.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:24.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921445+0000", 2024-09-12T16:18:24.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1953000000000003e-05 2024-09-12T16:18:24.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921497+0000", 2024-09-12T16:18:24.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2253000000000003e-05 2024-09-12T16:18:24.361 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.361 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.361 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.361 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11085 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 3497984~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:24.361 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.876449+0000", 2024-09-12T16:18:24.362 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.459056563000001, 2024-09-12T16:18:24.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045173054999999997, 2024-09-12T16:18:24.362 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.362 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.362 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:24.362 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.362 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:24.362 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:24.362 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11085 2024-09-12T16:18:24.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.362 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876449+0000", 2024-09-12T16:18:24.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.363 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876449+0000", 2024-09-12T16:18:24.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.363 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.881997+0000", 2024-09-12T16:18:24.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055481209999999996 2024-09-12T16:18:24.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.364 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.882002+0000", 2024-09-12T16:18:24.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8269999999999997e-06 2024-09-12T16:18:24.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.364 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.882013+0000", 2024-09-12T16:18:24.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0869999999999999e-05 2024-09-12T16:18:24.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.882020+0000", 2024-09-12T16:18:24.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5839999999999997e-06 2024-09-12T16:18:24.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921523+0000", 2024-09-12T16:18:24.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039502411000000001 2024-09-12T16:18:24.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:24.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921566+0000", 2024-09-12T16:18:24.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3353000000000003e-05 2024-09-12T16:18:24.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921622+0000", 2024-09-12T16:18:24.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5889e-05 2024-09-12T16:18:24.366 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.366 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.366 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.366 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11139 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 6152192~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:24.366 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883248+0000", 2024-09-12T16:18:24.366 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.452257699, 2024-09-12T16:18:24.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045153225999999998, 2024-09-12T16:18:24.366 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.367 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.367 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:24.367 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.367 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:24.367 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:24.367 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11139 2024-09-12T16:18:24.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.367 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.367 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.367 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883248+0000", 2024-09-12T16:18:24.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.368 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.368 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883248+0000", 2024-09-12T16:18:24.368 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.368 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.368 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883248+0000", 2024-09-12T16:18:24.368 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9999999999999998e-07 2024-09-12T16:18:24.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.368 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.368 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883250+0000", 2024-09-12T16:18:24.368 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0660000000000002e-06 2024-09-12T16:18:24.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883256+0000", 2024-09-12T16:18:24.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8699999999999997e-06 2024-09-12T16:18:24.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883261+0000", 2024-09-12T16:18:24.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0490000000000003e-06 2024-09-12T16:18:24.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928316+0000", 2024-09-12T16:18:24.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045055398000000003 2024-09-12T16:18:24.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:24.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928359+0000", 2024-09-12T16:18:24.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2286000000000001e-05 2024-09-12T16:18:24.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928401+0000", 2024-09-12T16:18:24.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2157000000000003e-05 2024-09-12T16:18:24.370 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.370 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.370 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.371 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11140 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 6201344~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:24.371 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883267+0000", 2024-09-12T16:18:24.371 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.452237932999999, 2024-09-12T16:18:24.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045241199000000003, 2024-09-12T16:18:24.371 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.371 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.371 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:24.371 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.371 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:24.371 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:24.371 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11140 2024-09-12T16:18:24.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.372 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883267+0000", 2024-09-12T16:18:24.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883267+0000", 2024-09-12T16:18:24.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883268+0000", 2024-09-12T16:18:24.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8700000000000001e-07 2024-09-12T16:18:24.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883270+0000", 2024-09-12T16:18:24.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3420000000000002e-06 2024-09-12T16:18:24.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883276+0000", 2024-09-12T16:18:24.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0310000000000004e-06 2024-09-12T16:18:24.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883281+0000", 2024-09-12T16:18:24.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1259999999999997e-06 2024-09-12T16:18:24.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928428+0000", 2024-09-12T16:18:24.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045146276999999999 2024-09-12T16:18:24.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:24.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928469+0000", 2024-09-12T16:18:24.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1007000000000002e-05 2024-09-12T16:18:24.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928509+0000", 2024-09-12T16:18:24.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0028999999999999e-05 2024-09-12T16:18:24.375 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.375 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.375 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.375 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11141 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 6250496~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:24.375 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883288+0000", 2024-09-12T16:18:24.375 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.452217336, 2024-09-12T16:18:24.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045331594000000003, 2024-09-12T16:18:24.375 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.375 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.375 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:24.375 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.375 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:24.376 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:24.376 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11141 2024-09-12T16:18:24.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.376 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.376 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883288+0000", 2024-09-12T16:18:24.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.376 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883288+0000", 2024-09-12T16:18:24.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.376 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883288+0000", 2024-09-12T16:18:24.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0200000000000003e-07 2024-09-12T16:18:24.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883290+0000", 2024-09-12T16:18:24.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9350000000000001e-06 2024-09-12T16:18:24.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883296+0000", 2024-09-12T16:18:24.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.913e-06 2024-09-12T16:18:24.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.378 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.379 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883302+0000", 2024-09-12T16:18:24.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.879e-06 2024-09-12T16:18:24.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.379 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.379 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928534+0000", 2024-09-12T16:18:24.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045231544999999998 2024-09-12T16:18:24.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.379 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:24.379 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928577+0000", 2024-09-12T16:18:24.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3676e-05 2024-09-12T16:18:24.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928620+0000", 2024-09-12T16:18:24.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2243999999999997e-05 2024-09-12T16:18:24.380 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.380 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.380 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.380 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11271 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3174400~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:24.380 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883316+0000", 2024-09-12T16:18:24.380 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.452189275999999, 2024-09-12T16:18:24.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045477308000000001, 2024-09-12T16:18:24.381 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.381 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.381 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:24.381 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.381 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:24.381 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:24.381 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11271 2024-09-12T16:18:24.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.381 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.381 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883316+0000", 2024-09-12T16:18:24.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883316+0000", 2024-09-12T16:18:24.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883317+0000", 2024-09-12T16:18:24.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9200000000000001e-07 2024-09-12T16:18:24.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883319+0000", 2024-09-12T16:18:24.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2670000000000001e-06 2024-09-12T16:18:24.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883326+0000", 2024-09-12T16:18:24.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6000000000000003e-06 2024-09-12T16:18:24.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883331+0000", 2024-09-12T16:18:24.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1719999999999998e-06 2024-09-12T16:18:24.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928647+0000", 2024-09-12T16:18:24.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045316457999999997 2024-09-12T16:18:24.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:24.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928689+0000", 2024-09-12T16:18:24.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1352e-05 2024-09-12T16:18:24.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928793+0000", 2024-09-12T16:18:24.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000104867 2024-09-12T16:18:24.384 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.384 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.385 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.386 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11272 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3223552~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:24.386 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883338+0000", 2024-09-12T16:18:24.386 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.452167416000002, 2024-09-12T16:18:24.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045595268000000001, 2024-09-12T16:18:24.386 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.386 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.386 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:24.386 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.386 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:24.386 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:24.386 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11272 2024-09-12T16:18:24.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.386 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.387 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.387 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883338+0000", 2024-09-12T16:18:24.387 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.387 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.387 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883338+0000", 2024-09-12T16:18:24.387 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.387 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.387 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883339+0000", 2024-09-12T16:18:24.387 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8599999999999998e-07 2024-09-12T16:18:24.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883341+0000", 2024-09-12T16:18:24.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1449999999999998e-06 2024-09-12T16:18:24.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883348+0000", 2024-09-12T16:18:24.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0110000000000003e-06 2024-09-12T16:18:24.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883353+0000", 2024-09-12T16:18:24.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2360000000000004e-06 2024-09-12T16:18:24.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.389 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.389 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928819+0000", 2024-09-12T16:18:24.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045466392000000001 2024-09-12T16:18:24.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.389 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:24.389 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928869+0000", 2024-09-12T16:18:24.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9829e-05 2024-09-12T16:18:24.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.389 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928933+0000", 2024-09-12T16:18:24.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3968999999999997e-05 2024-09-12T16:18:24.390 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.390 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.390 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.390 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11273 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3272704~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:24.390 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883359+0000", 2024-09-12T16:18:24.390 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.452146104000001, 2024-09-12T16:18:24.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045735142999999999, 2024-09-12T16:18:24.390 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.390 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.390 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:24.390 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.391 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:24.391 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:24.391 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11273 2024-09-12T16:18:24.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.391 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.391 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.391 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883359+0000", 2024-09-12T16:18:24.391 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.391 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.391 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883359+0000", 2024-09-12T16:18:24.392 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.392 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.392 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883360+0000", 2024-09-12T16:18:24.392 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9400000000000001e-07 2024-09-12T16:18:24.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.393 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.393 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.393 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883367+0000", 2024-09-12T16:18:24.393 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8530000000000003e-06 2024-09-12T16:18:24.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.393 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.393 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.393 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883373+0000", 2024-09-12T16:18:24.393 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9989999999999997e-06 2024-09-12T16:18:24.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.393 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.393 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.394 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883378+0000", 2024-09-12T16:18:24.394 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3369999999999999e-06 2024-09-12T16:18:24.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.394 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.394 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928950+0000", 2024-09-12T16:18:24.394 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045571751000000001 2024-09-12T16:18:24.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.394 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:24.394 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928992+0000", 2024-09-12T16:18:24.394 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1891000000000003e-05 2024-09-12T16:18:24.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.394 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.395 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929094+0000", 2024-09-12T16:18:24.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010291800000000001 2024-09-12T16:18:24.395 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.395 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.395 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.395 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11274 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3321856~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:24.395 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883385+0000", 2024-09-12T16:18:24.395 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.452120587, 2024-09-12T16:18:24.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045864239000000001, 2024-09-12T16:18:24.395 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.395 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.395 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:24.395 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.396 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:24.396 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:24.396 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11274 2024-09-12T16:18:24.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.396 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.396 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.396 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883385+0000", 2024-09-12T16:18:24.396 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.396 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.396 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883385+0000", 2024-09-12T16:18:24.396 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.397 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.397 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883385+0000", 2024-09-12T16:18:24.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4799999999999999e-07 2024-09-12T16:18:24.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.397 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.397 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883388+0000", 2024-09-12T16:18:24.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3199999999999998e-06 2024-09-12T16:18:24.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.397 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.397 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883394+0000", 2024-09-12T16:18:24.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2020000000000001e-06 2024-09-12T16:18:24.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883400+0000", 2024-09-12T16:18:24.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8510000000000004e-06 2024-09-12T16:18:24.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929123+0000", 2024-09-12T16:18:24.401 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045723235000000001 2024-09-12T16:18:24.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.401 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:24.401 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929166+0000", 2024-09-12T16:18:24.401 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2769999999999999e-05 2024-09-12T16:18:24.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929249+0000", 2024-09-12T16:18:24.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3412999999999996e-05 2024-09-12T16:18:24.402 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.402 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.402 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.403 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11275 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3371008~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:24.403 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883416+0000", 2024-09-12T16:18:24.403 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.452088977999999, 2024-09-12T16:18:24.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.046042315, 2024-09-12T16:18:24.404 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.404 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.404 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:24.404 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.404 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:24.404 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:24.404 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11275 2024-09-12T16:18:24.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.405 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.405 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.405 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883416+0000", 2024-09-12T16:18:24.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.406 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883416+0000", 2024-09-12T16:18:24.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.406 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883417+0000", 2024-09-12T16:18:24.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4700000000000001e-07 2024-09-12T16:18:24.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.407 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883419+0000", 2024-09-12T16:18:24.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2029999999999999e-06 2024-09-12T16:18:24.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.408 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.408 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883426+0000", 2024-09-12T16:18:24.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.579e-06 2024-09-12T16:18:24.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.408 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.408 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883431+0000", 2024-09-12T16:18:24.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5679999999999999e-06 2024-09-12T16:18:24.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929290+0000", 2024-09-12T16:18:24.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045858227000000001 2024-09-12T16:18:24.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:24.410 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929365+0000", 2024-09-12T16:18:24.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5519999999999995e-05 2024-09-12T16:18:24.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.410 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.410 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929459+0000", 2024-09-12T16:18:24.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3671000000000005e-05 2024-09-12T16:18:24.410 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.411 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.411 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.411 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11276 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3420160~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:24.411 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883439+0000", 2024-09-12T16:18:24.411 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.452066575, 2024-09-12T16:18:24.411 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.046138991999999997, 2024-09-12T16:18:24.412 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.412 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.412 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:24.412 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.412 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:24.412 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:24.412 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11276 2024-09-12T16:18:24.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.413 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883439+0000", 2024-09-12T16:18:24.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883439+0000", 2024-09-12T16:18:24.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883560+0000", 2024-09-12T16:18:24.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121229 2024-09-12T16:18:24.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.415 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883569+0000", 2024-09-12T16:18:24.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9390000000000003e-06 2024-09-12T16:18:24.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.416 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883579+0000", 2024-09-12T16:18:24.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8859999999999999e-06 2024-09-12T16:18:24.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.417 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.417 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883585+0000", 2024-09-12T16:18:24.417 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.545e-06 2024-09-12T16:18:24.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.417 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.417 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929486+0000", 2024-09-12T16:18:24.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045900653999999999 2024-09-12T16:18:24.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:24.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929527+0000", 2024-09-12T16:18:24.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0707999999999997e-05 2024-09-12T16:18:24.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.419 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929578+0000", 2024-09-12T16:18:24.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1031e-05 2024-09-12T16:18:24.419 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.419 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.419 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.420 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11277 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3469312~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:24.420 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883595+0000", 2024-09-12T16:18:24.420 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.451910231999999, 2024-09-12T16:18:24.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.046187702999999997, 2024-09-12T16:18:24.420 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.420 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.420 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:24.420 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.420 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:24.421 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:24.421 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11277 2024-09-12T16:18:24.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.421 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883595+0000", 2024-09-12T16:18:24.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.422 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.422 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883595+0000", 2024-09-12T16:18:24.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.423 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.423 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.889065+0000", 2024-09-12T16:18:24.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00547001 2024-09-12T16:18:24.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.423 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.423 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.889069+0000", 2024-09-12T16:18:24.424 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1180000000000002e-06 2024-09-12T16:18:24.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.424 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.424 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.889079+0000", 2024-09-12T16:18:24.424 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2250000000000006e-06 2024-09-12T16:18:24.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.889084+0000", 2024-09-12T16:18:24.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2680000000000002e-06 2024-09-12T16:18:24.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929612+0000", 2024-09-12T16:18:24.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040528343000000001 2024-09-12T16:18:24.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:24.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929691+0000", 2024-09-12T16:18:24.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8541999999999994e-05 2024-09-12T16:18:24.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929783+0000", 2024-09-12T16:18:24.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2196999999999998e-05 2024-09-12T16:18:24.427 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.427 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.427 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.428 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.428 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:27683 3.1 3.d6dd1621 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e127)", 2024-09-12T16:18:24.428 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:15.196201+0000", 2024-09-12T16:18:24.428 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1393045540000006, 2024-09-12T16:18:24.428 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.91402251499999998, 2024-09-12T16:18:24.428 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.429 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.429 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:18:24.429 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.429 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:18:24.429 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:18:24.429 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 27683 2024-09-12T16:18:24.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.430 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.430 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196201+0000", 2024-09-12T16:18:24.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.430 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196201+0000", 2024-09-12T16:18:24.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196202+0000", 2024-09-12T16:18:24.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4929999999999999e-06 2024-09-12T16:18:24.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196209+0000", 2024-09-12T16:18:24.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2269999999999998e-06 2024-09-12T16:18:24.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196221+0000", 2024-09-12T16:18:24.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2517000000000001e-05 2024-09-12T16:18:24.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196229+0000", 2024-09-12T16:18:24.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3250000000000008e-06 2024-09-12T16:18:24.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196293+0000", 2024-09-12T16:18:24.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3975999999999999e-05 2024-09-12T16:18:24.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T16:18:24.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196299+0000", 2024-09-12T16:18:24.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3000000000000001e-06 2024-09-12T16:18:24.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.434 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.434 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110210+0000", 2024-09-12T16:18:24.434 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.91391175099999999 2024-09-12T16:18:24.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.434 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.434 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110223+0000", 2024-09-12T16:18:24.434 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2926e-05 2024-09-12T16:18:24.434 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.434 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.434 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.435 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:27740 3.1 3.859365c1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e127)", 2024-09-12T16:18:24.435 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:15.209778+0000", 2024-09-12T16:18:24.435 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1257274250000009, 2024-09-12T16:18:24.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.90059554500000005, 2024-09-12T16:18:24.435 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.435 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.435 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:18:24.435 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.435 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:18:24.435 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:18:24.435 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 27740 2024-09-12T16:18:24.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.435 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209778+0000", 2024-09-12T16:18:24.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209778+0000", 2024-09-12T16:18:24.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209779+0000", 2024-09-12T16:18:24.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.274e-06 2024-09-12T16:18:24.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.437 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209785+0000", 2024-09-12T16:18:24.438 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3310000000000003e-06 2024-09-12T16:18:24.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.438 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.438 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209799+0000", 2024-09-12T16:18:24.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.448e-05 2024-09-12T16:18:24.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.439 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.439 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209806+0000", 2024-09-12T16:18:24.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3479999999999998e-06 2024-09-12T16:18:24.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.440 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.440 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209864+0000", 2024-09-12T16:18:24.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7395999999999997e-05 2024-09-12T16:18:24.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.441 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T16:18:24.441 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209871+0000", 2024-09-12T16:18:24.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1149999999999996e-06 2024-09-12T16:18:24.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.441 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.441 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110360+0000", 2024-09-12T16:18:24.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.90048930100000002 2024-09-12T16:18:24.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.442 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.442 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110374+0000", 2024-09-12T16:18:24.442 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.33e-05 2024-09-12T16:18:24.442 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.442 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.442 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.442 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:27742 3.1 3.d09829a1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e127)", 2024-09-12T16:18:24.442 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:15.210634+0000", 2024-09-12T16:18:24.442 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1248709290000001, 2024-09-12T16:18:24.442 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.89977736500000005, 2024-09-12T16:18:24.442 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.443 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.443 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:18:24.443 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.443 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:18:24.443 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:18:24.443 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 27742 2024-09-12T16:18:24.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.443 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.443 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.443 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210634+0000", 2024-09-12T16:18:24.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.444 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210634+0000", 2024-09-12T16:18:24.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.444 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210635+0000", 2024-09-12T16:18:24.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8100000000000001e-07 2024-09-12T16:18:24.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.445 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.445 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210641+0000", 2024-09-12T16:18:24.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.429e-06 2024-09-12T16:18:24.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.446 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.446 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210656+0000", 2024-09-12T16:18:24.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5557e-05 2024-09-12T16:18:24.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.446 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.447 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210663+0000", 2024-09-12T16:18:24.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5930000000000002e-06 2024-09-12T16:18:24.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.447 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.447 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210713+0000", 2024-09-12T16:18:24.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0488000000000002e-05 2024-09-12T16:18:24.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.448 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T16:18:24.448 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210722+0000", 2024-09-12T16:18:24.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0790000000000001e-06 2024-09-12T16:18:24.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.449 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.449 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110403+0000", 2024-09-12T16:18:24.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.89968195799999995 2024-09-12T16:18:24.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110412+0000", 2024-09-12T16:18:24.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3799999999999994e-06 2024-09-12T16:18:24.450 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.451 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.451 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.451 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:27745 3.1 3.36f5b621 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e127)", 2024-09-12T16:18:24.451 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:15.211355+0000", 2024-09-12T16:18:24.452 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1241503270000006, 2024-09-12T16:18:24.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.89909103999999995, 2024-09-12T16:18:24.452 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.452 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.452 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:18:24.453 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.453 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:18:24.453 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:18:24.453 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 27745 2024-09-12T16:18:24.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.453 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211355+0000", 2024-09-12T16:18:24.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211355+0000", 2024-09-12T16:18:24.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211356+0000", 2024-09-12T16:18:24.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9599999999999998e-07 2024-09-12T16:18:24.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211360+0000", 2024-09-12T16:18:24.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0419999999999996e-06 2024-09-12T16:18:24.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211373+0000", 2024-09-12T16:18:24.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3183000000000001e-05 2024-09-12T16:18:24.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211381+0000", 2024-09-12T16:18:24.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0499999999999992e-06 2024-09-12T16:18:24.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211438+0000", 2024-09-12T16:18:24.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6576999999999997e-05 2024-09-12T16:18:24.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.460 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T16:18:24.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211445+0000", 2024-09-12T16:18:24.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.391e-06 2024-09-12T16:18:24.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.461 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110437+0000", 2024-09-12T16:18:24.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.898991977 2024-09-12T16:18:24.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110446+0000", 2024-09-12T16:18:24.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0240000000000003e-06 2024-09-12T16:18:24.462 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.462 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.463 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.463 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.463 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.463 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:24.465 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:24.463+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:24.466 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:18:24.565 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:24.564+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:24.619 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:24.619 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:24.619 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:18:24.619 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:24.628 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:18:24.666 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:24.665+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:24.740 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:24.740 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:24.740 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:18:24.741 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:18:24.741 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:24.749 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:18:24.793 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:24.792+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:24.857 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:24.858 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:18:24.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:18:24.858 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:18:24.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.858 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2213 3.18 3:1944e921:::rbd_data.1155ccb1894c.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:18:24.858 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:18:24.858 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 87.480783330999998, 2024-09-12T16:18:24.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.055657836000000002, 2024-09-12T16:18:24.858 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.858 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.858 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:24.858 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.858 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:18:24.859 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:18:24.859 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2213 2024-09-12T16:18:24.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.859 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.859 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:18:24.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.859 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:18:24.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.860 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375351+0000", 2024-09-12T16:18:24.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.556e-06 2024-09-12T16:18:24.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.860 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.399989+0000", 2024-09-12T16:18:24.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024637949999999999 2024-09-12T16:18:24.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.860 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400038+0000", 2024-09-12T16:18:24.861 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9187999999999997e-05 2024-09-12T16:18:24.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.861 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.861 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400056+0000", 2024-09-12T16:18:24.861 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8451e-05 2024-09-12T16:18:24.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.861 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.861 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400151+0000", 2024-09-12T16:18:24.861 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5026999999999997e-05 2024-09-12T16:18:24.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.861 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:24.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400345+0000", 2024-09-12T16:18:24.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019352900000000001 2024-09-12T16:18:24.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 1", 2024-09-12T16:18:24.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.401319+0000", 2024-09-12T16:18:24.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00097419399999999995 2024-09-12T16:18:24.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:18:24.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.429350+0000", 2024-09-12T16:18:24.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028030607999999999 2024-09-12T16:18:24.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:24.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.430907+0000", 2024-09-12T16:18:24.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001557466 2024-09-12T16:18:24.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:18:24.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.430966+0000", 2024-09-12T16:18:24.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9437e-05 2024-09-12T16:18:24.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.431007+0000", 2024-09-12T16:18:24.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0429999999999997e-05 2024-09-12T16:18:24.864 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.864 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.864 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.864 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5632 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 585728~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:24.864 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556262+0000", 2024-09-12T16:18:24.864 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.299870275, 2024-09-12T16:18:24.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051267114000000003, 2024-09-12T16:18:24.864 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.864 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.864 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:24.864 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.864 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:24.864 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:24.865 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5632 2024-09-12T16:18:24.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.865 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556262+0000", 2024-09-12T16:18:24.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556262+0000", 2024-09-12T16:18:24.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556262+0000", 2024-09-12T16:18:24.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9999999999999998e-07 2024-09-12T16:18:24.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556269+0000", 2024-09-12T16:18:24.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4119999999999998e-06 2024-09-12T16:18:24.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556276+0000", 2024-09-12T16:18:24.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8549999999999996e-06 2024-09-12T16:18:24.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556281+0000", 2024-09-12T16:18:24.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1159999999999998e-06 2024-09-12T16:18:24.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607438+0000", 2024-09-12T16:18:24.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.05115695 2024-09-12T16:18:24.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:24.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607478+0000", 2024-09-12T16:18:24.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0535999999999999e-05 2024-09-12T16:18:24.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.868 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.868 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607529+0000", 2024-09-12T16:18:24.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0844999999999999e-05 2024-09-12T16:18:24.868 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.868 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.868 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.868 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5633 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 638976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:24.868 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556288+0000", 2024-09-12T16:18:24.868 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.299844242999999, 2024-09-12T16:18:24.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051384633999999998, 2024-09-12T16:18:24.868 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.868 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.869 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:24.869 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.869 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:24.869 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:24.869 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5633 2024-09-12T16:18:24.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.869 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.869 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.869 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556288+0000", 2024-09-12T16:18:24.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.869 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.870 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556288+0000", 2024-09-12T16:18:24.870 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.870 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556289+0000", 2024-09-12T16:18:24.870 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4000000000000002e-07 2024-09-12T16:18:24.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.870 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556291+0000", 2024-09-12T16:18:24.870 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0470000000000001e-06 2024-09-12T16:18:24.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556297+0000", 2024-09-12T16:18:24.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5080000000000002e-06 2024-09-12T16:18:24.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556302+0000", 2024-09-12T16:18:24.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2190000000000003e-06 2024-09-12T16:18:24.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607559+0000", 2024-09-12T16:18:24.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051256542000000002 2024-09-12T16:18:24.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:24.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607619+0000", 2024-09-12T16:18:24.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0538000000000002e-05 2024-09-12T16:18:24.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607673+0000", 2024-09-12T16:18:24.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3340000000000001e-05 2024-09-12T16:18:24.872 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.872 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.872 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.872 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5634 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 692224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:24.873 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556324+0000", 2024-09-12T16:18:24.873 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.299808553999998, 2024-09-12T16:18:24.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.05149252, 2024-09-12T16:18:24.873 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.873 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.873 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:24.873 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.873 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:24.873 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:24.873 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5634 2024-09-12T16:18:24.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.873 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556324+0000", 2024-09-12T16:18:24.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.874 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.874 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556324+0000", 2024-09-12T16:18:24.874 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.874 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.874 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556324+0000", 2024-09-12T16:18:24.874 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1900000000000002e-07 2024-09-12T16:18:24.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.874 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.874 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556327+0000", 2024-09-12T16:18:24.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T16:18:24.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.875 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556334+0000", 2024-09-12T16:18:24.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3919999999999997e-06 2024-09-12T16:18:24.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.875 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556341+0000", 2024-09-12T16:18:24.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6000000000000003e-06 2024-09-12T16:18:24.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.875 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607704+0000", 2024-09-12T16:18:24.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051363233000000001 2024-09-12T16:18:24.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.876 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:24.876 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607764+0000", 2024-09-12T16:18:24.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9871000000000003e-05 2024-09-12T16:18:24.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.876 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.876 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607816+0000", 2024-09-12T16:18:24.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2374999999999999e-05 2024-09-12T16:18:24.876 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.876 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.877 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.877 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5635 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 745472~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:24.877 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556348+0000", 2024-09-12T16:18:24.877 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.299783983000001, 2024-09-12T16:18:24.877 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051607838000000003, 2024-09-12T16:18:24.877 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.877 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.878 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:24.878 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.878 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:24.878 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:24.878 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5635 2024-09-12T16:18:24.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.878 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.878 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.878 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556348+0000", 2024-09-12T16:18:24.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.878 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556348+0000", 2024-09-12T16:18:24.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.879 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556349+0000", 2024-09-12T16:18:24.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.75e-07 2024-09-12T16:18:24.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.879 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556351+0000", 2024-09-12T16:18:24.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1890000000000001e-06 2024-09-12T16:18:24.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556358+0000", 2024-09-12T16:18:24.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.922e-06 2024-09-12T16:18:24.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556363+0000", 2024-09-12T16:18:24.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.242e-06 2024-09-12T16:18:24.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607846+0000", 2024-09-12T16:18:24.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051482433000000001 2024-09-12T16:18:24.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.881 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:24.881 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607886+0000", 2024-09-12T16:18:24.881 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0290999999999998e-05 2024-09-12T16:18:24.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.881 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.881 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607956+0000", 2024-09-12T16:18:24.881 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0285999999999998e-05 2024-09-12T16:18:24.881 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.881 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.881 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.882 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5636 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 806912~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:24.882 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556371+0000", 2024-09-12T16:18:24.882 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.299761804999999, 2024-09-12T16:18:24.882 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051725921000000001, 2024-09-12T16:18:24.882 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.882 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.882 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:24.882 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.882 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:24.882 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:24.882 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5636 2024-09-12T16:18:24.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.882 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.882 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.883 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556371+0000", 2024-09-12T16:18:24.883 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.883 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.883 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556371+0000", 2024-09-12T16:18:24.883 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.883 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.883 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556371+0000", 2024-09-12T16:18:24.883 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9800000000000004e-07 2024-09-12T16:18:24.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.884 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.884 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556373+0000", 2024-09-12T16:18:24.884 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0490000000000002e-06 2024-09-12T16:18:24.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.884 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.884 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556380+0000", 2024-09-12T16:18:24.884 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6050000000000003e-06 2024-09-12T16:18:24.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.884 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.884 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556385+0000", 2024-09-12T16:18:24.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2449999999999998e-06 2024-09-12T16:18:24.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.885 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607993+0000", 2024-09-12T16:18:24.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051608182000000002 2024-09-12T16:18:24.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.886 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:24.886 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608035+0000", 2024-09-12T16:18:24.886 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1698e-05 2024-09-12T16:18:24.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.886 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.886 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608096+0000", 2024-09-12T16:18:24.886 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1643999999999995e-05 2024-09-12T16:18:24.886 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.886 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.886 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.887 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5637 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 860160~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:24.887 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556393+0000", 2024-09-12T16:18:24.887 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.299739154000001, 2024-09-12T16:18:24.887 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051839035999999998, 2024-09-12T16:18:24.887 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.887 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.887 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:24.887 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.887 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:24.887 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:24.887 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5637 2024-09-12T16:18:24.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.887 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.887 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.888 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556393+0000", 2024-09-12T16:18:24.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.888 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.888 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556393+0000", 2024-09-12T16:18:24.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.888 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.888 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556394+0000", 2024-09-12T16:18:24.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3000000000000001e-07 2024-09-12T16:18:24.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556396+0000", 2024-09-12T16:18:24.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0839999999999999e-06 2024-09-12T16:18:24.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556402+0000", 2024-09-12T16:18:24.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6919999999999996e-06 2024-09-12T16:18:24.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556408+0000", 2024-09-12T16:18:24.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2800000000000003e-06 2024-09-12T16:18:24.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.890 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.890 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608129+0000", 2024-09-12T16:18:24.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051720902999999999 2024-09-12T16:18:24.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.890 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:24.890 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608174+0000", 2024-09-12T16:18:24.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5676000000000001e-05 2024-09-12T16:18:24.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.890 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.891 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608232+0000", 2024-09-12T16:18:24.891 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7970999999999998e-05 2024-09-12T16:18:24.891 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.891 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.891 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.891 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5638 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 913408~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:24.891 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556415+0000", 2024-09-12T16:18:24.891 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.29971776, 2024-09-12T16:18:24.891 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051949532999999999, 2024-09-12T16:18:24.891 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.891 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.892 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:24.892 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.892 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:24.892 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:24.892 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5638 2024-09-12T16:18:24.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.892 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.892 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.892 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556415+0000", 2024-09-12T16:18:24.892 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.892 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556415+0000", 2024-09-12T16:18:24.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.893 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556415+0000", 2024-09-12T16:18:24.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7199999999999999e-07 2024-09-12T16:18:24.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.893 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556417+0000", 2024-09-12T16:18:24.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0279999999999999e-06 2024-09-12T16:18:24.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.894 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.894 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556424+0000", 2024-09-12T16:18:24.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6950000000000003e-06 2024-09-12T16:18:24.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.894 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.894 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556429+0000", 2024-09-12T16:18:24.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3059999999999997e-06 2024-09-12T16:18:24.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.894 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.894 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608260+0000", 2024-09-12T16:18:24.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051831254 2024-09-12T16:18:24.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.895 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:24.895 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608306+0000", 2024-09-12T16:18:24.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5976999999999997e-05 2024-09-12T16:18:24.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.895 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.895 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608364+0000", 2024-09-12T16:18:24.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7800999999999998e-05 2024-09-12T16:18:24.895 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.895 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.895 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.896 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5639 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 966656~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:24.896 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556436+0000", 2024-09-12T16:18:24.896 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.299696087000001, 2024-09-12T16:18:24.896 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052070419, 2024-09-12T16:18:24.896 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.896 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.896 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:24.896 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.896 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:24.896 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:24.896 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5639 2024-09-12T16:18:24.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.896 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.897 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.897 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556436+0000", 2024-09-12T16:18:24.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.897 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.897 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556436+0000", 2024-09-12T16:18:24.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.897 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.897 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556437+0000", 2024-09-12T16:18:24.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1899999999999998e-07 2024-09-12T16:18:24.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556439+0000", 2024-09-12T16:18:24.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.973e-06 2024-09-12T16:18:24.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556445+0000", 2024-09-12T16:18:24.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7769999999999997e-06 2024-09-12T16:18:24.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556451+0000", 2024-09-12T16:18:24.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.31e-06 2024-09-12T16:18:24.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.899 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608397+0000", 2024-09-12T16:18:24.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051945829999999998 2024-09-12T16:18:24.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:24.899 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608438+0000", 2024-09-12T16:18:24.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1539000000000003e-05 2024-09-12T16:18:24.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.899 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608507+0000", 2024-09-12T16:18:24.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8571000000000005e-05 2024-09-12T16:18:24.899 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.900 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.900 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.900 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5640 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1019904~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:24.900 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556458+0000", 2024-09-12T16:18:24.900 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.299674575000001, 2024-09-12T16:18:24.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052171423000000001, 2024-09-12T16:18:24.900 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.900 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.900 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:24.900 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.901 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:24.901 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:24.901 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5640 2024-09-12T16:18:24.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.901 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.901 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.901 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556458+0000", 2024-09-12T16:18:24.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.901 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556458+0000", 2024-09-12T16:18:24.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556458+0000", 2024-09-12T16:18:24.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2500000000000001e-07 2024-09-12T16:18:24.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556460+0000", 2024-09-12T16:18:24.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.934e-06 2024-09-12T16:18:24.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556468+0000", 2024-09-12T16:18:24.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7950000000000008e-06 2024-09-12T16:18:24.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556473+0000", 2024-09-12T16:18:24.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3539999999999999e-06 2024-09-12T16:18:24.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608539+0000", 2024-09-12T16:18:24.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052065974000000001 2024-09-12T16:18:24.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:24.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608579+0000", 2024-09-12T16:18:24.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0238999999999999e-05 2024-09-12T16:18:24.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608629+0000", 2024-09-12T16:18:24.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9701999999999999e-05 2024-09-12T16:18:24.904 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.905 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.905 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.905 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5641 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1081344~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:24.905 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556480+0000", 2024-09-12T16:18:24.905 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.299651965999999, 2024-09-12T16:18:24.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052284826999999999, 2024-09-12T16:18:24.906 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.906 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.906 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:24.906 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.906 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:24.906 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:24.906 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5641 2024-09-12T16:18:24.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.906 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556480+0000", 2024-09-12T16:18:24.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556480+0000", 2024-09-12T16:18:24.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556481+0000", 2024-09-12T16:18:24.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.27e-07 2024-09-12T16:18:24.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556483+0000", 2024-09-12T16:18:24.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9379999999999999e-06 2024-09-12T16:18:24.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556489+0000", 2024-09-12T16:18:24.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5910000000000001e-06 2024-09-12T16:18:24.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556495+0000", 2024-09-12T16:18:24.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5600000000000001e-06 2024-09-12T16:18:24.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608659+0000", 2024-09-12T16:18:24.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052164489000000001 2024-09-12T16:18:24.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:24.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608714+0000", 2024-09-12T16:18:24.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4849999999999998e-05 2024-09-12T16:18:24.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.910 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608765+0000", 2024-09-12T16:18:24.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0971999999999999e-05 2024-09-12T16:18:24.910 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.910 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.910 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.910 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5642 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1134592~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:24.910 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556502+0000", 2024-09-12T16:18:24.910 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.299630070999999, 2024-09-12T16:18:24.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052404536000000002, 2024-09-12T16:18:24.910 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.910 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.910 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:24.911 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.911 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:24.911 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:24.911 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5642 2024-09-12T16:18:24.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.911 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556502+0000", 2024-09-12T16:18:24.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556502+0000", 2024-09-12T16:18:24.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556503+0000", 2024-09-12T16:18:24.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8599999999999998e-07 2024-09-12T16:18:24.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556505+0000", 2024-09-12T16:18:24.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.097e-06 2024-09-12T16:18:24.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.913 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556512+0000", 2024-09-12T16:18:24.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8229999999999997e-06 2024-09-12T16:18:24.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.913 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.913 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556517+0000", 2024-09-12T16:18:24.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6289999999999998e-06 2024-09-12T16:18:24.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.913 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.913 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608797+0000", 2024-09-12T16:18:24.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052279651000000003 2024-09-12T16:18:24.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.914 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:24.914 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608852+0000", 2024-09-12T16:18:24.914 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4994999999999998e-05 2024-09-12T16:18:24.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.914 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.914 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608907+0000", 2024-09-12T16:18:24.914 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4755e-05 2024-09-12T16:18:24.914 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.914 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.914 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.914 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5643 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1187840~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:24.915 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556525+0000", 2024-09-12T16:18:24.915 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.299607828999999, 2024-09-12T16:18:24.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052518288000000003, 2024-09-12T16:18:24.915 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.915 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.915 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:24.915 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.915 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:24.915 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:24.915 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5643 2024-09-12T16:18:24.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.915 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.915 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.915 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556525+0000", 2024-09-12T16:18:24.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556525+0000", 2024-09-12T16:18:24.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556525+0000", 2024-09-12T16:18:24.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0400000000000002e-07 2024-09-12T16:18:24.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556528+0000", 2024-09-12T16:18:24.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8679999999999999e-06 2024-09-12T16:18:24.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556536+0000", 2024-09-12T16:18:24.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3089999999999996e-06 2024-09-12T16:18:24.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556541+0000", 2024-09-12T16:18:24.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3120000000000001e-06 2024-09-12T16:18:24.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608943+0000", 2024-09-12T16:18:24.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052401089999999997 2024-09-12T16:18:24.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:24.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608991+0000", 2024-09-12T16:18:24.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8633e-05 2024-09-12T16:18:24.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609043+0000", 2024-09-12T16:18:24.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1672000000000003e-05 2024-09-12T16:18:24.918 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.919 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.919 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.919 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5644 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1241088~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:24.919 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556548+0000", 2024-09-12T16:18:24.919 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.299584295999999, 2024-09-12T16:18:24.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052634777000000001, 2024-09-12T16:18:24.919 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.919 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.919 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:24.919 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.919 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:24.919 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:24.920 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5644 2024-09-12T16:18:24.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.920 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556548+0000", 2024-09-12T16:18:24.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556548+0000", 2024-09-12T16:18:24.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556549+0000", 2024-09-12T16:18:24.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1900000000000003e-07 2024-09-12T16:18:24.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556555+0000", 2024-09-12T16:18:24.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.652e-06 2024-09-12T16:18:24.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556562+0000", 2024-09-12T16:18:24.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.905e-06 2024-09-12T16:18:24.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556567+0000", 2024-09-12T16:18:24.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1730000000000003e-06 2024-09-12T16:18:24.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609079+0000", 2024-09-12T16:18:24.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052511993 2024-09-12T16:18:24.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:24.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609125+0000", 2024-09-12T16:18:24.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5327000000000002e-05 2024-09-12T16:18:24.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609183+0000", 2024-09-12T16:18:24.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8208000000000002e-05 2024-09-12T16:18:24.923 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.923 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.923 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.923 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5645 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1294336~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:24.923 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556574+0000", 2024-09-12T16:18:24.923 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.299557898, 2024-09-12T16:18:24.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052876909999999999, 2024-09-12T16:18:24.923 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.923 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.924 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:24.924 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.924 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:24.924 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:24.924 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5645 2024-09-12T16:18:24.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.924 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.924 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.924 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556574+0000", 2024-09-12T16:18:24.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.924 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.924 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556574+0000", 2024-09-12T16:18:24.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556575+0000", 2024-09-12T16:18:24.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.89e-07 2024-09-12T16:18:24.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556577+0000", 2024-09-12T16:18:24.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8700000000000001e-06 2024-09-12T16:18:24.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556583+0000", 2024-09-12T16:18:24.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4320000000000004e-06 2024-09-12T16:18:24.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556589+0000", 2024-09-12T16:18:24.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3890000000000004e-06 2024-09-12T16:18:24.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609236+0000", 2024-09-12T16:18:24.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052647022000000002 2024-09-12T16:18:24.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:24.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609334+0000", 2024-09-12T16:18:24.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8039000000000001e-05 2024-09-12T16:18:24.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609451+0000", 2024-09-12T16:18:24.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117769 2024-09-12T16:18:24.927 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.928 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.928 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.928 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5646 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1355776~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:24.928 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556595+0000", 2024-09-12T16:18:24.928 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.299536917000001, 2024-09-12T16:18:24.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053088173000000002, 2024-09-12T16:18:24.929 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.929 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.929 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:24.929 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.929 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:24.929 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:24.929 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5646 2024-09-12T16:18:24.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.930 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556595+0000", 2024-09-12T16:18:24.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556595+0000", 2024-09-12T16:18:24.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.931 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556596+0000", 2024-09-12T16:18:24.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:18:24.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556598+0000", 2024-09-12T16:18:24.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0669999999999999e-06 2024-09-12T16:18:24.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.932 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556603+0000", 2024-09-12T16:18:24.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5210000000000002e-06 2024-09-12T16:18:24.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.932 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556609+0000", 2024-09-12T16:18:24.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1590000000000001e-06 2024-09-12T16:18:24.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609499+0000", 2024-09-12T16:18:24.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052890489999999998 2024-09-12T16:18:24.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:24.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609586+0000", 2024-09-12T16:18:24.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6681999999999994e-05 2024-09-12T16:18:24.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609684+0000", 2024-09-12T16:18:24.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7863999999999997e-05 2024-09-12T16:18:24.933 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.934 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.934 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.934 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5647 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1409024~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:24.934 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556616+0000", 2024-09-12T16:18:24.934 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.299516621999999, 2024-09-12T16:18:24.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053207888000000002, 2024-09-12T16:18:24.934 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.934 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.934 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:24.934 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.934 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:24.934 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:24.935 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5647 2024-09-12T16:18:24.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.935 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.936 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.936 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556616+0000", 2024-09-12T16:18:24.936 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.936 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.936 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556616+0000", 2024-09-12T16:18:24.936 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.936 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.937 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556616+0000", 2024-09-12T16:18:24.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3599999999999999e-07 2024-09-12T16:18:24.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.937 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556618+0000", 2024-09-12T16:18:24.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1550000000000001e-06 2024-09-12T16:18:24.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.937 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556624+0000", 2024-09-12T16:18:24.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0499999999999997e-06 2024-09-12T16:18:24.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556629+0000", 2024-09-12T16:18:24.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8840000000000002e-06 2024-09-12T16:18:24.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609721+0000", 2024-09-12T16:18:24.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053091808999999997 2024-09-12T16:18:24.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:24.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609767+0000", 2024-09-12T16:18:24.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.638e-05 2024-09-12T16:18:24.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609824+0000", 2024-09-12T16:18:24.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6174000000000001e-05 2024-09-12T16:18:24.939 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.939 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.939 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.939 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5648 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1462272~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:24.939 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556636+0000", 2024-09-12T16:18:24.939 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.299495962999998, 2024-09-12T16:18:24.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053322131000000002, 2024-09-12T16:18:24.940 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.940 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.940 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:24.940 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.940 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:24.940 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:24.940 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5648 2024-09-12T16:18:24.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.941 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.941 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556636+0000", 2024-09-12T16:18:24.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.941 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556636+0000", 2024-09-12T16:18:24.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.941 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.942 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557015+0000", 2024-09-12T16:18:24.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000378911 2024-09-12T16:18:24.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.942 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.942 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557019+0000", 2024-09-12T16:18:24.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2100000000000002e-06 2024-09-12T16:18:24.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.942 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.942 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557030+0000", 2024-09-12T16:18:24.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.149e-05 2024-09-12T16:18:24.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.942 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.943 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557037+0000", 2024-09-12T16:18:24.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5719999999999999e-06 2024-09-12T16:18:24.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.943 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609838+0000", 2024-09-12T16:18:24.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052801305999999999 2024-09-12T16:18:24.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:24.943 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609880+0000", 2024-09-12T16:18:24.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2604000000000001e-05 2024-09-12T16:18:24.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609959+0000", 2024-09-12T16:18:24.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8038000000000001e-05 2024-09-12T16:18:24.944 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.944 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.944 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.944 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5649 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1515520~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:24.944 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.557073+0000", 2024-09-12T16:18:24.944 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.299058962, 2024-09-12T16:18:24.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053030573999999997, 2024-09-12T16:18:24.944 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.944 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.945 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:24.945 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.945 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:24.945 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:24.945 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5649 2024-09-12T16:18:24.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.945 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557073+0000", 2024-09-12T16:18:24.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557073+0000", 2024-09-12T16:18:24.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557074+0000", 2024-09-12T16:18:24.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5199999999999996e-07 2024-09-12T16:18:24.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557084+0000", 2024-09-12T16:18:24.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0349e-05 2024-09-12T16:18:24.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557092+0000", 2024-09-12T16:18:24.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9699999999999999e-06 2024-09-12T16:18:24.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557100+0000", 2024-09-12T16:18:24.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7049999999999999e-06 2024-09-12T16:18:24.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609992+0000", 2024-09-12T16:18:24.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052891821999999998 2024-09-12T16:18:24.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:24.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610034+0000", 2024-09-12T16:18:24.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2141000000000002e-05 2024-09-12T16:18:24.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.949 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610104+0000", 2024-09-12T16:18:24.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9935e-05 2024-09-12T16:18:24.949 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.949 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.950 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.950 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5650 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1568768~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:24.950 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.557111+0000", 2024-09-12T16:18:24.950 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.299021740000001, 2024-09-12T16:18:24.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053118023, 2024-09-12T16:18:24.950 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:24.950 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:24.951 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:24.951 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:24.951 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:24.951 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:24.951 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5650 2024-09-12T16:18:24.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.951 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:24.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:24.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557111+0000", 2024-09-12T16:18:24.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:24.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557111+0000", 2024-09-12T16:18:24.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:24.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:24.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.562089+0000", 2024-09-12T16:18:24.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0049787410000000001 2024-09-12T16:18:24.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:24.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.562094+0000", 2024-09-12T16:18:24.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7210000000000002e-06 2024-09-12T16:18:24.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:24.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.562105+0000", 2024-09-12T16:18:24.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0458999999999999e-05 2024-09-12T16:18:24.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:24.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.562112+0000", 2024-09-12T16:18:24.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0280000000000003e-06 2024-09-12T16:18:24.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:24.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610135+0000", 2024-09-12T16:18:24.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048023374000000001 2024-09-12T16:18:24.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:24.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610177+0000", 2024-09-12T16:18:24.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2119000000000001e-05 2024-09-12T16:18:24.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:24.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:24.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:24.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610229+0000", 2024-09-12T16:18:24.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1581e-05 2024-09-12T16:18:24.955 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.955 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.955 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.955 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:24.955 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:24.955 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:24.956 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:18:24.957 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:24.955+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:25.035 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T16:18:25.077 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:25.077 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:25.078 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:18:25.078 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:25.079 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:25.078+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:25.089 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:18:25.158 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:25.157+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:25.209 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:25.210 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:25.210 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:18:25.210 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:18:25.210 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:25.219 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:18:25.263 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:25.262+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:25.329 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:25.329 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:18:25.329 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:18:25.329 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:18:25.329 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.329 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:18:25.330 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:18:25.330 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 163.563024426, 2024-09-12T16:18:25.330 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55645454900000002, 2024-09-12T16:18:25.330 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:25.330 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:25.330 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:25.330 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:25.330 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:18:25.330 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:18:25.330 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1 2024-09-12T16:18:25.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.330 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:25.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.330 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:25.331 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:18:25.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:25.331 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:18:25.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:25.331 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764440+0000", 2024-09-12T16:18:25.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6249999999999999e-06 2024-09-12T16:18:25.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:25.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764447+0000", 2024-09-12T16:18:25.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4939999999999997e-06 2024-09-12T16:18:25.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:25.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764459+0000", 2024-09-12T16:18:25.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1517e-05 2024-09-12T16:18:25.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:25.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764468+0000", 2024-09-12T16:18:25.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7690000000000002e-06 2024-09-12T16:18:25.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:25.333 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764539+0000", 2024-09-12T16:18:25.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1103e-05 2024-09-12T16:18:25.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:25.333 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764551+0000", 2024-09-12T16:18:25.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2687999999999999e-05 2024-09-12T16:18:25.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:25.333 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319497+0000", 2024-09-12T16:18:25.334 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55494560500000001 2024-09-12T16:18:25.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.334 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.334 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:25.334 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319688+0000", 2024-09-12T16:18:25.334 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019105599999999999 2024-09-12T16:18:25.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.334 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.334 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:18:25.334 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319842+0000", 2024-09-12T16:18:25.334 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015377699999999999 2024-09-12T16:18:25.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.334 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.334 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:18:25.335 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320473+0000", 2024-09-12T16:18:25.335 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00063117100000000003 2024-09-12T16:18:25.335 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.335 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.335 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:25.335 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320825+0000", 2024-09-12T16:18:25.335 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00035202500000000001 2024-09-12T16:18:25.335 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.335 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.335 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:25.335 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320867+0000", 2024-09-12T16:18:25.335 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2005000000000002e-05 2024-09-12T16:18:25.335 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.335 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.336 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:25.336 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320893+0000", 2024-09-12T16:18:25.336 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5714000000000001e-05 2024-09-12T16:18:25.336 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.336 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:25.336 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.336 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.336 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14034 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5035008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:25.336 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:18:25.336 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 125.805966193, 2024-09-12T16:18:25.336 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053404082999999998, 2024-09-12T16:18:25.336 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:25.336 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:25.337 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:25.337 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:25.337 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:25.337 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:25.337 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14034 2024-09-12T16:18:25.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.337 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:25.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.337 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:25.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:18:25.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.338 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:25.338 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:18:25.338 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.338 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.338 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.338 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:25.338 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521740+0000", 2024-09-12T16:18:25.338 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000243976 2024-09-12T16:18:25.338 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.338 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.338 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:25.338 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521745+0000", 2024-09-12T16:18:25.338 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1280000000000001e-06 2024-09-12T16:18:25.338 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.339 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.339 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:25.339 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521757+0000", 2024-09-12T16:18:25.339 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2751e-05 2024-09-12T16:18:25.339 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.339 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.339 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:25.339 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521771+0000", 2024-09-12T16:18:25.339 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3328e-05 2024-09-12T16:18:25.339 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.339 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.339 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:25.339 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574710+0000", 2024-09-12T16:18:25.339 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052939358999999998 2024-09-12T16:18:25.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.340 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.340 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:25.340 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574799+0000", 2024-09-12T16:18:25.340 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8893000000000004e-05 2024-09-12T16:18:25.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.340 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.340 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:25.340 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574901+0000", 2024-09-12T16:18:25.340 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101648 2024-09-12T16:18:25.340 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.341 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:25.341 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.341 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.341 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14036 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5043200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:25.342 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:18:25.342 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 125.805506999, 2024-09-12T16:18:25.342 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053426247000000003, 2024-09-12T16:18:25.342 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:25.342 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:25.343 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:25.343 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:25.343 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:25.343 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:25.343 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14036 2024-09-12T16:18:25.343 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.343 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:25.343 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.343 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:25.343 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:18:25.343 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.344 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.344 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:25.344 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:18:25.344 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.344 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.344 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:25.344 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522208+0000", 2024-09-12T16:18:25.344 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025195300000000002 2024-09-12T16:18:25.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.344 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.344 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:25.344 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522211+0000", 2024-09-12T16:18:25.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2160000000000002e-06 2024-09-12T16:18:25.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.345 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.345 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:25.345 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522223+0000", 2024-09-12T16:18:25.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2044e-05 2024-09-12T16:18:25.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.345 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.345 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:25.345 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522229+0000", 2024-09-12T16:18:25.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8850000000000004e-06 2024-09-12T16:18:25.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.345 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.345 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:25.345 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575192+0000", 2024-09-12T16:18:25.346 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052963573 2024-09-12T16:18:25.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.346 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:25.346 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575282+0000", 2024-09-12T16:18:25.346 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9666000000000005e-05 2024-09-12T16:18:25.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.346 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:25.346 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575382+0000", 2024-09-12T16:18:25.346 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9909999999999997e-05 2024-09-12T16:18:25.346 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.346 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:25.347 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.347 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.347 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.347 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14039 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5055488~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:25.347 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:18:25.347 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 125.804827215, 2024-09-12T16:18:25.347 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053466207000000002, 2024-09-12T16:18:25.347 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:25.347 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:25.347 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:25.347 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:25.347 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:25.347 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:25.347 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14039 2024-09-12T16:18:25.348 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.348 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:25.348 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.348 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:25.348 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:18:25.348 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.348 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.348 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.348 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:25.348 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:18:25.348 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.348 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.349 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.349 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:25.349 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522899+0000", 2024-09-12T16:18:25.349 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026318199999999999 2024-09-12T16:18:25.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.349 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.349 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:25.349 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522903+0000", 2024-09-12T16:18:25.349 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.929e-06 2024-09-12T16:18:25.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.349 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.349 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:25.349 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522913+0000", 2024-09-12T16:18:25.349 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0162e-05 2024-09-12T16:18:25.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:25.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522921+0000", 2024-09-12T16:18:25.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.14e-06 2024-09-12T16:18:25.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:25.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575922+0000", 2024-09-12T16:18:25.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053000712999999998 2024-09-12T16:18:25.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:25.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576006+0000", 2024-09-12T16:18:25.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4161999999999998e-05 2024-09-12T16:18:25.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.351 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:25.351 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576102+0000", 2024-09-12T16:18:25.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5919000000000001e-05 2024-09-12T16:18:25.351 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.351 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:25.351 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.351 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14040 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5059584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:25.351 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:18:25.351 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 125.80452232, 2024-09-12T16:18:25.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053413258999999998, 2024-09-12T16:18:25.352 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:25.352 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:25.352 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:25.352 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:25.352 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:25.352 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:25.352 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14040 2024-09-12T16:18:25.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.352 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:25.352 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.352 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:25.352 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:18:25.352 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.353 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.353 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:25.353 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:18:25.353 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.353 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.353 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:25.353 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523059+0000", 2024-09-12T16:18:25.353 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118466 2024-09-12T16:18:25.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.353 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.353 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:25.353 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523062+0000", 2024-09-12T16:18:25.353 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.971e-06 2024-09-12T16:18:25.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.354 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:25.354 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523069+0000", 2024-09-12T16:18:25.354 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8279999999999997e-06 2024-09-12T16:18:25.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.354 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:25.354 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523073+0000", 2024-09-12T16:18:25.354 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3019999999999996e-06 2024-09-12T16:18:25.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.354 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:25.355 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576155+0000", 2024-09-12T16:18:25.355 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053081962000000003 2024-09-12T16:18:25.355 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.355 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.355 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:25.355 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576249+0000", 2024-09-12T16:18:25.355 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3914999999999998e-05 2024-09-12T16:18:25.355 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.355 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.355 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:25.355 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576354+0000", 2024-09-12T16:18:25.355 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010481500000000001 2024-09-12T16:18:25.355 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.355 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:25.356 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.356 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.356 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14041 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5063680~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:25.356 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:18:25.356 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 125.804372015, 2024-09-12T16:18:25.356 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053519111000000001, 2024-09-12T16:18:25.356 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:25.356 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:25.356 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:25.356 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:25.356 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:25.356 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:25.357 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14041 2024-09-12T16:18:25.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.357 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:25.357 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.357 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:25.357 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:18:25.357 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.357 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.357 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:25.357 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:18:25.357 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.358 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.358 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:25.358 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523309+0000", 2024-09-12T16:18:25.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000218712 2024-09-12T16:18:25.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.358 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.358 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:25.358 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523313+0000", 2024-09-12T16:18:25.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.151e-06 2024-09-12T16:18:25.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.358 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.358 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:25.358 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523320+0000", 2024-09-12T16:18:25.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9789999999999993e-06 2024-09-12T16:18:25.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.359 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:25.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523325+0000", 2024-09-12T16:18:25.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:18:25.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.359 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:25.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576402+0000", 2024-09-12T16:18:25.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053076811000000002 2024-09-12T16:18:25.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.359 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:25.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576491+0000", 2024-09-12T16:18:25.360 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8578999999999993e-05 2024-09-12T16:18:25.360 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.360 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.360 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:25.360 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576610+0000", 2024-09-12T16:18:25.360 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119129 2024-09-12T16:18:25.360 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.360 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:25.360 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.360 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.360 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.360 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14042 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5067776~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:25.360 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:18:25.360 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 125.804128581, 2024-09-12T16:18:25.360 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053510350999999998, 2024-09-12T16:18:25.361 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:25.361 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:25.361 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:25.361 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:25.361 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:25.361 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:25.361 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14042 2024-09-12T16:18:25.361 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.361 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:25.361 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.361 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:25.361 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:18:25.361 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.361 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.362 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.362 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:25.362 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:18:25.362 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.362 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.362 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.362 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:25.362 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523591+0000", 2024-09-12T16:18:25.362 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025710300000000001 2024-09-12T16:18:25.362 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.362 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.362 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:25.362 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523594+0000", 2024-09-12T16:18:25.362 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2229999999999999e-06 2024-09-12T16:18:25.362 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.363 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.363 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:25.363 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523602+0000", 2024-09-12T16:18:25.363 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6930000000000007e-06 2024-09-12T16:18:25.363 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.363 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.363 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:25.363 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523607+0000", 2024-09-12T16:18:25.363 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4789999999999998e-06 2024-09-12T16:18:25.363 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.363 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.363 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:25.363 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576661+0000", 2024-09-12T16:18:25.363 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053973999999997 2024-09-12T16:18:25.363 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.363 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.364 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:25.364 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576745+0000", 2024-09-12T16:18:25.364 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4660000000000006e-05 2024-09-12T16:18:25.364 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.364 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.364 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:25.364 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576844+0000", 2024-09-12T16:18:25.364 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9219e-05 2024-09-12T16:18:25.364 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.364 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:25.364 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.364 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.364 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.364 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14043 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5071872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:25.365 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:18:25.365 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 125.803848102, 2024-09-12T16:18:25.365 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053475295999999999, 2024-09-12T16:18:25.365 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:25.365 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:25.365 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:25.365 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:25.365 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:25.365 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:25.365 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14043 2024-09-12T16:18:25.365 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.365 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:25.365 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.365 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:25.366 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:18:25.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.366 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.366 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:25.366 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:18:25.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.366 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.366 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:25.366 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523823+0000", 2024-09-12T16:18:25.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020818900000000001 2024-09-12T16:18:25.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.366 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.366 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:25.367 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523826+0000", 2024-09-12T16:18:25.367 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.405e-06 2024-09-12T16:18:25.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.367 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.367 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:25.367 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523834+0000", 2024-09-12T16:18:25.367 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5499999999999997e-06 2024-09-12T16:18:25.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.367 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.367 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:25.367 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523838+0000", 2024-09-12T16:18:25.367 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.408e-06 2024-09-12T16:18:25.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.367 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.368 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:25.368 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576904+0000", 2024-09-12T16:18:25.368 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053065687 2024-09-12T16:18:25.368 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.368 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.368 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:25.368 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576991+0000", 2024-09-12T16:18:25.368 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7399999999999997e-05 2024-09-12T16:18:25.368 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.368 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.368 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:25.368 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577090+0000", 2024-09-12T16:18:25.368 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8657000000000001e-05 2024-09-12T16:18:25.368 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.369 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:25.369 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.369 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.369 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.369 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14044 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5075968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:25.369 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:18:25.369 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 125.803616572, 2024-09-12T16:18:25.369 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053442659000000003, 2024-09-12T16:18:25.369 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:25.369 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:25.369 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:25.369 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:25.369 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:25.369 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:25.369 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14044 2024-09-12T16:18:25.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.370 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:25.370 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.370 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:25.370 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:18:25.370 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.370 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.370 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:25.370 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:18:25.370 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.370 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.370 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:25.370 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523985+0000", 2024-09-12T16:18:25.370 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000138522 2024-09-12T16:18:25.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.371 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.371 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:25.371 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523988+0000", 2024-09-12T16:18:25.371 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.788e-06 2024-09-12T16:18:25.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.371 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.371 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:25.371 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523998+0000", 2024-09-12T16:18:25.371 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8470000000000008e-06 2024-09-12T16:18:25.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.371 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.371 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:25.371 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524010+0000", 2024-09-12T16:18:25.371 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1348999999999999e-05 2024-09-12T16:18:25.372 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.372 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.372 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:25.372 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577137+0000", 2024-09-12T16:18:25.372 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053127055999999999 2024-09-12T16:18:25.372 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.372 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.372 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:25.372 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577210+0000", 2024-09-12T16:18:25.372 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3392000000000005e-05 2024-09-12T16:18:25.372 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.372 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.372 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:25.372 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577289+0000", 2024-09-12T16:18:25.373 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8704999999999999e-05 2024-09-12T16:18:25.373 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.373 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:25.373 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.373 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.373 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.373 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14045 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5080064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:25.373 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:18:25.373 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 125.803437751, 2024-09-12T16:18:25.373 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053497514000000003, 2024-09-12T16:18:25.373 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:25.373 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:25.373 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:25.373 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:25.374 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:25.374 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:25.374 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14045 2024-09-12T16:18:25.374 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.374 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:25.375 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.375 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:25.375 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:18:25.375 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.375 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.375 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.376 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:25.376 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:18:25.376 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.376 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.376 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.376 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:25.377 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524311+0000", 2024-09-12T16:18:25.377 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028626299999999998 2024-09-12T16:18:25.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.377 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.377 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:25.377 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524315+0000", 2024-09-12T16:18:25.377 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0969999999999999e-06 2024-09-12T16:18:25.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.377 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.377 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:25.377 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524325+0000", 2024-09-12T16:18:25.377 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6330000000000008e-06 2024-09-12T16:18:25.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.378 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.378 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:25.378 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524332+0000", 2024-09-12T16:18:25.378 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8700000000000003e-06 2024-09-12T16:18:25.378 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.378 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.378 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:25.378 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577334+0000", 2024-09-12T16:18:25.378 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053001834999999997 2024-09-12T16:18:25.378 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.378 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.378 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:25.378 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577420+0000", 2024-09-12T16:18:25.378 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6145999999999998e-05 2024-09-12T16:18:25.379 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.379 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.379 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:25.379 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577522+0000", 2024-09-12T16:18:25.379 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010267 2024-09-12T16:18:25.379 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.379 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:25.379 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.379 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.379 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.379 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14047 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5088256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:25.379 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:18:25.379 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 125.802952025, 2024-09-12T16:18:25.380 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053433340000000003, 2024-09-12T16:18:25.380 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:25.380 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:25.380 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:25.380 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:25.380 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:25.380 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:25.380 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14047 2024-09-12T16:18:25.381 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.381 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:25.381 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.381 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:25.381 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:18:25.381 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.381 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.381 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.381 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:25.381 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:18:25.381 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.381 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.382 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.382 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:25.382 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524727+0000", 2024-09-12T16:18:25.382 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000216126 2024-09-12T16:18:25.382 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.382 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.382 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:25.382 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524732+0000", 2024-09-12T16:18:25.382 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1569999999999999e-06 2024-09-12T16:18:25.382 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.382 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.382 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:25.382 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524742+0000", 2024-09-12T16:18:25.382 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0186999999999999e-05 2024-09-12T16:18:25.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.383 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.383 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:25.383 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524750+0000", 2024-09-12T16:18:25.383 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4279999999999999e-06 2024-09-12T16:18:25.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.383 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.383 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:25.383 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577743+0000", 2024-09-12T16:18:25.383 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052993077 2024-09-12T16:18:25.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.383 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.384 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:25.384 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577841+0000", 2024-09-12T16:18:25.384 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8369000000000006e-05 2024-09-12T16:18:25.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.384 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:25.384 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577944+0000", 2024-09-12T16:18:25.384 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102996 2024-09-12T16:18:25.384 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.384 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:25.384 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.385 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14048 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5092352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:25.385 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:18:25.385 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 125.80270043199999, 2024-09-12T16:18:25.385 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053397515, 2024-09-12T16:18:25.385 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:25.385 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:25.385 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:25.385 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:25.385 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:25.385 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:25.385 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14048 2024-09-12T16:18:25.385 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.386 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:25.386 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.386 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:25.386 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:18:25.386 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.386 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.386 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:25.386 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:18:25.386 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.386 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.386 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:25.387 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524957+0000", 2024-09-12T16:18:25.387 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019516999999999999 2024-09-12T16:18:25.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.387 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.387 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:25.387 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524962+0000", 2024-09-12T16:18:25.387 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7709999999999997e-06 2024-09-12T16:18:25.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.388 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:25.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524973+0000", 2024-09-12T16:18:25.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1031e-05 2024-09-12T16:18:25.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.388 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:25.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524980+0000", 2024-09-12T16:18:25.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6100000000000002e-06 2024-09-12T16:18:25.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.388 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:25.389 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577977+0000", 2024-09-12T16:18:25.389 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052997481999999999 2024-09-12T16:18:25.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.389 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.389 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:25.389 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578062+0000", 2024-09-12T16:18:25.389 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4851000000000005e-05 2024-09-12T16:18:25.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.389 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.389 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:25.389 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578160+0000", 2024-09-12T16:18:25.389 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7600000000000001e-05 2024-09-12T16:18:25.389 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.389 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:25.390 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.390 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.390 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14049 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5096448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:25.390 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:18:25.390 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 125.80247180400001, 2024-09-12T16:18:25.390 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053439792, 2024-09-12T16:18:25.390 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:25.390 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:25.390 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:25.390 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:25.390 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:25.390 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:25.390 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14049 2024-09-12T16:18:25.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.391 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:25.391 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.391 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:25.391 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:18:25.391 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.391 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.391 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:25.391 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:18:25.391 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.391 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.391 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:25.391 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525170+0000", 2024-09-12T16:18:25.391 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017958500000000001 2024-09-12T16:18:25.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.392 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.392 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:25.392 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525174+0000", 2024-09-12T16:18:25.392 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0239999999999999e-06 2024-09-12T16:18:25.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.392 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.392 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:25.392 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525184+0000", 2024-09-12T16:18:25.392 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5950000000000005e-06 2024-09-12T16:18:25.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.392 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.392 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:25.392 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525191+0000", 2024-09-12T16:18:25.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8329999999999996e-06 2024-09-12T16:18:25.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.393 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:25.393 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578240+0000", 2024-09-12T16:18:25.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053049236 2024-09-12T16:18:25.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.393 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:25.393 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578333+0000", 2024-09-12T16:18:25.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2806999999999994e-05 2024-09-12T16:18:25.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:25.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578431+0000", 2024-09-12T16:18:25.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7712000000000002e-05 2024-09-12T16:18:25.395 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.395 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:25.395 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.395 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.395 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.395 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14055 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5121024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:25.395 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:18:25.395 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 125.801201113, 2024-09-12T16:18:25.396 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053399038000000003, 2024-09-12T16:18:25.396 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:25.396 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:25.396 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:25.396 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:25.396 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:25.396 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:25.396 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14055 2024-09-12T16:18:25.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.396 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:25.396 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.396 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:25.396 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:18:25.396 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.397 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.397 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:25.397 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:18:25.397 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.397 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.397 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:25.397 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526403+0000", 2024-09-12T16:18:25.397 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141571 2024-09-12T16:18:25.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.397 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.397 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:25.398 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526406+0000", 2024-09-12T16:18:25.398 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2660000000000002e-06 2024-09-12T16:18:25.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.398 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:25.398 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526420+0000", 2024-09-12T16:18:25.398 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3949e-05 2024-09-12T16:18:25.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.398 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:25.398 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526428+0000", 2024-09-12T16:18:25.398 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4250000000000001e-06 2024-09-12T16:18:25.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.399 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:25.399 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579476+0000", 2024-09-12T16:18:25.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053048349000000002 2024-09-12T16:18:25.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.399 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.399 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:25.399 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579563+0000", 2024-09-12T16:18:25.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6502999999999995e-05 2024-09-12T16:18:25.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.399 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.399 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:25.399 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579661+0000", 2024-09-12T16:18:25.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7974999999999996e-05 2024-09-12T16:18:25.399 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.400 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:25.400 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.400 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.400 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.400 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4806.0:3139 3.1e 3:78d5a095:::rbd_data.11552a37e55b.0000000000000000:head [read 69632~61440] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:18:25.400 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:18:25.400 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 115.026206863, 2024-09-12T16:18:25.400 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057851734000000002, 2024-09-12T16:18:25.400 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:25.400 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:25.401 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:25.401 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:25.401 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4806", 2024-09-12T16:18:25.401 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3959815836", 2024-09-12T16:18:25.401 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 3139 2024-09-12T16:18:25.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.401 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:25.401 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.401 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:25.401 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:18:25.401 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.401 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.401 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:25.402 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:18:25.402 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.402 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:25.402 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:18:25.402 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4799999999999999e-07 2024-09-12T16:18:25.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.402 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:25.402 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301258+0000", 2024-09-12T16:18:25.402 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.844e-06 2024-09-12T16:18:25.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.403 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:25.403 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301267+0000", 2024-09-12T16:18:25.403 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2960000000000004e-06 2024-09-12T16:18:25.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.403 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.403 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:25.403 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301276+0000", 2024-09-12T16:18:25.403 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0650000000000005e-06 2024-09-12T16:18:25.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.403 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.403 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:25.403 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301871+0000", 2024-09-12T16:18:25.403 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00059423600000000005 2024-09-12T16:18:25.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.403 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.404 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:25.404 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301920+0000", 2024-09-12T16:18:25.404 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9067000000000003e-05 2024-09-12T16:18:25.404 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.404 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.404 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:25.404 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359108+0000", 2024-09-12T16:18:25.404 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057187877999999998 2024-09-12T16:18:25.404 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.404 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:25.404 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.404 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.404 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.404 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:6428 3.14 3:28a44e54:::rbd_header.11552a37e55b:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:18:25.405 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:18:25.405 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 115.025878269, 2024-09-12T16:18:25.405 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057504023000000001, 2024-09-12T16:18:25.405 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:25.405 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:25.405 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:25.405 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:25.405 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:18:25.405 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:18:25.405 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6428 2024-09-12T16:18:25.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.405 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:25.405 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:25.406 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:18:25.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:25.406 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:18:25.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:25.406 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301585+0000", 2024-09-12T16:18:25.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6300000000000005e-07 2024-09-12T16:18:25.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.407 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:25.407 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301588+0000", 2024-09-12T16:18:25.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4149999999999999e-06 2024-09-12T16:18:25.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.407 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:25.407 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301597+0000", 2024-09-12T16:18:25.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5450000000000003e-06 2024-09-12T16:18:25.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.407 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:25.407 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301617+0000", 2024-09-12T16:18:25.408 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9837e-05 2024-09-12T16:18:25.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.408 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.408 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:25.408 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301779+0000", 2024-09-12T16:18:25.408 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016186799999999999 2024-09-12T16:18:25.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.408 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.408 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:25.408 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301855+0000", 2024-09-12T16:18:25.408 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5899e-05 2024-09-12T16:18:25.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.409 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.409 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:25.409 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359088+0000", 2024-09-12T16:18:25.409 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057233895999999999 2024-09-12T16:18:25.409 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.409 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:25.409 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.409 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.409 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.409 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5223.0:1814 3.f 3:f7b1b1c5:::rbd_object_map.1155a1fd27d2:head [read 0~136] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-12T16:18:25.409 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:18:25.409 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 79.090212205, 2024-09-12T16:18:25.409 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.006378226, 2024-09-12T16:18:25.409 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:25.410 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:25.410 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:25.410 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:25.410 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5223", 2024-09-12T16:18:25.410 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/4066330994", 2024-09-12T16:18:25.410 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1814 2024-09-12T16:18:25.410 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.410 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:25.410 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.410 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:25.410 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:18:25.410 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.410 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.411 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.411 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:25.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:18:25.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.411 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.411 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:25.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237252+0000", 2024-09-12T16:18:25.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.344e-06 2024-09-12T16:18:25.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.411 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.411 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:25.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237258+0000", 2024-09-12T16:18:25.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1070000000000001e-06 2024-09-12T16:18:25.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.412 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:25.412 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237270+0000", 2024-09-12T16:18:25.412 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1758e-05 2024-09-12T16:18:25.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.412 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:25.412 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237278+0000", 2024-09-12T16:18:25.412 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3219999999999993e-06 2024-09-12T16:18:25.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.412 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:25.413 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237334+0000", 2024-09-12T16:18:25.413 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6356e-05 2024-09-12T16:18:25.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.413 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:25.413 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237345+0000", 2024-09-12T16:18:25.413 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0433e-05 2024-09-12T16:18:25.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.413 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:25.413 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243426+0000", 2024-09-12T16:18:25.413 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.00608133 2024-09-12T16:18:25.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.414 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.414 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:25.414 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243534+0000", 2024-09-12T16:18:25.414 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010784 2024-09-12T16:18:25.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.414 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.414 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:25.414 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243629+0000", 2024-09-12T16:18:25.414 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4735999999999996e-05 2024-09-12T16:18:25.414 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.414 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:25.414 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.414 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.415 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5328.0:2542 3.16 3:6928f3a1:::rbd_object_map.11551722dd77:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:18:25.415 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:18:25.415 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 73.271866775000007, 2024-09-12T16:18:25.415 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.054219934999999997, 2024-09-12T16:18:25.415 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:25.415 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:25.415 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:25.415 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:25.415 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5328", 2024-09-12T16:18:25.415 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:18:25.415 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2542 2024-09-12T16:18:25.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.415 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:25.415 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.416 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:25.416 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:18:25.416 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.416 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.416 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.416 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:25.416 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:18:25.416 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.416 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.416 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.416 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:25.416 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055597+0000", 2024-09-12T16:18:25.416 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4300000000000001e-07 2024-09-12T16:18:25.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.417 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.417 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:25.417 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055602+0000", 2024-09-12T16:18:25.417 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4269999999999999e-06 2024-09-12T16:18:25.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.417 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.417 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:25.417 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055613+0000", 2024-09-12T16:18:25.417 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0815000000000001e-05 2024-09-12T16:18:25.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.417 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.417 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:25.417 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055621+0000", 2024-09-12T16:18:25.418 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4189999999999996e-06 2024-09-12T16:18:25.418 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.418 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.418 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:25.418 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102196+0000", 2024-09-12T16:18:25.418 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.046575616 2024-09-12T16:18:25.418 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.418 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.418 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:25.418 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102258+0000", 2024-09-12T16:18:25.418 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1872000000000007e-05 2024-09-12T16:18:25.418 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.418 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.418 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T16:18:25.419 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102601+0000", 2024-09-12T16:18:25.419 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034285700000000001 2024-09-12T16:18:25.419 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.419 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.419 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:25.419 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.104431+0000", 2024-09-12T16:18:25.419 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001830524 2024-09-12T16:18:25.419 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.419 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.419 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:18:25.419 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109733+0000", 2024-09-12T16:18:25.419 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0053020089999999999 2024-09-12T16:18:25.419 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.420 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.420 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:25.420 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109777+0000", 2024-09-12T16:18:25.420 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3754000000000002e-05 2024-09-12T16:18:25.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.420 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.420 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:25.420 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109816+0000", 2024-09-12T16:18:25.420 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8699000000000003e-05 2024-09-12T16:18:25.420 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.420 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:25.420 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.421 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.421 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5328.0:2543 3.16 3:6928f3a1:::rbd_object_map.11551722dd77:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:18:25.421 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:18:25.421 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 73.271272796000005, 2024-09-12T16:18:25.421 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053695720000000002, 2024-09-12T16:18:25.421 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:25.421 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:25.421 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:25.421 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:25.421 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5328", 2024-09-12T16:18:25.421 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:18:25.421 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2543 2024-09-12T16:18:25.421 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.421 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:25.422 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.422 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:25.422 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:18:25.422 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.422 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.422 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:25.422 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:18:25.422 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.422 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.422 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:25.422 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056191+0000", 2024-09-12T16:18:25.422 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.54e-07 2024-09-12T16:18:25.423 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.423 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.423 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:25.423 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056195+0000", 2024-09-12T16:18:25.423 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5460000000000002e-06 2024-09-12T16:18:25.423 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.423 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.423 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:25.423 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056205+0000", 2024-09-12T16:18:25.423 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7350000000000008e-06 2024-09-12T16:18:25.423 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.423 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.423 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:25.424 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056214+0000", 2024-09-12T16:18:25.424 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8089999999999999e-06 2024-09-12T16:18:25.424 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.424 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.424 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:25.424 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103317+0000", 2024-09-12T16:18:25.424 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.047102889000000002 2024-09-12T16:18:25.424 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.424 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.424 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:25.424 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103410+0000", 2024-09-12T16:18:25.424 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3689000000000004e-05 2024-09-12T16:18:25.424 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.424 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.425 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T16:18:25.425 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103754+0000", 2024-09-12T16:18:25.425 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034344699999999998 2024-09-12T16:18:25.425 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.425 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.425 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:25.425 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.106487+0000", 2024-09-12T16:18:25.425 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0027330100000000001 2024-09-12T16:18:25.425 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.425 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.425 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:18:25.425 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109827+0000", 2024-09-12T16:18:25.425 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033406640000000001 2024-09-12T16:18:25.426 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.426 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.426 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:25.426 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109854+0000", 2024-09-12T16:18:25.426 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6866999999999999e-05 2024-09-12T16:18:25.426 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.426 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.426 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:25.426 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109886+0000", 2024-09-12T16:18:25.426 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1309999999999997e-05 2024-09-12T16:18:25.426 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.426 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:25.426 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.426 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.427 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.427 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5832.0:1710 3.f 3:f0d97d21:::rbd_data.1155d3b3a2ae.0000000000000012:head [truncate 1376256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-12T16:18:25.427 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:18:25.427 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 37.943474711, 2024-09-12T16:18:25.427 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6441524489999999, 2024-09-12T16:18:25.427 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:25.427 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:25.427 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:25.427 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:25.427 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5832", 2024-09-12T16:18:25.427 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/201125203", 2024-09-12T16:18:25.427 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1710 2024-09-12T16:18:25.428 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.428 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:25.428 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.428 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:25.428 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:18:25.428 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.428 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.428 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.428 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:25.428 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:18:25.428 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.428 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.428 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.429 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:25.429 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:18:25.429 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.08e-07 2024-09-12T16:18:25.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.429 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.429 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:25.429 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383990+0000", 2024-09-12T16:18:25.429 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.979e-06 2024-09-12T16:18:25.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.429 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.429 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:25.429 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383999+0000", 2024-09-12T16:18:25.429 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3240000000000003e-06 2024-09-12T16:18:25.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.430 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.430 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:25.430 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.384002+0000", 2024-09-12T16:18:25.430 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5489999999999998e-06 2024-09-12T16:18:25.430 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.430 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.430 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:25.430 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.384037+0000", 2024-09-12T16:18:25.430 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4931000000000001e-05 2024-09-12T16:18:25.430 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.430 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.430 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:25.430 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.384043+0000", 2024-09-12T16:18:25.430 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3920000000000002e-06 2024-09-12T16:18:25.431 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.431 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.431 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:25.431 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:48.007976+0000", 2024-09-12T16:18:25.431 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.62393385300000004 2024-09-12T16:18:25.431 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.431 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.431 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:25.431 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:48.007992+0000", 2024-09-12T16:18:25.431 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5668e-05 2024-09-12T16:18:25.431 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.431 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.431 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:25.431 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024187+0000", 2024-09-12T16:18:25.432 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0161951629999999 2024-09-12T16:18:25.432 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.432 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.432 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:25.432 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024362+0000", 2024-09-12T16:18:25.432 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017500600000000001 2024-09-12T16:18:25.432 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.432 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.432 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:18:25.432 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024453+0000", 2024-09-12T16:18:25.432 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1055000000000001e-05 2024-09-12T16:18:25.432 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.432 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.432 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:18:25.433 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024963+0000", 2024-09-12T16:18:25.433 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000510087 2024-09-12T16:18:25.433 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.433 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.433 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:25.433 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.027974+0000", 2024-09-12T16:18:25.433 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030107070000000001 2024-09-12T16:18:25.433 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.433 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.433 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:25.433 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.028022+0000", 2024-09-12T16:18:25.433 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7636000000000003e-05 2024-09-12T16:18:25.433 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.434 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.434 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:25.434 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.028140+0000", 2024-09-12T16:18:25.434 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011869100000000001 2024-09-12T16:18:25.434 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.434 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:25.434 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.434 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.434 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:25.434 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:25.436 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:18:25.436 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:25.434+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:25.536 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:25.535+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:25.584 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:25.584 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:18:25.584 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.584 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:28648 3.1d 3.d6e4301d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-12T16:18:25.584 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:25.241792+0000", 2024-09-12T16:18:25.585 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.34226149900000002, 2024-09-12T16:18:25.585 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.34227801899999999, 2024-09-12T16:18:25.585 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:25.585 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:25.585 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "waiting for peered", 2024-09-12T16:18:25.585 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:25.585 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:18:25.585 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:18:25.585 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 28648 2024-09-12T16:18:25.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.585 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:25.585 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.585 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:25.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.241792+0000", 2024-09-12T16:18:25.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:25.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.241792+0000", 2024-09-12T16:18:25.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:25.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:25.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.241794+0000", 2024-09-12T16:18:25.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.066e-06 2024-09-12T16:18:25.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:25.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.241799+0000", 2024-09-12T16:18:25.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2100000000000001e-06 2024-09-12T16:18:25.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:25.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.241814+0000", 2024-09-12T16:18:25.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4885000000000001e-05 2024-09-12T16:18:25.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:25.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.241822+0000", 2024-09-12T16:18:25.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9000000000000006e-06 2024-09-12T16:18:25.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.588 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:25.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.241885+0000", 2024-09-12T16:18:25.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3323000000000003e-05 2024-09-12T16:18:25.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:25.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:25.588 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:25.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.241894+0000", 2024-09-12T16:18:25.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1200000000000008e-06 2024-09-12T16:18:25.588 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.588 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:25.589 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.589 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:25.589 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-12T16:18:25.589 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 1 2024-09-12T16:18:25.589 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:25.592 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:18:25.641 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T16:18:25.676 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:25.675+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:25.737 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:25.736+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:25.740 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:25.740 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:25.740 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:18:25.740 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:18:25.740 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:25.749 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:18:25.765 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:18:25.766 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:18:25.783 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:18:25.783 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:18:25.799 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:18:25.799 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:18:25.816 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:18:25.816 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:18:25.832 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:18:25.833 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:18:25.838 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:25.837+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:25.849 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:18:25.850 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:18:25.896 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:25.896 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:25.904 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:18:25.939 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:25.938+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:26.040 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:26.039+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:26.052 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:26.052 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:26.061 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:18:26.140 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:26.139+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:26.141 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-12T16:18:26.146 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 3, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-12T16:18:26.146 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T16:18:26.147 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-12T16:18:26.147 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T16:18:26.176 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:26.176 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:26.185 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:18:26.271 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:26.268+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:26.333 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:26.333 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:26.342 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:26.340+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:26.342 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:18:26.443 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:26.442+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:26.449 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:26.450 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:26.455 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:18:26.455 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:26.456 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 138, 2024-09-12T16:18:26.456 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "66dcb8ed-8de5-4784-8071-fd6b3bf3b78f", 2024-09-12T16:18:26.456 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2024-09-12T16:15:28.208893+0000", 2024-09-12T16:18:26.456 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2024-09-12T16:18:26.140159+0000", 2024-09-12T16:18:26.456 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2024-09-12T16:17:03.223056+0000", 2024-09-12T16:18:26.456 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2024-09-12T16:18:21.117144+0000", 2024-09-12T16:18:26.456 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T16:18:26.456 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5804032, 2024-09-12T16:18:26.456 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2024-09-12T16:18:26.456 INFO:teuthology.orchestra.run.smithi017.stdout: "nodeep-scrub", 2024-09-12T16:18:26.456 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2024-09-12T16:18:26.457 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2024-09-12T16:18:26.457 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2024-09-12T16:18:26.457 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2024-09-12T16:18:26.457 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-12T16:18:26.457 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 5, 2024-09-12T16:18:26.457 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T16:18:26.457 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T16:18:26.457 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T16:18:26.457 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2024-09-12T16:18:26.457 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 3, 2024-09-12T16:18:26.457 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 6, 2024-09-12T16:18:26.457 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2024-09-12T16:18:26.457 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "luminous", 2024-09-12T16:18:26.458 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "squid", 2024-09-12T16:18:26.458 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2024-09-12T16:18:26.458 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2024-09-12T16:18:26.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.458 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2024-09-12T16:18:26.458 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2024-09-12T16:18:26.458 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2024-09-12T16:15:40.677216+0000", 2024-09-12T16:18:26.458 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-12T16:18:26.458 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2024-09-12T16:18:26.458 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2024-09-12T16:18:26.458 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2024-09-12T16:18:26.458 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2024-09-12T16:18:26.459 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2024-09-12T16:18:26.459 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2024-09-12T16:18:26.459 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2024-09-12T16:18:26.459 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T16:18:26.459 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T16:18:26.459 INFO:teuthology.orchestra.run.smithi017.stdout: "is_stretch_pool": false, 2024-09-12T16:18:26.459 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2024-09-12T16:18:26.459 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2024-09-12T16:18:26.459 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2024-09-12T16:18:26.459 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2024-09-12T16:18:26.459 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2024-09-12T16:18:26.459 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2024-09-12T16:18:26.459 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2024-09-12T16:18:26.460 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2024-09-12T16:18:26.460 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2024-09-12T16:18:26.460 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2024-09-12T16:18:26.460 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2024-09-12T16:18:26.460 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2024-09-12T16:18:26.460 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2024-09-12T16:18:26.460 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2024-09-12T16:18:26.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.460 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "15", 2024-09-12T16:18:26.460 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2024-09-12T16:18:26.460 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T16:18:26.460 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T16:18:26.460 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2024-09-12T16:18:26.461 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2024-09-12T16:18:26.461 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2024-09-12T16:18:26.461 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2024-09-12T16:18:26.461 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2024-09-12T16:18:26.461 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2024-09-12T16:18:26.461 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2024-09-12T16:18:26.461 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2024-09-12T16:18:26.461 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2024-09-12T16:18:26.461 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2024-09-12T16:18:26.461 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2024-09-12T16:18:26.461 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2024-09-12T16:18:26.461 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2024-09-12T16:18:26.461 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2024-09-12T16:18:26.462 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2024-09-12T16:18:26.462 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T16:18:26.462 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T16:18:26.462 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T16:18:26.462 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2024-09-12T16:18:26.462 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2024-09-12T16:18:26.462 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2024-09-12T16:18:26.462 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2024-09-12T16:18:26.462 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2024-09-12T16:18:26.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.462 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2024-09-12T16:18:26.462 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2024-09-12T16:18:26.462 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2024-09-12T16:18:26.462 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2024-09-12T16:18:26.463 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2024-09-12T16:18:26.463 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T16:18:26.463 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2024-09-12T16:18:26.463 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2024-09-12T16:18:26.463 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2024-09-12T16:18:26.463 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2024-09-12T16:18:26.463 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2024-09-12T16:18:26.463 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2024-09-12T16:18:26.463 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2024-09-12T16:18:26.463 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2024-09-12T16:18:26.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.463 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2024-09-12T16:18:26.463 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2024-09-12T16:18:26.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.464 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2024-09-12T16:18:26.464 INFO:teuthology.orchestra.run.smithi017.stdout: "score_type": "Fair distribution", 2024-09-12T16:18:26.464 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 6.059999942779541, 2024-09-12T16:18:26.464 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 6.059999942779541, 2024-09-12T16:18:26.464 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.33000001311302185, 2024-09-12T16:18:26.464 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2024-09-12T16:18:26.464 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2024-09-12T16:18:26.464 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 0.84821069240570068, 2024-09-12T16:18:26.464 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 0.85000002384185791, 2024-09-12T16:18:26.464 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 0.85000002384185791 2024-09-12T16:18:26.464 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:26.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.465 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2024-09-12T16:18:26.465 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2024-09-12T16:18:26.465 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2024-09-12T16:15:45.306180+0000", 2024-09-12T16:18:26.465 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 8193, 2024-09-12T16:18:26.465 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T16:18:26.465 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2024-09-12T16:18:26.465 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2024-09-12T16:18:26.465 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2024-09-12T16:18:26.465 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2024-09-12T16:18:26.465 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2024-09-12T16:18:26.465 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2024-09-12T16:18:26.465 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T16:18:26.465 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T16:18:26.466 INFO:teuthology.orchestra.run.smithi017.stdout: "is_stretch_pool": false, 2024-09-12T16:18:26.466 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2024-09-12T16:18:26.466 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2024-09-12T16:18:26.466 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2024-09-12T16:18:26.466 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2024-09-12T16:18:26.466 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2024-09-12T16:18:26.466 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2024-09-12T16:18:26.466 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2024-09-12T16:18:26.466 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2024-09-12T16:18:26.466 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2024-09-12T16:18:26.466 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2024-09-12T16:18:26.466 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2024-09-12T16:18:26.467 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2024-09-12T16:18:26.467 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2024-09-12T16:18:26.467 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2024-09-12T16:18:26.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.467 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "19", 2024-09-12T16:18:26.467 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2024-09-12T16:18:26.467 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T16:18:26.467 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T16:18:26.467 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2024-09-12T16:18:26.467 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2024-09-12T16:18:26.467 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 2, 2024-09-12T16:18:26.467 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 19, 2024-09-12T16:18:26.467 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2024-09-12T16:18:26.468 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2024-09-12T16:18:26.468 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2024-09-12T16:18:26.468 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2024-09-12T16:18:26.468 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2024-09-12T16:18:26.468 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2024-09-12T16:18:26.468 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2024-09-12T16:18:26.468 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2024-09-12T16:18:26.468 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2024-09-12T16:18:26.468 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2024-09-12T16:18:26.468 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2024-09-12T16:18:26.468 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T16:18:26.468 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T16:18:26.468 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T16:18:26.469 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2024-09-12T16:18:26.469 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2024-09-12T16:18:26.469 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2024-09-12T16:18:26.469 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2024-09-12T16:18:26.469 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2024-09-12T16:18:26.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.469 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2024-09-12T16:18:26.469 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2024-09-12T16:18:26.469 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2024-09-12T16:18:26.469 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2024-09-12T16:18:26.469 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2024-09-12T16:18:26.469 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T16:18:26.469 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2024-09-12T16:18:26.470 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2024-09-12T16:18:26.470 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2024-09-12T16:18:26.470 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2024-09-12T16:18:26.470 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2024-09-12T16:18:26.470 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2024-09-12T16:18:26.470 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2024-09-12T16:18:26.470 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2024-09-12T16:18:26.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.470 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2024-09-12T16:18:26.470 INFO:teuthology.orchestra.run.smithi017.stdout: "score_type": "Fair distribution", 2024-09-12T16:18:26.470 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 2.25, 2024-09-12T16:18:26.470 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 2.25, 2024-09-12T16:18:26.470 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2024-09-12T16:18:26.470 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2.25, 2024-09-12T16:18:26.470 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2.25, 2024-09-12T16:18:26.471 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 0.84821069240570068, 2024-09-12T16:18:26.471 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 0.85000002384185791, 2024-09-12T16:18:26.471 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 0.85000002384185791 2024-09-12T16:18:26.471 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:26.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.471 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 3, 2024-09-12T16:18:26.471 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "pool_client.0", 2024-09-12T16:18:26.471 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2024-09-12T16:15:55.082975+0000", 2024-09-12T16:18:26.471 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 8193, 2024-09-12T16:18:26.471 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T16:18:26.471 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2024-09-12T16:18:26.471 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2024-09-12T16:18:26.471 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2024-09-12T16:18:26.472 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2024-09-12T16:18:26.472 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2024-09-12T16:18:26.472 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2024-09-12T16:18:26.472 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T16:18:26.472 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T16:18:26.472 INFO:teuthology.orchestra.run.smithi017.stdout: "is_stretch_pool": false, 2024-09-12T16:18:26.472 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2024-09-12T16:18:26.472 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2024-09-12T16:18:26.472 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2024-09-12T16:18:26.472 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2024-09-12T16:18:26.472 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2024-09-12T16:18:26.472 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2024-09-12T16:18:26.472 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2024-09-12T16:18:26.472 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2024-09-12T16:18:26.473 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2024-09-12T16:18:26.473 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2024-09-12T16:18:26.473 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2024-09-12T16:18:26.473 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2024-09-12T16:18:26.473 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2024-09-12T16:18:26.473 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2024-09-12T16:18:26.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.473 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "136", 2024-09-12T16:18:26.473 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2024-09-12T16:18:26.473 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T16:18:26.473 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T16:18:26.473 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2024-09-12T16:18:26.473 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2024-09-12T16:18:26.474 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 43, 2024-09-12T16:18:26.474 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 136, 2024-09-12T16:18:26.474 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2024-09-12T16:18:26.474 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2024-09-12T16:18:26.474 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2024-09-12T16:18:26.474 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2024-09-12T16:18:26.474 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2024-09-12T16:18:26.474 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2024-09-12T16:18:26.474 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2024-09-12T16:18:26.474 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2024-09-12T16:18:26.474 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2024-09-12T16:18:26.474 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2024-09-12T16:18:26.474 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2024-09-12T16:18:26.475 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T16:18:26.475 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T16:18:26.475 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T16:18:26.475 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2024-09-12T16:18:26.475 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2024-09-12T16:18:26.475 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2024-09-12T16:18:26.475 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2024-09-12T16:18:26.475 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2024-09-12T16:18:26.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.475 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2024-09-12T16:18:26.475 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2024-09-12T16:18:26.475 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2024-09-12T16:18:26.475 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2024-09-12T16:18:26.476 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2024-09-12T16:18:26.476 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T16:18:26.476 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2024-09-12T16:18:26.476 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2024-09-12T16:18:26.476 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2024-09-12T16:18:26.476 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2024-09-12T16:18:26.476 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2024-09-12T16:18:26.476 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2024-09-12T16:18:26.476 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2024-09-12T16:18:26.476 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2024-09-12T16:18:26.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.476 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2024-09-12T16:18:26.476 INFO:teuthology.orchestra.run.smithi017.stdout: "score_type": "Fair distribution", 2024-09-12T16:18:26.477 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.5, 2024-09-12T16:18:26.477 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.5, 2024-09-12T16:18:26.477 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2024-09-12T16:18:26.477 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.5, 2024-09-12T16:18:26.477 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.5, 2024-09-12T16:18:26.477 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 0.84821069240570068, 2024-09-12T16:18:26.477 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 0.85000002384185791, 2024-09-12T16:18:26.477 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 0.85000002384185791 2024-09-12T16:18:26.477 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:26.477 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:26.477 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-12T16:18:26.477 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2024-09-12T16:18:26.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.478 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2024-09-12T16:18:26.478 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "aabea24b-3f1f-4555-80c3-5caecf2e2001", 2024-09-12T16:18:26.478 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-12T16:18:26.478 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-12T16:18:26.478 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-12T16:18:26.478 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-12T16:18:26.478 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-12T16:18:26.478 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-12T16:18:26.478 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 11, 2024-09-12T16:18:26.478 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 137, 2024-09-12T16:18:26.478 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-12T16:18:26.478 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-12T16:18:26.478 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-12T16:18:26.478 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:26.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.479 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:26.479 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2024-09-12T16:18:26.479 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1385915755 2024-09-12T16:18:26.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.479 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:26.479 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2024-09-12T16:18:26.479 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1385915755 2024-09-12T16:18:26.479 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:26.479 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:26.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.479 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-12T16:18:26.479 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:26.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.480 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:26.480 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2024-09-12T16:18:26.480 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1385915755 2024-09-12T16:18:26.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.480 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:26.480 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2024-09-12T16:18:26.480 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1385915755 2024-09-12T16:18:26.480 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:26.480 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:26.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.480 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-12T16:18:26.480 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:26.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.481 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:26.481 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2024-09-12T16:18:26.481 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1385915755 2024-09-12T16:18:26.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.481 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:26.481 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2024-09-12T16:18:26.481 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1385915755 2024-09-12T16:18:26.481 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:26.481 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:26.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.481 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-12T16:18:26.481 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:26.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.482 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:26.482 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2024-09-12T16:18:26.482 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1385915755 2024-09-12T16:18:26.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.482 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:26.482 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2024-09-12T16:18:26.482 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1385915755 2024-09-12T16:18:26.482 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:26.482 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:26.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.482 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1385915755", 2024-09-12T16:18:26.482 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1385915755", 2024-09-12T16:18:26.482 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1385915755", 2024-09-12T16:18:26.482 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1385915755", 2024-09-12T16:18:26.483 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-12T16:18:26.483 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-12T16:18:26.483 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-12T16:18:26.483 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:26.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.483 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.483 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2024-09-12T16:18:26.483 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "7a17ca3b-8e49-4d92-a633-45d3e4a45b4e", 2024-09-12T16:18:26.483 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-12T16:18:26.483 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-12T16:18:26.483 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-12T16:18:26.483 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-12T16:18:26.483 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-12T16:18:26.483 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-12T16:18:26.484 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 11, 2024-09-12T16:18:26.484 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 136, 2024-09-12T16:18:26.484 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-12T16:18:26.484 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-12T16:18:26.484 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-12T16:18:26.484 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:26.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.484 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:26.484 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2024-09-12T16:18:26.484 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3906173234 2024-09-12T16:18:26.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.484 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:26.485 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2024-09-12T16:18:26.485 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3906173234 2024-09-12T16:18:26.485 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:26.485 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:26.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.485 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-12T16:18:26.485 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:26.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.485 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:26.485 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2024-09-12T16:18:26.485 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3906173234 2024-09-12T16:18:26.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.485 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:26.485 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2024-09-12T16:18:26.486 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3906173234 2024-09-12T16:18:26.486 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:26.486 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:26.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.486 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-12T16:18:26.486 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:26.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.486 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:26.486 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2024-09-12T16:18:26.486 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3906173234 2024-09-12T16:18:26.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.486 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:26.486 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2024-09-12T16:18:26.486 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3906173234 2024-09-12T16:18:26.487 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:26.487 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:26.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.487 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-12T16:18:26.487 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:26.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.487 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:26.487 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2024-09-12T16:18:26.487 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3906173234 2024-09-12T16:18:26.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.487 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:26.487 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2024-09-12T16:18:26.488 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3906173234 2024-09-12T16:18:26.488 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:26.488 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:26.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.488 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/3906173234", 2024-09-12T16:18:26.488 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/3906173234", 2024-09-12T16:18:26.488 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/3906173234", 2024-09-12T16:18:26.488 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/3906173234", 2024-09-12T16:18:26.488 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-12T16:18:26.488 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-12T16:18:26.489 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-12T16:18:26.489 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:26.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.489 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2024-09-12T16:18:26.489 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "dae09a32-24c6-464c-bee8-04ef2c42f7e4", 2024-09-12T16:18:26.489 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-12T16:18:26.489 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-12T16:18:26.489 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-12T16:18:26.489 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-12T16:18:26.489 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-12T16:18:26.489 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-12T16:18:26.489 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 11, 2024-09-12T16:18:26.490 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 136, 2024-09-12T16:18:26.490 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-12T16:18:26.490 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-12T16:18:26.490 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-12T16:18:26.490 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:26.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.490 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:26.490 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2024-09-12T16:18:26.490 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1974346628 2024-09-12T16:18:26.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.490 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:26.490 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2024-09-12T16:18:26.490 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1974346628 2024-09-12T16:18:26.491 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:26.491 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:26.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.491 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-12T16:18:26.491 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:26.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.491 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:26.491 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2024-09-12T16:18:26.491 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1974346628 2024-09-12T16:18:26.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.491 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:26.491 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2024-09-12T16:18:26.491 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1974346628 2024-09-12T16:18:26.492 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:26.492 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:26.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.492 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-12T16:18:26.492 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:26.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.492 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:26.492 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2024-09-12T16:18:26.492 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1974346628 2024-09-12T16:18:26.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.492 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:26.492 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2024-09-12T16:18:26.493 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1974346628 2024-09-12T16:18:26.493 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:26.493 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:26.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.493 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-12T16:18:26.493 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:26.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.493 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:26.493 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2024-09-12T16:18:26.493 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1974346628 2024-09-12T16:18:26.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.493 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:26.493 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2024-09-12T16:18:26.494 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1974346628 2024-09-12T16:18:26.494 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:26.494 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:26.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.494 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/1974346628", 2024-09-12T16:18:26.494 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/1974346628", 2024-09-12T16:18:26.494 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/1974346628", 2024-09-12T16:18:26.494 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/1974346628", 2024-09-12T16:18:26.494 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-12T16:18:26.494 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-12T16:18:26.494 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-12T16:18:26.494 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:26.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.495 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2024-09-12T16:18:26.495 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "9cc5463c-cdb4-4a6a-b526-39a60de417f4", 2024-09-12T16:18:26.495 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-12T16:18:26.495 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-12T16:18:26.495 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-12T16:18:26.495 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-12T16:18:26.495 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-12T16:18:26.495 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-12T16:18:26.495 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 11, 2024-09-12T16:18:26.495 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 137, 2024-09-12T16:18:26.495 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-12T16:18:26.495 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-12T16:18:26.496 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-12T16:18:26.496 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:26.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.496 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:26.496 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6808", 2024-09-12T16:18:26.496 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3370202675 2024-09-12T16:18:26.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.496 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:26.496 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6809", 2024-09-12T16:18:26.496 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3370202675 2024-09-12T16:18:26.496 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:26.496 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:26.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.497 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-12T16:18:26.497 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:26.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.497 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:26.497 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6810", 2024-09-12T16:18:26.497 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3370202675 2024-09-12T16:18:26.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.497 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:26.497 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6811", 2024-09-12T16:18:26.497 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3370202675 2024-09-12T16:18:26.497 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:26.498 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:26.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.498 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-12T16:18:26.498 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:26.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.498 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:26.498 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6814", 2024-09-12T16:18:26.498 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3370202675 2024-09-12T16:18:26.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.498 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:26.498 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6815", 2024-09-12T16:18:26.498 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3370202675 2024-09-12T16:18:26.498 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:26.499 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:26.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.499 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-12T16:18:26.499 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:26.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.499 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:26.499 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6812", 2024-09-12T16:18:26.499 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3370202675 2024-09-12T16:18:26.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.499 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:26.499 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6813", 2024-09-12T16:18:26.499 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3370202675 2024-09-12T16:18:26.499 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:26.499 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:26.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.500 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.47:6809/3370202675", 2024-09-12T16:18:26.500 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.47:6811/3370202675", 2024-09-12T16:18:26.500 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.47:6815/3370202675", 2024-09-12T16:18:26.500 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.47:6813/3370202675", 2024-09-12T16:18:26.500 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-12T16:18:26.500 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-12T16:18:26.500 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-12T16:18:26.500 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:26.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.501 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2024-09-12T16:18:26.501 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "1e329af3-a88a-4a95-b822-01519079084b", 2024-09-12T16:18:26.501 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-12T16:18:26.501 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-12T16:18:26.501 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-12T16:18:26.501 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-12T16:18:26.501 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-12T16:18:26.501 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-12T16:18:26.501 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 11, 2024-09-12T16:18:26.501 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 137, 2024-09-12T16:18:26.501 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-12T16:18:26.501 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-12T16:18:26.501 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-12T16:18:26.502 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:26.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.502 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:26.502 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6816", 2024-09-12T16:18:26.502 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1823488259 2024-09-12T16:18:26.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.502 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:26.502 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6817", 2024-09-12T16:18:26.502 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1823488259 2024-09-12T16:18:26.502 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:26.502 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:26.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.503 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-12T16:18:26.503 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:26.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.503 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:26.503 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6818", 2024-09-12T16:18:26.503 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1823488259 2024-09-12T16:18:26.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.503 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:26.503 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6819", 2024-09-12T16:18:26.503 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1823488259 2024-09-12T16:18:26.503 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:26.503 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:26.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.504 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-12T16:18:26.504 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:26.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.504 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:26.504 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6822", 2024-09-12T16:18:26.504 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1823488259 2024-09-12T16:18:26.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.504 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:26.504 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6823", 2024-09-12T16:18:26.504 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1823488259 2024-09-12T16:18:26.504 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:26.504 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:26.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.505 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-12T16:18:26.505 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:26.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.505 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:26.505 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6820", 2024-09-12T16:18:26.505 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1823488259 2024-09-12T16:18:26.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.505 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:26.505 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6821", 2024-09-12T16:18:26.505 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1823488259 2024-09-12T16:18:26.505 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:26.505 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:26.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.506 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.47:6817/1823488259", 2024-09-12T16:18:26.506 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.47:6819/1823488259", 2024-09-12T16:18:26.506 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.47:6823/1823488259", 2024-09-12T16:18:26.506 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.47:6821/1823488259", 2024-09-12T16:18:26.506 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-12T16:18:26.506 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-12T16:18:26.506 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-12T16:18:26.506 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:26.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.506 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2024-09-12T16:18:26.506 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "c255a252-3afe-4aad-b44c-85820867c960", 2024-09-12T16:18:26.506 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-12T16:18:26.507 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-12T16:18:26.507 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-12T16:18:26.507 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 0.089263916015625, 2024-09-12T16:18:26.507 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 11, 2024-09-12T16:18:26.507 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 35, 2024-09-12T16:18:26.507 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 71, 2024-09-12T16:18:26.507 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 32, 2024-09-12T16:18:26.507 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 37, 2024-09-12T16:18:26.507 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-12T16:18:26.507 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-12T16:18:26.507 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:26.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.507 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:26.507 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6800", 2024-09-12T16:18:26.508 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2087971028 2024-09-12T16:18:26.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.508 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:26.508 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6801", 2024-09-12T16:18:26.508 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2087971028 2024-09-12T16:18:26.508 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:26.508 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:26.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.508 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-12T16:18:26.508 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:26.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.508 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:26.509 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6802", 2024-09-12T16:18:26.509 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2087971028 2024-09-12T16:18:26.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.509 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:26.509 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6803", 2024-09-12T16:18:26.509 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2087971028 2024-09-12T16:18:26.509 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:26.509 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:26.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.509 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-12T16:18:26.509 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:26.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.509 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:26.509 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6806", 2024-09-12T16:18:26.510 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2087971028 2024-09-12T16:18:26.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.510 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:26.510 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6807", 2024-09-12T16:18:26.510 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2087971028 2024-09-12T16:18:26.510 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:26.510 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:26.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.510 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-12T16:18:26.510 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-12T16:18:26.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.510 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-12T16:18:26.510 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6804", 2024-09-12T16:18:26.510 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2087971028 2024-09-12T16:18:26.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.511 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-12T16:18:26.511 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.47:6805", 2024-09-12T16:18:26.511 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2087971028 2024-09-12T16:18:26.511 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:26.511 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:26.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.511 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.47:6801/2087971028", 2024-09-12T16:18:26.511 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.47:6803/2087971028", 2024-09-12T16:18:26.511 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.47:6807/2087971028", 2024-09-12T16:18:26.511 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.47:6805/2087971028", 2024-09-12T16:18:26.511 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-12T16:18:26.512 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-12T16:18:26.512 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-12T16:18:26.512 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:26.512 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:26.512 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-12T16:18:26.512 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2024-09-12T16:18:26.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.512 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2024-09-12T16:18:26.512 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-12T16:18:26.512 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-12T16:18:26.512 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-12T16:18:26.512 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540719139924082687, 2024-09-12T16:18:26.512 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-12T16:18:26.512 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-12T16:15:35.752566+0000", 2024-09-12T16:18:26.512 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-12T16:18:26.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.513 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2024-09-12T16:18:26.513 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-12T16:18:26.513 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-12T16:18:26.513 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-12T16:18:26.513 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540719139924082687, 2024-09-12T16:18:26.513 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-12T16:18:26.513 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-12T16:15:36.269665+0000", 2024-09-12T16:18:26.513 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-12T16:18:26.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.514 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2024-09-12T16:18:26.514 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-12T16:18:26.514 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-12T16:18:26.514 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-12T16:18:26.514 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540719139924082687, 2024-09-12T16:18:26.514 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-12T16:18:26.514 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-12T16:15:36.524745+0000", 2024-09-12T16:18:26.514 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-12T16:18:26.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.514 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2024-09-12T16:18:26.515 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-12T16:18:26.515 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-12T16:18:26.515 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-12T16:18:26.515 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540719139924082687, 2024-09-12T16:18:26.515 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-12T16:18:26.515 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-12T16:15:36.095607+0000", 2024-09-12T16:18:26.515 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-12T16:18:26.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.515 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2024-09-12T16:18:26.515 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-12T16:18:26.515 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-12T16:18:26.515 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-12T16:18:26.516 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540719139924082687, 2024-09-12T16:18:26.516 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-12T16:18:26.516 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-12T16:15:36.294055+0000", 2024-09-12T16:18:26.516 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-12T16:18:26.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.516 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2024-09-12T16:18:26.516 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-12T16:18:26.516 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-12T16:18:26.516 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-12T16:18:26.516 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540719139924082687, 2024-09-12T16:18:26.516 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-12T16:18:26.517 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-12T16:15:36.092708+0000", 2024-09-12T16:18:26.517 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 37 2024-09-12T16:18:26.517 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:26.517 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-12T16:18:26.517 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [ 2024-09-12T16:18:26.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.517 INFO:teuthology.orchestra.run.smithi017.stdout: "pgid": "3.1", 2024-09-12T16:18:26.517 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2024-09-12T16:18:26.517 INFO:teuthology.orchestra.run.smithi017.stdout: 1, 2024-09-12T16:18:26.517 INFO:teuthology.orchestra.run.smithi017.stdout: 0 2024-09-12T16:18:26.517 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:26.517 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:26.517 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-12T16:18:26.517 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [], 2024-09-12T16:18:26.518 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2024-09-12T16:18:26.518 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2024-09-12T16:18:26.518 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2024-09-12T16:18:26.518 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2024-09-12T16:18:26.518 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2024-09-12T16:18:26.518 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2024-09-12T16:18:26.518 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2024-09-12T16:18:26.518 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2024-09-12T16:18:26.518 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2024-09-12T16:18:26.518 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2024-09-12T16:18:26.518 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2024-09-12T16:18:26.518 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2024-09-12T16:18:26.518 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:26.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:26.519 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [ 2024-09-12T16:18:26.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.519 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 3, 2024-09-12T16:18:26.519 INFO:teuthology.orchestra.run.smithi017.stdout: "snaps": [ 2024-09-12T16:18:26.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:26.519 INFO:teuthology.orchestra.run.smithi017.stdout: "begin": 26, 2024-09-12T16:18:26.519 INFO:teuthology.orchestra.run.smithi017.stdout: "length": 3 2024-09-12T16:18:26.519 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:26.519 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:26.519 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:26.519 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-12T16:18:26.519 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [], 2024-09-12T16:18:26.519 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2024-09-12T16:18:26.520 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2024-09-12T16:18:26.520 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2024-09-12T16:18:26.520 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2024-09-12T16:18:26.520 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2024-09-12T16:18:26.520 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2024-09-12T16:18:26.520 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2024-09-12T16:18:26.520 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2024-09-12T16:18:26.520 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2024-09-12T16:18:26.520 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:26.520 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:26.521 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:18:26.523 INFO:tasks.thrashosds.thrasher:j is {'epoch': 138, 'fsid': '66dcb8ed-8de5-4784-8071-fd6b3bf3b78f', 'created': '2024-09-12T16:15:28.208893+0000', 'modified': '2024-09-12T16:18:26.140159+0000', 'last_up_change': '2024-09-12T16:17:03.223056+0000', 'last_in_change': '2024-09-12T16:18:21.117144+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 6, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T16:15:40.677216+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8482106924057007, 'average_primary_affinity': 0.8500000238418579, 'average_primary_affinity_weighted': 0.8500000238418579}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T16:15:45.306180+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 19, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.8482106924057007, 'average_primary_affinity': 0.8500000238418579, 'average_primary_affinity_weighted': 0.8500000238418579}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-12T16:15:55.082975+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '136', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 43, 'snap_epoch': 136, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.8482106924057007, 'average_primary_affinity': 0.8500000238418579, 'average_primary_affinity_weighted': 0.8500000238418579}}], 'osds': [{'osd': 0, 'uuid': 'aabea24b-3f1f-4555-80c3-5caecf2e2001', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 11, 'up_thru': 137, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6800', 'nonce': 1385915755}, {'type': 'v1', 'addr': '172.21.15.17:6801', 'nonce': 1385915755}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6802', 'nonce': 1385915755}, {'type': 'v1', 'addr': '172.21.15.17:6803', 'nonce': 1385915755}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6806', 'nonce': 1385915755}, {'type': 'v1', 'addr': '172.21.15.17:6807', 'nonce': 1385915755}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6804', 'nonce': 1385915755}, {'type': 'v1', 'addr': '172.21.15.17:6805', 'nonce': 1385915755}]}, 'public_addr': '172.21.15.17:6801/1385915755', 'cluster_addr': '172.21.15.17:6803/1385915755', 'heartbeat_back_addr': '172.21.15.17:6807/1385915755', 'heartbeat_front_addr': '172.21.15.17:6805/1385915755', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '7a17ca3b-8e49-4d92-a633-45d3e4a45b4e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 11, 'up_thru': 136, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6808', 'nonce': 3906173234}, {'type': 'v1', 'addr': '172.21.15.17:6809', 'nonce': 3906173234}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6810', 'nonce': 3906173234}, {'type': 'v1', 'addr': '172.21.15.17:6811', 'nonce': 3906173234}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6814', 'nonce': 3906173234}, {'type': 'v1', 'addr': '172.21.15.17:6815', 'nonce': 3906173234}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6812', 'nonce': 3906173234}, {'type': 'v1', 'addr': '172.21.15.17:6813', 'nonce': 3906173234}]}, 'public_addr': '172.21.15.17:6809/3906173234', 'cluster_addr': '172.21.15.17:6811/3906173234', 'heartbeat_back_addr': '172.21.15.17:6815/3906173234', 'heartbeat_front_addr': '172.21.15.17:6813/3906173234', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'dae09a32-24c6-464c-bee8-04ef2c42f7e4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 11, 'up_thru': 136, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6816', 'nonce': 1974346628}, {'type': 'v1', 'addr': '172.21.15.17:6817', 'nonce': 1974346628}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6818', 'nonce': 1974346628}, {'type': 'v1', 'addr': '172.21.15.17:6819', 'nonce': 1974346628}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6822', 'nonce': 1974346628}, {'type': 'v1', 'addr': '172.21.15.17:6823', 'nonce': 1974346628}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6820', 'nonce': 1974346628}, {'type': 'v1', 'addr': '172.21.15.17:6821', 'nonce': 1974346628}]}, 'public_addr': '172.21.15.17:6817/1974346628', 'cluster_addr': '172.21.15.17:6819/1974346628', 'heartbeat_back_addr': '172.21.15.17:6823/1974346628', 'heartbeat_front_addr': '172.21.15.17:6821/1974346628', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '9cc5463c-cdb4-4a6a-b526-39a60de417f4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 11, 'up_thru': 137, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6808', 'nonce': 3370202675}, {'type': 'v1', 'addr': '172.21.15.47:6809', 'nonce': 3370202675}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6810', 'nonce': 3370202675}, {'type': 'v1', 'addr': '172.21.15.47:6811', 'nonce': 3370202675}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6814', 'nonce': 3370202675}, {'type': 'v1', 'addr': '172.21.15.47:6815', 'nonce': 3370202675}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6812', 'nonce': 3370202675}, {'type': 'v1', 'addr': '172.21.15.47:6813', 'nonce': 3370202675}]}, 'public_addr': '172.21.15.47:6809/3370202675', 'cluster_addr': '172.21.15.47:6811/3370202675', 'heartbeat_back_addr': '172.21.15.47:6815/3370202675', 'heartbeat_front_addr': '172.21.15.47:6813/3370202675', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '1e329af3-a88a-4a95-b822-01519079084b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 11, 'up_thru': 137, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6816', 'nonce': 1823488259}, {'type': 'v1', 'addr': '172.21.15.47:6817', 'nonce': 1823488259}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6818', 'nonce': 1823488259}, {'type': 'v1', 'addr': '172.21.15.47:6819', 'nonce': 1823488259}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6822', 'nonce': 1823488259}, {'type': 'v1', 'addr': '172.21.15.47:6823', 'nonce': 1823488259}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6820', 'nonce': 1823488259}, {'type': 'v1', 'addr': '172.21.15.47:6821', 'nonce': 1823488259}]}, 'public_addr': '172.21.15.47:6817/1823488259', 'cluster_addr': '172.21.15.47:6819/1823488259', 'heartbeat_back_addr': '172.21.15.47:6823/1823488259', 'heartbeat_front_addr': '172.21.15.47:6821/1823488259', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'c255a252-3afe-4aad-b44c-85820867c960', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.089263916015625, 'last_clean_begin': 11, 'last_clean_end': 35, 'up_from': 71, 'up_thru': 32, 'down_at': 37, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6800', 'nonce': 2087971028}, {'type': 'v1', 'addr': '172.21.15.47:6801', 'nonce': 2087971028}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6802', 'nonce': 2087971028}, {'type': 'v1', 'addr': '172.21.15.47:6803', 'nonce': 2087971028}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6806', 'nonce': 2087971028}, {'type': 'v1', 'addr': '172.21.15.47:6807', 'nonce': 2087971028}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6804', 'nonce': 2087971028}, {'type': 'v1', 'addr': '172.21.15.47:6805', 'nonce': 2087971028}]}, 'public_addr': '172.21.15.47:6801/2087971028', 'cluster_addr': '172.21.15.47:6803/2087971028', 'heartbeat_back_addr': '172.21.15.47:6807/2087971028', 'heartbeat_front_addr': '172.21.15.47:6805/2087971028', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T16:15:35.752566+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T16:15:36.269665+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T16:15:36.524745+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T16:15:36.095607+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T16:15:36.294055+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T16:15:36.092708+0000', 'dead_epoch': 37}], 'pg_upmap': [{'pgid': '3.1', 'osds': [1, 0]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 26, 'length': 3}]}], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T16:18:26.523 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T16:18:26.565 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:26.564+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:26.644 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:26.644+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:26.671 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:26.671 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:26.681 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:18:26.745 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:26.744+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:26.788 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:26.788 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:26.797 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:18:26.862 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:18:26.862 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-12T16:18:26.863 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:26.860+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:26.874 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":217,"stamp":"2024-09-12T16:18:26.689813+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1016154872,"num_objects":1351,"num_object_clones":272,"num_object_copies":2702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":42,"num_objects_unfound":0,"num_objects_dirty":1351,"num_whiteouts":608,"num_read":446583,"num_read_kb":1618617,"num_write":28218,"num_write_kb":480295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4776,"num_bytes_recovered":191382431,"num_keys_recovered":632,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22685,"ondisk_log_size":22685,"up":82,"acting":76,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":629092,"kb_used_data":297416,"kb_used_omap":19,"kb_used_meta":331500,"kb_avail":565601948,"statfs":{"total":579820584960,"available":579176394752,"internally_reserved":0,"allocated":304553984,"data_stored":368668385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19565,"internal_metadata":339456915},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-16918807,"num_objects":-93,"num_object_clones":-47,"num_object_copies":-186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":42,"num_objects_unfound":0,"num_objects_dirty":-93,"num_whiteouts":-22,"num_read":562,"num_read_kb":481,"num_write":99,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1315,"num_bytes_recovered":24699389,"num_keys_recovered":119,"num_objects_omap":-2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000667"},"pg_stats":[{"pgid":"3.1f","version":"136'613","reported_seq":18676,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-12T16:18:24.141985+0000","last_change":"2024-09-12T16:18:24.141985+0000","last_active":"2024-09-12T16:18:24.141985+0000","last_peered":"2024-09-12T16:18:24.141985+0000","last_clean":"2024-09-12T16:18:24.141985+0000","last_became_active":"2024-09-12T16:17:21.011550+0000","last_became_peered":"2024-09-12T16:17:21.011550+0000","last_unstale":"2024-09-12T16:18:24.141985+0000","last_undegraded":"2024-09-12T16:18:24.141985+0000","last_fullsized":"2024-09-12T16:18:24.141985+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:33.975822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0063863929999999998,"stat_sum":{"num_bytes":28064859,"num_objects":46,"num_object_clones":11,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":21,"num_read":18805,"num_read_kb":74226,"num_write":835,"num_write_kb":11023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":2818651,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1a","length":"3"}]},{"pgid":"3.1e","version":"136'554","reported_seq":13766,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-12T16:18:24.150744+0000","last_change":"2024-09-12T16:18:24.144576+0000","last_active":"2024-09-12T16:18:24.150744+0000","last_peered":"2024-09-12T16:18:24.150744+0000","last_clean":"2024-09-12T16:18:24.150744+0000","last_became_active":"2024-09-12T16:16:55.202876+0000","last_became_peered":"2024-09-12T16:16:55.202876+0000","last_unstale":"2024-09-12T16:18:24.150744+0000","last_undegraded":"2024-09-12T16:18:24.150744+0000","last_fullsized":"2024-09-12T16:18:24.150744+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:08.305976+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0095377569999999991,"stat_sum":{"num_bytes":24222736,"num_objects":56,"num_object_clones":10,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":25,"num_read":13605,"num_read_kb":46844,"num_write":600,"num_write_kb":8472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":3145760,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1a","length":"3"}]},{"pgid":"3.1d","version":"135'1449","reported_seq":19717,"reported_epoch":136,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-09-12T16:18:24.693019+0000","last_change":"2024-09-12T16:18:24.667025+0000","last_active":"2024-09-12T16:18:24.693019+0000","last_peered":"2024-09-12T16:18:24.693019+0000","last_clean":"2024-09-12T16:18:20.274694+0000","last_became_active":"2024-09-12T16:18:23.072560+0000","last_became_peered":"2024-09-12T16:18:23.072560+0000","last_unstale":"2024-09-12T16:18:24.693019+0000","last_undegraded":"2024-09-12T16:18:23.023606+0000","last_fullsized":"2024-09-12T16:18:23.014736+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1449,"log_dups_size":0,"ondisk_log_size":1449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066983699999999995,"stat_sum":{"num_bytes":44326115,"num_objects":51,"num_object_clones":12,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":42,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":23,"num_read":22534,"num_read_kb":66906,"num_write":2084,"num_write_kb":16165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":232,"num_bytes_recovered":21412471,"num_keys_recovered":23,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4],"avail_no_missing":["4","1"],"object_location_counts":[{"shards":"1,4","objects":42},{"shards":"4","objects":8}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1c","length":"1"}]},{"pgid":"3.1c","version":"135'810","reported_seq":8822,"reported_epoch":135,"state":"peering","last_fresh":"2024-09-12T16:18:23.620835+0000","last_change":"2024-09-12T16:18:24.137089+0000","last_active":"2024-09-12T16:18:24.137089+0000","last_peered":"2024-09-12T16:18:23.620835+0000","last_clean":"2024-09-12T16:18:20.248601+0000","last_became_active":"2024-09-12T16:18:23.054838+0000","last_became_peered":"2024-09-12T16:18:23.054838+0000","last_unstale":"2024-09-12T16:18:23.620835+0000","last_undegraded":"2024-09-12T16:18:23.620835+0000","last_fullsized":"2024-09-12T16:18:23.014897+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069688499999999995,"stat_sum":{"num_bytes":13767696,"num_objects":32,"num_object_clones":8,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":20,"num_read":9553,"num_read_kb":27738,"num_write":1066,"num_write_kb":6805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":3550768,"num_keys_recovered":168,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,5],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1c","length":"1"}]},{"pgid":"3.1b","version":"136'1208","reported_seq":8584,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-12T16:18:24.140885+0000","last_change":"2024-09-12T16:18:24.141401+0000","last_active":"2024-09-12T16:18:24.140885+0000","last_peered":"2024-09-12T16:18:24.140885+0000","last_clean":"2024-09-12T16:18:24.140885+0000","last_became_active":"2024-09-12T16:17:21.011585+0000","last_became_peered":"2024-09-12T16:17:21.011585+0000","last_unstale":"2024-09-12T16:18:24.140885+0000","last_undegraded":"2024-09-12T16:18:24.140885+0000","last_fullsized":"2024-09-12T16:18:24.140885+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1208,"log_dups_size":0,"ondisk_log_size":1208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:46.289255+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0082552700000000003,"stat_sum":{"num_bytes":38510080,"num_objects":37,"num_object_clones":9,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":21,"num_read":12165,"num_read_kb":38004,"num_write":1706,"num_write_kb":15355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":14697984,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1a","length":"3"}]},{"pgid":"3.1a","version":"132'1289","reported_seq":11647,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-12T16:18:24.137919+0000","last_change":"2024-09-12T16:18:24.139057+0000","last_active":"2024-09-12T16:18:24.137919+0000","last_peered":"2024-09-12T16:18:24.137919+0000","last_clean":"2024-09-12T16:18:24.137919+0000","last_became_active":"2024-09-12T16:15:57.014803+0000","last_became_peered":"2024-09-12T16:15:57.014803+0000","last_unstale":"2024-09-12T16:18:24.137919+0000","last_undegraded":"2024-09-12T16:18:24.137919+0000","last_fullsized":"2024-09-12T16:18:24.137919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1289,"log_dups_size":0,"ondisk_log_size":1289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:06:10.140844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020532889999999998,"stat_sum":{"num_bytes":25332259,"num_objects":42,"num_object_clones":6,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":24,"num_read":15151,"num_read_kb":54173,"num_write":1998,"num_write_kb":21868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1a","length":"3"}]},{"pgid":"3.19","version":"136'492","reported_seq":14731,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-12T16:18:24.144230+0000","last_change":"2024-09-12T16:18:24.144230+0000","last_active":"2024-09-12T16:18:24.144230+0000","last_peered":"2024-09-12T16:18:24.144230+0000","last_clean":"2024-09-12T16:18:24.144230+0000","last_became_active":"2024-09-12T16:15:57.016110+0000","last_became_peered":"2024-09-12T16:15:57.016110+0000","last_unstale":"2024-09-12T16:18:24.144230+0000","last_undegraded":"2024-09-12T16:18:24.144230+0000","last_fullsized":"2024-09-12T16:18:24.144230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:37:33.986483+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0055722269999999999,"stat_sum":{"num_bytes":21027888,"num_objects":64,"num_object_clones":15,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":28,"num_read":14627,"num_read_kb":54218,"num_write":545,"num_write_kb":10346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1a","length":"3"}]},{"pgid":"3.18","version":"135'735","reported_seq":6183,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-12T16:18:24.133949+0000","last_change":"2024-09-12T16:18:24.133949+0000","last_active":"2024-09-12T16:18:24.133949+0000","last_peered":"2024-09-12T16:18:24.133949+0000","last_clean":"2024-09-12T16:18:24.133949+0000","last_became_active":"2024-09-12T16:17:21.009370+0000","last_became_peered":"2024-09-12T16:17:21.009370+0000","last_unstale":"2024-09-12T16:18:24.133949+0000","last_undegraded":"2024-09-12T16:18:24.133949+0000","last_fullsized":"2024-09-12T16:18:24.133949+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:25.689365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068161700000000003,"stat_sum":{"num_bytes":40327779,"num_objects":33,"num_object_clones":6,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":13,"num_read":7089,"num_read_kb":45462,"num_write":879,"num_write_kb":34056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":17173091,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1a","length":"3"}]},{"pgid":"3.17","version":"135'632","reported_seq":8094,"reported_epoch":136,"state":"active+undersized+remapped","last_fresh":"2024-09-12T16:18:24.666792+0000","last_change":"2024-09-12T16:18:24.666792+0000","last_active":"2024-09-12T16:18:24.666792+0000","last_peered":"2024-09-12T16:18:24.666792+0000","last_clean":"2024-09-12T16:18:20.257448+0000","last_became_active":"2024-09-12T16:18:23.062630+0000","last_became_peered":"2024-09-12T16:18:23.062630+0000","last_unstale":"2024-09-12T16:18:24.666792+0000","last_undegraded":"2024-09-12T16:18:24.666792+0000","last_fullsized":"2024-09-12T16:18:23.012734+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.008293267,"stat_sum":{"num_bytes":52720196,"num_objects":50,"num_object_clones":10,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":24,"num_read":7823,"num_read_kb":33805,"num_write":882,"num_write_kb":21940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":331,"num_bytes_recovered":20360415,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0],"avail_no_missing":["0","2","5"],"object_location_counts":[{"shards":"0","objects":50}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1c","length":"1"}]},{"pgid":"3.16","version":"135'1474","reported_seq":14942,"reported_epoch":136,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T16:18:24.133836+0000","last_change":"2024-09-12T16:18:23.072299+0000","last_active":"2024-09-12T16:18:24.133836+0000","last_peered":"2024-09-12T16:18:24.133836+0000","last_clean":"2024-09-12T16:18:20.276602+0000","last_became_active":"2024-09-12T16:18:23.070635+0000","last_became_peered":"2024-09-12T16:18:23.070635+0000","last_unstale":"2024-09-12T16:18:24.133836+0000","last_undegraded":"2024-09-12T16:18:23.026213+0000","last_fullsized":"2024-09-12T16:18:23.014323+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1474,"log_dups_size":0,"ondisk_log_size":1474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026449249999999998,"stat_sum":{"num_bytes":31707498,"num_objects":52,"num_object_clones":13,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":24,"num_read":18420,"num_read_kb":49399,"num_write":2264,"num_write_kb":15622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":11625898,"num_keys_recovered":96,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3],"avail_no_missing":["3","1"],"object_location_counts":[{"shards":"1,3","objects":52},{"shards":"3","objects":-1}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1c","length":"1"}]},{"pgid":"3.15","version":"135'351","reported_seq":7640,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-12T16:18:24.134778+0000","last_change":"2024-09-12T16:18:24.135450+0000","last_active":"2024-09-12T16:18:24.134778+0000","last_peered":"2024-09-12T16:18:24.134778+0000","last_clean":"2024-09-12T16:18:24.134778+0000","last_became_active":"2024-09-12T16:16:55.203324+0000","last_became_peered":"2024-09-12T16:16:55.203324+0000","last_unstale":"2024-09-12T16:18:24.134778+0000","last_undegraded":"2024-09-12T16:18:24.134778+0000","last_fullsized":"2024-09-12T16:18:24.134778+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:51.122453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002281305,"stat_sum":{"num_bytes":54265905,"num_objects":45,"num_object_clones":11,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":20,"num_read":6918,"num_read_kb":49308,"num_write":406,"num_write_kb":20795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":1054818,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1a","length":"3"}]},{"pgid":"3.14","version":"131'822","reported_seq":9027,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-12T16:18:24.135509+0000","last_change":"2024-09-12T16:18:24.136156+0000","last_active":"2024-09-12T16:18:24.135509+0000","last_peered":"2024-09-12T16:18:24.135509+0000","last_clean":"2024-09-12T16:18:24.135509+0000","last_became_active":"2024-09-12T16:16:53.185698+0000","last_became_peered":"2024-09-12T16:16:53.185698+0000","last_unstale":"2024-09-12T16:18:24.135509+0000","last_undegraded":"2024-09-12T16:18:24.135509+0000","last_fullsized":"2024-09-12T16:18:24.135509+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:02.950151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029806379999999999,"stat_sum":{"num_bytes":45892699,"num_objects":36,"num_object_clones":5,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":17,"num_read":11588,"num_read_kb":49876,"num_write":1101,"num_write_kb":23381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1a","length":"3"}]},{"pgid":"2.7","version":"0'0","reported_seq":159,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-12T16:18:24.133493+0000","last_change":"2024-09-12T16:16:52.184699+0000","last_active":"2024-09-12T16:18:24.133493+0000","last_peered":"2024-09-12T16:18:24.133493+0000","last_clean":"2024-09-12T16:18:24.133493+0000","last_became_active":"2024-09-12T16:16:52.184420+0000","last_became_peered":"2024-09-12T16:16:52.184420+0000","last_unstale":"2024-09-12T16:18:24.133493+0000","last_undegraded":"2024-09-12T16:18:24.133493+0000","last_fullsized":"2024-09-12T16:18:24.133493+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:50.051152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"135'471","reported_seq":9595,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-12T16:18:24.133512+0000","last_change":"2024-09-12T16:18:24.134038+0000","last_active":"2024-09-12T16:18:24.133512+0000","last_peered":"2024-09-12T16:18:24.133512+0000","last_clean":"2024-09-12T16:18:24.133512+0000","last_became_active":"2024-09-12T16:15:57.012577+0000","last_became_peered":"2024-09-12T16:15:57.012577+0000","last_unstale":"2024-09-12T16:18:24.133512+0000","last_undegraded":"2024-09-12T16:18:24.133512+0000","last_fullsized":"2024-09-12T16:18:24.133512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:14.775309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082294300000000003,"stat_sum":{"num_bytes":17994798,"num_objects":17,"num_object_clones":3,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":5,"num_read":10169,"num_read_kb":43938,"num_write":454,"num_write_kb":9188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1a","length":"3"}]},{"pgid":"2.6","version":"0'0","reported_seq":267,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-12T16:18:24.140626+0000","last_change":"2024-09-12T16:16:52.187010+0000","last_active":"2024-09-12T16:18:24.140626+0000","last_peered":"2024-09-12T16:18:24.140626+0000","last_clean":"2024-09-12T16:18:24.140626+0000","last_became_active":"2024-09-12T16:16:52.186638+0000","last_became_peered":"2024-09-12T16:16:52.186638+0000","last_unstale":"2024-09-12T16:18:24.140626+0000","last_undegraded":"2024-09-12T16:18:24.140626+0000","last_fullsized":"2024-09-12T16:18:24.140626+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:40.681796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066384400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"136'712","reported_seq":16479,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-12T16:18:24.142661+0000","last_change":"2024-09-12T16:18:24.143089+0000","last_active":"2024-09-12T16:18:24.142661+0000","last_peered":"2024-09-12T16:18:24.142661+0000","last_clean":"2024-09-12T16:18:24.142661+0000","last_became_active":"2024-09-12T16:16:34.108850+0000","last_became_peered":"2024-09-12T16:16:34.108850+0000","last_unstale":"2024-09-12T16:18:24.142661+0000","last_undegraded":"2024-09-12T16:18:24.142661+0000","last_fullsized":"2024-09-12T16:18:24.142661+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":712,"log_dups_size":0,"ondisk_log_size":712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:54.898187+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0076671609999999996,"stat_sum":{"num_bytes":50278912,"num_objects":40,"num_object_clones":9,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":19,"num_read":17496,"num_read_kb":60950,"num_write":637,"num_write_kb":27109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1a","length":"3"}]},{"pgid":"2.5","version":"0'0","reported_seq":159,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-12T16:18:24.133516+0000","last_change":"2024-09-12T16:16:52.183981+0000","last_active":"2024-09-12T16:18:24.133516+0000","last_peered":"2024-09-12T16:18:24.133516+0000","last_clean":"2024-09-12T16:18:24.133516+0000","last_became_active":"2024-09-12T16:16:52.183675+0000","last_became_peered":"2024-09-12T16:16:52.183675+0000","last_unstale":"2024-09-12T16:18:24.133516+0000","last_undegraded":"2024-09-12T16:18:24.133516+0000","last_fullsized":"2024-09-12T16:18:24.133516+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:35.267433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"135'690","reported_seq":7999,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-12T16:18:24.144979+0000","last_change":"2024-09-12T16:18:24.145799+0000","last_active":"2024-09-12T16:18:24.144979+0000","last_peered":"2024-09-12T16:18:24.144979+0000","last_clean":"2024-09-12T16:18:24.144979+0000","last_became_active":"2024-09-12T16:15:57.011381+0000","last_became_peered":"2024-09-12T16:15:57.011381+0000","last_unstale":"2024-09-12T16:18:24.144979+0000","last_undegraded":"2024-09-12T16:18:24.144979+0000","last_fullsized":"2024-09-12T16:18:24.144979+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":690,"log_dups_size":0,"ondisk_log_size":690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:44.369627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0062004759999999999,"stat_sum":{"num_bytes":12242496,"num_objects":38,"num_object_clones":3,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":16,"num_read":10055,"num_read_kb":43825,"num_write":888,"num_write_kb":7773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1a","length":"3"}]},{"pgid":"2.4","version":"0'0","reported_seq":255,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-12T16:18:24.139638+0000","last_change":"2024-09-12T16:15:48.822724+0000","last_active":"2024-09-12T16:18:24.139638+0000","last_peered":"2024-09-12T16:18:24.139638+0000","last_clean":"2024-09-12T16:18:24.139638+0000","last_became_active":"2024-09-12T16:15:46.818676+0000","last_became_peered":"2024-09-12T16:15:46.818676+0000","last_unstale":"2024-09-12T16:18:24.139638+0000","last_undegraded":"2024-09-12T16:18:24.139638+0000","last_fullsized":"2024-09-12T16:18:24.139638+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:11.170806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065522900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"131'743","reported_seq":21715,"reported_epoch":135,"state":"peering","last_fresh":"2024-09-12T16:18:23.998709+0000","last_change":"2024-09-12T16:18:24.134368+0000","last_active":"2024-09-12T16:18:24.134368+0000","last_peered":"2024-09-12T16:18:23.998709+0000","last_clean":"2024-09-12T16:18:20.121733+0000","last_became_active":"2024-09-12T16:18:23.070407+0000","last_became_peered":"2024-09-12T16:18:23.070407+0000","last_unstale":"2024-09-12T16:18:23.998709+0000","last_undegraded":"2024-09-12T16:18:23.998709+0000","last_fullsized":"2024-09-12T16:18:23.015121+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023072219999999998,"stat_sum":{"num_bytes":14539808,"num_objects":46,"num_object_clones":14,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":19,"num_read":25016,"num_read_kb":48247,"num_write":678,"num_write_kb":4777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":335,"num_bytes_recovered":4005968,"num_keys_recovered":105,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,5],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1c","length":"1"}]},{"pgid":"3.3","version":"135'702","reported_seq":6164,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-12T16:18:24.138682+0000","last_change":"2024-09-12T16:18:24.139251+0000","last_active":"2024-09-12T16:18:24.138682+0000","last_peered":"2024-09-12T16:18:24.138682+0000","last_clean":"2024-09-12T16:18:24.138682+0000","last_became_active":"2024-09-12T16:15:57.012238+0000","last_became_peered":"2024-09-12T16:15:57.012238+0000","last_unstale":"2024-09-12T16:18:24.138682+0000","last_undegraded":"2024-09-12T16:18:24.138682+0000","last_fullsized":"2024-09-12T16:18:24.138682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:56.578298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094099199999999998,"stat_sum":{"num_bytes":66991692,"num_objects":38,"num_object_clones":10,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":13,"num_read":6381,"num_read_kb":41367,"num_write":900,"num_write_kb":9196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1a","length":"3"}]},{"pgid":"2.2","version":"19'2","reported_seq":276,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-12T16:18:24.139502+0000","last_change":"2024-09-12T16:18:22.131014+0000","last_active":"2024-09-12T16:18:24.139502+0000","last_peered":"2024-09-12T16:18:24.139502+0000","last_clean":"2024-09-12T16:18:24.139502+0000","last_became_active":"2024-09-12T16:18:22.127939+0000","last_became_peered":"2024-09-12T16:18:22.127939+0000","last_unstale":"2024-09-12T16:18:24.139502+0000","last_undegraded":"2024-09-12T16:18:24.139502+0000","last_fullsized":"2024-09-12T16:18:24.139502+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:08.073541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"136'715","reported_seq":18414,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-12T16:18:24.144455+0000","last_change":"2024-09-12T16:18:24.144823+0000","last_active":"2024-09-12T16:18:24.144455+0000","last_peered":"2024-09-12T16:18:24.144455+0000","last_clean":"2024-09-12T16:18:24.144455+0000","last_became_active":"2024-09-12T16:15:57.014294+0000","last_became_peered":"2024-09-12T16:15:57.014294+0000","last_unstale":"2024-09-12T16:18:24.144455+0000","last_undegraded":"2024-09-12T16:18:24.144455+0000","last_fullsized":"2024-09-12T16:18:24.144455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":715,"log_dups_size":0,"ondisk_log_size":715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:35.214278+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0067076419999999998,"stat_sum":{"num_bytes":22597740,"num_objects":38,"num_object_clones":7,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":17,"num_read":19631,"num_read_kb":52701,"num_write":628,"num_write_kb":17119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1a","length":"3"}]},{"pgid":"2.1","version":"0'0","reported_seq":233,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-12T16:18:24.134241+0000","last_change":"2024-09-12T16:16:34.109269+0000","last_active":"2024-09-12T16:18:24.134241+0000","last_peered":"2024-09-12T16:18:24.134241+0000","last_clean":"2024-09-12T16:18:24.134241+0000","last_became_active":"2024-09-12T16:16:34.108999+0000","last_became_peered":"2024-09-12T16:16:34.108999+0000","last_unstale":"2024-09-12T16:18:24.134241+0000","last_undegraded":"2024-09-12T16:18:24.134241+0000","last_fullsized":"2024-09-12T16:18:24.134241+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:02:32.771436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"133'463","reported_seq":5659,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-12T16:18:24.138588+0000","last_change":"2024-09-12T16:18:24.139296+0000","last_active":"2024-09-12T16:18:24.138588+0000","last_peered":"2024-09-12T16:18:24.138588+0000","last_clean":"2024-09-12T16:18:24.138588+0000","last_became_active":"2024-09-12T16:18:19.018295+0000","last_became_peered":"2024-09-12T16:18:19.018295+0000","last_unstale":"2024-09-12T16:18:24.138588+0000","last_undegraded":"2024-09-12T16:18:24.138588+0000","last_fullsized":"2024-09-12T16:18:24.138588+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:22:12.185766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091674900000000001,"stat_sum":{"num_bytes":20465757,"num_objects":37,"num_object_clones":7,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":20,"num_read":5407,"num_read_kb":44101,"num_write":628,"num_write_kb":24794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":10774621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1a","length":"3"}]},{"pgid":"2.0","version":"0'0","reported_seq":159,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-12T16:18:24.132820+0000","last_change":"2024-09-12T16:16:52.184861+0000","last_active":"2024-09-12T16:18:24.132820+0000","last_peered":"2024-09-12T16:18:24.132820+0000","last_clean":"2024-09-12T16:18:24.132820+0000","last_became_active":"2024-09-12T16:16:52.184555+0000","last_became_peered":"2024-09-12T16:16:52.184555+0000","last_unstale":"2024-09-12T16:18:24.132820+0000","last_undegraded":"2024-09-12T16:18:24.132820+0000","last_fullsized":"2024-09-12T16:18:24.132820+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:32.617153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"132'532","reported_seq":9890,"reported_epoch":135,"state":"peering","last_fresh":"2024-09-12T16:18:23.472205+0000","last_change":"2024-09-12T16:18:24.138250+0000","last_active":"2024-09-12T16:18:24.138250+0000","last_peered":"2024-09-12T16:18:23.472205+0000","last_clean":"2024-09-12T16:18:20.132038+0000","last_became_active":"2024-09-12T16:18:23.051686+0000","last_became_peered":"2024-09-12T16:18:23.051686+0000","last_unstale":"2024-09-12T16:18:23.472205+0000","last_undegraded":"2024-09-12T16:18:23.472205+0000","last_fullsized":"2024-09-12T16:18:23.017002+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0038160550000000001,"stat_sum":{"num_bytes":31080992,"num_objects":39,"num_object_clones":9,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":16,"num_read":9715,"num_read_kb":35956,"num_write":464,"num_write_kb":7462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":315,"num_bytes_recovered":8454224,"num_keys_recovered":35,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,5],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1c","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":255,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-12T16:18:24.134574+0000","last_change":"2024-09-12T16:18:22.132779+0000","last_active":"2024-09-12T16:18:24.134574+0000","last_peered":"2024-09-12T16:18:24.134574+0000","last_clean":"2024-09-12T16:18:24.134574+0000","last_became_active":"2024-09-12T16:18:22.128933+0000","last_became_peered":"2024-09-12T16:18:22.128933+0000","last_unstale":"2024-09-12T16:18:24.134574+0000","last_undegraded":"2024-09-12T16:18:24.134574+0000","last_fullsized":"2024-09-12T16:18:24.134574+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:54.609583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":165,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-12T16:18:24.132928+0000","last_change":"2024-09-12T16:16:52.190735+0000","last_active":"2024-09-12T16:18:24.132928+0000","last_peered":"2024-09-12T16:18:24.132928+0000","last_clean":"2024-09-12T16:18:24.132928+0000","last_became_active":"2024-09-12T16:16:52.183781+0000","last_became_peered":"2024-09-12T16:16:52.183781+0000","last_unstale":"2024-09-12T16:18:24.132928+0000","last_undegraded":"2024-09-12T16:18:24.132928+0000","last_fullsized":"2024-09-12T16:18:24.132928+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:40.751677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:40.751677+0000","last_clean_scrub_stamp":"2024-09-12T16:15:40.751677+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:34.274075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"136'530","reported_seq":13403,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-12T16:18:24.146971+0000","last_change":"2024-09-12T16:18:24.147329+0000","last_active":"2024-09-12T16:18:24.146971+0000","last_peered":"2024-09-12T16:18:24.146971+0000","last_clean":"2024-09-12T16:18:24.146971+0000","last_became_active":"2024-09-12T16:16:34.108998+0000","last_became_peered":"2024-09-12T16:16:34.108998+0000","last_unstale":"2024-09-12T16:18:24.146971+0000","last_undegraded":"2024-09-12T16:18:24.146971+0000","last_fullsized":"2024-09-12T16:18:24.146971+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:59.074580+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.011359482000000001,"stat_sum":{"num_bytes":44922158,"num_objects":47,"num_object_clones":8,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":20,"num_read":13131,"num_read_kb":49375,"num_write":632,"num_write_kb":7937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1a","length":"3"}]},{"pgid":"3.9","version":"133'457","reported_seq":31392,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-12T16:18:24.137406+0000","last_change":"2024-09-12T16:18:24.137850+0000","last_active":"2024-09-12T16:18:24.137406+0000","last_peered":"2024-09-12T16:18:24.137406+0000","last_clean":"2024-09-12T16:18:24.137406+0000","last_became_active":"2024-09-12T16:15:57.013620+0000","last_became_peered":"2024-09-12T16:15:57.013620+0000","last_unstale":"2024-09-12T16:18:24.137406+0000","last_undegraded":"2024-09-12T16:18:24.137406+0000","last_fullsized":"2024-09-12T16:18:24.137406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:28.059728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013361250000000001,"stat_sum":{"num_bytes":56234512,"num_objects":34,"num_object_clones":7,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":14,"num_read":30740,"num_read_kb":77488,"num_write":550,"num_write_kb":11505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1a","length":"3"}]},{"pgid":"3.a","version":"135'832","reported_seq":20603,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-12T16:18:24.133364+0000","last_change":"2024-09-12T16:18:24.134010+0000","last_active":"2024-09-12T16:18:24.133364+0000","last_peered":"2024-09-12T16:18:24.133364+0000","last_clean":"2024-09-12T16:18:24.133364+0000","last_became_active":"2024-09-12T16:16:55.202934+0000","last_became_peered":"2024-09-12T16:16:55.202934+0000","last_unstale":"2024-09-12T16:18:24.133364+0000","last_undegraded":"2024-09-12T16:18:24.133364+0000","last_fullsized":"2024-09-12T16:18:24.133364+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:19.694632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090416599999999998,"stat_sum":{"num_bytes":39159434,"num_objects":41,"num_object_clones":8,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":17,"num_read":21878,"num_read_kb":59559,"num_write":898,"num_write_kb":8220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":4487368,"num_keys_recovered":26,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1a","length":"3"}]},{"pgid":"3.b","version":"136'490","reported_seq":15426,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-12T16:18:24.148835+0000","last_change":"2024-09-12T16:18:24.149059+0000","last_active":"2024-09-12T16:18:24.148835+0000","last_peered":"2024-09-12T16:18:24.148835+0000","last_clean":"2024-09-12T16:18:24.148835+0000","last_became_active":"2024-09-12T16:15:57.012845+0000","last_became_peered":"2024-09-12T16:15:57.012845+0000","last_unstale":"2024-09-12T16:18:24.148835+0000","last_undegraded":"2024-09-12T16:18:24.148835+0000","last_fullsized":"2024-09-12T16:18:24.148835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:36.080913+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.0097919429999999991,"stat_sum":{"num_bytes":8369320,"num_objects":35,"num_object_clones":3,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":15,"num_read":15255,"num_read_kb":48851,"num_write":555,"num_write_kb":5111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1a","length":"3"}]},{"pgid":"3.c","version":"135'412","reported_seq":11308,"reported_epoch":136,"state":"active+undersized+remapped","last_fresh":"2024-09-12T16:18:24.185631+0000","last_change":"2024-09-12T16:18:24.185855+0000","last_active":"2024-09-12T16:18:24.185631+0000","last_peered":"2024-09-12T16:18:24.185631+0000","last_clean":"2024-09-12T16:18:20.120328+0000","last_became_active":"2024-09-12T16:18:23.053932+0000","last_became_peered":"2024-09-12T16:18:23.053932+0000","last_unstale":"2024-09-12T16:18:24.185631+0000","last_undegraded":"2024-09-12T16:18:23.015415+0000","last_fullsized":"2024-09-12T16:18:23.011531+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010778719999999999,"stat_sum":{"num_bytes":21365248,"num_objects":51,"num_object_clones":13,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":26,"num_read":9857,"num_read_kb":46208,"num_write":409,"num_write_kb":17232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":316,"num_bytes_recovered":11704832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0],"avail_no_missing":["0","3","5"],"object_location_counts":[{"shards":"0","objects":51}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1c","length":"1"}]},{"pgid":"3.d","version":"136'584","reported_seq":16858,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-12T16:18:24.144734+0000","last_change":"2024-09-12T16:18:24.145040+0000","last_active":"2024-09-12T16:18:24.144734+0000","last_peered":"2024-09-12T16:18:24.144734+0000","last_clean":"2024-09-12T16:18:24.144734+0000","last_became_active":"2024-09-12T16:16:55.202102+0000","last_became_peered":"2024-09-12T16:16:55.202102+0000","last_unstale":"2024-09-12T16:18:24.144734+0000","last_undegraded":"2024-09-12T16:18:24.144734+0000","last_fullsized":"2024-09-12T16:18:24.144734+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:56.924053+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.011319442000000001,"stat_sum":{"num_bytes":25440305,"num_objects":42,"num_object_clones":8,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":16,"num_read":17966,"num_read_kb":58016,"num_write":562,"num_write_kb":13608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":126,"num_bytes_recovered":6078562,"num_keys_recovered":48,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1a","length":"3"}]},{"pgid":"3.e","version":"132'523","reported_seq":7317,"reported_epoch":136,"state":"active+undersized+remapped","last_fresh":"2024-09-12T16:18:24.340102+0000","last_change":"2024-09-12T16:18:24.340383+0000","last_active":"2024-09-12T16:18:24.340102+0000","last_peered":"2024-09-12T16:18:24.340102+0000","last_clean":"2024-09-12T16:18:20.184878+0000","last_became_active":"2024-09-12T16:18:23.069807+0000","last_became_peered":"2024-09-12T16:18:23.069807+0000","last_unstale":"2024-09-12T16:18:24.340102+0000","last_undegraded":"2024-09-12T16:18:24.340102+0000","last_fullsized":"2024-09-12T16:18:23.015152+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":523,"log_dups_size":0,"ondisk_log_size":523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022390159999999999,"stat_sum":{"num_bytes":17230848,"num_objects":39,"num_object_clones":4,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":19,"num_read":7459,"num_read_kb":29736,"num_write":513,"num_write_kb":13250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":319,"num_bytes_recovered":6744127,"num_keys_recovered":60,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4],"avail_no_missing":["4","1","5"],"object_location_counts":[{"shards":"4","objects":39}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1c","length":"1"}]},{"pgid":"3.f","version":"132'617","reported_seq":11985,"reported_epoch":136,"state":"active+undersized+remapped","last_fresh":"2024-09-12T16:18:24.464618+0000","last_change":"2024-09-12T16:18:24.464810+0000","last_active":"2024-09-12T16:18:24.464618+0000","last_peered":"2024-09-12T16:18:24.464618+0000","last_clean":"2024-09-12T16:18:20.208404+0000","last_became_active":"2024-09-12T16:18:23.062603+0000","last_became_peered":"2024-09-12T16:18:23.062603+0000","last_unstale":"2024-09-12T16:18:24.464618+0000","last_undegraded":"2024-09-12T16:18:24.464618+0000","last_fullsized":"2024-09-12T16:18:23.013492+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001192673,"stat_sum":{"num_bytes":10921259,"num_objects":26,"num_object_clones":1,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":15,"num_read":10809,"num_read_kb":49077,"num_write":792,"num_write_kb":21652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":304,"num_bytes_recovered":6361542,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3],"avail_no_missing":["3","0","5"],"object_location_counts":[{"shards":"3","objects":26}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1c","length":"1"}]},{"pgid":"3.10","version":"131'585","reported_seq":14984,"reported_epoch":136,"state":"peering","last_fresh":"2024-09-12T16:18:24.135096+0000","last_change":"2024-09-12T16:18:24.135096+0000","last_active":"2024-09-12T16:18:24.135096+0000","last_peered":"2024-09-12T16:18:23.311240+0000","last_clean":"2024-09-12T16:18:20.121142+0000","last_became_active":"2024-09-12T16:18:23.041761+0000","last_became_peered":"2024-09-12T16:18:23.041761+0000","last_unstale":"2024-09-12T16:18:24.135096+0000","last_undegraded":"2024-09-12T16:18:24.135096+0000","last_fullsized":"2024-09-12T16:18:24.135096+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001863714,"stat_sum":{"num_bytes":35049754,"num_objects":57,"num_object_clones":13,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":25,"num_read":12784,"num_read_kb":73170,"num_write":765,"num_write_kb":17171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":412,"num_bytes_recovered":13039478,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1c","length":"1"}]},{"pgid":"3.11","version":"136'611","reported_seq":16801,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-12T16:18:24.138223+0000","last_change":"2024-09-12T16:18:24.138632+0000","last_active":"2024-09-12T16:18:24.138223+0000","last_peered":"2024-09-12T16:18:24.138223+0000","last_clean":"2024-09-12T16:18:24.138223+0000","last_became_active":"2024-09-12T16:16:55.202493+0000","last_became_peered":"2024-09-12T16:16:55.202493+0000","last_unstale":"2024-09-12T16:18:24.138223+0000","last_undegraded":"2024-09-12T16:18:24.138223+0000","last_fullsized":"2024-09-12T16:18:24.138223+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":611,"log_dups_size":0,"ondisk_log_size":611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:39:51.729610+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.0057182659999999996,"stat_sum":{"num_bytes":32181335,"num_objects":42,"num_object_clones":8,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":17,"num_read":16715,"num_read_kb":61484,"num_write":781,"num_write_kb":15885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":1725440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1a","length":"3"}]},{"pgid":"3.12","version":"136'593","reported_seq":14716,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-12T16:18:24.140884+0000","last_change":"2024-09-12T16:18:24.141766+0000","last_active":"2024-09-12T16:18:24.140884+0000","last_peered":"2024-09-12T16:18:24.140884+0000","last_clean":"2024-09-12T16:18:24.140884+0000","last_became_active":"2024-09-12T16:16:55.202220+0000","last_became_peered":"2024-09-12T16:16:55.202220+0000","last_unstale":"2024-09-12T16:18:24.140884+0000","last_undegraded":"2024-09-12T16:18:24.140884+0000","last_fullsized":"2024-09-12T16:18:24.140884+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:19.787694+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0085533999999999992,"stat_sum":{"num_bytes":32453222,"num_objects":38,"num_object_clones":6,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":16,"num_read":15965,"num_read_kb":59822,"num_write":626,"num_write_kb":14663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":3518540,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1a","length":"3"}]},{"pgid":"3.13","version":"132'919","reported_seq":11152,"reported_epoch":135,"state":"peering","last_fresh":"2024-09-12T16:18:23.811380+0000","last_change":"2024-09-12T16:18:24.133642+0000","last_active":"2024-09-12T16:18:24.133642+0000","last_peered":"2024-09-12T16:18:23.811380+0000","last_clean":"2024-09-12T16:18:20.123438+0000","last_became_active":"2024-09-12T16:18:23.060645+0000","last_became_peered":"2024-09-12T16:18:23.060645+0000","last_unstale":"2024-09-12T16:18:23.811380+0000","last_undegraded":"2024-09-12T16:18:23.811380+0000","last_fullsized":"2024-09-12T16:18:23.013506+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":919,"log_dups_size":0,"ondisk_log_size":919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.0046047750000000002,"stat_sum":{"num_bytes":35879185,"num_objects":58,"num_object_clones":15,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":23,"num_read":11810,"num_read_kb":44732,"num_write":1389,"num_write_kb":19185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":434,"num_bytes_recovered":17467099,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,5],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1c","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1015564485,"num_objects":1347,"num_object_clones":272,"num_object_copies":2694,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":42,"num_objects_unfound":0,"num_objects_dirty":1347,"num_whiteouts":608,"num_read":446517,"num_read_kb":1618562,"num_write":28115,"num_write_kb":478665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4768,"num_bytes_recovered":190201657,"num_keys_recovered":632,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296656896,"data_stored":366475300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6949,"internal_metadata":0},"log_size":22610,"ondisk_log_size":22610,"up":64,"acting":58,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":5,"up_from":71,"seq":304942678033,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42596,"kb_used_data":1544,"kb_used_omap":11,"kb_used_meta":41012,"kb_avail":94329244,"statfs":{"total":96636764160,"available":96593145856,"internally_reserved":0,"allocated":1581056,"data_stored":655727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11593,"internal_metadata":41996983},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640292,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113072,"kb_used_data":41624,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94258768,"statfs":{"total":96636764160,"available":96520978432,"internally_reserved":0,"allocated":42622976,"data_stored":51131146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640293,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122112,"kb_used_data":50656,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94249728,"statfs":{"total":96636764160,"available":96511721472,"internally_reserved":0,"allocated":51871744,"data_stored":67422928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73136583},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640294,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":112576,"kb_used_data":67496,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94259264,"statfs":{"total":96636764160,"available":96521486336,"internally_reserved":0,"allocated":69115904,"data_stored":84149391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640292,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":117772,"kb_used_data":64372,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94254068,"statfs":{"total":96636764160,"available":96516165632,"internally_reserved":0,"allocated":65916928,"data_stored":76250464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640293,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120964,"kb_used_data":71724,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94250876,"statfs":{"total":96636764160,"available":96512897024,"internally_reserved":0,"allocated":73445376,"data_stored":89058729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":71200768,"data_stored":87767389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":64118784,"data_stored":74610465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":67497984,"data_stored":83477044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49659904,"data_stored":66160213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40919040,"data_stored":50112734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3260416,"data_stored":4347455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6949,"internal_metadata":0}]}} 2024-09-12T16:18:26.876 INFO:tasks.thrashosds.thrasher:Setting 2.1 to [2, 3] 2024-09-12T16:18:26.876 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '2.1', '2', '3'] 2024-09-12T16:18:26.876 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 2.1 2 3 2024-09-12T16:18:26.946 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:26.946 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:26.947 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:26.946+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:26.956 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:18:27.047 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:27.047+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:27.105 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:27.105 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:27.114 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:18:27.149 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:27.147+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:27.249 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:27.249+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:27.268 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:27.268 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:27.277 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:18:27.351 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:27.349+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:27.425 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:27.426 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:27.434 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:18:27.479 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:27.478+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:27.541 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:27.542 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:27.551 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:18:27.593 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:27.592+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:27.654 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:27.653+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:27.699 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:27.699 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:27.707 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:18:27.754 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:27.753+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:27.828 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:27.828 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:27.837 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:18:27.860 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T16:18:27.878 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:27.877+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:27.955 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:27.955+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:27.985 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:27.985 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:27.986 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:18:27.987 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:18:27.994 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:18:28.004 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:18:28.004 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:18:28.013 INFO:teuthology.orchestra.run.smithi017.stderr:set 2.1 pg_upmap mapping to [2,3] 2024-09-12T16:18:28.030 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:18:28.030 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:18:28.049 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:18:28.049 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:18:28.056 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:28.055+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:28.067 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:18:28.068 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:18:28.085 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:18:28.085 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:18:28.116 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:28.116 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:18:28.116 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:18:28.116 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:18:28.116 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.116 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:18:28.116 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:18:28.116 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 166.349641574, 2024-09-12T16:18:28.116 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55645454900000002, 2024-09-12T16:18:28.116 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.116 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.117 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:28.117 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.117 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:18:28.117 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:18:28.117 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1 2024-09-12T16:18:28.117 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.117 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.117 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.117 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.117 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:18:28.118 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.118 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.118 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.118 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.118 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:18:28.118 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.118 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.118 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.118 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.118 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764440+0000", 2024-09-12T16:18:28.118 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6249999999999999e-06 2024-09-12T16:18:28.118 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.118 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.118 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.119 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764447+0000", 2024-09-12T16:18:28.119 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4939999999999997e-06 2024-09-12T16:18:28.119 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.119 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.119 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.119 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764459+0000", 2024-09-12T16:18:28.119 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1517e-05 2024-09-12T16:18:28.119 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.119 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.119 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.119 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764468+0000", 2024-09-12T16:18:28.119 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7690000000000002e-06 2024-09-12T16:18:28.119 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.119 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.120 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.120 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764539+0000", 2024-09-12T16:18:28.120 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1103e-05 2024-09-12T16:18:28.120 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.120 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.120 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:28.120 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764551+0000", 2024-09-12T16:18:28.120 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2687999999999999e-05 2024-09-12T16:18:28.120 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.120 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.120 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.120 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319497+0000", 2024-09-12T16:18:28.120 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55494560500000001 2024-09-12T16:18:28.120 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.121 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.121 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.121 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319688+0000", 2024-09-12T16:18:28.121 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019105599999999999 2024-09-12T16:18:28.121 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.121 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.121 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:18:28.121 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319842+0000", 2024-09-12T16:18:28.121 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015377699999999999 2024-09-12T16:18:28.121 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.121 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.121 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:18:28.121 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320473+0000", 2024-09-12T16:18:28.121 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00063117100000000003 2024-09-12T16:18:28.122 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.122 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.122 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:28.122 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320825+0000", 2024-09-12T16:18:28.122 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00035202500000000001 2024-09-12T16:18:28.122 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.122 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.122 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:28.122 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320867+0000", 2024-09-12T16:18:28.122 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2005000000000002e-05 2024-09-12T16:18:28.122 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.122 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.122 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.122 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320893+0000", 2024-09-12T16:18:28.122 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5714000000000001e-05 2024-09-12T16:18:28.123 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.123 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.123 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.123 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.123 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.123 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14034 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5035008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:28.123 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:18:28.123 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 128.59258334099999, 2024-09-12T16:18:28.123 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053404082999999998, 2024-09-12T16:18:28.123 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.123 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.123 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:28.123 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.123 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:28.124 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:28.124 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14034 2024-09-12T16:18:28.124 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.124 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.124 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.124 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.124 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:18:28.124 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.124 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.124 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.124 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.124 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:18:28.125 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.125 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.125 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.125 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.125 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521740+0000", 2024-09-12T16:18:28.125 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000243976 2024-09-12T16:18:28.125 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.125 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.125 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.125 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521745+0000", 2024-09-12T16:18:28.125 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1280000000000001e-06 2024-09-12T16:18:28.125 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.126 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.126 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.126 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521757+0000", 2024-09-12T16:18:28.126 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2751e-05 2024-09-12T16:18:28.126 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.126 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.126 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.126 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521771+0000", 2024-09-12T16:18:28.126 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3328e-05 2024-09-12T16:18:28.126 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.126 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.126 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.126 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574710+0000", 2024-09-12T16:18:28.126 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052939358999999998 2024-09-12T16:18:28.127 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.127 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.127 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.127 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574799+0000", 2024-09-12T16:18:28.127 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8893000000000004e-05 2024-09-12T16:18:28.127 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.127 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.127 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.127 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574901+0000", 2024-09-12T16:18:28.127 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101648 2024-09-12T16:18:28.127 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.127 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.127 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.128 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.128 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.128 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14036 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5043200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:28.128 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:18:28.128 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 128.59212414699999, 2024-09-12T16:18:28.128 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053426247000000003, 2024-09-12T16:18:28.128 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.128 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.128 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:28.128 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.128 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:28.129 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:28.129 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14036 2024-09-12T16:18:28.129 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.129 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.129 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.129 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.129 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:18:28.130 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.130 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.130 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.130 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.130 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:18:28.130 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.130 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.130 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.130 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.130 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522208+0000", 2024-09-12T16:18:28.130 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025195300000000002 2024-09-12T16:18:28.131 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.131 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.131 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.131 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522211+0000", 2024-09-12T16:18:28.131 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2160000000000002e-06 2024-09-12T16:18:28.132 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.132 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.132 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.132 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522223+0000", 2024-09-12T16:18:28.132 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2044e-05 2024-09-12T16:18:28.132 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.132 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.132 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.133 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522229+0000", 2024-09-12T16:18:28.133 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8850000000000004e-06 2024-09-12T16:18:28.133 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.133 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.133 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.133 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575192+0000", 2024-09-12T16:18:28.133 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052963573 2024-09-12T16:18:28.133 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.133 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.133 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.133 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575282+0000", 2024-09-12T16:18:28.133 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9666000000000005e-05 2024-09-12T16:18:28.133 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.133 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.134 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.134 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575382+0000", 2024-09-12T16:18:28.134 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9909999999999997e-05 2024-09-12T16:18:28.134 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.134 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.134 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.134 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.134 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.134 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14039 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5055488~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:28.134 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:18:28.134 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 128.59144436299999, 2024-09-12T16:18:28.134 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053466207000000002, 2024-09-12T16:18:28.134 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.134 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.134 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:28.135 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.135 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:28.135 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:28.135 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14039 2024-09-12T16:18:28.135 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.135 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.135 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.135 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.135 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:18:28.135 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.135 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.135 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.135 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.135 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:18:28.136 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.136 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.136 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.136 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.136 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522899+0000", 2024-09-12T16:18:28.136 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026318199999999999 2024-09-12T16:18:28.136 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.136 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.136 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.136 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522903+0000", 2024-09-12T16:18:28.136 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.929e-06 2024-09-12T16:18:28.136 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.136 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.136 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.137 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522913+0000", 2024-09-12T16:18:28.137 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0162e-05 2024-09-12T16:18:28.137 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.137 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.137 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.137 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522921+0000", 2024-09-12T16:18:28.137 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.14e-06 2024-09-12T16:18:28.137 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.137 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.137 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.137 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575922+0000", 2024-09-12T16:18:28.138 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053000712999999998 2024-09-12T16:18:28.138 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.138 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.138 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.138 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576006+0000", 2024-09-12T16:18:28.138 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4161999999999998e-05 2024-09-12T16:18:28.138 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.138 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.138 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.138 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576102+0000", 2024-09-12T16:18:28.138 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5919000000000001e-05 2024-09-12T16:18:28.138 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.138 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.139 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.139 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.139 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.139 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14040 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5059584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:28.139 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:18:28.139 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 128.59113946799999, 2024-09-12T16:18:28.139 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053413258999999998, 2024-09-12T16:18:28.139 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.139 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.139 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:28.139 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.139 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:28.139 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:28.139 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14040 2024-09-12T16:18:28.140 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.140 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.140 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.140 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.140 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:18:28.140 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.140 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.140 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.140 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.140 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:18:28.140 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.140 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.140 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.141 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.141 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523059+0000", 2024-09-12T16:18:28.141 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118466 2024-09-12T16:18:28.141 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.141 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.141 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.141 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523062+0000", 2024-09-12T16:18:28.141 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.971e-06 2024-09-12T16:18:28.141 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.141 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.141 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.141 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523069+0000", 2024-09-12T16:18:28.142 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8279999999999997e-06 2024-09-12T16:18:28.142 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.142 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.142 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.142 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523073+0000", 2024-09-12T16:18:28.142 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3019999999999996e-06 2024-09-12T16:18:28.142 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.142 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.143 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.143 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576155+0000", 2024-09-12T16:18:28.143 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053081962000000003 2024-09-12T16:18:28.143 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.143 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.143 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.143 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576249+0000", 2024-09-12T16:18:28.143 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3914999999999998e-05 2024-09-12T16:18:28.143 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.143 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.143 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.143 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576354+0000", 2024-09-12T16:18:28.143 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010481500000000001 2024-09-12T16:18:28.144 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.144 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.144 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.144 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.144 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.144 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14041 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5063680~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:28.144 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:18:28.144 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 128.59098916299999, 2024-09-12T16:18:28.144 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053519111000000001, 2024-09-12T16:18:28.144 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.144 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.144 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:28.144 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.145 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:28.145 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:28.145 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14041 2024-09-12T16:18:28.145 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.145 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.145 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.145 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.145 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:18:28.145 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.145 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.145 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.145 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.145 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:18:28.145 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.146 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.146 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.146 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.146 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523309+0000", 2024-09-12T16:18:28.146 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000218712 2024-09-12T16:18:28.146 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.146 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.146 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.146 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523313+0000", 2024-09-12T16:18:28.146 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.151e-06 2024-09-12T16:18:28.146 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.146 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.147 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.147 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523320+0000", 2024-09-12T16:18:28.147 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9789999999999993e-06 2024-09-12T16:18:28.147 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.147 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.148 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.148 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523325+0000", 2024-09-12T16:18:28.148 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:18:28.148 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.148 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.149 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.149 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576402+0000", 2024-09-12T16:18:28.149 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053076811000000002 2024-09-12T16:18:28.149 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.149 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.149 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.149 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576491+0000", 2024-09-12T16:18:28.149 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8578999999999993e-05 2024-09-12T16:18:28.149 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.150 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.150 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.150 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576610+0000", 2024-09-12T16:18:28.150 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119129 2024-09-12T16:18:28.150 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.150 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.150 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.151 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.151 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.151 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14042 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5067776~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:28.151 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:18:28.151 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 128.59074572899999, 2024-09-12T16:18:28.151 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053510350999999998, 2024-09-12T16:18:28.151 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.151 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.151 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:28.151 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.151 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:28.152 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:28.152 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14042 2024-09-12T16:18:28.152 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.152 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.152 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.152 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.152 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:18:28.152 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.152 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.153 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.153 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.153 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:18:28.153 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.153 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.153 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.153 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.153 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523591+0000", 2024-09-12T16:18:28.153 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025710300000000001 2024-09-12T16:18:28.153 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.153 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.153 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.153 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523594+0000", 2024-09-12T16:18:28.154 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2229999999999999e-06 2024-09-12T16:18:28.154 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.154 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.154 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.154 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523602+0000", 2024-09-12T16:18:28.154 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6930000000000007e-06 2024-09-12T16:18:28.154 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.154 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.154 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.154 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523607+0000", 2024-09-12T16:18:28.154 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4789999999999998e-06 2024-09-12T16:18:28.155 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.155 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.155 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.155 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576661+0000", 2024-09-12T16:18:28.155 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053973999999997 2024-09-12T16:18:28.155 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.155 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.155 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.155 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576745+0000", 2024-09-12T16:18:28.155 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4660000000000006e-05 2024-09-12T16:18:28.155 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.155 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.155 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.156 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576844+0000", 2024-09-12T16:18:28.156 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9219e-05 2024-09-12T16:18:28.156 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.156 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.156 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.156 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.156 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.156 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14043 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5071872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:28.156 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:18:28.156 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 128.59046524999999, 2024-09-12T16:18:28.156 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053475295999999999, 2024-09-12T16:18:28.156 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.156 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.156 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:28.157 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.157 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:28.157 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:28.157 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14043 2024-09-12T16:18:28.157 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.157 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.157 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.157 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.157 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:18:28.158 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.158 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.158 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.158 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.158 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:18:28.158 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.158 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.158 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.158 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.158 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523823+0000", 2024-09-12T16:18:28.158 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020818900000000001 2024-09-12T16:18:28.158 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.158 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.158 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.159 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523826+0000", 2024-09-12T16:18:28.159 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.405e-06 2024-09-12T16:18:28.159 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.159 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.159 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.159 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523834+0000", 2024-09-12T16:18:28.159 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5499999999999997e-06 2024-09-12T16:18:28.159 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.159 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.159 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.159 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523838+0000", 2024-09-12T16:18:28.159 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.408e-06 2024-09-12T16:18:28.160 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.160 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.160 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.160 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576904+0000", 2024-09-12T16:18:28.160 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053065687 2024-09-12T16:18:28.160 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.160 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.160 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.160 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576991+0000", 2024-09-12T16:18:28.160 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7399999999999997e-05 2024-09-12T16:18:28.160 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.161 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.161 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.161 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577090+0000", 2024-09-12T16:18:28.161 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8657000000000001e-05 2024-09-12T16:18:28.161 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.161 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.161 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.161 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.161 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.161 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14044 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5075968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:28.161 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:18:28.161 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 128.59023371999999, 2024-09-12T16:18:28.161 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053442659000000003, 2024-09-12T16:18:28.161 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.162 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.162 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:28.162 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.162 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:28.162 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:28.162 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14044 2024-09-12T16:18:28.162 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.162 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.162 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.162 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.162 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:18:28.162 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.162 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.162 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.163 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.163 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:18:28.163 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.163 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.163 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.163 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.163 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523985+0000", 2024-09-12T16:18:28.163 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000138522 2024-09-12T16:18:28.163 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.163 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.163 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.163 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523988+0000", 2024-09-12T16:18:28.164 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.788e-06 2024-09-12T16:18:28.164 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.164 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.164 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.164 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523998+0000", 2024-09-12T16:18:28.164 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8470000000000008e-06 2024-09-12T16:18:28.164 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.164 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.164 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.164 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524010+0000", 2024-09-12T16:18:28.164 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1348999999999999e-05 2024-09-12T16:18:28.164 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.164 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.165 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.165 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577137+0000", 2024-09-12T16:18:28.165 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053127055999999999 2024-09-12T16:18:28.165 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.165 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.165 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.165 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577210+0000", 2024-09-12T16:18:28.165 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3392000000000005e-05 2024-09-12T16:18:28.165 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.165 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.165 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.165 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577289+0000", 2024-09-12T16:18:28.165 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8704999999999999e-05 2024-09-12T16:18:28.165 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.166 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.166 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.166 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.166 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.166 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14045 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5080064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:28.166 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:18:28.166 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 128.59005489899999, 2024-09-12T16:18:28.166 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053497514000000003, 2024-09-12T16:18:28.166 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.166 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.166 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:28.166 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.166 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:28.166 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:28.166 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14045 2024-09-12T16:18:28.167 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.167 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.167 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.167 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.167 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:18:28.167 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.167 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.167 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.167 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.167 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:18:28.167 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.167 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.168 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.168 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.168 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524311+0000", 2024-09-12T16:18:28.168 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028626299999999998 2024-09-12T16:18:28.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.168 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.168 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.168 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524315+0000", 2024-09-12T16:18:28.169 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0969999999999999e-06 2024-09-12T16:18:28.169 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.169 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.169 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.169 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524325+0000", 2024-09-12T16:18:28.169 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6330000000000008e-06 2024-09-12T16:18:28.169 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.169 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.169 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.170 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524332+0000", 2024-09-12T16:18:28.170 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8700000000000003e-06 2024-09-12T16:18:28.170 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.170 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.170 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.171 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577334+0000", 2024-09-12T16:18:28.171 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053001834999999997 2024-09-12T16:18:28.171 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.171 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.171 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.171 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577420+0000", 2024-09-12T16:18:28.171 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6145999999999998e-05 2024-09-12T16:18:28.171 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.171 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.171 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.172 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577522+0000", 2024-09-12T16:18:28.172 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010267 2024-09-12T16:18:28.172 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.172 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.172 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.172 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.172 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.172 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14047 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5088256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:28.172 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:18:28.172 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 128.589569173, 2024-09-12T16:18:28.172 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053433340000000003, 2024-09-12T16:18:28.172 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.172 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.173 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:28.173 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.173 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:28.173 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:28.173 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14047 2024-09-12T16:18:28.173 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.173 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.173 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.173 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.173 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:18:28.173 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.173 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.173 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.173 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.174 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:18:28.174 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.174 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.174 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.174 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.174 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524727+0000", 2024-09-12T16:18:28.174 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000216126 2024-09-12T16:18:28.174 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.174 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.174 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.174 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524732+0000", 2024-09-12T16:18:28.174 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1569999999999999e-06 2024-09-12T16:18:28.174 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.174 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.175 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.175 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524742+0000", 2024-09-12T16:18:28.175 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0186999999999999e-05 2024-09-12T16:18:28.175 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.175 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.175 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.175 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524750+0000", 2024-09-12T16:18:28.176 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4279999999999999e-06 2024-09-12T16:18:28.176 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.176 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.176 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.176 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577743+0000", 2024-09-12T16:18:28.176 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052993077 2024-09-12T16:18:28.176 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.176 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.176 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.176 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577841+0000", 2024-09-12T16:18:28.176 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8369000000000006e-05 2024-09-12T16:18:28.176 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.177 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.177 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.177 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577944+0000", 2024-09-12T16:18:28.177 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102996 2024-09-12T16:18:28.177 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.177 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.177 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.177 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.177 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.177 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14048 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5092352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:28.177 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:18:28.177 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 128.58931758, 2024-09-12T16:18:28.178 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053397515, 2024-09-12T16:18:28.178 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.178 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.178 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:28.178 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.178 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:28.178 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:28.178 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14048 2024-09-12T16:18:28.178 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.178 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.178 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.178 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.178 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:18:28.178 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.179 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.179 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.179 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.179 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:18:28.179 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.179 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.179 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.179 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.179 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524957+0000", 2024-09-12T16:18:28.179 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019516999999999999 2024-09-12T16:18:28.179 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.179 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.179 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.179 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524962+0000", 2024-09-12T16:18:28.180 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7709999999999997e-06 2024-09-12T16:18:28.180 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.180 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.180 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.180 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524973+0000", 2024-09-12T16:18:28.180 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1031e-05 2024-09-12T16:18:28.180 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.180 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.180 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.180 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524980+0000", 2024-09-12T16:18:28.180 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6100000000000002e-06 2024-09-12T16:18:28.180 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.181 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.181 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.181 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577977+0000", 2024-09-12T16:18:28.181 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052997481999999999 2024-09-12T16:18:28.181 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.181 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.181 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.181 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578062+0000", 2024-09-12T16:18:28.181 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4851000000000005e-05 2024-09-12T16:18:28.181 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.181 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.181 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.181 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578160+0000", 2024-09-12T16:18:28.181 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7600000000000001e-05 2024-09-12T16:18:28.182 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.182 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.182 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.182 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.182 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14049 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5096448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:28.182 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:18:28.182 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 128.589088952, 2024-09-12T16:18:28.182 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053439792, 2024-09-12T16:18:28.182 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.182 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.182 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:28.182 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.183 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:28.183 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:28.183 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14049 2024-09-12T16:18:28.183 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.183 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.183 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.183 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.183 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:18:28.183 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.183 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.183 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.183 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.183 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:18:28.184 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.184 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.184 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.184 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.184 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525170+0000", 2024-09-12T16:18:28.184 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017958500000000001 2024-09-12T16:18:28.184 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.184 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.184 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.184 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525174+0000", 2024-09-12T16:18:28.184 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0239999999999999e-06 2024-09-12T16:18:28.184 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.184 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.184 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.185 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525184+0000", 2024-09-12T16:18:28.185 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5950000000000005e-06 2024-09-12T16:18:28.185 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.185 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.185 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.185 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525191+0000", 2024-09-12T16:18:28.185 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8329999999999996e-06 2024-09-12T16:18:28.185 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.185 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.185 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.185 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578240+0000", 2024-09-12T16:18:28.185 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053049236 2024-09-12T16:18:28.185 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.185 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.186 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.186 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578333+0000", 2024-09-12T16:18:28.186 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2806999999999994e-05 2024-09-12T16:18:28.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.186 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.186 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.187 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578431+0000", 2024-09-12T16:18:28.187 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7712000000000002e-05 2024-09-12T16:18:28.187 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.187 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.187 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.187 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.187 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.187 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14055 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5121024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:28.187 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:18:28.187 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 128.587818261, 2024-09-12T16:18:28.187 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053399038000000003, 2024-09-12T16:18:28.187 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.187 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.188 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:28.188 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.188 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:28.188 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:28.188 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14055 2024-09-12T16:18:28.188 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.188 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.188 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.188 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.188 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:18:28.188 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.188 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.188 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.189 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.189 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:18:28.189 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.189 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.189 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.189 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.189 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526403+0000", 2024-09-12T16:18:28.189 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141571 2024-09-12T16:18:28.189 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.189 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.189 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.189 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526406+0000", 2024-09-12T16:18:28.189 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2660000000000002e-06 2024-09-12T16:18:28.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.190 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.190 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.190 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526420+0000", 2024-09-12T16:18:28.190 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3949e-05 2024-09-12T16:18:28.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.190 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.190 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.190 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526428+0000", 2024-09-12T16:18:28.190 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4250000000000001e-06 2024-09-12T16:18:28.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.191 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.191 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.191 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579476+0000", 2024-09-12T16:18:28.191 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053048349000000002 2024-09-12T16:18:28.191 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.191 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.191 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.191 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579563+0000", 2024-09-12T16:18:28.191 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6502999999999995e-05 2024-09-12T16:18:28.191 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.191 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.191 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.191 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579661+0000", 2024-09-12T16:18:28.191 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7974999999999996e-05 2024-09-12T16:18:28.192 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.192 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.192 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.192 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.192 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.192 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4806.0:3139 3.1e 3:78d5a095:::rbd_data.11552a37e55b.0000000000000000:head [read 69632~61440] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:18:28.192 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:18:28.192 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 117.812824011, 2024-09-12T16:18:28.192 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057851734000000002, 2024-09-12T16:18:28.192 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.192 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.192 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:28.192 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.193 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4806", 2024-09-12T16:18:28.193 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3959815836", 2024-09-12T16:18:28.193 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 3139 2024-09-12T16:18:28.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.193 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.193 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.193 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.193 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:18:28.193 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.193 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.193 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.193 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:18:28.193 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.194 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.194 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.194 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:18:28.194 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4799999999999999e-07 2024-09-12T16:18:28.194 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.194 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.194 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.194 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301258+0000", 2024-09-12T16:18:28.194 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.844e-06 2024-09-12T16:18:28.194 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301267+0000", 2024-09-12T16:18:28.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2960000000000004e-06 2024-09-12T16:18:28.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301276+0000", 2024-09-12T16:18:28.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0650000000000005e-06 2024-09-12T16:18:28.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301871+0000", 2024-09-12T16:18:28.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00059423600000000005 2024-09-12T16:18:28.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.196 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.196 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301920+0000", 2024-09-12T16:18:28.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9067000000000003e-05 2024-09-12T16:18:28.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.196 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.196 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359108+0000", 2024-09-12T16:18:28.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057187877999999998 2024-09-12T16:18:28.196 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.196 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.196 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.197 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.197 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:6428 3.14 3:28a44e54:::rbd_header.11552a37e55b:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:18:28.197 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:18:28.197 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 117.81249541699999, 2024-09-12T16:18:28.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057504023000000001, 2024-09-12T16:18:28.197 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.197 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.197 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:28.197 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.197 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:18:28.197 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:18:28.198 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6428 2024-09-12T16:18:28.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.198 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.198 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.198 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.198 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:18:28.198 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.198 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.198 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.198 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:18:28.198 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.198 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.198 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.199 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301585+0000", 2024-09-12T16:18:28.199 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6300000000000005e-07 2024-09-12T16:18:28.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.199 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301588+0000", 2024-09-12T16:18:28.199 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4149999999999999e-06 2024-09-12T16:18:28.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.199 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301597+0000", 2024-09-12T16:18:28.199 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5450000000000003e-06 2024-09-12T16:18:28.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301617+0000", 2024-09-12T16:18:28.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9837e-05 2024-09-12T16:18:28.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301779+0000", 2024-09-12T16:18:28.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016186799999999999 2024-09-12T16:18:28.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301855+0000", 2024-09-12T16:18:28.201 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5899e-05 2024-09-12T16:18:28.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.201 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.201 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.201 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359088+0000", 2024-09-12T16:18:28.201 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057233895999999999 2024-09-12T16:18:28.201 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.201 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.201 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.201 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.202 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5223.0:1814 3.f 3:f7b1b1c5:::rbd_object_map.1155a1fd27d2:head [read 0~136] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-12T16:18:28.202 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:18:28.202 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 81.876829353000005, 2024-09-12T16:18:28.202 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.006378226, 2024-09-12T16:18:28.202 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.202 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.202 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:28.202 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.202 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5223", 2024-09-12T16:18:28.202 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/4066330994", 2024-09-12T16:18:28.202 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1814 2024-09-12T16:18:28.202 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.202 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:18:28.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:18:28.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.204 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237252+0000", 2024-09-12T16:18:28.204 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.344e-06 2024-09-12T16:18:28.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.204 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.204 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.204 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237258+0000", 2024-09-12T16:18:28.204 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1070000000000001e-06 2024-09-12T16:18:28.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.204 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.204 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.204 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237270+0000", 2024-09-12T16:18:28.204 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1758e-05 2024-09-12T16:18:28.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.205 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.205 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237278+0000", 2024-09-12T16:18:28.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3219999999999993e-06 2024-09-12T16:18:28.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.205 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.205 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237334+0000", 2024-09-12T16:18:28.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6356e-05 2024-09-12T16:18:28.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.205 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:28.206 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237345+0000", 2024-09-12T16:18:28.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0433e-05 2024-09-12T16:18:28.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.206 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.206 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.206 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243426+0000", 2024-09-12T16:18:28.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.00608133 2024-09-12T16:18:28.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.206 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.206 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.206 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243534+0000", 2024-09-12T16:18:28.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010784 2024-09-12T16:18:28.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.207 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.207 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243629+0000", 2024-09-12T16:18:28.207 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4735999999999996e-05 2024-09-12T16:18:28.207 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.207 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.207 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.207 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5328.0:2542 3.16 3:6928f3a1:::rbd_object_map.11551722dd77:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:18:28.207 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:18:28.207 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 76.058483922999997, 2024-09-12T16:18:28.207 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.054219934999999997, 2024-09-12T16:18:28.208 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.208 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.208 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:28.208 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.208 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5328", 2024-09-12T16:18:28.208 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:18:28.208 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2542 2024-09-12T16:18:28.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.208 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.208 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.208 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.208 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:18:28.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:18:28.209 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055597+0000", 2024-09-12T16:18:28.209 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4300000000000001e-07 2024-09-12T16:18:28.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055602+0000", 2024-09-12T16:18:28.209 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4269999999999999e-06 2024-09-12T16:18:28.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.210 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.210 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.210 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055613+0000", 2024-09-12T16:18:28.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0815000000000001e-05 2024-09-12T16:18:28.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.210 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.210 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.210 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055621+0000", 2024-09-12T16:18:28.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4189999999999996e-06 2024-09-12T16:18:28.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.210 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.210 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.210 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102196+0000", 2024-09-12T16:18:28.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.046575616 2024-09-12T16:18:28.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.211 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.211 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102258+0000", 2024-09-12T16:18:28.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1872000000000007e-05 2024-09-12T16:18:28.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.211 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T16:18:28.211 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102601+0000", 2024-09-12T16:18:28.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034285700000000001 2024-09-12T16:18:28.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.211 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:28.211 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.104431+0000", 2024-09-12T16:18:28.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001830524 2024-09-12T16:18:28.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:18:28.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109733+0000", 2024-09-12T16:18:28.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0053020089999999999 2024-09-12T16:18:28.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:28.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109777+0000", 2024-09-12T16:18:28.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3754000000000002e-05 2024-09-12T16:18:28.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.213 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109816+0000", 2024-09-12T16:18:28.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8699000000000003e-05 2024-09-12T16:18:28.213 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.213 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.213 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.213 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5328.0:2543 3.16 3:6928f3a1:::rbd_object_map.11551722dd77:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:18:28.213 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:18:28.213 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 76.057889943999996, 2024-09-12T16:18:28.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053695720000000002, 2024-09-12T16:18:28.213 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.214 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.214 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:28.214 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.214 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5328", 2024-09-12T16:18:28.214 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:18:28.214 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2543 2024-09-12T16:18:28.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.214 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.214 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.214 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:18:28.214 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.215 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.215 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:18:28.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.215 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.215 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056191+0000", 2024-09-12T16:18:28.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.54e-07 2024-09-12T16:18:28.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.215 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.215 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056195+0000", 2024-09-12T16:18:28.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5460000000000002e-06 2024-09-12T16:18:28.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.216 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.216 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056205+0000", 2024-09-12T16:18:28.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7350000000000008e-06 2024-09-12T16:18:28.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.216 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.216 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056214+0000", 2024-09-12T16:18:28.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8089999999999999e-06 2024-09-12T16:18:28.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103317+0000", 2024-09-12T16:18:28.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.047102889000000002 2024-09-12T16:18:28.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103410+0000", 2024-09-12T16:18:28.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3689000000000004e-05 2024-09-12T16:18:28.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T16:18:28.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103754+0000", 2024-09-12T16:18:28.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034344699999999998 2024-09-12T16:18:28.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:28.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.106487+0000", 2024-09-12T16:18:28.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0027330100000000001 2024-09-12T16:18:28.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:18:28.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109827+0000", 2024-09-12T16:18:28.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033406640000000001 2024-09-12T16:18:28.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:28.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109854+0000", 2024-09-12T16:18:28.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6866999999999999e-05 2024-09-12T16:18:28.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109886+0000", 2024-09-12T16:18:28.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1309999999999997e-05 2024-09-12T16:18:28.219 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.219 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.219 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.220 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.220 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5832.0:1710 3.f 3:f0d97d21:::rbd_data.1155d3b3a2ae.0000000000000012:head [truncate 1376256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-12T16:18:28.220 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:18:28.220 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 40.730091858999998, 2024-09-12T16:18:28.220 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6441524489999999, 2024-09-12T16:18:28.220 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.220 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.220 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:28.220 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.220 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5832", 2024-09-12T16:18:28.220 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/201125203", 2024-09-12T16:18:28.220 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1710 2024-09-12T16:18:28.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.221 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.221 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.221 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.221 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:18:28.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.221 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.221 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.221 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:18:28.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.221 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.221 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.221 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:18:28.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.08e-07 2024-09-12T16:18:28.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.222 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383990+0000", 2024-09-12T16:18:28.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.979e-06 2024-09-12T16:18:28.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.222 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383999+0000", 2024-09-12T16:18:28.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3240000000000003e-06 2024-09-12T16:18:28.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.384002+0000", 2024-09-12T16:18:28.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5489999999999998e-06 2024-09-12T16:18:28.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.384037+0000", 2024-09-12T16:18:28.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4931000000000001e-05 2024-09-12T16:18:28.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:28.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.384043+0000", 2024-09-12T16:18:28.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3920000000000002e-06 2024-09-12T16:18:28.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:48.007976+0000", 2024-09-12T16:18:28.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.62393385300000004 2024-09-12T16:18:28.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:28.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:48.007992+0000", 2024-09-12T16:18:28.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5668e-05 2024-09-12T16:18:28.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024187+0000", 2024-09-12T16:18:28.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0161951629999999 2024-09-12T16:18:28.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024362+0000", 2024-09-12T16:18:28.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017500600000000001 2024-09-12T16:18:28.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:18:28.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024453+0000", 2024-09-12T16:18:28.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1055000000000001e-05 2024-09-12T16:18:28.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:18:28.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024963+0000", 2024-09-12T16:18:28.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000510087 2024-09-12T16:18:28.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:28.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.027974+0000", 2024-09-12T16:18:28.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030107070000000001 2024-09-12T16:18:28.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:28.227 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.028022+0000", 2024-09-12T16:18:28.227 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7636000000000003e-05 2024-09-12T16:18:28.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.227 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.227 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.227 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.028140+0000", 2024-09-12T16:18:28.227 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011869100000000001 2024-09-12T16:18:28.227 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.227 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.227 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.227 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.227 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.227 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:28.228 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T16:18:28.230 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:18:28.230 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:28.227+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:28.329 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:28.328+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:28.378 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:28.378 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:28.379 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:18:28.379 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:28.387 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:18:28.430 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:28.429+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:28.531 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:28.530+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:28.535 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:28.535 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:28.535 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:18:28.536 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:18:28.536 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:28.544 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:18:28.631 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:28.630+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:28.693 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:28.693 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:18:28.693 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:18:28.694 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:18:28.694 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.694 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5599 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4788224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:28.694 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:18:28.694 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 108.39521787699999, 2024-09-12T16:18:28.694 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061192059, 2024-09-12T16:18:28.694 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.694 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.694 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:28.694 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.694 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:28.695 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:28.695 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5599 2024-09-12T16:18:28.695 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.695 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.695 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.695 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.695 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:18:28.695 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.695 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.695 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.695 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.696 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:18:28.696 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.696 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.696 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.696 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.696 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296333+0000", 2024-09-12T16:18:28.696 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6599999999999996e-07 2024-09-12T16:18:28.696 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.696 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.696 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.696 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296335+0000", 2024-09-12T16:18:28.697 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5900000000000002e-06 2024-09-12T16:18:28.697 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.697 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.697 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.697 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296344+0000", 2024-09-12T16:18:28.697 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9539999999999993e-06 2024-09-12T16:18:28.697 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.697 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.697 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.697 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296350+0000", 2024-09-12T16:18:28.697 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5589999999999996e-06 2024-09-12T16:18:28.698 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.698 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.698 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.698 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357307+0000", 2024-09-12T16:18:28.698 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.060957573000000001 2024-09-12T16:18:28.698 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.698 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.698 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.698 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357401+0000", 2024-09-12T16:18:28.699 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3512999999999997e-05 2024-09-12T16:18:28.699 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.699 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.699 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.699 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357524+0000", 2024-09-12T16:18:28.699 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000123304 2024-09-12T16:18:28.699 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.699 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.699 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.699 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.699 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.699 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5611 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4730880~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:28.700 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:18:28.700 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 108.395155433, 2024-09-12T16:18:28.700 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061359348000000001, 2024-09-12T16:18:28.700 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.700 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.700 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:28.700 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.700 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:28.700 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:28.700 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5611 2024-09-12T16:18:28.701 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.701 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.701 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.701 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.701 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:18:28.701 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.701 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.701 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.701 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.701 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:18:28.701 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.702 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.702 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.702 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.702 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296395+0000", 2024-09-12T16:18:28.702 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4600000000000003e-07 2024-09-12T16:18:28.702 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.702 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.702 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.702 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296399+0000", 2024-09-12T16:18:28.702 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9430000000000002e-06 2024-09-12T16:18:28.702 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.702 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.703 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.703 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296411+0000", 2024-09-12T16:18:28.703 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1755e-05 2024-09-12T16:18:28.703 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.703 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.703 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.703 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296417+0000", 2024-09-12T16:18:28.703 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3790000000000003e-06 2024-09-12T16:18:28.703 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.703 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.703 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.703 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357572+0000", 2024-09-12T16:18:28.704 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061154871 2024-09-12T16:18:28.704 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.704 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.704 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.704 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357663+0000", 2024-09-12T16:18:28.704 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0389999999999993e-05 2024-09-12T16:18:28.704 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.704 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.704 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.704 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357754+0000", 2024-09-12T16:18:28.704 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1063999999999994e-05 2024-09-12T16:18:28.705 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.705 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.705 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.705 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.705 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.705 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5613 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4775936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:28.705 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:18:28.705 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 108.395114253, 2024-09-12T16:18:28.705 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061491777999999997, 2024-09-12T16:18:28.705 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.705 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.705 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:28.706 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.706 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:28.706 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:28.706 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5613 2024-09-12T16:18:28.706 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.706 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.706 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.706 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.706 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:18:28.706 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.706 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.706 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.707 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.707 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:18:28.707 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.707 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.707 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.707 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.707 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:18:28.707 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8899999999999999e-07 2024-09-12T16:18:28.707 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.707 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.707 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.708 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296439+0000", 2024-09-12T16:18:28.708 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8439999999999998e-06 2024-09-12T16:18:28.708 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.708 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.708 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.708 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296452+0000", 2024-09-12T16:18:28.708 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2639e-05 2024-09-12T16:18:28.708 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.708 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.708 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.708 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296457+0000", 2024-09-12T16:18:28.708 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5720000000000002e-06 2024-09-12T16:18:28.709 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.709 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.709 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.709 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357773+0000", 2024-09-12T16:18:28.709 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061315500000000002 2024-09-12T16:18:28.709 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.709 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.709 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.709 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357814+0000", 2024-09-12T16:18:28.710 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1448e-05 2024-09-12T16:18:28.710 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.710 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.710 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.710 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357927+0000", 2024-09-12T16:18:28.710 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000113186 2024-09-12T16:18:28.710 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.710 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.710 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.710 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.710 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.710 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5616 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4784128~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:28.711 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:18:28.711 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 108.39507919099999, 2024-09-12T16:18:28.711 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061725002000000001, 2024-09-12T16:18:28.711 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.711 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.711 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:28.711 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.711 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:28.711 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:28.711 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5616 2024-09-12T16:18:28.711 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.711 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.712 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.712 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.712 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:18:28.712 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.712 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.712 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.712 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.712 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:18:28.712 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.712 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.712 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.712 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.713 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:18:28.713 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5900000000000002e-07 2024-09-12T16:18:28.713 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.713 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.713 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.713 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296473+0000", 2024-09-12T16:18:28.713 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3130000000000001e-06 2024-09-12T16:18:28.713 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.713 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.713 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.713 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296481+0000", 2024-09-12T16:18:28.713 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1389999999999998e-06 2024-09-12T16:18:28.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.714 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.714 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.714 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296486+0000", 2024-09-12T16:18:28.714 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3310000000000003e-06 2024-09-12T16:18:28.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.714 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.714 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.714 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357981+0000", 2024-09-12T16:18:28.714 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061494866000000002 2024-09-12T16:18:28.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.715 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.715 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.715 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358082+0000", 2024-09-12T16:18:28.715 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101424 2024-09-12T16:18:28.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.715 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.715 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.715 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358196+0000", 2024-09-12T16:18:28.715 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011347 2024-09-12T16:18:28.715 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.715 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.716 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.716 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.716 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.716 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5626 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4739072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:28.716 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:18:28.716 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 108.395001235, 2024-09-12T16:18:28.716 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061802430999999998, 2024-09-12T16:18:28.717 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.717 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.717 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:28.717 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.717 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:28.717 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:28.717 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5626 2024-09-12T16:18:28.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.717 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.717 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.717 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.717 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:18:28.717 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.718 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.718 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.718 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:18:28.718 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.718 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.718 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.718 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.718 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296550+0000", 2024-09-12T16:18:28.718 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.215e-06 2024-09-12T16:18:28.718 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.718 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.718 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.718 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296555+0000", 2024-09-12T16:18:28.719 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9590000000000003e-06 2024-09-12T16:18:28.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.719 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.719 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.719 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296568+0000", 2024-09-12T16:18:28.719 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3338e-05 2024-09-12T16:18:28.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.719 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.719 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.719 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296576+0000", 2024-09-12T16:18:28.719 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5510000000000002e-06 2024-09-12T16:18:28.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.719 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.720 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.720 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358241+0000", 2024-09-12T16:18:28.720 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.06166576 2024-09-12T16:18:28.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.720 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.720 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.720 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358288+0000", 2024-09-12T16:18:28.720 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6097000000000003e-05 2024-09-12T16:18:28.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.720 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.720 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.720 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358351+0000", 2024-09-12T16:18:28.721 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3510999999999996e-05 2024-09-12T16:18:28.721 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.721 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.721 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.721 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.721 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.721 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5628 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4792320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:28.721 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:18:28.721 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 108.394958735, 2024-09-12T16:18:28.721 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061961161000000001, 2024-09-12T16:18:28.721 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.721 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.721 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:28.721 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.722 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:28.722 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:28.722 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5628 2024-09-12T16:18:28.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.722 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.722 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.722 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.722 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:18:28.722 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.722 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.722 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.722 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:18:28.722 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.723 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.723 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.723 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296592+0000", 2024-09-12T16:18:28.723 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2099999999999996e-07 2024-09-12T16:18:28.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.723 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.723 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.723 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296595+0000", 2024-09-12T16:18:28.723 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0429999999999999e-06 2024-09-12T16:18:28.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.723 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.723 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.724 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296603+0000", 2024-09-12T16:18:28.724 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9899999999999997e-06 2024-09-12T16:18:28.724 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.724 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.724 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.724 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296609+0000", 2024-09-12T16:18:28.724 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7259999999999999e-06 2024-09-12T16:18:28.724 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.724 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.724 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.724 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358393+0000", 2024-09-12T16:18:28.724 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061784617 2024-09-12T16:18:28.724 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.724 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.724 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.725 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358460+0000", 2024-09-12T16:18:28.725 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7253000000000001e-05 2024-09-12T16:18:28.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.725 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.725 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.725 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358552+0000", 2024-09-12T16:18:28.725 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1811000000000006e-05 2024-09-12T16:18:28.725 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.725 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.725 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.725 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.725 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5638 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4734976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:28.726 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:18:28.726 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 108.394486184, 2024-09-12T16:18:28.726 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061654460000000001, 2024-09-12T16:18:28.726 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.726 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.726 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:28.726 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.726 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:28.726 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:28.726 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5638 2024-09-12T16:18:28.726 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.726 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.726 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.727 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:18:28.727 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.727 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:18:28.727 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.727 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:18:28.727 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.23e-07 2024-09-12T16:18:28.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.728 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.728 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297068+0000", 2024-09-12T16:18:28.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0060000000000003e-06 2024-09-12T16:18:28.728 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.728 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.728 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.728 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297080+0000", 2024-09-12T16:18:28.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1234e-05 2024-09-12T16:18:28.728 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.728 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.728 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.728 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297095+0000", 2024-09-12T16:18:28.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5698000000000001e-05 2024-09-12T16:18:28.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.729 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.729 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.729 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358582+0000", 2024-09-12T16:18:28.729 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061486274 2024-09-12T16:18:28.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.729 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.729 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.729 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358637+0000", 2024-09-12T16:18:28.729 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5439999999999998e-05 2024-09-12T16:18:28.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.729 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.729 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.729 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358718+0000", 2024-09-12T16:18:28.730 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0984999999999998e-05 2024-09-12T16:18:28.730 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.730 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.730 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.730 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5640 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4780032~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:28.730 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:18:28.730 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 108.394404464, 2024-09-12T16:18:28.730 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061746620000000002, 2024-09-12T16:18:28.730 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.730 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.730 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:28.730 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.731 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:28.731 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:28.731 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5640 2024-09-12T16:18:28.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.731 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.731 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.731 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:18:28.731 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.731 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.731 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:18:28.731 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297146+0000", 2024-09-12T16:18:28.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3600000000000003e-07 2024-09-12T16:18:28.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297150+0000", 2024-09-12T16:18:28.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8430000000000003e-06 2024-09-12T16:18:28.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297160+0000", 2024-09-12T16:18:28.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7229999999999999e-06 2024-09-12T16:18:28.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.733 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.733 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.733 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297167+0000", 2024-09-12T16:18:28.733 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0180000000000004e-06 2024-09-12T16:18:28.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.733 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.733 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.733 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358750+0000", 2024-09-12T16:18:28.733 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061583104 2024-09-12T16:18:28.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.733 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.733 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.733 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358804+0000", 2024-09-12T16:18:28.734 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4277000000000002e-05 2024-09-12T16:18:28.734 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.734 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.734 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.734 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358892+0000", 2024-09-12T16:18:28.734 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7918999999999996e-05 2024-09-12T16:18:28.734 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.734 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.734 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.734 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.734 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.734 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5642 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4788224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:28.734 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:18:28.734 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 108.39436012, 2024-09-12T16:18:28.735 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061860409999999998, 2024-09-12T16:18:28.735 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.735 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.735 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:28.735 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.735 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:28.735 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:28.735 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5642 2024-09-12T16:18:28.735 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.735 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.735 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.735 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.735 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:18:28.735 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.735 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.735 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.736 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.736 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:18:28.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.736 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.736 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.736 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:18:28.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7999999999999995e-07 2024-09-12T16:18:28.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.736 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.736 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.736 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297193+0000", 2024-09-12T16:18:28.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8310000000000001e-06 2024-09-12T16:18:28.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.737 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.737 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.737 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297204+0000", 2024-09-12T16:18:28.737 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0832999999999999e-05 2024-09-12T16:18:28.737 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.737 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.737 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.737 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297210+0000", 2024-09-12T16:18:28.737 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1770000000000003e-06 2024-09-12T16:18:28.737 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.737 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.737 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.737 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358928+0000", 2024-09-12T16:18:28.737 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061717826000000003 2024-09-12T16:18:28.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.738 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.738 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.738 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358977+0000", 2024-09-12T16:18:28.738 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9514000000000001e-05 2024-09-12T16:18:28.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.738 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.738 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.738 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359050+0000", 2024-09-12T16:18:28.738 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2649000000000002e-05 2024-09-12T16:18:28.738 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.738 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.738 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.739 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5646 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4743168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:28.739 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:18:28.739 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 108.394180179, 2024-09-12T16:18:28.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061822122, 2024-09-12T16:18:28.739 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.739 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.739 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:28.739 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.739 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:28.739 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:28.739 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5646 2024-09-12T16:18:28.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.740 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.740 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.740 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.740 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:18:28.740 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.740 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.740 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.740 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:18:28.740 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.740 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.741 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.741 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:18:28.741 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3200000000000004e-07 2024-09-12T16:18:28.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.741 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.741 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.741 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297374+0000", 2024-09-12T16:18:28.741 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8240000000000001e-06 2024-09-12T16:18:28.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.741 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.741 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.741 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297384+0000", 2024-09-12T16:18:28.741 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5710000000000004e-06 2024-09-12T16:18:28.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.742 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.742 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297390+0000", 2024-09-12T16:18:28.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5130000000000002e-06 2024-09-12T16:18:28.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.742 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.742 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359080+0000", 2024-09-12T16:18:28.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061689569999999999 2024-09-12T16:18:28.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.742 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.742 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359134+0000", 2024-09-12T16:18:28.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3838999999999997e-05 2024-09-12T16:18:28.743 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359192+0000", 2024-09-12T16:18:28.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8072999999999998e-05 2024-09-12T16:18:28.743 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.743 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.743 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.743 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.743 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5647 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4751360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:28.743 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:18:28.743 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 108.39414349400001, 2024-09-12T16:18:28.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061927569000000002, 2024-09-12T16:18:28.744 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.744 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.744 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:28.744 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.744 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:28.744 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:28.744 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5647 2024-09-12T16:18:28.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.744 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.744 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.744 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:18:28.745 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.745 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.745 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.745 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.745 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:18:28.745 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.745 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.745 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.745 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.745 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297407+0000", 2024-09-12T16:18:28.745 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.46e-07 2024-09-12T16:18:28.745 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.745 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.745 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.746 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297409+0000", 2024-09-12T16:18:28.746 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.469e-06 2024-09-12T16:18:28.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.746 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.746 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.746 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297415+0000", 2024-09-12T16:18:28.746 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9259999999999997e-06 2024-09-12T16:18:28.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.746 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.746 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.746 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297419+0000", 2024-09-12T16:18:28.746 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3840000000000001e-06 2024-09-12T16:18:28.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.746 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.747 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359224+0000", 2024-09-12T16:18:28.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061805367999999999 2024-09-12T16:18:28.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.747 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359275+0000", 2024-09-12T16:18:28.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1338000000000002e-05 2024-09-12T16:18:28.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.747 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359334+0000", 2024-09-12T16:18:28.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8638000000000003e-05 2024-09-12T16:18:28.748 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.748 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.748 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.748 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5649 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4796416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:28.748 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:18:28.748 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 108.394088635, 2024-09-12T16:18:28.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.062018578999999997, 2024-09-12T16:18:28.748 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.748 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.748 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:28.748 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.748 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:28.749 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:28.749 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5649 2024-09-12T16:18:28.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.749 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.749 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.749 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:18:28.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.749 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.749 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:18:28.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.750 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.750 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.750 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.750 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297462+0000", 2024-09-12T16:18:28.750 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2399999999999998e-07 2024-09-12T16:18:28.750 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.750 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.750 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.750 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297465+0000", 2024-09-12T16:18:28.750 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.371e-06 2024-09-12T16:18:28.750 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.750 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.750 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.751 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297473+0000", 2024-09-12T16:18:28.751 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4699999999999996e-06 2024-09-12T16:18:28.751 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.751 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.751 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.751 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297478+0000", 2024-09-12T16:18:28.751 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2780000000000001e-06 2024-09-12T16:18:28.751 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.751 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.751 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.751 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359368+0000", 2024-09-12T16:18:28.751 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061889758000000003 2024-09-12T16:18:28.751 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.752 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.752 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.752 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359420+0000", 2024-09-12T16:18:28.752 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2574999999999997e-05 2024-09-12T16:18:28.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.752 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.752 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.752 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359480+0000", 2024-09-12T16:18:28.752 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9503000000000003e-05 2024-09-12T16:18:28.752 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.752 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.752 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.753 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.753 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5674 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4739072~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:28.753 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:18:28.753 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 108.393684867, 2024-09-12T16:18:28.753 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061762989999999997, 2024-09-12T16:18:28.753 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.753 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.753 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:28.753 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.753 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:28.753 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:28.753 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5674 2024-09-12T16:18:28.753 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.753 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.754 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.754 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.754 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:18:28.754 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.754 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.754 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.754 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.754 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:18:28.754 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.754 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.754 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.754 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.754 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297866+0000", 2024-09-12T16:18:28.755 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1900000000000001e-07 2024-09-12T16:18:28.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.755 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.755 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.755 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297870+0000", 2024-09-12T16:18:28.755 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3560000000000003e-06 2024-09-12T16:18:28.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.755 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.755 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.755 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297888+0000", 2024-09-12T16:18:28.755 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8088999999999999e-05 2024-09-12T16:18:28.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.755 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.756 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.756 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297904+0000", 2024-09-12T16:18:28.756 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5971e-05 2024-09-12T16:18:28.756 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.756 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.756 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.756 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359510+0000", 2024-09-12T16:18:28.756 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061605634999999999 2024-09-12T16:18:28.756 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.756 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.756 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.756 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359554+0000", 2024-09-12T16:18:28.756 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4024999999999999e-05 2024-09-12T16:18:28.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.757 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.757 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.757 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359628+0000", 2024-09-12T16:18:28.757 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4095000000000001e-05 2024-09-12T16:18:28.757 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.757 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.757 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.757 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.757 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5676 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4792320~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:28.757 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:18:28.757 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 108.39348378699999, 2024-09-12T16:18:28.758 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061720143999999998, 2024-09-12T16:18:28.758 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.758 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.758 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:28.758 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.758 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:28.758 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:28.758 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5676 2024-09-12T16:18:28.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.758 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.758 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.758 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.758 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:18:28.758 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.759 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.759 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.759 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:18:28.759 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.759 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.759 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.759 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.759 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298067+0000", 2024-09-12T16:18:28.759 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8199999999999999e-07 2024-09-12T16:18:28.759 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.759 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.759 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.759 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298070+0000", 2024-09-12T16:18:28.759 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.743e-06 2024-09-12T16:18:28.760 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.760 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.760 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.760 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298080+0000", 2024-09-12T16:18:28.760 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4059999999999994e-06 2024-09-12T16:18:28.760 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.760 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.760 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.760 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298088+0000", 2024-09-12T16:18:28.760 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0779999999999996e-06 2024-09-12T16:18:28.760 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.760 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.760 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.760 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359659+0000", 2024-09-12T16:18:28.760 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061570688999999998 2024-09-12T16:18:28.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.761 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.761 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.761 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359713+0000", 2024-09-12T16:18:28.761 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3939e-05 2024-09-12T16:18:28.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.761 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.761 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.761 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359786+0000", 2024-09-12T16:18:28.761 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3607000000000002e-05 2024-09-12T16:18:28.761 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.761 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.761 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.762 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.762 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5684 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4747264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:28.762 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:18:28.762 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 108.393016495, 2024-09-12T16:18:28.762 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061394799, 2024-09-12T16:18:28.762 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.762 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.762 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:28.762 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.762 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:28.762 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:28.762 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5684 2024-09-12T16:18:28.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.762 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.763 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.763 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.763 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:18:28.763 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.763 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.763 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.763 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.763 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:18:28.763 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.763 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.763 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.763 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.763 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298534+0000", 2024-09-12T16:18:28.763 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4399999999999999e-07 2024-09-12T16:18:28.763 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.764 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.764 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.764 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298539+0000", 2024-09-12T16:18:28.764 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5360000000000003e-06 2024-09-12T16:18:28.764 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.764 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.764 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.764 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298550+0000", 2024-09-12T16:18:28.764 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1499e-05 2024-09-12T16:18:28.764 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.764 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.764 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.764 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298558+0000", 2024-09-12T16:18:28.765 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3000000000000004e-06 2024-09-12T16:18:28.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.765 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.765 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.765 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359815+0000", 2024-09-12T16:18:28.765 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061257952999999997 2024-09-12T16:18:28.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.765 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.765 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.765 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359868+0000", 2024-09-12T16:18:28.765 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2317000000000001e-05 2024-09-12T16:18:28.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.766 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359928+0000", 2024-09-12T16:18:28.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0350000000000003e-05 2024-09-12T16:18:28.766 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.766 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.766 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.766 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5686 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4755456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:28.766 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:18:28.766 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 108.392849071, 2024-09-12T16:18:28.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061355082999999998, 2024-09-12T16:18:28.766 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.767 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.767 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:28.767 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.767 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:28.767 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:28.767 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5686 2024-09-12T16:18:28.767 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.767 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.767 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.767 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.767 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:18:28.767 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.767 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.767 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.767 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.768 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:18:28.768 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.768 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.768 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.768 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.768 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298702+0000", 2024-09-12T16:18:28.768 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2399999999999997e-07 2024-09-12T16:18:28.768 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.768 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.768 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.768 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298706+0000", 2024-09-12T16:18:28.768 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5700000000000003e-06 2024-09-12T16:18:28.768 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.768 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.769 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.769 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298718+0000", 2024-09-12T16:18:28.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1457999999999999e-05 2024-09-12T16:18:28.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.769 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.769 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298732+0000", 2024-09-12T16:18:28.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.452e-05 2024-09-12T16:18:28.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.769 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.769 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359956+0000", 2024-09-12T16:18:28.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061223626000000003 2024-09-12T16:18:28.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.770 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.770 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360000+0000", 2024-09-12T16:18:28.770 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3922999999999999e-05 2024-09-12T16:18:28.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.770 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.770 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360056+0000", 2024-09-12T16:18:28.770 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6162000000000002e-05 2024-09-12T16:18:28.770 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.770 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.770 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.771 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.771 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5688 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4800512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:28.771 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:18:28.771 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 108.392626018, 2024-09-12T16:18:28.771 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061270514999999998, 2024-09-12T16:18:28.771 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.771 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.771 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:28.771 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.771 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:28.771 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:28.771 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5688 2024-09-12T16:18:28.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.772 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.772 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.772 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:18:28.772 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.772 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.772 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:18:28.772 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.773 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.773 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298925+0000", 2024-09-12T16:18:28.773 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4e-07 2024-09-12T16:18:28.773 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.773 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.773 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.773 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298929+0000", 2024-09-12T16:18:28.773 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9890000000000003e-06 2024-09-12T16:18:28.773 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.773 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.773 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.773 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298936+0000", 2024-09-12T16:18:28.773 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.52e-06 2024-09-12T16:18:28.773 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.774 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.774 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.774 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298941+0000", 2024-09-12T16:18:28.774 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4800000000000003e-06 2024-09-12T16:18:28.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.774 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.774 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.774 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360087+0000", 2024-09-12T16:18:28.774 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061146143 2024-09-12T16:18:28.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.774 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.774 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.774 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360137+0000", 2024-09-12T16:18:28.775 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0584000000000002e-05 2024-09-12T16:18:28.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.775 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.775 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360194+0000", 2024-09-12T16:18:28.775 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6858999999999999e-05 2024-09-12T16:18:28.775 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.775 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.775 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.775 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5693 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4751360~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:28.775 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:18:28.776 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 108.392204381, 2024-09-12T16:18:28.776 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061139444000000001, 2024-09-12T16:18:28.776 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.776 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.776 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:28.776 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.776 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:28.776 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:28.776 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5693 2024-09-12T16:18:28.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.776 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.776 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.777 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:18:28.777 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.777 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.777 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.777 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:18:28.777 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.777 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.777 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.777 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299346+0000", 2024-09-12T16:18:28.777 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2300000000000001e-07 2024-09-12T16:18:28.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.778 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.778 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299349+0000", 2024-09-12T16:18:28.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5270000000000001e-06 2024-09-12T16:18:28.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.778 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.778 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299358+0000", 2024-09-12T16:18:28.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7030000000000001e-06 2024-09-12T16:18:28.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.778 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.778 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299364+0000", 2024-09-12T16:18:28.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7239999999999997e-06 2024-09-12T16:18:28.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360369+0000", 2024-09-12T16:18:28.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061004713000000002 2024-09-12T16:18:28.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360415+0000", 2024-09-12T16:18:28.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5926e-05 2024-09-12T16:18:28.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360485+0000", 2024-09-12T16:18:28.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0327999999999995e-05 2024-09-12T16:18:28.780 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.780 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.780 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.780 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.780 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5694 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4796416~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:28.780 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:18:28.780 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 108.392175352, 2024-09-12T16:18:28.780 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061258034000000003, 2024-09-12T16:18:28.780 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.780 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.780 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:28.780 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.780 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:28.781 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:28.781 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5694 2024-09-12T16:18:28.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.781 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.781 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.781 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.781 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:18:28.781 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.781 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.781 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.781 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:18:28.781 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.782 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.782 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.782 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.782 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301884+0000", 2024-09-12T16:18:28.782 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025090379999999999 2024-09-12T16:18:28.782 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.782 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.782 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.782 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301889+0000", 2024-09-12T16:18:28.782 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5879999999999997e-06 2024-09-12T16:18:28.782 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.782 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.782 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.782 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301901+0000", 2024-09-12T16:18:28.782 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1466e-05 2024-09-12T16:18:28.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.783 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.783 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301908+0000", 2024-09-12T16:18:28.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1999999999999997e-06 2024-09-12T16:18:28.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.783 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.783 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360513+0000", 2024-09-12T16:18:28.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.058605023999999999 2024-09-12T16:18:28.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.783 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.783 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360562+0000", 2024-09-12T16:18:28.784 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9546000000000003e-05 2024-09-12T16:18:28.784 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.784 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.784 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.784 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360633+0000", 2024-09-12T16:18:28.784 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0172000000000005e-05 2024-09-12T16:18:28.784 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.784 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.784 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.784 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.784 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.784 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:28537 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_get_id in=13b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-12T16:18:28.784 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:24.151599+0000", 2024-09-12T16:18:28.785 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.5399505539999998, 2024-09-12T16:18:28.785 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.99758962900000003, 2024-09-12T16:18:28.785 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:28.785 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:28.785 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:28.785 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:28.785 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:18:28.785 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:18:28.785 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 28537 2024-09-12T16:18:28.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.785 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:28.785 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.785 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:28.786 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.151599+0000", 2024-09-12T16:18:28.786 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.786 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.786 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:28.786 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.151599+0000", 2024-09-12T16:18:28.786 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:28.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.786 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.786 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:28.786 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.151601+0000", 2024-09-12T16:18:28.786 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4130000000000001e-06 2024-09-12T16:18:28.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.786 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.787 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:28.787 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.151606+0000", 2024-09-12T16:18:28.787 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.502e-06 2024-09-12T16:18:28.787 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.787 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.787 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:28.787 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.151618+0000", 2024-09-12T16:18:28.787 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1430999999999999e-05 2024-09-12T16:18:28.787 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.787 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.787 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:28.787 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.151623+0000", 2024-09-12T16:18:28.787 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3109999999999996e-06 2024-09-12T16:18:28.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.788 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.788 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.788 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.151681+0000", 2024-09-12T16:18:28.788 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8068e-05 2024-09-12T16:18:28.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.788 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.788 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:28.788 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.151689+0000", 2024-09-12T16:18:28.788 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9000000000000006e-06 2024-09-12T16:18:28.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.788 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.788 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:28.788 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.148883+0000", 2024-09-12T16:18:28.789 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.99719448399999999 2024-09-12T16:18:28.789 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.789 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.789 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:28.789 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.149018+0000", 2024-09-12T16:18:28.789 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000134733 2024-09-12T16:18:28.789 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:28.789 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:28.789 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:28.789 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.149189+0000", 2024-09-12T16:18:28.789 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017078699999999999 2024-09-12T16:18:28.789 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.789 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.789 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.790 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:28.790 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:28.790 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:28.791 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:18:28.792 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:28.790+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:28.892 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:28.891+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:28.938 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:28.939 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:28.939 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:18:28.939 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:28.947 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:18:28.992 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:28.991+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:29.017 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2024-09-12T16:18:29.059 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:29.059 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:29.059 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:18:29.059 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:18:29.059 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:29.067 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:18:29.093 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:29.092+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:29.194 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:29.193+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:29.221 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:29.221 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:18:29.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:18:29.222 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:18:29.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.222 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.17 73/72 [PushOp(3:e9340267:::rbd_data.1155525b14e3.0000000000000031:f, version: 50'357, data_included: [0~4096,20480~4096,40960~8192,65536~4096,81920~8192,110592~4096,126976~8192,151552~4096,172032~8192,196608~4096,212992~8192,241664~4096,258048~8192,282624~4096,303104~8192,327680~4096,344064~8192,372736~4096,389120~8192,413696~4096,434176~8192,458752~4096,475136~8192,503808~4096,520192~8192,544768~4096,565248~8192,589824~4096,606208~8192,634880~4096,651264~8192,675840~4096,696320~8192,720896~4096,737280~8192,765952~4096,782336~8192,806912~4096,827392~8192,851968~4096,868352~8192,897024~4096,913408~8192,937984~4096,958464~8192,983040~4096,999424~8192,1028096~4096,1044480~4096], data_size: 294912, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:e9340267:::rbd_data.1155525b14e3.0000000000000031:f@50'357, size: 1048576, copy_subset: [(0, 1048576)], clone_subset: {}, snapset: f=[]:{f: [f]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T16:18:29.222 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.067448+0000", 2024-09-12T16:18:29.222 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 83.152423274, 2024-09-12T16:18:29.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003036721, 2024-09-12T16:18:29.222 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:29.222 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:29.222 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:29.222 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:29.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:29.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067448+0000", 2024-09-12T16:18:29.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:29.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067448+0000", 2024-09-12T16:18:29.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:29.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067449+0000", 2024-09-12T16:18:29.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2200000000000004e-07 2024-09-12T16:18:29.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:29.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067703+0000", 2024-09-12T16:18:29.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025377199999999998 2024-09-12T16:18:29.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:29.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067723+0000", 2024-09-12T16:18:29.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.986e-05 2024-09-12T16:18:29.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067743+0000", 2024-09-12T16:18:29.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9942e-05 2024-09-12T16:18:29.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:29.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067860+0000", 2024-09-12T16:18:29.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000116959 2024-09-12T16:18:29.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:29.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067872+0000", 2024-09-12T16:18:29.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2928000000000001e-05 2024-09-12T16:18:29.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:29.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.070485+0000", 2024-09-12T16:18:29.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0026127379999999999 2024-09-12T16:18:29.226 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.226 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:29.226 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.226 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5120.0:3941 3.17 e80/74 3:eff97428:::rbd_data.1155a3b3a26e.0000000000000060:head v 80'442, mlcod=79'439)", 2024-09-12T16:18:29.226 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:18:29.226 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 72.864082792999994, 2024-09-12T16:18:29.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0035981759999999998, 2024-09-12T16:18:29.226 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:29.227 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:29.227 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:29.227 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:29.227 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.227 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:29.227 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:18:29.227 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.227 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.227 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:29.227 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:18:29.227 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.228 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:29.228 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:18:29.228 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2e-07 2024-09-12T16:18:29.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.228 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:29.228 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355794+0000", 2024-09-12T16:18:29.228 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.865e-06 2024-09-12T16:18:29.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.228 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:29.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355956+0000", 2024-09-12T16:18:29.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016131699999999999 2024-09-12T16:18:29.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355964+0000", 2024-09-12T16:18:29.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7960000000000001e-06 2024-09-12T16:18:29.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:29.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.356320+0000", 2024-09-12T16:18:29.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000355612 2024-09-12T16:18:29.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:29.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.356337+0000", 2024-09-12T16:18:29.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6643e-05 2024-09-12T16:18:29.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:29.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.359340+0000", 2024-09-12T16:18:29.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003003618 2024-09-12T16:18:29.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:29.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.359387+0000", 2024-09-12T16:18:29.231 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6904999999999999e-05 2024-09-12T16:18:29.231 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.231 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:29.231 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.231 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.231 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2118 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1219, mlcod=88'1217)", 2024-09-12T16:18:29.231 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440434+0000", 2024-09-12T16:18:29.231 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 63.779437903000002, 2024-09-12T16:18:29.231 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003875543, 2024-09-12T16:18:29.231 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:29.231 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:29.231 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:29.231 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:29.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:29.232 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440434+0000", 2024-09-12T16:18:29.232 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:29.232 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440434+0000", 2024-09-12T16:18:29.232 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:29.232 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440435+0000", 2024-09-12T16:18:29.232 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8899999999999998e-07 2024-09-12T16:18:29.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.233 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:29.233 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440444+0000", 2024-09-12T16:18:29.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4599999999999992e-06 2024-09-12T16:18:29.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.233 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:29.233 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440459+0000", 2024-09-12T16:18:29.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4460999999999999e-05 2024-09-12T16:18:29.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.233 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.233 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440466+0000", 2024-09-12T16:18:29.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4340000000000003e-06 2024-09-12T16:18:29.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.234 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.234 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:29.234 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:18:29.234 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9054999999999997e-05 2024-09-12T16:18:29.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.234 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.234 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:29.234 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440535+0000", 2024-09-12T16:18:29.234 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.98e-05 2024-09-12T16:18:29.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.234 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.234 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:29.234 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444269+0000", 2024-09-12T16:18:29.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003734448 2024-09-12T16:18:29.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.235 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.235 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:29.235 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444309+0000", 2024-09-12T16:18:29.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0095999999999997e-05 2024-09-12T16:18:29.235 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.235 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:29.235 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.235 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.235 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2122 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1220, mlcod=88'1217)", 2024-09-12T16:18:29.235 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440484+0000", 2024-09-12T16:18:29.236 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 63.779387397000001, 2024-09-12T16:18:29.236 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0038538029999999998, 2024-09-12T16:18:29.236 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:29.236 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:29.236 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:29.236 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:29.236 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.236 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:29.236 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440484+0000", 2024-09-12T16:18:29.236 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.236 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.236 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.236 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:29.237 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440484+0000", 2024-09-12T16:18:29.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.237 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.237 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:29.237 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440485+0000", 2024-09-12T16:18:29.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6100000000000002e-07 2024-09-12T16:18:29.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.237 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.237 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:29.237 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440493+0000", 2024-09-12T16:18:29.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0169999999999996e-06 2024-09-12T16:18:29.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.237 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.238 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:29.238 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440501+0000", 2024-09-12T16:18:29.238 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9319999999999996e-06 2024-09-12T16:18:29.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.238 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.238 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440506+0000", 2024-09-12T16:18:29.238 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3510000000000001e-06 2024-09-12T16:18:29.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.238 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:29.238 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441319+0000", 2024-09-12T16:18:29.238 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00081295300000000005 2024-09-12T16:18:29.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.239 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:29.239 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441336+0000", 2024-09-12T16:18:29.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6897000000000001e-05 2024-09-12T16:18:29.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.239 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:29.239 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444311+0000", 2024-09-12T16:18:29.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029754510000000001 2024-09-12T16:18:29.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.239 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:29.239 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444338+0000", 2024-09-12T16:18:29.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6840999999999999e-05 2024-09-12T16:18:29.239 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.239 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:29.240 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.240 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.240 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.240 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2124 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1221, mlcod=88'1217)", 2024-09-12T16:18:29.240 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:18:29.240 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 63.779356825000001, 2024-09-12T16:18:29.240 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0038507229999999999, 2024-09-12T16:18:29.240 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:29.240 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:29.240 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:29.240 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:29.240 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.240 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:29.240 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:18:29.241 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.241 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.241 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.241 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:29.241 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:18:29.241 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.241 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.241 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.241 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:29.241 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:18:29.241 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8799999999999998e-07 2024-09-12T16:18:29.241 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.241 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.241 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:29.242 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440519+0000", 2024-09-12T16:18:29.242 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5499999999999999e-06 2024-09-12T16:18:29.242 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.242 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.242 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:29.242 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440525+0000", 2024-09-12T16:18:29.242 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1009999999999997e-06 2024-09-12T16:18:29.242 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.242 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.242 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.242 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440529+0000", 2024-09-12T16:18:29.242 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3749999999999996e-06 2024-09-12T16:18:29.242 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.242 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.243 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:29.243 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441883+0000", 2024-09-12T16:18:29.243 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0013538249999999999 2024-09-12T16:18:29.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.243 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:29.243 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441901+0000", 2024-09-12T16:18:29.243 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7972999999999999e-05 2024-09-12T16:18:29.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.243 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:29.243 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444341+0000", 2024-09-12T16:18:29.243 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002439568 2024-09-12T16:18:29.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.244 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.244 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:29.244 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444366+0000", 2024-09-12T16:18:29.244 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5043000000000001e-05 2024-09-12T16:18:29.244 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.244 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:29.244 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.244 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.244 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2327 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1222, mlcod=88'1217)", 2024-09-12T16:18:29.244 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440696+0000", 2024-09-12T16:18:29.244 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 63.779175483000003, 2024-09-12T16:18:29.244 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0036945739999999999, 2024-09-12T16:18:29.244 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:29.245 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:29.245 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:29.245 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:29.245 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.245 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:29.245 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440696+0000", 2024-09-12T16:18:29.245 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.245 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.245 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:29.245 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440696+0000", 2024-09-12T16:18:29.245 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.246 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.246 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:29.246 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440697+0000", 2024-09-12T16:18:29.246 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5899999999999996e-07 2024-09-12T16:18:29.246 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.246 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.246 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:29.246 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440702+0000", 2024-09-12T16:18:29.246 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0969999999999996e-06 2024-09-12T16:18:29.246 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.246 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.246 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:29.246 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440713+0000", 2024-09-12T16:18:29.246 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1114000000000001e-05 2024-09-12T16:18:29.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.247 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.247 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440719+0000", 2024-09-12T16:18:29.247 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1650000000000003e-06 2024-09-12T16:18:29.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.247 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:29.247 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.442435+0000", 2024-09-12T16:18:29.247 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017155440000000001 2024-09-12T16:18:29.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.247 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:29.247 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.442457+0000", 2024-09-12T16:18:29.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1793999999999998e-05 2024-09-12T16:18:29.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.248 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.248 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:29.248 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444367+0000", 2024-09-12T16:18:29.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0019101980000000001 2024-09-12T16:18:29.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.248 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.248 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:29.248 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444391+0000", 2024-09-12T16:18:29.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4003e-05 2024-09-12T16:18:29.248 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.248 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:29.249 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.249 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2487 3.1d e88/74 3:b8c395a6:::rbd_data.11558d85ce23.000000000000000b:head v 88'1225, mlcod=88'1223)", 2024-09-12T16:18:29.249 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:18:29.249 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 63.773661113999999, 2024-09-12T16:18:29.249 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033166039999999999, 2024-09-12T16:18:29.249 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:29.249 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:29.249 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:29.249 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:29.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.249 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:29.249 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:18:29.250 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.250 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.250 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.250 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:29.250 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:18:29.250 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.250 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.250 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.250 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:29.250 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:18:29.250 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9299999999999997e-07 2024-09-12T16:18:29.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:29.252 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446295+0000", 2024-09-12T16:18:29.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3153999999999997e-05 2024-09-12T16:18:29.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:29.252 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446309+0000", 2024-09-12T16:18:29.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4015e-05 2024-09-12T16:18:29.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446317+0000", 2024-09-12T16:18:29.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4880000000000007e-06 2024-09-12T16:18:29.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:29.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446373+0000", 2024-09-12T16:18:29.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5766000000000001e-05 2024-09-12T16:18:29.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:29.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446395+0000", 2024-09-12T16:18:29.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2500000000000001e-05 2024-09-12T16:18:29.254 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.254 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.254 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:29.254 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.449445+0000", 2024-09-12T16:18:29.254 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003049791 2024-09-12T16:18:29.254 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.254 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.254 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:29.254 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.449527+0000", 2024-09-12T16:18:29.254 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2096999999999997e-05 2024-09-12T16:18:29.254 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.254 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:29.254 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.254 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.255 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "pg_update_log_missing(3.1d epoch 92/74 rep_tid 3087 entries 92'1280 (0'0) error 3:bc3c4c0b:::rbd_data.1155c757bf36.000000000000002c:head by client.5577.0:14343 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 90'1278)", 2024-09-12T16:18:29.255 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.408860+0000", 2024-09-12T16:18:29.255 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 58.811011667999999, 2024-09-12T16:18:29.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0056480419999999998, 2024-09-12T16:18:29.255 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:29.255 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:29.255 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "reached pg", 2024-09-12T16:18:29.255 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:29.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.255 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:29.255 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408860+0000", 2024-09-12T16:18:29.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.256 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:29.256 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408860+0000", 2024-09-12T16:18:29.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.256 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:29.256 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408861+0000", 2024-09-12T16:18:29.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6600000000000002e-07 2024-09-12T16:18:29.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.256 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:29.256 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408867+0000", 2024-09-12T16:18:29.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4150000000000004e-06 2024-09-12T16:18:29.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.257 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:29.257 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408881+0000", 2024-09-12T16:18:29.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4326e-05 2024-09-12T16:18:29.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.257 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.257 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408895+0000", 2024-09-12T16:18:29.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3903000000000001e-05 2024-09-12T16:18:29.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.257 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:29.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410566+0000", 2024-09-12T16:18:29.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001670822 2024-09-12T16:18:29.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.258 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:29.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414508+0000", 2024-09-12T16:18:29.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039421100000000004 2024-09-12T16:18:29.258 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.258 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:29.258 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.258 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "pg_update_log_missing(3.5 epoch 92/74 rep_tid 1621 entries 92'521 (0'0) error 3:a759f741:::rbd_data.1155c757bf36.0000000000000036:head by client.5577.0:14364 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 92'518)", 2024-09-12T16:18:29.258 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:18:29.259 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 58.810063190999998, 2024-09-12T16:18:29.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047586740000000001, 2024-09-12T16:18:29.259 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:29.259 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:29.259 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "reached pg", 2024-09-12T16:18:29.259 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:29.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.259 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:29.259 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:18:29.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.259 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:29.259 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:18:29.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.260 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:29.260 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:18:29.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.54e-07 2024-09-12T16:18:29.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.260 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:29.260 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409817+0000", 2024-09-12T16:18:29.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.028e-06 2024-09-12T16:18:29.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.260 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:29.260 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410047+0000", 2024-09-12T16:18:29.261 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022964599999999999 2024-09-12T16:18:29.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.261 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.261 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410067+0000", 2024-09-12T16:18:29.261 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0438999999999999e-05 2024-09-12T16:18:29.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.261 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:29.261 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411223+0000", 2024-09-12T16:18:29.261 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011560229999999999 2024-09-12T16:18:29.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.261 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:29.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414567+0000", 2024-09-12T16:18:29.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033437839999999998 2024-09-12T16:18:29.262 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.262 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:29.262 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.262 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14391 3.5 e92/74 3:a5105766:::rbd_data.1155c757bf36.0000000000000044:head v 92'523, mlcod=92'518)", 2024-09-12T16:18:29.262 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.410084+0000", 2024-09-12T16:18:29.262 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 58.809787321000002, 2024-09-12T16:18:29.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0046720299999999998, 2024-09-12T16:18:29.262 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:29.262 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:29.262 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:29.262 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:29.263 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.263 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:29.263 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410084+0000", 2024-09-12T16:18:29.263 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.263 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.263 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:29.263 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410084+0000", 2024-09-12T16:18:29.263 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.263 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.263 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:29.263 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410085+0000", 2024-09-12T16:18:29.263 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1900000000000002e-07 2024-09-12T16:18:29.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.264 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:29.264 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410091+0000", 2024-09-12T16:18:29.264 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1e-06 2024-09-12T16:18:29.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.264 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:29.264 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410100+0000", 2024-09-12T16:18:29.264 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6889999999999993e-06 2024-09-12T16:18:29.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.264 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.264 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410105+0000", 2024-09-12T16:18:29.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3199999999999999e-06 2024-09-12T16:18:29.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:29.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411563+0000", 2024-09-12T16:18:29.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00145795 2024-09-12T16:18:29.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:29.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411590+0000", 2024-09-12T16:18:29.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6570000000000001e-05 2024-09-12T16:18:29.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:29.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414571+0000", 2024-09-12T16:18:29.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029815710000000001 2024-09-12T16:18:29.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:29.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414756+0000", 2024-09-12T16:18:29.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018521100000000001 2024-09-12T16:18:29.266 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.266 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:29.266 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.266 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14405 3.5 e92/74 3:a0797093:::rbd_data.1155c757bf36.000000000000004b:head v 92'525, mlcod=92'518)", 2024-09-12T16:18:29.266 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.410119+0000", 2024-09-12T16:18:29.267 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 58.809752381000003, 2024-09-12T16:18:29.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047304000000000001, 2024-09-12T16:18:29.267 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:29.267 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:29.267 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:29.267 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:29.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.267 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:29.267 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410119+0000", 2024-09-12T16:18:29.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.267 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:29.268 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410119+0000", 2024-09-12T16:18:29.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.268 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.268 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:29.268 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410120+0000", 2024-09-12T16:18:29.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:18:29.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.268 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.268 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:29.268 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410126+0000", 2024-09-12T16:18:29.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1460000000000001e-06 2024-09-12T16:18:29.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.269 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.269 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:29.269 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410134+0000", 2024-09-12T16:18:29.269 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8879999999999997e-06 2024-09-12T16:18:29.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.269 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.269 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.269 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410140+0000", 2024-09-12T16:18:29.269 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0839999999999997e-06 2024-09-12T16:18:29.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.269 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.269 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:29.269 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412146+0000", 2024-09-12T16:18:29.269 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0020057569999999999 2024-09-12T16:18:29.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.270 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:29.270 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412163+0000", 2024-09-12T16:18:29.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7742000000000001e-05 2024-09-12T16:18:29.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.270 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:29.270 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414761+0000", 2024-09-12T16:18:29.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025979660000000002 2024-09-12T16:18:29.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.270 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:29.270 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414850+0000", 2024-09-12T16:18:29.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8426999999999999e-05 2024-09-12T16:18:29.271 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.271 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:29.271 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.271 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14435 3.1d e92/74 3:b810b250:::rbd_data.1155c757bf36.000000000000010b:head v 92'1282, mlcod=90'1278)", 2024-09-12T16:18:29.271 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:18:29.271 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 58.808909911999997, 2024-09-12T16:18:29.271 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039190579999999996, 2024-09-12T16:18:29.271 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:29.271 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:29.271 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:29.271 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:29.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.271 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:29.272 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:18:29.272 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.272 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.272 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.272 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:29.272 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:18:29.272 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.272 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.272 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.272 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:29.272 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:18:29.272 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5199999999999996e-07 2024-09-12T16:18:29.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.273 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:29.273 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410968+0000", 2024-09-12T16:18:29.273 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.305e-06 2024-09-12T16:18:29.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.273 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:29.273 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410986+0000", 2024-09-12T16:18:29.273 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8213999999999999e-05 2024-09-12T16:18:29.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.273 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.273 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410993+0000", 2024-09-12T16:18:29.274 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2849999999999997e-06 2024-09-12T16:18:29.274 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.274 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.274 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:29.274 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412228+0000", 2024-09-12T16:18:29.274 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0012347370000000001 2024-09-12T16:18:29.274 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.274 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.274 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:29.274 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412262+0000", 2024-09-12T16:18:29.274 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3531999999999997e-05 2024-09-12T16:18:29.274 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.274 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.274 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:29.274 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414854+0000", 2024-09-12T16:18:29.275 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002592039 2024-09-12T16:18:29.275 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.275 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.275 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:29.275 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414881+0000", 2024-09-12T16:18:29.275 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7294e-05 2024-09-12T16:18:29.275 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.275 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:29.275 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.275 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.275 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.275 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14434 3.5 e92/74 3:a09dd60f:::rbd_data.1155c757bf36.000000000000010a:head v 92'527, mlcod=92'518)", 2024-09-12T16:18:29.275 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.411186+0000", 2024-09-12T16:18:29.276 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 58.808685765, 2024-09-12T16:18:29.276 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0037696930000000002, 2024-09-12T16:18:29.276 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:29.276 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:29.276 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:29.276 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:29.276 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.276 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:29.276 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411186+0000", 2024-09-12T16:18:29.276 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.276 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.276 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.276 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:29.276 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411186+0000", 2024-09-12T16:18:29.277 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.277 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.277 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:29.277 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411187+0000", 2024-09-12T16:18:29.277 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3799999999999997e-07 2024-09-12T16:18:29.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.277 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.277 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:29.277 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411203+0000", 2024-09-12T16:18:29.277 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6793999999999999e-05 2024-09-12T16:18:29.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.277 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.278 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:29.278 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411323+0000", 2024-09-12T16:18:29.278 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011975499999999999 2024-09-12T16:18:29.278 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.278 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.278 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.278 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411332+0000", 2024-09-12T16:18:29.278 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4370000000000007e-06 2024-09-12T16:18:29.278 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.278 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.278 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:29.278 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.413073+0000", 2024-09-12T16:18:29.278 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001741827 2024-09-12T16:18:29.279 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.279 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.279 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:29.279 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.413091+0000", 2024-09-12T16:18:29.279 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8011000000000001e-05 2024-09-12T16:18:29.279 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.279 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.279 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:29.279 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414882+0000", 2024-09-12T16:18:29.279 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001790841 2024-09-12T16:18:29.279 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.279 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.279 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:29.279 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414956+0000", 2024-09-12T16:18:29.279 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.339e-05 2024-09-12T16:18:29.280 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.280 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:29.280 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.280 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.280 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.280 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14426 3.13 e92/74 3:c827d1d7:::rbd_data.1155c757bf36.0000000000000056:head v 92'741, mlcod=90'737)", 2024-09-12T16:18:29.280 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:18:29.280 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 58.804593851999996, 2024-09-12T16:18:29.280 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030296030000000001, 2024-09-12T16:18:29.280 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:29.280 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:29.280 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:29.280 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:29.281 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.281 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:29.281 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:18:29.281 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.281 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.281 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.281 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:29.281 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:18:29.281 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.281 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.281 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.281 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:29.281 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:18:29.281 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6300000000000001e-07 2024-09-12T16:18:29.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.282 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.282 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:29.282 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415282+0000", 2024-09-12T16:18:29.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6289999999999999e-06 2024-09-12T16:18:29.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.282 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.282 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:29.282 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415288+0000", 2024-09-12T16:18:29.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5520000000000001e-06 2024-09-12T16:18:29.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.282 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.282 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.282 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415293+0000", 2024-09-12T16:18:29.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6879999999999998e-06 2024-09-12T16:18:29.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.283 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.283 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:29.283 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415412+0000", 2024-09-12T16:18:29.283 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118579 2024-09-12T16:18:29.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.283 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.283 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:29.283 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415429+0000", 2024-09-12T16:18:29.283 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7501000000000001e-05 2024-09-12T16:18:29.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.283 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.283 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:29.283 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.418270+0000", 2024-09-12T16:18:29.283 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028404860000000001 2024-09-12T16:18:29.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.284 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.284 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:29.284 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.418307+0000", 2024-09-12T16:18:29.284 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7805000000000001e-05 2024-09-12T16:18:29.284 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.284 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:29.284 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.284 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.284 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5384.0:1241 3.16 e95/75 3:6ee670ce:::rbd_data.1155b9894cdc.0000000000000005:head v 95'1303, mlcod=95'1301)", 2024-09-12T16:18:29.284 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:35.272164+0000", 2024-09-12T16:18:29.284 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 53.947707995999998, 2024-09-12T16:18:29.284 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015008743, 2024-09-12T16:18:29.285 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:29.285 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:29.285 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:29.285 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:29.285 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.285 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:29.285 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.272164+0000", 2024-09-12T16:18:29.285 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.285 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.285 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.285 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:29.285 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.272164+0000", 2024-09-12T16:18:29.285 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.285 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.286 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.286 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:29.286 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.272165+0000", 2024-09-12T16:18:29.286 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.311e-06 2024-09-12T16:18:29.286 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.286 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.286 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:29.286 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275503+0000", 2024-09-12T16:18:29.286 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003337881 2024-09-12T16:18:29.286 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.286 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.286 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:29.286 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275530+0000", 2024-09-12T16:18:29.287 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6797000000000001e-05 2024-09-12T16:18:29.287 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.287 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.287 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.287 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275541+0000", 2024-09-12T16:18:29.287 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1634000000000001e-05 2024-09-12T16:18:29.287 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.287 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.287 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:29.287 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275618+0000", 2024-09-12T16:18:29.287 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6811999999999996e-05 2024-09-12T16:18:29.287 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.287 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.288 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:29.288 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275642+0000", 2024-09-12T16:18:29.288 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4111999999999999e-05 2024-09-12T16:18:29.288 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.288 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.288 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:29.288 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287116+0000", 2024-09-12T16:18:29.288 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01147395 2024-09-12T16:18:29.288 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.288 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.288 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:29.288 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287172+0000", 2024-09-12T16:18:29.288 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6246000000000003e-05 2024-09-12T16:18:29.288 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.289 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:29.289 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.289 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.289 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5384.0:1246 3.f e95/74 3:f0725c44:::rbd_data.1155b9894cdc.0000000000000006:head v 95'356, mlcod=95'354)", 2024-09-12T16:18:29.289 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:35.276304+0000", 2024-09-12T16:18:29.289 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 53.943568069000001, 2024-09-12T16:18:29.289 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011209733, 2024-09-12T16:18:29.289 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:29.289 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:29.289 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:29.289 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:29.289 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.289 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:29.289 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.276304+0000", 2024-09-12T16:18:29.290 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.290 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.290 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.290 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:29.290 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.276304+0000", 2024-09-12T16:18:29.290 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.290 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.290 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.290 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:29.290 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.276305+0000", 2024-09-12T16:18:29.290 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2500000000000001e-06 2024-09-12T16:18:29.290 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.290 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.290 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:29.290 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279256+0000", 2024-09-12T16:18:29.291 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002951076 2024-09-12T16:18:29.291 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.291 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.291 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:29.291 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279281+0000", 2024-09-12T16:18:29.291 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4779000000000001e-05 2024-09-12T16:18:29.291 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.291 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.291 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.291 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279294+0000", 2024-09-12T16:18:29.291 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3614e-05 2024-09-12T16:18:29.291 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.291 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.291 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:29.292 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279366+0000", 2024-09-12T16:18:29.292 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2094000000000005e-05 2024-09-12T16:18:29.292 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.292 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.292 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:29.292 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279395+0000", 2024-09-12T16:18:29.292 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8337999999999999e-05 2024-09-12T16:18:29.292 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.292 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.292 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:29.292 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287479+0000", 2024-09-12T16:18:29.292 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0080844799999999998 2024-09-12T16:18:29.292 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.293 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.293 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:29.293 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287513+0000", 2024-09-12T16:18:29.293 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4102e-05 2024-09-12T16:18:29.293 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.293 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:29.293 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.293 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.293 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.293 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.13 135/134 [PushOp(3:c808f6af:::rbd_data.1155525b14e3.000000000000002e:f, version: 50'174, data_included: [0~4096,24576~4096,40960~8192,65536~4096,86016~8192,110592~4096,126976~8192,155648~4096,172032~8192,196608~4096,217088~8192,241664~4096,258048~8192,286720~4096,303104~8192,327680~4096,348160~8192,372736~4096,389120~8192,417792~4096,434176~8192,458752~4096,479232~8192,503808~4096,520192~8192,548864~4096,565248~8192,589824~4096,610304~8192,634880~4096,651264~8192,679936~4096,696320~8192,720896~4096,741376~8192,765952~4096,782336~8192,811008~4096,827392~8192,851968~4096,872448~8192,897024~4096,913408~8192,942080~4096,958464~8192,983040~4096,1003520~8192,1028096~4096,1044480~4096], data_size: 294912, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:c808f6af:::rbd_data.1155525b14e3.000000000000002e:f@50'174, size: 1048576, copy_subset: [(0, 1048576)], clone_subset: {}, snapset: f=[]:{f: [f]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T16:18:29.293 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:23.685641+0000", 2024-09-12T16:18:29.293 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.5342304630000001, 2024-09-12T16:18:29.294 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030424850000000002, 2024-09-12T16:18:29.294 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:29.294 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:29.294 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:29.294 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:29.294 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.294 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:29.294 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:23.685641+0000", 2024-09-12T16:18:29.294 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.294 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.294 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.294 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:29.294 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:23.685641+0000", 2024-09-12T16:18:29.294 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.295 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.295 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:29.295 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:23.685642+0000", 2024-09-12T16:18:29.295 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3099999999999997e-07 2024-09-12T16:18:29.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.295 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.295 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:29.295 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:23.685785+0000", 2024-09-12T16:18:29.295 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014354099999999999 2024-09-12T16:18:29.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.295 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.295 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:29.296 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:23.685807+0000", 2024-09-12T16:18:29.296 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1420000000000002e-05 2024-09-12T16:18:29.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.296 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.296 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.296 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:23.685836+0000", 2024-09-12T16:18:29.296 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9359000000000001e-05 2024-09-12T16:18:29.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.296 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.296 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:29.296 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:23.685933+0000", 2024-09-12T16:18:29.296 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6472999999999996e-05 2024-09-12T16:18:29.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.296 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.296 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:29.297 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:23.685945+0000", 2024-09-12T16:18:29.297 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2578000000000001e-05 2024-09-12T16:18:29.297 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.297 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.297 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:29.297 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:23.688684+0000", 2024-09-12T16:18:29.297 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0027384829999999999 2024-09-12T16:18:29.297 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.297 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:29.297 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.297 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.297 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.297 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.5 135/134 [PushOp(3:a1218f83:::rbd_data.1155525b14e3.000000000000002d:f, version: 50'247, data_included: [0~4096,24576~4096,40960~8192,65536~4096,86016~8192,110592~4096,131072~4096,155648~4096,172032~8192,196608~4096,217088~8192,241664~4096,262144~4096,286720~4096,303104~8192,327680~4096,348160~8192,372736~4096,393216~4096,417792~4096,434176~8192,458752~4096,479232~8192,503808~4096,524288~4096,548864~4096,565248~8192,589824~4096,610304~8192,634880~4096,655360~4096,679936~4096,696320~8192,720896~4096,741376~8192,765952~4096,786432~4096,811008~4096,827392~8192,851968~4096,872448~8192,897024~4096,917504~4096,942080~4096,958464~8192,983040~4096,1003520~8192,1028096~4096], data_size: 262144, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:a1218f83:::rbd_data.1155525b14e3.000000000000002d:f@50'247, size: 1032192, copy_subset: [(0, 1032192)], clone_subset: {}, snapset: f=[]:{f: [f]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1032192, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T16:18:29.298 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:23.876412+0000", 2024-09-12T16:18:29.298 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.3434593960000001, 2024-09-12T16:18:29.298 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0032680349999999999, 2024-09-12T16:18:29.298 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:29.298 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:29.298 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:29.298 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:29.298 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.298 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:29.298 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:23.876412+0000", 2024-09-12T16:18:29.298 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.298 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.298 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:29.299 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:23.876412+0000", 2024-09-12T16:18:29.299 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.299 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.299 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.299 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:29.299 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:23.876413+0000", 2024-09-12T16:18:29.299 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8899999999999999e-07 2024-09-12T16:18:29.299 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.299 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.299 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:29.299 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:23.876974+0000", 2024-09-12T16:18:29.299 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00056118900000000002 2024-09-12T16:18:29.299 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.299 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.300 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:29.300 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:23.876994+0000", 2024-09-12T16:18:29.300 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0250000000000001e-05 2024-09-12T16:18:29.300 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.300 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.300 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.300 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:23.877030+0000", 2024-09-12T16:18:29.300 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5864000000000001e-05 2024-09-12T16:18:29.300 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.300 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.300 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:29.300 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:23.877155+0000", 2024-09-12T16:18:29.300 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000124461 2024-09-12T16:18:29.301 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.301 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.301 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:29.301 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:23.877168+0000", 2024-09-12T16:18:29.301 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2853e-05 2024-09-12T16:18:29.301 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.301 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.301 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:29.301 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:23.879680+0000", 2024-09-12T16:18:29.301 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025128289999999998 2024-09-12T16:18:29.301 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.301 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:29.301 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.302 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.302 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.1d 136/134 [PushOp(3:b81abef1:::rbd_data.1155525b14e3.0000000000000032:f, version: 50'956, data_included: [0~4096,20480~4096,40960~4096,65536~4096,81920~8192,126976~8192,151552~4096,172032~4096,196608~4096,212992~8192,258048~8192,282624~4096,303104~4096,327680~4096,344064~8192,389120~8192,413696~4096,434176~4096,458752~4096,475136~8192,520192~8192,544768~4096,565248~4096,589824~4096,606208~8192,651264~8192,675840~4096,696320~4096,720896~4096,737280~8192,782336~8192,806912~4096,827392~4096,851968~4096,868352~8192,913408~8192,937984~4096,958464~4096,983040~4096,999424~8192,1044480~4096], data_size: 229376, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:b81abef1:::rbd_data.1155525b14e3.0000000000000032:f@50'956, size: 1048576, copy_subset: [(0, 1048576)], clone_subset: {}, snapset: f=[]:{f: [f]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T16:18:29.302 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:24.748161+0000", 2024-09-12T16:18:29.302 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.4717109979999998, 2024-09-12T16:18:29.302 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0041873149999999996, 2024-09-12T16:18:29.302 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:29.302 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:29.302 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:29.302 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:29.302 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.302 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:29.303 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.748161+0000", 2024-09-12T16:18:29.303 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.303 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.303 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:29.303 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.748161+0000", 2024-09-12T16:18:29.303 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.303 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.303 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:29.303 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.748161+0000", 2024-09-12T16:18:29.303 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1899999999999998e-07 2024-09-12T16:18:29.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.303 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.303 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:29.304 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.748223+0000", 2024-09-12T16:18:29.304 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1807e-05 2024-09-12T16:18:29.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.304 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.304 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:29.304 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.748249+0000", 2024-09-12T16:18:29.304 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5760000000000001e-05 2024-09-12T16:18:29.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.304 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.304 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.304 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.748267+0000", 2024-09-12T16:18:29.304 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8400999999999999e-05 2024-09-12T16:18:29.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.304 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.305 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:29.305 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.748390+0000", 2024-09-12T16:18:29.305 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012325300000000001 2024-09-12T16:18:29.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.305 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.305 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:29.305 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.748409+0000", 2024-09-12T16:18:29.305 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8833000000000001e-05 2024-09-12T16:18:29.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.305 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.305 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:29.305 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.752348+0000", 2024-09-12T16:18:29.305 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039388419999999997 2024-09-12T16:18:29.305 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.306 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:29.306 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.306 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.306 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.1.0:3184 3.2 e137/136 3:474f413e:::rbd_data.1155a3488f5d.0000000000000032:1a v 137'534, mlcod=0'0)", 2024-09-12T16:18:29.306 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:25.149131+0000", 2024-09-12T16:18:29.306 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.0707411440000003, 2024-09-12T16:18:29.306 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003147983, 2024-09-12T16:18:29.306 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:29.306 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:29.306 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:29.306 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:29.306 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.306 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:29.307 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.149131+0000", 2024-09-12T16:18:29.307 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.307 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.307 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:29.307 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.149131+0000", 2024-09-12T16:18:29.307 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:29.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.307 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.307 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:29.307 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.149131+0000", 2024-09-12T16:18:29.307 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2600000000000002e-07 2024-09-12T16:18:29.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.307 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:29.308 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.149136+0000", 2024-09-12T16:18:29.308 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1850000000000003e-06 2024-09-12T16:18:29.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:29.308 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.149145+0000", 2024-09-12T16:18:29.308 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9579999999999996e-06 2024-09-12T16:18:29.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.149152+0000", 2024-09-12T16:18:29.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9079999999999998e-06 2024-09-12T16:18:29.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:29.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.149193+0000", 2024-09-12T16:18:29.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1189000000000002e-05 2024-09-12T16:18:29.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:29.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.149212+0000", 2024-09-12T16:18:29.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8961999999999999e-05 2024-09-12T16:18:29.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.310 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:29.310 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.152239+0000", 2024-09-12T16:18:29.310 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030268059999999999 2024-09-12T16:18:29.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:29.310 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:29.310 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:29.310 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.152279+0000", 2024-09-12T16:18:29.310 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9348999999999999e-05 2024-09-12T16:18:29.310 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.310 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:29.310 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.310 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:29.310 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:29.310 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:29.312 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:18:29.313 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:29.311+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:29.413 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:29.412+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:29.426 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:29.426 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:29.426 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:18:29.426 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:29.435 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:18:29.514 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:29.514+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:29.542 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:29.542 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:29.542 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:18:29.542 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:18:29.542 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:29.551 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:18:29.615 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:29.615+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:29.660 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:29.660 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:18:29.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:18:29.660 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:18:29.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.661 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3705 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14812160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:29.661 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:18:29.661 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 131.51828902299999, 2024-09-12T16:18:29.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053368831999999998, 2024-09-12T16:18:29.661 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:29.661 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:29.661 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:29.661 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:29.661 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:29.661 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:29.661 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3705 2024-09-12T16:18:29.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.662 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:29.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:29.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:18:29.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:29.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:18:29.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:29.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139932+0000", 2024-09-12T16:18:29.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012762099999999999 2024-09-12T16:18:29.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:29.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139935+0000", 2024-09-12T16:18:29.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.119e-06 2024-09-12T16:18:29.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:29.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139939+0000", 2024-09-12T16:18:29.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7999999999999998e-06 2024-09-12T16:18:29.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139953+0000", 2024-09-12T16:18:29.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3923999999999999e-05 2024-09-12T16:18:29.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:29.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192946+0000", 2024-09-12T16:18:29.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052992971 2024-09-12T16:18:29.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:29.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193035+0000", 2024-09-12T16:18:29.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9040000000000001e-05 2024-09-12T16:18:29.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:29.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193174+0000", 2024-09-12T16:18:29.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138357 2024-09-12T16:18:29.665 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.665 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:29.665 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.666 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3706 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14816256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:29.666 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:18:29.666 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 131.518134033, 2024-09-12T16:18:29.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053341723000000001, 2024-09-12T16:18:29.666 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:29.666 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:29.666 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:29.666 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:29.666 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:29.666 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:29.666 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3706 2024-09-12T16:18:29.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.666 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:18:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:18:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:29.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140090+0000", 2024-09-12T16:18:29.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013020100000000001 2024-09-12T16:18:29.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:29.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140097+0000", 2024-09-12T16:18:29.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0709999999999997e-06 2024-09-12T16:18:29.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:29.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140103+0000", 2024-09-12T16:18:29.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5450000000000003e-06 2024-09-12T16:18:29.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140106+0000", 2024-09-12T16:18:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3739999999999998e-06 2024-09-12T16:18:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193190+0000", 2024-09-12T16:18:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053084131999999999 2024-09-12T16:18:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193232+0000", 2024-09-12T16:18:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1517000000000002e-05 2024-09-12T16:18:29.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:29.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193302+0000", 2024-09-12T16:18:29.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9882999999999995e-05 2024-09-12T16:18:29.670 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.670 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:29.670 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.670 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3707 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14820352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:29.670 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:18:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 131.51798204400001, 2024-09-12T16:18:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053452771000000003, 2024-09-12T16:18:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3707 2024-09-12T16:18:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:29.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:18:29.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:29.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:18:29.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:29.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140219+0000", 2024-09-12T16:18:29.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106902 2024-09-12T16:18:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140225+0000", 2024-09-12T16:18:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3199999999999996e-06 2024-09-12T16:18:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140230+0000", 2024-09-12T16:18:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8969999999999999e-06 2024-09-12T16:18:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140233+0000", 2024-09-12T16:18:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2119999999999999e-06 2024-09-12T16:18:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193339+0000", 2024-09-12T16:18:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053105556999999998 2024-09-12T16:18:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193431+0000", 2024-09-12T16:18:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1837999999999997e-05 2024-09-12T16:18:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193565+0000", 2024-09-12T16:18:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013404500000000001 2024-09-12T16:18:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3708 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14824448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:18:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 131.517853202, 2024-09-12T16:18:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053468190999999998, 2024-09-12T16:18:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3708 2024-09-12T16:18:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:18:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:18:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140351+0000", 2024-09-12T16:18:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110096 2024-09-12T16:18:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140358+0000", 2024-09-12T16:18:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.306e-06 2024-09-12T16:18:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140368+0000", 2024-09-12T16:18:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0225e-05 2024-09-12T16:18:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140372+0000", 2024-09-12T16:18:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6169999999999998e-06 2024-09-12T16:18:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193594+0000", 2024-09-12T16:18:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053222419999999999 2024-09-12T16:18:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:29.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193640+0000", 2024-09-12T16:18:29.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.587e-05 2024-09-12T16:18:29.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:29.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193709+0000", 2024-09-12T16:18:29.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8657000000000004e-05 2024-09-12T16:18:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3709 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14828544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:18:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 131.51771623400001, 2024-09-12T16:18:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594033999999999, 2024-09-12T16:18:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3709 2024-09-12T16:18:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:18:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:18:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140499+0000", 2024-09-12T16:18:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121019 2024-09-12T16:18:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140501+0000", 2024-09-12T16:18:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2369999999999999e-06 2024-09-12T16:18:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140506+0000", 2024-09-12T16:18:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.639e-06 2024-09-12T16:18:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140509+0000", 2024-09-12T16:18:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3419999999999999e-06 2024-09-12T16:18:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193743+0000", 2024-09-12T16:18:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053234311999999999 2024-09-12T16:18:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:29.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193833+0000", 2024-09-12T16:18:29.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9883999999999995e-05 2024-09-12T16:18:29.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:29.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193972+0000", 2024-09-12T16:18:29.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138601 2024-09-12T16:18:29.684 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.684 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:29.684 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3710 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14832640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:18:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 131.517578888, 2024-09-12T16:18:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053607324999999997, 2024-09-12T16:18:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3710 2024-09-12T16:18:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:18:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:18:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140664+0000", 2024-09-12T16:18:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014918700000000001 2024-09-12T16:18:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140674+0000", 2024-09-12T16:18:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8379999999999997e-06 2024-09-12T16:18:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140694+0000", 2024-09-12T16:18:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0145000000000001e-05 2024-09-12T16:18:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140703+0000", 2024-09-12T16:18:29.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5150000000000006e-06 2024-09-12T16:18:29.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:29.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194006+0000", 2024-09-12T16:18:29.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053303370000000003 2024-09-12T16:18:29.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:29.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194051+0000", 2024-09-12T16:18:29.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5012000000000002e-05 2024-09-12T16:18:29.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194122+0000", 2024-09-12T16:18:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1258000000000001e-05 2024-09-12T16:18:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3711 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14836736~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:18:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 131.51737743999999, 2024-09-12T16:18:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053670799999999998, 2024-09-12T16:18:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3711 2024-09-12T16:18:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:18:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:18:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140782+0000", 2024-09-12T16:18:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5549999999999994e-05 2024-09-12T16:18:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140786+0000", 2024-09-12T16:18:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.89e-06 2024-09-12T16:18:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140796+0000", 2024-09-12T16:18:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0057e-05 2024-09-12T16:18:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140819+0000", 2024-09-12T16:18:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3005000000000001e-05 2024-09-12T16:18:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194159+0000", 2024-09-12T16:18:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053340324000000001 2024-09-12T16:18:29.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:29.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194248+0000", 2024-09-12T16:18:29.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9209000000000006e-05 2024-09-12T16:18:29.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:29.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194387+0000", 2024-09-12T16:18:29.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138765 2024-09-12T16:18:29.693 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.693 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:29.694 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.694 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3712 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14840832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:29.694 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:18:29.694 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 131.51726298200001, 2024-09-12T16:18:29.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053699068000000003, 2024-09-12T16:18:29.694 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:29.694 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:29.694 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:29.694 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:29.694 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:29.694 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:29.695 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3712 2024-09-12T16:18:29.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.695 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:29.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:29.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:18:29.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:29.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:18:29.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140900+0000", 2024-09-12T16:18:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9014e-05 2024-09-12T16:18:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140904+0000", 2024-09-12T16:18:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0940000000000001e-06 2024-09-12T16:18:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140933+0000", 2024-09-12T16:18:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8996000000000002e-05 2024-09-12T16:18:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140945+0000", 2024-09-12T16:18:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1909000000000001e-05 2024-09-12T16:18:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194415+0000", 2024-09-12T16:18:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053470403 2024-09-12T16:18:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194460+0000", 2024-09-12T16:18:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5145000000000002e-05 2024-09-12T16:18:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194530+0000", 2024-09-12T16:18:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9506999999999997e-05 2024-09-12T16:18:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3713 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14844928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:18:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 131.51712992200001, 2024-09-12T16:18:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053821236000000001, 2024-09-12T16:18:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3713 2024-09-12T16:18:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:18:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:18:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141078+0000", 2024-09-12T16:18:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114162 2024-09-12T16:18:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141090+0000", 2024-09-12T16:18:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.19e-05 2024-09-12T16:18:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141100+0000", 2024-09-12T16:18:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0447e-05 2024-09-12T16:18:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141108+0000", 2024-09-12T16:18:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7190000000000001e-06 2024-09-12T16:18:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194564+0000", 2024-09-12T16:18:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053455729 2024-09-12T16:18:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194652+0000", 2024-09-12T16:18:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8288999999999994e-05 2024-09-12T16:18:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194785+0000", 2024-09-12T16:18:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013299000000000001 2024-09-12T16:18:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3714 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14849024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:18:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 131.51697399299999, 2024-09-12T16:18:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053816382000000003, 2024-09-12T16:18:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3714 2024-09-12T16:18:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.704 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:29.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:29.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:18:29.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:29.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:18:29.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141182+0000", 2024-09-12T16:18:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1805999999999997e-05 2024-09-12T16:18:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141185+0000", 2024-09-12T16:18:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5930000000000002e-06 2024-09-12T16:18:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141194+0000", 2024-09-12T16:18:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5760000000000006e-06 2024-09-12T16:18:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141222+0000", 2024-09-12T16:18:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8034999999999998e-05 2024-09-12T16:18:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194817+0000", 2024-09-12T16:18:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594887000000001 2024-09-12T16:18:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194860+0000", 2024-09-12T16:18:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3714999999999997e-05 2024-09-12T16:18:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194936+0000", 2024-09-12T16:18:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5770000000000001e-05 2024-09-12T16:18:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3715 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14853120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:18:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 131.516850336, 2024-09-12T16:18:29.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053962307000000001, 2024-09-12T16:18:29.708 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:29.708 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:29.708 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:29.708 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:29.708 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:29.708 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:29.708 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3715 2024-09-12T16:18:29.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.708 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:29.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:29.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:18:29.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:29.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:18:29.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:29.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141417+0000", 2024-09-12T16:18:29.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017384099999999999 2024-09-12T16:18:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141422+0000", 2024-09-12T16:18:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7310000000000001e-06 2024-09-12T16:18:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141434+0000", 2024-09-12T16:18:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2058e-05 2024-09-12T16:18:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141442+0000", 2024-09-12T16:18:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7610000000000007e-06 2024-09-12T16:18:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194973+0000", 2024-09-12T16:18:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053530618000000002 2024-09-12T16:18:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195063+0000", 2024-09-12T16:18:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0927000000000005e-05 2024-09-12T16:18:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:29.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195206+0000", 2024-09-12T16:18:29.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142371 2024-09-12T16:18:29.712 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.712 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:29.712 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.712 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3716 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14857216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:29.712 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:18:29.712 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 131.516640486, 2024-09-12T16:18:29.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053916360000000003, 2024-09-12T16:18:29.713 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:29.713 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:29.713 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:29.713 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:29.713 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:29.713 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:29.713 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3716 2024-09-12T16:18:29.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.713 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:29.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:29.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:18:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:18:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142933+0000", 2024-09-12T16:18:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014796290000000001 2024-09-12T16:18:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:29.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142937+0000", 2024-09-12T16:18:29.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5760000000000002e-06 2024-09-12T16:18:29.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:29.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142946+0000", 2024-09-12T16:18:29.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0380000000000005e-06 2024-09-12T16:18:29.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142951+0000", 2024-09-12T16:18:29.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9749999999999998e-06 2024-09-12T16:18:29.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:29.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195246+0000", 2024-09-12T16:18:29.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052295358 2024-09-12T16:18:29.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:29.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195299+0000", 2024-09-12T16:18:29.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2976999999999998e-05 2024-09-12T16:18:29.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195370+0000", 2024-09-12T16:18:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0807000000000002e-05 2024-09-12T16:18:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3721 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14877696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:18:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 131.51506703499999, 2024-09-12T16:18:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053422994000000001, 2024-09-12T16:18:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3721 2024-09-12T16:18:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:18:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:18:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:18:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:18:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143028+0000", 2024-09-12T16:18:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7399999999999991e-07 2024-09-12T16:18:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143031+0000", 2024-09-12T16:18:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7599999999999998e-06 2024-09-12T16:18:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143034+0000", 2024-09-12T16:18:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9780000000000001e-06 2024-09-12T16:18:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196220+0000", 2024-09-12T16:18:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053186341999999998 2024-09-12T16:18:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196313+0000", 2024-09-12T16:18:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2676000000000005e-05 2024-09-12T16:18:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196450+0000", 2024-09-12T16:18:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137052 2024-09-12T16:18:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3722 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14881792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:18:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 131.51505714300001, 2024-09-12T16:18:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053556835999999997, 2024-09-12T16:18:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3722 2024-09-12T16:18:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:18:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:18:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:29.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:18:29.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.11e-07 2024-09-12T16:18:29.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:29.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143038+0000", 2024-09-12T16:18:29.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2399999999999996e-07 2024-09-12T16:18:29.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143041+0000", 2024-09-12T16:18:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8030000000000001e-06 2024-09-12T16:18:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143043+0000", 2024-09-12T16:18:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3140000000000002e-06 2024-09-12T16:18:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196481+0000", 2024-09-12T16:18:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053437601000000001 2024-09-12T16:18:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196525+0000", 2024-09-12T16:18:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4280000000000003e-05 2024-09-12T16:18:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196594+0000", 2024-09-12T16:18:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8702999999999996e-05 2024-09-12T16:18:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.727 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3723 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14885888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:29.727 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:18:29.727 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 131.51504796099999, 2024-09-12T16:18:29.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053815546999999998, 2024-09-12T16:18:29.727 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:29.727 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:29.727 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:29.727 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:29.727 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:29.727 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:29.727 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3723 2024-09-12T16:18:29.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.728 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:29.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:29.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:18:29.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:29.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:18:29.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:29.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148994+0000", 2024-09-12T16:18:29.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059481330000000004 2024-09-12T16:18:29.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:29.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148999+0000", 2024-09-12T16:18:29.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7140000000000001e-06 2024-09-12T16:18:29.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:29.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149008+0000", 2024-09-12T16:18:29.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4350000000000003e-06 2024-09-12T16:18:29.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149021+0000", 2024-09-12T16:18:29.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2514000000000001e-05 2024-09-12T16:18:29.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:29.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196630+0000", 2024-09-12T16:18:29.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047609758000000002 2024-09-12T16:18:29.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:29.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196724+0000", 2024-09-12T16:18:29.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3522000000000003e-05 2024-09-12T16:18:29.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:29.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196861+0000", 2024-09-12T16:18:29.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013747100000000001 2024-09-12T16:18:29.731 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.731 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:29.731 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.731 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4438 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15719424~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:29.731 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:18:29.731 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 131.370167184, 2024-09-12T16:18:29.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367981000000002, 2024-09-12T16:18:29.732 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:29.732 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:29.732 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:29.732 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:29.732 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:29.732 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:29.732 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4438 2024-09-12T16:18:29.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.732 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:29.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:29.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:18:29.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.733 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:29.733 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:18:29.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.733 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:29.733 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:18:29.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3e-07 2024-09-12T16:18:29.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:29.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287930+0000", 2024-09-12T16:18:29.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-12T16:18:29.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:29.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287937+0000", 2024-09-12T16:18:29.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.08e-06 2024-09-12T16:18:29.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287943+0000", 2024-09-12T16:18:29.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5709999999999997e-06 2024-09-12T16:18:29.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:29.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341068+0000", 2024-09-12T16:18:29.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053125101000000001 2024-09-12T16:18:29.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:29.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341154+0000", 2024-09-12T16:18:29.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6100999999999994e-05 2024-09-12T16:18:29.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:29.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341295+0000", 2024-09-12T16:18:29.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014087999999999999 2024-09-12T16:18:29.736 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.736 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:29.736 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.736 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4439 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15723520~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:29.736 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:18:29.736 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 131.37014302399999, 2024-09-12T16:18:29.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053526799, 2024-09-12T16:18:29.737 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:29.737 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:29.737 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:29.737 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:29.737 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:29.737 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:29.737 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4439 2024-09-12T16:18:29.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.737 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:29.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:29.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:18:29.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:29.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:18:29.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:29.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:18:29.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-07 2024-09-12T16:18:29.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:29.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287953+0000", 2024-09-12T16:18:29.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1349999999999999e-06 2024-09-12T16:18:29.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:29.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287960+0000", 2024-09-12T16:18:29.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-12T16:18:29.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287965+0000", 2024-09-12T16:18:29.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1580000000000004e-06 2024-09-12T16:18:29.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:29.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341332+0000", 2024-09-12T16:18:29.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367009 2024-09-12T16:18:29.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:29.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341402+0000", 2024-09-12T16:18:29.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9759999999999996e-05 2024-09-12T16:18:29.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:29.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341478+0000", 2024-09-12T16:18:29.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5412000000000002e-05 2024-09-12T16:18:29.741 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.741 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:29.741 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.741 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4440 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15727616~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:29.741 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:18:29.741 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 131.37012192, 2024-09-12T16:18:29.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053761601999999999, 2024-09-12T16:18:29.742 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:29.742 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:29.742 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:29.742 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:29.742 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:29.742 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:29.742 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4440 2024-09-12T16:18:29.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.742 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:29.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:29.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:18:29.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:29.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:18:29.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:29.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:18:29.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:18:29.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:29.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287974+0000", 2024-09-12T16:18:29.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0540000000000002e-06 2024-09-12T16:18:29.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:29.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287980+0000", 2024-09-12T16:18:29.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9440000000000002e-06 2024-09-12T16:18:29.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287987+0000", 2024-09-12T16:18:29.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5889999999999999e-06 2024-09-12T16:18:29.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:29.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341502+0000", 2024-09-12T16:18:29.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053515199999999999 2024-09-12T16:18:29.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:29.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341595+0000", 2024-09-12T16:18:29.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3097000000000007e-05 2024-09-12T16:18:29.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:29.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341734+0000", 2024-09-12T16:18:29.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013832800000000001 2024-09-12T16:18:29.747 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.747 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:29.747 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.747 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2209 3.1 3:85f36d3b:::rbd_data.1155ccb1894c.0000000000000004:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:18:29.747 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:18:29.747 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 92.286436781999996, 2024-09-12T16:18:29.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.060659365, 2024-09-12T16:18:29.748 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:29.748 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:29.748 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:29.748 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:29.748 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:18:29.748 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:18:29.748 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2209 2024-09-12T16:18:29.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.748 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:29.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:29.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:18:29.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:29.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:18:29.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:29.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371658+0000", 2024-09-12T16:18:29.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1570000000000001e-06 2024-09-12T16:18:29.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:29.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393414+0000", 2024-09-12T16:18:29.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021755495999999999 2024-09-12T16:18:29.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:29.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393447+0000", 2024-09-12T16:18:29.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3630000000000002e-05 2024-09-12T16:18:29.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393462+0000", 2024-09-12T16:18:29.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5048999999999999e-05 2024-09-12T16:18:29.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.751 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:29.751 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393556+0000", 2024-09-12T16:18:29.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3549999999999997e-05 2024-09-12T16:18:29.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.751 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:29.751 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393697+0000", 2024-09-12T16:18:29.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000141414 2024-09-12T16:18:29.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.751 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T16:18:29.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.394944+0000", 2024-09-12T16:18:29.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012463039999999999 2024-09-12T16:18:29.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:29.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.431803+0000", 2024-09-12T16:18:29.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0368594 2024-09-12T16:18:29.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:18:29.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432268+0000", 2024-09-12T16:18:29.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046457600000000002 2024-09-12T16:18:29.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:18:29.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432293+0000", 2024-09-12T16:18:29.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.527e-05 2024-09-12T16:18:29.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:29.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432316+0000", 2024-09-12T16:18:29.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3519e-05 2024-09-12T16:18:29.753 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.753 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:29.753 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.753 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:9400 3.1f 3:feea9999:::rbd_data.1155338d0570.0000000000000007:head [read 32768~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-12T16:18:29.754 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:20.012502+0000", 2024-09-12T16:18:29.754 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 69.645591789999997, 2024-09-12T16:18:29.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.000678049, 2024-09-12T16:18:29.754 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:29.754 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:29.754 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:29.754 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:29.754 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:18:29.754 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:18:29.754 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 9400 2024-09-12T16:18:29.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.754 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:29.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.755 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:29.755 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012502+0000", 2024-09-12T16:18:29.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.755 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:29.755 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012502+0000", 2024-09-12T16:18:29.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:29.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.755 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:29.755 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012504+0000", 2024-09-12T16:18:29.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5939999999999999e-06 2024-09-12T16:18:29.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.756 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:29.756 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012511+0000", 2024-09-12T16:18:29.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0840000000000003e-06 2024-09-12T16:18:29.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.756 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:29.756 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012525+0000", 2024-09-12T16:18:29.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4538999999999999e-05 2024-09-12T16:18:29.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:29.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012532+0000", 2024-09-12T16:18:29.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8310000000000003e-06 2024-09-12T16:18:29.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:29.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012605+0000", 2024-09-12T16:18:29.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2387999999999999e-05 2024-09-12T16:18:29.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T16:18:29.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012617+0000", 2024-09-12T16:18:29.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2167999999999999e-05 2024-09-12T16:18:29.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:29.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:21.012823+0000", 2024-09-12T16:18:29.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0002068230000001 2024-09-12T16:18:29.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:29.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:21.012975+0000", 2024-09-12T16:18:29.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015196200000000001 2024-09-12T16:18:29.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:29.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:29.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:29.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:21.013180+0000", 2024-09-12T16:18:29.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020466000000000001 2024-09-12T16:18:29.759 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.759 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:29.759 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.759 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:29.759 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:29.759 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:29.761 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:18:29.761 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:29.759+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:29.861 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:29.860+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:29.909 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:29.909 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:29.909 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:18:29.909 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:29.918 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:18:29.962 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:29.961+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:30.062 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:30.061+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:30.066 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:30.066 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:30.066 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:18:30.066 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:18:30.066 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:30.074 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:18:30.097 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T16:18:30.163 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:30.162+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:30.190 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:30.190 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:18:30.190 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:18:30.190 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:18:30.190 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.190 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1571 3.b 3:d046566d:::rbd_data.1155525b14e3.0000000000000001:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:18:30.190 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:18:30.190 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 109.03614244800001, 2024-09-12T16:18:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064439785999999999, 2024-09-12T16:18:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:18:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:18:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1571 2024-09-12T16:18:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:18:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:18:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:18:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5400000000000002e-07 2024-09-12T16:18:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152567+0000", 2024-09-12T16:18:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.131e-06 2024-09-12T16:18:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152574+0000", 2024-09-12T16:18:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1840000000000002e-06 2024-09-12T16:18:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152579+0000", 2024-09-12T16:18:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.152e-06 2024-09-12T16:18:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153671+0000", 2024-09-12T16:18:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001092078 2024-09-12T16:18:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153779+0000", 2024-09-12T16:18:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108461 2024-09-12T16:18:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217004+0000", 2024-09-12T16:18:30.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.063224426 2024-09-12T16:18:30.195 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.195 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:30.195 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.195 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1581 3.4 3:22e34893:::rbd_data.1155525b14e3.0000000000000005:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:18:30.195 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:18:30.195 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 109.036045323, 2024-09-12T16:18:30.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064484407999999993, 2024-09-12T16:18:30.195 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:18:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:18:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1581 2024-09-12T16:18:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:18:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:18:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152662+0000", 2024-09-12T16:18:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.65e-07 2024-09-12T16:18:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152664+0000", 2024-09-12T16:18:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9829999999999999e-06 2024-09-12T16:18:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152670+0000", 2024-09-12T16:18:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2260000000000002e-06 2024-09-12T16:18:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152675+0000", 2024-09-12T16:18:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7990000000000001e-06 2024-09-12T16:18:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.216945+0000", 2024-09-12T16:18:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064270341999999994 2024-09-12T16:18:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217040+0000", 2024-09-12T16:18:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5242999999999996e-05 2024-09-12T16:18:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217146+0000", 2024-09-12T16:18:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010545 2024-09-12T16:18:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2207 3.0 3:05fdc61f:::rbd_data.1155ccb1894c.0000000000000003:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:18:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:18:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 92.818001761999994, 2024-09-12T16:18:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.05105382, 2024-09-12T16:18:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:18:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:18:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2207 2024-09-12T16:18:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:18:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:18:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370706+0000", 2024-09-12T16:18:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7800000000000001e-07 2024-09-12T16:18:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391581+0000", 2024-09-12T16:18:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020875624999999998 2024-09-12T16:18:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391608+0000", 2024-09-12T16:18:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6412999999999999e-05 2024-09-12T16:18:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391618+0000", 2024-09-12T16:18:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9240000000000002e-06 2024-09-12T16:18:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391705+0000", 2024-09-12T16:18:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7489000000000002e-05 2024-09-12T16:18:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391838+0000", 2024-09-12T16:18:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132865 2024-09-12T16:18:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 2", 2024-09-12T16:18:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.392587+0000", 2024-09-12T16:18:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074930000000000005 2024-09-12T16:18:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.420095+0000", 2024-09-12T16:18:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027507949 2024-09-12T16:18:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:18:30.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421610+0000", 2024-09-12T16:18:30.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001515195 2024-09-12T16:18:30.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:18:30.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421681+0000", 2024-09-12T16:18:30.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0320000000000004e-05 2024-09-12T16:18:30.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:30.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421759+0000", 2024-09-12T16:18:30.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7961999999999997e-05 2024-09-12T16:18:30.206 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.206 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:30.206 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.206 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11083 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 3399680~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:30.206 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.876304+0000", 2024-09-12T16:18:30.206 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 36.312402355000003, 2024-09-12T16:18:30.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045070883999999999, 2024-09-12T16:18:30.206 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:30.206 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:30.206 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11083 2024-09-12T16:18:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876304+0000", 2024-09-12T16:18:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:30.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876304+0000", 2024-09-12T16:18:30.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:30.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876305+0000", 2024-09-12T16:18:30.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4099999999999999e-07 2024-09-12T16:18:30.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:30.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876307+0000", 2024-09-12T16:18:30.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9470000000000002e-06 2024-09-12T16:18:30.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:30.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876312+0000", 2024-09-12T16:18:30.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7540000000000003e-06 2024-09-12T16:18:30.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:30.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876318+0000", 2024-09-12T16:18:30.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3589999999999999e-06 2024-09-12T16:18:30.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921221+0000", 2024-09-12T16:18:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044903464999999997 2024-09-12T16:18:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921266+0000", 2024-09-12T16:18:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4795000000000001e-05 2024-09-12T16:18:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921375+0000", 2024-09-12T16:18:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000109023 2024-09-12T16:18:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11084 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 3448832~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.876324+0000", 2024-09-12T16:18:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 36.312382237999998, 2024-09-12T16:18:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045172474999999997, 2024-09-12T16:18:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11084 2024-09-12T16:18:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876324+0000", 2024-09-12T16:18:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876324+0000", 2024-09-12T16:18:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:30.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876411+0000", 2024-09-12T16:18:30.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6292000000000007e-05 2024-09-12T16:18:30.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:30.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876418+0000", 2024-09-12T16:18:30.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3309999999999998e-06 2024-09-12T16:18:30.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:30.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876426+0000", 2024-09-12T16:18:30.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3850000000000002e-06 2024-09-12T16:18:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876436+0000", 2024-09-12T16:18:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8749999999999995e-06 2024-09-12T16:18:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921403+0000", 2024-09-12T16:18:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044966385999999997 2024-09-12T16:18:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921445+0000", 2024-09-12T16:18:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1953000000000003e-05 2024-09-12T16:18:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921497+0000", 2024-09-12T16:18:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2253000000000003e-05 2024-09-12T16:18:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11085 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 3497984~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.876449+0000", 2024-09-12T16:18:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 36.312257727999999, 2024-09-12T16:18:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045173054999999997, 2024-09-12T16:18:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11085 2024-09-12T16:18:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876449+0000", 2024-09-12T16:18:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876449+0000", 2024-09-12T16:18:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.881997+0000", 2024-09-12T16:18:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055481209999999996 2024-09-12T16:18:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:30.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.882002+0000", 2024-09-12T16:18:30.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8269999999999997e-06 2024-09-12T16:18:30.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:30.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.882013+0000", 2024-09-12T16:18:30.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0869999999999999e-05 2024-09-12T16:18:30.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.882020+0000", 2024-09-12T16:18:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5839999999999997e-06 2024-09-12T16:18:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921523+0000", 2024-09-12T16:18:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039502411000000001 2024-09-12T16:18:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921566+0000", 2024-09-12T16:18:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3353000000000003e-05 2024-09-12T16:18:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921622+0000", 2024-09-12T16:18:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5889e-05 2024-09-12T16:18:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11139 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 6152192~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883248+0000", 2024-09-12T16:18:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 36.305458864000002, 2024-09-12T16:18:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045153225999999998, 2024-09-12T16:18:30.221 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:30.221 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:30.221 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:30.221 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:30.221 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:30.221 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:30.221 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11139 2024-09-12T16:18:30.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.221 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:30.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:30.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883248+0000", 2024-09-12T16:18:30.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:30.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883248+0000", 2024-09-12T16:18:30.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883248+0000", 2024-09-12T16:18:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9999999999999998e-07 2024-09-12T16:18:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883250+0000", 2024-09-12T16:18:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0660000000000002e-06 2024-09-12T16:18:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883256+0000", 2024-09-12T16:18:30.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8699999999999997e-06 2024-09-12T16:18:30.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:30.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883261+0000", 2024-09-12T16:18:30.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0490000000000003e-06 2024-09-12T16:18:30.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:30.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928316+0000", 2024-09-12T16:18:30.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045055398000000003 2024-09-12T16:18:30.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928359+0000", 2024-09-12T16:18:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2286000000000001e-05 2024-09-12T16:18:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928401+0000", 2024-09-12T16:18:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2157000000000003e-05 2024-09-12T16:18:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11140 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 6201344~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883267+0000", 2024-09-12T16:18:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 36.305439098000001, 2024-09-12T16:18:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045241199000000003, 2024-09-12T16:18:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11140 2024-09-12T16:18:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883267+0000", 2024-09-12T16:18:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883267+0000", 2024-09-12T16:18:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883268+0000", 2024-09-12T16:18:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8700000000000001e-07 2024-09-12T16:18:30.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:30.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883270+0000", 2024-09-12T16:18:30.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3420000000000002e-06 2024-09-12T16:18:30.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:30.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883276+0000", 2024-09-12T16:18:30.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0310000000000004e-06 2024-09-12T16:18:30.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:30.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883281+0000", 2024-09-12T16:18:30.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1259999999999997e-06 2024-09-12T16:18:30.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:30.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928428+0000", 2024-09-12T16:18:30.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045146276999999999 2024-09-12T16:18:30.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:30.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928469+0000", 2024-09-12T16:18:30.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1007000000000002e-05 2024-09-12T16:18:30.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:30.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928509+0000", 2024-09-12T16:18:30.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0028999999999999e-05 2024-09-12T16:18:30.230 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.230 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:30.230 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.230 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11141 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 6250496~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:30.230 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883288+0000", 2024-09-12T16:18:30.230 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 36.305418500999998, 2024-09-12T16:18:30.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045331594000000003, 2024-09-12T16:18:30.231 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:30.231 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:30.231 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:30.231 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:30.231 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:30.231 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:30.231 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11141 2024-09-12T16:18:30.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.231 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:30.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:30.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883288+0000", 2024-09-12T16:18:30.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:30.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883288+0000", 2024-09-12T16:18:30.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:30.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883288+0000", 2024-09-12T16:18:30.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0200000000000003e-07 2024-09-12T16:18:30.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:30.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883290+0000", 2024-09-12T16:18:30.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9350000000000001e-06 2024-09-12T16:18:30.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:30.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883296+0000", 2024-09-12T16:18:30.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.913e-06 2024-09-12T16:18:30.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:30.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883302+0000", 2024-09-12T16:18:30.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.879e-06 2024-09-12T16:18:30.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:30.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928534+0000", 2024-09-12T16:18:30.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045231544999999998 2024-09-12T16:18:30.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:30.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928577+0000", 2024-09-12T16:18:30.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3676e-05 2024-09-12T16:18:30.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:30.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928620+0000", 2024-09-12T16:18:30.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2243999999999997e-05 2024-09-12T16:18:30.234 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.234 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:30.234 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.235 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11271 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3174400~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:30.235 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883316+0000", 2024-09-12T16:18:30.235 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 36.305390441, 2024-09-12T16:18:30.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045477308000000001, 2024-09-12T16:18:30.235 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:30.235 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:30.235 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:30.235 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:30.235 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:30.235 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:30.235 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11271 2024-09-12T16:18:30.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.236 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:30.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:30.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883316+0000", 2024-09-12T16:18:30.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:30.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883316+0000", 2024-09-12T16:18:30.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:30.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883317+0000", 2024-09-12T16:18:30.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9200000000000001e-07 2024-09-12T16:18:30.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.237 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:30.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883319+0000", 2024-09-12T16:18:30.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2670000000000001e-06 2024-09-12T16:18:30.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.237 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:30.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883326+0000", 2024-09-12T16:18:30.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6000000000000003e-06 2024-09-12T16:18:30.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:30.238 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883331+0000", 2024-09-12T16:18:30.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1719999999999998e-06 2024-09-12T16:18:30.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:30.238 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928647+0000", 2024-09-12T16:18:30.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045316457999999997 2024-09-12T16:18:30.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:30.238 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928689+0000", 2024-09-12T16:18:30.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1352e-05 2024-09-12T16:18:30.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:30.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928793+0000", 2024-09-12T16:18:30.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000104867 2024-09-12T16:18:30.239 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.239 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:30.239 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.239 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11272 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3223552~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:30.239 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883338+0000", 2024-09-12T16:18:30.239 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 36.305368581000003, 2024-09-12T16:18:30.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045595268000000001, 2024-09-12T16:18:30.240 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:30.240 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:30.240 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:30.240 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:30.240 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:30.240 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:30.240 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11272 2024-09-12T16:18:30.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.240 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:30.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:30.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883338+0000", 2024-09-12T16:18:30.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:30.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883338+0000", 2024-09-12T16:18:30.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:30.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883339+0000", 2024-09-12T16:18:30.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8599999999999998e-07 2024-09-12T16:18:30.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:30.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883341+0000", 2024-09-12T16:18:30.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1449999999999998e-06 2024-09-12T16:18:30.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:30.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883348+0000", 2024-09-12T16:18:30.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0110000000000003e-06 2024-09-12T16:18:30.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:30.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883353+0000", 2024-09-12T16:18:30.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2360000000000004e-06 2024-09-12T16:18:30.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:30.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928819+0000", 2024-09-12T16:18:30.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045466392000000001 2024-09-12T16:18:30.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:30.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928869+0000", 2024-09-12T16:18:30.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9829e-05 2024-09-12T16:18:30.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:30.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928933+0000", 2024-09-12T16:18:30.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3968999999999997e-05 2024-09-12T16:18:30.244 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.244 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:30.244 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.244 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11273 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3272704~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:30.244 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883359+0000", 2024-09-12T16:18:30.244 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 36.305347269000002, 2024-09-12T16:18:30.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045735142999999999, 2024-09-12T16:18:30.244 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:30.244 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:30.244 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:30.245 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:30.245 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:30.245 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:30.245 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11273 2024-09-12T16:18:30.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.245 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:30.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:30.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883359+0000", 2024-09-12T16:18:30.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:30.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883359+0000", 2024-09-12T16:18:30.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:30.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883360+0000", 2024-09-12T16:18:30.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9400000000000001e-07 2024-09-12T16:18:30.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:30.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883367+0000", 2024-09-12T16:18:30.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8530000000000003e-06 2024-09-12T16:18:30.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:30.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883373+0000", 2024-09-12T16:18:30.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9989999999999997e-06 2024-09-12T16:18:30.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:30.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883378+0000", 2024-09-12T16:18:30.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3369999999999999e-06 2024-09-12T16:18:30.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:30.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928950+0000", 2024-09-12T16:18:30.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045571751000000001 2024-09-12T16:18:30.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:30.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928992+0000", 2024-09-12T16:18:30.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1891000000000003e-05 2024-09-12T16:18:30.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:30.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929094+0000", 2024-09-12T16:18:30.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010291800000000001 2024-09-12T16:18:30.248 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.248 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:30.248 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.249 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11274 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3321856~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:30.249 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883385+0000", 2024-09-12T16:18:30.249 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 36.305321751999998, 2024-09-12T16:18:30.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045864239000000001, 2024-09-12T16:18:30.249 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:30.249 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:30.249 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:30.249 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:30.249 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:30.249 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:30.249 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11274 2024-09-12T16:18:30.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.250 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:30.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:30.250 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883385+0000", 2024-09-12T16:18:30.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:30.250 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883385+0000", 2024-09-12T16:18:30.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:30.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883385+0000", 2024-09-12T16:18:30.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4799999999999999e-07 2024-09-12T16:18:30.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:30.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883388+0000", 2024-09-12T16:18:30.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3199999999999998e-06 2024-09-12T16:18:30.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:30.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883394+0000", 2024-09-12T16:18:30.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2020000000000001e-06 2024-09-12T16:18:30.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:30.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883400+0000", 2024-09-12T16:18:30.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8510000000000004e-06 2024-09-12T16:18:30.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:30.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929123+0000", 2024-09-12T16:18:30.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045723235000000001 2024-09-12T16:18:30.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:30.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929166+0000", 2024-09-12T16:18:30.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2769999999999999e-05 2024-09-12T16:18:30.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:30.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929249+0000", 2024-09-12T16:18:30.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3412999999999996e-05 2024-09-12T16:18:30.253 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.253 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:30.253 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.253 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11275 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3371008~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:30.253 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883416+0000", 2024-09-12T16:18:30.253 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 36.305290143000001, 2024-09-12T16:18:30.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.046042315, 2024-09-12T16:18:30.253 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:30.253 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:30.254 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:30.254 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:30.254 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:30.254 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:30.254 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11275 2024-09-12T16:18:30.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.254 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:30.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:30.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883416+0000", 2024-09-12T16:18:30.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:30.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883416+0000", 2024-09-12T16:18:30.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:30.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883417+0000", 2024-09-12T16:18:30.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4700000000000001e-07 2024-09-12T16:18:30.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:30.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883419+0000", 2024-09-12T16:18:30.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2029999999999999e-06 2024-09-12T16:18:30.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:30.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883426+0000", 2024-09-12T16:18:30.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.579e-06 2024-09-12T16:18:30.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:30.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883431+0000", 2024-09-12T16:18:30.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5679999999999999e-06 2024-09-12T16:18:30.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:30.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929290+0000", 2024-09-12T16:18:30.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045858227000000001 2024-09-12T16:18:30.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:30.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929365+0000", 2024-09-12T16:18:30.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5519999999999995e-05 2024-09-12T16:18:30.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:30.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929459+0000", 2024-09-12T16:18:30.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3671000000000005e-05 2024-09-12T16:18:30.257 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.257 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:30.257 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.258 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11276 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3420160~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:30.258 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883439+0000", 2024-09-12T16:18:30.258 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 36.305267739999998, 2024-09-12T16:18:30.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.046138991999999997, 2024-09-12T16:18:30.258 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:30.258 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:30.258 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:30.258 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:30.258 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:30.258 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:30.258 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11276 2024-09-12T16:18:30.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.259 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:30.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:30.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883439+0000", 2024-09-12T16:18:30.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:30.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883439+0000", 2024-09-12T16:18:30.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:30.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883560+0000", 2024-09-12T16:18:30.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121229 2024-09-12T16:18:30.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:30.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883569+0000", 2024-09-12T16:18:30.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9390000000000003e-06 2024-09-12T16:18:30.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:30.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883579+0000", 2024-09-12T16:18:30.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8859999999999999e-06 2024-09-12T16:18:30.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:30.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883585+0000", 2024-09-12T16:18:30.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.545e-06 2024-09-12T16:18:30.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:30.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929486+0000", 2024-09-12T16:18:30.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045900653999999999 2024-09-12T16:18:30.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:30.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929527+0000", 2024-09-12T16:18:30.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0707999999999997e-05 2024-09-12T16:18:30.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:30.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929578+0000", 2024-09-12T16:18:30.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1031e-05 2024-09-12T16:18:30.262 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.262 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:30.262 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.262 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11277 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3469312~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:30.262 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883595+0000", 2024-09-12T16:18:30.262 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 36.305111396999997, 2024-09-12T16:18:30.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.046187702999999997, 2024-09-12T16:18:30.262 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:30.263 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:30.263 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:30.263 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:30.263 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:30.263 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:30.263 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11277 2024-09-12T16:18:30.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.263 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:30.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:30.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883595+0000", 2024-09-12T16:18:30.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:30.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883595+0000", 2024-09-12T16:18:30.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:30.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.889065+0000", 2024-09-12T16:18:30.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00547001 2024-09-12T16:18:30.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:30.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.889069+0000", 2024-09-12T16:18:30.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1180000000000002e-06 2024-09-12T16:18:30.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:30.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.889079+0000", 2024-09-12T16:18:30.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2250000000000006e-06 2024-09-12T16:18:30.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:30.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.889084+0000", 2024-09-12T16:18:30.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2680000000000002e-06 2024-09-12T16:18:30.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:30.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929612+0000", 2024-09-12T16:18:30.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040528343000000001 2024-09-12T16:18:30.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:30.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929691+0000", 2024-09-12T16:18:30.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8541999999999994e-05 2024-09-12T16:18:30.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:30.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929783+0000", 2024-09-12T16:18:30.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2196999999999998e-05 2024-09-12T16:18:30.267 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.267 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:30.267 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.267 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:27683 3.1 3.d6dd1621 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e127)", 2024-09-12T16:18:30.267 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:15.196201+0000", 2024-09-12T16:18:30.267 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.992505719, 2024-09-12T16:18:30.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.91402251499999998, 2024-09-12T16:18:30.267 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:30.268 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:30.268 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:18:30.268 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:30.268 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:18:30.268 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:18:30.268 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 27683 2024-09-12T16:18:30.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.268 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:30.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:30.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196201+0000", 2024-09-12T16:18:30.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:30.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196201+0000", 2024-09-12T16:18:30.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:30.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196202+0000", 2024-09-12T16:18:30.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4929999999999999e-06 2024-09-12T16:18:30.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:30.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196209+0000", 2024-09-12T16:18:30.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2269999999999998e-06 2024-09-12T16:18:30.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:30.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196221+0000", 2024-09-12T16:18:30.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2517000000000001e-05 2024-09-12T16:18:30.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:30.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196229+0000", 2024-09-12T16:18:30.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3250000000000008e-06 2024-09-12T16:18:30.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:30.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196293+0000", 2024-09-12T16:18:30.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3975999999999999e-05 2024-09-12T16:18:30.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T16:18:30.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196299+0000", 2024-09-12T16:18:30.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3000000000000001e-06 2024-09-12T16:18:30.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:30.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110210+0000", 2024-09-12T16:18:30.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.91391175099999999 2024-09-12T16:18:30.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:30.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110223+0000", 2024-09-12T16:18:30.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2926e-05 2024-09-12T16:18:30.272 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.272 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:30.272 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.272 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:27740 3.1 3.859365c1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e127)", 2024-09-12T16:18:30.272 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:15.209778+0000", 2024-09-12T16:18:30.272 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.978928590000001, 2024-09-12T16:18:30.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.90059554500000005, 2024-09-12T16:18:30.273 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:30.273 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:30.273 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:18:30.273 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:30.273 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:18:30.273 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:18:30.273 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 27740 2024-09-12T16:18:30.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.273 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:30.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:30.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209778+0000", 2024-09-12T16:18:30.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:30.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209778+0000", 2024-09-12T16:18:30.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:30.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209779+0000", 2024-09-12T16:18:30.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.274e-06 2024-09-12T16:18:30.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:30.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209785+0000", 2024-09-12T16:18:30.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3310000000000003e-06 2024-09-12T16:18:30.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:30.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209799+0000", 2024-09-12T16:18:30.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.448e-05 2024-09-12T16:18:30.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:30.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209806+0000", 2024-09-12T16:18:30.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3479999999999998e-06 2024-09-12T16:18:30.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:30.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209864+0000", 2024-09-12T16:18:30.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7395999999999997e-05 2024-09-12T16:18:30.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T16:18:30.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209871+0000", 2024-09-12T16:18:30.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1149999999999996e-06 2024-09-12T16:18:30.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:30.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110360+0000", 2024-09-12T16:18:30.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.90048930100000002 2024-09-12T16:18:30.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:30.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110374+0000", 2024-09-12T16:18:30.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.33e-05 2024-09-12T16:18:30.278 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.278 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:30.278 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.278 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:27742 3.1 3.d09829a1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e127)", 2024-09-12T16:18:30.278 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:15.210634+0000", 2024-09-12T16:18:30.278 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.978072094, 2024-09-12T16:18:30.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.89977736500000005, 2024-09-12T16:18:30.278 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:30.278 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:30.278 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:18:30.278 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:30.278 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:18:30.279 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:18:30.279 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 27742 2024-09-12T16:18:30.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.279 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:30.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:30.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210634+0000", 2024-09-12T16:18:30.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:30.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210634+0000", 2024-09-12T16:18:30.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:30.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210635+0000", 2024-09-12T16:18:30.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8100000000000001e-07 2024-09-12T16:18:30.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:30.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210641+0000", 2024-09-12T16:18:30.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.429e-06 2024-09-12T16:18:30.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:30.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210656+0000", 2024-09-12T16:18:30.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5557e-05 2024-09-12T16:18:30.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:30.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210663+0000", 2024-09-12T16:18:30.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5930000000000002e-06 2024-09-12T16:18:30.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:30.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210713+0000", 2024-09-12T16:18:30.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0488000000000002e-05 2024-09-12T16:18:30.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T16:18:30.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210722+0000", 2024-09-12T16:18:30.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0790000000000001e-06 2024-09-12T16:18:30.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:30.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110403+0000", 2024-09-12T16:18:30.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.89968195799999995 2024-09-12T16:18:30.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:30.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110412+0000", 2024-09-12T16:18:30.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3799999999999994e-06 2024-09-12T16:18:30.283 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.283 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:30.283 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.283 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:27745 3.1 3.36f5b621 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e127)", 2024-09-12T16:18:30.283 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:15.211355+0000", 2024-09-12T16:18:30.283 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.977351492, 2024-09-12T16:18:30.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.89909103999999995, 2024-09-12T16:18:30.283 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:30.283 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:30.284 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:18:30.284 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:30.284 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:18:30.284 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:18:30.284 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 27745 2024-09-12T16:18:30.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.284 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:30.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:30.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211355+0000", 2024-09-12T16:18:30.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:30.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211355+0000", 2024-09-12T16:18:30.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:30.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:30.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211356+0000", 2024-09-12T16:18:30.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9599999999999998e-07 2024-09-12T16:18:30.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:30.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211360+0000", 2024-09-12T16:18:30.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0419999999999996e-06 2024-09-12T16:18:30.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:30.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211373+0000", 2024-09-12T16:18:30.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3183000000000001e-05 2024-09-12T16:18:30.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:30.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211381+0000", 2024-09-12T16:18:30.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0499999999999992e-06 2024-09-12T16:18:30.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:30.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211438+0000", 2024-09-12T16:18:30.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6576999999999997e-05 2024-09-12T16:18:30.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T16:18:30.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211445+0000", 2024-09-12T16:18:30.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.391e-06 2024-09-12T16:18:30.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:30.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110437+0000", 2024-09-12T16:18:30.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.898991977 2024-09-12T16:18:30.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:30.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:30.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:30.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110446+0000", 2024-09-12T16:18:30.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0240000000000003e-06 2024-09-12T16:18:30.288 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.288 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:30.288 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.288 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:30.288 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:30.288 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:30.290 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:18:30.290 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:18:30.290 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:18:30.291 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:18:30.291 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:18:30.291 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:18:30.292 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:18:30.292 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:30.288+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:30.300 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:18:30.300 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:18:30.317 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:18:30.318 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:18:30.335 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:18:30.335 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:18:30.391 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:30.390+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:30.409 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:30.409 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:30.418 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:18:30.491 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:30.490+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:30.525 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:30.525 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:30.533 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:18:30.592 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:30.591+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:30.640 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:30.640 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:30.648 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:18:30.693 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:30.692+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:30.765 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:30.766 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:30.774 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:18:30.818 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:30.817+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:30.882 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:30.882 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:30.891 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:18:30.894 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:30.893+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:30.995 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:30.994+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:31.038 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T16:18:31.039 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:31.039 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:31.048 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:18:31.096 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:31.095+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:31.155 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:31.155 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:31.164 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:18:31.205 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:31.204+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:31.298 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:31.297+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:31.316 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:31.316 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:31.325 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:18:31.409 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:31.408+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:31.472 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:31.472 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:31.481 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:18:31.522 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:31.521+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:31.600 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:31.599+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:31.628 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:31.628 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:31.637 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:18:31.701 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:31.700+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:31.744 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:31.744 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:31.753 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:18:31.801 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:31.801+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:31.860 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:31.860 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:31.868 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:18:31.902 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:31.902+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:31.987 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:31.987 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:31.996 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:18:32.040 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:32.039+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:32.104 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:32.104 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:32.104 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:32.103+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:32.112 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:18:32.168 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2024-09-12T16:18:32.228 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:32.227+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:32.276 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:32.277 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:32.286 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:18:32.306 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:32.305+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:32.347 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T16:18:32.407 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:32.407+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:32.434 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:32.434 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:32.443 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:18:32.494 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:18:32.494 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:18:32.508 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:32.508+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:32.511 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:18:32.512 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:18:32.528 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:18:32.528 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:18:32.545 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:18:32.546 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:18:32.553 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:32.554 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:32.554 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:18:32.554 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:18:32.554 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:32.562 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:18:32.563 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:18:32.563 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:18:32.580 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:18:32.580 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:18:32.632 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:32.631+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:32.672 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:32.672 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:18:32.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:18:32.672 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:18:32.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.672 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1571 3.b 3:d046566d:::rbd_data.1155525b14e3.0000000000000001:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:18:32.672 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:18:32.672 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 111.51787280000001, 2024-09-12T16:18:32.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064439785999999999, 2024-09-12T16:18:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:18:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:18:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1571 2024-09-12T16:18:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:18:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:32.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:18:32.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:32.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:18:32.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5400000000000002e-07 2024-09-12T16:18:32.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:32.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152567+0000", 2024-09-12T16:18:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.131e-06 2024-09-12T16:18:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152574+0000", 2024-09-12T16:18:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1840000000000002e-06 2024-09-12T16:18:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152579+0000", 2024-09-12T16:18:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.152e-06 2024-09-12T16:18:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153671+0000", 2024-09-12T16:18:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001092078 2024-09-12T16:18:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153779+0000", 2024-09-12T16:18:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108461 2024-09-12T16:18:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217004+0000", 2024-09-12T16:18:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.063224426 2024-09-12T16:18:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.677 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:32.677 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.677 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1581 3.4 3:22e34893:::rbd_data.1155525b14e3.0000000000000005:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:18:32.677 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:18:32.677 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 111.517775675, 2024-09-12T16:18:32.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064484407999999993, 2024-09-12T16:18:32.677 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:32.677 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:32.677 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:32.677 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:32.677 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:18:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:18:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1581 2024-09-12T16:18:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:18:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:18:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152662+0000", 2024-09-12T16:18:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.65e-07 2024-09-12T16:18:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152664+0000", 2024-09-12T16:18:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9829999999999999e-06 2024-09-12T16:18:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152670+0000", 2024-09-12T16:18:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2260000000000002e-06 2024-09-12T16:18:32.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:32.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152675+0000", 2024-09-12T16:18:32.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7990000000000001e-06 2024-09-12T16:18:32.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:32.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.216945+0000", 2024-09-12T16:18:32.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064270341999999994 2024-09-12T16:18:32.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217040+0000", 2024-09-12T16:18:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5242999999999996e-05 2024-09-12T16:18:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217146+0000", 2024-09-12T16:18:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010545 2024-09-12T16:18:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2207 3.0 3:05fdc61f:::rbd_data.1155ccb1894c.0000000000000003:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:18:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:18:32.682 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 95.299732113999994, 2024-09-12T16:18:32.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.05105382, 2024-09-12T16:18:32.682 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:32.682 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:32.682 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:32.682 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:32.682 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:18:32.682 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:18:32.682 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2207 2024-09-12T16:18:32.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.682 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:32.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:32.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:18:32.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:32.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:18:32.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:32.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370706+0000", 2024-09-12T16:18:32.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7800000000000001e-07 2024-09-12T16:18:32.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:32.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391581+0000", 2024-09-12T16:18:32.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020875624999999998 2024-09-12T16:18:32.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:32.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391608+0000", 2024-09-12T16:18:32.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6412999999999999e-05 2024-09-12T16:18:32.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391618+0000", 2024-09-12T16:18:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9240000000000002e-06 2024-09-12T16:18:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391705+0000", 2024-09-12T16:18:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7489000000000002e-05 2024-09-12T16:18:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391838+0000", 2024-09-12T16:18:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132865 2024-09-12T16:18:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 2", 2024-09-12T16:18:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.392587+0000", 2024-09-12T16:18:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074930000000000005 2024-09-12T16:18:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.420095+0000", 2024-09-12T16:18:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027507949 2024-09-12T16:18:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:18:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421610+0000", 2024-09-12T16:18:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001515195 2024-09-12T16:18:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:18:32.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421681+0000", 2024-09-12T16:18:32.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0320000000000004e-05 2024-09-12T16:18:32.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:32.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421759+0000", 2024-09-12T16:18:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7961999999999997e-05 2024-09-12T16:18:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11083 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 3399680~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.876304+0000", 2024-09-12T16:18:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.794132707000003, 2024-09-12T16:18:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045070883999999999, 2024-09-12T16:18:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:32.689 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:32.689 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:32.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:32.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:32.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:32.689 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11083 2024-09-12T16:18:32.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.689 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:32.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:32.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876304+0000", 2024-09-12T16:18:32.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:32.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876304+0000", 2024-09-12T16:18:32.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:32.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876305+0000", 2024-09-12T16:18:32.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4099999999999999e-07 2024-09-12T16:18:32.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:32.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876307+0000", 2024-09-12T16:18:32.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9470000000000002e-06 2024-09-12T16:18:32.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:32.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876312+0000", 2024-09-12T16:18:32.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7540000000000003e-06 2024-09-12T16:18:32.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:32.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876318+0000", 2024-09-12T16:18:32.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3589999999999999e-06 2024-09-12T16:18:32.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:32.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921221+0000", 2024-09-12T16:18:32.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044903464999999997 2024-09-12T16:18:32.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:32.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921266+0000", 2024-09-12T16:18:32.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4795000000000001e-05 2024-09-12T16:18:32.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921375+0000", 2024-09-12T16:18:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000109023 2024-09-12T16:18:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11084 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 3448832~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.876324+0000", 2024-09-12T16:18:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.794112589999997, 2024-09-12T16:18:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045172474999999997, 2024-09-12T16:18:32.694 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:32.694 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:32.694 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:32.694 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:32.694 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:32.694 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:32.694 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11084 2024-09-12T16:18:32.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.694 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:32.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:32.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876324+0000", 2024-09-12T16:18:32.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:32.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876324+0000", 2024-09-12T16:18:32.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:32.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876411+0000", 2024-09-12T16:18:32.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6292000000000007e-05 2024-09-12T16:18:32.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:32.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876418+0000", 2024-09-12T16:18:32.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3309999999999998e-06 2024-09-12T16:18:32.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:32.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876426+0000", 2024-09-12T16:18:32.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3850000000000002e-06 2024-09-12T16:18:32.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876436+0000", 2024-09-12T16:18:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8749999999999995e-06 2024-09-12T16:18:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921403+0000", 2024-09-12T16:18:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044966385999999997 2024-09-12T16:18:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921445+0000", 2024-09-12T16:18:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1953000000000003e-05 2024-09-12T16:18:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921497+0000", 2024-09-12T16:18:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2253000000000003e-05 2024-09-12T16:18:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11085 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 3497984~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.876449+0000", 2024-09-12T16:18:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.793988079999998, 2024-09-12T16:18:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045173054999999997, 2024-09-12T16:18:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:32.699 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:32.699 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:32.699 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:32.699 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:32.699 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:32.699 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11085 2024-09-12T16:18:32.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.699 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:32.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:32.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876449+0000", 2024-09-12T16:18:32.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:32.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876449+0000", 2024-09-12T16:18:32.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:32.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.881997+0000", 2024-09-12T16:18:32.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055481209999999996 2024-09-12T16:18:32.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:32.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.882002+0000", 2024-09-12T16:18:32.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8269999999999997e-06 2024-09-12T16:18:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.882013+0000", 2024-09-12T16:18:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0869999999999999e-05 2024-09-12T16:18:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.882020+0000", 2024-09-12T16:18:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5839999999999997e-06 2024-09-12T16:18:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921523+0000", 2024-09-12T16:18:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039502411000000001 2024-09-12T16:18:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921566+0000", 2024-09-12T16:18:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3353000000000003e-05 2024-09-12T16:18:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921622+0000", 2024-09-12T16:18:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5889e-05 2024-09-12T16:18:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11139 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 6152192~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883248+0000", 2024-09-12T16:18:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.787189216000002, 2024-09-12T16:18:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045153225999999998, 2024-09-12T16:18:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11139 2024-09-12T16:18:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883248+0000", 2024-09-12T16:18:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883248+0000", 2024-09-12T16:18:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883248+0000", 2024-09-12T16:18:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9999999999999998e-07 2024-09-12T16:18:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883250+0000", 2024-09-12T16:18:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0660000000000002e-06 2024-09-12T16:18:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883256+0000", 2024-09-12T16:18:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8699999999999997e-06 2024-09-12T16:18:32.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:32.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883261+0000", 2024-09-12T16:18:32.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0490000000000003e-06 2024-09-12T16:18:32.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:32.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928316+0000", 2024-09-12T16:18:32.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045055398000000003 2024-09-12T16:18:32.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:32.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928359+0000", 2024-09-12T16:18:32.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2286000000000001e-05 2024-09-12T16:18:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928401+0000", 2024-09-12T16:18:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2157000000000003e-05 2024-09-12T16:18:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11140 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 6201344~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883267+0000", 2024-09-12T16:18:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.78716945, 2024-09-12T16:18:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045241199000000003, 2024-09-12T16:18:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:32.708 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:32.708 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:32.708 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:32.708 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:32.708 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11140 2024-09-12T16:18:32.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.708 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:32.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:32.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883267+0000", 2024-09-12T16:18:32.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:32.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883267+0000", 2024-09-12T16:18:32.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:32.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883268+0000", 2024-09-12T16:18:32.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8700000000000001e-07 2024-09-12T16:18:32.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:32.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883270+0000", 2024-09-12T16:18:32.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3420000000000002e-06 2024-09-12T16:18:32.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:32.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883276+0000", 2024-09-12T16:18:32.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0310000000000004e-06 2024-09-12T16:18:32.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:32.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883281+0000", 2024-09-12T16:18:32.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1259999999999997e-06 2024-09-12T16:18:32.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:32.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928428+0000", 2024-09-12T16:18:32.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045146276999999999 2024-09-12T16:18:32.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:32.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928469+0000", 2024-09-12T16:18:32.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1007000000000002e-05 2024-09-12T16:18:32.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:32.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928509+0000", 2024-09-12T16:18:32.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0028999999999999e-05 2024-09-12T16:18:32.711 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.711 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:32.711 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.712 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11141 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 6250496~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:32.712 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883288+0000", 2024-09-12T16:18:32.712 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.787148852999998, 2024-09-12T16:18:32.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045331594000000003, 2024-09-12T16:18:32.712 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:32.712 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:32.712 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:32.712 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:32.712 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:32.712 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:32.712 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11141 2024-09-12T16:18:32.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.712 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:32.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:32.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883288+0000", 2024-09-12T16:18:32.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:32.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883288+0000", 2024-09-12T16:18:32.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:32.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883288+0000", 2024-09-12T16:18:32.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0200000000000003e-07 2024-09-12T16:18:32.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:32.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883290+0000", 2024-09-12T16:18:32.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9350000000000001e-06 2024-09-12T16:18:32.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:32.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883296+0000", 2024-09-12T16:18:32.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.913e-06 2024-09-12T16:18:32.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:32.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883302+0000", 2024-09-12T16:18:32.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.879e-06 2024-09-12T16:18:32.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:32.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928534+0000", 2024-09-12T16:18:32.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045231544999999998 2024-09-12T16:18:32.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:32.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928577+0000", 2024-09-12T16:18:32.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3676e-05 2024-09-12T16:18:32.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:32.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928620+0000", 2024-09-12T16:18:32.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2243999999999997e-05 2024-09-12T16:18:32.716 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.716 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:32.716 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.716 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11271 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3174400~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:32.716 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883316+0000", 2024-09-12T16:18:32.716 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.787120793, 2024-09-12T16:18:32.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045477308000000001, 2024-09-12T16:18:32.716 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:32.716 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:32.717 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:32.717 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:32.717 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:32.717 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:32.717 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11271 2024-09-12T16:18:32.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.717 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:32.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:32.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883316+0000", 2024-09-12T16:18:32.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:32.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883316+0000", 2024-09-12T16:18:32.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:32.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883317+0000", 2024-09-12T16:18:32.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9200000000000001e-07 2024-09-12T16:18:32.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:32.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883319+0000", 2024-09-12T16:18:32.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2670000000000001e-06 2024-09-12T16:18:32.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:32.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883326+0000", 2024-09-12T16:18:32.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6000000000000003e-06 2024-09-12T16:18:32.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:32.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883331+0000", 2024-09-12T16:18:32.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1719999999999998e-06 2024-09-12T16:18:32.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:32.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928647+0000", 2024-09-12T16:18:32.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045316457999999997 2024-09-12T16:18:32.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:32.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928689+0000", 2024-09-12T16:18:32.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1352e-05 2024-09-12T16:18:32.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:32.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928793+0000", 2024-09-12T16:18:32.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000104867 2024-09-12T16:18:32.720 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.720 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:32.721 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.721 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11272 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3223552~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:32.721 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883338+0000", 2024-09-12T16:18:32.721 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.787098933000003, 2024-09-12T16:18:32.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045595268000000001, 2024-09-12T16:18:32.721 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:32.721 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:32.721 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:32.721 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:32.721 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:32.721 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:32.722 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11272 2024-09-12T16:18:32.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.722 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:32.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:32.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883338+0000", 2024-09-12T16:18:32.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:32.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883338+0000", 2024-09-12T16:18:32.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:32.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883339+0000", 2024-09-12T16:18:32.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8599999999999998e-07 2024-09-12T16:18:32.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:32.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883341+0000", 2024-09-12T16:18:32.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1449999999999998e-06 2024-09-12T16:18:32.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:32.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883348+0000", 2024-09-12T16:18:32.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0110000000000003e-06 2024-09-12T16:18:32.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:32.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883353+0000", 2024-09-12T16:18:32.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2360000000000004e-06 2024-09-12T16:18:32.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:32.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928819+0000", 2024-09-12T16:18:32.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045466392000000001 2024-09-12T16:18:32.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:32.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928869+0000", 2024-09-12T16:18:32.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9829e-05 2024-09-12T16:18:32.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:32.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928933+0000", 2024-09-12T16:18:32.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3968999999999997e-05 2024-09-12T16:18:32.725 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.725 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:32.725 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.725 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11273 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3272704~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:32.725 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883359+0000", 2024-09-12T16:18:32.725 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.787077621000002, 2024-09-12T16:18:32.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045735142999999999, 2024-09-12T16:18:32.726 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:32.726 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:32.726 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:32.726 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:32.726 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:32.726 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:32.726 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11273 2024-09-12T16:18:32.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.726 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:32.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:32.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883359+0000", 2024-09-12T16:18:32.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:32.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883359+0000", 2024-09-12T16:18:32.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:32.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883360+0000", 2024-09-12T16:18:32.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9400000000000001e-07 2024-09-12T16:18:32.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:32.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883367+0000", 2024-09-12T16:18:32.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8530000000000003e-06 2024-09-12T16:18:32.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:32.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883373+0000", 2024-09-12T16:18:32.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9989999999999997e-06 2024-09-12T16:18:32.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:32.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883378+0000", 2024-09-12T16:18:32.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3369999999999999e-06 2024-09-12T16:18:32.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:32.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928950+0000", 2024-09-12T16:18:32.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045571751000000001 2024-09-12T16:18:32.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:32.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928992+0000", 2024-09-12T16:18:32.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1891000000000003e-05 2024-09-12T16:18:32.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:32.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929094+0000", 2024-09-12T16:18:32.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010291800000000001 2024-09-12T16:18:32.730 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.730 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:32.730 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.730 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11274 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3321856~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:32.730 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883385+0000", 2024-09-12T16:18:32.730 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.787052103999997, 2024-09-12T16:18:32.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045864239000000001, 2024-09-12T16:18:32.730 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:32.731 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:32.731 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:32.731 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:32.731 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:32.731 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:32.731 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11274 2024-09-12T16:18:32.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.731 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:32.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:32.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883385+0000", 2024-09-12T16:18:32.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:32.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883385+0000", 2024-09-12T16:18:32.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:32.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883385+0000", 2024-09-12T16:18:32.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4799999999999999e-07 2024-09-12T16:18:32.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:32.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883388+0000", 2024-09-12T16:18:32.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3199999999999998e-06 2024-09-12T16:18:32.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.733 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:32.733 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883394+0000", 2024-09-12T16:18:32.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2020000000000001e-06 2024-09-12T16:18:32.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.733 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:32.733 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883400+0000", 2024-09-12T16:18:32.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8510000000000004e-06 2024-09-12T16:18:32.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.733 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:32.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929123+0000", 2024-09-12T16:18:32.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045723235000000001 2024-09-12T16:18:32.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:32.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929166+0000", 2024-09-12T16:18:32.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2769999999999999e-05 2024-09-12T16:18:32.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:32.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929249+0000", 2024-09-12T16:18:32.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3412999999999996e-05 2024-09-12T16:18:32.734 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.735 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:32.735 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.735 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11275 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3371008~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:32.735 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883416+0000", 2024-09-12T16:18:32.735 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.787020495, 2024-09-12T16:18:32.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.046042315, 2024-09-12T16:18:32.735 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:32.735 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:32.735 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:32.735 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:32.735 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:32.735 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:32.736 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11275 2024-09-12T16:18:32.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.736 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:32.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:32.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883416+0000", 2024-09-12T16:18:32.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:32.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883416+0000", 2024-09-12T16:18:32.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:32.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883417+0000", 2024-09-12T16:18:32.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4700000000000001e-07 2024-09-12T16:18:32.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:32.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883419+0000", 2024-09-12T16:18:32.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2029999999999999e-06 2024-09-12T16:18:32.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:32.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883426+0000", 2024-09-12T16:18:32.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.579e-06 2024-09-12T16:18:32.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:32.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883431+0000", 2024-09-12T16:18:32.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5679999999999999e-06 2024-09-12T16:18:32.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:32.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929290+0000", 2024-09-12T16:18:32.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045858227000000001 2024-09-12T16:18:32.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:32.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929365+0000", 2024-09-12T16:18:32.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5519999999999995e-05 2024-09-12T16:18:32.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:32.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929459+0000", 2024-09-12T16:18:32.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3671000000000005e-05 2024-09-12T16:18:32.739 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.739 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:32.739 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.739 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11276 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3420160~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:32.739 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883439+0000", 2024-09-12T16:18:32.739 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.786998091999997, 2024-09-12T16:18:32.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.046138991999999997, 2024-09-12T16:18:32.740 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:32.740 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:32.740 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:32.740 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:32.740 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:32.740 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:32.740 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11276 2024-09-12T16:18:32.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.740 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:32.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:32.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883439+0000", 2024-09-12T16:18:32.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:32.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883439+0000", 2024-09-12T16:18:32.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:32.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883560+0000", 2024-09-12T16:18:32.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121229 2024-09-12T16:18:32.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:32.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883569+0000", 2024-09-12T16:18:32.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9390000000000003e-06 2024-09-12T16:18:32.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:32.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883579+0000", 2024-09-12T16:18:32.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8859999999999999e-06 2024-09-12T16:18:32.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:32.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883585+0000", 2024-09-12T16:18:32.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.545e-06 2024-09-12T16:18:32.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:32.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929486+0000", 2024-09-12T16:18:32.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045900653999999999 2024-09-12T16:18:32.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:32.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929527+0000", 2024-09-12T16:18:32.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0707999999999997e-05 2024-09-12T16:18:32.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:32.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929578+0000", 2024-09-12T16:18:32.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1031e-05 2024-09-12T16:18:32.743 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.743 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:32.743 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.744 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11277 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3469312~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:32.744 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883595+0000", 2024-09-12T16:18:32.744 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.786841748999997, 2024-09-12T16:18:32.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.046187702999999997, 2024-09-12T16:18:32.744 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:32.744 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:32.744 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:32.744 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:32.744 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:32.744 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:32.744 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11277 2024-09-12T16:18:32.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.745 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:32.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:32.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883595+0000", 2024-09-12T16:18:32.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:32.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883595+0000", 2024-09-12T16:18:32.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:32.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.889065+0000", 2024-09-12T16:18:32.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00547001 2024-09-12T16:18:32.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:32.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.889069+0000", 2024-09-12T16:18:32.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1180000000000002e-06 2024-09-12T16:18:32.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:32.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.889079+0000", 2024-09-12T16:18:32.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2250000000000006e-06 2024-09-12T16:18:32.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:32.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.889084+0000", 2024-09-12T16:18:32.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2680000000000002e-06 2024-09-12T16:18:32.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:32.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929612+0000", 2024-09-12T16:18:32.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040528343000000001 2024-09-12T16:18:32.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:32.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929691+0000", 2024-09-12T16:18:32.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8541999999999994e-05 2024-09-12T16:18:32.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:32.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929783+0000", 2024-09-12T16:18:32.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2196999999999998e-05 2024-09-12T16:18:32.748 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.748 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:32.748 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.748 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:27683 3.1 3.d6dd1621 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e127)", 2024-09-12T16:18:32.748 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:15.196201+0000", 2024-09-12T16:18:32.748 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.474236071, 2024-09-12T16:18:32.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.91402251499999998, 2024-09-12T16:18:32.749 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:32.749 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:32.749 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:18:32.749 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:32.749 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:18:32.749 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:18:32.749 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 27683 2024-09-12T16:18:32.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.749 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:32.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:32.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196201+0000", 2024-09-12T16:18:32.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:32.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196201+0000", 2024-09-12T16:18:32.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:32.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196202+0000", 2024-09-12T16:18:32.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4929999999999999e-06 2024-09-12T16:18:32.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:32.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196209+0000", 2024-09-12T16:18:32.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2269999999999998e-06 2024-09-12T16:18:32.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.751 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:32.751 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196221+0000", 2024-09-12T16:18:32.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2517000000000001e-05 2024-09-12T16:18:32.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.751 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:32.751 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196229+0000", 2024-09-12T16:18:32.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3250000000000008e-06 2024-09-12T16:18:32.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.751 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:32.751 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196293+0000", 2024-09-12T16:18:32.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3975999999999999e-05 2024-09-12T16:18:32.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T16:18:32.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196299+0000", 2024-09-12T16:18:32.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3000000000000001e-06 2024-09-12T16:18:32.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:32.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110210+0000", 2024-09-12T16:18:32.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.91391175099999999 2024-09-12T16:18:32.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:32.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110223+0000", 2024-09-12T16:18:32.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2926e-05 2024-09-12T16:18:32.753 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.753 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:32.753 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.753 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:27740 3.1 3.859365c1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e127)", 2024-09-12T16:18:32.753 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:15.209778+0000", 2024-09-12T16:18:32.753 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.460658941999998, 2024-09-12T16:18:32.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.90059554500000005, 2024-09-12T16:18:32.753 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:32.753 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:32.753 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:18:32.754 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:32.754 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:18:32.754 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:18:32.754 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 27740 2024-09-12T16:18:32.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.754 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:32.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:32.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209778+0000", 2024-09-12T16:18:32.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:32.755 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209778+0000", 2024-09-12T16:18:32.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.755 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:32.755 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209779+0000", 2024-09-12T16:18:32.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.274e-06 2024-09-12T16:18:32.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.755 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:32.755 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209785+0000", 2024-09-12T16:18:32.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3310000000000003e-06 2024-09-12T16:18:32.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.756 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:32.756 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209799+0000", 2024-09-12T16:18:32.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.448e-05 2024-09-12T16:18:32.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.756 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:32.756 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209806+0000", 2024-09-12T16:18:32.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3479999999999998e-06 2024-09-12T16:18:32.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.756 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:32.756 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209864+0000", 2024-09-12T16:18:32.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7395999999999997e-05 2024-09-12T16:18:32.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T16:18:32.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209871+0000", 2024-09-12T16:18:32.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1149999999999996e-06 2024-09-12T16:18:32.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:32.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110360+0000", 2024-09-12T16:18:32.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.90048930100000002 2024-09-12T16:18:32.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:32.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110374+0000", 2024-09-12T16:18:32.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.33e-05 2024-09-12T16:18:32.758 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.758 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:32.758 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.758 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:27742 3.1 3.d09829a1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e127)", 2024-09-12T16:18:32.758 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:15.210634+0000", 2024-09-12T16:18:32.758 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.459802446000001, 2024-09-12T16:18:32.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.89977736500000005, 2024-09-12T16:18:32.758 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:32.758 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:32.759 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:18:32.759 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:32.759 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:18:32.759 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:18:32.759 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 27742 2024-09-12T16:18:32.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.759 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:32.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.759 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:32.759 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210634+0000", 2024-09-12T16:18:32.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.759 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:32.760 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210634+0000", 2024-09-12T16:18:32.760 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.760 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:32.760 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210635+0000", 2024-09-12T16:18:32.760 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8100000000000001e-07 2024-09-12T16:18:32.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.760 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:32.760 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210641+0000", 2024-09-12T16:18:32.760 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.429e-06 2024-09-12T16:18:32.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:32.761 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210656+0000", 2024-09-12T16:18:32.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5557e-05 2024-09-12T16:18:32.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:32.761 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210663+0000", 2024-09-12T16:18:32.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5930000000000002e-06 2024-09-12T16:18:32.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:32.761 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210713+0000", 2024-09-12T16:18:32.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0488000000000002e-05 2024-09-12T16:18:32.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T16:18:32.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210722+0000", 2024-09-12T16:18:32.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0790000000000001e-06 2024-09-12T16:18:32.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:32.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110403+0000", 2024-09-12T16:18:32.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.89968195799999995 2024-09-12T16:18:32.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:32.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110412+0000", 2024-09-12T16:18:32.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3799999999999994e-06 2024-09-12T16:18:32.763 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.763 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:32.763 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.763 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:27745 3.1 3.36f5b621 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e127)", 2024-09-12T16:18:32.763 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:15.211355+0000", 2024-09-12T16:18:32.763 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.459081844, 2024-09-12T16:18:32.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.89909103999999995, 2024-09-12T16:18:32.763 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:32.763 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:32.763 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:18:32.763 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:32.764 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:18:32.764 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:18:32.764 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 27745 2024-09-12T16:18:32.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.764 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:32.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:32.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211355+0000", 2024-09-12T16:18:32.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:32.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211355+0000", 2024-09-12T16:18:32.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:32.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:32.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211356+0000", 2024-09-12T16:18:32.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9599999999999998e-07 2024-09-12T16:18:32.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:32.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211360+0000", 2024-09-12T16:18:32.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0419999999999996e-06 2024-09-12T16:18:32.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:32.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211373+0000", 2024-09-12T16:18:32.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3183000000000001e-05 2024-09-12T16:18:32.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:32.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211381+0000", 2024-09-12T16:18:32.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0499999999999992e-06 2024-09-12T16:18:32.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:32.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211438+0000", 2024-09-12T16:18:32.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6576999999999997e-05 2024-09-12T16:18:32.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T16:18:32.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211445+0000", 2024-09-12T16:18:32.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.391e-06 2024-09-12T16:18:32.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:32.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110437+0000", 2024-09-12T16:18:32.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.898991977 2024-09-12T16:18:32.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:32.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:32.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:32.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110446+0000", 2024-09-12T16:18:32.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0240000000000003e-06 2024-09-12T16:18:32.767 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.767 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:32.767 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.768 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:32.768 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:32.768 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:32.769 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:18:32.770 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:32.768+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:32.870 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:32.869+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:32.918 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:32.918 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:32.918 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:18:32.918 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:32.927 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:18:32.971 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:32.970+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:33.035 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 3, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-12T16:18:33.035 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T16:18:33.036 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T16:18:33.039 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:33.039 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:33.039 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:18:33.039 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:18:33.039 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:33.049 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:18:33.071 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:33.070+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:33.172 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:33.171+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:33.206 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:33.206 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:18:33.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:18:33.206 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:18:33.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.207 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2213 3.18 3:1944e921:::rbd_data.1155ccb1894c.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:18:33.207 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:18:33.207 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 95.829667990000004, 2024-09-12T16:18:33.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.055657836000000002, 2024-09-12T16:18:33.207 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:33.207 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:33.207 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:33.207 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:33.207 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:18:33.207 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:18:33.207 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2213 2024-09-12T16:18:33.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.207 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:33.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:33.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:18:33.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:33.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:18:33.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:33.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375351+0000", 2024-09-12T16:18:33.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.556e-06 2024-09-12T16:18:33.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:33.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.399989+0000", 2024-09-12T16:18:33.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024637949999999999 2024-09-12T16:18:33.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:33.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400038+0000", 2024-09-12T16:18:33.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9187999999999997e-05 2024-09-12T16:18:33.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400056+0000", 2024-09-12T16:18:33.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8451e-05 2024-09-12T16:18:33.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:33.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400151+0000", 2024-09-12T16:18:33.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5026999999999997e-05 2024-09-12T16:18:33.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:33.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400345+0000", 2024-09-12T16:18:33.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019352900000000001 2024-09-12T16:18:33.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 1", 2024-09-12T16:18:33.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.401319+0000", 2024-09-12T16:18:33.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00097419399999999995 2024-09-12T16:18:33.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:18:33.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.429350+0000", 2024-09-12T16:18:33.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028030607999999999 2024-09-12T16:18:33.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:33.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.430907+0000", 2024-09-12T16:18:33.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001557466 2024-09-12T16:18:33.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:18:33.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.430966+0000", 2024-09-12T16:18:33.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9437e-05 2024-09-12T16:18:33.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:33.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.431007+0000", 2024-09-12T16:18:33.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0429999999999997e-05 2024-09-12T16:18:33.212 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.212 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:33.212 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.213 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5632 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 585728~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:33.213 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556262+0000", 2024-09-12T16:18:33.213 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.648754933999999, 2024-09-12T16:18:33.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051267114000000003, 2024-09-12T16:18:33.213 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:33.213 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:33.213 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:33.213 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:33.213 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:33.213 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:33.213 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5632 2024-09-12T16:18:33.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.213 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:33.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.214 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:33.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556262+0000", 2024-09-12T16:18:33.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.214 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:33.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556262+0000", 2024-09-12T16:18:33.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.214 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:33.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556262+0000", 2024-09-12T16:18:33.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9999999999999998e-07 2024-09-12T16:18:33.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:33.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556269+0000", 2024-09-12T16:18:33.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4119999999999998e-06 2024-09-12T16:18:33.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:33.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556276+0000", 2024-09-12T16:18:33.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8549999999999996e-06 2024-09-12T16:18:33.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556281+0000", 2024-09-12T16:18:33.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1159999999999998e-06 2024-09-12T16:18:33.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:33.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607438+0000", 2024-09-12T16:18:33.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.05115695 2024-09-12T16:18:33.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:33.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607478+0000", 2024-09-12T16:18:33.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0535999999999999e-05 2024-09-12T16:18:33.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:33.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607529+0000", 2024-09-12T16:18:33.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0844999999999999e-05 2024-09-12T16:18:33.217 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.217 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:33.217 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.217 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5633 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 638976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:33.217 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556288+0000", 2024-09-12T16:18:33.217 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.648728901999998, 2024-09-12T16:18:33.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051384633999999998, 2024-09-12T16:18:33.217 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:33.217 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:33.218 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:33.218 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:33.218 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:33.218 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:33.218 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5633 2024-09-12T16:18:33.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.218 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:33.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:33.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556288+0000", 2024-09-12T16:18:33.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:33.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556288+0000", 2024-09-12T16:18:33.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:33.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556289+0000", 2024-09-12T16:18:33.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4000000000000002e-07 2024-09-12T16:18:33.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:33.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556291+0000", 2024-09-12T16:18:33.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0470000000000001e-06 2024-09-12T16:18:33.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.220 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:33.220 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556297+0000", 2024-09-12T16:18:33.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5080000000000002e-06 2024-09-12T16:18:33.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.220 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.220 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556302+0000", 2024-09-12T16:18:33.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2190000000000003e-06 2024-09-12T16:18:33.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.220 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:33.220 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607559+0000", 2024-09-12T16:18:33.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051256542000000002 2024-09-12T16:18:33.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:33.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607619+0000", 2024-09-12T16:18:33.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0538000000000002e-05 2024-09-12T16:18:33.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:33.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607673+0000", 2024-09-12T16:18:33.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3340000000000001e-05 2024-09-12T16:18:33.221 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.222 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:33.222 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.222 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5634 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 692224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:33.222 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556324+0000", 2024-09-12T16:18:33.222 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.648693213000001, 2024-09-12T16:18:33.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.05149252, 2024-09-12T16:18:33.222 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:33.222 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:33.222 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:33.222 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:33.223 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:33.223 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:33.223 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5634 2024-09-12T16:18:33.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.223 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:33.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.223 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:33.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556324+0000", 2024-09-12T16:18:33.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.223 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:33.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556324+0000", 2024-09-12T16:18:33.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:33.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556324+0000", 2024-09-12T16:18:33.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1900000000000002e-07 2024-09-12T16:18:33.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:33.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556327+0000", 2024-09-12T16:18:33.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T16:18:33.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:33.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556334+0000", 2024-09-12T16:18:33.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3919999999999997e-06 2024-09-12T16:18:33.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556341+0000", 2024-09-12T16:18:33.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6000000000000003e-06 2024-09-12T16:18:33.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:33.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607704+0000", 2024-09-12T16:18:33.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051363233000000001 2024-09-12T16:18:33.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:33.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607764+0000", 2024-09-12T16:18:33.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9871000000000003e-05 2024-09-12T16:18:33.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:33.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607816+0000", 2024-09-12T16:18:33.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2374999999999999e-05 2024-09-12T16:18:33.226 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.226 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:33.226 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.227 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5635 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 745472~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:33.227 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556348+0000", 2024-09-12T16:18:33.227 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.648668642000001, 2024-09-12T16:18:33.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051607838000000003, 2024-09-12T16:18:33.227 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:33.227 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:33.227 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:33.227 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:33.227 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:33.227 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:33.227 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5635 2024-09-12T16:18:33.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.228 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:33.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:33.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556348+0000", 2024-09-12T16:18:33.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:33.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556348+0000", 2024-09-12T16:18:33.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:33.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556349+0000", 2024-09-12T16:18:33.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.75e-07 2024-09-12T16:18:33.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:33.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556351+0000", 2024-09-12T16:18:33.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1890000000000001e-06 2024-09-12T16:18:33.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:33.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556358+0000", 2024-09-12T16:18:33.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.922e-06 2024-09-12T16:18:33.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556363+0000", 2024-09-12T16:18:33.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.242e-06 2024-09-12T16:18:33.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:33.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607846+0000", 2024-09-12T16:18:33.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051482433000000001 2024-09-12T16:18:33.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:33.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607886+0000", 2024-09-12T16:18:33.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0290999999999998e-05 2024-09-12T16:18:33.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:33.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607956+0000", 2024-09-12T16:18:33.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0285999999999998e-05 2024-09-12T16:18:33.231 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.231 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:33.231 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.231 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5636 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 806912~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:33.231 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556371+0000", 2024-09-12T16:18:33.231 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.648646463999999, 2024-09-12T16:18:33.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051725921000000001, 2024-09-12T16:18:33.231 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:33.232 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:33.232 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:33.232 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:33.232 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:33.232 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:33.232 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5636 2024-09-12T16:18:33.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.232 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:33.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:33.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556371+0000", 2024-09-12T16:18:33.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:33.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556371+0000", 2024-09-12T16:18:33.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:33.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556371+0000", 2024-09-12T16:18:33.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9800000000000004e-07 2024-09-12T16:18:33.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:33.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556373+0000", 2024-09-12T16:18:33.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0490000000000002e-06 2024-09-12T16:18:33.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:33.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556380+0000", 2024-09-12T16:18:33.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6050000000000003e-06 2024-09-12T16:18:33.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556385+0000", 2024-09-12T16:18:33.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2449999999999998e-06 2024-09-12T16:18:33.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:33.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607993+0000", 2024-09-12T16:18:33.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051608182000000002 2024-09-12T16:18:33.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:33.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608035+0000", 2024-09-12T16:18:33.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1698e-05 2024-09-12T16:18:33.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:33.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608096+0000", 2024-09-12T16:18:33.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1643999999999995e-05 2024-09-12T16:18:33.236 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.236 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:33.236 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.236 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5637 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 860160~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:33.236 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556393+0000", 2024-09-12T16:18:33.236 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.648623813, 2024-09-12T16:18:33.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051839035999999998, 2024-09-12T16:18:33.236 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:33.236 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:33.236 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:33.236 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:33.236 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:33.237 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:33.237 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5637 2024-09-12T16:18:33.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.237 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:33.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.237 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:33.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556393+0000", 2024-09-12T16:18:33.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.237 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:33.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556393+0000", 2024-09-12T16:18:33.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:33.238 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556394+0000", 2024-09-12T16:18:33.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3000000000000001e-07 2024-09-12T16:18:33.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:33.238 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556396+0000", 2024-09-12T16:18:33.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0839999999999999e-06 2024-09-12T16:18:33.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:33.238 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556402+0000", 2024-09-12T16:18:33.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6919999999999996e-06 2024-09-12T16:18:33.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556408+0000", 2024-09-12T16:18:33.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2800000000000003e-06 2024-09-12T16:18:33.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:33.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608129+0000", 2024-09-12T16:18:33.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051720902999999999 2024-09-12T16:18:33.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:33.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608174+0000", 2024-09-12T16:18:33.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5676000000000001e-05 2024-09-12T16:18:33.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:33.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608232+0000", 2024-09-12T16:18:33.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7970999999999998e-05 2024-09-12T16:18:33.240 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.240 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:33.240 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.241 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5638 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 913408~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:33.241 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556415+0000", 2024-09-12T16:18:33.241 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.648602418999999, 2024-09-12T16:18:33.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051949532999999999, 2024-09-12T16:18:33.241 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:33.241 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:33.241 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:33.241 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:33.241 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:33.241 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:33.241 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5638 2024-09-12T16:18:33.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.241 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:33.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:33.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556415+0000", 2024-09-12T16:18:33.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:33.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556415+0000", 2024-09-12T16:18:33.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:33.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556415+0000", 2024-09-12T16:18:33.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7199999999999999e-07 2024-09-12T16:18:33.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:33.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556417+0000", 2024-09-12T16:18:33.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0279999999999999e-06 2024-09-12T16:18:33.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:33.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556424+0000", 2024-09-12T16:18:33.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6950000000000003e-06 2024-09-12T16:18:33.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556429+0000", 2024-09-12T16:18:33.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3059999999999997e-06 2024-09-12T16:18:33.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.244 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:33.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608260+0000", 2024-09-12T16:18:33.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051831254 2024-09-12T16:18:33.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.244 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:33.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608306+0000", 2024-09-12T16:18:33.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5976999999999997e-05 2024-09-12T16:18:33.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:33.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608364+0000", 2024-09-12T16:18:33.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7800999999999998e-05 2024-09-12T16:18:33.245 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.245 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:33.245 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.245 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5639 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 966656~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:33.246 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556436+0000", 2024-09-12T16:18:33.246 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.648580746, 2024-09-12T16:18:33.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052070419, 2024-09-12T16:18:33.246 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:33.246 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:33.246 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:33.246 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:33.246 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:33.246 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:33.246 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5639 2024-09-12T16:18:33.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.246 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:33.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:33.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556436+0000", 2024-09-12T16:18:33.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:33.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556436+0000", 2024-09-12T16:18:33.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:33.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556437+0000", 2024-09-12T16:18:33.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1899999999999998e-07 2024-09-12T16:18:33.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:33.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556439+0000", 2024-09-12T16:18:33.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.973e-06 2024-09-12T16:18:33.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:33.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556445+0000", 2024-09-12T16:18:33.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7769999999999997e-06 2024-09-12T16:18:33.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556451+0000", 2024-09-12T16:18:33.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.31e-06 2024-09-12T16:18:33.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:33.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608397+0000", 2024-09-12T16:18:33.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051945829999999998 2024-09-12T16:18:33.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:33.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608438+0000", 2024-09-12T16:18:33.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1539000000000003e-05 2024-09-12T16:18:33.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:33.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608507+0000", 2024-09-12T16:18:33.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8571000000000005e-05 2024-09-12T16:18:33.250 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.250 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:33.250 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.250 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5640 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1019904~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:33.250 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556458+0000", 2024-09-12T16:18:33.250 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.648559234, 2024-09-12T16:18:33.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052171423000000001, 2024-09-12T16:18:33.250 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:33.250 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:33.251 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:33.251 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:33.251 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:33.251 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:33.251 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5640 2024-09-12T16:18:33.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.251 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:33.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:33.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556458+0000", 2024-09-12T16:18:33.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:33.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556458+0000", 2024-09-12T16:18:33.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:33.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556458+0000", 2024-09-12T16:18:33.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2500000000000001e-07 2024-09-12T16:18:33.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:33.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556460+0000", 2024-09-12T16:18:33.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.934e-06 2024-09-12T16:18:33.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:33.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556468+0000", 2024-09-12T16:18:33.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7950000000000008e-06 2024-09-12T16:18:33.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556473+0000", 2024-09-12T16:18:33.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3539999999999999e-06 2024-09-12T16:18:33.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:33.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608539+0000", 2024-09-12T16:18:33.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052065974000000001 2024-09-12T16:18:33.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:33.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608579+0000", 2024-09-12T16:18:33.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0238999999999999e-05 2024-09-12T16:18:33.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:33.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608629+0000", 2024-09-12T16:18:33.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9701999999999999e-05 2024-09-12T16:18:33.254 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.254 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:33.254 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.254 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5641 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1081344~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:33.254 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556480+0000", 2024-09-12T16:18:33.255 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.648536624999998, 2024-09-12T16:18:33.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052284826999999999, 2024-09-12T16:18:33.255 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:33.255 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:33.255 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:33.255 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:33.255 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:33.255 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:33.255 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5641 2024-09-12T16:18:33.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.255 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:33.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:33.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556480+0000", 2024-09-12T16:18:33.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:33.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556480+0000", 2024-09-12T16:18:33.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:33.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556481+0000", 2024-09-12T16:18:33.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.27e-07 2024-09-12T16:18:33.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:33.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556483+0000", 2024-09-12T16:18:33.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9379999999999999e-06 2024-09-12T16:18:33.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:33.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556489+0000", 2024-09-12T16:18:33.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5910000000000001e-06 2024-09-12T16:18:33.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556495+0000", 2024-09-12T16:18:33.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5600000000000001e-06 2024-09-12T16:18:33.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:33.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608659+0000", 2024-09-12T16:18:33.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052164489000000001 2024-09-12T16:18:33.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:33.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608714+0000", 2024-09-12T16:18:33.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4849999999999998e-05 2024-09-12T16:18:33.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:33.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608765+0000", 2024-09-12T16:18:33.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0971999999999999e-05 2024-09-12T16:18:33.259 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.259 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:33.259 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.260 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5642 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1134592~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:33.260 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556502+0000", 2024-09-12T16:18:33.260 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.648514729999999, 2024-09-12T16:18:33.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052404536000000002, 2024-09-12T16:18:33.260 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:33.260 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:33.260 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:33.260 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:33.260 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:33.260 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:33.260 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5642 2024-09-12T16:18:33.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.260 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:33.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:33.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556502+0000", 2024-09-12T16:18:33.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:33.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556502+0000", 2024-09-12T16:18:33.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:33.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556503+0000", 2024-09-12T16:18:33.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8599999999999998e-07 2024-09-12T16:18:33.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:33.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556505+0000", 2024-09-12T16:18:33.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.097e-06 2024-09-12T16:18:33.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:33.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556512+0000", 2024-09-12T16:18:33.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8229999999999997e-06 2024-09-12T16:18:33.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556517+0000", 2024-09-12T16:18:33.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6289999999999998e-06 2024-09-12T16:18:33.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:33.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608797+0000", 2024-09-12T16:18:33.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052279651000000003 2024-09-12T16:18:33.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:33.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608852+0000", 2024-09-12T16:18:33.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4994999999999998e-05 2024-09-12T16:18:33.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:33.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608907+0000", 2024-09-12T16:18:33.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4755e-05 2024-09-12T16:18:33.264 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.264 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:33.264 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.264 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5643 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1187840~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:33.265 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556525+0000", 2024-09-12T16:18:33.265 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.648492487999999, 2024-09-12T16:18:33.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052518288000000003, 2024-09-12T16:18:33.265 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:33.265 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:33.265 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:33.265 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:33.265 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:33.265 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:33.265 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5643 2024-09-12T16:18:33.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.265 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:33.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:33.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556525+0000", 2024-09-12T16:18:33.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:33.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556525+0000", 2024-09-12T16:18:33.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:33.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556525+0000", 2024-09-12T16:18:33.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0400000000000002e-07 2024-09-12T16:18:33.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:33.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556528+0000", 2024-09-12T16:18:33.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8679999999999999e-06 2024-09-12T16:18:33.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:33.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556536+0000", 2024-09-12T16:18:33.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3089999999999996e-06 2024-09-12T16:18:33.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556541+0000", 2024-09-12T16:18:33.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3120000000000001e-06 2024-09-12T16:18:33.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:33.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608943+0000", 2024-09-12T16:18:33.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052401089999999997 2024-09-12T16:18:33.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:33.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608991+0000", 2024-09-12T16:18:33.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8633e-05 2024-09-12T16:18:33.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:33.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609043+0000", 2024-09-12T16:18:33.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1672000000000003e-05 2024-09-12T16:18:33.269 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.269 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:33.269 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.269 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5644 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1241088~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:33.269 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556548+0000", 2024-09-12T16:18:33.269 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.648468954999998, 2024-09-12T16:18:33.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052634777000000001, 2024-09-12T16:18:33.269 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:33.269 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:33.269 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:33.269 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:33.269 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:33.270 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:33.270 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5644 2024-09-12T16:18:33.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.270 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:33.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:33.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556548+0000", 2024-09-12T16:18:33.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:33.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556548+0000", 2024-09-12T16:18:33.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:33.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556549+0000", 2024-09-12T16:18:33.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1900000000000003e-07 2024-09-12T16:18:33.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:33.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556555+0000", 2024-09-12T16:18:33.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.652e-06 2024-09-12T16:18:33.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:33.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556562+0000", 2024-09-12T16:18:33.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.905e-06 2024-09-12T16:18:33.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556567+0000", 2024-09-12T16:18:33.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1730000000000003e-06 2024-09-12T16:18:33.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:33.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609079+0000", 2024-09-12T16:18:33.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052511993 2024-09-12T16:18:33.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:33.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609125+0000", 2024-09-12T16:18:33.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5327000000000002e-05 2024-09-12T16:18:33.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:33.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609183+0000", 2024-09-12T16:18:33.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8208000000000002e-05 2024-09-12T16:18:33.273 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.273 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:33.273 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.273 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5645 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1294336~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:33.273 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556574+0000", 2024-09-12T16:18:33.273 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.648442556999999, 2024-09-12T16:18:33.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052876909999999999, 2024-09-12T16:18:33.273 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:33.273 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:33.273 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:33.274 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:33.274 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:33.274 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:33.274 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5645 2024-09-12T16:18:33.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.274 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:33.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:33.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556574+0000", 2024-09-12T16:18:33.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:33.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556574+0000", 2024-09-12T16:18:33.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:33.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556575+0000", 2024-09-12T16:18:33.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.89e-07 2024-09-12T16:18:33.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:33.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556577+0000", 2024-09-12T16:18:33.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8700000000000001e-06 2024-09-12T16:18:33.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:33.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556583+0000", 2024-09-12T16:18:33.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4320000000000004e-06 2024-09-12T16:18:33.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556589+0000", 2024-09-12T16:18:33.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3890000000000004e-06 2024-09-12T16:18:33.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:33.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609236+0000", 2024-09-12T16:18:33.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052647022000000002 2024-09-12T16:18:33.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:33.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609334+0000", 2024-09-12T16:18:33.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8039000000000001e-05 2024-09-12T16:18:33.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:33.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609451+0000", 2024-09-12T16:18:33.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117769 2024-09-12T16:18:33.277 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.277 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:33.277 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.278 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5646 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1355776~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:33.278 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556595+0000", 2024-09-12T16:18:33.278 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.648421576, 2024-09-12T16:18:33.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053088173000000002, 2024-09-12T16:18:33.278 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:33.278 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:33.278 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:33.278 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:33.278 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:33.278 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:33.278 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5646 2024-09-12T16:18:33.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.278 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:33.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:33.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556595+0000", 2024-09-12T16:18:33.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:33.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556595+0000", 2024-09-12T16:18:33.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:33.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556596+0000", 2024-09-12T16:18:33.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:18:33.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:33.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556598+0000", 2024-09-12T16:18:33.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0669999999999999e-06 2024-09-12T16:18:33.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:33.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556603+0000", 2024-09-12T16:18:33.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5210000000000002e-06 2024-09-12T16:18:33.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556609+0000", 2024-09-12T16:18:33.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1590000000000001e-06 2024-09-12T16:18:33.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:33.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609499+0000", 2024-09-12T16:18:33.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052890489999999998 2024-09-12T16:18:33.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:33.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609586+0000", 2024-09-12T16:18:33.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6681999999999994e-05 2024-09-12T16:18:33.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:33.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609684+0000", 2024-09-12T16:18:33.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7863999999999997e-05 2024-09-12T16:18:33.282 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.282 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:33.282 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.282 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5647 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1409024~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:33.282 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556616+0000", 2024-09-12T16:18:33.282 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.648401281000002, 2024-09-12T16:18:33.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053207888000000002, 2024-09-12T16:18:33.283 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:33.283 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:33.283 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:33.283 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:33.283 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:33.283 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:33.283 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5647 2024-09-12T16:18:33.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.283 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:33.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:33.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556616+0000", 2024-09-12T16:18:33.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:33.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556616+0000", 2024-09-12T16:18:33.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:33.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556616+0000", 2024-09-12T16:18:33.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3599999999999999e-07 2024-09-12T16:18:33.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:33.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556618+0000", 2024-09-12T16:18:33.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1550000000000001e-06 2024-09-12T16:18:33.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:33.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556624+0000", 2024-09-12T16:18:33.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0499999999999997e-06 2024-09-12T16:18:33.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556629+0000", 2024-09-12T16:18:33.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8840000000000002e-06 2024-09-12T16:18:33.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:33.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609721+0000", 2024-09-12T16:18:33.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053091808999999997 2024-09-12T16:18:33.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:33.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609767+0000", 2024-09-12T16:18:33.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.638e-05 2024-09-12T16:18:33.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:33.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609824+0000", 2024-09-12T16:18:33.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6174000000000001e-05 2024-09-12T16:18:33.287 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.287 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:33.287 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.288 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5648 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1462272~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:33.288 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556636+0000", 2024-09-12T16:18:33.288 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.648380622000001, 2024-09-12T16:18:33.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053322131000000002, 2024-09-12T16:18:33.288 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:33.288 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:33.288 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:33.288 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:33.288 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:33.288 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:33.288 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5648 2024-09-12T16:18:33.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.288 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:33.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:33.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556636+0000", 2024-09-12T16:18:33.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:33.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556636+0000", 2024-09-12T16:18:33.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:33.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557015+0000", 2024-09-12T16:18:33.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000378911 2024-09-12T16:18:33.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:33.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557019+0000", 2024-09-12T16:18:33.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2100000000000002e-06 2024-09-12T16:18:33.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:33.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557030+0000", 2024-09-12T16:18:33.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.149e-05 2024-09-12T16:18:33.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557037+0000", 2024-09-12T16:18:33.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5719999999999999e-06 2024-09-12T16:18:33.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:33.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609838+0000", 2024-09-12T16:18:33.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052801305999999999 2024-09-12T16:18:33.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:33.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609880+0000", 2024-09-12T16:18:33.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2604000000000001e-05 2024-09-12T16:18:33.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:33.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609959+0000", 2024-09-12T16:18:33.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8038000000000001e-05 2024-09-12T16:18:33.292 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.292 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:33.292 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.292 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5649 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1515520~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:33.292 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.557073+0000", 2024-09-12T16:18:33.292 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.647943621, 2024-09-12T16:18:33.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053030573999999997, 2024-09-12T16:18:33.292 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:33.292 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:33.292 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:33.293 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:33.293 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:33.293 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:33.293 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5649 2024-09-12T16:18:33.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.293 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:33.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:33.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557073+0000", 2024-09-12T16:18:33.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:33.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557073+0000", 2024-09-12T16:18:33.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:33.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557074+0000", 2024-09-12T16:18:33.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5199999999999996e-07 2024-09-12T16:18:33.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:33.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557084+0000", 2024-09-12T16:18:33.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0349e-05 2024-09-12T16:18:33.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:33.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557092+0000", 2024-09-12T16:18:33.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9699999999999999e-06 2024-09-12T16:18:33.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557100+0000", 2024-09-12T16:18:33.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7049999999999999e-06 2024-09-12T16:18:33.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:33.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609992+0000", 2024-09-12T16:18:33.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052891821999999998 2024-09-12T16:18:33.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:33.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610034+0000", 2024-09-12T16:18:33.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2141000000000002e-05 2024-09-12T16:18:33.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:33.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610104+0000", 2024-09-12T16:18:33.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9935e-05 2024-09-12T16:18:33.296 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.296 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:33.296 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.297 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5650 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1568768~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:33.297 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.557111+0000", 2024-09-12T16:18:33.297 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.647906399, 2024-09-12T16:18:33.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053118023, 2024-09-12T16:18:33.297 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:33.297 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:33.297 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:33.297 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:33.297 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:33.297 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:33.297 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5650 2024-09-12T16:18:33.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.297 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:33.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:33.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557111+0000", 2024-09-12T16:18:33.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:33.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557111+0000", 2024-09-12T16:18:33.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:33.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:33.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.562089+0000", 2024-09-12T16:18:33.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0049787410000000001 2024-09-12T16:18:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.562094+0000", 2024-09-12T16:18:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7210000000000002e-06 2024-09-12T16:18:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.562105+0000", 2024-09-12T16:18:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0458999999999999e-05 2024-09-12T16:18:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.562112+0000", 2024-09-12T16:18:33.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0280000000000003e-06 2024-09-12T16:18:33.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:33.300 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610135+0000", 2024-09-12T16:18:33.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048023374000000001 2024-09-12T16:18:33.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:33.300 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610177+0000", 2024-09-12T16:18:33.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2119000000000001e-05 2024-09-12T16:18:33.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:33.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:33.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:33.300 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610229+0000", 2024-09-12T16:18:33.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1581e-05 2024-09-12T16:18:33.301 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.301 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:33.301 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.301 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:33.301 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:33.301 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:33.302 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:18:33.303 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:33.301+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:33.345 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:18:33.345 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-12T16:18:33.357 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":227,"stamp":"2024-09-12T16:18:33.011878+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":951621363,"num_objects":1213,"num_object_clones":232,"num_object_copies":2426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1213,"num_whiteouts":583,"num_read":447927,"num_read_kb":1619761,"num_write":28427,"num_write_kb":480348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5094,"num_bytes_recovered":203261420,"num_keys_recovered":679,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22989,"ondisk_log_size":22989,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":89,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":613016,"kb_used_data":277204,"kb_used_omap":19,"kb_used_meta":335660,"kb_avail":565618024,"statfs":{"total":579820584960,"available":579192856576,"internally_reserved":0,"allocated":283856896,"data_stored":343487384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19565,"internal_metadata":343716755},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-64533509,"num_objects":-138,"num_object_clones":-40,"num_object_copies":-276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-177,"num_objects_misplaced":-42,"num_objects_unfound":0,"num_objects_dirty":-138,"num_whiteouts":-25,"num_read":1344,"num_read_kb":1144,"num_write":209,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":11878989,"num_keys_recovered":47,"num_objects_omap":-4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000022"},"pg_stats":[{"pgid":"3.1f","version":"140'624","reported_seq":18715,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.018513+0000","last_change":"2024-09-12T16:18:29.020414+0000","last_active":"2024-09-12T16:18:29.018513+0000","last_peered":"2024-09-12T16:18:29.018513+0000","last_clean":"2024-09-12T16:18:29.018513+0000","last_became_active":"2024-09-12T16:17:21.011550+0000","last_became_peered":"2024-09-12T16:17:21.011550+0000","last_unstale":"2024-09-12T16:18:29.018513+0000","last_undegraded":"2024-09-12T16:18:29.018513+0000","last_fullsized":"2024-09-12T16:18:29.018513+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:23.502360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021885440000000002,"stat_sum":{"num_bytes":27834422,"num_objects":43,"num_object_clones":10,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":20,"num_read":18829,"num_read_kb":74245,"num_write":846,"num_write_kb":11027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":2818651,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"17","length":"5"}]},{"pgid":"3.1e","version":"141'581","reported_seq":13863,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.104789+0000","last_change":"2024-09-12T16:18:29.024655+0000","last_active":"2024-09-12T16:18:29.104789+0000","last_peered":"2024-09-12T16:18:29.104789+0000","last_clean":"2024-09-12T16:18:29.104789+0000","last_became_active":"2024-09-12T16:16:55.202876+0000","last_became_peered":"2024-09-12T16:16:55.202876+0000","last_unstale":"2024-09-12T16:18:29.104789+0000","last_undegraded":"2024-09-12T16:18:29.104789+0000","last_fullsized":"2024-09-12T16:18:29.104789+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":581,"log_dups_size":0,"ondisk_log_size":581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:08.975385+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.010298932,"stat_sum":{"num_bytes":14819344,"num_objects":44,"num_object_clones":6,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":23,"num_read":13699,"num_read_kb":46927,"num_write":612,"num_write_kb":8472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":3145760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"17","length":"5"}]},{"pgid":"3.1d","version":"140'1478","reported_seq":20140,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.015516+0000","last_change":"2024-09-12T16:18:29.015859+0000","last_active":"2024-09-12T16:18:29.015516+0000","last_peered":"2024-09-12T16:18:29.015516+0000","last_clean":"2024-09-12T16:18:29.015516+0000","last_became_active":"2024-09-12T16:18:26.148000+0000","last_became_peered":"2024-09-12T16:18:26.148000+0000","last_unstale":"2024-09-12T16:18:29.015516+0000","last_undegraded":"2024-09-12T16:18:29.015516+0000","last_fullsized":"2024-09-12T16:18:29.015516+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1478,"log_dups_size":0,"ondisk_log_size":1478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:03.106630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056150000000000004,"stat_sum":{"num_bytes":43510499,"num_objects":43,"num_object_clones":9,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":20,"num_read":22707,"num_read_kb":67057,"num_write":2102,"num_write_kb":16171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":374,"num_bytes_recovered":30814554,"num_keys_recovered":34,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"17","length":"5"}]},{"pgid":"3.1c","version":"141'816","reported_seq":8892,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.144075+0000","last_change":"2024-09-12T16:18:29.021022+0000","last_active":"2024-09-12T16:18:29.144075+0000","last_peered":"2024-09-12T16:18:29.144075+0000","last_clean":"2024-09-12T16:18:29.144075+0000","last_became_active":"2024-09-12T16:18:25.147460+0000","last_became_peered":"2024-09-12T16:18:25.147460+0000","last_unstale":"2024-09-12T16:18:29.144075+0000","last_undegraded":"2024-09-12T16:18:29.144075+0000","last_fullsized":"2024-09-12T16:18:29.144075+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:58.548750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055907109999999999,"stat_sum":{"num_bytes":13700112,"num_objects":30,"num_object_clones":7,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":19,"num_read":9585,"num_read_kb":27770,"num_write":1074,"num_write_kb":6805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":3550768,"num_keys_recovered":168,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"17","length":"5"}]},{"pgid":"3.1b","version":"141'1232","reported_seq":8714,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.116151+0000","last_change":"2024-09-12T16:18:29.024549+0000","last_active":"2024-09-12T16:18:29.116151+0000","last_peered":"2024-09-12T16:18:29.116151+0000","last_clean":"2024-09-12T16:18:29.116151+0000","last_became_active":"2024-09-12T16:17:21.011585+0000","last_became_peered":"2024-09-12T16:17:21.011585+0000","last_unstale":"2024-09-12T16:18:29.116151+0000","last_undegraded":"2024-09-12T16:18:29.116151+0000","last_fullsized":"2024-09-12T16:18:29.116151+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1232,"log_dups_size":0,"ondisk_log_size":1232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:29.884550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005271881,"stat_sum":{"num_bytes":38033920,"num_objects":34,"num_object_clones":8,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":20,"num_read":12367,"num_read_kb":38179,"num_write":1723,"num_write_kb":15361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":14697984,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"17","length":"5"}]},{"pgid":"3.1a","version":"141'1294","reported_seq":11714,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.171212+0000","last_change":"2024-09-12T16:18:29.020973+0000","last_active":"2024-09-12T16:18:29.171212+0000","last_peered":"2024-09-12T16:18:29.171212+0000","last_clean":"2024-09-12T16:18:29.171212+0000","last_became_active":"2024-09-12T16:15:57.014803+0000","last_became_peered":"2024-09-12T16:15:57.014803+0000","last_unstale":"2024-09-12T16:18:29.171212+0000","last_undegraded":"2024-09-12T16:18:29.171212+0000","last_fullsized":"2024-09-12T16:18:29.171212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1294,"log_dups_size":0,"ondisk_log_size":1294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:23.656310+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0057167600000000004,"stat_sum":{"num_bytes":22376995,"num_objects":38,"num_object_clones":5,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":24,"num_read":15187,"num_read_kb":54209,"num_write":2001,"num_write_kb":21868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"17","length":"5"}]},{"pgid":"3.19","version":"141'503","reported_seq":14768,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.126022+0000","last_change":"2024-09-12T16:18:29.021872+0000","last_active":"2024-09-12T16:18:29.126022+0000","last_peered":"2024-09-12T16:18:29.126022+0000","last_clean":"2024-09-12T16:18:29.126022+0000","last_became_active":"2024-09-12T16:15:57.016110+0000","last_became_peered":"2024-09-12T16:15:57.016110+0000","last_unstale":"2024-09-12T16:18:29.126022+0000","last_undegraded":"2024-09-12T16:18:29.126022+0000","last_fullsized":"2024-09-12T16:18:29.126022+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:35.462841+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0076947109999999999,"stat_sum":{"num_bytes":14480416,"num_objects":55,"num_object_clones":13,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":28,"num_read":14630,"num_read_kb":54219,"num_write":552,"num_write_kb":10346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"17","length":"5"}]},{"pgid":"3.18","version":"141'740","reported_seq":6215,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.078078+0000","last_change":"2024-09-12T16:18:29.019416+0000","last_active":"2024-09-12T16:18:29.078078+0000","last_peered":"2024-09-12T16:18:29.078078+0000","last_clean":"2024-09-12T16:18:29.078078+0000","last_became_active":"2024-09-12T16:17:21.009370+0000","last_became_peered":"2024-09-12T16:17:21.009370+0000","last_unstale":"2024-09-12T16:18:29.078078+0000","last_undegraded":"2024-09-12T16:18:29.078078+0000","last_fullsized":"2024-09-12T16:18:29.078078+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:57.268766+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0056489160000000004,"stat_sum":{"num_bytes":35805779,"num_objects":29,"num_object_clones":5,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":13,"num_read":7092,"num_read_kb":45463,"num_write":882,"num_write_kb":34056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":17173091,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"17","length":"5"}]},{"pgid":"3.17","version":"140'633","reported_seq":8134,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.019702+0000","last_change":"2024-09-12T16:18:29.020376+0000","last_active":"2024-09-12T16:18:29.019702+0000","last_peered":"2024-09-12T16:18:29.019702+0000","last_clean":"2024-09-12T16:18:29.019702+0000","last_became_active":"2024-09-12T16:18:26.148363+0000","last_became_peered":"2024-09-12T16:18:26.148363+0000","last_unstale":"2024-09-12T16:18:29.019702+0000","last_undegraded":"2024-09-12T16:18:29.019702+0000","last_fullsized":"2024-09-12T16:18:29.019702+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:19.131494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015737100000000001,"stat_sum":{"num_bytes":52512836,"num_objects":49,"num_object_clones":10,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":24,"num_read":7823,"num_read_kb":33805,"num_write":883,"num_write_kb":21940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":331,"num_bytes_recovered":20360415,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"17","length":"5"}]},{"pgid":"3.16","version":"141'1479","reported_seq":15382,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.179797+0000","last_change":"2024-09-12T16:18:29.019227+0000","last_active":"2024-09-12T16:18:29.179797+0000","last_peered":"2024-09-12T16:18:29.179797+0000","last_clean":"2024-09-12T16:18:29.179797+0000","last_became_active":"2024-09-12T16:18:26.147921+0000","last_became_peered":"2024-09-12T16:18:26.147921+0000","last_unstale":"2024-09-12T16:18:29.179797+0000","last_undegraded":"2024-09-12T16:18:29.179797+0000","last_fullsized":"2024-09-12T16:18:29.179797+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1479,"log_dups_size":0,"ondisk_log_size":1479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:19.358915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0057940680000000003,"stat_sum":{"num_bytes":31707498,"num_objects":52,"num_object_clones":13,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":24,"num_read":18556,"num_read_kb":49514,"num_write":2270,"num_write_kb":15627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":483,"num_bytes_recovered":14102804,"num_keys_recovered":132,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"17","length":"5"}]},{"pgid":"3.15","version":"140'353","reported_seq":7667,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.018049+0000","last_change":"2024-09-12T16:18:29.018545+0000","last_active":"2024-09-12T16:18:29.018049+0000","last_peered":"2024-09-12T16:18:29.018049+0000","last_clean":"2024-09-12T16:18:29.018049+0000","last_became_active":"2024-09-12T16:16:55.203324+0000","last_became_peered":"2024-09-12T16:16:55.203324+0000","last_unstale":"2024-09-12T16:18:29.018049+0000","last_undegraded":"2024-09-12T16:18:29.018049+0000","last_fullsized":"2024-09-12T16:18:29.018049+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:18.011400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0053948920000000001,"stat_sum":{"num_bytes":54003761,"num_objects":43,"num_object_clones":10,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":19,"num_read":6918,"num_read_kb":49308,"num_write":406,"num_write_kb":20795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":1054818,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"17","length":"5"}]},{"pgid":"3.14","version":"141'825","reported_seq":9056,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.177290+0000","last_change":"2024-09-12T16:18:29.018072+0000","last_active":"2024-09-12T16:18:29.177290+0000","last_peered":"2024-09-12T16:18:29.177290+0000","last_clean":"2024-09-12T16:18:29.177290+0000","last_became_active":"2024-09-12T16:16:53.185698+0000","last_became_peered":"2024-09-12T16:16:53.185698+0000","last_unstale":"2024-09-12T16:18:29.177290+0000","last_undegraded":"2024-09-12T16:18:29.177290+0000","last_fullsized":"2024-09-12T16:18:29.177290+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":825,"log_dups_size":0,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:00.751989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0048897360000000004,"stat_sum":{"num_bytes":45479003,"num_objects":35,"num_object_clones":5,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":17,"num_read":11594,"num_read_kb":49880,"num_write":1103,"num_write_kb":23381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"17","length":"5"}]},{"pgid":"2.7","version":"0'0","reported_seq":169,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.013366+0000","last_change":"2024-09-12T16:16:52.184699+0000","last_active":"2024-09-12T16:18:29.013366+0000","last_peered":"2024-09-12T16:18:29.013366+0000","last_clean":"2024-09-12T16:18:29.013366+0000","last_became_active":"2024-09-12T16:16:52.184420+0000","last_became_peered":"2024-09-12T16:16:52.184420+0000","last_unstale":"2024-09-12T16:18:29.013366+0000","last_undegraded":"2024-09-12T16:18:29.013366+0000","last_fullsized":"2024-09-12T16:18:29.013366+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:50.051152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"141'476","reported_seq":9625,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.023985+0000","last_change":"2024-09-12T16:18:29.023985+0000","last_active":"2024-09-12T16:18:29.023985+0000","last_peered":"2024-09-12T16:18:29.023985+0000","last_clean":"2024-09-12T16:18:29.023985+0000","last_became_active":"2024-09-12T16:15:57.012577+0000","last_became_peered":"2024-09-12T16:15:57.012577+0000","last_unstale":"2024-09-12T16:18:29.023985+0000","last_undegraded":"2024-09-12T16:18:29.023985+0000","last_fullsized":"2024-09-12T16:18:29.023985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:52.308435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0050613050000000003,"stat_sum":{"num_bytes":17486382,"num_objects":16,"num_object_clones":3,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":5,"num_read":10169,"num_read_kb":43938,"num_write":455,"num_write_kb":9188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"17","length":"5"}]},{"pgid":"2.6","version":"0'0","reported_seq":277,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.013945+0000","last_change":"2024-09-12T16:16:52.187010+0000","last_active":"2024-09-12T16:18:29.013945+0000","last_peered":"2024-09-12T16:18:29.013945+0000","last_clean":"2024-09-12T16:18:29.013945+0000","last_became_active":"2024-09-12T16:16:52.186638+0000","last_became_peered":"2024-09-12T16:16:52.186638+0000","last_unstale":"2024-09-12T16:18:29.013945+0000","last_undegraded":"2024-09-12T16:18:29.013945+0000","last_fullsized":"2024-09-12T16:18:29.013945+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:40.681796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066384400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"140'734","reported_seq":16597,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.015871+0000","last_change":"2024-09-12T16:18:29.018118+0000","last_active":"2024-09-12T16:18:29.015871+0000","last_peered":"2024-09-12T16:18:29.015871+0000","last_clean":"2024-09-12T16:18:29.015871+0000","last_became_active":"2024-09-12T16:16:34.108850+0000","last_became_peered":"2024-09-12T16:16:34.108850+0000","last_unstale":"2024-09-12T16:18:29.015871+0000","last_undegraded":"2024-09-12T16:18:29.015871+0000","last_fullsized":"2024-09-12T16:18:29.015871+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":734,"log_dups_size":0,"ondisk_log_size":734,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:55.290310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038820909999999998,"stat_sum":{"num_bytes":50278912,"num_objects":39,"num_object_clones":9,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":19,"num_read":17664,"num_read_kb":61096,"num_write":654,"num_write_kb":27115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"17","length":"5"}]},{"pgid":"2.5","version":"0'0","reported_seq":169,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.013236+0000","last_change":"2024-09-12T16:16:52.183981+0000","last_active":"2024-09-12T16:18:29.013236+0000","last_peered":"2024-09-12T16:18:29.013236+0000","last_clean":"2024-09-12T16:18:29.013236+0000","last_became_active":"2024-09-12T16:16:52.183675+0000","last_became_peered":"2024-09-12T16:16:52.183675+0000","last_unstale":"2024-09-12T16:18:29.013236+0000","last_undegraded":"2024-09-12T16:18:29.013236+0000","last_fullsized":"2024-09-12T16:18:29.013236+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:35.267433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"140'704","reported_seq":8072,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.148698+0000","last_change":"2024-09-12T16:18:29.020034+0000","last_active":"2024-09-12T16:18:29.148698+0000","last_peered":"2024-09-12T16:18:29.148698+0000","last_clean":"2024-09-12T16:18:29.148698+0000","last_became_active":"2024-09-12T16:15:57.011381+0000","last_became_peered":"2024-09-12T16:15:57.011381+0000","last_unstale":"2024-09-12T16:18:29.148698+0000","last_undegraded":"2024-09-12T16:18:29.148698+0000","last_fullsized":"2024-09-12T16:18:29.148698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:48.809509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0051824920000000003,"stat_sum":{"num_bytes":12183552,"num_objects":35,"num_object_clones":2,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":15,"num_read":10188,"num_read_kb":43936,"num_write":902,"num_write_kb":7778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"17","length":"5"}]},{"pgid":"2.4","version":"0'0","reported_seq":265,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.015066+0000","last_change":"2024-09-12T16:15:48.822724+0000","last_active":"2024-09-12T16:18:29.015066+0000","last_peered":"2024-09-12T16:18:29.015066+0000","last_clean":"2024-09-12T16:18:29.015066+0000","last_became_active":"2024-09-12T16:15:46.818676+0000","last_became_peered":"2024-09-12T16:15:46.818676+0000","last_unstale":"2024-09-12T16:18:29.015066+0000","last_undegraded":"2024-09-12T16:18:29.015066+0000","last_fullsized":"2024-09-12T16:18:29.015066+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:11.170806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065522900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"137'751","reported_seq":21792,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.157169+0000","last_change":"2024-09-12T16:18:29.021867+0000","last_active":"2024-09-12T16:18:29.157169+0000","last_peered":"2024-09-12T16:18:29.157169+0000","last_clean":"2024-09-12T16:18:29.157169+0000","last_became_active":"2024-09-12T16:18:25.145884+0000","last_became_peered":"2024-09-12T16:18:25.145884+0000","last_unstale":"2024-09-12T16:18:29.157169+0000","last_undegraded":"2024-09-12T16:18:29.157169+0000","last_fullsized":"2024-09-12T16:18:29.157169+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:33.761323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0074612669999999997,"stat_sum":{"num_bytes":13641760,"num_objects":40,"num_object_clones":11,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":18,"num_read":25121,"num_read_kb":48337,"num_write":680,"num_write_kb":4777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":335,"num_bytes_recovered":4005968,"num_keys_recovered":105,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"17","length":"5"}]},{"pgid":"3.3","version":"141'721","reported_seq":6224,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.122472+0000","last_change":"2024-09-12T16:18:29.021306+0000","last_active":"2024-09-12T16:18:29.122472+0000","last_peered":"2024-09-12T16:18:29.122472+0000","last_clean":"2024-09-12T16:18:29.122472+0000","last_became_active":"2024-09-12T16:15:57.012238+0000","last_became_peered":"2024-09-12T16:15:57.012238+0000","last_unstale":"2024-09-12T16:18:29.122472+0000","last_undegraded":"2024-09-12T16:18:29.122472+0000","last_fullsized":"2024-09-12T16:18:29.122472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:58.776208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0057815879999999998,"stat_sum":{"num_bytes":66140748,"num_objects":35,"num_object_clones":10,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":13,"num_read":6405,"num_read_kb":41391,"num_write":919,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"17","length":"5"}]},{"pgid":"2.2","version":"19'2","reported_seq":286,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.014609+0000","last_change":"2024-09-12T16:18:22.131014+0000","last_active":"2024-09-12T16:18:29.014609+0000","last_peered":"2024-09-12T16:18:29.014609+0000","last_clean":"2024-09-12T16:18:29.014609+0000","last_became_active":"2024-09-12T16:18:22.127939+0000","last_became_peered":"2024-09-12T16:18:22.127939+0000","last_unstale":"2024-09-12T16:18:29.014609+0000","last_undegraded":"2024-09-12T16:18:29.014609+0000","last_fullsized":"2024-09-12T16:18:29.014609+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:08.073541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"137'717","reported_seq":18441,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.014012+0000","last_change":"2024-09-12T16:18:29.014641+0000","last_active":"2024-09-12T16:18:29.014012+0000","last_peered":"2024-09-12T16:18:29.014012+0000","last_clean":"2024-09-12T16:18:29.014012+0000","last_became_active":"2024-09-12T16:15:57.014294+0000","last_became_peered":"2024-09-12T16:15:57.014294+0000","last_unstale":"2024-09-12T16:18:29.014012+0000","last_undegraded":"2024-09-12T16:18:29.014012+0000","last_fullsized":"2024-09-12T16:18:29.014012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:17.472530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001159382,"stat_sum":{"num_bytes":21942380,"num_objects":36,"num_object_clones":7,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":17,"num_read":19631,"num_read_kb":52701,"num_write":630,"num_write_kb":17119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"17","length":"5"}]},{"pgid":"2.1","version":"0'0","reported_seq":249,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.019797+0000","last_change":"2024-09-12T16:18:29.019699+0000","last_active":"2024-09-12T16:18:29.019797+0000","last_peered":"2024-09-12T16:18:29.019797+0000","last_clean":"2024-09-12T16:18:29.019797+0000","last_became_active":"2024-09-12T16:18:29.019339+0000","last_became_peered":"2024-09-12T16:18:29.019339+0000","last_unstale":"2024-09-12T16:18:29.019797+0000","last_undegraded":"2024-09-12T16:18:29.019797+0000","last_fullsized":"2024-09-12T16:18:29.019797+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:51:54.701552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"140'467","reported_seq":5687,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.014231+0000","last_change":"2024-09-12T16:18:29.015757+0000","last_active":"2024-09-12T16:18:29.014231+0000","last_peered":"2024-09-12T16:18:29.014231+0000","last_clean":"2024-09-12T16:18:29.014231+0000","last_became_active":"2024-09-12T16:18:19.018295+0000","last_became_peered":"2024-09-12T16:18:19.018295+0000","last_unstale":"2024-09-12T16:18:29.014231+0000","last_undegraded":"2024-09-12T16:18:29.014231+0000","last_fullsized":"2024-09-12T16:18:29.014231+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:06.047432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020208240000000001,"stat_sum":{"num_bytes":19890781,"num_objects":33,"num_object_clones":5,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":18,"num_read":5407,"num_read_kb":44101,"num_write":628,"num_write_kb":24794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":10774621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"17","length":"5"}]},{"pgid":"2.0","version":"0'0","reported_seq":169,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.012888+0000","last_change":"2024-09-12T16:16:52.184861+0000","last_active":"2024-09-12T16:18:29.012888+0000","last_peered":"2024-09-12T16:18:29.012888+0000","last_clean":"2024-09-12T16:18:29.012888+0000","last_became_active":"2024-09-12T16:16:52.184555+0000","last_became_peered":"2024-09-12T16:16:52.184555+0000","last_unstale":"2024-09-12T16:18:29.012888+0000","last_undegraded":"2024-09-12T16:18:29.012888+0000","last_fullsized":"2024-09-12T16:18:29.012888+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:32.617153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"141'537","reported_seq":9935,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.019340+0000","last_change":"2024-09-12T16:18:29.019340+0000","last_active":"2024-09-12T16:18:29.019340+0000","last_peered":"2024-09-12T16:18:29.019340+0000","last_clean":"2024-09-12T16:18:29.019340+0000","last_became_active":"2024-09-12T16:18:25.146756+0000","last_became_peered":"2024-09-12T16:18:25.146756+0000","last_unstale":"2024-09-12T16:18:29.019340+0000","last_undegraded":"2024-09-12T16:18:29.019340+0000","last_fullsized":"2024-09-12T16:18:29.019340+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":537,"log_dups_size":0,"ondisk_log_size":537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:56.306048+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0048356090000000003,"stat_sum":{"num_bytes":25903648,"num_objects":35,"num_object_clones":7,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":15,"num_read":9715,"num_read_kb":35956,"num_write":465,"num_write_kb":7462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":315,"num_bytes_recovered":8454224,"num_keys_recovered":35,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"17","length":"5"}]},{"pgid":"2.3","version":"17'1","reported_seq":265,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.014162+0000","last_change":"2024-09-12T16:18:22.132779+0000","last_active":"2024-09-12T16:18:29.014162+0000","last_peered":"2024-09-12T16:18:29.014162+0000","last_clean":"2024-09-12T16:18:29.014162+0000","last_became_active":"2024-09-12T16:18:22.128933+0000","last_became_peered":"2024-09-12T16:18:22.128933+0000","last_unstale":"2024-09-12T16:18:29.014162+0000","last_undegraded":"2024-09-12T16:18:29.014162+0000","last_fullsized":"2024-09-12T16:18:29.014162+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:54.609583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":175,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.012897+0000","last_change":"2024-09-12T16:16:52.190735+0000","last_active":"2024-09-12T16:18:29.012897+0000","last_peered":"2024-09-12T16:18:29.012897+0000","last_clean":"2024-09-12T16:18:29.012897+0000","last_became_active":"2024-09-12T16:16:52.183781+0000","last_became_peered":"2024-09-12T16:16:52.183781+0000","last_unstale":"2024-09-12T16:18:29.012897+0000","last_undegraded":"2024-09-12T16:18:29.012897+0000","last_fullsized":"2024-09-12T16:18:29.012897+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:40.751677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:40.751677+0000","last_clean_scrub_stamp":"2024-09-12T16:15:40.751677+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:34.274075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"141'547","reported_seq":13449,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.111057+0000","last_change":"2024-09-12T16:18:29.014815+0000","last_active":"2024-09-12T16:18:29.111057+0000","last_peered":"2024-09-12T16:18:29.111057+0000","last_clean":"2024-09-12T16:18:29.111057+0000","last_became_active":"2024-09-12T16:16:34.108998+0000","last_became_peered":"2024-09-12T16:16:34.108998+0000","last_unstale":"2024-09-12T16:18:29.111057+0000","last_undegraded":"2024-09-12T16:18:29.111057+0000","last_fullsized":"2024-09-12T16:18:29.111057+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":547,"log_dups_size":0,"ondisk_log_size":547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:36.294056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010027370000000001,"stat_sum":{"num_bytes":44141320,"num_objects":41,"num_object_clones":7,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":19,"num_read":13162,"num_read_kb":49399,"num_write":648,"num_write_kb":7941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"17","length":"5"}]},{"pgid":"3.9","version":"141'464","reported_seq":31426,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.020408+0000","last_change":"2024-09-12T16:18:29.020408+0000","last_active":"2024-09-12T16:18:29.020408+0000","last_peered":"2024-09-12T16:18:29.020408+0000","last_clean":"2024-09-12T16:18:29.020408+0000","last_became_active":"2024-09-12T16:15:57.013620+0000","last_became_peered":"2024-09-12T16:15:57.013620+0000","last_unstale":"2024-09-12T16:18:29.020408+0000","last_undegraded":"2024-09-12T16:18:29.020408+0000","last_fullsized":"2024-09-12T16:18:29.020408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:22.558246+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0051029220000000002,"stat_sum":{"num_bytes":52614144,"num_objects":28,"num_object_clones":6,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":14,"num_read":30743,"num_read_kb":77489,"num_write":555,"num_write_kb":11505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"17","length":"5"}]},{"pgid":"3.a","version":"141'841","reported_seq":20639,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.104020+0000","last_change":"2024-09-12T16:18:29.020533+0000","last_active":"2024-09-12T16:18:29.104020+0000","last_peered":"2024-09-12T16:18:29.104020+0000","last_clean":"2024-09-12T16:18:29.104020+0000","last_became_active":"2024-09-12T16:16:55.202934+0000","last_became_peered":"2024-09-12T16:16:55.202934+0000","last_unstale":"2024-09-12T16:18:29.104020+0000","last_undegraded":"2024-09-12T16:18:29.104020+0000","last_fullsized":"2024-09-12T16:18:29.104020+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:53.576369+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0074385500000000004,"stat_sum":{"num_bytes":35980900,"num_objects":36,"num_object_clones":7,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":17,"num_read":21885,"num_read_kb":59564,"num_write":905,"num_write_kb":8220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":4487368,"num_keys_recovered":26,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"17","length":"5"}]},{"pgid":"3.b","version":"141'498","reported_seq":15464,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.180354+0000","last_change":"2024-09-12T16:18:29.015108+0000","last_active":"2024-09-12T16:18:29.180354+0000","last_peered":"2024-09-12T16:18:29.180354+0000","last_clean":"2024-09-12T16:18:29.180354+0000","last_became_active":"2024-09-12T16:15:57.012845+0000","last_became_peered":"2024-09-12T16:15:57.012845+0000","last_unstale":"2024-09-12T16:18:29.180354+0000","last_undegraded":"2024-09-12T16:18:29.180354+0000","last_fullsized":"2024-09-12T16:18:29.180354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:07.647291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001300587,"stat_sum":{"num_bytes":6962307,"num_objects":27,"num_object_clones":1,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":13,"num_read":15267,"num_read_kb":48857,"num_write":559,"num_write_kb":5111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"17","length":"5"}]},{"pgid":"3.c","version":"140'420","reported_seq":11354,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.020476+0000","last_change":"2024-09-12T16:18:29.022023+0000","last_active":"2024-09-12T16:18:29.020476+0000","last_peered":"2024-09-12T16:18:29.020476+0000","last_clean":"2024-09-12T16:18:29.020476+0000","last_became_active":"2024-09-12T16:18:26.148424+0000","last_became_peered":"2024-09-12T16:18:26.148424+0000","last_unstale":"2024-09-12T16:18:29.020476+0000","last_undegraded":"2024-09-12T16:18:29.020476+0000","last_fullsized":"2024-09-12T16:18:29.020476+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:39.963756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003435801,"stat_sum":{"num_bytes":21029376,"num_objects":43,"num_object_clones":9,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":22,"num_read":9857,"num_read_kb":46208,"num_write":409,"num_write_kb":17232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":316,"num_bytes_recovered":11704832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"17","length":"5"}]},{"pgid":"3.d","version":"137'586","reported_seq":16915,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.140939+0000","last_change":"2024-09-12T16:18:29.019685+0000","last_active":"2024-09-12T16:18:29.140939+0000","last_peered":"2024-09-12T16:18:29.140939+0000","last_clean":"2024-09-12T16:18:29.140939+0000","last_became_active":"2024-09-12T16:16:55.202102+0000","last_became_peered":"2024-09-12T16:16:55.202102+0000","last_unstale":"2024-09-12T16:18:29.140939+0000","last_undegraded":"2024-09-12T16:18:29.140939+0000","last_fullsized":"2024-09-12T16:18:29.140939+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:24.100704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0062401690000000003,"stat_sum":{"num_bytes":24765489,"num_objects":40,"num_object_clones":8,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":16,"num_read":18068,"num_read_kb":58103,"num_write":564,"num_write_kb":13608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":126,"num_bytes_recovered":6078562,"num_keys_recovered":48,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"17","length":"5"}]},{"pgid":"3.e","version":"140'526","reported_seq":7359,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.021090+0000","last_change":"2024-09-12T16:18:29.021350+0000","last_active":"2024-09-12T16:18:29.021090+0000","last_peered":"2024-09-12T16:18:29.021090+0000","last_clean":"2024-09-12T16:18:29.021090+0000","last_became_active":"2024-09-12T16:18:26.147326+0000","last_became_peered":"2024-09-12T16:18:26.147326+0000","last_unstale":"2024-09-12T16:18:29.021090+0000","last_undegraded":"2024-09-12T16:18:29.021090+0000","last_fullsized":"2024-09-12T16:18:29.021090+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:59.561410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058195469999999996,"stat_sum":{"num_bytes":16303104,"num_objects":36,"num_object_clones":4,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":19,"num_read":7459,"num_read_kb":29736,"num_write":516,"num_write_kb":13250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":319,"num_bytes_recovered":6744127,"num_keys_recovered":60,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"17","length":"5"}]},{"pgid":"3.f","version":"140'630","reported_seq":12045,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.020156+0000","last_change":"2024-09-12T16:18:29.020156+0000","last_active":"2024-09-12T16:18:29.020156+0000","last_peered":"2024-09-12T16:18:29.020156+0000","last_clean":"2024-09-12T16:18:29.020156+0000","last_became_active":"2024-09-12T16:18:26.146621+0000","last_became_peered":"2024-09-12T16:18:26.146621+0000","last_unstale":"2024-09-12T16:18:29.020156+0000","last_undegraded":"2024-09-12T16:18:29.020156+0000","last_fullsized":"2024-09-12T16:18:29.020156+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:52.034507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0066124449999999998,"stat_sum":{"num_bytes":10921083,"num_objects":24,"num_object_clones":1,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":15,"num_read":10848,"num_read_kb":49105,"num_write":807,"num_write_kb":21657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":304,"num_bytes_recovered":6361542,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"17","length":"5"}]},{"pgid":"3.10","version":"141'595","reported_seq":15036,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.024451+0000","last_change":"2024-09-12T16:18:29.024451+0000","last_active":"2024-09-12T16:18:29.024451+0000","last_peered":"2024-09-12T16:18:29.024451+0000","last_clean":"2024-09-12T16:18:29.024451+0000","last_became_active":"2024-09-12T16:18:25.146733+0000","last_became_peered":"2024-09-12T16:18:25.146733+0000","last_unstale":"2024-09-12T16:18:29.024451+0000","last_undegraded":"2024-09-12T16:18:29.024451+0000","last_fullsized":"2024-09-12T16:18:29.024451+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:20.829960+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0057465529999999997,"stat_sum":{"num_bytes":29220107,"num_objects":48,"num_object_clones":11,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":24,"num_read":12787,"num_read_kb":73171,"num_write":771,"num_write_kb":17171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":412,"num_bytes_recovered":13039478,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"17","length":"5"}]},{"pgid":"3.11","version":"141'618","reported_seq":16836,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.104405+0000","last_change":"2024-09-12T16:18:29.017083+0000","last_active":"2024-09-12T16:18:29.104405+0000","last_peered":"2024-09-12T16:18:29.104405+0000","last_clean":"2024-09-12T16:18:29.104405+0000","last_became_active":"2024-09-12T16:16:55.202493+0000","last_became_peered":"2024-09-12T16:16:55.202493+0000","last_unstale":"2024-09-12T16:18:29.104405+0000","last_undegraded":"2024-09-12T16:18:29.104405+0000","last_fullsized":"2024-09-12T16:18:29.104405+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:43.072560+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.00408663,"stat_sum":{"num_bytes":26840151,"num_objects":36,"num_object_clones":6,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":16,"num_read":16721,"num_read_kb":61487,"num_write":784,"num_write_kb":15885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":1725440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"17","length":"5"}]},{"pgid":"3.12","version":"141'598","reported_seq":14747,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.023408+0000","last_change":"2024-09-12T16:18:29.023408+0000","last_active":"2024-09-12T16:18:29.023408+0000","last_peered":"2024-09-12T16:18:29.023408+0000","last_clean":"2024-09-12T16:18:29.023408+0000","last_became_active":"2024-09-12T16:16:55.202220+0000","last_became_peered":"2024-09-12T16:16:55.202220+0000","last_unstale":"2024-09-12T16:18:29.023408+0000","last_undegraded":"2024-09-12T16:18:29.023408+0000","last_fullsized":"2024-09-12T16:18:29.023408+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":598,"log_dups_size":0,"ondisk_log_size":598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:21.237497+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0048240760000000001,"stat_sum":{"num_bytes":27636262,"num_objects":34,"num_object_clones":5,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":16,"num_read":15967,"num_read_kb":59823,"num_write":629,"num_write_kb":14663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":3518540,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"17","length":"5"}]},{"pgid":"3.13","version":"141'926","reported_seq":11199,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-12T16:18:29.017206+0000","last_change":"2024-09-12T16:18:29.017206+0000","last_active":"2024-09-12T16:18:29.017206+0000","last_peered":"2024-09-12T16:18:29.017206+0000","last_clean":"2024-09-12T16:18:29.017206+0000","last_became_active":"2024-09-12T16:18:25.147080+0000","last_became_peered":"2024-09-12T16:18:25.147080+0000","last_unstale":"2024-09-12T16:18:29.017206+0000","last_undegraded":"2024-09-12T16:18:29.017206+0000","last_fullsized":"2024-09-12T16:18:29.017206+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":926,"log_dups_size":0,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:21:59.016901+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0041615080000000004,"stat_sum":{"num_bytes":32883985,"num_objects":52,"num_object_clones":12,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":21,"num_read":11810,"num_read_kb":44732,"num_write":1390,"num_write_kb":19185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":434,"num_bytes_recovered":17467099,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"17","length":"5"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":951030976,"num_objects":1209,"num_object_clones":232,"num_object_copies":2418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1209,"num_whiteouts":583,"num_read":447861,"num_read_kb":1619706,"num_write":28324,"num_write_kb":478718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5086,"num_bytes_recovered":202080646,"num_keys_recovered":679,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":271425536,"data_stored":336564551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6949,"internal_metadata":0},"log_size":22914,"ondisk_log_size":22914,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":5,"up_from":71,"seq":304942678035,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61088,"kb_used_data":24204,"kb_used_omap":11,"kb_used_meta":36852,"kb_avail":94310752,"statfs":{"total":96636764160,"available":96574210048,"internally_reserved":0,"allocated":24784896,"data_stored":31785840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11593,"internal_metadata":37737143},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640293,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":116136,"kb_used_data":40532,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94255704,"statfs":{"total":96636764160,"available":96517840896,"internally_reserved":0,"allocated":41504768,"data_stored":49781551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640294,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118440,"kb_used_data":42828,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94253400,"statfs":{"total":96636764160,"available":96515481600,"internally_reserved":0,"allocated":43855872,"data_stored":56088254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640295,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100140,"kb_used_data":55060,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94271700,"statfs":{"total":96636764160,"available":96534220800,"internally_reserved":0,"allocated":56381440,"data_stored":67557356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640293,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98216,"kb_used_data":44820,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94273624,"statfs":{"total":96636764160,"available":96536190976,"internally_reserved":0,"allocated":45895680,"data_stored":51136986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640294,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118996,"kb_used_data":69760,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94252844,"statfs":{"total":96636764160,"available":96514912256,"internally_reserved":0,"allocated":71434240,"data_stored":87137397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69005312,"data_stored":85565833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":43945984,"data_stored":50117861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":54702080,"data_stored":66858536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":41320448,"data_stored":54536922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":39378944,"data_stored":48409240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":23072768,"data_stored":31076159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6949,"internal_metadata":0}]}} 2024-09-12T16:18:33.403 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:33.402+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:33.411 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:33.411 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:33.412 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:18:33.412 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:33.420 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:18:33.505 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:33.504+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:33.567 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:33.567 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:33.567 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:18:33.567 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:18:33.567 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:33.576 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:18:33.605 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:33.604+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:33.684 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:33.684 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:18:33.684 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:18:33.684 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:18:33.685 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.685 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:18:33.685 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:18:33.685 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 171.91821157000001, 2024-09-12T16:18:33.685 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55645454900000002, 2024-09-12T16:18:33.685 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:33.685 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:33.685 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:33.685 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:33.685 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:18:33.685 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:18:33.685 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1 2024-09-12T16:18:33.686 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.686 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:33.686 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.686 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:33.686 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:18:33.686 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.686 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.686 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.686 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:33.686 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:18:33.686 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.686 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.686 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.687 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:33.687 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764440+0000", 2024-09-12T16:18:33.687 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6249999999999999e-06 2024-09-12T16:18:33.687 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.687 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.687 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:33.687 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764447+0000", 2024-09-12T16:18:33.687 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4939999999999997e-06 2024-09-12T16:18:33.687 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.687 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.687 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:33.687 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764459+0000", 2024-09-12T16:18:33.687 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1517e-05 2024-09-12T16:18:33.688 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.688 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.688 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.688 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764468+0000", 2024-09-12T16:18:33.688 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7690000000000002e-06 2024-09-12T16:18:33.688 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.688 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.688 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:33.688 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764539+0000", 2024-09-12T16:18:33.688 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1103e-05 2024-09-12T16:18:33.688 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.688 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.688 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:33.689 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764551+0000", 2024-09-12T16:18:33.689 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2687999999999999e-05 2024-09-12T16:18:33.689 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.689 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.689 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:33.689 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319497+0000", 2024-09-12T16:18:33.689 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55494560500000001 2024-09-12T16:18:33.689 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.689 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.689 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:33.689 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319688+0000", 2024-09-12T16:18:33.689 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019105599999999999 2024-09-12T16:18:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:18:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319842+0000", 2024-09-12T16:18:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015377699999999999 2024-09-12T16:18:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:18:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320473+0000", 2024-09-12T16:18:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00063117100000000003 2024-09-12T16:18:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320825+0000", 2024-09-12T16:18:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00035202500000000001 2024-09-12T16:18:33.691 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.691 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.691 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:33.691 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320867+0000", 2024-09-12T16:18:33.691 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2005000000000002e-05 2024-09-12T16:18:33.691 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.691 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.691 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:33.691 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320893+0000", 2024-09-12T16:18:33.691 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5714000000000001e-05 2024-09-12T16:18:33.691 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.691 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:33.692 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.692 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.692 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.692 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14034 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5035008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:33.692 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:18:33.692 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 134.161153337, 2024-09-12T16:18:33.692 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053404082999999998, 2024-09-12T16:18:33.692 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:33.692 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:33.692 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:33.692 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:33.692 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:33.692 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:33.693 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14034 2024-09-12T16:18:33.693 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.693 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:33.693 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.693 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:33.693 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:18:33.693 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.693 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.693 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.693 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:33.693 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:18:33.693 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.693 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.694 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.694 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:33.694 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521740+0000", 2024-09-12T16:18:33.694 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000243976 2024-09-12T16:18:33.694 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.694 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.694 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:33.694 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521745+0000", 2024-09-12T16:18:33.694 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1280000000000001e-06 2024-09-12T16:18:33.694 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.694 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.694 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:33.694 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521757+0000", 2024-09-12T16:18:33.695 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2751e-05 2024-09-12T16:18:33.695 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.695 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.695 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.695 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521771+0000", 2024-09-12T16:18:33.695 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3328e-05 2024-09-12T16:18:33.695 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.695 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.695 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:33.695 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574710+0000", 2024-09-12T16:18:33.695 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052939358999999998 2024-09-12T16:18:33.695 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.695 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.696 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:33.696 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574799+0000", 2024-09-12T16:18:33.696 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8893000000000004e-05 2024-09-12T16:18:33.696 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.696 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.696 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:33.696 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574901+0000", 2024-09-12T16:18:33.696 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101648 2024-09-12T16:18:33.696 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.696 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:33.696 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.697 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.697 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.697 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14036 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5043200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:33.697 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:18:33.697 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 134.160694143, 2024-09-12T16:18:33.697 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053426247000000003, 2024-09-12T16:18:33.697 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:33.697 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:33.697 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:33.697 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:33.697 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:33.697 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:33.698 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14036 2024-09-12T16:18:33.698 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.698 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:33.698 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.698 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:33.698 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:18:33.698 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.698 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.698 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.698 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:33.698 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:18:33.698 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.698 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.699 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.699 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:33.699 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522208+0000", 2024-09-12T16:18:33.699 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025195300000000002 2024-09-12T16:18:33.699 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.699 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.699 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:33.699 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522211+0000", 2024-09-12T16:18:33.699 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2160000000000002e-06 2024-09-12T16:18:33.699 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.699 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.699 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:33.699 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522223+0000", 2024-09-12T16:18:33.700 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2044e-05 2024-09-12T16:18:33.700 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.700 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.700 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.700 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522229+0000", 2024-09-12T16:18:33.700 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8850000000000004e-06 2024-09-12T16:18:33.700 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.700 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.700 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:33.700 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575192+0000", 2024-09-12T16:18:33.700 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052963573 2024-09-12T16:18:33.700 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.701 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.701 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:33.701 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575282+0000", 2024-09-12T16:18:33.701 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9666000000000005e-05 2024-09-12T16:18:33.701 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.701 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.701 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:33.701 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575382+0000", 2024-09-12T16:18:33.701 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9909999999999997e-05 2024-09-12T16:18:33.701 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.701 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:33.701 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.701 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.701 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.702 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14039 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5055488~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:33.702 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:18:33.702 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 134.160014359, 2024-09-12T16:18:33.702 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053466207000000002, 2024-09-12T16:18:33.702 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:33.702 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:33.702 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:33.702 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:33.702 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:33.702 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:33.702 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14039 2024-09-12T16:18:33.702 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.702 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:33.703 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.703 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:33.703 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:18:33.703 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.703 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.703 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.703 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:33.703 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:18:33.703 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.703 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.703 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.703 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:33.704 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522899+0000", 2024-09-12T16:18:33.704 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026318199999999999 2024-09-12T16:18:33.704 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.704 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.704 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:33.704 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522903+0000", 2024-09-12T16:18:33.704 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.929e-06 2024-09-12T16:18:33.704 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.704 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.704 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:33.704 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522913+0000", 2024-09-12T16:18:33.704 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0162e-05 2024-09-12T16:18:33.704 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.705 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.705 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.705 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522921+0000", 2024-09-12T16:18:33.705 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.14e-06 2024-09-12T16:18:33.705 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.705 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.705 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:33.705 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575922+0000", 2024-09-12T16:18:33.705 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053000712999999998 2024-09-12T16:18:33.705 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.705 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.705 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:33.706 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576006+0000", 2024-09-12T16:18:33.706 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4161999999999998e-05 2024-09-12T16:18:33.706 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.706 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.706 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:33.706 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576102+0000", 2024-09-12T16:18:33.706 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5919000000000001e-05 2024-09-12T16:18:33.706 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.706 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:33.706 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.706 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.707 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.707 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14040 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5059584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:33.707 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:18:33.707 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 134.159709464, 2024-09-12T16:18:33.707 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053413258999999998, 2024-09-12T16:18:33.707 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:33.707 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:33.707 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:33.707 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:33.707 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:33.707 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:33.707 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14040 2024-09-12T16:18:33.707 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.708 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:33.708 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.708 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:33.708 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:18:33.708 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.708 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.708 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.708 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:33.708 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:18:33.708 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.708 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.708 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.709 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:33.709 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523059+0000", 2024-09-12T16:18:33.709 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118466 2024-09-12T16:18:33.709 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.709 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.709 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:33.709 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523062+0000", 2024-09-12T16:18:33.709 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.971e-06 2024-09-12T16:18:33.709 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.709 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.709 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:33.709 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523069+0000", 2024-09-12T16:18:33.710 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8279999999999997e-06 2024-09-12T16:18:33.710 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.710 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.710 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.710 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523073+0000", 2024-09-12T16:18:33.710 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3019999999999996e-06 2024-09-12T16:18:33.710 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.710 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.710 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:33.710 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576155+0000", 2024-09-12T16:18:33.710 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053081962000000003 2024-09-12T16:18:33.710 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.710 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.711 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:33.711 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576249+0000", 2024-09-12T16:18:33.711 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3914999999999998e-05 2024-09-12T16:18:33.711 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.711 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.711 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:33.711 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576354+0000", 2024-09-12T16:18:33.711 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010481500000000001 2024-09-12T16:18:33.711 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.711 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:33.711 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.711 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.711 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.711 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14041 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5063680~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:33.711 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:18:33.712 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 134.159559159, 2024-09-12T16:18:33.712 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053519111000000001, 2024-09-12T16:18:33.712 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:33.712 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:33.712 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:33.712 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:33.712 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:33.712 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:33.712 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14041 2024-09-12T16:18:33.712 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.712 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:33.712 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.712 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:33.713 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:18:33.713 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.713 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.713 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.713 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:33.713 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:18:33.713 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.713 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.713 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.713 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:33.713 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523309+0000", 2024-09-12T16:18:33.713 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000218712 2024-09-12T16:18:33.713 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.713 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.713 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:33.714 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523313+0000", 2024-09-12T16:18:33.714 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.151e-06 2024-09-12T16:18:33.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.714 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.714 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:33.714 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523320+0000", 2024-09-12T16:18:33.714 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9789999999999993e-06 2024-09-12T16:18:33.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.714 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.714 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.714 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523325+0000", 2024-09-12T16:18:33.714 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:18:33.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.714 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.715 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:33.715 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576402+0000", 2024-09-12T16:18:33.715 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053076811000000002 2024-09-12T16:18:33.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.715 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.715 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:33.715 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576491+0000", 2024-09-12T16:18:33.715 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8578999999999993e-05 2024-09-12T16:18:33.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.715 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.715 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:33.715 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576610+0000", 2024-09-12T16:18:33.715 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119129 2024-09-12T16:18:33.715 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.716 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:33.716 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.716 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.716 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.716 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14042 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5067776~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:33.716 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:18:33.716 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 134.159315725, 2024-09-12T16:18:33.716 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053510350999999998, 2024-09-12T16:18:33.716 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:33.716 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:33.716 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:33.716 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:33.716 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:33.717 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:33.717 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14042 2024-09-12T16:18:33.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.717 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:33.717 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.717 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:33.717 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:18:33.717 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.717 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.717 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:33.717 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:18:33.718 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.718 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.718 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.718 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:33.718 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523591+0000", 2024-09-12T16:18:33.718 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025710300000000001 2024-09-12T16:18:33.718 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.718 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.718 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:33.718 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523594+0000", 2024-09-12T16:18:33.718 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2229999999999999e-06 2024-09-12T16:18:33.718 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.718 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.719 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:33.719 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523602+0000", 2024-09-12T16:18:33.719 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6930000000000007e-06 2024-09-12T16:18:33.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.719 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.719 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.719 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523607+0000", 2024-09-12T16:18:33.719 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4789999999999998e-06 2024-09-12T16:18:33.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.719 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.719 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:33.719 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576661+0000", 2024-09-12T16:18:33.719 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053973999999997 2024-09-12T16:18:33.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.720 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.720 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:33.720 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576745+0000", 2024-09-12T16:18:33.720 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4660000000000006e-05 2024-09-12T16:18:33.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.720 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.720 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:33.720 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576844+0000", 2024-09-12T16:18:33.720 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9219e-05 2024-09-12T16:18:33.721 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.721 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:33.721 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.721 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.721 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.721 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14043 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5071872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:33.721 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:18:33.721 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 134.159035246, 2024-09-12T16:18:33.721 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053475295999999999, 2024-09-12T16:18:33.721 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:33.721 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:33.721 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:33.721 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:33.722 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:33.722 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:33.722 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14043 2024-09-12T16:18:33.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.722 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:33.722 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.722 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:33.722 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:18:33.722 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.722 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.722 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:33.722 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:18:33.722 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.723 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.723 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:33.723 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523823+0000", 2024-09-12T16:18:33.723 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020818900000000001 2024-09-12T16:18:33.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.723 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.723 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:33.723 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523826+0000", 2024-09-12T16:18:33.723 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.405e-06 2024-09-12T16:18:33.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.724 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.724 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:33.724 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523834+0000", 2024-09-12T16:18:33.724 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5499999999999997e-06 2024-09-12T16:18:33.724 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.724 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.724 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.724 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523838+0000", 2024-09-12T16:18:33.724 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.408e-06 2024-09-12T16:18:33.724 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.724 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.724 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:33.725 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576904+0000", 2024-09-12T16:18:33.725 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053065687 2024-09-12T16:18:33.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.725 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.725 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:33.725 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576991+0000", 2024-09-12T16:18:33.725 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7399999999999997e-05 2024-09-12T16:18:33.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.725 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.725 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:33.725 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577090+0000", 2024-09-12T16:18:33.725 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8657000000000001e-05 2024-09-12T16:18:33.725 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.725 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:33.726 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.726 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.726 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.726 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14044 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5075968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:33.726 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:18:33.726 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 134.15880371599999, 2024-09-12T16:18:33.726 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053442659000000003, 2024-09-12T16:18:33.726 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:33.726 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:33.726 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:33.726 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:33.726 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:33.726 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:33.726 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14044 2024-09-12T16:18:33.726 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.726 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:33.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.727 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:33.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:18:33.727 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.727 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:33.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:18:33.727 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.727 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:33.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523985+0000", 2024-09-12T16:18:33.727 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000138522 2024-09-12T16:18:33.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.728 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:33.728 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523988+0000", 2024-09-12T16:18:33.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.788e-06 2024-09-12T16:18:33.728 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.728 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.728 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:33.728 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523998+0000", 2024-09-12T16:18:33.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8470000000000008e-06 2024-09-12T16:18:33.728 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.728 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.728 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.728 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524010+0000", 2024-09-12T16:18:33.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1348999999999999e-05 2024-09-12T16:18:33.728 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.728 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.729 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:33.729 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577137+0000", 2024-09-12T16:18:33.729 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053127055999999999 2024-09-12T16:18:33.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.729 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.729 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:33.729 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577210+0000", 2024-09-12T16:18:33.729 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3392000000000005e-05 2024-09-12T16:18:33.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.729 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.729 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:33.729 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577289+0000", 2024-09-12T16:18:33.730 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8704999999999999e-05 2024-09-12T16:18:33.730 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.730 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:33.730 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.730 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14045 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5080064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:33.730 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:18:33.730 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 134.158624895, 2024-09-12T16:18:33.730 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053497514000000003, 2024-09-12T16:18:33.730 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:33.730 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:33.730 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:33.730 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:33.731 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:33.731 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:33.731 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14045 2024-09-12T16:18:33.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.731 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:33.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.731 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:33.731 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:18:33.731 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.731 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:33.731 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:18:33.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:33.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524311+0000", 2024-09-12T16:18:33.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028626299999999998 2024-09-12T16:18:33.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:33.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524315+0000", 2024-09-12T16:18:33.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0969999999999999e-06 2024-09-12T16:18:33.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.733 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:33.733 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524325+0000", 2024-09-12T16:18:33.733 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6330000000000008e-06 2024-09-12T16:18:33.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.733 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.733 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.733 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524332+0000", 2024-09-12T16:18:33.733 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8700000000000003e-06 2024-09-12T16:18:33.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.733 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.733 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:33.733 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577334+0000", 2024-09-12T16:18:33.733 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053001834999999997 2024-09-12T16:18:33.734 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.734 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.734 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:33.734 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577420+0000", 2024-09-12T16:18:33.734 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6145999999999998e-05 2024-09-12T16:18:33.734 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.734 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.734 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:33.734 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577522+0000", 2024-09-12T16:18:33.734 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010267 2024-09-12T16:18:33.734 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.734 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:33.735 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.735 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.735 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.735 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14047 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5088256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:33.735 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:18:33.735 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 134.15813916900001, 2024-09-12T16:18:33.735 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053433340000000003, 2024-09-12T16:18:33.735 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:33.735 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:33.735 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:33.735 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:33.735 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:33.735 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:33.735 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14047 2024-09-12T16:18:33.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.736 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:33.736 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.736 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:33.736 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:18:33.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.736 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.736 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:33.736 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:18:33.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.737 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.737 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.737 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:33.737 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524727+0000", 2024-09-12T16:18:33.737 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000216126 2024-09-12T16:18:33.737 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.737 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.737 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:33.737 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524732+0000", 2024-09-12T16:18:33.737 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1569999999999999e-06 2024-09-12T16:18:33.737 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.737 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.737 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:33.738 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524742+0000", 2024-09-12T16:18:33.738 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0186999999999999e-05 2024-09-12T16:18:33.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.738 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.738 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.738 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524750+0000", 2024-09-12T16:18:33.738 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4279999999999999e-06 2024-09-12T16:18:33.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.738 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.738 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:33.738 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577743+0000", 2024-09-12T16:18:33.738 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052993077 2024-09-12T16:18:33.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:33.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577841+0000", 2024-09-12T16:18:33.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8369000000000006e-05 2024-09-12T16:18:33.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:33.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577944+0000", 2024-09-12T16:18:33.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102996 2024-09-12T16:18:33.739 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.739 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:33.739 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.740 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14048 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5092352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:33.740 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:18:33.740 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 134.15788757600001, 2024-09-12T16:18:33.740 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053397515, 2024-09-12T16:18:33.740 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:33.740 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:33.740 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:33.740 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:33.740 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:33.740 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:33.740 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14048 2024-09-12T16:18:33.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.741 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:33.741 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.741 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:33.741 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:18:33.741 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.741 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.741 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:33.741 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:18:33.741 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.741 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.741 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:33.742 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524957+0000", 2024-09-12T16:18:33.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019516999999999999 2024-09-12T16:18:33.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.742 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:33.742 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524962+0000", 2024-09-12T16:18:33.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7709999999999997e-06 2024-09-12T16:18:33.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.742 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:33.742 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524973+0000", 2024-09-12T16:18:33.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1031e-05 2024-09-12T16:18:33.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524980+0000", 2024-09-12T16:18:33.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6100000000000002e-06 2024-09-12T16:18:33.743 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:33.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577977+0000", 2024-09-12T16:18:33.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052997481999999999 2024-09-12T16:18:33.743 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:33.744 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578062+0000", 2024-09-12T16:18:33.744 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4851000000000005e-05 2024-09-12T16:18:33.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.744 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:33.744 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578160+0000", 2024-09-12T16:18:33.744 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7600000000000001e-05 2024-09-12T16:18:33.744 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.744 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:33.744 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.745 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14049 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5096448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:33.745 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:18:33.745 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 134.15765894800001, 2024-09-12T16:18:33.745 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053439792, 2024-09-12T16:18:33.745 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:33.745 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:33.745 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:33.745 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:33.745 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:33.745 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:33.745 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14049 2024-09-12T16:18:33.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.746 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:33.746 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.746 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:33.746 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:18:33.746 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.746 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.746 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:33.746 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:18:33.746 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:33.747 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525170+0000", 2024-09-12T16:18:33.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017958500000000001 2024-09-12T16:18:33.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:33.747 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525174+0000", 2024-09-12T16:18:33.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0239999999999999e-06 2024-09-12T16:18:33.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:33.747 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525184+0000", 2024-09-12T16:18:33.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5950000000000005e-06 2024-09-12T16:18:33.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.748 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.748 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525191+0000", 2024-09-12T16:18:33.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8329999999999996e-06 2024-09-12T16:18:33.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.748 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:33.748 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578240+0000", 2024-09-12T16:18:33.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053049236 2024-09-12T16:18:33.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.748 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:33.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578333+0000", 2024-09-12T16:18:33.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2806999999999994e-05 2024-09-12T16:18:33.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.749 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.749 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:33.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578431+0000", 2024-09-12T16:18:33.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7712000000000002e-05 2024-09-12T16:18:33.749 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.749 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:33.749 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.749 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.749 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14055 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5121024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:33.749 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:18:33.749 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 134.156388257, 2024-09-12T16:18:33.750 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053399038000000003, 2024-09-12T16:18:33.750 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:33.750 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:33.750 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:33.750 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:33.750 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:33.750 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:33.750 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14055 2024-09-12T16:18:33.750 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.750 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:33.750 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.750 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:33.750 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:18:33.750 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.750 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.751 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.751 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:33.751 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:18:33.751 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.751 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.751 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.751 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:33.751 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526403+0000", 2024-09-12T16:18:33.751 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141571 2024-09-12T16:18:33.751 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.751 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.751 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:33.751 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526406+0000", 2024-09-12T16:18:33.751 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2660000000000002e-06 2024-09-12T16:18:33.751 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.751 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.752 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:33.752 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526420+0000", 2024-09-12T16:18:33.752 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3949e-05 2024-09-12T16:18:33.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.752 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.752 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.752 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526428+0000", 2024-09-12T16:18:33.752 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4250000000000001e-06 2024-09-12T16:18:33.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.752 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.752 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:33.752 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579476+0000", 2024-09-12T16:18:33.752 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053048349000000002 2024-09-12T16:18:33.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.753 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.753 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:33.753 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579563+0000", 2024-09-12T16:18:33.753 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6502999999999995e-05 2024-09-12T16:18:33.753 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.753 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.753 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:33.753 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579661+0000", 2024-09-12T16:18:33.753 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7974999999999996e-05 2024-09-12T16:18:33.753 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.753 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:33.753 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.754 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.754 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.754 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4806.0:3139 3.1e 3:78d5a095:::rbd_data.11552a37e55b.0000000000000000:head [read 69632~61440] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:18:33.754 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:18:33.754 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 123.381394007, 2024-09-12T16:18:33.754 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057851734000000002, 2024-09-12T16:18:33.754 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:33.754 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:33.754 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:33.754 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:33.754 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4806", 2024-09-12T16:18:33.754 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3959815836", 2024-09-12T16:18:33.754 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 3139 2024-09-12T16:18:33.754 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.755 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:33.755 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.755 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:33.755 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:18:33.755 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.755 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.755 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:33.755 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:18:33.755 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.755 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.755 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:33.756 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:18:33.756 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4799999999999999e-07 2024-09-12T16:18:33.756 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.756 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.756 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:33.756 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301258+0000", 2024-09-12T16:18:33.756 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.844e-06 2024-09-12T16:18:33.756 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.756 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.756 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:33.756 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301267+0000", 2024-09-12T16:18:33.756 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2960000000000004e-06 2024-09-12T16:18:33.756 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.756 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.756 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.757 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301276+0000", 2024-09-12T16:18:33.757 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0650000000000005e-06 2024-09-12T16:18:33.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.757 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.757 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:33.757 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301871+0000", 2024-09-12T16:18:33.757 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00059423600000000005 2024-09-12T16:18:33.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.757 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.757 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:33.757 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301920+0000", 2024-09-12T16:18:33.757 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9067000000000003e-05 2024-09-12T16:18:33.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.758 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.758 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:33.758 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359108+0000", 2024-09-12T16:18:33.758 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057187877999999998 2024-09-12T16:18:33.758 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.758 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:33.758 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.758 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.758 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:6428 3.14 3:28a44e54:::rbd_header.11552a37e55b:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:18:33.758 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:18:33.758 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 123.381065413, 2024-09-12T16:18:33.758 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057504023000000001, 2024-09-12T16:18:33.758 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:33.758 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:33.759 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:33.759 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:33.759 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:18:33.759 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:18:33.759 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6428 2024-09-12T16:18:33.759 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.759 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:33.759 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.759 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:33.759 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:18:33.759 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.759 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.759 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.759 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:33.760 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:18:33.760 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.760 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.760 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.760 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:33.760 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301585+0000", 2024-09-12T16:18:33.760 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6300000000000005e-07 2024-09-12T16:18:33.760 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.760 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.760 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:33.760 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301588+0000", 2024-09-12T16:18:33.760 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4149999999999999e-06 2024-09-12T16:18:33.760 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.760 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.760 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:33.761 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301597+0000", 2024-09-12T16:18:33.761 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5450000000000003e-06 2024-09-12T16:18:33.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.761 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.761 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.761 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301617+0000", 2024-09-12T16:18:33.761 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9837e-05 2024-09-12T16:18:33.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.761 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.761 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:33.761 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301779+0000", 2024-09-12T16:18:33.761 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016186799999999999 2024-09-12T16:18:33.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.761 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.761 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:33.762 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301855+0000", 2024-09-12T16:18:33.762 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5899e-05 2024-09-12T16:18:33.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.762 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.762 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:33.762 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359088+0000", 2024-09-12T16:18:33.762 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057233895999999999 2024-09-12T16:18:33.762 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.762 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:33.762 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.762 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.762 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5223.0:1814 3.f 3:f7b1b1c5:::rbd_object_map.1155a1fd27d2:head [read 0~136] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-12T16:18:33.762 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:18:33.762 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 87.445399348999999, 2024-09-12T16:18:33.763 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.006378226, 2024-09-12T16:18:33.763 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:33.763 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:33.763 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:33.763 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:33.763 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5223", 2024-09-12T16:18:33.763 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/4066330994", 2024-09-12T16:18:33.763 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1814 2024-09-12T16:18:33.763 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.763 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:33.763 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.763 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:33.763 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:18:33.763 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.763 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.763 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.764 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:33.764 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:18:33.764 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.764 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.764 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.764 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:33.764 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237252+0000", 2024-09-12T16:18:33.764 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.344e-06 2024-09-12T16:18:33.764 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.764 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.764 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:33.764 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237258+0000", 2024-09-12T16:18:33.764 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1070000000000001e-06 2024-09-12T16:18:33.764 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.765 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.765 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:33.765 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237270+0000", 2024-09-12T16:18:33.765 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1758e-05 2024-09-12T16:18:33.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.765 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.765 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.765 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237278+0000", 2024-09-12T16:18:33.765 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3219999999999993e-06 2024-09-12T16:18:33.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.765 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.765 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:33.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237334+0000", 2024-09-12T16:18:33.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6356e-05 2024-09-12T16:18:33.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.766 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:33.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237345+0000", 2024-09-12T16:18:33.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0433e-05 2024-09-12T16:18:33.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.766 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:33.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243426+0000", 2024-09-12T16:18:33.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.00608133 2024-09-12T16:18:33.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.767 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:33.767 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243534+0000", 2024-09-12T16:18:33.767 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010784 2024-09-12T16:18:33.767 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.767 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.767 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:33.767 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243629+0000", 2024-09-12T16:18:33.767 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4735999999999996e-05 2024-09-12T16:18:33.767 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.767 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:33.767 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.767 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.768 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.768 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5328.0:2542 3.16 3:6928f3a1:::rbd_object_map.11551722dd77:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:18:33.768 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:18:33.768 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 81.627053919000005, 2024-09-12T16:18:33.768 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.054219934999999997, 2024-09-12T16:18:33.768 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:33.768 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:33.768 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:33.768 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:33.768 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5328", 2024-09-12T16:18:33.768 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:18:33.768 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2542 2024-09-12T16:18:33.768 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.768 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:33.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.769 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:33.769 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:18:33.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.769 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:33.769 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:18:33.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.769 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:33.769 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055597+0000", 2024-09-12T16:18:33.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4300000000000001e-07 2024-09-12T16:18:33.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.770 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:33.770 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055602+0000", 2024-09-12T16:18:33.770 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4269999999999999e-06 2024-09-12T16:18:33.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.770 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:33.770 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055613+0000", 2024-09-12T16:18:33.770 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0815000000000001e-05 2024-09-12T16:18:33.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.771 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.771 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055621+0000", 2024-09-12T16:18:33.771 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4189999999999996e-06 2024-09-12T16:18:33.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.771 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.771 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:33.771 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102196+0000", 2024-09-12T16:18:33.771 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.046575616 2024-09-12T16:18:33.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.771 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.771 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:33.771 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102258+0000", 2024-09-12T16:18:33.771 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1872000000000007e-05 2024-09-12T16:18:33.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.772 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T16:18:33.772 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102601+0000", 2024-09-12T16:18:33.772 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034285700000000001 2024-09-12T16:18:33.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.772 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:33.772 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.104431+0000", 2024-09-12T16:18:33.772 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001830524 2024-09-12T16:18:33.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.772 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:18:33.772 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109733+0000", 2024-09-12T16:18:33.773 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0053020089999999999 2024-09-12T16:18:33.773 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.773 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.773 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:33.773 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109777+0000", 2024-09-12T16:18:33.773 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3754000000000002e-05 2024-09-12T16:18:33.773 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.773 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.773 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:33.773 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109816+0000", 2024-09-12T16:18:33.773 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8699000000000003e-05 2024-09-12T16:18:33.773 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.773 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:33.773 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.774 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.774 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5328.0:2543 3.16 3:6928f3a1:::rbd_object_map.11551722dd77:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:18:33.774 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:18:33.774 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 81.626459940000004, 2024-09-12T16:18:33.774 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053695720000000002, 2024-09-12T16:18:33.774 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:33.774 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:33.774 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:33.774 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:33.774 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5328", 2024-09-12T16:18:33.774 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:18:33.774 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2543 2024-09-12T16:18:33.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.775 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:33.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.775 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:33.775 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:18:33.775 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.775 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:33.775 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:18:33.775 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.775 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:33.775 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056191+0000", 2024-09-12T16:18:33.776 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.54e-07 2024-09-12T16:18:33.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.776 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:33.776 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056195+0000", 2024-09-12T16:18:33.776 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5460000000000002e-06 2024-09-12T16:18:33.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.776 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:33.776 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056205+0000", 2024-09-12T16:18:33.776 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7350000000000008e-06 2024-09-12T16:18:33.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.777 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.777 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056214+0000", 2024-09-12T16:18:33.777 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8089999999999999e-06 2024-09-12T16:18:33.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.777 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.777 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:33.777 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103317+0000", 2024-09-12T16:18:33.777 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.047102889000000002 2024-09-12T16:18:33.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.777 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.777 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:33.777 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103410+0000", 2024-09-12T16:18:33.777 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3689000000000004e-05 2024-09-12T16:18:33.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.777 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.778 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T16:18:33.778 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103754+0000", 2024-09-12T16:18:33.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034344699999999998 2024-09-12T16:18:33.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.778 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:33.778 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.106487+0000", 2024-09-12T16:18:33.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0027330100000000001 2024-09-12T16:18:33.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.778 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:18:33.778 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109827+0000", 2024-09-12T16:18:33.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033406640000000001 2024-09-12T16:18:33.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:33.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109854+0000", 2024-09-12T16:18:33.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6866999999999999e-05 2024-09-12T16:18:33.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:33.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109886+0000", 2024-09-12T16:18:33.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1309999999999997e-05 2024-09-12T16:18:33.779 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.779 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:33.779 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.780 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.780 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5832.0:1710 3.f 3:f0d97d21:::rbd_data.1155d3b3a2ae.0000000000000012:head [truncate 1376256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-12T16:18:33.780 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:18:33.780 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 46.298661854999999, 2024-09-12T16:18:33.780 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6441524489999999, 2024-09-12T16:18:33.780 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:33.780 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:33.780 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:33.780 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:33.780 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5832", 2024-09-12T16:18:33.780 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/201125203", 2024-09-12T16:18:33.781 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1710 2024-09-12T16:18:33.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.781 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:33.781 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.781 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:33.781 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:18:33.781 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.781 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.781 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:33.781 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:18:33.781 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:33.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.782 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.782 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:33.782 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:18:33.782 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.08e-07 2024-09-12T16:18:33.782 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.782 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.782 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:33.782 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383990+0000", 2024-09-12T16:18:33.782 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.979e-06 2024-09-12T16:18:33.782 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.782 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.782 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:33.782 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383999+0000", 2024-09-12T16:18:33.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3240000000000003e-06 2024-09-12T16:18:33.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.783 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:33.783 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.384002+0000", 2024-09-12T16:18:33.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5489999999999998e-06 2024-09-12T16:18:33.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.783 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:33.783 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.384037+0000", 2024-09-12T16:18:33.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4931000000000001e-05 2024-09-12T16:18:33.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.784 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.784 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:33.784 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.384043+0000", 2024-09-12T16:18:33.784 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3920000000000002e-06 2024-09-12T16:18:33.784 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.784 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.784 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:33.784 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:48.007976+0000", 2024-09-12T16:18:33.784 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.62393385300000004 2024-09-12T16:18:33.784 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.784 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.784 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:33.785 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:48.007992+0000", 2024-09-12T16:18:33.785 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5668e-05 2024-09-12T16:18:33.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.785 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.785 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:33.785 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024187+0000", 2024-09-12T16:18:33.785 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0161951629999999 2024-09-12T16:18:33.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.785 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.785 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:33.785 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024362+0000", 2024-09-12T16:18:33.785 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017500600000000001 2024-09-12T16:18:33.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.786 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.786 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:18:33.786 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024453+0000", 2024-09-12T16:18:33.786 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1055000000000001e-05 2024-09-12T16:18:33.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.786 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.786 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:18:33.786 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024963+0000", 2024-09-12T16:18:33.786 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000510087 2024-09-12T16:18:33.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.786 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.786 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:33.786 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.027974+0000", 2024-09-12T16:18:33.786 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030107070000000001 2024-09-12T16:18:33.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.787 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.787 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:33.787 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.028022+0000", 2024-09-12T16:18:33.787 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7636000000000003e-05 2024-09-12T16:18:33.787 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:33.787 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:33.787 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:33.787 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.028140+0000", 2024-09-12T16:18:33.787 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011869100000000001 2024-09-12T16:18:33.787 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.787 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:33.787 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.788 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:33.788 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:33.788 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:33.789 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:18:33.790 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:33.788+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:33.890 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:33.889+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:33.938 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:33.938 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:33.938 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:18:33.939 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:33.946 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:18:33.990 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:33.989+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:34.053 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:34.053 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:34.054 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:18:34.054 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:18:34.054 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:34.061 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:18:34.092 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:34.091+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:34.188 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T16:18:34.192 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:34.191+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:34.220 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:34.221 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:18:34.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:18:34.221 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:18:34.221 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.221 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5599 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4788224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:34.221 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:18:34.221 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 113.921983916, 2024-09-12T16:18:34.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061192059, 2024-09-12T16:18:34.221 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.221 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.222 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:34.222 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:34.222 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:34.222 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:34.222 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5599 2024-09-12T16:18:34.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.222 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.222 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:18:34.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:18:34.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296333+0000", 2024-09-12T16:18:34.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6599999999999996e-07 2024-09-12T16:18:34.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296335+0000", 2024-09-12T16:18:34.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5900000000000002e-06 2024-09-12T16:18:34.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296344+0000", 2024-09-12T16:18:34.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9539999999999993e-06 2024-09-12T16:18:34.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296350+0000", 2024-09-12T16:18:34.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5589999999999996e-06 2024-09-12T16:18:34.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357307+0000", 2024-09-12T16:18:34.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.060957573000000001 2024-09-12T16:18:34.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357401+0000", 2024-09-12T16:18:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3512999999999997e-05 2024-09-12T16:18:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357524+0000", 2024-09-12T16:18:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000123304 2024-09-12T16:18:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5611 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4730880~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:18:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 113.92192147199999, 2024-09-12T16:18:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061359348000000001, 2024-09-12T16:18:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5611 2024-09-12T16:18:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:18:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:18:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296395+0000", 2024-09-12T16:18:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4600000000000003e-07 2024-09-12T16:18:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296399+0000", 2024-09-12T16:18:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9430000000000002e-06 2024-09-12T16:18:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296411+0000", 2024-09-12T16:18:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1755e-05 2024-09-12T16:18:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296417+0000", 2024-09-12T16:18:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3790000000000003e-06 2024-09-12T16:18:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357572+0000", 2024-09-12T16:18:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061154871 2024-09-12T16:18:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357663+0000", 2024-09-12T16:18:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0389999999999993e-05 2024-09-12T16:18:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357754+0000", 2024-09-12T16:18:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1063999999999994e-05 2024-09-12T16:18:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5613 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4775936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:18:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 113.921880292, 2024-09-12T16:18:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061491777999999997, 2024-09-12T16:18:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5613 2024-09-12T16:18:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:18:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:18:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:18:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8899999999999999e-07 2024-09-12T16:18:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296439+0000", 2024-09-12T16:18:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8439999999999998e-06 2024-09-12T16:18:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296452+0000", 2024-09-12T16:18:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2639e-05 2024-09-12T16:18:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296457+0000", 2024-09-12T16:18:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5720000000000002e-06 2024-09-12T16:18:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357773+0000", 2024-09-12T16:18:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061315500000000002 2024-09-12T16:18:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357814+0000", 2024-09-12T16:18:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1448e-05 2024-09-12T16:18:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357927+0000", 2024-09-12T16:18:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000113186 2024-09-12T16:18:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5616 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4784128~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:18:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 113.92184523, 2024-09-12T16:18:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061725002000000001, 2024-09-12T16:18:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5616 2024-09-12T16:18:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:18:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:18:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.238 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.238 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:18:34.238 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5900000000000002e-07 2024-09-12T16:18:34.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.238 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.238 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296473+0000", 2024-09-12T16:18:34.238 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3130000000000001e-06 2024-09-12T16:18:34.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.238 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.239 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296481+0000", 2024-09-12T16:18:34.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1389999999999998e-06 2024-09-12T16:18:34.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.239 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.239 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296486+0000", 2024-09-12T16:18:34.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3310000000000003e-06 2024-09-12T16:18:34.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.239 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.240 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357981+0000", 2024-09-12T16:18:34.240 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061494866000000002 2024-09-12T16:18:34.240 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.240 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.240 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:34.240 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358082+0000", 2024-09-12T16:18:34.240 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101424 2024-09-12T16:18:34.240 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.240 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.240 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.241 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358196+0000", 2024-09-12T16:18:34.241 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011347 2024-09-12T16:18:34.241 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.241 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.241 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.241 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.241 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.241 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5626 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4739072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:34.241 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:18:34.241 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 113.921767274, 2024-09-12T16:18:34.241 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061802430999999998, 2024-09-12T16:18:34.241 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.241 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.241 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:34.241 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:34.242 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:34.242 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:34.242 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5626 2024-09-12T16:18:34.242 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.242 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.242 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.242 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.242 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:18:34.242 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.242 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.242 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.242 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.243 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:18:34.243 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.243 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.243 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296550+0000", 2024-09-12T16:18:34.243 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.215e-06 2024-09-12T16:18:34.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.243 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.243 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296555+0000", 2024-09-12T16:18:34.243 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9590000000000003e-06 2024-09-12T16:18:34.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.243 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.243 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296568+0000", 2024-09-12T16:18:34.244 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3338e-05 2024-09-12T16:18:34.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.244 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.244 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.244 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296576+0000", 2024-09-12T16:18:34.244 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5510000000000002e-06 2024-09-12T16:18:34.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.244 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.244 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.244 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358241+0000", 2024-09-12T16:18:34.244 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.06166576 2024-09-12T16:18:34.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.244 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.245 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:34.245 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358288+0000", 2024-09-12T16:18:34.245 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6097000000000003e-05 2024-09-12T16:18:34.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.245 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.245 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.245 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358351+0000", 2024-09-12T16:18:34.245 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3510999999999996e-05 2024-09-12T16:18:34.245 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.245 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.245 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.245 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.245 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5628 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4792320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:34.246 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:18:34.246 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 113.921724774, 2024-09-12T16:18:34.246 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061961161000000001, 2024-09-12T16:18:34.246 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.246 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.246 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:34.246 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:34.246 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:34.246 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:34.246 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5628 2024-09-12T16:18:34.246 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.246 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.246 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.246 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.246 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:18:34.247 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.247 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.247 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:18:34.247 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.247 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.247 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296592+0000", 2024-09-12T16:18:34.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2099999999999996e-07 2024-09-12T16:18:34.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.248 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.248 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.248 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296595+0000", 2024-09-12T16:18:34.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0429999999999999e-06 2024-09-12T16:18:34.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.248 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.248 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.248 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296603+0000", 2024-09-12T16:18:34.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9899999999999997e-06 2024-09-12T16:18:34.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.248 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.248 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.249 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296609+0000", 2024-09-12T16:18:34.249 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7259999999999999e-06 2024-09-12T16:18:34.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.249 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.249 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358393+0000", 2024-09-12T16:18:34.249 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061784617 2024-09-12T16:18:34.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.249 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:34.249 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358460+0000", 2024-09-12T16:18:34.249 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7253000000000001e-05 2024-09-12T16:18:34.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.250 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.250 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358552+0000", 2024-09-12T16:18:34.250 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1811000000000006e-05 2024-09-12T16:18:34.250 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.250 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.250 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.250 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.250 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.250 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5638 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4734976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:34.250 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:18:34.250 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 113.921252223, 2024-09-12T16:18:34.251 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061654460000000001, 2024-09-12T16:18:34.251 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.251 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.251 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:34.251 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:34.251 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:34.251 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:34.251 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5638 2024-09-12T16:18:34.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.251 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.251 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.251 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.251 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:18:34.251 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.252 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:18:34.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.252 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:18:34.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.23e-07 2024-09-12T16:18:34.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.256 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.256 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297068+0000", 2024-09-12T16:18:34.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0060000000000003e-06 2024-09-12T16:18:34.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.257 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.257 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297080+0000", 2024-09-12T16:18:34.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1234e-05 2024-09-12T16:18:34.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.257 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.257 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297095+0000", 2024-09-12T16:18:34.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5698000000000001e-05 2024-09-12T16:18:34.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.257 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.257 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358582+0000", 2024-09-12T16:18:34.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061486274 2024-09-12T16:18:34.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.258 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:34.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358637+0000", 2024-09-12T16:18:34.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5439999999999998e-05 2024-09-12T16:18:34.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.258 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358718+0000", 2024-09-12T16:18:34.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0984999999999998e-05 2024-09-12T16:18:34.258 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.258 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.258 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.259 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5640 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4780032~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:34.259 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:18:34.259 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 113.921170503, 2024-09-12T16:18:34.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061746620000000002, 2024-09-12T16:18:34.259 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.259 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.259 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:34.259 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:34.259 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:34.259 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:34.259 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5640 2024-09-12T16:18:34.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.259 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.260 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.260 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:18:34.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.260 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.260 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:18:34.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.260 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.260 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297146+0000", 2024-09-12T16:18:34.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3600000000000003e-07 2024-09-12T16:18:34.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.261 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.261 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297150+0000", 2024-09-12T16:18:34.261 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8430000000000003e-06 2024-09-12T16:18:34.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.261 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.261 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297160+0000", 2024-09-12T16:18:34.261 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7229999999999999e-06 2024-09-12T16:18:34.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.261 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.261 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297167+0000", 2024-09-12T16:18:34.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0180000000000004e-06 2024-09-12T16:18:34.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358750+0000", 2024-09-12T16:18:34.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061583104 2024-09-12T16:18:34.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:34.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358804+0000", 2024-09-12T16:18:34.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4277000000000002e-05 2024-09-12T16:18:34.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358892+0000", 2024-09-12T16:18:34.263 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7918999999999996e-05 2024-09-12T16:18:34.263 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.263 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.263 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.263 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.263 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5642 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4788224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:34.263 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:18:34.263 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 113.921126159, 2024-09-12T16:18:34.263 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061860409999999998, 2024-09-12T16:18:34.263 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.263 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.263 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:34.263 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:34.264 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:34.264 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:34.264 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5642 2024-09-12T16:18:34.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.264 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.264 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.264 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:18:34.264 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.264 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.264 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:18:34.264 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:18:34.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7999999999999995e-07 2024-09-12T16:18:34.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297193+0000", 2024-09-12T16:18:34.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8310000000000001e-06 2024-09-12T16:18:34.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297204+0000", 2024-09-12T16:18:34.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0832999999999999e-05 2024-09-12T16:18:34.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297210+0000", 2024-09-12T16:18:34.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1770000000000003e-06 2024-09-12T16:18:34.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358928+0000", 2024-09-12T16:18:34.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061717826000000003 2024-09-12T16:18:34.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.267 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:34.267 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358977+0000", 2024-09-12T16:18:34.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9514000000000001e-05 2024-09-12T16:18:34.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.267 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.267 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359050+0000", 2024-09-12T16:18:34.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2649000000000002e-05 2024-09-12T16:18:34.267 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.267 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.267 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.268 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.268 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5646 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4743168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:34.268 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:18:34.268 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 113.920946218, 2024-09-12T16:18:34.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061822122, 2024-09-12T16:18:34.268 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.268 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.268 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:34.268 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:34.268 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:34.268 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:34.268 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5646 2024-09-12T16:18:34.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.268 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.269 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.269 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.269 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:18:34.269 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.269 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.269 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.269 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:18:34.269 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.270 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.270 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:18:34.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3200000000000004e-07 2024-09-12T16:18:34.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.271 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.271 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297374+0000", 2024-09-12T16:18:34.271 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8240000000000001e-06 2024-09-12T16:18:34.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.271 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.272 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297384+0000", 2024-09-12T16:18:34.272 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5710000000000004e-06 2024-09-12T16:18:34.272 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.272 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.272 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.272 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297390+0000", 2024-09-12T16:18:34.272 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5130000000000002e-06 2024-09-12T16:18:34.272 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.272 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.272 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.273 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359080+0000", 2024-09-12T16:18:34.273 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061689569999999999 2024-09-12T16:18:34.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.273 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:34.273 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359134+0000", 2024-09-12T16:18:34.274 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3838999999999997e-05 2024-09-12T16:18:34.274 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.274 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.274 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.274 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359192+0000", 2024-09-12T16:18:34.274 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8072999999999998e-05 2024-09-12T16:18:34.274 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.274 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.274 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.274 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.274 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.274 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5647 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4751360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:34.274 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:18:34.275 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 113.920909533, 2024-09-12T16:18:34.275 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061927569000000002, 2024-09-12T16:18:34.275 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.275 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.275 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:34.275 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:34.275 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:34.275 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:34.275 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5647 2024-09-12T16:18:34.275 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.275 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.275 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.275 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.275 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:18:34.275 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.276 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.276 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.276 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.276 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:18:34.276 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.276 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.276 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.276 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.276 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297407+0000", 2024-09-12T16:18:34.276 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.46e-07 2024-09-12T16:18:34.276 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.276 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.276 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.276 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297409+0000", 2024-09-12T16:18:34.277 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.469e-06 2024-09-12T16:18:34.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.277 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.277 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.277 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297415+0000", 2024-09-12T16:18:34.277 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9259999999999997e-06 2024-09-12T16:18:34.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.277 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.277 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.277 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297419+0000", 2024-09-12T16:18:34.277 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3840000000000001e-06 2024-09-12T16:18:34.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.277 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.278 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.278 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359224+0000", 2024-09-12T16:18:34.278 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061805367999999999 2024-09-12T16:18:34.278 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.278 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.278 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:34.278 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359275+0000", 2024-09-12T16:18:34.278 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1338000000000002e-05 2024-09-12T16:18:34.278 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.278 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.278 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.278 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359334+0000", 2024-09-12T16:18:34.278 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8638000000000003e-05 2024-09-12T16:18:34.278 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.279 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.279 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.279 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.279 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.279 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5649 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4796416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:34.279 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:18:34.279 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 113.920854674, 2024-09-12T16:18:34.279 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.062018578999999997, 2024-09-12T16:18:34.279 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.280 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.280 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:34.280 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:34.280 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:34.280 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:34.280 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5649 2024-09-12T16:18:34.280 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.280 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.280 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.280 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.280 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:18:34.280 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.281 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.281 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.281 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.281 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:18:34.281 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.281 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.281 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.281 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.281 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297462+0000", 2024-09-12T16:18:34.281 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2399999999999998e-07 2024-09-12T16:18:34.281 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.281 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.281 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.282 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297465+0000", 2024-09-12T16:18:34.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.371e-06 2024-09-12T16:18:34.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.282 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.282 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.282 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297473+0000", 2024-09-12T16:18:34.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4699999999999996e-06 2024-09-12T16:18:34.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.282 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.282 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.282 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297478+0000", 2024-09-12T16:18:34.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2780000000000001e-06 2024-09-12T16:18:34.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.283 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.283 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.283 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359368+0000", 2024-09-12T16:18:34.283 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061889758000000003 2024-09-12T16:18:34.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.283 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.283 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:34.283 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359420+0000", 2024-09-12T16:18:34.283 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2574999999999997e-05 2024-09-12T16:18:34.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.283 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.283 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.283 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359480+0000", 2024-09-12T16:18:34.284 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9503000000000003e-05 2024-09-12T16:18:34.284 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.284 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.284 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.284 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.284 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5674 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4739072~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:34.284 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:18:34.285 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 113.920450906, 2024-09-12T16:18:34.285 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061762989999999997, 2024-09-12T16:18:34.285 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.285 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.285 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:34.285 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:34.286 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:34.286 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:34.286 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5674 2024-09-12T16:18:34.286 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.286 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.286 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.286 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.286 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:18:34.286 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.286 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.286 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.287 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.287 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:18:34.287 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.287 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.287 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.287 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.287 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297866+0000", 2024-09-12T16:18:34.287 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1900000000000001e-07 2024-09-12T16:18:34.287 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.287 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.287 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.287 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297870+0000", 2024-09-12T16:18:34.287 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3560000000000003e-06 2024-09-12T16:18:34.288 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.288 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.288 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.288 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297888+0000", 2024-09-12T16:18:34.288 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8088999999999999e-05 2024-09-12T16:18:34.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.289 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.289 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.289 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297904+0000", 2024-09-12T16:18:34.289 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5971e-05 2024-09-12T16:18:34.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.289 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.289 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.289 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359510+0000", 2024-09-12T16:18:34.289 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061605634999999999 2024-09-12T16:18:34.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.289 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.289 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:34.289 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359554+0000", 2024-09-12T16:18:34.290 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4024999999999999e-05 2024-09-12T16:18:34.290 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.290 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.290 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.290 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359628+0000", 2024-09-12T16:18:34.290 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4095000000000001e-05 2024-09-12T16:18:34.290 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.290 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.290 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.290 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.290 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.290 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5676 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4792320~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:34.290 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:18:34.290 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 113.920249826, 2024-09-12T16:18:34.291 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061720143999999998, 2024-09-12T16:18:34.291 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.291 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.291 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:34.291 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:34.291 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:34.291 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:34.291 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5676 2024-09-12T16:18:34.291 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.291 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.291 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.292 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.292 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:18:34.292 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.292 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.292 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.292 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.293 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:18:34.293 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.293 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.293 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.293 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.293 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298067+0000", 2024-09-12T16:18:34.294 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8199999999999999e-07 2024-09-12T16:18:34.294 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.294 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.294 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.294 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298070+0000", 2024-09-12T16:18:34.294 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.743e-06 2024-09-12T16:18:34.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.295 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.295 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.295 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298080+0000", 2024-09-12T16:18:34.295 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4059999999999994e-06 2024-09-12T16:18:34.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.295 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.295 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.295 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298088+0000", 2024-09-12T16:18:34.295 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0779999999999996e-06 2024-09-12T16:18:34.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.295 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.295 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.295 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359659+0000", 2024-09-12T16:18:34.295 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061570688999999998 2024-09-12T16:18:34.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.296 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.296 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:34.296 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359713+0000", 2024-09-12T16:18:34.296 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3939e-05 2024-09-12T16:18:34.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.296 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.296 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.296 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359786+0000", 2024-09-12T16:18:34.296 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3607000000000002e-05 2024-09-12T16:18:34.296 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.296 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.296 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.297 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.297 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.297 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5684 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4747264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:34.297 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:18:34.297 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 113.91978253400001, 2024-09-12T16:18:34.297 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061394799, 2024-09-12T16:18:34.297 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.297 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.297 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:34.297 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:34.297 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:34.297 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:34.297 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5684 2024-09-12T16:18:34.297 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.298 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.298 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.298 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.298 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:18:34.298 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.298 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.298 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.298 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:18:34.298 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.298 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.298 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.298 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298534+0000", 2024-09-12T16:18:34.298 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4399999999999999e-07 2024-09-12T16:18:34.299 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.299 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.299 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.299 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298539+0000", 2024-09-12T16:18:34.299 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5360000000000003e-06 2024-09-12T16:18:34.299 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.299 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.299 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.299 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298550+0000", 2024-09-12T16:18:34.299 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1499e-05 2024-09-12T16:18:34.299 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.299 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.299 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.299 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298558+0000", 2024-09-12T16:18:34.300 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3000000000000004e-06 2024-09-12T16:18:34.300 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.300 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.300 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.300 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359815+0000", 2024-09-12T16:18:34.300 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061257952999999997 2024-09-12T16:18:34.300 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.300 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.300 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:34.300 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359868+0000", 2024-09-12T16:18:34.300 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2317000000000001e-05 2024-09-12T16:18:34.300 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.300 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.300 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.301 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359928+0000", 2024-09-12T16:18:34.301 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0350000000000003e-05 2024-09-12T16:18:34.301 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.301 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.301 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.301 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.301 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.301 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5686 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4755456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:34.301 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:18:34.301 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 113.91961511, 2024-09-12T16:18:34.301 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061355082999999998, 2024-09-12T16:18:34.301 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.301 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.302 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:34.302 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:34.302 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:34.302 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:34.302 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5686 2024-09-12T16:18:34.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.302 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.302 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.302 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.302 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:18:34.302 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.303 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.303 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.303 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:18:34.303 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.303 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.303 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.303 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298702+0000", 2024-09-12T16:18:34.303 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2399999999999997e-07 2024-09-12T16:18:34.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.303 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.303 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.303 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298706+0000", 2024-09-12T16:18:34.304 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5700000000000003e-06 2024-09-12T16:18:34.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.304 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.304 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.304 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298718+0000", 2024-09-12T16:18:34.304 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1457999999999999e-05 2024-09-12T16:18:34.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.304 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.304 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.304 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298732+0000", 2024-09-12T16:18:34.304 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.452e-05 2024-09-12T16:18:34.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.304 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.304 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.305 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359956+0000", 2024-09-12T16:18:34.305 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061223626000000003 2024-09-12T16:18:34.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.305 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.305 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:34.305 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360000+0000", 2024-09-12T16:18:34.305 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3922999999999999e-05 2024-09-12T16:18:34.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.305 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.305 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.305 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360056+0000", 2024-09-12T16:18:34.306 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6162000000000002e-05 2024-09-12T16:18:34.306 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.306 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.306 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.306 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.306 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5688 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4800512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:34.306 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:18:34.306 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 113.919392057, 2024-09-12T16:18:34.306 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061270514999999998, 2024-09-12T16:18:34.306 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.306 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.306 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:34.307 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:34.307 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:34.307 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:34.307 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5688 2024-09-12T16:18:34.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.307 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.307 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.307 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.307 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:18:34.307 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.307 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.308 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:18:34.308 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.308 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298925+0000", 2024-09-12T16:18:34.308 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4e-07 2024-09-12T16:18:34.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.308 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298929+0000", 2024-09-12T16:18:34.308 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9890000000000003e-06 2024-09-12T16:18:34.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298936+0000", 2024-09-12T16:18:34.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.52e-06 2024-09-12T16:18:34.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.310 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.310 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298941+0000", 2024-09-12T16:18:34.310 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4800000000000003e-06 2024-09-12T16:18:34.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.310 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.311 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.311 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360087+0000", 2024-09-12T16:18:34.311 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061146143 2024-09-12T16:18:34.311 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.311 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.312 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:34.312 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360137+0000", 2024-09-12T16:18:34.312 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0584000000000002e-05 2024-09-12T16:18:34.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.312 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.312 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.313 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360194+0000", 2024-09-12T16:18:34.313 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6858999999999999e-05 2024-09-12T16:18:34.313 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.313 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.313 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.314 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.314 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.314 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5693 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4751360~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:34.314 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:18:34.314 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 113.91897041999999, 2024-09-12T16:18:34.314 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061139444000000001, 2024-09-12T16:18:34.314 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.314 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.315 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:34.315 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:34.315 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:34.315 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:34.315 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5693 2024-09-12T16:18:34.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.316 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.316 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.316 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:18:34.316 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.316 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.316 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:18:34.316 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.317 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.317 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299346+0000", 2024-09-12T16:18:34.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2300000000000001e-07 2024-09-12T16:18:34.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.317 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.317 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299349+0000", 2024-09-12T16:18:34.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5270000000000001e-06 2024-09-12T16:18:34.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.317 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.317 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299358+0000", 2024-09-12T16:18:34.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7030000000000001e-06 2024-09-12T16:18:34.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.318 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.318 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299364+0000", 2024-09-12T16:18:34.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7239999999999997e-06 2024-09-12T16:18:34.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.318 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.318 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360369+0000", 2024-09-12T16:18:34.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061004713000000002 2024-09-12T16:18:34.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.318 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:34.318 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360415+0000", 2024-09-12T16:18:34.319 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5926e-05 2024-09-12T16:18:34.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.319 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.319 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.319 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360485+0000", 2024-09-12T16:18:34.319 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0327999999999995e-05 2024-09-12T16:18:34.319 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.319 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.319 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.319 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.319 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5694 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4796416~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:34.319 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:18:34.319 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 113.918941391, 2024-09-12T16:18:34.320 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061258034000000003, 2024-09-12T16:18:34.320 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.320 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.320 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:34.320 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:34.320 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:34.320 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:34.320 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5694 2024-09-12T16:18:34.320 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.320 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.320 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.320 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.320 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:18:34.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.321 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.321 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.321 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:18:34.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.321 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.321 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.322 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301884+0000", 2024-09-12T16:18:34.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025090379999999999 2024-09-12T16:18:34.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.322 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301889+0000", 2024-09-12T16:18:34.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5879999999999997e-06 2024-09-12T16:18:34.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.322 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301901+0000", 2024-09-12T16:18:34.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1466e-05 2024-09-12T16:18:34.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.323 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.323 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301908+0000", 2024-09-12T16:18:34.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1999999999999997e-06 2024-09-12T16:18:34.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.323 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.323 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360513+0000", 2024-09-12T16:18:34.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.058605023999999999 2024-09-12T16:18:34.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.323 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:34.323 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360562+0000", 2024-09-12T16:18:34.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9546000000000003e-05 2024-09-12T16:18:34.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.324 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.324 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360633+0000", 2024-09-12T16:18:34.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0172000000000005e-05 2024-09-12T16:18:34.324 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.324 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.324 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.324 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.324 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:28537 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_get_id in=13b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-12T16:18:34.324 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:24.151599+0000", 2024-09-12T16:18:34.324 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.066716593000001, 2024-09-12T16:18:34.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.99758962900000003, 2024-09-12T16:18:34.324 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.324 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.324 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:34.325 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:34.325 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:18:34.325 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:18:34.325 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 28537 2024-09-12T16:18:34.325 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.325 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.325 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.325 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.325 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.151599+0000", 2024-09-12T16:18:34.325 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.325 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.325 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.325 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.325 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.151599+0000", 2024-09-12T16:18:34.325 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.326 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.326 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.326 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.151601+0000", 2024-09-12T16:18:34.326 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4130000000000001e-06 2024-09-12T16:18:34.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.326 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.326 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.326 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.151606+0000", 2024-09-12T16:18:34.326 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.502e-06 2024-09-12T16:18:34.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.326 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.326 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.326 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.151618+0000", 2024-09-12T16:18:34.326 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1430999999999999e-05 2024-09-12T16:18:34.327 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.327 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.327 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.327 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.151623+0000", 2024-09-12T16:18:34.327 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3109999999999996e-06 2024-09-12T16:18:34.327 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.327 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.327 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.327 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.151681+0000", 2024-09-12T16:18:34.327 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8068e-05 2024-09-12T16:18:34.327 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.327 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.327 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:34.327 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.151689+0000", 2024-09-12T16:18:34.327 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9000000000000006e-06 2024-09-12T16:18:34.328 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.328 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.328 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.328 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.148883+0000", 2024-09-12T16:18:34.328 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.99719448399999999 2024-09-12T16:18:34.328 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.328 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.328 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:34.328 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.149018+0000", 2024-09-12T16:18:34.328 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000134733 2024-09-12T16:18:34.328 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.328 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.328 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.328 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.149189+0000", 2024-09-12T16:18:34.329 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017078699999999999 2024-09-12T16:18:34.329 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.329 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.329 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.329 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.329 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.329 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:34.330 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:18:34.331 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:34.329+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:34.431 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:34.430+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:34.478 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:34.478 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:34.478 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:18:34.478 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:34.486 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:18:34.532 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:34.531+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:34.592 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T16:18:34.633 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:34.632+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:34.633 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:34.633 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:34.633 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:18:34.633 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:18:34.634 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:34.642 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:18:34.714 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:18:34.715 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:18:34.731 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:18:34.732 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:18:34.733 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:34.733+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:34.748 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:18:34.748 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:18:34.765 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:18:34.765 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:18:34.782 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:18:34.782 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:18:34.791 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:34.792 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:18:34.792 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:18:34.792 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:18:34.792 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.792 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.17 73/72 [PushOp(3:e9340267:::rbd_data.1155525b14e3.0000000000000031:f, version: 50'357, data_included: [0~4096,20480~4096,40960~8192,65536~4096,81920~8192,110592~4096,126976~8192,151552~4096,172032~8192,196608~4096,212992~8192,241664~4096,258048~8192,282624~4096,303104~8192,327680~4096,344064~8192,372736~4096,389120~8192,413696~4096,434176~8192,458752~4096,475136~8192,503808~4096,520192~8192,544768~4096,565248~8192,589824~4096,606208~8192,634880~4096,651264~8192,675840~4096,696320~8192,720896~4096,737280~8192,765952~4096,782336~8192,806912~4096,827392~8192,851968~4096,868352~8192,897024~4096,913408~8192,937984~4096,958464~8192,983040~4096,999424~8192,1028096~4096,1044480~4096], data_size: 294912, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:e9340267:::rbd_data.1155525b14e3.0000000000000031:f@50'357, size: 1048576, copy_subset: [(0, 1048576)], clone_subset: {}, snapset: f=[]:{f: [f]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T16:18:34.792 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.067448+0000", 2024-09-12T16:18:34.792 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 88.722864340000001, 2024-09-12T16:18:34.792 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003036721, 2024-09-12T16:18:34.792 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.792 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.792 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:34.792 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.793 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.793 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.793 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067448+0000", 2024-09-12T16:18:34.793 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.793 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.793 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.793 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.793 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067448+0000", 2024-09-12T16:18:34.793 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.793 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.793 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.793 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.793 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067449+0000", 2024-09-12T16:18:34.794 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2200000000000004e-07 2024-09-12T16:18:34.794 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.794 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.794 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.794 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067703+0000", 2024-09-12T16:18:34.794 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025377199999999998 2024-09-12T16:18:34.794 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.794 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.794 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.794 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067723+0000", 2024-09-12T16:18:34.794 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.986e-05 2024-09-12T16:18:34.794 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.794 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.795 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.795 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067743+0000", 2024-09-12T16:18:34.795 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9942e-05 2024-09-12T16:18:34.795 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.795 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.795 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.795 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067860+0000", 2024-09-12T16:18:34.795 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000116959 2024-09-12T16:18:34.795 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.795 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.795 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:34.795 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.067872+0000", 2024-09-12T16:18:34.796 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2928000000000001e-05 2024-09-12T16:18:34.796 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.796 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.796 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.796 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.070485+0000", 2024-09-12T16:18:34.796 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0026127379999999999 2024-09-12T16:18:34.796 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.796 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.796 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.796 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.796 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.797 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5120.0:3941 3.17 e80/74 3:eff97428:::rbd_data.1155a3b3a26e.0000000000000060:head v 80'442, mlcod=79'439)", 2024-09-12T16:18:34.797 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:18:34.797 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 78.434523858999995, 2024-09-12T16:18:34.797 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0035981759999999998, 2024-09-12T16:18:34.797 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.797 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.797 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:34.797 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.797 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.797 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.797 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:18:34.798 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.798 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.798 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.798 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:18:34.798 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.798 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.798 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.798 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355789+0000", 2024-09-12T16:18:34.798 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2e-07 2024-09-12T16:18:34.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.798 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.799 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.799 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355794+0000", 2024-09-12T16:18:34.799 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.865e-06 2024-09-12T16:18:34.799 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.799 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.799 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.799 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355956+0000", 2024-09-12T16:18:34.799 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016131699999999999 2024-09-12T16:18:34.799 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.799 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.799 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.799 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.355964+0000", 2024-09-12T16:18:34.799 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7960000000000001e-06 2024-09-12T16:18:34.800 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.800 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.800 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.800 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.356320+0000", 2024-09-12T16:18:34.800 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000355612 2024-09-12T16:18:34.800 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.800 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.800 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:34.800 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.356337+0000", 2024-09-12T16:18:34.800 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6643e-05 2024-09-12T16:18:34.800 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.800 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.800 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:34.801 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.359340+0000", 2024-09-12T16:18:34.801 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003003618 2024-09-12T16:18:34.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.801 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.801 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.801 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:16.359387+0000", 2024-09-12T16:18:34.801 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6904999999999999e-05 2024-09-12T16:18:34.801 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.801 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.801 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.802 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.802 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2118 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1219, mlcod=88'1217)", 2024-09-12T16:18:34.802 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440434+0000", 2024-09-12T16:18:34.802 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 69.349878969000002, 2024-09-12T16:18:34.802 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003875543, 2024-09-12T16:18:34.802 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.802 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.802 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:34.802 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.802 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.802 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.802 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440434+0000", 2024-09-12T16:18:34.802 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.802 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.802 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.802 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.803 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440434+0000", 2024-09-12T16:18:34.803 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.803 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.803 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.803 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.803 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440435+0000", 2024-09-12T16:18:34.803 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8899999999999998e-07 2024-09-12T16:18:34.803 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.803 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.803 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.803 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440444+0000", 2024-09-12T16:18:34.803 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4599999999999992e-06 2024-09-12T16:18:34.803 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.803 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.803 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.803 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440459+0000", 2024-09-12T16:18:34.804 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4460999999999999e-05 2024-09-12T16:18:34.804 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.804 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.804 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.804 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440466+0000", 2024-09-12T16:18:34.804 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4340000000000003e-06 2024-09-12T16:18:34.804 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.804 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.804 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.804 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:18:34.804 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9054999999999997e-05 2024-09-12T16:18:34.804 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.804 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.805 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:34.805 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440535+0000", 2024-09-12T16:18:34.805 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.98e-05 2024-09-12T16:18:34.805 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.805 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.805 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:34.805 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444269+0000", 2024-09-12T16:18:34.805 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003734448 2024-09-12T16:18:34.805 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.805 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.805 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.805 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444309+0000", 2024-09-12T16:18:34.805 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0095999999999997e-05 2024-09-12T16:18:34.805 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.806 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.806 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.806 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.806 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2122 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1220, mlcod=88'1217)", 2024-09-12T16:18:34.806 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440484+0000", 2024-09-12T16:18:34.806 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 69.349828462999994, 2024-09-12T16:18:34.806 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0038538029999999998, 2024-09-12T16:18:34.806 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.806 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.806 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:34.806 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.806 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.806 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.806 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440484+0000", 2024-09-12T16:18:34.807 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.807 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.807 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.807 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.807 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440484+0000", 2024-09-12T16:18:34.807 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.807 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.807 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.807 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.807 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440485+0000", 2024-09-12T16:18:34.807 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6100000000000002e-07 2024-09-12T16:18:34.807 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.807 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.807 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.807 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440493+0000", 2024-09-12T16:18:34.808 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0169999999999996e-06 2024-09-12T16:18:34.808 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.808 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.808 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.808 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440501+0000", 2024-09-12T16:18:34.808 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9319999999999996e-06 2024-09-12T16:18:34.808 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.808 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.808 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.808 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440506+0000", 2024-09-12T16:18:34.808 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3510000000000001e-06 2024-09-12T16:18:34.808 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.808 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.809 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.809 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441319+0000", 2024-09-12T16:18:34.809 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00081295300000000005 2024-09-12T16:18:34.809 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.809 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.809 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:34.809 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441336+0000", 2024-09-12T16:18:34.809 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6897000000000001e-05 2024-09-12T16:18:34.809 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.809 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.809 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:34.809 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444311+0000", 2024-09-12T16:18:34.809 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029754510000000001 2024-09-12T16:18:34.809 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.809 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.810 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.810 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444338+0000", 2024-09-12T16:18:34.810 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6840999999999999e-05 2024-09-12T16:18:34.810 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.810 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.810 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.810 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.810 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.810 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2124 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1221, mlcod=88'1217)", 2024-09-12T16:18:34.810 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:18:34.810 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 69.349797890999994, 2024-09-12T16:18:34.810 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0038507229999999999, 2024-09-12T16:18:34.811 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.811 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.811 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:34.811 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.811 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.811 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.811 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:18:34.811 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.811 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.811 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.811 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.811 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:18:34.811 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.812 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.812 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.812 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.812 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440515+0000", 2024-09-12T16:18:34.812 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8799999999999998e-07 2024-09-12T16:18:34.812 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.812 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.812 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.812 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440519+0000", 2024-09-12T16:18:34.812 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5499999999999999e-06 2024-09-12T16:18:34.812 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.813 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.813 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.813 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440525+0000", 2024-09-12T16:18:34.813 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1009999999999997e-06 2024-09-12T16:18:34.813 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.813 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.813 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.813 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440529+0000", 2024-09-12T16:18:34.813 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3749999999999996e-06 2024-09-12T16:18:34.813 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.813 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.813 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.814 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441883+0000", 2024-09-12T16:18:34.814 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0013538249999999999 2024-09-12T16:18:34.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.814 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.814 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:34.814 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.441901+0000", 2024-09-12T16:18:34.814 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7972999999999999e-05 2024-09-12T16:18:34.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.814 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.814 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:34.814 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444341+0000", 2024-09-12T16:18:34.814 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002439568 2024-09-12T16:18:34.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.815 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.815 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.815 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444366+0000", 2024-09-12T16:18:34.815 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5043000000000001e-05 2024-09-12T16:18:34.815 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.815 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.815 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.815 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.815 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.815 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2327 3.1d e88/74 3:be05eb34:::rbd_object_map.11558d85ce23.000000000000001f:head v 88'1222, mlcod=88'1217)", 2024-09-12T16:18:34.815 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.440696+0000", 2024-09-12T16:18:34.815 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 69.349616549000004, 2024-09-12T16:18:34.815 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0036945739999999999, 2024-09-12T16:18:34.815 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.815 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.816 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:34.816 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.816 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.816 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.816 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440696+0000", 2024-09-12T16:18:34.816 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.816 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.816 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.816 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.816 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440696+0000", 2024-09-12T16:18:34.816 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.816 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.816 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.816 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.816 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440697+0000", 2024-09-12T16:18:34.817 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5899999999999996e-07 2024-09-12T16:18:34.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.817 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.817 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.817 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440702+0000", 2024-09-12T16:18:34.817 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0969999999999996e-06 2024-09-12T16:18:34.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.817 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.817 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.817 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440713+0000", 2024-09-12T16:18:34.817 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1114000000000001e-05 2024-09-12T16:18:34.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.817 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.817 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.818 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.440719+0000", 2024-09-12T16:18:34.818 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1650000000000003e-06 2024-09-12T16:18:34.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.818 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.818 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.818 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.442435+0000", 2024-09-12T16:18:34.818 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017155440000000001 2024-09-12T16:18:34.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.818 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.818 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:34.818 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.442457+0000", 2024-09-12T16:18:34.818 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1793999999999998e-05 2024-09-12T16:18:34.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.818 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.818 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:34.818 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444367+0000", 2024-09-12T16:18:34.819 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0019101980000000001 2024-09-12T16:18:34.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.819 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.819 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.819 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.444391+0000", 2024-09-12T16:18:34.819 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4003e-05 2024-09-12T16:18:34.819 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.819 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.819 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.820 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.820 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5398.0:2487 3.1d e88/74 3:b8c395a6:::rbd_data.11558d85ce23.000000000000000b:head v 88'1225, mlcod=88'1223)", 2024-09-12T16:18:34.820 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:18:34.820 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 69.344102179999993, 2024-09-12T16:18:34.820 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033166039999999999, 2024-09-12T16:18:34.820 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.820 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.820 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:34.820 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.820 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.820 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.821 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:18:34.821 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.821 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.821 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.821 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:18:34.821 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.821 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.821 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.821 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446211+0000", 2024-09-12T16:18:34.821 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9299999999999997e-07 2024-09-12T16:18:34.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.822 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.822 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.822 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446295+0000", 2024-09-12T16:18:34.822 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3153999999999997e-05 2024-09-12T16:18:34.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.822 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.822 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.822 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446309+0000", 2024-09-12T16:18:34.822 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4015e-05 2024-09-12T16:18:34.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.822 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.822 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.822 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446317+0000", 2024-09-12T16:18:34.822 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4880000000000007e-06 2024-09-12T16:18:34.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.823 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.823 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446373+0000", 2024-09-12T16:18:34.823 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5766000000000001e-05 2024-09-12T16:18:34.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.823 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:34.823 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.446395+0000", 2024-09-12T16:18:34.823 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2500000000000001e-05 2024-09-12T16:18:34.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.824 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:34.824 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.449445+0000", 2024-09-12T16:18:34.824 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003049791 2024-09-12T16:18:34.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.824 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.824 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.824 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:25.449527+0000", 2024-09-12T16:18:34.824 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2096999999999997e-05 2024-09-12T16:18:34.824 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.824 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.824 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.825 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.825 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.825 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "pg_update_log_missing(3.1d epoch 92/74 rep_tid 3087 entries 92'1280 (0'0) error 3:bc3c4c0b:::rbd_data.1155c757bf36.000000000000002c:head by client.5577.0:14343 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 90'1278)", 2024-09-12T16:18:34.825 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.408860+0000", 2024-09-12T16:18:34.825 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 64.381452734000007, 2024-09-12T16:18:34.825 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0056480419999999998, 2024-09-12T16:18:34.825 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.825 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.825 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "reached pg", 2024-09-12T16:18:34.825 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.825 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.825 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.825 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408860+0000", 2024-09-12T16:18:34.826 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.826 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.826 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.826 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.826 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408860+0000", 2024-09-12T16:18:34.826 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.826 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.826 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.826 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.826 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408861+0000", 2024-09-12T16:18:34.826 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6600000000000002e-07 2024-09-12T16:18:34.826 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.827 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.827 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.827 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408867+0000", 2024-09-12T16:18:34.827 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4150000000000004e-06 2024-09-12T16:18:34.827 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.827 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.827 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.827 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408881+0000", 2024-09-12T16:18:34.827 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4326e-05 2024-09-12T16:18:34.827 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.827 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.827 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.827 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408895+0000", 2024-09-12T16:18:34.827 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3903000000000001e-05 2024-09-12T16:18:34.828 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.828 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.828 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.828 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410566+0000", 2024-09-12T16:18:34.828 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001670822 2024-09-12T16:18:34.828 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.828 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.828 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.828 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414508+0000", 2024-09-12T16:18:34.828 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039421100000000004 2024-09-12T16:18:34.828 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.828 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.829 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.829 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.829 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.829 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "pg_update_log_missing(3.5 epoch 92/74 rep_tid 1621 entries 92'521 (0'0) error 3:a759f741:::rbd_data.1155c757bf36.0000000000000036:head by client.5577.0:14364 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 92'518)", 2024-09-12T16:18:34.829 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:18:34.829 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 64.380504256999998, 2024-09-12T16:18:34.829 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047586740000000001, 2024-09-12T16:18:34.829 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.829 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.829 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "reached pg", 2024-09-12T16:18:34.829 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.829 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.829 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.830 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:18:34.830 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.830 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.830 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.830 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:18:34.830 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.830 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.830 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.830 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:18:34.831 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.54e-07 2024-09-12T16:18:34.831 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.831 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.831 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.831 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409817+0000", 2024-09-12T16:18:34.831 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.028e-06 2024-09-12T16:18:34.831 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.831 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.831 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.831 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410047+0000", 2024-09-12T16:18:34.831 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022964599999999999 2024-09-12T16:18:34.832 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.832 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.832 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.832 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410067+0000", 2024-09-12T16:18:34.832 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0438999999999999e-05 2024-09-12T16:18:34.832 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.832 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.832 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.832 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411223+0000", 2024-09-12T16:18:34.832 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011560229999999999 2024-09-12T16:18:34.833 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.833 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.833 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.833 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414567+0000", 2024-09-12T16:18:34.833 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033437839999999998 2024-09-12T16:18:34.833 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.833 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.833 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.833 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.833 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.833 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14391 3.5 e92/74 3:a5105766:::rbd_data.1155c757bf36.0000000000000044:head v 92'523, mlcod=92'518)", 2024-09-12T16:18:34.833 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.410084+0000", 2024-09-12T16:18:34.833 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 64.380228387000002, 2024-09-12T16:18:34.834 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0046720299999999998, 2024-09-12T16:18:34.834 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.834 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.834 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:34.834 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.834 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.834 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.834 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410084+0000", 2024-09-12T16:18:34.834 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.834 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.834 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.834 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.835 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410084+0000", 2024-09-12T16:18:34.835 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.835 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.835 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.835 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410085+0000", 2024-09-12T16:18:34.835 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1900000000000002e-07 2024-09-12T16:18:34.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.835 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.835 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.835 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410091+0000", 2024-09-12T16:18:34.835 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1e-06 2024-09-12T16:18:34.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.835 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.835 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.836 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410100+0000", 2024-09-12T16:18:34.836 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6889999999999993e-06 2024-09-12T16:18:34.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.836 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.836 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.836 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410105+0000", 2024-09-12T16:18:34.836 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3199999999999999e-06 2024-09-12T16:18:34.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.836 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.836 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.836 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411563+0000", 2024-09-12T16:18:34.836 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00145795 2024-09-12T16:18:34.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.836 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.837 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:34.837 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411590+0000", 2024-09-12T16:18:34.837 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6570000000000001e-05 2024-09-12T16:18:34.837 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.837 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.837 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:34.837 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414571+0000", 2024-09-12T16:18:34.837 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029815710000000001 2024-09-12T16:18:34.837 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.837 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.837 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.837 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414756+0000", 2024-09-12T16:18:34.837 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018521100000000001 2024-09-12T16:18:34.837 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.838 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.838 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.838 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.838 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.838 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14405 3.5 e92/74 3:a0797093:::rbd_data.1155c757bf36.000000000000004b:head v 92'525, mlcod=92'518)", 2024-09-12T16:18:34.838 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.410119+0000", 2024-09-12T16:18:34.838 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 64.380193446999996, 2024-09-12T16:18:34.838 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047304000000000001, 2024-09-12T16:18:34.838 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.838 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.838 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:34.838 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.838 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.839 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.839 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410119+0000", 2024-09-12T16:18:34.839 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.839 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.839 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.839 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.839 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410119+0000", 2024-09-12T16:18:34.839 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.839 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.839 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.839 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.839 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410120+0000", 2024-09-12T16:18:34.839 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:18:34.839 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.840 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.840 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.840 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410126+0000", 2024-09-12T16:18:34.840 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1460000000000001e-06 2024-09-12T16:18:34.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.840 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.840 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.840 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410134+0000", 2024-09-12T16:18:34.840 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8879999999999997e-06 2024-09-12T16:18:34.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.840 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.840 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.840 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410140+0000", 2024-09-12T16:18:34.841 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0839999999999997e-06 2024-09-12T16:18:34.841 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.841 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.841 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.841 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412146+0000", 2024-09-12T16:18:34.841 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0020057569999999999 2024-09-12T16:18:34.841 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.841 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.841 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:34.841 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412163+0000", 2024-09-12T16:18:34.841 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7742000000000001e-05 2024-09-12T16:18:34.841 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.841 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.842 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:34.842 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414761+0000", 2024-09-12T16:18:34.842 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025979660000000002 2024-09-12T16:18:34.842 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.842 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.842 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.842 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414850+0000", 2024-09-12T16:18:34.842 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8426999999999999e-05 2024-09-12T16:18:34.842 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.842 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.842 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.842 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.842 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.842 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14435 3.1d e92/74 3:b810b250:::rbd_data.1155c757bf36.000000000000010b:head v 92'1282, mlcod=90'1278)", 2024-09-12T16:18:34.843 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:18:34.843 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 64.379350978000005, 2024-09-12T16:18:34.843 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039190579999999996, 2024-09-12T16:18:34.843 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.843 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.843 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:34.843 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.843 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.843 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.843 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:18:34.843 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.843 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.843 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.843 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.843 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:18:34.844 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.844 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.844 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.844 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.844 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410962+0000", 2024-09-12T16:18:34.844 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5199999999999996e-07 2024-09-12T16:18:34.844 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.844 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.844 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.844 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410968+0000", 2024-09-12T16:18:34.844 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.305e-06 2024-09-12T16:18:34.844 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.844 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.845 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.845 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410986+0000", 2024-09-12T16:18:34.845 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8213999999999999e-05 2024-09-12T16:18:34.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.845 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.845 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.845 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410993+0000", 2024-09-12T16:18:34.845 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2849999999999997e-06 2024-09-12T16:18:34.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.845 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.845 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.845 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412228+0000", 2024-09-12T16:18:34.845 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0012347370000000001 2024-09-12T16:18:34.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.846 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.846 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:34.846 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412262+0000", 2024-09-12T16:18:34.846 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3531999999999997e-05 2024-09-12T16:18:34.846 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.846 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.846 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:34.846 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414854+0000", 2024-09-12T16:18:34.846 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002592039 2024-09-12T16:18:34.846 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.847 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.847 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.847 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414881+0000", 2024-09-12T16:18:34.847 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7294e-05 2024-09-12T16:18:34.847 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.847 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.847 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.847 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.847 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.847 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14434 3.5 e92/74 3:a09dd60f:::rbd_data.1155c757bf36.000000000000010a:head v 92'527, mlcod=92'518)", 2024-09-12T16:18:34.847 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.411186+0000", 2024-09-12T16:18:34.847 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 64.379126830999994, 2024-09-12T16:18:34.847 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0037696930000000002, 2024-09-12T16:18:34.848 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.848 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.848 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:34.848 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.848 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.848 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.848 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411186+0000", 2024-09-12T16:18:34.848 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.848 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.848 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.848 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.848 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411186+0000", 2024-09-12T16:18:34.848 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.849 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.849 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411187+0000", 2024-09-12T16:18:34.849 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3799999999999997e-07 2024-09-12T16:18:34.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.849 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.849 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411203+0000", 2024-09-12T16:18:34.849 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6793999999999999e-05 2024-09-12T16:18:34.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.849 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411323+0000", 2024-09-12T16:18:34.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011975499999999999 2024-09-12T16:18:34.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411332+0000", 2024-09-12T16:18:34.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4370000000000007e-06 2024-09-12T16:18:34.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.413073+0000", 2024-09-12T16:18:34.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001741827 2024-09-12T16:18:34.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:34.851 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.413091+0000", 2024-09-12T16:18:34.851 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8011000000000001e-05 2024-09-12T16:18:34.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.851 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.851 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:34.851 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414882+0000", 2024-09-12T16:18:34.851 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001790841 2024-09-12T16:18:34.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.851 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.851 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.851 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414956+0000", 2024-09-12T16:18:34.851 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.339e-05 2024-09-12T16:18:34.851 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.851 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.852 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.852 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.852 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14426 3.13 e92/74 3:c827d1d7:::rbd_data.1155c757bf36.0000000000000056:head v 92'741, mlcod=90'737)", 2024-09-12T16:18:34.852 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:18:34.852 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 64.375034917999997, 2024-09-12T16:18:34.852 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030296030000000001, 2024-09-12T16:18:34.852 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.852 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.852 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:34.852 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.852 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.852 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.853 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:18:34.853 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.853 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.853 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.853 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.853 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:18:34.853 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.853 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.853 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.853 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.853 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415278+0000", 2024-09-12T16:18:34.853 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6300000000000001e-07 2024-09-12T16:18:34.853 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.854 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.854 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.854 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415282+0000", 2024-09-12T16:18:34.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6289999999999999e-06 2024-09-12T16:18:34.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.854 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.854 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.854 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415288+0000", 2024-09-12T16:18:34.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5520000000000001e-06 2024-09-12T16:18:34.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.854 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.854 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.854 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415293+0000", 2024-09-12T16:18:34.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6879999999999998e-06 2024-09-12T16:18:34.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415412+0000", 2024-09-12T16:18:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118579 2024-09-12T16:18:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.415429+0000", 2024-09-12T16:18:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7501000000000001e-05 2024-09-12T16:18:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.418270+0000", 2024-09-12T16:18:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028404860000000001 2024-09-12T16:18:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.418307+0000", 2024-09-12T16:18:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7805000000000001e-05 2024-09-12T16:18:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5384.0:1241 3.16 e95/75 3:6ee670ce:::rbd_data.1155b9894cdc.0000000000000005:head v 95'1303, mlcod=95'1301)", 2024-09-12T16:18:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:35.272164+0000", 2024-09-12T16:18:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 59.518149061999999, 2024-09-12T16:18:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015008743, 2024-09-12T16:18:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.272164+0000", 2024-09-12T16:18:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.272164+0000", 2024-09-12T16:18:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.272165+0000", 2024-09-12T16:18:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.311e-06 2024-09-12T16:18:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275503+0000", 2024-09-12T16:18:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003337881 2024-09-12T16:18:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275530+0000", 2024-09-12T16:18:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6797000000000001e-05 2024-09-12T16:18:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275541+0000", 2024-09-12T16:18:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1634000000000001e-05 2024-09-12T16:18:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275618+0000", 2024-09-12T16:18:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6811999999999996e-05 2024-09-12T16:18:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275642+0000", 2024-09-12T16:18:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4111999999999999e-05 2024-09-12T16:18:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287116+0000", 2024-09-12T16:18:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01147395 2024-09-12T16:18:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287172+0000", 2024-09-12T16:18:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6246000000000003e-05 2024-09-12T16:18:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5384.0:1246 3.f e95/74 3:f0725c44:::rbd_data.1155b9894cdc.0000000000000006:head v 95'356, mlcod=95'354)", 2024-09-12T16:18:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:35.276304+0000", 2024-09-12T16:18:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 59.514009135000002, 2024-09-12T16:18:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011209733, 2024-09-12T16:18:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.276304+0000", 2024-09-12T16:18:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.276304+0000", 2024-09-12T16:18:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.276305+0000", 2024-09-12T16:18:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2500000000000001e-06 2024-09-12T16:18:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279256+0000", 2024-09-12T16:18:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002951076 2024-09-12T16:18:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279281+0000", 2024-09-12T16:18:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4779000000000001e-05 2024-09-12T16:18:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279294+0000", 2024-09-12T16:18:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3614e-05 2024-09-12T16:18:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279366+0000", 2024-09-12T16:18:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2094000000000005e-05 2024-09-12T16:18:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279395+0000", 2024-09-12T16:18:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8337999999999999e-05 2024-09-12T16:18:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287479+0000", 2024-09-12T16:18:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0080844799999999998 2024-09-12T16:18:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287513+0000", 2024-09-12T16:18:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4102e-05 2024-09-12T16:18:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.13 135/134 [PushOp(3:c808f6af:::rbd_data.1155525b14e3.000000000000002e:f, version: 50'174, data_included: [0~4096,24576~4096,40960~8192,65536~4096,86016~8192,110592~4096,126976~8192,155648~4096,172032~8192,196608~4096,217088~8192,241664~4096,258048~8192,286720~4096,303104~8192,327680~4096,348160~8192,372736~4096,389120~8192,417792~4096,434176~8192,458752~4096,479232~8192,503808~4096,520192~8192,548864~4096,565248~8192,589824~4096,610304~8192,634880~4096,651264~8192,679936~4096,696320~8192,720896~4096,741376~8192,765952~4096,782336~8192,811008~4096,827392~8192,851968~4096,872448~8192,897024~4096,913408~8192,942080~4096,958464~8192,983040~4096,1003520~8192,1028096~4096,1044480~4096], data_size: 294912, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:c808f6af:::rbd_data.1155525b14e3.000000000000002e:f@50'174, size: 1048576, copy_subset: [(0, 1048576)], clone_subset: {}, snapset: f=[]:{f: [f]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T16:18:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:23.685641+0000", 2024-09-12T16:18:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 11.104671529000001, 2024-09-12T16:18:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030424850000000002, 2024-09-12T16:18:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:23.685641+0000", 2024-09-12T16:18:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:23.685641+0000", 2024-09-12T16:18:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:23.685642+0000", 2024-09-12T16:18:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3099999999999997e-07 2024-09-12T16:18:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:23.685785+0000", 2024-09-12T16:18:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014354099999999999 2024-09-12T16:18:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.868 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:23.685807+0000", 2024-09-12T16:18:34.868 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1420000000000002e-05 2024-09-12T16:18:34.868 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.868 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.868 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.868 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:23.685836+0000", 2024-09-12T16:18:34.868 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9359000000000001e-05 2024-09-12T16:18:34.868 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.868 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.868 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.868 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:23.685933+0000", 2024-09-12T16:18:34.868 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6472999999999996e-05 2024-09-12T16:18:34.869 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.869 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.869 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:34.869 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:23.685945+0000", 2024-09-12T16:18:34.869 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2578000000000001e-05 2024-09-12T16:18:34.869 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.869 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.869 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.869 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:23.688684+0000", 2024-09-12T16:18:34.869 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0027384829999999999 2024-09-12T16:18:34.869 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.869 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.870 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.870 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.870 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.870 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.5 135/134 [PushOp(3:a1218f83:::rbd_data.1155525b14e3.000000000000002d:f, version: 50'247, data_included: [0~4096,24576~4096,40960~8192,65536~4096,86016~8192,110592~4096,131072~4096,155648~4096,172032~8192,196608~4096,217088~8192,241664~4096,262144~4096,286720~4096,303104~8192,327680~4096,348160~8192,372736~4096,393216~4096,417792~4096,434176~8192,458752~4096,479232~8192,503808~4096,524288~4096,548864~4096,565248~8192,589824~4096,610304~8192,634880~4096,655360~4096,679936~4096,696320~8192,720896~4096,741376~8192,765952~4096,786432~4096,811008~4096,827392~8192,851968~4096,872448~8192,897024~4096,917504~4096,942080~4096,958464~8192,983040~4096,1003520~8192,1028096~4096], data_size: 262144, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:a1218f83:::rbd_data.1155525b14e3.000000000000002d:f@50'247, size: 1032192, copy_subset: [(0, 1032192)], clone_subset: {}, snapset: f=[]:{f: [f]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1032192, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T16:18:34.870 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:23.876412+0000", 2024-09-12T16:18:34.870 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.913900462000001, 2024-09-12T16:18:34.870 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0032680349999999999, 2024-09-12T16:18:34.870 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.870 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.870 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:34.870 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.870 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.870 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.870 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:23.876412+0000", 2024-09-12T16:18:34.871 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.871 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.871 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.871 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.871 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:23.876412+0000", 2024-09-12T16:18:34.871 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.871 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.871 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.871 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.871 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:23.876413+0000", 2024-09-12T16:18:34.871 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8899999999999999e-07 2024-09-12T16:18:34.871 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.871 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.871 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.872 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:23.876974+0000", 2024-09-12T16:18:34.872 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00056118900000000002 2024-09-12T16:18:34.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.872 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.872 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.872 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:23.876994+0000", 2024-09-12T16:18:34.872 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0250000000000001e-05 2024-09-12T16:18:34.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.872 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.872 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.872 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:23.877030+0000", 2024-09-12T16:18:34.872 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5864000000000001e-05 2024-09-12T16:18:34.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.872 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.873 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.873 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:23.877155+0000", 2024-09-12T16:18:34.873 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000124461 2024-09-12T16:18:34.873 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.873 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.873 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:34.873 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:23.877168+0000", 2024-09-12T16:18:34.873 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2853e-05 2024-09-12T16:18:34.873 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.873 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.873 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.873 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:23.879680+0000", 2024-09-12T16:18:34.874 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025128289999999998 2024-09-12T16:18:34.874 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.874 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.874 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.874 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.874 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.874 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "MOSDPGPush(3.1d 136/134 [PushOp(3:b81abef1:::rbd_data.1155525b14e3.0000000000000032:f, version: 50'956, data_included: [0~4096,20480~4096,40960~4096,65536~4096,81920~8192,126976~8192,151552~4096,172032~4096,196608~4096,212992~8192,258048~8192,282624~4096,303104~4096,327680~4096,344064~8192,389120~8192,413696~4096,434176~4096,458752~4096,475136~8192,520192~8192,544768~4096,565248~4096,589824~4096,606208~8192,651264~8192,675840~4096,696320~4096,720896~4096,737280~8192,782336~8192,806912~4096,827392~4096,851968~4096,868352~8192,913408~8192,937984~4096,958464~4096,983040~4096,999424~8192,1044480~4096], data_size: 229376, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:b81abef1:::rbd_data.1155525b14e3.0000000000000032:f@50'956, size: 1048576, copy_subset: [(0, 1048576)], clone_subset: {}, snapset: f=[]:{f: [f]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T16:18:34.874 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:24.748161+0000", 2024-09-12T16:18:34.874 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.042152064, 2024-09-12T16:18:34.874 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0041873149999999996, 2024-09-12T16:18:34.874 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.874 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.874 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:34.874 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.874 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.875 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.875 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.748161+0000", 2024-09-12T16:18:34.875 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.875 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.875 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.875 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.875 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.748161+0000", 2024-09-12T16:18:34.875 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.875 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.875 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.875 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.875 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.748161+0000", 2024-09-12T16:18:34.875 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1899999999999998e-07 2024-09-12T16:18:34.875 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.876 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.876 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.876 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.748223+0000", 2024-09-12T16:18:34.876 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1807e-05 2024-09-12T16:18:34.876 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.876 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.876 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.876 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.748249+0000", 2024-09-12T16:18:34.876 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5760000000000001e-05 2024-09-12T16:18:34.876 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.876 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.876 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.876 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.748267+0000", 2024-09-12T16:18:34.876 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8400999999999999e-05 2024-09-12T16:18:34.876 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.877 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.877 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.877 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.748390+0000", 2024-09-12T16:18:34.877 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012325300000000001 2024-09-12T16:18:34.877 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.877 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.877 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:34.877 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.748409+0000", 2024-09-12T16:18:34.877 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8833000000000001e-05 2024-09-12T16:18:34.877 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.877 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.877 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.878 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.752348+0000", 2024-09-12T16:18:34.878 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039388419999999997 2024-09-12T16:18:34.878 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.878 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.878 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.878 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.878 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.878 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.1.0:3184 3.2 e137/136 3:474f413e:::rbd_data.1155a3488f5d.0000000000000032:1a v 137'534, mlcod=0'0)", 2024-09-12T16:18:34.878 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:25.149131+0000", 2024-09-12T16:18:34.878 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 9.6411822100000002, 2024-09-12T16:18:34.878 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003147983, 2024-09-12T16:18:34.878 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:34.878 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:34.878 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:34.879 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:34.879 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.879 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:34.879 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.149131+0000", 2024-09-12T16:18:34.879 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.879 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.879 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:34.879 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.149131+0000", 2024-09-12T16:18:34.879 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:34.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.879 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.879 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:34.879 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.149131+0000", 2024-09-12T16:18:34.880 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2600000000000002e-07 2024-09-12T16:18:34.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.880 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.880 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:34.880 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.149136+0000", 2024-09-12T16:18:34.880 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1850000000000003e-06 2024-09-12T16:18:34.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.880 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.880 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:34.880 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.149145+0000", 2024-09-12T16:18:34.880 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9579999999999996e-06 2024-09-12T16:18:34.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.880 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.880 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:34.880 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.149152+0000", 2024-09-12T16:18:34.881 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9079999999999998e-06 2024-09-12T16:18:34.881 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.881 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.881 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:34.881 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.149193+0000", 2024-09-12T16:18:34.881 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1189000000000002e-05 2024-09-12T16:18:34.881 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.881 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.881 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:34.881 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.149212+0000", 2024-09-12T16:18:34.881 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8961999999999999e-05 2024-09-12T16:18:34.881 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.881 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.881 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:34.881 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.152239+0000", 2024-09-12T16:18:34.882 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030268059999999999 2024-09-12T16:18:34.882 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:34.882 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:34.882 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:34.882 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.152279+0000", 2024-09-12T16:18:34.882 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9348999999999999e-05 2024-09-12T16:18:34.882 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.882 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.882 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.882 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:34.882 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:34.882 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:34.883 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:18:34.884 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:34.883+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:34.884 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:18:34.885 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:18:34.984 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:34.983+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:35.033 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:35.033 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:35.042 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:18:35.086 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:35.085+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:35.149 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:35.149 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:35.158 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:18:35.176 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2024-09-12T16:18:35.200 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:35.199+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:35.286 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:35.285+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:35.294 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:35.294 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:35.303 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:18:35.387 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:35.386+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:35.450 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:35.451 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:35.459 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:18:35.500 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:35.499+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:35.590 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:35.589+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:35.605 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:35.605 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:35.614 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:18:35.693 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:35.692+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:35.721 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:35.721 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:35.730 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:18:35.794 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:35.793+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:35.837 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:35.837 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:35.846 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:18:35.931 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:35.930+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:35.993 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:35.993 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:35.995 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:35.994+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:36.001 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:18:36.096 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:36.095+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:36.149 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:36.149 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:36.157 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:18:36.200 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:36.199+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:36.295 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:36.296 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:36.298 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:36.297+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:36.305 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:18:36.399 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:36.398+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:36.454 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:36.454 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:36.463 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:18:36.507 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:36.507+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:36.569 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:36.570 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:36.579 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:18:36.620 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:36.620+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:36.702 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:36.701+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:36.728 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:36.728 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:36.737 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:18:36.803 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:36.802+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:36.844 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:36.844 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:36.853 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:18:36.885 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T16:18:36.931 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:36.930+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:36.960 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:36.960 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:36.968 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:18:37.013 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:37.013+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:37.024 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:18:37.024 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:18:37.034 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:18:37.034 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:18:37.050 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:18:37.050 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:18:37.067 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:18:37.067 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:18:37.076 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:37.076 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:37.084 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:18:37.084 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:18:37.085 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:18:37.100 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:18:37.100 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:18:37.126 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:37.126+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:37.201 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T16:18:37.247 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:37.246+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:37.249 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:37.249 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:37.250 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:18:37.250 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:18:37.250 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:37.260 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:18:37.306 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:37.306+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:37.376 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:37.376 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:18:37.377 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:18:37.377 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:18:37.377 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.377 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "pg_update_log_missing(3.1d epoch 92/74 rep_tid 3087 entries 92'1280 (0'0) error 3:bc3c4c0b:::rbd_data.1155c757bf36.000000000000002c:head by client.5577.0:14343 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 90'1278)", 2024-09-12T16:18:37.377 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.408860+0000", 2024-09-12T16:18:37.377 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 66.966078409000005, 2024-09-12T16:18:37.377 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0056480419999999998, 2024-09-12T16:18:37.377 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:37.377 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:37.377 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "reached pg", 2024-09-12T16:18:37.377 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:37.377 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.377 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:37.378 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408860+0000", 2024-09-12T16:18:37.378 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.378 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.378 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.378 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:37.378 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408860+0000", 2024-09-12T16:18:37.378 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.378 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.378 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.378 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:37.378 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408861+0000", 2024-09-12T16:18:37.378 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6600000000000002e-07 2024-09-12T16:18:37.378 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.379 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.379 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:37.379 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408867+0000", 2024-09-12T16:18:37.379 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4150000000000004e-06 2024-09-12T16:18:37.379 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.379 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.379 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:37.379 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408881+0000", 2024-09-12T16:18:37.379 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4326e-05 2024-09-12T16:18:37.379 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.380 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.380 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.380 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408895+0000", 2024-09-12T16:18:37.380 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3903000000000001e-05 2024-09-12T16:18:37.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.380 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.380 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:37.380 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410566+0000", 2024-09-12T16:18:37.380 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001670822 2024-09-12T16:18:37.381 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.381 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.381 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:37.381 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414508+0000", 2024-09-12T16:18:37.381 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039421100000000004 2024-09-12T16:18:37.381 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.381 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:37.381 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.381 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.381 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.381 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "pg_update_log_missing(3.5 epoch 92/74 rep_tid 1621 entries 92'521 (0'0) error 3:a759f741:::rbd_data.1155c757bf36.0000000000000036:head by client.5577.0:14364 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 92'518)", 2024-09-12T16:18:37.381 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:18:37.382 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 66.965129931999996, 2024-09-12T16:18:37.382 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047586740000000001, 2024-09-12T16:18:37.382 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:37.382 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:37.382 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "reached pg", 2024-09-12T16:18:37.382 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:37.382 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.382 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:37.382 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:18:37.382 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.382 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.382 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.382 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:37.383 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:18:37.383 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.383 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.383 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:37.383 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:18:37.383 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.54e-07 2024-09-12T16:18:37.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.383 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.383 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:37.383 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409817+0000", 2024-09-12T16:18:37.383 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.028e-06 2024-09-12T16:18:37.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.383 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.384 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:37.384 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410047+0000", 2024-09-12T16:18:37.384 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022964599999999999 2024-09-12T16:18:37.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.384 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.384 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410067+0000", 2024-09-12T16:18:37.384 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0438999999999999e-05 2024-09-12T16:18:37.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.384 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:37.384 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411223+0000", 2024-09-12T16:18:37.385 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011560229999999999 2024-09-12T16:18:37.385 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.385 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.385 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:37.385 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414567+0000", 2024-09-12T16:18:37.385 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033437839999999998 2024-09-12T16:18:37.385 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.385 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:37.385 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.385 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.385 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.385 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14391 3.5 e92/74 3:a5105766:::rbd_data.1155c757bf36.0000000000000044:head v 92'523, mlcod=92'518)", 2024-09-12T16:18:37.385 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.410084+0000", 2024-09-12T16:18:37.386 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 66.964854062000001, 2024-09-12T16:18:37.386 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0046720299999999998, 2024-09-12T16:18:37.386 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:37.386 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:37.386 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:37.386 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:37.386 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.386 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:37.386 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410084+0000", 2024-09-12T16:18:37.386 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.386 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.386 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:37.386 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410084+0000", 2024-09-12T16:18:37.386 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.387 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.387 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:37.387 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410085+0000", 2024-09-12T16:18:37.387 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1900000000000002e-07 2024-09-12T16:18:37.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.387 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.387 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:37.387 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410091+0000", 2024-09-12T16:18:37.387 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1e-06 2024-09-12T16:18:37.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.387 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.387 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:37.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410100+0000", 2024-09-12T16:18:37.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6889999999999993e-06 2024-09-12T16:18:37.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.388 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410105+0000", 2024-09-12T16:18:37.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3199999999999999e-06 2024-09-12T16:18:37.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.388 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:37.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411563+0000", 2024-09-12T16:18:37.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00145795 2024-09-12T16:18:37.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.389 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.389 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:37.389 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411590+0000", 2024-09-12T16:18:37.389 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6570000000000001e-05 2024-09-12T16:18:37.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.389 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.389 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:37.389 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414571+0000", 2024-09-12T16:18:37.389 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029815710000000001 2024-09-12T16:18:37.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.389 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.389 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:37.389 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414756+0000", 2024-09-12T16:18:37.390 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018521100000000001 2024-09-12T16:18:37.390 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.390 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:37.390 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.390 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.390 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14405 3.5 e92/74 3:a0797093:::rbd_data.1155c757bf36.000000000000004b:head v 92'525, mlcod=92'518)", 2024-09-12T16:18:37.390 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.410119+0000", 2024-09-12T16:18:37.390 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 66.964819121999994, 2024-09-12T16:18:37.390 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047304000000000001, 2024-09-12T16:18:37.390 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:37.390 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:37.390 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:37.391 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:37.391 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.391 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:37.391 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410119+0000", 2024-09-12T16:18:37.391 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.391 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.391 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:37.391 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410119+0000", 2024-09-12T16:18:37.391 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.391 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.391 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:37.391 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410120+0000", 2024-09-12T16:18:37.392 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:18:37.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.392 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.392 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:37.392 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410126+0000", 2024-09-12T16:18:37.392 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1460000000000001e-06 2024-09-12T16:18:37.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.393 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:37.393 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410134+0000", 2024-09-12T16:18:37.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8879999999999997e-06 2024-09-12T16:18:37.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.393 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.393 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410140+0000", 2024-09-12T16:18:37.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0839999999999997e-06 2024-09-12T16:18:37.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.393 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:37.393 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412146+0000", 2024-09-12T16:18:37.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0020057569999999999 2024-09-12T16:18:37.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:37.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412163+0000", 2024-09-12T16:18:37.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7742000000000001e-05 2024-09-12T16:18:37.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:37.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414761+0000", 2024-09-12T16:18:37.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025979660000000002 2024-09-12T16:18:37.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:37.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414850+0000", 2024-09-12T16:18:37.395 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8426999999999999e-05 2024-09-12T16:18:37.395 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.395 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:37.395 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.395 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.395 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.395 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5384.0:1241 3.16 e95/75 3:6ee670ce:::rbd_data.1155b9894cdc.0000000000000005:head v 95'1303, mlcod=95'1301)", 2024-09-12T16:18:37.395 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:35.272164+0000", 2024-09-12T16:18:37.395 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 62.102774736999997, 2024-09-12T16:18:37.395 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015008743, 2024-09-12T16:18:37.395 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:37.395 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:37.395 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:37.396 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:37.396 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.396 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:37.396 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.272164+0000", 2024-09-12T16:18:37.396 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.396 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.396 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:37.396 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.272164+0000", 2024-09-12T16:18:37.396 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.396 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.396 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:37.397 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.272165+0000", 2024-09-12T16:18:37.397 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.311e-06 2024-09-12T16:18:37.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.397 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.397 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:37.397 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275503+0000", 2024-09-12T16:18:37.397 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003337881 2024-09-12T16:18:37.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.397 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.397 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:37.397 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275530+0000", 2024-09-12T16:18:37.397 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6797000000000001e-05 2024-09-12T16:18:37.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.398 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.398 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275541+0000", 2024-09-12T16:18:37.398 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1634000000000001e-05 2024-09-12T16:18:37.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.398 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:37.398 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275618+0000", 2024-09-12T16:18:37.398 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6811999999999996e-05 2024-09-12T16:18:37.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.398 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:37.399 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275642+0000", 2024-09-12T16:18:37.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4111999999999999e-05 2024-09-12T16:18:37.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.399 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.399 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:37.399 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287116+0000", 2024-09-12T16:18:37.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01147395 2024-09-12T16:18:37.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.399 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.399 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:37.399 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287172+0000", 2024-09-12T16:18:37.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6246000000000003e-05 2024-09-12T16:18:37.399 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.399 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:37.400 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.400 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.400 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.400 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5384.0:1246 3.f e95/74 3:f0725c44:::rbd_data.1155b9894cdc.0000000000000006:head v 95'356, mlcod=95'354)", 2024-09-12T16:18:37.400 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:35.276304+0000", 2024-09-12T16:18:37.400 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 62.09863481, 2024-09-12T16:18:37.400 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011209733, 2024-09-12T16:18:37.400 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:37.400 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:37.400 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:37.400 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:37.400 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.400 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:37.401 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.276304+0000", 2024-09-12T16:18:37.401 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.401 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.401 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:37.401 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.276304+0000", 2024-09-12T16:18:37.401 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.401 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.401 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:37.401 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.276305+0000", 2024-09-12T16:18:37.401 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2500000000000001e-06 2024-09-12T16:18:37.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.402 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:37.402 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279256+0000", 2024-09-12T16:18:37.402 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002951076 2024-09-12T16:18:37.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.402 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:37.402 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279281+0000", 2024-09-12T16:18:37.402 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4779000000000001e-05 2024-09-12T16:18:37.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.402 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.402 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279294+0000", 2024-09-12T16:18:37.402 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3614e-05 2024-09-12T16:18:37.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.403 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.403 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:37.403 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279366+0000", 2024-09-12T16:18:37.403 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2094000000000005e-05 2024-09-12T16:18:37.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.403 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.403 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:37.403 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279395+0000", 2024-09-12T16:18:37.403 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8337999999999999e-05 2024-09-12T16:18:37.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.403 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.403 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:37.403 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287479+0000", 2024-09-12T16:18:37.403 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0080844799999999998 2024-09-12T16:18:37.404 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.404 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.404 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:37.404 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287513+0000", 2024-09-12T16:18:37.404 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4102e-05 2024-09-12T16:18:37.404 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.404 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:37.404 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.404 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.404 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.404 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.3.0:6016 3.13 e149/136 3:c923ecd0:::rbd_data.1155525b14e3.000000000000003f:f v 149'966, mlcod=147'960)", 2024-09-12T16:18:37.404 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.190622+0000", 2024-09-12T16:18:37.404 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.18431608899999999, 2024-09-12T16:18:37.404 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004419821, 2024-09-12T16:18:37.405 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:37.405 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:37.405 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:37.405 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:37.405 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.405 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:37.405 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.190622+0000", 2024-09-12T16:18:37.405 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.405 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.405 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:37.405 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.190622+0000", 2024-09-12T16:18:37.405 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:37.406 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.190623+0000", 2024-09-12T16:18:37.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7199999999999998e-07 2024-09-12T16:18:37.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:37.406 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.190629+0000", 2024-09-12T16:18:37.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7869999999999998e-06 2024-09-12T16:18:37.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:37.406 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.190642+0000", 2024-09-12T16:18:37.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2928999999999999e-05 2024-09-12T16:18:37.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.407 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.407 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.190649+0000", 2024-09-12T16:18:37.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2899999999999997e-06 2024-09-12T16:18:37.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.407 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:37.407 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.190702+0000", 2024-09-12T16:18:37.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2738999999999998e-05 2024-09-12T16:18:37.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.408 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.408 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:37.408 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.190721+0000", 2024-09-12T16:18:37.408 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9589000000000002e-05 2024-09-12T16:18:37.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.408 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.408 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:37.408 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194995+0000", 2024-09-12T16:18:37.409 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0042735389999999998 2024-09-12T16:18:37.409 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.409 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.409 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:37.409 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195042+0000", 2024-09-12T16:18:37.409 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7175999999999997e-05 2024-09-12T16:18:37.409 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.409 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:37.409 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.409 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.409 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.409 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.4.0:5451 3.1c e149/136 3:384eb380:::rbd_data.1155525b14e3.0000000000000044:f v 149'831, mlcod=148'828)", 2024-09-12T16:18:37.409 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.191205+0000", 2024-09-12T16:18:37.410 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.183733271, 2024-09-12T16:18:37.410 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0064034929999999997, 2024-09-12T16:18:37.410 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:37.410 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:37.410 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:37.410 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:37.410 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.410 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:37.410 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191205+0000", 2024-09-12T16:18:37.410 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.411 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.411 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:37.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191205+0000", 2024-09-12T16:18:37.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.411 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.411 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:37.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191205+0000", 2024-09-12T16:18:37.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9299999999999999e-07 2024-09-12T16:18:37.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.412 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:37.412 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191210+0000", 2024-09-12T16:18:37.412 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0879999999999997e-06 2024-09-12T16:18:37.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.412 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:37.412 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191218+0000", 2024-09-12T16:18:37.412 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.867e-06 2024-09-12T16:18:37.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.413 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.413 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191225+0000", 2024-09-12T16:18:37.413 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3300000000000004e-06 2024-09-12T16:18:37.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.413 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:37.413 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191312+0000", 2024-09-12T16:18:37.413 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7371000000000001e-05 2024-09-12T16:18:37.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.413 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:37.414 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191333+0000", 2024-09-12T16:18:37.414 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0591999999999999e-05 2024-09-12T16:18:37.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.414 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.414 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:37.414 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.197573+0000", 2024-09-12T16:18:37.414 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0062397579999999998 2024-09-12T16:18:37.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.414 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.414 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:37.414 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.197609+0000", 2024-09-12T16:18:37.414 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6193999999999999e-05 2024-09-12T16:18:37.414 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.415 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:37.415 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.415 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.415 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4437.0:30787 3.16 e149/137 3:6afd6e65:::rbd_header.1155525b14e3:head v 149'1535, mlcod=148'1533)", 2024-09-12T16:18:37.415 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.191485+0000", 2024-09-12T16:18:37.415 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.18345373400000001, 2024-09-12T16:18:37.415 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004520774, 2024-09-12T16:18:37.415 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:37.415 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:37.416 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:37.416 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:37.416 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.416 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:37.416 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191485+0000", 2024-09-12T16:18:37.416 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.416 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.416 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.416 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:37.416 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191485+0000", 2024-09-12T16:18:37.416 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.416 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.416 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.417 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:37.417 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191486+0000", 2024-09-12T16:18:37.417 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1500000000000003e-07 2024-09-12T16:18:37.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.417 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.417 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:37.417 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191492+0000", 2024-09-12T16:18:37.417 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9660000000000001e-06 2024-09-12T16:18:37.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.417 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.417 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:37.417 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191500+0000", 2024-09-12T16:18:37.418 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1270000000000003e-06 2024-09-12T16:18:37.418 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.418 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.418 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.418 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191507+0000", 2024-09-12T16:18:37.418 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1609999999999997e-06 2024-09-12T16:18:37.418 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.419 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.419 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:37.419 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191582+0000", 2024-09-12T16:18:37.419 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5568999999999994e-05 2024-09-12T16:18:37.419 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.419 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.419 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:37.419 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191622+0000", 2024-09-12T16:18:37.419 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9288000000000001e-05 2024-09-12T16:18:37.419 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.419 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.420 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:37.420 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195973+0000", 2024-09-12T16:18:37.420 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0043517410000000001 2024-09-12T16:18:37.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.420 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.420 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:37.420 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.196006+0000", 2024-09-12T16:18:37.420 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2107000000000003e-05 2024-09-12T16:18:37.420 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.420 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:37.420 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.421 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.421 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.0.0:4264 3.c e149/137 3:341d16c5:::rbd_data.1155525b14e3.0000000000000042:f v 149'428, mlcod=147'424)", 2024-09-12T16:18:37.421 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.191925+0000", 2024-09-12T16:18:37.421 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.183013341, 2024-09-12T16:18:37.421 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0065976330000000003, 2024-09-12T16:18:37.421 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:37.421 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:37.421 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:37.421 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:37.421 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.421 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:37.421 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191925+0000", 2024-09-12T16:18:37.421 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.422 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.422 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:37.422 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191925+0000", 2024-09-12T16:18:37.422 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.422 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.422 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:37.422 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191926+0000", 2024-09-12T16:18:37.422 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0699999999999996e-07 2024-09-12T16:18:37.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.422 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.422 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:37.422 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191931+0000", 2024-09-12T16:18:37.423 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4589999999999997e-06 2024-09-12T16:18:37.423 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.423 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.423 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:37.423 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191941+0000", 2024-09-12T16:18:37.423 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.302e-06 2024-09-12T16:18:37.423 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.423 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.423 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.423 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191962+0000", 2024-09-12T16:18:37.423 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1126999999999999e-05 2024-09-12T16:18:37.423 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.424 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.424 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:37.424 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.193331+0000", 2024-09-12T16:18:37.424 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0013695599999999999 2024-09-12T16:18:37.424 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.424 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.424 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:37.424 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.193351+0000", 2024-09-12T16:18:37.424 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9344e-05 2024-09-12T16:18:37.424 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.424 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.424 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:37.424 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.198486+0000", 2024-09-12T16:18:37.425 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0051356630000000004 2024-09-12T16:18:37.425 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.425 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.425 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:37.425 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.198523+0000", 2024-09-12T16:18:37.425 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6270999999999999e-05 2024-09-12T16:18:37.425 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.425 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:37.425 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.425 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.425 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.425 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.4.0:5452 3.1d e149/137 3:b81abef1:::rbd_data.1155525b14e3.0000000000000032:f v 149'1487, mlcod=147'1484)", 2024-09-12T16:18:37.425 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.192040+0000", 2024-09-12T16:18:37.425 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.18289844799999999, 2024-09-12T16:18:37.426 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0063393620000000003, 2024-09-12T16:18:37.426 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:37.426 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:37.426 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:37.426 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:37.426 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.426 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:37.426 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192040+0000", 2024-09-12T16:18:37.426 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.426 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.426 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.426 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:37.426 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192040+0000", 2024-09-12T16:18:37.426 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.427 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.427 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.427 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:37.427 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192040+0000", 2024-09-12T16:18:37.427 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1199999999999998e-07 2024-09-12T16:18:37.427 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.427 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.427 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:37.427 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192044+0000", 2024-09-12T16:18:37.427 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0110000000000002e-06 2024-09-12T16:18:37.427 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.427 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.427 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:37.427 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192051+0000", 2024-09-12T16:18:37.427 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0380000000000002e-06 2024-09-12T16:18:37.428 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.428 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.428 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.428 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192057+0000", 2024-09-12T16:18:37.428 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9220000000000002e-06 2024-09-12T16:18:37.428 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.428 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.428 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:37.428 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192182+0000", 2024-09-12T16:18:37.428 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000125012 2024-09-12T16:18:37.428 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.429 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.429 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:37.429 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192199+0000", 2024-09-12T16:18:37.429 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6642000000000001e-05 2024-09-12T16:18:37.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.429 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.429 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:37.429 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.198340+0000", 2024-09-12T16:18:37.429 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0061410099999999997 2024-09-12T16:18:37.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.429 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.429 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:37.430 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.198379+0000", 2024-09-12T16:18:37.430 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9314999999999999e-05 2024-09-12T16:18:37.430 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.430 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:37.430 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.430 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.430 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.430 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.1.0:3298 3.2 e149/136 3:40dbe95a:::rbd_data.1155525b14e3.000000000000007c:f v 149'547, mlcod=147'544)", 2024-09-12T16:18:37.430 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.192706+0000", 2024-09-12T16:18:37.430 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.18223231200000001, 2024-09-12T16:18:37.430 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0058280850000000002, 2024-09-12T16:18:37.430 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:37.430 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:37.431 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:37.431 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:37.431 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.431 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:37.431 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192706+0000", 2024-09-12T16:18:37.431 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.431 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.431 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.431 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:37.432 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192706+0000", 2024-09-12T16:18:37.432 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.432 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.432 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.432 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:37.432 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192707+0000", 2024-09-12T16:18:37.432 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6100000000000002e-07 2024-09-12T16:18:37.432 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.432 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.432 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:37.432 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192711+0000", 2024-09-12T16:18:37.432 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6079999999999998e-06 2024-09-12T16:18:37.433 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.433 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.433 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:37.433 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192733+0000", 2024-09-12T16:18:37.433 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1923e-05 2024-09-12T16:18:37.433 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.433 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.433 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.433 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192741+0000", 2024-09-12T16:18:37.433 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5390000000000002e-06 2024-09-12T16:18:37.433 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.433 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.434 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:37.434 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.193578+0000", 2024-09-12T16:18:37.434 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00083768500000000001 2024-09-12T16:18:37.434 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.434 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.434 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:37.434 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.193595+0000", 2024-09-12T16:18:37.434 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7119999999999999e-05 2024-09-12T16:18:37.434 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.434 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.434 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:37.434 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.198493+0000", 2024-09-12T16:18:37.434 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0048975080000000001 2024-09-12T16:18:37.435 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.435 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.435 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:37.435 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.198534+0000", 2024-09-12T16:18:37.435 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1341000000000003e-05 2024-09-12T16:18:37.435 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.435 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:37.435 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.435 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.435 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.435 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.0.0:4266 3.c e149/137 3:360c2ef2:::rbd_data.1155525b14e3.0000000000000016:f v 149'430, mlcod=147'424)", 2024-09-12T16:18:37.435 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.192781+0000", 2024-09-12T16:18:37.435 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.18215793999999999, 2024-09-12T16:18:37.435 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.007657779, 2024-09-12T16:18:37.436 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:37.436 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:37.436 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:37.436 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:37.436 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.436 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:37.436 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192781+0000", 2024-09-12T16:18:37.436 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.436 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.436 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.436 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:37.436 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192781+0000", 2024-09-12T16:18:37.436 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.437 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.437 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.437 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:37.437 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192781+0000", 2024-09-12T16:18:37.437 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3e-07 2024-09-12T16:18:37.437 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.437 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.437 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:37.437 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192791+0000", 2024-09-12T16:18:37.437 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5089999999999999e-06 2024-09-12T16:18:37.437 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.437 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.437 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:37.438 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192802+0000", 2024-09-12T16:18:37.438 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0920999999999999e-05 2024-09-12T16:18:37.438 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.438 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.438 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.438 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192808+0000", 2024-09-12T16:18:37.438 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1070000000000001e-06 2024-09-12T16:18:37.438 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.438 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.438 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:37.438 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195891+0000", 2024-09-12T16:18:37.438 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003083531 2024-09-12T16:18:37.438 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.438 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.439 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:37.439 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195907+0000", 2024-09-12T16:18:37.439 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5336e-05 2024-09-12T16:18:37.439 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.439 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.439 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:37.439 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.200415+0000", 2024-09-12T16:18:37.439 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0045088319999999999 2024-09-12T16:18:37.439 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.439 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.439 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:37.439 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.200438+0000", 2024-09-12T16:18:37.440 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2912999999999999e-05 2024-09-12T16:18:37.440 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.440 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:37.440 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.440 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.440 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.440 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.0.0:4267 3.10 e149/136 3:0b8b145b:::rbd_data.1155525b14e3.000000000000005e:f v 149'606, mlcod=147'600)", 2024-09-12T16:18:37.440 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.192819+0000", 2024-09-12T16:18:37.440 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.18211925100000001, 2024-09-12T16:18:37.440 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0043054909999999998, 2024-09-12T16:18:37.440 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:37.441 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:37.441 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:37.441 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:37.441 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.441 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:37.441 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192819+0000", 2024-09-12T16:18:37.441 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.441 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.441 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.441 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:37.441 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192819+0000", 2024-09-12T16:18:37.441 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.442 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.442 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.442 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:37.442 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192819+0000", 2024-09-12T16:18:37.442 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4600000000000001e-07 2024-09-12T16:18:37.442 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.442 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.442 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:37.442 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192827+0000", 2024-09-12T16:18:37.442 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9030000000000004e-06 2024-09-12T16:18:37.442 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.442 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.442 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:37.442 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192834+0000", 2024-09-12T16:18:37.443 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4810000000000003e-06 2024-09-12T16:18:37.443 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.443 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.443 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.443 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192839+0000", 2024-09-12T16:18:37.443 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8790000000000002e-06 2024-09-12T16:18:37.443 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.443 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.443 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:37.444 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.193371+0000", 2024-09-12T16:18:37.444 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00053213999999999996 2024-09-12T16:18:37.444 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.444 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.444 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:37.444 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.193388+0000", 2024-09-12T16:18:37.444 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7407000000000001e-05 2024-09-12T16:18:37.444 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.444 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.444 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:37.444 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.197081+0000", 2024-09-12T16:18:37.444 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003692608 2024-09-12T16:18:37.445 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.445 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.445 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:37.445 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.197125+0000", 2024-09-12T16:18:37.445 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3826999999999999e-05 2024-09-12T16:18:37.445 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.445 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:37.445 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.445 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.445 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.445 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.1.0:3300 3.2 e149/136 3:46a84092:::rbd_data.1155525b14e3.000000000000006d:f v 149'549, mlcod=147'544)", 2024-09-12T16:18:37.445 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.193554+0000", 2024-09-12T16:18:37.445 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.18138399099999999, 2024-09-12T16:18:37.446 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.006035749, 2024-09-12T16:18:37.446 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:37.446 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:37.446 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:37.446 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:37.446 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.446 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:37.446 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.193554+0000", 2024-09-12T16:18:37.446 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.446 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.446 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.446 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:37.446 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.193554+0000", 2024-09-12T16:18:37.446 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.447 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.447 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.447 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:37.447 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.193555+0000", 2024-09-12T16:18:37.447 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3399999999999999e-07 2024-09-12T16:18:37.447 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.447 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.447 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:37.447 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.193560+0000", 2024-09-12T16:18:37.447 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1889999999999998e-06 2024-09-12T16:18:37.447 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.447 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.447 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:37.447 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.193572+0000", 2024-09-12T16:18:37.448 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1653e-05 2024-09-12T16:18:37.448 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.448 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.448 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.448 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.193578+0000", 2024-09-12T16:18:37.448 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3759999999999996e-06 2024-09-12T16:18:37.448 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.448 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.448 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:37.448 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.197103+0000", 2024-09-12T16:18:37.448 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0035248889999999998 2024-09-12T16:18:37.448 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.449 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.449 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:37.449 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.197122+0000", 2024-09-12T16:18:37.449 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9272000000000001e-05 2024-09-12T16:18:37.449 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.449 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.449 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:37.449 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.199555+0000", 2024-09-12T16:18:37.449 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0024325710000000001 2024-09-12T16:18:37.449 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.449 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.449 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:37.449 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.199590+0000", 2024-09-12T16:18:37.449 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5265000000000002e-05 2024-09-12T16:18:37.450 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.450 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:37.450 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.450 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.450 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.450 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.4.0:5453 3.1c e149/136 3:3ea3e34f:::rbd_data.1155525b14e3.0000000000000029:f v 149'833, mlcod=148'828)", 2024-09-12T16:18:37.450 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.194348+0000", 2024-09-12T16:18:37.450 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.18059051300000001, 2024-09-12T16:18:37.450 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0060649639999999999, 2024-09-12T16:18:37.450 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:37.450 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:37.450 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:37.450 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:37.451 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.451 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:37.451 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194348+0000", 2024-09-12T16:18:37.451 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.451 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.451 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.451 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:37.451 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194348+0000", 2024-09-12T16:18:37.451 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.452 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.452 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.452 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:37.452 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194349+0000", 2024-09-12T16:18:37.452 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1999999999999999e-07 2024-09-12T16:18:37.452 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.452 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.452 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:37.452 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194354+0000", 2024-09-12T16:18:37.452 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5790000000000003e-06 2024-09-12T16:18:37.452 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.452 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.452 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:37.452 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194367+0000", 2024-09-12T16:18:37.453 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3191e-05 2024-09-12T16:18:37.453 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.453 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.453 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.453 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194374+0000", 2024-09-12T16:18:37.453 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6490000000000002e-06 2024-09-12T16:18:37.453 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.453 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.453 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:37.453 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195828+0000", 2024-09-12T16:18:37.454 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001454131 2024-09-12T16:18:37.454 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.454 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.454 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:37.454 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195846+0000", 2024-09-12T16:18:37.454 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7978999999999998e-05 2024-09-12T16:18:37.454 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.454 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.454 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:37.454 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.200370+0000", 2024-09-12T16:18:37.454 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0045236060000000003 2024-09-12T16:18:37.454 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.454 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.454 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:37.455 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.200413+0000", 2024-09-12T16:18:37.455 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3108999999999997e-05 2024-09-12T16:18:37.455 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.455 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:37.455 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.455 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.455 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.455 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.4.0:5454 3.1d e149/137 3:be124de3:::rbd_data.1155525b14e3.0000000000000015:f v 149'1489, mlcod=147'1484)", 2024-09-12T16:18:37.455 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.194388+0000", 2024-09-12T16:18:37.455 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.180550498, 2024-09-12T16:18:37.455 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0045598710000000001, 2024-09-12T16:18:37.455 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:37.455 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:37.456 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:37.456 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:37.456 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.456 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:37.456 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194388+0000", 2024-09-12T16:18:37.456 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.456 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.456 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.456 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:37.456 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194388+0000", 2024-09-12T16:18:37.456 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.456 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.456 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.457 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:37.457 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194388+0000", 2024-09-12T16:18:37.457 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8299999999999998e-07 2024-09-12T16:18:37.457 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.457 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.457 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:37.457 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194396+0000", 2024-09-12T16:18:37.457 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.418e-06 2024-09-12T16:18:37.457 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.457 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.457 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:37.457 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194404+0000", 2024-09-12T16:18:37.457 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0490000000000004e-06 2024-09-12T16:18:37.458 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.458 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.458 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.458 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194409+0000", 2024-09-12T16:18:37.458 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1420000000000001e-06 2024-09-12T16:18:37.458 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.458 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.458 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:37.458 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194472+0000", 2024-09-12T16:18:37.458 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3058999999999994e-05 2024-09-12T16:18:37.458 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.458 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.459 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:37.459 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194484+0000", 2024-09-12T16:18:37.459 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.223e-05 2024-09-12T16:18:37.459 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.459 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.459 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:37.459 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.198908+0000", 2024-09-12T16:18:37.459 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0044234809999999999 2024-09-12T16:18:37.459 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.459 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.459 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:37.459 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.198948+0000", 2024-09-12T16:18:37.459 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0209000000000001e-05 2024-09-12T16:18:37.460 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.460 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:37.460 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.460 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.460 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.460 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.2.0:2914 3.5 e149/136 3:a003977d:::rbd_data.1155525b14e3.000000000000007b:f v 149'781, mlcod=147'777)", 2024-09-12T16:18:37.460 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.195113+0000", 2024-09-12T16:18:37.460 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.17982564600000001, 2024-09-12T16:18:37.460 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0044523849999999997, 2024-09-12T16:18:37.460 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:37.460 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:37.461 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:37.461 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:37.461 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.461 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:37.461 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195113+0000", 2024-09-12T16:18:37.461 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.461 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.461 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.461 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:37.461 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195113+0000", 2024-09-12T16:18:37.461 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.461 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.462 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.462 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:37.462 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195113+0000", 2024-09-12T16:18:37.462 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0800000000000005e-07 2024-09-12T16:18:37.462 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.462 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.463 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:37.463 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195118+0000", 2024-09-12T16:18:37.463 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7160000000000002e-06 2024-09-12T16:18:37.463 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.463 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.464 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:37.464 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195126+0000", 2024-09-12T16:18:37.464 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4430000000000003e-06 2024-09-12T16:18:37.464 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.464 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.464 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.464 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195132+0000", 2024-09-12T16:18:37.464 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6890000000000001e-06 2024-09-12T16:18:37.464 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.464 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.465 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:37.465 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195181+0000", 2024-09-12T16:18:37.465 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8922999999999999e-05 2024-09-12T16:18:37.465 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.465 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.465 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:37.465 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195207+0000", 2024-09-12T16:18:37.466 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5454999999999999e-05 2024-09-12T16:18:37.466 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.466 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.466 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:37.466 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.199522+0000", 2024-09-12T16:18:37.466 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004315864 2024-09-12T16:18:37.466 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.466 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.466 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:37.466 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.199565+0000", 2024-09-12T16:18:37.466 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2787000000000002e-05 2024-09-12T16:18:37.466 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.466 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:37.467 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.467 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.467 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.467 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.2.0:2915 3.5 e149/136 3:a0ca3b20:::rbd_data.1155525b14e3.0000000000000041:f v 149'783, mlcod=147'777)", 2024-09-12T16:18:37.467 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.195812+0000", 2024-09-12T16:18:37.467 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.179126176, 2024-09-12T16:18:37.467 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0043974340000000004, 2024-09-12T16:18:37.467 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:37.467 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:37.467 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:37.467 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:37.467 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.467 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:37.468 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195812+0000", 2024-09-12T16:18:37.468 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.468 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.468 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.468 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:37.468 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195812+0000", 2024-09-12T16:18:37.468 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.468 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.468 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.468 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:37.468 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195813+0000", 2024-09-12T16:18:37.468 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1900000000000001e-07 2024-09-12T16:18:37.468 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.468 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.469 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:37.469 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195819+0000", 2024-09-12T16:18:37.469 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3839999999999996e-06 2024-09-12T16:18:37.469 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.469 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.469 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:37.469 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195828+0000", 2024-09-12T16:18:37.469 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1579999999999994e-06 2024-09-12T16:18:37.469 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.469 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.469 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.469 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195835+0000", 2024-09-12T16:18:37.469 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8040000000000004e-06 2024-09-12T16:18:37.469 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.469 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.470 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:37.470 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.198407+0000", 2024-09-12T16:18:37.470 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025724659999999998 2024-09-12T16:18:37.470 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.470 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.470 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:37.470 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.198425+0000", 2024-09-12T16:18:37.470 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8136999999999999e-05 2024-09-12T16:18:37.470 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.470 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.470 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:37.470 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.200173+0000", 2024-09-12T16:18:37.470 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017473949999999999 2024-09-12T16:18:37.470 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.471 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.471 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:37.471 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.200210+0000", 2024-09-12T16:18:37.471 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7171e-05 2024-09-12T16:18:37.471 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.471 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:37.471 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.471 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.471 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.471 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.3.0:6023 3.16 e149/137 3:68db2424:::rbd_data.1155525b14e3.000000000000002a:f v 149'1538, mlcod=148'1534)", 2024-09-12T16:18:37.471 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.201343+0000", 2024-09-12T16:18:37.471 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.173595166, 2024-09-12T16:18:37.471 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0049766510000000003, 2024-09-12T16:18:37.472 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:37.472 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:37.472 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:37.472 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:37.472 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.472 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:37.472 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.201343+0000", 2024-09-12T16:18:37.472 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.472 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.472 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.472 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:37.472 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.201343+0000", 2024-09-12T16:18:37.472 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:37.472 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.473 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.473 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:37.473 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.201344+0000", 2024-09-12T16:18:37.473 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6300000000000005e-07 2024-09-12T16:18:37.473 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.473 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.473 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:37.473 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.201367+0000", 2024-09-12T16:18:37.473 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2534000000000001e-05 2024-09-12T16:18:37.473 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.473 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.473 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:37.473 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.201375+0000", 2024-09-12T16:18:37.473 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9199999999999993e-06 2024-09-12T16:18:37.474 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.474 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.474 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.474 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.201383+0000", 2024-09-12T16:18:37.474 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6389999999999992e-06 2024-09-12T16:18:37.474 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.474 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.474 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:37.474 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.201439+0000", 2024-09-12T16:18:37.474 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5673e-05 2024-09-12T16:18:37.474 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.474 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.474 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:37.475 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.201457+0000", 2024-09-12T16:18:37.475 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8623000000000001e-05 2024-09-12T16:18:37.475 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.475 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.475 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:37.475 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.206280+0000", 2024-09-12T16:18:37.475 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0048226279999999998 2024-09-12T16:18:37.475 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:37.475 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:37.475 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:37.475 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.206320+0000", 2024-09-12T16:18:37.475 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9971000000000001e-05 2024-09-12T16:18:37.475 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.475 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:37.476 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.476 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:37.476 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:37.476 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:37.477 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:37.477+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:37.478 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:18:37.578 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:37.578+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:37.585 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:37.585 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:37.585 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:18:37.585 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:37.594 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:18:37.679 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:37.679+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:37.701 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:37.701 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:37.701 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:18:37.701 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:18:37.701 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:37.710 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:18:37.780 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:37.780+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:37.818 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:37.818 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:18:37.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:18:37.818 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:18:37.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.818 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3705 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14812160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:37.818 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:18:37.818 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 139.67659942200001, 2024-09-12T16:18:37.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053368831999999998, 2024-09-12T16:18:37.818 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:37.818 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:37.819 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:37.819 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:37.819 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:37.819 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:37.819 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3705 2024-09-12T16:18:37.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.819 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:37.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:37.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:18:37.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:37.820 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:18:37.820 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.820 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:37.820 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139932+0000", 2024-09-12T16:18:37.820 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012762099999999999 2024-09-12T16:18:37.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.820 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:37.820 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139935+0000", 2024-09-12T16:18:37.820 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.119e-06 2024-09-12T16:18:37.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.821 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:37.821 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139939+0000", 2024-09-12T16:18:37.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7999999999999998e-06 2024-09-12T16:18:37.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.821 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.821 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139953+0000", 2024-09-12T16:18:37.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3923999999999999e-05 2024-09-12T16:18:37.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.821 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:37.821 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192946+0000", 2024-09-12T16:18:37.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052992971 2024-09-12T16:18:37.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.822 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:37.822 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193035+0000", 2024-09-12T16:18:37.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9040000000000001e-05 2024-09-12T16:18:37.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.822 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:37.822 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193174+0000", 2024-09-12T16:18:37.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138357 2024-09-12T16:18:37.822 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.822 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:37.822 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.823 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.823 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3706 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14816256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:37.823 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:18:37.823 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 139.67644443200001, 2024-09-12T16:18:37.823 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053341723000000001, 2024-09-12T16:18:37.823 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:37.823 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:37.823 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:37.823 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:37.823 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:37.823 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:37.823 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3706 2024-09-12T16:18:37.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.824 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:37.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.824 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:37.824 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:18:37.824 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.824 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:37.824 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:18:37.824 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.824 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:37.825 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140090+0000", 2024-09-12T16:18:37.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013020100000000001 2024-09-12T16:18:37.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.825 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:37.825 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140097+0000", 2024-09-12T16:18:37.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0709999999999997e-06 2024-09-12T16:18:37.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.825 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:37.825 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140103+0000", 2024-09-12T16:18:37.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5450000000000003e-06 2024-09-12T16:18:37.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140106+0000", 2024-09-12T16:18:37.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3739999999999998e-06 2024-09-12T16:18:37.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:37.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193190+0000", 2024-09-12T16:18:37.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053084131999999999 2024-09-12T16:18:37.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:37.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193232+0000", 2024-09-12T16:18:37.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1517000000000002e-05 2024-09-12T16:18:37.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:37.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193302+0000", 2024-09-12T16:18:37.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9882999999999995e-05 2024-09-12T16:18:37.827 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.827 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:37.827 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.827 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3707 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14820352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:37.827 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:18:37.828 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 139.67629244299999, 2024-09-12T16:18:37.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053452771000000003, 2024-09-12T16:18:37.828 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:37.828 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:37.828 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:37.828 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:37.828 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:37.828 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:37.828 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3707 2024-09-12T16:18:37.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.828 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:37.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:37.829 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:18:37.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.829 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:37.829 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:18:37.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.829 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:37.829 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140219+0000", 2024-09-12T16:18:37.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106902 2024-09-12T16:18:37.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.830 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:37.830 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140225+0000", 2024-09-12T16:18:37.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3199999999999996e-06 2024-09-12T16:18:37.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.830 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:37.830 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140230+0000", 2024-09-12T16:18:37.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8969999999999999e-06 2024-09-12T16:18:37.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.830 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.830 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140233+0000", 2024-09-12T16:18:37.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2119999999999999e-06 2024-09-12T16:18:37.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:37.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193339+0000", 2024-09-12T16:18:37.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053105556999999998 2024-09-12T16:18:37.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:37.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193431+0000", 2024-09-12T16:18:37.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1837999999999997e-05 2024-09-12T16:18:37.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:37.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193565+0000", 2024-09-12T16:18:37.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013404500000000001 2024-09-12T16:18:37.831 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.832 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:37.832 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.832 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3708 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14824448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:37.832 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:18:37.832 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 139.67616360100001, 2024-09-12T16:18:37.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053468190999999998, 2024-09-12T16:18:37.832 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:37.832 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:37.832 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:37.832 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:37.832 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:37.833 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:37.833 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3708 2024-09-12T16:18:37.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.833 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:37.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:37.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:18:37.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:37.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:18:37.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:37.834 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140351+0000", 2024-09-12T16:18:37.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110096 2024-09-12T16:18:37.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:37.834 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140358+0000", 2024-09-12T16:18:37.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.306e-06 2024-09-12T16:18:37.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:37.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140368+0000", 2024-09-12T16:18:37.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0225e-05 2024-09-12T16:18:37.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140372+0000", 2024-09-12T16:18:37.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6169999999999998e-06 2024-09-12T16:18:37.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:37.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193594+0000", 2024-09-12T16:18:37.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053222419999999999 2024-09-12T16:18:37.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:37.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193640+0000", 2024-09-12T16:18:37.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.587e-05 2024-09-12T16:18:37.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:37.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193709+0000", 2024-09-12T16:18:37.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8657000000000004e-05 2024-09-12T16:18:37.836 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.837 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:37.837 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.837 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3709 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14828544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:37.837 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:18:37.837 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 139.67602663299999, 2024-09-12T16:18:37.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594033999999999, 2024-09-12T16:18:37.837 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:37.837 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:37.837 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:37.837 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:37.837 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:37.838 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:37.838 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3709 2024-09-12T16:18:37.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.838 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:37.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:37.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:18:37.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:37.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:18:37.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:37.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140499+0000", 2024-09-12T16:18:37.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121019 2024-09-12T16:18:37.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:37.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140501+0000", 2024-09-12T16:18:37.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2369999999999999e-06 2024-09-12T16:18:37.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:37.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140506+0000", 2024-09-12T16:18:37.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.639e-06 2024-09-12T16:18:37.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140509+0000", 2024-09-12T16:18:37.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3419999999999999e-06 2024-09-12T16:18:37.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:37.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193743+0000", 2024-09-12T16:18:37.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053234311999999999 2024-09-12T16:18:37.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:37.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193833+0000", 2024-09-12T16:18:37.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9883999999999995e-05 2024-09-12T16:18:37.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:37.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193972+0000", 2024-09-12T16:18:37.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138601 2024-09-12T16:18:37.841 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.841 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:37.841 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.841 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3710 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14832640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:37.841 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:18:37.842 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 139.67588928699999, 2024-09-12T16:18:37.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053607324999999997, 2024-09-12T16:18:37.842 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:37.842 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:37.842 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:37.842 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:37.842 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:37.842 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:37.842 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3710 2024-09-12T16:18:37.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.842 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:37.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:37.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:18:37.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:37.843 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:18:37.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:37.843 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140664+0000", 2024-09-12T16:18:37.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014918700000000001 2024-09-12T16:18:37.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:37.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140674+0000", 2024-09-12T16:18:37.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8379999999999997e-06 2024-09-12T16:18:37.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:37.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140694+0000", 2024-09-12T16:18:37.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0145000000000001e-05 2024-09-12T16:18:37.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140703+0000", 2024-09-12T16:18:37.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5150000000000006e-06 2024-09-12T16:18:37.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:37.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194006+0000", 2024-09-12T16:18:37.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053303370000000003 2024-09-12T16:18:37.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:37.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194051+0000", 2024-09-12T16:18:37.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5012000000000002e-05 2024-09-12T16:18:37.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:37.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194122+0000", 2024-09-12T16:18:37.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1258000000000001e-05 2024-09-12T16:18:37.845 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.846 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:37.846 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.846 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3711 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14836736~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:37.846 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:18:37.846 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 139.67568783900001, 2024-09-12T16:18:37.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053670799999999998, 2024-09-12T16:18:37.846 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:37.846 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:37.846 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:37.846 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:37.847 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:37.847 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:37.847 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3711 2024-09-12T16:18:37.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.847 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:37.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:37.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:18:37.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:37.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:18:37.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:37.848 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140782+0000", 2024-09-12T16:18:37.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5549999999999994e-05 2024-09-12T16:18:37.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:37.848 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140786+0000", 2024-09-12T16:18:37.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.89e-06 2024-09-12T16:18:37.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:37.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140796+0000", 2024-09-12T16:18:37.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0057e-05 2024-09-12T16:18:37.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140819+0000", 2024-09-12T16:18:37.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3005000000000001e-05 2024-09-12T16:18:37.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:37.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194159+0000", 2024-09-12T16:18:37.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053340324000000001 2024-09-12T16:18:37.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:37.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194248+0000", 2024-09-12T16:18:37.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9209000000000006e-05 2024-09-12T16:18:37.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:37.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194387+0000", 2024-09-12T16:18:37.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138765 2024-09-12T16:18:37.850 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.850 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:37.850 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.850 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3712 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14840832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:37.850 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:18:37.851 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 139.67557338099999, 2024-09-12T16:18:37.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053699068000000003, 2024-09-12T16:18:37.851 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:37.851 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:37.851 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:37.851 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:37.851 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:37.851 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:37.851 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3712 2024-09-12T16:18:37.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.851 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:37.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:37.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:18:37.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:37.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:18:37.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:37.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140900+0000", 2024-09-12T16:18:37.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9014e-05 2024-09-12T16:18:37.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:37.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140904+0000", 2024-09-12T16:18:37.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0940000000000001e-06 2024-09-12T16:18:37.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:37.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140933+0000", 2024-09-12T16:18:37.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8996000000000002e-05 2024-09-12T16:18:37.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140945+0000", 2024-09-12T16:18:37.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1909000000000001e-05 2024-09-12T16:18:37.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:37.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194415+0000", 2024-09-12T16:18:37.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053470403 2024-09-12T16:18:37.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:37.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194460+0000", 2024-09-12T16:18:37.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5145000000000002e-05 2024-09-12T16:18:37.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.855 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:37.855 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194530+0000", 2024-09-12T16:18:37.855 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9506999999999997e-05 2024-09-12T16:18:37.855 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.855 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:37.855 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.855 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3713 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14844928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:37.855 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:18:37.855 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 139.675440321, 2024-09-12T16:18:37.855 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053821236000000001, 2024-09-12T16:18:37.855 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:37.855 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:37.856 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:37.856 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:37.856 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:37.856 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:37.856 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3713 2024-09-12T16:18:37.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.856 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:37.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.856 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:37.856 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:18:37.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:37.857 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:18:37.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:37.857 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141078+0000", 2024-09-12T16:18:37.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114162 2024-09-12T16:18:37.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:37.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141090+0000", 2024-09-12T16:18:37.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.19e-05 2024-09-12T16:18:37.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:37.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141100+0000", 2024-09-12T16:18:37.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0447e-05 2024-09-12T16:18:37.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141108+0000", 2024-09-12T16:18:37.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7190000000000001e-06 2024-09-12T16:18:37.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:37.859 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194564+0000", 2024-09-12T16:18:37.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053455729 2024-09-12T16:18:37.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:37.859 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194652+0000", 2024-09-12T16:18:37.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8288999999999994e-05 2024-09-12T16:18:37.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:37.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194785+0000", 2024-09-12T16:18:37.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013299000000000001 2024-09-12T16:18:37.860 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.860 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:37.860 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.860 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3714 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14849024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:37.860 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:18:37.860 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 139.67528439200001, 2024-09-12T16:18:37.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053816382000000003, 2024-09-12T16:18:37.860 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:37.860 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:37.861 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:37.861 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:37.861 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:37.861 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:37.861 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3714 2024-09-12T16:18:37.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.861 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:37.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.861 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:37.861 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:18:37.861 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.861 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:37.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:18:37.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:37.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141182+0000", 2024-09-12T16:18:37.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1805999999999997e-05 2024-09-12T16:18:37.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:37.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141185+0000", 2024-09-12T16:18:37.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5930000000000002e-06 2024-09-12T16:18:37.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:37.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141194+0000", 2024-09-12T16:18:37.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5760000000000006e-06 2024-09-12T16:18:37.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141222+0000", 2024-09-12T16:18:37.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8034999999999998e-05 2024-09-12T16:18:37.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:37.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194817+0000", 2024-09-12T16:18:37.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594887000000001 2024-09-12T16:18:37.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.864 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:37.864 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194860+0000", 2024-09-12T16:18:37.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3714999999999997e-05 2024-09-12T16:18:37.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.864 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:37.864 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194936+0000", 2024-09-12T16:18:37.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5770000000000001e-05 2024-09-12T16:18:37.864 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.864 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:37.864 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.865 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3715 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14853120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:37.865 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:18:37.865 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 139.67516073499999, 2024-09-12T16:18:37.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053962307000000001, 2024-09-12T16:18:37.865 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:37.865 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:37.865 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:37.865 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:37.865 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:37.865 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:37.865 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3715 2024-09-12T16:18:37.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.866 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:37.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:37.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:18:37.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:37.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:18:37.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:37.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141417+0000", 2024-09-12T16:18:37.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017384099999999999 2024-09-12T16:18:37.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:37.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141422+0000", 2024-09-12T16:18:37.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7310000000000001e-06 2024-09-12T16:18:37.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:37.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141434+0000", 2024-09-12T16:18:37.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2058e-05 2024-09-12T16:18:37.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.868 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141442+0000", 2024-09-12T16:18:37.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7610000000000007e-06 2024-09-12T16:18:37.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.868 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:37.868 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194973+0000", 2024-09-12T16:18:37.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053530618000000002 2024-09-12T16:18:37.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.868 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:37.868 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195063+0000", 2024-09-12T16:18:37.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0927000000000005e-05 2024-09-12T16:18:37.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.869 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:37.869 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195206+0000", 2024-09-12T16:18:37.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142371 2024-09-12T16:18:37.869 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.869 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:37.869 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.869 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3716 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14857216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:37.869 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:18:37.869 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 139.67495088499999, 2024-09-12T16:18:37.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053916360000000003, 2024-09-12T16:18:37.869 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:37.870 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:37.870 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:37.870 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:37.870 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:37.870 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:37.870 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3716 2024-09-12T16:18:37.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.870 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:37.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:37.870 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:18:37.870 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:37.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:18:37.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:37.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142933+0000", 2024-09-12T16:18:37.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014796290000000001 2024-09-12T16:18:37.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:37.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142937+0000", 2024-09-12T16:18:37.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5760000000000002e-06 2024-09-12T16:18:37.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:37.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142946+0000", 2024-09-12T16:18:37.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0380000000000005e-06 2024-09-12T16:18:37.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142951+0000", 2024-09-12T16:18:37.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9749999999999998e-06 2024-09-12T16:18:37.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:37.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195246+0000", 2024-09-12T16:18:37.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052295358 2024-09-12T16:18:37.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:37.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195299+0000", 2024-09-12T16:18:37.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2976999999999998e-05 2024-09-12T16:18:37.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:37.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195370+0000", 2024-09-12T16:18:37.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0807000000000002e-05 2024-09-12T16:18:37.873 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.873 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:37.873 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.874 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3721 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14877696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:37.874 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:18:37.874 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 139.673377434, 2024-09-12T16:18:37.874 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053422994000000001, 2024-09-12T16:18:37.874 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:37.874 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:37.874 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:37.874 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:37.874 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:37.874 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:37.874 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3721 2024-09-12T16:18:37.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.874 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:37.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:37.875 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:18:37.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:37.875 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:18:37.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:37.875 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:18:37.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:18:37.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:37.876 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143028+0000", 2024-09-12T16:18:37.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7399999999999991e-07 2024-09-12T16:18:37.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.876 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:37.876 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143031+0000", 2024-09-12T16:18:37.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7599999999999998e-06 2024-09-12T16:18:37.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.876 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.876 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143034+0000", 2024-09-12T16:18:37.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9780000000000001e-06 2024-09-12T16:18:37.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.877 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:37.877 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196220+0000", 2024-09-12T16:18:37.877 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053186341999999998 2024-09-12T16:18:37.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.877 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:37.877 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196313+0000", 2024-09-12T16:18:37.877 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2676000000000005e-05 2024-09-12T16:18:37.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.877 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:37.877 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196450+0000", 2024-09-12T16:18:37.877 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137052 2024-09-12T16:18:37.878 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.878 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:37.878 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.878 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3722 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14881792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:37.878 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:18:37.878 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 139.67336754199999, 2024-09-12T16:18:37.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053556835999999997, 2024-09-12T16:18:37.878 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:37.878 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:37.878 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:37.878 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:37.879 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:37.879 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:37.879 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3722 2024-09-12T16:18:37.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.879 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:37.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.879 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:37.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:18:37.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:37.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:18:37.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:37.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:18:37.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.11e-07 2024-09-12T16:18:37.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:37.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143038+0000", 2024-09-12T16:18:37.881 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2399999999999996e-07 2024-09-12T16:18:37.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.881 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:37.881 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143041+0000", 2024-09-12T16:18:37.881 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8030000000000001e-06 2024-09-12T16:18:37.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.881 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.881 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143043+0000", 2024-09-12T16:18:37.881 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3140000000000002e-06 2024-09-12T16:18:37.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.881 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:37.882 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196481+0000", 2024-09-12T16:18:37.882 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053437601000000001 2024-09-12T16:18:37.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.882 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:37.882 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196525+0000", 2024-09-12T16:18:37.882 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4280000000000003e-05 2024-09-12T16:18:37.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.882 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:37.882 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196594+0000", 2024-09-12T16:18:37.882 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8702999999999996e-05 2024-09-12T16:18:37.882 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.882 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:37.883 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.883 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3723 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14885888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:37.883 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:18:37.883 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 139.67335836000001, 2024-09-12T16:18:37.883 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053815546999999998, 2024-09-12T16:18:37.883 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:37.883 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:37.883 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:37.883 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:37.883 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:37.883 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:37.884 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3723 2024-09-12T16:18:37.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.884 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:37.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.884 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:37.884 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:18:37.884 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.884 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:37.884 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:18:37.884 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.885 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:37.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148994+0000", 2024-09-12T16:18:37.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059481330000000004 2024-09-12T16:18:37.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.885 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:37.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148999+0000", 2024-09-12T16:18:37.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7140000000000001e-06 2024-09-12T16:18:37.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.885 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:37.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149008+0000", 2024-09-12T16:18:37.886 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4350000000000003e-06 2024-09-12T16:18:37.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.886 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.886 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149021+0000", 2024-09-12T16:18:37.886 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2514000000000001e-05 2024-09-12T16:18:37.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.886 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:37.886 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196630+0000", 2024-09-12T16:18:37.886 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047609758000000002 2024-09-12T16:18:37.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.887 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:37.887 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196724+0000", 2024-09-12T16:18:37.887 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3522000000000003e-05 2024-09-12T16:18:37.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.887 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:37.887 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196861+0000", 2024-09-12T16:18:37.887 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013747100000000001 2024-09-12T16:18:37.887 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.887 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:37.887 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.888 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4438 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15719424~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:37.888 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:18:37.888 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 139.52847758300001, 2024-09-12T16:18:37.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367981000000002, 2024-09-12T16:18:37.888 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:37.888 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:37.888 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:37.888 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:37.888 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:37.888 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:37.888 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4438 2024-09-12T16:18:37.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.888 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:37.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:37.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:18:37.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:37.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:18:37.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:37.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:18:37.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3e-07 2024-09-12T16:18:37.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.890 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:37.890 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287930+0000", 2024-09-12T16:18:37.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-12T16:18:37.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.890 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:37.890 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287937+0000", 2024-09-12T16:18:37.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.08e-06 2024-09-12T16:18:37.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.891 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.891 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287943+0000", 2024-09-12T16:18:37.891 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5709999999999997e-06 2024-09-12T16:18:37.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.891 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:37.891 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341068+0000", 2024-09-12T16:18:37.891 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053125101000000001 2024-09-12T16:18:37.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.891 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:37.891 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341154+0000", 2024-09-12T16:18:37.891 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6100999999999994e-05 2024-09-12T16:18:37.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.892 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:37.892 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341295+0000", 2024-09-12T16:18:37.892 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014087999999999999 2024-09-12T16:18:37.892 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.892 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:37.892 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.892 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4439 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15723520~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:37.892 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:18:37.892 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 139.528453423, 2024-09-12T16:18:37.892 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053526799, 2024-09-12T16:18:37.893 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:37.893 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:37.893 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:37.893 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:37.893 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:37.893 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:37.893 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4439 2024-09-12T16:18:37.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.893 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:37.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.893 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:37.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:18:37.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.894 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:37.894 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:18:37.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.894 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:37.894 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:18:37.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-07 2024-09-12T16:18:37.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.894 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:37.895 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287953+0000", 2024-09-12T16:18:37.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1349999999999999e-06 2024-09-12T16:18:37.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.895 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:37.895 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287960+0000", 2024-09-12T16:18:37.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-12T16:18:37.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.895 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.895 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287965+0000", 2024-09-12T16:18:37.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1580000000000004e-06 2024-09-12T16:18:37.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.896 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:37.896 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341332+0000", 2024-09-12T16:18:37.896 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367009 2024-09-12T16:18:37.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.896 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:37.896 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341402+0000", 2024-09-12T16:18:37.896 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9759999999999996e-05 2024-09-12T16:18:37.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.896 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:37.896 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341478+0000", 2024-09-12T16:18:37.896 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5412000000000002e-05 2024-09-12T16:18:37.897 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.897 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:37.897 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.897 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4440 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15727616~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:37.897 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:18:37.897 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 139.52843231899999, 2024-09-12T16:18:37.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053761601999999999, 2024-09-12T16:18:37.897 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:37.897 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:37.897 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:37.897 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:37.898 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:37.898 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:37.898 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4440 2024-09-12T16:18:37.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.898 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:37.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:37.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:18:37.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:37.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:18:37.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:37.899 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:18:37.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:18:37.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:37.899 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287974+0000", 2024-09-12T16:18:37.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0540000000000002e-06 2024-09-12T16:18:37.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:37.899 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287980+0000", 2024-09-12T16:18:37.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9440000000000002e-06 2024-09-12T16:18:37.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.900 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.900 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287987+0000", 2024-09-12T16:18:37.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5889999999999999e-06 2024-09-12T16:18:37.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.900 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:37.900 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341502+0000", 2024-09-12T16:18:37.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053515199999999999 2024-09-12T16:18:37.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.901 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:37.901 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341595+0000", 2024-09-12T16:18:37.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3097000000000007e-05 2024-09-12T16:18:37.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.901 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:37.901 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341734+0000", 2024-09-12T16:18:37.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013832800000000001 2024-09-12T16:18:37.901 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.901 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:37.901 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.902 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2209 3.1 3:85f36d3b:::rbd_data.1155ccb1894c.0000000000000004:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:18:37.902 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:18:37.902 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 100.444747181, 2024-09-12T16:18:37.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.060659365, 2024-09-12T16:18:37.902 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:37.902 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:37.902 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:37.902 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:37.902 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:18:37.902 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:18:37.902 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2209 2024-09-12T16:18:37.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.902 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:37.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:37.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:18:37.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:37.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:18:37.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:37.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371658+0000", 2024-09-12T16:18:37.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1570000000000001e-06 2024-09-12T16:18:37.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:37.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393414+0000", 2024-09-12T16:18:37.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021755495999999999 2024-09-12T16:18:37.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:37.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393447+0000", 2024-09-12T16:18:37.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3630000000000002e-05 2024-09-12T16:18:37.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.905 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.905 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393462+0000", 2024-09-12T16:18:37.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5048999999999999e-05 2024-09-12T16:18:37.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.905 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:37.905 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393556+0000", 2024-09-12T16:18:37.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3549999999999997e-05 2024-09-12T16:18:37.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.905 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:37.905 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393697+0000", 2024-09-12T16:18:37.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000141414 2024-09-12T16:18:37.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.906 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T16:18:37.906 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.394944+0000", 2024-09-12T16:18:37.906 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012463039999999999 2024-09-12T16:18:37.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.906 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:37.906 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.431803+0000", 2024-09-12T16:18:37.906 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0368594 2024-09-12T16:18:37.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.906 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:18:37.906 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432268+0000", 2024-09-12T16:18:37.906 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046457600000000002 2024-09-12T16:18:37.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:18:37.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432293+0000", 2024-09-12T16:18:37.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.527e-05 2024-09-12T16:18:37.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:37.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432316+0000", 2024-09-12T16:18:37.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3519e-05 2024-09-12T16:18:37.907 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.907 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:37.907 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.908 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:9400 3.1f 3:feea9999:::rbd_data.1155338d0570.0000000000000007:head [read 32768~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-12T16:18:37.908 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:20.012502+0000", 2024-09-12T16:18:37.908 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 77.803902188999999, 2024-09-12T16:18:37.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.000678049, 2024-09-12T16:18:37.908 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:37.908 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:37.908 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:37.908 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:37.908 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:18:37.908 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:18:37.908 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 9400 2024-09-12T16:18:37.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.908 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:37.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:37.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012502+0000", 2024-09-12T16:18:37.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:37.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012502+0000", 2024-09-12T16:18:37.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:37.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:37.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012504+0000", 2024-09-12T16:18:37.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5939999999999999e-06 2024-09-12T16:18:37.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:37.910 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012511+0000", 2024-09-12T16:18:37.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0840000000000003e-06 2024-09-12T16:18:37.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:37.910 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012525+0000", 2024-09-12T16:18:37.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4538999999999999e-05 2024-09-12T16:18:37.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:37.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012532+0000", 2024-09-12T16:18:37.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8310000000000003e-06 2024-09-12T16:18:37.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:37.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012605+0000", 2024-09-12T16:18:37.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2387999999999999e-05 2024-09-12T16:18:37.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T16:18:37.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012617+0000", 2024-09-12T16:18:37.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2167999999999999e-05 2024-09-12T16:18:37.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:37.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:21.012823+0000", 2024-09-12T16:18:37.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0002068230000001 2024-09-12T16:18:37.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:37.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:21.012975+0000", 2024-09-12T16:18:37.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015196200000000001 2024-09-12T16:18:37.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:37.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:37.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:37.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:21.013180+0000", 2024-09-12T16:18:37.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020466000000000001 2024-09-12T16:18:37.912 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.912 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:37.913 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.913 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:37.913 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:37.913 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:37.914 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:18:37.915 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:37.913+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:38.015 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:38.014+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:38.016 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-12T16:18:38.080 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:38.080 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:38.080 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:18:38.080 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:38.089 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:18:38.115 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:38.115+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:38.216 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:38.215+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:38.239 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:38.239 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:38.239 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:18:38.239 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:18:38.239 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:38.247 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:18:38.317 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:38.317+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:38.360 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 3, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-12T16:18:38.360 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-12T16:18:38.397 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:38.397 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:18:38.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:18:38.398 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:18:38.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.398 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1571 3.b 3:d046566d:::rbd_data.1155525b14e3.0000000000000001:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:18:38.398 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:18:38.398 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 117.24345488, 2024-09-12T16:18:38.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064439785999999999, 2024-09-12T16:18:38.398 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:38.398 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:38.398 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:38.398 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:38.398 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:18:38.398 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:18:38.398 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1571 2024-09-12T16:18:38.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.399 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:38.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:38.399 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:18:38.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:38.399 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:18:38.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:38.400 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:18:38.400 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5400000000000002e-07 2024-09-12T16:18:38.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.400 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:38.400 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152567+0000", 2024-09-12T16:18:38.400 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.131e-06 2024-09-12T16:18:38.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.400 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:38.400 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152574+0000", 2024-09-12T16:18:38.400 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1840000000000002e-06 2024-09-12T16:18:38.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.401 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:38.401 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152579+0000", 2024-09-12T16:18:38.401 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.152e-06 2024-09-12T16:18:38.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.401 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.401 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153671+0000", 2024-09-12T16:18:38.401 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001092078 2024-09-12T16:18:38.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.401 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:38.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153779+0000", 2024-09-12T16:18:38.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108461 2024-09-12T16:18:38.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:38.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217004+0000", 2024-09-12T16:18:38.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.063224426 2024-09-12T16:18:38.402 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.402 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:38.402 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.402 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1581 3.4 3:22e34893:::rbd_data.1155525b14e3.0000000000000005:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:18:38.402 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:18:38.403 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 117.24335775500001, 2024-09-12T16:18:38.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064484407999999993, 2024-09-12T16:18:38.403 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:38.403 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:38.403 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:38.403 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:38.403 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:18:38.403 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:18:38.403 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1581 2024-09-12T16:18:38.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.403 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:38.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:38.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:18:38.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.404 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:38.404 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:18:38.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.404 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:38.404 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152662+0000", 2024-09-12T16:18:38.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.65e-07 2024-09-12T16:18:38.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.405 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:38.405 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152664+0000", 2024-09-12T16:18:38.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9829999999999999e-06 2024-09-12T16:18:38.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.405 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:38.405 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152670+0000", 2024-09-12T16:18:38.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2260000000000002e-06 2024-09-12T16:18:38.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.405 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:38.405 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152675+0000", 2024-09-12T16:18:38.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7990000000000001e-06 2024-09-12T16:18:38.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.406 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.216945+0000", 2024-09-12T16:18:38.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064270341999999994 2024-09-12T16:18:38.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:38.406 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217040+0000", 2024-09-12T16:18:38.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5242999999999996e-05 2024-09-12T16:18:38.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:38.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217146+0000", 2024-09-12T16:18:38.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010545 2024-09-12T16:18:38.407 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.407 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:38.407 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.407 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2207 3.0 3:05fdc61f:::rbd_data.1155ccb1894c.0000000000000003:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:18:38.407 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:18:38.407 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 101.025314194, 2024-09-12T16:18:38.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.05105382, 2024-09-12T16:18:38.407 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:38.407 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:38.408 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:38.408 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:38.408 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:18:38.408 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:18:38.408 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2207 2024-09-12T16:18:38.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.408 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:38.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.408 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:38.408 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:18:38.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:38.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:18:38.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:38.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370706+0000", 2024-09-12T16:18:38.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7800000000000001e-07 2024-09-12T16:18:38.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:38.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391581+0000", 2024-09-12T16:18:38.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020875624999999998 2024-09-12T16:18:38.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.410 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:38.410 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391608+0000", 2024-09-12T16:18:38.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6412999999999999e-05 2024-09-12T16:18:38.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.410 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:38.410 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391618+0000", 2024-09-12T16:18:38.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9240000000000002e-06 2024-09-12T16:18:38.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.410 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.411 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391705+0000", 2024-09-12T16:18:38.411 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7489000000000002e-05 2024-09-12T16:18:38.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.411 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:38.411 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391838+0000", 2024-09-12T16:18:38.411 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132865 2024-09-12T16:18:38.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.411 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 2", 2024-09-12T16:18:38.411 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.392587+0000", 2024-09-12T16:18:38.411 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074930000000000005 2024-09-12T16:18:38.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:38.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.420095+0000", 2024-09-12T16:18:38.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027507949 2024-09-12T16:18:38.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:18:38.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421610+0000", 2024-09-12T16:18:38.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001515195 2024-09-12T16:18:38.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:18:38.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421681+0000", 2024-09-12T16:18:38.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0320000000000004e-05 2024-09-12T16:18:38.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:38.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421759+0000", 2024-09-12T16:18:38.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7961999999999997e-05 2024-09-12T16:18:38.413 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.413 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:38.413 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.413 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11083 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 3399680~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:38.413 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.876304+0000", 2024-09-12T16:18:38.413 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.519714786999998, 2024-09-12T16:18:38.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045070883999999999, 2024-09-12T16:18:38.414 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:38.414 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:38.414 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:38.414 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:38.414 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:38.414 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:38.414 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11083 2024-09-12T16:18:38.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.414 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:38.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:38.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876304+0000", 2024-09-12T16:18:38.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.415 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:38.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876304+0000", 2024-09-12T16:18:38.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.415 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:38.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876305+0000", 2024-09-12T16:18:38.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4099999999999999e-07 2024-09-12T16:18:38.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.415 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:38.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876307+0000", 2024-09-12T16:18:38.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9470000000000002e-06 2024-09-12T16:18:38.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.416 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:38.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876312+0000", 2024-09-12T16:18:38.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7540000000000003e-06 2024-09-12T16:18:38.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.416 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:38.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876318+0000", 2024-09-12T16:18:38.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3589999999999999e-06 2024-09-12T16:18:38.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.417 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.417 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921221+0000", 2024-09-12T16:18:38.417 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044903464999999997 2024-09-12T16:18:38.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.417 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:38.417 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921266+0000", 2024-09-12T16:18:38.417 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4795000000000001e-05 2024-09-12T16:18:38.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.417 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:38.417 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921375+0000", 2024-09-12T16:18:38.417 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000109023 2024-09-12T16:18:38.418 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.418 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:38.418 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.418 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11084 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 3448832~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:38.418 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.876324+0000", 2024-09-12T16:18:38.418 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.51969467, 2024-09-12T16:18:38.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045172474999999997, 2024-09-12T16:18:38.418 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:38.418 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:38.418 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:38.418 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:38.419 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:38.419 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:38.419 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11084 2024-09-12T16:18:38.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.419 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:38.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.419 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:38.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876324+0000", 2024-09-12T16:18:38.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.419 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:38.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876324+0000", 2024-09-12T16:18:38.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:38.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876411+0000", 2024-09-12T16:18:38.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6292000000000007e-05 2024-09-12T16:18:38.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:38.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876418+0000", 2024-09-12T16:18:38.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3309999999999998e-06 2024-09-12T16:18:38.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:38.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876426+0000", 2024-09-12T16:18:38.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3850000000000002e-06 2024-09-12T16:18:38.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:38.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876436+0000", 2024-09-12T16:18:38.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8749999999999995e-06 2024-09-12T16:18:38.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921403+0000", 2024-09-12T16:18:38.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044966385999999997 2024-09-12T16:18:38.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.422 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:38.422 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921445+0000", 2024-09-12T16:18:38.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1953000000000003e-05 2024-09-12T16:18:38.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.422 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:38.422 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921497+0000", 2024-09-12T16:18:38.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2253000000000003e-05 2024-09-12T16:18:38.422 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.422 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:38.422 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.423 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11085 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 3497984~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:38.423 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.876449+0000", 2024-09-12T16:18:38.423 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.519570160000001, 2024-09-12T16:18:38.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045173054999999997, 2024-09-12T16:18:38.423 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:38.423 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:38.423 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:38.423 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:38.423 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:38.423 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:38.423 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11085 2024-09-12T16:18:38.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.423 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:38.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.424 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:38.424 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876449+0000", 2024-09-12T16:18:38.424 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.424 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:38.424 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876449+0000", 2024-09-12T16:18:38.424 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.424 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:38.424 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.881997+0000", 2024-09-12T16:18:38.424 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055481209999999996 2024-09-12T16:18:38.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:38.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.882002+0000", 2024-09-12T16:18:38.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8269999999999997e-06 2024-09-12T16:18:38.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:38.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.882013+0000", 2024-09-12T16:18:38.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0869999999999999e-05 2024-09-12T16:18:38.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:38.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.882020+0000", 2024-09-12T16:18:38.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5839999999999997e-06 2024-09-12T16:18:38.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921523+0000", 2024-09-12T16:18:38.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039502411000000001 2024-09-12T16:18:38.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:38.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921566+0000", 2024-09-12T16:18:38.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3353000000000003e-05 2024-09-12T16:18:38.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:38.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921622+0000", 2024-09-12T16:18:38.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5889e-05 2024-09-12T16:18:38.427 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.427 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:38.427 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.427 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11139 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 6152192~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:38.427 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883248+0000", 2024-09-12T16:18:38.427 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.512771295999997, 2024-09-12T16:18:38.428 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045153225999999998, 2024-09-12T16:18:38.428 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:38.428 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:38.428 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:38.428 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:38.428 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:38.428 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:38.428 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11139 2024-09-12T16:18:38.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.428 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:38.428 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.428 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:38.428 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883248+0000", 2024-09-12T16:18:38.429 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.429 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:38.429 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883248+0000", 2024-09-12T16:18:38.429 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.429 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:38.429 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883248+0000", 2024-09-12T16:18:38.429 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9999999999999998e-07 2024-09-12T16:18:38.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.429 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:38.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883250+0000", 2024-09-12T16:18:38.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0660000000000002e-06 2024-09-12T16:18:38.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.430 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:38.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883256+0000", 2024-09-12T16:18:38.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8699999999999997e-06 2024-09-12T16:18:38.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.430 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:38.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883261+0000", 2024-09-12T16:18:38.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0490000000000003e-06 2024-09-12T16:18:38.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928316+0000", 2024-09-12T16:18:38.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045055398000000003 2024-09-12T16:18:38.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:38.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928359+0000", 2024-09-12T16:18:38.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2286000000000001e-05 2024-09-12T16:18:38.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:38.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928401+0000", 2024-09-12T16:18:38.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2157000000000003e-05 2024-09-12T16:18:38.431 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.432 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:38.432 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.432 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11140 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 6201344~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:38.432 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883267+0000", 2024-09-12T16:18:38.432 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.512751530000003, 2024-09-12T16:18:38.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045241199000000003, 2024-09-12T16:18:38.432 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:38.432 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:38.432 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:38.432 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:38.432 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:38.433 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:38.433 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11140 2024-09-12T16:18:38.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.433 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:38.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:38.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883267+0000", 2024-09-12T16:18:38.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:38.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883267+0000", 2024-09-12T16:18:38.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.434 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:38.434 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883268+0000", 2024-09-12T16:18:38.434 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8700000000000001e-07 2024-09-12T16:18:38.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.434 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:38.434 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883270+0000", 2024-09-12T16:18:38.434 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3420000000000002e-06 2024-09-12T16:18:38.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.434 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:38.434 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883276+0000", 2024-09-12T16:18:38.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0310000000000004e-06 2024-09-12T16:18:38.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.435 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:38.435 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883281+0000", 2024-09-12T16:18:38.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1259999999999997e-06 2024-09-12T16:18:38.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.435 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.435 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928428+0000", 2024-09-12T16:18:38.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045146276999999999 2024-09-12T16:18:38.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:38.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928469+0000", 2024-09-12T16:18:38.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1007000000000002e-05 2024-09-12T16:18:38.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:38.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928509+0000", 2024-09-12T16:18:38.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0028999999999999e-05 2024-09-12T16:18:38.436 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.436 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:38.436 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.437 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11141 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 6250496~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:38.437 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883288+0000", 2024-09-12T16:18:38.437 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.512730933, 2024-09-12T16:18:38.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045331594000000003, 2024-09-12T16:18:38.437 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:38.437 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:38.437 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:38.437 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:38.437 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:38.437 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:38.437 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11141 2024-09-12T16:18:38.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.437 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:38.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.438 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:38.438 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883288+0000", 2024-09-12T16:18:38.438 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.438 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:38.438 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883288+0000", 2024-09-12T16:18:38.438 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.438 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:38.438 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883288+0000", 2024-09-12T16:18:38.438 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0200000000000003e-07 2024-09-12T16:18:38.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.439 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:38.439 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883290+0000", 2024-09-12T16:18:38.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9350000000000001e-06 2024-09-12T16:18:38.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.439 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:38.439 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883296+0000", 2024-09-12T16:18:38.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.913e-06 2024-09-12T16:18:38.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.439 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:38.439 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883302+0000", 2024-09-12T16:18:38.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.879e-06 2024-09-12T16:18:38.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.440 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.440 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928534+0000", 2024-09-12T16:18:38.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045231544999999998 2024-09-12T16:18:38.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.440 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:38.440 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928577+0000", 2024-09-12T16:18:38.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3676e-05 2024-09-12T16:18:38.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.441 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:38.441 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928620+0000", 2024-09-12T16:18:38.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2243999999999997e-05 2024-09-12T16:18:38.441 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.441 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:38.441 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.441 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11271 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3174400~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:38.441 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883316+0000", 2024-09-12T16:18:38.441 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.512702873000002, 2024-09-12T16:18:38.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045477308000000001, 2024-09-12T16:18:38.441 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:38.442 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:38.442 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:38.442 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:38.442 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:38.442 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:38.442 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11271 2024-09-12T16:18:38.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.442 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:38.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.442 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:38.442 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883316+0000", 2024-09-12T16:18:38.442 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.443 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:38.443 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883316+0000", 2024-09-12T16:18:38.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.443 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:38.443 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883317+0000", 2024-09-12T16:18:38.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9200000000000001e-07 2024-09-12T16:18:38.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.443 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:38.443 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883319+0000", 2024-09-12T16:18:38.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2670000000000001e-06 2024-09-12T16:18:38.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:38.444 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883326+0000", 2024-09-12T16:18:38.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6000000000000003e-06 2024-09-12T16:18:38.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:38.444 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883331+0000", 2024-09-12T16:18:38.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1719999999999998e-06 2024-09-12T16:18:38.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.445 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.445 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928647+0000", 2024-09-12T16:18:38.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045316457999999997 2024-09-12T16:18:38.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.445 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:38.445 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928689+0000", 2024-09-12T16:18:38.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1352e-05 2024-09-12T16:18:38.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.445 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:38.445 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928793+0000", 2024-09-12T16:18:38.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000104867 2024-09-12T16:18:38.445 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.446 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:38.446 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.446 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11272 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3223552~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:38.446 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883338+0000", 2024-09-12T16:18:38.446 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.512681012999998, 2024-09-12T16:18:38.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045595268000000001, 2024-09-12T16:18:38.446 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:38.446 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:38.446 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:38.446 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:38.446 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:38.447 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:38.447 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11272 2024-09-12T16:18:38.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.447 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:38.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.447 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:38.447 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883338+0000", 2024-09-12T16:18:38.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.447 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:38.447 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883338+0000", 2024-09-12T16:18:38.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.448 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:38.448 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883339+0000", 2024-09-12T16:18:38.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8599999999999998e-07 2024-09-12T16:18:38.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.448 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:38.448 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883341+0000", 2024-09-12T16:18:38.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1449999999999998e-06 2024-09-12T16:18:38.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.448 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:38.448 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883348+0000", 2024-09-12T16:18:38.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0110000000000003e-06 2024-09-12T16:18:38.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.449 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:38.449 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883353+0000", 2024-09-12T16:18:38.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2360000000000004e-06 2024-09-12T16:18:38.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.449 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.449 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928819+0000", 2024-09-12T16:18:38.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045466392000000001 2024-09-12T16:18:38.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:38.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928869+0000", 2024-09-12T16:18:38.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9829e-05 2024-09-12T16:18:38.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:38.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928933+0000", 2024-09-12T16:18:38.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3968999999999997e-05 2024-09-12T16:18:38.450 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.450 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:38.450 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.451 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11273 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3272704~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:38.451 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883359+0000", 2024-09-12T16:18:38.451 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.512659700999997, 2024-09-12T16:18:38.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045735142999999999, 2024-09-12T16:18:38.451 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:38.451 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:38.451 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:38.451 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:38.451 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:38.451 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:38.451 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11273 2024-09-12T16:18:38.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.451 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:38.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:38.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883359+0000", 2024-09-12T16:18:38.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:38.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883359+0000", 2024-09-12T16:18:38.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:38.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883360+0000", 2024-09-12T16:18:38.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9400000000000001e-07 2024-09-12T16:18:38.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:38.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883367+0000", 2024-09-12T16:18:38.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8530000000000003e-06 2024-09-12T16:18:38.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:38.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883373+0000", 2024-09-12T16:18:38.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9989999999999997e-06 2024-09-12T16:18:38.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:38.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883378+0000", 2024-09-12T16:18:38.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3369999999999999e-06 2024-09-12T16:18:38.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928950+0000", 2024-09-12T16:18:38.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045571751000000001 2024-09-12T16:18:38.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:38.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928992+0000", 2024-09-12T16:18:38.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1891000000000003e-05 2024-09-12T16:18:38.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:38.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929094+0000", 2024-09-12T16:18:38.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010291800000000001 2024-09-12T16:18:38.455 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.455 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:38.455 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.455 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11274 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3321856~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:38.455 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883385+0000", 2024-09-12T16:18:38.456 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.512634183999999, 2024-09-12T16:18:38.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045864239000000001, 2024-09-12T16:18:38.456 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:38.456 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:38.456 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:38.456 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:38.456 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:38.456 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:38.456 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11274 2024-09-12T16:18:38.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.456 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:38.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:38.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883385+0000", 2024-09-12T16:18:38.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:38.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883385+0000", 2024-09-12T16:18:38.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:38.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883385+0000", 2024-09-12T16:18:38.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4799999999999999e-07 2024-09-12T16:18:38.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:38.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883388+0000", 2024-09-12T16:18:38.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3199999999999998e-06 2024-09-12T16:18:38.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:38.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883394+0000", 2024-09-12T16:18:38.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2020000000000001e-06 2024-09-12T16:18:38.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:38.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883400+0000", 2024-09-12T16:18:38.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8510000000000004e-06 2024-09-12T16:18:38.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929123+0000", 2024-09-12T16:18:38.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045723235000000001 2024-09-12T16:18:38.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:38.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929166+0000", 2024-09-12T16:18:38.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2769999999999999e-05 2024-09-12T16:18:38.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:38.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929249+0000", 2024-09-12T16:18:38.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3412999999999996e-05 2024-09-12T16:18:38.460 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.460 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:38.460 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.460 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11275 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3371008~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:38.460 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883416+0000", 2024-09-12T16:18:38.460 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.512602575000003, 2024-09-12T16:18:38.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.046042315, 2024-09-12T16:18:38.460 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:38.460 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:38.460 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:38.461 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:38.461 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:38.461 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:38.461 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11275 2024-09-12T16:18:38.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.461 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:38.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:38.461 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883416+0000", 2024-09-12T16:18:38.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:38.461 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883416+0000", 2024-09-12T16:18:38.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:38.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883417+0000", 2024-09-12T16:18:38.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4700000000000001e-07 2024-09-12T16:18:38.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:38.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883419+0000", 2024-09-12T16:18:38.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2029999999999999e-06 2024-09-12T16:18:38.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.463 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:38.463 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883426+0000", 2024-09-12T16:18:38.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.579e-06 2024-09-12T16:18:38.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.463 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:38.463 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883431+0000", 2024-09-12T16:18:38.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5679999999999999e-06 2024-09-12T16:18:38.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.463 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.463 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929290+0000", 2024-09-12T16:18:38.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045858227000000001 2024-09-12T16:18:38.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.464 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:38.464 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929365+0000", 2024-09-12T16:18:38.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5519999999999995e-05 2024-09-12T16:18:38.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.464 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:38.464 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929459+0000", 2024-09-12T16:18:38.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3671000000000005e-05 2024-09-12T16:18:38.464 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.464 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:38.464 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.465 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11276 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3420160~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:38.465 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883439+0000", 2024-09-12T16:18:38.465 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.512580172, 2024-09-12T16:18:38.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.046138991999999997, 2024-09-12T16:18:38.465 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:38.465 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:38.465 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:38.465 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:38.465 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:38.465 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:38.465 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11276 2024-09-12T16:18:38.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.466 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:38.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:38.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883439+0000", 2024-09-12T16:18:38.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:38.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883439+0000", 2024-09-12T16:18:38.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:38.467 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883560+0000", 2024-09-12T16:18:38.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121229 2024-09-12T16:18:38.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.467 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:38.467 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883569+0000", 2024-09-12T16:18:38.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9390000000000003e-06 2024-09-12T16:18:38.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.467 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:38.467 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883579+0000", 2024-09-12T16:18:38.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8859999999999999e-06 2024-09-12T16:18:38.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.468 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:38.468 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883585+0000", 2024-09-12T16:18:38.468 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.545e-06 2024-09-12T16:18:38.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.468 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.468 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929486+0000", 2024-09-12T16:18:38.468 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045900653999999999 2024-09-12T16:18:38.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.468 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:38.468 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929527+0000", 2024-09-12T16:18:38.468 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0707999999999997e-05 2024-09-12T16:18:38.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.469 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:38.469 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929578+0000", 2024-09-12T16:18:38.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1031e-05 2024-09-12T16:18:38.469 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.469 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:38.469 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.469 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11277 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3469312~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:38.469 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883595+0000", 2024-09-12T16:18:38.469 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.512423828999999, 2024-09-12T16:18:38.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.046187702999999997, 2024-09-12T16:18:38.470 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:38.470 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:38.470 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:38.470 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:38.470 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:38.470 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:38.470 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11277 2024-09-12T16:18:38.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.470 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:38.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:38.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883595+0000", 2024-09-12T16:18:38.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:38.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883595+0000", 2024-09-12T16:18:38.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:38.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.889065+0000", 2024-09-12T16:18:38.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00547001 2024-09-12T16:18:38.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:38.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.889069+0000", 2024-09-12T16:18:38.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1180000000000002e-06 2024-09-12T16:18:38.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:38.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.889079+0000", 2024-09-12T16:18:38.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2250000000000006e-06 2024-09-12T16:18:38.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:38.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.889084+0000", 2024-09-12T16:18:38.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2680000000000002e-06 2024-09-12T16:18:38.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929612+0000", 2024-09-12T16:18:38.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040528343000000001 2024-09-12T16:18:38.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.473 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:38.473 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929691+0000", 2024-09-12T16:18:38.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8541999999999994e-05 2024-09-12T16:18:38.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.473 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:38.473 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929783+0000", 2024-09-12T16:18:38.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2196999999999998e-05 2024-09-12T16:18:38.473 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.473 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:38.474 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.474 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:27683 3.1 3.d6dd1621 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e127)", 2024-09-12T16:18:38.474 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:15.196201+0000", 2024-09-12T16:18:38.474 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.199818150999999, 2024-09-12T16:18:38.474 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.91402251499999998, 2024-09-12T16:18:38.474 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:38.474 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:38.474 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:18:38.474 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:38.474 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:18:38.474 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:18:38.474 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 27683 2024-09-12T16:18:38.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.475 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:38.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.475 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:38.475 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196201+0000", 2024-09-12T16:18:38.475 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.475 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:38.475 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196201+0000", 2024-09-12T16:18:38.475 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.476 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:38.476 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196202+0000", 2024-09-12T16:18:38.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4929999999999999e-06 2024-09-12T16:18:38.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.476 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:38.476 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196209+0000", 2024-09-12T16:18:38.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2269999999999998e-06 2024-09-12T16:18:38.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.476 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:38.476 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196221+0000", 2024-09-12T16:18:38.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2517000000000001e-05 2024-09-12T16:18:38.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.477 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:38.477 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196229+0000", 2024-09-12T16:18:38.477 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3250000000000008e-06 2024-09-12T16:18:38.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.477 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.477 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196293+0000", 2024-09-12T16:18:38.477 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3975999999999999e-05 2024-09-12T16:18:38.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.477 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T16:18:38.478 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196299+0000", 2024-09-12T16:18:38.478 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3000000000000001e-06 2024-09-12T16:18:38.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.478 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.478 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.478 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110210+0000", 2024-09-12T16:18:38.478 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.91391175099999999 2024-09-12T16:18:38.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.478 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.478 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:38.478 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110223+0000", 2024-09-12T16:18:38.478 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2926e-05 2024-09-12T16:18:38.478 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.478 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:38.478 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.479 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:27740 3.1 3.859365c1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e127)", 2024-09-12T16:18:38.479 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:15.209778+0000", 2024-09-12T16:18:38.479 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.186241022000001, 2024-09-12T16:18:38.479 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.90059554500000005, 2024-09-12T16:18:38.479 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:38.479 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:38.479 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:18:38.479 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:38.479 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:18:38.479 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:18:38.479 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 27740 2024-09-12T16:18:38.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.480 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:38.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.480 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:38.480 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209778+0000", 2024-09-12T16:18:38.480 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.480 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:38.480 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209778+0000", 2024-09-12T16:18:38.480 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.480 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:38.481 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209779+0000", 2024-09-12T16:18:38.481 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.274e-06 2024-09-12T16:18:38.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.481 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:38.481 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209785+0000", 2024-09-12T16:18:38.481 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3310000000000003e-06 2024-09-12T16:18:38.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.481 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:38.481 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209799+0000", 2024-09-12T16:18:38.481 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.448e-05 2024-09-12T16:18:38.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.482 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:38.482 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209806+0000", 2024-09-12T16:18:38.482 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3479999999999998e-06 2024-09-12T16:18:38.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.482 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.482 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209864+0000", 2024-09-12T16:18:38.482 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7395999999999997e-05 2024-09-12T16:18:38.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.482 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T16:18:38.482 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209871+0000", 2024-09-12T16:18:38.482 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1149999999999996e-06 2024-09-12T16:18:38.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.483 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.483 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.483 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110360+0000", 2024-09-12T16:18:38.483 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.90048930100000002 2024-09-12T16:18:38.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.483 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.483 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:38.483 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110374+0000", 2024-09-12T16:18:38.483 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.33e-05 2024-09-12T16:18:38.483 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.483 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:38.483 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.484 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:27742 3.1 3.d09829a1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e127)", 2024-09-12T16:18:38.484 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:15.210634+0000", 2024-09-12T16:18:38.484 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.185384526, 2024-09-12T16:18:38.484 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.89977736500000005, 2024-09-12T16:18:38.484 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:38.484 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:38.484 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:18:38.484 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:38.484 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:18:38.484 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:18:38.484 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 27742 2024-09-12T16:18:38.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.484 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:38.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:38.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210634+0000", 2024-09-12T16:18:38.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:38.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210634+0000", 2024-09-12T16:18:38.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:38.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210635+0000", 2024-09-12T16:18:38.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8100000000000001e-07 2024-09-12T16:18:38.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.486 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:38.486 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210641+0000", 2024-09-12T16:18:38.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.429e-06 2024-09-12T16:18:38.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.486 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:38.486 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210656+0000", 2024-09-12T16:18:38.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5557e-05 2024-09-12T16:18:38.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.486 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:38.487 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210663+0000", 2024-09-12T16:18:38.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5930000000000002e-06 2024-09-12T16:18:38.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.487 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.487 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210713+0000", 2024-09-12T16:18:38.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0488000000000002e-05 2024-09-12T16:18:38.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.487 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T16:18:38.487 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210722+0000", 2024-09-12T16:18:38.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0790000000000001e-06 2024-09-12T16:18:38.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.488 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.488 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110403+0000", 2024-09-12T16:18:38.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.89968195799999995 2024-09-12T16:18:38.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.488 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:38.488 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110412+0000", 2024-09-12T16:18:38.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3799999999999994e-06 2024-09-12T16:18:38.488 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.488 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:38.488 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.488 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:27745 3.1 3.36f5b621 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e127)", 2024-09-12T16:18:38.489 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:15.211355+0000", 2024-09-12T16:18:38.489 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.184663923999999, 2024-09-12T16:18:38.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.89909103999999995, 2024-09-12T16:18:38.489 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:38.489 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:38.489 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:18:38.489 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:38.489 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:18:38.489 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:18:38.489 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 27745 2024-09-12T16:18:38.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.489 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:38.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:38.490 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211355+0000", 2024-09-12T16:18:38.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:38.490 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211355+0000", 2024-09-12T16:18:38.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:38.490 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211356+0000", 2024-09-12T16:18:38.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9599999999999998e-07 2024-09-12T16:18:38.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.491 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:38.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211360+0000", 2024-09-12T16:18:38.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0419999999999996e-06 2024-09-12T16:18:38.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.491 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:38.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211373+0000", 2024-09-12T16:18:38.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3183000000000001e-05 2024-09-12T16:18:38.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.491 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:38.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211381+0000", 2024-09-12T16:18:38.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0499999999999992e-06 2024-09-12T16:18:38.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.492 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.492 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211438+0000", 2024-09-12T16:18:38.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6576999999999997e-05 2024-09-12T16:18:38.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.492 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T16:18:38.492 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211445+0000", 2024-09-12T16:18:38.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.391e-06 2024-09-12T16:18:38.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.493 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.493 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110437+0000", 2024-09-12T16:18:38.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.898991977 2024-09-12T16:18:38.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.493 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:38.493 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110446+0000", 2024-09-12T16:18:38.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0240000000000003e-06 2024-09-12T16:18:38.493 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.493 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:38.493 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.493 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.493 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:38.493 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:38.495 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:18:38.495 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:38.495+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:38.596 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:38.595+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:38.642 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:38.643 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:38.643 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:18:38.643 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:38.652 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:18:38.696 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:38.695+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:38.759 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:38.759 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:38.760 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:18:38.760 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:18:38.760 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:38.768 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:18:38.797 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:38.797+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:38.899 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:38.899+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:38.916 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:38.917 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:18:38.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:18:38.917 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:18:38.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.917 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2213 3.18 3:1944e921:::rbd_data.1155ccb1894c.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:18:38.917 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:18:38.917 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 101.53989374299999, 2024-09-12T16:18:38.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.055657836000000002, 2024-09-12T16:18:38.917 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:38.917 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:38.917 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:38.917 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:38.918 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:18:38.918 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:18:38.918 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2213 2024-09-12T16:18:38.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.918 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:38.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:38.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:18:38.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:38.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:18:38.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.919 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:38.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375351+0000", 2024-09-12T16:18:38.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.556e-06 2024-09-12T16:18:38.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.919 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:38.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.399989+0000", 2024-09-12T16:18:38.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024637949999999999 2024-09-12T16:18:38.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:38.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400038+0000", 2024-09-12T16:18:38.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9187999999999997e-05 2024-09-12T16:18:38.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:38.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400056+0000", 2024-09-12T16:18:38.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8451e-05 2024-09-12T16:18:38.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400151+0000", 2024-09-12T16:18:38.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5026999999999997e-05 2024-09-12T16:18:38.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:38.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400345+0000", 2024-09-12T16:18:38.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019352900000000001 2024-09-12T16:18:38.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 1", 2024-09-12T16:18:38.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.401319+0000", 2024-09-12T16:18:38.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00097419399999999995 2024-09-12T16:18:38.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:18:38.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.429350+0000", 2024-09-12T16:18:38.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028030607999999999 2024-09-12T16:18:38.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:38.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.430907+0000", 2024-09-12T16:18:38.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001557466 2024-09-12T16:18:38.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:18:38.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.430966+0000", 2024-09-12T16:18:38.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9437e-05 2024-09-12T16:18:38.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:38.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.431007+0000", 2024-09-12T16:18:38.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0429999999999997e-05 2024-09-12T16:18:38.923 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.923 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:38.923 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.923 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5632 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 585728~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:38.923 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556262+0000", 2024-09-12T16:18:38.923 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.358980686999999, 2024-09-12T16:18:38.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051267114000000003, 2024-09-12T16:18:38.923 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:38.924 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:38.924 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:38.924 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:38.924 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:38.924 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:38.924 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5632 2024-09-12T16:18:38.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.924 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:38.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.924 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:38.924 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556262+0000", 2024-09-12T16:18:38.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:38.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556262+0000", 2024-09-12T16:18:38.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:38.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556262+0000", 2024-09-12T16:18:38.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9999999999999998e-07 2024-09-12T16:18:38.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:38.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556269+0000", 2024-09-12T16:18:38.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4119999999999998e-06 2024-09-12T16:18:38.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:38.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556276+0000", 2024-09-12T16:18:38.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8549999999999996e-06 2024-09-12T16:18:38.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:38.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556281+0000", 2024-09-12T16:18:38.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1159999999999998e-06 2024-09-12T16:18:38.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607438+0000", 2024-09-12T16:18:38.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.05115695 2024-09-12T16:18:38.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:38.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607478+0000", 2024-09-12T16:18:38.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0535999999999999e-05 2024-09-12T16:18:38.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:38.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607529+0000", 2024-09-12T16:18:38.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0844999999999999e-05 2024-09-12T16:18:38.927 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.927 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:38.928 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.928 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5633 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 638976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:38.928 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556288+0000", 2024-09-12T16:18:38.928 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.358954654999998, 2024-09-12T16:18:38.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051384633999999998, 2024-09-12T16:18:38.928 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:38.928 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:38.928 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:38.928 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:38.928 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:38.928 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:38.929 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5633 2024-09-12T16:18:38.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.929 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:38.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.929 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:38.929 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556288+0000", 2024-09-12T16:18:38.929 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.929 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:38.929 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556288+0000", 2024-09-12T16:18:38.929 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:38.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556289+0000", 2024-09-12T16:18:38.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4000000000000002e-07 2024-09-12T16:18:38.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:38.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556291+0000", 2024-09-12T16:18:38.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0470000000000001e-06 2024-09-12T16:18:38.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:38.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556297+0000", 2024-09-12T16:18:38.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5080000000000002e-06 2024-09-12T16:18:38.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:38.931 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556302+0000", 2024-09-12T16:18:38.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2190000000000003e-06 2024-09-12T16:18:38.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.931 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607559+0000", 2024-09-12T16:18:38.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051256542000000002 2024-09-12T16:18:38.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:38.931 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607619+0000", 2024-09-12T16:18:38.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0538000000000002e-05 2024-09-12T16:18:38.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.932 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:38.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607673+0000", 2024-09-12T16:18:38.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3340000000000001e-05 2024-09-12T16:18:38.932 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.932 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:38.932 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.932 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5634 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 692224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:38.932 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556324+0000", 2024-09-12T16:18:38.933 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.358918965999997, 2024-09-12T16:18:38.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.05149252, 2024-09-12T16:18:38.933 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:38.933 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:38.933 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:38.933 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:38.933 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:38.933 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:38.933 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5634 2024-09-12T16:18:38.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.933 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:38.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:38.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556324+0000", 2024-09-12T16:18:38.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:38.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556324+0000", 2024-09-12T16:18:38.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:38.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556324+0000", 2024-09-12T16:18:38.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1900000000000002e-07 2024-09-12T16:18:38.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.935 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:38.935 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556327+0000", 2024-09-12T16:18:38.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T16:18:38.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.935 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:38.935 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556334+0000", 2024-09-12T16:18:38.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3919999999999997e-06 2024-09-12T16:18:38.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.935 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:38.935 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556341+0000", 2024-09-12T16:18:38.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6000000000000003e-06 2024-09-12T16:18:38.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.936 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.936 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607704+0000", 2024-09-12T16:18:38.936 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051363233000000001 2024-09-12T16:18:38.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.936 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:38.936 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607764+0000", 2024-09-12T16:18:38.936 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9871000000000003e-05 2024-09-12T16:18:38.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.936 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:38.936 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607816+0000", 2024-09-12T16:18:38.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2374999999999999e-05 2024-09-12T16:18:38.937 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.937 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:38.937 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.937 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5635 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 745472~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:38.937 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556348+0000", 2024-09-12T16:18:38.937 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.358894395, 2024-09-12T16:18:38.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051607838000000003, 2024-09-12T16:18:38.937 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:38.937 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:38.937 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:38.938 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:38.938 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:38.938 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:38.938 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5635 2024-09-12T16:18:38.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.938 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:38.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:38.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556348+0000", 2024-09-12T16:18:38.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:38.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556348+0000", 2024-09-12T16:18:38.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:38.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556349+0000", 2024-09-12T16:18:38.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.75e-07 2024-09-12T16:18:38.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:38.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556351+0000", 2024-09-12T16:18:38.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1890000000000001e-06 2024-09-12T16:18:38.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:38.940 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556358+0000", 2024-09-12T16:18:38.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.922e-06 2024-09-12T16:18:38.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:38.940 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556363+0000", 2024-09-12T16:18:38.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.242e-06 2024-09-12T16:18:38.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.940 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607846+0000", 2024-09-12T16:18:38.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051482433000000001 2024-09-12T16:18:38.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.941 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:38.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607886+0000", 2024-09-12T16:18:38.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0290999999999998e-05 2024-09-12T16:18:38.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.941 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:38.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607956+0000", 2024-09-12T16:18:38.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0285999999999998e-05 2024-09-12T16:18:38.942 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.942 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:38.942 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.942 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5636 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 806912~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:38.942 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556371+0000", 2024-09-12T16:18:38.942 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.358872216999998, 2024-09-12T16:18:38.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051725921000000001, 2024-09-12T16:18:38.942 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:38.942 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:38.942 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:38.942 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:38.943 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:38.943 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:38.943 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5636 2024-09-12T16:18:38.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.943 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:38.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:38.943 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556371+0000", 2024-09-12T16:18:38.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:38.943 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556371+0000", 2024-09-12T16:18:38.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:38.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556371+0000", 2024-09-12T16:18:38.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9800000000000004e-07 2024-09-12T16:18:38.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:38.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556373+0000", 2024-09-12T16:18:38.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0490000000000002e-06 2024-09-12T16:18:38.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:38.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556380+0000", 2024-09-12T16:18:38.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6050000000000003e-06 2024-09-12T16:18:38.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:38.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556385+0000", 2024-09-12T16:18:38.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2449999999999998e-06 2024-09-12T16:18:38.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607993+0000", 2024-09-12T16:18:38.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051608182000000002 2024-09-12T16:18:38.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:38.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608035+0000", 2024-09-12T16:18:38.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1698e-05 2024-09-12T16:18:38.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:38.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608096+0000", 2024-09-12T16:18:38.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1643999999999995e-05 2024-09-12T16:18:38.946 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.946 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:38.946 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.947 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5637 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 860160~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:38.947 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556393+0000", 2024-09-12T16:18:38.947 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.358849566000004, 2024-09-12T16:18:38.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051839035999999998, 2024-09-12T16:18:38.947 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:38.947 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:38.947 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:38.947 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:38.947 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:38.947 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:38.947 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5637 2024-09-12T16:18:38.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.947 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:38.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:38.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556393+0000", 2024-09-12T16:18:38.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:38.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556393+0000", 2024-09-12T16:18:38.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:38.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556394+0000", 2024-09-12T16:18:38.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3000000000000001e-07 2024-09-12T16:18:38.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:38.949 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556396+0000", 2024-09-12T16:18:38.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0839999999999999e-06 2024-09-12T16:18:38.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:38.949 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556402+0000", 2024-09-12T16:18:38.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6919999999999996e-06 2024-09-12T16:18:38.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:38.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556408+0000", 2024-09-12T16:18:38.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2800000000000003e-06 2024-09-12T16:18:38.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608129+0000", 2024-09-12T16:18:38.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051720902999999999 2024-09-12T16:18:38.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:38.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608174+0000", 2024-09-12T16:18:38.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5676000000000001e-05 2024-09-12T16:18:38.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.951 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:38.951 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608232+0000", 2024-09-12T16:18:38.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7970999999999998e-05 2024-09-12T16:18:38.951 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.951 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:38.951 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.951 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5638 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 913408~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:38.951 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556415+0000", 2024-09-12T16:18:38.951 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.358828172000003, 2024-09-12T16:18:38.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051949532999999999, 2024-09-12T16:18:38.951 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:38.951 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:38.952 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:38.952 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:38.952 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:38.952 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:38.952 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5638 2024-09-12T16:18:38.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.952 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:38.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:38.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556415+0000", 2024-09-12T16:18:38.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:38.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556415+0000", 2024-09-12T16:18:38.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:38.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556415+0000", 2024-09-12T16:18:38.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7199999999999999e-07 2024-09-12T16:18:38.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:38.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556417+0000", 2024-09-12T16:18:38.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0279999999999999e-06 2024-09-12T16:18:38.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:38.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556424+0000", 2024-09-12T16:18:38.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6950000000000003e-06 2024-09-12T16:18:38.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:38.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556429+0000", 2024-09-12T16:18:38.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3059999999999997e-06 2024-09-12T16:18:38.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608260+0000", 2024-09-12T16:18:38.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051831254 2024-09-12T16:18:38.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:38.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608306+0000", 2024-09-12T16:18:38.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5976999999999997e-05 2024-09-12T16:18:38.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:38.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608364+0000", 2024-09-12T16:18:38.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7800999999999998e-05 2024-09-12T16:18:38.955 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.955 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:38.955 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.956 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5639 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 966656~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:38.956 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556436+0000", 2024-09-12T16:18:38.956 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.358806499000003, 2024-09-12T16:18:38.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052070419, 2024-09-12T16:18:38.956 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:38.956 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:38.956 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:38.957 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:38.957 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:38.957 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:38.957 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5639 2024-09-12T16:18:38.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.957 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:38.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:38.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556436+0000", 2024-09-12T16:18:38.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:38.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556436+0000", 2024-09-12T16:18:38.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:38.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556437+0000", 2024-09-12T16:18:38.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1899999999999998e-07 2024-09-12T16:18:38.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:38.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556439+0000", 2024-09-12T16:18:38.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.973e-06 2024-09-12T16:18:38.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:38.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556445+0000", 2024-09-12T16:18:38.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7769999999999997e-06 2024-09-12T16:18:38.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:38.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556451+0000", 2024-09-12T16:18:38.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.31e-06 2024-09-12T16:18:38.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608397+0000", 2024-09-12T16:18:38.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051945829999999998 2024-09-12T16:18:38.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:38.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608438+0000", 2024-09-12T16:18:38.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1539000000000003e-05 2024-09-12T16:18:38.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:38.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608507+0000", 2024-09-12T16:18:38.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8571000000000005e-05 2024-09-12T16:18:38.960 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.960 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:38.960 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.961 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5640 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1019904~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:38.961 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556458+0000", 2024-09-12T16:18:38.961 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.358784987, 2024-09-12T16:18:38.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052171423000000001, 2024-09-12T16:18:38.961 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:38.961 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:38.961 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:38.961 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:38.961 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:38.961 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:38.961 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5640 2024-09-12T16:18:38.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.961 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:38.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:38.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556458+0000", 2024-09-12T16:18:38.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:38.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556458+0000", 2024-09-12T16:18:38.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:38.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556458+0000", 2024-09-12T16:18:38.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2500000000000001e-07 2024-09-12T16:18:38.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.963 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:38.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556460+0000", 2024-09-12T16:18:38.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.934e-06 2024-09-12T16:18:38.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.963 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:38.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556468+0000", 2024-09-12T16:18:38.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7950000000000008e-06 2024-09-12T16:18:38.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:38.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556473+0000", 2024-09-12T16:18:38.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3539999999999999e-06 2024-09-12T16:18:38.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608539+0000", 2024-09-12T16:18:38.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052065974000000001 2024-09-12T16:18:38.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:38.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608579+0000", 2024-09-12T16:18:38.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0238999999999999e-05 2024-09-12T16:18:38.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:38.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608629+0000", 2024-09-12T16:18:38.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9701999999999999e-05 2024-09-12T16:18:38.965 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.965 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:38.965 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.965 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5641 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1081344~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:38.965 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556480+0000", 2024-09-12T16:18:38.965 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.358762378000002, 2024-09-12T16:18:38.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052284826999999999, 2024-09-12T16:18:38.966 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:38.966 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:38.966 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:38.966 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:38.966 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:38.966 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:38.966 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5641 2024-09-12T16:18:38.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.966 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:38.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:38.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556480+0000", 2024-09-12T16:18:38.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:38.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556480+0000", 2024-09-12T16:18:38.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:38.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556481+0000", 2024-09-12T16:18:38.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.27e-07 2024-09-12T16:18:38.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:38.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556483+0000", 2024-09-12T16:18:38.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9379999999999999e-06 2024-09-12T16:18:38.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:38.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556489+0000", 2024-09-12T16:18:38.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5910000000000001e-06 2024-09-12T16:18:38.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:38.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556495+0000", 2024-09-12T16:18:38.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5600000000000001e-06 2024-09-12T16:18:38.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608659+0000", 2024-09-12T16:18:38.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052164489000000001 2024-09-12T16:18:38.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:38.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608714+0000", 2024-09-12T16:18:38.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4849999999999998e-05 2024-09-12T16:18:38.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:38.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608765+0000", 2024-09-12T16:18:38.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0971999999999999e-05 2024-09-12T16:18:38.970 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.970 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:38.970 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.970 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5642 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1134592~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:38.970 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556502+0000", 2024-09-12T16:18:38.970 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.358740482999998, 2024-09-12T16:18:38.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052404536000000002, 2024-09-12T16:18:38.970 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:38.970 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:38.970 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:38.970 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:38.971 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:38.971 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:38.971 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5642 2024-09-12T16:18:38.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.971 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:38.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:38.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556502+0000", 2024-09-12T16:18:38.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:38.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556502+0000", 2024-09-12T16:18:38.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:38.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556503+0000", 2024-09-12T16:18:38.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8599999999999998e-07 2024-09-12T16:18:38.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:38.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556505+0000", 2024-09-12T16:18:38.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.097e-06 2024-09-12T16:18:38.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:38.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556512+0000", 2024-09-12T16:18:38.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8229999999999997e-06 2024-09-12T16:18:38.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:38.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556517+0000", 2024-09-12T16:18:38.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6289999999999998e-06 2024-09-12T16:18:38.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608797+0000", 2024-09-12T16:18:38.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052279651000000003 2024-09-12T16:18:38.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:38.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608852+0000", 2024-09-12T16:18:38.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4994999999999998e-05 2024-09-12T16:18:38.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:38.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608907+0000", 2024-09-12T16:18:38.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4755e-05 2024-09-12T16:18:38.974 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.974 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:38.974 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.975 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5643 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1187840~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:38.975 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556525+0000", 2024-09-12T16:18:38.975 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.358718240999998, 2024-09-12T16:18:38.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052518288000000003, 2024-09-12T16:18:38.975 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:38.975 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:38.975 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:38.975 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:38.975 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:38.975 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:38.975 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5643 2024-09-12T16:18:38.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.975 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:38.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:38.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556525+0000", 2024-09-12T16:18:38.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:38.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556525+0000", 2024-09-12T16:18:38.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:38.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556525+0000", 2024-09-12T16:18:38.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0400000000000002e-07 2024-09-12T16:18:38.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:38.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556528+0000", 2024-09-12T16:18:38.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8679999999999999e-06 2024-09-12T16:18:38.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:38.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556536+0000", 2024-09-12T16:18:38.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3089999999999996e-06 2024-09-12T16:18:38.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:38.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556541+0000", 2024-09-12T16:18:38.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3120000000000001e-06 2024-09-12T16:18:38.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608943+0000", 2024-09-12T16:18:38.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052401089999999997 2024-09-12T16:18:38.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:38.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608991+0000", 2024-09-12T16:18:38.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8633e-05 2024-09-12T16:18:38.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:38.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609043+0000", 2024-09-12T16:18:38.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1672000000000003e-05 2024-09-12T16:18:38.979 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.979 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:38.979 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.979 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5644 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1241088~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:38.979 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556548+0000", 2024-09-12T16:18:38.979 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.358694708000002, 2024-09-12T16:18:38.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052634777000000001, 2024-09-12T16:18:38.979 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:38.979 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:38.980 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:38.980 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:38.980 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:38.980 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:38.980 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5644 2024-09-12T16:18:38.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.980 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:38.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:38.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556548+0000", 2024-09-12T16:18:38.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:38.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556548+0000", 2024-09-12T16:18:38.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:38.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556549+0000", 2024-09-12T16:18:38.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1900000000000003e-07 2024-09-12T16:18:38.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:38.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556555+0000", 2024-09-12T16:18:38.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.652e-06 2024-09-12T16:18:38.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:38.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556562+0000", 2024-09-12T16:18:38.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.905e-06 2024-09-12T16:18:38.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:38.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556567+0000", 2024-09-12T16:18:38.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1730000000000003e-06 2024-09-12T16:18:38.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609079+0000", 2024-09-12T16:18:38.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052511993 2024-09-12T16:18:38.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:38.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609125+0000", 2024-09-12T16:18:38.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5327000000000002e-05 2024-09-12T16:18:38.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:38.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609183+0000", 2024-09-12T16:18:38.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8208000000000002e-05 2024-09-12T16:18:38.983 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.984 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:38.984 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.984 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5645 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1294336~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:38.984 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556574+0000", 2024-09-12T16:18:38.984 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.358668309999999, 2024-09-12T16:18:38.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052876909999999999, 2024-09-12T16:18:38.984 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:38.984 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:38.984 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:38.984 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:38.985 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:38.985 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:38.985 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5645 2024-09-12T16:18:38.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.985 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:38.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:38.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556574+0000", 2024-09-12T16:18:38.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:38.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556574+0000", 2024-09-12T16:18:38.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:38.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556575+0000", 2024-09-12T16:18:38.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.89e-07 2024-09-12T16:18:38.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:38.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556577+0000", 2024-09-12T16:18:38.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8700000000000001e-06 2024-09-12T16:18:38.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:38.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556583+0000", 2024-09-12T16:18:38.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4320000000000004e-06 2024-09-12T16:18:38.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:38.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556589+0000", 2024-09-12T16:18:38.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3890000000000004e-06 2024-09-12T16:18:38.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609236+0000", 2024-09-12T16:18:38.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052647022000000002 2024-09-12T16:18:38.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:38.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609334+0000", 2024-09-12T16:18:38.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8039000000000001e-05 2024-09-12T16:18:38.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:38.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609451+0000", 2024-09-12T16:18:38.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117769 2024-09-12T16:18:38.988 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.988 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:38.989 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.989 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5646 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1355776~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:38.989 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556595+0000", 2024-09-12T16:18:38.989 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.358647329, 2024-09-12T16:18:38.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053088173000000002, 2024-09-12T16:18:38.989 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:38.989 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:38.989 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:38.989 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:38.989 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:38.990 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:38.990 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5646 2024-09-12T16:18:38.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.990 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:38.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:38.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556595+0000", 2024-09-12T16:18:38.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:38.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556595+0000", 2024-09-12T16:18:38.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:38.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556596+0000", 2024-09-12T16:18:38.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:18:38.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:38.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556598+0000", 2024-09-12T16:18:38.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0669999999999999e-06 2024-09-12T16:18:38.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:38.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556603+0000", 2024-09-12T16:18:38.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5210000000000002e-06 2024-09-12T16:18:38.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:38.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556609+0000", 2024-09-12T16:18:38.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1590000000000001e-06 2024-09-12T16:18:38.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609499+0000", 2024-09-12T16:18:38.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052890489999999998 2024-09-12T16:18:38.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:38.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609586+0000", 2024-09-12T16:18:38.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6681999999999994e-05 2024-09-12T16:18:38.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:38.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609684+0000", 2024-09-12T16:18:38.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7863999999999997e-05 2024-09-12T16:18:38.993 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.993 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:38.993 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.994 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5647 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1409024~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:38.994 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556616+0000", 2024-09-12T16:18:38.994 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.358627034000001, 2024-09-12T16:18:38.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053207888000000002, 2024-09-12T16:18:38.994 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:38.994 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:38.994 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:38.994 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:38.994 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:38.994 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:38.994 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5647 2024-09-12T16:18:38.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.994 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:38.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:38.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556616+0000", 2024-09-12T16:18:38.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:38.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556616+0000", 2024-09-12T16:18:38.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:38.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:38.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556616+0000", 2024-09-12T16:18:38.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3599999999999999e-07 2024-09-12T16:18:38.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:38.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556618+0000", 2024-09-12T16:18:38.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1550000000000001e-06 2024-09-12T16:18:38.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:38.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556624+0000", 2024-09-12T16:18:38.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0499999999999997e-06 2024-09-12T16:18:38.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:38.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556629+0000", 2024-09-12T16:18:38.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8840000000000002e-06 2024-09-12T16:18:38.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:38.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609721+0000", 2024-09-12T16:18:38.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053091808999999997 2024-09-12T16:18:38.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:38.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609767+0000", 2024-09-12T16:18:38.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.638e-05 2024-09-12T16:18:38.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:38.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609824+0000", 2024-09-12T16:18:38.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6174000000000001e-05 2024-09-12T16:18:38.998 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.998 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:38.998 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:38.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.998 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5648 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1462272~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:38.998 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556636+0000", 2024-09-12T16:18:38.998 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.358606375000001, 2024-09-12T16:18:38.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053322131000000002, 2024-09-12T16:18:38.999 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:38.999 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:38.999 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:38.999 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:38.999 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:38.999 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:38.999 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5648 2024-09-12T16:18:38.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:38.999 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:38.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:38.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:38.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556636+0000", 2024-09-12T16:18:38.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:39.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:39.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:39.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:39.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556636+0000", 2024-09-12T16:18:39.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:39.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:39.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:39.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:39.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557015+0000", 2024-09-12T16:18:39.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000378911 2024-09-12T16:18:39.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:39.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:39.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:39.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557019+0000", 2024-09-12T16:18:39.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2100000000000002e-06 2024-09-12T16:18:39.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:39.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:39.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:39.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557030+0000", 2024-09-12T16:18:39.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.149e-05 2024-09-12T16:18:39.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:39.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:39.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:39.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557037+0000", 2024-09-12T16:18:39.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5719999999999999e-06 2024-09-12T16:18:39.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:39.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:39.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:39.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609838+0000", 2024-09-12T16:18:39.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052801305999999999 2024-09-12T16:18:39.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:39.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:39.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:39.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609880+0000", 2024-09-12T16:18:39.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2604000000000001e-05 2024-09-12T16:18:39.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:39.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:39.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:39.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609959+0000", 2024-09-12T16:18:39.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8038000000000001e-05 2024-09-12T16:18:39.002 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:39.003 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:39.003 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:39.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:39.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:39.003 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5649 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1515520~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:39.003 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.557073+0000", 2024-09-12T16:18:39.003 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.358169373999999, 2024-09-12T16:18:39.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053030573999999997, 2024-09-12T16:18:39.003 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:39.003 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:39.003 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:39.003 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:39.003 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:39.004 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:39.004 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5649 2024-09-12T16:18:39.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:39.004 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:39.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:39.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:39.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557073+0000", 2024-09-12T16:18:39.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:39.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:39.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:39.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:39.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557073+0000", 2024-09-12T16:18:39.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:39.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:39.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:39.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:39.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557074+0000", 2024-09-12T16:18:39.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5199999999999996e-07 2024-09-12T16:18:39.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:39.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:39.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:39.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557084+0000", 2024-09-12T16:18:39.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0349e-05 2024-09-12T16:18:39.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:39.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:39.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:39.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557092+0000", 2024-09-12T16:18:39.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9699999999999999e-06 2024-09-12T16:18:39.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:39.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:39.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:39.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557100+0000", 2024-09-12T16:18:39.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7049999999999999e-06 2024-09-12T16:18:39.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:39.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:39.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:39.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609992+0000", 2024-09-12T16:18:39.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052891821999999998 2024-09-12T16:18:39.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:39.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:39.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:39.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610034+0000", 2024-09-12T16:18:39.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2141000000000002e-05 2024-09-12T16:18:39.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:39.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:39.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:39.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610104+0000", 2024-09-12T16:18:39.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9935e-05 2024-09-12T16:18:39.007 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:39.007 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:39.007 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:39.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:39.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:39.008 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5650 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1568768~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:39.008 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.557111+0000", 2024-09-12T16:18:39.008 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.358132152000003, 2024-09-12T16:18:39.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053118023, 2024-09-12T16:18:39.008 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:39.008 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:39.008 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:39.008 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:39.008 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:39.008 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:39.008 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5650 2024-09-12T16:18:39.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:39.009 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:39.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:39.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:39.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557111+0000", 2024-09-12T16:18:39.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:39.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:39.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:39.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:39.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557111+0000", 2024-09-12T16:18:39.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:39.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:39.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:39.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:39.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.562089+0000", 2024-09-12T16:18:39.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0049787410000000001 2024-09-12T16:18:39.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:39.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:39.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:39.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.562094+0000", 2024-09-12T16:18:39.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7210000000000002e-06 2024-09-12T16:18:39.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:39.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:39.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:39.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.562105+0000", 2024-09-12T16:18:39.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0458999999999999e-05 2024-09-12T16:18:39.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:39.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:39.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:39.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.562112+0000", 2024-09-12T16:18:39.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0280000000000003e-06 2024-09-12T16:18:39.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:39.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:39.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:39.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610135+0000", 2024-09-12T16:18:39.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048023374000000001 2024-09-12T16:18:39.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:39.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:39.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:39.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610177+0000", 2024-09-12T16:18:39.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2119000000000001e-05 2024-09-12T16:18:39.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:39.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:39.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:39.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610229+0000", 2024-09-12T16:18:39.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1581e-05 2024-09-12T16:18:39.012 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:39.012 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:39.012 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:39.012 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:39.012 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:39.012 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:39.014 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:18:39.014 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:39.013+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:39.112 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T16:18:39.114 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:39.113+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:39.134 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:39.134 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:39.134 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:18:39.134 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:39.143 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:18:39.194 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.0 to 1 (10000) 2024-09-12T16:18:39.215 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-12T16:18:39.215 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:39.214+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:39.247 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:18:39.248 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:18:39.265 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:18:39.265 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:18:39.268 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:39.268 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:39.268 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:18:39.268 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:18:39.268 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:39.278 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:18:39.287 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:18:39.288 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:18:39.305 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:18:39.306 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:18:39.316 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:39.315+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:39.323 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:18:39.323 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:18:39.340 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:18:39.340 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:18:39.389 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:39.390 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:39.398 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:18:39.442 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:39.442+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:39.506 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:39.506 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:39.514 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:18:39.555 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:39.555+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:39.619 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:39.619+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:39.661 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:39.661 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:39.670 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:18:39.720 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:39.719+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:39.817 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:39.818 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:39.821 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:39.820+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:39.826 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:18:39.922 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:39.922+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:39.976 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:39.976 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:39.982 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:18:40.023 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:40.023+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:40.040 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T16:18:40.124 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:40.124+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:40.129 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:40.129 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:40.138 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:18:40.197 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.1 to 1 (10000) 2024-09-12T16:18:40.210 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-12T16:18:40.225 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:40.225+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:40.299 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:40.299 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:40.307 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:18:40.351 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:40.350+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:40.420 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:40.421 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:40.427 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:40.426+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:40.429 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:18:40.528 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:40.527+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:40.577 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:40.577 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:40.586 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:18:40.629 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:40.629+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:40.693 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:40.693 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:40.702 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:18:40.746 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:40.745+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:40.809 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:40.809 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:40.818 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:18:40.831 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:40.831+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:40.932 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:40.932+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:40.965 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:40.965 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:40.973 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:18:41.033 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:41.033+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:41.081 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:41.081 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:41.090 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:18:41.133 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:41.133+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:41.200 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2024-09-12T16:18:41.201 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.2 to 1 (10000) 2024-09-12T16:18:41.201 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:41.201 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:41.214 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:18:41.221 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-12T16:18:41.265 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:41.264+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:41.334 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:41.334 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:41.335 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:41.334+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:41.344 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:18:41.352 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T16:18:41.436 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:41.435+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:41.455 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:41.455 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:41.465 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:18:41.510 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:18:41.511 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:18:41.527 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:18:41.527 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:18:41.537 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:41.536+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:41.543 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:18:41.544 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:18:41.560 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:18:41.560 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:18:41.576 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:18:41.577 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:18:41.583 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:41.584 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:41.584 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:18:41.584 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:41.593 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:18:41.594 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:18:41.594 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:18:41.637 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:41.636+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:41.737 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:41.737+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:41.741 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:41.741 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:41.741 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:18:41.741 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:18:41.741 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:41.750 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:18:41.838 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:41.838+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:41.900 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:41.900 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:18:41.900 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:18:41.900 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:18:41.900 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.900 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:18:41.900 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:18:41.900 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 180.13360576700001, 2024-09-12T16:18:41.900 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55645454900000002, 2024-09-12T16:18:41.900 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:41.900 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:41.901 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:41.901 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:41.901 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:18:41.901 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:18:41.901 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1 2024-09-12T16:18:41.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.901 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:41.901 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.901 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:41.901 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:18:41.901 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.901 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.901 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:41.902 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:18:41.902 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.902 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.902 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:41.902 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764440+0000", 2024-09-12T16:18:41.902 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6249999999999999e-06 2024-09-12T16:18:41.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.902 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.902 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:41.902 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764447+0000", 2024-09-12T16:18:41.902 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4939999999999997e-06 2024-09-12T16:18:41.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.902 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.902 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:41.903 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764459+0000", 2024-09-12T16:18:41.903 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1517e-05 2024-09-12T16:18:41.903 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.903 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.903 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:41.903 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764468+0000", 2024-09-12T16:18:41.903 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7690000000000002e-06 2024-09-12T16:18:41.903 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.903 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.904 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:41.904 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764539+0000", 2024-09-12T16:18:41.904 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1103e-05 2024-09-12T16:18:41.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.904 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.904 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:41.904 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764551+0000", 2024-09-12T16:18:41.904 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2687999999999999e-05 2024-09-12T16:18:41.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.904 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.904 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:41.904 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319497+0000", 2024-09-12T16:18:41.904 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55494560500000001 2024-09-12T16:18:41.905 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.905 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.905 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:41.905 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319688+0000", 2024-09-12T16:18:41.905 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019105599999999999 2024-09-12T16:18:41.905 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.905 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.905 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:18:41.905 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319842+0000", 2024-09-12T16:18:41.905 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015377699999999999 2024-09-12T16:18:41.905 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.905 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.905 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:18:41.906 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320473+0000", 2024-09-12T16:18:41.906 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00063117100000000003 2024-09-12T16:18:41.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.906 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.906 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:41.906 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320825+0000", 2024-09-12T16:18:41.906 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00035202500000000001 2024-09-12T16:18:41.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.906 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.906 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:41.906 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320867+0000", 2024-09-12T16:18:41.906 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2005000000000002e-05 2024-09-12T16:18:41.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.906 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.906 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:41.907 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320893+0000", 2024-09-12T16:18:41.907 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5714000000000001e-05 2024-09-12T16:18:41.907 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:41.907 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:41.907 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:41.907 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.907 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.907 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14034 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5035008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:41.907 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:18:41.907 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 142.376547534, 2024-09-12T16:18:41.907 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053404082999999998, 2024-09-12T16:18:41.907 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:41.907 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:41.907 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:41.907 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:41.908 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:41.908 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:41.908 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14034 2024-09-12T16:18:41.908 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.908 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:41.908 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.908 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:41.908 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:18:41.908 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.908 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.908 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.908 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:41.908 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:18:41.908 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.908 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.909 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.909 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:41.909 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521740+0000", 2024-09-12T16:18:41.909 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000243976 2024-09-12T16:18:41.909 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.909 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.909 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:41.909 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521745+0000", 2024-09-12T16:18:41.909 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1280000000000001e-06 2024-09-12T16:18:41.909 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.909 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.909 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:41.909 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521757+0000", 2024-09-12T16:18:41.909 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2751e-05 2024-09-12T16:18:41.910 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.910 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.910 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:41.910 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521771+0000", 2024-09-12T16:18:41.910 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3328e-05 2024-09-12T16:18:41.910 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.910 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.910 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:41.910 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574710+0000", 2024-09-12T16:18:41.910 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052939358999999998 2024-09-12T16:18:41.910 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.910 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.910 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:41.910 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574799+0000", 2024-09-12T16:18:41.910 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8893000000000004e-05 2024-09-12T16:18:41.910 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.911 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.911 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:41.911 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574901+0000", 2024-09-12T16:18:41.911 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101648 2024-09-12T16:18:41.911 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:41.911 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:41.911 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:41.911 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.911 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.911 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14036 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5043200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:41.911 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:18:41.911 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 142.37608834, 2024-09-12T16:18:41.911 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053426247000000003, 2024-09-12T16:18:41.911 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:41.912 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:41.912 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:41.912 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:41.912 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:41.912 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:41.912 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14036 2024-09-12T16:18:41.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.912 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:41.912 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.912 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:41.912 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:18:41.912 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.912 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.913 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:41.913 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:18:41.913 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.913 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.913 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.913 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:41.913 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522208+0000", 2024-09-12T16:18:41.913 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025195300000000002 2024-09-12T16:18:41.913 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.913 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.913 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:41.913 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522211+0000", 2024-09-12T16:18:41.913 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2160000000000002e-06 2024-09-12T16:18:41.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.914 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:41.914 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522223+0000", 2024-09-12T16:18:41.914 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2044e-05 2024-09-12T16:18:41.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.914 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:41.914 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522229+0000", 2024-09-12T16:18:41.914 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8850000000000004e-06 2024-09-12T16:18:41.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.914 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:41.914 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575192+0000", 2024-09-12T16:18:41.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052963573 2024-09-12T16:18:41.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.915 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:41.915 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575282+0000", 2024-09-12T16:18:41.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9666000000000005e-05 2024-09-12T16:18:41.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.915 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:41.915 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575382+0000", 2024-09-12T16:18:41.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9909999999999997e-05 2024-09-12T16:18:41.915 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:41.915 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:41.915 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:41.916 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.916 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.916 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14039 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5055488~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:41.916 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:18:41.916 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 142.375408556, 2024-09-12T16:18:41.916 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053466207000000002, 2024-09-12T16:18:41.916 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:41.916 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:41.916 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:41.916 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:41.916 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:41.916 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:41.916 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14039 2024-09-12T16:18:41.916 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.917 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:41.917 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.917 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:41.917 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:18:41.917 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.917 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.917 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.917 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:41.917 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:18:41.917 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.917 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.917 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.917 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:41.918 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522899+0000", 2024-09-12T16:18:41.918 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026318199999999999 2024-09-12T16:18:41.918 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.918 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.918 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:41.918 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522903+0000", 2024-09-12T16:18:41.918 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.929e-06 2024-09-12T16:18:41.918 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.918 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.918 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:41.918 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522913+0000", 2024-09-12T16:18:41.918 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0162e-05 2024-09-12T16:18:41.918 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.918 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.918 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:41.919 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522921+0000", 2024-09-12T16:18:41.919 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.14e-06 2024-09-12T16:18:41.919 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.919 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.919 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:41.919 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575922+0000", 2024-09-12T16:18:41.919 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053000712999999998 2024-09-12T16:18:41.919 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.919 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.919 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:41.919 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576006+0000", 2024-09-12T16:18:41.919 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4161999999999998e-05 2024-09-12T16:18:41.919 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.920 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.920 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:41.920 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576102+0000", 2024-09-12T16:18:41.920 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5919000000000001e-05 2024-09-12T16:18:41.920 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:41.920 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:41.920 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:41.920 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.920 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.920 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14040 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5059584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:41.920 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:18:41.920 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 142.375103661, 2024-09-12T16:18:41.920 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053413258999999998, 2024-09-12T16:18:41.920 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:41.921 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:41.921 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:41.921 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:41.921 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:41.921 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:41.921 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14040 2024-09-12T16:18:41.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.921 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:41.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:41.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:18:41.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:41.922 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:18:41.922 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.922 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.922 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.922 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:41.922 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523059+0000", 2024-09-12T16:18:41.922 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118466 2024-09-12T16:18:41.922 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.922 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.922 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:41.922 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523062+0000", 2024-09-12T16:18:41.922 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.971e-06 2024-09-12T16:18:41.922 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.922 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.922 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:41.923 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523069+0000", 2024-09-12T16:18:41.923 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8279999999999997e-06 2024-09-12T16:18:41.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.923 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.923 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:41.923 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523073+0000", 2024-09-12T16:18:41.923 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3019999999999996e-06 2024-09-12T16:18:41.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.923 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.923 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:41.923 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576155+0000", 2024-09-12T16:18:41.923 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053081962000000003 2024-09-12T16:18:41.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.923 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.923 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:41.924 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576249+0000", 2024-09-12T16:18:41.924 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3914999999999998e-05 2024-09-12T16:18:41.924 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.924 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.924 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:41.924 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576354+0000", 2024-09-12T16:18:41.924 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010481500000000001 2024-09-12T16:18:41.924 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:41.924 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:41.924 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:41.924 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.924 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.924 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14041 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5063680~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:41.925 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:18:41.925 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 142.37495335599999, 2024-09-12T16:18:41.925 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053519111000000001, 2024-09-12T16:18:41.925 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:41.925 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:41.925 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:41.925 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:41.925 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:41.925 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:41.925 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14041 2024-09-12T16:18:41.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.925 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:41.926 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.926 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:41.926 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:18:41.926 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.926 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.926 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:41.926 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:18:41.926 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.926 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.926 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:41.926 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523309+0000", 2024-09-12T16:18:41.926 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000218712 2024-09-12T16:18:41.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.927 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.927 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:41.927 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523313+0000", 2024-09-12T16:18:41.927 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.151e-06 2024-09-12T16:18:41.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.927 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.927 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:41.927 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523320+0000", 2024-09-12T16:18:41.927 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9789999999999993e-06 2024-09-12T16:18:41.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.927 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.927 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:41.927 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523325+0000", 2024-09-12T16:18:41.927 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:18:41.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.928 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.928 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:41.928 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576402+0000", 2024-09-12T16:18:41.928 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053076811000000002 2024-09-12T16:18:41.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.928 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.928 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:41.928 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576491+0000", 2024-09-12T16:18:41.928 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8578999999999993e-05 2024-09-12T16:18:41.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.928 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.928 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:41.929 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576610+0000", 2024-09-12T16:18:41.929 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119129 2024-09-12T16:18:41.929 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:41.929 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:41.929 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:41.929 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.929 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.929 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14042 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5067776~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:41.929 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:18:41.929 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 142.37470992199999, 2024-09-12T16:18:41.929 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053510350999999998, 2024-09-12T16:18:41.929 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:41.929 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:41.930 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:41.930 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:41.930 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:41.930 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:41.930 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14042 2024-09-12T16:18:41.930 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.930 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:41.930 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.930 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:41.930 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:18:41.930 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.930 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.930 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.930 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:41.930 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:18:41.930 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.931 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.931 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:41.931 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523591+0000", 2024-09-12T16:18:41.931 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025710300000000001 2024-09-12T16:18:41.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.931 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.931 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:41.931 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523594+0000", 2024-09-12T16:18:41.931 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2229999999999999e-06 2024-09-12T16:18:41.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.931 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.931 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:41.931 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523602+0000", 2024-09-12T16:18:41.931 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6930000000000007e-06 2024-09-12T16:18:41.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.932 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.932 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:41.932 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523607+0000", 2024-09-12T16:18:41.932 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4789999999999998e-06 2024-09-12T16:18:41.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.932 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.932 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:41.932 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576661+0000", 2024-09-12T16:18:41.932 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053973999999997 2024-09-12T16:18:41.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.932 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.932 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:41.932 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576745+0000", 2024-09-12T16:18:41.932 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4660000000000006e-05 2024-09-12T16:18:41.933 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.933 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.933 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:41.933 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576844+0000", 2024-09-12T16:18:41.933 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9219e-05 2024-09-12T16:18:41.933 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:41.933 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:41.933 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:41.933 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.933 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.933 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14043 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5071872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:41.933 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:18:41.933 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 142.374429443, 2024-09-12T16:18:41.933 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053475295999999999, 2024-09-12T16:18:41.934 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:41.934 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:41.934 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:41.934 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:41.934 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:41.934 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:41.934 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14043 2024-09-12T16:18:41.934 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.934 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:41.934 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.934 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:41.934 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:18:41.934 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.934 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.935 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.935 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:41.935 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:18:41.935 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.935 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.935 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:41.935 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523823+0000", 2024-09-12T16:18:41.935 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020818900000000001 2024-09-12T16:18:41.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.935 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.935 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:41.935 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523826+0000", 2024-09-12T16:18:41.935 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.405e-06 2024-09-12T16:18:41.936 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.936 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.936 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:41.936 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523834+0000", 2024-09-12T16:18:41.936 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5499999999999997e-06 2024-09-12T16:18:41.936 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.936 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.936 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:41.936 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523838+0000", 2024-09-12T16:18:41.936 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.408e-06 2024-09-12T16:18:41.936 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.936 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.936 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:41.936 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576904+0000", 2024-09-12T16:18:41.936 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053065687 2024-09-12T16:18:41.937 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.937 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.937 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:41.937 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576991+0000", 2024-09-12T16:18:41.937 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7399999999999997e-05 2024-09-12T16:18:41.937 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.937 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.937 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:41.937 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577090+0000", 2024-09-12T16:18:41.937 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8657000000000001e-05 2024-09-12T16:18:41.937 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:41.937 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:41.937 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:41.937 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.938 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.938 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14044 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5075968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:41.938 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:18:41.938 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 142.37419791299999, 2024-09-12T16:18:41.938 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053442659000000003, 2024-09-12T16:18:41.938 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:41.938 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:41.938 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:41.938 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:41.938 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:41.938 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:41.938 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14044 2024-09-12T16:18:41.938 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.938 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:41.938 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.939 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:41.939 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:18:41.939 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.939 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.939 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.939 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:41.939 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:18:41.939 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.939 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.939 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.939 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:41.939 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523985+0000", 2024-09-12T16:18:41.939 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000138522 2024-09-12T16:18:41.939 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.940 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.940 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:41.940 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523988+0000", 2024-09-12T16:18:41.940 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.788e-06 2024-09-12T16:18:41.940 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.940 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.940 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:41.940 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523998+0000", 2024-09-12T16:18:41.940 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8470000000000008e-06 2024-09-12T16:18:41.940 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.940 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.940 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:41.940 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524010+0000", 2024-09-12T16:18:41.941 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1348999999999999e-05 2024-09-12T16:18:41.941 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.941 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.941 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:41.941 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577137+0000", 2024-09-12T16:18:41.941 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053127055999999999 2024-09-12T16:18:41.941 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.941 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.941 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:41.941 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577210+0000", 2024-09-12T16:18:41.941 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3392000000000005e-05 2024-09-12T16:18:41.941 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.941 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.942 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:41.942 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577289+0000", 2024-09-12T16:18:41.942 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8704999999999999e-05 2024-09-12T16:18:41.942 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:41.942 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:41.942 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:41.942 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.942 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.942 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14045 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5080064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:41.942 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:18:41.942 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 142.374019092, 2024-09-12T16:18:41.942 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053497514000000003, 2024-09-12T16:18:41.942 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:41.943 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:41.943 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:41.943 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:41.943 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:41.943 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:41.943 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14045 2024-09-12T16:18:41.943 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.943 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:41.943 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.943 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:41.943 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:18:41.943 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.943 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.944 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.944 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:41.944 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:18:41.944 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.944 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.944 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.944 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:41.944 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524311+0000", 2024-09-12T16:18:41.944 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028626299999999998 2024-09-12T16:18:41.944 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.945 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.945 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:41.945 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524315+0000", 2024-09-12T16:18:41.945 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0969999999999999e-06 2024-09-12T16:18:41.945 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.945 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.945 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:41.946 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524325+0000", 2024-09-12T16:18:41.946 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6330000000000008e-06 2024-09-12T16:18:41.946 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.946 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.946 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:41.946 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524332+0000", 2024-09-12T16:18:41.946 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8700000000000003e-06 2024-09-12T16:18:41.946 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.946 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.946 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:41.946 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577334+0000", 2024-09-12T16:18:41.946 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053001834999999997 2024-09-12T16:18:41.946 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.946 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.946 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:41.947 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577420+0000", 2024-09-12T16:18:41.947 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6145999999999998e-05 2024-09-12T16:18:41.947 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.947 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.947 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:41.947 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577522+0000", 2024-09-12T16:18:41.947 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010267 2024-09-12T16:18:41.947 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:41.947 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:41.947 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:41.947 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.947 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.947 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14047 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5088256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:41.947 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:18:41.947 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 142.373533366, 2024-09-12T16:18:41.948 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053433340000000003, 2024-09-12T16:18:41.948 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:41.948 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:41.948 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:41.948 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:41.948 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:41.948 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:41.948 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14047 2024-09-12T16:18:41.948 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.948 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:41.948 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.948 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:41.948 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:18:41.948 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.948 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.949 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.949 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:41.949 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:18:41.949 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.949 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.949 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.949 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:41.949 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524727+0000", 2024-09-12T16:18:41.949 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000216126 2024-09-12T16:18:41.949 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.949 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.949 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:41.949 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524732+0000", 2024-09-12T16:18:41.949 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1569999999999999e-06 2024-09-12T16:18:41.950 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.950 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.950 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:41.950 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524742+0000", 2024-09-12T16:18:41.950 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0186999999999999e-05 2024-09-12T16:18:41.950 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.950 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.950 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:41.950 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524750+0000", 2024-09-12T16:18:41.950 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4279999999999999e-06 2024-09-12T16:18:41.950 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.950 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.950 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:41.950 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577743+0000", 2024-09-12T16:18:41.951 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052993077 2024-09-12T16:18:41.951 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.951 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.951 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:41.951 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577841+0000", 2024-09-12T16:18:41.951 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8369000000000006e-05 2024-09-12T16:18:41.951 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.951 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.951 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:41.951 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577944+0000", 2024-09-12T16:18:41.951 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102996 2024-09-12T16:18:41.951 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:41.951 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:41.951 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:41.951 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.952 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.952 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14048 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5092352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:41.952 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:18:41.952 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 142.373281773, 2024-09-12T16:18:41.952 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053397515, 2024-09-12T16:18:41.952 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:41.952 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:41.952 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:41.952 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:41.952 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:41.952 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:41.952 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14048 2024-09-12T16:18:41.952 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.952 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:41.953 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.953 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:41.953 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:18:41.953 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.953 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.953 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.953 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:41.953 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:18:41.953 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.953 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.953 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.953 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:41.953 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524957+0000", 2024-09-12T16:18:41.953 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019516999999999999 2024-09-12T16:18:41.954 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.954 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.954 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:41.954 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524962+0000", 2024-09-12T16:18:41.954 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7709999999999997e-06 2024-09-12T16:18:41.954 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.954 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.954 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:41.954 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524973+0000", 2024-09-12T16:18:41.954 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1031e-05 2024-09-12T16:18:41.954 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.954 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.954 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:41.954 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524980+0000", 2024-09-12T16:18:41.955 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6100000000000002e-06 2024-09-12T16:18:41.955 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.955 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.955 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:41.955 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577977+0000", 2024-09-12T16:18:41.955 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052997481999999999 2024-09-12T16:18:41.955 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.955 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.955 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:41.955 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578062+0000", 2024-09-12T16:18:41.955 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4851000000000005e-05 2024-09-12T16:18:41.955 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.955 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.955 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:41.955 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578160+0000", 2024-09-12T16:18:41.955 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7600000000000001e-05 2024-09-12T16:18:41.956 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:41.956 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:41.956 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:41.956 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.956 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.956 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14049 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5096448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:41.956 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:18:41.956 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 142.373053145, 2024-09-12T16:18:41.956 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053439792, 2024-09-12T16:18:41.956 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:41.956 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:41.956 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:41.956 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:41.956 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:41.957 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:41.957 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14049 2024-09-12T16:18:41.957 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.957 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:41.957 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.957 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:41.957 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:18:41.957 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.957 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.957 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.957 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:41.957 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:18:41.957 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.957 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.957 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.957 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:41.958 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525170+0000", 2024-09-12T16:18:41.958 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017958500000000001 2024-09-12T16:18:41.958 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.958 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.958 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:41.958 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525174+0000", 2024-09-12T16:18:41.958 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0239999999999999e-06 2024-09-12T16:18:41.958 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.958 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.958 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:41.958 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525184+0000", 2024-09-12T16:18:41.958 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5950000000000005e-06 2024-09-12T16:18:41.958 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.958 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.958 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:41.959 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525191+0000", 2024-09-12T16:18:41.959 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8329999999999996e-06 2024-09-12T16:18:41.959 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.959 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.959 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:41.959 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578240+0000", 2024-09-12T16:18:41.959 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053049236 2024-09-12T16:18:41.960 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.960 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.960 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:41.960 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578333+0000", 2024-09-12T16:18:41.960 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2806999999999994e-05 2024-09-12T16:18:41.961 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.961 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.961 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:41.961 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578431+0000", 2024-09-12T16:18:41.961 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7712000000000002e-05 2024-09-12T16:18:41.961 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:41.961 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:41.961 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:41.961 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.961 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.961 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14055 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5121024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:41.961 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:18:41.961 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 142.371782454, 2024-09-12T16:18:41.962 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053399038000000003, 2024-09-12T16:18:41.962 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:41.962 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:41.962 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:41.962 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:41.962 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:41.962 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:41.962 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14055 2024-09-12T16:18:41.962 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.962 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:41.962 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.962 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:41.962 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:18:41.962 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.963 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.963 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.963 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:41.963 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:18:41.963 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.963 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.963 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.963 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:41.963 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526403+0000", 2024-09-12T16:18:41.963 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141571 2024-09-12T16:18:41.963 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.963 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.963 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:41.963 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526406+0000", 2024-09-12T16:18:41.963 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2660000000000002e-06 2024-09-12T16:18:41.964 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.964 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.964 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:41.964 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526420+0000", 2024-09-12T16:18:41.964 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3949e-05 2024-09-12T16:18:41.964 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.964 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.964 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:41.964 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526428+0000", 2024-09-12T16:18:41.964 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4250000000000001e-06 2024-09-12T16:18:41.964 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.965 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.965 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:41.965 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579476+0000", 2024-09-12T16:18:41.965 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053048349000000002 2024-09-12T16:18:41.965 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.966 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.966 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:41.966 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579563+0000", 2024-09-12T16:18:41.966 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6502999999999995e-05 2024-09-12T16:18:41.966 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.967 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.967 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:41.967 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579661+0000", 2024-09-12T16:18:41.967 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7974999999999996e-05 2024-09-12T16:18:41.967 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:41.967 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:41.967 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:41.967 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.968 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.968 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4806.0:3139 3.1e 3:78d5a095:::rbd_data.11552a37e55b.0000000000000000:head [read 69632~61440] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:18:41.968 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:18:41.968 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 131.59678820400001, 2024-09-12T16:18:41.968 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057851734000000002, 2024-09-12T16:18:41.968 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:41.968 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:41.968 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:41.968 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:41.968 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4806", 2024-09-12T16:18:41.968 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3959815836", 2024-09-12T16:18:41.969 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 3139 2024-09-12T16:18:41.969 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.969 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:41.969 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.969 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:41.969 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:18:41.969 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.969 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.969 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.969 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:41.969 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:18:41.970 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.970 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.970 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.970 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:41.970 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:18:41.970 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4799999999999999e-07 2024-09-12T16:18:41.970 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.970 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.970 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:41.970 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301258+0000", 2024-09-12T16:18:41.970 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.844e-06 2024-09-12T16:18:41.970 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.970 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.971 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:41.971 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301267+0000", 2024-09-12T16:18:41.971 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2960000000000004e-06 2024-09-12T16:18:41.971 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.971 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.971 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:41.971 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301276+0000", 2024-09-12T16:18:41.971 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0650000000000005e-06 2024-09-12T16:18:41.971 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.971 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.971 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:41.971 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301871+0000", 2024-09-12T16:18:41.971 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00059423600000000005 2024-09-12T16:18:41.971 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.972 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.972 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:41.972 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301920+0000", 2024-09-12T16:18:41.972 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9067000000000003e-05 2024-09-12T16:18:41.972 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.972 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.972 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:41.972 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359108+0000", 2024-09-12T16:18:41.972 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057187877999999998 2024-09-12T16:18:41.972 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:41.972 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:41.972 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:41.973 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.973 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.973 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:6428 3.14 3:28a44e54:::rbd_header.11552a37e55b:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:18:41.973 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:18:41.973 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 131.59645961000001, 2024-09-12T16:18:41.973 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057504023000000001, 2024-09-12T16:18:41.973 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:41.973 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:41.973 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:41.973 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:41.973 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:18:41.973 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:18:41.973 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6428 2024-09-12T16:18:41.973 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.973 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:41.974 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.974 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:41.974 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:18:41.974 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.974 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.974 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.974 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:41.974 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:18:41.974 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.974 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.974 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.974 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:41.974 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301585+0000", 2024-09-12T16:18:41.974 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6300000000000005e-07 2024-09-12T16:18:41.974 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.975 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.975 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:41.975 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301588+0000", 2024-09-12T16:18:41.975 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4149999999999999e-06 2024-09-12T16:18:41.975 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.975 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.975 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:41.975 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301597+0000", 2024-09-12T16:18:41.975 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5450000000000003e-06 2024-09-12T16:18:41.975 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.975 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.975 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:41.975 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301617+0000", 2024-09-12T16:18:41.975 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9837e-05 2024-09-12T16:18:41.976 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.976 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.976 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:41.976 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301779+0000", 2024-09-12T16:18:41.976 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016186799999999999 2024-09-12T16:18:41.976 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.976 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.976 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:41.976 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301855+0000", 2024-09-12T16:18:41.976 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5899e-05 2024-09-12T16:18:41.976 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.976 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.976 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:41.976 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359088+0000", 2024-09-12T16:18:41.977 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057233895999999999 2024-09-12T16:18:41.977 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:41.977 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:41.977 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:41.977 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.977 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.977 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5223.0:1814 3.f 3:f7b1b1c5:::rbd_object_map.1155a1fd27d2:head [read 0~136] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-12T16:18:41.977 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:18:41.977 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 95.660793545999994, 2024-09-12T16:18:41.977 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.006378226, 2024-09-12T16:18:41.977 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:41.977 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:41.977 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:41.977 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:41.978 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5223", 2024-09-12T16:18:41.978 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/4066330994", 2024-09-12T16:18:41.978 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1814 2024-09-12T16:18:41.978 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.978 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:41.978 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.978 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:41.978 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:18:41.978 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.978 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.978 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.978 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:41.978 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:18:41.978 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.978 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.979 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.979 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:41.979 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237252+0000", 2024-09-12T16:18:41.979 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.344e-06 2024-09-12T16:18:41.979 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.979 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.979 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:41.979 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237258+0000", 2024-09-12T16:18:41.979 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1070000000000001e-06 2024-09-12T16:18:41.979 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.979 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.979 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:41.979 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237270+0000", 2024-09-12T16:18:41.979 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1758e-05 2024-09-12T16:18:41.980 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.980 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.980 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:41.980 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237278+0000", 2024-09-12T16:18:41.980 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3219999999999993e-06 2024-09-12T16:18:41.980 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.980 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.980 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:41.980 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237334+0000", 2024-09-12T16:18:41.980 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6356e-05 2024-09-12T16:18:41.980 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.980 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.980 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:41.980 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237345+0000", 2024-09-12T16:18:41.980 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0433e-05 2024-09-12T16:18:41.981 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.981 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.981 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:41.981 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243426+0000", 2024-09-12T16:18:41.981 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.00608133 2024-09-12T16:18:41.981 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.981 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.981 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:41.981 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243534+0000", 2024-09-12T16:18:41.981 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010784 2024-09-12T16:18:41.981 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.981 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.982 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:41.982 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243629+0000", 2024-09-12T16:18:41.982 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4735999999999996e-05 2024-09-12T16:18:41.982 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:41.982 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:41.982 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:41.982 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.982 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.982 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5328.0:2542 3.16 3:6928f3a1:::rbd_object_map.11551722dd77:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:18:41.982 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:18:41.982 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 89.842448116, 2024-09-12T16:18:41.982 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.054219934999999997, 2024-09-12T16:18:41.982 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:41.982 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:41.983 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:41.983 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:41.983 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5328", 2024-09-12T16:18:41.983 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:18:41.983 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2542 2024-09-12T16:18:41.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.983 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:41.983 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.983 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:41.983 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:18:41.983 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.983 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.983 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:41.984 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:18:41.984 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.984 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.984 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.984 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:41.984 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055597+0000", 2024-09-12T16:18:41.984 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4300000000000001e-07 2024-09-12T16:18:41.984 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.984 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.984 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:41.984 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055602+0000", 2024-09-12T16:18:41.984 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4269999999999999e-06 2024-09-12T16:18:41.984 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.984 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.984 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:41.985 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055613+0000", 2024-09-12T16:18:41.985 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0815000000000001e-05 2024-09-12T16:18:41.985 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.985 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.985 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:41.985 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055621+0000", 2024-09-12T16:18:41.985 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4189999999999996e-06 2024-09-12T16:18:41.985 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.985 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.985 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:41.985 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102196+0000", 2024-09-12T16:18:41.985 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.046575616 2024-09-12T16:18:41.985 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.986 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.986 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:41.986 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102258+0000", 2024-09-12T16:18:41.986 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1872000000000007e-05 2024-09-12T16:18:41.986 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.986 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.986 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T16:18:41.986 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102601+0000", 2024-09-12T16:18:41.986 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034285700000000001 2024-09-12T16:18:41.986 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.986 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.986 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:41.986 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.104431+0000", 2024-09-12T16:18:41.986 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001830524 2024-09-12T16:18:41.986 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.986 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.987 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:18:41.987 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109733+0000", 2024-09-12T16:18:41.987 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0053020089999999999 2024-09-12T16:18:41.987 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.987 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.987 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:41.987 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109777+0000", 2024-09-12T16:18:41.987 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3754000000000002e-05 2024-09-12T16:18:41.987 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.987 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.987 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:41.987 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109816+0000", 2024-09-12T16:18:41.987 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8699000000000003e-05 2024-09-12T16:18:41.988 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:41.988 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:41.988 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:41.988 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.988 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.988 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5328.0:2543 3.16 3:6928f3a1:::rbd_object_map.11551722dd77:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:18:41.988 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:18:41.988 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 89.841854136999999, 2024-09-12T16:18:41.988 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053695720000000002, 2024-09-12T16:18:41.988 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:41.988 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:41.988 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:41.988 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:41.989 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5328", 2024-09-12T16:18:41.989 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:18:41.989 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2543 2024-09-12T16:18:41.989 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.989 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:41.989 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.989 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:41.989 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:18:41.989 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.989 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.989 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.989 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:41.989 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:18:41.990 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.990 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.990 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.990 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:41.990 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056191+0000", 2024-09-12T16:18:41.990 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.54e-07 2024-09-12T16:18:41.990 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.990 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.990 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:41.990 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056195+0000", 2024-09-12T16:18:41.990 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5460000000000002e-06 2024-09-12T16:18:41.990 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.990 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.990 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:41.991 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056205+0000", 2024-09-12T16:18:41.991 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7350000000000008e-06 2024-09-12T16:18:41.991 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.991 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.991 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:41.991 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056214+0000", 2024-09-12T16:18:41.991 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8089999999999999e-06 2024-09-12T16:18:41.991 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.991 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.991 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:41.991 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103317+0000", 2024-09-12T16:18:41.991 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.047102889000000002 2024-09-12T16:18:41.991 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.991 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.991 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:41.992 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103410+0000", 2024-09-12T16:18:41.992 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3689000000000004e-05 2024-09-12T16:18:41.992 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.992 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.992 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T16:18:41.992 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103754+0000", 2024-09-12T16:18:41.992 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034344699999999998 2024-09-12T16:18:41.992 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.992 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.992 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:41.992 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.106487+0000", 2024-09-12T16:18:41.992 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0027330100000000001 2024-09-12T16:18:41.992 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.992 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.992 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:18:41.993 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109827+0000", 2024-09-12T16:18:41.993 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033406640000000001 2024-09-12T16:18:41.993 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.993 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.993 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:41.993 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109854+0000", 2024-09-12T16:18:41.993 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6866999999999999e-05 2024-09-12T16:18:41.993 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.993 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.993 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:41.993 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109886+0000", 2024-09-12T16:18:41.993 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1309999999999997e-05 2024-09-12T16:18:41.993 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:41.994 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:41.994 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:41.994 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.994 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.994 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5832.0:1710 3.f 3:f0d97d21:::rbd_data.1155d3b3a2ae.0000000000000012:head [truncate 1376256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-12T16:18:41.994 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:18:41.994 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 54.514056052000001, 2024-09-12T16:18:41.994 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6441524489999999, 2024-09-12T16:18:41.994 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:41.994 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:41.994 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:41.994 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:41.994 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5832", 2024-09-12T16:18:41.994 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/201125203", 2024-09-12T16:18:41.994 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1710 2024-09-12T16:18:41.994 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.995 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:41.995 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.995 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:41.995 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:18:41.995 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.995 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.995 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.995 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:41.995 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:18:41.995 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:41.995 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.995 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.995 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:41.995 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:18:41.996 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.08e-07 2024-09-12T16:18:41.996 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.996 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.996 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:41.996 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383990+0000", 2024-09-12T16:18:41.996 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.979e-06 2024-09-12T16:18:41.996 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.996 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.996 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:41.996 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383999+0000", 2024-09-12T16:18:41.996 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3240000000000003e-06 2024-09-12T16:18:41.996 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.996 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.996 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:41.997 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.384002+0000", 2024-09-12T16:18:41.997 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5489999999999998e-06 2024-09-12T16:18:41.997 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.997 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.997 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:41.997 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.384037+0000", 2024-09-12T16:18:41.997 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4931000000000001e-05 2024-09-12T16:18:41.997 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.997 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.997 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:41.997 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.384043+0000", 2024-09-12T16:18:41.997 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3920000000000002e-06 2024-09-12T16:18:41.997 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.997 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.997 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:41.998 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:48.007976+0000", 2024-09-12T16:18:41.998 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.62393385300000004 2024-09-12T16:18:41.998 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.998 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.998 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:41.998 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:48.007992+0000", 2024-09-12T16:18:41.998 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5668e-05 2024-09-12T16:18:41.998 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.998 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.998 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:41.998 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024187+0000", 2024-09-12T16:18:41.998 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0161951629999999 2024-09-12T16:18:41.998 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.999 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.999 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:41.999 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024362+0000", 2024-09-12T16:18:41.999 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017500600000000001 2024-09-12T16:18:41.999 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:41.999 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:41.999 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:18:41.999 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024453+0000", 2024-09-12T16:18:41.999 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1055000000000001e-05 2024-09-12T16:18:41.999 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.000 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.000 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:18:42.000 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024963+0000", 2024-09-12T16:18:42.000 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000510087 2024-09-12T16:18:42.000 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.000 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.000 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:42.000 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.027974+0000", 2024-09-12T16:18:42.001 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030107070000000001 2024-09-12T16:18:42.001 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.001 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.001 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:42.001 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.028022+0000", 2024-09-12T16:18:42.001 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7636000000000003e-05 2024-09-12T16:18:42.001 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.001 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.001 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:42.001 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.028140+0000", 2024-09-12T16:18:42.001 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011869100000000001 2024-09-12T16:18:42.001 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.001 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:42.001 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.002 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.002 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:42.002 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:42.003 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:18:42.003 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:42.002+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:42.104 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:42.104+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:42.152 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:42.152 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:42.152 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:18:42.152 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:42.161 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:18:42.199 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.4 to 1 (10000) 2024-09-12T16:18:42.205 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:42.205+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:42.219 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-12T16:18:42.306 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:42.306+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:42.320 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:42.320 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:42.320 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:18:42.320 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:18:42.321 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:42.330 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:18:42.407 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:42.406+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:42.480 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:42.480 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:18:42.480 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:18:42.480 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:18:42.481 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.481 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5599 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4788224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:42.481 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:18:42.481 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 122.182513938, 2024-09-12T16:18:42.481 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061192059, 2024-09-12T16:18:42.481 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:42.481 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:42.481 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:42.481 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:42.481 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:42.481 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:42.481 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5599 2024-09-12T16:18:42.481 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.481 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:42.482 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.482 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:42.482 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:18:42.482 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.482 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.482 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.482 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:42.482 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:18:42.482 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.482 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.482 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.482 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:42.482 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296333+0000", 2024-09-12T16:18:42.483 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6599999999999996e-07 2024-09-12T16:18:42.483 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.483 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.483 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:42.483 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296335+0000", 2024-09-12T16:18:42.483 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5900000000000002e-06 2024-09-12T16:18:42.483 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.483 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.483 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:42.483 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296344+0000", 2024-09-12T16:18:42.483 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9539999999999993e-06 2024-09-12T16:18:42.484 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.484 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.484 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:42.484 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296350+0000", 2024-09-12T16:18:42.484 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5589999999999996e-06 2024-09-12T16:18:42.484 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.484 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.484 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:42.484 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357307+0000", 2024-09-12T16:18:42.484 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.060957573000000001 2024-09-12T16:18:42.484 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.484 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.484 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:42.484 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357401+0000", 2024-09-12T16:18:42.485 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3512999999999997e-05 2024-09-12T16:18:42.485 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.485 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.485 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:42.485 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357524+0000", 2024-09-12T16:18:42.485 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000123304 2024-09-12T16:18:42.485 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.485 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:42.485 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.485 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.485 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.485 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5611 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4730880~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:42.486 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:18:42.486 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 122.18245149400001, 2024-09-12T16:18:42.486 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061359348000000001, 2024-09-12T16:18:42.486 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:42.486 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:42.486 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:42.486 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:42.486 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:42.486 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:42.486 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5611 2024-09-12T16:18:42.486 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.486 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:42.486 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.487 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:42.487 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:18:42.487 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.487 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.487 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.487 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:42.487 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:18:42.487 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.487 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.487 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.487 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:42.487 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296395+0000", 2024-09-12T16:18:42.487 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4600000000000003e-07 2024-09-12T16:18:42.487 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.487 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.488 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:42.488 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296399+0000", 2024-09-12T16:18:42.488 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9430000000000002e-06 2024-09-12T16:18:42.488 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.488 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.488 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:42.488 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296411+0000", 2024-09-12T16:18:42.488 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1755e-05 2024-09-12T16:18:42.488 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.489 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.489 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:42.489 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296417+0000", 2024-09-12T16:18:42.489 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3790000000000003e-06 2024-09-12T16:18:42.489 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.489 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.489 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:42.489 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357572+0000", 2024-09-12T16:18:42.489 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061154871 2024-09-12T16:18:42.489 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.489 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.489 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:42.489 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357663+0000", 2024-09-12T16:18:42.490 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0389999999999993e-05 2024-09-12T16:18:42.490 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.490 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.490 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:42.490 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357754+0000", 2024-09-12T16:18:42.490 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1063999999999994e-05 2024-09-12T16:18:42.490 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.490 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:42.490 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.490 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.490 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.490 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5613 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4775936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:42.490 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:18:42.490 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 122.18241031399999, 2024-09-12T16:18:42.490 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061491777999999997, 2024-09-12T16:18:42.491 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:42.491 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:42.491 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:42.491 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:42.491 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:42.491 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:42.491 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5613 2024-09-12T16:18:42.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.491 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:42.491 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.491 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:42.491 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:18:42.491 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.491 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.491 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:42.492 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:18:42.492 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.492 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.492 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.492 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:42.492 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:18:42.492 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8899999999999999e-07 2024-09-12T16:18:42.492 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.492 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.492 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:42.492 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296439+0000", 2024-09-12T16:18:42.492 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8439999999999998e-06 2024-09-12T16:18:42.492 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.493 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.493 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:42.493 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296452+0000", 2024-09-12T16:18:42.493 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2639e-05 2024-09-12T16:18:42.493 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.493 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.493 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:42.493 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296457+0000", 2024-09-12T16:18:42.493 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5720000000000002e-06 2024-09-12T16:18:42.493 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.493 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.493 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:42.493 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357773+0000", 2024-09-12T16:18:42.493 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061315500000000002 2024-09-12T16:18:42.493 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.493 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.494 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:42.494 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357814+0000", 2024-09-12T16:18:42.494 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1448e-05 2024-09-12T16:18:42.494 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.494 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.494 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:42.494 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357927+0000", 2024-09-12T16:18:42.494 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000113186 2024-09-12T16:18:42.494 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.494 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:42.494 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.494 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.494 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.494 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5616 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4784128~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:42.494 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:18:42.495 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 122.182375252, 2024-09-12T16:18:42.495 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061725002000000001, 2024-09-12T16:18:42.495 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:42.495 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:42.495 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:42.495 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:42.495 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:42.495 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:42.495 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5616 2024-09-12T16:18:42.495 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.495 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:42.495 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.496 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:42.496 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:18:42.496 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.496 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.496 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.496 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:42.496 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:18:42.496 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.496 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.496 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.496 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:42.496 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:18:42.496 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5900000000000002e-07 2024-09-12T16:18:42.496 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.496 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.497 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:42.497 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296473+0000", 2024-09-12T16:18:42.497 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3130000000000001e-06 2024-09-12T16:18:42.497 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.497 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.497 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:42.497 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296481+0000", 2024-09-12T16:18:42.497 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1389999999999998e-06 2024-09-12T16:18:42.497 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.497 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.498 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:42.498 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296486+0000", 2024-09-12T16:18:42.498 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3310000000000003e-06 2024-09-12T16:18:42.498 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.498 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.498 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:42.498 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357981+0000", 2024-09-12T16:18:42.498 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061494866000000002 2024-09-12T16:18:42.498 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.498 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.498 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:42.498 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358082+0000", 2024-09-12T16:18:42.498 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101424 2024-09-12T16:18:42.498 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.498 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.499 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:42.499 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358196+0000", 2024-09-12T16:18:42.499 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011347 2024-09-12T16:18:42.499 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.499 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:42.499 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.499 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.499 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.499 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5626 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4739072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:42.499 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:18:42.499 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 122.182297296, 2024-09-12T16:18:42.499 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061802430999999998, 2024-09-12T16:18:42.499 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:42.499 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:42.500 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:42.500 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:42.500 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:42.500 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:42.500 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5626 2024-09-12T16:18:42.500 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.500 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:42.500 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.500 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:42.500 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:18:42.500 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.500 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.500 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.500 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:42.501 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:18:42.501 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.501 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.501 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.501 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:42.501 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296550+0000", 2024-09-12T16:18:42.501 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.215e-06 2024-09-12T16:18:42.501 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.501 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.501 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:42.501 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296555+0000", 2024-09-12T16:18:42.502 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9590000000000003e-06 2024-09-12T16:18:42.502 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.502 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.502 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:42.502 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296568+0000", 2024-09-12T16:18:42.502 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3338e-05 2024-09-12T16:18:42.502 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.502 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.502 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:42.502 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296576+0000", 2024-09-12T16:18:42.502 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5510000000000002e-06 2024-09-12T16:18:42.503 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.503 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.503 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:42.503 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358241+0000", 2024-09-12T16:18:42.503 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.06166576 2024-09-12T16:18:42.503 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.503 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.503 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:42.503 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358288+0000", 2024-09-12T16:18:42.503 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6097000000000003e-05 2024-09-12T16:18:42.503 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.503 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.503 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:42.503 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358351+0000", 2024-09-12T16:18:42.503 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3510999999999996e-05 2024-09-12T16:18:42.504 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.504 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:42.504 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.504 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.504 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.504 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5628 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4792320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:42.504 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:18:42.504 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 122.182254796, 2024-09-12T16:18:42.504 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061961161000000001, 2024-09-12T16:18:42.504 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:42.504 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:42.504 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:42.504 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:42.504 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:42.505 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:42.505 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5628 2024-09-12T16:18:42.505 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.505 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:42.505 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.505 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:42.505 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:18:42.505 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.505 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.505 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.505 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:42.506 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:18:42.506 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.506 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.506 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.506 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:42.506 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296592+0000", 2024-09-12T16:18:42.506 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2099999999999996e-07 2024-09-12T16:18:42.506 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.506 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.506 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:42.506 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296595+0000", 2024-09-12T16:18:42.506 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0429999999999999e-06 2024-09-12T16:18:42.507 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.507 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.507 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:42.507 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296603+0000", 2024-09-12T16:18:42.507 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9899999999999997e-06 2024-09-12T16:18:42.507 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.507 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.507 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:42.507 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296609+0000", 2024-09-12T16:18:42.507 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7259999999999999e-06 2024-09-12T16:18:42.507 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.507 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.507 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:42.508 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358393+0000", 2024-09-12T16:18:42.508 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061784617 2024-09-12T16:18:42.508 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.508 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.508 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:42.508 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358460+0000", 2024-09-12T16:18:42.508 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7253000000000001e-05 2024-09-12T16:18:42.508 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.508 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.508 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:42.508 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358552+0000", 2024-09-12T16:18:42.508 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1811000000000006e-05 2024-09-12T16:18:42.508 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.509 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:42.509 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.509 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.509 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.509 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5638 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4734976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:42.509 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:18:42.509 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 122.18178224499999, 2024-09-12T16:18:42.509 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061654460000000001, 2024-09-12T16:18:42.509 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:42.509 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:42.509 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:42.510 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:42.510 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:42.510 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:42.510 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5638 2024-09-12T16:18:42.510 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.510 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:42.510 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.510 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:42.510 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:18:42.510 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.510 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.510 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.510 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:42.510 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:18:42.510 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.511 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.511 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.511 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:42.511 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:18:42.511 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.23e-07 2024-09-12T16:18:42.511 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.511 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.511 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:42.511 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297068+0000", 2024-09-12T16:18:42.511 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0060000000000003e-06 2024-09-12T16:18:42.511 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.511 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.511 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:42.511 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297080+0000", 2024-09-12T16:18:42.512 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1234e-05 2024-09-12T16:18:42.512 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.512 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.512 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:42.512 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297095+0000", 2024-09-12T16:18:42.512 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5698000000000001e-05 2024-09-12T16:18:42.512 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.512 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.512 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:42.512 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358582+0000", 2024-09-12T16:18:42.512 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061486274 2024-09-12T16:18:42.512 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.512 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.513 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:42.513 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358637+0000", 2024-09-12T16:18:42.513 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5439999999999998e-05 2024-09-12T16:18:42.513 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.513 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.513 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:42.513 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358718+0000", 2024-09-12T16:18:42.513 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0984999999999998e-05 2024-09-12T16:18:42.513 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.513 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:42.513 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.513 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.513 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.513 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5640 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4780032~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:42.513 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:18:42.514 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 122.181700525, 2024-09-12T16:18:42.514 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061746620000000002, 2024-09-12T16:18:42.514 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:42.514 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:42.514 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:42.514 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:42.514 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:42.514 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:42.514 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5640 2024-09-12T16:18:42.515 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.515 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:42.515 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.515 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:42.515 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:18:42.515 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.515 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.515 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.515 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:42.515 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:18:42.515 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.515 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.515 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.515 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:42.515 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297146+0000", 2024-09-12T16:18:42.516 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3600000000000003e-07 2024-09-12T16:18:42.516 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.516 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.516 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:42.516 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297150+0000", 2024-09-12T16:18:42.516 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8430000000000003e-06 2024-09-12T16:18:42.516 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.516 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.516 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:42.516 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297160+0000", 2024-09-12T16:18:42.516 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7229999999999999e-06 2024-09-12T16:18:42.516 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.516 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.516 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:42.517 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297167+0000", 2024-09-12T16:18:42.517 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0180000000000004e-06 2024-09-12T16:18:42.517 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.517 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.517 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:42.517 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358750+0000", 2024-09-12T16:18:42.517 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061583104 2024-09-12T16:18:42.517 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.517 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.517 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:42.517 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358804+0000", 2024-09-12T16:18:42.517 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4277000000000002e-05 2024-09-12T16:18:42.518 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.518 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.518 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:42.518 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358892+0000", 2024-09-12T16:18:42.518 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7918999999999996e-05 2024-09-12T16:18:42.518 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.518 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:42.518 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.518 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.518 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.518 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5642 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4788224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:42.518 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:18:42.518 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 122.18165618099999, 2024-09-12T16:18:42.518 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061860409999999998, 2024-09-12T16:18:42.519 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:42.519 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:42.519 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:42.519 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:42.519 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:42.519 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:42.519 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5642 2024-09-12T16:18:42.519 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.519 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:42.519 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.519 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:42.519 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:18:42.519 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.519 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.519 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.520 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:42.520 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:18:42.520 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.520 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.520 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.520 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:42.520 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:18:42.520 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7999999999999995e-07 2024-09-12T16:18:42.520 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.520 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.520 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:42.520 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297193+0000", 2024-09-12T16:18:42.520 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8310000000000001e-06 2024-09-12T16:18:42.520 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.520 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.520 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:42.521 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297204+0000", 2024-09-12T16:18:42.521 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0832999999999999e-05 2024-09-12T16:18:42.521 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.521 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.521 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:42.521 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297210+0000", 2024-09-12T16:18:42.521 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1770000000000003e-06 2024-09-12T16:18:42.521 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.521 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.521 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:42.521 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358928+0000", 2024-09-12T16:18:42.521 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061717826000000003 2024-09-12T16:18:42.521 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.521 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.522 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:42.522 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358977+0000", 2024-09-12T16:18:42.522 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9514000000000001e-05 2024-09-12T16:18:42.522 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.522 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.522 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:42.522 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359050+0000", 2024-09-12T16:18:42.522 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2649000000000002e-05 2024-09-12T16:18:42.522 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.522 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:42.522 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.522 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.522 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.522 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5646 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4743168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:42.522 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:18:42.523 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 122.18147623999999, 2024-09-12T16:18:42.523 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061822122, 2024-09-12T16:18:42.523 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:42.523 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:42.523 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:42.523 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:42.523 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:42.523 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:42.523 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5646 2024-09-12T16:18:42.523 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.523 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:42.523 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.524 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:42.524 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:18:42.524 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.524 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.524 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.524 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:42.524 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:18:42.524 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.524 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.524 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.524 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:42.524 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:18:42.524 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3200000000000004e-07 2024-09-12T16:18:42.525 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.525 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.525 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:42.525 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297374+0000", 2024-09-12T16:18:42.525 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8240000000000001e-06 2024-09-12T16:18:42.525 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.525 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.525 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:42.525 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297384+0000", 2024-09-12T16:18:42.525 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5710000000000004e-06 2024-09-12T16:18:42.525 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.525 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.525 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:42.525 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297390+0000", 2024-09-12T16:18:42.525 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5130000000000002e-06 2024-09-12T16:18:42.525 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.526 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.526 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:42.526 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359080+0000", 2024-09-12T16:18:42.526 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061689569999999999 2024-09-12T16:18:42.526 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.526 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.526 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:42.526 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359134+0000", 2024-09-12T16:18:42.526 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3838999999999997e-05 2024-09-12T16:18:42.526 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.526 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.527 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:42.527 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359192+0000", 2024-09-12T16:18:42.527 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8072999999999998e-05 2024-09-12T16:18:42.527 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.527 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:42.527 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.527 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.527 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.527 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5647 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4751360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:42.527 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:18:42.527 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 122.181439555, 2024-09-12T16:18:42.528 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061927569000000002, 2024-09-12T16:18:42.528 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:42.528 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:42.528 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:42.528 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:42.528 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:42.528 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:42.528 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5647 2024-09-12T16:18:42.528 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.528 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:42.528 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.528 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:42.528 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:18:42.528 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.529 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.529 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.529 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:42.529 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:18:42.529 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.529 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.529 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.529 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:42.529 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297407+0000", 2024-09-12T16:18:42.529 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.46e-07 2024-09-12T16:18:42.529 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.529 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.530 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:42.530 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297409+0000", 2024-09-12T16:18:42.530 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.469e-06 2024-09-12T16:18:42.530 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.530 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.530 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:42.530 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297415+0000", 2024-09-12T16:18:42.530 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9259999999999997e-06 2024-09-12T16:18:42.531 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.531 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.531 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:42.531 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297419+0000", 2024-09-12T16:18:42.531 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3840000000000001e-06 2024-09-12T16:18:42.531 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.531 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.531 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:42.531 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359224+0000", 2024-09-12T16:18:42.531 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061805367999999999 2024-09-12T16:18:42.531 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.531 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.531 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:42.532 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359275+0000", 2024-09-12T16:18:42.532 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1338000000000002e-05 2024-09-12T16:18:42.532 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.532 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.532 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:42.532 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359334+0000", 2024-09-12T16:18:42.532 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8638000000000003e-05 2024-09-12T16:18:42.532 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.532 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:42.533 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.533 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.533 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.533 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5649 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4796416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:42.533 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:18:42.533 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 122.18138469599999, 2024-09-12T16:18:42.533 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.062018578999999997, 2024-09-12T16:18:42.533 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:42.533 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:42.533 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:42.533 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:42.533 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:42.533 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:42.534 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5649 2024-09-12T16:18:42.534 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.534 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:42.534 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.534 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:42.534 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:18:42.534 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.534 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.534 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.534 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:42.534 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:18:42.534 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.534 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.534 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.534 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:42.535 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297462+0000", 2024-09-12T16:18:42.535 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2399999999999998e-07 2024-09-12T16:18:42.535 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.535 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.535 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:42.535 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297465+0000", 2024-09-12T16:18:42.535 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.371e-06 2024-09-12T16:18:42.535 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.535 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.535 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:42.535 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297473+0000", 2024-09-12T16:18:42.535 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4699999999999996e-06 2024-09-12T16:18:42.535 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.536 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.536 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:42.536 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297478+0000", 2024-09-12T16:18:42.536 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2780000000000001e-06 2024-09-12T16:18:42.536 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.536 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.536 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:42.536 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359368+0000", 2024-09-12T16:18:42.536 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061889758000000003 2024-09-12T16:18:42.536 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.536 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.536 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:42.537 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359420+0000", 2024-09-12T16:18:42.537 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2574999999999997e-05 2024-09-12T16:18:42.537 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.537 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.537 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:42.537 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359480+0000", 2024-09-12T16:18:42.537 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9503000000000003e-05 2024-09-12T16:18:42.537 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.537 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:42.537 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.537 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.537 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.537 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5674 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4739072~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:42.538 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:18:42.538 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 122.180980928, 2024-09-12T16:18:42.538 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061762989999999997, 2024-09-12T16:18:42.538 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:42.538 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:42.538 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:42.538 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:42.538 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:42.538 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:42.538 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5674 2024-09-12T16:18:42.538 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.538 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:42.538 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.539 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:42.539 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:18:42.539 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.539 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.539 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.539 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:42.539 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:18:42.539 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.539 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.539 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.539 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:42.539 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297866+0000", 2024-09-12T16:18:42.539 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1900000000000001e-07 2024-09-12T16:18:42.539 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.540 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.540 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:42.540 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297870+0000", 2024-09-12T16:18:42.540 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3560000000000003e-06 2024-09-12T16:18:42.540 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.540 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.540 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:42.540 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297888+0000", 2024-09-12T16:18:42.540 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8088999999999999e-05 2024-09-12T16:18:42.540 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.540 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.540 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:42.541 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297904+0000", 2024-09-12T16:18:42.541 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5971e-05 2024-09-12T16:18:42.541 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.541 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.541 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:42.541 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359510+0000", 2024-09-12T16:18:42.541 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061605634999999999 2024-09-12T16:18:42.541 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.541 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.541 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:42.541 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359554+0000", 2024-09-12T16:18:42.541 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4024999999999999e-05 2024-09-12T16:18:42.541 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.542 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.542 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:42.542 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359628+0000", 2024-09-12T16:18:42.542 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4095000000000001e-05 2024-09-12T16:18:42.542 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.542 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:42.542 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.542 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.542 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5676 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4792320~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:42.542 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:18:42.542 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 122.180779848, 2024-09-12T16:18:42.542 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061720143999999998, 2024-09-12T16:18:42.542 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:42.543 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:42.543 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:42.543 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:42.543 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:42.543 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:42.543 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5676 2024-09-12T16:18:42.543 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.543 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:42.543 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.543 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:42.543 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:18:42.543 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.543 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.544 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.544 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:42.544 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:18:42.544 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.544 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.544 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.544 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:42.544 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298067+0000", 2024-09-12T16:18:42.544 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8199999999999999e-07 2024-09-12T16:18:42.544 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.544 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.544 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:42.544 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298070+0000", 2024-09-12T16:18:42.545 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.743e-06 2024-09-12T16:18:42.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.545 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.545 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:42.545 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298080+0000", 2024-09-12T16:18:42.545 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4059999999999994e-06 2024-09-12T16:18:42.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.545 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.545 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:42.545 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298088+0000", 2024-09-12T16:18:42.545 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0779999999999996e-06 2024-09-12T16:18:42.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.545 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.546 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:42.546 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359659+0000", 2024-09-12T16:18:42.546 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061570688999999998 2024-09-12T16:18:42.546 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.546 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.546 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:42.546 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359713+0000", 2024-09-12T16:18:42.546 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3939e-05 2024-09-12T16:18:42.546 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.546 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.546 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:42.546 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359786+0000", 2024-09-12T16:18:42.546 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3607000000000002e-05 2024-09-12T16:18:42.547 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.547 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:42.547 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.547 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.547 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.547 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5684 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4747264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:42.547 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:18:42.547 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 122.180312556, 2024-09-12T16:18:42.547 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061394799, 2024-09-12T16:18:42.547 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:42.548 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:42.548 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:42.548 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:42.548 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:42.548 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:42.548 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5684 2024-09-12T16:18:42.548 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.548 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:42.548 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.548 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:42.549 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:18:42.549 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.549 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.549 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:42.549 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:18:42.549 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.549 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.549 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:42.549 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298534+0000", 2024-09-12T16:18:42.549 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4399999999999999e-07 2024-09-12T16:18:42.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.550 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:42.550 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298539+0000", 2024-09-12T16:18:42.550 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5360000000000003e-06 2024-09-12T16:18:42.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.550 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:42.550 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298550+0000", 2024-09-12T16:18:42.550 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1499e-05 2024-09-12T16:18:42.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.550 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:42.550 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298558+0000", 2024-09-12T16:18:42.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3000000000000004e-06 2024-09-12T16:18:42.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.551 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:42.551 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359815+0000", 2024-09-12T16:18:42.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061257952999999997 2024-09-12T16:18:42.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.551 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:42.551 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359868+0000", 2024-09-12T16:18:42.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2317000000000001e-05 2024-09-12T16:18:42.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.551 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:42.552 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359928+0000", 2024-09-12T16:18:42.552 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0350000000000003e-05 2024-09-12T16:18:42.552 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.552 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:42.552 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.552 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.552 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.552 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5686 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4755456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:42.552 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:18:42.552 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 122.18014513200001, 2024-09-12T16:18:42.552 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061355082999999998, 2024-09-12T16:18:42.552 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:42.552 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:42.553 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:42.553 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:42.553 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:42.553 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:42.553 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5686 2024-09-12T16:18:42.553 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.553 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:42.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.553 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:42.553 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:18:42.553 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.553 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.554 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:42.554 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:18:42.554 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.554 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.554 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:42.554 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298702+0000", 2024-09-12T16:18:42.554 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2399999999999997e-07 2024-09-12T16:18:42.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.554 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.554 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:42.554 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298706+0000", 2024-09-12T16:18:42.554 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5700000000000003e-06 2024-09-12T16:18:42.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.555 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.555 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:42.555 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298718+0000", 2024-09-12T16:18:42.555 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1457999999999999e-05 2024-09-12T16:18:42.555 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.555 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.555 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:42.555 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298732+0000", 2024-09-12T16:18:42.556 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.452e-05 2024-09-12T16:18:42.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.556 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.556 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:42.556 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359956+0000", 2024-09-12T16:18:42.556 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061223626000000003 2024-09-12T16:18:42.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.556 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.556 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:42.556 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360000+0000", 2024-09-12T16:18:42.557 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3922999999999999e-05 2024-09-12T16:18:42.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.557 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.557 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:42.557 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360056+0000", 2024-09-12T16:18:42.557 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6162000000000002e-05 2024-09-12T16:18:42.557 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.557 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:42.557 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.557 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.557 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5688 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4800512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:42.557 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:18:42.558 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 122.17992207899999, 2024-09-12T16:18:42.558 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061270514999999998, 2024-09-12T16:18:42.558 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:42.558 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:42.558 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:42.558 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:42.558 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:42.558 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:42.558 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5688 2024-09-12T16:18:42.558 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.558 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:42.558 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.558 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:42.558 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:18:42.559 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.559 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.559 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:42.559 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:18:42.559 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.559 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.559 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:42.559 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298925+0000", 2024-09-12T16:18:42.559 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4e-07 2024-09-12T16:18:42.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.560 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.560 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:42.560 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298929+0000", 2024-09-12T16:18:42.560 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9890000000000003e-06 2024-09-12T16:18:42.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.560 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.560 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:42.560 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298936+0000", 2024-09-12T16:18:42.560 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.52e-06 2024-09-12T16:18:42.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.560 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.561 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:42.561 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298941+0000", 2024-09-12T16:18:42.561 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4800000000000003e-06 2024-09-12T16:18:42.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.561 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:42.561 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360087+0000", 2024-09-12T16:18:42.561 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061146143 2024-09-12T16:18:42.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.561 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:42.561 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360137+0000", 2024-09-12T16:18:42.561 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0584000000000002e-05 2024-09-12T16:18:42.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.562 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.562 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:42.562 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360194+0000", 2024-09-12T16:18:42.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6858999999999999e-05 2024-09-12T16:18:42.562 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.562 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:42.562 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.562 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.562 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5693 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4751360~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:42.562 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:18:42.562 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 122.17950044200001, 2024-09-12T16:18:42.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061139444000000001, 2024-09-12T16:18:42.562 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:42.563 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:42.563 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:42.563 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:42.563 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:42.563 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:42.563 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5693 2024-09-12T16:18:42.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.563 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:42.563 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.563 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:42.563 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:18:42.563 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.563 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.563 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:42.564 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:18:42.564 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.564 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.564 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:42.564 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299346+0000", 2024-09-12T16:18:42.564 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2300000000000001e-07 2024-09-12T16:18:42.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.564 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.564 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:42.564 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299349+0000", 2024-09-12T16:18:42.564 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5270000000000001e-06 2024-09-12T16:18:42.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.565 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.565 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:42.565 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299358+0000", 2024-09-12T16:18:42.565 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7030000000000001e-06 2024-09-12T16:18:42.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.565 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.565 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:42.565 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299364+0000", 2024-09-12T16:18:42.565 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7239999999999997e-06 2024-09-12T16:18:42.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.565 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.565 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:42.565 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360369+0000", 2024-09-12T16:18:42.566 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061004713000000002 2024-09-12T16:18:42.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.566 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:42.566 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360415+0000", 2024-09-12T16:18:42.566 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5926e-05 2024-09-12T16:18:42.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.566 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:42.566 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360485+0000", 2024-09-12T16:18:42.567 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0327999999999995e-05 2024-09-12T16:18:42.567 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.567 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:42.567 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.567 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.567 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5694 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4796416~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:42.567 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:18:42.567 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 122.179471413, 2024-09-12T16:18:42.567 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061258034000000003, 2024-09-12T16:18:42.567 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:42.567 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:42.567 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:42.567 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:42.568 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:42.568 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:42.568 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5694 2024-09-12T16:18:42.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.568 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:42.568 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.568 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:42.568 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:18:42.568 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.568 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.568 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:42.568 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:18:42.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.569 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:42.569 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301884+0000", 2024-09-12T16:18:42.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025090379999999999 2024-09-12T16:18:42.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.569 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:42.569 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301889+0000", 2024-09-12T16:18:42.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5879999999999997e-06 2024-09-12T16:18:42.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.570 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:42.570 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301901+0000", 2024-09-12T16:18:42.570 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1466e-05 2024-09-12T16:18:42.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.570 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:42.570 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301908+0000", 2024-09-12T16:18:42.570 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1999999999999997e-06 2024-09-12T16:18:42.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.571 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:42.571 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360513+0000", 2024-09-12T16:18:42.571 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.058605023999999999 2024-09-12T16:18:42.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.571 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.571 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:42.571 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360562+0000", 2024-09-12T16:18:42.571 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9546000000000003e-05 2024-09-12T16:18:42.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.571 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.571 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:42.571 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360633+0000", 2024-09-12T16:18:42.571 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0172000000000005e-05 2024-09-12T16:18:42.572 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.572 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:42.572 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.572 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.572 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:28537 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_get_id in=13b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-12T16:18:42.572 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:24.151599+0000", 2024-09-12T16:18:42.572 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 18.327246615, 2024-09-12T16:18:42.572 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.99758962900000003, 2024-09-12T16:18:42.572 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:42.572 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:42.573 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:42.573 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:42.573 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:18:42.573 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:18:42.573 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 28537 2024-09-12T16:18:42.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.573 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:42.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.573 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:42.573 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.151599+0000", 2024-09-12T16:18:42.573 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:42.574 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.151599+0000", 2024-09-12T16:18:42.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:42.574 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.151601+0000", 2024-09-12T16:18:42.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4130000000000001e-06 2024-09-12T16:18:42.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.575 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.575 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:42.575 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.151606+0000", 2024-09-12T16:18:42.575 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.502e-06 2024-09-12T16:18:42.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.575 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.575 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:42.575 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.151618+0000", 2024-09-12T16:18:42.575 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1430999999999999e-05 2024-09-12T16:18:42.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.575 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.575 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:42.575 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.151623+0000", 2024-09-12T16:18:42.575 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3109999999999996e-06 2024-09-12T16:18:42.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.576 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.576 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:42.576 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.151681+0000", 2024-09-12T16:18:42.576 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8068e-05 2024-09-12T16:18:42.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.576 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.576 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:42.576 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.151689+0000", 2024-09-12T16:18:42.576 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9000000000000006e-06 2024-09-12T16:18:42.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.576 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.576 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:42.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.148883+0000", 2024-09-12T16:18:42.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.99719448399999999 2024-09-12T16:18:42.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.577 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:42.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.149018+0000", 2024-09-12T16:18:42.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000134733 2024-09-12T16:18:42.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.577 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:42.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.149189+0000", 2024-09-12T16:18:42.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017078699999999999 2024-09-12T16:18:42.578 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.578 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:42.578 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.578 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.578 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:42.578 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:42.579 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:18:42.580 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:42.579+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:42.681 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:42.680+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:42.728 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:42.728 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:42.728 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:18:42.728 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:42.736 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:18:42.781 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:42.780+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:42.843 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:42.843 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:42.843 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:18:42.843 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:18:42.843 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:42.851 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:18:42.895 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:42.895+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:42.960 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:42.960 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:18:42.960 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:18:42.960 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:18:42.960 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.960 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "pg_update_log_missing(3.1d epoch 92/74 rep_tid 3087 entries 92'1280 (0'0) error 3:bc3c4c0b:::rbd_data.1155c757bf36.000000000000002c:head by client.5577.0:14343 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 90'1278)", 2024-09-12T16:18:42.960 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.408860+0000", 2024-09-12T16:18:42.960 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 72.549617495000007, 2024-09-12T16:18:42.960 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0056480419999999998, 2024-09-12T16:18:42.960 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:42.961 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:42.961 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "reached pg", 2024-09-12T16:18:42.961 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:42.961 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.961 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:42.961 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408860+0000", 2024-09-12T16:18:42.961 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.961 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.961 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.961 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:42.961 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408860+0000", 2024-09-12T16:18:42.961 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.961 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.962 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.962 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:42.962 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408861+0000", 2024-09-12T16:18:42.962 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6600000000000002e-07 2024-09-12T16:18:42.962 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.962 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.962 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:42.962 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408867+0000", 2024-09-12T16:18:42.962 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4150000000000004e-06 2024-09-12T16:18:42.962 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.962 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.962 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:42.962 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408881+0000", 2024-09-12T16:18:42.962 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4326e-05 2024-09-12T16:18:42.963 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.963 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.963 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:42.963 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408895+0000", 2024-09-12T16:18:42.963 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3903000000000001e-05 2024-09-12T16:18:42.963 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.963 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.963 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:42.963 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410566+0000", 2024-09-12T16:18:42.963 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001670822 2024-09-12T16:18:42.963 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.964 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.964 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:42.964 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414508+0000", 2024-09-12T16:18:42.964 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039421100000000004 2024-09-12T16:18:42.964 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.964 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:42.965 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.965 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.965 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.965 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "pg_update_log_missing(3.5 epoch 92/74 rep_tid 1621 entries 92'521 (0'0) error 3:a759f741:::rbd_data.1155c757bf36.0000000000000036:head by client.5577.0:14364 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 92'518)", 2024-09-12T16:18:42.965 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:18:42.965 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 72.548669017999998, 2024-09-12T16:18:42.965 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047586740000000001, 2024-09-12T16:18:42.965 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:42.965 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:42.965 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "reached pg", 2024-09-12T16:18:42.966 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:42.966 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.966 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:42.966 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:18:42.966 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.966 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.966 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.966 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:42.967 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:18:42.967 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.967 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.967 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.967 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:42.967 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:18:42.967 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.54e-07 2024-09-12T16:18:42.968 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.968 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.968 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:42.968 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409817+0000", 2024-09-12T16:18:42.968 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.028e-06 2024-09-12T16:18:42.968 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.968 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.968 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:42.968 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410047+0000", 2024-09-12T16:18:42.968 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022964599999999999 2024-09-12T16:18:42.968 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.968 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.968 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:42.969 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410067+0000", 2024-09-12T16:18:42.969 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0438999999999999e-05 2024-09-12T16:18:42.969 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.969 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.969 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:42.969 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411223+0000", 2024-09-12T16:18:42.969 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011560229999999999 2024-09-12T16:18:42.969 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.969 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.969 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:42.969 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414567+0000", 2024-09-12T16:18:42.970 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033437839999999998 2024-09-12T16:18:42.970 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.970 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:42.970 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.970 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.970 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.970 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14391 3.5 e92/74 3:a5105766:::rbd_data.1155c757bf36.0000000000000044:head v 92'523, mlcod=92'518)", 2024-09-12T16:18:42.970 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.410084+0000", 2024-09-12T16:18:42.970 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 72.548393148000002, 2024-09-12T16:18:42.970 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0046720299999999998, 2024-09-12T16:18:42.970 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:42.970 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:42.970 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:42.970 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:42.971 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.971 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:42.971 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410084+0000", 2024-09-12T16:18:42.971 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.971 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.971 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.971 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:42.971 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410084+0000", 2024-09-12T16:18:42.971 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.971 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.972 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.972 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:42.972 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410085+0000", 2024-09-12T16:18:42.972 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1900000000000002e-07 2024-09-12T16:18:42.972 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.972 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.972 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:42.972 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410091+0000", 2024-09-12T16:18:42.972 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1e-06 2024-09-12T16:18:42.972 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.972 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.972 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:42.972 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410100+0000", 2024-09-12T16:18:42.972 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6889999999999993e-06 2024-09-12T16:18:42.973 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.973 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.973 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:42.973 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410105+0000", 2024-09-12T16:18:42.973 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3199999999999999e-06 2024-09-12T16:18:42.973 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.974 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.974 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:42.974 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411563+0000", 2024-09-12T16:18:42.974 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00145795 2024-09-12T16:18:42.974 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.975 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.975 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:42.975 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411590+0000", 2024-09-12T16:18:42.975 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6570000000000001e-05 2024-09-12T16:18:42.975 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.975 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.975 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:42.976 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414571+0000", 2024-09-12T16:18:42.976 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029815710000000001 2024-09-12T16:18:42.976 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.976 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.976 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:42.976 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414756+0000", 2024-09-12T16:18:42.976 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018521100000000001 2024-09-12T16:18:42.976 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.976 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:42.976 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.976 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.976 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.976 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14405 3.5 e92/74 3:a0797093:::rbd_data.1155c757bf36.000000000000004b:head v 92'525, mlcod=92'518)", 2024-09-12T16:18:42.976 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.410119+0000", 2024-09-12T16:18:42.977 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 72.548358207999996, 2024-09-12T16:18:42.977 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047304000000000001, 2024-09-12T16:18:42.977 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:42.977 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:42.977 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:42.977 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:42.977 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.977 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:42.977 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410119+0000", 2024-09-12T16:18:42.977 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.977 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.977 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.977 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:42.978 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410119+0000", 2024-09-12T16:18:42.978 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.978 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.978 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.978 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:42.978 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410120+0000", 2024-09-12T16:18:42.978 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:18:42.978 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.978 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.978 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:42.978 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410126+0000", 2024-09-12T16:18:42.978 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1460000000000001e-06 2024-09-12T16:18:42.978 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.978 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.978 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:42.979 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410134+0000", 2024-09-12T16:18:42.979 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8879999999999997e-06 2024-09-12T16:18:42.979 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.979 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.979 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:42.979 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410140+0000", 2024-09-12T16:18:42.979 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0839999999999997e-06 2024-09-12T16:18:42.979 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.979 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.979 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:42.979 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412146+0000", 2024-09-12T16:18:42.979 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0020057569999999999 2024-09-12T16:18:42.979 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.979 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.979 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:42.980 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412163+0000", 2024-09-12T16:18:42.980 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7742000000000001e-05 2024-09-12T16:18:42.980 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.980 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.980 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:42.980 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414761+0000", 2024-09-12T16:18:42.980 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025979660000000002 2024-09-12T16:18:42.980 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.980 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.980 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:42.980 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414850+0000", 2024-09-12T16:18:42.980 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8426999999999999e-05 2024-09-12T16:18:42.980 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.980 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:42.981 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.981 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.981 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.981 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5384.0:1241 3.16 e95/75 3:6ee670ce:::rbd_data.1155b9894cdc.0000000000000005:head v 95'1303, mlcod=95'1301)", 2024-09-12T16:18:42.981 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:35.272164+0000", 2024-09-12T16:18:42.981 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 67.686313823000006, 2024-09-12T16:18:42.981 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015008743, 2024-09-12T16:18:42.981 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:42.981 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:42.981 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:42.981 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:42.981 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.981 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:42.981 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.272164+0000", 2024-09-12T16:18:42.982 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.982 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.982 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.982 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:42.982 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.272164+0000", 2024-09-12T16:18:42.982 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.982 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.982 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.982 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:42.982 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.272165+0000", 2024-09-12T16:18:42.982 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.311e-06 2024-09-12T16:18:42.982 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.982 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.982 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:42.982 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275503+0000", 2024-09-12T16:18:42.983 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003337881 2024-09-12T16:18:42.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.983 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.983 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:42.983 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275530+0000", 2024-09-12T16:18:42.983 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6797000000000001e-05 2024-09-12T16:18:42.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.983 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.983 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:42.983 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275541+0000", 2024-09-12T16:18:42.983 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1634000000000001e-05 2024-09-12T16:18:42.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.983 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.983 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:42.984 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275618+0000", 2024-09-12T16:18:42.984 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6811999999999996e-05 2024-09-12T16:18:42.984 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.984 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.984 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:42.984 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275642+0000", 2024-09-12T16:18:42.984 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4111999999999999e-05 2024-09-12T16:18:42.984 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.984 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.984 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:42.984 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287116+0000", 2024-09-12T16:18:42.984 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01147395 2024-09-12T16:18:42.984 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.984 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.984 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:42.985 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287172+0000", 2024-09-12T16:18:42.985 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6246000000000003e-05 2024-09-12T16:18:42.985 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.985 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:42.985 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.985 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.985 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.985 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5384.0:1246 3.f e95/74 3:f0725c44:::rbd_data.1155b9894cdc.0000000000000006:head v 95'356, mlcod=95'354)", 2024-09-12T16:18:42.985 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:35.276304+0000", 2024-09-12T16:18:42.985 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 67.682173895999995, 2024-09-12T16:18:42.985 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011209733, 2024-09-12T16:18:42.985 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:42.985 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:42.985 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:42.986 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:42.986 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.986 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:42.986 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.276304+0000", 2024-09-12T16:18:42.986 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.986 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.986 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.986 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:42.986 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.276304+0000", 2024-09-12T16:18:42.986 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.986 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.986 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.986 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:42.986 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.276305+0000", 2024-09-12T16:18:42.987 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2500000000000001e-06 2024-09-12T16:18:42.987 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.987 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.987 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:42.987 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279256+0000", 2024-09-12T16:18:42.987 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002951076 2024-09-12T16:18:42.987 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.987 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.987 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:42.987 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279281+0000", 2024-09-12T16:18:42.987 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4779000000000001e-05 2024-09-12T16:18:42.987 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.987 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.987 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:42.987 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279294+0000", 2024-09-12T16:18:42.988 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3614e-05 2024-09-12T16:18:42.988 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.988 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.988 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:42.988 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279366+0000", 2024-09-12T16:18:42.988 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2094000000000005e-05 2024-09-12T16:18:42.988 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.988 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.988 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:42.988 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279395+0000", 2024-09-12T16:18:42.988 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8337999999999999e-05 2024-09-12T16:18:42.988 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.988 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.988 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:42.989 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287479+0000", 2024-09-12T16:18:42.989 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0080844799999999998 2024-09-12T16:18:42.989 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.989 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.989 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:42.989 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287513+0000", 2024-09-12T16:18:42.989 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4102e-05 2024-09-12T16:18:42.989 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.989 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:42.989 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.989 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.989 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.989 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.3.0:6016 3.13 e149/136 3:c923ecd0:::rbd_data.1155525b14e3.000000000000003f:f v 149'966, mlcod=147'960)", 2024-09-12T16:18:42.990 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.190622+0000", 2024-09-12T16:18:42.990 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.7678551750000002, 2024-09-12T16:18:42.990 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004419821, 2024-09-12T16:18:42.990 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:42.990 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:42.991 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:42.991 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:42.991 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.991 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:42.991 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.190622+0000", 2024-09-12T16:18:42.991 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.991 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.991 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.991 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:42.991 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.190622+0000", 2024-09-12T16:18:42.992 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.992 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.992 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.992 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:42.992 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.190623+0000", 2024-09-12T16:18:42.993 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7199999999999998e-07 2024-09-12T16:18:42.993 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.993 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.993 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:42.993 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.190629+0000", 2024-09-12T16:18:42.993 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7869999999999998e-06 2024-09-12T16:18:42.993 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.993 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.994 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:42.994 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.190642+0000", 2024-09-12T16:18:42.994 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2928999999999999e-05 2024-09-12T16:18:42.994 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.994 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.994 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:42.994 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.190649+0000", 2024-09-12T16:18:42.994 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2899999999999997e-06 2024-09-12T16:18:42.994 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.994 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.994 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:42.994 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.190702+0000", 2024-09-12T16:18:42.994 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2738999999999998e-05 2024-09-12T16:18:42.994 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.995 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.995 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:42.995 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.190721+0000", 2024-09-12T16:18:42.995 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9589000000000002e-05 2024-09-12T16:18:42.995 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.995 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.995 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:42.995 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194995+0000", 2024-09-12T16:18:42.995 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0042735389999999998 2024-09-12T16:18:42.995 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.995 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.995 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:42.995 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195042+0000", 2024-09-12T16:18:42.995 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7175999999999997e-05 2024-09-12T16:18:42.995 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.995 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:42.996 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:42.996 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.996 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.996 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.4.0:5451 3.1c e149/136 3:384eb380:::rbd_data.1155525b14e3.0000000000000044:f v 149'831, mlcod=148'828)", 2024-09-12T16:18:42.996 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.191205+0000", 2024-09-12T16:18:42.996 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.7672723569999995, 2024-09-12T16:18:42.996 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0064034929999999997, 2024-09-12T16:18:42.996 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:42.996 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:42.996 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:42.996 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:42.996 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.996 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:42.996 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191205+0000", 2024-09-12T16:18:42.996 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.997 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.997 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.997 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:42.997 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191205+0000", 2024-09-12T16:18:42.997 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:42.997 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.997 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.997 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:42.997 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191205+0000", 2024-09-12T16:18:42.997 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9299999999999999e-07 2024-09-12T16:18:42.997 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.997 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.997 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:42.997 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191210+0000", 2024-09-12T16:18:42.997 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0879999999999997e-06 2024-09-12T16:18:42.998 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.998 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.998 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:42.998 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191218+0000", 2024-09-12T16:18:42.998 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.867e-06 2024-09-12T16:18:42.998 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.998 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.998 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:42.998 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191225+0000", 2024-09-12T16:18:42.998 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3300000000000004e-06 2024-09-12T16:18:42.998 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.998 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.998 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:42.998 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191312+0000", 2024-09-12T16:18:42.999 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7371000000000001e-05 2024-09-12T16:18:42.999 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.999 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.999 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:42.999 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191333+0000", 2024-09-12T16:18:42.999 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0591999999999999e-05 2024-09-12T16:18:42.999 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.999 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.999 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:42.999 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.197573+0000", 2024-09-12T16:18:42.999 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0062397579999999998 2024-09-12T16:18:42.999 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:42.999 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:42.999 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:43.000 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.197609+0000", 2024-09-12T16:18:43.000 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6193999999999999e-05 2024-09-12T16:18:43.000 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:43.000 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:43.000 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:43.000 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.000 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.001 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4437.0:30787 3.16 e149/137 3:6afd6e65:::rbd_header.1155525b14e3:head v 149'1535, mlcod=148'1533)", 2024-09-12T16:18:43.001 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.191485+0000", 2024-09-12T16:18:43.001 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.7669928200000005, 2024-09-12T16:18:43.001 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004520774, 2024-09-12T16:18:43.001 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:43.001 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:43.001 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:43.001 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:43.001 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.001 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:43.001 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191485+0000", 2024-09-12T16:18:43.001 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:43.001 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.002 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.002 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:43.002 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191485+0000", 2024-09-12T16:18:43.002 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:43.002 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.002 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.003 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:43.003 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191486+0000", 2024-09-12T16:18:43.003 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1500000000000003e-07 2024-09-12T16:18:43.003 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.003 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.003 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:43.004 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191492+0000", 2024-09-12T16:18:43.004 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9660000000000001e-06 2024-09-12T16:18:43.004 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.004 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.004 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:43.005 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191500+0000", 2024-09-12T16:18:43.005 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1270000000000003e-06 2024-09-12T16:18:43.005 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.005 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.005 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:43.005 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191507+0000", 2024-09-12T16:18:43.005 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1609999999999997e-06 2024-09-12T16:18:43.006 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.006 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.006 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:43.006 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191582+0000", 2024-09-12T16:18:43.006 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5568999999999994e-05 2024-09-12T16:18:43.006 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.006 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.006 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:43.006 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191622+0000", 2024-09-12T16:18:43.006 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9288000000000001e-05 2024-09-12T16:18:43.006 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.006 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.006 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:43.006 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195973+0000", 2024-09-12T16:18:43.006 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0043517410000000001 2024-09-12T16:18:43.006 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.007 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.007 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:43.007 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.196006+0000", 2024-09-12T16:18:43.007 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2107000000000003e-05 2024-09-12T16:18:43.007 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:43.007 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:43.007 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:43.007 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.007 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.007 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.0.0:4264 3.c e149/137 3:341d16c5:::rbd_data.1155525b14e3.0000000000000042:f v 149'428, mlcod=147'424)", 2024-09-12T16:18:43.007 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.191925+0000", 2024-09-12T16:18:43.007 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.7665524269999997, 2024-09-12T16:18:43.007 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0065976330000000003, 2024-09-12T16:18:43.007 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:43.008 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:43.008 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:43.008 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:43.008 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.008 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:43.008 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191925+0000", 2024-09-12T16:18:43.008 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:43.008 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.008 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.008 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:43.008 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191925+0000", 2024-09-12T16:18:43.008 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:43.008 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.009 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.009 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:43.009 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191926+0000", 2024-09-12T16:18:43.009 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0699999999999996e-07 2024-09-12T16:18:43.009 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.009 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.009 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:43.009 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191931+0000", 2024-09-12T16:18:43.009 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4589999999999997e-06 2024-09-12T16:18:43.009 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.009 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.009 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:43.009 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191941+0000", 2024-09-12T16:18:43.009 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.302e-06 2024-09-12T16:18:43.009 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.010 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.010 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:43.010 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191962+0000", 2024-09-12T16:18:43.010 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1126999999999999e-05 2024-09-12T16:18:43.010 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.010 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.010 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:43.010 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.193331+0000", 2024-09-12T16:18:43.010 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0013695599999999999 2024-09-12T16:18:43.010 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.011 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.011 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:43.011 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.193351+0000", 2024-09-12T16:18:43.011 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9344e-05 2024-09-12T16:18:43.011 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.011 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.011 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:43.011 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.198486+0000", 2024-09-12T16:18:43.011 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0051356630000000004 2024-09-12T16:18:43.011 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.011 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.011 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:43.011 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.198523+0000", 2024-09-12T16:18:43.011 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6270999999999999e-05 2024-09-12T16:18:43.012 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:43.012 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:43.012 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:43.012 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.012 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.012 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.4.0:5452 3.1d e149/137 3:b81abef1:::rbd_data.1155525b14e3.0000000000000032:f v 149'1487, mlcod=147'1484)", 2024-09-12T16:18:43.012 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.192040+0000", 2024-09-12T16:18:43.012 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.7664375339999996, 2024-09-12T16:18:43.012 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0063393620000000003, 2024-09-12T16:18:43.012 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:43.012 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:43.012 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:43.012 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:43.012 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.012 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:43.013 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192040+0000", 2024-09-12T16:18:43.013 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:43.013 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.013 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.013 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:43.013 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192040+0000", 2024-09-12T16:18:43.013 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:43.013 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.013 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.013 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:43.013 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192040+0000", 2024-09-12T16:18:43.013 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1199999999999998e-07 2024-09-12T16:18:43.013 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.013 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.013 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:43.014 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192044+0000", 2024-09-12T16:18:43.014 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0110000000000002e-06 2024-09-12T16:18:43.014 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.014 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.014 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:43.014 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192051+0000", 2024-09-12T16:18:43.014 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0380000000000002e-06 2024-09-12T16:18:43.014 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.014 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.014 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:43.014 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192057+0000", 2024-09-12T16:18:43.015 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9220000000000002e-06 2024-09-12T16:18:43.015 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.015 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.015 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:43.015 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192182+0000", 2024-09-12T16:18:43.015 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000125012 2024-09-12T16:18:43.015 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.015 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.015 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:43.015 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192199+0000", 2024-09-12T16:18:43.015 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6642000000000001e-05 2024-09-12T16:18:43.016 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.016 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.016 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:43.016 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.198340+0000", 2024-09-12T16:18:43.016 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0061410099999999997 2024-09-12T16:18:43.016 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.016 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.016 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:43.016 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.198379+0000", 2024-09-12T16:18:43.016 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9314999999999999e-05 2024-09-12T16:18:43.016 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:43.016 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:43.016 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:43.017 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.017 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.017 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.1.0:3298 3.2 e149/136 3:40dbe95a:::rbd_data.1155525b14e3.000000000000007c:f v 149'547, mlcod=147'544)", 2024-09-12T16:18:43.017 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.192706+0000", 2024-09-12T16:18:43.017 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.765771398, 2024-09-12T16:18:43.017 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0058280850000000002, 2024-09-12T16:18:43.017 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:43.017 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:43.017 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:43.017 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:43.017 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.017 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:43.017 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192706+0000", 2024-09-12T16:18:43.018 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:43.018 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.018 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.018 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:43.018 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192706+0000", 2024-09-12T16:18:43.018 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:43.018 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.018 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.018 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:43.018 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192707+0000", 2024-09-12T16:18:43.018 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6100000000000002e-07 2024-09-12T16:18:43.018 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.018 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.018 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:43.018 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192711+0000", 2024-09-12T16:18:43.019 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6079999999999998e-06 2024-09-12T16:18:43.019 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.019 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.019 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:43.019 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192733+0000", 2024-09-12T16:18:43.019 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1923e-05 2024-09-12T16:18:43.019 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.019 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.019 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:43.019 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192741+0000", 2024-09-12T16:18:43.019 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5390000000000002e-06 2024-09-12T16:18:43.019 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.019 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.019 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:43.019 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.193578+0000", 2024-09-12T16:18:43.020 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00083768500000000001 2024-09-12T16:18:43.020 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.020 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.020 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:43.020 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.193595+0000", 2024-09-12T16:18:43.020 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7119999999999999e-05 2024-09-12T16:18:43.020 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.020 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.020 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:43.020 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.198493+0000", 2024-09-12T16:18:43.020 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0048975080000000001 2024-09-12T16:18:43.020 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.020 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.021 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:43.021 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.198534+0000", 2024-09-12T16:18:43.021 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1341000000000003e-05 2024-09-12T16:18:43.021 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:43.021 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:43.021 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:43.021 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.021 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.021 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.0.0:4266 3.c e149/137 3:360c2ef2:::rbd_data.1155525b14e3.0000000000000016:f v 149'430, mlcod=147'424)", 2024-09-12T16:18:43.021 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.192781+0000", 2024-09-12T16:18:43.021 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.7656970259999998, 2024-09-12T16:18:43.022 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.007657779, 2024-09-12T16:18:43.022 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:43.022 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:43.022 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:43.022 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:43.023 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.023 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:43.023 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192781+0000", 2024-09-12T16:18:43.023 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:43.023 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.023 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.023 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:43.023 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192781+0000", 2024-09-12T16:18:43.024 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:43.024 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.024 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.024 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:43.024 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192781+0000", 2024-09-12T16:18:43.024 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3e-07 2024-09-12T16:18:43.024 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.024 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.024 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:43.024 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192791+0000", 2024-09-12T16:18:43.024 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5089999999999999e-06 2024-09-12T16:18:43.024 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.024 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.025 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:43.025 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192802+0000", 2024-09-12T16:18:43.025 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0920999999999999e-05 2024-09-12T16:18:43.025 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.025 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.025 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:43.025 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192808+0000", 2024-09-12T16:18:43.025 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1070000000000001e-06 2024-09-12T16:18:43.025 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.025 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.025 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:43.025 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195891+0000", 2024-09-12T16:18:43.025 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003083531 2024-09-12T16:18:43.025 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.025 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.026 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:43.026 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195907+0000", 2024-09-12T16:18:43.026 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5336e-05 2024-09-12T16:18:43.026 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.026 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.026 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:43.026 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.200415+0000", 2024-09-12T16:18:43.026 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0045088319999999999 2024-09-12T16:18:43.026 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.026 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.026 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:43.026 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.200438+0000", 2024-09-12T16:18:43.026 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2912999999999999e-05 2024-09-12T16:18:43.026 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:43.027 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:43.027 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:43.027 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.027 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.027 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.0.0:4267 3.10 e149/136 3:0b8b145b:::rbd_data.1155525b14e3.000000000000005e:f v 149'606, mlcod=147'600)", 2024-09-12T16:18:43.027 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.192819+0000", 2024-09-12T16:18:43.027 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.7656583369999996, 2024-09-12T16:18:43.027 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0043054909999999998, 2024-09-12T16:18:43.027 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:43.027 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:43.028 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:43.028 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:43.028 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.028 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:43.028 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192819+0000", 2024-09-12T16:18:43.028 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:43.028 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.028 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.028 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:43.028 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192819+0000", 2024-09-12T16:18:43.028 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:43.028 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.028 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.029 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:43.029 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192819+0000", 2024-09-12T16:18:43.029 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4600000000000001e-07 2024-09-12T16:18:43.029 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.029 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.029 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:43.029 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192827+0000", 2024-09-12T16:18:43.029 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9030000000000004e-06 2024-09-12T16:18:43.029 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.029 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.029 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:43.029 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192834+0000", 2024-09-12T16:18:43.029 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4810000000000003e-06 2024-09-12T16:18:43.030 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.030 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.030 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:43.030 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192839+0000", 2024-09-12T16:18:43.030 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8790000000000002e-06 2024-09-12T16:18:43.030 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.030 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.030 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:43.030 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.193371+0000", 2024-09-12T16:18:43.030 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00053213999999999996 2024-09-12T16:18:43.030 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.030 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.030 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:43.030 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.193388+0000", 2024-09-12T16:18:43.030 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7407000000000001e-05 2024-09-12T16:18:43.031 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.031 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.031 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:43.031 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.197081+0000", 2024-09-12T16:18:43.031 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003692608 2024-09-12T16:18:43.031 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.031 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.031 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:43.031 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.197125+0000", 2024-09-12T16:18:43.031 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3826999999999999e-05 2024-09-12T16:18:43.031 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:43.032 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:43.032 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:43.032 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.032 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.032 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.1.0:3300 3.2 e149/136 3:46a84092:::rbd_data.1155525b14e3.000000000000006d:f v 149'549, mlcod=147'544)", 2024-09-12T16:18:43.032 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.193554+0000", 2024-09-12T16:18:43.032 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.7649230769999997, 2024-09-12T16:18:43.032 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.006035749, 2024-09-12T16:18:43.032 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:43.032 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:43.032 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:43.032 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:43.033 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.033 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:43.033 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.193554+0000", 2024-09-12T16:18:43.033 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:43.033 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.033 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.033 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:43.033 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.193554+0000", 2024-09-12T16:18:43.033 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:43.033 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.033 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.033 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:43.033 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.193555+0000", 2024-09-12T16:18:43.033 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3399999999999999e-07 2024-09-12T16:18:43.034 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.034 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.034 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:43.034 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.193560+0000", 2024-09-12T16:18:43.034 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1889999999999998e-06 2024-09-12T16:18:43.034 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.034 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.034 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:43.034 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.193572+0000", 2024-09-12T16:18:43.034 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1653e-05 2024-09-12T16:18:43.034 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.034 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.035 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:43.035 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.193578+0000", 2024-09-12T16:18:43.035 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3759999999999996e-06 2024-09-12T16:18:43.035 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.035 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.035 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:43.035 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.197103+0000", 2024-09-12T16:18:43.035 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0035248889999999998 2024-09-12T16:18:43.035 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.035 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.036 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:43.036 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.197122+0000", 2024-09-12T16:18:43.036 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9272000000000001e-05 2024-09-12T16:18:43.036 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.036 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.036 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:43.036 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.199555+0000", 2024-09-12T16:18:43.036 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0024325710000000001 2024-09-12T16:18:43.036 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.036 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.036 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:43.036 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.199590+0000", 2024-09-12T16:18:43.036 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5265000000000002e-05 2024-09-12T16:18:43.037 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:43.037 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:43.037 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:43.037 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.037 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.037 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.4.0:5453 3.1c e149/136 3:3ea3e34f:::rbd_data.1155525b14e3.0000000000000029:f v 149'833, mlcod=148'828)", 2024-09-12T16:18:43.037 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.194348+0000", 2024-09-12T16:18:43.037 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.7641295990000003, 2024-09-12T16:18:43.037 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0060649639999999999, 2024-09-12T16:18:43.037 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:43.037 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:43.037 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:43.037 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:43.038 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.038 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:43.038 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194348+0000", 2024-09-12T16:18:43.038 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:43.038 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.038 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.038 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:43.038 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194348+0000", 2024-09-12T16:18:43.038 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:43.038 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.038 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.038 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:43.038 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194349+0000", 2024-09-12T16:18:43.038 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1999999999999999e-07 2024-09-12T16:18:43.038 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.038 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.039 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:43.039 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194354+0000", 2024-09-12T16:18:43.039 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5790000000000003e-06 2024-09-12T16:18:43.039 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.039 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.039 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:43.039 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194367+0000", 2024-09-12T16:18:43.039 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3191e-05 2024-09-12T16:18:43.039 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.039 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.040 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:43.040 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194374+0000", 2024-09-12T16:18:43.040 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6490000000000002e-06 2024-09-12T16:18:43.040 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.040 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.040 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:43.041 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195828+0000", 2024-09-12T16:18:43.041 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001454131 2024-09-12T16:18:43.041 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.041 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.041 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:43.041 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195846+0000", 2024-09-12T16:18:43.042 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7978999999999998e-05 2024-09-12T16:18:43.042 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.042 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.042 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:43.042 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.200370+0000", 2024-09-12T16:18:43.042 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0045236060000000003 2024-09-12T16:18:43.043 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.043 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.043 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:43.043 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.200413+0000", 2024-09-12T16:18:43.043 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3108999999999997e-05 2024-09-12T16:18:43.043 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:43.043 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:43.044 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:43.044 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.044 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.044 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.4.0:5454 3.1d e149/137 3:be124de3:::rbd_data.1155525b14e3.0000000000000015:f v 149'1489, mlcod=147'1484)", 2024-09-12T16:18:43.044 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.194388+0000", 2024-09-12T16:18:43.044 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.7640895839999997, 2024-09-12T16:18:43.044 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0045598710000000001, 2024-09-12T16:18:43.044 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:43.044 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:43.045 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:43.045 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:43.045 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.045 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:43.045 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194388+0000", 2024-09-12T16:18:43.045 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:43.045 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.045 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.046 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:43.046 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194388+0000", 2024-09-12T16:18:43.046 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:43.046 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.046 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.046 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:43.046 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194388+0000", 2024-09-12T16:18:43.046 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8299999999999998e-07 2024-09-12T16:18:43.047 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.047 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.047 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:43.047 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194396+0000", 2024-09-12T16:18:43.047 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.418e-06 2024-09-12T16:18:43.047 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.047 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.047 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:43.047 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194404+0000", 2024-09-12T16:18:43.047 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0490000000000004e-06 2024-09-12T16:18:43.047 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.048 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.048 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:43.048 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194409+0000", 2024-09-12T16:18:43.048 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1420000000000001e-06 2024-09-12T16:18:43.048 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.048 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.048 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:43.048 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194472+0000", 2024-09-12T16:18:43.048 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3058999999999994e-05 2024-09-12T16:18:43.048 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.048 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.048 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:43.048 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194484+0000", 2024-09-12T16:18:43.048 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.223e-05 2024-09-12T16:18:43.049 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.049 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.049 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:43.049 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.198908+0000", 2024-09-12T16:18:43.049 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0044234809999999999 2024-09-12T16:18:43.049 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.049 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.049 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:43.049 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.198948+0000", 2024-09-12T16:18:43.049 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0209000000000001e-05 2024-09-12T16:18:43.049 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:43.049 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:43.049 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:43.049 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.050 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.050 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.2.0:2914 3.5 e149/136 3:a003977d:::rbd_data.1155525b14e3.000000000000007b:f v 149'781, mlcod=147'777)", 2024-09-12T16:18:43.050 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.195113+0000", 2024-09-12T16:18:43.050 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.7633647320000003, 2024-09-12T16:18:43.050 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0044523849999999997, 2024-09-12T16:18:43.050 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:43.050 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:43.050 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:43.050 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:43.050 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.050 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:43.050 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195113+0000", 2024-09-12T16:18:43.050 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:43.050 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.051 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.051 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:43.051 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195113+0000", 2024-09-12T16:18:43.051 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:43.051 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.051 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.051 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:43.051 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195113+0000", 2024-09-12T16:18:43.051 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0800000000000005e-07 2024-09-12T16:18:43.051 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.051 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.051 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:43.051 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195118+0000", 2024-09-12T16:18:43.052 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7160000000000002e-06 2024-09-12T16:18:43.052 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.052 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.052 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:43.052 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195126+0000", 2024-09-12T16:18:43.052 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4430000000000003e-06 2024-09-12T16:18:43.052 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.052 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.052 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:43.052 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195132+0000", 2024-09-12T16:18:43.052 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6890000000000001e-06 2024-09-12T16:18:43.052 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.052 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.052 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:43.053 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195181+0000", 2024-09-12T16:18:43.053 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8922999999999999e-05 2024-09-12T16:18:43.053 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.053 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.053 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:43.053 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195207+0000", 2024-09-12T16:18:43.053 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5454999999999999e-05 2024-09-12T16:18:43.053 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.053 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.053 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:43.053 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.199522+0000", 2024-09-12T16:18:43.053 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004315864 2024-09-12T16:18:43.053 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.054 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.054 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:43.054 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.199565+0000", 2024-09-12T16:18:43.054 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2787000000000002e-05 2024-09-12T16:18:43.054 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:43.054 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:43.054 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:43.054 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.054 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.054 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.2.0:2915 3.5 e149/136 3:a0ca3b20:::rbd_data.1155525b14e3.0000000000000041:f v 149'783, mlcod=147'777)", 2024-09-12T16:18:43.054 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.195812+0000", 2024-09-12T16:18:43.054 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.7626652619999996, 2024-09-12T16:18:43.054 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0043974340000000004, 2024-09-12T16:18:43.054 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:43.055 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:43.055 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:43.055 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:43.055 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.055 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:43.055 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195812+0000", 2024-09-12T16:18:43.055 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:43.055 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.055 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.055 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:43.055 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195812+0000", 2024-09-12T16:18:43.055 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:43.055 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.056 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.056 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:43.056 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195813+0000", 2024-09-12T16:18:43.056 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1900000000000001e-07 2024-09-12T16:18:43.056 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.056 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.056 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:43.056 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195819+0000", 2024-09-12T16:18:43.056 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3839999999999996e-06 2024-09-12T16:18:43.056 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.056 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.056 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:43.056 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195828+0000", 2024-09-12T16:18:43.057 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1579999999999994e-06 2024-09-12T16:18:43.057 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.057 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.057 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:43.057 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195835+0000", 2024-09-12T16:18:43.057 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8040000000000004e-06 2024-09-12T16:18:43.057 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.057 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.057 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:43.057 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.198407+0000", 2024-09-12T16:18:43.057 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025724659999999998 2024-09-12T16:18:43.057 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.057 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.058 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:43.058 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.198425+0000", 2024-09-12T16:18:43.058 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8136999999999999e-05 2024-09-12T16:18:43.058 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.058 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.058 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:43.058 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.200173+0000", 2024-09-12T16:18:43.058 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017473949999999999 2024-09-12T16:18:43.058 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.058 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.058 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:43.058 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.200210+0000", 2024-09-12T16:18:43.058 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7171e-05 2024-09-12T16:18:43.058 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:43.059 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:43.059 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:43.059 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.059 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.059 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.3.0:6023 3.16 e149/137 3:68db2424:::rbd_data.1155525b14e3.000000000000002a:f v 149'1538, mlcod=148'1534)", 2024-09-12T16:18:43.059 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.201343+0000", 2024-09-12T16:18:43.059 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.7571342520000002, 2024-09-12T16:18:43.059 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0049766510000000003, 2024-09-12T16:18:43.059 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:43.059 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:43.059 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:43.060 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:43.060 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.060 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:43.060 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.201343+0000", 2024-09-12T16:18:43.060 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:43.060 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.060 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.060 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:43.060 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.201343+0000", 2024-09-12T16:18:43.060 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:43.060 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.060 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.061 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:43.061 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.201344+0000", 2024-09-12T16:18:43.061 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6300000000000005e-07 2024-09-12T16:18:43.061 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.061 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.061 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:43.061 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.201367+0000", 2024-09-12T16:18:43.061 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2534000000000001e-05 2024-09-12T16:18:43.061 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.061 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.061 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:43.061 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.201375+0000", 2024-09-12T16:18:43.061 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9199999999999993e-06 2024-09-12T16:18:43.061 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.061 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.062 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:43.062 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.201383+0000", 2024-09-12T16:18:43.062 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6389999999999992e-06 2024-09-12T16:18:43.062 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.062 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.062 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:43.062 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.201439+0000", 2024-09-12T16:18:43.062 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5673e-05 2024-09-12T16:18:43.062 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.062 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.062 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:43.062 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.201457+0000", 2024-09-12T16:18:43.062 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8623000000000001e-05 2024-09-12T16:18:43.062 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.062 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.063 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:43.063 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.206280+0000", 2024-09-12T16:18:43.063 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0048226279999999998 2024-09-12T16:18:43.063 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:43.063 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:43.063 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:43.063 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.206320+0000", 2024-09-12T16:18:43.063 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9971000000000001e-05 2024-09-12T16:18:43.063 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:43.063 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:43.063 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:43.063 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:43.063 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:43.063 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:43.065 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.3 to 1 (10000) 2024-09-12T16:18:43.066 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-12T16:18:43.066 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:43.064+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:43.066 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:18:43.165 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:43.164+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:43.224 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T16:18:43.227 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:43.227 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:43.227 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:18:43.227 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:43.238 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T16:18:43.266 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:43.266+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:43.368 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:43.367+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:43.391 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:43.392 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:43.392 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:18:43.392 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:18:43.392 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:43.401 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T16:18:43.469 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:43.468+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:43.550 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:43.550 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:18:43.550 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:18:43.550 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:18:43.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.551 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3705 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14812160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:43.551 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:18:43.551 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 145.408868219, 2024-09-12T16:18:43.551 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053368831999999998, 2024-09-12T16:18:43.551 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:43.551 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:43.551 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:43.551 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:43.551 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:43.551 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:43.551 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3705 2024-09-12T16:18:43.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.551 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:43.551 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.552 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:43.552 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:18:43.552 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.552 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:43.552 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139805+0000", 2024-09-12T16:18:43.552 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.552 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:43.552 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139932+0000", 2024-09-12T16:18:43.552 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012762099999999999 2024-09-12T16:18:43.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.553 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:43.553 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139935+0000", 2024-09-12T16:18:43.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.119e-06 2024-09-12T16:18:43.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.553 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:43.553 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139939+0000", 2024-09-12T16:18:43.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7999999999999998e-06 2024-09-12T16:18:43.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.553 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:43.553 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139953+0000", 2024-09-12T16:18:43.554 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3923999999999999e-05 2024-09-12T16:18:43.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.554 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:43.554 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.192946+0000", 2024-09-12T16:18:43.554 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052992971 2024-09-12T16:18:43.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.554 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:43.554 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193035+0000", 2024-09-12T16:18:43.554 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9040000000000001e-05 2024-09-12T16:18:43.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.554 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:43.555 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193174+0000", 2024-09-12T16:18:43.555 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138357 2024-09-12T16:18:43.555 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.555 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:43.555 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.555 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.555 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3706 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14816256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:43.555 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:18:43.555 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 145.408713229, 2024-09-12T16:18:43.555 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053341723000000001, 2024-09-12T16:18:43.555 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:43.555 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:43.556 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:43.556 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:43.556 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:43.556 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:43.556 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3706 2024-09-12T16:18:43.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.556 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:43.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.556 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:43.556 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:18:43.556 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:43.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.139960+0000", 2024-09-12T16:18:43.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:43.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140090+0000", 2024-09-12T16:18:43.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013020100000000001 2024-09-12T16:18:43.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:43.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140097+0000", 2024-09-12T16:18:43.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0709999999999997e-06 2024-09-12T16:18:43.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.558 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:43.558 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140103+0000", 2024-09-12T16:18:43.558 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5450000000000003e-06 2024-09-12T16:18:43.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.558 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:43.558 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140106+0000", 2024-09-12T16:18:43.558 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3739999999999998e-06 2024-09-12T16:18:43.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.558 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:43.558 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193190+0000", 2024-09-12T16:18:43.558 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053084131999999999 2024-09-12T16:18:43.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.559 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:43.559 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193232+0000", 2024-09-12T16:18:43.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1517000000000002e-05 2024-09-12T16:18:43.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.559 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:43.559 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193302+0000", 2024-09-12T16:18:43.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9882999999999995e-05 2024-09-12T16:18:43.559 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.559 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:43.560 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.560 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3707 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14820352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:43.560 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:18:43.560 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 145.40856124000001, 2024-09-12T16:18:43.560 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053452771000000003, 2024-09-12T16:18:43.560 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:43.560 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:43.560 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:43.560 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:43.560 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:43.560 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:43.561 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3707 2024-09-12T16:18:43.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.561 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:43.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:43.561 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:18:43.561 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:43.561 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140112+0000", 2024-09-12T16:18:43.561 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:43.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140219+0000", 2024-09-12T16:18:43.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106902 2024-09-12T16:18:43.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:43.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140225+0000", 2024-09-12T16:18:43.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3199999999999996e-06 2024-09-12T16:18:43.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:43.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140230+0000", 2024-09-12T16:18:43.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8969999999999999e-06 2024-09-12T16:18:43.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.563 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:43.563 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140233+0000", 2024-09-12T16:18:43.563 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2119999999999999e-06 2024-09-12T16:18:43.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.563 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:43.563 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193339+0000", 2024-09-12T16:18:43.563 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053105556999999998 2024-09-12T16:18:43.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.563 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:43.564 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193431+0000", 2024-09-12T16:18:43.564 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1837999999999997e-05 2024-09-12T16:18:43.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.564 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.564 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:43.564 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193565+0000", 2024-09-12T16:18:43.564 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013404500000000001 2024-09-12T16:18:43.564 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.564 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:43.564 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.564 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.564 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3708 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14824448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:43.565 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:18:43.565 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 145.408432398, 2024-09-12T16:18:43.565 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053468190999999998, 2024-09-12T16:18:43.565 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:43.565 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:43.565 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:43.565 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:43.565 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:43.565 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:43.565 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3708 2024-09-12T16:18:43.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.565 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:43.565 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.566 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:43.566 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:18:43.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.566 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:43.566 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140241+0000", 2024-09-12T16:18:43.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.566 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:43.566 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140351+0000", 2024-09-12T16:18:43.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110096 2024-09-12T16:18:43.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:43.567 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140358+0000", 2024-09-12T16:18:43.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.306e-06 2024-09-12T16:18:43.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:43.567 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140368+0000", 2024-09-12T16:18:43.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0225e-05 2024-09-12T16:18:43.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:43.567 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140372+0000", 2024-09-12T16:18:43.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6169999999999998e-06 2024-09-12T16:18:43.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.568 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:43.568 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193594+0000", 2024-09-12T16:18:43.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053222419999999999 2024-09-12T16:18:43.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.568 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:43.568 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193640+0000", 2024-09-12T16:18:43.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.587e-05 2024-09-12T16:18:43.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.568 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:43.568 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193709+0000", 2024-09-12T16:18:43.569 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8657000000000004e-05 2024-09-12T16:18:43.569 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.569 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:43.569 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.569 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3709 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14828544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:43.569 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:18:43.569 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 145.40829543000001, 2024-09-12T16:18:43.569 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594033999999999, 2024-09-12T16:18:43.569 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:43.569 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:43.569 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:43.569 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:43.569 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:43.570 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:43.570 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3709 2024-09-12T16:18:43.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.570 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:43.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.570 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:43.570 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:18:43.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.570 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:43.570 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140378+0000", 2024-09-12T16:18:43.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:43.571 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140499+0000", 2024-09-12T16:18:43.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121019 2024-09-12T16:18:43.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:43.571 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140501+0000", 2024-09-12T16:18:43.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2369999999999999e-06 2024-09-12T16:18:43.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:43.572 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140506+0000", 2024-09-12T16:18:43.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.639e-06 2024-09-12T16:18:43.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.572 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:43.572 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140509+0000", 2024-09-12T16:18:43.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3419999999999999e-06 2024-09-12T16:18:43.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.572 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:43.572 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193743+0000", 2024-09-12T16:18:43.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053234311999999999 2024-09-12T16:18:43.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.573 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:43.573 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193833+0000", 2024-09-12T16:18:43.573 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9883999999999995e-05 2024-09-12T16:18:43.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.573 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:43.573 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.193972+0000", 2024-09-12T16:18:43.573 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138601 2024-09-12T16:18:43.573 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.573 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:43.573 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.574 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3710 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14832640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:43.574 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:18:43.574 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 145.40815808400001, 2024-09-12T16:18:43.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053607324999999997, 2024-09-12T16:18:43.574 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:43.574 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:43.574 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:43.574 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:43.574 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:43.574 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:43.574 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3710 2024-09-12T16:18:43.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.575 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:43.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:43.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:18:43.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:43.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140515+0000", 2024-09-12T16:18:43.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:43.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140664+0000", 2024-09-12T16:18:43.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014918700000000001 2024-09-12T16:18:43.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.576 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:43.576 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140674+0000", 2024-09-12T16:18:43.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8379999999999997e-06 2024-09-12T16:18:43.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.576 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:43.576 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140694+0000", 2024-09-12T16:18:43.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0145000000000001e-05 2024-09-12T16:18:43.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.576 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:43.576 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140703+0000", 2024-09-12T16:18:43.577 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5150000000000006e-06 2024-09-12T16:18:43.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.577 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:43.577 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194006+0000", 2024-09-12T16:18:43.577 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053303370000000003 2024-09-12T16:18:43.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.577 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:43.577 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194051+0000", 2024-09-12T16:18:43.577 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5012000000000002e-05 2024-09-12T16:18:43.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.577 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:43.578 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194122+0000", 2024-09-12T16:18:43.578 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1258000000000001e-05 2024-09-12T16:18:43.578 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.578 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:43.578 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.578 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3711 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14836736~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:43.578 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:18:43.578 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 145.40795663599999, 2024-09-12T16:18:43.578 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053670799999999998, 2024-09-12T16:18:43.578 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:43.578 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:43.578 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:43.578 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:43.579 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:43.579 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:43.579 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3711 2024-09-12T16:18:43.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.579 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:43.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.579 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:43.579 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:18:43.579 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.579 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:43.579 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140716+0000", 2024-09-12T16:18:43.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:43.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140782+0000", 2024-09-12T16:18:43.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5549999999999994e-05 2024-09-12T16:18:43.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:43.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140786+0000", 2024-09-12T16:18:43.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.89e-06 2024-09-12T16:18:43.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:43.581 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140796+0000", 2024-09-12T16:18:43.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0057e-05 2024-09-12T16:18:43.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.581 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.581 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:43.581 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140819+0000", 2024-09-12T16:18:43.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3005000000000001e-05 2024-09-12T16:18:43.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.581 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.581 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:43.581 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194159+0000", 2024-09-12T16:18:43.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053340324000000001 2024-09-12T16:18:43.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.582 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:43.582 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194248+0000", 2024-09-12T16:18:43.582 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9209000000000006e-05 2024-09-12T16:18:43.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.582 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:43.582 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194387+0000", 2024-09-12T16:18:43.582 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138765 2024-09-12T16:18:43.582 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.582 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:43.582 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.583 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3712 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14840832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:43.583 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:18:43.583 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 145.40784217800001, 2024-09-12T16:18:43.583 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053699068000000003, 2024-09-12T16:18:43.583 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:43.583 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:43.583 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:43.583 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:43.583 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:43.583 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:43.583 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3712 2024-09-12T16:18:43.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.583 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:43.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.583 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:43.584 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:18:43.584 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.584 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.584 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:43.584 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140831+0000", 2024-09-12T16:18:43.584 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.584 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.584 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:43.584 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140900+0000", 2024-09-12T16:18:43.584 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9014e-05 2024-09-12T16:18:43.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.585 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.585 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:43.585 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140904+0000", 2024-09-12T16:18:43.585 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0940000000000001e-06 2024-09-12T16:18:43.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.585 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.585 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:43.585 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140933+0000", 2024-09-12T16:18:43.585 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8996000000000002e-05 2024-09-12T16:18:43.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.585 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.585 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:43.586 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140945+0000", 2024-09-12T16:18:43.586 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1909000000000001e-05 2024-09-12T16:18:43.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.586 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:43.586 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194415+0000", 2024-09-12T16:18:43.586 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053470403 2024-09-12T16:18:43.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.586 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:43.586 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194460+0000", 2024-09-12T16:18:43.586 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5145000000000002e-05 2024-09-12T16:18:43.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.587 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:43.587 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194530+0000", 2024-09-12T16:18:43.587 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9506999999999997e-05 2024-09-12T16:18:43.587 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.587 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:43.587 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.587 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3713 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14844928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:43.587 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:18:43.587 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 145.40770911800001, 2024-09-12T16:18:43.587 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053821236000000001, 2024-09-12T16:18:43.588 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:43.588 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:43.588 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:43.588 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:43.588 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:43.588 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:43.588 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3713 2024-09-12T16:18:43.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.588 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:43.588 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.588 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:43.588 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:18:43.588 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.589 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:43.589 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.140964+0000", 2024-09-12T16:18:43.589 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.589 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:43.589 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141078+0000", 2024-09-12T16:18:43.589 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114162 2024-09-12T16:18:43.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.589 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:43.590 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141090+0000", 2024-09-12T16:18:43.590 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.19e-05 2024-09-12T16:18:43.590 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.590 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.590 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:43.590 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141100+0000", 2024-09-12T16:18:43.590 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0447e-05 2024-09-12T16:18:43.590 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.590 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.590 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:43.590 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141108+0000", 2024-09-12T16:18:43.590 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7190000000000001e-06 2024-09-12T16:18:43.590 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.590 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.591 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:43.591 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194564+0000", 2024-09-12T16:18:43.591 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053455729 2024-09-12T16:18:43.591 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.591 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.591 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:43.591 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194652+0000", 2024-09-12T16:18:43.591 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8288999999999994e-05 2024-09-12T16:18:43.591 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.591 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.591 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:43.591 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194785+0000", 2024-09-12T16:18:43.591 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013299000000000001 2024-09-12T16:18:43.591 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.592 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:43.592 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.592 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.592 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.592 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3714 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14849024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:43.592 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:18:43.592 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 145.407553189, 2024-09-12T16:18:43.592 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053816382000000003, 2024-09-12T16:18:43.592 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:43.592 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:43.592 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:43.592 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:43.592 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:43.592 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:43.593 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3714 2024-09-12T16:18:43.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.593 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:43.593 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.593 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:43.593 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:18:43.593 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.593 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.593 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:43.593 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141120+0000", 2024-09-12T16:18:43.593 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.594 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.594 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:43.594 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141182+0000", 2024-09-12T16:18:43.594 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1805999999999997e-05 2024-09-12T16:18:43.594 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.594 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.594 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:43.594 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141185+0000", 2024-09-12T16:18:43.594 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5930000000000002e-06 2024-09-12T16:18:43.594 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.594 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.594 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:43.594 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141194+0000", 2024-09-12T16:18:43.594 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5760000000000006e-06 2024-09-12T16:18:43.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.595 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.595 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:43.595 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141222+0000", 2024-09-12T16:18:43.595 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8034999999999998e-05 2024-09-12T16:18:43.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.595 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.595 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:43.595 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194817+0000", 2024-09-12T16:18:43.595 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053594887000000001 2024-09-12T16:18:43.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.595 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.595 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:43.595 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194860+0000", 2024-09-12T16:18:43.595 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3714999999999997e-05 2024-09-12T16:18:43.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.596 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.596 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:43.596 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194936+0000", 2024-09-12T16:18:43.596 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5770000000000001e-05 2024-09-12T16:18:43.596 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.596 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:43.596 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.596 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.596 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3715 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14853120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:43.596 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:18:43.596 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 145.40742953200001, 2024-09-12T16:18:43.596 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053962307000000001, 2024-09-12T16:18:43.596 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:43.597 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:43.597 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:43.597 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:43.597 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:43.597 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:43.597 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3715 2024-09-12T16:18:43.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.597 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:43.597 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.597 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:43.597 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:18:43.597 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.597 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.597 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:43.598 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141244+0000", 2024-09-12T16:18:43.598 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.598 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:43.598 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141417+0000", 2024-09-12T16:18:43.598 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017384099999999999 2024-09-12T16:18:43.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.598 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:43.598 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141422+0000", 2024-09-12T16:18:43.598 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7310000000000001e-06 2024-09-12T16:18:43.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.598 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:43.599 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141434+0000", 2024-09-12T16:18:43.599 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2058e-05 2024-09-12T16:18:43.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.599 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.599 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:43.599 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141442+0000", 2024-09-12T16:18:43.599 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7610000000000007e-06 2024-09-12T16:18:43.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.599 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.599 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:43.599 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.194973+0000", 2024-09-12T16:18:43.599 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053530618000000002 2024-09-12T16:18:43.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.600 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.600 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:43.600 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195063+0000", 2024-09-12T16:18:43.600 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0927000000000005e-05 2024-09-12T16:18:43.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.600 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.600 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:43.600 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195206+0000", 2024-09-12T16:18:43.600 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142371 2024-09-12T16:18:43.600 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.600 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:43.600 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.600 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.601 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3716 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14857216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:43.601 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:18:43.601 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 145.407219682, 2024-09-12T16:18:43.601 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053916360000000003, 2024-09-12T16:18:43.601 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:43.601 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:43.601 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:43.601 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:43.601 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:43.601 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:43.601 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3716 2024-09-12T16:18:43.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.601 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:43.601 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.602 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:43.602 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:18:43.602 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.602 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.602 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:43.602 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.141453+0000", 2024-09-12T16:18:43.602 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.602 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.602 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:43.602 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142933+0000", 2024-09-12T16:18:43.602 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014796290000000001 2024-09-12T16:18:43.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.603 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.603 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:43.603 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142937+0000", 2024-09-12T16:18:43.603 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5760000000000002e-06 2024-09-12T16:18:43.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.603 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.603 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:43.603 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142946+0000", 2024-09-12T16:18:43.603 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0380000000000005e-06 2024-09-12T16:18:43.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.603 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.603 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:43.603 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.142951+0000", 2024-09-12T16:18:43.603 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9749999999999998e-06 2024-09-12T16:18:43.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.604 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.604 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:43.604 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195246+0000", 2024-09-12T16:18:43.604 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052295358 2024-09-12T16:18:43.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.604 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.604 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:43.604 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195299+0000", 2024-09-12T16:18:43.604 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2976999999999998e-05 2024-09-12T16:18:43.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.604 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.604 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:43.604 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.195370+0000", 2024-09-12T16:18:43.605 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0807000000000002e-05 2024-09-12T16:18:43.605 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.605 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:43.605 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.605 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3721 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14877696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:43.605 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:18:43.605 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 145.40564623099999, 2024-09-12T16:18:43.605 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053422994000000001, 2024-09-12T16:18:43.605 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:43.605 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:43.605 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:43.605 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:43.606 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:43.606 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:43.606 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3721 2024-09-12T16:18:43.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.606 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:43.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.606 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:43.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:18:43.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.606 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:43.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:18:43.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.607 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:43.607 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143027+0000", 2024-09-12T16:18:43.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1199999999999999e-07 2024-09-12T16:18:43.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.607 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:43.607 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143028+0000", 2024-09-12T16:18:43.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7399999999999991e-07 2024-09-12T16:18:43.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.607 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:43.607 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143031+0000", 2024-09-12T16:18:43.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7599999999999998e-06 2024-09-12T16:18:43.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.608 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:43.608 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143034+0000", 2024-09-12T16:18:43.608 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9780000000000001e-06 2024-09-12T16:18:43.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.608 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:43.608 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196220+0000", 2024-09-12T16:18:43.608 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053186341999999998 2024-09-12T16:18:43.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.608 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:43.609 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196313+0000", 2024-09-12T16:18:43.609 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2676000000000005e-05 2024-09-12T16:18:43.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.609 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.609 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:43.609 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196450+0000", 2024-09-12T16:18:43.609 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137052 2024-09-12T16:18:43.609 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.609 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:43.609 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.609 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.610 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3722 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14881792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:43.610 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:18:43.610 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 145.40563633900001, 2024-09-12T16:18:43.610 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053556835999999997, 2024-09-12T16:18:43.610 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:43.610 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:43.610 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:43.610 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:43.610 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:43.610 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:43.610 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3722 2024-09-12T16:18:43.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.610 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:43.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.611 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:43.611 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:18:43.611 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.611 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:43.611 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:18:43.611 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.611 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:43.611 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143037+0000", 2024-09-12T16:18:43.611 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.11e-07 2024-09-12T16:18:43.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.612 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:43.612 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143038+0000", 2024-09-12T16:18:43.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2399999999999996e-07 2024-09-12T16:18:43.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.612 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:43.612 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143041+0000", 2024-09-12T16:18:43.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8030000000000001e-06 2024-09-12T16:18:43.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.612 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:43.612 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143043+0000", 2024-09-12T16:18:43.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3140000000000002e-06 2024-09-12T16:18:43.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.613 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:43.613 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196481+0000", 2024-09-12T16:18:43.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053437601000000001 2024-09-12T16:18:43.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.613 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:43.613 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196525+0000", 2024-09-12T16:18:43.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4280000000000003e-05 2024-09-12T16:18:43.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.613 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:43.613 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196594+0000", 2024-09-12T16:18:43.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8702999999999996e-05 2024-09-12T16:18:43.614 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.614 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:43.614 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.614 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:3723 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 14885888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:43.614 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:18:43.614 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 145.405627157, 2024-09-12T16:18:43.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053815546999999998, 2024-09-12T16:18:43.614 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:43.614 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:43.614 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:43.614 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:43.614 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:43.615 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:43.615 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 3723 2024-09-12T16:18:43.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.615 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:43.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:43.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:18:43.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:43.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.143046+0000", 2024-09-12T16:18:43.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:43.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148994+0000", 2024-09-12T16:18:43.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059481330000000004 2024-09-12T16:18:43.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:43.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.148999+0000", 2024-09-12T16:18:43.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7140000000000001e-06 2024-09-12T16:18:43.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:43.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149008+0000", 2024-09-12T16:18:43.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4350000000000003e-06 2024-09-12T16:18:43.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:43.617 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.149021+0000", 2024-09-12T16:18:43.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2514000000000001e-05 2024-09-12T16:18:43.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:43.617 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196630+0000", 2024-09-12T16:18:43.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047609758000000002 2024-09-12T16:18:43.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:43.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196724+0000", 2024-09-12T16:18:43.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3522000000000003e-05 2024-09-12T16:18:43.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.618 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:43.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.196861+0000", 2024-09-12T16:18:43.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013747100000000001 2024-09-12T16:18:43.618 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.618 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:43.618 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.618 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4438 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15719424~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:43.619 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:18:43.619 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 145.26074638, 2024-09-12T16:18:43.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367981000000002, 2024-09-12T16:18:43.619 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:43.619 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:43.619 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:43.619 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:43.619 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:43.619 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:43.619 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4438 2024-09-12T16:18:43.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.619 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:43.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:43.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:18:43.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:43.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:18:43.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:43.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287927+0000", 2024-09-12T16:18:43.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3e-07 2024-09-12T16:18:43.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:43.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287930+0000", 2024-09-12T16:18:43.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-12T16:18:43.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:43.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287937+0000", 2024-09-12T16:18:43.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.08e-06 2024-09-12T16:18:43.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:43.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287943+0000", 2024-09-12T16:18:43.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5709999999999997e-06 2024-09-12T16:18:43.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:43.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341068+0000", 2024-09-12T16:18:43.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053125101000000001 2024-09-12T16:18:43.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:43.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341154+0000", 2024-09-12T16:18:43.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6100999999999994e-05 2024-09-12T16:18:43.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:43.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341295+0000", 2024-09-12T16:18:43.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014087999999999999 2024-09-12T16:18:43.623 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.623 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:43.623 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.623 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4439 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15723520~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:43.623 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:18:43.623 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 145.26072221999999, 2024-09-12T16:18:43.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053526799, 2024-09-12T16:18:43.623 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:43.623 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:43.623 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:43.623 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:43.624 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:43.624 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:43.624 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4439 2024-09-12T16:18:43.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.624 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:43.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:43.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:18:43.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:43.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:18:43.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:43.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287951+0000", 2024-09-12T16:18:43.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8500000000000002e-07 2024-09-12T16:18:43.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:43.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287953+0000", 2024-09-12T16:18:43.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1349999999999999e-06 2024-09-12T16:18:43.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:43.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287960+0000", 2024-09-12T16:18:43.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-12T16:18:43.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:43.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287965+0000", 2024-09-12T16:18:43.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1580000000000004e-06 2024-09-12T16:18:43.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:43.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341332+0000", 2024-09-12T16:18:43.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053367009 2024-09-12T16:18:43.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:43.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341402+0000", 2024-09-12T16:18:43.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9759999999999996e-05 2024-09-12T16:18:43.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:43.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341478+0000", 2024-09-12T16:18:43.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5412000000000002e-05 2024-09-12T16:18:43.627 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.627 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:43.627 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.628 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4615.0:4440 3.17 3:ef54c282:::rbd_data.1155627435cb.0000000000000004:9 [read 15727616~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:43.628 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:18:43.628 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 145.26070111600001, 2024-09-12T16:18:43.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053761601999999999, 2024-09-12T16:18:43.628 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:43.628 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:43.628 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:43.628 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:43.628 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4615", 2024-09-12T16:18:43.628 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:43.628 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 4440 2024-09-12T16:18:43.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.629 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:43.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:43.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:18:43.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:43.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:18:43.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:43.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287972+0000", 2024-09-12T16:18:43.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:18:43.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:43.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287974+0000", 2024-09-12T16:18:43.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0540000000000002e-06 2024-09-12T16:18:43.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:43.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287980+0000", 2024-09-12T16:18:43.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9440000000000002e-06 2024-09-12T16:18:43.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:43.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.287987+0000", 2024-09-12T16:18:43.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5889999999999999e-06 2024-09-12T16:18:43.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:43.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341502+0000", 2024-09-12T16:18:43.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053515199999999999 2024-09-12T16:18:43.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:43.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341595+0000", 2024-09-12T16:18:43.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3097000000000007e-05 2024-09-12T16:18:43.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:43.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:18.341734+0000", 2024-09-12T16:18:43.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013832800000000001 2024-09-12T16:18:43.632 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.632 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:43.632 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.632 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2209 3.1 3:85f36d3b:::rbd_data.1155ccb1894c.0000000000000004:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:18:43.632 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:18:43.632 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 106.177015978, 2024-09-12T16:18:43.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.060659365, 2024-09-12T16:18:43.633 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:43.633 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:43.633 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:43.633 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:43.633 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:18:43.633 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:18:43.633 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2209 2024-09-12T16:18:43.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.633 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:43.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:43.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:18:43.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:43.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371657+0000", 2024-09-12T16:18:43.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:43.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.371658+0000", 2024-09-12T16:18:43.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1570000000000001e-06 2024-09-12T16:18:43.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:43.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393414+0000", 2024-09-12T16:18:43.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021755495999999999 2024-09-12T16:18:43.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:43.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393447+0000", 2024-09-12T16:18:43.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3630000000000002e-05 2024-09-12T16:18:43.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:43.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393462+0000", 2024-09-12T16:18:43.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5048999999999999e-05 2024-09-12T16:18:43.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:43.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393556+0000", 2024-09-12T16:18:43.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3549999999999997e-05 2024-09-12T16:18:43.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:43.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.393697+0000", 2024-09-12T16:18:43.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000141414 2024-09-12T16:18:43.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T16:18:43.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.394944+0000", 2024-09-12T16:18:43.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012463039999999999 2024-09-12T16:18:43.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:43.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.431803+0000", 2024-09-12T16:18:43.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0368594 2024-09-12T16:18:43.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:18:43.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432268+0000", 2024-09-12T16:18:43.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046457600000000002 2024-09-12T16:18:43.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:18:43.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432293+0000", 2024-09-12T16:18:43.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.527e-05 2024-09-12T16:18:43.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:43.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.432316+0000", 2024-09-12T16:18:43.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3519e-05 2024-09-12T16:18:43.638 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.638 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:43.638 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.638 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5254.0:9400 3.1f 3:feea9999:::rbd_data.1155338d0570.0000000000000007:head [read 32768~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-12T16:18:43.638 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:20.012502+0000", 2024-09-12T16:18:43.639 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 83.536170986000002, 2024-09-12T16:18:43.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.000678049, 2024-09-12T16:18:43.639 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:43.639 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:43.639 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:43.639 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:43.639 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5254", 2024-09-12T16:18:43.639 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/1491253064", 2024-09-12T16:18:43.639 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 9400 2024-09-12T16:18:43.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.639 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:43.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:43.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012502+0000", 2024-09-12T16:18:43.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:43.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012502+0000", 2024-09-12T16:18:43.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:43.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:43.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012504+0000", 2024-09-12T16:18:43.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5939999999999999e-06 2024-09-12T16:18:43.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:43.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012511+0000", 2024-09-12T16:18:43.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0840000000000003e-06 2024-09-12T16:18:43.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:43.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012525+0000", 2024-09-12T16:18:43.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4538999999999999e-05 2024-09-12T16:18:43.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:43.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012532+0000", 2024-09-12T16:18:43.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8310000000000003e-06 2024-09-12T16:18:43.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:43.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012605+0000", 2024-09-12T16:18:43.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2387999999999999e-05 2024-09-12T16:18:43.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T16:18:43.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:20.012617+0000", 2024-09-12T16:18:43.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2167999999999999e-05 2024-09-12T16:18:43.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:43.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:21.012823+0000", 2024-09-12T16:18:43.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0002068230000001 2024-09-12T16:18:43.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:43.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:21.012975+0000", 2024-09-12T16:18:43.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015196200000000001 2024-09-12T16:18:43.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:43.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:43.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:43.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:21.013180+0000", 2024-09-12T16:18:43.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020466000000000001 2024-09-12T16:18:43.643 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.643 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:43.643 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.643 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:43.643 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:43.643 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:43.644 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T16:18:43.645 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:18:43.646 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:43.644+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:43.745 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:43.744+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:43.797 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:43.797 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:43.797 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:18:43.797 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:43.806 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:18:43.812 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T16:18:43.812 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T16:18:43.831 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:18:43.831 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:18:43.846 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:43.845+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:43.848 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:18:43.848 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:18:43.865 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:18:43.865 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:18:43.883 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:18:43.883 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:18:43.901 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:18:43.901 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:18:43.921 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:43.921 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:43.930 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:18:43.971 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:43.970+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:44.015 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2024-09-12T16:18:44.019 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.5 to 1 (10000) 2024-09-12T16:18:44.040 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-12T16:18:44.040 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T16:18:44.081 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:44.080+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:44.092 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:44.092 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:44.102 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:18:44.149 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:44.149+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:44.250 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:44.250+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:44.256 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:44.256 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:44.268 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:18:44.351 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:44.350+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:44.375 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:44.375 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:44.384 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:18:44.393 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:18:44.393 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-12T16:18:44.404 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":243,"stamp":"2024-09-12T16:18:44.015677+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":350563861,"num_objects":712,"num_object_clones":39,"num_object_copies":1424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":712,"num_whiteouts":447,"num_read":451606,"num_read_kb":1622891,"num_write":28954,"num_write_kb":480484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5094,"num_bytes_recovered":203261420,"num_keys_recovered":679,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23938,"ondisk_log_size":23938,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":402140,"kb_used_data":56660,"kb_used_omap":19,"kb_used_meta":343980,"kb_avail":565828900,"statfs":{"total":579820584960,"available":579408793600,"internally_reserved":0,"allocated":58019840,"data_stored":80703610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19565,"internal_metadata":352236435},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.821820"},"pg_stats":[{"pgid":"3.1f","version":"151'647","reported_seq":18807,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.201881+0000","last_change":"2024-09-12T16:18:39.202274+0000","last_active":"2024-09-12T16:18:39.201881+0000","last_peered":"2024-09-12T16:18:39.201881+0000","last_clean":"2024-09-12T16:18:39.201881+0000","last_became_active":"2024-09-12T16:17:21.011550+0000","last_became_peered":"2024-09-12T16:17:21.011550+0000","last_unstale":"2024-09-12T16:18:39.201881+0000","last_undegraded":"2024-09-12T16:18:39.201881+0000","last_fullsized":"2024-09-12T16:18:39.201881+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:18.831762+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0068338009999999996,"stat_sum":{"num_bytes":11732496,"num_objects":23,"num_object_clones":2,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":15,"num_read":18831,"num_read_kb":74246,"num_write":853,"num_write_kb":11027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":2818651,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.1e","version":"151'596","reported_seq":13948,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.201733+0000","last_change":"2024-09-12T16:18:39.201733+0000","last_active":"2024-09-12T16:18:39.201733+0000","last_peered":"2024-09-12T16:18:39.201733+0000","last_clean":"2024-09-12T16:18:39.201733+0000","last_became_active":"2024-09-12T16:16:55.202876+0000","last_became_peered":"2024-09-12T16:16:55.202876+0000","last_unstale":"2024-09-12T16:18:39.201733+0000","last_undegraded":"2024-09-12T16:18:39.201733+0000","last_fullsized":"2024-09-12T16:18:39.201733+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:08:24.653915+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.0092288519999999992,"stat_sum":{"num_bytes":9723904,"num_objects":31,"num_object_clones":1,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":20,"num_read":13702,"num_read_kb":46928,"num_write":617,"num_write_kb":8472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":3145760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.1d","version":"150'1496","reported_seq":20227,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.195092+0000","last_change":"2024-09-12T16:18:39.195510+0000","last_active":"2024-09-12T16:18:39.195092+0000","last_peered":"2024-09-12T16:18:39.195092+0000","last_clean":"2024-09-12T16:18:39.195092+0000","last_became_active":"2024-09-12T16:18:26.148000+0000","last_became_peered":"2024-09-12T16:18:26.148000+0000","last_unstale":"2024-09-12T16:18:39.195092+0000","last_undegraded":"2024-09-12T16:18:39.195092+0000","last_fullsized":"2024-09-12T16:18:39.195092+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1496,"log_dups_size":0,"ondisk_log_size":1496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:38.591058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065995099999999998,"stat_sum":{"num_bytes":20784867,"num_objects":29,"num_object_clones":3,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":18,"num_read":22707,"num_read_kb":67057,"num_write":2108,"num_write_kb":16171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":374,"num_bytes_recovered":30814554,"num_keys_recovered":34,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.1c","version":"151'842","reported_seq":9057,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.312556+0000","last_change":"2024-09-12T16:18:39.199179+0000","last_active":"2024-09-12T16:18:39.312556+0000","last_peered":"2024-09-12T16:18:39.312556+0000","last_clean":"2024-09-12T16:18:39.312556+0000","last_became_active":"2024-09-12T16:18:25.147460+0000","last_became_peered":"2024-09-12T16:18:25.147460+0000","last_unstale":"2024-09-12T16:18:39.312556+0000","last_undegraded":"2024-09-12T16:18:39.312556+0000","last_fullsized":"2024-09-12T16:18:39.312556+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":842,"log_dups_size":0,"ondisk_log_size":842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:13.116215+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0042266559999999996,"stat_sum":{"num_bytes":278528,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":12,"num_read":9676,"num_read_kb":27859,"num_write":1096,"num_write_kb":6805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":3550768,"num_keys_recovered":168,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.1b","version":"151'1249","reported_seq":8800,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.208511+0000","last_change":"2024-09-12T16:18:39.208511+0000","last_active":"2024-09-12T16:18:39.208511+0000","last_peered":"2024-09-12T16:18:39.208511+0000","last_clean":"2024-09-12T16:18:39.208511+0000","last_became_active":"2024-09-12T16:17:21.011585+0000","last_became_peered":"2024-09-12T16:17:21.011585+0000","last_unstale":"2024-09-12T16:18:39.208511+0000","last_undegraded":"2024-09-12T16:18:39.208511+0000","last_fullsized":"2024-09-12T16:18:39.208511+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1249,"log_dups_size":0,"ondisk_log_size":1249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:01.909712+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.011421169,"stat_sum":{"num_bytes":2555904,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":15,"num_read":12367,"num_read_kb":38179,"num_write":1726,"num_write_kb":15361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":14697984,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.1a","version":"150'1309","reported_seq":11897,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.325288+0000","last_change":"2024-09-12T16:18:39.202286+0000","last_active":"2024-09-12T16:18:39.325288+0000","last_peered":"2024-09-12T16:18:39.325288+0000","last_clean":"2024-09-12T16:18:39.325288+0000","last_became_active":"2024-09-12T16:15:57.014803+0000","last_became_peered":"2024-09-12T16:15:57.014803+0000","last_unstale":"2024-09-12T16:18:39.325288+0000","last_undegraded":"2024-09-12T16:18:39.325288+0000","last_fullsized":"2024-09-12T16:18:39.325288+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1309,"log_dups_size":0,"ondisk_log_size":1309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:43.194878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.006031247,"stat_sum":{"num_bytes":3686419,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":19,"num_read":15288,"num_read_kb":54308,"num_write":2006,"num_write_kb":21868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.19","version":"151'530","reported_seq":14862,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.201391+0000","last_change":"2024-09-12T16:18:39.201780+0000","last_active":"2024-09-12T16:18:39.201391+0000","last_peered":"2024-09-12T16:18:39.201391+0000","last_clean":"2024-09-12T16:18:39.201391+0000","last_became_active":"2024-09-12T16:15:57.016110+0000","last_became_peered":"2024-09-12T16:15:57.016110+0000","last_unstale":"2024-09-12T16:18:39.201391+0000","last_undegraded":"2024-09-12T16:18:39.201391+0000","last_fullsized":"2024-09-12T16:18:39.201391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:21.330798+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0097675869999999995,"stat_sum":{"num_bytes":7046656,"num_objects":30,"num_object_clones":2,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":19,"num_read":14633,"num_read_kb":54220,"num_write":557,"num_write_kb":10346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.18","version":"149'754","reported_seq":6298,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.194799+0000","last_change":"2024-09-12T16:18:39.195707+0000","last_active":"2024-09-12T16:18:39.194799+0000","last_peered":"2024-09-12T16:18:39.194799+0000","last_clean":"2024-09-12T16:18:39.194799+0000","last_became_active":"2024-09-12T16:17:21.009370+0000","last_became_peered":"2024-09-12T16:17:21.009370+0000","last_unstale":"2024-09-12T16:18:39.194799+0000","last_undegraded":"2024-09-12T16:18:39.194799+0000","last_fullsized":"2024-09-12T16:18:39.194799+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:07.842034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026414799999999999,"stat_sum":{"num_bytes":2251347,"num_objects":18,"num_object_clones":1,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":12,"num_read":7092,"num_read_kb":45463,"num_write":888,"num_write_kb":34056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":17173091,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.17","version":"151'670","reported_seq":8242,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.287445+0000","last_change":"2024-09-12T16:18:39.203172+0000","last_active":"2024-09-12T16:18:39.287445+0000","last_peered":"2024-09-12T16:18:39.287445+0000","last_clean":"2024-09-12T16:18:39.287445+0000","last_became_active":"2024-09-12T16:18:26.148363+0000","last_became_peered":"2024-09-12T16:18:26.148363+0000","last_unstale":"2024-09-12T16:18:39.287445+0000","last_undegraded":"2024-09-12T16:18:39.287445+0000","last_fullsized":"2024-09-12T16:18:39.287445+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":670,"log_dups_size":0,"ondisk_log_size":670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:05.856083+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0074591019999999996,"stat_sum":{"num_bytes":26658334,"num_objects":26,"num_object_clones":1,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":18,"num_read":7854,"num_read_kb":33829,"num_write":903,"num_write_kb":21944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":331,"num_bytes_recovered":20360415,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.16","version":"151'1576","reported_seq":15781,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.205360+0000","last_change":"2024-09-12T16:18:39.205360+0000","last_active":"2024-09-12T16:18:39.205360+0000","last_peered":"2024-09-12T16:18:39.205360+0000","last_clean":"2024-09-12T16:18:39.205360+0000","last_became_active":"2024-09-12T16:18:26.147921+0000","last_became_peered":"2024-09-12T16:18:26.147921+0000","last_unstale":"2024-09-12T16:18:39.205360+0000","last_undegraded":"2024-09-12T16:18:39.205360+0000","last_fullsized":"2024-09-12T16:18:39.205360+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1576,"log_dups_size":0,"ondisk_log_size":1576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:12.177829+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.012976682,"stat_sum":{"num_bytes":22728456,"num_objects":26,"num_object_clones":4,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":16,"num_read":19138,"num_read_kb":50012,"num_write":2334,"num_write_kb":15645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":483,"num_bytes_recovered":14102804,"num_keys_recovered":132,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.15","version":"149'374","reported_seq":7755,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.197996+0000","last_change":"2024-09-12T16:18:39.199321+0000","last_active":"2024-09-12T16:18:39.197996+0000","last_peered":"2024-09-12T16:18:39.197996+0000","last_clean":"2024-09-12T16:18:39.197996+0000","last_became_active":"2024-09-12T16:16:55.203324+0000","last_became_peered":"2024-09-12T16:16:55.203324+0000","last_unstale":"2024-09-12T16:18:39.197996+0000","last_undegraded":"2024-09-12T16:18:39.197996+0000","last_fullsized":"2024-09-12T16:18:39.197996+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:18.779009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0072904689999999999,"stat_sum":{"num_bytes":10363953,"num_objects":24,"num_object_clones":2,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":13,"num_read":6918,"num_read_kb":49308,"num_write":411,"num_write_kb":20795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":1054818,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.14","version":"151'853","reported_seq":9238,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.343068+0000","last_change":"2024-09-12T16:18:39.197911+0000","last_active":"2024-09-12T16:18:39.343068+0000","last_peered":"2024-09-12T16:18:39.343068+0000","last_clean":"2024-09-12T16:18:39.343068+0000","last_became_active":"2024-09-12T16:16:53.185698+0000","last_became_peered":"2024-09-12T16:16:53.185698+0000","last_unstale":"2024-09-12T16:18:39.343068+0000","last_undegraded":"2024-09-12T16:18:39.343068+0000","last_fullsized":"2024-09-12T16:18:39.343068+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":853,"log_dups_size":0,"ondisk_log_size":853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:27:11.560678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058878589999999996,"stat_sum":{"num_bytes":16495670,"num_objects":24,"num_object_clones":1,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":14,"num_read":11897,"num_read_kb":50135,"num_write":1126,"num_write_kb":23391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"2.7","version":"0'0","reported_seq":189,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.191570+0000","last_change":"2024-09-12T16:16:52.184699+0000","last_active":"2024-09-12T16:18:39.191570+0000","last_peered":"2024-09-12T16:18:39.191570+0000","last_clean":"2024-09-12T16:18:39.191570+0000","last_became_active":"2024-09-12T16:16:52.184420+0000","last_became_peered":"2024-09-12T16:16:52.184420+0000","last_unstale":"2024-09-12T16:18:39.191570+0000","last_undegraded":"2024-09-12T16:18:39.191570+0000","last_fullsized":"2024-09-12T16:18:39.191570+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:50.051152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"151'493","reported_seq":9719,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.297725+0000","last_change":"2024-09-12T16:18:39.205997+0000","last_active":"2024-09-12T16:18:39.297725+0000","last_peered":"2024-09-12T16:18:39.297725+0000","last_clean":"2024-09-12T16:18:39.297725+0000","last_became_active":"2024-09-12T16:15:57.012577+0000","last_became_peered":"2024-09-12T16:15:57.012577+0000","last_unstale":"2024-09-12T16:18:39.297725+0000","last_undegraded":"2024-09-12T16:18:39.297725+0000","last_fullsized":"2024-09-12T16:18:39.297725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:26.324778+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.009570027,"stat_sum":{"num_bytes":6304302,"num_objects":10,"num_object_clones":1,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":4,"num_read":10183,"num_read_kb":43945,"num_write":458,"num_write_kb":9188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"2.6","version":"0'0","reported_seq":297,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.191925+0000","last_change":"2024-09-12T16:16:52.187010+0000","last_active":"2024-09-12T16:18:39.191925+0000","last_peered":"2024-09-12T16:18:39.191925+0000","last_clean":"2024-09-12T16:18:39.191925+0000","last_became_active":"2024-09-12T16:16:52.186638+0000","last_became_peered":"2024-09-12T16:16:52.186638+0000","last_unstale":"2024-09-12T16:18:39.191925+0000","last_undegraded":"2024-09-12T16:18:39.191925+0000","last_fullsized":"2024-09-12T16:18:39.191925+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:40.681796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066384400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"150'754","reported_seq":16684,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.197403+0000","last_change":"2024-09-12T16:18:39.199470+0000","last_active":"2024-09-12T16:18:39.197403+0000","last_peered":"2024-09-12T16:18:39.197403+0000","last_clean":"2024-09-12T16:18:39.197403+0000","last_became_active":"2024-09-12T16:16:34.108850+0000","last_became_peered":"2024-09-12T16:16:34.108850+0000","last_unstale":"2024-09-12T16:18:39.197403+0000","last_undegraded":"2024-09-12T16:18:39.197403+0000","last_fullsized":"2024-09-12T16:18:39.197403+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:44.652110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065435220000000004,"stat_sum":{"num_bytes":17841664,"num_objects":21,"num_object_clones":2,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":14,"num_read":17664,"num_read_kb":61096,"num_write":660,"num_write_kb":27115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"2.5","version":"0'0","reported_seq":189,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.191939+0000","last_change":"2024-09-12T16:16:52.183981+0000","last_active":"2024-09-12T16:18:39.191939+0000","last_peered":"2024-09-12T16:18:39.191939+0000","last_clean":"2024-09-12T16:18:39.191939+0000","last_became_active":"2024-09-12T16:16:52.183675+0000","last_became_peered":"2024-09-12T16:16:52.183675+0000","last_unstale":"2024-09-12T16:18:39.191939+0000","last_undegraded":"2024-09-12T16:18:39.191939+0000","last_fullsized":"2024-09-12T16:18:39.191939+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:35.267433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"149'735","reported_seq":8254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.198867+0000","last_change":"2024-09-12T16:18:39.199506+0000","last_active":"2024-09-12T16:18:39.198867+0000","last_peered":"2024-09-12T16:18:39.198867+0000","last_clean":"2024-09-12T16:18:39.198867+0000","last_became_active":"2024-09-12T16:15:57.011381+0000","last_became_peered":"2024-09-12T16:15:57.011381+0000","last_unstale":"2024-09-12T16:18:39.198867+0000","last_undegraded":"2024-09-12T16:18:39.198867+0000","last_fullsized":"2024-09-12T16:18:39.198867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:59.116385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0073317310000000002,"stat_sum":{"num_bytes":6828544,"num_objects":26,"num_object_clones":1,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":15,"num_read":10390,"num_read_kb":44111,"num_write":926,"num_write_kb":7784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"2.4","version":"0'0","reported_seq":285,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.192358+0000","last_change":"2024-09-12T16:15:48.822724+0000","last_active":"2024-09-12T16:18:39.192358+0000","last_peered":"2024-09-12T16:18:39.192358+0000","last_clean":"2024-09-12T16:18:39.192358+0000","last_became_active":"2024-09-12T16:15:46.818676+0000","last_became_peered":"2024-09-12T16:15:46.818676+0000","last_unstale":"2024-09-12T16:18:39.192358+0000","last_undegraded":"2024-09-12T16:18:39.192358+0000","last_fullsized":"2024-09-12T16:18:39.192358+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:11.170806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065522900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"150'819","reported_seq":22128,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.192344+0000","last_change":"2024-09-12T16:18:39.192912+0000","last_active":"2024-09-12T16:18:39.192344+0000","last_peered":"2024-09-12T16:18:39.192344+0000","last_clean":"2024-09-12T16:18:39.192344+0000","last_became_active":"2024-09-12T16:18:25.145884+0000","last_became_peered":"2024-09-12T16:18:25.145884+0000","last_unstale":"2024-09-12T16:18:39.192344+0000","last_undegraded":"2024-09-12T16:18:39.192344+0000","last_fullsized":"2024-09-12T16:18:39.192344+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:42.628897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076821500000000004,"stat_sum":{"num_bytes":1075744,"num_objects":16,"num_object_clones":1,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":10,"num_read":25668,"num_read_kb":48810,"num_write":718,"num_write_kb":4789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":335,"num_bytes_recovered":4005968,"num_keys_recovered":105,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.3","version":"151'793","reported_seq":6407,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.299400+0000","last_change":"2024-09-12T16:18:39.202085+0000","last_active":"2024-09-12T16:18:39.299400+0000","last_peered":"2024-09-12T16:18:39.299400+0000","last_clean":"2024-09-12T16:18:39.299400+0000","last_became_active":"2024-09-12T16:15:57.012238+0000","last_became_peered":"2024-09-12T16:15:57.012238+0000","last_unstale":"2024-09-12T16:18:39.299400+0000","last_undegraded":"2024-09-12T16:18:39.299400+0000","last_fullsized":"2024-09-12T16:18:39.299400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:43:31.555314+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0065370280000000003,"stat_sum":{"num_bytes":28617256,"num_objects":16,"num_object_clones":2,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":7,"num_read":6496,"num_read_kb":41475,"num_write":976,"num_write_kb":9242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"2.2","version":"19'2","reported_seq":306,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.191925+0000","last_change":"2024-09-12T16:18:22.131014+0000","last_active":"2024-09-12T16:18:39.191925+0000","last_peered":"2024-09-12T16:18:39.191925+0000","last_clean":"2024-09-12T16:18:39.191925+0000","last_became_active":"2024-09-12T16:18:22.127939+0000","last_became_peered":"2024-09-12T16:18:22.127939+0000","last_unstale":"2024-09-12T16:18:39.191925+0000","last_undegraded":"2024-09-12T16:18:39.191925+0000","last_fullsized":"2024-09-12T16:18:39.191925+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:08.073541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"149'730","reported_seq":18594,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.326016+0000","last_change":"2024-09-12T16:18:39.192790+0000","last_active":"2024-09-12T16:18:39.326016+0000","last_peered":"2024-09-12T16:18:39.326016+0000","last_clean":"2024-09-12T16:18:39.326016+0000","last_became_active":"2024-09-12T16:15:57.014294+0000","last_became_peered":"2024-09-12T16:15:57.014294+0000","last_unstale":"2024-09-12T16:18:39.326016+0000","last_undegraded":"2024-09-12T16:18:39.326016+0000","last_fullsized":"2024-09-12T16:18:39.326016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":730,"log_dups_size":0,"ondisk_log_size":730,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:05.168697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00105989,"stat_sum":{"num_bytes":7792748,"num_objects":24,"num_object_clones":2,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":13,"num_read":19879,"num_read_kb":52912,"num_write":633,"num_write_kb":17119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"2.1","version":"0'0","reported_seq":269,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.192132+0000","last_change":"2024-09-12T16:18:29.019699+0000","last_active":"2024-09-12T16:18:39.192132+0000","last_peered":"2024-09-12T16:18:39.192132+0000","last_clean":"2024-09-12T16:18:39.192132+0000","last_became_active":"2024-09-12T16:18:29.019339+0000","last_became_peered":"2024-09-12T16:18:29.019339+0000","last_unstale":"2024-09-12T16:18:39.192132+0000","last_undegraded":"2024-09-12T16:18:39.192132+0000","last_fullsized":"2024-09-12T16:18:39.192132+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:51:54.701552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"151'491","reported_seq":5784,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.198808+0000","last_change":"2024-09-12T16:18:39.198808+0000","last_active":"2024-09-12T16:18:39.198808+0000","last_peered":"2024-09-12T16:18:39.198808+0000","last_clean":"2024-09-12T16:18:39.198808+0000","last_became_active":"2024-09-12T16:18:19.018295+0000","last_became_peered":"2024-09-12T16:18:19.018295+0000","last_unstale":"2024-09-12T16:18:39.198808+0000","last_undegraded":"2024-09-12T16:18:39.198808+0000","last_fullsized":"2024-09-12T16:18:39.198808+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:03.642530+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.0071172359999999999,"stat_sum":{"num_bytes":6825512,"num_objects":22,"num_object_clones":1,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":16,"num_read":5438,"num_read_kb":44125,"num_write":645,"num_write_kb":24798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":10774621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"2.0","version":"0'0","reported_seq":189,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.191440+0000","last_change":"2024-09-12T16:16:52.184861+0000","last_active":"2024-09-12T16:18:39.191440+0000","last_peered":"2024-09-12T16:18:39.191440+0000","last_clean":"2024-09-12T16:18:39.191440+0000","last_became_active":"2024-09-12T16:16:52.184555+0000","last_became_peered":"2024-09-12T16:16:52.184555+0000","last_unstale":"2024-09-12T16:18:39.191440+0000","last_undegraded":"2024-09-12T16:18:39.191440+0000","last_fullsized":"2024-09-12T16:18:39.191440+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:32.617153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"151'556","reported_seq":10024,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.198572+0000","last_change":"2024-09-12T16:18:39.198572+0000","last_active":"2024-09-12T16:18:39.198572+0000","last_peered":"2024-09-12T16:18:39.198572+0000","last_clean":"2024-09-12T16:18:39.198572+0000","last_became_active":"2024-09-12T16:18:25.146756+0000","last_became_peered":"2024-09-12T16:18:25.146756+0000","last_unstale":"2024-09-12T16:18:39.198572+0000","last_undegraded":"2024-09-12T16:18:39.198572+0000","last_fullsized":"2024-09-12T16:18:39.198572+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:08.424463+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.0063242910000000001,"stat_sum":{"num_bytes":2866192,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":10,"num_read":9718,"num_read_kb":35957,"num_write":470,"num_write_kb":7462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":315,"num_bytes_recovered":8454224,"num_keys_recovered":35,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"2.3","version":"17'1","reported_seq":285,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.192227+0000","last_change":"2024-09-12T16:18:22.132779+0000","last_active":"2024-09-12T16:18:39.192227+0000","last_peered":"2024-09-12T16:18:39.192227+0000","last_clean":"2024-09-12T16:18:39.192227+0000","last_became_active":"2024-09-12T16:18:22.128933+0000","last_became_peered":"2024-09-12T16:18:22.128933+0000","last_unstale":"2024-09-12T16:18:39.192227+0000","last_undegraded":"2024-09-12T16:18:39.192227+0000","last_fullsized":"2024-09-12T16:18:39.192227+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:54.609583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":195,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.191449+0000","last_change":"2024-09-12T16:16:52.190735+0000","last_active":"2024-09-12T16:18:39.191449+0000","last_peered":"2024-09-12T16:18:39.191449+0000","last_clean":"2024-09-12T16:18:39.191449+0000","last_became_active":"2024-09-12T16:16:52.183781+0000","last_became_peered":"2024-09-12T16:16:52.183781+0000","last_unstale":"2024-09-12T16:18:39.191449+0000","last_undegraded":"2024-09-12T16:18:39.191449+0000","last_fullsized":"2024-09-12T16:18:39.191449+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:40.751677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:40.751677+0000","last_clean_scrub_stamp":"2024-09-12T16:15:40.751677+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:34.274075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"150'566","reported_seq":13544,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.196836+0000","last_change":"2024-09-12T16:18:39.197301+0000","last_active":"2024-09-12T16:18:39.196836+0000","last_peered":"2024-09-12T16:18:39.196836+0000","last_clean":"2024-09-12T16:18:39.196836+0000","last_became_active":"2024-09-12T16:16:34.108998+0000","last_became_peered":"2024-09-12T16:16:34.108998+0000","last_unstale":"2024-09-12T16:18:39.196836+0000","last_undegraded":"2024-09-12T16:18:39.196836+0000","last_fullsized":"2024-09-12T16:18:39.196836+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":566,"log_dups_size":0,"ondisk_log_size":566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:15.885586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003946321,"stat_sum":{"num_bytes":14456884,"num_objects":23,"num_object_clones":1,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":14,"num_read":13175,"num_read_kb":49405,"num_write":655,"num_write_kb":7941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.9","version":"151'474","reported_seq":31506,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.200991+0000","last_change":"2024-09-12T16:18:39.200991+0000","last_active":"2024-09-12T16:18:39.200991+0000","last_peered":"2024-09-12T16:18:39.200991+0000","last_clean":"2024-09-12T16:18:39.200991+0000","last_became_active":"2024-09-12T16:15:57.013620+0000","last_became_peered":"2024-09-12T16:15:57.013620+0000","last_unstale":"2024-09-12T16:18:39.200991+0000","last_undegraded":"2024-09-12T16:18:39.200991+0000","last_fullsized":"2024-09-12T16:18:39.200991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:45.606739+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0059698390000000002,"stat_sum":{"num_bytes":48824832,"num_objects":20,"num_object_clones":2,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":12,"num_read":30743,"num_read_kb":77489,"num_write":557,"num_write_kb":11505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.a","version":"151'875","reported_seq":20749,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.281497+0000","last_change":"2024-09-12T16:18:39.198300+0000","last_active":"2024-09-12T16:18:39.281497+0000","last_peered":"2024-09-12T16:18:39.281497+0000","last_clean":"2024-09-12T16:18:39.281497+0000","last_became_active":"2024-09-12T16:16:55.202934+0000","last_became_peered":"2024-09-12T16:16:55.202934+0000","last_unstale":"2024-09-12T16:18:39.281497+0000","last_undegraded":"2024-09-12T16:18:39.281497+0000","last_fullsized":"2024-09-12T16:18:39.281497+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:26:53.334134+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0065984019999999997,"stat_sum":{"num_bytes":22458416,"num_objects":23,"num_object_clones":2,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":13,"num_read":21928,"num_read_kb":59598,"num_write":930,"num_write_kb":8224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":4487368,"num_keys_recovered":26,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.b","version":"149'518","reported_seq":15562,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.198113+0000","last_change":"2024-09-12T16:18:39.198661+0000","last_active":"2024-09-12T16:18:39.198113+0000","last_peered":"2024-09-12T16:18:39.198113+0000","last_clean":"2024-09-12T16:18:39.198113+0000","last_became_active":"2024-09-12T16:15:57.012845+0000","last_became_peered":"2024-09-12T16:15:57.012845+0000","last_unstale":"2024-09-12T16:18:39.198113+0000","last_undegraded":"2024-09-12T16:18:39.198113+0000","last_fullsized":"2024-09-12T16:18:39.198113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:02.315511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067754429999999999,"stat_sum":{"num_bytes":1757200,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":12,"num_read":15305,"num_read_kb":48884,"num_write":579,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.c","version":"151'439","reported_seq":11440,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.199116+0000","last_change":"2024-09-12T16:18:39.199116+0000","last_active":"2024-09-12T16:18:39.199116+0000","last_peered":"2024-09-12T16:18:39.199116+0000","last_clean":"2024-09-12T16:18:39.199116+0000","last_became_active":"2024-09-12T16:18:26.148424+0000","last_became_peered":"2024-09-12T16:18:26.148424+0000","last_unstale":"2024-09-12T16:18:39.199116+0000","last_undegraded":"2024-09-12T16:18:39.199116+0000","last_fullsized":"2024-09-12T16:18:39.199116+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:55.036766+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.003704644,"stat_sum":{"num_bytes":13849088,"num_objects":26,"num_object_clones":1,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":16,"num_read":9857,"num_read_kb":46208,"num_write":412,"num_write_kb":17232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":316,"num_bytes_recovered":11704832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.d","version":"151'671","reported_seq":17342,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.292191+0000","last_change":"2024-09-12T16:18:39.206888+0000","last_active":"2024-09-12T16:18:39.292191+0000","last_peered":"2024-09-12T16:18:39.292191+0000","last_clean":"2024-09-12T16:18:39.292191+0000","last_became_active":"2024-09-12T16:16:55.202102+0000","last_became_peered":"2024-09-12T16:16:55.202102+0000","last_unstale":"2024-09-12T16:18:39.292191+0000","last_undegraded":"2024-09-12T16:18:39.292191+0000","last_fullsized":"2024-09-12T16:18:39.292191+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:53:51.326968+0000","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.014654996999999999,"stat_sum":{"num_bytes":6873137,"num_objects":21,"num_object_clones":1,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":11,"num_read":18776,"num_read_kb":58715,"num_write":619,"num_write_kb":13626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":126,"num_bytes_recovered":6078562,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.e","version":"149'559","reported_seq":7552,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.201159+0000","last_change":"2024-09-12T16:18:39.201921+0000","last_active":"2024-09-12T16:18:39.201159+0000","last_peered":"2024-09-12T16:18:39.201159+0000","last_clean":"2024-09-12T16:18:39.201159+0000","last_became_active":"2024-09-12T16:18:26.147326+0000","last_became_peered":"2024-09-12T16:18:26.147326+0000","last_unstale":"2024-09-12T16:18:39.201159+0000","last_undegraded":"2024-09-12T16:18:39.201159+0000","last_fullsized":"2024-09-12T16:18:39.201159+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:49.675529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058916369999999999,"stat_sum":{"num_bytes":3466240,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":17,"num_read":7695,"num_read_kb":29940,"num_write":536,"num_write_kb":13256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":319,"num_bytes_recovered":6744127,"num_keys_recovered":60,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.f","version":"148'634","reported_seq":12124,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.196437+0000","last_change":"2024-09-12T16:18:39.197260+0000","last_active":"2024-09-12T16:18:39.196437+0000","last_peered":"2024-09-12T16:18:39.196437+0000","last_clean":"2024-09-12T16:18:39.196437+0000","last_became_active":"2024-09-12T16:18:26.146621+0000","last_became_peered":"2024-09-12T16:18:26.146621+0000","last_unstale":"2024-09-12T16:18:39.196437+0000","last_undegraded":"2024-09-12T16:18:39.196437+0000","last_fullsized":"2024-09-12T16:18:39.196437+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:45.147399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0052530720000000001,"stat_sum":{"num_bytes":2958352,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":14,"num_read":10858,"num_read_kb":49110,"num_write":809,"num_write_kb":21657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":304,"num_bytes_recovered":6361542,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.10","version":"151'619","reported_seq":15140,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.279805+0000","last_change":"2024-09-12T16:18:39.199684+0000","last_active":"2024-09-12T16:18:39.279805+0000","last_peered":"2024-09-12T16:18:39.279805+0000","last_clean":"2024-09-12T16:18:39.279805+0000","last_became_active":"2024-09-12T16:18:25.146733+0000","last_became_peered":"2024-09-12T16:18:25.146733+0000","last_unstale":"2024-09-12T16:18:39.279805+0000","last_undegraded":"2024-09-12T16:18:39.279805+0000","last_fullsized":"2024-09-12T16:18:39.279805+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:34.060723+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0044594819999999999,"stat_sum":{"num_bytes":9976035,"num_objects":27,"num_object_clones":2,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":18,"num_read":12811,"num_read_kb":73183,"num_write":777,"num_write_kb":17171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":412,"num_bytes_recovered":13039478,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.11","version":"150'636","reported_seq":16925,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.191718+0000","last_change":"2024-09-12T16:18:39.192399+0000","last_active":"2024-09-12T16:18:39.191718+0000","last_peered":"2024-09-12T16:18:39.191718+0000","last_clean":"2024-09-12T16:18:39.191718+0000","last_became_active":"2024-09-12T16:16:55.202493+0000","last_became_peered":"2024-09-12T16:16:55.202493+0000","last_unstale":"2024-09-12T16:18:39.191718+0000","last_undegraded":"2024-09-12T16:18:39.191718+0000","last_fullsized":"2024-09-12T16:18:39.191718+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:18.752401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084498600000000004,"stat_sum":{"num_bytes":1822208,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":12,"num_read":16727,"num_read_kb":61490,"num_write":790,"num_write_kb":15885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":1725440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.12","version":"151'626","reported_seq":14920,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.317945+0000","last_change":"2024-09-12T16:18:39.205515+0000","last_active":"2024-09-12T16:18:39.317945+0000","last_peered":"2024-09-12T16:18:39.317945+0000","last_clean":"2024-09-12T16:18:39.317945+0000","last_became_active":"2024-09-12T16:16:55.202220+0000","last_became_peered":"2024-09-12T16:16:55.202220+0000","last_unstale":"2024-09-12T16:18:39.317945+0000","last_undegraded":"2024-09-12T16:18:39.317945+0000","last_fullsized":"2024-09-12T16:18:39.317945+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:53.498593+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0089097480000000003,"stat_sum":{"num_bytes":1339904,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":14,"num_read":16237,"num_read_kb":60051,"num_write":649,"num_write_kb":14668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":3518540,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.13","version":"151'979","reported_seq":11336,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.343377+0000","last_change":"2024-09-12T16:18:39.196336+0000","last_active":"2024-09-12T16:18:39.343377+0000","last_peered":"2024-09-12T16:18:39.343377+0000","last_clean":"2024-09-12T16:18:39.343377+0000","last_became_active":"2024-09-12T16:18:25.147080+0000","last_became_peered":"2024-09-12T16:18:25.147080+0000","last_unstale":"2024-09-12T16:18:39.343377+0000","last_undegraded":"2024-09-12T16:18:39.343377+0000","last_fullsized":"2024-09-12T16:18:39.343377+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":979,"log_dups_size":0,"ondisk_log_size":979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:51.793343+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0046578979999999997,"stat_sum":{"num_bytes":9732682,"num_objects":24,"num_object_clones":2,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":14,"num_read":11889,"num_read_kb":44788,"num_write":1427,"num_write_kb":19195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":434,"num_bytes_recovered":17467099,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"d","length":"5"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":349973474,"num_objects":708,"num_object_clones":39,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":708,"num_whiteouts":447,"num_read":451540,"num_read_kb":1622836,"num_write":28851,"num_write_kb":478854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5086,"num_bytes_recovered":202080646,"num_keys_recovered":679,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20144128,"data_stored":25864913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6949,"internal_metadata":0},"log_size":23863,"ondisk_log_size":23863,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":5,"up_from":71,"seq":304942678037,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41564,"kb_used_data":4672,"kb_used_omap":11,"kb_used_meta":36852,"kb_avail":94330276,"statfs":{"total":96636764160,"available":96594202624,"internally_reserved":0,"allocated":4784128,"data_stored":3728843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11593,"internal_metadata":37737143},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640295,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85696,"kb_used_data":10084,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94286144,"statfs":{"total":96636764160,"available":96549011456,"internally_reserved":0,"allocated":10326016,"data_stored":15090181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640296,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91244,"kb_used_data":15608,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94280596,"statfs":{"total":96636764160,"available":96543330304,"internally_reserved":0,"allocated":15982592,"data_stored":24865553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640297,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54712,"kb_used_data":5472,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94317128,"statfs":{"total":96636764160,"available":96580739072,"internally_reserved":0,"allocated":5603328,"data_stored":6530290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640295,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64280,"kb_used_data":6720,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94307560,"statfs":{"total":96636764160,"available":96570941440,"internally_reserved":0,"allocated":6881280,"data_stored":8243645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640296,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64644,"kb_used_data":14104,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94307196,"statfs":{"total":96636764160,"available":96570568704,"internally_reserved":0,"allocated":14442496,"data_stored":22245098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3448832,"data_stored":4539427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2191360,"data_stored":2017577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3801088,"data_stored":5777220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3538944,"data_stored":4422202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4222976,"data_stored":6148996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2940928,"data_stored":2959491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6949,"internal_metadata":0}]}} 2024-09-12T16:18:44.407 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T16:18:44.489 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:44.488+0000 7f56426f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32115) UID: 0 2024-09-12T16:18:44.494 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:44.494 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:44.503 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:18:44.552 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:44.552+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:44.624 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:44.624 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:44.633 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:18:44.653 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:44.652+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:44.741 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:18:44.742 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-12T16:18:44.754 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":244,"stamp":"2024-09-12T16:18:44.692657+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":350563861,"num_objects":712,"num_object_clones":39,"num_object_copies":1424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":712,"num_whiteouts":447,"num_read":451606,"num_read_kb":1622891,"num_write":28954,"num_write_kb":480484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5094,"num_bytes_recovered":203261420,"num_keys_recovered":679,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23938,"ondisk_log_size":23938,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":402140,"kb_used_data":56660,"kb_used_omap":19,"kb_used_meta":343980,"kb_avail":565828900,"statfs":{"total":579820584960,"available":579408793600,"internally_reserved":0,"allocated":58019840,"data_stored":80703610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19565,"internal_metadata":352236435},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000608"},"pg_stats":[{"pgid":"3.1f","version":"151'647","reported_seq":18807,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.201881+0000","last_change":"2024-09-12T16:18:39.202274+0000","last_active":"2024-09-12T16:18:39.201881+0000","last_peered":"2024-09-12T16:18:39.201881+0000","last_clean":"2024-09-12T16:18:39.201881+0000","last_became_active":"2024-09-12T16:17:21.011550+0000","last_became_peered":"2024-09-12T16:17:21.011550+0000","last_unstale":"2024-09-12T16:18:39.201881+0000","last_undegraded":"2024-09-12T16:18:39.201881+0000","last_fullsized":"2024-09-12T16:18:39.201881+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:18.831762+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0068338009999999996,"stat_sum":{"num_bytes":11732496,"num_objects":23,"num_object_clones":2,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":15,"num_read":18831,"num_read_kb":74246,"num_write":853,"num_write_kb":11027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":2818651,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.1e","version":"151'596","reported_seq":13948,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.201733+0000","last_change":"2024-09-12T16:18:39.201733+0000","last_active":"2024-09-12T16:18:39.201733+0000","last_peered":"2024-09-12T16:18:39.201733+0000","last_clean":"2024-09-12T16:18:39.201733+0000","last_became_active":"2024-09-12T16:16:55.202876+0000","last_became_peered":"2024-09-12T16:16:55.202876+0000","last_unstale":"2024-09-12T16:18:39.201733+0000","last_undegraded":"2024-09-12T16:18:39.201733+0000","last_fullsized":"2024-09-12T16:18:39.201733+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:08:24.653915+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.0092288519999999992,"stat_sum":{"num_bytes":9723904,"num_objects":31,"num_object_clones":1,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":20,"num_read":13702,"num_read_kb":46928,"num_write":617,"num_write_kb":8472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":3145760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.1d","version":"150'1496","reported_seq":20227,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.195092+0000","last_change":"2024-09-12T16:18:39.195510+0000","last_active":"2024-09-12T16:18:39.195092+0000","last_peered":"2024-09-12T16:18:39.195092+0000","last_clean":"2024-09-12T16:18:39.195092+0000","last_became_active":"2024-09-12T16:18:26.148000+0000","last_became_peered":"2024-09-12T16:18:26.148000+0000","last_unstale":"2024-09-12T16:18:39.195092+0000","last_undegraded":"2024-09-12T16:18:39.195092+0000","last_fullsized":"2024-09-12T16:18:39.195092+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1496,"log_dups_size":0,"ondisk_log_size":1496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:38.591058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065995099999999998,"stat_sum":{"num_bytes":20784867,"num_objects":29,"num_object_clones":3,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":18,"num_read":22707,"num_read_kb":67057,"num_write":2108,"num_write_kb":16171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":374,"num_bytes_recovered":30814554,"num_keys_recovered":34,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.1c","version":"151'842","reported_seq":9057,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.312556+0000","last_change":"2024-09-12T16:18:39.199179+0000","last_active":"2024-09-12T16:18:39.312556+0000","last_peered":"2024-09-12T16:18:39.312556+0000","last_clean":"2024-09-12T16:18:39.312556+0000","last_became_active":"2024-09-12T16:18:25.147460+0000","last_became_peered":"2024-09-12T16:18:25.147460+0000","last_unstale":"2024-09-12T16:18:39.312556+0000","last_undegraded":"2024-09-12T16:18:39.312556+0000","last_fullsized":"2024-09-12T16:18:39.312556+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":842,"log_dups_size":0,"ondisk_log_size":842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:13.116215+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0042266559999999996,"stat_sum":{"num_bytes":278528,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":12,"num_read":9676,"num_read_kb":27859,"num_write":1096,"num_write_kb":6805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":3550768,"num_keys_recovered":168,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.1b","version":"151'1249","reported_seq":8800,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.208511+0000","last_change":"2024-09-12T16:18:39.208511+0000","last_active":"2024-09-12T16:18:39.208511+0000","last_peered":"2024-09-12T16:18:39.208511+0000","last_clean":"2024-09-12T16:18:39.208511+0000","last_became_active":"2024-09-12T16:17:21.011585+0000","last_became_peered":"2024-09-12T16:17:21.011585+0000","last_unstale":"2024-09-12T16:18:39.208511+0000","last_undegraded":"2024-09-12T16:18:39.208511+0000","last_fullsized":"2024-09-12T16:18:39.208511+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1249,"log_dups_size":0,"ondisk_log_size":1249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:01.909712+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.011421169,"stat_sum":{"num_bytes":2555904,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":15,"num_read":12367,"num_read_kb":38179,"num_write":1726,"num_write_kb":15361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":14697984,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.1a","version":"150'1309","reported_seq":11897,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.325288+0000","last_change":"2024-09-12T16:18:39.202286+0000","last_active":"2024-09-12T16:18:39.325288+0000","last_peered":"2024-09-12T16:18:39.325288+0000","last_clean":"2024-09-12T16:18:39.325288+0000","last_became_active":"2024-09-12T16:15:57.014803+0000","last_became_peered":"2024-09-12T16:15:57.014803+0000","last_unstale":"2024-09-12T16:18:39.325288+0000","last_undegraded":"2024-09-12T16:18:39.325288+0000","last_fullsized":"2024-09-12T16:18:39.325288+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1309,"log_dups_size":0,"ondisk_log_size":1309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:43.194878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.006031247,"stat_sum":{"num_bytes":3686419,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":19,"num_read":15288,"num_read_kb":54308,"num_write":2006,"num_write_kb":21868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.19","version":"151'530","reported_seq":14862,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.201391+0000","last_change":"2024-09-12T16:18:39.201780+0000","last_active":"2024-09-12T16:18:39.201391+0000","last_peered":"2024-09-12T16:18:39.201391+0000","last_clean":"2024-09-12T16:18:39.201391+0000","last_became_active":"2024-09-12T16:15:57.016110+0000","last_became_peered":"2024-09-12T16:15:57.016110+0000","last_unstale":"2024-09-12T16:18:39.201391+0000","last_undegraded":"2024-09-12T16:18:39.201391+0000","last_fullsized":"2024-09-12T16:18:39.201391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:21.330798+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0097675869999999995,"stat_sum":{"num_bytes":7046656,"num_objects":30,"num_object_clones":2,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":19,"num_read":14633,"num_read_kb":54220,"num_write":557,"num_write_kb":10346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.18","version":"149'754","reported_seq":6298,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.194799+0000","last_change":"2024-09-12T16:18:39.195707+0000","last_active":"2024-09-12T16:18:39.194799+0000","last_peered":"2024-09-12T16:18:39.194799+0000","last_clean":"2024-09-12T16:18:39.194799+0000","last_became_active":"2024-09-12T16:17:21.009370+0000","last_became_peered":"2024-09-12T16:17:21.009370+0000","last_unstale":"2024-09-12T16:18:39.194799+0000","last_undegraded":"2024-09-12T16:18:39.194799+0000","last_fullsized":"2024-09-12T16:18:39.194799+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:07.842034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026414799999999999,"stat_sum":{"num_bytes":2251347,"num_objects":18,"num_object_clones":1,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":12,"num_read":7092,"num_read_kb":45463,"num_write":888,"num_write_kb":34056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":17173091,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.17","version":"151'670","reported_seq":8242,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.287445+0000","last_change":"2024-09-12T16:18:39.203172+0000","last_active":"2024-09-12T16:18:39.287445+0000","last_peered":"2024-09-12T16:18:39.287445+0000","last_clean":"2024-09-12T16:18:39.287445+0000","last_became_active":"2024-09-12T16:18:26.148363+0000","last_became_peered":"2024-09-12T16:18:26.148363+0000","last_unstale":"2024-09-12T16:18:39.287445+0000","last_undegraded":"2024-09-12T16:18:39.287445+0000","last_fullsized":"2024-09-12T16:18:39.287445+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":670,"log_dups_size":0,"ondisk_log_size":670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:05.856083+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0074591019999999996,"stat_sum":{"num_bytes":26658334,"num_objects":26,"num_object_clones":1,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":18,"num_read":7854,"num_read_kb":33829,"num_write":903,"num_write_kb":21944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":331,"num_bytes_recovered":20360415,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.16","version":"151'1576","reported_seq":15781,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.205360+0000","last_change":"2024-09-12T16:18:39.205360+0000","last_active":"2024-09-12T16:18:39.205360+0000","last_peered":"2024-09-12T16:18:39.205360+0000","last_clean":"2024-09-12T16:18:39.205360+0000","last_became_active":"2024-09-12T16:18:26.147921+0000","last_became_peered":"2024-09-12T16:18:26.147921+0000","last_unstale":"2024-09-12T16:18:39.205360+0000","last_undegraded":"2024-09-12T16:18:39.205360+0000","last_fullsized":"2024-09-12T16:18:39.205360+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1576,"log_dups_size":0,"ondisk_log_size":1576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:12.177829+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.012976682,"stat_sum":{"num_bytes":22728456,"num_objects":26,"num_object_clones":4,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":16,"num_read":19138,"num_read_kb":50012,"num_write":2334,"num_write_kb":15645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":483,"num_bytes_recovered":14102804,"num_keys_recovered":132,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.15","version":"149'374","reported_seq":7755,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.197996+0000","last_change":"2024-09-12T16:18:39.199321+0000","last_active":"2024-09-12T16:18:39.197996+0000","last_peered":"2024-09-12T16:18:39.197996+0000","last_clean":"2024-09-12T16:18:39.197996+0000","last_became_active":"2024-09-12T16:16:55.203324+0000","last_became_peered":"2024-09-12T16:16:55.203324+0000","last_unstale":"2024-09-12T16:18:39.197996+0000","last_undegraded":"2024-09-12T16:18:39.197996+0000","last_fullsized":"2024-09-12T16:18:39.197996+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:18.779009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0072904689999999999,"stat_sum":{"num_bytes":10363953,"num_objects":24,"num_object_clones":2,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":13,"num_read":6918,"num_read_kb":49308,"num_write":411,"num_write_kb":20795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":1054818,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.14","version":"151'853","reported_seq":9238,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.343068+0000","last_change":"2024-09-12T16:18:39.197911+0000","last_active":"2024-09-12T16:18:39.343068+0000","last_peered":"2024-09-12T16:18:39.343068+0000","last_clean":"2024-09-12T16:18:39.343068+0000","last_became_active":"2024-09-12T16:16:53.185698+0000","last_became_peered":"2024-09-12T16:16:53.185698+0000","last_unstale":"2024-09-12T16:18:39.343068+0000","last_undegraded":"2024-09-12T16:18:39.343068+0000","last_fullsized":"2024-09-12T16:18:39.343068+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":853,"log_dups_size":0,"ondisk_log_size":853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:27:11.560678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058878589999999996,"stat_sum":{"num_bytes":16495670,"num_objects":24,"num_object_clones":1,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":14,"num_read":11897,"num_read_kb":50135,"num_write":1126,"num_write_kb":23391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"2.7","version":"0'0","reported_seq":189,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.191570+0000","last_change":"2024-09-12T16:16:52.184699+0000","last_active":"2024-09-12T16:18:39.191570+0000","last_peered":"2024-09-12T16:18:39.191570+0000","last_clean":"2024-09-12T16:18:39.191570+0000","last_became_active":"2024-09-12T16:16:52.184420+0000","last_became_peered":"2024-09-12T16:16:52.184420+0000","last_unstale":"2024-09-12T16:18:39.191570+0000","last_undegraded":"2024-09-12T16:18:39.191570+0000","last_fullsized":"2024-09-12T16:18:39.191570+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:50.051152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"151'493","reported_seq":9719,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.297725+0000","last_change":"2024-09-12T16:18:39.205997+0000","last_active":"2024-09-12T16:18:39.297725+0000","last_peered":"2024-09-12T16:18:39.297725+0000","last_clean":"2024-09-12T16:18:39.297725+0000","last_became_active":"2024-09-12T16:15:57.012577+0000","last_became_peered":"2024-09-12T16:15:57.012577+0000","last_unstale":"2024-09-12T16:18:39.297725+0000","last_undegraded":"2024-09-12T16:18:39.297725+0000","last_fullsized":"2024-09-12T16:18:39.297725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:26.324778+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.009570027,"stat_sum":{"num_bytes":6304302,"num_objects":10,"num_object_clones":1,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":4,"num_read":10183,"num_read_kb":43945,"num_write":458,"num_write_kb":9188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"2.6","version":"0'0","reported_seq":297,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.191925+0000","last_change":"2024-09-12T16:16:52.187010+0000","last_active":"2024-09-12T16:18:39.191925+0000","last_peered":"2024-09-12T16:18:39.191925+0000","last_clean":"2024-09-12T16:18:39.191925+0000","last_became_active":"2024-09-12T16:16:52.186638+0000","last_became_peered":"2024-09-12T16:16:52.186638+0000","last_unstale":"2024-09-12T16:18:39.191925+0000","last_undegraded":"2024-09-12T16:18:39.191925+0000","last_fullsized":"2024-09-12T16:18:39.191925+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:40.681796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066384400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"150'754","reported_seq":16684,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.197403+0000","last_change":"2024-09-12T16:18:39.199470+0000","last_active":"2024-09-12T16:18:39.197403+0000","last_peered":"2024-09-12T16:18:39.197403+0000","last_clean":"2024-09-12T16:18:39.197403+0000","last_became_active":"2024-09-12T16:16:34.108850+0000","last_became_peered":"2024-09-12T16:16:34.108850+0000","last_unstale":"2024-09-12T16:18:39.197403+0000","last_undegraded":"2024-09-12T16:18:39.197403+0000","last_fullsized":"2024-09-12T16:18:39.197403+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:44.652110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065435220000000004,"stat_sum":{"num_bytes":17841664,"num_objects":21,"num_object_clones":2,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":14,"num_read":17664,"num_read_kb":61096,"num_write":660,"num_write_kb":27115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"2.5","version":"0'0","reported_seq":189,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.191939+0000","last_change":"2024-09-12T16:16:52.183981+0000","last_active":"2024-09-12T16:18:39.191939+0000","last_peered":"2024-09-12T16:18:39.191939+0000","last_clean":"2024-09-12T16:18:39.191939+0000","last_became_active":"2024-09-12T16:16:52.183675+0000","last_became_peered":"2024-09-12T16:16:52.183675+0000","last_unstale":"2024-09-12T16:18:39.191939+0000","last_undegraded":"2024-09-12T16:18:39.191939+0000","last_fullsized":"2024-09-12T16:18:39.191939+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:35.267433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"149'735","reported_seq":8254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.198867+0000","last_change":"2024-09-12T16:18:39.199506+0000","last_active":"2024-09-12T16:18:39.198867+0000","last_peered":"2024-09-12T16:18:39.198867+0000","last_clean":"2024-09-12T16:18:39.198867+0000","last_became_active":"2024-09-12T16:15:57.011381+0000","last_became_peered":"2024-09-12T16:15:57.011381+0000","last_unstale":"2024-09-12T16:18:39.198867+0000","last_undegraded":"2024-09-12T16:18:39.198867+0000","last_fullsized":"2024-09-12T16:18:39.198867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:59.116385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0073317310000000002,"stat_sum":{"num_bytes":6828544,"num_objects":26,"num_object_clones":1,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":15,"num_read":10390,"num_read_kb":44111,"num_write":926,"num_write_kb":7784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"2.4","version":"0'0","reported_seq":285,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.192358+0000","last_change":"2024-09-12T16:15:48.822724+0000","last_active":"2024-09-12T16:18:39.192358+0000","last_peered":"2024-09-12T16:18:39.192358+0000","last_clean":"2024-09-12T16:18:39.192358+0000","last_became_active":"2024-09-12T16:15:46.818676+0000","last_became_peered":"2024-09-12T16:15:46.818676+0000","last_unstale":"2024-09-12T16:18:39.192358+0000","last_undegraded":"2024-09-12T16:18:39.192358+0000","last_fullsized":"2024-09-12T16:18:39.192358+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:11.170806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065522900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"150'819","reported_seq":22128,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.192344+0000","last_change":"2024-09-12T16:18:39.192912+0000","last_active":"2024-09-12T16:18:39.192344+0000","last_peered":"2024-09-12T16:18:39.192344+0000","last_clean":"2024-09-12T16:18:39.192344+0000","last_became_active":"2024-09-12T16:18:25.145884+0000","last_became_peered":"2024-09-12T16:18:25.145884+0000","last_unstale":"2024-09-12T16:18:39.192344+0000","last_undegraded":"2024-09-12T16:18:39.192344+0000","last_fullsized":"2024-09-12T16:18:39.192344+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:42.628897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076821500000000004,"stat_sum":{"num_bytes":1075744,"num_objects":16,"num_object_clones":1,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":10,"num_read":25668,"num_read_kb":48810,"num_write":718,"num_write_kb":4789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":335,"num_bytes_recovered":4005968,"num_keys_recovered":105,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.3","version":"151'793","reported_seq":6407,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.299400+0000","last_change":"2024-09-12T16:18:39.202085+0000","last_active":"2024-09-12T16:18:39.299400+0000","last_peered":"2024-09-12T16:18:39.299400+0000","last_clean":"2024-09-12T16:18:39.299400+0000","last_became_active":"2024-09-12T16:15:57.012238+0000","last_became_peered":"2024-09-12T16:15:57.012238+0000","last_unstale":"2024-09-12T16:18:39.299400+0000","last_undegraded":"2024-09-12T16:18:39.299400+0000","last_fullsized":"2024-09-12T16:18:39.299400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:43:31.555314+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0065370280000000003,"stat_sum":{"num_bytes":28617256,"num_objects":16,"num_object_clones":2,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":7,"num_read":6496,"num_read_kb":41475,"num_write":976,"num_write_kb":9242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"2.2","version":"19'2","reported_seq":306,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.191925+0000","last_change":"2024-09-12T16:18:22.131014+0000","last_active":"2024-09-12T16:18:39.191925+0000","last_peered":"2024-09-12T16:18:39.191925+0000","last_clean":"2024-09-12T16:18:39.191925+0000","last_became_active":"2024-09-12T16:18:22.127939+0000","last_became_peered":"2024-09-12T16:18:22.127939+0000","last_unstale":"2024-09-12T16:18:39.191925+0000","last_undegraded":"2024-09-12T16:18:39.191925+0000","last_fullsized":"2024-09-12T16:18:39.191925+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:08.073541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"149'730","reported_seq":18594,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.326016+0000","last_change":"2024-09-12T16:18:39.192790+0000","last_active":"2024-09-12T16:18:39.326016+0000","last_peered":"2024-09-12T16:18:39.326016+0000","last_clean":"2024-09-12T16:18:39.326016+0000","last_became_active":"2024-09-12T16:15:57.014294+0000","last_became_peered":"2024-09-12T16:15:57.014294+0000","last_unstale":"2024-09-12T16:18:39.326016+0000","last_undegraded":"2024-09-12T16:18:39.326016+0000","last_fullsized":"2024-09-12T16:18:39.326016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":730,"log_dups_size":0,"ondisk_log_size":730,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:05.168697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00105989,"stat_sum":{"num_bytes":7792748,"num_objects":24,"num_object_clones":2,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":13,"num_read":19879,"num_read_kb":52912,"num_write":633,"num_write_kb":17119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"2.1","version":"0'0","reported_seq":269,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.192132+0000","last_change":"2024-09-12T16:18:29.019699+0000","last_active":"2024-09-12T16:18:39.192132+0000","last_peered":"2024-09-12T16:18:39.192132+0000","last_clean":"2024-09-12T16:18:39.192132+0000","last_became_active":"2024-09-12T16:18:29.019339+0000","last_became_peered":"2024-09-12T16:18:29.019339+0000","last_unstale":"2024-09-12T16:18:39.192132+0000","last_undegraded":"2024-09-12T16:18:39.192132+0000","last_fullsized":"2024-09-12T16:18:39.192132+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:51:54.701552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"151'491","reported_seq":5784,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.198808+0000","last_change":"2024-09-12T16:18:39.198808+0000","last_active":"2024-09-12T16:18:39.198808+0000","last_peered":"2024-09-12T16:18:39.198808+0000","last_clean":"2024-09-12T16:18:39.198808+0000","last_became_active":"2024-09-12T16:18:19.018295+0000","last_became_peered":"2024-09-12T16:18:19.018295+0000","last_unstale":"2024-09-12T16:18:39.198808+0000","last_undegraded":"2024-09-12T16:18:39.198808+0000","last_fullsized":"2024-09-12T16:18:39.198808+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:03.642530+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.0071172359999999999,"stat_sum":{"num_bytes":6825512,"num_objects":22,"num_object_clones":1,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":16,"num_read":5438,"num_read_kb":44125,"num_write":645,"num_write_kb":24798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":10774621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"2.0","version":"0'0","reported_seq":189,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.191440+0000","last_change":"2024-09-12T16:16:52.184861+0000","last_active":"2024-09-12T16:18:39.191440+0000","last_peered":"2024-09-12T16:18:39.191440+0000","last_clean":"2024-09-12T16:18:39.191440+0000","last_became_active":"2024-09-12T16:16:52.184555+0000","last_became_peered":"2024-09-12T16:16:52.184555+0000","last_unstale":"2024-09-12T16:18:39.191440+0000","last_undegraded":"2024-09-12T16:18:39.191440+0000","last_fullsized":"2024-09-12T16:18:39.191440+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:32.617153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"151'556","reported_seq":10024,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.198572+0000","last_change":"2024-09-12T16:18:39.198572+0000","last_active":"2024-09-12T16:18:39.198572+0000","last_peered":"2024-09-12T16:18:39.198572+0000","last_clean":"2024-09-12T16:18:39.198572+0000","last_became_active":"2024-09-12T16:18:25.146756+0000","last_became_peered":"2024-09-12T16:18:25.146756+0000","last_unstale":"2024-09-12T16:18:39.198572+0000","last_undegraded":"2024-09-12T16:18:39.198572+0000","last_fullsized":"2024-09-12T16:18:39.198572+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:08.424463+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.0063242910000000001,"stat_sum":{"num_bytes":2866192,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":10,"num_read":9718,"num_read_kb":35957,"num_write":470,"num_write_kb":7462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":315,"num_bytes_recovered":8454224,"num_keys_recovered":35,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"2.3","version":"17'1","reported_seq":285,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.192227+0000","last_change":"2024-09-12T16:18:22.132779+0000","last_active":"2024-09-12T16:18:39.192227+0000","last_peered":"2024-09-12T16:18:39.192227+0000","last_clean":"2024-09-12T16:18:39.192227+0000","last_became_active":"2024-09-12T16:18:22.128933+0000","last_became_peered":"2024-09-12T16:18:22.128933+0000","last_unstale":"2024-09-12T16:18:39.192227+0000","last_undegraded":"2024-09-12T16:18:39.192227+0000","last_fullsized":"2024-09-12T16:18:39.192227+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:54.609583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":195,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.191449+0000","last_change":"2024-09-12T16:16:52.190735+0000","last_active":"2024-09-12T16:18:39.191449+0000","last_peered":"2024-09-12T16:18:39.191449+0000","last_clean":"2024-09-12T16:18:39.191449+0000","last_became_active":"2024-09-12T16:16:52.183781+0000","last_became_peered":"2024-09-12T16:16:52.183781+0000","last_unstale":"2024-09-12T16:18:39.191449+0000","last_undegraded":"2024-09-12T16:18:39.191449+0000","last_fullsized":"2024-09-12T16:18:39.191449+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:40.751677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:40.751677+0000","last_clean_scrub_stamp":"2024-09-12T16:15:40.751677+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:34.274075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"150'566","reported_seq":13544,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.196836+0000","last_change":"2024-09-12T16:18:39.197301+0000","last_active":"2024-09-12T16:18:39.196836+0000","last_peered":"2024-09-12T16:18:39.196836+0000","last_clean":"2024-09-12T16:18:39.196836+0000","last_became_active":"2024-09-12T16:16:34.108998+0000","last_became_peered":"2024-09-12T16:16:34.108998+0000","last_unstale":"2024-09-12T16:18:39.196836+0000","last_undegraded":"2024-09-12T16:18:39.196836+0000","last_fullsized":"2024-09-12T16:18:39.196836+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":566,"log_dups_size":0,"ondisk_log_size":566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:15.885586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003946321,"stat_sum":{"num_bytes":14456884,"num_objects":23,"num_object_clones":1,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":14,"num_read":13175,"num_read_kb":49405,"num_write":655,"num_write_kb":7941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.9","version":"151'474","reported_seq":31506,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.200991+0000","last_change":"2024-09-12T16:18:39.200991+0000","last_active":"2024-09-12T16:18:39.200991+0000","last_peered":"2024-09-12T16:18:39.200991+0000","last_clean":"2024-09-12T16:18:39.200991+0000","last_became_active":"2024-09-12T16:15:57.013620+0000","last_became_peered":"2024-09-12T16:15:57.013620+0000","last_unstale":"2024-09-12T16:18:39.200991+0000","last_undegraded":"2024-09-12T16:18:39.200991+0000","last_fullsized":"2024-09-12T16:18:39.200991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:45.606739+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0059698390000000002,"stat_sum":{"num_bytes":48824832,"num_objects":20,"num_object_clones":2,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":12,"num_read":30743,"num_read_kb":77489,"num_write":557,"num_write_kb":11505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.a","version":"151'875","reported_seq":20749,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.281497+0000","last_change":"2024-09-12T16:18:39.198300+0000","last_active":"2024-09-12T16:18:39.281497+0000","last_peered":"2024-09-12T16:18:39.281497+0000","last_clean":"2024-09-12T16:18:39.281497+0000","last_became_active":"2024-09-12T16:16:55.202934+0000","last_became_peered":"2024-09-12T16:16:55.202934+0000","last_unstale":"2024-09-12T16:18:39.281497+0000","last_undegraded":"2024-09-12T16:18:39.281497+0000","last_fullsized":"2024-09-12T16:18:39.281497+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:26:53.334134+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0065984019999999997,"stat_sum":{"num_bytes":22458416,"num_objects":23,"num_object_clones":2,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":13,"num_read":21928,"num_read_kb":59598,"num_write":930,"num_write_kb":8224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":4487368,"num_keys_recovered":26,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.b","version":"149'518","reported_seq":15562,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.198113+0000","last_change":"2024-09-12T16:18:39.198661+0000","last_active":"2024-09-12T16:18:39.198113+0000","last_peered":"2024-09-12T16:18:39.198113+0000","last_clean":"2024-09-12T16:18:39.198113+0000","last_became_active":"2024-09-12T16:15:57.012845+0000","last_became_peered":"2024-09-12T16:15:57.012845+0000","last_unstale":"2024-09-12T16:18:39.198113+0000","last_undegraded":"2024-09-12T16:18:39.198113+0000","last_fullsized":"2024-09-12T16:18:39.198113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:02.315511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067754429999999999,"stat_sum":{"num_bytes":1757200,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":12,"num_read":15305,"num_read_kb":48884,"num_write":579,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.c","version":"151'439","reported_seq":11440,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.199116+0000","last_change":"2024-09-12T16:18:39.199116+0000","last_active":"2024-09-12T16:18:39.199116+0000","last_peered":"2024-09-12T16:18:39.199116+0000","last_clean":"2024-09-12T16:18:39.199116+0000","last_became_active":"2024-09-12T16:18:26.148424+0000","last_became_peered":"2024-09-12T16:18:26.148424+0000","last_unstale":"2024-09-12T16:18:39.199116+0000","last_undegraded":"2024-09-12T16:18:39.199116+0000","last_fullsized":"2024-09-12T16:18:39.199116+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:55.036766+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.003704644,"stat_sum":{"num_bytes":13849088,"num_objects":26,"num_object_clones":1,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":16,"num_read":9857,"num_read_kb":46208,"num_write":412,"num_write_kb":17232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":316,"num_bytes_recovered":11704832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.d","version":"151'671","reported_seq":17342,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.292191+0000","last_change":"2024-09-12T16:18:39.206888+0000","last_active":"2024-09-12T16:18:39.292191+0000","last_peered":"2024-09-12T16:18:39.292191+0000","last_clean":"2024-09-12T16:18:39.292191+0000","last_became_active":"2024-09-12T16:16:55.202102+0000","last_became_peered":"2024-09-12T16:16:55.202102+0000","last_unstale":"2024-09-12T16:18:39.292191+0000","last_undegraded":"2024-09-12T16:18:39.292191+0000","last_fullsized":"2024-09-12T16:18:39.292191+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:53:51.326968+0000","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.014654996999999999,"stat_sum":{"num_bytes":6873137,"num_objects":21,"num_object_clones":1,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":11,"num_read":18776,"num_read_kb":58715,"num_write":619,"num_write_kb":13626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":126,"num_bytes_recovered":6078562,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.e","version":"149'559","reported_seq":7552,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.201159+0000","last_change":"2024-09-12T16:18:39.201921+0000","last_active":"2024-09-12T16:18:39.201159+0000","last_peered":"2024-09-12T16:18:39.201159+0000","last_clean":"2024-09-12T16:18:39.201159+0000","last_became_active":"2024-09-12T16:18:26.147326+0000","last_became_peered":"2024-09-12T16:18:26.147326+0000","last_unstale":"2024-09-12T16:18:39.201159+0000","last_undegraded":"2024-09-12T16:18:39.201159+0000","last_fullsized":"2024-09-12T16:18:39.201159+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:49.675529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058916369999999999,"stat_sum":{"num_bytes":3466240,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":17,"num_read":7695,"num_read_kb":29940,"num_write":536,"num_write_kb":13256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":319,"num_bytes_recovered":6744127,"num_keys_recovered":60,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.f","version":"148'634","reported_seq":12124,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.196437+0000","last_change":"2024-09-12T16:18:39.197260+0000","last_active":"2024-09-12T16:18:39.196437+0000","last_peered":"2024-09-12T16:18:39.196437+0000","last_clean":"2024-09-12T16:18:39.196437+0000","last_became_active":"2024-09-12T16:18:26.146621+0000","last_became_peered":"2024-09-12T16:18:26.146621+0000","last_unstale":"2024-09-12T16:18:39.196437+0000","last_undegraded":"2024-09-12T16:18:39.196437+0000","last_fullsized":"2024-09-12T16:18:39.196437+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:45.147399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0052530720000000001,"stat_sum":{"num_bytes":2958352,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":14,"num_read":10858,"num_read_kb":49110,"num_write":809,"num_write_kb":21657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":304,"num_bytes_recovered":6361542,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.10","version":"151'619","reported_seq":15140,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.279805+0000","last_change":"2024-09-12T16:18:39.199684+0000","last_active":"2024-09-12T16:18:39.279805+0000","last_peered":"2024-09-12T16:18:39.279805+0000","last_clean":"2024-09-12T16:18:39.279805+0000","last_became_active":"2024-09-12T16:18:25.146733+0000","last_became_peered":"2024-09-12T16:18:25.146733+0000","last_unstale":"2024-09-12T16:18:39.279805+0000","last_undegraded":"2024-09-12T16:18:39.279805+0000","last_fullsized":"2024-09-12T16:18:39.279805+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:34.060723+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0044594819999999999,"stat_sum":{"num_bytes":9976035,"num_objects":27,"num_object_clones":2,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":18,"num_read":12811,"num_read_kb":73183,"num_write":777,"num_write_kb":17171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":412,"num_bytes_recovered":13039478,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.11","version":"150'636","reported_seq":16925,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.191718+0000","last_change":"2024-09-12T16:18:39.192399+0000","last_active":"2024-09-12T16:18:39.191718+0000","last_peered":"2024-09-12T16:18:39.191718+0000","last_clean":"2024-09-12T16:18:39.191718+0000","last_became_active":"2024-09-12T16:16:55.202493+0000","last_became_peered":"2024-09-12T16:16:55.202493+0000","last_unstale":"2024-09-12T16:18:39.191718+0000","last_undegraded":"2024-09-12T16:18:39.191718+0000","last_fullsized":"2024-09-12T16:18:39.191718+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:18.752401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084498600000000004,"stat_sum":{"num_bytes":1822208,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":12,"num_read":16727,"num_read_kb":61490,"num_write":790,"num_write_kb":15885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":1725440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.12","version":"151'626","reported_seq":14920,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.317945+0000","last_change":"2024-09-12T16:18:39.205515+0000","last_active":"2024-09-12T16:18:39.317945+0000","last_peered":"2024-09-12T16:18:39.317945+0000","last_clean":"2024-09-12T16:18:39.317945+0000","last_became_active":"2024-09-12T16:16:55.202220+0000","last_became_peered":"2024-09-12T16:16:55.202220+0000","last_unstale":"2024-09-12T16:18:39.317945+0000","last_undegraded":"2024-09-12T16:18:39.317945+0000","last_fullsized":"2024-09-12T16:18:39.317945+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:53.498593+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0089097480000000003,"stat_sum":{"num_bytes":1339904,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":14,"num_read":16237,"num_read_kb":60051,"num_write":649,"num_write_kb":14668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":3518540,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.13","version":"151'979","reported_seq":11336,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T16:18:39.343377+0000","last_change":"2024-09-12T16:18:39.196336+0000","last_active":"2024-09-12T16:18:39.343377+0000","last_peered":"2024-09-12T16:18:39.343377+0000","last_clean":"2024-09-12T16:18:39.343377+0000","last_became_active":"2024-09-12T16:18:25.147080+0000","last_became_peered":"2024-09-12T16:18:25.147080+0000","last_unstale":"2024-09-12T16:18:39.343377+0000","last_undegraded":"2024-09-12T16:18:39.343377+0000","last_fullsized":"2024-09-12T16:18:39.343377+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":979,"log_dups_size":0,"ondisk_log_size":979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:51.793343+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0046578979999999997,"stat_sum":{"num_bytes":9732682,"num_objects":24,"num_object_clones":2,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":14,"num_read":11889,"num_read_kb":44788,"num_write":1427,"num_write_kb":19195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":434,"num_bytes_recovered":17467099,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"d","length":"5"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":349973474,"num_objects":708,"num_object_clones":39,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":708,"num_whiteouts":447,"num_read":451540,"num_read_kb":1622836,"num_write":28851,"num_write_kb":478854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5086,"num_bytes_recovered":202080646,"num_keys_recovered":679,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20144128,"data_stored":25864913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6949,"internal_metadata":0},"log_size":23863,"ondisk_log_size":23863,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":5,"up_from":71,"seq":304942678037,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41564,"kb_used_data":4672,"kb_used_omap":11,"kb_used_meta":36852,"kb_avail":94330276,"statfs":{"total":96636764160,"available":96594202624,"internally_reserved":0,"allocated":4784128,"data_stored":3728843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11593,"internal_metadata":37737143},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640295,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85696,"kb_used_data":10084,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94286144,"statfs":{"total":96636764160,"available":96549011456,"internally_reserved":0,"allocated":10326016,"data_stored":15090181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640296,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91244,"kb_used_data":15608,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94280596,"statfs":{"total":96636764160,"available":96543330304,"internally_reserved":0,"allocated":15982592,"data_stored":24865553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640297,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54712,"kb_used_data":5472,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94317128,"statfs":{"total":96636764160,"available":96580739072,"internally_reserved":0,"allocated":5603328,"data_stored":6530290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640295,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64280,"kb_used_data":6720,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94307560,"statfs":{"total":96636764160,"available":96570941440,"internally_reserved":0,"allocated":6881280,"data_stored":8243645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640296,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64644,"kb_used_data":14104,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94307196,"statfs":{"total":96636764160,"available":96570568704,"internally_reserved":0,"allocated":14442496,"data_stored":22245098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3448832,"data_stored":4539427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2191360,"data_stored":2017577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3801088,"data_stored":5777220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3538944,"data_stored":4422202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4222976,"data_stored":6148996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2940928,"data_stored":2959491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6949,"internal_metadata":0}]}} 2024-09-12T16:18:44.756 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-12T16:18:44.756 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:44.753+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:44.756 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T16:18:44.756 INFO:tasks.thrashosds.thrasher:Killing osd 0, live_osds are [0, 1, 2, 3, 4, 5] 2024-09-12T16:18:44.756 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T16:18:44.757 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T16:18:44.786 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:44.786 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:44.795 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:18:44.826 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T16:18:44.826 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.0 2024-09-12T16:18:44.826 INFO:tasks.thrashosds.thrasher:remote for osd 0 is ubuntu@smithi017.front.sepia.ceph.com 2024-09-12T16:18:44.827 DEBUG:teuthology.orchestra.run.smithi017:> type ceph-objectstore-tool 2024-09-12T16:18:44.868 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:44.867+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:44.882 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-12T16:18:44.882 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-0 --journal-path /var/lib/ceph/osd/ceph-0/journal --op list-pgs 2024-09-12T16:18:44.902 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:44.902 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:44.910 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:18:44.955 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:44.955+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:45.020 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:45.020 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:45.032 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:18:45.073 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:45.073+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:45.157 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:45.156+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:45.179 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:45.180 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:45.189 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:18:45.257 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:45.257+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:45.335 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:45.335 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:45.344 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:18:45.388 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:45.387+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:45.404 INFO:teuthology.orchestra.run.smithi017.stdout:3.c 2024-09-12T16:18:45.404 INFO:teuthology.orchestra.run.smithi017.stdout:3.b 2024-09-12T16:18:45.404 INFO:teuthology.orchestra.run.smithi017.stdout:1.0 2024-09-12T16:18:45.404 INFO:teuthology.orchestra.run.smithi017.stdout:2.4 2024-09-12T16:18:45.404 INFO:teuthology.orchestra.run.smithi017.stdout:2.5 2024-09-12T16:18:45.404 INFO:teuthology.orchestra.run.smithi017.stdout:3.10 2024-09-12T16:18:45.404 INFO:teuthology.orchestra.run.smithi017.stdout:3.12 2024-09-12T16:18:45.404 INFO:teuthology.orchestra.run.smithi017.stdout:3.17 2024-09-12T16:18:45.404 INFO:teuthology.orchestra.run.smithi017.stdout:3.3 2024-09-12T16:18:45.404 INFO:teuthology.orchestra.run.smithi017.stdout:3.18 2024-09-12T16:18:45.404 INFO:teuthology.orchestra.run.smithi017.stdout:3.1 2024-09-12T16:18:45.405 INFO:teuthology.orchestra.run.smithi017.stdout:3.1b 2024-09-12T16:18:45.405 INFO:teuthology.orchestra.run.smithi017.stdout:3.1f 2024-09-12T16:18:45.405 INFO:teuthology.orchestra.run.smithi017.stdout:3.15 2024-09-12T16:18:45.405 INFO:teuthology.orchestra.run.smithi017.stdout:3.6 2024-09-12T16:18:45.454 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:45.454 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:45.460 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:45.459+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:45.463 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:18:45.561 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:45.560+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:45.610 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:45.610 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:45.619 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:18:45.663 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:45.662+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:45.694 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-0 --journal-path /var/lib/ceph/osd/ceph-0/journal --op export --pgid 3.1b --file /var/log/ceph/exp.3.1b.0 2024-09-12T16:18:45.726 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:45.726 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:45.735 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:18:45.763 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:45.762+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:45.863 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:45.863+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:45.882 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:45.882 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:45.891 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:18:45.912 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T16:18:45.964 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:45.964+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:45.998 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:45.998 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:46.007 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:18:46.034 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T16:18:46.047 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T16:18:46.065 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:46.065+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:46.068 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:18:46.068 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:18:46.091 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:18:46.091 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:18:46.111 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:18:46.111 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:18:46.133 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:18:46.133 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:18:46.151 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:18:46.152 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:18:46.156 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T16:18:46.156 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T16:18:46.160 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:46.160 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:18:46.161 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:18:46.161 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:18:46.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.161 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2213 3.18 3:1944e921:::rbd_data.1155ccb1894c.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:18:46.161 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:18:46.161 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 108.7833387, 2024-09-12T16:18:46.161 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.055657836000000002, 2024-09-12T16:18:46.161 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:46.161 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:46.162 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:46.162 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:46.162 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:18:46.162 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:18:46.162 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2213 2024-09-12T16:18:46.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.162 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:46.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:46.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:18:46.163 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:46.163 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375349+0000", 2024-09-12T16:18:46.163 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.164 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:46.164 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.375351+0000", 2024-09-12T16:18:46.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.556e-06 2024-09-12T16:18:46.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.164 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.164 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:46.164 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.399989+0000", 2024-09-12T16:18:46.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024637949999999999 2024-09-12T16:18:46.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.164 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.165 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:46.165 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400038+0000", 2024-09-12T16:18:46.165 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9187999999999997e-05 2024-09-12T16:18:46.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.165 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.165 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.165 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400056+0000", 2024-09-12T16:18:46.165 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8451e-05 2024-09-12T16:18:46.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.165 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.165 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:46.166 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400151+0000", 2024-09-12T16:18:46.166 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5026999999999997e-05 2024-09-12T16:18:46.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.166 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.166 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:46.166 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.400345+0000", 2024-09-12T16:18:46.166 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019352900000000001 2024-09-12T16:18:46.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.166 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.166 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 1", 2024-09-12T16:18:46.166 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.401319+0000", 2024-09-12T16:18:46.166 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00097419399999999995 2024-09-12T16:18:46.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.167 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.167 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:18:46.167 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.429350+0000", 2024-09-12T16:18:46.167 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028030607999999999 2024-09-12T16:18:46.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.167 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.167 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:46.167 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.430907+0000", 2024-09-12T16:18:46.167 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001557466 2024-09-12T16:18:46.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.167 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.167 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:18:46.167 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.430966+0000", 2024-09-12T16:18:46.167 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9437e-05 2024-09-12T16:18:46.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.168 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.168 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:46.168 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.431007+0000", 2024-09-12T16:18:46.168 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0429999999999997e-05 2024-09-12T16:18:46.168 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.168 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:46.168 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.168 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.168 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5632 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 585728~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:46.168 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556262+0000", 2024-09-12T16:18:46.168 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.602425644, 2024-09-12T16:18:46.168 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051267114000000003, 2024-09-12T16:18:46.168 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:46.169 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:46.169 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:46.169 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:46.169 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:46.169 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:46.169 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5632 2024-09-12T16:18:46.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.169 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:46.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.169 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:46.169 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556262+0000", 2024-09-12T16:18:46.169 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.169 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:46.170 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556262+0000", 2024-09-12T16:18:46.170 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.170 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:46.170 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556262+0000", 2024-09-12T16:18:46.170 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9999999999999998e-07 2024-09-12T16:18:46.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.170 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:46.170 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556269+0000", 2024-09-12T16:18:46.171 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4119999999999998e-06 2024-09-12T16:18:46.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.171 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.171 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:46.171 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556276+0000", 2024-09-12T16:18:46.171 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8549999999999996e-06 2024-09-12T16:18:46.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.171 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.171 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.171 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556281+0000", 2024-09-12T16:18:46.171 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1159999999999998e-06 2024-09-12T16:18:46.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.171 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.171 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:46.172 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607438+0000", 2024-09-12T16:18:46.172 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.05115695 2024-09-12T16:18:46.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.172 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:46.172 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607478+0000", 2024-09-12T16:18:46.172 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0535999999999999e-05 2024-09-12T16:18:46.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.172 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:46.172 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607529+0000", 2024-09-12T16:18:46.172 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0844999999999999e-05 2024-09-12T16:18:46.172 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.172 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:46.172 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.173 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5633 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 638976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:46.173 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556288+0000", 2024-09-12T16:18:46.173 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.602399611999999, 2024-09-12T16:18:46.173 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051384633999999998, 2024-09-12T16:18:46.173 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:46.173 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:46.173 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:46.173 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:46.173 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:46.173 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:46.173 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5633 2024-09-12T16:18:46.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.174 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:46.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.174 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:46.174 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556288+0000", 2024-09-12T16:18:46.174 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.174 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:46.174 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556288+0000", 2024-09-12T16:18:46.174 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.174 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:46.174 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556289+0000", 2024-09-12T16:18:46.175 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4000000000000002e-07 2024-09-12T16:18:46.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.175 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:46.175 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556291+0000", 2024-09-12T16:18:46.175 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0470000000000001e-06 2024-09-12T16:18:46.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.175 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:46.176 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556297+0000", 2024-09-12T16:18:46.176 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5080000000000002e-06 2024-09-12T16:18:46.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.176 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.176 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.177 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556302+0000", 2024-09-12T16:18:46.177 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2190000000000003e-06 2024-09-12T16:18:46.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.177 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:46.177 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607559+0000", 2024-09-12T16:18:46.177 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051256542000000002 2024-09-12T16:18:46.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.177 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:46.177 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607619+0000", 2024-09-12T16:18:46.177 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0538000000000002e-05 2024-09-12T16:18:46.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.178 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:46.178 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607673+0000", 2024-09-12T16:18:46.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3340000000000001e-05 2024-09-12T16:18:46.178 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.178 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:46.178 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.178 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5634 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 692224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:46.178 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556324+0000", 2024-09-12T16:18:46.178 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.602363922999999, 2024-09-12T16:18:46.179 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.05149252, 2024-09-12T16:18:46.179 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:46.179 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:46.179 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:46.179 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:46.179 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:46.179 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:46.179 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5634 2024-09-12T16:18:46.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.179 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:46.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.179 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:46.179 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556324+0000", 2024-09-12T16:18:46.180 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.180 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:46.180 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556324+0000", 2024-09-12T16:18:46.180 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.180 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:46.180 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556324+0000", 2024-09-12T16:18:46.180 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1900000000000002e-07 2024-09-12T16:18:46.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.180 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:46.181 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556327+0000", 2024-09-12T16:18:46.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T16:18:46.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.181 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:46.181 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556334+0000", 2024-09-12T16:18:46.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3919999999999997e-06 2024-09-12T16:18:46.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.181 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.181 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556341+0000", 2024-09-12T16:18:46.182 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6000000000000003e-06 2024-09-12T16:18:46.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.182 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.182 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:46.182 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607704+0000", 2024-09-12T16:18:46.183 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051363233000000001 2024-09-12T16:18:46.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.183 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.183 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:46.183 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607764+0000", 2024-09-12T16:18:46.183 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9871000000000003e-05 2024-09-12T16:18:46.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.184 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.184 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:46.184 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607816+0000", 2024-09-12T16:18:46.184 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2374999999999999e-05 2024-09-12T16:18:46.184 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.184 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:46.184 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.184 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.184 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5635 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 745472~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:46.184 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556348+0000", 2024-09-12T16:18:46.185 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.602339352000001, 2024-09-12T16:18:46.185 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051607838000000003, 2024-09-12T16:18:46.185 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:46.185 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:46.185 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:46.185 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:46.185 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:46.185 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:46.186 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5635 2024-09-12T16:18:46.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.186 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:46.186 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.186 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:46.186 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556348+0000", 2024-09-12T16:18:46.186 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.186 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.186 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:46.187 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556348+0000", 2024-09-12T16:18:46.187 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.187 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.187 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:46.187 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556349+0000", 2024-09-12T16:18:46.187 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.75e-07 2024-09-12T16:18:46.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.187 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.187 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:46.187 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556351+0000", 2024-09-12T16:18:46.187 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1890000000000001e-06 2024-09-12T16:18:46.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.187 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.187 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:46.188 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556358+0000", 2024-09-12T16:18:46.188 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.922e-06 2024-09-12T16:18:46.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.188 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.188 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.188 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556363+0000", 2024-09-12T16:18:46.188 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.242e-06 2024-09-12T16:18:46.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.188 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.188 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:46.188 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607846+0000", 2024-09-12T16:18:46.188 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051482433000000001 2024-09-12T16:18:46.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.188 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.188 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:46.189 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607886+0000", 2024-09-12T16:18:46.189 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0290999999999998e-05 2024-09-12T16:18:46.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.189 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.189 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:46.189 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607956+0000", 2024-09-12T16:18:46.189 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0285999999999998e-05 2024-09-12T16:18:46.189 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.189 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:46.189 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.189 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.189 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5636 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 806912~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:46.189 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556371+0000", 2024-09-12T16:18:46.190 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.602317174, 2024-09-12T16:18:46.190 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051725921000000001, 2024-09-12T16:18:46.190 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:46.190 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:46.190 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:46.190 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:46.190 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:46.190 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:46.190 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5636 2024-09-12T16:18:46.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.190 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:46.190 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.190 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:46.190 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556371+0000", 2024-09-12T16:18:46.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.191 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:46.191 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556371+0000", 2024-09-12T16:18:46.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.191 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:46.191 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556371+0000", 2024-09-12T16:18:46.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9800000000000004e-07 2024-09-12T16:18:46.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.191 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:46.191 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556373+0000", 2024-09-12T16:18:46.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0490000000000002e-06 2024-09-12T16:18:46.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.192 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:46.192 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556380+0000", 2024-09-12T16:18:46.192 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6050000000000003e-06 2024-09-12T16:18:46.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.192 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.192 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556385+0000", 2024-09-12T16:18:46.192 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2449999999999998e-06 2024-09-12T16:18:46.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.192 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:46.192 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.607993+0000", 2024-09-12T16:18:46.192 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051608182000000002 2024-09-12T16:18:46.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.193 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:46.193 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608035+0000", 2024-09-12T16:18:46.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1698e-05 2024-09-12T16:18:46.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.193 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:46.193 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608096+0000", 2024-09-12T16:18:46.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1643999999999995e-05 2024-09-12T16:18:46.193 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.193 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:46.193 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.194 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5637 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 860160~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:46.194 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556393+0000", 2024-09-12T16:18:46.194 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.602294522999998, 2024-09-12T16:18:46.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051839035999999998, 2024-09-12T16:18:46.194 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:46.194 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:46.194 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:46.194 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:46.194 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:46.194 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:46.194 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5637 2024-09-12T16:18:46.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.195 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:46.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:46.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556393+0000", 2024-09-12T16:18:46.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:46.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556393+0000", 2024-09-12T16:18:46.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:46.196 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556394+0000", 2024-09-12T16:18:46.196 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3000000000000001e-07 2024-09-12T16:18:46.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.196 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:46.196 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556396+0000", 2024-09-12T16:18:46.196 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0839999999999999e-06 2024-09-12T16:18:46.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.196 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:46.196 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556402+0000", 2024-09-12T16:18:46.196 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6919999999999996e-06 2024-09-12T16:18:46.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.197 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556408+0000", 2024-09-12T16:18:46.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2800000000000003e-06 2024-09-12T16:18:46.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:46.197 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608129+0000", 2024-09-12T16:18:46.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051720902999999999 2024-09-12T16:18:46.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:46.197 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608174+0000", 2024-09-12T16:18:46.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5676000000000001e-05 2024-09-12T16:18:46.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:46.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608232+0000", 2024-09-12T16:18:46.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7970999999999998e-05 2024-09-12T16:18:46.198 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.198 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:46.198 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.198 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5638 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 913408~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:46.198 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556415+0000", 2024-09-12T16:18:46.198 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.602273128999997, 2024-09-12T16:18:46.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051949532999999999, 2024-09-12T16:18:46.198 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:46.199 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:46.199 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:46.199 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:46.199 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:46.199 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:46.199 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5638 2024-09-12T16:18:46.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.199 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:46.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:46.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556415+0000", 2024-09-12T16:18:46.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:46.200 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556415+0000", 2024-09-12T16:18:46.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.200 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.200 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:46.200 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556415+0000", 2024-09-12T16:18:46.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7199999999999999e-07 2024-09-12T16:18:46.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.200 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.200 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:46.200 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556417+0000", 2024-09-12T16:18:46.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0279999999999999e-06 2024-09-12T16:18:46.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.201 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:46.201 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556424+0000", 2024-09-12T16:18:46.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6950000000000003e-06 2024-09-12T16:18:46.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.201 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.201 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556429+0000", 2024-09-12T16:18:46.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3059999999999997e-06 2024-09-12T16:18:46.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.201 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:46.201 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608260+0000", 2024-09-12T16:18:46.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051831254 2024-09-12T16:18:46.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.202 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:46.202 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608306+0000", 2024-09-12T16:18:46.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5976999999999997e-05 2024-09-12T16:18:46.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.202 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:46.202 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608364+0000", 2024-09-12T16:18:46.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7800999999999998e-05 2024-09-12T16:18:46.202 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.202 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:46.202 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.203 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5639 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 966656~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:46.203 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556436+0000", 2024-09-12T16:18:46.203 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.602251455999998, 2024-09-12T16:18:46.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052070419, 2024-09-12T16:18:46.203 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:46.203 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:46.203 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:46.203 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:46.203 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:46.203 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:46.203 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5639 2024-09-12T16:18:46.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.203 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:46.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:46.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556436+0000", 2024-09-12T16:18:46.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:46.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556436+0000", 2024-09-12T16:18:46.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:46.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556437+0000", 2024-09-12T16:18:46.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1899999999999998e-07 2024-09-12T16:18:46.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:46.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556439+0000", 2024-09-12T16:18:46.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.973e-06 2024-09-12T16:18:46.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:46.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556445+0000", 2024-09-12T16:18:46.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7769999999999997e-06 2024-09-12T16:18:46.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556451+0000", 2024-09-12T16:18:46.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.31e-06 2024-09-12T16:18:46.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:46.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608397+0000", 2024-09-12T16:18:46.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.051945829999999998 2024-09-12T16:18:46.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:46.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608438+0000", 2024-09-12T16:18:46.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1539000000000003e-05 2024-09-12T16:18:46.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:46.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608507+0000", 2024-09-12T16:18:46.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8571000000000005e-05 2024-09-12T16:18:46.207 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.207 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:46.207 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.207 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5640 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1019904~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:46.207 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556458+0000", 2024-09-12T16:18:46.207 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.602229944000001, 2024-09-12T16:18:46.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052171423000000001, 2024-09-12T16:18:46.207 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:46.207 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:46.207 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:46.207 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:46.208 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:46.208 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:46.208 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5640 2024-09-12T16:18:46.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.208 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:46.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:46.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556458+0000", 2024-09-12T16:18:46.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:46.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556458+0000", 2024-09-12T16:18:46.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:46.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556458+0000", 2024-09-12T16:18:46.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2500000000000001e-07 2024-09-12T16:18:46.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:46.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556460+0000", 2024-09-12T16:18:46.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.934e-06 2024-09-12T16:18:46.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:46.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556468+0000", 2024-09-12T16:18:46.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7950000000000008e-06 2024-09-12T16:18:46.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556473+0000", 2024-09-12T16:18:46.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3539999999999999e-06 2024-09-12T16:18:46.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:46.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608539+0000", 2024-09-12T16:18:46.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052065974000000001 2024-09-12T16:18:46.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:46.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608579+0000", 2024-09-12T16:18:46.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0238999999999999e-05 2024-09-12T16:18:46.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:46.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608629+0000", 2024-09-12T16:18:46.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9701999999999999e-05 2024-09-12T16:18:46.211 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.211 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:46.211 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.211 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5641 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1081344~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:46.211 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556480+0000", 2024-09-12T16:18:46.212 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.602207335000003, 2024-09-12T16:18:46.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052284826999999999, 2024-09-12T16:18:46.212 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:46.212 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:46.212 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:46.212 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:46.212 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:46.212 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:46.212 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5641 2024-09-12T16:18:46.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.212 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:46.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:46.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556480+0000", 2024-09-12T16:18:46.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:46.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556480+0000", 2024-09-12T16:18:46.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:46.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556481+0000", 2024-09-12T16:18:46.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.27e-07 2024-09-12T16:18:46.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.214 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:46.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556483+0000", 2024-09-12T16:18:46.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9379999999999999e-06 2024-09-12T16:18:46.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.214 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:46.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556489+0000", 2024-09-12T16:18:46.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5910000000000001e-06 2024-09-12T16:18:46.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.214 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556495+0000", 2024-09-12T16:18:46.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5600000000000001e-06 2024-09-12T16:18:46.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:46.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608659+0000", 2024-09-12T16:18:46.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052164489000000001 2024-09-12T16:18:46.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:46.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608714+0000", 2024-09-12T16:18:46.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4849999999999998e-05 2024-09-12T16:18:46.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:46.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608765+0000", 2024-09-12T16:18:46.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0971999999999999e-05 2024-09-12T16:18:46.216 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.216 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:46.216 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.216 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5642 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1134592~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:46.216 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556502+0000", 2024-09-12T16:18:46.216 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.60218544, 2024-09-12T16:18:46.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052404536000000002, 2024-09-12T16:18:46.216 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:46.216 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:46.216 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:46.216 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:46.216 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:46.217 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:46.217 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5642 2024-09-12T16:18:46.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.217 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:46.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:46.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556502+0000", 2024-09-12T16:18:46.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:46.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556502+0000", 2024-09-12T16:18:46.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:46.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556503+0000", 2024-09-12T16:18:46.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8599999999999998e-07 2024-09-12T16:18:46.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:46.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556505+0000", 2024-09-12T16:18:46.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.097e-06 2024-09-12T16:18:46.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:46.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556512+0000", 2024-09-12T16:18:46.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8229999999999997e-06 2024-09-12T16:18:46.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556517+0000", 2024-09-12T16:18:46.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6289999999999998e-06 2024-09-12T16:18:46.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:46.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608797+0000", 2024-09-12T16:18:46.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052279651000000003 2024-09-12T16:18:46.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:46.220 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608852+0000", 2024-09-12T16:18:46.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4994999999999998e-05 2024-09-12T16:18:46.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.220 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:46.220 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608907+0000", 2024-09-12T16:18:46.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4755e-05 2024-09-12T16:18:46.220 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.220 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:46.220 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.220 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5643 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1187840~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:46.221 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556525+0000", 2024-09-12T16:18:46.221 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.602163198, 2024-09-12T16:18:46.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052518288000000003, 2024-09-12T16:18:46.221 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:46.221 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:46.221 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:46.221 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:46.221 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:46.221 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:46.221 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5643 2024-09-12T16:18:46.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.221 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:46.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:46.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556525+0000", 2024-09-12T16:18:46.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:46.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556525+0000", 2024-09-12T16:18:46.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:46.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556525+0000", 2024-09-12T16:18:46.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0400000000000002e-07 2024-09-12T16:18:46.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.223 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:46.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556528+0000", 2024-09-12T16:18:46.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8679999999999999e-06 2024-09-12T16:18:46.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.223 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:46.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556536+0000", 2024-09-12T16:18:46.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3089999999999996e-06 2024-09-12T16:18:46.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.223 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556541+0000", 2024-09-12T16:18:46.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3120000000000001e-06 2024-09-12T16:18:46.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:46.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608943+0000", 2024-09-12T16:18:46.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052401089999999997 2024-09-12T16:18:46.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:46.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.608991+0000", 2024-09-12T16:18:46.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8633e-05 2024-09-12T16:18:46.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:46.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609043+0000", 2024-09-12T16:18:46.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1672000000000003e-05 2024-09-12T16:18:46.225 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.225 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:46.225 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.225 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5644 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1241088~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:46.225 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556548+0000", 2024-09-12T16:18:46.225 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.602139665000003, 2024-09-12T16:18:46.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052634777000000001, 2024-09-12T16:18:46.225 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:46.225 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:46.225 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:46.225 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:46.226 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:46.226 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:46.226 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5644 2024-09-12T16:18:46.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.226 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:46.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:46.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556548+0000", 2024-09-12T16:18:46.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:46.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556548+0000", 2024-09-12T16:18:46.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:46.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556549+0000", 2024-09-12T16:18:46.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1900000000000003e-07 2024-09-12T16:18:46.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:46.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556555+0000", 2024-09-12T16:18:46.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.652e-06 2024-09-12T16:18:46.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:46.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556562+0000", 2024-09-12T16:18:46.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.905e-06 2024-09-12T16:18:46.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556567+0000", 2024-09-12T16:18:46.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1730000000000003e-06 2024-09-12T16:18:46.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:46.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609079+0000", 2024-09-12T16:18:46.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052511993 2024-09-12T16:18:46.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:46.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609125+0000", 2024-09-12T16:18:46.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5327000000000002e-05 2024-09-12T16:18:46.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:46.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609183+0000", 2024-09-12T16:18:46.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8208000000000002e-05 2024-09-12T16:18:46.229 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.229 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:46.229 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.229 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5645 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1294336~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:46.229 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556574+0000", 2024-09-12T16:18:46.229 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.602113267, 2024-09-12T16:18:46.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052876909999999999, 2024-09-12T16:18:46.230 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:46.230 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:46.230 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:46.230 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:46.230 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:46.230 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:46.230 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5645 2024-09-12T16:18:46.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.230 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:46.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:46.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556574+0000", 2024-09-12T16:18:46.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:46.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556574+0000", 2024-09-12T16:18:46.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:46.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556575+0000", 2024-09-12T16:18:46.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.89e-07 2024-09-12T16:18:46.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:46.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556577+0000", 2024-09-12T16:18:46.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8700000000000001e-06 2024-09-12T16:18:46.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:46.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556583+0000", 2024-09-12T16:18:46.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4320000000000004e-06 2024-09-12T16:18:46.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556589+0000", 2024-09-12T16:18:46.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3890000000000004e-06 2024-09-12T16:18:46.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:46.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609236+0000", 2024-09-12T16:18:46.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052647022000000002 2024-09-12T16:18:46.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:46.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609334+0000", 2024-09-12T16:18:46.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8039000000000001e-05 2024-09-12T16:18:46.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:46.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609451+0000", 2024-09-12T16:18:46.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117769 2024-09-12T16:18:46.233 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.233 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:46.233 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.233 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5646 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1355776~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:46.234 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556595+0000", 2024-09-12T16:18:46.234 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.602092286000001, 2024-09-12T16:18:46.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053088173000000002, 2024-09-12T16:18:46.234 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:46.234 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:46.234 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:46.234 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:46.234 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:46.234 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:46.234 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5646 2024-09-12T16:18:46.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.234 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:46.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:46.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556595+0000", 2024-09-12T16:18:46.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:46.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556595+0000", 2024-09-12T16:18:46.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:46.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556596+0000", 2024-09-12T16:18:46.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:18:46.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:46.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556598+0000", 2024-09-12T16:18:46.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0669999999999999e-06 2024-09-12T16:18:46.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:46.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556603+0000", 2024-09-12T16:18:46.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5210000000000002e-06 2024-09-12T16:18:46.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556609+0000", 2024-09-12T16:18:46.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1590000000000001e-06 2024-09-12T16:18:46.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.237 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:46.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609499+0000", 2024-09-12T16:18:46.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052890489999999998 2024-09-12T16:18:46.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.237 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:46.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609586+0000", 2024-09-12T16:18:46.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6681999999999994e-05 2024-09-12T16:18:46.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.237 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:46.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609684+0000", 2024-09-12T16:18:46.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7863999999999997e-05 2024-09-12T16:18:46.238 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.238 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:46.238 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.238 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5647 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1409024~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:46.238 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556616+0000", 2024-09-12T16:18:46.238 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.602071991000003, 2024-09-12T16:18:46.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053207888000000002, 2024-09-12T16:18:46.239 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:46.239 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:46.239 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:46.239 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:46.239 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:46.239 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:46.239 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5647 2024-09-12T16:18:46.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.239 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:46.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:46.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556616+0000", 2024-09-12T16:18:46.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:46.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556616+0000", 2024-09-12T16:18:46.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:46.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556616+0000", 2024-09-12T16:18:46.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3599999999999999e-07 2024-09-12T16:18:46.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:46.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556618+0000", 2024-09-12T16:18:46.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1550000000000001e-06 2024-09-12T16:18:46.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:46.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556624+0000", 2024-09-12T16:18:46.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0499999999999997e-06 2024-09-12T16:18:46.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556629+0000", 2024-09-12T16:18:46.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8840000000000002e-06 2024-09-12T16:18:46.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:46.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609721+0000", 2024-09-12T16:18:46.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053091808999999997 2024-09-12T16:18:46.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:46.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609767+0000", 2024-09-12T16:18:46.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.638e-05 2024-09-12T16:18:46.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:46.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609824+0000", 2024-09-12T16:18:46.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6174000000000001e-05 2024-09-12T16:18:46.242 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.242 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:46.242 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.243 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5648 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1462272~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:46.243 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.556636+0000", 2024-09-12T16:18:46.243 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.602051332000002, 2024-09-12T16:18:46.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053322131000000002, 2024-09-12T16:18:46.243 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:46.243 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:46.243 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:46.243 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:46.243 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:46.243 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:46.243 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5648 2024-09-12T16:18:46.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.244 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:46.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.244 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:46.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556636+0000", 2024-09-12T16:18:46.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.244 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:46.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.556636+0000", 2024-09-12T16:18:46.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.244 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:46.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557015+0000", 2024-09-12T16:18:46.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000378911 2024-09-12T16:18:46.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:46.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557019+0000", 2024-09-12T16:18:46.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2100000000000002e-06 2024-09-12T16:18:46.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:46.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557030+0000", 2024-09-12T16:18:46.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.149e-05 2024-09-12T16:18:46.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557037+0000", 2024-09-12T16:18:46.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5719999999999999e-06 2024-09-12T16:18:46.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:46.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609838+0000", 2024-09-12T16:18:46.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052801305999999999 2024-09-12T16:18:46.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:46.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609880+0000", 2024-09-12T16:18:46.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2604000000000001e-05 2024-09-12T16:18:46.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:46.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609959+0000", 2024-09-12T16:18:46.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8038000000000001e-05 2024-09-12T16:18:46.247 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.247 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:46.247 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.247 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5649 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1515520~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:46.247 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.557073+0000", 2024-09-12T16:18:46.247 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.601614331, 2024-09-12T16:18:46.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053030573999999997, 2024-09-12T16:18:46.248 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:46.248 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:46.248 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:46.248 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:46.248 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:46.248 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:46.248 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5649 2024-09-12T16:18:46.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.248 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:46.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:46.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557073+0000", 2024-09-12T16:18:46.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:46.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557073+0000", 2024-09-12T16:18:46.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:46.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557074+0000", 2024-09-12T16:18:46.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5199999999999996e-07 2024-09-12T16:18:46.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:46.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557084+0000", 2024-09-12T16:18:46.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0349e-05 2024-09-12T16:18:46.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:46.250 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557092+0000", 2024-09-12T16:18:46.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9699999999999999e-06 2024-09-12T16:18:46.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.250 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557100+0000", 2024-09-12T16:18:46.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7049999999999999e-06 2024-09-12T16:18:46.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:46.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.609992+0000", 2024-09-12T16:18:46.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052891821999999998 2024-09-12T16:18:46.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:46.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610034+0000", 2024-09-12T16:18:46.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2141000000000002e-05 2024-09-12T16:18:46.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:46.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610104+0000", 2024-09-12T16:18:46.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9935e-05 2024-09-12T16:18:46.251 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.251 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:46.252 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.252 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5979.0:5650 3.8 3:1660a10b:::rbd_data.1155193bfe6e.0000000000000007:2b [read 1568768~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-09-12T16:18:46.252 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:01.557111+0000", 2024-09-12T16:18:46.252 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.601577108999997, 2024-09-12T16:18:46.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053118023, 2024-09-12T16:18:46.252 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:46.252 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:46.252 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:46.252 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:46.252 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5979", 2024-09-12T16:18:46.252 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/599572363", 2024-09-12T16:18:46.253 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5650 2024-09-12T16:18:46.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.253 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:46.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:46.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557111+0000", 2024-09-12T16:18:46.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:46.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.557111+0000", 2024-09-12T16:18:46.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:46.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:46.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.562089+0000", 2024-09-12T16:18:46.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0049787410000000001 2024-09-12T16:18:46.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:46.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.562094+0000", 2024-09-12T16:18:46.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7210000000000002e-06 2024-09-12T16:18:46.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:46.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.562105+0000", 2024-09-12T16:18:46.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0458999999999999e-05 2024-09-12T16:18:46.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.562112+0000", 2024-09-12T16:18:46.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0280000000000003e-06 2024-09-12T16:18:46.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:46.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610135+0000", 2024-09-12T16:18:46.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048023374000000001 2024-09-12T16:18:46.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:46.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610177+0000", 2024-09-12T16:18:46.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2119000000000001e-05 2024-09-12T16:18:46.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:46.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:46.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:46.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:01.610229+0000", 2024-09-12T16:18:46.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1581e-05 2024-09-12T16:18:46.256 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.256 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:46.256 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.256 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:46.256 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:46.256 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:46.258 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:18:46.258 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:46.257+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:46.267 INFO:teuthology.orchestra.run.smithi017.stderr:Exporting 3.1b info 3.1b( v 154'1252 (0'0,154'1252] local-lis/les=84/85 n=16 ec=21/21 lis/c=84/84 les/c/f=85/85/0 sis=84) 2024-09-12T16:18:46.277 INFO:teuthology.orchestra.run.smithi017.stderr:Read #3:d8554148:::rbd_data.11552a15f591.0000000000000095:head# 2024-09-12T16:18:46.278 INFO:teuthology.orchestra.run.smithi017.stderr:Read #3:d90f3791:::rbd_data.11552a15f591.0000000000000068:head# 2024-09-12T16:18:46.278 INFO:teuthology.orchestra.run.smithi017.stderr:Read #3:d936ad2f:::rbd_data.11552a15f591.0000000000000043:head# 2024-09-12T16:18:46.278 INFO:teuthology.orchestra.run.smithi017.stderr:Read #3:da28d2b0:::rbd_data.1155463b02f1.000000000000005d:head# 2024-09-12T16:18:46.278 INFO:teuthology.orchestra.run.smithi017.stderr:Read #3:da41e9b8:::rbd_data.11552a15f591.000000000000005a:head# 2024-09-12T16:18:46.278 INFO:teuthology.orchestra.run.smithi017.stderr:Read #3:da7137f5:::rbd_data.11552a15f591.0000000000000063:head# 2024-09-12T16:18:46.278 INFO:teuthology.orchestra.run.smithi017.stderr:Read #3:da7eb35d:::rbd_data.11557ed36bb5.00000000000000b0:head# 2024-09-12T16:18:46.278 INFO:teuthology.orchestra.run.smithi017.stderr:Read #3:da856c6c:::rbd_data.1155b4d1eca0.0000000000000113:head# 2024-09-12T16:18:46.278 INFO:teuthology.orchestra.run.smithi017.stderr:Read #3:da9fab25:::rbd_data.1155b4d1eca0.000000000000012a:head# 2024-09-12T16:18:46.278 INFO:teuthology.orchestra.run.smithi017.stderr:Read #3:dc1d99df:::rbd_data.1155463b02f1.000000000000004b:head# 2024-09-12T16:18:46.278 INFO:teuthology.orchestra.run.smithi017.stderr:Read #3:dc550107:::rbd_data.1155b4d1eca0.0000000000000073:head# 2024-09-12T16:18:46.278 INFO:teuthology.orchestra.run.smithi017.stderr:Read #3:dc6deea6:::rbd_data.1155b4d1eca0.000000000000006f:head# 2024-09-12T16:18:46.278 INFO:teuthology.orchestra.run.smithi017.stderr:Read #3:dc89eb30:::rbd_data.11557ed36bb5.000000000000003e:head# 2024-09-12T16:18:46.279 INFO:teuthology.orchestra.run.smithi017.stderr:Read #3:dce4f678:::rbd_data.1155b4d1eca0.00000000000000a0:head# 2024-09-12T16:18:46.279 INFO:teuthology.orchestra.run.smithi017.stderr:Read #3:df29696e:::rbd_data.1155c757bf36.0000000000000034:head# 2024-09-12T16:18:46.279 INFO:teuthology.orchestra.run.smithi017.stderr:Read #3:dfd58a31:::rbd_data.1155525b14e3.0000000000000038:head# 2024-09-12T16:18:46.279 INFO:teuthology.orchestra.run.smithi017.stderr:Export successful 2024-09-12T16:18:46.358 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:46.357+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:46.369 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:46.369 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:46.369 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:18:46.369 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:46.378 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:18:46.459 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:46.458+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:46.485 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:46.485 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:46.485 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:18:46.485 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:18:46.486 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:46.494 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:18:46.544 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-0 --journal-path /var/lib/ceph/osd/ceph-0/journal --force --op remove --pgid 3.1b 2024-09-12T16:18:46.586 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:46.585+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:46.603 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:46.603 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:18:46.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:18:46.603 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:18:46.603 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.603 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14)", 2024-09-12T16:18:46.603 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:18:46.603 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 184.83678546199999, 2024-09-12T16:18:46.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55645454900000002, 2024-09-12T16:18:46.603 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:46.603 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:46.604 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:46.604 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:46.604 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4180", 2024-09-12T16:18:46.604 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2948918136", 2024-09-12T16:18:46.604 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1 2024-09-12T16:18:46.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.604 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:46.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.604 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:46.604 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:18:46.604 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.604 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:46.604 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764438+0000", 2024-09-12T16:18:46.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.605 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:46.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764440+0000", 2024-09-12T16:18:46.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6249999999999999e-06 2024-09-12T16:18:46.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.605 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:46.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764447+0000", 2024-09-12T16:18:46.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4939999999999997e-06 2024-09-12T16:18:46.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.605 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:46.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764459+0000", 2024-09-12T16:18:46.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1517e-05 2024-09-12T16:18:46.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764468+0000", 2024-09-12T16:18:46.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7690000000000002e-06 2024-09-12T16:18:46.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:46.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764539+0000", 2024-09-12T16:18:46.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1103e-05 2024-09-12T16:18:46.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:46.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:41.764551+0000", 2024-09-12T16:18:46.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2687999999999999e-05 2024-09-12T16:18:46.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:46.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319497+0000", 2024-09-12T16:18:46.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.55494560500000001 2024-09-12T16:18:46.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:46.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319688+0000", 2024-09-12T16:18:46.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019105599999999999 2024-09-12T16:18:46.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:18:46.608 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.319842+0000", 2024-09-12T16:18:46.608 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015377699999999999 2024-09-12T16:18:46.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.608 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:18:46.608 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320473+0000", 2024-09-12T16:18:46.608 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00063117100000000003 2024-09-12T16:18:46.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.608 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:46.608 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320825+0000", 2024-09-12T16:18:46.608 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00035202500000000001 2024-09-12T16:18:46.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:46.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320867+0000", 2024-09-12T16:18:46.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2005000000000002e-05 2024-09-12T16:18:46.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:46.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:15:42.320893+0000", 2024-09-12T16:18:46.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5714000000000001e-05 2024-09-12T16:18:46.609 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.609 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:46.609 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.609 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14034 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5035008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:46.610 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:18:46.610 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 147.07972722900001, 2024-09-12T16:18:46.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053404082999999998, 2024-09-12T16:18:46.610 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:46.610 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:46.610 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:46.610 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:46.610 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:46.610 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:46.610 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14034 2024-09-12T16:18:46.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.610 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:46.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.610 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:46.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:18:46.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.611 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:46.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521496+0000", 2024-09-12T16:18:46.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.611 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:46.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521740+0000", 2024-09-12T16:18:46.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000243976 2024-09-12T16:18:46.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:46.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521745+0000", 2024-09-12T16:18:46.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1280000000000001e-06 2024-09-12T16:18:46.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:46.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521757+0000", 2024-09-12T16:18:46.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2751e-05 2024-09-12T16:18:46.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.613 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521771+0000", 2024-09-12T16:18:46.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3328e-05 2024-09-12T16:18:46.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.613 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.613 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:46.613 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574710+0000", 2024-09-12T16:18:46.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052939358999999998 2024-09-12T16:18:46.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.613 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.613 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:46.613 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574799+0000", 2024-09-12T16:18:46.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8893000000000004e-05 2024-09-12T16:18:46.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.613 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.614 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:46.614 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.574901+0000", 2024-09-12T16:18:46.614 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101648 2024-09-12T16:18:46.614 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.614 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:46.614 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.614 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14036 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5043200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:46.614 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:18:46.614 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 147.07926803500001, 2024-09-12T16:18:46.614 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053426247000000003, 2024-09-12T16:18:46.614 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:46.614 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:46.614 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:46.615 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:46.615 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:46.615 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:46.615 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14036 2024-09-12T16:18:46.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.615 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:46.615 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.615 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:46.615 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:18:46.615 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.615 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.615 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:46.615 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.521956+0000", 2024-09-12T16:18:46.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.616 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:46.616 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522208+0000", 2024-09-12T16:18:46.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025195300000000002 2024-09-12T16:18:46.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.616 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:46.616 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522211+0000", 2024-09-12T16:18:46.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2160000000000002e-06 2024-09-12T16:18:46.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.617 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:46.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522223+0000", 2024-09-12T16:18:46.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2044e-05 2024-09-12T16:18:46.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.617 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522229+0000", 2024-09-12T16:18:46.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8850000000000004e-06 2024-09-12T16:18:46.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.617 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:46.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575192+0000", 2024-09-12T16:18:46.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052963573 2024-09-12T16:18:46.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.618 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:46.618 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575282+0000", 2024-09-12T16:18:46.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9666000000000005e-05 2024-09-12T16:18:46.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.618 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:46.618 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575382+0000", 2024-09-12T16:18:46.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9909999999999997e-05 2024-09-12T16:18:46.618 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.618 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:46.618 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.618 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14039 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5055488~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:46.619 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:18:46.619 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 147.07858825100001, 2024-09-12T16:18:46.619 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053466207000000002, 2024-09-12T16:18:46.619 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:46.619 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:46.619 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:46.619 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:46.619 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:46.619 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:46.619 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14039 2024-09-12T16:18:46.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.619 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:46.619 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:46.620 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:18:46.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:46.620 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522635+0000", 2024-09-12T16:18:46.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:46.620 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522899+0000", 2024-09-12T16:18:46.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026318199999999999 2024-09-12T16:18:46.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.621 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:46.621 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522903+0000", 2024-09-12T16:18:46.621 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.929e-06 2024-09-12T16:18:46.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.621 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:46.621 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522913+0000", 2024-09-12T16:18:46.621 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0162e-05 2024-09-12T16:18:46.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.621 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.621 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522921+0000", 2024-09-12T16:18:46.621 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.14e-06 2024-09-12T16:18:46.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.622 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.622 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:46.622 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.575922+0000", 2024-09-12T16:18:46.622 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053000712999999998 2024-09-12T16:18:46.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.622 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.622 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:46.622 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576006+0000", 2024-09-12T16:18:46.622 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4161999999999998e-05 2024-09-12T16:18:46.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.622 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.622 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:46.623 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576102+0000", 2024-09-12T16:18:46.623 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5919000000000001e-05 2024-09-12T16:18:46.623 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.623 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:46.623 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.623 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14040 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5059584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:46.623 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:18:46.623 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 147.07828335599999, 2024-09-12T16:18:46.623 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053413258999999998, 2024-09-12T16:18:46.623 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:46.623 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:46.623 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:46.624 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:46.624 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:46.624 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:46.624 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14040 2024-09-12T16:18:46.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.624 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:46.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.624 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:46.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:18:46.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.624 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:46.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.522940+0000", 2024-09-12T16:18:46.625 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.625 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.625 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.625 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:46.625 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523059+0000", 2024-09-12T16:18:46.625 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118466 2024-09-12T16:18:46.625 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.625 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.625 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:46.625 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523062+0000", 2024-09-12T16:18:46.625 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.971e-06 2024-09-12T16:18:46.625 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.625 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.625 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:46.626 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523069+0000", 2024-09-12T16:18:46.626 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8279999999999997e-06 2024-09-12T16:18:46.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.626 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.626 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.626 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523073+0000", 2024-09-12T16:18:46.626 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3019999999999996e-06 2024-09-12T16:18:46.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.626 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.626 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:46.626 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576155+0000", 2024-09-12T16:18:46.626 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053081962000000003 2024-09-12T16:18:46.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.626 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.626 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:46.627 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576249+0000", 2024-09-12T16:18:46.627 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3914999999999998e-05 2024-09-12T16:18:46.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.627 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.627 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:46.627 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576354+0000", 2024-09-12T16:18:46.627 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010481500000000001 2024-09-12T16:18:46.627 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.627 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:46.627 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.627 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.627 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14041 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5063680~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:46.627 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:18:46.627 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 147.07813305100001, 2024-09-12T16:18:46.628 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053519111000000001, 2024-09-12T16:18:46.628 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:46.628 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:46.628 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:46.628 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:46.628 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:46.628 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:46.628 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14041 2024-09-12T16:18:46.628 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.628 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:46.628 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.628 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:46.628 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:18:46.628 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:46.629 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523091+0000", 2024-09-12T16:18:46.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:46.629 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523309+0000", 2024-09-12T16:18:46.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000218712 2024-09-12T16:18:46.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:46.630 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523313+0000", 2024-09-12T16:18:46.630 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.151e-06 2024-09-12T16:18:46.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.630 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.630 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:46.630 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523320+0000", 2024-09-12T16:18:46.630 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9789999999999993e-06 2024-09-12T16:18:46.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.630 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.631 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.631 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523325+0000", 2024-09-12T16:18:46.631 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7500000000000003e-06 2024-09-12T16:18:46.631 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.631 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.631 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:46.631 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576402+0000", 2024-09-12T16:18:46.631 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053076811000000002 2024-09-12T16:18:46.631 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.631 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.631 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:46.631 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576491+0000", 2024-09-12T16:18:46.631 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8578999999999993e-05 2024-09-12T16:18:46.631 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.632 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.632 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:46.632 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576610+0000", 2024-09-12T16:18:46.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119129 2024-09-12T16:18:46.632 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.632 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:46.632 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.632 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.632 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.632 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14042 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5067776~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:46.632 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:18:46.632 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 147.07788961700001, 2024-09-12T16:18:46.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053510350999999998, 2024-09-12T16:18:46.632 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:46.633 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:46.633 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:46.633 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:46.633 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:46.633 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:46.633 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14042 2024-09-12T16:18:46.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.633 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:46.633 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.633 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:46.633 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:18:46.633 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.633 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.634 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:46.634 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523334+0000", 2024-09-12T16:18:46.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.634 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.634 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:46.634 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523591+0000", 2024-09-12T16:18:46.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025710300000000001 2024-09-12T16:18:46.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.634 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.634 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:46.634 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523594+0000", 2024-09-12T16:18:46.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2229999999999999e-06 2024-09-12T16:18:46.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.635 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.635 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:46.635 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523602+0000", 2024-09-12T16:18:46.635 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6930000000000007e-06 2024-09-12T16:18:46.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.635 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.635 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.635 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523607+0000", 2024-09-12T16:18:46.635 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4789999999999998e-06 2024-09-12T16:18:46.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.635 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.635 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:46.635 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576661+0000", 2024-09-12T16:18:46.635 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053053973999999997 2024-09-12T16:18:46.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.636 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.636 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:46.636 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576745+0000", 2024-09-12T16:18:46.636 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4660000000000006e-05 2024-09-12T16:18:46.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.636 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.636 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:46.636 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576844+0000", 2024-09-12T16:18:46.636 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9219e-05 2024-09-12T16:18:46.636 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.636 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:46.636 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.637 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.637 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14043 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5071872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:46.637 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:18:46.637 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 147.07760913800001, 2024-09-12T16:18:46.637 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053475295999999999, 2024-09-12T16:18:46.637 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:46.637 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:46.637 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:46.637 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:46.637 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:46.637 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:46.637 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14043 2024-09-12T16:18:46.637 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.638 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:46.638 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.638 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:46.638 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:18:46.638 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.638 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.638 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:46.638 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523615+0000", 2024-09-12T16:18:46.638 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.638 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.638 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:46.638 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523823+0000", 2024-09-12T16:18:46.638 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020818900000000001 2024-09-12T16:18:46.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.639 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.639 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:46.639 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523826+0000", 2024-09-12T16:18:46.639 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.405e-06 2024-09-12T16:18:46.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.639 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.639 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:46.639 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523834+0000", 2024-09-12T16:18:46.639 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5499999999999997e-06 2024-09-12T16:18:46.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.639 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.639 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.639 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523838+0000", 2024-09-12T16:18:46.639 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.408e-06 2024-09-12T16:18:46.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.640 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.640 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:46.640 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576904+0000", 2024-09-12T16:18:46.640 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053065687 2024-09-12T16:18:46.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.640 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.640 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:46.640 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.576991+0000", 2024-09-12T16:18:46.640 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7399999999999997e-05 2024-09-12T16:18:46.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.640 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.640 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:46.640 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577090+0000", 2024-09-12T16:18:46.640 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8657000000000001e-05 2024-09-12T16:18:46.641 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.641 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:46.641 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.641 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.641 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14044 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5075968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:46.641 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:18:46.641 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 147.07737760800001, 2024-09-12T16:18:46.641 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053442659000000003, 2024-09-12T16:18:46.641 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:46.641 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:46.641 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:46.641 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:46.641 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:46.642 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:46.642 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14044 2024-09-12T16:18:46.642 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.642 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:46.642 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.642 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:46.642 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:18:46.642 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.642 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.642 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.642 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:46.642 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523846+0000", 2024-09-12T16:18:46.642 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.642 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.642 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.643 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:46.643 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523985+0000", 2024-09-12T16:18:46.643 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000138522 2024-09-12T16:18:46.643 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.643 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.643 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:46.643 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523988+0000", 2024-09-12T16:18:46.643 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.788e-06 2024-09-12T16:18:46.643 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.643 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.643 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:46.643 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.523998+0000", 2024-09-12T16:18:46.644 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8470000000000008e-06 2024-09-12T16:18:46.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.644 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.644 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.644 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524010+0000", 2024-09-12T16:18:46.644 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1348999999999999e-05 2024-09-12T16:18:46.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.644 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.644 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:46.644 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577137+0000", 2024-09-12T16:18:46.644 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053127055999999999 2024-09-12T16:18:46.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.644 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.645 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:46.645 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577210+0000", 2024-09-12T16:18:46.645 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3392000000000005e-05 2024-09-12T16:18:46.645 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.645 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.645 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:46.645 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577289+0000", 2024-09-12T16:18:46.645 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8704999999999999e-05 2024-09-12T16:18:46.645 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.645 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:46.645 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.645 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.645 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.646 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14045 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5080064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:46.646 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:18:46.646 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 147.07719878699999, 2024-09-12T16:18:46.646 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053497514000000003, 2024-09-12T16:18:46.646 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:46.646 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:46.646 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:46.646 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:46.646 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:46.646 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:46.646 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14045 2024-09-12T16:18:46.646 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.646 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:46.647 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.647 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:46.647 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:18:46.647 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.647 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.647 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:46.647 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524025+0000", 2024-09-12T16:18:46.647 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.647 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.647 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:46.647 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524311+0000", 2024-09-12T16:18:46.647 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028626299999999998 2024-09-12T16:18:46.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.648 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.648 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:46.648 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524315+0000", 2024-09-12T16:18:46.648 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0969999999999999e-06 2024-09-12T16:18:46.648 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.648 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.648 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:46.648 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524325+0000", 2024-09-12T16:18:46.648 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6330000000000008e-06 2024-09-12T16:18:46.648 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.648 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.648 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.648 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524332+0000", 2024-09-12T16:18:46.648 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8700000000000003e-06 2024-09-12T16:18:46.649 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.649 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.649 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:46.649 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577334+0000", 2024-09-12T16:18:46.649 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053001834999999997 2024-09-12T16:18:46.649 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.649 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.649 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:46.649 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577420+0000", 2024-09-12T16:18:46.649 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6145999999999998e-05 2024-09-12T16:18:46.649 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.649 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.649 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:46.650 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577522+0000", 2024-09-12T16:18:46.650 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010267 2024-09-12T16:18:46.650 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.650 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:46.650 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.650 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.650 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14047 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5088256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:46.650 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:18:46.650 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 147.07671306099999, 2024-09-12T16:18:46.650 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053433340000000003, 2024-09-12T16:18:46.650 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:46.650 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:46.651 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:46.651 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:46.651 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:46.651 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:46.651 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14047 2024-09-12T16:18:46.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.651 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:46.651 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.651 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:46.651 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:18:46.651 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.651 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.651 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:46.652 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524511+0000", 2024-09-12T16:18:46.652 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.652 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.652 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:46.652 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524727+0000", 2024-09-12T16:18:46.652 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000216126 2024-09-12T16:18:46.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.652 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.652 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:46.652 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524732+0000", 2024-09-12T16:18:46.652 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1569999999999999e-06 2024-09-12T16:18:46.653 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.653 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.653 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:46.653 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524742+0000", 2024-09-12T16:18:46.653 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0186999999999999e-05 2024-09-12T16:18:46.653 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.653 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.653 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.653 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524750+0000", 2024-09-12T16:18:46.653 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4279999999999999e-06 2024-09-12T16:18:46.653 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.653 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.653 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:46.653 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577743+0000", 2024-09-12T16:18:46.654 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052993077 2024-09-12T16:18:46.654 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.654 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.654 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:46.654 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577841+0000", 2024-09-12T16:18:46.654 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8369000000000006e-05 2024-09-12T16:18:46.654 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.654 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.654 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:46.654 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577944+0000", 2024-09-12T16:18:46.654 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102996 2024-09-12T16:18:46.654 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.654 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:46.654 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.655 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.655 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.655 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14048 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5092352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:46.655 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:18:46.655 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 147.07646146799999, 2024-09-12T16:18:46.655 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053397515, 2024-09-12T16:18:46.655 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:46.655 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:46.655 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:46.655 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:46.655 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:46.655 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:46.655 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14048 2024-09-12T16:18:46.655 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.656 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:46.656 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.656 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:46.656 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:18:46.656 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.656 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.656 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:46.656 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524762+0000", 2024-09-12T16:18:46.656 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.656 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.656 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:46.657 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524957+0000", 2024-09-12T16:18:46.657 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019516999999999999 2024-09-12T16:18:46.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.657 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.657 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:46.657 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524962+0000", 2024-09-12T16:18:46.657 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7709999999999997e-06 2024-09-12T16:18:46.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.657 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.657 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:46.657 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524973+0000", 2024-09-12T16:18:46.657 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1031e-05 2024-09-12T16:18:46.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.657 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.658 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.658 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524980+0000", 2024-09-12T16:18:46.658 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6100000000000002e-06 2024-09-12T16:18:46.658 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.658 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.658 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:46.658 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.577977+0000", 2024-09-12T16:18:46.658 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.052997481999999999 2024-09-12T16:18:46.658 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.658 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.658 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:46.658 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578062+0000", 2024-09-12T16:18:46.658 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4851000000000005e-05 2024-09-12T16:18:46.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.659 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.659 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:46.659 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578160+0000", 2024-09-12T16:18:46.659 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7600000000000001e-05 2024-09-12T16:18:46.659 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.659 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:46.659 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.659 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.659 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14049 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5096448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:46.659 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:18:46.660 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 147.07623283999999, 2024-09-12T16:18:46.660 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053439792, 2024-09-12T16:18:46.660 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:46.660 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:46.660 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:46.660 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:46.660 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:46.660 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:46.660 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14049 2024-09-12T16:18:46.660 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.660 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:46.660 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.660 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:46.661 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:18:46.661 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.661 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.661 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:46.661 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.524991+0000", 2024-09-12T16:18:46.661 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.661 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.662 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:46.662 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525170+0000", 2024-09-12T16:18:46.662 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017958500000000001 2024-09-12T16:18:46.662 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.662 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.662 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:46.662 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525174+0000", 2024-09-12T16:18:46.662 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0239999999999999e-06 2024-09-12T16:18:46.662 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.662 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.662 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:46.662 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525184+0000", 2024-09-12T16:18:46.662 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5950000000000005e-06 2024-09-12T16:18:46.662 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.663 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.663 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.663 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.525191+0000", 2024-09-12T16:18:46.663 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8329999999999996e-06 2024-09-12T16:18:46.663 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.663 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.663 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:46.663 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578240+0000", 2024-09-12T16:18:46.663 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053049236 2024-09-12T16:18:46.663 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.663 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.663 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:46.663 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578333+0000", 2024-09-12T16:18:46.663 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2806999999999994e-05 2024-09-12T16:18:46.664 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.664 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.664 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:46.664 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.578431+0000", 2024-09-12T16:18:46.664 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7712000000000002e-05 2024-09-12T16:18:46.664 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.664 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:46.664 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.664 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.664 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.664 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4615.0:14055 3.a 3:537ef52f:::rbd_data.1155627435cb.0000000000000001:9 [read 5121024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T16:18:46.664 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:18:46.664 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 147.07496214899999, 2024-09-12T16:18:46.665 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053399038000000003, 2024-09-12T16:18:46.665 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:46.665 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:46.665 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:46.665 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:46.665 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4615", 2024-09-12T16:18:46.665 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2674760522", 2024-09-12T16:18:46.665 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 14055 2024-09-12T16:18:46.665 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.665 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:46.665 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.665 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:46.665 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:18:46.665 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.666 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.666 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.666 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:46.666 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526262+0000", 2024-09-12T16:18:46.666 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.666 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.666 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.666 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:46.666 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526403+0000", 2024-09-12T16:18:46.666 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141571 2024-09-12T16:18:46.666 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.666 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.666 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:46.666 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526406+0000", 2024-09-12T16:18:46.667 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2660000000000002e-06 2024-09-12T16:18:46.667 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.667 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.667 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:46.667 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526420+0000", 2024-09-12T16:18:46.667 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3949e-05 2024-09-12T16:18:46.667 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.667 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.667 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.667 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.526428+0000", 2024-09-12T16:18:46.667 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4250000000000001e-06 2024-09-12T16:18:46.667 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.667 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.667 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:46.668 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579476+0000", 2024-09-12T16:18:46.668 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053048349000000002 2024-09-12T16:18:46.668 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.668 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.668 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:46.668 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579563+0000", 2024-09-12T16:18:46.668 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6502999999999995e-05 2024-09-12T16:18:46.668 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.668 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.668 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:46.668 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:19.579661+0000", 2024-09-12T16:18:46.668 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7974999999999996e-05 2024-09-12T16:18:46.668 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.668 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:46.669 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.669 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.669 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.669 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4806.0:3139 3.1e 3:78d5a095:::rbd_data.11552a37e55b.0000000000000000:head [read 69632~61440] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:18:46.669 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:18:46.669 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 136.29996789899999, 2024-09-12T16:18:46.669 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057851734000000002, 2024-09-12T16:18:46.669 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:46.669 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:46.669 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:46.669 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:46.669 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4806", 2024-09-12T16:18:46.669 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/3959815836", 2024-09-12T16:18:46.670 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 3139 2024-09-12T16:18:46.670 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.670 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:46.670 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.670 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:46.670 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:18:46.670 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.670 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.670 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.670 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:46.670 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:18:46.670 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.670 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.670 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.671 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:46.671 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301256+0000", 2024-09-12T16:18:46.671 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4799999999999999e-07 2024-09-12T16:18:46.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.671 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.671 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:46.671 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301258+0000", 2024-09-12T16:18:46.671 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.844e-06 2024-09-12T16:18:46.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.671 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.671 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:46.671 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301267+0000", 2024-09-12T16:18:46.671 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2960000000000004e-06 2024-09-12T16:18:46.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.672 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.672 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.672 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301276+0000", 2024-09-12T16:18:46.672 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0650000000000005e-06 2024-09-12T16:18:46.672 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.672 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.672 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:46.672 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301871+0000", 2024-09-12T16:18:46.672 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00059423600000000005 2024-09-12T16:18:46.672 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.672 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.672 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:46.672 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301920+0000", 2024-09-12T16:18:46.673 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9067000000000003e-05 2024-09-12T16:18:46.673 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.673 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.673 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:46.673 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359108+0000", 2024-09-12T16:18:46.673 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057187877999999998 2024-09-12T16:18:46.673 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.673 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:46.673 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.673 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.673 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.673 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:6428 3.14 3:28a44e54:::rbd_header.11552a37e55b:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-12T16:18:46.673 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:18:46.673 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 136.299639305, 2024-09-12T16:18:46.674 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057504023000000001, 2024-09-12T16:18:46.674 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:46.674 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:46.674 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:46.674 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:46.674 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:18:46.674 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:18:46.674 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 6428 2024-09-12T16:18:46.674 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.674 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:46.674 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.674 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:46.674 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:18:46.675 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.675 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.675 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.675 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:46.675 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301584+0000", 2024-09-12T16:18:46.675 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.675 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.675 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.675 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:46.675 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301585+0000", 2024-09-12T16:18:46.675 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6300000000000005e-07 2024-09-12T16:18:46.675 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.675 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.675 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:46.676 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301588+0000", 2024-09-12T16:18:46.676 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4149999999999999e-06 2024-09-12T16:18:46.676 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.676 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.676 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:46.676 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301597+0000", 2024-09-12T16:18:46.676 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5450000000000003e-06 2024-09-12T16:18:46.676 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.676 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.676 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.676 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301617+0000", 2024-09-12T16:18:46.676 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9837e-05 2024-09-12T16:18:46.677 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.677 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.677 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:46.677 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301779+0000", 2024-09-12T16:18:46.677 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016186799999999999 2024-09-12T16:18:46.677 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.677 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.677 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:46.677 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.301855+0000", 2024-09-12T16:18:46.677 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5899e-05 2024-09-12T16:18:46.677 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.677 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.677 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:46.678 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:30.359088+0000", 2024-09-12T16:18:46.678 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.057233895999999999 2024-09-12T16:18:46.678 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.678 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:46.678 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.678 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.678 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.678 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5223.0:1814 3.f 3:f7b1b1c5:::rbd_object_map.1155a1fd27d2:head [read 0~136] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-12T16:18:46.678 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:18:46.678 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 100.363973241, 2024-09-12T16:18:46.678 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.006378226, 2024-09-12T16:18:46.678 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:46.678 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:46.678 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:46.679 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:46.679 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5223", 2024-09-12T16:18:46.679 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/4066330994", 2024-09-12T16:18:46.679 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1814 2024-09-12T16:18:46.679 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.679 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:46.679 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.679 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:46.679 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:18:46.679 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.679 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.679 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.679 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:46.680 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237250+0000", 2024-09-12T16:18:46.680 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.680 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.680 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.680 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:46.680 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237252+0000", 2024-09-12T16:18:46.680 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.344e-06 2024-09-12T16:18:46.680 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.680 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.680 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:46.680 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237258+0000", 2024-09-12T16:18:46.680 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1070000000000001e-06 2024-09-12T16:18:46.680 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.681 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.681 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:46.681 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237270+0000", 2024-09-12T16:18:46.681 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1758e-05 2024-09-12T16:18:46.681 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.681 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.681 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.681 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237278+0000", 2024-09-12T16:18:46.681 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3219999999999993e-06 2024-09-12T16:18:46.681 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.681 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.681 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:46.681 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237334+0000", 2024-09-12T16:18:46.681 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6356e-05 2024-09-12T16:18:46.682 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.682 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.682 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:46.682 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:06.237345+0000", 2024-09-12T16:18:46.682 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0433e-05 2024-09-12T16:18:46.682 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.682 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.682 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:46.682 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243426+0000", 2024-09-12T16:18:46.682 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.00608133 2024-09-12T16:18:46.682 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.682 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.682 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:46.682 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243534+0000", 2024-09-12T16:18:46.683 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010784 2024-09-12T16:18:46.683 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.683 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.683 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:46.683 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:07.243629+0000", 2024-09-12T16:18:46.683 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4735999999999996e-05 2024-09-12T16:18:46.683 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.683 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:46.683 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.683 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.683 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.683 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5328.0:2542 3.16 3:6928f3a1:::rbd_object_map.11551722dd77:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:18:46.683 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:18:46.683 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 94.545627811000003, 2024-09-12T16:18:46.684 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.054219934999999997, 2024-09-12T16:18:46.684 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:46.684 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:46.684 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:46.684 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:46.684 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5328", 2024-09-12T16:18:46.684 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:18:46.684 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2542 2024-09-12T16:18:46.684 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.684 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:46.684 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.684 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:46.684 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:18:46.684 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.685 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.685 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.685 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:46.685 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055596+0000", 2024-09-12T16:18:46.685 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.685 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.685 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.685 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:46.685 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055597+0000", 2024-09-12T16:18:46.685 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4300000000000001e-07 2024-09-12T16:18:46.685 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.685 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.685 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:46.686 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055602+0000", 2024-09-12T16:18:46.686 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4269999999999999e-06 2024-09-12T16:18:46.686 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.686 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.686 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:46.686 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055613+0000", 2024-09-12T16:18:46.686 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0815000000000001e-05 2024-09-12T16:18:46.686 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.686 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.687 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.687 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.055621+0000", 2024-09-12T16:18:46.687 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4189999999999996e-06 2024-09-12T16:18:46.687 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.687 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.687 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:46.687 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102196+0000", 2024-09-12T16:18:46.687 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.046575616 2024-09-12T16:18:46.687 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.688 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.688 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:46.688 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102258+0000", 2024-09-12T16:18:46.688 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1872000000000007e-05 2024-09-12T16:18:46.688 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.688 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.688 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T16:18:46.688 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.102601+0000", 2024-09-12T16:18:46.688 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034285700000000001 2024-09-12T16:18:46.688 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.688 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.688 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:46.688 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.104431+0000", 2024-09-12T16:18:46.688 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001830524 2024-09-12T16:18:46.689 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.689 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.689 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:18:46.689 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109733+0000", 2024-09-12T16:18:46.689 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0053020089999999999 2024-09-12T16:18:46.689 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.689 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.689 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:46.689 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109777+0000", 2024-09-12T16:18:46.689 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3754000000000002e-05 2024-09-12T16:18:46.689 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.689 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.689 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:46.690 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109816+0000", 2024-09-12T16:18:46.690 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8699000000000003e-05 2024-09-12T16:18:46.690 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.690 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:46.690 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.690 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.690 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.690 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5328.0:2543 3.16 3:6928f3a1:::rbd_object_map.11551722dd77:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T16:18:46.690 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:18:46.690 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 94.545033832000001, 2024-09-12T16:18:46.690 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.053695720000000002, 2024-09-12T16:18:46.690 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:46.690 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:46.690 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:46.691 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:46.691 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5328", 2024-09-12T16:18:46.691 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/1862890784", 2024-09-12T16:18:46.691 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2543 2024-09-12T16:18:46.691 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.691 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:46.691 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.691 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:46.691 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:18:46.691 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.691 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.691 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.691 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:46.692 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056190+0000", 2024-09-12T16:18:46.692 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.692 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.692 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.692 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:46.692 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056191+0000", 2024-09-12T16:18:46.692 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.54e-07 2024-09-12T16:18:46.692 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.692 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.692 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:46.692 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056195+0000", 2024-09-12T16:18:46.692 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5460000000000002e-06 2024-09-12T16:18:46.692 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.693 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.693 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:46.693 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056205+0000", 2024-09-12T16:18:46.693 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7350000000000008e-06 2024-09-12T16:18:46.693 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.693 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.693 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.693 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.056214+0000", 2024-09-12T16:18:46.693 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8089999999999999e-06 2024-09-12T16:18:46.693 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.693 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.693 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:46.693 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103317+0000", 2024-09-12T16:18:46.694 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.047102889000000002 2024-09-12T16:18:46.694 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.694 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.694 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:46.694 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103410+0000", 2024-09-12T16:18:46.694 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3689000000000004e-05 2024-09-12T16:18:46.694 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.694 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.694 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T16:18:46.694 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.103754+0000", 2024-09-12T16:18:46.694 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034344699999999998 2024-09-12T16:18:46.694 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.694 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.695 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:46.695 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.106487+0000", 2024-09-12T16:18:46.695 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0027330100000000001 2024-09-12T16:18:46.695 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.695 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.695 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:18:46.695 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109827+0000", 2024-09-12T16:18:46.695 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033406640000000001 2024-09-12T16:18:46.695 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.695 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.695 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:46.695 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109854+0000", 2024-09-12T16:18:46.695 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6866999999999999e-05 2024-09-12T16:18:46.695 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.695 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.696 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:46.696 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:12.109886+0000", 2024-09-12T16:18:46.696 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1309999999999997e-05 2024-09-12T16:18:46.696 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.696 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:46.696 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.696 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.696 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.696 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.5832.0:1710 3.f 3:f0d97d21:::rbd_data.1155d3b3a2ae.0000000000000012:head [truncate 1376256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-12T16:18:46.696 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:18:46.696 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 59.217235746999997, 2024-09-12T16:18:46.696 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6441524489999999, 2024-09-12T16:18:46.697 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:46.697 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:46.697 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:46.697 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:46.697 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.5832", 2024-09-12T16:18:46.697 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/201125203", 2024-09-12T16:18:46.697 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1710 2024-09-12T16:18:46.697 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.697 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:46.697 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.697 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:46.697 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:18:46.697 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.697 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.698 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.698 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:46.698 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:18:46.698 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:46.698 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.698 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.698 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:46.698 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383988+0000", 2024-09-12T16:18:46.698 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.08e-07 2024-09-12T16:18:46.698 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.698 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.698 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:46.698 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383990+0000", 2024-09-12T16:18:46.699 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.979e-06 2024-09-12T16:18:46.699 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.699 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.699 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:46.699 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.383999+0000", 2024-09-12T16:18:46.699 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3240000000000003e-06 2024-09-12T16:18:46.699 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.699 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.699 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:46.699 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.384002+0000", 2024-09-12T16:18:46.699 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5489999999999998e-06 2024-09-12T16:18:46.699 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.699 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.699 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:46.699 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.384037+0000", 2024-09-12T16:18:46.700 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4931000000000001e-05 2024-09-12T16:18:46.700 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.700 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.700 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:46.700 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:47.384043+0000", 2024-09-12T16:18:46.700 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3920000000000002e-06 2024-09-12T16:18:46.700 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.700 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.700 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:46.700 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:48.007976+0000", 2024-09-12T16:18:46.700 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.62393385300000004 2024-09-12T16:18:46.700 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.700 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.701 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:46.701 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:48.007992+0000", 2024-09-12T16:18:46.701 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5668e-05 2024-09-12T16:18:46.701 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.701 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.701 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:46.701 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024187+0000", 2024-09-12T16:18:46.701 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0161951629999999 2024-09-12T16:18:46.701 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.701 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.701 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:46.701 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024362+0000", 2024-09-12T16:18:46.701 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017500600000000001 2024-09-12T16:18:46.701 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.702 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.702 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T16:18:46.702 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024453+0000", 2024-09-12T16:18:46.702 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1055000000000001e-05 2024-09-12T16:18:46.702 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.702 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.702 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T16:18:46.702 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.024963+0000", 2024-09-12T16:18:46.702 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000510087 2024-09-12T16:18:46.702 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.702 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.702 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:46.702 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.027974+0000", 2024-09-12T16:18:46.702 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030107070000000001 2024-09-12T16:18:46.703 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.703 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.703 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:46.703 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.028022+0000", 2024-09-12T16:18:46.703 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7636000000000003e-05 2024-09-12T16:18:46.703 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:46.703 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:46.703 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:46.703 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:49.028140+0000", 2024-09-12T16:18:46.703 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011869100000000001 2024-09-12T16:18:46.703 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.703 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:46.703 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.704 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:46.704 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:46.704 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:46.705 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:18:46.706 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:46.704+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:46.806 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:46.805+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:46.812 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:46.813 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:46.813 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:18:46.813 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:46.821 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:18:46.907 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:46.907+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:46.928 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:46.928 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:46.928 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:18:46.929 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:18:46.929 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:46.937 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:18:47.021 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:47.021+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:47.022 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2024-09-12T16:18:47.092 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:47.092 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:18:47.092 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:18:47.092 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:18:47.092 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.092 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5599 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4788224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:47.092 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:18:47.092 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 126.79397753800001, 2024-09-12T16:18:47.092 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061192059, 2024-09-12T16:18:47.093 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.093 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.093 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:47.093 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:47.093 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:47.093 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:47.093 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5599 2024-09-12T16:18:47.093 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.093 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.093 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.093 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.093 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:18:47.093 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.093 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.094 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.094 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.094 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296332+0000", 2024-09-12T16:18:47.094 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.094 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.094 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.094 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.094 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296333+0000", 2024-09-12T16:18:47.094 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6599999999999996e-07 2024-09-12T16:18:47.094 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.094 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.094 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.094 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296335+0000", 2024-09-12T16:18:47.094 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5900000000000002e-06 2024-09-12T16:18:47.094 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.094 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.095 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.095 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296344+0000", 2024-09-12T16:18:47.095 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9539999999999993e-06 2024-09-12T16:18:47.095 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.095 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.095 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.095 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296350+0000", 2024-09-12T16:18:47.095 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5589999999999996e-06 2024-09-12T16:18:47.095 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.095 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.095 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.095 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357307+0000", 2024-09-12T16:18:47.095 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.060957573000000001 2024-09-12T16:18:47.095 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.096 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.096 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:47.096 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357401+0000", 2024-09-12T16:18:47.096 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3512999999999997e-05 2024-09-12T16:18:47.096 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.096 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.096 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.096 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357524+0000", 2024-09-12T16:18:47.096 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000123304 2024-09-12T16:18:47.096 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.096 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.096 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.096 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.096 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.096 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5611 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4730880~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:47.097 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:18:47.097 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 126.793915094, 2024-09-12T16:18:47.097 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061359348000000001, 2024-09-12T16:18:47.097 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.097 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.097 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:47.097 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:47.097 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:47.097 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:47.097 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5611 2024-09-12T16:18:47.097 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.097 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.097 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.097 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.098 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:18:47.098 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.098 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.098 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.098 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.098 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296394+0000", 2024-09-12T16:18:47.098 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.098 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.098 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.098 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.098 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296395+0000", 2024-09-12T16:18:47.098 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4600000000000003e-07 2024-09-12T16:18:47.098 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.099 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.099 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.099 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296399+0000", 2024-09-12T16:18:47.099 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9430000000000002e-06 2024-09-12T16:18:47.099 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.099 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.099 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.099 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296411+0000", 2024-09-12T16:18:47.099 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1755e-05 2024-09-12T16:18:47.099 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.099 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.099 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.099 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296417+0000", 2024-09-12T16:18:47.099 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3790000000000003e-06 2024-09-12T16:18:47.099 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.100 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.100 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.100 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357572+0000", 2024-09-12T16:18:47.100 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061154871 2024-09-12T16:18:47.100 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.100 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.100 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:47.100 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357663+0000", 2024-09-12T16:18:47.100 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0389999999999993e-05 2024-09-12T16:18:47.100 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.100 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.100 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.100 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357754+0000", 2024-09-12T16:18:47.100 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1063999999999994e-05 2024-09-12T16:18:47.101 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.101 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.101 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.101 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.101 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.101 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5613 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4775936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:47.101 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:18:47.101 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 126.793873914, 2024-09-12T16:18:47.101 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061491777999999997, 2024-09-12T16:18:47.101 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.101 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.101 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:47.101 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:47.102 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:47.102 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:47.102 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5613 2024-09-12T16:18:47.102 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.102 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.102 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.102 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.102 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:18:47.102 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.102 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.102 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.102 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.102 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:18:47.102 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.103 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.103 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.103 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.103 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296436+0000", 2024-09-12T16:18:47.103 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8899999999999999e-07 2024-09-12T16:18:47.103 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.103 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.103 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.103 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296439+0000", 2024-09-12T16:18:47.103 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8439999999999998e-06 2024-09-12T16:18:47.103 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.103 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.103 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.103 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296452+0000", 2024-09-12T16:18:47.103 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2639e-05 2024-09-12T16:18:47.104 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.104 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.104 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.104 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296457+0000", 2024-09-12T16:18:47.104 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5720000000000002e-06 2024-09-12T16:18:47.104 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.104 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.104 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.104 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357773+0000", 2024-09-12T16:18:47.104 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061315500000000002 2024-09-12T16:18:47.104 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.104 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.104 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:47.105 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357814+0000", 2024-09-12T16:18:47.105 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1448e-05 2024-09-12T16:18:47.105 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.105 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.105 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.105 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357927+0000", 2024-09-12T16:18:47.105 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000113186 2024-09-12T16:18:47.105 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.105 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.105 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.105 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.105 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.105 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5616 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4784128~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:47.105 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:18:47.105 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 126.79383885199999, 2024-09-12T16:18:47.106 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061725002000000001, 2024-09-12T16:18:47.106 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.106 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.106 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:47.106 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:47.106 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:47.106 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:47.106 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5616 2024-09-12T16:18:47.106 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.106 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.106 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.106 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.106 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:18:47.106 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.107 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.107 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.107 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.107 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:18:47.107 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.107 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.107 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.107 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.107 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296471+0000", 2024-09-12T16:18:47.107 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5900000000000002e-07 2024-09-12T16:18:47.107 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.107 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.107 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.107 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296473+0000", 2024-09-12T16:18:47.107 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3130000000000001e-06 2024-09-12T16:18:47.108 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.108 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.108 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.108 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296481+0000", 2024-09-12T16:18:47.108 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1389999999999998e-06 2024-09-12T16:18:47.108 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.108 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.108 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.108 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296486+0000", 2024-09-12T16:18:47.108 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3310000000000003e-06 2024-09-12T16:18:47.108 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.108 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.108 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.108 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.357981+0000", 2024-09-12T16:18:47.109 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061494866000000002 2024-09-12T16:18:47.109 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.109 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.109 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:47.109 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358082+0000", 2024-09-12T16:18:47.109 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101424 2024-09-12T16:18:47.109 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.109 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.109 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.109 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358196+0000", 2024-09-12T16:18:47.109 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011347 2024-09-12T16:18:47.109 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.109 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.110 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.110 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.110 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.110 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5626 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4739072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:47.110 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:18:47.110 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 126.79376089599999, 2024-09-12T16:18:47.110 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061802430999999998, 2024-09-12T16:18:47.110 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.110 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.110 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:47.110 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:47.110 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:47.110 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:47.110 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5626 2024-09-12T16:18:47.111 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.111 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.111 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.111 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.111 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:18:47.111 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.111 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.111 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.111 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.111 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296549+0000", 2024-09-12T16:18:47.111 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.111 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.111 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.111 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.112 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296550+0000", 2024-09-12T16:18:47.112 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.215e-06 2024-09-12T16:18:47.112 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.112 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.112 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.112 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296555+0000", 2024-09-12T16:18:47.112 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9590000000000003e-06 2024-09-12T16:18:47.112 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.112 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.112 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.112 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296568+0000", 2024-09-12T16:18:47.112 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3338e-05 2024-09-12T16:18:47.112 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.113 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.113 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.113 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296576+0000", 2024-09-12T16:18:47.113 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5510000000000002e-06 2024-09-12T16:18:47.113 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.113 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.113 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.113 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358241+0000", 2024-09-12T16:18:47.113 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.06166576 2024-09-12T16:18:47.113 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.113 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.113 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:47.113 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358288+0000", 2024-09-12T16:18:47.113 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6097000000000003e-05 2024-09-12T16:18:47.114 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.114 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.114 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.114 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358351+0000", 2024-09-12T16:18:47.114 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3510999999999996e-05 2024-09-12T16:18:47.114 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.114 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.114 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.114 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.114 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.114 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5628 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4792320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:47.114 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:18:47.114 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 126.793718396, 2024-09-12T16:18:47.114 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061961161000000001, 2024-09-12T16:18:47.115 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.115 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.115 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:47.115 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:47.115 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:47.115 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:47.115 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5628 2024-09-12T16:18:47.115 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.115 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.115 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.115 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.115 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:18:47.115 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.115 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.115 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.115 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.116 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296591+0000", 2024-09-12T16:18:47.116 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.116 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.116 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.116 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.116 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296592+0000", 2024-09-12T16:18:47.116 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2099999999999996e-07 2024-09-12T16:18:47.116 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.116 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.116 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.116 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296595+0000", 2024-09-12T16:18:47.116 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0429999999999999e-06 2024-09-12T16:18:47.116 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.116 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.116 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.117 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296603+0000", 2024-09-12T16:18:47.117 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9899999999999997e-06 2024-09-12T16:18:47.117 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.117 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.117 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.117 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.296609+0000", 2024-09-12T16:18:47.117 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7259999999999999e-06 2024-09-12T16:18:47.117 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.117 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.117 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.117 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358393+0000", 2024-09-12T16:18:47.117 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061784617 2024-09-12T16:18:47.117 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.117 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.117 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:47.118 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358460+0000", 2024-09-12T16:18:47.118 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7253000000000001e-05 2024-09-12T16:18:47.118 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.118 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.118 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.118 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358552+0000", 2024-09-12T16:18:47.118 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1811000000000006e-05 2024-09-12T16:18:47.118 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.118 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.118 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.118 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.118 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.118 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5638 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4734976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:47.119 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:18:47.119 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 126.793245845, 2024-09-12T16:18:47.119 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061654460000000001, 2024-09-12T16:18:47.119 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.119 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.119 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:47.119 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:47.119 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:47.119 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:47.119 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5638 2024-09-12T16:18:47.119 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.119 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.119 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.119 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.119 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:18:47.120 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.120 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.120 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.120 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.120 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:18:47.120 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.120 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.120 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.120 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.120 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297064+0000", 2024-09-12T16:18:47.120 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.23e-07 2024-09-12T16:18:47.120 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.120 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.120 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.120 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297068+0000", 2024-09-12T16:18:47.120 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0060000000000003e-06 2024-09-12T16:18:47.121 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.121 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.121 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.121 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297080+0000", 2024-09-12T16:18:47.121 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1234e-05 2024-09-12T16:18:47.121 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.121 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.121 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.121 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297095+0000", 2024-09-12T16:18:47.121 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5698000000000001e-05 2024-09-12T16:18:47.121 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.121 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.121 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.121 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358582+0000", 2024-09-12T16:18:47.122 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061486274 2024-09-12T16:18:47.122 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.122 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.122 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:47.122 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358637+0000", 2024-09-12T16:18:47.122 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5439999999999998e-05 2024-09-12T16:18:47.122 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.122 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.122 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.122 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358718+0000", 2024-09-12T16:18:47.122 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0984999999999998e-05 2024-09-12T16:18:47.122 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.122 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.122 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.123 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.123 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.123 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5640 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4780032~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:47.123 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:18:47.123 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 126.793164125, 2024-09-12T16:18:47.123 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061746620000000002, 2024-09-12T16:18:47.123 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.123 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.123 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:47.123 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:47.123 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:47.123 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:47.123 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5640 2024-09-12T16:18:47.123 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.123 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.123 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.124 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.124 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:18:47.124 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.124 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.124 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.124 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.124 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297145+0000", 2024-09-12T16:18:47.124 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.124 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.124 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.124 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.124 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297146+0000", 2024-09-12T16:18:47.124 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3600000000000003e-07 2024-09-12T16:18:47.124 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.125 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.125 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.125 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297150+0000", 2024-09-12T16:18:47.125 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8430000000000003e-06 2024-09-12T16:18:47.125 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.125 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.125 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.125 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297160+0000", 2024-09-12T16:18:47.125 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7229999999999999e-06 2024-09-12T16:18:47.125 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.125 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.125 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.125 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297167+0000", 2024-09-12T16:18:47.125 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0180000000000004e-06 2024-09-12T16:18:47.126 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.126 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.126 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.126 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358750+0000", 2024-09-12T16:18:47.126 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061583104 2024-09-12T16:18:47.126 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.126 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.126 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:47.126 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358804+0000", 2024-09-12T16:18:47.126 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4277000000000002e-05 2024-09-12T16:18:47.126 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.128 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.128 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.128 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358892+0000", 2024-09-12T16:18:47.128 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7918999999999996e-05 2024-09-12T16:18:47.128 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.128 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.128 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.128 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.128 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.128 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5642 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4788224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:47.129 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:18:47.129 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 126.793119781, 2024-09-12T16:18:47.129 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061860409999999998, 2024-09-12T16:18:47.129 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.129 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.129 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:47.129 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:47.129 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:47.129 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:47.129 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5642 2024-09-12T16:18:47.129 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.129 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.129 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.130 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.130 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:18:47.130 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.130 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.130 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.130 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.130 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:18:47.130 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.130 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.130 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.130 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.130 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297190+0000", 2024-09-12T16:18:47.130 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7999999999999995e-07 2024-09-12T16:18:47.130 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.131 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.131 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.131 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297193+0000", 2024-09-12T16:18:47.131 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8310000000000001e-06 2024-09-12T16:18:47.131 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.131 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.131 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.131 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297204+0000", 2024-09-12T16:18:47.131 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0832999999999999e-05 2024-09-12T16:18:47.131 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.131 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.131 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.131 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297210+0000", 2024-09-12T16:18:47.132 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1770000000000003e-06 2024-09-12T16:18:47.132 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.132 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.132 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.132 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358928+0000", 2024-09-12T16:18:47.132 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061717826000000003 2024-09-12T16:18:47.132 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.132 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.132 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:47.132 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.358977+0000", 2024-09-12T16:18:47.132 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9514000000000001e-05 2024-09-12T16:18:47.132 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.132 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.133 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.133 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359050+0000", 2024-09-12T16:18:47.133 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2649000000000002e-05 2024-09-12T16:18:47.133 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.133 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.133 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.133 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.133 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.133 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5646 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4743168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:47.133 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:18:47.133 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 126.79293984, 2024-09-12T16:18:47.133 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061822122, 2024-09-12T16:18:47.133 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.133 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.134 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:47.134 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:47.134 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:47.134 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:47.134 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5646 2024-09-12T16:18:47.134 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.134 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.134 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.134 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.134 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:18:47.134 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.134 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.134 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.134 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.135 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:18:47.135 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.135 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.135 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.135 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.135 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297370+0000", 2024-09-12T16:18:47.135 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3200000000000004e-07 2024-09-12T16:18:47.135 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.135 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.135 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.135 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297374+0000", 2024-09-12T16:18:47.135 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8240000000000001e-06 2024-09-12T16:18:47.135 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.136 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.136 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.136 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297384+0000", 2024-09-12T16:18:47.136 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5710000000000004e-06 2024-09-12T16:18:47.136 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.136 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.136 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.136 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297390+0000", 2024-09-12T16:18:47.136 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5130000000000002e-06 2024-09-12T16:18:47.136 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.136 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.136 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.136 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359080+0000", 2024-09-12T16:18:47.137 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061689569999999999 2024-09-12T16:18:47.137 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.137 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.137 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:47.137 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359134+0000", 2024-09-12T16:18:47.137 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3838999999999997e-05 2024-09-12T16:18:47.137 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.137 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.137 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.137 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359192+0000", 2024-09-12T16:18:47.137 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8072999999999998e-05 2024-09-12T16:18:47.137 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.137 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.137 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.138 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.138 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.138 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5647 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4751360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:47.138 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:18:47.138 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 126.792903155, 2024-09-12T16:18:47.138 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061927569000000002, 2024-09-12T16:18:47.138 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.138 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.138 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:47.138 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:47.138 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:47.138 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:47.138 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5647 2024-09-12T16:18:47.139 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.139 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.139 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.139 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.139 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:18:47.139 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.139 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.139 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.139 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.139 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297406+0000", 2024-09-12T16:18:47.139 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.139 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.139 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.140 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.140 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297407+0000", 2024-09-12T16:18:47.140 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.46e-07 2024-09-12T16:18:47.140 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.140 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.140 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.140 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297409+0000", 2024-09-12T16:18:47.140 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.469e-06 2024-09-12T16:18:47.140 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.140 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.140 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.140 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297415+0000", 2024-09-12T16:18:47.140 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9259999999999997e-06 2024-09-12T16:18:47.141 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.141 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.141 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.141 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297419+0000", 2024-09-12T16:18:47.141 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3840000000000001e-06 2024-09-12T16:18:47.141 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.141 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.141 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.141 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359224+0000", 2024-09-12T16:18:47.141 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061805367999999999 2024-09-12T16:18:47.141 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.141 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.141 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:47.141 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359275+0000", 2024-09-12T16:18:47.142 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1338000000000002e-05 2024-09-12T16:18:47.142 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.142 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.142 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.142 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359334+0000", 2024-09-12T16:18:47.142 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8638000000000003e-05 2024-09-12T16:18:47.142 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.142 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.142 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.142 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.142 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.142 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5649 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4796416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:47.142 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:18:47.142 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 126.792848296, 2024-09-12T16:18:47.143 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.062018578999999997, 2024-09-12T16:18:47.143 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.143 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.143 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:47.143 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:47.143 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:47.143 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:47.143 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5649 2024-09-12T16:18:47.143 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.143 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.143 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.143 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.143 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:18:47.143 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.144 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.144 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.144 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.144 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297461+0000", 2024-09-12T16:18:47.144 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.144 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.144 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.144 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.144 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297462+0000", 2024-09-12T16:18:47.144 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2399999999999998e-07 2024-09-12T16:18:47.144 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.144 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.144 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.144 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297465+0000", 2024-09-12T16:18:47.145 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.371e-06 2024-09-12T16:18:47.145 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.145 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.145 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.145 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297473+0000", 2024-09-12T16:18:47.145 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4699999999999996e-06 2024-09-12T16:18:47.145 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.145 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.145 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.145 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297478+0000", 2024-09-12T16:18:47.145 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2780000000000001e-06 2024-09-12T16:18:47.145 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.145 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.145 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.146 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359368+0000", 2024-09-12T16:18:47.146 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061889758000000003 2024-09-12T16:18:47.146 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.146 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.146 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:47.146 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359420+0000", 2024-09-12T16:18:47.146 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2574999999999997e-05 2024-09-12T16:18:47.146 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.146 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.146 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.146 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359480+0000", 2024-09-12T16:18:47.146 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9503000000000003e-05 2024-09-12T16:18:47.146 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.146 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.147 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.147 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.147 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.147 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5674 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4739072~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:47.147 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:18:47.147 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 126.792444528, 2024-09-12T16:18:47.147 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061762989999999997, 2024-09-12T16:18:47.147 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.147 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.147 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:47.147 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:47.147 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:47.147 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:47.148 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5674 2024-09-12T16:18:47.148 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.148 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.148 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.148 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.148 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:18:47.148 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.148 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.148 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.148 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.148 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297865+0000", 2024-09-12T16:18:47.148 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.148 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.148 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.149 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.149 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297866+0000", 2024-09-12T16:18:47.149 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1900000000000001e-07 2024-09-12T16:18:47.149 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.149 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.149 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.149 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297870+0000", 2024-09-12T16:18:47.149 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3560000000000003e-06 2024-09-12T16:18:47.149 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.149 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.149 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.149 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297888+0000", 2024-09-12T16:18:47.149 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8088999999999999e-05 2024-09-12T16:18:47.149 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.150 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.150 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.150 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.297904+0000", 2024-09-12T16:18:47.150 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5971e-05 2024-09-12T16:18:47.150 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.150 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.150 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.150 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359510+0000", 2024-09-12T16:18:47.150 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061605634999999999 2024-09-12T16:18:47.150 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.150 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.150 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:47.150 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359554+0000", 2024-09-12T16:18:47.151 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4024999999999999e-05 2024-09-12T16:18:47.151 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.151 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.151 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.151 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359628+0000", 2024-09-12T16:18:47.151 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4095000000000001e-05 2024-09-12T16:18:47.151 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.151 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.151 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.151 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.151 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.151 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5676 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4792320~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:47.151 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:18:47.152 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 126.79224344799999, 2024-09-12T16:18:47.152 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061720143999999998, 2024-09-12T16:18:47.152 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.152 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.152 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:47.152 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:47.152 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:47.152 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:47.152 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5676 2024-09-12T16:18:47.152 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.152 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.152 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.152 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.152 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:18:47.153 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.153 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.153 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.153 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.153 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298066+0000", 2024-09-12T16:18:47.153 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.153 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.153 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.153 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.153 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298067+0000", 2024-09-12T16:18:47.153 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8199999999999999e-07 2024-09-12T16:18:47.153 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.153 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.154 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.154 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298070+0000", 2024-09-12T16:18:47.154 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.743e-06 2024-09-12T16:18:47.154 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.154 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.154 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.154 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298080+0000", 2024-09-12T16:18:47.154 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4059999999999994e-06 2024-09-12T16:18:47.154 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.154 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.154 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.154 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298088+0000", 2024-09-12T16:18:47.154 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0779999999999996e-06 2024-09-12T16:18:47.154 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.155 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.155 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.155 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359659+0000", 2024-09-12T16:18:47.155 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061570688999999998 2024-09-12T16:18:47.155 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.155 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.155 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:47.155 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359713+0000", 2024-09-12T16:18:47.155 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3939e-05 2024-09-12T16:18:47.155 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.155 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.155 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.156 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359786+0000", 2024-09-12T16:18:47.156 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3607000000000002e-05 2024-09-12T16:18:47.156 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.156 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.156 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.156 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.156 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.156 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5684 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4747264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:47.156 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:18:47.156 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 126.791776156, 2024-09-12T16:18:47.156 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061394799, 2024-09-12T16:18:47.156 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.156 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.157 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:47.157 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:47.157 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:47.157 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:47.157 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5684 2024-09-12T16:18:47.157 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.157 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.157 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.157 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.157 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:18:47.157 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.157 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.157 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.158 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.158 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298533+0000", 2024-09-12T16:18:47.158 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.158 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.158 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.158 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.158 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298534+0000", 2024-09-12T16:18:47.158 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4399999999999999e-07 2024-09-12T16:18:47.158 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.158 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.158 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.158 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298539+0000", 2024-09-12T16:18:47.158 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5360000000000003e-06 2024-09-12T16:18:47.159 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.159 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.159 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.159 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298550+0000", 2024-09-12T16:18:47.159 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1499e-05 2024-09-12T16:18:47.159 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.159 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.159 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.159 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298558+0000", 2024-09-12T16:18:47.159 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3000000000000004e-06 2024-09-12T16:18:47.159 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.159 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.159 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.159 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359815+0000", 2024-09-12T16:18:47.160 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061257952999999997 2024-09-12T16:18:47.160 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.160 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.160 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:47.160 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359868+0000", 2024-09-12T16:18:47.160 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2317000000000001e-05 2024-09-12T16:18:47.160 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.160 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.160 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.160 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359928+0000", 2024-09-12T16:18:47.160 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0350000000000003e-05 2024-09-12T16:18:47.160 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.160 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.161 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.161 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.161 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.161 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5686 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4755456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:47.161 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:18:47.161 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 126.791608732, 2024-09-12T16:18:47.161 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061355082999999998, 2024-09-12T16:18:47.161 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.161 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.161 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:47.161 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:47.161 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:47.161 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:47.161 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5686 2024-09-12T16:18:47.162 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.162 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.162 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.162 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.162 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:18:47.162 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.162 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.162 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.162 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.162 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298701+0000", 2024-09-12T16:18:47.162 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.162 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.162 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.163 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.163 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298702+0000", 2024-09-12T16:18:47.163 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2399999999999997e-07 2024-09-12T16:18:47.163 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.163 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.163 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.163 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298706+0000", 2024-09-12T16:18:47.163 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5700000000000003e-06 2024-09-12T16:18:47.163 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.163 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.163 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.163 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298718+0000", 2024-09-12T16:18:47.163 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1457999999999999e-05 2024-09-12T16:18:47.163 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.164 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.164 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.164 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298732+0000", 2024-09-12T16:18:47.164 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.452e-05 2024-09-12T16:18:47.164 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.164 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.164 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.164 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.359956+0000", 2024-09-12T16:18:47.164 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061223626000000003 2024-09-12T16:18:47.164 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.164 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.164 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:47.164 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360000+0000", 2024-09-12T16:18:47.165 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3922999999999999e-05 2024-09-12T16:18:47.165 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.165 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.165 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.165 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360056+0000", 2024-09-12T16:18:47.165 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6162000000000002e-05 2024-09-12T16:18:47.165 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.165 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.165 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.165 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.165 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.165 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5688 3.1d 3:bb9d75ff:::rbd_data.115511a83a30.0000000000000002:e [read 4800512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:47.165 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:18:47.165 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 126.791385679, 2024-09-12T16:18:47.166 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061270514999999998, 2024-09-12T16:18:47.166 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.166 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.166 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:47.166 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:47.166 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:47.166 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:47.166 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5688 2024-09-12T16:18:47.166 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.166 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.166 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.166 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.166 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:18:47.166 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.167 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.167 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.167 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.167 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298924+0000", 2024-09-12T16:18:47.167 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.167 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.167 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.167 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.167 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298925+0000", 2024-09-12T16:18:47.167 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4e-07 2024-09-12T16:18:47.167 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.167 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.167 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.167 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298929+0000", 2024-09-12T16:18:47.168 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9890000000000003e-06 2024-09-12T16:18:47.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.168 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.168 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.168 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298936+0000", 2024-09-12T16:18:47.168 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.52e-06 2024-09-12T16:18:47.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.168 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.168 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.168 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.298941+0000", 2024-09-12T16:18:47.168 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4800000000000003e-06 2024-09-12T16:18:47.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.168 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.168 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.169 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360087+0000", 2024-09-12T16:18:47.169 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061146143 2024-09-12T16:18:47.169 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.169 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.169 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:47.169 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360137+0000", 2024-09-12T16:18:47.169 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0584000000000002e-05 2024-09-12T16:18:47.169 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.169 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.169 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.169 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360194+0000", 2024-09-12T16:18:47.169 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6858999999999999e-05 2024-09-12T16:18:47.169 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.169 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.169 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.170 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.170 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.170 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5693 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4751360~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:47.170 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:18:47.170 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 126.790964042, 2024-09-12T16:18:47.170 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061139444000000001, 2024-09-12T16:18:47.170 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.170 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.170 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:47.170 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:47.170 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:47.170 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:47.170 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5693 2024-09-12T16:18:47.171 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.171 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.171 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.171 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.171 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:18:47.171 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.171 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.171 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.171 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.171 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299345+0000", 2024-09-12T16:18:47.171 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.171 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.171 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.171 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.172 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299346+0000", 2024-09-12T16:18:47.172 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2300000000000001e-07 2024-09-12T16:18:47.172 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.172 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.172 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.172 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299349+0000", 2024-09-12T16:18:47.172 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5270000000000001e-06 2024-09-12T16:18:47.172 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.172 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.172 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.172 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299358+0000", 2024-09-12T16:18:47.172 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7030000000000001e-06 2024-09-12T16:18:47.172 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.172 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.172 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.173 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299364+0000", 2024-09-12T16:18:47.173 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7239999999999997e-06 2024-09-12T16:18:47.173 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.173 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.173 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.173 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360369+0000", 2024-09-12T16:18:47.173 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061004713000000002 2024-09-12T16:18:47.173 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.173 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.173 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:47.173 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360415+0000", 2024-09-12T16:18:47.173 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5926e-05 2024-09-12T16:18:47.173 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.174 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.174 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.174 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360485+0000", 2024-09-12T16:18:47.174 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0327999999999995e-05 2024-09-12T16:18:47.174 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.174 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.174 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.174 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.174 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.174 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4944.0:5694 3.1d 3:be51ec89:::rbd_data.115511a83a30.0000000000000000:e [read 4796416~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T16:18:47.174 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:18:47.174 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 126.790935013, 2024-09-12T16:18:47.174 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.061258034000000003, 2024-09-12T16:18:47.174 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.174 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.174 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:47.175 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:47.175 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4944", 2024-09-12T16:18:47.175 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/386821983", 2024-09-12T16:18:47.175 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5694 2024-09-12T16:18:47.175 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.175 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.175 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.175 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.175 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:18:47.175 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.175 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.175 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.175 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.175 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.299374+0000", 2024-09-12T16:18:47.175 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.176 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.176 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.176 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.176 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301884+0000", 2024-09-12T16:18:47.176 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025090379999999999 2024-09-12T16:18:47.176 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.176 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.176 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.176 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301889+0000", 2024-09-12T16:18:47.176 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5879999999999997e-06 2024-09-12T16:18:47.176 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.176 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.176 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.176 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301901+0000", 2024-09-12T16:18:47.176 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1466e-05 2024-09-12T16:18:47.177 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.177 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.177 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.177 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.301908+0000", 2024-09-12T16:18:47.177 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1999999999999997e-06 2024-09-12T16:18:47.177 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.177 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.177 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.177 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360513+0000", 2024-09-12T16:18:47.177 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.058605023999999999 2024-09-12T16:18:47.177 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.177 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.177 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:47.177 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360562+0000", 2024-09-12T16:18:47.178 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9546000000000003e-05 2024-09-12T16:18:47.178 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.178 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.178 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.178 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:16:40.360633+0000", 2024-09-12T16:18:47.178 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0172000000000005e-05 2024-09-12T16:18:47.178 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.178 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.178 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.178 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.178 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.178 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4437.0:28537 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_get_id in=13b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e136)", 2024-09-12T16:18:47.178 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:24.151599+0000", 2024-09-12T16:18:47.178 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 22.938710215, 2024-09-12T16:18:47.178 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.99758962900000003, 2024-09-12T16:18:47.179 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.179 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.179 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T16:18:47.179 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T16:18:47.179 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4437", 2024-09-12T16:18:47.179 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:18:47.179 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 28537 2024-09-12T16:18:47.179 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.179 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.179 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.179 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.179 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.151599+0000", 2024-09-12T16:18:47.179 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.179 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.180 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.180 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.180 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.151599+0000", 2024-09-12T16:18:47.180 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.180 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.180 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.180 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.180 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.151601+0000", 2024-09-12T16:18:47.180 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4130000000000001e-06 2024-09-12T16:18:47.180 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.180 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.180 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.180 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.151606+0000", 2024-09-12T16:18:47.180 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.502e-06 2024-09-12T16:18:47.181 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.181 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.181 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.181 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.151618+0000", 2024-09-12T16:18:47.181 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1430999999999999e-05 2024-09-12T16:18:47.181 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.181 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.181 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.181 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.151623+0000", 2024-09-12T16:18:47.181 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3109999999999996e-06 2024-09-12T16:18:47.181 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.181 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.181 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.182 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.151681+0000", 2024-09-12T16:18:47.182 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8068e-05 2024-09-12T16:18:47.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.182 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.182 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T16:18:47.182 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:24.151689+0000", 2024-09-12T16:18:47.182 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9000000000000006e-06 2024-09-12T16:18:47.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.182 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.182 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.182 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.148883+0000", 2024-09-12T16:18:47.182 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.99719448399999999 2024-09-12T16:18:47.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.182 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.182 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:47.183 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.149018+0000", 2024-09-12T16:18:47.183 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000134733 2024-09-12T16:18:47.183 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.183 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.183 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.183 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:25.149189+0000", 2024-09-12T16:18:47.183 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017078699999999999 2024-09-12T16:18:47.183 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.183 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.183 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.183 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.183 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.183 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:47.185 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:18:47.185 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:47.183+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:47.286 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:47.285+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:47.333 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:47.333 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:47.333 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T16:18:47.333 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:47.341 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:18:47.387 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:47.385+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:47.448 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:47.448 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T16:18:47.449 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T16:18:47.449 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T16:18:47.449 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:47.457 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:18:47.498 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:47.497+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:47.589 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:47.588+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:47.606 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T16:18:47.606 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T16:18:47.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T16:18:47.606 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T16:18:47.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.606 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "pg_update_log_missing(3.1d epoch 92/74 rep_tid 3087 entries 92'1280 (0'0) error 3:bc3c4c0b:::rbd_data.1155c757bf36.000000000000002c:head by client.5577.0:14343 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 90'1278)", 2024-09-12T16:18:47.606 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.408860+0000", 2024-09-12T16:18:47.607 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 77.196144677999996, 2024-09-12T16:18:47.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0056480419999999998, 2024-09-12T16:18:47.607 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.607 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.607 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "reached pg", 2024-09-12T16:18:47.607 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408860+0000", 2024-09-12T16:18:47.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408860+0000", 2024-09-12T16:18:47.608 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.608 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.608 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408861+0000", 2024-09-12T16:18:47.608 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6600000000000002e-07 2024-09-12T16:18:47.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.608 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.608 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408867+0000", 2024-09-12T16:18:47.608 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4150000000000004e-06 2024-09-12T16:18:47.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.608 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.608 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408881+0000", 2024-09-12T16:18:47.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4326e-05 2024-09-12T16:18:47.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.408895+0000", 2024-09-12T16:18:47.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3903000000000001e-05 2024-09-12T16:18:47.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410566+0000", 2024-09-12T16:18:47.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001670822 2024-09-12T16:18:47.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414508+0000", 2024-09-12T16:18:47.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039421100000000004 2024-09-12T16:18:47.610 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.610 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.610 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.610 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "pg_update_log_missing(3.5 epoch 92/74 rep_tid 1621 entries 92'521 (0'0) error 3:a759f741:::rbd_data.1155c757bf36.0000000000000036:head by client.5577.0:14364 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 92'518)", 2024-09-12T16:18:47.610 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:18:47.610 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 77.195196201000002, 2024-09-12T16:18:47.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047586740000000001, 2024-09-12T16:18:47.610 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.610 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.610 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "reached pg", 2024-09-12T16:18:47.610 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.611 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:18:47.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.611 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:18:47.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.611 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409809+0000", 2024-09-12T16:18:47.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.54e-07 2024-09-12T16:18:47.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.409817+0000", 2024-09-12T16:18:47.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.028e-06 2024-09-12T16:18:47.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410047+0000", 2024-09-12T16:18:47.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022964599999999999 2024-09-12T16:18:47.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410067+0000", 2024-09-12T16:18:47.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0438999999999999e-05 2024-09-12T16:18:47.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.613 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.613 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.613 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411223+0000", 2024-09-12T16:18:47.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011560229999999999 2024-09-12T16:18:47.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.613 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.613 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.613 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414567+0000", 2024-09-12T16:18:47.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033437839999999998 2024-09-12T16:18:47.613 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.613 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.613 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.614 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14391 3.5 e92/74 3:a5105766:::rbd_data.1155c757bf36.0000000000000044:head v 92'523, mlcod=92'518)", 2024-09-12T16:18:47.614 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.410084+0000", 2024-09-12T16:18:47.614 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 77.194920331000006, 2024-09-12T16:18:47.614 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0046720299999999998, 2024-09-12T16:18:47.614 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.614 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.614 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:47.614 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.614 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.614 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410084+0000", 2024-09-12T16:18:47.614 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.615 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.615 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.615 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410084+0000", 2024-09-12T16:18:47.615 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.615 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.615 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.615 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410085+0000", 2024-09-12T16:18:47.615 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1900000000000002e-07 2024-09-12T16:18:47.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.615 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.615 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.615 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410091+0000", 2024-09-12T16:18:47.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1e-06 2024-09-12T16:18:47.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.616 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.616 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410100+0000", 2024-09-12T16:18:47.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6889999999999993e-06 2024-09-12T16:18:47.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.616 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.616 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410105+0000", 2024-09-12T16:18:47.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3199999999999999e-06 2024-09-12T16:18:47.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.616 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411563+0000", 2024-09-12T16:18:47.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00145795 2024-09-12T16:18:47.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.617 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:47.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.411590+0000", 2024-09-12T16:18:47.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6570000000000001e-05 2024-09-12T16:18:47.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.617 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:47.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414571+0000", 2024-09-12T16:18:47.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029815710000000001 2024-09-12T16:18:47.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.618 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.618 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414756+0000", 2024-09-12T16:18:47.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018521100000000001 2024-09-12T16:18:47.618 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.618 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.618 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.618 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5577.0:14405 3.5 e92/74 3:a0797093:::rbd_data.1155c757bf36.000000000000004b:head v 92'525, mlcod=92'518)", 2024-09-12T16:18:47.618 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:30.410119+0000", 2024-09-12T16:18:47.618 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 77.194885391, 2024-09-12T16:18:47.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047304000000000001, 2024-09-12T16:18:47.618 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.619 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.619 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:47.619 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.619 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.619 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.619 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410119+0000", 2024-09-12T16:18:47.619 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.619 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.619 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.619 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410119+0000", 2024-09-12T16:18:47.619 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.619 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.619 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.620 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410120+0000", 2024-09-12T16:18:47.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9000000000000002e-07 2024-09-12T16:18:47.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.620 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410126+0000", 2024-09-12T16:18:47.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1460000000000001e-06 2024-09-12T16:18:47.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.620 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410134+0000", 2024-09-12T16:18:47.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8879999999999997e-06 2024-09-12T16:18:47.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.621 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.621 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.410140+0000", 2024-09-12T16:18:47.621 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0839999999999997e-06 2024-09-12T16:18:47.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.621 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.621 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412146+0000", 2024-09-12T16:18:47.621 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0020057569999999999 2024-09-12T16:18:47.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.621 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:47.621 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.412163+0000", 2024-09-12T16:18:47.622 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7742000000000001e-05 2024-09-12T16:18:47.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.622 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.622 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:47.622 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414761+0000", 2024-09-12T16:18:47.622 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025979660000000002 2024-09-12T16:18:47.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.622 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.622 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.622 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:30.414850+0000", 2024-09-12T16:18:47.622 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8426999999999999e-05 2024-09-12T16:18:47.622 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.622 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.623 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.623 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5384.0:1241 3.16 e95/75 3:6ee670ce:::rbd_data.1155b9894cdc.0000000000000005:head v 95'1303, mlcod=95'1301)", 2024-09-12T16:18:47.623 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:35.272164+0000", 2024-09-12T16:18:47.623 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 72.332841005999995, 2024-09-12T16:18:47.623 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015008743, 2024-09-12T16:18:47.623 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.623 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.623 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:47.623 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.623 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.272164+0000", 2024-09-12T16:18:47.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.624 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.272164+0000", 2024-09-12T16:18:47.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.624 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.272165+0000", 2024-09-12T16:18:47.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.311e-06 2024-09-12T16:18:47.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.625 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.625 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.625 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275503+0000", 2024-09-12T16:18:47.625 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003337881 2024-09-12T16:18:47.625 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.625 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.625 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.625 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275530+0000", 2024-09-12T16:18:47.625 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6797000000000001e-05 2024-09-12T16:18:47.625 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.625 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.625 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.625 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275541+0000", 2024-09-12T16:18:47.626 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1634000000000001e-05 2024-09-12T16:18:47.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.626 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.626 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.626 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275618+0000", 2024-09-12T16:18:47.626 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6811999999999996e-05 2024-09-12T16:18:47.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.626 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.626 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:47.626 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.275642+0000", 2024-09-12T16:18:47.626 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4111999999999999e-05 2024-09-12T16:18:47.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.626 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.626 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:47.627 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287116+0000", 2024-09-12T16:18:47.627 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01147395 2024-09-12T16:18:47.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.627 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.627 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.627 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287172+0000", 2024-09-12T16:18:47.627 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6246000000000003e-05 2024-09-12T16:18:47.627 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.627 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.627 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.627 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.627 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.5384.0:1246 3.f e95/74 3:f0725c44:::rbd_data.1155b9894cdc.0000000000000006:head v 95'356, mlcod=95'354)", 2024-09-12T16:18:47.628 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:17:35.276304+0000", 2024-09-12T16:18:47.628 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 72.328701078999998, 2024-09-12T16:18:47.628 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011209733, 2024-09-12T16:18:47.628 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.628 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.628 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:47.628 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.628 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.628 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.628 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.276304+0000", 2024-09-12T16:18:47.628 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.628 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.628 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.628 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.628 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.276304+0000", 2024-09-12T16:18:47.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.629 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.276305+0000", 2024-09-12T16:18:47.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2500000000000001e-06 2024-09-12T16:18:47.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.629 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279256+0000", 2024-09-12T16:18:47.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002951076 2024-09-12T16:18:47.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.630 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279281+0000", 2024-09-12T16:18:47.630 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4779000000000001e-05 2024-09-12T16:18:47.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.630 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.630 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.630 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279294+0000", 2024-09-12T16:18:47.630 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3614e-05 2024-09-12T16:18:47.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.630 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.630 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.630 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279366+0000", 2024-09-12T16:18:47.630 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2094000000000005e-05 2024-09-12T16:18:47.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.631 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.631 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:47.631 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.279395+0000", 2024-09-12T16:18:47.631 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8337999999999999e-05 2024-09-12T16:18:47.631 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.631 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.631 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:47.631 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287479+0000", 2024-09-12T16:18:47.631 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0080844799999999998 2024-09-12T16:18:47.631 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.631 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.631 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.631 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:17:35.287513+0000", 2024-09-12T16:18:47.631 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4102e-05 2024-09-12T16:18:47.632 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.632 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.632 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.632 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.632 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.632 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.3.0:6016 3.13 e149/136 3:c923ecd0:::rbd_data.1155525b14e3.000000000000003f:f v 149'966, mlcod=147'960)", 2024-09-12T16:18:47.632 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.190622+0000", 2024-09-12T16:18:47.632 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.414382357999999, 2024-09-12T16:18:47.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004419821, 2024-09-12T16:18:47.632 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.632 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.632 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:47.632 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.633 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.633 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.633 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.190622+0000", 2024-09-12T16:18:47.633 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.633 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.633 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.633 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.190622+0000", 2024-09-12T16:18:47.633 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.633 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.633 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.633 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.190623+0000", 2024-09-12T16:18:47.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7199999999999998e-07 2024-09-12T16:18:47.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.634 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.634 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.634 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.190629+0000", 2024-09-12T16:18:47.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7869999999999998e-06 2024-09-12T16:18:47.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.634 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.634 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.634 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.190642+0000", 2024-09-12T16:18:47.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2928999999999999e-05 2024-09-12T16:18:47.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.634 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.634 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.635 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.190649+0000", 2024-09-12T16:18:47.635 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2899999999999997e-06 2024-09-12T16:18:47.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.635 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.635 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.635 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.190702+0000", 2024-09-12T16:18:47.635 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2738999999999998e-05 2024-09-12T16:18:47.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.635 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.635 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:47.635 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.190721+0000", 2024-09-12T16:18:47.635 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9589000000000002e-05 2024-09-12T16:18:47.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.635 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.636 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:47.636 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194995+0000", 2024-09-12T16:18:47.636 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0042735389999999998 2024-09-12T16:18:47.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.636 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.636 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.636 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195042+0000", 2024-09-12T16:18:47.636 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7175999999999997e-05 2024-09-12T16:18:47.636 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.636 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.636 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.636 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.637 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.4.0:5451 3.1c e149/136 3:384eb380:::rbd_data.1155525b14e3.0000000000000044:f v 149'831, mlcod=148'828)", 2024-09-12T16:18:47.637 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.191205+0000", 2024-09-12T16:18:47.637 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.413799539999999, 2024-09-12T16:18:47.637 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0064034929999999997, 2024-09-12T16:18:47.637 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.637 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.637 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:47.637 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.637 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.637 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.637 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191205+0000", 2024-09-12T16:18:47.637 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.637 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.637 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.638 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.638 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191205+0000", 2024-09-12T16:18:47.638 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.638 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.638 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.638 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191205+0000", 2024-09-12T16:18:47.638 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9299999999999999e-07 2024-09-12T16:18:47.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.638 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.638 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.638 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191210+0000", 2024-09-12T16:18:47.638 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0879999999999997e-06 2024-09-12T16:18:47.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.639 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.639 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.639 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191218+0000", 2024-09-12T16:18:47.639 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.867e-06 2024-09-12T16:18:47.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.639 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.639 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.639 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191225+0000", 2024-09-12T16:18:47.639 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3300000000000004e-06 2024-09-12T16:18:47.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.639 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.639 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.639 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191312+0000", 2024-09-12T16:18:47.640 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7371000000000001e-05 2024-09-12T16:18:47.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.640 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.640 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:47.640 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191333+0000", 2024-09-12T16:18:47.640 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0591999999999999e-05 2024-09-12T16:18:47.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.640 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.640 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:47.640 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.197573+0000", 2024-09-12T16:18:47.640 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0062397579999999998 2024-09-12T16:18:47.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.640 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.640 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.641 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.197609+0000", 2024-09-12T16:18:47.641 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6193999999999999e-05 2024-09-12T16:18:47.641 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.641 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.641 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.641 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.641 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4437.0:30787 3.16 e149/137 3:6afd6e65:::rbd_header.1155525b14e3:head v 149'1535, mlcod=148'1533)", 2024-09-12T16:18:47.641 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.191485+0000", 2024-09-12T16:18:47.641 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.413520003, 2024-09-12T16:18:47.641 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004520774, 2024-09-12T16:18:47.641 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.642 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.642 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:47.642 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.642 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.642 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.642 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191485+0000", 2024-09-12T16:18:47.642 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.642 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.642 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.642 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.642 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191485+0000", 2024-09-12T16:18:47.642 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.643 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.643 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.643 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.643 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191486+0000", 2024-09-12T16:18:47.643 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1500000000000003e-07 2024-09-12T16:18:47.643 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.643 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.643 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.643 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191492+0000", 2024-09-12T16:18:47.643 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9660000000000001e-06 2024-09-12T16:18:47.643 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.643 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.643 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.644 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191500+0000", 2024-09-12T16:18:47.644 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1270000000000003e-06 2024-09-12T16:18:47.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.644 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.644 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.644 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191507+0000", 2024-09-12T16:18:47.644 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1609999999999997e-06 2024-09-12T16:18:47.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.644 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.644 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.644 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191582+0000", 2024-09-12T16:18:47.644 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5568999999999994e-05 2024-09-12T16:18:47.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.645 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.645 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:47.645 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191622+0000", 2024-09-12T16:18:47.645 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9288000000000001e-05 2024-09-12T16:18:47.645 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.645 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.645 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:47.645 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195973+0000", 2024-09-12T16:18:47.645 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0043517410000000001 2024-09-12T16:18:47.645 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.645 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.645 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.645 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.196006+0000", 2024-09-12T16:18:47.646 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2107000000000003e-05 2024-09-12T16:18:47.646 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.646 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.646 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.646 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.646 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.646 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.0.0:4264 3.c e149/137 3:341d16c5:::rbd_data.1155525b14e3.0000000000000042:f v 149'428, mlcod=147'424)", 2024-09-12T16:18:47.646 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.191925+0000", 2024-09-12T16:18:47.646 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.41307961, 2024-09-12T16:18:47.646 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0065976330000000003, 2024-09-12T16:18:47.646 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.646 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.646 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:47.646 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.647 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.647 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.647 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191925+0000", 2024-09-12T16:18:47.647 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.647 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.647 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.647 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191925+0000", 2024-09-12T16:18:47.647 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.647 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.647 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.647 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191926+0000", 2024-09-12T16:18:47.648 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0699999999999996e-07 2024-09-12T16:18:47.648 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.648 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.648 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.648 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191931+0000", 2024-09-12T16:18:47.648 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4589999999999997e-06 2024-09-12T16:18:47.648 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.648 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.648 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.648 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191941+0000", 2024-09-12T16:18:47.648 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.302e-06 2024-09-12T16:18:47.648 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.648 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.648 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.648 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.191962+0000", 2024-09-12T16:18:47.649 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1126999999999999e-05 2024-09-12T16:18:47.649 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.649 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.649 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.649 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.193331+0000", 2024-09-12T16:18:47.649 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0013695599999999999 2024-09-12T16:18:47.649 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.649 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.649 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:47.649 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.193351+0000", 2024-09-12T16:18:47.649 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9344e-05 2024-09-12T16:18:47.649 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.649 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.650 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:47.650 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.198486+0000", 2024-09-12T16:18:47.650 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0051356630000000004 2024-09-12T16:18:47.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.650 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.650 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.650 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.198523+0000", 2024-09-12T16:18:47.650 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6270999999999999e-05 2024-09-12T16:18:47.650 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.650 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.650 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.651 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.651 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.4.0:5452 3.1d e149/137 3:b81abef1:::rbd_data.1155525b14e3.0000000000000032:f v 149'1487, mlcod=147'1484)", 2024-09-12T16:18:47.651 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.192040+0000", 2024-09-12T16:18:47.651 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.412964716999999, 2024-09-12T16:18:47.651 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0063393620000000003, 2024-09-12T16:18:47.651 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.651 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.651 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:47.651 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.651 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.651 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.651 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192040+0000", 2024-09-12T16:18:47.651 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.652 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.652 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.652 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192040+0000", 2024-09-12T16:18:47.652 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.652 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.652 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.652 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192040+0000", 2024-09-12T16:18:47.652 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1199999999999998e-07 2024-09-12T16:18:47.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.652 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.652 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.653 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192044+0000", 2024-09-12T16:18:47.653 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0110000000000002e-06 2024-09-12T16:18:47.653 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.653 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.653 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.653 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192051+0000", 2024-09-12T16:18:47.653 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0380000000000002e-06 2024-09-12T16:18:47.653 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.653 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.653 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.653 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192057+0000", 2024-09-12T16:18:47.653 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9220000000000002e-06 2024-09-12T16:18:47.653 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.654 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.654 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.654 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192182+0000", 2024-09-12T16:18:47.654 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000125012 2024-09-12T16:18:47.654 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.654 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.654 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:47.654 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192199+0000", 2024-09-12T16:18:47.654 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6642000000000001e-05 2024-09-12T16:18:47.654 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.654 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.654 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:47.654 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.198340+0000", 2024-09-12T16:18:47.654 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0061410099999999997 2024-09-12T16:18:47.655 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.655 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.655 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.655 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.198379+0000", 2024-09-12T16:18:47.655 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9314999999999999e-05 2024-09-12T16:18:47.655 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.655 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.655 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.655 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.655 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.655 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.1.0:3298 3.2 e149/136 3:40dbe95a:::rbd_data.1155525b14e3.000000000000007c:f v 149'547, mlcod=147'544)", 2024-09-12T16:18:47.655 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.192706+0000", 2024-09-12T16:18:47.655 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.412298581, 2024-09-12T16:18:47.655 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0058280850000000002, 2024-09-12T16:18:47.655 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.656 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.656 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:47.656 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.656 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.656 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.656 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192706+0000", 2024-09-12T16:18:47.656 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.656 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.656 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.656 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192706+0000", 2024-09-12T16:18:47.656 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.657 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.657 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.657 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192707+0000", 2024-09-12T16:18:47.657 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6100000000000002e-07 2024-09-12T16:18:47.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.657 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.657 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.657 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192711+0000", 2024-09-12T16:18:47.657 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6079999999999998e-06 2024-09-12T16:18:47.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.657 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.657 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.657 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192733+0000", 2024-09-12T16:18:47.657 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1923e-05 2024-09-12T16:18:47.658 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.658 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.658 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.658 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192741+0000", 2024-09-12T16:18:47.658 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5390000000000002e-06 2024-09-12T16:18:47.658 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.658 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.658 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.658 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.193578+0000", 2024-09-12T16:18:47.658 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00083768500000000001 2024-09-12T16:18:47.658 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.658 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.658 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:47.659 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.193595+0000", 2024-09-12T16:18:47.659 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7119999999999999e-05 2024-09-12T16:18:47.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.659 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.659 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:47.659 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.198493+0000", 2024-09-12T16:18:47.659 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0048975080000000001 2024-09-12T16:18:47.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.659 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.659 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.659 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.198534+0000", 2024-09-12T16:18:47.659 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1341000000000003e-05 2024-09-12T16:18:47.659 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.659 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.660 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.660 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.660 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.660 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.0.0:4266 3.c e149/137 3:360c2ef2:::rbd_data.1155525b14e3.0000000000000016:f v 149'430, mlcod=147'424)", 2024-09-12T16:18:47.660 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.192781+0000", 2024-09-12T16:18:47.660 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.412224209, 2024-09-12T16:18:47.660 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.007657779, 2024-09-12T16:18:47.660 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.660 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.660 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:47.660 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.660 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.660 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.661 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192781+0000", 2024-09-12T16:18:47.661 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.661 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.661 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.661 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192781+0000", 2024-09-12T16:18:47.661 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.661 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.661 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.661 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192781+0000", 2024-09-12T16:18:47.661 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3e-07 2024-09-12T16:18:47.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.662 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.662 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.662 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192791+0000", 2024-09-12T16:18:47.662 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5089999999999999e-06 2024-09-12T16:18:47.662 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.662 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.662 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.662 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192802+0000", 2024-09-12T16:18:47.662 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0920999999999999e-05 2024-09-12T16:18:47.662 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.662 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.662 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.662 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192808+0000", 2024-09-12T16:18:47.662 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1070000000000001e-06 2024-09-12T16:18:47.663 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.663 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.663 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.663 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195891+0000", 2024-09-12T16:18:47.663 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003083531 2024-09-12T16:18:47.663 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.663 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.663 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:47.663 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195907+0000", 2024-09-12T16:18:47.663 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5336e-05 2024-09-12T16:18:47.663 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.663 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.663 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:47.664 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.200415+0000", 2024-09-12T16:18:47.664 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0045088319999999999 2024-09-12T16:18:47.664 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.664 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.664 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.664 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.200438+0000", 2024-09-12T16:18:47.664 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2912999999999999e-05 2024-09-12T16:18:47.664 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.664 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.664 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.664 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.664 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.664 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.0.0:4267 3.10 e149/136 3:0b8b145b:::rbd_data.1155525b14e3.000000000000005e:f v 149'606, mlcod=147'600)", 2024-09-12T16:18:47.665 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.192819+0000", 2024-09-12T16:18:47.665 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.41218552, 2024-09-12T16:18:47.665 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0043054909999999998, 2024-09-12T16:18:47.665 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.665 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.665 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:47.665 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.665 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.665 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.665 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192819+0000", 2024-09-12T16:18:47.665 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.665 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.665 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.665 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.666 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192819+0000", 2024-09-12T16:18:47.666 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.666 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.666 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.666 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.666 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192819+0000", 2024-09-12T16:18:47.666 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4600000000000001e-07 2024-09-12T16:18:47.666 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.666 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.666 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.666 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192827+0000", 2024-09-12T16:18:47.666 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9030000000000004e-06 2024-09-12T16:18:47.666 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.667 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.667 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.667 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192834+0000", 2024-09-12T16:18:47.667 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4810000000000003e-06 2024-09-12T16:18:47.667 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.667 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.667 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.667 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.192839+0000", 2024-09-12T16:18:47.667 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8790000000000002e-06 2024-09-12T16:18:47.667 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.667 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.667 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.667 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.193371+0000", 2024-09-12T16:18:47.668 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00053213999999999996 2024-09-12T16:18:47.668 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.668 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.668 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:47.668 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.193388+0000", 2024-09-12T16:18:47.668 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7407000000000001e-05 2024-09-12T16:18:47.668 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.668 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.668 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:47.668 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.197081+0000", 2024-09-12T16:18:47.668 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003692608 2024-09-12T16:18:47.668 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.668 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.668 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.669 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.197125+0000", 2024-09-12T16:18:47.669 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3826999999999999e-05 2024-09-12T16:18:47.669 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.669 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.669 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.669 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.669 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.669 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.1.0:3300 3.2 e149/136 3:46a84092:::rbd_data.1155525b14e3.000000000000006d:f v 149'549, mlcod=147'544)", 2024-09-12T16:18:47.669 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.193554+0000", 2024-09-12T16:18:47.669 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.411450260000001, 2024-09-12T16:18:47.669 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.006035749, 2024-09-12T16:18:47.669 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.669 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.669 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:47.670 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.670 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.670 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.670 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.193554+0000", 2024-09-12T16:18:47.670 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.670 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.670 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.670 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.670 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.193554+0000", 2024-09-12T16:18:47.670 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.670 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.670 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.670 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.671 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.193555+0000", 2024-09-12T16:18:47.671 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3399999999999999e-07 2024-09-12T16:18:47.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.671 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.671 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.671 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.193560+0000", 2024-09-12T16:18:47.671 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1889999999999998e-06 2024-09-12T16:18:47.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.671 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.671 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.671 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.193572+0000", 2024-09-12T16:18:47.671 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1653e-05 2024-09-12T16:18:47.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.672 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.672 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.672 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.193578+0000", 2024-09-12T16:18:47.672 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3759999999999996e-06 2024-09-12T16:18:47.672 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.672 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.672 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.672 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.197103+0000", 2024-09-12T16:18:47.672 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0035248889999999998 2024-09-12T16:18:47.672 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.672 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.672 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:47.672 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.197122+0000", 2024-09-12T16:18:47.672 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9272000000000001e-05 2024-09-12T16:18:47.673 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.673 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.673 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:47.673 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.199555+0000", 2024-09-12T16:18:47.673 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0024325710000000001 2024-09-12T16:18:47.673 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.673 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.673 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.673 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.199590+0000", 2024-09-12T16:18:47.673 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5265000000000002e-05 2024-09-12T16:18:47.673 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.673 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.673 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.674 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.674 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.674 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.4.0:5453 3.1c e149/136 3:3ea3e34f:::rbd_data.1155525b14e3.0000000000000029:f v 149'833, mlcod=148'828)", 2024-09-12T16:18:47.674 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.194348+0000", 2024-09-12T16:18:47.674 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.410656782, 2024-09-12T16:18:47.674 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0060649639999999999, 2024-09-12T16:18:47.674 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.674 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.674 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:47.674 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.674 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.674 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.674 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194348+0000", 2024-09-12T16:18:47.674 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.675 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.675 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.675 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.675 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194348+0000", 2024-09-12T16:18:47.675 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.675 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.675 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.675 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.675 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194349+0000", 2024-09-12T16:18:47.675 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1999999999999999e-07 2024-09-12T16:18:47.675 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.675 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.675 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.676 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194354+0000", 2024-09-12T16:18:47.676 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5790000000000003e-06 2024-09-12T16:18:47.676 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.676 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.676 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.676 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194367+0000", 2024-09-12T16:18:47.676 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3191e-05 2024-09-12T16:18:47.676 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.676 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.676 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.676 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194374+0000", 2024-09-12T16:18:47.676 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6490000000000002e-06 2024-09-12T16:18:47.676 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.677 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.677 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.677 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195828+0000", 2024-09-12T16:18:47.677 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001454131 2024-09-12T16:18:47.677 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.677 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.677 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:47.677 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195846+0000", 2024-09-12T16:18:47.677 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7978999999999998e-05 2024-09-12T16:18:47.677 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.677 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.677 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:47.677 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.200370+0000", 2024-09-12T16:18:47.677 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0045236060000000003 2024-09-12T16:18:47.678 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.678 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.678 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.678 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.200413+0000", 2024-09-12T16:18:47.678 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3108999999999997e-05 2024-09-12T16:18:47.678 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.678 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.678 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.678 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.678 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.678 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.4.0:5454 3.1d e149/137 3:be124de3:::rbd_data.1155525b14e3.0000000000000015:f v 149'1489, mlcod=147'1484)", 2024-09-12T16:18:47.678 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.194388+0000", 2024-09-12T16:18:47.678 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.410616767, 2024-09-12T16:18:47.679 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0045598710000000001, 2024-09-12T16:18:47.679 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.679 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.679 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:47.679 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.679 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.679 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.679 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194388+0000", 2024-09-12T16:18:47.679 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.679 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.679 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.679 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.679 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194388+0000", 2024-09-12T16:18:47.679 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.679 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.680 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.680 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.680 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194388+0000", 2024-09-12T16:18:47.680 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8299999999999998e-07 2024-09-12T16:18:47.680 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.680 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.680 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.680 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194396+0000", 2024-09-12T16:18:47.680 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.418e-06 2024-09-12T16:18:47.680 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.680 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.680 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.680 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194404+0000", 2024-09-12T16:18:47.681 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0490000000000004e-06 2024-09-12T16:18:47.681 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.681 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.681 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.681 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194409+0000", 2024-09-12T16:18:47.681 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1420000000000001e-06 2024-09-12T16:18:47.681 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.681 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.681 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.681 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194472+0000", 2024-09-12T16:18:47.681 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3058999999999994e-05 2024-09-12T16:18:47.681 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.681 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.682 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:47.682 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.194484+0000", 2024-09-12T16:18:47.682 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.223e-05 2024-09-12T16:18:47.682 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.682 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.682 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:47.682 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.198908+0000", 2024-09-12T16:18:47.682 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0044234809999999999 2024-09-12T16:18:47.682 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.682 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.682 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.682 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.198948+0000", 2024-09-12T16:18:47.682 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0209000000000001e-05 2024-09-12T16:18:47.682 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.682 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.683 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.683 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.683 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.683 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.2.0:2914 3.5 e149/136 3:a003977d:::rbd_data.1155525b14e3.000000000000007b:f v 149'781, mlcod=147'777)", 2024-09-12T16:18:47.683 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.195113+0000", 2024-09-12T16:18:47.683 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.409891914999999, 2024-09-12T16:18:47.683 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0044523849999999997, 2024-09-12T16:18:47.683 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.683 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.683 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:47.683 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.683 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.683 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.684 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195113+0000", 2024-09-12T16:18:47.684 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.684 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.684 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.684 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.684 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195113+0000", 2024-09-12T16:18:47.684 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.684 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.684 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.684 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.684 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195113+0000", 2024-09-12T16:18:47.684 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0800000000000005e-07 2024-09-12T16:18:47.684 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.685 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.685 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.685 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195118+0000", 2024-09-12T16:18:47.685 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7160000000000002e-06 2024-09-12T16:18:47.685 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.685 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.685 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.685 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195126+0000", 2024-09-12T16:18:47.685 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4430000000000003e-06 2024-09-12T16:18:47.685 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.685 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.685 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.685 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195132+0000", 2024-09-12T16:18:47.686 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6890000000000001e-06 2024-09-12T16:18:47.686 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.686 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.686 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.686 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195181+0000", 2024-09-12T16:18:47.686 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8922999999999999e-05 2024-09-12T16:18:47.686 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.686 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.686 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:47.686 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195207+0000", 2024-09-12T16:18:47.686 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5454999999999999e-05 2024-09-12T16:18:47.686 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.686 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.687 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:47.687 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.199522+0000", 2024-09-12T16:18:47.687 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004315864 2024-09-12T16:18:47.687 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.687 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.687 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.687 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.199565+0000", 2024-09-12T16:18:47.687 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2787000000000002e-05 2024-09-12T16:18:47.687 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.687 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.687 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.687 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.687 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.687 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.2.0:2915 3.5 e149/136 3:a0ca3b20:::rbd_data.1155525b14e3.0000000000000041:f v 149'783, mlcod=147'777)", 2024-09-12T16:18:47.688 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.195812+0000", 2024-09-12T16:18:47.688 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.409192445, 2024-09-12T16:18:47.688 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0043974340000000004, 2024-09-12T16:18:47.688 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.688 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.688 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:47.688 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.688 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.688 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.688 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195812+0000", 2024-09-12T16:18:47.688 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.688 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.688 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.688 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.689 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195812+0000", 2024-09-12T16:18:47.689 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.689 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.689 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.689 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.689 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195813+0000", 2024-09-12T16:18:47.689 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1900000000000001e-07 2024-09-12T16:18:47.689 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.689 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.689 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.689 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195819+0000", 2024-09-12T16:18:47.689 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3839999999999996e-06 2024-09-12T16:18:47.689 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.690 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.690 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.690 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195828+0000", 2024-09-12T16:18:47.690 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1579999999999994e-06 2024-09-12T16:18:47.690 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.690 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.690 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.690 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.195835+0000", 2024-09-12T16:18:47.690 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8040000000000004e-06 2024-09-12T16:18:47.691 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.691 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.691 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.691 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.198407+0000", 2024-09-12T16:18:47.691 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025724659999999998 2024-09-12T16:18:47.691 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.691 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.691 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:47.691 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.198425+0000", 2024-09-12T16:18:47.691 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8136999999999999e-05 2024-09-12T16:18:47.691 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.691 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.691 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:47.691 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.200173+0000", 2024-09-12T16:18:47.692 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017473949999999999 2024-09-12T16:18:47.692 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.692 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.692 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.692 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.200210+0000", 2024-09-12T16:18:47.692 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7171e-05 2024-09-12T16:18:47.692 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.692 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.692 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.692 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.692 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.692 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(osd.3.0:6023 3.16 e149/137 3:68db2424:::rbd_data.1155525b14e3.000000000000002a:f v 149'1538, mlcod=148'1534)", 2024-09-12T16:18:47.692 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T16:18:37.201343+0000", 2024-09-12T16:18:47.693 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.403661435, 2024-09-12T16:18:47.693 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0049766510000000003, 2024-09-12T16:18:47.693 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T16:18:47.693 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T16:18:47.693 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:47.693 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T16:18:47.693 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.693 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T16:18:47.693 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.201343+0000", 2024-09-12T16:18:47.693 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.693 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.693 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.693 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T16:18:47.693 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.201343+0000", 2024-09-12T16:18:47.694 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T16:18:47.694 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.694 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.694 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T16:18:47.694 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.201344+0000", 2024-09-12T16:18:47.694 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6300000000000005e-07 2024-09-12T16:18:47.694 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.694 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.694 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T16:18:47.694 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.201367+0000", 2024-09-12T16:18:47.694 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2534000000000001e-05 2024-09-12T16:18:47.694 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.694 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.695 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T16:18:47.695 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.201375+0000", 2024-09-12T16:18:47.695 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9199999999999993e-06 2024-09-12T16:18:47.695 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.695 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.695 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T16:18:47.695 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.201383+0000", 2024-09-12T16:18:47.695 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6389999999999992e-06 2024-09-12T16:18:47.695 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.695 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.695 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T16:18:47.695 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.201439+0000", 2024-09-12T16:18:47.695 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5673e-05 2024-09-12T16:18:47.695 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.695 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.696 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T16:18:47.696 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.201457+0000", 2024-09-12T16:18:47.696 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8623000000000001e-05 2024-09-12T16:18:47.696 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.696 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.696 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T16:18:47.696 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.206280+0000", 2024-09-12T16:18:47.696 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0048226279999999998 2024-09-12T16:18:47.696 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T16:18:47.696 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T16:18:47.696 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T16:18:47.696 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T16:18:37.206320+0000", 2024-09-12T16:18:47.696 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9971000000000001e-05 2024-09-12T16:18:47.697 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.697 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.697 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.697 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T16:18:47.697 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T16:18:47.697 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T16:18:47.698 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:47.697+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:47.699 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:18:47.799 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:47.797+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:47.809 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:47.810 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:47.810 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:18:47.810 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:47.818 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:18:47.900 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:47.898+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:47.925 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:47.925 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:47.925 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T16:18:47.925 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T16:18:47.925 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:47.933 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:18:48.000 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:47.999+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:48.047 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:48.047 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T16:18:48.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T16:18:48.047 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T16:18:48.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.047 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1571 3.b 3:d046566d:::rbd_data.1155525b14e3.0000000000000001:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:18:48.048 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:18:48.048 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 126.893028286, 2024-09-12T16:18:48.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064439785999999999, 2024-09-12T16:18:48.048 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:48.048 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:48.048 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:48.048 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:48.048 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:18:48.048 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:18:48.048 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1571 2024-09-12T16:18:48.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.048 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:48.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:18:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:18:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152564+0000", 2024-09-12T16:18:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5400000000000002e-07 2024-09-12T16:18:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152567+0000", 2024-09-12T16:18:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.131e-06 2024-09-12T16:18:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152574+0000", 2024-09-12T16:18:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1840000000000002e-06 2024-09-12T16:18:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152579+0000", 2024-09-12T16:18:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.152e-06 2024-09-12T16:18:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153671+0000", 2024-09-12T16:18:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001092078 2024-09-12T16:18:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.153779+0000", 2024-09-12T16:18:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108461 2024-09-12T16:18:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217004+0000", 2024-09-12T16:18:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.063224426 2024-09-12T16:18:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4855.0:1581 3.4 3:22e34893:::rbd_data.1155525b14e3.0000000000000005:f [read 24576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T16:18:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:18:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 126.89293116100001, 2024-09-12T16:18:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064484407999999993, 2024-09-12T16:18:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4855", 2024-09-12T16:18:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/460495648", 2024-09-12T16:18:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1581 2024-09-12T16:18:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:18:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:48.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152661+0000", 2024-09-12T16:18:48.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:48.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152662+0000", 2024-09-12T16:18:48.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.65e-07 2024-09-12T16:18:48.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:48.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152664+0000", 2024-09-12T16:18:48.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9829999999999999e-06 2024-09-12T16:18:48.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:48.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152670+0000", 2024-09-12T16:18:48.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2260000000000002e-06 2024-09-12T16:18:48.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:48.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.152675+0000", 2024-09-12T16:18:48.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7990000000000001e-06 2024-09-12T16:18:48.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:48.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.216945+0000", 2024-09-12T16:18:48.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.064270341999999994 2024-09-12T16:18:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217040+0000", 2024-09-12T16:18:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5242999999999996e-05 2024-09-12T16:18:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:41.217146+0000", 2024-09-12T16:18:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010545 2024-09-12T16:18:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5124.0:2207 3.0 3:05fdc61f:::rbd_data.1155ccb1894c.0000000000000003:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T16:18:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:18:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 110.67488760000001, 2024-09-12T16:18:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.05105382, 2024-09-12T16:18:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T16:18:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5124", 2024-09-12T16:18:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/615411105", 2024-09-12T16:18:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2207 2024-09-12T16:18:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.058 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:48.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:48.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:18:48.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:48.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370705+0000", 2024-09-12T16:18:48.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:48.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.370706+0000", 2024-09-12T16:18:48.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7800000000000001e-07 2024-09-12T16:18:48.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:48.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391581+0000", 2024-09-12T16:18:48.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020875624999999998 2024-09-12T16:18:48.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:48.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391608+0000", 2024-09-12T16:18:48.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6412999999999999e-05 2024-09-12T16:18:48.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391618+0000", 2024-09-12T16:18:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9240000000000002e-06 2024-09-12T16:18:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391705+0000", 2024-09-12T16:18:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7489000000000002e-05 2024-09-12T16:18:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.391838+0000", 2024-09-12T16:18:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132865 2024-09-12T16:18:48.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 2", 2024-09-12T16:18:48.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.392587+0000", 2024-09-12T16:18:48.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074930000000000005 2024-09-12T16:18:48.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T16:18:48.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.420095+0000", 2024-09-12T16:18:48.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027507949 2024-09-12T16:18:48.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T16:18:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421610+0000", 2024-09-12T16:18:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001515195 2024-09-12T16:18:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T16:18:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421681+0000", 2024-09-12T16:18:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0320000000000004e-05 2024-09-12T16:18:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:16:57.421759+0000", 2024-09-12T16:18:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7961999999999997e-05 2024-09-12T16:18:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11083 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 3399680~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.876304+0000", 2024-09-12T16:18:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 54.169288193, 2024-09-12T16:18:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045070883999999999, 2024-09-12T16:18:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11083 2024-09-12T16:18:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876304+0000", 2024-09-12T16:18:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876304+0000", 2024-09-12T16:18:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876305+0000", 2024-09-12T16:18:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4099999999999999e-07 2024-09-12T16:18:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876307+0000", 2024-09-12T16:18:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9470000000000002e-06 2024-09-12T16:18:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876312+0000", 2024-09-12T16:18:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7540000000000003e-06 2024-09-12T16:18:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876318+0000", 2024-09-12T16:18:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3589999999999999e-06 2024-09-12T16:18:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921221+0000", 2024-09-12T16:18:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044903464999999997 2024-09-12T16:18:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921266+0000", 2024-09-12T16:18:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4795000000000001e-05 2024-09-12T16:18:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921375+0000", 2024-09-12T16:18:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000109023 2024-09-12T16:18:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11084 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 3448832~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.876324+0000", 2024-09-12T16:18:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 54.169268076000002, 2024-09-12T16:18:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045172474999999997, 2024-09-12T16:18:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11084 2024-09-12T16:18:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876324+0000", 2024-09-12T16:18:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876324+0000", 2024-09-12T16:18:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876411+0000", 2024-09-12T16:18:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6292000000000007e-05 2024-09-12T16:18:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876418+0000", 2024-09-12T16:18:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3309999999999998e-06 2024-09-12T16:18:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876426+0000", 2024-09-12T16:18:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3850000000000002e-06 2024-09-12T16:18:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876436+0000", 2024-09-12T16:18:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8749999999999995e-06 2024-09-12T16:18:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921403+0000", 2024-09-12T16:18:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.044966385999999997 2024-09-12T16:18:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921445+0000", 2024-09-12T16:18:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1953000000000003e-05 2024-09-12T16:18:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921497+0000", 2024-09-12T16:18:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2253000000000003e-05 2024-09-12T16:18:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11085 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 3497984~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.876449+0000", 2024-09-12T16:18:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 54.169143566000002, 2024-09-12T16:18:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045173054999999997, 2024-09-12T16:18:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11085 2024-09-12T16:18:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876449+0000", 2024-09-12T16:18:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.876449+0000", 2024-09-12T16:18:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.881997+0000", 2024-09-12T16:18:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055481209999999996 2024-09-12T16:18:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.882002+0000", 2024-09-12T16:18:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8269999999999997e-06 2024-09-12T16:18:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.882013+0000", 2024-09-12T16:18:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0869999999999999e-05 2024-09-12T16:18:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.882020+0000", 2024-09-12T16:18:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5839999999999997e-06 2024-09-12T16:18:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921523+0000", 2024-09-12T16:18:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039502411000000001 2024-09-12T16:18:48.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.076 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:48.076 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921566+0000", 2024-09-12T16:18:48.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3353000000000003e-05 2024-09-12T16:18:48.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.076 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:48.076 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.921622+0000", 2024-09-12T16:18:48.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5889e-05 2024-09-12T16:18:48.076 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.076 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:48.076 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.077 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11139 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 6152192~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:48.077 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883248+0000", 2024-09-12T16:18:48.077 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 54.162344701999999, 2024-09-12T16:18:48.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045153225999999998, 2024-09-12T16:18:48.077 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:48.077 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:48.077 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:48.077 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:48.077 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:48.077 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:48.077 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11139 2024-09-12T16:18:48.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.078 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:48.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:48.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883248+0000", 2024-09-12T16:18:48.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:48.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883248+0000", 2024-09-12T16:18:48.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:48.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883248+0000", 2024-09-12T16:18:48.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9999999999999998e-07 2024-09-12T16:18:48.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:48.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883250+0000", 2024-09-12T16:18:48.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0660000000000002e-06 2024-09-12T16:18:48.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:48.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883256+0000", 2024-09-12T16:18:48.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8699999999999997e-06 2024-09-12T16:18:48.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:48.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883261+0000", 2024-09-12T16:18:48.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0490000000000003e-06 2024-09-12T16:18:48.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:48.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928316+0000", 2024-09-12T16:18:48.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045055398000000003 2024-09-12T16:18:48.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:48.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928359+0000", 2024-09-12T16:18:48.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2286000000000001e-05 2024-09-12T16:18:48.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.081 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:48.081 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928401+0000", 2024-09-12T16:18:48.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2157000000000003e-05 2024-09-12T16:18:48.081 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.081 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:48.081 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.081 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11140 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 6201344~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:48.081 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883267+0000", 2024-09-12T16:18:48.081 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 54.162324935999997, 2024-09-12T16:18:48.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045241199000000003, 2024-09-12T16:18:48.082 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:48.082 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:48.082 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:48.082 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:48.082 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:48.082 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:48.082 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11140 2024-09-12T16:18:48.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.082 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:48.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:48.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883267+0000", 2024-09-12T16:18:48.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:48.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883267+0000", 2024-09-12T16:18:48.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:48.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883268+0000", 2024-09-12T16:18:48.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8700000000000001e-07 2024-09-12T16:18:48.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:48.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883270+0000", 2024-09-12T16:18:48.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3420000000000002e-06 2024-09-12T16:18:48.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:48.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883276+0000", 2024-09-12T16:18:48.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0310000000000004e-06 2024-09-12T16:18:48.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:48.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883281+0000", 2024-09-12T16:18:48.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1259999999999997e-06 2024-09-12T16:18:48.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:48.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928428+0000", 2024-09-12T16:18:48.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045146276999999999 2024-09-12T16:18:48.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:48.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928469+0000", 2024-09-12T16:18:48.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1007000000000002e-05 2024-09-12T16:18:48.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:48.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928509+0000", 2024-09-12T16:18:48.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0028999999999999e-05 2024-09-12T16:18:48.086 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.086 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:48.086 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.086 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11141 3.19 3:9c7c9453:::rbd_data.1155d3b3a2ae.0000000000000003:28 [read 6250496~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:48.086 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883288+0000", 2024-09-12T16:18:48.086 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 54.162304339000002, 2024-09-12T16:18:48.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045331594000000003, 2024-09-12T16:18:48.086 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:48.086 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:48.086 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:48.086 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:48.086 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:48.087 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:48.087 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11141 2024-09-12T16:18:48.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.087 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:48.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:48.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883288+0000", 2024-09-12T16:18:48.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:48.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883288+0000", 2024-09-12T16:18:48.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:48.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883288+0000", 2024-09-12T16:18:48.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0200000000000003e-07 2024-09-12T16:18:48.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:48.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883290+0000", 2024-09-12T16:18:48.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9350000000000001e-06 2024-09-12T16:18:48.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:48.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883296+0000", 2024-09-12T16:18:48.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.913e-06 2024-09-12T16:18:48.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:48.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883302+0000", 2024-09-12T16:18:48.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.879e-06 2024-09-12T16:18:48.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:48.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928534+0000", 2024-09-12T16:18:48.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045231544999999998 2024-09-12T16:18:48.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:48.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928577+0000", 2024-09-12T16:18:48.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3676e-05 2024-09-12T16:18:48.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:48.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928620+0000", 2024-09-12T16:18:48.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2243999999999997e-05 2024-09-12T16:18:48.090 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.090 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:48.090 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.090 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11271 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3174400~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:48.090 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883316+0000", 2024-09-12T16:18:48.091 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 54.162276278999997, 2024-09-12T16:18:48.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045477308000000001, 2024-09-12T16:18:48.091 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:48.091 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:48.091 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:48.091 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:48.091 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:48.091 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:48.091 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11271 2024-09-12T16:18:48.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.091 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:48.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:48.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883316+0000", 2024-09-12T16:18:48.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:48.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883316+0000", 2024-09-12T16:18:48.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:48.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883317+0000", 2024-09-12T16:18:48.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9200000000000001e-07 2024-09-12T16:18:48.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:48.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883319+0000", 2024-09-12T16:18:48.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2670000000000001e-06 2024-09-12T16:18:48.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:48.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883326+0000", 2024-09-12T16:18:48.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6000000000000003e-06 2024-09-12T16:18:48.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:48.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883331+0000", 2024-09-12T16:18:48.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1719999999999998e-06 2024-09-12T16:18:48.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:48.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928647+0000", 2024-09-12T16:18:48.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045316457999999997 2024-09-12T16:18:48.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:48.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928689+0000", 2024-09-12T16:18:48.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1352e-05 2024-09-12T16:18:48.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:48.095 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928793+0000", 2024-09-12T16:18:48.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000104867 2024-09-12T16:18:48.095 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.095 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:48.095 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.095 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11272 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3223552~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:48.095 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883338+0000", 2024-09-12T16:18:48.095 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 54.162254419, 2024-09-12T16:18:48.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045595268000000001, 2024-09-12T16:18:48.096 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:48.096 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:48.096 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:48.096 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:48.096 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:48.096 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:48.096 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11272 2024-09-12T16:18:48.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.096 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:48.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.096 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:48.096 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883338+0000", 2024-09-12T16:18:48.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:48.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883338+0000", 2024-09-12T16:18:48.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:48.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883339+0000", 2024-09-12T16:18:48.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8599999999999998e-07 2024-09-12T16:18:48.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:48.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883341+0000", 2024-09-12T16:18:48.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1449999999999998e-06 2024-09-12T16:18:48.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:48.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883348+0000", 2024-09-12T16:18:48.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0110000000000003e-06 2024-09-12T16:18:48.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:48.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883353+0000", 2024-09-12T16:18:48.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2360000000000004e-06 2024-09-12T16:18:48.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:48.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928819+0000", 2024-09-12T16:18:48.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045466392000000001 2024-09-12T16:18:48.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:48.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928869+0000", 2024-09-12T16:18:48.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9829e-05 2024-09-12T16:18:48.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:48.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928933+0000", 2024-09-12T16:18:48.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3968999999999997e-05 2024-09-12T16:18:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11273 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3272704~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883359+0000", 2024-09-12T16:18:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 54.162233106999999, 2024-09-12T16:18:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045735142999999999, 2024-09-12T16:18:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:48.101 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11273 2024-09-12T16:18:48.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.101 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:48.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:48.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883359+0000", 2024-09-12T16:18:48.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:48.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883359+0000", 2024-09-12T16:18:48.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:48.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883360+0000", 2024-09-12T16:18:48.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9400000000000001e-07 2024-09-12T16:18:48.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:48.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883367+0000", 2024-09-12T16:18:48.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8530000000000003e-06 2024-09-12T16:18:48.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:48.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883373+0000", 2024-09-12T16:18:48.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9989999999999997e-06 2024-09-12T16:18:48.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:48.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883378+0000", 2024-09-12T16:18:48.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3369999999999999e-06 2024-09-12T16:18:48.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:48.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928950+0000", 2024-09-12T16:18:48.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045571751000000001 2024-09-12T16:18:48.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:48.104 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.928992+0000", 2024-09-12T16:18:48.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1891000000000003e-05 2024-09-12T16:18:48.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.104 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:48.104 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929094+0000", 2024-09-12T16:18:48.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010291800000000001 2024-09-12T16:18:48.104 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.104 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:48.104 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.104 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11274 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3321856~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:48.104 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883385+0000", 2024-09-12T16:18:48.105 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 54.162207590000001, 2024-09-12T16:18:48.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045864239000000001, 2024-09-12T16:18:48.105 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:48.105 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:48.105 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:48.105 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:48.105 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:48.105 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:48.105 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11274 2024-09-12T16:18:48.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.105 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:48.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:48.105 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883385+0000", 2024-09-12T16:18:48.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:48.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883385+0000", 2024-09-12T16:18:48.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:48.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883385+0000", 2024-09-12T16:18:48.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4799999999999999e-07 2024-09-12T16:18:48.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:48.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883388+0000", 2024-09-12T16:18:48.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3199999999999998e-06 2024-09-12T16:18:48.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:48.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883394+0000", 2024-09-12T16:18:48.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2020000000000001e-06 2024-09-12T16:18:48.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:48.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883400+0000", 2024-09-12T16:18:48.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8510000000000004e-06 2024-09-12T16:18:48.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:48.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929123+0000", 2024-09-12T16:18:48.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045723235000000001 2024-09-12T16:18:48.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:48.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929166+0000", 2024-09-12T16:18:48.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2769999999999999e-05 2024-09-12T16:18:48.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:48.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929249+0000", 2024-09-12T16:18:48.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3412999999999996e-05 2024-09-12T16:18:48.109 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.109 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:48.109 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.109 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11275 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3371008~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:48.109 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883416+0000", 2024-09-12T16:18:48.109 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 54.162175980999997, 2024-09-12T16:18:48.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.046042315, 2024-09-12T16:18:48.109 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:48.109 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:48.109 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:48.109 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:48.109 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:48.110 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:48.110 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11275 2024-09-12T16:18:48.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.110 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:48.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:48.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883416+0000", 2024-09-12T16:18:48.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:48.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883416+0000", 2024-09-12T16:18:48.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:48.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883417+0000", 2024-09-12T16:18:48.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4700000000000001e-07 2024-09-12T16:18:48.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:48.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883419+0000", 2024-09-12T16:18:48.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2029999999999999e-06 2024-09-12T16:18:48.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:48.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883426+0000", 2024-09-12T16:18:48.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.579e-06 2024-09-12T16:18:48.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.112 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:48.112 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883431+0000", 2024-09-12T16:18:48.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5679999999999999e-06 2024-09-12T16:18:48.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.112 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:48.112 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929290+0000", 2024-09-12T16:18:48.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045858227000000001 2024-09-12T16:18:48.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.112 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:48.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929365+0000", 2024-09-12T16:18:48.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5519999999999995e-05 2024-09-12T16:18:48.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:48.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929459+0000", 2024-09-12T16:18:48.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3671000000000005e-05 2024-09-12T16:18:48.113 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.113 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:48.113 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.113 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11276 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3420160~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:48.113 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883439+0000", 2024-09-12T16:18:48.114 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 54.162153578000002, 2024-09-12T16:18:48.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.046138991999999997, 2024-09-12T16:18:48.114 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:48.114 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:48.114 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:48.114 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:48.114 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:48.114 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:48.114 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11276 2024-09-12T16:18:48.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.114 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:48.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:48.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883439+0000", 2024-09-12T16:18:48.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.115 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:48.115 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883439+0000", 2024-09-12T16:18:48.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.115 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:48.115 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883560+0000", 2024-09-12T16:18:48.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121229 2024-09-12T16:18:48.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.115 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:48.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883569+0000", 2024-09-12T16:18:48.116 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9390000000000003e-06 2024-09-12T16:18:48.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:48.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883579+0000", 2024-09-12T16:18:48.116 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8859999999999999e-06 2024-09-12T16:18:48.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:48.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883585+0000", 2024-09-12T16:18:48.116 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.545e-06 2024-09-12T16:18:48.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.117 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:48.117 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929486+0000", 2024-09-12T16:18:48.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.045900653999999999 2024-09-12T16:18:48.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.117 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:48.117 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929527+0000", 2024-09-12T16:18:48.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0707999999999997e-05 2024-09-12T16:18:48.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.117 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:48.117 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929578+0000", 2024-09-12T16:18:48.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1031e-05 2024-09-12T16:18:48.117 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.118 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:48.118 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.118 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.5883.0:11277 3.19 3:9ce8debe:::rbd_data.1155d3b3a2ae.0000000000000002:28 [read 3469312~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e109)", 2024-09-12T16:18:48.118 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:17:53.883595+0000", 2024-09-12T16:18:48.118 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 54.161997235000001, 2024-09-12T16:18:48.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.046187702999999997, 2024-09-12T16:18:48.118 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:48.118 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:48.118 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T16:18:48.118 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:48.118 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.5883", 2024-09-12T16:18:48.118 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2116700423", 2024-09-12T16:18:48.119 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 11277 2024-09-12T16:18:48.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.119 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:48.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:48.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883595+0000", 2024-09-12T16:18:48.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:48.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.883595+0000", 2024-09-12T16:18:48.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.120 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.120 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:48.120 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.889065+0000", 2024-09-12T16:18:48.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00547001 2024-09-12T16:18:48.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.120 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.120 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:48.120 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.889069+0000", 2024-09-12T16:18:48.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1180000000000002e-06 2024-09-12T16:18:48.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.120 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.120 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:48.120 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.889079+0000", 2024-09-12T16:18:48.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2250000000000006e-06 2024-09-12T16:18:48.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:48.121 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.889084+0000", 2024-09-12T16:18:48.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2680000000000002e-06 2024-09-12T16:18:48.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:48.121 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929612+0000", 2024-09-12T16:18:48.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040528343000000001 2024-09-12T16:18:48.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T16:18:48.121 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929691+0000", 2024-09-12T16:18:48.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8541999999999994e-05 2024-09-12T16:18:48.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:48.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:17:53.929783+0000", 2024-09-12T16:18:48.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2196999999999998e-05 2024-09-12T16:18:48.122 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.122 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:48.122 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.122 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:27683 3.1 3.d6dd1621 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e127)", 2024-09-12T16:18:48.122 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:15.196201+0000", 2024-09-12T16:18:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 32.849391556999997, 2024-09-12T16:18:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.91402251499999998, 2024-09-12T16:18:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:18:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:18:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:18:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 27683 2024-09-12T16:18:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196201+0000", 2024-09-12T16:18:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.124 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:48.124 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196201+0000", 2024-09-12T16:18:48.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.124 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:48.124 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196202+0000", 2024-09-12T16:18:48.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4929999999999999e-06 2024-09-12T16:18:48.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.124 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:48.125 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196209+0000", 2024-09-12T16:18:48.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2269999999999998e-06 2024-09-12T16:18:48.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:48.125 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196221+0000", 2024-09-12T16:18:48.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2517000000000001e-05 2024-09-12T16:18:48.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:48.125 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196229+0000", 2024-09-12T16:18:48.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3250000000000008e-06 2024-09-12T16:18:48.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.126 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:48.126 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196293+0000", 2024-09-12T16:18:48.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3975999999999999e-05 2024-09-12T16:18:48.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.126 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T16:18:48.126 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.196299+0000", 2024-09-12T16:18:48.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3000000000000001e-06 2024-09-12T16:18:48.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.126 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:48.126 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110210+0000", 2024-09-12T16:18:48.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.91391175099999999 2024-09-12T16:18:48.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.127 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:48.127 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110223+0000", 2024-09-12T16:18:48.127 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2926e-05 2024-09-12T16:18:48.127 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.127 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:48.127 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.127 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:27740 3.1 3.859365c1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e127)", 2024-09-12T16:18:48.127 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:15.209778+0000", 2024-09-12T16:18:48.127 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 32.835814427999999, 2024-09-12T16:18:48.127 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.90059554500000005, 2024-09-12T16:18:48.128 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:48.128 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:48.128 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:18:48.128 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:48.128 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:18:48.128 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:18:48.128 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 27740 2024-09-12T16:18:48.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.128 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:48.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.128 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:48.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209778+0000", 2024-09-12T16:18:48.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.129 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:48.129 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209778+0000", 2024-09-12T16:18:48.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.129 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:48.129 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209779+0000", 2024-09-12T16:18:48.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.274e-06 2024-09-12T16:18:48.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.129 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:48.129 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209785+0000", 2024-09-12T16:18:48.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3310000000000003e-06 2024-09-12T16:18:48.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.130 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:48.130 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209799+0000", 2024-09-12T16:18:48.130 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.448e-05 2024-09-12T16:18:48.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.130 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:48.130 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209806+0000", 2024-09-12T16:18:48.130 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3479999999999998e-06 2024-09-12T16:18:48.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.130 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:48.131 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209864+0000", 2024-09-12T16:18:48.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7395999999999997e-05 2024-09-12T16:18:48.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.131 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T16:18:48.131 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.209871+0000", 2024-09-12T16:18:48.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1149999999999996e-06 2024-09-12T16:18:48.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.131 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:48.131 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110360+0000", 2024-09-12T16:18:48.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.90048930100000002 2024-09-12T16:18:48.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:48.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110374+0000", 2024-09-12T16:18:48.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.33e-05 2024-09-12T16:18:48.132 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.132 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:48.132 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.132 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:27742 3.1 3.d09829a1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e127)", 2024-09-12T16:18:48.132 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:15.210634+0000", 2024-09-12T16:18:48.132 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 32.834957932000002, 2024-09-12T16:18:48.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.89977736500000005, 2024-09-12T16:18:48.132 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:48.132 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:48.133 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:18:48.133 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:48.133 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:18:48.133 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:18:48.133 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 27742 2024-09-12T16:18:48.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.133 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:48.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.133 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:48.133 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210634+0000", 2024-09-12T16:18:48.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210634+0000", 2024-09-12T16:18:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210635+0000", 2024-09-12T16:18:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8100000000000001e-07 2024-09-12T16:18:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210641+0000", 2024-09-12T16:18:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.429e-06 2024-09-12T16:18:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210656+0000", 2024-09-12T16:18:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5557e-05 2024-09-12T16:18:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210663+0000", 2024-09-12T16:18:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5930000000000002e-06 2024-09-12T16:18:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210713+0000", 2024-09-12T16:18:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0488000000000002e-05 2024-09-12T16:18:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T16:18:48.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.210722+0000", 2024-09-12T16:18:48.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0790000000000001e-06 2024-09-12T16:18:48.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:48.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110403+0000", 2024-09-12T16:18:48.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.89968195799999995 2024-09-12T16:18:48.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:48.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110412+0000", 2024-09-12T16:18:48.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3799999999999994e-06 2024-09-12T16:18:48.137 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.137 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:48.137 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.137 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4437.0:27745 3.1 3.36f5b621 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e127)", 2024-09-12T16:18:48.137 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T16:18:15.211355+0000", 2024-09-12T16:18:48.137 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 32.834237330000001, 2024-09-12T16:18:48.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.89909103999999995, 2024-09-12T16:18:48.137 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T16:18:48.137 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T16:18:48.137 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T16:18:48.137 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T16:18:48.138 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4437", 2024-09-12T16:18:48.138 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.204:0/2323089147", 2024-09-12T16:18:48.138 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 27745 2024-09-12T16:18:48.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.138 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T16:18:48.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.138 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T16:18:48.138 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211355+0000", 2024-09-12T16:18:48.138 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.138 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T16:18:48.138 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211355+0000", 2024-09-12T16:18:48.138 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T16:18:48.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.139 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T16:18:48.139 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211356+0000", 2024-09-12T16:18:48.139 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9599999999999998e-07 2024-09-12T16:18:48.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.139 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T16:18:48.139 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211360+0000", 2024-09-12T16:18:48.139 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0419999999999996e-06 2024-09-12T16:18:48.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T16:18:48.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211373+0000", 2024-09-12T16:18:48.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3183000000000001e-05 2024-09-12T16:18:48.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T16:18:48.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211381+0000", 2024-09-12T16:18:48.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0499999999999992e-06 2024-09-12T16:18:48.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:48.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211438+0000", 2024-09-12T16:18:48.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6576999999999997e-05 2024-09-12T16:18:48.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T16:18:48.141 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:15.211445+0000", 2024-09-12T16:18:48.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.391e-06 2024-09-12T16:18:48.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T16:18:48.141 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110437+0000", 2024-09-12T16:18:48.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.898991977 2024-09-12T16:18:48.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T16:18:48.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T16:18:48.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T16:18:48.141 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T16:18:16.110446+0000", 2024-09-12T16:18:48.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0240000000000003e-06 2024-09-12T16:18:48.142 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.142 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:48.142 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.142 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T16:18:48.142 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T16:18:48.142 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:48.143 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:18:48.144 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:48.142+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:48.157 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T16:18:48.244 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:48.243+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:48.296 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:18:48.296 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:18:48.296 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:18:48.297 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:18:48.304 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T16:18:48.308 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:18:48.323 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T16:18:48.323 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T16:18:48.341 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T16:18:48.341 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T16:18:48.345 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:48.343+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:48.360 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T16:18:48.360 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T16:18:48.377 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T16:18:48.377 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T16:18:48.394 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T16:18:48.394 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T16:18:48.397 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T16:18:48.397 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T16:18:48.417 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:48.417 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:48.426 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:18:48.445 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:48.444+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:48.546 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:48.545+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:48.575 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:48.575 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:48.585 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:18:48.630 INFO:teuthology.orchestra.run.smithi017.stdout: marking collection for removal 2024-09-12T16:18:48.630 INFO:teuthology.orchestra.run.smithi017.stdout:setting '_remove' omap key 2024-09-12T16:18:48.631 INFO:teuthology.orchestra.run.smithi017.stdout:finish_remove_pgs 3.1b_head removing 3.1b 2024-09-12T16:18:48.633 INFO:teuthology.orchestra.run.smithi017.stdout:Remove successful 2024-09-12T16:18:48.647 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:48.646+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:48.707 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:48.707 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:48.717 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:18:48.760 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:48.757+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:48.849 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:48.848+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:48.869 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:48.869 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:48.878 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:18:48.964 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:48.961+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:49.029 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:49.029 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:49.039 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T16:18:49.040 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:18:49.082 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:49.081+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:49.153 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --data-path /var/lib/ceph/osd/ceph-0 --journal-path /var/lib/ceph/osd/ceph-0/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.3.1b.0 2024-09-12T16:18:49.153 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:49.151+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:49.198 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:49.198 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:49.207 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:18:49.253 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:49.252+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:49.314 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:49.314 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:49.323 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:18:49.364 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-09-12T16:18:49.363+0000 7f1c6fba1640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32208) UID: 0 2024-09-12T16:18:49.455 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:49.454+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:49.470 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:49.470 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:49.479 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:18:49.556 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:49.555+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:49.586 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:49.586 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:49.595 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:18:49.679 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:49.678+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:49.743 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:49.743 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:49.752 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:18:49.758 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T16:18:49.757+0000 7fc51c8fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32117) UID: 0 2024-09-12T16:18:49.859 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T16:18:49.858+0000 7f0b6e673640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32122) UID: 0 2024-09-12T16:18:49.899 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:49.900 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:49.908 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T16:18:49.959 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T16:18:49.958+0000 7fb45b60e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 40918) UID: 0 2024-09-12T16:18:50.017 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-12T16:18:50.033 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:50.033 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:50.044 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T16:18:50.060 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T16:18:50.059+0000 7f97b2f69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32209) UID: 0 2024-09-12T16:18:50.121 INFO:teuthology.orchestra.run.smithi204.stdout:All operations completed A-OK! 2024-09-12T16:18:50.133 DEBUG:teuthology.parallel:result is None 2024-09-12T16:18:50.133 DEBUG:teuthology.run_tasks:Unwinding manager rbd_fsx 2024-09-12T16:18:50.142 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-12T16:18:50.151 INFO:tasks.thrashosds:joining thrashosds 2024-09-12T16:18:50.201 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:50.201 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:50.210 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T16:18:50.318 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:50.318 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:50.326 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T16:18:50.434 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:50.434 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:50.442 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T16:18:50.549 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:50.549 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:50.558 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T16:18:50.664 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:50.664 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:50.674 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T16:18:50.793 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:50.793 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:50.802 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T16:18:50.910 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:50.910 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:50.918 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T16:18:51.026 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:51.026 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:51.034 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T16:18:51.101 INFO:teuthology.orchestra.run.smithi017.stdout:get_pg_num_history pg_num_history pg_num_history(e156 pg_nums {1={13=1},2={16=8},3={21=32}} deleted_pools ) 2024-09-12T16:18:51.101 INFO:teuthology.orchestra.run.smithi017.stdout:Importing pgid 3.1b 2024-09-12T16:18:51.103 INFO:teuthology.orchestra.run.smithi017.stdout:Write #3:d8554148:::rbd_data.11552a15f591.0000000000000095:head# 2024-09-12T16:18:51.103 INFO:teuthology.orchestra.run.smithi017.stdout:snapset 1e=[]:{} 2024-09-12T16:18:51.103 INFO:teuthology.orchestra.run.smithi017.stdout:Write #3:d90f3791:::rbd_data.11552a15f591.0000000000000068:head# 2024-09-12T16:18:51.103 INFO:teuthology.orchestra.run.smithi017.stdout:snapset 1e=[]:{} 2024-09-12T16:18:51.104 INFO:teuthology.orchestra.run.smithi017.stdout:Write #3:d936ad2f:::rbd_data.11552a15f591.0000000000000043:head# 2024-09-12T16:18:51.104 INFO:teuthology.orchestra.run.smithi017.stdout:snapset 1e=[]:{} 2024-09-12T16:18:51.104 INFO:teuthology.orchestra.run.smithi017.stdout:Write #3:da28d2b0:::rbd_data.1155463b02f1.000000000000005d:head# 2024-09-12T16:18:51.104 INFO:teuthology.orchestra.run.smithi017.stdout:snapset 14=[]:{} 2024-09-12T16:18:51.105 INFO:teuthology.orchestra.run.smithi017.stdout:Write #3:da41e9b8:::rbd_data.11552a15f591.000000000000005a:head# 2024-09-12T16:18:51.105 INFO:teuthology.orchestra.run.smithi017.stdout:snapset 1e=[]:{} 2024-09-12T16:18:51.105 INFO:teuthology.orchestra.run.smithi017.stdout:Write #3:da7137f5:::rbd_data.11552a15f591.0000000000000063:head# 2024-09-12T16:18:51.105 INFO:teuthology.orchestra.run.smithi017.stdout:snapset 1e=[]:{} 2024-09-12T16:18:51.105 INFO:teuthology.orchestra.run.smithi017.stdout:Write #3:da7eb35d:::rbd_data.11557ed36bb5.00000000000000b0:head# 2024-09-12T16:18:51.105 INFO:teuthology.orchestra.run.smithi017.stdout:snapset 0=[]:{} 2024-09-12T16:18:51.105 INFO:teuthology.orchestra.run.smithi017.stdout:Write #3:da856c6c:::rbd_data.1155b4d1eca0.0000000000000113:head# 2024-09-12T16:18:51.105 INFO:teuthology.orchestra.run.smithi017.stdout:snapset 11=[]:{} 2024-09-12T16:18:51.105 INFO:teuthology.orchestra.run.smithi017.stdout:Write #3:da9fab25:::rbd_data.1155b4d1eca0.000000000000012a:head# 2024-09-12T16:18:51.106 INFO:teuthology.orchestra.run.smithi017.stdout:snapset 11=[]:{} 2024-09-12T16:18:51.106 INFO:teuthology.orchestra.run.smithi017.stdout:Write #3:dc1d99df:::rbd_data.1155463b02f1.000000000000004b:head# 2024-09-12T16:18:51.106 INFO:teuthology.orchestra.run.smithi017.stdout:snapset 14=[]:{} 2024-09-12T16:18:51.107 INFO:teuthology.orchestra.run.smithi017.stdout:Write #3:dc550107:::rbd_data.1155b4d1eca0.0000000000000073:head# 2024-09-12T16:18:51.107 INFO:teuthology.orchestra.run.smithi017.stdout:snapset 11=[]:{} 2024-09-12T16:18:51.107 INFO:teuthology.orchestra.run.smithi017.stdout:Write #3:dc6deea6:::rbd_data.1155b4d1eca0.000000000000006f:head# 2024-09-12T16:18:51.107 INFO:teuthology.orchestra.run.smithi017.stdout:snapset 11=[]:{} 2024-09-12T16:18:51.107 INFO:teuthology.orchestra.run.smithi017.stdout:Write #3:dc89eb30:::rbd_data.11557ed36bb5.000000000000003e:head# 2024-09-12T16:18:51.107 INFO:teuthology.orchestra.run.smithi017.stdout:snapset 0=[]:{} 2024-09-12T16:18:51.107 INFO:teuthology.orchestra.run.smithi017.stdout:Write #3:dce4f678:::rbd_data.1155b4d1eca0.00000000000000a0:head# 2024-09-12T16:18:51.107 INFO:teuthology.orchestra.run.smithi017.stdout:snapset 11=[]:{} 2024-09-12T16:18:51.107 INFO:teuthology.orchestra.run.smithi017.stdout:Write #3:df29696e:::rbd_data.1155c757bf36.0000000000000034:head# 2024-09-12T16:18:51.107 INFO:teuthology.orchestra.run.smithi017.stdout:snapset 21=[]:{} 2024-09-12T16:18:51.107 INFO:teuthology.orchestra.run.smithi017.stdout:Write #3:dfd58a31:::rbd_data.1155525b14e3.0000000000000038:head# 2024-09-12T16:18:51.108 INFO:teuthology.orchestra.run.smithi017.stdout:snapset f=[]:{} 2024-09-12T16:18:51.108 INFO:teuthology.orchestra.run.smithi017.stdout:write_pg epoch 156 info 3.1b( v 154'1252 (0'0,154'1252] local-lis/les=84/85 n=16 ec=21/21 lis/c=84/84 les/c/f=85/85/0 sis=84) 2024-09-12T16:18:51.117 INFO:teuthology.orchestra.run.smithi017.stdout:Import successful 2024-09-12T16:18:51.141 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:51.142 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:51.150 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T16:18:51.258 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:51.259 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:51.267 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T16:18:51.375 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:51.375 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:51.383 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T16:18:51.491 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:51.491 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:51.500 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T16:18:51.607 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:51.608 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:51.616 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T16:18:51.625 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f /var/log/ceph/exp.3.1b.0 2024-09-12T16:18:51.726 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T16:18:51.727 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T16:18:52.036 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T16:18:53.229 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-12T16:18:53.247 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T16:18:54.231 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2024-09-12T16:18:56.655 INFO:tasks.thrashosds.thrasher:reviving osd 2024-09-12T16:18:56.656 INFO:tasks.thrashosds.thrasher:Reviving osd 0 2024-09-12T16:18:56.656 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T16:18:56.656 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T16:18:56.659 INFO:tasks.ceph.osd.0:Started 2024-09-12T16:18:56.659 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:18:56.772 INFO:teuthology.orchestra.run.smithi017.stderr:no valid command found; 10 closest matches: 2024-09-12T16:18:56.773 INFO:teuthology.orchestra.run.smithi017.stderr:0 2024-09-12T16:18:56.773 INFO:teuthology.orchestra.run.smithi017.stderr:1 2024-09-12T16:18:56.773 INFO:teuthology.orchestra.run.smithi017.stderr:2 2024-09-12T16:18:56.773 INFO:teuthology.orchestra.run.smithi017.stderr:abort 2024-09-12T16:18:56.773 INFO:teuthology.orchestra.run.smithi017.stderr:assert 2024-09-12T16:18:56.773 INFO:teuthology.orchestra.run.smithi017.stderr:config diff 2024-09-12T16:18:56.773 INFO:teuthology.orchestra.run.smithi017.stderr:config diff get 2024-09-12T16:18:56.773 INFO:teuthology.orchestra.run.smithi017.stderr:config get 2024-09-12T16:18:56.773 INFO:teuthology.orchestra.run.smithi017.stderr:config help [] 2024-09-12T16:18:56.773 INFO:teuthology.orchestra.run.smithi017.stderr:config set ... 2024-09-12T16:18:56.773 INFO:teuthology.orchestra.run.smithi017.stderr:admin_socket: invalid command 2024-09-12T16:18:56.775 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T16:18:56.775 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-12T16:18:57.590 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:18:57.589+0000 7f9f31615640 -1 Falling back to public interface 2024-09-12T16:19:01.437 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:19:01.436+0000 7f9f31615640 -1 osd.0 156 log_to_monitors true 2024-09-12T16:19:01.774 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T16:19:01.773+0000 7f9f24d45640 -1 osd.0 165 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T16:19:01.776 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T16:19:01.889 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:19:01.889 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T16:19:01.889 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T16:19:01.889 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:19:01.899 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-12T16:19:02.014 INFO:teuthology.orchestra.run.smithi017.stdout:mon.a: {} 2024-09-12T16:19:02.014 INFO:teuthology.orchestra.run.smithi017.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T16:19:02.024 INFO:teuthology.orchestra.run.smithi017.stdout:mon.b: {} 2024-09-12T16:19:02.024 INFO:teuthology.orchestra.run.smithi017.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T16:19:02.032 INFO:teuthology.orchestra.run.smithi017.stdout:mon.c: {} 2024-09-12T16:19:02.033 INFO:teuthology.orchestra.run.smithi017.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T16:19:02.043 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-12T16:19:02.765 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.1 to 1 (10000) 2024-09-12T16:19:02.784 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-12T16:19:03.766 INFO:teuthology.orchestra.run.smithi017.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-12T16:19:03.793 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-12T16:19:04.771 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.2 to 1 (10000) 2024-09-12T16:19:04.788 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-12T16:19:05.777 INFO:teuthology.orchestra.run.smithi017.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-12T16:19:05.794 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-12T16:19:06.779 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.3 to 1 (10000) 2024-09-12T16:19:06.798 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-12T16:19:07.785 INFO:teuthology.orchestra.run.smithi017.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-12T16:19:07.803 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-12T16:19:08.790 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.4 to 1 (10000) 2024-09-12T16:19:08.808 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-09-12T16:19:09.796 INFO:teuthology.orchestra.run.smithi017.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-09-12T16:19:09.817 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-12T16:19:10.801 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.5 to 1 (10000) 2024-09-12T16:19:10.819 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-12T16:19:11.810 INFO:teuthology.orchestra.run.smithi017.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-12T16:19:11.828 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-12T16:19:12.815 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.0 to 1 (10000) 2024-09-12T16:19:12.835 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-12T16:19:14.018 INFO:teuthology.orchestra.run.smithi017.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-12T16:19:14.036 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-12T16:19:14.036 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-12T16:19:14.036 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-12T16:19:14.036 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-12T16:19:14.036 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T16:19:14.036 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T16:19:14.342 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:19:14.342 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":178,"fsid":"66dcb8ed-8de5-4784-8071-fd6b3bf3b78f","created":"2024-09-12T16:15:28.208893+0000","modified":"2024-09-12T16:19:14.017315+0000","last_up_change":"2024-09-12T16:19:02.757214+0000","last_in_change":"2024-09-12T16:18:21.117144+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T16:15:40.677216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T16:15:45.306180+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-12T16:15:55.082975+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":43,"snap_epoch":162,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aabea24b-3f1f-4555-80c3-5caecf2e2001","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":11,"last_clean_end":156,"up_from":166,"up_thru":166,"down_at":157,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":2288624473},{"type":"v1","addr":"172.21.15.17:6801","nonce":2288624473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":2288624473},{"type":"v1","addr":"172.21.15.17:6803","nonce":2288624473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":2288624473},{"type":"v1","addr":"172.21.15.17:6807","nonce":2288624473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":2288624473},{"type":"v1","addr":"172.21.15.17:6805","nonce":2288624473}]},"public_addr":"172.21.15.17:6801/2288624473","cluster_addr":"172.21.15.17:6803/2288624473","heartbeat_back_addr":"172.21.15.17:6807/2288624473","heartbeat_front_addr":"172.21.15.17:6805/2288624473","state":["exists","up"]},{"osd":1,"uuid":"7a17ca3b-8e49-4d92-a633-45d3e4a45b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":3906173234},{"type":"v1","addr":"172.21.15.17:6809","nonce":3906173234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3906173234},{"type":"v1","addr":"172.21.15.17:6811","nonce":3906173234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3906173234},{"type":"v1","addr":"172.21.15.17:6815","nonce":3906173234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3906173234},{"type":"v1","addr":"172.21.15.17:6813","nonce":3906173234}]},"public_addr":"172.21.15.17:6809/3906173234","cluster_addr":"172.21.15.17:6811/3906173234","heartbeat_back_addr":"172.21.15.17:6815/3906173234","heartbeat_front_addr":"172.21.15.17:6813/3906173234","state":["exists","up"]},{"osd":2,"uuid":"dae09a32-24c6-464c-bee8-04ef2c42f7e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1974346628},{"type":"v1","addr":"172.21.15.17:6817","nonce":1974346628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":1974346628},{"type":"v1","addr":"172.21.15.17:6819","nonce":1974346628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":1974346628},{"type":"v1","addr":"172.21.15.17:6823","nonce":1974346628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":1974346628},{"type":"v1","addr":"172.21.15.17:6821","nonce":1974346628}]},"public_addr":"172.21.15.17:6817/1974346628","cluster_addr":"172.21.15.17:6819/1974346628","heartbeat_back_addr":"172.21.15.17:6823/1974346628","heartbeat_front_addr":"172.21.15.17:6821/1974346628","state":["exists","up"]},{"osd":3,"uuid":"9cc5463c-cdb4-4a6a-b526-39a60de417f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3370202675},{"type":"v1","addr":"172.21.15.47:6809","nonce":3370202675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3370202675},{"type":"v1","addr":"172.21.15.47:6811","nonce":3370202675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3370202675},{"type":"v1","addr":"172.21.15.47:6815","nonce":3370202675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3370202675},{"type":"v1","addr":"172.21.15.47:6813","nonce":3370202675}]},"public_addr":"172.21.15.47:6809/3370202675","cluster_addr":"172.21.15.47:6811/3370202675","heartbeat_back_addr":"172.21.15.47:6815/3370202675","heartbeat_front_addr":"172.21.15.47:6813/3370202675","state":["exists","up"]},{"osd":4,"uuid":"1e329af3-a88a-4a95-b822-01519079084b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":1823488259},{"type":"v1","addr":"172.21.15.47:6817","nonce":1823488259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1823488259},{"type":"v1","addr":"172.21.15.47:6819","nonce":1823488259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1823488259},{"type":"v1","addr":"172.21.15.47:6823","nonce":1823488259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1823488259},{"type":"v1","addr":"172.21.15.47:6821","nonce":1823488259}]},"public_addr":"172.21.15.47:6817/1823488259","cluster_addr":"172.21.15.47:6819/1823488259","heartbeat_back_addr":"172.21.15.47:6823/1823488259","heartbeat_front_addr":"172.21.15.47:6821/1823488259","state":["exists","up"]},{"osd":5,"uuid":"c255a252-3afe-4aad-b44c-85820867c960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":11,"last_clean_end":35,"up_from":71,"up_thru":175,"down_at":37,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":2087971028},{"type":"v1","addr":"172.21.15.47:6801","nonce":2087971028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2087971028},{"type":"v1","addr":"172.21.15.47:6803","nonce":2087971028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2087971028},{"type":"v1","addr":"172.21.15.47:6807","nonce":2087971028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2087971028},{"type":"v1","addr":"172.21.15.47:6805","nonce":2087971028}]},"public_addr":"172.21.15.47:6801/2087971028","cluster_addr":"172.21.15.47:6803/2087971028","heartbeat_back_addr":"172.21.15.47:6807/2087971028","heartbeat_front_addr":"172.21.15.47:6805/2087971028","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:15:35.752566+0000","dead_epoch":157},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:15:36.269665+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:15:36.524745+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:15:36.095607+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:15:36.294055+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:15:36.092708+0000","dead_epoch":37}],"pg_upmap":[{"pgid":"2.1","osds":[2,3]},{"pgid":"3.1","osds":[1,0]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T16:19:14.355 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T16:19:14.355 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T16:19:14.653 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:19:14.654 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":178,"fsid":"66dcb8ed-8de5-4784-8071-fd6b3bf3b78f","created":"2024-09-12T16:15:28.208893+0000","modified":"2024-09-12T16:19:14.017315+0000","last_up_change":"2024-09-12T16:19:02.757214+0000","last_in_change":"2024-09-12T16:18:21.117144+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T16:15:40.677216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T16:15:45.306180+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-12T16:15:55.082975+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":43,"snap_epoch":162,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aabea24b-3f1f-4555-80c3-5caecf2e2001","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":11,"last_clean_end":156,"up_from":166,"up_thru":166,"down_at":157,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":2288624473},{"type":"v1","addr":"172.21.15.17:6801","nonce":2288624473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":2288624473},{"type":"v1","addr":"172.21.15.17:6803","nonce":2288624473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":2288624473},{"type":"v1","addr":"172.21.15.17:6807","nonce":2288624473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":2288624473},{"type":"v1","addr":"172.21.15.17:6805","nonce":2288624473}]},"public_addr":"172.21.15.17:6801/2288624473","cluster_addr":"172.21.15.17:6803/2288624473","heartbeat_back_addr":"172.21.15.17:6807/2288624473","heartbeat_front_addr":"172.21.15.17:6805/2288624473","state":["exists","up"]},{"osd":1,"uuid":"7a17ca3b-8e49-4d92-a633-45d3e4a45b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":3906173234},{"type":"v1","addr":"172.21.15.17:6809","nonce":3906173234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3906173234},{"type":"v1","addr":"172.21.15.17:6811","nonce":3906173234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3906173234},{"type":"v1","addr":"172.21.15.17:6815","nonce":3906173234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3906173234},{"type":"v1","addr":"172.21.15.17:6813","nonce":3906173234}]},"public_addr":"172.21.15.17:6809/3906173234","cluster_addr":"172.21.15.17:6811/3906173234","heartbeat_back_addr":"172.21.15.17:6815/3906173234","heartbeat_front_addr":"172.21.15.17:6813/3906173234","state":["exists","up"]},{"osd":2,"uuid":"dae09a32-24c6-464c-bee8-04ef2c42f7e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1974346628},{"type":"v1","addr":"172.21.15.17:6817","nonce":1974346628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":1974346628},{"type":"v1","addr":"172.21.15.17:6819","nonce":1974346628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":1974346628},{"type":"v1","addr":"172.21.15.17:6823","nonce":1974346628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":1974346628},{"type":"v1","addr":"172.21.15.17:6821","nonce":1974346628}]},"public_addr":"172.21.15.17:6817/1974346628","cluster_addr":"172.21.15.17:6819/1974346628","heartbeat_back_addr":"172.21.15.17:6823/1974346628","heartbeat_front_addr":"172.21.15.17:6821/1974346628","state":["exists","up"]},{"osd":3,"uuid":"9cc5463c-cdb4-4a6a-b526-39a60de417f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3370202675},{"type":"v1","addr":"172.21.15.47:6809","nonce":3370202675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3370202675},{"type":"v1","addr":"172.21.15.47:6811","nonce":3370202675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3370202675},{"type":"v1","addr":"172.21.15.47:6815","nonce":3370202675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3370202675},{"type":"v1","addr":"172.21.15.47:6813","nonce":3370202675}]},"public_addr":"172.21.15.47:6809/3370202675","cluster_addr":"172.21.15.47:6811/3370202675","heartbeat_back_addr":"172.21.15.47:6815/3370202675","heartbeat_front_addr":"172.21.15.47:6813/3370202675","state":["exists","up"]},{"osd":4,"uuid":"1e329af3-a88a-4a95-b822-01519079084b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":1823488259},{"type":"v1","addr":"172.21.15.47:6817","nonce":1823488259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1823488259},{"type":"v1","addr":"172.21.15.47:6819","nonce":1823488259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1823488259},{"type":"v1","addr":"172.21.15.47:6823","nonce":1823488259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1823488259},{"type":"v1","addr":"172.21.15.47:6821","nonce":1823488259}]},"public_addr":"172.21.15.47:6817/1823488259","cluster_addr":"172.21.15.47:6819/1823488259","heartbeat_back_addr":"172.21.15.47:6823/1823488259","heartbeat_front_addr":"172.21.15.47:6821/1823488259","state":["exists","up"]},{"osd":5,"uuid":"c255a252-3afe-4aad-b44c-85820867c960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":11,"last_clean_end":35,"up_from":71,"up_thru":175,"down_at":37,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":2087971028},{"type":"v1","addr":"172.21.15.47:6801","nonce":2087971028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2087971028},{"type":"v1","addr":"172.21.15.47:6803","nonce":2087971028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2087971028},{"type":"v1","addr":"172.21.15.47:6807","nonce":2087971028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2087971028},{"type":"v1","addr":"172.21.15.47:6805","nonce":2087971028}]},"public_addr":"172.21.15.47:6801/2087971028","cluster_addr":"172.21.15.47:6803/2087971028","heartbeat_back_addr":"172.21.15.47:6807/2087971028","heartbeat_front_addr":"172.21.15.47:6805/2087971028","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:15:35.752566+0000","dead_epoch":157},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:15:36.269665+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:15:36.524745+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:15:36.095607+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:15:36.294055+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:15:36.092708+0000","dead_epoch":37}],"pg_upmap":[{"pgid":"2.1","osds":[2,3]},{"pgid":"3.1","osds":[1,0]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T16:19:14.669 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T16:19:14.669 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T16:19:14.670 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T16:19:14.671 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T16:19:14.671 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T16:19:14.671 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T16:19:14.834 INFO:teuthology.orchestra.run.smithi017.stdout:47244640304 2024-09-12T16:19:14.834 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T16:19:14.835 INFO:teuthology.orchestra.run.smithi017.stdout:304942678044 2024-09-12T16:19:14.836 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T16:19:14.876 INFO:teuthology.orchestra.run.smithi017.stdout:47244640303 2024-09-12T16:19:14.876 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T16:19:14.885 INFO:teuthology.orchestra.run.smithi017.stdout:47244640305 2024-09-12T16:19:14.886 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T16:19:14.886 INFO:teuthology.orchestra.run.smithi017.stdout:712964571140 2024-09-12T16:19:14.887 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T16:19:14.895 INFO:teuthology.orchestra.run.smithi017.stdout:47244640303 2024-09-12T16:19:14.896 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T16:19:15.225 INFO:teuthology.orchestra.run.smithi017.stdout:47244640303 2024-09-12T16:19:15.240 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640304 got 47244640303 for osd.3 2024-09-12T16:19:15.292 INFO:teuthology.orchestra.run.smithi017.stdout:712964571139 2024-09-12T16:19:15.305 INFO:tasks.ceph.ceph_manager.ceph:need seq 712964571140 got 712964571139 for osd.0 2024-09-12T16:19:15.369 INFO:teuthology.orchestra.run.smithi017.stdout:304942678043 2024-09-12T16:19:15.386 INFO:tasks.ceph.ceph_manager.ceph:need seq 304942678044 got 304942678043 for osd.5 2024-09-12T16:19:15.386 INFO:teuthology.orchestra.run.smithi017.stdout:47244640303 2024-09-12T16:19:15.393 INFO:teuthology.orchestra.run.smithi017.stdout:47244640301 2024-09-12T16:19:15.400 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640305 got 47244640303 for osd.2 2024-09-12T16:19:15.407 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640303 got 47244640301 for osd.1 2024-09-12T16:19:15.431 INFO:teuthology.orchestra.run.smithi017.stdout:47244640302 2024-09-12T16:19:15.444 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640303 got 47244640302 for osd.4 2024-09-12T16:19:16.241 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T16:19:16.306 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T16:19:16.387 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T16:19:16.401 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T16:19:16.407 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T16:19:16.444 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T16:19:16.646 INFO:teuthology.orchestra.run.smithi017.stdout:47244640303 2024-09-12T16:19:16.665 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640304 got 47244640303 for osd.3 2024-09-12T16:19:16.709 INFO:teuthology.orchestra.run.smithi017.stdout:712964571139 2024-09-12T16:19:16.725 INFO:tasks.ceph.ceph_manager.ceph:need seq 712964571140 got 712964571139 for osd.0 2024-09-12T16:19:16.823 INFO:teuthology.orchestra.run.smithi017.stdout:47244640301 2024-09-12T16:19:16.826 INFO:teuthology.orchestra.run.smithi017.stdout:47244640303 2024-09-12T16:19:16.838 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640303 got 47244640301 for osd.1 2024-09-12T16:19:16.841 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640305 got 47244640303 for osd.2 2024-09-12T16:19:16.854 INFO:teuthology.orchestra.run.smithi017.stdout:304942678043 2024-09-12T16:19:16.867 INFO:tasks.ceph.ceph_manager.ceph:need seq 304942678044 got 304942678043 for osd.5 2024-09-12T16:19:16.919 INFO:teuthology.orchestra.run.smithi017.stdout:47244640302 2024-09-12T16:19:16.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640303 got 47244640302 for osd.4 2024-09-12T16:19:17.667 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T16:19:17.727 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T16:19:17.839 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T16:19:17.843 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T16:19:17.868 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T16:19:17.934 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T16:19:18.008 INFO:teuthology.orchestra.run.smithi017.stdout:47244640304 2024-09-12T16:19:18.027 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640304 got 47244640304 for osd.3 2024-09-12T16:19:18.027 DEBUG:teuthology.parallel:result is None 2024-09-12T16:19:18.086 INFO:teuthology.orchestra.run.smithi017.stdout:712964571140 2024-09-12T16:19:18.104 INFO:tasks.ceph.ceph_manager.ceph:need seq 712964571140 got 712964571140 for osd.0 2024-09-12T16:19:18.104 DEBUG:teuthology.parallel:result is None 2024-09-12T16:19:18.200 INFO:teuthology.orchestra.run.smithi017.stdout:47244640303 2024-09-12T16:19:18.214 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640303 got 47244640303 for osd.1 2024-09-12T16:19:18.214 DEBUG:teuthology.parallel:result is None 2024-09-12T16:19:18.256 INFO:teuthology.orchestra.run.smithi017.stdout:47244640305 2024-09-12T16:19:18.270 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640305 got 47244640305 for osd.2 2024-09-12T16:19:18.270 DEBUG:teuthology.parallel:result is None 2024-09-12T16:19:18.283 INFO:teuthology.orchestra.run.smithi017.stdout:304942678044 2024-09-12T16:19:18.296 INFO:tasks.ceph.ceph_manager.ceph:need seq 304942678044 got 304942678044 for osd.5 2024-09-12T16:19:18.296 DEBUG:teuthology.parallel:result is None 2024-09-12T16:19:18.320 INFO:teuthology.orchestra.run.smithi017.stdout:47244640303 2024-09-12T16:19:18.333 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640303 got 47244640303 for osd.4 2024-09-12T16:19:18.333 DEBUG:teuthology.parallel:result is None 2024-09-12T16:19:18.333 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-12T16:19:18.333 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T16:19:18.670 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:19:18.671 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-12T16:19:18.681 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":282,"stamp":"2024-09-12T16:19:16.700030+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":422,"num_object_clones":0,"num_object_copies":844,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":422,"num_whiteouts":414,"num_read":454005,"num_read_kb":1624949,"num_write":29512,"num_write_kb":480610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5138,"num_bytes_recovered":203261401,"num_keys_recovered":679,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24613,"ondisk_log_size":24613,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":341904,"kb_used_data":13680,"kb_used_omap":42,"kb_used_meta":328021,"kb_avail":565889136,"statfs":{"total":579820584960,"available":579470475264,"internally_reserved":0,"allocated":14008320,"data_stored":6549594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43798,"internal_metadata":335893738},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-2,"num_read_kb":-2,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-2,"num_bytes_recovered":-19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.892352"},"pg_stats":[{"pgid":"3.1f","version":"167'657","reported_seq":18912,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136260+0000","last_change":"2024-09-12T16:19:03.804780+0000","last_active":"2024-09-12T16:19:14.136260+0000","last_peered":"2024-09-12T16:19:14.136260+0000","last_clean":"2024-09-12T16:19:14.136260+0000","last_became_active":"2024-09-12T16:19:03.771427+0000","last_became_peered":"2024-09-12T16:19:03.771427+0000","last_unstale":"2024-09-12T16:19:14.136260+0000","last_undegraded":"2024-09-12T16:19:14.136260+0000","last_fullsized":"2024-09-12T16:19:14.136260+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:08.465348+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0071910430000000003,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":18834,"num_read_kb":74247,"num_write":859,"num_write_kb":11027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":2818651,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"161'608","reported_seq":14063,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020631+0000","last_change":"2024-09-12T16:18:50.020927+0000","last_active":"2024-09-12T16:19:14.020631+0000","last_peered":"2024-09-12T16:19:14.020631+0000","last_clean":"2024-09-12T16:19:14.020631+0000","last_became_active":"2024-09-12T16:16:55.202876+0000","last_became_peered":"2024-09-12T16:16:55.202876+0000","last_unstale":"2024-09-12T16:19:14.020631+0000","last_undegraded":"2024-09-12T16:19:14.020631+0000","last_fullsized":"2024-09-12T16:19:14.020631+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:07.278294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076921300000000004,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":13702,"num_read_kb":46928,"num_write":627,"num_write_kb":8472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":3145760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"162'1521","reported_seq":20341,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136679+0000","last_change":"2024-09-12T16:19:12.827121+0000","last_active":"2024-09-12T16:19:14.136679+0000","last_peered":"2024-09-12T16:19:14.136679+0000","last_clean":"2024-09-12T16:19:14.136679+0000","last_became_active":"2024-09-12T16:19:12.822483+0000","last_became_peered":"2024-09-12T16:19:12.822483+0000","last_unstale":"2024-09-12T16:19:14.136679+0000","last_undegraded":"2024-09-12T16:19:14.136679+0000","last_fullsized":"2024-09-12T16:19:14.136679+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1521,"log_dups_size":0,"ondisk_log_size":1521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:33.105008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074565700000000005,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":22738,"num_read_kb":67081,"num_write":2129,"num_write_kb":16176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":374,"num_bytes_recovered":30814554,"num_keys_recovered":34,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"162'853","reported_seq":9191,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136304+0000","last_change":"2024-09-12T16:19:12.827513+0000","last_active":"2024-09-12T16:19:14.136304+0000","last_peered":"2024-09-12T16:19:14.136304+0000","last_clean":"2024-09-12T16:19:14.136304+0000","last_became_active":"2024-09-12T16:19:12.823034+0000","last_became_peered":"2024-09-12T16:19:12.823034+0000","last_unstale":"2024-09-12T16:19:14.136304+0000","last_undegraded":"2024-09-12T16:19:14.136304+0000","last_fullsized":"2024-09-12T16:19:14.136304+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":853,"log_dups_size":0,"ondisk_log_size":853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:31.584973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001077195,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":12,"num_read":9731,"num_read_kb":27914,"num_write":1117,"num_write_kb":6805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":3550768,"num_keys_recovered":168,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"161'1254","reported_seq":8898,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136048+0000","last_change":"2024-09-12T16:19:03.795634+0000","last_active":"2024-09-12T16:19:14.136048+0000","last_peered":"2024-09-12T16:19:14.136048+0000","last_clean":"2024-09-12T16:19:14.136048+0000","last_became_active":"2024-09-12T16:19:03.770673+0000","last_became_peered":"2024-09-12T16:19:03.770673+0000","last_unstale":"2024-09-12T16:19:14.136048+0000","last_undegraded":"2024-09-12T16:19:14.136048+0000","last_fullsized":"2024-09-12T16:19:14.136048+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1254,"log_dups_size":0,"ondisk_log_size":1254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:59.427193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0046887659999999996,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":12367,"num_read_kb":38179,"num_write":1729,"num_write_kb":15361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":14697984,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"162'1312","reported_seq":12069,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020481+0000","last_change":"2024-09-12T16:18:50.033545+0000","last_active":"2024-09-12T16:19:14.020481+0000","last_peered":"2024-09-12T16:19:14.020481+0000","last_clean":"2024-09-12T16:19:14.020481+0000","last_became_active":"2024-09-12T16:15:57.014803+0000","last_became_peered":"2024-09-12T16:15:57.014803+0000","last_unstale":"2024-09-12T16:19:14.020481+0000","last_undegraded":"2024-09-12T16:19:14.020481+0000","last_fullsized":"2024-09-12T16:19:14.020481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1312,"log_dups_size":0,"ondisk_log_size":1312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:39.318465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011248300000000001,"stat_sum":{"num_bytes":19,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":19,"num_read":15353,"num_read_kb":54373,"num_write":2009,"num_write_kb":21868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"161'543","reported_seq":14978,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020840+0000","last_change":"2024-09-12T16:18:50.021500+0000","last_active":"2024-09-12T16:19:14.020840+0000","last_peered":"2024-09-12T16:19:14.020840+0000","last_clean":"2024-09-12T16:19:14.020840+0000","last_became_active":"2024-09-12T16:15:57.016110+0000","last_became_peered":"2024-09-12T16:15:57.016110+0000","last_unstale":"2024-09-12T16:19:14.020840+0000","last_undegraded":"2024-09-12T16:19:14.020840+0000","last_fullsized":"2024-09-12T16:19:14.020840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:26.468226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010965269999999999,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":14633,"num_read_kb":54220,"num_write":566,"num_write_kb":10346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"162'783","reported_seq":6457,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020536+0000","last_change":"2024-09-12T16:19:03.797973+0000","last_active":"2024-09-12T16:19:14.020536+0000","last_peered":"2024-09-12T16:19:14.020536+0000","last_clean":"2024-09-12T16:19:14.020536+0000","last_became_active":"2024-09-12T16:19:03.772548+0000","last_became_peered":"2024-09-12T16:19:03.772548+0000","last_unstale":"2024-09-12T16:19:14.020536+0000","last_undegraded":"2024-09-12T16:19:14.020536+0000","last_fullsized":"2024-09-12T16:19:14.020536+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:17.356209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038788759999999999,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":7154,"num_read_kb":45511,"num_write":918,"num_write_kb":34065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":17173091,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"161'688","reported_seq":8348,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136200+0000","last_change":"2024-09-12T16:19:03.820286+0000","last_active":"2024-09-12T16:19:14.136200+0000","last_peered":"2024-09-12T16:19:14.136200+0000","last_clean":"2024-09-12T16:19:14.136200+0000","last_became_active":"2024-09-12T16:19:03.780157+0000","last_became_peered":"2024-09-12T16:19:03.780157+0000","last_unstale":"2024-09-12T16:19:14.136200+0000","last_undegraded":"2024-09-12T16:19:14.136200+0000","last_fullsized":"2024-09-12T16:19:14.136200+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:26.752604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0043783590000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":7873,"num_read_kb":33843,"num_write":918,"num_write_kb":21944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":337,"num_bytes_recovered":20360415,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"161'1601","reported_seq":15889,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136738+0000","last_change":"2024-09-12T16:19:12.829030+0000","last_active":"2024-09-12T16:19:14.136738+0000","last_peered":"2024-09-12T16:19:14.136738+0000","last_clean":"2024-09-12T16:19:14.136738+0000","last_became_active":"2024-09-12T16:19:12.824566+0000","last_became_peered":"2024-09-12T16:19:12.824566+0000","last_unstale":"2024-09-12T16:19:14.136738+0000","last_undegraded":"2024-09-12T16:19:14.136738+0000","last_fullsized":"2024-09-12T16:19:14.136738+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1601,"log_dups_size":0,"ondisk_log_size":1601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:45.672159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036743769999999999,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":19171,"num_read_kb":50037,"num_write":2353,"num_write_kb":15650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":483,"num_bytes_recovered":14102804,"num_keys_recovered":132,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"167'387","reported_seq":7895,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136386+0000","last_change":"2024-09-12T16:19:03.792024+0000","last_active":"2024-09-12T16:19:14.136386+0000","last_peered":"2024-09-12T16:19:14.136386+0000","last_clean":"2024-09-12T16:19:14.136386+0000","last_became_active":"2024-09-12T16:19:03.771611+0000","last_became_peered":"2024-09-12T16:19:03.771611+0000","last_unstale":"2024-09-12T16:19:14.136386+0000","last_undegraded":"2024-09-12T16:19:14.136386+0000","last_fullsized":"2024-09-12T16:19:14.136386+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:39.727256+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0056373990000000004,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":6922,"num_read_kb":49310,"num_write":420,"num_write_kb":20795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":1054818,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"161'889","reported_seq":9435,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136206+0000","last_change":"2024-09-12T16:18:50.019678+0000","last_active":"2024-09-12T16:19:14.136206+0000","last_peered":"2024-09-12T16:19:14.136206+0000","last_clean":"2024-09-12T16:19:14.136206+0000","last_became_active":"2024-09-12T16:16:53.185698+0000","last_became_peered":"2024-09-12T16:16:53.185698+0000","last_unstale":"2024-09-12T16:19:14.136206+0000","last_undegraded":"2024-09-12T16:19:14.136206+0000","last_fullsized":"2024-09-12T16:19:14.136206+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":889,"log_dups_size":0,"ondisk_log_size":889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:26.722024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001055348,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":12029,"num_read_kb":50248,"num_write":1156,"num_write_kb":23396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":244,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136406+0000","last_change":"2024-09-12T16:16:52.184699+0000","last_active":"2024-09-12T16:19:14.136406+0000","last_peered":"2024-09-12T16:19:14.136406+0000","last_clean":"2024-09-12T16:19:14.136406+0000","last_became_active":"2024-09-12T16:16:52.184420+0000","last_became_peered":"2024-09-12T16:16:52.184420+0000","last_unstale":"2024-09-12T16:19:14.136406+0000","last_undegraded":"2024-09-12T16:19:14.136406+0000","last_fullsized":"2024-09-12T16:19:14.136406+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:50.051152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"167'553","reported_seq":9918,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136070+0000","last_change":"2024-09-12T16:19:03.788892+0000","last_active":"2024-09-12T16:19:14.136070+0000","last_peered":"2024-09-12T16:19:14.136070+0000","last_clean":"2024-09-12T16:19:14.136070+0000","last_became_active":"2024-09-12T16:19:03.770869+0000","last_became_peered":"2024-09-12T16:19:03.770869+0000","last_unstale":"2024-09-12T16:19:14.136070+0000","last_undegraded":"2024-09-12T16:19:14.136070+0000","last_fullsized":"2024-09-12T16:19:14.136070+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:38.037187+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0075018430000000002,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":10526,"num_read_kb":44243,"num_write":495,"num_write_kb":9200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":351,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.021261+0000","last_change":"2024-09-12T16:16:52.187010+0000","last_active":"2024-09-12T16:19:14.021261+0000","last_peered":"2024-09-12T16:19:14.021261+0000","last_clean":"2024-09-12T16:19:14.021261+0000","last_became_active":"2024-09-12T16:16:52.186638+0000","last_became_peered":"2024-09-12T16:16:52.186638+0000","last_unstale":"2024-09-12T16:19:14.021261+0000","last_undegraded":"2024-09-12T16:19:14.021261+0000","last_fullsized":"2024-09-12T16:19:14.021261+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:40.681796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066384400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"161'763","reported_seq":16796,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020763+0000","last_change":"2024-09-12T16:18:50.020013+0000","last_active":"2024-09-12T16:19:14.020763+0000","last_peered":"2024-09-12T16:19:14.020763+0000","last_clean":"2024-09-12T16:19:14.020763+0000","last_became_active":"2024-09-12T16:16:34.108850+0000","last_became_peered":"2024-09-12T16:16:34.108850+0000","last_unstale":"2024-09-12T16:19:14.020763+0000","last_undegraded":"2024-09-12T16:19:14.020763+0000","last_fullsized":"2024-09-12T16:19:14.020763+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":763,"log_dups_size":0,"ondisk_log_size":763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:03.909473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080883699999999997,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":17664,"num_read_kb":61096,"num_write":665,"num_write_kb":27115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":253,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136274+0000","last_change":"2024-09-12T16:19:03.772388+0000","last_active":"2024-09-12T16:19:14.136274+0000","last_peered":"2024-09-12T16:19:14.136274+0000","last_clean":"2024-09-12T16:19:14.136274+0000","last_became_active":"2024-09-12T16:19:03.772128+0000","last_became_peered":"2024-09-12T16:19:03.772128+0000","last_unstale":"2024-09-12T16:19:14.136274+0000","last_undegraded":"2024-09-12T16:19:14.136274+0000","last_fullsized":"2024-09-12T16:19:14.136274+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:57.248706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"161'768","reported_seq":8492,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.021187+0000","last_change":"2024-09-12T16:18:50.022176+0000","last_active":"2024-09-12T16:19:14.021187+0000","last_peered":"2024-09-12T16:19:14.021187+0000","last_clean":"2024-09-12T16:19:14.021187+0000","last_became_active":"2024-09-12T16:15:57.011381+0000","last_became_peered":"2024-09-12T16:15:57.011381+0000","last_unstale":"2024-09-12T16:19:14.021187+0000","last_undegraded":"2024-09-12T16:19:14.021187+0000","last_fullsized":"2024-09-12T16:19:14.021187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:56.655837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012620280000000001,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":10668,"num_read_kb":44352,"num_write":952,"num_write_kb":7790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":348,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.021193+0000","last_change":"2024-09-12T16:19:03.773076+0000","last_active":"2024-09-12T16:19:14.021193+0000","last_peered":"2024-09-12T16:19:14.021193+0000","last_clean":"2024-09-12T16:19:14.021193+0000","last_became_active":"2024-09-12T16:19:03.772694+0000","last_became_peered":"2024-09-12T16:19:03.772694+0000","last_unstale":"2024-09-12T16:19:14.021193+0000","last_undegraded":"2024-09-12T16:19:14.021193+0000","last_fullsized":"2024-09-12T16:19:14.021193+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:29.591812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065522900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"161'847","reported_seq":22320,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136695+0000","last_change":"2024-09-12T16:19:12.827179+0000","last_active":"2024-09-12T16:19:14.136695+0000","last_peered":"2024-09-12T16:19:14.136695+0000","last_clean":"2024-09-12T16:19:14.136695+0000","last_became_active":"2024-09-12T16:19:12.821483+0000","last_became_peered":"2024-09-12T16:19:12.821483+0000","last_unstale":"2024-09-12T16:19:14.136695+0000","last_undegraded":"2024-09-12T16:19:14.136695+0000","last_fullsized":"2024-09-12T16:19:14.136695+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:42.532127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001861333,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":25876,"num_read_kb":48987,"num_write":739,"num_write_kb":4795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":335,"num_bytes_recovered":4005968,"num_keys_recovered":105,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"162'843","reported_seq":6625,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020628+0000","last_change":"2024-09-12T16:19:03.811936+0000","last_active":"2024-09-12T16:19:14.020628+0000","last_peered":"2024-09-12T16:19:14.020628+0000","last_clean":"2024-09-12T16:19:14.020628+0000","last_became_active":"2024-09-12T16:19:03.778155+0000","last_became_peered":"2024-09-12T16:19:03.778155+0000","last_unstale":"2024-09-12T16:19:14.020628+0000","last_undegraded":"2024-09-12T16:19:14.020628+0000","last_fullsized":"2024-09-12T16:19:14.020628+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:50.828354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028595159999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":5,"num_read":6564,"num_read_kb":41539,"num_write":1022,"num_write_kb":9272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":275,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136387+0000","last_change":"2024-09-12T16:19:12.821506+0000","last_active":"2024-09-12T16:19:14.136387+0000","last_peered":"2024-09-12T16:19:14.136387+0000","last_clean":"2024-09-12T16:19:14.136387+0000","last_became_active":"2024-09-12T16:19:12.820814+0000","last_became_peered":"2024-09-12T16:19:12.820814+0000","last_unstale":"2024-09-12T16:19:14.136387+0000","last_undegraded":"2024-09-12T16:19:14.136387+0000","last_fullsized":"2024-09-12T16:19:14.136387+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:38.164468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"162'797","reported_seq":18921,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020586+0000","last_change":"2024-09-12T16:18:50.023044+0000","last_active":"2024-09-12T16:19:14.020586+0000","last_peered":"2024-09-12T16:19:14.020586+0000","last_clean":"2024-09-12T16:19:14.020586+0000","last_became_active":"2024-09-12T16:15:57.014294+0000","last_became_peered":"2024-09-12T16:15:57.014294+0000","last_unstale":"2024-09-12T16:19:14.020586+0000","last_undegraded":"2024-09-12T16:19:14.020586+0000","last_fullsized":"2024-09-12T16:19:14.020586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:27.209021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023814270000000002,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":20280,"num_read_kb":53258,"num_write":686,"num_write_kb":17135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":322,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020909+0000","last_change":"2024-09-12T16:18:29.019699+0000","last_active":"2024-09-12T16:19:14.020909+0000","last_peered":"2024-09-12T16:19:14.020909+0000","last_clean":"2024-09-12T16:19:14.020909+0000","last_became_active":"2024-09-12T16:18:29.019339+0000","last_became_peered":"2024-09-12T16:18:29.019339+0000","last_unstale":"2024-09-12T16:19:14.020909+0000","last_undegraded":"2024-09-12T16:19:14.020909+0000","last_fullsized":"2024-09-12T16:19:14.020909+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:51:54.701552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'509","reported_seq":5927,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020778+0000","last_change":"2024-09-12T16:19:03.807136+0000","last_active":"2024-09-12T16:19:14.020778+0000","last_peered":"2024-09-12T16:19:14.020778+0000","last_clean":"2024-09-12T16:19:14.020778+0000","last_became_active":"2024-09-12T16:19:03.775131+0000","last_became_peered":"2024-09-12T16:19:03.775131+0000","last_unstale":"2024-09-12T16:19:14.020778+0000","last_undegraded":"2024-09-12T16:19:14.020778+0000","last_fullsized":"2024-09-12T16:19:14.020778+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:06.175739+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0072137039999999996,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":5469,"num_read_kb":44149,"num_write":663,"num_write_kb":24803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":144,"num_bytes_recovered":10774621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":244,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.135988+0000","last_change":"2024-09-12T16:16:52.184861+0000","last_active":"2024-09-12T16:19:14.135988+0000","last_peered":"2024-09-12T16:19:14.135988+0000","last_clean":"2024-09-12T16:19:14.135988+0000","last_became_active":"2024-09-12T16:16:52.184555+0000","last_became_peered":"2024-09-12T16:16:52.184555+0000","last_unstale":"2024-09-12T16:19:14.135988+0000","last_undegraded":"2024-09-12T16:19:14.135988+0000","last_fullsized":"2024-09-12T16:19:14.135988+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:32.617153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"161'585","reported_seq":10230,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020916+0000","last_change":"2024-09-12T16:18:50.022910+0000","last_active":"2024-09-12T16:19:14.020916+0000","last_peered":"2024-09-12T16:19:14.020916+0000","last_clean":"2024-09-12T16:19:14.020916+0000","last_became_active":"2024-09-12T16:18:25.146756+0000","last_became_peered":"2024-09-12T16:18:25.146756+0000","last_unstale":"2024-09-12T16:19:14.020916+0000","last_undegraded":"2024-09-12T16:19:14.020916+0000","last_fullsized":"2024-09-12T16:19:14.020916+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:36.568042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014402110000000001,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":9889,"num_read_kb":36104,"num_write":494,"num_write_kb":7468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":315,"num_bytes_recovered":8454224,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":254,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136585+0000","last_change":"2024-09-12T16:19:12.821797+0000","last_active":"2024-09-12T16:19:14.136585+0000","last_peered":"2024-09-12T16:19:14.136585+0000","last_clean":"2024-09-12T16:19:14.136585+0000","last_became_active":"2024-09-12T16:19:12.821406+0000","last_became_peered":"2024-09-12T16:19:12.821406+0000","last_unstale":"2024-09-12T16:19:14.136585+0000","last_undegraded":"2024-09-12T16:19:14.136585+0000","last_fullsized":"2024-09-12T16:19:14.136585+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:52.917717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":259,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136033+0000","last_change":"2024-09-12T16:19:03.772630+0000","last_active":"2024-09-12T16:19:14.136033+0000","last_peered":"2024-09-12T16:19:14.136033+0000","last_clean":"2024-09-12T16:19:14.136033+0000","last_became_active":"2024-09-12T16:19:03.772266+0000","last_became_peered":"2024-09-12T16:19:03.772266+0000","last_unstale":"2024-09-12T16:19:14.136033+0000","last_undegraded":"2024-09-12T16:19:14.136033+0000","last_fullsized":"2024-09-12T16:19:14.136033+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:40.751677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:40.751677+0000","last_clean_scrub_stamp":"2024-09-12T16:15:40.751677+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:10.211741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"162'587","reported_seq":13674,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020587+0000","last_change":"2024-09-12T16:18:50.020057+0000","last_active":"2024-09-12T16:19:14.020587+0000","last_peered":"2024-09-12T16:19:14.020587+0000","last_clean":"2024-09-12T16:19:14.020587+0000","last_became_active":"2024-09-12T16:16:34.108998+0000","last_became_peered":"2024-09-12T16:16:34.108998+0000","last_unstale":"2024-09-12T16:19:14.020587+0000","last_undegraded":"2024-09-12T16:19:14.020587+0000","last_fullsized":"2024-09-12T16:19:14.020587+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:33.303142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010878509999999999,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":13209,"num_read_kb":49430,"num_write":675,"num_write_kb":7945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"161'484","reported_seq":31619,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020447+0000","last_change":"2024-09-12T16:18:50.033972+0000","last_active":"2024-09-12T16:19:14.020447+0000","last_peered":"2024-09-12T16:19:14.020447+0000","last_clean":"2024-09-12T16:19:14.020447+0000","last_became_active":"2024-09-12T16:15:57.013620+0000","last_became_peered":"2024-09-12T16:15:57.013620+0000","last_unstale":"2024-09-12T16:19:14.020447+0000","last_undegraded":"2024-09-12T16:19:14.020447+0000","last_fullsized":"2024-09-12T16:19:14.020447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:29.211114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014423319999999999,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":30743,"num_read_kb":77489,"num_write":563,"num_write_kb":11505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"161'892","reported_seq":20872,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136199+0000","last_change":"2024-09-12T16:18:50.021461+0000","last_active":"2024-09-12T16:19:14.136199+0000","last_peered":"2024-09-12T16:19:14.136199+0000","last_clean":"2024-09-12T16:19:14.136199+0000","last_became_active":"2024-09-12T16:16:55.202934+0000","last_became_peered":"2024-09-12T16:16:55.202934+0000","last_unstale":"2024-09-12T16:19:14.136199+0000","last_undegraded":"2024-09-12T16:19:14.136199+0000","last_fullsized":"2024-09-12T16:19:14.136199+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:45.656313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025551279999999998,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":11,"num_read":21936,"num_read_kb":59605,"num_write":943,"num_write_kb":8224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":4487368,"num_keys_recovered":26,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"162'524","reported_seq":15687,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.021028+0000","last_change":"2024-09-12T16:19:03.815628+0000","last_active":"2024-09-12T16:19:14.021028+0000","last_peered":"2024-09-12T16:19:14.021028+0000","last_clean":"2024-09-12T16:19:14.021028+0000","last_became_active":"2024-09-12T16:19:03.777557+0000","last_became_peered":"2024-09-12T16:19:03.777557+0000","last_unstale":"2024-09-12T16:19:14.021028+0000","last_undegraded":"2024-09-12T16:19:14.021028+0000","last_fullsized":"2024-09-12T16:19:14.021028+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:18.398871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040340999999999997,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":15308,"num_read_kb":48885,"num_write":585,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"167'450","reported_seq":11537,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136636+0000","last_change":"2024-09-12T16:19:12.827508+0000","last_active":"2024-09-12T16:19:14.136636+0000","last_peered":"2024-09-12T16:19:14.136636+0000","last_clean":"2024-09-12T16:19:14.136636+0000","last_became_active":"2024-09-12T16:19:12.822409+0000","last_became_peered":"2024-09-12T16:19:12.822409+0000","last_unstale":"2024-09-12T16:19:14.136636+0000","last_undegraded":"2024-09-12T16:19:14.136636+0000","last_fullsized":"2024-09-12T16:19:14.136636+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:38.886837+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00419339,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":9857,"num_read_kb":46208,"num_write":421,"num_write_kb":17232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":322,"num_bytes_recovered":11704832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"161'693","reported_seq":17473,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136383+0000","last_change":"2024-09-12T16:18:50.021962+0000","last_active":"2024-09-12T16:19:14.136383+0000","last_peered":"2024-09-12T16:19:14.136383+0000","last_clean":"2024-09-12T16:19:14.136383+0000","last_became_active":"2024-09-12T16:16:55.202102+0000","last_became_peered":"2024-09-12T16:16:55.202102+0000","last_unstale":"2024-09-12T16:19:14.136383+0000","last_undegraded":"2024-09-12T16:19:14.136383+0000","last_fullsized":"2024-09-12T16:19:14.136383+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:56.617525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026029579999999998,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":18807,"num_read_kb":58739,"num_write":641,"num_write_kb":13631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":126,"num_bytes_recovered":6078562,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"161'589","reported_seq":7753,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136721+0000","last_change":"2024-09-12T16:19:12.829072+0000","last_active":"2024-09-12T16:19:14.136721+0000","last_peered":"2024-09-12T16:19:14.136721+0000","last_clean":"2024-09-12T16:19:14.136721+0000","last_became_active":"2024-09-12T16:19:12.823347+0000","last_became_peered":"2024-09-12T16:19:12.823347+0000","last_unstale":"2024-09-12T16:19:14.136721+0000","last_undegraded":"2024-09-12T16:19:14.136721+0000","last_fullsized":"2024-09-12T16:19:14.136721+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:07.925513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013497229999999999,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":7931,"num_read_kb":30144,"num_write":561,"num_write_kb":13262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":319,"num_bytes_recovered":6744127,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"156'640","reported_seq":12181,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136735+0000","last_change":"2024-09-12T16:19:12.825115+0000","last_active":"2024-09-12T16:19:14.136735+0000","last_peered":"2024-09-12T16:19:14.136735+0000","last_clean":"2024-09-12T16:19:14.136735+0000","last_became_active":"2024-09-12T16:19:12.821943+0000","last_became_peered":"2024-09-12T16:19:12.821943+0000","last_unstale":"2024-09-12T16:19:14.136735+0000","last_undegraded":"2024-09-12T16:19:14.136735+0000","last_fullsized":"2024-09-12T16:19:14.136735+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:09.892807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00220666,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":10861,"num_read_kb":49111,"num_write":815,"num_write_kb":21657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":304,"num_bytes_recovered":6361542,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"167'630","reported_seq":15237,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136345+0000","last_change":"2024-09-12T16:19:12.823613+0000","last_active":"2024-09-12T16:19:14.136345+0000","last_peered":"2024-09-12T16:19:14.136345+0000","last_clean":"2024-09-12T16:19:14.136345+0000","last_became_active":"2024-09-12T16:19:12.819772+0000","last_became_peered":"2024-09-12T16:19:12.819772+0000","last_unstale":"2024-09-12T16:19:14.136345+0000","last_undegraded":"2024-09-12T16:19:14.136345+0000","last_fullsized":"2024-09-12T16:19:14.136345+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:48.846755+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0022010100000000002,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":12815,"num_read_kb":73185,"num_write":784,"num_write_kb":17171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":416,"num_bytes_recovered":13039478,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"161'644","reported_seq":17038,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136155+0000","last_change":"2024-09-12T16:18:50.019987+0000","last_active":"2024-09-12T16:19:14.136155+0000","last_peered":"2024-09-12T16:19:14.136155+0000","last_clean":"2024-09-12T16:19:14.136155+0000","last_became_active":"2024-09-12T16:16:55.202493+0000","last_became_peered":"2024-09-12T16:16:55.202493+0000","last_unstale":"2024-09-12T16:19:14.136155+0000","last_undegraded":"2024-09-12T16:19:14.136155+0000","last_fullsized":"2024-09-12T16:19:14.136155+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:04.668586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013216020000000001,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":16727,"num_read_kb":61490,"num_write":798,"num_write_kb":15885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":1725440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"161'653","reported_seq":15112,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.135985+0000","last_change":"2024-09-12T16:19:03.792167+0000","last_active":"2024-09-12T16:19:14.135985+0000","last_peered":"2024-09-12T16:19:14.135985+0000","last_clean":"2024-09-12T16:19:14.135985+0000","last_became_active":"2024-09-12T16:19:03.770819+0000","last_became_peered":"2024-09-12T16:19:03.770819+0000","last_unstale":"2024-09-12T16:19:14.135985+0000","last_undegraded":"2024-09-12T16:19:14.135985+0000","last_fullsized":"2024-09-12T16:19:14.135985+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":653,"log_dups_size":0,"ondisk_log_size":653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:29:19.655991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055961810000000004,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":16405,"num_read_kb":60197,"num_write":671,"num_write_kb":14674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":3518540,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"162'991","reported_seq":11455,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136175+0000","last_change":"2024-09-12T16:18:50.020480+0000","last_active":"2024-09-12T16:19:14.136175+0000","last_peered":"2024-09-12T16:19:14.136175+0000","last_clean":"2024-09-12T16:19:14.136175+0000","last_became_active":"2024-09-12T16:18:25.147080+0000","last_became_peered":"2024-09-12T16:18:25.147080+0000","last_unstale":"2024-09-12T16:19:14.136175+0000","last_undegraded":"2024-09-12T16:19:14.136175+0000","last_fullsized":"2024-09-12T16:19:14.136175+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":991,"log_dups_size":0,"ondisk_log_size":991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:11.134793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017970779999999999,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":11897,"num_read_kb":44792,"num_write":1435,"num_write_kb":19195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":434,"num_bytes_recovered":17467099,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":418,"num_object_clones":0,"num_object_copies":836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":418,"num_whiteouts":414,"num_read":453939,"num_read_kb":1624894,"num_write":29409,"num_write_kb":478980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5132,"num_bytes_recovered":202080646,"num_keys_recovered":679,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16597,"internal_metadata":0},"log_size":24538,"ondisk_log_size":24538,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":5,"up_from":71,"seq":304942678044,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43140,"kb_used_data":2088,"kb_used_omap":11,"kb_used_meta":41012,"kb_avail":94328700,"statfs":{"total":96636764160,"available":96592588800,"internally_reserved":0,"allocated":2138112,"data_stored":894816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11593,"internal_metadata":41996983},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640303,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77696,"kb_used_data":2088,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94294144,"statfs":{"total":96636764160,"available":96557203456,"internally_reserved":0,"allocated":2138112,"data_stored":894816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640304,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78276,"kb_used_data":2664,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293564,"statfs":{"total":96636764160,"available":96556609536,"internally_reserved":0,"allocated":2727936,"data_stored":1485165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640305,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51332,"kb_used_data":2084,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320508,"statfs":{"total":96636764160,"available":96584200192,"internally_reserved":0,"allocated":2134016,"data_stored":894797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640303,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59652,"kb_used_data":2092,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312188,"statfs":{"total":96636764160,"available":96575680512,"internally_reserved":0,"allocated":2142208,"data_stored":894835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":166,"seq":712964571140,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31808,"kb_used_data":2664,"kb_used_omap":25,"kb_used_meta":29094,"kb_avail":94340032,"statfs":{"total":96636764160,"available":96604192768,"internally_reserved":0,"allocated":2727936,"data_stored":1485165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25827,"internal_metadata":29793053},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9648,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6949,"internal_metadata":0}]}} 2024-09-12T16:19:18.684 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T16:19:18.982 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:19:18.982 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-12T16:19:18.993 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":283,"stamp":"2024-09-12T16:19:18.700612+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":422,"num_object_clones":0,"num_object_copies":844,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":422,"num_whiteouts":414,"num_read":454005,"num_read_kb":1624949,"num_write":29512,"num_write_kb":480610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5138,"num_bytes_recovered":203261401,"num_keys_recovered":679,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24613,"ondisk_log_size":24613,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":341904,"kb_used_data":13680,"kb_used_omap":42,"kb_used_meta":328021,"kb_avail":565889136,"statfs":{"total":579820584960,"available":579470475264,"internally_reserved":0,"allocated":14008320,"data_stored":6549594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43798,"internal_metadata":335893738},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001477"},"pg_stats":[{"pgid":"3.1f","version":"167'657","reported_seq":18912,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136260+0000","last_change":"2024-09-12T16:19:03.804780+0000","last_active":"2024-09-12T16:19:14.136260+0000","last_peered":"2024-09-12T16:19:14.136260+0000","last_clean":"2024-09-12T16:19:14.136260+0000","last_became_active":"2024-09-12T16:19:03.771427+0000","last_became_peered":"2024-09-12T16:19:03.771427+0000","last_unstale":"2024-09-12T16:19:14.136260+0000","last_undegraded":"2024-09-12T16:19:14.136260+0000","last_fullsized":"2024-09-12T16:19:14.136260+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:08.465348+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0071910430000000003,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":18834,"num_read_kb":74247,"num_write":859,"num_write_kb":11027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":2818651,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"161'608","reported_seq":14063,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020631+0000","last_change":"2024-09-12T16:18:50.020927+0000","last_active":"2024-09-12T16:19:14.020631+0000","last_peered":"2024-09-12T16:19:14.020631+0000","last_clean":"2024-09-12T16:19:14.020631+0000","last_became_active":"2024-09-12T16:16:55.202876+0000","last_became_peered":"2024-09-12T16:16:55.202876+0000","last_unstale":"2024-09-12T16:19:14.020631+0000","last_undegraded":"2024-09-12T16:19:14.020631+0000","last_fullsized":"2024-09-12T16:19:14.020631+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:07.278294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076921300000000004,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":13702,"num_read_kb":46928,"num_write":627,"num_write_kb":8472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":3145760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"162'1521","reported_seq":20341,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136679+0000","last_change":"2024-09-12T16:19:12.827121+0000","last_active":"2024-09-12T16:19:14.136679+0000","last_peered":"2024-09-12T16:19:14.136679+0000","last_clean":"2024-09-12T16:19:14.136679+0000","last_became_active":"2024-09-12T16:19:12.822483+0000","last_became_peered":"2024-09-12T16:19:12.822483+0000","last_unstale":"2024-09-12T16:19:14.136679+0000","last_undegraded":"2024-09-12T16:19:14.136679+0000","last_fullsized":"2024-09-12T16:19:14.136679+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1521,"log_dups_size":0,"ondisk_log_size":1521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:33.105008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074565700000000005,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":22738,"num_read_kb":67081,"num_write":2129,"num_write_kb":16176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":374,"num_bytes_recovered":30814554,"num_keys_recovered":34,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"162'853","reported_seq":9191,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136304+0000","last_change":"2024-09-12T16:19:12.827513+0000","last_active":"2024-09-12T16:19:14.136304+0000","last_peered":"2024-09-12T16:19:14.136304+0000","last_clean":"2024-09-12T16:19:14.136304+0000","last_became_active":"2024-09-12T16:19:12.823034+0000","last_became_peered":"2024-09-12T16:19:12.823034+0000","last_unstale":"2024-09-12T16:19:14.136304+0000","last_undegraded":"2024-09-12T16:19:14.136304+0000","last_fullsized":"2024-09-12T16:19:14.136304+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":853,"log_dups_size":0,"ondisk_log_size":853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:31.584973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001077195,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":12,"num_read":9731,"num_read_kb":27914,"num_write":1117,"num_write_kb":6805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":3550768,"num_keys_recovered":168,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"161'1254","reported_seq":8898,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136048+0000","last_change":"2024-09-12T16:19:03.795634+0000","last_active":"2024-09-12T16:19:14.136048+0000","last_peered":"2024-09-12T16:19:14.136048+0000","last_clean":"2024-09-12T16:19:14.136048+0000","last_became_active":"2024-09-12T16:19:03.770673+0000","last_became_peered":"2024-09-12T16:19:03.770673+0000","last_unstale":"2024-09-12T16:19:14.136048+0000","last_undegraded":"2024-09-12T16:19:14.136048+0000","last_fullsized":"2024-09-12T16:19:14.136048+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1254,"log_dups_size":0,"ondisk_log_size":1254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:59.427193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0046887659999999996,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":12367,"num_read_kb":38179,"num_write":1729,"num_write_kb":15361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":14697984,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"162'1312","reported_seq":12069,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020481+0000","last_change":"2024-09-12T16:18:50.033545+0000","last_active":"2024-09-12T16:19:14.020481+0000","last_peered":"2024-09-12T16:19:14.020481+0000","last_clean":"2024-09-12T16:19:14.020481+0000","last_became_active":"2024-09-12T16:15:57.014803+0000","last_became_peered":"2024-09-12T16:15:57.014803+0000","last_unstale":"2024-09-12T16:19:14.020481+0000","last_undegraded":"2024-09-12T16:19:14.020481+0000","last_fullsized":"2024-09-12T16:19:14.020481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1312,"log_dups_size":0,"ondisk_log_size":1312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:39.318465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011248300000000001,"stat_sum":{"num_bytes":19,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":19,"num_read":15353,"num_read_kb":54373,"num_write":2009,"num_write_kb":21868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"161'543","reported_seq":14978,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020840+0000","last_change":"2024-09-12T16:18:50.021500+0000","last_active":"2024-09-12T16:19:14.020840+0000","last_peered":"2024-09-12T16:19:14.020840+0000","last_clean":"2024-09-12T16:19:14.020840+0000","last_became_active":"2024-09-12T16:15:57.016110+0000","last_became_peered":"2024-09-12T16:15:57.016110+0000","last_unstale":"2024-09-12T16:19:14.020840+0000","last_undegraded":"2024-09-12T16:19:14.020840+0000","last_fullsized":"2024-09-12T16:19:14.020840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:26.468226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010965269999999999,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":14633,"num_read_kb":54220,"num_write":566,"num_write_kb":10346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"162'783","reported_seq":6457,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020536+0000","last_change":"2024-09-12T16:19:03.797973+0000","last_active":"2024-09-12T16:19:14.020536+0000","last_peered":"2024-09-12T16:19:14.020536+0000","last_clean":"2024-09-12T16:19:14.020536+0000","last_became_active":"2024-09-12T16:19:03.772548+0000","last_became_peered":"2024-09-12T16:19:03.772548+0000","last_unstale":"2024-09-12T16:19:14.020536+0000","last_undegraded":"2024-09-12T16:19:14.020536+0000","last_fullsized":"2024-09-12T16:19:14.020536+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:17.356209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038788759999999999,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":7154,"num_read_kb":45511,"num_write":918,"num_write_kb":34065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":17173091,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"161'688","reported_seq":8348,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136200+0000","last_change":"2024-09-12T16:19:03.820286+0000","last_active":"2024-09-12T16:19:14.136200+0000","last_peered":"2024-09-12T16:19:14.136200+0000","last_clean":"2024-09-12T16:19:14.136200+0000","last_became_active":"2024-09-12T16:19:03.780157+0000","last_became_peered":"2024-09-12T16:19:03.780157+0000","last_unstale":"2024-09-12T16:19:14.136200+0000","last_undegraded":"2024-09-12T16:19:14.136200+0000","last_fullsized":"2024-09-12T16:19:14.136200+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:26.752604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0043783590000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":7873,"num_read_kb":33843,"num_write":918,"num_write_kb":21944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":337,"num_bytes_recovered":20360415,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"161'1601","reported_seq":15889,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136738+0000","last_change":"2024-09-12T16:19:12.829030+0000","last_active":"2024-09-12T16:19:14.136738+0000","last_peered":"2024-09-12T16:19:14.136738+0000","last_clean":"2024-09-12T16:19:14.136738+0000","last_became_active":"2024-09-12T16:19:12.824566+0000","last_became_peered":"2024-09-12T16:19:12.824566+0000","last_unstale":"2024-09-12T16:19:14.136738+0000","last_undegraded":"2024-09-12T16:19:14.136738+0000","last_fullsized":"2024-09-12T16:19:14.136738+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1601,"log_dups_size":0,"ondisk_log_size":1601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:45.672159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036743769999999999,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":19171,"num_read_kb":50037,"num_write":2353,"num_write_kb":15650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":483,"num_bytes_recovered":14102804,"num_keys_recovered":132,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"167'387","reported_seq":7895,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136386+0000","last_change":"2024-09-12T16:19:03.792024+0000","last_active":"2024-09-12T16:19:14.136386+0000","last_peered":"2024-09-12T16:19:14.136386+0000","last_clean":"2024-09-12T16:19:14.136386+0000","last_became_active":"2024-09-12T16:19:03.771611+0000","last_became_peered":"2024-09-12T16:19:03.771611+0000","last_unstale":"2024-09-12T16:19:14.136386+0000","last_undegraded":"2024-09-12T16:19:14.136386+0000","last_fullsized":"2024-09-12T16:19:14.136386+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:39.727256+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0056373990000000004,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":6922,"num_read_kb":49310,"num_write":420,"num_write_kb":20795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":1054818,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"161'889","reported_seq":9435,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136206+0000","last_change":"2024-09-12T16:18:50.019678+0000","last_active":"2024-09-12T16:19:14.136206+0000","last_peered":"2024-09-12T16:19:14.136206+0000","last_clean":"2024-09-12T16:19:14.136206+0000","last_became_active":"2024-09-12T16:16:53.185698+0000","last_became_peered":"2024-09-12T16:16:53.185698+0000","last_unstale":"2024-09-12T16:19:14.136206+0000","last_undegraded":"2024-09-12T16:19:14.136206+0000","last_fullsized":"2024-09-12T16:19:14.136206+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":889,"log_dups_size":0,"ondisk_log_size":889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:26.722024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001055348,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":12029,"num_read_kb":50248,"num_write":1156,"num_write_kb":23396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":244,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136406+0000","last_change":"2024-09-12T16:16:52.184699+0000","last_active":"2024-09-12T16:19:14.136406+0000","last_peered":"2024-09-12T16:19:14.136406+0000","last_clean":"2024-09-12T16:19:14.136406+0000","last_became_active":"2024-09-12T16:16:52.184420+0000","last_became_peered":"2024-09-12T16:16:52.184420+0000","last_unstale":"2024-09-12T16:19:14.136406+0000","last_undegraded":"2024-09-12T16:19:14.136406+0000","last_fullsized":"2024-09-12T16:19:14.136406+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:50.051152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"167'553","reported_seq":9918,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136070+0000","last_change":"2024-09-12T16:19:03.788892+0000","last_active":"2024-09-12T16:19:14.136070+0000","last_peered":"2024-09-12T16:19:14.136070+0000","last_clean":"2024-09-12T16:19:14.136070+0000","last_became_active":"2024-09-12T16:19:03.770869+0000","last_became_peered":"2024-09-12T16:19:03.770869+0000","last_unstale":"2024-09-12T16:19:14.136070+0000","last_undegraded":"2024-09-12T16:19:14.136070+0000","last_fullsized":"2024-09-12T16:19:14.136070+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:38.037187+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0075018430000000002,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":10526,"num_read_kb":44243,"num_write":495,"num_write_kb":9200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":351,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.021261+0000","last_change":"2024-09-12T16:16:52.187010+0000","last_active":"2024-09-12T16:19:14.021261+0000","last_peered":"2024-09-12T16:19:14.021261+0000","last_clean":"2024-09-12T16:19:14.021261+0000","last_became_active":"2024-09-12T16:16:52.186638+0000","last_became_peered":"2024-09-12T16:16:52.186638+0000","last_unstale":"2024-09-12T16:19:14.021261+0000","last_undegraded":"2024-09-12T16:19:14.021261+0000","last_fullsized":"2024-09-12T16:19:14.021261+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:40.681796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066384400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"161'763","reported_seq":16796,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020763+0000","last_change":"2024-09-12T16:18:50.020013+0000","last_active":"2024-09-12T16:19:14.020763+0000","last_peered":"2024-09-12T16:19:14.020763+0000","last_clean":"2024-09-12T16:19:14.020763+0000","last_became_active":"2024-09-12T16:16:34.108850+0000","last_became_peered":"2024-09-12T16:16:34.108850+0000","last_unstale":"2024-09-12T16:19:14.020763+0000","last_undegraded":"2024-09-12T16:19:14.020763+0000","last_fullsized":"2024-09-12T16:19:14.020763+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":763,"log_dups_size":0,"ondisk_log_size":763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:03.909473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080883699999999997,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":17664,"num_read_kb":61096,"num_write":665,"num_write_kb":27115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":253,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136274+0000","last_change":"2024-09-12T16:19:03.772388+0000","last_active":"2024-09-12T16:19:14.136274+0000","last_peered":"2024-09-12T16:19:14.136274+0000","last_clean":"2024-09-12T16:19:14.136274+0000","last_became_active":"2024-09-12T16:19:03.772128+0000","last_became_peered":"2024-09-12T16:19:03.772128+0000","last_unstale":"2024-09-12T16:19:14.136274+0000","last_undegraded":"2024-09-12T16:19:14.136274+0000","last_fullsized":"2024-09-12T16:19:14.136274+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:57.248706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"161'768","reported_seq":8492,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.021187+0000","last_change":"2024-09-12T16:18:50.022176+0000","last_active":"2024-09-12T16:19:14.021187+0000","last_peered":"2024-09-12T16:19:14.021187+0000","last_clean":"2024-09-12T16:19:14.021187+0000","last_became_active":"2024-09-12T16:15:57.011381+0000","last_became_peered":"2024-09-12T16:15:57.011381+0000","last_unstale":"2024-09-12T16:19:14.021187+0000","last_undegraded":"2024-09-12T16:19:14.021187+0000","last_fullsized":"2024-09-12T16:19:14.021187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:56.655837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012620280000000001,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":10668,"num_read_kb":44352,"num_write":952,"num_write_kb":7790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":348,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.021193+0000","last_change":"2024-09-12T16:19:03.773076+0000","last_active":"2024-09-12T16:19:14.021193+0000","last_peered":"2024-09-12T16:19:14.021193+0000","last_clean":"2024-09-12T16:19:14.021193+0000","last_became_active":"2024-09-12T16:19:03.772694+0000","last_became_peered":"2024-09-12T16:19:03.772694+0000","last_unstale":"2024-09-12T16:19:14.021193+0000","last_undegraded":"2024-09-12T16:19:14.021193+0000","last_fullsized":"2024-09-12T16:19:14.021193+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:29.591812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065522900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"161'847","reported_seq":22320,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136695+0000","last_change":"2024-09-12T16:19:12.827179+0000","last_active":"2024-09-12T16:19:14.136695+0000","last_peered":"2024-09-12T16:19:14.136695+0000","last_clean":"2024-09-12T16:19:14.136695+0000","last_became_active":"2024-09-12T16:19:12.821483+0000","last_became_peered":"2024-09-12T16:19:12.821483+0000","last_unstale":"2024-09-12T16:19:14.136695+0000","last_undegraded":"2024-09-12T16:19:14.136695+0000","last_fullsized":"2024-09-12T16:19:14.136695+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:42.532127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001861333,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":25876,"num_read_kb":48987,"num_write":739,"num_write_kb":4795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":335,"num_bytes_recovered":4005968,"num_keys_recovered":105,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"162'843","reported_seq":6625,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020628+0000","last_change":"2024-09-12T16:19:03.811936+0000","last_active":"2024-09-12T16:19:14.020628+0000","last_peered":"2024-09-12T16:19:14.020628+0000","last_clean":"2024-09-12T16:19:14.020628+0000","last_became_active":"2024-09-12T16:19:03.778155+0000","last_became_peered":"2024-09-12T16:19:03.778155+0000","last_unstale":"2024-09-12T16:19:14.020628+0000","last_undegraded":"2024-09-12T16:19:14.020628+0000","last_fullsized":"2024-09-12T16:19:14.020628+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:50.828354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028595159999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":5,"num_read":6564,"num_read_kb":41539,"num_write":1022,"num_write_kb":9272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":275,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136387+0000","last_change":"2024-09-12T16:19:12.821506+0000","last_active":"2024-09-12T16:19:14.136387+0000","last_peered":"2024-09-12T16:19:14.136387+0000","last_clean":"2024-09-12T16:19:14.136387+0000","last_became_active":"2024-09-12T16:19:12.820814+0000","last_became_peered":"2024-09-12T16:19:12.820814+0000","last_unstale":"2024-09-12T16:19:14.136387+0000","last_undegraded":"2024-09-12T16:19:14.136387+0000","last_fullsized":"2024-09-12T16:19:14.136387+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:38.164468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"162'797","reported_seq":18921,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020586+0000","last_change":"2024-09-12T16:18:50.023044+0000","last_active":"2024-09-12T16:19:14.020586+0000","last_peered":"2024-09-12T16:19:14.020586+0000","last_clean":"2024-09-12T16:19:14.020586+0000","last_became_active":"2024-09-12T16:15:57.014294+0000","last_became_peered":"2024-09-12T16:15:57.014294+0000","last_unstale":"2024-09-12T16:19:14.020586+0000","last_undegraded":"2024-09-12T16:19:14.020586+0000","last_fullsized":"2024-09-12T16:19:14.020586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:27.209021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023814270000000002,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":20280,"num_read_kb":53258,"num_write":686,"num_write_kb":17135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":322,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020909+0000","last_change":"2024-09-12T16:18:29.019699+0000","last_active":"2024-09-12T16:19:14.020909+0000","last_peered":"2024-09-12T16:19:14.020909+0000","last_clean":"2024-09-12T16:19:14.020909+0000","last_became_active":"2024-09-12T16:18:29.019339+0000","last_became_peered":"2024-09-12T16:18:29.019339+0000","last_unstale":"2024-09-12T16:19:14.020909+0000","last_undegraded":"2024-09-12T16:19:14.020909+0000","last_fullsized":"2024-09-12T16:19:14.020909+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:51:54.701552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'509","reported_seq":5927,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020778+0000","last_change":"2024-09-12T16:19:03.807136+0000","last_active":"2024-09-12T16:19:14.020778+0000","last_peered":"2024-09-12T16:19:14.020778+0000","last_clean":"2024-09-12T16:19:14.020778+0000","last_became_active":"2024-09-12T16:19:03.775131+0000","last_became_peered":"2024-09-12T16:19:03.775131+0000","last_unstale":"2024-09-12T16:19:14.020778+0000","last_undegraded":"2024-09-12T16:19:14.020778+0000","last_fullsized":"2024-09-12T16:19:14.020778+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:06.175739+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0072137039999999996,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":5469,"num_read_kb":44149,"num_write":663,"num_write_kb":24803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":144,"num_bytes_recovered":10774621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":244,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.135988+0000","last_change":"2024-09-12T16:16:52.184861+0000","last_active":"2024-09-12T16:19:14.135988+0000","last_peered":"2024-09-12T16:19:14.135988+0000","last_clean":"2024-09-12T16:19:14.135988+0000","last_became_active":"2024-09-12T16:16:52.184555+0000","last_became_peered":"2024-09-12T16:16:52.184555+0000","last_unstale":"2024-09-12T16:19:14.135988+0000","last_undegraded":"2024-09-12T16:19:14.135988+0000","last_fullsized":"2024-09-12T16:19:14.135988+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:32.617153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"161'585","reported_seq":10230,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020916+0000","last_change":"2024-09-12T16:18:50.022910+0000","last_active":"2024-09-12T16:19:14.020916+0000","last_peered":"2024-09-12T16:19:14.020916+0000","last_clean":"2024-09-12T16:19:14.020916+0000","last_became_active":"2024-09-12T16:18:25.146756+0000","last_became_peered":"2024-09-12T16:18:25.146756+0000","last_unstale":"2024-09-12T16:19:14.020916+0000","last_undegraded":"2024-09-12T16:19:14.020916+0000","last_fullsized":"2024-09-12T16:19:14.020916+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:36.568042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014402110000000001,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":9889,"num_read_kb":36104,"num_write":494,"num_write_kb":7468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":315,"num_bytes_recovered":8454224,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":254,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136585+0000","last_change":"2024-09-12T16:19:12.821797+0000","last_active":"2024-09-12T16:19:14.136585+0000","last_peered":"2024-09-12T16:19:14.136585+0000","last_clean":"2024-09-12T16:19:14.136585+0000","last_became_active":"2024-09-12T16:19:12.821406+0000","last_became_peered":"2024-09-12T16:19:12.821406+0000","last_unstale":"2024-09-12T16:19:14.136585+0000","last_undegraded":"2024-09-12T16:19:14.136585+0000","last_fullsized":"2024-09-12T16:19:14.136585+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:52.917717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":259,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136033+0000","last_change":"2024-09-12T16:19:03.772630+0000","last_active":"2024-09-12T16:19:14.136033+0000","last_peered":"2024-09-12T16:19:14.136033+0000","last_clean":"2024-09-12T16:19:14.136033+0000","last_became_active":"2024-09-12T16:19:03.772266+0000","last_became_peered":"2024-09-12T16:19:03.772266+0000","last_unstale":"2024-09-12T16:19:14.136033+0000","last_undegraded":"2024-09-12T16:19:14.136033+0000","last_fullsized":"2024-09-12T16:19:14.136033+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:40.751677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:40.751677+0000","last_clean_scrub_stamp":"2024-09-12T16:15:40.751677+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:10.211741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"162'587","reported_seq":13674,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020587+0000","last_change":"2024-09-12T16:18:50.020057+0000","last_active":"2024-09-12T16:19:14.020587+0000","last_peered":"2024-09-12T16:19:14.020587+0000","last_clean":"2024-09-12T16:19:14.020587+0000","last_became_active":"2024-09-12T16:16:34.108998+0000","last_became_peered":"2024-09-12T16:16:34.108998+0000","last_unstale":"2024-09-12T16:19:14.020587+0000","last_undegraded":"2024-09-12T16:19:14.020587+0000","last_fullsized":"2024-09-12T16:19:14.020587+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:33.303142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010878509999999999,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":13209,"num_read_kb":49430,"num_write":675,"num_write_kb":7945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"161'484","reported_seq":31619,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020447+0000","last_change":"2024-09-12T16:18:50.033972+0000","last_active":"2024-09-12T16:19:14.020447+0000","last_peered":"2024-09-12T16:19:14.020447+0000","last_clean":"2024-09-12T16:19:14.020447+0000","last_became_active":"2024-09-12T16:15:57.013620+0000","last_became_peered":"2024-09-12T16:15:57.013620+0000","last_unstale":"2024-09-12T16:19:14.020447+0000","last_undegraded":"2024-09-12T16:19:14.020447+0000","last_fullsized":"2024-09-12T16:19:14.020447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:29.211114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014423319999999999,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":30743,"num_read_kb":77489,"num_write":563,"num_write_kb":11505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"161'892","reported_seq":20872,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136199+0000","last_change":"2024-09-12T16:18:50.021461+0000","last_active":"2024-09-12T16:19:14.136199+0000","last_peered":"2024-09-12T16:19:14.136199+0000","last_clean":"2024-09-12T16:19:14.136199+0000","last_became_active":"2024-09-12T16:16:55.202934+0000","last_became_peered":"2024-09-12T16:16:55.202934+0000","last_unstale":"2024-09-12T16:19:14.136199+0000","last_undegraded":"2024-09-12T16:19:14.136199+0000","last_fullsized":"2024-09-12T16:19:14.136199+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:45.656313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025551279999999998,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":11,"num_read":21936,"num_read_kb":59605,"num_write":943,"num_write_kb":8224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":4487368,"num_keys_recovered":26,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"162'524","reported_seq":15687,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.021028+0000","last_change":"2024-09-12T16:19:03.815628+0000","last_active":"2024-09-12T16:19:14.021028+0000","last_peered":"2024-09-12T16:19:14.021028+0000","last_clean":"2024-09-12T16:19:14.021028+0000","last_became_active":"2024-09-12T16:19:03.777557+0000","last_became_peered":"2024-09-12T16:19:03.777557+0000","last_unstale":"2024-09-12T16:19:14.021028+0000","last_undegraded":"2024-09-12T16:19:14.021028+0000","last_fullsized":"2024-09-12T16:19:14.021028+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:18.398871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040340999999999997,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":15308,"num_read_kb":48885,"num_write":585,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"167'450","reported_seq":11537,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136636+0000","last_change":"2024-09-12T16:19:12.827508+0000","last_active":"2024-09-12T16:19:14.136636+0000","last_peered":"2024-09-12T16:19:14.136636+0000","last_clean":"2024-09-12T16:19:14.136636+0000","last_became_active":"2024-09-12T16:19:12.822409+0000","last_became_peered":"2024-09-12T16:19:12.822409+0000","last_unstale":"2024-09-12T16:19:14.136636+0000","last_undegraded":"2024-09-12T16:19:14.136636+0000","last_fullsized":"2024-09-12T16:19:14.136636+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:38.886837+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00419339,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":9857,"num_read_kb":46208,"num_write":421,"num_write_kb":17232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":322,"num_bytes_recovered":11704832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"161'693","reported_seq":17473,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136383+0000","last_change":"2024-09-12T16:18:50.021962+0000","last_active":"2024-09-12T16:19:14.136383+0000","last_peered":"2024-09-12T16:19:14.136383+0000","last_clean":"2024-09-12T16:19:14.136383+0000","last_became_active":"2024-09-12T16:16:55.202102+0000","last_became_peered":"2024-09-12T16:16:55.202102+0000","last_unstale":"2024-09-12T16:19:14.136383+0000","last_undegraded":"2024-09-12T16:19:14.136383+0000","last_fullsized":"2024-09-12T16:19:14.136383+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:56.617525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026029579999999998,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":18807,"num_read_kb":58739,"num_write":641,"num_write_kb":13631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":126,"num_bytes_recovered":6078562,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"161'589","reported_seq":7753,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136721+0000","last_change":"2024-09-12T16:19:12.829072+0000","last_active":"2024-09-12T16:19:14.136721+0000","last_peered":"2024-09-12T16:19:14.136721+0000","last_clean":"2024-09-12T16:19:14.136721+0000","last_became_active":"2024-09-12T16:19:12.823347+0000","last_became_peered":"2024-09-12T16:19:12.823347+0000","last_unstale":"2024-09-12T16:19:14.136721+0000","last_undegraded":"2024-09-12T16:19:14.136721+0000","last_fullsized":"2024-09-12T16:19:14.136721+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:07.925513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013497229999999999,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":7931,"num_read_kb":30144,"num_write":561,"num_write_kb":13262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":319,"num_bytes_recovered":6744127,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"156'640","reported_seq":12181,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136735+0000","last_change":"2024-09-12T16:19:12.825115+0000","last_active":"2024-09-12T16:19:14.136735+0000","last_peered":"2024-09-12T16:19:14.136735+0000","last_clean":"2024-09-12T16:19:14.136735+0000","last_became_active":"2024-09-12T16:19:12.821943+0000","last_became_peered":"2024-09-12T16:19:12.821943+0000","last_unstale":"2024-09-12T16:19:14.136735+0000","last_undegraded":"2024-09-12T16:19:14.136735+0000","last_fullsized":"2024-09-12T16:19:14.136735+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:09.892807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00220666,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":10861,"num_read_kb":49111,"num_write":815,"num_write_kb":21657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":304,"num_bytes_recovered":6361542,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"167'630","reported_seq":15237,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136345+0000","last_change":"2024-09-12T16:19:12.823613+0000","last_active":"2024-09-12T16:19:14.136345+0000","last_peered":"2024-09-12T16:19:14.136345+0000","last_clean":"2024-09-12T16:19:14.136345+0000","last_became_active":"2024-09-12T16:19:12.819772+0000","last_became_peered":"2024-09-12T16:19:12.819772+0000","last_unstale":"2024-09-12T16:19:14.136345+0000","last_undegraded":"2024-09-12T16:19:14.136345+0000","last_fullsized":"2024-09-12T16:19:14.136345+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:48.846755+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0022010100000000002,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":12815,"num_read_kb":73185,"num_write":784,"num_write_kb":17171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":416,"num_bytes_recovered":13039478,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"161'644","reported_seq":17038,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136155+0000","last_change":"2024-09-12T16:18:50.019987+0000","last_active":"2024-09-12T16:19:14.136155+0000","last_peered":"2024-09-12T16:19:14.136155+0000","last_clean":"2024-09-12T16:19:14.136155+0000","last_became_active":"2024-09-12T16:16:55.202493+0000","last_became_peered":"2024-09-12T16:16:55.202493+0000","last_unstale":"2024-09-12T16:19:14.136155+0000","last_undegraded":"2024-09-12T16:19:14.136155+0000","last_fullsized":"2024-09-12T16:19:14.136155+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:04.668586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013216020000000001,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":16727,"num_read_kb":61490,"num_write":798,"num_write_kb":15885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":1725440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"161'653","reported_seq":15112,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.135985+0000","last_change":"2024-09-12T16:19:03.792167+0000","last_active":"2024-09-12T16:19:14.135985+0000","last_peered":"2024-09-12T16:19:14.135985+0000","last_clean":"2024-09-12T16:19:14.135985+0000","last_became_active":"2024-09-12T16:19:03.770819+0000","last_became_peered":"2024-09-12T16:19:03.770819+0000","last_unstale":"2024-09-12T16:19:14.135985+0000","last_undegraded":"2024-09-12T16:19:14.135985+0000","last_fullsized":"2024-09-12T16:19:14.135985+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":653,"log_dups_size":0,"ondisk_log_size":653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:29:19.655991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055961810000000004,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":16405,"num_read_kb":60197,"num_write":671,"num_write_kb":14674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":3518540,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"162'991","reported_seq":11455,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136175+0000","last_change":"2024-09-12T16:18:50.020480+0000","last_active":"2024-09-12T16:19:14.136175+0000","last_peered":"2024-09-12T16:19:14.136175+0000","last_clean":"2024-09-12T16:19:14.136175+0000","last_became_active":"2024-09-12T16:18:25.147080+0000","last_became_peered":"2024-09-12T16:18:25.147080+0000","last_unstale":"2024-09-12T16:19:14.136175+0000","last_undegraded":"2024-09-12T16:19:14.136175+0000","last_fullsized":"2024-09-12T16:19:14.136175+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":991,"log_dups_size":0,"ondisk_log_size":991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:11.134793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017970779999999999,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":11897,"num_read_kb":44792,"num_write":1435,"num_write_kb":19195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":434,"num_bytes_recovered":17467099,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":418,"num_object_clones":0,"num_object_copies":836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":418,"num_whiteouts":414,"num_read":453939,"num_read_kb":1624894,"num_write":29409,"num_write_kb":478980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5132,"num_bytes_recovered":202080646,"num_keys_recovered":679,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16597,"internal_metadata":0},"log_size":24538,"ondisk_log_size":24538,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":5,"up_from":71,"seq":304942678045,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43140,"kb_used_data":2088,"kb_used_omap":11,"kb_used_meta":41012,"kb_avail":94328700,"statfs":{"total":96636764160,"available":96592588800,"internally_reserved":0,"allocated":2138112,"data_stored":894816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11593,"internal_metadata":41996983},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640303,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77696,"kb_used_data":2088,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94294144,"statfs":{"total":96636764160,"available":96557203456,"internally_reserved":0,"allocated":2138112,"data_stored":894816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640304,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78276,"kb_used_data":2664,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293564,"statfs":{"total":96636764160,"available":96556609536,"internally_reserved":0,"allocated":2727936,"data_stored":1485165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640305,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51332,"kb_used_data":2084,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320508,"statfs":{"total":96636764160,"available":96584200192,"internally_reserved":0,"allocated":2134016,"data_stored":894797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640303,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59652,"kb_used_data":2092,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312188,"statfs":{"total":96636764160,"available":96575680512,"internally_reserved":0,"allocated":2142208,"data_stored":894835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":166,"seq":712964571141,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31808,"kb_used_data":2664,"kb_used_omap":25,"kb_used_meta":29094,"kb_avail":94340032,"statfs":{"total":96636764160,"available":96604192768,"internally_reserved":0,"allocated":2727936,"data_stored":1485165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25827,"internal_metadata":29793053},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9648,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6949,"internal_metadata":0}]}} 2024-09-12T16:19:18.995 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-12T16:19:18.995 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-12T16:19:19.308 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T16:19:19.321 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T16:19:19.322 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T16:19:19.618 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:19:19.618 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-12T16:19:19.630 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":283,"stamp":"2024-09-12T16:19:18.700612+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":422,"num_object_clones":0,"num_object_copies":844,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":422,"num_whiteouts":414,"num_read":454005,"num_read_kb":1624949,"num_write":29512,"num_write_kb":480610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5138,"num_bytes_recovered":203261401,"num_keys_recovered":679,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24613,"ondisk_log_size":24613,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":341904,"kb_used_data":13680,"kb_used_omap":42,"kb_used_meta":328021,"kb_avail":565889136,"statfs":{"total":579820584960,"available":579470475264,"internally_reserved":0,"allocated":14008320,"data_stored":6549594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43798,"internal_metadata":335893738},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001477"},"pg_stats":[{"pgid":"3.1f","version":"167'657","reported_seq":18912,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136260+0000","last_change":"2024-09-12T16:19:03.804780+0000","last_active":"2024-09-12T16:19:14.136260+0000","last_peered":"2024-09-12T16:19:14.136260+0000","last_clean":"2024-09-12T16:19:14.136260+0000","last_became_active":"2024-09-12T16:19:03.771427+0000","last_became_peered":"2024-09-12T16:19:03.771427+0000","last_unstale":"2024-09-12T16:19:14.136260+0000","last_undegraded":"2024-09-12T16:19:14.136260+0000","last_fullsized":"2024-09-12T16:19:14.136260+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:08.465348+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0071910430000000003,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":18834,"num_read_kb":74247,"num_write":859,"num_write_kb":11027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":2818651,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"161'608","reported_seq":14063,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020631+0000","last_change":"2024-09-12T16:18:50.020927+0000","last_active":"2024-09-12T16:19:14.020631+0000","last_peered":"2024-09-12T16:19:14.020631+0000","last_clean":"2024-09-12T16:19:14.020631+0000","last_became_active":"2024-09-12T16:16:55.202876+0000","last_became_peered":"2024-09-12T16:16:55.202876+0000","last_unstale":"2024-09-12T16:19:14.020631+0000","last_undegraded":"2024-09-12T16:19:14.020631+0000","last_fullsized":"2024-09-12T16:19:14.020631+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:07.278294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076921300000000004,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":13702,"num_read_kb":46928,"num_write":627,"num_write_kb":8472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":3145760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"162'1521","reported_seq":20341,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136679+0000","last_change":"2024-09-12T16:19:12.827121+0000","last_active":"2024-09-12T16:19:14.136679+0000","last_peered":"2024-09-12T16:19:14.136679+0000","last_clean":"2024-09-12T16:19:14.136679+0000","last_became_active":"2024-09-12T16:19:12.822483+0000","last_became_peered":"2024-09-12T16:19:12.822483+0000","last_unstale":"2024-09-12T16:19:14.136679+0000","last_undegraded":"2024-09-12T16:19:14.136679+0000","last_fullsized":"2024-09-12T16:19:14.136679+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1521,"log_dups_size":0,"ondisk_log_size":1521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:33.105008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074565700000000005,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":22738,"num_read_kb":67081,"num_write":2129,"num_write_kb":16176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":374,"num_bytes_recovered":30814554,"num_keys_recovered":34,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"162'853","reported_seq":9191,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136304+0000","last_change":"2024-09-12T16:19:12.827513+0000","last_active":"2024-09-12T16:19:14.136304+0000","last_peered":"2024-09-12T16:19:14.136304+0000","last_clean":"2024-09-12T16:19:14.136304+0000","last_became_active":"2024-09-12T16:19:12.823034+0000","last_became_peered":"2024-09-12T16:19:12.823034+0000","last_unstale":"2024-09-12T16:19:14.136304+0000","last_undegraded":"2024-09-12T16:19:14.136304+0000","last_fullsized":"2024-09-12T16:19:14.136304+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":853,"log_dups_size":0,"ondisk_log_size":853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:31.584973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001077195,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":12,"num_read":9731,"num_read_kb":27914,"num_write":1117,"num_write_kb":6805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":3550768,"num_keys_recovered":168,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"161'1254","reported_seq":8898,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136048+0000","last_change":"2024-09-12T16:19:03.795634+0000","last_active":"2024-09-12T16:19:14.136048+0000","last_peered":"2024-09-12T16:19:14.136048+0000","last_clean":"2024-09-12T16:19:14.136048+0000","last_became_active":"2024-09-12T16:19:03.770673+0000","last_became_peered":"2024-09-12T16:19:03.770673+0000","last_unstale":"2024-09-12T16:19:14.136048+0000","last_undegraded":"2024-09-12T16:19:14.136048+0000","last_fullsized":"2024-09-12T16:19:14.136048+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1254,"log_dups_size":0,"ondisk_log_size":1254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:59.427193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0046887659999999996,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":12367,"num_read_kb":38179,"num_write":1729,"num_write_kb":15361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":14697984,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"162'1312","reported_seq":12069,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020481+0000","last_change":"2024-09-12T16:18:50.033545+0000","last_active":"2024-09-12T16:19:14.020481+0000","last_peered":"2024-09-12T16:19:14.020481+0000","last_clean":"2024-09-12T16:19:14.020481+0000","last_became_active":"2024-09-12T16:15:57.014803+0000","last_became_peered":"2024-09-12T16:15:57.014803+0000","last_unstale":"2024-09-12T16:19:14.020481+0000","last_undegraded":"2024-09-12T16:19:14.020481+0000","last_fullsized":"2024-09-12T16:19:14.020481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1312,"log_dups_size":0,"ondisk_log_size":1312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:39.318465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011248300000000001,"stat_sum":{"num_bytes":19,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":19,"num_read":15353,"num_read_kb":54373,"num_write":2009,"num_write_kb":21868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"161'543","reported_seq":14978,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020840+0000","last_change":"2024-09-12T16:18:50.021500+0000","last_active":"2024-09-12T16:19:14.020840+0000","last_peered":"2024-09-12T16:19:14.020840+0000","last_clean":"2024-09-12T16:19:14.020840+0000","last_became_active":"2024-09-12T16:15:57.016110+0000","last_became_peered":"2024-09-12T16:15:57.016110+0000","last_unstale":"2024-09-12T16:19:14.020840+0000","last_undegraded":"2024-09-12T16:19:14.020840+0000","last_fullsized":"2024-09-12T16:19:14.020840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:26.468226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010965269999999999,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":14633,"num_read_kb":54220,"num_write":566,"num_write_kb":10346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"162'783","reported_seq":6457,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020536+0000","last_change":"2024-09-12T16:19:03.797973+0000","last_active":"2024-09-12T16:19:14.020536+0000","last_peered":"2024-09-12T16:19:14.020536+0000","last_clean":"2024-09-12T16:19:14.020536+0000","last_became_active":"2024-09-12T16:19:03.772548+0000","last_became_peered":"2024-09-12T16:19:03.772548+0000","last_unstale":"2024-09-12T16:19:14.020536+0000","last_undegraded":"2024-09-12T16:19:14.020536+0000","last_fullsized":"2024-09-12T16:19:14.020536+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:17.356209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038788759999999999,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":7154,"num_read_kb":45511,"num_write":918,"num_write_kb":34065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":17173091,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"161'688","reported_seq":8348,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136200+0000","last_change":"2024-09-12T16:19:03.820286+0000","last_active":"2024-09-12T16:19:14.136200+0000","last_peered":"2024-09-12T16:19:14.136200+0000","last_clean":"2024-09-12T16:19:14.136200+0000","last_became_active":"2024-09-12T16:19:03.780157+0000","last_became_peered":"2024-09-12T16:19:03.780157+0000","last_unstale":"2024-09-12T16:19:14.136200+0000","last_undegraded":"2024-09-12T16:19:14.136200+0000","last_fullsized":"2024-09-12T16:19:14.136200+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:26.752604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0043783590000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":7873,"num_read_kb":33843,"num_write":918,"num_write_kb":21944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":337,"num_bytes_recovered":20360415,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"161'1601","reported_seq":15889,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136738+0000","last_change":"2024-09-12T16:19:12.829030+0000","last_active":"2024-09-12T16:19:14.136738+0000","last_peered":"2024-09-12T16:19:14.136738+0000","last_clean":"2024-09-12T16:19:14.136738+0000","last_became_active":"2024-09-12T16:19:12.824566+0000","last_became_peered":"2024-09-12T16:19:12.824566+0000","last_unstale":"2024-09-12T16:19:14.136738+0000","last_undegraded":"2024-09-12T16:19:14.136738+0000","last_fullsized":"2024-09-12T16:19:14.136738+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1601,"log_dups_size":0,"ondisk_log_size":1601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:45.672159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036743769999999999,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":19171,"num_read_kb":50037,"num_write":2353,"num_write_kb":15650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":483,"num_bytes_recovered":14102804,"num_keys_recovered":132,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"167'387","reported_seq":7895,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136386+0000","last_change":"2024-09-12T16:19:03.792024+0000","last_active":"2024-09-12T16:19:14.136386+0000","last_peered":"2024-09-12T16:19:14.136386+0000","last_clean":"2024-09-12T16:19:14.136386+0000","last_became_active":"2024-09-12T16:19:03.771611+0000","last_became_peered":"2024-09-12T16:19:03.771611+0000","last_unstale":"2024-09-12T16:19:14.136386+0000","last_undegraded":"2024-09-12T16:19:14.136386+0000","last_fullsized":"2024-09-12T16:19:14.136386+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:39.727256+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0056373990000000004,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":6922,"num_read_kb":49310,"num_write":420,"num_write_kb":20795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":1054818,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"161'889","reported_seq":9435,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136206+0000","last_change":"2024-09-12T16:18:50.019678+0000","last_active":"2024-09-12T16:19:14.136206+0000","last_peered":"2024-09-12T16:19:14.136206+0000","last_clean":"2024-09-12T16:19:14.136206+0000","last_became_active":"2024-09-12T16:16:53.185698+0000","last_became_peered":"2024-09-12T16:16:53.185698+0000","last_unstale":"2024-09-12T16:19:14.136206+0000","last_undegraded":"2024-09-12T16:19:14.136206+0000","last_fullsized":"2024-09-12T16:19:14.136206+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":889,"log_dups_size":0,"ondisk_log_size":889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:26.722024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001055348,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":12029,"num_read_kb":50248,"num_write":1156,"num_write_kb":23396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":244,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136406+0000","last_change":"2024-09-12T16:16:52.184699+0000","last_active":"2024-09-12T16:19:14.136406+0000","last_peered":"2024-09-12T16:19:14.136406+0000","last_clean":"2024-09-12T16:19:14.136406+0000","last_became_active":"2024-09-12T16:16:52.184420+0000","last_became_peered":"2024-09-12T16:16:52.184420+0000","last_unstale":"2024-09-12T16:19:14.136406+0000","last_undegraded":"2024-09-12T16:19:14.136406+0000","last_fullsized":"2024-09-12T16:19:14.136406+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:50.051152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"167'553","reported_seq":9918,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136070+0000","last_change":"2024-09-12T16:19:03.788892+0000","last_active":"2024-09-12T16:19:14.136070+0000","last_peered":"2024-09-12T16:19:14.136070+0000","last_clean":"2024-09-12T16:19:14.136070+0000","last_became_active":"2024-09-12T16:19:03.770869+0000","last_became_peered":"2024-09-12T16:19:03.770869+0000","last_unstale":"2024-09-12T16:19:14.136070+0000","last_undegraded":"2024-09-12T16:19:14.136070+0000","last_fullsized":"2024-09-12T16:19:14.136070+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:38.037187+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0075018430000000002,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":10526,"num_read_kb":44243,"num_write":495,"num_write_kb":9200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":351,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.021261+0000","last_change":"2024-09-12T16:16:52.187010+0000","last_active":"2024-09-12T16:19:14.021261+0000","last_peered":"2024-09-12T16:19:14.021261+0000","last_clean":"2024-09-12T16:19:14.021261+0000","last_became_active":"2024-09-12T16:16:52.186638+0000","last_became_peered":"2024-09-12T16:16:52.186638+0000","last_unstale":"2024-09-12T16:19:14.021261+0000","last_undegraded":"2024-09-12T16:19:14.021261+0000","last_fullsized":"2024-09-12T16:19:14.021261+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:40.681796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066384400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"161'763","reported_seq":16796,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020763+0000","last_change":"2024-09-12T16:18:50.020013+0000","last_active":"2024-09-12T16:19:14.020763+0000","last_peered":"2024-09-12T16:19:14.020763+0000","last_clean":"2024-09-12T16:19:14.020763+0000","last_became_active":"2024-09-12T16:16:34.108850+0000","last_became_peered":"2024-09-12T16:16:34.108850+0000","last_unstale":"2024-09-12T16:19:14.020763+0000","last_undegraded":"2024-09-12T16:19:14.020763+0000","last_fullsized":"2024-09-12T16:19:14.020763+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":763,"log_dups_size":0,"ondisk_log_size":763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:03.909473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080883699999999997,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":17664,"num_read_kb":61096,"num_write":665,"num_write_kb":27115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":253,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136274+0000","last_change":"2024-09-12T16:19:03.772388+0000","last_active":"2024-09-12T16:19:14.136274+0000","last_peered":"2024-09-12T16:19:14.136274+0000","last_clean":"2024-09-12T16:19:14.136274+0000","last_became_active":"2024-09-12T16:19:03.772128+0000","last_became_peered":"2024-09-12T16:19:03.772128+0000","last_unstale":"2024-09-12T16:19:14.136274+0000","last_undegraded":"2024-09-12T16:19:14.136274+0000","last_fullsized":"2024-09-12T16:19:14.136274+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:57.248706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"161'768","reported_seq":8492,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.021187+0000","last_change":"2024-09-12T16:18:50.022176+0000","last_active":"2024-09-12T16:19:14.021187+0000","last_peered":"2024-09-12T16:19:14.021187+0000","last_clean":"2024-09-12T16:19:14.021187+0000","last_became_active":"2024-09-12T16:15:57.011381+0000","last_became_peered":"2024-09-12T16:15:57.011381+0000","last_unstale":"2024-09-12T16:19:14.021187+0000","last_undegraded":"2024-09-12T16:19:14.021187+0000","last_fullsized":"2024-09-12T16:19:14.021187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:56.655837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012620280000000001,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":10668,"num_read_kb":44352,"num_write":952,"num_write_kb":7790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":348,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.021193+0000","last_change":"2024-09-12T16:19:03.773076+0000","last_active":"2024-09-12T16:19:14.021193+0000","last_peered":"2024-09-12T16:19:14.021193+0000","last_clean":"2024-09-12T16:19:14.021193+0000","last_became_active":"2024-09-12T16:19:03.772694+0000","last_became_peered":"2024-09-12T16:19:03.772694+0000","last_unstale":"2024-09-12T16:19:14.021193+0000","last_undegraded":"2024-09-12T16:19:14.021193+0000","last_fullsized":"2024-09-12T16:19:14.021193+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:29.591812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065522900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"161'847","reported_seq":22320,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136695+0000","last_change":"2024-09-12T16:19:12.827179+0000","last_active":"2024-09-12T16:19:14.136695+0000","last_peered":"2024-09-12T16:19:14.136695+0000","last_clean":"2024-09-12T16:19:14.136695+0000","last_became_active":"2024-09-12T16:19:12.821483+0000","last_became_peered":"2024-09-12T16:19:12.821483+0000","last_unstale":"2024-09-12T16:19:14.136695+0000","last_undegraded":"2024-09-12T16:19:14.136695+0000","last_fullsized":"2024-09-12T16:19:14.136695+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:42.532127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001861333,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":25876,"num_read_kb":48987,"num_write":739,"num_write_kb":4795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":335,"num_bytes_recovered":4005968,"num_keys_recovered":105,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"162'843","reported_seq":6625,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020628+0000","last_change":"2024-09-12T16:19:03.811936+0000","last_active":"2024-09-12T16:19:14.020628+0000","last_peered":"2024-09-12T16:19:14.020628+0000","last_clean":"2024-09-12T16:19:14.020628+0000","last_became_active":"2024-09-12T16:19:03.778155+0000","last_became_peered":"2024-09-12T16:19:03.778155+0000","last_unstale":"2024-09-12T16:19:14.020628+0000","last_undegraded":"2024-09-12T16:19:14.020628+0000","last_fullsized":"2024-09-12T16:19:14.020628+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:50.828354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028595159999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":5,"num_read":6564,"num_read_kb":41539,"num_write":1022,"num_write_kb":9272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":275,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136387+0000","last_change":"2024-09-12T16:19:12.821506+0000","last_active":"2024-09-12T16:19:14.136387+0000","last_peered":"2024-09-12T16:19:14.136387+0000","last_clean":"2024-09-12T16:19:14.136387+0000","last_became_active":"2024-09-12T16:19:12.820814+0000","last_became_peered":"2024-09-12T16:19:12.820814+0000","last_unstale":"2024-09-12T16:19:14.136387+0000","last_undegraded":"2024-09-12T16:19:14.136387+0000","last_fullsized":"2024-09-12T16:19:14.136387+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:38.164468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"162'797","reported_seq":18921,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020586+0000","last_change":"2024-09-12T16:18:50.023044+0000","last_active":"2024-09-12T16:19:14.020586+0000","last_peered":"2024-09-12T16:19:14.020586+0000","last_clean":"2024-09-12T16:19:14.020586+0000","last_became_active":"2024-09-12T16:15:57.014294+0000","last_became_peered":"2024-09-12T16:15:57.014294+0000","last_unstale":"2024-09-12T16:19:14.020586+0000","last_undegraded":"2024-09-12T16:19:14.020586+0000","last_fullsized":"2024-09-12T16:19:14.020586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:27.209021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023814270000000002,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":20280,"num_read_kb":53258,"num_write":686,"num_write_kb":17135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":322,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020909+0000","last_change":"2024-09-12T16:18:29.019699+0000","last_active":"2024-09-12T16:19:14.020909+0000","last_peered":"2024-09-12T16:19:14.020909+0000","last_clean":"2024-09-12T16:19:14.020909+0000","last_became_active":"2024-09-12T16:18:29.019339+0000","last_became_peered":"2024-09-12T16:18:29.019339+0000","last_unstale":"2024-09-12T16:19:14.020909+0000","last_undegraded":"2024-09-12T16:19:14.020909+0000","last_fullsized":"2024-09-12T16:19:14.020909+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:51:54.701552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'509","reported_seq":5927,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020778+0000","last_change":"2024-09-12T16:19:03.807136+0000","last_active":"2024-09-12T16:19:14.020778+0000","last_peered":"2024-09-12T16:19:14.020778+0000","last_clean":"2024-09-12T16:19:14.020778+0000","last_became_active":"2024-09-12T16:19:03.775131+0000","last_became_peered":"2024-09-12T16:19:03.775131+0000","last_unstale":"2024-09-12T16:19:14.020778+0000","last_undegraded":"2024-09-12T16:19:14.020778+0000","last_fullsized":"2024-09-12T16:19:14.020778+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:06.175739+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0072137039999999996,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":5469,"num_read_kb":44149,"num_write":663,"num_write_kb":24803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":144,"num_bytes_recovered":10774621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":244,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.135988+0000","last_change":"2024-09-12T16:16:52.184861+0000","last_active":"2024-09-12T16:19:14.135988+0000","last_peered":"2024-09-12T16:19:14.135988+0000","last_clean":"2024-09-12T16:19:14.135988+0000","last_became_active":"2024-09-12T16:16:52.184555+0000","last_became_peered":"2024-09-12T16:16:52.184555+0000","last_unstale":"2024-09-12T16:19:14.135988+0000","last_undegraded":"2024-09-12T16:19:14.135988+0000","last_fullsized":"2024-09-12T16:19:14.135988+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:32.617153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"161'585","reported_seq":10230,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020916+0000","last_change":"2024-09-12T16:18:50.022910+0000","last_active":"2024-09-12T16:19:14.020916+0000","last_peered":"2024-09-12T16:19:14.020916+0000","last_clean":"2024-09-12T16:19:14.020916+0000","last_became_active":"2024-09-12T16:18:25.146756+0000","last_became_peered":"2024-09-12T16:18:25.146756+0000","last_unstale":"2024-09-12T16:19:14.020916+0000","last_undegraded":"2024-09-12T16:19:14.020916+0000","last_fullsized":"2024-09-12T16:19:14.020916+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:36.568042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014402110000000001,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":9889,"num_read_kb":36104,"num_write":494,"num_write_kb":7468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":315,"num_bytes_recovered":8454224,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":254,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136585+0000","last_change":"2024-09-12T16:19:12.821797+0000","last_active":"2024-09-12T16:19:14.136585+0000","last_peered":"2024-09-12T16:19:14.136585+0000","last_clean":"2024-09-12T16:19:14.136585+0000","last_became_active":"2024-09-12T16:19:12.821406+0000","last_became_peered":"2024-09-12T16:19:12.821406+0000","last_unstale":"2024-09-12T16:19:14.136585+0000","last_undegraded":"2024-09-12T16:19:14.136585+0000","last_fullsized":"2024-09-12T16:19:14.136585+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:52.917717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":259,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136033+0000","last_change":"2024-09-12T16:19:03.772630+0000","last_active":"2024-09-12T16:19:14.136033+0000","last_peered":"2024-09-12T16:19:14.136033+0000","last_clean":"2024-09-12T16:19:14.136033+0000","last_became_active":"2024-09-12T16:19:03.772266+0000","last_became_peered":"2024-09-12T16:19:03.772266+0000","last_unstale":"2024-09-12T16:19:14.136033+0000","last_undegraded":"2024-09-12T16:19:14.136033+0000","last_fullsized":"2024-09-12T16:19:14.136033+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:40.751677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:40.751677+0000","last_clean_scrub_stamp":"2024-09-12T16:15:40.751677+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:10.211741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"162'587","reported_seq":13674,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020587+0000","last_change":"2024-09-12T16:18:50.020057+0000","last_active":"2024-09-12T16:19:14.020587+0000","last_peered":"2024-09-12T16:19:14.020587+0000","last_clean":"2024-09-12T16:19:14.020587+0000","last_became_active":"2024-09-12T16:16:34.108998+0000","last_became_peered":"2024-09-12T16:16:34.108998+0000","last_unstale":"2024-09-12T16:19:14.020587+0000","last_undegraded":"2024-09-12T16:19:14.020587+0000","last_fullsized":"2024-09-12T16:19:14.020587+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:33.303142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010878509999999999,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":13209,"num_read_kb":49430,"num_write":675,"num_write_kb":7945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"161'484","reported_seq":31619,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020447+0000","last_change":"2024-09-12T16:18:50.033972+0000","last_active":"2024-09-12T16:19:14.020447+0000","last_peered":"2024-09-12T16:19:14.020447+0000","last_clean":"2024-09-12T16:19:14.020447+0000","last_became_active":"2024-09-12T16:15:57.013620+0000","last_became_peered":"2024-09-12T16:15:57.013620+0000","last_unstale":"2024-09-12T16:19:14.020447+0000","last_undegraded":"2024-09-12T16:19:14.020447+0000","last_fullsized":"2024-09-12T16:19:14.020447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:29.211114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014423319999999999,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":30743,"num_read_kb":77489,"num_write":563,"num_write_kb":11505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"161'892","reported_seq":20872,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136199+0000","last_change":"2024-09-12T16:18:50.021461+0000","last_active":"2024-09-12T16:19:14.136199+0000","last_peered":"2024-09-12T16:19:14.136199+0000","last_clean":"2024-09-12T16:19:14.136199+0000","last_became_active":"2024-09-12T16:16:55.202934+0000","last_became_peered":"2024-09-12T16:16:55.202934+0000","last_unstale":"2024-09-12T16:19:14.136199+0000","last_undegraded":"2024-09-12T16:19:14.136199+0000","last_fullsized":"2024-09-12T16:19:14.136199+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:45.656313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025551279999999998,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":11,"num_read":21936,"num_read_kb":59605,"num_write":943,"num_write_kb":8224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":4487368,"num_keys_recovered":26,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"162'524","reported_seq":15687,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.021028+0000","last_change":"2024-09-12T16:19:03.815628+0000","last_active":"2024-09-12T16:19:14.021028+0000","last_peered":"2024-09-12T16:19:14.021028+0000","last_clean":"2024-09-12T16:19:14.021028+0000","last_became_active":"2024-09-12T16:19:03.777557+0000","last_became_peered":"2024-09-12T16:19:03.777557+0000","last_unstale":"2024-09-12T16:19:14.021028+0000","last_undegraded":"2024-09-12T16:19:14.021028+0000","last_fullsized":"2024-09-12T16:19:14.021028+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:18.398871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040340999999999997,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":15308,"num_read_kb":48885,"num_write":585,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"167'450","reported_seq":11537,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136636+0000","last_change":"2024-09-12T16:19:12.827508+0000","last_active":"2024-09-12T16:19:14.136636+0000","last_peered":"2024-09-12T16:19:14.136636+0000","last_clean":"2024-09-12T16:19:14.136636+0000","last_became_active":"2024-09-12T16:19:12.822409+0000","last_became_peered":"2024-09-12T16:19:12.822409+0000","last_unstale":"2024-09-12T16:19:14.136636+0000","last_undegraded":"2024-09-12T16:19:14.136636+0000","last_fullsized":"2024-09-12T16:19:14.136636+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:38.886837+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00419339,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":9857,"num_read_kb":46208,"num_write":421,"num_write_kb":17232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":322,"num_bytes_recovered":11704832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"161'693","reported_seq":17473,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136383+0000","last_change":"2024-09-12T16:18:50.021962+0000","last_active":"2024-09-12T16:19:14.136383+0000","last_peered":"2024-09-12T16:19:14.136383+0000","last_clean":"2024-09-12T16:19:14.136383+0000","last_became_active":"2024-09-12T16:16:55.202102+0000","last_became_peered":"2024-09-12T16:16:55.202102+0000","last_unstale":"2024-09-12T16:19:14.136383+0000","last_undegraded":"2024-09-12T16:19:14.136383+0000","last_fullsized":"2024-09-12T16:19:14.136383+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:56.617525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026029579999999998,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":18807,"num_read_kb":58739,"num_write":641,"num_write_kb":13631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":126,"num_bytes_recovered":6078562,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"161'589","reported_seq":7753,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136721+0000","last_change":"2024-09-12T16:19:12.829072+0000","last_active":"2024-09-12T16:19:14.136721+0000","last_peered":"2024-09-12T16:19:14.136721+0000","last_clean":"2024-09-12T16:19:14.136721+0000","last_became_active":"2024-09-12T16:19:12.823347+0000","last_became_peered":"2024-09-12T16:19:12.823347+0000","last_unstale":"2024-09-12T16:19:14.136721+0000","last_undegraded":"2024-09-12T16:19:14.136721+0000","last_fullsized":"2024-09-12T16:19:14.136721+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:07.925513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013497229999999999,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":7931,"num_read_kb":30144,"num_write":561,"num_write_kb":13262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":319,"num_bytes_recovered":6744127,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"156'640","reported_seq":12181,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136735+0000","last_change":"2024-09-12T16:19:12.825115+0000","last_active":"2024-09-12T16:19:14.136735+0000","last_peered":"2024-09-12T16:19:14.136735+0000","last_clean":"2024-09-12T16:19:14.136735+0000","last_became_active":"2024-09-12T16:19:12.821943+0000","last_became_peered":"2024-09-12T16:19:12.821943+0000","last_unstale":"2024-09-12T16:19:14.136735+0000","last_undegraded":"2024-09-12T16:19:14.136735+0000","last_fullsized":"2024-09-12T16:19:14.136735+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:09.892807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00220666,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":10861,"num_read_kb":49111,"num_write":815,"num_write_kb":21657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":304,"num_bytes_recovered":6361542,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"167'630","reported_seq":15237,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136345+0000","last_change":"2024-09-12T16:19:12.823613+0000","last_active":"2024-09-12T16:19:14.136345+0000","last_peered":"2024-09-12T16:19:14.136345+0000","last_clean":"2024-09-12T16:19:14.136345+0000","last_became_active":"2024-09-12T16:19:12.819772+0000","last_became_peered":"2024-09-12T16:19:12.819772+0000","last_unstale":"2024-09-12T16:19:14.136345+0000","last_undegraded":"2024-09-12T16:19:14.136345+0000","last_fullsized":"2024-09-12T16:19:14.136345+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:48.846755+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0022010100000000002,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":12815,"num_read_kb":73185,"num_write":784,"num_write_kb":17171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":416,"num_bytes_recovered":13039478,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"161'644","reported_seq":17038,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136155+0000","last_change":"2024-09-12T16:18:50.019987+0000","last_active":"2024-09-12T16:19:14.136155+0000","last_peered":"2024-09-12T16:19:14.136155+0000","last_clean":"2024-09-12T16:19:14.136155+0000","last_became_active":"2024-09-12T16:16:55.202493+0000","last_became_peered":"2024-09-12T16:16:55.202493+0000","last_unstale":"2024-09-12T16:19:14.136155+0000","last_undegraded":"2024-09-12T16:19:14.136155+0000","last_fullsized":"2024-09-12T16:19:14.136155+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:04.668586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013216020000000001,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":16727,"num_read_kb":61490,"num_write":798,"num_write_kb":15885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":1725440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"161'653","reported_seq":15112,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.135985+0000","last_change":"2024-09-12T16:19:03.792167+0000","last_active":"2024-09-12T16:19:14.135985+0000","last_peered":"2024-09-12T16:19:14.135985+0000","last_clean":"2024-09-12T16:19:14.135985+0000","last_became_active":"2024-09-12T16:19:03.770819+0000","last_became_peered":"2024-09-12T16:19:03.770819+0000","last_unstale":"2024-09-12T16:19:14.135985+0000","last_undegraded":"2024-09-12T16:19:14.135985+0000","last_fullsized":"2024-09-12T16:19:14.135985+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":653,"log_dups_size":0,"ondisk_log_size":653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:29:19.655991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055961810000000004,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":16405,"num_read_kb":60197,"num_write":671,"num_write_kb":14674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":3518540,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"162'991","reported_seq":11455,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136175+0000","last_change":"2024-09-12T16:18:50.020480+0000","last_active":"2024-09-12T16:19:14.136175+0000","last_peered":"2024-09-12T16:19:14.136175+0000","last_clean":"2024-09-12T16:19:14.136175+0000","last_became_active":"2024-09-12T16:18:25.147080+0000","last_became_peered":"2024-09-12T16:18:25.147080+0000","last_unstale":"2024-09-12T16:19:14.136175+0000","last_undegraded":"2024-09-12T16:19:14.136175+0000","last_fullsized":"2024-09-12T16:19:14.136175+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":991,"log_dups_size":0,"ondisk_log_size":991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:11.134793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017970779999999999,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":11897,"num_read_kb":44792,"num_write":1435,"num_write_kb":19195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":434,"num_bytes_recovered":17467099,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":418,"num_object_clones":0,"num_object_copies":836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":418,"num_whiteouts":414,"num_read":453939,"num_read_kb":1624894,"num_write":29409,"num_write_kb":478980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5132,"num_bytes_recovered":202080646,"num_keys_recovered":679,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16597,"internal_metadata":0},"log_size":24538,"ondisk_log_size":24538,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":5,"up_from":71,"seq":304942678045,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43140,"kb_used_data":2088,"kb_used_omap":11,"kb_used_meta":41012,"kb_avail":94328700,"statfs":{"total":96636764160,"available":96592588800,"internally_reserved":0,"allocated":2138112,"data_stored":894816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11593,"internal_metadata":41996983},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640303,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77696,"kb_used_data":2088,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94294144,"statfs":{"total":96636764160,"available":96557203456,"internally_reserved":0,"allocated":2138112,"data_stored":894816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640304,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78276,"kb_used_data":2664,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293564,"statfs":{"total":96636764160,"available":96556609536,"internally_reserved":0,"allocated":2727936,"data_stored":1485165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640305,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51332,"kb_used_data":2084,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320508,"statfs":{"total":96636764160,"available":96584200192,"internally_reserved":0,"allocated":2134016,"data_stored":894797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640303,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59652,"kb_used_data":2092,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312188,"statfs":{"total":96636764160,"available":96575680512,"internally_reserved":0,"allocated":2142208,"data_stored":894835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":166,"seq":712964571141,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31808,"kb_used_data":2664,"kb_used_omap":25,"kb_used_meta":29094,"kb_avail":94340032,"statfs":{"total":96636764160,"available":96604192768,"internally_reserved":0,"allocated":2727936,"data_stored":1485165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25827,"internal_metadata":29793053},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9648,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6949,"internal_metadata":0}]}} 2024-09-12T16:19:19.633 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T16:19:19.929 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:19:19.930 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-12T16:19:19.941 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":283,"stamp":"2024-09-12T16:19:18.700612+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":422,"num_object_clones":0,"num_object_copies":844,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":422,"num_whiteouts":414,"num_read":454005,"num_read_kb":1624949,"num_write":29512,"num_write_kb":480610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5138,"num_bytes_recovered":203261401,"num_keys_recovered":679,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24613,"ondisk_log_size":24613,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":341904,"kb_used_data":13680,"kb_used_omap":42,"kb_used_meta":328021,"kb_avail":565889136,"statfs":{"total":579820584960,"available":579470475264,"internally_reserved":0,"allocated":14008320,"data_stored":6549594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43798,"internal_metadata":335893738},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001477"},"pg_stats":[{"pgid":"3.1f","version":"167'657","reported_seq":18912,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136260+0000","last_change":"2024-09-12T16:19:03.804780+0000","last_active":"2024-09-12T16:19:14.136260+0000","last_peered":"2024-09-12T16:19:14.136260+0000","last_clean":"2024-09-12T16:19:14.136260+0000","last_became_active":"2024-09-12T16:19:03.771427+0000","last_became_peered":"2024-09-12T16:19:03.771427+0000","last_unstale":"2024-09-12T16:19:14.136260+0000","last_undegraded":"2024-09-12T16:19:14.136260+0000","last_fullsized":"2024-09-12T16:19:14.136260+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:08.465348+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0071910430000000003,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":18834,"num_read_kb":74247,"num_write":859,"num_write_kb":11027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":2818651,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"161'608","reported_seq":14063,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020631+0000","last_change":"2024-09-12T16:18:50.020927+0000","last_active":"2024-09-12T16:19:14.020631+0000","last_peered":"2024-09-12T16:19:14.020631+0000","last_clean":"2024-09-12T16:19:14.020631+0000","last_became_active":"2024-09-12T16:16:55.202876+0000","last_became_peered":"2024-09-12T16:16:55.202876+0000","last_unstale":"2024-09-12T16:19:14.020631+0000","last_undegraded":"2024-09-12T16:19:14.020631+0000","last_fullsized":"2024-09-12T16:19:14.020631+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:07.278294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076921300000000004,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":13702,"num_read_kb":46928,"num_write":627,"num_write_kb":8472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":3145760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"162'1521","reported_seq":20341,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136679+0000","last_change":"2024-09-12T16:19:12.827121+0000","last_active":"2024-09-12T16:19:14.136679+0000","last_peered":"2024-09-12T16:19:14.136679+0000","last_clean":"2024-09-12T16:19:14.136679+0000","last_became_active":"2024-09-12T16:19:12.822483+0000","last_became_peered":"2024-09-12T16:19:12.822483+0000","last_unstale":"2024-09-12T16:19:14.136679+0000","last_undegraded":"2024-09-12T16:19:14.136679+0000","last_fullsized":"2024-09-12T16:19:14.136679+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1521,"log_dups_size":0,"ondisk_log_size":1521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:33.105008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074565700000000005,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":22738,"num_read_kb":67081,"num_write":2129,"num_write_kb":16176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":374,"num_bytes_recovered":30814554,"num_keys_recovered":34,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"162'853","reported_seq":9191,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136304+0000","last_change":"2024-09-12T16:19:12.827513+0000","last_active":"2024-09-12T16:19:14.136304+0000","last_peered":"2024-09-12T16:19:14.136304+0000","last_clean":"2024-09-12T16:19:14.136304+0000","last_became_active":"2024-09-12T16:19:12.823034+0000","last_became_peered":"2024-09-12T16:19:12.823034+0000","last_unstale":"2024-09-12T16:19:14.136304+0000","last_undegraded":"2024-09-12T16:19:14.136304+0000","last_fullsized":"2024-09-12T16:19:14.136304+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":853,"log_dups_size":0,"ondisk_log_size":853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:31.584973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001077195,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":12,"num_read":9731,"num_read_kb":27914,"num_write":1117,"num_write_kb":6805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":3550768,"num_keys_recovered":168,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"161'1254","reported_seq":8898,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136048+0000","last_change":"2024-09-12T16:19:03.795634+0000","last_active":"2024-09-12T16:19:14.136048+0000","last_peered":"2024-09-12T16:19:14.136048+0000","last_clean":"2024-09-12T16:19:14.136048+0000","last_became_active":"2024-09-12T16:19:03.770673+0000","last_became_peered":"2024-09-12T16:19:03.770673+0000","last_unstale":"2024-09-12T16:19:14.136048+0000","last_undegraded":"2024-09-12T16:19:14.136048+0000","last_fullsized":"2024-09-12T16:19:14.136048+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1254,"log_dups_size":0,"ondisk_log_size":1254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:59.427193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0046887659999999996,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":12367,"num_read_kb":38179,"num_write":1729,"num_write_kb":15361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":14697984,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"162'1312","reported_seq":12069,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020481+0000","last_change":"2024-09-12T16:18:50.033545+0000","last_active":"2024-09-12T16:19:14.020481+0000","last_peered":"2024-09-12T16:19:14.020481+0000","last_clean":"2024-09-12T16:19:14.020481+0000","last_became_active":"2024-09-12T16:15:57.014803+0000","last_became_peered":"2024-09-12T16:15:57.014803+0000","last_unstale":"2024-09-12T16:19:14.020481+0000","last_undegraded":"2024-09-12T16:19:14.020481+0000","last_fullsized":"2024-09-12T16:19:14.020481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1312,"log_dups_size":0,"ondisk_log_size":1312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:39.318465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011248300000000001,"stat_sum":{"num_bytes":19,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":19,"num_read":15353,"num_read_kb":54373,"num_write":2009,"num_write_kb":21868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"161'543","reported_seq":14978,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020840+0000","last_change":"2024-09-12T16:18:50.021500+0000","last_active":"2024-09-12T16:19:14.020840+0000","last_peered":"2024-09-12T16:19:14.020840+0000","last_clean":"2024-09-12T16:19:14.020840+0000","last_became_active":"2024-09-12T16:15:57.016110+0000","last_became_peered":"2024-09-12T16:15:57.016110+0000","last_unstale":"2024-09-12T16:19:14.020840+0000","last_undegraded":"2024-09-12T16:19:14.020840+0000","last_fullsized":"2024-09-12T16:19:14.020840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:26.468226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010965269999999999,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":14633,"num_read_kb":54220,"num_write":566,"num_write_kb":10346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"162'783","reported_seq":6457,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020536+0000","last_change":"2024-09-12T16:19:03.797973+0000","last_active":"2024-09-12T16:19:14.020536+0000","last_peered":"2024-09-12T16:19:14.020536+0000","last_clean":"2024-09-12T16:19:14.020536+0000","last_became_active":"2024-09-12T16:19:03.772548+0000","last_became_peered":"2024-09-12T16:19:03.772548+0000","last_unstale":"2024-09-12T16:19:14.020536+0000","last_undegraded":"2024-09-12T16:19:14.020536+0000","last_fullsized":"2024-09-12T16:19:14.020536+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:17.356209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038788759999999999,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":7154,"num_read_kb":45511,"num_write":918,"num_write_kb":34065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":17173091,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"161'688","reported_seq":8348,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136200+0000","last_change":"2024-09-12T16:19:03.820286+0000","last_active":"2024-09-12T16:19:14.136200+0000","last_peered":"2024-09-12T16:19:14.136200+0000","last_clean":"2024-09-12T16:19:14.136200+0000","last_became_active":"2024-09-12T16:19:03.780157+0000","last_became_peered":"2024-09-12T16:19:03.780157+0000","last_unstale":"2024-09-12T16:19:14.136200+0000","last_undegraded":"2024-09-12T16:19:14.136200+0000","last_fullsized":"2024-09-12T16:19:14.136200+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:26.752604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0043783590000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":7873,"num_read_kb":33843,"num_write":918,"num_write_kb":21944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":337,"num_bytes_recovered":20360415,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"161'1601","reported_seq":15889,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136738+0000","last_change":"2024-09-12T16:19:12.829030+0000","last_active":"2024-09-12T16:19:14.136738+0000","last_peered":"2024-09-12T16:19:14.136738+0000","last_clean":"2024-09-12T16:19:14.136738+0000","last_became_active":"2024-09-12T16:19:12.824566+0000","last_became_peered":"2024-09-12T16:19:12.824566+0000","last_unstale":"2024-09-12T16:19:14.136738+0000","last_undegraded":"2024-09-12T16:19:14.136738+0000","last_fullsized":"2024-09-12T16:19:14.136738+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1601,"log_dups_size":0,"ondisk_log_size":1601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:45.672159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036743769999999999,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":19171,"num_read_kb":50037,"num_write":2353,"num_write_kb":15650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":483,"num_bytes_recovered":14102804,"num_keys_recovered":132,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"167'387","reported_seq":7895,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136386+0000","last_change":"2024-09-12T16:19:03.792024+0000","last_active":"2024-09-12T16:19:14.136386+0000","last_peered":"2024-09-12T16:19:14.136386+0000","last_clean":"2024-09-12T16:19:14.136386+0000","last_became_active":"2024-09-12T16:19:03.771611+0000","last_became_peered":"2024-09-12T16:19:03.771611+0000","last_unstale":"2024-09-12T16:19:14.136386+0000","last_undegraded":"2024-09-12T16:19:14.136386+0000","last_fullsized":"2024-09-12T16:19:14.136386+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:39.727256+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0056373990000000004,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":6922,"num_read_kb":49310,"num_write":420,"num_write_kb":20795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":1054818,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"161'889","reported_seq":9435,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136206+0000","last_change":"2024-09-12T16:18:50.019678+0000","last_active":"2024-09-12T16:19:14.136206+0000","last_peered":"2024-09-12T16:19:14.136206+0000","last_clean":"2024-09-12T16:19:14.136206+0000","last_became_active":"2024-09-12T16:16:53.185698+0000","last_became_peered":"2024-09-12T16:16:53.185698+0000","last_unstale":"2024-09-12T16:19:14.136206+0000","last_undegraded":"2024-09-12T16:19:14.136206+0000","last_fullsized":"2024-09-12T16:19:14.136206+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":889,"log_dups_size":0,"ondisk_log_size":889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:26.722024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001055348,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":12029,"num_read_kb":50248,"num_write":1156,"num_write_kb":23396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":244,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136406+0000","last_change":"2024-09-12T16:16:52.184699+0000","last_active":"2024-09-12T16:19:14.136406+0000","last_peered":"2024-09-12T16:19:14.136406+0000","last_clean":"2024-09-12T16:19:14.136406+0000","last_became_active":"2024-09-12T16:16:52.184420+0000","last_became_peered":"2024-09-12T16:16:52.184420+0000","last_unstale":"2024-09-12T16:19:14.136406+0000","last_undegraded":"2024-09-12T16:19:14.136406+0000","last_fullsized":"2024-09-12T16:19:14.136406+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:50.051152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"167'553","reported_seq":9918,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136070+0000","last_change":"2024-09-12T16:19:03.788892+0000","last_active":"2024-09-12T16:19:14.136070+0000","last_peered":"2024-09-12T16:19:14.136070+0000","last_clean":"2024-09-12T16:19:14.136070+0000","last_became_active":"2024-09-12T16:19:03.770869+0000","last_became_peered":"2024-09-12T16:19:03.770869+0000","last_unstale":"2024-09-12T16:19:14.136070+0000","last_undegraded":"2024-09-12T16:19:14.136070+0000","last_fullsized":"2024-09-12T16:19:14.136070+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:38.037187+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0075018430000000002,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":10526,"num_read_kb":44243,"num_write":495,"num_write_kb":9200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":351,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.021261+0000","last_change":"2024-09-12T16:16:52.187010+0000","last_active":"2024-09-12T16:19:14.021261+0000","last_peered":"2024-09-12T16:19:14.021261+0000","last_clean":"2024-09-12T16:19:14.021261+0000","last_became_active":"2024-09-12T16:16:52.186638+0000","last_became_peered":"2024-09-12T16:16:52.186638+0000","last_unstale":"2024-09-12T16:19:14.021261+0000","last_undegraded":"2024-09-12T16:19:14.021261+0000","last_fullsized":"2024-09-12T16:19:14.021261+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:40.681796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066384400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"161'763","reported_seq":16796,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020763+0000","last_change":"2024-09-12T16:18:50.020013+0000","last_active":"2024-09-12T16:19:14.020763+0000","last_peered":"2024-09-12T16:19:14.020763+0000","last_clean":"2024-09-12T16:19:14.020763+0000","last_became_active":"2024-09-12T16:16:34.108850+0000","last_became_peered":"2024-09-12T16:16:34.108850+0000","last_unstale":"2024-09-12T16:19:14.020763+0000","last_undegraded":"2024-09-12T16:19:14.020763+0000","last_fullsized":"2024-09-12T16:19:14.020763+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":763,"log_dups_size":0,"ondisk_log_size":763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:03.909473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080883699999999997,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":17664,"num_read_kb":61096,"num_write":665,"num_write_kb":27115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":253,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136274+0000","last_change":"2024-09-12T16:19:03.772388+0000","last_active":"2024-09-12T16:19:14.136274+0000","last_peered":"2024-09-12T16:19:14.136274+0000","last_clean":"2024-09-12T16:19:14.136274+0000","last_became_active":"2024-09-12T16:19:03.772128+0000","last_became_peered":"2024-09-12T16:19:03.772128+0000","last_unstale":"2024-09-12T16:19:14.136274+0000","last_undegraded":"2024-09-12T16:19:14.136274+0000","last_fullsized":"2024-09-12T16:19:14.136274+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:57.248706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"161'768","reported_seq":8492,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.021187+0000","last_change":"2024-09-12T16:18:50.022176+0000","last_active":"2024-09-12T16:19:14.021187+0000","last_peered":"2024-09-12T16:19:14.021187+0000","last_clean":"2024-09-12T16:19:14.021187+0000","last_became_active":"2024-09-12T16:15:57.011381+0000","last_became_peered":"2024-09-12T16:15:57.011381+0000","last_unstale":"2024-09-12T16:19:14.021187+0000","last_undegraded":"2024-09-12T16:19:14.021187+0000","last_fullsized":"2024-09-12T16:19:14.021187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:56.655837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012620280000000001,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":10668,"num_read_kb":44352,"num_write":952,"num_write_kb":7790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":348,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.021193+0000","last_change":"2024-09-12T16:19:03.773076+0000","last_active":"2024-09-12T16:19:14.021193+0000","last_peered":"2024-09-12T16:19:14.021193+0000","last_clean":"2024-09-12T16:19:14.021193+0000","last_became_active":"2024-09-12T16:19:03.772694+0000","last_became_peered":"2024-09-12T16:19:03.772694+0000","last_unstale":"2024-09-12T16:19:14.021193+0000","last_undegraded":"2024-09-12T16:19:14.021193+0000","last_fullsized":"2024-09-12T16:19:14.021193+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:29.591812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065522900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"161'847","reported_seq":22320,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136695+0000","last_change":"2024-09-12T16:19:12.827179+0000","last_active":"2024-09-12T16:19:14.136695+0000","last_peered":"2024-09-12T16:19:14.136695+0000","last_clean":"2024-09-12T16:19:14.136695+0000","last_became_active":"2024-09-12T16:19:12.821483+0000","last_became_peered":"2024-09-12T16:19:12.821483+0000","last_unstale":"2024-09-12T16:19:14.136695+0000","last_undegraded":"2024-09-12T16:19:14.136695+0000","last_fullsized":"2024-09-12T16:19:14.136695+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:42.532127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001861333,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":25876,"num_read_kb":48987,"num_write":739,"num_write_kb":4795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":335,"num_bytes_recovered":4005968,"num_keys_recovered":105,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"162'843","reported_seq":6625,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020628+0000","last_change":"2024-09-12T16:19:03.811936+0000","last_active":"2024-09-12T16:19:14.020628+0000","last_peered":"2024-09-12T16:19:14.020628+0000","last_clean":"2024-09-12T16:19:14.020628+0000","last_became_active":"2024-09-12T16:19:03.778155+0000","last_became_peered":"2024-09-12T16:19:03.778155+0000","last_unstale":"2024-09-12T16:19:14.020628+0000","last_undegraded":"2024-09-12T16:19:14.020628+0000","last_fullsized":"2024-09-12T16:19:14.020628+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:50.828354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028595159999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":5,"num_read":6564,"num_read_kb":41539,"num_write":1022,"num_write_kb":9272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":275,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136387+0000","last_change":"2024-09-12T16:19:12.821506+0000","last_active":"2024-09-12T16:19:14.136387+0000","last_peered":"2024-09-12T16:19:14.136387+0000","last_clean":"2024-09-12T16:19:14.136387+0000","last_became_active":"2024-09-12T16:19:12.820814+0000","last_became_peered":"2024-09-12T16:19:12.820814+0000","last_unstale":"2024-09-12T16:19:14.136387+0000","last_undegraded":"2024-09-12T16:19:14.136387+0000","last_fullsized":"2024-09-12T16:19:14.136387+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:38.164468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"162'797","reported_seq":18921,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020586+0000","last_change":"2024-09-12T16:18:50.023044+0000","last_active":"2024-09-12T16:19:14.020586+0000","last_peered":"2024-09-12T16:19:14.020586+0000","last_clean":"2024-09-12T16:19:14.020586+0000","last_became_active":"2024-09-12T16:15:57.014294+0000","last_became_peered":"2024-09-12T16:15:57.014294+0000","last_unstale":"2024-09-12T16:19:14.020586+0000","last_undegraded":"2024-09-12T16:19:14.020586+0000","last_fullsized":"2024-09-12T16:19:14.020586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:27.209021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023814270000000002,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":20280,"num_read_kb":53258,"num_write":686,"num_write_kb":17135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":322,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020909+0000","last_change":"2024-09-12T16:18:29.019699+0000","last_active":"2024-09-12T16:19:14.020909+0000","last_peered":"2024-09-12T16:19:14.020909+0000","last_clean":"2024-09-12T16:19:14.020909+0000","last_became_active":"2024-09-12T16:18:29.019339+0000","last_became_peered":"2024-09-12T16:18:29.019339+0000","last_unstale":"2024-09-12T16:19:14.020909+0000","last_undegraded":"2024-09-12T16:19:14.020909+0000","last_fullsized":"2024-09-12T16:19:14.020909+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:51:54.701552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'509","reported_seq":5927,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020778+0000","last_change":"2024-09-12T16:19:03.807136+0000","last_active":"2024-09-12T16:19:14.020778+0000","last_peered":"2024-09-12T16:19:14.020778+0000","last_clean":"2024-09-12T16:19:14.020778+0000","last_became_active":"2024-09-12T16:19:03.775131+0000","last_became_peered":"2024-09-12T16:19:03.775131+0000","last_unstale":"2024-09-12T16:19:14.020778+0000","last_undegraded":"2024-09-12T16:19:14.020778+0000","last_fullsized":"2024-09-12T16:19:14.020778+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:06.175739+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0072137039999999996,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":5469,"num_read_kb":44149,"num_write":663,"num_write_kb":24803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":144,"num_bytes_recovered":10774621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":244,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.135988+0000","last_change":"2024-09-12T16:16:52.184861+0000","last_active":"2024-09-12T16:19:14.135988+0000","last_peered":"2024-09-12T16:19:14.135988+0000","last_clean":"2024-09-12T16:19:14.135988+0000","last_became_active":"2024-09-12T16:16:52.184555+0000","last_became_peered":"2024-09-12T16:16:52.184555+0000","last_unstale":"2024-09-12T16:19:14.135988+0000","last_undegraded":"2024-09-12T16:19:14.135988+0000","last_fullsized":"2024-09-12T16:19:14.135988+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:32.617153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"161'585","reported_seq":10230,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020916+0000","last_change":"2024-09-12T16:18:50.022910+0000","last_active":"2024-09-12T16:19:14.020916+0000","last_peered":"2024-09-12T16:19:14.020916+0000","last_clean":"2024-09-12T16:19:14.020916+0000","last_became_active":"2024-09-12T16:18:25.146756+0000","last_became_peered":"2024-09-12T16:18:25.146756+0000","last_unstale":"2024-09-12T16:19:14.020916+0000","last_undegraded":"2024-09-12T16:19:14.020916+0000","last_fullsized":"2024-09-12T16:19:14.020916+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:36.568042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014402110000000001,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":9889,"num_read_kb":36104,"num_write":494,"num_write_kb":7468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":315,"num_bytes_recovered":8454224,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":254,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136585+0000","last_change":"2024-09-12T16:19:12.821797+0000","last_active":"2024-09-12T16:19:14.136585+0000","last_peered":"2024-09-12T16:19:14.136585+0000","last_clean":"2024-09-12T16:19:14.136585+0000","last_became_active":"2024-09-12T16:19:12.821406+0000","last_became_peered":"2024-09-12T16:19:12.821406+0000","last_unstale":"2024-09-12T16:19:14.136585+0000","last_undegraded":"2024-09-12T16:19:14.136585+0000","last_fullsized":"2024-09-12T16:19:14.136585+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:52.917717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":259,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136033+0000","last_change":"2024-09-12T16:19:03.772630+0000","last_active":"2024-09-12T16:19:14.136033+0000","last_peered":"2024-09-12T16:19:14.136033+0000","last_clean":"2024-09-12T16:19:14.136033+0000","last_became_active":"2024-09-12T16:19:03.772266+0000","last_became_peered":"2024-09-12T16:19:03.772266+0000","last_unstale":"2024-09-12T16:19:14.136033+0000","last_undegraded":"2024-09-12T16:19:14.136033+0000","last_fullsized":"2024-09-12T16:19:14.136033+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:40.751677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:40.751677+0000","last_clean_scrub_stamp":"2024-09-12T16:15:40.751677+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:10.211741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"162'587","reported_seq":13674,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020587+0000","last_change":"2024-09-12T16:18:50.020057+0000","last_active":"2024-09-12T16:19:14.020587+0000","last_peered":"2024-09-12T16:19:14.020587+0000","last_clean":"2024-09-12T16:19:14.020587+0000","last_became_active":"2024-09-12T16:16:34.108998+0000","last_became_peered":"2024-09-12T16:16:34.108998+0000","last_unstale":"2024-09-12T16:19:14.020587+0000","last_undegraded":"2024-09-12T16:19:14.020587+0000","last_fullsized":"2024-09-12T16:19:14.020587+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:33.303142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010878509999999999,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":13209,"num_read_kb":49430,"num_write":675,"num_write_kb":7945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"161'484","reported_seq":31619,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020447+0000","last_change":"2024-09-12T16:18:50.033972+0000","last_active":"2024-09-12T16:19:14.020447+0000","last_peered":"2024-09-12T16:19:14.020447+0000","last_clean":"2024-09-12T16:19:14.020447+0000","last_became_active":"2024-09-12T16:15:57.013620+0000","last_became_peered":"2024-09-12T16:15:57.013620+0000","last_unstale":"2024-09-12T16:19:14.020447+0000","last_undegraded":"2024-09-12T16:19:14.020447+0000","last_fullsized":"2024-09-12T16:19:14.020447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:29.211114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014423319999999999,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":30743,"num_read_kb":77489,"num_write":563,"num_write_kb":11505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"161'892","reported_seq":20872,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136199+0000","last_change":"2024-09-12T16:18:50.021461+0000","last_active":"2024-09-12T16:19:14.136199+0000","last_peered":"2024-09-12T16:19:14.136199+0000","last_clean":"2024-09-12T16:19:14.136199+0000","last_became_active":"2024-09-12T16:16:55.202934+0000","last_became_peered":"2024-09-12T16:16:55.202934+0000","last_unstale":"2024-09-12T16:19:14.136199+0000","last_undegraded":"2024-09-12T16:19:14.136199+0000","last_fullsized":"2024-09-12T16:19:14.136199+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:45.656313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025551279999999998,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":11,"num_read":21936,"num_read_kb":59605,"num_write":943,"num_write_kb":8224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":4487368,"num_keys_recovered":26,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"162'524","reported_seq":15687,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.021028+0000","last_change":"2024-09-12T16:19:03.815628+0000","last_active":"2024-09-12T16:19:14.021028+0000","last_peered":"2024-09-12T16:19:14.021028+0000","last_clean":"2024-09-12T16:19:14.021028+0000","last_became_active":"2024-09-12T16:19:03.777557+0000","last_became_peered":"2024-09-12T16:19:03.777557+0000","last_unstale":"2024-09-12T16:19:14.021028+0000","last_undegraded":"2024-09-12T16:19:14.021028+0000","last_fullsized":"2024-09-12T16:19:14.021028+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:18.398871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040340999999999997,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":15308,"num_read_kb":48885,"num_write":585,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"167'450","reported_seq":11537,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136636+0000","last_change":"2024-09-12T16:19:12.827508+0000","last_active":"2024-09-12T16:19:14.136636+0000","last_peered":"2024-09-12T16:19:14.136636+0000","last_clean":"2024-09-12T16:19:14.136636+0000","last_became_active":"2024-09-12T16:19:12.822409+0000","last_became_peered":"2024-09-12T16:19:12.822409+0000","last_unstale":"2024-09-12T16:19:14.136636+0000","last_undegraded":"2024-09-12T16:19:14.136636+0000","last_fullsized":"2024-09-12T16:19:14.136636+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:38.886837+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00419339,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":9857,"num_read_kb":46208,"num_write":421,"num_write_kb":17232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":322,"num_bytes_recovered":11704832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"161'693","reported_seq":17473,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136383+0000","last_change":"2024-09-12T16:18:50.021962+0000","last_active":"2024-09-12T16:19:14.136383+0000","last_peered":"2024-09-12T16:19:14.136383+0000","last_clean":"2024-09-12T16:19:14.136383+0000","last_became_active":"2024-09-12T16:16:55.202102+0000","last_became_peered":"2024-09-12T16:16:55.202102+0000","last_unstale":"2024-09-12T16:19:14.136383+0000","last_undegraded":"2024-09-12T16:19:14.136383+0000","last_fullsized":"2024-09-12T16:19:14.136383+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:56.617525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026029579999999998,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":18807,"num_read_kb":58739,"num_write":641,"num_write_kb":13631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":126,"num_bytes_recovered":6078562,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"161'589","reported_seq":7753,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136721+0000","last_change":"2024-09-12T16:19:12.829072+0000","last_active":"2024-09-12T16:19:14.136721+0000","last_peered":"2024-09-12T16:19:14.136721+0000","last_clean":"2024-09-12T16:19:14.136721+0000","last_became_active":"2024-09-12T16:19:12.823347+0000","last_became_peered":"2024-09-12T16:19:12.823347+0000","last_unstale":"2024-09-12T16:19:14.136721+0000","last_undegraded":"2024-09-12T16:19:14.136721+0000","last_fullsized":"2024-09-12T16:19:14.136721+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:07.925513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013497229999999999,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":7931,"num_read_kb":30144,"num_write":561,"num_write_kb":13262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":319,"num_bytes_recovered":6744127,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"156'640","reported_seq":12181,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136735+0000","last_change":"2024-09-12T16:19:12.825115+0000","last_active":"2024-09-12T16:19:14.136735+0000","last_peered":"2024-09-12T16:19:14.136735+0000","last_clean":"2024-09-12T16:19:14.136735+0000","last_became_active":"2024-09-12T16:19:12.821943+0000","last_became_peered":"2024-09-12T16:19:12.821943+0000","last_unstale":"2024-09-12T16:19:14.136735+0000","last_undegraded":"2024-09-12T16:19:14.136735+0000","last_fullsized":"2024-09-12T16:19:14.136735+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:09.892807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00220666,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":10861,"num_read_kb":49111,"num_write":815,"num_write_kb":21657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":304,"num_bytes_recovered":6361542,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"167'630","reported_seq":15237,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136345+0000","last_change":"2024-09-12T16:19:12.823613+0000","last_active":"2024-09-12T16:19:14.136345+0000","last_peered":"2024-09-12T16:19:14.136345+0000","last_clean":"2024-09-12T16:19:14.136345+0000","last_became_active":"2024-09-12T16:19:12.819772+0000","last_became_peered":"2024-09-12T16:19:12.819772+0000","last_unstale":"2024-09-12T16:19:14.136345+0000","last_undegraded":"2024-09-12T16:19:14.136345+0000","last_fullsized":"2024-09-12T16:19:14.136345+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:48.846755+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0022010100000000002,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":12815,"num_read_kb":73185,"num_write":784,"num_write_kb":17171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":416,"num_bytes_recovered":13039478,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"161'644","reported_seq":17038,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136155+0000","last_change":"2024-09-12T16:18:50.019987+0000","last_active":"2024-09-12T16:19:14.136155+0000","last_peered":"2024-09-12T16:19:14.136155+0000","last_clean":"2024-09-12T16:19:14.136155+0000","last_became_active":"2024-09-12T16:16:55.202493+0000","last_became_peered":"2024-09-12T16:16:55.202493+0000","last_unstale":"2024-09-12T16:19:14.136155+0000","last_undegraded":"2024-09-12T16:19:14.136155+0000","last_fullsized":"2024-09-12T16:19:14.136155+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:04.668586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013216020000000001,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":16727,"num_read_kb":61490,"num_write":798,"num_write_kb":15885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":1725440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"161'653","reported_seq":15112,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.135985+0000","last_change":"2024-09-12T16:19:03.792167+0000","last_active":"2024-09-12T16:19:14.135985+0000","last_peered":"2024-09-12T16:19:14.135985+0000","last_clean":"2024-09-12T16:19:14.135985+0000","last_became_active":"2024-09-12T16:19:03.770819+0000","last_became_peered":"2024-09-12T16:19:03.770819+0000","last_unstale":"2024-09-12T16:19:14.135985+0000","last_undegraded":"2024-09-12T16:19:14.135985+0000","last_fullsized":"2024-09-12T16:19:14.135985+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":653,"log_dups_size":0,"ondisk_log_size":653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:29:19.655991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055961810000000004,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":16405,"num_read_kb":60197,"num_write":671,"num_write_kb":14674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":3518540,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"162'991","reported_seq":11455,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136175+0000","last_change":"2024-09-12T16:18:50.020480+0000","last_active":"2024-09-12T16:19:14.136175+0000","last_peered":"2024-09-12T16:19:14.136175+0000","last_clean":"2024-09-12T16:19:14.136175+0000","last_became_active":"2024-09-12T16:18:25.147080+0000","last_became_peered":"2024-09-12T16:18:25.147080+0000","last_unstale":"2024-09-12T16:19:14.136175+0000","last_undegraded":"2024-09-12T16:19:14.136175+0000","last_fullsized":"2024-09-12T16:19:14.136175+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":991,"log_dups_size":0,"ondisk_log_size":991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:11.134793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017970779999999999,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":11897,"num_read_kb":44792,"num_write":1435,"num_write_kb":19195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":434,"num_bytes_recovered":17467099,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":418,"num_object_clones":0,"num_object_copies":836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":418,"num_whiteouts":414,"num_read":453939,"num_read_kb":1624894,"num_write":29409,"num_write_kb":478980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5132,"num_bytes_recovered":202080646,"num_keys_recovered":679,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16597,"internal_metadata":0},"log_size":24538,"ondisk_log_size":24538,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":5,"up_from":71,"seq":304942678045,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43140,"kb_used_data":2088,"kb_used_omap":11,"kb_used_meta":41012,"kb_avail":94328700,"statfs":{"total":96636764160,"available":96592588800,"internally_reserved":0,"allocated":2138112,"data_stored":894816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11593,"internal_metadata":41996983},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640303,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77696,"kb_used_data":2088,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94294144,"statfs":{"total":96636764160,"available":96557203456,"internally_reserved":0,"allocated":2138112,"data_stored":894816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640304,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78276,"kb_used_data":2664,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293564,"statfs":{"total":96636764160,"available":96556609536,"internally_reserved":0,"allocated":2727936,"data_stored":1485165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640305,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51332,"kb_used_data":2084,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320508,"statfs":{"total":96636764160,"available":96584200192,"internally_reserved":0,"allocated":2134016,"data_stored":894797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640303,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59652,"kb_used_data":2092,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312188,"statfs":{"total":96636764160,"available":96575680512,"internally_reserved":0,"allocated":2142208,"data_stored":894835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":166,"seq":712964571141,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31808,"kb_used_data":2664,"kb_used_omap":25,"kb_used_meta":29094,"kb_avail":94340032,"statfs":{"total":96636764160,"available":96604192768,"internally_reserved":0,"allocated":2727936,"data_stored":1485165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25827,"internal_metadata":29793053},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9648,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6949,"internal_metadata":0}]}} 2024-09-12T16:19:19.943 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T16:19:19.943 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T16:19:20.241 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:19:20.241 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-12T16:19:20.253 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":283,"stamp":"2024-09-12T16:19:18.700612+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":422,"num_object_clones":0,"num_object_copies":844,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":422,"num_whiteouts":414,"num_read":454005,"num_read_kb":1624949,"num_write":29512,"num_write_kb":480610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5138,"num_bytes_recovered":203261401,"num_keys_recovered":679,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24613,"ondisk_log_size":24613,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":341904,"kb_used_data":13680,"kb_used_omap":42,"kb_used_meta":328021,"kb_avail":565889136,"statfs":{"total":579820584960,"available":579470475264,"internally_reserved":0,"allocated":14008320,"data_stored":6549594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43798,"internal_metadata":335893738},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001477"},"pg_stats":[{"pgid":"3.1f","version":"167'657","reported_seq":18912,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136260+0000","last_change":"2024-09-12T16:19:03.804780+0000","last_active":"2024-09-12T16:19:14.136260+0000","last_peered":"2024-09-12T16:19:14.136260+0000","last_clean":"2024-09-12T16:19:14.136260+0000","last_became_active":"2024-09-12T16:19:03.771427+0000","last_became_peered":"2024-09-12T16:19:03.771427+0000","last_unstale":"2024-09-12T16:19:14.136260+0000","last_undegraded":"2024-09-12T16:19:14.136260+0000","last_fullsized":"2024-09-12T16:19:14.136260+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:08.465348+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0071910430000000003,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":18834,"num_read_kb":74247,"num_write":859,"num_write_kb":11027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":2818651,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"161'608","reported_seq":14063,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020631+0000","last_change":"2024-09-12T16:18:50.020927+0000","last_active":"2024-09-12T16:19:14.020631+0000","last_peered":"2024-09-12T16:19:14.020631+0000","last_clean":"2024-09-12T16:19:14.020631+0000","last_became_active":"2024-09-12T16:16:55.202876+0000","last_became_peered":"2024-09-12T16:16:55.202876+0000","last_unstale":"2024-09-12T16:19:14.020631+0000","last_undegraded":"2024-09-12T16:19:14.020631+0000","last_fullsized":"2024-09-12T16:19:14.020631+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:07.278294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076921300000000004,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":13702,"num_read_kb":46928,"num_write":627,"num_write_kb":8472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":3145760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"162'1521","reported_seq":20341,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136679+0000","last_change":"2024-09-12T16:19:12.827121+0000","last_active":"2024-09-12T16:19:14.136679+0000","last_peered":"2024-09-12T16:19:14.136679+0000","last_clean":"2024-09-12T16:19:14.136679+0000","last_became_active":"2024-09-12T16:19:12.822483+0000","last_became_peered":"2024-09-12T16:19:12.822483+0000","last_unstale":"2024-09-12T16:19:14.136679+0000","last_undegraded":"2024-09-12T16:19:14.136679+0000","last_fullsized":"2024-09-12T16:19:14.136679+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1521,"log_dups_size":0,"ondisk_log_size":1521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:33.105008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074565700000000005,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":22738,"num_read_kb":67081,"num_write":2129,"num_write_kb":16176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":374,"num_bytes_recovered":30814554,"num_keys_recovered":34,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"162'853","reported_seq":9191,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136304+0000","last_change":"2024-09-12T16:19:12.827513+0000","last_active":"2024-09-12T16:19:14.136304+0000","last_peered":"2024-09-12T16:19:14.136304+0000","last_clean":"2024-09-12T16:19:14.136304+0000","last_became_active":"2024-09-12T16:19:12.823034+0000","last_became_peered":"2024-09-12T16:19:12.823034+0000","last_unstale":"2024-09-12T16:19:14.136304+0000","last_undegraded":"2024-09-12T16:19:14.136304+0000","last_fullsized":"2024-09-12T16:19:14.136304+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":853,"log_dups_size":0,"ondisk_log_size":853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:31.584973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001077195,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":12,"num_read":9731,"num_read_kb":27914,"num_write":1117,"num_write_kb":6805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":3550768,"num_keys_recovered":168,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"161'1254","reported_seq":8898,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136048+0000","last_change":"2024-09-12T16:19:03.795634+0000","last_active":"2024-09-12T16:19:14.136048+0000","last_peered":"2024-09-12T16:19:14.136048+0000","last_clean":"2024-09-12T16:19:14.136048+0000","last_became_active":"2024-09-12T16:19:03.770673+0000","last_became_peered":"2024-09-12T16:19:03.770673+0000","last_unstale":"2024-09-12T16:19:14.136048+0000","last_undegraded":"2024-09-12T16:19:14.136048+0000","last_fullsized":"2024-09-12T16:19:14.136048+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1254,"log_dups_size":0,"ondisk_log_size":1254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:59.427193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0046887659999999996,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":12367,"num_read_kb":38179,"num_write":1729,"num_write_kb":15361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":14697984,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"162'1312","reported_seq":12069,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020481+0000","last_change":"2024-09-12T16:18:50.033545+0000","last_active":"2024-09-12T16:19:14.020481+0000","last_peered":"2024-09-12T16:19:14.020481+0000","last_clean":"2024-09-12T16:19:14.020481+0000","last_became_active":"2024-09-12T16:15:57.014803+0000","last_became_peered":"2024-09-12T16:15:57.014803+0000","last_unstale":"2024-09-12T16:19:14.020481+0000","last_undegraded":"2024-09-12T16:19:14.020481+0000","last_fullsized":"2024-09-12T16:19:14.020481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1312,"log_dups_size":0,"ondisk_log_size":1312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:39.318465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011248300000000001,"stat_sum":{"num_bytes":19,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":19,"num_read":15353,"num_read_kb":54373,"num_write":2009,"num_write_kb":21868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"161'543","reported_seq":14978,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020840+0000","last_change":"2024-09-12T16:18:50.021500+0000","last_active":"2024-09-12T16:19:14.020840+0000","last_peered":"2024-09-12T16:19:14.020840+0000","last_clean":"2024-09-12T16:19:14.020840+0000","last_became_active":"2024-09-12T16:15:57.016110+0000","last_became_peered":"2024-09-12T16:15:57.016110+0000","last_unstale":"2024-09-12T16:19:14.020840+0000","last_undegraded":"2024-09-12T16:19:14.020840+0000","last_fullsized":"2024-09-12T16:19:14.020840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:26.468226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010965269999999999,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":14633,"num_read_kb":54220,"num_write":566,"num_write_kb":10346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"162'783","reported_seq":6457,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020536+0000","last_change":"2024-09-12T16:19:03.797973+0000","last_active":"2024-09-12T16:19:14.020536+0000","last_peered":"2024-09-12T16:19:14.020536+0000","last_clean":"2024-09-12T16:19:14.020536+0000","last_became_active":"2024-09-12T16:19:03.772548+0000","last_became_peered":"2024-09-12T16:19:03.772548+0000","last_unstale":"2024-09-12T16:19:14.020536+0000","last_undegraded":"2024-09-12T16:19:14.020536+0000","last_fullsized":"2024-09-12T16:19:14.020536+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:17.356209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038788759999999999,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":7154,"num_read_kb":45511,"num_write":918,"num_write_kb":34065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":17173091,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"161'688","reported_seq":8348,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136200+0000","last_change":"2024-09-12T16:19:03.820286+0000","last_active":"2024-09-12T16:19:14.136200+0000","last_peered":"2024-09-12T16:19:14.136200+0000","last_clean":"2024-09-12T16:19:14.136200+0000","last_became_active":"2024-09-12T16:19:03.780157+0000","last_became_peered":"2024-09-12T16:19:03.780157+0000","last_unstale":"2024-09-12T16:19:14.136200+0000","last_undegraded":"2024-09-12T16:19:14.136200+0000","last_fullsized":"2024-09-12T16:19:14.136200+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:26.752604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0043783590000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":7873,"num_read_kb":33843,"num_write":918,"num_write_kb":21944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":337,"num_bytes_recovered":20360415,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"161'1601","reported_seq":15889,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136738+0000","last_change":"2024-09-12T16:19:12.829030+0000","last_active":"2024-09-12T16:19:14.136738+0000","last_peered":"2024-09-12T16:19:14.136738+0000","last_clean":"2024-09-12T16:19:14.136738+0000","last_became_active":"2024-09-12T16:19:12.824566+0000","last_became_peered":"2024-09-12T16:19:12.824566+0000","last_unstale":"2024-09-12T16:19:14.136738+0000","last_undegraded":"2024-09-12T16:19:14.136738+0000","last_fullsized":"2024-09-12T16:19:14.136738+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1601,"log_dups_size":0,"ondisk_log_size":1601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:45.672159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036743769999999999,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":19171,"num_read_kb":50037,"num_write":2353,"num_write_kb":15650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":483,"num_bytes_recovered":14102804,"num_keys_recovered":132,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"167'387","reported_seq":7895,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136386+0000","last_change":"2024-09-12T16:19:03.792024+0000","last_active":"2024-09-12T16:19:14.136386+0000","last_peered":"2024-09-12T16:19:14.136386+0000","last_clean":"2024-09-12T16:19:14.136386+0000","last_became_active":"2024-09-12T16:19:03.771611+0000","last_became_peered":"2024-09-12T16:19:03.771611+0000","last_unstale":"2024-09-12T16:19:14.136386+0000","last_undegraded":"2024-09-12T16:19:14.136386+0000","last_fullsized":"2024-09-12T16:19:14.136386+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:39.727256+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0056373990000000004,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":6922,"num_read_kb":49310,"num_write":420,"num_write_kb":20795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":1054818,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"161'889","reported_seq":9435,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136206+0000","last_change":"2024-09-12T16:18:50.019678+0000","last_active":"2024-09-12T16:19:14.136206+0000","last_peered":"2024-09-12T16:19:14.136206+0000","last_clean":"2024-09-12T16:19:14.136206+0000","last_became_active":"2024-09-12T16:16:53.185698+0000","last_became_peered":"2024-09-12T16:16:53.185698+0000","last_unstale":"2024-09-12T16:19:14.136206+0000","last_undegraded":"2024-09-12T16:19:14.136206+0000","last_fullsized":"2024-09-12T16:19:14.136206+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":889,"log_dups_size":0,"ondisk_log_size":889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:26.722024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001055348,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":12029,"num_read_kb":50248,"num_write":1156,"num_write_kb":23396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":244,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136406+0000","last_change":"2024-09-12T16:16:52.184699+0000","last_active":"2024-09-12T16:19:14.136406+0000","last_peered":"2024-09-12T16:19:14.136406+0000","last_clean":"2024-09-12T16:19:14.136406+0000","last_became_active":"2024-09-12T16:16:52.184420+0000","last_became_peered":"2024-09-12T16:16:52.184420+0000","last_unstale":"2024-09-12T16:19:14.136406+0000","last_undegraded":"2024-09-12T16:19:14.136406+0000","last_fullsized":"2024-09-12T16:19:14.136406+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:50.051152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"167'553","reported_seq":9918,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136070+0000","last_change":"2024-09-12T16:19:03.788892+0000","last_active":"2024-09-12T16:19:14.136070+0000","last_peered":"2024-09-12T16:19:14.136070+0000","last_clean":"2024-09-12T16:19:14.136070+0000","last_became_active":"2024-09-12T16:19:03.770869+0000","last_became_peered":"2024-09-12T16:19:03.770869+0000","last_unstale":"2024-09-12T16:19:14.136070+0000","last_undegraded":"2024-09-12T16:19:14.136070+0000","last_fullsized":"2024-09-12T16:19:14.136070+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:38.037187+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0075018430000000002,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":10526,"num_read_kb":44243,"num_write":495,"num_write_kb":9200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":351,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.021261+0000","last_change":"2024-09-12T16:16:52.187010+0000","last_active":"2024-09-12T16:19:14.021261+0000","last_peered":"2024-09-12T16:19:14.021261+0000","last_clean":"2024-09-12T16:19:14.021261+0000","last_became_active":"2024-09-12T16:16:52.186638+0000","last_became_peered":"2024-09-12T16:16:52.186638+0000","last_unstale":"2024-09-12T16:19:14.021261+0000","last_undegraded":"2024-09-12T16:19:14.021261+0000","last_fullsized":"2024-09-12T16:19:14.021261+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:40.681796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066384400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"161'763","reported_seq":16796,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020763+0000","last_change":"2024-09-12T16:18:50.020013+0000","last_active":"2024-09-12T16:19:14.020763+0000","last_peered":"2024-09-12T16:19:14.020763+0000","last_clean":"2024-09-12T16:19:14.020763+0000","last_became_active":"2024-09-12T16:16:34.108850+0000","last_became_peered":"2024-09-12T16:16:34.108850+0000","last_unstale":"2024-09-12T16:19:14.020763+0000","last_undegraded":"2024-09-12T16:19:14.020763+0000","last_fullsized":"2024-09-12T16:19:14.020763+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":763,"log_dups_size":0,"ondisk_log_size":763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:03.909473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080883699999999997,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":17664,"num_read_kb":61096,"num_write":665,"num_write_kb":27115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":253,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136274+0000","last_change":"2024-09-12T16:19:03.772388+0000","last_active":"2024-09-12T16:19:14.136274+0000","last_peered":"2024-09-12T16:19:14.136274+0000","last_clean":"2024-09-12T16:19:14.136274+0000","last_became_active":"2024-09-12T16:19:03.772128+0000","last_became_peered":"2024-09-12T16:19:03.772128+0000","last_unstale":"2024-09-12T16:19:14.136274+0000","last_undegraded":"2024-09-12T16:19:14.136274+0000","last_fullsized":"2024-09-12T16:19:14.136274+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:57.248706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"161'768","reported_seq":8492,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.021187+0000","last_change":"2024-09-12T16:18:50.022176+0000","last_active":"2024-09-12T16:19:14.021187+0000","last_peered":"2024-09-12T16:19:14.021187+0000","last_clean":"2024-09-12T16:19:14.021187+0000","last_became_active":"2024-09-12T16:15:57.011381+0000","last_became_peered":"2024-09-12T16:15:57.011381+0000","last_unstale":"2024-09-12T16:19:14.021187+0000","last_undegraded":"2024-09-12T16:19:14.021187+0000","last_fullsized":"2024-09-12T16:19:14.021187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:56.655837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012620280000000001,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":10668,"num_read_kb":44352,"num_write":952,"num_write_kb":7790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":348,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.021193+0000","last_change":"2024-09-12T16:19:03.773076+0000","last_active":"2024-09-12T16:19:14.021193+0000","last_peered":"2024-09-12T16:19:14.021193+0000","last_clean":"2024-09-12T16:19:14.021193+0000","last_became_active":"2024-09-12T16:19:03.772694+0000","last_became_peered":"2024-09-12T16:19:03.772694+0000","last_unstale":"2024-09-12T16:19:14.021193+0000","last_undegraded":"2024-09-12T16:19:14.021193+0000","last_fullsized":"2024-09-12T16:19:14.021193+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:29.591812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065522900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"161'847","reported_seq":22320,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136695+0000","last_change":"2024-09-12T16:19:12.827179+0000","last_active":"2024-09-12T16:19:14.136695+0000","last_peered":"2024-09-12T16:19:14.136695+0000","last_clean":"2024-09-12T16:19:14.136695+0000","last_became_active":"2024-09-12T16:19:12.821483+0000","last_became_peered":"2024-09-12T16:19:12.821483+0000","last_unstale":"2024-09-12T16:19:14.136695+0000","last_undegraded":"2024-09-12T16:19:14.136695+0000","last_fullsized":"2024-09-12T16:19:14.136695+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:42.532127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001861333,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":25876,"num_read_kb":48987,"num_write":739,"num_write_kb":4795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":335,"num_bytes_recovered":4005968,"num_keys_recovered":105,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"162'843","reported_seq":6625,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020628+0000","last_change":"2024-09-12T16:19:03.811936+0000","last_active":"2024-09-12T16:19:14.020628+0000","last_peered":"2024-09-12T16:19:14.020628+0000","last_clean":"2024-09-12T16:19:14.020628+0000","last_became_active":"2024-09-12T16:19:03.778155+0000","last_became_peered":"2024-09-12T16:19:03.778155+0000","last_unstale":"2024-09-12T16:19:14.020628+0000","last_undegraded":"2024-09-12T16:19:14.020628+0000","last_fullsized":"2024-09-12T16:19:14.020628+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:50.828354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028595159999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":5,"num_read":6564,"num_read_kb":41539,"num_write":1022,"num_write_kb":9272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":275,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136387+0000","last_change":"2024-09-12T16:19:12.821506+0000","last_active":"2024-09-12T16:19:14.136387+0000","last_peered":"2024-09-12T16:19:14.136387+0000","last_clean":"2024-09-12T16:19:14.136387+0000","last_became_active":"2024-09-12T16:19:12.820814+0000","last_became_peered":"2024-09-12T16:19:12.820814+0000","last_unstale":"2024-09-12T16:19:14.136387+0000","last_undegraded":"2024-09-12T16:19:14.136387+0000","last_fullsized":"2024-09-12T16:19:14.136387+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:38.164468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"162'797","reported_seq":18921,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020586+0000","last_change":"2024-09-12T16:18:50.023044+0000","last_active":"2024-09-12T16:19:14.020586+0000","last_peered":"2024-09-12T16:19:14.020586+0000","last_clean":"2024-09-12T16:19:14.020586+0000","last_became_active":"2024-09-12T16:15:57.014294+0000","last_became_peered":"2024-09-12T16:15:57.014294+0000","last_unstale":"2024-09-12T16:19:14.020586+0000","last_undegraded":"2024-09-12T16:19:14.020586+0000","last_fullsized":"2024-09-12T16:19:14.020586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:27.209021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023814270000000002,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":20280,"num_read_kb":53258,"num_write":686,"num_write_kb":17135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":322,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020909+0000","last_change":"2024-09-12T16:18:29.019699+0000","last_active":"2024-09-12T16:19:14.020909+0000","last_peered":"2024-09-12T16:19:14.020909+0000","last_clean":"2024-09-12T16:19:14.020909+0000","last_became_active":"2024-09-12T16:18:29.019339+0000","last_became_peered":"2024-09-12T16:18:29.019339+0000","last_unstale":"2024-09-12T16:19:14.020909+0000","last_undegraded":"2024-09-12T16:19:14.020909+0000","last_fullsized":"2024-09-12T16:19:14.020909+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:51:54.701552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'509","reported_seq":5927,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020778+0000","last_change":"2024-09-12T16:19:03.807136+0000","last_active":"2024-09-12T16:19:14.020778+0000","last_peered":"2024-09-12T16:19:14.020778+0000","last_clean":"2024-09-12T16:19:14.020778+0000","last_became_active":"2024-09-12T16:19:03.775131+0000","last_became_peered":"2024-09-12T16:19:03.775131+0000","last_unstale":"2024-09-12T16:19:14.020778+0000","last_undegraded":"2024-09-12T16:19:14.020778+0000","last_fullsized":"2024-09-12T16:19:14.020778+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:06.175739+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0072137039999999996,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":5469,"num_read_kb":44149,"num_write":663,"num_write_kb":24803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":144,"num_bytes_recovered":10774621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":244,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.135988+0000","last_change":"2024-09-12T16:16:52.184861+0000","last_active":"2024-09-12T16:19:14.135988+0000","last_peered":"2024-09-12T16:19:14.135988+0000","last_clean":"2024-09-12T16:19:14.135988+0000","last_became_active":"2024-09-12T16:16:52.184555+0000","last_became_peered":"2024-09-12T16:16:52.184555+0000","last_unstale":"2024-09-12T16:19:14.135988+0000","last_undegraded":"2024-09-12T16:19:14.135988+0000","last_fullsized":"2024-09-12T16:19:14.135988+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:32.617153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"161'585","reported_seq":10230,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020916+0000","last_change":"2024-09-12T16:18:50.022910+0000","last_active":"2024-09-12T16:19:14.020916+0000","last_peered":"2024-09-12T16:19:14.020916+0000","last_clean":"2024-09-12T16:19:14.020916+0000","last_became_active":"2024-09-12T16:18:25.146756+0000","last_became_peered":"2024-09-12T16:18:25.146756+0000","last_unstale":"2024-09-12T16:19:14.020916+0000","last_undegraded":"2024-09-12T16:19:14.020916+0000","last_fullsized":"2024-09-12T16:19:14.020916+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:36.568042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014402110000000001,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":9889,"num_read_kb":36104,"num_write":494,"num_write_kb":7468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":315,"num_bytes_recovered":8454224,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":254,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136585+0000","last_change":"2024-09-12T16:19:12.821797+0000","last_active":"2024-09-12T16:19:14.136585+0000","last_peered":"2024-09-12T16:19:14.136585+0000","last_clean":"2024-09-12T16:19:14.136585+0000","last_became_active":"2024-09-12T16:19:12.821406+0000","last_became_peered":"2024-09-12T16:19:12.821406+0000","last_unstale":"2024-09-12T16:19:14.136585+0000","last_undegraded":"2024-09-12T16:19:14.136585+0000","last_fullsized":"2024-09-12T16:19:14.136585+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:52.917717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":259,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136033+0000","last_change":"2024-09-12T16:19:03.772630+0000","last_active":"2024-09-12T16:19:14.136033+0000","last_peered":"2024-09-12T16:19:14.136033+0000","last_clean":"2024-09-12T16:19:14.136033+0000","last_became_active":"2024-09-12T16:19:03.772266+0000","last_became_peered":"2024-09-12T16:19:03.772266+0000","last_unstale":"2024-09-12T16:19:14.136033+0000","last_undegraded":"2024-09-12T16:19:14.136033+0000","last_fullsized":"2024-09-12T16:19:14.136033+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:40.751677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:40.751677+0000","last_clean_scrub_stamp":"2024-09-12T16:15:40.751677+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:10.211741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"162'587","reported_seq":13674,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020587+0000","last_change":"2024-09-12T16:18:50.020057+0000","last_active":"2024-09-12T16:19:14.020587+0000","last_peered":"2024-09-12T16:19:14.020587+0000","last_clean":"2024-09-12T16:19:14.020587+0000","last_became_active":"2024-09-12T16:16:34.108998+0000","last_became_peered":"2024-09-12T16:16:34.108998+0000","last_unstale":"2024-09-12T16:19:14.020587+0000","last_undegraded":"2024-09-12T16:19:14.020587+0000","last_fullsized":"2024-09-12T16:19:14.020587+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:33.303142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010878509999999999,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":13209,"num_read_kb":49430,"num_write":675,"num_write_kb":7945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"161'484","reported_seq":31619,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020447+0000","last_change":"2024-09-12T16:18:50.033972+0000","last_active":"2024-09-12T16:19:14.020447+0000","last_peered":"2024-09-12T16:19:14.020447+0000","last_clean":"2024-09-12T16:19:14.020447+0000","last_became_active":"2024-09-12T16:15:57.013620+0000","last_became_peered":"2024-09-12T16:15:57.013620+0000","last_unstale":"2024-09-12T16:19:14.020447+0000","last_undegraded":"2024-09-12T16:19:14.020447+0000","last_fullsized":"2024-09-12T16:19:14.020447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:29.211114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014423319999999999,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":30743,"num_read_kb":77489,"num_write":563,"num_write_kb":11505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"161'892","reported_seq":20872,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136199+0000","last_change":"2024-09-12T16:18:50.021461+0000","last_active":"2024-09-12T16:19:14.136199+0000","last_peered":"2024-09-12T16:19:14.136199+0000","last_clean":"2024-09-12T16:19:14.136199+0000","last_became_active":"2024-09-12T16:16:55.202934+0000","last_became_peered":"2024-09-12T16:16:55.202934+0000","last_unstale":"2024-09-12T16:19:14.136199+0000","last_undegraded":"2024-09-12T16:19:14.136199+0000","last_fullsized":"2024-09-12T16:19:14.136199+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:45.656313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025551279999999998,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":11,"num_read":21936,"num_read_kb":59605,"num_write":943,"num_write_kb":8224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":4487368,"num_keys_recovered":26,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"162'524","reported_seq":15687,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.021028+0000","last_change":"2024-09-12T16:19:03.815628+0000","last_active":"2024-09-12T16:19:14.021028+0000","last_peered":"2024-09-12T16:19:14.021028+0000","last_clean":"2024-09-12T16:19:14.021028+0000","last_became_active":"2024-09-12T16:19:03.777557+0000","last_became_peered":"2024-09-12T16:19:03.777557+0000","last_unstale":"2024-09-12T16:19:14.021028+0000","last_undegraded":"2024-09-12T16:19:14.021028+0000","last_fullsized":"2024-09-12T16:19:14.021028+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:18.398871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040340999999999997,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":15308,"num_read_kb":48885,"num_write":585,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"167'450","reported_seq":11537,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136636+0000","last_change":"2024-09-12T16:19:12.827508+0000","last_active":"2024-09-12T16:19:14.136636+0000","last_peered":"2024-09-12T16:19:14.136636+0000","last_clean":"2024-09-12T16:19:14.136636+0000","last_became_active":"2024-09-12T16:19:12.822409+0000","last_became_peered":"2024-09-12T16:19:12.822409+0000","last_unstale":"2024-09-12T16:19:14.136636+0000","last_undegraded":"2024-09-12T16:19:14.136636+0000","last_fullsized":"2024-09-12T16:19:14.136636+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:38.886837+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00419339,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":9857,"num_read_kb":46208,"num_write":421,"num_write_kb":17232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":322,"num_bytes_recovered":11704832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"161'693","reported_seq":17473,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136383+0000","last_change":"2024-09-12T16:18:50.021962+0000","last_active":"2024-09-12T16:19:14.136383+0000","last_peered":"2024-09-12T16:19:14.136383+0000","last_clean":"2024-09-12T16:19:14.136383+0000","last_became_active":"2024-09-12T16:16:55.202102+0000","last_became_peered":"2024-09-12T16:16:55.202102+0000","last_unstale":"2024-09-12T16:19:14.136383+0000","last_undegraded":"2024-09-12T16:19:14.136383+0000","last_fullsized":"2024-09-12T16:19:14.136383+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:56.617525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026029579999999998,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":18807,"num_read_kb":58739,"num_write":641,"num_write_kb":13631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":126,"num_bytes_recovered":6078562,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"161'589","reported_seq":7753,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136721+0000","last_change":"2024-09-12T16:19:12.829072+0000","last_active":"2024-09-12T16:19:14.136721+0000","last_peered":"2024-09-12T16:19:14.136721+0000","last_clean":"2024-09-12T16:19:14.136721+0000","last_became_active":"2024-09-12T16:19:12.823347+0000","last_became_peered":"2024-09-12T16:19:12.823347+0000","last_unstale":"2024-09-12T16:19:14.136721+0000","last_undegraded":"2024-09-12T16:19:14.136721+0000","last_fullsized":"2024-09-12T16:19:14.136721+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:07.925513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013497229999999999,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":7931,"num_read_kb":30144,"num_write":561,"num_write_kb":13262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":319,"num_bytes_recovered":6744127,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"156'640","reported_seq":12181,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136735+0000","last_change":"2024-09-12T16:19:12.825115+0000","last_active":"2024-09-12T16:19:14.136735+0000","last_peered":"2024-09-12T16:19:14.136735+0000","last_clean":"2024-09-12T16:19:14.136735+0000","last_became_active":"2024-09-12T16:19:12.821943+0000","last_became_peered":"2024-09-12T16:19:12.821943+0000","last_unstale":"2024-09-12T16:19:14.136735+0000","last_undegraded":"2024-09-12T16:19:14.136735+0000","last_fullsized":"2024-09-12T16:19:14.136735+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:09.892807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00220666,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":10861,"num_read_kb":49111,"num_write":815,"num_write_kb":21657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":304,"num_bytes_recovered":6361542,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"167'630","reported_seq":15237,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136345+0000","last_change":"2024-09-12T16:19:12.823613+0000","last_active":"2024-09-12T16:19:14.136345+0000","last_peered":"2024-09-12T16:19:14.136345+0000","last_clean":"2024-09-12T16:19:14.136345+0000","last_became_active":"2024-09-12T16:19:12.819772+0000","last_became_peered":"2024-09-12T16:19:12.819772+0000","last_unstale":"2024-09-12T16:19:14.136345+0000","last_undegraded":"2024-09-12T16:19:14.136345+0000","last_fullsized":"2024-09-12T16:19:14.136345+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:48.846755+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0022010100000000002,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":12815,"num_read_kb":73185,"num_write":784,"num_write_kb":17171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":416,"num_bytes_recovered":13039478,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"161'644","reported_seq":17038,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136155+0000","last_change":"2024-09-12T16:18:50.019987+0000","last_active":"2024-09-12T16:19:14.136155+0000","last_peered":"2024-09-12T16:19:14.136155+0000","last_clean":"2024-09-12T16:19:14.136155+0000","last_became_active":"2024-09-12T16:16:55.202493+0000","last_became_peered":"2024-09-12T16:16:55.202493+0000","last_unstale":"2024-09-12T16:19:14.136155+0000","last_undegraded":"2024-09-12T16:19:14.136155+0000","last_fullsized":"2024-09-12T16:19:14.136155+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:04.668586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013216020000000001,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":16727,"num_read_kb":61490,"num_write":798,"num_write_kb":15885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":1725440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"161'653","reported_seq":15112,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.135985+0000","last_change":"2024-09-12T16:19:03.792167+0000","last_active":"2024-09-12T16:19:14.135985+0000","last_peered":"2024-09-12T16:19:14.135985+0000","last_clean":"2024-09-12T16:19:14.135985+0000","last_became_active":"2024-09-12T16:19:03.770819+0000","last_became_peered":"2024-09-12T16:19:03.770819+0000","last_unstale":"2024-09-12T16:19:14.135985+0000","last_undegraded":"2024-09-12T16:19:14.135985+0000","last_fullsized":"2024-09-12T16:19:14.135985+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":653,"log_dups_size":0,"ondisk_log_size":653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:29:19.655991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055961810000000004,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":16405,"num_read_kb":60197,"num_write":671,"num_write_kb":14674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":3518540,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"162'991","reported_seq":11455,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136175+0000","last_change":"2024-09-12T16:18:50.020480+0000","last_active":"2024-09-12T16:19:14.136175+0000","last_peered":"2024-09-12T16:19:14.136175+0000","last_clean":"2024-09-12T16:19:14.136175+0000","last_became_active":"2024-09-12T16:18:25.147080+0000","last_became_peered":"2024-09-12T16:18:25.147080+0000","last_unstale":"2024-09-12T16:19:14.136175+0000","last_undegraded":"2024-09-12T16:19:14.136175+0000","last_fullsized":"2024-09-12T16:19:14.136175+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":991,"log_dups_size":0,"ondisk_log_size":991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:11.134793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017970779999999999,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":11897,"num_read_kb":44792,"num_write":1435,"num_write_kb":19195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":434,"num_bytes_recovered":17467099,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":418,"num_object_clones":0,"num_object_copies":836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":418,"num_whiteouts":414,"num_read":453939,"num_read_kb":1624894,"num_write":29409,"num_write_kb":478980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5132,"num_bytes_recovered":202080646,"num_keys_recovered":679,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16597,"internal_metadata":0},"log_size":24538,"ondisk_log_size":24538,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":5,"up_from":71,"seq":304942678045,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43140,"kb_used_data":2088,"kb_used_omap":11,"kb_used_meta":41012,"kb_avail":94328700,"statfs":{"total":96636764160,"available":96592588800,"internally_reserved":0,"allocated":2138112,"data_stored":894816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11593,"internal_metadata":41996983},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640303,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77696,"kb_used_data":2088,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94294144,"statfs":{"total":96636764160,"available":96557203456,"internally_reserved":0,"allocated":2138112,"data_stored":894816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640304,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78276,"kb_used_data":2664,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293564,"statfs":{"total":96636764160,"available":96556609536,"internally_reserved":0,"allocated":2727936,"data_stored":1485165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640305,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51332,"kb_used_data":2084,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320508,"statfs":{"total":96636764160,"available":96584200192,"internally_reserved":0,"allocated":2134016,"data_stored":894797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640303,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59652,"kb_used_data":2092,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312188,"statfs":{"total":96636764160,"available":96575680512,"internally_reserved":0,"allocated":2142208,"data_stored":894835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":166,"seq":712964571141,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31808,"kb_used_data":2664,"kb_used_omap":25,"kb_used_meta":29094,"kb_avail":94340032,"statfs":{"total":96636764160,"available":96604192768,"internally_reserved":0,"allocated":2727936,"data_stored":1485165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25827,"internal_metadata":29793053},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9648,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6949,"internal_metadata":0}]}} 2024-09-12T16:19:20.257 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T16:19:20.555 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:19:20.555 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":178,"fsid":"66dcb8ed-8de5-4784-8071-fd6b3bf3b78f","created":"2024-09-12T16:15:28.208893+0000","modified":"2024-09-12T16:19:14.017315+0000","last_up_change":"2024-09-12T16:19:02.757214+0000","last_in_change":"2024-09-12T16:18:21.117144+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T16:15:40.677216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T16:15:45.306180+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-12T16:15:55.082975+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":43,"snap_epoch":162,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aabea24b-3f1f-4555-80c3-5caecf2e2001","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":11,"last_clean_end":156,"up_from":166,"up_thru":166,"down_at":157,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":2288624473},{"type":"v1","addr":"172.21.15.17:6801","nonce":2288624473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":2288624473},{"type":"v1","addr":"172.21.15.17:6803","nonce":2288624473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":2288624473},{"type":"v1","addr":"172.21.15.17:6807","nonce":2288624473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":2288624473},{"type":"v1","addr":"172.21.15.17:6805","nonce":2288624473}]},"public_addr":"172.21.15.17:6801/2288624473","cluster_addr":"172.21.15.17:6803/2288624473","heartbeat_back_addr":"172.21.15.17:6807/2288624473","heartbeat_front_addr":"172.21.15.17:6805/2288624473","state":["exists","up"]},{"osd":1,"uuid":"7a17ca3b-8e49-4d92-a633-45d3e4a45b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":3906173234},{"type":"v1","addr":"172.21.15.17:6809","nonce":3906173234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3906173234},{"type":"v1","addr":"172.21.15.17:6811","nonce":3906173234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3906173234},{"type":"v1","addr":"172.21.15.17:6815","nonce":3906173234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3906173234},{"type":"v1","addr":"172.21.15.17:6813","nonce":3906173234}]},"public_addr":"172.21.15.17:6809/3906173234","cluster_addr":"172.21.15.17:6811/3906173234","heartbeat_back_addr":"172.21.15.17:6815/3906173234","heartbeat_front_addr":"172.21.15.17:6813/3906173234","state":["exists","up"]},{"osd":2,"uuid":"dae09a32-24c6-464c-bee8-04ef2c42f7e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1974346628},{"type":"v1","addr":"172.21.15.17:6817","nonce":1974346628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":1974346628},{"type":"v1","addr":"172.21.15.17:6819","nonce":1974346628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":1974346628},{"type":"v1","addr":"172.21.15.17:6823","nonce":1974346628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":1974346628},{"type":"v1","addr":"172.21.15.17:6821","nonce":1974346628}]},"public_addr":"172.21.15.17:6817/1974346628","cluster_addr":"172.21.15.17:6819/1974346628","heartbeat_back_addr":"172.21.15.17:6823/1974346628","heartbeat_front_addr":"172.21.15.17:6821/1974346628","state":["exists","up"]},{"osd":3,"uuid":"9cc5463c-cdb4-4a6a-b526-39a60de417f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3370202675},{"type":"v1","addr":"172.21.15.47:6809","nonce":3370202675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3370202675},{"type":"v1","addr":"172.21.15.47:6811","nonce":3370202675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3370202675},{"type":"v1","addr":"172.21.15.47:6815","nonce":3370202675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3370202675},{"type":"v1","addr":"172.21.15.47:6813","nonce":3370202675}]},"public_addr":"172.21.15.47:6809/3370202675","cluster_addr":"172.21.15.47:6811/3370202675","heartbeat_back_addr":"172.21.15.47:6815/3370202675","heartbeat_front_addr":"172.21.15.47:6813/3370202675","state":["exists","up"]},{"osd":4,"uuid":"1e329af3-a88a-4a95-b822-01519079084b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":1823488259},{"type":"v1","addr":"172.21.15.47:6817","nonce":1823488259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1823488259},{"type":"v1","addr":"172.21.15.47:6819","nonce":1823488259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1823488259},{"type":"v1","addr":"172.21.15.47:6823","nonce":1823488259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1823488259},{"type":"v1","addr":"172.21.15.47:6821","nonce":1823488259}]},"public_addr":"172.21.15.47:6817/1823488259","cluster_addr":"172.21.15.47:6819/1823488259","heartbeat_back_addr":"172.21.15.47:6823/1823488259","heartbeat_front_addr":"172.21.15.47:6821/1823488259","state":["exists","up"]},{"osd":5,"uuid":"c255a252-3afe-4aad-b44c-85820867c960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":11,"last_clean_end":35,"up_from":71,"up_thru":175,"down_at":37,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":2087971028},{"type":"v1","addr":"172.21.15.47:6801","nonce":2087971028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2087971028},{"type":"v1","addr":"172.21.15.47:6803","nonce":2087971028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2087971028},{"type":"v1","addr":"172.21.15.47:6807","nonce":2087971028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2087971028},{"type":"v1","addr":"172.21.15.47:6805","nonce":2087971028}]},"public_addr":"172.21.15.47:6801/2087971028","cluster_addr":"172.21.15.47:6803/2087971028","heartbeat_back_addr":"172.21.15.47:6807/2087971028","heartbeat_front_addr":"172.21.15.47:6805/2087971028","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:15:35.752566+0000","dead_epoch":157},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:15:36.269665+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:15:36.524745+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:15:36.095607+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:15:36.294055+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:15:36.092708+0000","dead_epoch":37}],"pg_upmap":[{"pgid":"2.1","osds":[2,3]},{"pgid":"3.1","osds":[1,0]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T16:19:21.569 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T16:19:21.569 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T16:19:21.709 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:19:21.709 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-12T16:19:21.709 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:19:21.719 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T16:19:22.017 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T16:19:22.030 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T16:19:22.030 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T16:19:22.156 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:19:22.156 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T16:19:22.156 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:19:22.167 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T16:19:22.465 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T16:19:22.478 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T16:19:22.479 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T16:19:22.604 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:19:22.604 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T16:19:22.605 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:19:22.615 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T16:19:22.912 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T16:19:22.926 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T16:19:22.926 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T16:19:23.052 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:19:23.052 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T16:19:23.052 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:19:23.063 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T16:19:23.364 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T16:19:23.377 INFO:tasks.ceph:Scrubbing osd.4 2024-09-12T16:19:23.377 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-12T16:19:23.504 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:19:23.504 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T16:19:23.504 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:19:23.514 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-12T16:19:23.814 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 4 to deep-scrub 2024-09-12T16:19:23.828 INFO:tasks.ceph:Scrubbing osd.5 2024-09-12T16:19:23.828 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-12T16:19:23.954 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T16:19:23.954 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T16:19:23.954 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T16:19:23.964 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-12T16:19:24.271 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 5 to deep-scrub 2024-09-12T16:19:24.284 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T16:19:24.582 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:19:24.582 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-12T16:19:24.594 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":285,"stamp":"2024-09-12T16:19:22.701375+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":422,"num_object_clones":0,"num_object_copies":844,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":422,"num_whiteouts":414,"num_read":454005,"num_read_kb":1624949,"num_write":29512,"num_write_kb":480610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5138,"num_bytes_recovered":203261401,"num_keys_recovered":679,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24613,"ondisk_log_size":24613,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":341904,"kb_used_data":13680,"kb_used_omap":42,"kb_used_meta":328021,"kb_avail":565889136,"statfs":{"total":579820584960,"available":579470475264,"internally_reserved":0,"allocated":14008320,"data_stored":6549594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43798,"internal_metadata":335893738},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.683407"},"pg_stats":[{"pgid":"3.1f","version":"167'657","reported_seq":18912,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136260+0000","last_change":"2024-09-12T16:19:03.804780+0000","last_active":"2024-09-12T16:19:14.136260+0000","last_peered":"2024-09-12T16:19:14.136260+0000","last_clean":"2024-09-12T16:19:14.136260+0000","last_became_active":"2024-09-12T16:19:03.771427+0000","last_became_peered":"2024-09-12T16:19:03.771427+0000","last_unstale":"2024-09-12T16:19:14.136260+0000","last_undegraded":"2024-09-12T16:19:14.136260+0000","last_fullsized":"2024-09-12T16:19:14.136260+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:08.465348+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0071910430000000003,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":18834,"num_read_kb":74247,"num_write":859,"num_write_kb":11027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":2818651,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"161'608","reported_seq":14063,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020631+0000","last_change":"2024-09-12T16:18:50.020927+0000","last_active":"2024-09-12T16:19:14.020631+0000","last_peered":"2024-09-12T16:19:14.020631+0000","last_clean":"2024-09-12T16:19:14.020631+0000","last_became_active":"2024-09-12T16:16:55.202876+0000","last_became_peered":"2024-09-12T16:16:55.202876+0000","last_unstale":"2024-09-12T16:19:14.020631+0000","last_undegraded":"2024-09-12T16:19:14.020631+0000","last_fullsized":"2024-09-12T16:19:14.020631+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:07.278294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076921300000000004,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":13702,"num_read_kb":46928,"num_write":627,"num_write_kb":8472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":3145760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"162'1521","reported_seq":20341,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136679+0000","last_change":"2024-09-12T16:19:12.827121+0000","last_active":"2024-09-12T16:19:14.136679+0000","last_peered":"2024-09-12T16:19:14.136679+0000","last_clean":"2024-09-12T16:19:14.136679+0000","last_became_active":"2024-09-12T16:19:12.822483+0000","last_became_peered":"2024-09-12T16:19:12.822483+0000","last_unstale":"2024-09-12T16:19:14.136679+0000","last_undegraded":"2024-09-12T16:19:14.136679+0000","last_fullsized":"2024-09-12T16:19:14.136679+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1521,"log_dups_size":0,"ondisk_log_size":1521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:33.105008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074565700000000005,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":22738,"num_read_kb":67081,"num_write":2129,"num_write_kb":16176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":374,"num_bytes_recovered":30814554,"num_keys_recovered":34,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"162'853","reported_seq":9191,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136304+0000","last_change":"2024-09-12T16:19:12.827513+0000","last_active":"2024-09-12T16:19:14.136304+0000","last_peered":"2024-09-12T16:19:14.136304+0000","last_clean":"2024-09-12T16:19:14.136304+0000","last_became_active":"2024-09-12T16:19:12.823034+0000","last_became_peered":"2024-09-12T16:19:12.823034+0000","last_unstale":"2024-09-12T16:19:14.136304+0000","last_undegraded":"2024-09-12T16:19:14.136304+0000","last_fullsized":"2024-09-12T16:19:14.136304+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":853,"log_dups_size":0,"ondisk_log_size":853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:31.584973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001077195,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":12,"num_read":9731,"num_read_kb":27914,"num_write":1117,"num_write_kb":6805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":3550768,"num_keys_recovered":168,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"161'1254","reported_seq":8898,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136048+0000","last_change":"2024-09-12T16:19:03.795634+0000","last_active":"2024-09-12T16:19:14.136048+0000","last_peered":"2024-09-12T16:19:14.136048+0000","last_clean":"2024-09-12T16:19:14.136048+0000","last_became_active":"2024-09-12T16:19:03.770673+0000","last_became_peered":"2024-09-12T16:19:03.770673+0000","last_unstale":"2024-09-12T16:19:14.136048+0000","last_undegraded":"2024-09-12T16:19:14.136048+0000","last_fullsized":"2024-09-12T16:19:14.136048+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1254,"log_dups_size":0,"ondisk_log_size":1254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:59.427193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0046887659999999996,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":12367,"num_read_kb":38179,"num_write":1729,"num_write_kb":15361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":14697984,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"162'1312","reported_seq":12069,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020481+0000","last_change":"2024-09-12T16:18:50.033545+0000","last_active":"2024-09-12T16:19:14.020481+0000","last_peered":"2024-09-12T16:19:14.020481+0000","last_clean":"2024-09-12T16:19:14.020481+0000","last_became_active":"2024-09-12T16:15:57.014803+0000","last_became_peered":"2024-09-12T16:15:57.014803+0000","last_unstale":"2024-09-12T16:19:14.020481+0000","last_undegraded":"2024-09-12T16:19:14.020481+0000","last_fullsized":"2024-09-12T16:19:14.020481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1312,"log_dups_size":0,"ondisk_log_size":1312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:39.318465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011248300000000001,"stat_sum":{"num_bytes":19,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":19,"num_read":15353,"num_read_kb":54373,"num_write":2009,"num_write_kb":21868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"161'543","reported_seq":14978,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020840+0000","last_change":"2024-09-12T16:18:50.021500+0000","last_active":"2024-09-12T16:19:14.020840+0000","last_peered":"2024-09-12T16:19:14.020840+0000","last_clean":"2024-09-12T16:19:14.020840+0000","last_became_active":"2024-09-12T16:15:57.016110+0000","last_became_peered":"2024-09-12T16:15:57.016110+0000","last_unstale":"2024-09-12T16:19:14.020840+0000","last_undegraded":"2024-09-12T16:19:14.020840+0000","last_fullsized":"2024-09-12T16:19:14.020840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:26.468226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010965269999999999,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":14633,"num_read_kb":54220,"num_write":566,"num_write_kb":10346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"162'783","reported_seq":6457,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020536+0000","last_change":"2024-09-12T16:19:03.797973+0000","last_active":"2024-09-12T16:19:14.020536+0000","last_peered":"2024-09-12T16:19:14.020536+0000","last_clean":"2024-09-12T16:19:14.020536+0000","last_became_active":"2024-09-12T16:19:03.772548+0000","last_became_peered":"2024-09-12T16:19:03.772548+0000","last_unstale":"2024-09-12T16:19:14.020536+0000","last_undegraded":"2024-09-12T16:19:14.020536+0000","last_fullsized":"2024-09-12T16:19:14.020536+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:17.356209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038788759999999999,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":7154,"num_read_kb":45511,"num_write":918,"num_write_kb":34065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":17173091,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"161'688","reported_seq":8348,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136200+0000","last_change":"2024-09-12T16:19:03.820286+0000","last_active":"2024-09-12T16:19:14.136200+0000","last_peered":"2024-09-12T16:19:14.136200+0000","last_clean":"2024-09-12T16:19:14.136200+0000","last_became_active":"2024-09-12T16:19:03.780157+0000","last_became_peered":"2024-09-12T16:19:03.780157+0000","last_unstale":"2024-09-12T16:19:14.136200+0000","last_undegraded":"2024-09-12T16:19:14.136200+0000","last_fullsized":"2024-09-12T16:19:14.136200+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:26.752604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0043783590000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":7873,"num_read_kb":33843,"num_write":918,"num_write_kb":21944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":337,"num_bytes_recovered":20360415,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"161'1601","reported_seq":15889,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136738+0000","last_change":"2024-09-12T16:19:12.829030+0000","last_active":"2024-09-12T16:19:14.136738+0000","last_peered":"2024-09-12T16:19:14.136738+0000","last_clean":"2024-09-12T16:19:14.136738+0000","last_became_active":"2024-09-12T16:19:12.824566+0000","last_became_peered":"2024-09-12T16:19:12.824566+0000","last_unstale":"2024-09-12T16:19:14.136738+0000","last_undegraded":"2024-09-12T16:19:14.136738+0000","last_fullsized":"2024-09-12T16:19:14.136738+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":1601,"log_dups_size":0,"ondisk_log_size":1601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:45.672159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036743769999999999,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":19171,"num_read_kb":50037,"num_write":2353,"num_write_kb":15650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":483,"num_bytes_recovered":14102804,"num_keys_recovered":132,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"167'387","reported_seq":7896,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136429+0000","last_change":"2024-09-12T16:19:03.792024+0000","last_active":"2024-09-12T16:19:14.136429+0000","last_peered":"2024-09-12T16:19:14.136429+0000","last_clean":"2024-09-12T16:19:14.136429+0000","last_became_active":"2024-09-12T16:19:03.771611+0000","last_became_peered":"2024-09-12T16:19:03.771611+0000","last_unstale":"2024-09-12T16:19:14.136429+0000","last_undegraded":"2024-09-12T16:19:14.136429+0000","last_fullsized":"2024-09-12T16:19:14.136429+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:39.727256+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0056373990000000004,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":6922,"num_read_kb":49310,"num_write":420,"num_write_kb":20795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":1054818,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"161'889","reported_seq":9435,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136206+0000","last_change":"2024-09-12T16:18:50.019678+0000","last_active":"2024-09-12T16:19:14.136206+0000","last_peered":"2024-09-12T16:19:14.136206+0000","last_clean":"2024-09-12T16:19:14.136206+0000","last_became_active":"2024-09-12T16:16:53.185698+0000","last_became_peered":"2024-09-12T16:16:53.185698+0000","last_unstale":"2024-09-12T16:19:14.136206+0000","last_undegraded":"2024-09-12T16:19:14.136206+0000","last_fullsized":"2024-09-12T16:19:14.136206+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":889,"log_dups_size":0,"ondisk_log_size":889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:26.722024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001055348,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":12029,"num_read_kb":50248,"num_write":1156,"num_write_kb":23396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":244,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136406+0000","last_change":"2024-09-12T16:16:52.184699+0000","last_active":"2024-09-12T16:19:14.136406+0000","last_peered":"2024-09-12T16:19:14.136406+0000","last_clean":"2024-09-12T16:19:14.136406+0000","last_became_active":"2024-09-12T16:16:52.184420+0000","last_became_peered":"2024-09-12T16:16:52.184420+0000","last_unstale":"2024-09-12T16:19:14.136406+0000","last_undegraded":"2024-09-12T16:19:14.136406+0000","last_fullsized":"2024-09-12T16:19:14.136406+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:50.051152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"167'553","reported_seq":9918,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136070+0000","last_change":"2024-09-12T16:19:03.788892+0000","last_active":"2024-09-12T16:19:14.136070+0000","last_peered":"2024-09-12T16:19:14.136070+0000","last_clean":"2024-09-12T16:19:14.136070+0000","last_became_active":"2024-09-12T16:19:03.770869+0000","last_became_peered":"2024-09-12T16:19:03.770869+0000","last_unstale":"2024-09-12T16:19:14.136070+0000","last_undegraded":"2024-09-12T16:19:14.136070+0000","last_fullsized":"2024-09-12T16:19:14.136070+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:38.037187+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0075018430000000002,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":10526,"num_read_kb":44243,"num_write":495,"num_write_kb":9200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":351,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.021261+0000","last_change":"2024-09-12T16:16:52.187010+0000","last_active":"2024-09-12T16:19:14.021261+0000","last_peered":"2024-09-12T16:19:14.021261+0000","last_clean":"2024-09-12T16:19:14.021261+0000","last_became_active":"2024-09-12T16:16:52.186638+0000","last_became_peered":"2024-09-12T16:16:52.186638+0000","last_unstale":"2024-09-12T16:19:14.021261+0000","last_undegraded":"2024-09-12T16:19:14.021261+0000","last_fullsized":"2024-09-12T16:19:14.021261+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:40.681796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066384400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"161'763","reported_seq":16796,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020763+0000","last_change":"2024-09-12T16:18:50.020013+0000","last_active":"2024-09-12T16:19:14.020763+0000","last_peered":"2024-09-12T16:19:14.020763+0000","last_clean":"2024-09-12T16:19:14.020763+0000","last_became_active":"2024-09-12T16:16:34.108850+0000","last_became_peered":"2024-09-12T16:16:34.108850+0000","last_unstale":"2024-09-12T16:19:14.020763+0000","last_undegraded":"2024-09-12T16:19:14.020763+0000","last_fullsized":"2024-09-12T16:19:14.020763+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":763,"log_dups_size":0,"ondisk_log_size":763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:03.909473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080883699999999997,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":17664,"num_read_kb":61096,"num_write":665,"num_write_kb":27115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":253,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136274+0000","last_change":"2024-09-12T16:19:03.772388+0000","last_active":"2024-09-12T16:19:14.136274+0000","last_peered":"2024-09-12T16:19:14.136274+0000","last_clean":"2024-09-12T16:19:14.136274+0000","last_became_active":"2024-09-12T16:19:03.772128+0000","last_became_peered":"2024-09-12T16:19:03.772128+0000","last_unstale":"2024-09-12T16:19:14.136274+0000","last_undegraded":"2024-09-12T16:19:14.136274+0000","last_fullsized":"2024-09-12T16:19:14.136274+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:57.248706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"161'768","reported_seq":8492,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.021187+0000","last_change":"2024-09-12T16:18:50.022176+0000","last_active":"2024-09-12T16:19:14.021187+0000","last_peered":"2024-09-12T16:19:14.021187+0000","last_clean":"2024-09-12T16:19:14.021187+0000","last_became_active":"2024-09-12T16:15:57.011381+0000","last_became_peered":"2024-09-12T16:15:57.011381+0000","last_unstale":"2024-09-12T16:19:14.021187+0000","last_undegraded":"2024-09-12T16:19:14.021187+0000","last_fullsized":"2024-09-12T16:19:14.021187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:56.655837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012620280000000001,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":10668,"num_read_kb":44352,"num_write":952,"num_write_kb":7790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":348,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.021193+0000","last_change":"2024-09-12T16:19:03.773076+0000","last_active":"2024-09-12T16:19:14.021193+0000","last_peered":"2024-09-12T16:19:14.021193+0000","last_clean":"2024-09-12T16:19:14.021193+0000","last_became_active":"2024-09-12T16:19:03.772694+0000","last_became_peered":"2024-09-12T16:19:03.772694+0000","last_unstale":"2024-09-12T16:19:14.021193+0000","last_undegraded":"2024-09-12T16:19:14.021193+0000","last_fullsized":"2024-09-12T16:19:14.021193+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:29.591812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065522900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"161'847","reported_seq":22320,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136695+0000","last_change":"2024-09-12T16:19:12.827179+0000","last_active":"2024-09-12T16:19:14.136695+0000","last_peered":"2024-09-12T16:19:14.136695+0000","last_clean":"2024-09-12T16:19:14.136695+0000","last_became_active":"2024-09-12T16:19:12.821483+0000","last_became_peered":"2024-09-12T16:19:12.821483+0000","last_unstale":"2024-09-12T16:19:14.136695+0000","last_undegraded":"2024-09-12T16:19:14.136695+0000","last_fullsized":"2024-09-12T16:19:14.136695+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:42.532127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001861333,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":25876,"num_read_kb":48987,"num_write":739,"num_write_kb":4795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":335,"num_bytes_recovered":4005968,"num_keys_recovered":105,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"162'843","reported_seq":6625,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020628+0000","last_change":"2024-09-12T16:19:03.811936+0000","last_active":"2024-09-12T16:19:14.020628+0000","last_peered":"2024-09-12T16:19:14.020628+0000","last_clean":"2024-09-12T16:19:14.020628+0000","last_became_active":"2024-09-12T16:19:03.778155+0000","last_became_peered":"2024-09-12T16:19:03.778155+0000","last_unstale":"2024-09-12T16:19:14.020628+0000","last_undegraded":"2024-09-12T16:19:14.020628+0000","last_fullsized":"2024-09-12T16:19:14.020628+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:50.828354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028595159999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":5,"num_read":6564,"num_read_kb":41539,"num_write":1022,"num_write_kb":9272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":275,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136387+0000","last_change":"2024-09-12T16:19:12.821506+0000","last_active":"2024-09-12T16:19:14.136387+0000","last_peered":"2024-09-12T16:19:14.136387+0000","last_clean":"2024-09-12T16:19:14.136387+0000","last_became_active":"2024-09-12T16:19:12.820814+0000","last_became_peered":"2024-09-12T16:19:12.820814+0000","last_unstale":"2024-09-12T16:19:14.136387+0000","last_undegraded":"2024-09-12T16:19:14.136387+0000","last_fullsized":"2024-09-12T16:19:14.136387+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:38.164468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"162'797","reported_seq":18921,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020586+0000","last_change":"2024-09-12T16:18:50.023044+0000","last_active":"2024-09-12T16:19:14.020586+0000","last_peered":"2024-09-12T16:19:14.020586+0000","last_clean":"2024-09-12T16:19:14.020586+0000","last_became_active":"2024-09-12T16:15:57.014294+0000","last_became_peered":"2024-09-12T16:15:57.014294+0000","last_unstale":"2024-09-12T16:19:14.020586+0000","last_undegraded":"2024-09-12T16:19:14.020586+0000","last_fullsized":"2024-09-12T16:19:14.020586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:27.209021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023814270000000002,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":20280,"num_read_kb":53258,"num_write":686,"num_write_kb":17135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":322,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020909+0000","last_change":"2024-09-12T16:18:29.019699+0000","last_active":"2024-09-12T16:19:14.020909+0000","last_peered":"2024-09-12T16:19:14.020909+0000","last_clean":"2024-09-12T16:19:14.020909+0000","last_became_active":"2024-09-12T16:18:29.019339+0000","last_became_peered":"2024-09-12T16:18:29.019339+0000","last_unstale":"2024-09-12T16:19:14.020909+0000","last_undegraded":"2024-09-12T16:19:14.020909+0000","last_fullsized":"2024-09-12T16:19:14.020909+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:51:54.701552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'509","reported_seq":5927,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020778+0000","last_change":"2024-09-12T16:19:03.807136+0000","last_active":"2024-09-12T16:19:14.020778+0000","last_peered":"2024-09-12T16:19:14.020778+0000","last_clean":"2024-09-12T16:19:14.020778+0000","last_became_active":"2024-09-12T16:19:03.775131+0000","last_became_peered":"2024-09-12T16:19:03.775131+0000","last_unstale":"2024-09-12T16:19:14.020778+0000","last_undegraded":"2024-09-12T16:19:14.020778+0000","last_fullsized":"2024-09-12T16:19:14.020778+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:06.175739+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0072137039999999996,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":5469,"num_read_kb":44149,"num_write":663,"num_write_kb":24803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":144,"num_bytes_recovered":10774621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":244,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.135988+0000","last_change":"2024-09-12T16:16:52.184861+0000","last_active":"2024-09-12T16:19:14.135988+0000","last_peered":"2024-09-12T16:19:14.135988+0000","last_clean":"2024-09-12T16:19:14.135988+0000","last_became_active":"2024-09-12T16:16:52.184555+0000","last_became_peered":"2024-09-12T16:16:52.184555+0000","last_unstale":"2024-09-12T16:19:14.135988+0000","last_undegraded":"2024-09-12T16:19:14.135988+0000","last_fullsized":"2024-09-12T16:19:14.135988+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:32.617153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"161'585","reported_seq":10230,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020916+0000","last_change":"2024-09-12T16:18:50.022910+0000","last_active":"2024-09-12T16:19:14.020916+0000","last_peered":"2024-09-12T16:19:14.020916+0000","last_clean":"2024-09-12T16:19:14.020916+0000","last_became_active":"2024-09-12T16:18:25.146756+0000","last_became_peered":"2024-09-12T16:18:25.146756+0000","last_unstale":"2024-09-12T16:19:14.020916+0000","last_undegraded":"2024-09-12T16:19:14.020916+0000","last_fullsized":"2024-09-12T16:19:14.020916+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:36.568042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014402110000000001,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":9889,"num_read_kb":36104,"num_write":494,"num_write_kb":7468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":315,"num_bytes_recovered":8454224,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":254,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136585+0000","last_change":"2024-09-12T16:19:12.821797+0000","last_active":"2024-09-12T16:19:14.136585+0000","last_peered":"2024-09-12T16:19:14.136585+0000","last_clean":"2024-09-12T16:19:14.136585+0000","last_became_active":"2024-09-12T16:19:12.821406+0000","last_became_peered":"2024-09-12T16:19:12.821406+0000","last_unstale":"2024-09-12T16:19:14.136585+0000","last_undegraded":"2024-09-12T16:19:14.136585+0000","last_fullsized":"2024-09-12T16:19:14.136585+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:45.803619+0000","last_clean_scrub_stamp":"2024-09-12T16:15:45.803619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:52.917717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":259,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136033+0000","last_change":"2024-09-12T16:19:03.772630+0000","last_active":"2024-09-12T16:19:14.136033+0000","last_peered":"2024-09-12T16:19:14.136033+0000","last_clean":"2024-09-12T16:19:14.136033+0000","last_became_active":"2024-09-12T16:19:03.772266+0000","last_became_peered":"2024-09-12T16:19:03.772266+0000","last_unstale":"2024-09-12T16:19:14.136033+0000","last_undegraded":"2024-09-12T16:19:14.136033+0000","last_fullsized":"2024-09-12T16:19:14.136033+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:40.751677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:40.751677+0000","last_clean_scrub_stamp":"2024-09-12T16:15:40.751677+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:10.211741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"162'587","reported_seq":13674,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020587+0000","last_change":"2024-09-12T16:18:50.020057+0000","last_active":"2024-09-12T16:19:14.020587+0000","last_peered":"2024-09-12T16:19:14.020587+0000","last_clean":"2024-09-12T16:19:14.020587+0000","last_became_active":"2024-09-12T16:16:34.108998+0000","last_became_peered":"2024-09-12T16:16:34.108998+0000","last_unstale":"2024-09-12T16:19:14.020587+0000","last_undegraded":"2024-09-12T16:19:14.020587+0000","last_fullsized":"2024-09-12T16:19:14.020587+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:33.303142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010878509999999999,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":13209,"num_read_kb":49430,"num_write":675,"num_write_kb":7945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"161'484","reported_seq":31619,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.020447+0000","last_change":"2024-09-12T16:18:50.033972+0000","last_active":"2024-09-12T16:19:14.020447+0000","last_peered":"2024-09-12T16:19:14.020447+0000","last_clean":"2024-09-12T16:19:14.020447+0000","last_became_active":"2024-09-12T16:15:57.013620+0000","last_became_peered":"2024-09-12T16:15:57.013620+0000","last_unstale":"2024-09-12T16:19:14.020447+0000","last_undegraded":"2024-09-12T16:19:14.020447+0000","last_fullsized":"2024-09-12T16:19:14.020447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:29.211114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014423319999999999,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":30743,"num_read_kb":77489,"num_write":563,"num_write_kb":11505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"161'892","reported_seq":20872,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136199+0000","last_change":"2024-09-12T16:18:50.021461+0000","last_active":"2024-09-12T16:19:14.136199+0000","last_peered":"2024-09-12T16:19:14.136199+0000","last_clean":"2024-09-12T16:19:14.136199+0000","last_became_active":"2024-09-12T16:16:55.202934+0000","last_became_peered":"2024-09-12T16:16:55.202934+0000","last_unstale":"2024-09-12T16:19:14.136199+0000","last_undegraded":"2024-09-12T16:19:14.136199+0000","last_fullsized":"2024-09-12T16:19:14.136199+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:45.656313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025551279999999998,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":11,"num_read":21936,"num_read_kb":59605,"num_write":943,"num_write_kb":8224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":4487368,"num_keys_recovered":26,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"162'524","reported_seq":15687,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.021028+0000","last_change":"2024-09-12T16:19:03.815628+0000","last_active":"2024-09-12T16:19:14.021028+0000","last_peered":"2024-09-12T16:19:14.021028+0000","last_clean":"2024-09-12T16:19:14.021028+0000","last_became_active":"2024-09-12T16:19:03.777557+0000","last_became_peered":"2024-09-12T16:19:03.777557+0000","last_unstale":"2024-09-12T16:19:14.021028+0000","last_undegraded":"2024-09-12T16:19:14.021028+0000","last_fullsized":"2024-09-12T16:19:14.021028+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:18.398871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040340999999999997,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":15308,"num_read_kb":48885,"num_write":585,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"167'450","reported_seq":11537,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136636+0000","last_change":"2024-09-12T16:19:12.827508+0000","last_active":"2024-09-12T16:19:14.136636+0000","last_peered":"2024-09-12T16:19:14.136636+0000","last_clean":"2024-09-12T16:19:14.136636+0000","last_became_active":"2024-09-12T16:19:12.822409+0000","last_became_peered":"2024-09-12T16:19:12.822409+0000","last_unstale":"2024-09-12T16:19:14.136636+0000","last_undegraded":"2024-09-12T16:19:14.136636+0000","last_fullsized":"2024-09-12T16:19:14.136636+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:38.886837+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00419339,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":9857,"num_read_kb":46208,"num_write":421,"num_write_kb":17232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":322,"num_bytes_recovered":11704832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"161'693","reported_seq":17473,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136383+0000","last_change":"2024-09-12T16:18:50.021962+0000","last_active":"2024-09-12T16:19:14.136383+0000","last_peered":"2024-09-12T16:19:14.136383+0000","last_clean":"2024-09-12T16:19:14.136383+0000","last_became_active":"2024-09-12T16:16:55.202102+0000","last_became_peered":"2024-09-12T16:16:55.202102+0000","last_unstale":"2024-09-12T16:19:14.136383+0000","last_undegraded":"2024-09-12T16:19:14.136383+0000","last_fullsized":"2024-09-12T16:19:14.136383+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:56.617525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026029579999999998,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":18807,"num_read_kb":58739,"num_write":641,"num_write_kb":13631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":126,"num_bytes_recovered":6078562,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"161'589","reported_seq":7753,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136721+0000","last_change":"2024-09-12T16:19:12.829072+0000","last_active":"2024-09-12T16:19:14.136721+0000","last_peered":"2024-09-12T16:19:14.136721+0000","last_clean":"2024-09-12T16:19:14.136721+0000","last_became_active":"2024-09-12T16:19:12.823347+0000","last_became_peered":"2024-09-12T16:19:12.823347+0000","last_unstale":"2024-09-12T16:19:14.136721+0000","last_undegraded":"2024-09-12T16:19:14.136721+0000","last_fullsized":"2024-09-12T16:19:14.136721+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:07.925513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013497229999999999,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":7931,"num_read_kb":30144,"num_write":561,"num_write_kb":13262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":319,"num_bytes_recovered":6744127,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"156'640","reported_seq":12181,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136735+0000","last_change":"2024-09-12T16:19:12.825115+0000","last_active":"2024-09-12T16:19:14.136735+0000","last_peered":"2024-09-12T16:19:14.136735+0000","last_clean":"2024-09-12T16:19:14.136735+0000","last_became_active":"2024-09-12T16:19:12.821943+0000","last_became_peered":"2024-09-12T16:19:12.821943+0000","last_unstale":"2024-09-12T16:19:14.136735+0000","last_undegraded":"2024-09-12T16:19:14.136735+0000","last_fullsized":"2024-09-12T16:19:14.136735+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:09.892807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00220666,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":10861,"num_read_kb":49111,"num_write":815,"num_write_kb":21657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":304,"num_bytes_recovered":6361542,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"167'630","reported_seq":15237,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136345+0000","last_change":"2024-09-12T16:19:12.823613+0000","last_active":"2024-09-12T16:19:14.136345+0000","last_peered":"2024-09-12T16:19:14.136345+0000","last_clean":"2024-09-12T16:19:14.136345+0000","last_became_active":"2024-09-12T16:19:12.819772+0000","last_became_peered":"2024-09-12T16:19:12.819772+0000","last_unstale":"2024-09-12T16:19:14.136345+0000","last_undegraded":"2024-09-12T16:19:14.136345+0000","last_fullsized":"2024-09-12T16:19:14.136345+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:48.846755+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0022010100000000002,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":12815,"num_read_kb":73185,"num_write":784,"num_write_kb":17171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":416,"num_bytes_recovered":13039478,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"161'644","reported_seq":17038,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136155+0000","last_change":"2024-09-12T16:18:50.019987+0000","last_active":"2024-09-12T16:19:14.136155+0000","last_peered":"2024-09-12T16:19:14.136155+0000","last_clean":"2024-09-12T16:19:14.136155+0000","last_became_active":"2024-09-12T16:16:55.202493+0000","last_became_peered":"2024-09-12T16:16:55.202493+0000","last_unstale":"2024-09-12T16:19:14.136155+0000","last_undegraded":"2024-09-12T16:19:14.136155+0000","last_fullsized":"2024-09-12T16:19:14.136155+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:04.668586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013216020000000001,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":16727,"num_read_kb":61490,"num_write":798,"num_write_kb":15885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":1725440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"161'653","reported_seq":15112,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.135985+0000","last_change":"2024-09-12T16:19:03.792167+0000","last_active":"2024-09-12T16:19:14.135985+0000","last_peered":"2024-09-12T16:19:14.135985+0000","last_clean":"2024-09-12T16:19:14.135985+0000","last_became_active":"2024-09-12T16:19:03.770819+0000","last_became_peered":"2024-09-12T16:19:03.770819+0000","last_unstale":"2024-09-12T16:19:14.135985+0000","last_undegraded":"2024-09-12T16:19:14.135985+0000","last_fullsized":"2024-09-12T16:19:14.135985+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":653,"log_dups_size":0,"ondisk_log_size":653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:29:19.655991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055961810000000004,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":16405,"num_read_kb":60197,"num_write":671,"num_write_kb":14674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":3518540,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"162'991","reported_seq":11455,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:14.136175+0000","last_change":"2024-09-12T16:18:50.020480+0000","last_active":"2024-09-12T16:19:14.136175+0000","last_peered":"2024-09-12T16:19:14.136175+0000","last_clean":"2024-09-12T16:19:14.136175+0000","last_became_active":"2024-09-12T16:18:25.147080+0000","last_became_peered":"2024-09-12T16:18:25.147080+0000","last_unstale":"2024-09-12T16:19:14.136175+0000","last_undegraded":"2024-09-12T16:19:14.136175+0000","last_fullsized":"2024-09-12T16:19:14.136175+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:15:55.997586+0000","last_clean_scrub_stamp":"2024-09-12T16:15:55.997586+0000","objects_scrubbed":0,"log_size":991,"log_dups_size":0,"ondisk_log_size":991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:11.134793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017970779999999999,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":11897,"num_read_kb":44792,"num_write":1435,"num_write_kb":19195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":434,"num_bytes_recovered":17467099,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":418,"num_object_clones":0,"num_object_copies":836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":418,"num_whiteouts":414,"num_read":453939,"num_read_kb":1624894,"num_write":29409,"num_write_kb":478980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5132,"num_bytes_recovered":202080646,"num_keys_recovered":679,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16597,"internal_metadata":0},"log_size":24538,"ondisk_log_size":24538,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":5,"up_from":71,"seq":304942678046,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43140,"kb_used_data":2088,"kb_used_omap":11,"kb_used_meta":41012,"kb_avail":94328700,"statfs":{"total":96636764160,"available":96592588800,"internally_reserved":0,"allocated":2138112,"data_stored":894816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11593,"internal_metadata":41996983},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640304,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77696,"kb_used_data":2088,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94294144,"statfs":{"total":96636764160,"available":96557203456,"internally_reserved":0,"allocated":2138112,"data_stored":894816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640305,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78276,"kb_used_data":2664,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293564,"statfs":{"total":96636764160,"available":96556609536,"internally_reserved":0,"allocated":2727936,"data_stored":1485165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640306,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51332,"kb_used_data":2084,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320508,"statfs":{"total":96636764160,"available":96584200192,"internally_reserved":0,"allocated":2134016,"data_stored":894797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640304,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59652,"kb_used_data":2092,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312188,"statfs":{"total":96636764160,"available":96575680512,"internally_reserved":0,"allocated":2142208,"data_stored":894835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":166,"seq":712964571142,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31808,"kb_used_data":2664,"kb_used_omap":25,"kb_used_meta":29094,"kb_avail":94340032,"statfs":{"total":96636764160,"available":96604192768,"internally_reserved":0,"allocated":2727936,"data_stored":1485165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25827,"internal_metadata":29793053},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9648,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6949,"internal_metadata":0}]}} 2024-09-12T16:19:24.600 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T16:15:55.997586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.600 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T16:15:55.997586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.600 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T16:15:55.997586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.600 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T16:15:55.997586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.600 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T16:15:55.997586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.600 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T16:15:55.997586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.601 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T16:15:55.997586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.601 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T16:15:55.997586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.601 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T16:15:55.997586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.601 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T16:15:55.997586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.601 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T16:15:55.997586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.601 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T16:15:55.997586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.601 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T16:15:45.803619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.601 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-12T16:15:55.997586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.602 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T16:15:45.803619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.602 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T16:15:55.997586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.602 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T16:15:45.803619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.602 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T16:15:55.997586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.602 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T16:15:45.803619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.602 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T16:15:55.997586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.602 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T16:15:55.997586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.602 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T16:15:45.803619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.602 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T16:15:55.997586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.603 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T16:15:45.803619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.603 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-12T16:15:55.997586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.603 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T16:15:45.803619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.603 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T16:15:55.997586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.603 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T16:15:45.803619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.603 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T16:15:40.751677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.603 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T16:15:55.997586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.603 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T16:15:55.997586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.603 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T16:15:55.997586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.604 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T16:15:55.997586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.604 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T16:15:55.997586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.604 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T16:15:55.997586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.604 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T16:15:55.997586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.604 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T16:15:55.997586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.604 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T16:15:55.997586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.604 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T16:15:55.997586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.604 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T16:15:55.997586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.604 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T16:15:55.997586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=19, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:19:24.605 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T16:19:44.606 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T16:19:44.918 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T16:19:44.919 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-12T16:19:44.930 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":296,"stamp":"2024-09-12T16:19:44.706367+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":422,"num_object_clones":0,"num_object_copies":844,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":422,"num_whiteouts":414,"num_read":454005,"num_read_kb":1624949,"num_write":29512,"num_write_kb":480610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5138,"num_bytes_recovered":203261401,"num_keys_recovered":679,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25035,"ondisk_log_size":25035,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":341840,"kb_used_data":13680,"kb_used_omap":42,"kb_used_meta":328021,"kb_avail":565889200,"statfs":{"total":579820584960,"available":579470540800,"internally_reserved":0,"allocated":14008320,"data_stored":6549594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43798,"internal_metadata":335893738},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002760"},"pg_stats":[{"pgid":"3.1f","version":"178'671","reported_seq":18934,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:26.469274+0000","last_change":"2024-09-12T16:19:26.469274+0000","last_active":"2024-09-12T16:19:26.469274+0000","last_peered":"2024-09-12T16:19:26.469274+0000","last_clean":"2024-09-12T16:19:26.469274+0000","last_became_active":"2024-09-12T16:19:03.771427+0000","last_became_peered":"2024-09-12T16:19:03.771427+0000","last_unstale":"2024-09-12T16:19:26.469274+0000","last_undegraded":"2024-09-12T16:19:26.469274+0000","last_fullsized":"2024-09-12T16:19:26.469274+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'671","last_scrub_stamp":"2024-09-12T16:19:26.469183+0000","last_deep_scrub":"178'671","last_deep_scrub_stamp":"2024-09-12T16:19:26.469183+0000","last_clean_scrub_stamp":"2024-09-12T16:19:26.469183+0000","objects_scrubbed":14,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:28.731820+0000","scrub_duration":9,"objects_trimmed":2,"snaptrim_duration":0.0071910430000000003,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":18834,"num_read_kb":74247,"num_write":859,"num_write_kb":11027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":2818651,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"178'627","reported_seq":14090,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:27.313577+0000","last_change":"2024-09-12T16:19:27.313577+0000","last_active":"2024-09-12T16:19:27.313577+0000","last_peered":"2024-09-12T16:19:27.313577+0000","last_clean":"2024-09-12T16:19:27.313577+0000","last_became_active":"2024-09-12T16:16:55.202876+0000","last_became_peered":"2024-09-12T16:16:55.202876+0000","last_unstale":"2024-09-12T16:19:27.313577+0000","last_undegraded":"2024-09-12T16:19:27.313577+0000","last_fullsized":"2024-09-12T16:19:27.313577+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'627","last_scrub_stamp":"2024-09-12T16:19:27.313475+0000","last_deep_scrub":"178'627","last_deep_scrub_stamp":"2024-09-12T16:19:27.313475+0000","last_clean_scrub_stamp":"2024-09-12T16:19:27.313475+0000","objects_scrubbed":19,"log_size":627,"log_dups_size":0,"ondisk_log_size":627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:36.759383+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0.00076921300000000004,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":13702,"num_read_kb":46928,"num_write":627,"num_write_kb":8472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":3145760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"178'1536","reported_seq":20364,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:33.565798+0000","last_change":"2024-09-12T16:19:33.565798+0000","last_active":"2024-09-12T16:19:33.565798+0000","last_peered":"2024-09-12T16:19:33.565798+0000","last_clean":"2024-09-12T16:19:33.565798+0000","last_became_active":"2024-09-12T16:19:12.822483+0000","last_became_peered":"2024-09-12T16:19:12.822483+0000","last_unstale":"2024-09-12T16:19:33.565798+0000","last_undegraded":"2024-09-12T16:19:33.565798+0000","last_fullsized":"2024-09-12T16:19:33.565798+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'1536","last_scrub_stamp":"2024-09-12T16:19:33.565689+0000","last_deep_scrub":"178'1536","last_deep_scrub_stamp":"2024-09-12T16:19:33.565689+0000","last_clean_scrub_stamp":"2024-09-12T16:19:33.565689+0000","objects_scrubbed":15,"log_size":1536,"log_dups_size":0,"ondisk_log_size":1536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:31.484048+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0.00074565700000000005,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":22738,"num_read_kb":67081,"num_write":2129,"num_write_kb":16176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":374,"num_bytes_recovered":30814554,"num_keys_recovered":34,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"178'866","reported_seq":9212,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:32.532151+0000","last_change":"2024-09-12T16:19:32.532151+0000","last_active":"2024-09-12T16:19:32.532151+0000","last_peered":"2024-09-12T16:19:32.532151+0000","last_clean":"2024-09-12T16:19:32.532151+0000","last_became_active":"2024-09-12T16:19:12.823034+0000","last_became_peered":"2024-09-12T16:19:12.823034+0000","last_unstale":"2024-09-12T16:19:32.532151+0000","last_undegraded":"2024-09-12T16:19:32.532151+0000","last_fullsized":"2024-09-12T16:19:32.532151+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'866","last_scrub_stamp":"2024-09-12T16:19:32.532048+0000","last_deep_scrub":"178'866","last_deep_scrub_stamp":"2024-09-12T16:19:32.532048+0000","last_clean_scrub_stamp":"2024-09-12T16:19:32.532048+0000","objects_scrubbed":13,"log_size":866,"log_dups_size":0,"ondisk_log_size":866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:49.832746+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0.001077195,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":12,"num_read":9731,"num_read_kb":27914,"num_write":1117,"num_write_kb":6805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":3550768,"num_keys_recovered":168,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"178'1268","reported_seq":8920,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:25.469355+0000","last_change":"2024-09-12T16:19:25.469355+0000","last_active":"2024-09-12T16:19:25.469355+0000","last_peered":"2024-09-12T16:19:25.469355+0000","last_clean":"2024-09-12T16:19:25.469355+0000","last_became_active":"2024-09-12T16:19:03.770673+0000","last_became_peered":"2024-09-12T16:19:03.770673+0000","last_unstale":"2024-09-12T16:19:25.469355+0000","last_undegraded":"2024-09-12T16:19:25.469355+0000","last_fullsized":"2024-09-12T16:19:25.469355+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'1268","last_scrub_stamp":"2024-09-12T16:19:25.469250+0000","last_deep_scrub":"178'1268","last_deep_scrub_stamp":"2024-09-12T16:19:25.469250+0000","last_clean_scrub_stamp":"2024-09-12T16:19:25.469250+0000","objects_scrubbed":14,"log_size":1268,"log_dups_size":0,"ondisk_log_size":1268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:16.648140+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0.0046887659999999996,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":12367,"num_read_kb":38179,"num_write":1729,"num_write_kb":15361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":14697984,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"178'1332","reported_seq":12097,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:25.630833+0000","last_change":"2024-09-12T16:19:25.630833+0000","last_active":"2024-09-12T16:19:25.630833+0000","last_peered":"2024-09-12T16:19:25.630833+0000","last_clean":"2024-09-12T16:19:25.630833+0000","last_became_active":"2024-09-12T16:15:57.014803+0000","last_became_peered":"2024-09-12T16:15:57.014803+0000","last_unstale":"2024-09-12T16:19:25.630833+0000","last_undegraded":"2024-09-12T16:19:25.630833+0000","last_fullsized":"2024-09-12T16:19:25.630833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'1332","last_scrub_stamp":"2024-09-12T16:19:25.630733+0000","last_deep_scrub":"178'1332","last_deep_scrub_stamp":"2024-09-12T16:19:25.630733+0000","last_clean_scrub_stamp":"2024-09-12T16:19:25.630733+0000","objects_scrubbed":20,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:26.098358+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0.0011248300000000001,"stat_sum":{"num_bytes":19,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":19,"num_read":15353,"num_read_kb":54373,"num_write":2009,"num_write_kb":21868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"178'560","reported_seq":15003,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:30.250356+0000","last_change":"2024-09-12T16:19:30.250356+0000","last_active":"2024-09-12T16:19:30.250356+0000","last_peered":"2024-09-12T16:19:30.250356+0000","last_clean":"2024-09-12T16:19:30.250356+0000","last_became_active":"2024-09-12T16:15:57.016110+0000","last_became_peered":"2024-09-12T16:15:57.016110+0000","last_unstale":"2024-09-12T16:19:30.250356+0000","last_undegraded":"2024-09-12T16:19:30.250356+0000","last_fullsized":"2024-09-12T16:19:30.250356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'560","last_scrub_stamp":"2024-09-12T16:19:30.250261+0000","last_deep_scrub":"178'560","last_deep_scrub_stamp":"2024-09-12T16:19:30.250261+0000","last_clean_scrub_stamp":"2024-09-12T16:19:30.250261+0000","objects_scrubbed":17,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:50.241028+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0.0010965269999999999,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":14633,"num_read_kb":54220,"num_write":566,"num_write_kb":10346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"178'794","reported_seq":6476,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:26.277170+0000","last_change":"2024-09-12T16:19:26.277170+0000","last_active":"2024-09-12T16:19:26.277170+0000","last_peered":"2024-09-12T16:19:26.277170+0000","last_clean":"2024-09-12T16:19:26.277170+0000","last_became_active":"2024-09-12T16:19:03.772548+0000","last_became_peered":"2024-09-12T16:19:03.772548+0000","last_unstale":"2024-09-12T16:19:26.277170+0000","last_undegraded":"2024-09-12T16:19:26.277170+0000","last_fullsized":"2024-09-12T16:19:26.277170+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'794","last_scrub_stamp":"2024-09-12T16:19:26.277064+0000","last_deep_scrub":"178'794","last_deep_scrub_stamp":"2024-09-12T16:19:26.277064+0000","last_clean_scrub_stamp":"2024-09-12T16:19:26.277064+0000","objects_scrubbed":11,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:39.857191+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0.0038788759999999999,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":7154,"num_read_kb":45511,"num_write":918,"num_write_kb":34065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":17173091,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"178'705","reported_seq":8373,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:23.538869+0000","last_change":"2024-09-12T16:19:23.538869+0000","last_active":"2024-09-12T16:19:23.538869+0000","last_peered":"2024-09-12T16:19:23.538869+0000","last_clean":"2024-09-12T16:19:23.538869+0000","last_became_active":"2024-09-12T16:19:03.780157+0000","last_became_peered":"2024-09-12T16:19:03.780157+0000","last_unstale":"2024-09-12T16:19:23.538869+0000","last_undegraded":"2024-09-12T16:19:23.538869+0000","last_fullsized":"2024-09-12T16:19:23.538869+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'705","last_scrub_stamp":"2024-09-12T16:19:23.538772+0000","last_deep_scrub":"178'705","last_deep_scrub_stamp":"2024-09-12T16:19:23.538772+0000","last_clean_scrub_stamp":"2024-09-12T16:19:23.538772+0000","objects_scrubbed":17,"log_size":705,"log_dups_size":0,"ondisk_log_size":705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:50.915067+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0.0043783590000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":7873,"num_read_kb":33843,"num_write":918,"num_write_kb":21944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":337,"num_bytes_recovered":20360415,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"178'1613","reported_seq":15909,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:31.564025+0000","last_change":"2024-09-12T16:19:31.564025+0000","last_active":"2024-09-12T16:19:31.564025+0000","last_peered":"2024-09-12T16:19:31.564025+0000","last_clean":"2024-09-12T16:19:31.564025+0000","last_became_active":"2024-09-12T16:19:12.824566+0000","last_became_peered":"2024-09-12T16:19:12.824566+0000","last_unstale":"2024-09-12T16:19:31.564025+0000","last_undegraded":"2024-09-12T16:19:31.564025+0000","last_fullsized":"2024-09-12T16:19:31.564025+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'1613","last_scrub_stamp":"2024-09-12T16:19:31.563913+0000","last_deep_scrub":"178'1613","last_deep_scrub_stamp":"2024-09-12T16:19:31.563913+0000","last_clean_scrub_stamp":"2024-09-12T16:19:31.563913+0000","objects_scrubbed":12,"log_size":1613,"log_dups_size":0,"ondisk_log_size":1613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:59.861944+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0.0036743769999999999,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":19171,"num_read_kb":50037,"num_write":2353,"num_write_kb":15650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":483,"num_bytes_recovered":14102804,"num_keys_recovered":132,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"178'399","reported_seq":7916,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:33.267271+0000","last_change":"2024-09-12T16:19:33.267271+0000","last_active":"2024-09-12T16:19:33.267271+0000","last_peered":"2024-09-12T16:19:33.267271+0000","last_clean":"2024-09-12T16:19:33.267271+0000","last_became_active":"2024-09-12T16:19:03.771611+0000","last_became_peered":"2024-09-12T16:19:03.771611+0000","last_unstale":"2024-09-12T16:19:33.267271+0000","last_undegraded":"2024-09-12T16:19:33.267271+0000","last_fullsized":"2024-09-12T16:19:33.267271+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'399","last_scrub_stamp":"2024-09-12T16:19:33.267164+0000","last_deep_scrub":"178'399","last_deep_scrub_stamp":"2024-09-12T16:19:33.267164+0000","last_clean_scrub_stamp":"2024-09-12T16:19:33.267164+0000","objects_scrubbed":12,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:42.764080+0000","scrub_duration":9,"objects_trimmed":2,"snaptrim_duration":0.0056373990000000004,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":6922,"num_read_kb":49310,"num_write":420,"num_write_kb":20795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":1054818,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"178'902","reported_seq":9456,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:31.252790+0000","last_change":"2024-09-12T16:19:31.252790+0000","last_active":"2024-09-12T16:19:31.252790+0000","last_peered":"2024-09-12T16:19:31.252790+0000","last_clean":"2024-09-12T16:19:31.252790+0000","last_became_active":"2024-09-12T16:16:53.185698+0000","last_became_peered":"2024-09-12T16:16:53.185698+0000","last_unstale":"2024-09-12T16:19:31.252790+0000","last_undegraded":"2024-09-12T16:19:31.252790+0000","last_fullsized":"2024-09-12T16:19:31.252790+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'902","last_scrub_stamp":"2024-09-12T16:19:31.252672+0000","last_deep_scrub":"178'902","last_deep_scrub_stamp":"2024-09-12T16:19:31.252672+0000","last_clean_scrub_stamp":"2024-09-12T16:19:31.252672+0000","objects_scrubbed":13,"log_size":902,"log_dups_size":0,"ondisk_log_size":902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:27.587104+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0.001055348,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":12029,"num_read_kb":50248,"num_write":1156,"num_write_kb":23396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":252,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:25.162754+0000","last_change":"2024-09-12T16:19:25.162754+0000","last_active":"2024-09-12T16:19:25.162754+0000","last_peered":"2024-09-12T16:19:25.162754+0000","last_clean":"2024-09-12T16:19:25.162754+0000","last_became_active":"2024-09-12T16:16:52.184420+0000","last_became_peered":"2024-09-12T16:16:52.184420+0000","last_unstale":"2024-09-12T16:19:25.162754+0000","last_undegraded":"2024-09-12T16:19:25.162754+0000","last_fullsized":"2024-09-12T16:19:25.162754+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:19:25.162627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:19:25.162627+0000","last_clean_scrub_stamp":"2024-09-12T16:19:25.162627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:56.022751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"178'556","reported_seq":9929,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:24.502408+0000","last_change":"2024-09-12T16:19:24.502408+0000","last_active":"2024-09-12T16:19:24.502408+0000","last_peered":"2024-09-12T16:19:24.502408+0000","last_clean":"2024-09-12T16:19:24.502408+0000","last_became_active":"2024-09-12T16:19:03.770869+0000","last_became_peered":"2024-09-12T16:19:03.770869+0000","last_unstale":"2024-09-12T16:19:24.502408+0000","last_undegraded":"2024-09-12T16:19:24.502408+0000","last_fullsized":"2024-09-12T16:19:24.502408+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'556","last_scrub_stamp":"2024-09-12T16:19:24.502336+0000","last_deep_scrub":"178'556","last_deep_scrub_stamp":"2024-09-12T16:19:24.502336+0000","last_clean_scrub_stamp":"2024-09-12T16:19:24.502336+0000","objects_scrubbed":3,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:51.278671+0000","scrub_duration":3,"objects_trimmed":2,"snaptrim_duration":0.0075018430000000002,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":10526,"num_read_kb":44243,"num_write":495,"num_write_kb":9200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":359,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:25.273260+0000","last_change":"2024-09-12T16:19:25.273260+0000","last_active":"2024-09-12T16:19:25.273260+0000","last_peered":"2024-09-12T16:19:25.273260+0000","last_clean":"2024-09-12T16:19:25.273260+0000","last_became_active":"2024-09-12T16:16:52.186638+0000","last_became_peered":"2024-09-12T16:16:52.186638+0000","last_unstale":"2024-09-12T16:19:25.273260+0000","last_undegraded":"2024-09-12T16:19:25.273260+0000","last_fullsized":"2024-09-12T16:19:25.273260+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:19:25.273165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:19:25.273165+0000","last_clean_scrub_stamp":"2024-09-12T16:19:25.273165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:47.574976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066384400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"178'775","reported_seq":16816,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:24.246943+0000","last_change":"2024-09-12T16:19:24.246943+0000","last_active":"2024-09-12T16:19:24.246943+0000","last_peered":"2024-09-12T16:19:24.246943+0000","last_clean":"2024-09-12T16:19:24.246943+0000","last_became_active":"2024-09-12T16:16:34.108850+0000","last_became_peered":"2024-09-12T16:16:34.108850+0000","last_unstale":"2024-09-12T16:19:24.246943+0000","last_undegraded":"2024-09-12T16:19:24.246943+0000","last_fullsized":"2024-09-12T16:19:24.246943+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'775","last_scrub_stamp":"2024-09-12T16:19:24.246813+0000","last_deep_scrub":"178'775","last_deep_scrub_stamp":"2024-09-12T16:19:24.246813+0000","last_clean_scrub_stamp":"2024-09-12T16:19:24.246813+0000","objects_scrubbed":12,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:05.197649+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0.00080883699999999997,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":17664,"num_read_kb":61096,"num_write":665,"num_write_kb":27115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":261,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:32.268376+0000","last_change":"2024-09-12T16:19:32.268376+0000","last_active":"2024-09-12T16:19:32.268376+0000","last_peered":"2024-09-12T16:19:32.268376+0000","last_clean":"2024-09-12T16:19:32.268376+0000","last_became_active":"2024-09-12T16:19:03.772128+0000","last_became_peered":"2024-09-12T16:19:03.772128+0000","last_unstale":"2024-09-12T16:19:32.268376+0000","last_undegraded":"2024-09-12T16:19:32.268376+0000","last_fullsized":"2024-09-12T16:19:32.268376+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:19:32.268275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:19:32.268275+0000","last_clean_scrub_stamp":"2024-09-12T16:19:32.268275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:50.851649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"178'782","reported_seq":8514,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:27.259580+0000","last_change":"2024-09-12T16:19:27.259580+0000","last_active":"2024-09-12T16:19:27.259580+0000","last_peered":"2024-09-12T16:19:27.259580+0000","last_clean":"2024-09-12T16:19:27.259580+0000","last_became_active":"2024-09-12T16:15:57.011381+0000","last_became_peered":"2024-09-12T16:15:57.011381+0000","last_unstale":"2024-09-12T16:19:27.259580+0000","last_undegraded":"2024-09-12T16:19:27.259580+0000","last_fullsized":"2024-09-12T16:19:27.259580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'782","last_scrub_stamp":"2024-09-12T16:19:27.259477+0000","last_deep_scrub":"178'782","last_deep_scrub_stamp":"2024-09-12T16:19:27.259477+0000","last_clean_scrub_stamp":"2024-09-12T16:19:27.259477+0000","objects_scrubbed":14,"log_size":782,"log_dups_size":0,"ondisk_log_size":782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:07.850797+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0.0012620280000000001,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":10668,"num_read_kb":44352,"num_write":952,"num_write_kb":7790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":356,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:23.216209+0000","last_change":"2024-09-12T16:19:23.216209+0000","last_active":"2024-09-12T16:19:23.216209+0000","last_peered":"2024-09-12T16:19:23.216209+0000","last_clean":"2024-09-12T16:19:23.216209+0000","last_became_active":"2024-09-12T16:19:03.772694+0000","last_became_peered":"2024-09-12T16:19:03.772694+0000","last_unstale":"2024-09-12T16:19:23.216209+0000","last_undegraded":"2024-09-12T16:19:23.216209+0000","last_fullsized":"2024-09-12T16:19:23.216209+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:19:23.216138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:19:23.216138+0000","last_clean_scrub_stamp":"2024-09-12T16:19:23.216138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:27.206891+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00065522900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"178'856","reported_seq":22337,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:27.504359+0000","last_change":"2024-09-12T16:19:27.504359+0000","last_active":"2024-09-12T16:19:27.504359+0000","last_peered":"2024-09-12T16:19:27.504359+0000","last_clean":"2024-09-12T16:19:27.504359+0000","last_became_active":"2024-09-12T16:19:12.821483+0000","last_became_peered":"2024-09-12T16:19:12.821483+0000","last_unstale":"2024-09-12T16:19:27.504359+0000","last_undegraded":"2024-09-12T16:19:27.504359+0000","last_fullsized":"2024-09-12T16:19:27.504359+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'856","last_scrub_stamp":"2024-09-12T16:19:27.504239+0000","last_deep_scrub":"178'856","last_deep_scrub_stamp":"2024-09-12T16:19:27.504239+0000","last_clean_scrub_stamp":"2024-09-12T16:19:27.504239+0000","objects_scrubbed":9,"log_size":856,"log_dups_size":0,"ondisk_log_size":856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:33.597994+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0.001861333,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":25876,"num_read_kb":48987,"num_write":739,"num_write_kb":4795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":335,"num_bytes_recovered":4005968,"num_keys_recovered":105,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"178'849","reported_seq":6639,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:24.618830+0000","last_change":"2024-09-12T16:19:24.618830+0000","last_active":"2024-09-12T16:19:24.618830+0000","last_peered":"2024-09-12T16:19:24.618830+0000","last_clean":"2024-09-12T16:19:24.618830+0000","last_became_active":"2024-09-12T16:19:03.778155+0000","last_became_peered":"2024-09-12T16:19:03.778155+0000","last_unstale":"2024-09-12T16:19:24.618830+0000","last_undegraded":"2024-09-12T16:19:24.618830+0000","last_fullsized":"2024-09-12T16:19:24.618830+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'849","last_scrub_stamp":"2024-09-12T16:19:24.618741+0000","last_deep_scrub":"178'849","last_deep_scrub_stamp":"2024-09-12T16:19:24.618741+0000","last_clean_scrub_stamp":"2024-09-12T16:19:24.618741+0000","objects_scrubbed":6,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:40.692764+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0.0028595159999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":5,"num_read":6564,"num_read_kb":41539,"num_write":1022,"num_write_kb":9272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"178'3","reported_seq":284,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:24.505016+0000","last_change":"2024-09-12T16:19:24.505016+0000","last_active":"2024-09-12T16:19:24.505016+0000","last_peered":"2024-09-12T16:19:24.505016+0000","last_clean":"2024-09-12T16:19:24.505016+0000","last_became_active":"2024-09-12T16:19:12.820814+0000","last_became_peered":"2024-09-12T16:19:12.820814+0000","last_unstale":"2024-09-12T16:19:24.505016+0000","last_undegraded":"2024-09-12T16:19:24.505016+0000","last_fullsized":"2024-09-12T16:19:24.505016+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'3","last_scrub_stamp":"2024-09-12T16:19:24.504925+0000","last_deep_scrub":"178'3","last_deep_scrub_stamp":"2024-09-12T16:19:24.504925+0000","last_clean_scrub_stamp":"2024-09-12T16:19:24.504925+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:32.781225+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"178'808","reported_seq":18940,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:29.264941+0000","last_change":"2024-09-12T16:19:29.264941+0000","last_active":"2024-09-12T16:19:29.264941+0000","last_peered":"2024-09-12T16:19:29.264941+0000","last_clean":"2024-09-12T16:19:29.264941+0000","last_became_active":"2024-09-12T16:15:57.014294+0000","last_became_peered":"2024-09-12T16:15:57.014294+0000","last_unstale":"2024-09-12T16:19:29.264941+0000","last_undegraded":"2024-09-12T16:19:29.264941+0000","last_fullsized":"2024-09-12T16:19:29.264941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'808","last_scrub_stamp":"2024-09-12T16:19:29.264821+0000","last_deep_scrub":"178'808","last_deep_scrub_stamp":"2024-09-12T16:19:29.264821+0000","last_clean_scrub_stamp":"2024-09-12T16:19:29.264821+0000","objects_scrubbed":11,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:13.241173+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0.0023814270000000002,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":20280,"num_read_kb":53258,"num_write":686,"num_write_kb":17135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":330,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:23.285288+0000","last_change":"2024-09-12T16:19:23.285288+0000","last_active":"2024-09-12T16:19:23.285288+0000","last_peered":"2024-09-12T16:19:23.285288+0000","last_clean":"2024-09-12T16:19:23.285288+0000","last_became_active":"2024-09-12T16:18:29.019339+0000","last_became_peered":"2024-09-12T16:18:29.019339+0000","last_unstale":"2024-09-12T16:19:23.285288+0000","last_undegraded":"2024-09-12T16:19:23.285288+0000","last_fullsized":"2024-09-12T16:19:23.285288+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:19:23.285219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:19:23.285219+0000","last_clean_scrub_stamp":"2024-09-12T16:19:23.285219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:45.850962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"178'524","reported_seq":5950,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:24.234276+0000","last_change":"2024-09-12T16:19:24.234276+0000","last_active":"2024-09-12T16:19:24.234276+0000","last_peered":"2024-09-12T16:19:24.234276+0000","last_clean":"2024-09-12T16:19:24.234276+0000","last_became_active":"2024-09-12T16:19:03.775131+0000","last_became_peered":"2024-09-12T16:19:03.775131+0000","last_unstale":"2024-09-12T16:19:24.234276+0000","last_undegraded":"2024-09-12T16:19:24.234276+0000","last_fullsized":"2024-09-12T16:19:24.234276+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'524","last_scrub_stamp":"2024-09-12T16:19:24.234168+0000","last_deep_scrub":"178'524","last_deep_scrub_stamp":"2024-09-12T16:19:24.234168+0000","last_clean_scrub_stamp":"2024-09-12T16:19:24.234168+0000","objects_scrubbed":15,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:55.718109+0000","scrub_duration":10,"objects_trimmed":2,"snaptrim_duration":0.0072137039999999996,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":5469,"num_read_kb":44149,"num_write":663,"num_write_kb":24803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":144,"num_bytes_recovered":10774621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":252,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:26.198052+0000","last_change":"2024-09-12T16:19:26.198052+0000","last_active":"2024-09-12T16:19:26.198052+0000","last_peered":"2024-09-12T16:19:26.198052+0000","last_clean":"2024-09-12T16:19:26.198052+0000","last_became_active":"2024-09-12T16:16:52.184555+0000","last_became_peered":"2024-09-12T16:16:52.184555+0000","last_unstale":"2024-09-12T16:19:26.198052+0000","last_undegraded":"2024-09-12T16:19:26.198052+0000","last_fullsized":"2024-09-12T16:19:26.198052+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:19:26.197962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:19:26.197962+0000","last_clean_scrub_stamp":"2024-09-12T16:19:26.197962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:28.937094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"178'595","reported_seq":10248,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:26.256061+0000","last_change":"2024-09-12T16:19:26.256061+0000","last_active":"2024-09-12T16:19:26.256061+0000","last_peered":"2024-09-12T16:19:26.256061+0000","last_clean":"2024-09-12T16:19:26.256061+0000","last_became_active":"2024-09-12T16:18:25.146756+0000","last_became_peered":"2024-09-12T16:18:25.146756+0000","last_unstale":"2024-09-12T16:19:26.256061+0000","last_undegraded":"2024-09-12T16:19:26.256061+0000","last_fullsized":"2024-09-12T16:19:26.256061+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'595","last_scrub_stamp":"2024-09-12T16:19:26.255971+0000","last_deep_scrub":"178'595","last_deep_scrub_stamp":"2024-09-12T16:19:26.255971+0000","last_clean_scrub_stamp":"2024-09-12T16:19:26.255971+0000","objects_scrubbed":10,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:56.763608+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0.0014402110000000001,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":9889,"num_read_kb":36104,"num_write":494,"num_write_kb":7468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":315,"num_bytes_recovered":8454224,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"178'2","reported_seq":263,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:25.489720+0000","last_change":"2024-09-12T16:19:25.489720+0000","last_active":"2024-09-12T16:19:25.489720+0000","last_peered":"2024-09-12T16:19:25.489720+0000","last_clean":"2024-09-12T16:19:25.489720+0000","last_became_active":"2024-09-12T16:19:12.821406+0000","last_became_peered":"2024-09-12T16:19:12.821406+0000","last_unstale":"2024-09-12T16:19:25.489720+0000","last_undegraded":"2024-09-12T16:19:25.489720+0000","last_fullsized":"2024-09-12T16:19:25.489720+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'2","last_scrub_stamp":"2024-09-12T16:19:25.489621+0000","last_deep_scrub":"178'2","last_deep_scrub_stamp":"2024-09-12T16:19:25.489621+0000","last_clean_scrub_stamp":"2024-09-12T16:19:25.489621+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:28:00.828918+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"178'74","reported_seq":269,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:24.201287+0000","last_change":"2024-09-12T16:19:24.201287+0000","last_active":"2024-09-12T16:19:24.201287+0000","last_peered":"2024-09-12T16:19:24.201287+0000","last_clean":"2024-09-12T16:19:24.201287+0000","last_became_active":"2024-09-12T16:19:03.772266+0000","last_became_peered":"2024-09-12T16:19:03.772266+0000","last_unstale":"2024-09-12T16:19:24.201287+0000","last_undegraded":"2024-09-12T16:19:24.201287+0000","last_fullsized":"2024-09-12T16:19:24.201287+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'74","last_scrub_stamp":"2024-09-12T16:19:24.201170+0000","last_deep_scrub":"178'74","last_deep_scrub_stamp":"2024-09-12T16:19:24.201170+0000","last_clean_scrub_stamp":"2024-09-12T16:19:24.201170+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:56:01.665728+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"178'601","reported_seq":13696,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:25.297616+0000","last_change":"2024-09-12T16:19:25.297616+0000","last_active":"2024-09-12T16:19:25.297616+0000","last_peered":"2024-09-12T16:19:25.297616+0000","last_clean":"2024-09-12T16:19:25.297616+0000","last_became_active":"2024-09-12T16:16:34.108998+0000","last_became_peered":"2024-09-12T16:16:34.108998+0000","last_unstale":"2024-09-12T16:19:25.297616+0000","last_undegraded":"2024-09-12T16:19:25.297616+0000","last_fullsized":"2024-09-12T16:19:25.297616+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'601","last_scrub_stamp":"2024-09-12T16:19:25.297499+0000","last_deep_scrub":"178'601","last_deep_scrub_stamp":"2024-09-12T16:19:25.297499+0000","last_clean_scrub_stamp":"2024-09-12T16:19:25.297499+0000","objects_scrubbed":14,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:40.681179+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0.0010878509999999999,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":13209,"num_read_kb":49430,"num_write":675,"num_write_kb":7945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"178'495","reported_seq":31638,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:26.590739+0000","last_change":"2024-09-12T16:19:26.590739+0000","last_active":"2024-09-12T16:19:26.590739+0000","last_peered":"2024-09-12T16:19:26.590739+0000","last_clean":"2024-09-12T16:19:26.590739+0000","last_became_active":"2024-09-12T16:15:57.013620+0000","last_became_peered":"2024-09-12T16:15:57.013620+0000","last_unstale":"2024-09-12T16:19:26.590739+0000","last_undegraded":"2024-09-12T16:19:26.590739+0000","last_fullsized":"2024-09-12T16:19:26.590739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'495","last_scrub_stamp":"2024-09-12T16:19:26.590642+0000","last_deep_scrub":"178'495","last_deep_scrub_stamp":"2024-09-12T16:19:26.590642+0000","last_clean_scrub_stamp":"2024-09-12T16:19:26.590642+0000","objects_scrubbed":11,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:26.078032+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0.0014423319999999999,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":30743,"num_read_kb":77489,"num_write":563,"num_write_kb":11505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"178'904","reported_seq":20892,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:28.204683+0000","last_change":"2024-09-12T16:19:28.204683+0000","last_active":"2024-09-12T16:19:28.204683+0000","last_peered":"2024-09-12T16:19:28.204683+0000","last_clean":"2024-09-12T16:19:28.204683+0000","last_became_active":"2024-09-12T16:16:55.202934+0000","last_became_peered":"2024-09-12T16:16:55.202934+0000","last_unstale":"2024-09-12T16:19:28.204683+0000","last_undegraded":"2024-09-12T16:19:28.204683+0000","last_fullsized":"2024-09-12T16:19:28.204683+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'904","last_scrub_stamp":"2024-09-12T16:19:28.204565+0000","last_deep_scrub":"178'904","last_deep_scrub_stamp":"2024-09-12T16:19:28.204565+0000","last_clean_scrub_stamp":"2024-09-12T16:19:28.204565+0000","objects_scrubbed":12,"log_size":904,"log_dups_size":0,"ondisk_log_size":904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:57.869384+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0.0025551279999999998,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":11,"num_read":21936,"num_read_kb":59605,"num_write":943,"num_write_kb":8224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":4487368,"num_keys_recovered":26,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"178'536","reported_seq":15707,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:28.290076+0000","last_change":"2024-09-12T16:19:28.290076+0000","last_active":"2024-09-12T16:19:28.290076+0000","last_peered":"2024-09-12T16:19:28.290076+0000","last_clean":"2024-09-12T16:19:28.290076+0000","last_became_active":"2024-09-12T16:19:03.777557+0000","last_became_peered":"2024-09-12T16:19:03.777557+0000","last_unstale":"2024-09-12T16:19:28.290076+0000","last_undegraded":"2024-09-12T16:19:28.290076+0000","last_fullsized":"2024-09-12T16:19:28.290076+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'536","last_scrub_stamp":"2024-09-12T16:19:28.289963+0000","last_deep_scrub":"178'536","last_deep_scrub_stamp":"2024-09-12T16:19:28.289963+0000","last_clean_scrub_stamp":"2024-09-12T16:19:28.289963+0000","objects_scrubbed":12,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:24.923384+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0.0040340999999999997,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":15308,"num_read_kb":48885,"num_write":585,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"178'466","reported_seq":11561,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:26.533976+0000","last_change":"2024-09-12T16:19:26.533976+0000","last_active":"2024-09-12T16:19:26.533976+0000","last_peered":"2024-09-12T16:19:26.533976+0000","last_clean":"2024-09-12T16:19:26.533976+0000","last_became_active":"2024-09-12T16:19:12.822409+0000","last_became_peered":"2024-09-12T16:19:12.822409+0000","last_unstale":"2024-09-12T16:19:26.533976+0000","last_undegraded":"2024-09-12T16:19:26.533976+0000","last_fullsized":"2024-09-12T16:19:26.533976+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'466","last_scrub_stamp":"2024-09-12T16:19:26.533867+0000","last_deep_scrub":"178'466","last_deep_scrub_stamp":"2024-09-12T16:19:26.533867+0000","last_clean_scrub_stamp":"2024-09-12T16:19:26.533867+0000","objects_scrubbed":16,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:42.760546+0000","scrub_duration":13,"objects_trimmed":2,"snaptrim_duration":0.00419339,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":9857,"num_read_kb":46208,"num_write":421,"num_write_kb":17232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":322,"num_bytes_recovered":11704832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"178'703","reported_seq":17491,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:27.181043+0000","last_change":"2024-09-12T16:19:27.181043+0000","last_active":"2024-09-12T16:19:27.181043+0000","last_peered":"2024-09-12T16:19:27.181043+0000","last_clean":"2024-09-12T16:19:27.181043+0000","last_became_active":"2024-09-12T16:16:55.202102+0000","last_became_peered":"2024-09-12T16:16:55.202102+0000","last_unstale":"2024-09-12T16:19:27.181043+0000","last_undegraded":"2024-09-12T16:19:27.181043+0000","last_fullsized":"2024-09-12T16:19:27.181043+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'703","last_scrub_stamp":"2024-09-12T16:19:27.180938+0000","last_deep_scrub":"178'703","last_deep_scrub_stamp":"2024-09-12T16:19:27.180938+0000","last_clean_scrub_stamp":"2024-09-12T16:19:27.180938+0000","objects_scrubbed":10,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:09.496704+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0026029579999999998,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":18807,"num_read_kb":58739,"num_write":641,"num_write_kb":13631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":126,"num_bytes_recovered":6078562,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"178'606","reported_seq":7778,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:28.484139+0000","last_change":"2024-09-12T16:19:28.484139+0000","last_active":"2024-09-12T16:19:28.484139+0000","last_peered":"2024-09-12T16:19:28.484139+0000","last_clean":"2024-09-12T16:19:28.484139+0000","last_became_active":"2024-09-12T16:19:12.823347+0000","last_became_peered":"2024-09-12T16:19:12.823347+0000","last_unstale":"2024-09-12T16:19:28.484139+0000","last_undegraded":"2024-09-12T16:19:28.484139+0000","last_fullsized":"2024-09-12T16:19:28.484139+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'606","last_scrub_stamp":"2024-09-12T16:19:28.483999+0000","last_deep_scrub":"178'606","last_deep_scrub_stamp":"2024-09-12T16:19:28.483999+0000","last_clean_scrub_stamp":"2024-09-12T16:19:28.483999+0000","objects_scrubbed":17,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:51.550284+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0.0013497229999999999,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":7931,"num_read_kb":30144,"num_write":561,"num_write_kb":13262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":319,"num_bytes_recovered":6744127,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"178'654","reported_seq":12203,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:29.518159+0000","last_change":"2024-09-12T16:19:29.518159+0000","last_active":"2024-09-12T16:19:29.518159+0000","last_peered":"2024-09-12T16:19:29.518159+0000","last_clean":"2024-09-12T16:19:29.518159+0000","last_became_active":"2024-09-12T16:19:12.821943+0000","last_became_peered":"2024-09-12T16:19:12.821943+0000","last_unstale":"2024-09-12T16:19:29.518159+0000","last_undegraded":"2024-09-12T16:19:29.518159+0000","last_fullsized":"2024-09-12T16:19:29.518159+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'654","last_scrub_stamp":"2024-09-12T16:19:29.518057+0000","last_deep_scrub":"178'654","last_deep_scrub_stamp":"2024-09-12T16:19:29.518057+0000","last_clean_scrub_stamp":"2024-09-12T16:19:29.518057+0000","objects_scrubbed":14,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:44.372710+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0.00220666,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":10861,"num_read_kb":49111,"num_write":815,"num_write_kb":21657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":304,"num_bytes_recovered":6361542,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"178'647","reported_seq":15262,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:30.568685+0000","last_change":"2024-09-12T16:19:30.568685+0000","last_active":"2024-09-12T16:19:30.568685+0000","last_peered":"2024-09-12T16:19:30.568685+0000","last_clean":"2024-09-12T16:19:30.568685+0000","last_became_active":"2024-09-12T16:19:12.819772+0000","last_became_peered":"2024-09-12T16:19:12.819772+0000","last_unstale":"2024-09-12T16:19:30.568685+0000","last_undegraded":"2024-09-12T16:19:30.568685+0000","last_fullsized":"2024-09-12T16:19:30.568685+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'647","last_scrub_stamp":"2024-09-12T16:19:30.568550+0000","last_deep_scrub":"178'647","last_deep_scrub_stamp":"2024-09-12T16:19:30.568550+0000","last_clean_scrub_stamp":"2024-09-12T16:19:30.568550+0000","objects_scrubbed":17,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:24.453752+0000","scrub_duration":12,"objects_trimmed":2,"snaptrim_duration":0.0022010100000000002,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":12815,"num_read_kb":73185,"num_write":784,"num_write_kb":17171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":416,"num_bytes_recovered":13039478,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"178'656","reported_seq":17058,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:30.253545+0000","last_change":"2024-09-12T16:19:30.253545+0000","last_active":"2024-09-12T16:19:30.253545+0000","last_peered":"2024-09-12T16:19:30.253545+0000","last_clean":"2024-09-12T16:19:30.253545+0000","last_became_active":"2024-09-12T16:16:55.202493+0000","last_became_peered":"2024-09-12T16:16:55.202493+0000","last_unstale":"2024-09-12T16:19:30.253545+0000","last_undegraded":"2024-09-12T16:19:30.253545+0000","last_fullsized":"2024-09-12T16:19:30.253545+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'656","last_scrub_stamp":"2024-09-12T16:19:30.253450+0000","last_deep_scrub":"178'656","last_deep_scrub_stamp":"2024-09-12T16:19:30.253450+0000","last_clean_scrub_stamp":"2024-09-12T16:19:30.253450+0000","objects_scrubbed":12,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:29:53.266205+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0.0013216020000000001,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":16727,"num_read_kb":61490,"num_write":798,"num_write_kb":15885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":1725440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"178'667","reported_seq":15134,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:22.512081+0000","last_change":"2024-09-12T16:19:22.512081+0000","last_active":"2024-09-12T16:19:22.512081+0000","last_peered":"2024-09-12T16:19:22.512081+0000","last_clean":"2024-09-12T16:19:22.512081+0000","last_became_active":"2024-09-12T16:19:03.770819+0000","last_became_peered":"2024-09-12T16:19:03.770819+0000","last_unstale":"2024-09-12T16:19:22.512081+0000","last_undegraded":"2024-09-12T16:19:22.512081+0000","last_fullsized":"2024-09-12T16:19:22.512081+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'667","last_scrub_stamp":"2024-09-12T16:19:22.511998+0000","last_deep_scrub":"178'667","last_deep_scrub_stamp":"2024-09-12T16:19:22.511998+0000","last_clean_scrub_stamp":"2024-09-12T16:19:22.511998+0000","objects_scrubbed":14,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:53.931034+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0.0055961810000000004,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":16405,"num_read_kb":60197,"num_write":671,"num_write_kb":14674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":3518540,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"178'1003","reported_seq":11475,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-12T16:19:29.243645+0000","last_change":"2024-09-12T16:19:29.243645+0000","last_active":"2024-09-12T16:19:29.243645+0000","last_peered":"2024-09-12T16:19:29.243645+0000","last_clean":"2024-09-12T16:19:29.243645+0000","last_became_active":"2024-09-12T16:18:25.147080+0000","last_became_peered":"2024-09-12T16:18:25.147080+0000","last_unstale":"2024-09-12T16:19:29.243645+0000","last_undegraded":"2024-09-12T16:19:29.243645+0000","last_fullsized":"2024-09-12T16:19:29.243645+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'1003","last_scrub_stamp":"2024-09-12T16:19:29.243547+0000","last_deep_scrub":"178'1003","last_deep_scrub_stamp":"2024-09-12T16:19:29.243547+0000","last_clean_scrub_stamp":"2024-09-12T16:19:29.243547+0000","objects_scrubbed":12,"log_size":1003,"log_dups_size":0,"ondisk_log_size":1003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:19.889457+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0.0017970779999999999,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":11897,"num_read_kb":44792,"num_write":1435,"num_write_kb":19195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":434,"num_bytes_recovered":17467099,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":418,"num_object_clones":0,"num_object_copies":836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":418,"num_whiteouts":414,"num_read":453939,"num_read_kb":1624894,"num_write":29409,"num_write_kb":478980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5132,"num_bytes_recovered":202080646,"num_keys_recovered":679,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16597,"internal_metadata":0},"log_size":24956,"ondisk_log_size":24956,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":5,"up_from":71,"seq":304942678050,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43128,"kb_used_data":2088,"kb_used_omap":11,"kb_used_meta":41012,"kb_avail":94328712,"statfs":{"total":96636764160,"available":96592601088,"internally_reserved":0,"allocated":2138112,"data_stored":894816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11593,"internal_metadata":41996983},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640309,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77688,"kb_used_data":2088,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94294152,"statfs":{"total":96636764160,"available":96557211648,"internally_reserved":0,"allocated":2138112,"data_stored":894816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640310,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78264,"kb_used_data":2664,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293576,"statfs":{"total":96636764160,"available":96556621824,"internally_reserved":0,"allocated":2727936,"data_stored":1485165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640311,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51316,"kb_used_data":2084,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320524,"statfs":{"total":96636764160,"available":96584216576,"internally_reserved":0,"allocated":2134016,"data_stored":894797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640308,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59644,"kb_used_data":2092,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312196,"statfs":{"total":96636764160,"available":96575688704,"internally_reserved":0,"allocated":2142208,"data_stored":894835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":166,"seq":712964571146,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31800,"kb_used_data":2664,"kb_used_omap":25,"kb_used_meta":29094,"kb_avail":94340040,"statfs":{"total":96636764160,"available":96604200960,"internally_reserved":0,"allocated":2727936,"data_stored":1485165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25827,"internal_metadata":29793053},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9648,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6949,"internal_metadata":0}]}} 2024-09-12T16:19:44.933 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T16:19:45.248 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T16:19:45.248 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T16:19:45.248 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T16:19:45.248 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T16:19:45.284 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T16:19:45.284 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T16:19:45.284 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T16:19:45.358 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T16:19:45.358 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T16:19:45.358 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T16:19:45.437 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T16:19:45.438 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T16:19:45.438 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T16:19:45.480 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T16:19:45.481 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T16:19:45.481 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T16:19:45.526 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T16:19:45.526 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T16:19:45.526 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T16:19:45.575 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T16:19:45.576 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T16:19:45.576 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T16:19:45.576 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T16:19:45.605 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T16:19:45.606 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T16:19:45.606 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T16:19:45.606 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T16:19:45.617 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T16:19:45.618 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T16:19:45.618 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T16:19:45.669 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T16:19:45.670 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T16:19:45.670 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T16:19:45.682 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T16:19:45.682 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T16:19:45.682 DEBUG:teuthology.orchestra.run.smithi017:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v SLOW_OPS | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-12T16:19:45.749 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-12T16:19:45.749 DEBUG:teuthology.orchestra.run.smithi017:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T16:19:45.928 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-12T16:19:45.928 DEBUG:teuthology.orchestra.run.smithi017:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T16:19:46.028 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-12T16:19:46.028 DEBUG:teuthology.orchestra.run.smithi017:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T16:19:46.118 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi047.front.sepia.ceph.com 2024-09-12T16:19:46.118 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T16:19:46.279 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi047.front.sepia.ceph.com 2024-09-12T16:19:46.279 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-12T16:19:46.352 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi047.front.sepia.ceph.com 2024-09-12T16:19:46.352 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-12T16:19:46.407 INFO:tasks.ceph:Archiving mon data... 2024-09-12T16:19:46.408 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/dis-2024-09-12_15:21:08-rbd-wip-dis-testing-distro-default-smithi/7902667/data/mon.a.tgz 2024-09-12T16:19:46.408 DEBUG:teuthology.orchestra.run.smithi017:> mktemp 2024-09-12T16:19:46.426 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.XD5uHgsdjn 2024-09-12T16:19:46.426 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.XD5uHgsdjn 2024-09-12T16:19:46.587 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.XD5uHgsdjn 2024-09-12T16:19:46.672 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.XD5uHgsdjn is 360KB 2024-09-12T16:19:46.742 DEBUG:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.XD5uHgsdjn 2024-09-12T16:19:46.757 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/dis-2024-09-12_15:21:08-rbd-wip-dis-testing-distro-default-smithi/7902667/data/mon.c.tgz 2024-09-12T16:19:46.757 DEBUG:teuthology.orchestra.run.smithi017:> mktemp 2024-09-12T16:19:46.812 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.DlMRKt73mu 2024-09-12T16:19:46.813 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.DlMRKt73mu 2024-09-12T16:19:46.982 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.DlMRKt73mu 2024-09-12T16:19:47.065 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.DlMRKt73mu is 481KB 2024-09-12T16:19:47.135 DEBUG:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.DlMRKt73mu 2024-09-12T16:19:47.151 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/dis-2024-09-12_15:21:08-rbd-wip-dis-testing-distro-default-smithi/7902667/data/mon.b.tgz 2024-09-12T16:19:47.151 DEBUG:teuthology.orchestra.run.smithi047:> mktemp 2024-09-12T16:19:47.170 INFO:teuthology.orchestra.run.smithi047.stdout:/tmp/tmp.z9FwQASl0u 2024-09-12T16:19:47.170 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.z9FwQASl0u 2024-09-12T16:19:47.358 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0666 /tmp/tmp.z9FwQASl0u 2024-09-12T16:19:47.443 DEBUG:teuthology.orchestra.remote:smithi047:/tmp/tmp.z9FwQASl0u is 481KB 2024-09-12T16:19:47.540 DEBUG:teuthology.orchestra.run.smithi047:> rm -fr /tmp/tmp.z9FwQASl0u 2024-09-12T16:19:47.556 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T16:19:47.556 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T16:19:47.558 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T16:19:47.597 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T16:19:47.647 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T16:19:47.677 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T16:19:47.695 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T16:19:47.695 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T16:19:47.696 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/lib/ceph/crash to /home/teuthworker/archive/dis-2024-09-12_15:21:08-rbd-wip-dis-testing-distro-default-smithi/7902667/remote/smithi017/crash 2024-09-12T16:19:47.697 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T16:19:47.726 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/lib/ceph/crash to /home/teuthworker/archive/dis-2024-09-12_15:21:08-rbd-wip-dis-testing-distro-default-smithi/7902667/remote/smithi047/crash 2024-09-12T16:19:47.727 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T16:19:47.753 DEBUG:teuthology.misc:Transferring archived files from smithi204:/var/lib/ceph/crash to /home/teuthworker/archive/dis-2024-09-12_15:21:08-rbd-wip-dis-testing-distro-default-smithi/7902667/remote/smithi204/crash 2024-09-12T16:19:47.753 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T16:19:47.809 INFO:tasks.ceph:Compressing logs... 2024-09-12T16:19:47.809 DEBUG:teuthology.orchestra.run.smithi017:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T16:19:47.812 DEBUG:teuthology.orchestra.run.smithi047:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T16:19:47.814 DEBUG:teuthology.orchestra.run.smithi204:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T16:19:47.836 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.38353.log 2024-09-12T16:19:47.842 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-12T16:19:47.842 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/objectstore_tool.38353.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T16:19:47.842 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.37244.log 2024-09-12T16:19:47.842 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32135.log 2024-09-12T16:19:47.842 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/objectstore_tool.37244.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.37012.log 2024-09-12T16:19:47.843 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31924.log 2024-09-12T16:19:47.843 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32135.log.gz 2024-09-12T16:19:47.843 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/objectstore_tool.37012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32004.log 2024-09-12T16:19:47.843 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.31924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31964.log 2024-09-12T16:19:47.843 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31924.log.gz 2024-09-12T16:19:47.843 INFO:teuthology.orchestra.run.smithi047.stderr: 88.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T16:19:47.843 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32086.log 2024-09-12T16:19:47.843 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32004.log.gz 2024-09-12T16:19:47.843 INFO:teuthology.orchestra.run.smithi047.stderr: 94.5% -- replaced with /var/log/ceph/objectstore_tool.37244.log.gz 2024-09-12T16:19:47.843 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.31964.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-12T16:19:47.844 INFO:teuthology.orchestra.run.smithi047.stderr: 26.0% -- replaced with /var/log/ceph/ceph-client.admin.31964.log.gz 2024-09-12T16:19:47.844 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32086.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T16:19:47.844 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32086.log.gz 2024-09-12T16:19:47.844 INFO:teuthology.orchestra.run.smithi047.stderr: 94.5% -- replaced with /var/log/ceph/objectstore_tool.37012.log.gz 2024-09-12T16:19:47.844 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T16:19:47.844 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T16:19:47.844 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32044.log 2024-09-12T16:19:47.844 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.37556.log 2024-09-12T16:19:47.844 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32044.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32044.log.gz 2024-09-12T16:19:47.847 INFO:teuthology.orchestra.run.smithi047.stderr: 85.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T16:19:47.847 INFO:teuthology.orchestra.run.smithi047.stderr: 95.0% -- replaced with /var/log/ceph/objectstore_tool.38353.log.gz 2024-09-12T16:19:47.848 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T16:19:47.854 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/objectstore_tool.37556.log: /var/log/ceph/ceph-osd.3.log: 95.0% -- replaced with /var/log/ceph/objectstore_tool.37556.log.gz 2024-09-12T16:19:47.901 INFO:teuthology.orchestra.run.smithi047.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T16:19:47.975 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28867.log 2024-09-12T16:19:47.976 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30049.log 2024-09-12T16:19:47.976 INFO:teuthology.orchestra.run.smithi204.stderr:gzip/var/log/ceph/ceph-client.admin.28867.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.29358.log 2024-09-12T16:19:47.976 INFO:teuthology.orchestra.run.smithi204.stderr: 54.6% -- replaced with /var/log/ceph/ceph-client.admin.28867.log.gz 2024-09-12T16:19:47.976 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.30049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27464.log 2024-09-12T16:19:47.976 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.30049.log.gz 2024-09-12T16:19:47.977 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29873.log 2024-09-12T16:19:47.977 INFO:teuthology.orchestra.run.smithi204.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.29358.log.gz 2024-09-12T16:19:47.977 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.27464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29313.log 2024-09-12T16:19:47.977 INFO:teuthology.orchestra.run.smithi204.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.27464.log.gz 2024-09-12T16:19:47.977 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27266.log 2024-09-12T16:19:47.977 INFO:teuthology.orchestra.run.smithi204.stderr: 18.4% -- replaced with /var/log/ceph/ceph-client.admin.29873.log.gz 2024-09-12T16:19:47.977 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27770.log 2024-09-12T16:19:47.977 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29313.log.gz 2024-09-12T16:19:47.977 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.27266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28298.log 2024-09-12T16:19:47.977 INFO:teuthology.orchestra.run.smithi204.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.27266.log.gz 2024-09-12T16:19:47.978 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.27770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27498.log 2024-09-12T16:19:47.978 INFO:teuthology.orchestra.run.smithi204.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.27770.log.gz 2024-09-12T16:19:47.978 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28228.log 2024-09-12T16:19:47.978 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28298.log.gz 2024-09-12T16:19:47.978 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.27498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29523.log 2024-09-12T16:19:47.978 INFO:teuthology.orchestra.run.smithi204.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27498.log.gz 2024-09-12T16:19:47.978 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29243.log 2024-09-12T16:19:47.978 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28228.log.gz 2024-09-12T16:19:47.978 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29033.log 2024-09-12T16:19:47.978 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29523.log.gz 2024-09-12T16:19:47.978 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28097.log 2024-09-12T16:19:47.978 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29243.log.gz 2024-09-12T16:19:47.978 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29033.log: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.29033.log.gz 2024-09-12T16:19:47.978 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27991.log 2024-09-12T16:19:47.979 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30013.log 2024-09-12T16:19:47.979 INFO:teuthology.orchestra.run.smithi204.stderr: 94.7% -- replaced with /var/log/ceph/ceph-client.admin.28097.log.gz 2024-09-12T16:19:47.979 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.27991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29419.log 2024-09-12T16:19:47.979 INFO:teuthology.orchestra.run.smithi204.stderr: 56.8% -- replaced with /var/log/ceph/ceph-client.admin.27991.log.gz 2024-09-12T16:19:47.979 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.30013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29559.log 2024-09-12T16:19:47.979 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.30013.log.gz 2024-09-12T16:19:47.979 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28167.log 2024-09-12T16:19:47.979 INFO:teuthology.orchestra.run.smithi204.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.29419.log.gz 2024-09-12T16:19:47.979 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29139.log 2024-09-12T16:19:47.979 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29559.log.gz 2024-09-12T16:19:47.979 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28472.log 2024-09-12T16:19:47.979 INFO:teuthology.orchestra.run.smithi204.stderr: 95.0% -- replaced with /var/log/ceph/ceph-client.admin.28167.log.gz 2024-09-12T16:19:47.979 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28621.log 2024-09-12T16:19:47.979 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29139.log.gz 2024-09-12T16:19:47.980 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29148.log 2024-09-12T16:19:47.980 INFO:teuthology.orchestra.run.smithi204.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.28472.log.gz 2024-09-12T16:19:47.980 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28402.log 2024-09-12T16:19:47.980 INFO:teuthology.orchestra.run.smithi204.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.28621.log.gz 2024-09-12T16:19:47.980 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27384.log 2024-09-12T16:19:47.980 INFO:teuthology.orchestra.run.smithi204.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.29148.log.gz 2024-09-12T16:19:47.980 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30153.log 2024-09-12T16:19:47.980 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28402.log.gz 2024-09-12T16:19:47.980 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.27384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29383.log 2024-09-12T16:19:47.980 INFO:teuthology.orchestra.run.smithi204.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.27384.log.gz 2024-09-12T16:19:47.980 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.30153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30022.log 2024-09-12T16:19:47.980 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.30153.log.gz 2024-09-12T16:19:47.980 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29042.log 2024-09-12T16:19:47.981 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29383.log.gz 2024-09-12T16:19:47.981 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.30022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27559.log 2024-09-12T16:19:47.981 INFO:teuthology.orchestra.run.smithi204.stderr: 53.7% -- replaced with /var/log/ceph/ceph-client.admin.30022.log.gz 2024-09-12T16:19:47.981 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.27224.log 2024-09-12T16:19:47.981 INFO:teuthology.orchestra.run.smithi204.stderr: 53.6% -- replaced with /var/log/ceph/ceph-client.admin.29042.log.gz 2024-09-12T16:19:47.981 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.27559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27568.log 2024-09-12T16:19:47.981 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.27559.log.gz 2024-09-12T16:19:47.981 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.0.27224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27418.log 2024-09-12T16:19:47.981 INFO:teuthology.orchestra.run.smithi204.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.0.27224.log.gz 2024-09-12T16:19:47.981 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.27568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28999.log 2024-09-12T16:19:47.981 INFO:teuthology.orchestra.run.smithi204.stderr: 25.3% -- replaced with /var/log/ceph/ceph-client.admin.27568.log.gz 2024-09-12T16:19:47.981 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.27418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28508.log 2024-09-12T16:19:47.981 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.27418.log.gz 2024-09-12T16:19:47.982 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30162.log 2024-09-12T16:19:47.982 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28999.log.gz 2024-09-12T16:19:47.982 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27604.log 2024-09-12T16:19:47.982 INFO:teuthology.orchestra.run.smithi204.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.28508.log.gz 2024-09-12T16:19:47.982 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.30162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27921.log 2024-09-12T16:19:47.982 INFO:teuthology.orchestra.run.smithi204.stderr: 76.8% -- replaced with /var/log/ceph/ceph-client.admin.30162.log.gz 2024-09-12T16:19:47.982 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.27604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28752.log 2024-09-12T16:19:47.982 INFO:teuthology.orchestra.run.smithi204.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.27604.log.gz 2024-09-12T16:19:47.982 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.27921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29428.log 2024-09-12T16:19:47.982 INFO:teuthology.orchestra.run.smithi204.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.27921.log.gz 2024-09-12T16:19:47.982 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28691.log 2024-09-12T16:19:47.982 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28752.log.gz 2024-09-12T16:19:47.983 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29593.log 2024-09-12T16:19:47.983 INFO:teuthology.orchestra.run.smithi204.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.29428.log.gz 2024-09-12T16:19:47.983 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28542.log 2024-09-12T16:19:47.983 INFO:teuthology.orchestra.run.smithi204.stderr: 53.4% -- replaced with /var/log/ceph/ceph-client.admin.28691.log.gz 2024-09-12T16:19:47.983 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28858.log 2024-09-12T16:19:47.983 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29593.log.gz 2024-09-12T16:19:47.983 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28718.log 2024-09-12T16:19:47.983 INFO:teuthology.orchestra.run.smithi204.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.28542.log.gz 2024-09-12T16:19:47.983 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27887.log 2024-09-12T16:19:47.983 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28858.log: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.28858.log.gz 2024-09-12T16:19:47.983 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28892.log 2024-09-12T16:19:47.983 INFO:teuthology.orchestra.run.smithi204.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.28718.log.gz 2024-09-12T16:19:47.983 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.27887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27393.log 2024-09-12T16:19:47.983 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28892.log: 96.0% -- replaced with /var/log/ceph/ceph-client.admin.27887.log.gz 2024-09-12T16:19:47.983 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27779.log 2024-09-12T16:19:47.984 INFO:teuthology.orchestra.run.smithi204.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.28892.log.gz 2024-09-12T16:19:47.984 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.27393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27957.log 2024-09-12T16:19:47.984 INFO:teuthology.orchestra.run.smithi204.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.27393.log.gz 2024-09-12T16:19:47.984 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.27779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30189.log 2024-09-12T16:19:47.984 INFO:teuthology.orchestra.run.smithi204.stderr: 52.9% -- replaced with /var/log/ceph/ceph-client.admin.27779.log.gz 2024-09-12T16:19:47.984 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.27957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29602.log 2024-09-12T16:19:47.984 INFO:teuthology.orchestra.run.smithi204.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.27957.log.gz 2024-09-12T16:19:47.984 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28761.log 2024-09-12T16:19:47.984 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.30189.log: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.30189.log.gz 2024-09-12T16:19:47.984 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30198.log 2024-09-12T16:19:47.984 INFO:teuthology.orchestra.run.smithi204.stderr: 54.3% -- replaced with /var/log/ceph/ceph-client.admin.29602.log.gz 2024-09-12T16:19:47.984 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29349.log 2024-09-12T16:19:47.984 INFO:teuthology.orchestra.run.smithi204.stderr: 54.2% -- replaced with /var/log/ceph/ceph-client.admin.28761.log.gz 2024-09-12T16:19:47.985 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.30198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28517.log 2024-09-12T16:19:47.985 INFO:teuthology.orchestra.run.smithi204.stderr: 53.2% -- replaced with /var/log/ceph/ceph-client.admin.30198.log.gz 2024-09-12T16:19:47.985 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29733.log 2024-09-12T16:19:47.985 INFO:teuthology.orchestra.run.smithi204.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.29349.log.gz 2024-09-12T16:19:47.985 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28578.log 2024-09-12T16:19:47.985 INFO:teuthology.orchestra.run.smithi204.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.28517.log.gz 2024-09-12T16:19:47.985 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28648.log 2024-09-12T16:19:47.985 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29733.log.gz 2024-09-12T16:19:47.985 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29988.log 2024-09-12T16:19:47.985 INFO:teuthology.orchestra.run.smithi204.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.28578.log.gz 2024-09-12T16:19:47.985 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28928.log 2024-09-12T16:19:47.985 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28648.log.gz 2024-09-12T16:19:47.985 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28438.log 2024-09-12T16:19:47.986 INFO:teuthology.orchestra.run.smithi204.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.29988.log.gz 2024-09-12T16:19:47.986 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28158.log 2024-09-12T16:19:47.986 INFO:teuthology.orchestra.run.smithi204.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.28928.log.gz 2024-09-12T16:19:47.986 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28962.log 2024-09-12T16:19:47.986 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28438.log.gz 2024-09-12T16:19:47.986 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28122.log 2024-09-12T16:19:47.986 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28158.log.gz 2024-09-12T16:19:47.986 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29532.log 2024-09-12T16:19:47.986 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28962.log.gz 2024-09-12T16:19:47.986 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27842.log 2024-09-12T16:19:47.986 INFO:teuthology.orchestra.run.smithi204.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.28122.log.gz 2024-09-12T16:19:47.987 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29979.log 2024-09-12T16:19:47.987 INFO:teuthology.orchestra.run.smithi204.stderr: 75.7% -- replaced with /var/log/ceph/ceph-client.admin.29532.log.gz 2024-09-12T16:19:47.987 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.27842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27736.log 2024-09-12T16:19:47.987 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.27842.log.gz 2024-09-12T16:19:47.987 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27674.log 2024-09-12T16:19:47.987 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29979.log.gz 2024-09-12T16:19:47.987 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.27736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29322.log 2024-09-12T16:19:47.987 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.27736.log.gz 2024-09-12T16:19:47.987 INFO:teuthology.orchestra.run.smithi204.stderr:gzip/var/log/ceph/ceph-client.admin.27674.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.27912.log 2024-09-12T16:19:47.987 INFO:teuthology.orchestra.run.smithi204.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.27674.log.gz 2024-09-12T16:19:47.987 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28937.log 2024-09-12T16:19:47.987 INFO:teuthology.orchestra.run.smithi204.stderr: 25.9% -- replaced with /var/log/ceph/ceph-client.admin.29322.log.gz 2024-09-12T16:19:47.987 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.27912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29638.log 2024-09-12T16:19:47.988 INFO:teuthology.orchestra.run.smithi204.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.27912.log.gz 2024-09-12T16:19:47.988 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28332.log 2024-09-12T16:19:47.988 INFO:teuthology.orchestra.run.smithi204.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.28937.log.gz 2024-09-12T16:19:47.988 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27638.log 2024-09-12T16:19:47.988 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28088.log 2024-09-12T16:19:47.988 INFO:teuthology.orchestra.run.smithi204.stderr: 95.5% -- replaced with /var/log/ceph/ceph-client.admin.29638.log.gz 2024-09-12T16:19:47.988 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28332.log.gz 2024-09-12T16:19:47.988 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.27638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29103.log 2024-09-12T16:19:47.988 INFO:teuthology.orchestra.run.smithi204.stderr: 54.3% -- replaced with /var/log/ceph/ceph-client.admin.27638.log.gz 2024-09-12T16:19:47.988 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27851.log 2024-09-12T16:19:47.988 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28088.log: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28088.log.gz 2024-09-12T16:19:47.988 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28682.log 2024-09-12T16:19:47.988 INFO:teuthology.orchestra.run.smithi204.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.29103.log.gz 2024-09-12T16:19:47.989 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.27851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29112.log 2024-09-12T16:19:47.989 INFO:teuthology.orchestra.run.smithi204.stderr: 57.5% -- replaced with /var/log/ceph/ceph-client.admin.27851.log.gz 2024-09-12T16:19:47.989 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28262.log 2024-09-12T16:19:47.989 INFO:teuthology.orchestra.run.smithi204.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.28682.log.gz 2024-09-12T16:19:47.989 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28201.log 2024-09-12T16:19:47.989 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29112.log: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.29112.log.gz 2024-09-12T16:19:47.989 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29182.log 2024-09-12T16:19:47.989 INFO:teuthology.orchestra.run.smithi204.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.28262.log.gz 2024-09-12T16:19:47.989 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27808.log 2024-09-12T16:19:47.989 INFO:teuthology.orchestra.run.smithi204.stderr: 52.9% -- replaced with /var/log/ceph/ceph-client.admin.28201.log.gz 2024-09-12T16:19:47.989 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28481.log 2024-09-12T16:19:47.989 INFO:teuthology.orchestra.run.smithi204.stderr: 76.5% -- replaced with /var/log/ceph/ceph-client.admin.29182.log.gz 2024-09-12T16:19:47.990 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.27808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27948.log 2024-09-12T16:19:47.990 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.27808.log.gz 2024-09-12T16:19:47.990 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29778.log 2024-09-12T16:19:47.990 INFO:teuthology.orchestra.run.smithi204.stderr: 54.3% -- replaced with /var/log/ceph/ceph-client.admin.28481.log.gz 2024-09-12T16:19:47.990 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.27948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28797.log 2024-09-12T16:19:47.990 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.27948.log.gz 2024-09-12T16:19:47.990 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28307.log 2024-09-12T16:19:47.990 INFO:teuthology.orchestra.run.smithi204.stderr: 75.9% -- replaced with /var/log/ceph/ceph-client.admin.29778.log.gz 2024-09-12T16:19:47.990 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29803.log 2024-09-12T16:19:47.990 INFO:teuthology.orchestra.run.smithi204.stderr: 76.2% -- replaced with /var/log/ceph/ceph-client.admin.28797.log.gz 2024-09-12T16:19:47.990 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29672.log 2024-09-12T16:19:47.990 INFO:teuthology.orchestra.run.smithi204.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.28307.log.gz 2024-09-12T16:19:47.990 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27427.log 2024-09-12T16:19:47.990 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29803.log.gz 2024-09-12T16:19:47.991 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29812.log 2024-09-12T16:19:47.991 INFO:teuthology.orchestra.run.smithi204.stderr: 52.4% -- replaced with /var/log/ceph/ceph-client.admin.29672.log.gz 2024-09-12T16:19:47.991 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.27427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27745.log 2024-09-12T16:19:47.991 INFO:teuthology.orchestra.run.smithi204.stderr: 57.0% -- replaced with /var/log/ceph/ceph-client.admin.27427.log.gz 2024-09-12T16:19:47.991 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27982.log 2024-09-12T16:19:47.991 INFO:teuthology.orchestra.run.smithi204.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.29812.log.gz 2024-09-12T16:19:47.991 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.27745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29173.log 2024-09-12T16:19:47.991 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.27982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27489.log 2024-09-12T16:19:47.991 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.27982.log.gz 2024-09-12T16:19:47.991 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28271.log 2024-09-12T16:19:47.991 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29173.log.gz 2024-09-12T16:19:47.991 INFO:teuthology.orchestra.run.smithi204.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.27745.log.gz 2024-09-12T16:19:47.991 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.27489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28411.log 2024-09-12T16:19:47.991 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.27489.log.gz 2024-09-12T16:19:47.992 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29742.log 2024-09-12T16:19:47.992 INFO:teuthology.orchestra.run.smithi204.stderr: 54.3% -- replaced with /var/log/ceph/ceph-client.admin.28271.log.gz 2024-09-12T16:19:47.992 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29218.log 2024-09-12T16:19:47.992 INFO:teuthology.orchestra.run.smithi204.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.28411.log.gz 2024-09-12T16:19:47.992 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29699.log 2024-09-12T16:19:47.992 INFO:teuthology.orchestra.run.smithi204.stderr: 53.7% -- replaced with /var/log/ceph/ceph-client.admin.29742.log.gz 2024-09-12T16:19:47.992 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28368.log 2024-09-12T16:19:47.992 INFO:teuthology.orchestra.run.smithi204.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.29218.log.gz 2024-09-12T16:19:47.992 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28377.log 2024-09-12T16:19:47.992 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29699.log.gz 2024-09-12T16:19:47.992 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30119.log 2024-09-12T16:19:47.992 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28368.log.gz 2024-09-12T16:19:47.992 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28131.log 2024-09-12T16:19:47.992 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.30119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29392.log 2024-09-12T16:19:47.992 INFO:teuthology.orchestra.run.smithi204.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.30119.log.gz 2024-09-12T16:19:47.993 INFO:teuthology.orchestra.run.smithi204.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.admin.28377.log.gz 2024-09-12T16:19:47.993 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29909.log 2024-09-12T16:19:47.993 INFO:teuthology.orchestra.run.smithi204.stderr: 53.2% -- replaced with /var/log/ceph/ceph-client.admin.28131.log.gz 2024-09-12T16:19:47.993 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30092.log 2024-09-12T16:19:47.993 INFO:teuthology.orchestra.run.smithi204.stderr: 83.6% -- replaced with /var/log/ceph/ceph-client.admin.29392.log.gz 2024-09-12T16:19:47.993 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28901.log 2024-09-12T16:19:47.993 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29909.log.gz 2024-09-12T16:19:47.993 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.30092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28027.log 2024-09-12T16:19:47.993 INFO:teuthology.orchestra.run.smithi204.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.30092.log.gz 2024-09-12T16:19:47.993 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29453.log 2024-09-12T16:19:47.993 INFO:teuthology.orchestra.run.smithi204.stderr: 54.3% -- replaced with /var/log/ceph/ceph-client.admin.28901.log.gz 2024-09-12T16:19:47.993 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29663.log 2024-09-12T16:19:47.993 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28027.log: /var/log/ceph/ceph-client.admin.29453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27595.log 2024-09-12T16:19:47.993 INFO:teuthology.orchestra.run.smithi204.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.28027.log.gz 2024-09-12T16:19:47.993 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29453.log.gz 2024-09-12T16:19:47.994 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27257.log 2024-09-12T16:19:47.994 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29663.log.gz 2024-09-12T16:19:47.994 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.27595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27629.log 2024-09-12T16:19:47.994 INFO:teuthology.orchestra.run.smithi204.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.27595.log.gz 2024-09-12T16:19:47.994 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.27257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29629.log 2024-09-12T16:19:47.994 INFO:teuthology.orchestra.run.smithi204.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.27257.log.gz 2024-09-12T16:19:47.994 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.27629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30058.log 2024-09-12T16:19:47.994 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.27629.log.gz 2024-09-12T16:19:47.994 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28551.log 2024-09-12T16:19:47.994 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29629.log.gz 2024-09-12T16:19:47.994 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.30058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28052.log 2024-09-12T16:19:47.994 INFO:teuthology.orchestra.run.smithi204.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.30058.log.gz 2024-09-12T16:19:47.994 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27525.log 2024-09-12T16:19:47.994 INFO:teuthology.orchestra.run.smithi204.stderr: 52.8% -- replaced with /var/log/ceph/ceph-client.admin.28551.log.gz 2024-09-12T16:19:47.994 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29918.log 2024-09-12T16:19:47.995 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28052.log.gz 2024-09-12T16:19:47.995 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.27525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29008.log 2024-09-12T16:19:47.995 INFO:teuthology.orchestra.run.smithi204.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.27525.log.gz 2024-09-12T16:19:47.995 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27665.log 2024-09-12T16:19:47.995 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29008.log: gzip -5 94.9% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.29918.log.gz 2024-09-12T16:19:47.995 INFO:teuthology.orchestra.run.smithi204.stderr: /var/log/ceph/ceph-client.admin.29489.log 2024-09-12T16:19:47.995 INFO:teuthology.orchestra.run.smithi204.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.29008.log.gz 2024-09-12T16:19:47.995 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.27665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28822.log 2024-09-12T16:19:47.995 INFO:teuthology.orchestra.run.smithi204.stderr: 18.4% -- replaced with /var/log/ceph/ceph-client.admin.27665.log.gz 2024-09-12T16:19:47.995 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28788.log 2024-09-12T16:19:47.995 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29489.log.gz 2024-09-12T16:19:47.996 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28587.log 2024-09-12T16:19:47.996 INFO:teuthology.orchestra.run.smithi204.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.28822.log.gz 2024-09-12T16:19:47.996 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29952.log 2024-09-12T16:19:47.996 INFO:teuthology.orchestra.run.smithi204.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.28788.log.gz 2024-09-12T16:19:47.996 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28612.log 2024-09-12T16:19:47.996 INFO:teuthology.orchestra.run.smithi204.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.28587.log.gz 2024-09-12T16:19:47.996 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27699.log 2024-09-12T16:19:47.996 INFO:teuthology.orchestra.run.smithi204.stderr: 83.6% -- replaced with /var/log/ceph/ceph-client.admin.29952.log.gz 2024-09-12T16:19:47.996 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29943.log 2024-09-12T16:19:47.996 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28612.log: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28612.log.gz 2024-09-12T16:19:47.997 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.27699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28831.log 2024-09-12T16:19:47.997 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.27699.log.gz 2024-09-12T16:19:47.997 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29209.log 2024-09-12T16:19:47.997 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29943.log.gz 2024-09-12T16:19:47.997 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27878.log 2024-09-12T16:19:47.997 INFO:teuthology.orchestra.run.smithi204.stderr: 52.1% -- replaced with /var/log/ceph/ceph-client.admin.28831.log.gz 2024-09-12T16:19:47.997 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30083.log 2024-09-12T16:19:47.997 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29209.log.gz 2024-09-12T16:19:47.997 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.27878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29279.log 2024-09-12T16:19:47.998 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.27878.log.gz 2024-09-12T16:19:47.998 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.30083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27817.log 2024-09-12T16:19:47.998 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.30083.log.gz 2024-09-12T16:19:47.998 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29279.log: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29279.log.gz 2024-09-12T16:19:47.998 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28237.log 2024-09-12T16:19:47.998 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.27817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28727.log 2024-09-12T16:19:47.998 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28657.log 2024-09-12T16:19:47.999 INFO:teuthology.orchestra.run.smithi204.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.admin.27817.log.gz 2024-09-12T16:19:47.999 INFO:teuthology.orchestra.run.smithi204.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.28237.log.gz 2024-09-12T16:19:47.999 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27455.log 2024-09-12T16:19:47.999 INFO:teuthology.orchestra.run.smithi204.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.28727.log.gz 2024-09-12T16:19:47.999 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29882.log 2024-09-12T16:19:47.999 INFO:teuthology.orchestra.run.smithi204.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.28657.log.gz 2024-09-12T16:19:47.999 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.27455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29568.log 2024-09-12T16:19:47.999 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.27455.log.gz 2024-09-12T16:19:47.999 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28447.log 2024-09-12T16:19:48.000 INFO:teuthology.orchestra.run.smithi204.stderr: 25.3% -- replaced with /var/log/ceph/ceph-client.admin.29882.log.gz 2024-09-12T16:19:48.000 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28018.log 2024-09-12T16:19:48.000 INFO:teuthology.orchestra.run.smithi204.stderr: 95.5% -- replaced with /var/log/ceph/ceph-client.admin.29568.log.gz 2024-09-12T16:19:48.000 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29769.log 2024-09-12T16:19:48.000 INFO:teuthology.orchestra.run.smithi204.stderr: 53.7% -- replaced with /var/log/ceph/ceph-client.admin.28447.log.gz 2024-09-12T16:19:48.000 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27349.log 2024-09-12T16:19:48.001 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28018.log.gz 2024-09-12T16:19:48.001 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29078.log 2024-09-12T16:19:48.001 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29769.log.gz 2024-09-12T16:19:48.001 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.27349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30128.log 2024-09-12T16:19:48.001 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.27349.log.gz 2024-09-12T16:19:48.001 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29839.log 2024-09-12T16:19:48.002 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.30128.log: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.29078.log.gz 2024-09-12T16:19:48.002 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27358.log 2024-09-12T16:19:48.002 INFO:teuthology.orchestra.run.smithi204.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.30128.log.gz 2024-09-12T16:19:48.002 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28192.log 2024-09-12T16:19:48.002 INFO:teuthology.orchestra.run.smithi204.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29839.log.gz 2024-09-12T16:19:48.002 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.27358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29708.log 2024-09-12T16:19:48.002 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28192.log: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.27358.log.gz 2024-09-12T16:19:48.002 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29462.log 2024-09-12T16:19:48.002 INFO:teuthology.orchestra.run.smithi204.stderr: 32.2% -- replaced with /var/log/ceph/ceph-client.admin.28192.log.gz 2024-09-12T16:19:48.002 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29069.log 2024-09-12T16:19:48.002 INFO:teuthology.orchestra.run.smithi204.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.29708.log.gz 2024-09-12T16:19:48.002 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29288.log 2024-09-12T16:19:48.003 INFO:teuthology.orchestra.run.smithi204.stderr: 24.7% -- replaced with /var/log/ceph/ceph-client.admin.29462.log.gz 2024-09-12T16:19:48.003 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28971.log 2024-09-12T16:19:48.003 INFO:teuthology.orchestra.run.smithi204.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.29069.log.gz 2024-09-12T16:19:48.003 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29498.log 2024-09-12T16:19:48.003 INFO:teuthology.orchestra.run.smithi204.stderr: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.29288.log.gz 2024-09-12T16:19:48.003 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28341.log 2024-09-12T16:19:48.003 INFO:teuthology.orchestra.run.smithi204.stderr: 53.9% -- replaced with /var/log/ceph/ceph-client.admin.28971.log.gz 2024-09-12T16:19:48.003 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29848.log 2024-09-12T16:19:48.003 INFO:teuthology.orchestra.run.smithi204.stderr: 54.3% -- replaced with /var/log/ceph/ceph-client.admin.29498.log.gz 2024-09-12T16:19:48.003 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29252.log 2024-09-12T16:19:48.003 INFO:teuthology.orchestra.run.smithi204.stderr: 54.5% -- replaced with /var/log/ceph/ceph-client.admin.28341.log.gz 2024-09-12T16:19:48.003 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27708.log 2024-09-12T16:19:48.003 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.29252.log: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.29848.log.gz 2024-09-12T16:19:48.003 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27534.log 2024-09-12T16:19:48.003 INFO:teuthology.orchestra.run.smithi204.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.29252.log.gz 2024-09-12T16:19:48.004 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.27708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28061.log 2024-09-12T16:19:48.004 INFO:teuthology.orchestra.run.smithi204.stderr: 55.5% -- replaced with /var/log/ceph/ceph-client.admin.27708.log.gz 2024-09-12T16:19:48.004 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.27534.log: 54.5% -- replaced with /var/log/ceph/ceph-client.admin.27534.log.gz 2024-09-12T16:19:48.004 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.28061.log: 53.0% -- replaced with /var/log/ceph/ceph-client.admin.28061.log.gz 2024-09-12T16:19:48.004 INFO:teuthology.orchestra.run.smithi204.stderr: 2024-09-12T16:19:48.004 INFO:teuthology.orchestra.run.smithi204.stderr:real 0m0.062s 2024-09-12T16:19:48.004 INFO:teuthology.orchestra.run.smithi204.stderr:user 0m0.055s 2024-09-12T16:19:48.004 INFO:teuthology.orchestra.run.smithi204.stderr:sys 0m0.098s 2024-09-12T16:19:48.031 INFO:teuthology.orchestra.run.smithi047.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T16:19:48.070 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T16:19:48.070 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51875.log 2024-09-12T16:19:48.071 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59656.log 2024-09-12T16:19:48.071 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.51875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55212.log 2024-09-12T16:19:48.071 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51875.log.gz 2024-09-12T16:19:48.071 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.59656.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59656.log.gz 2024-09-12T16:19:48.071 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37880.log 2024-09-12T16:19:48.071 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.55212.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.55212.log.gz /var/log/ceph/ceph-client.admin.42911.log 2024-09-12T16:19:48.071 INFO:teuthology.orchestra.run.smithi017.stderr: 2024-09-12T16:19:48.071 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.37880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48988.log 2024-09-12T16:19:48.071 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37880.log.gz 2024-09-12T16:19:48.071 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.42911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55612.log 2024-09-12T16:19:48.071 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42911.log.gz 2024-09-12T16:19:48.071 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.48988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53300.log 2024-09-12T16:19:48.071 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48988.log.gz 2024-09-12T16:19:48.072 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.55612.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55612.log.gz 2024-09-12T16:19:48.072 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52174.log 2024-09-12T16:19:48.072 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.53300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46311.log 2024-09-12T16:19:48.072 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53300.log.gz 2024-09-12T16:19:48.072 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.52174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45693.log 2024-09-12T16:19:48.072 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52174.log.gz 2024-09-12T16:19:48.072 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.46311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40308.log 2024-09-12T16:19:48.072 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46311.log.gz 2024-09-12T16:19:48.072 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.45693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40803.log 2024-09-12T16:19:48.072 INFO:teuthology.orchestra.run.smithi017.stderr: 28.6% -- replaced with /var/log/ceph/ceph-client.admin.45693.log.gz 2024-09-12T16:19:48.072 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38944.log 2024-09-12T16:19:48.072 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.40308.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40308.log.gz 2024-09-12T16:19:48.072 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.40803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36036.log 2024-09-12T16:19:48.072 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40803.log.gz 2024-09-12T16:19:48.073 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.38944.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.38944.log.gz -- 2024-09-12T16:19:48.073 INFO:teuthology.orchestra.run.smithi017.stderr: /var/log/ceph/ceph-client.admin.51081.log 2024-09-12T16:19:48.073 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61000.log 2024-09-12T16:19:48.073 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36036.log.gz 2024-09-12T16:19:48.073 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.51081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60333.log 2024-09-12T16:19:48.073 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51081.log.gz 2024-09-12T16:19:48.073 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.61000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48629.log 2024-09-12T16:19:48.073 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61000.log.gz 2024-09-12T16:19:48.073 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.60333.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.60333.log.gz 2024-09-12T16:19:48.073 INFO:teuthology.orchestra.run.smithi017.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46032.log 2024-09-12T16:19:48.073 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.48629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36522.log 2024-09-12T16:19:48.073 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48629.log.gz 2024-09-12T16:19:48.073 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.46032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38269.log 2024-09-12T16:19:48.073 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46032.log.gz 2024-09-12T16:19:48.074 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55552.log 2024-09-12T16:19:48.074 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36522.log.gz 2024-09-12T16:19:48.074 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.38269.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38269.log.gz 2024-09-12T16:19:48.074 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55966.log 2024-09-12T16:19:48.074 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.55552.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.56760.log 2024-09-12T16:19:48.074 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55552.log.gz 2024-09-12T16:19:48.074 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.55966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61672.log 2024-09-12T16:19:48.074 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55966.log.gz 2024-09-12T16:19:48.074 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/objectstore_tool.56760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51612.log 2024-09-12T16:19:48.074 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.61672.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61672.log.gz 2024-09-12T16:19:48.074 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59782.log 2024-09-12T16:19:48.074 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.51612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50236.log 2024-09-12T16:19:48.074 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51612.log.gz 2024-09-12T16:19:48.074 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.59782.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59782.log.gz 2024-09-12T16:19:48.074 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38881.log 2024-09-12T16:19:48.075 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.50236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41096.log 2024-09-12T16:19:48.075 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50236.log.gz 2024-09-12T16:19:48.075 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.38881.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.56396.log 2024-09-12T16:19:48.075 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38881.log.gz 2024-09-12T16:19:48.075 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41096.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41096.log.gz 2024-09-12T16:19:48.075 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60339.log 2024-09-12T16:19:48.075 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/objectstore_tool.56396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59740.log 2024-09-12T16:19:48.075 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.60339.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60339.log.gz 2024-09-12T16:19:48.075 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40257.log 2024-09-12T16:19:48.075 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50531.log 2024-09-12T16:19:48.075 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.59740.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59740.log.gz 2024-09-12T16:19:48.076 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.40257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42910.log 2024-09-12T16:19:48.076 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40257.log.gz 2024-09-12T16:19:48.076 INFO:teuthology.orchestra.run.smithi017.stderr: 94.4% -- replaced with /var/log/ceph/objectstore_tool.56396.log.gz 2024-09-12T16:19:48.076 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.50531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50531.log.gz 2024-09-12T16:19:48.076 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T16:19:48.076 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54949.log 2024-09-12T16:19:48.076 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.42910.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42910.log.gz 2024-09-12T16:19:48.076 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52234.log 2024-09-12T16:19:48.076 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54949.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54949.log.gz 2024-09-12T16:19:48.076 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59698.log 2024-09-12T16:19:48.076 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60034.log 2024-09-12T16:19:48.076 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.52234.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52234.log.gz 2024-09-12T16:19:48.076 INFO:teuthology.orchestra.run.smithi017.stderr: 95.0% -- replaced with /var/log/ceph/objectstore_tool.56760.log.gz 2024-09-12T16:19:48.076 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.59698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59698.log.gz 2024-09-12T16:19:48.076 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36396.log 2024-09-12T16:19:48.077 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31898.log 2024-09-12T16:19:48.077 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.60034.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60034.log.gz 2024-09-12T16:19:48.077 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.36396.log: /var/log/ceph/ceph-client.admin.35775.log 2024-09-12T16:19:48.077 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36396.log.gz 2024-09-12T16:19:48.077 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.31898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37328.log 2024-09-12T16:19:48.077 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31898.log.gz 2024-09-12T16:19:48.077 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35775.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35775.log.gz 2024-09-12T16:19:48.077 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50806.log 2024-09-12T16:19:48.077 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.37328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46567.log 2024-09-12T16:19:48.077 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37328.log.gz 2024-09-12T16:19:48.077 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.50806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44896.log 2024-09-12T16:19:48.077 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50806.log.gz 2024-09-12T16:19:48.077 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.46567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45640.log 2024-09-12T16:19:48.077 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46567.log.gz 2024-09-12T16:19:48.078 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.44896.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44896.log.gz 2024-09-12T16:19:48.078 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61020.log 2024-09-12T16:19:48.078 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52981.log 2024-09-12T16:19:48.078 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.45640.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45640.log.gz 2024-09-12T16:19:48.078 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.61020.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61020.log.gz 2024-09-12T16:19:48.078 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49478.log 2024-09-12T16:19:48.078 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40742.log 2024-09-12T16:19:48.078 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.52981.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52981.log.gz 2024-09-12T16:19:48.078 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61840.log 2024-09-12T16:19:48.078 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49478.log.gz 2024-09-12T16:19:48.078 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.40742.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40742.log.gz 2024-09-12T16:19:48.078 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47984.log 2024-09-12T16:19:48.078 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.61840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52379.log 2024-09-12T16:19:48.079 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61840.log.gz 2024-09-12T16:19:48.079 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.47984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49633.log 2024-09-12T16:19:48.079 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47984.log.gz 2024-09-12T16:19:48.079 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.52379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57237.log 2024-09-12T16:19:48.079 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52379.log.gz 2024-09-12T16:19:48.079 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47494.log 2024-09-12T16:19:48.079 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49633.log.gz 2024-09-12T16:19:48.079 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.57237.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57237.log.gz -5 2024-09-12T16:19:48.079 INFO:teuthology.orchestra.run.smithi017.stderr: --verbose -- /var/log/ceph/ceph-client.admin.42050.log 2024-09-12T16:19:48.079 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.47494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37174.log 2024-09-12T16:19:48.079 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47494.log.gz 2024-09-12T16:19:48.079 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.42050.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.42050.log.gz -- 2024-09-12T16:19:48.079 INFO:teuthology.orchestra.run.smithi017.stderr: /var/log/ceph/ceph-client.admin.61252.log 2024-09-12T16:19:48.080 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.37174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61756.log 2024-09-12T16:19:48.080 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37174.log.gz 2024-09-12T16:19:48.080 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.61252.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.61252.log.gz /var/log/ceph/ceph-client.admin.49041.log 2024-09-12T16:19:48.080 INFO:teuthology.orchestra.run.smithi017.stderr: 2024-09-12T16:19:48.080 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.61756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57694.log 2024-09-12T16:19:48.080 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61756.log.gz 2024-09-12T16:19:48.080 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60656.log 2024-09-12T16:19:48.080 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49041.log.gz 2024-09-12T16:19:48.080 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.57694.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57694.log.gz 2024-09-12T16:19:48.080 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50632.log 2024-09-12T16:19:48.080 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.60656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61336.log 2024-09-12T16:19:48.080 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60656.log.gz 2024-09-12T16:19:48.080 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.50632.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50632.log.gz 2024-09-12T16:19:48.081 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54662.log 2024-09-12T16:19:48.081 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.61336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35463.log 2024-09-12T16:19:48.081 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61336.log.gz 2024-09-12T16:19:48.081 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54662.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54662.log.gz 2024-09-12T16:19:48.081 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35382.log 2024-09-12T16:19:48.081 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47106.log 2024-09-12T16:19:48.081 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35463.log.gz 2024-09-12T16:19:48.081 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35382.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35382.log.gz 2024-09-12T16:19:48.081 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35994.log 2024-09-12T16:19:48.081 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.47106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47159.log 2024-09-12T16:19:48.081 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47106.log.gz 2024-09-12T16:19:48.081 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60531.log 2024-09-12T16:19:48.081 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35994.log.gz 2024-09-12T16:19:48.081 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.47159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61294.log 2024-09-12T16:19:48.082 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47159.log.gz 2024-09-12T16:19:48.082 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.60531.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.57732.log 2024-09-12T16:19:48.082 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60531.log.gz 2024-09-12T16:19:48.082 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.61294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62132.log 2024-09-12T16:19:48.082 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61294.log.gz 2024-09-12T16:19:48.082 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/objectstore_tool.57732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49336.log 2024-09-12T16:19:48.082 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.62132.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62132.log.gz 2024-09-12T16:19:48.082 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39156.log 2024-09-12T16:19:48.082 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52336.log 2024-09-12T16:19:48.082 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49336.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49336.log.gz 2024-09-12T16:19:48.082 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39156.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39156.log.gz 2024-09-12T16:19:48.082 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55307.log 2024-09-12T16:19:48.082 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53834.log 2024-09-12T16:19:48.082 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.52336.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52336.log.gz 2024-09-12T16:19:48.083 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.55307.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55307.log.gz 2024-09-12T16:19:48.083 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61080.log 2024-09-12T16:19:48.083 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51176.log 2024-09-12T16:19:48.083 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.53834.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53834.log.gz 2024-09-12T16:19:48.083 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.61080.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61080.log.gz 2024-09-12T16:19:48.083 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61504.log 2024-09-12T16:19:48.083 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50183.log 2024-09-12T16:19:48.083 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.51176.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51176.log.gz 2024-09-12T16:19:48.083 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.61504.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61504.log.gz 2024-09-12T16:19:48.083 INFO:teuthology.orchestra.run.smithi017.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.36312.log 2024-09-12T16:19:48.083 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.50183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46713.log 2024-09-12T16:19:48.083 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50183.log.gz 2024-09-12T16:19:48.083 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36312.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.36312.log.gz -- 2024-09-12T16:19:48.083 INFO:teuthology.orchestra.run.smithi017.stderr: /var/log/ceph/ceph.audit.log 2024-09-12T16:19:48.084 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.46713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53616.log 2024-09-12T16:19:48.084 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46713.log.gz 2024-09-12T16:19:48.084 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42808.log 2024-09-12T16:19:48.084 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.53616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36438.log 2024-09-12T16:19:48.084 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53616.log.gz 2024-09-12T16:19:48.084 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.42808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37451.log 2024-09-12T16:19:48.084 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42808.log.gz 2024-09-12T16:19:48.084 INFO:teuthology.orchestra.run.smithi017.stderr: 95.0% -- replaced with /var/log/ceph/objectstore_tool.57732.log.gz 2024-09-12T16:19:48.084 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45090.log 2024-09-12T16:19:48.084 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36438.log.gz 2024-09-12T16:19:48.084 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.37451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49223.log 2024-09-12T16:19:48.084 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37451.log.gz 2024-09-12T16:19:48.085 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.45090.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.45090.log.gz --verbose 2024-09-12T16:19:48.085 INFO:teuthology.orchestra.run.smithi017.stderr: -- /var/log/ceph/ceph-client.admin.42222.log 2024-09-12T16:19:48.085 INFO:teuthology.orchestra.run.smithi017.stderr: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T16:19:48.085 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37050.log 2024-09-12T16:19:48.085 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49223.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49223.log.gz 2024-09-12T16:19:48.085 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.42222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38687.log 2024-09-12T16:19:48.085 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42222.log.gz 2024-09-12T16:19:48.085 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.37050.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37050.log.gz 2024-09-12T16:19:48.085 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.56124.log 2024-09-12T16:19:48.085 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.38687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37725.log 2024-09-12T16:19:48.085 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38687.log.gz 2024-09-12T16:19:48.085 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/objectstore_tool.56124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60572.log 2024-09-12T16:19:48.085 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.37725.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37725.log.gz 2024-09-12T16:19:48.086 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36035.log 2024-09-12T16:19:48.086 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51491.log 2024-09-12T16:19:48.086 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.60572.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60572.log.gz 2024-09-12T16:19:48.086 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36035.log: 94.5% -- replaced with /var/log/ceph/objectstore_tool.56124.log.gz 2024-09-12T16:19:48.086 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37799.log 2024-09-12T16:19:48.086 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36035.log.gz 2024-09-12T16:19:48.086 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36480.log 2024-09-12T16:19:48.086 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.51491.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51491.log.gz 2024-09-12T16:19:48.086 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.37799.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37799.log.gz 2024-09-12T16:19:48.086 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51806.log 2024-09-12T16:19:48.086 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59609.log 2024-09-12T16:19:48.087 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36480.log.gz 2024-09-12T16:19:48.087 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.51806.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51806.log.gz 2024-09-12T16:19:48.087 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36354.log 2024-09-12T16:19:48.087 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.59609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36747.log 2024-09-12T16:19:48.087 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59609.log.gz 2024-09-12T16:19:48.087 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36354.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36354.log.gz 2024-09-12T16:19:48.087 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60342.log 2024-09-12T16:19:48.087 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41604.log 2024-09-12T16:19:48.087 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36747.log.gz 2024-09-12T16:19:48.087 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.60342.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60342.log.gz 2024-09-12T16:19:48.087 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45110.log 2024-09-12T16:19:48.087 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49316.log 2024-09-12T16:19:48.087 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41604.log.gz 2024-09-12T16:19:48.088 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.45110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38096.log 2024-09-12T16:19:48.088 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45110.log.gz 2024-09-12T16:19:48.088 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49316.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49316.log.gz 2024-09-12T16:19:48.088 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58641.log 2024-09-12T16:19:48.088 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.38096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60202.log 2024-09-12T16:19:48.088 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38096.log.gz 2024-09-12T16:19:48.088 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.58641.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58641.log.gz 2024-09-12T16:19:48.088 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61588.log 2024-09-12T16:19:48.088 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.60202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60868.log 2024-09-12T16:19:48.088 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60202.log.gz 2024-09-12T16:19:48.088 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.61588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46494.log 2024-09-12T16:19:48.088 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61588.log.gz 2024-09-12T16:19:48.089 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.60868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39691.log 2024-09-12T16:19:48.089 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60868.log.gz 2024-09-12T16:19:48.089 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.46494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54621.log 2024-09-12T16:19:48.089 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46494.log.gz 2024-09-12T16:19:48.089 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44446.log 2024-09-12T16:19:48.089 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39691.log.gz 2024-09-12T16:19:48.089 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60812.log 2024-09-12T16:19:48.089 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54621.log.gz 2024-09-12T16:19:48.089 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.44446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60865.log 2024-09-12T16:19:48.089 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44446.log.gz 2024-09-12T16:19:48.089 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.60812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37134.log 2024-09-12T16:19:48.089 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60812.log.gz 2024-09-12T16:19:48.089 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.60865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38606.log 2024-09-12T16:19:48.090 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60865.log.gz 2024-09-12T16:19:48.090 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.37134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62008.log 2024-09-12T16:19:48.090 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37134.log.gz 2024-09-12T16:19:48.090 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.38606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35779.log 2024-09-12T16:19:48.090 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38606.log.gz 2024-09-12T16:19:48.090 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.62008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61378.log 2024-09-12T16:19:48.090 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62008.log.gz 2024-09-12T16:19:48.090 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36248.log 2024-09-12T16:19:48.090 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35779.log.gz 2024-09-12T16:19:48.090 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.61378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54304.log 2024-09-12T16:19:48.090 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61378.log.gz 2024-09-12T16:19:48.090 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60578.log 2024-09-12T16:19:48.090 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36248.log.gz 2024-09-12T16:19:48.090 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60344.log 2024-09-12T16:19:48.091 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54304.log.gz 2024-09-12T16:19:48.091 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.60578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60768.log 2024-09-12T16:19:48.091 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60578.log.gz 2024-09-12T16:19:48.091 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.60344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60908.log 2024-09-12T16:19:48.091 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60344.log.gz 2024-09-12T16:19:48.091 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.60768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55769.log 2024-09-12T16:19:48.091 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60768.log.gz 2024-09-12T16:19:48.091 INFO:teuthology.orchestra.run.smithi017.stderr:gzip/var/log/ceph/ceph-client.admin.60908.log: -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T16:19:48.091 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60908.log.gz 2024-09-12T16:19:48.091 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.55769.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55769.log.gz 2024-09-12T16:19:48.091 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52696.log 2024-09-12T16:19:48.091 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44194.log 2024-09-12T16:19:48.091 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.52696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61714.log 2024-09-12T16:19:48.091 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52696.log.gz 2024-09-12T16:19:48.091 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.44194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44722.log 2024-09-12T16:19:48.092 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44194.log.gz 2024-09-12T16:19:48.092 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50418.log 2024-09-12T16:19:48.092 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.61714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61714.log.gz 2024-09-12T16:19:48.092 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.44722.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44722.log.gz 2024-09-12T16:19:48.092 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35640.log 2024-09-12T16:19:48.092 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36206.log 2024-09-12T16:19:48.092 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.50418.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50418.log.gz 2024-09-12T16:19:48.092 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40621.log 2024-09-12T16:19:48.092 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35640.log.gz 2024-09-12T16:19:48.092 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36206.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.36206.log.gz 2024-09-12T16:19:48.092 INFO:teuthology.orchestra.run.smithi017.stderr: /var/log/ceph/ceph-client.admin.61630.log 2024-09-12T16:19:48.092 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55728.log 2024-09-12T16:19:48.092 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.40621.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40621.log.gz 2024-09-12T16:19:48.093 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.61630.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61630.log.gz 2024-09-12T16:19:48.093 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41269.log 2024-09-12T16:19:48.093 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56526.log 2024-09-12T16:19:48.093 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.55728.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55728.log.gz 2024-09-12T16:19:48.093 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36626.log 2024-09-12T16:19:48.093 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41269.log.gz 2024-09-12T16:19:48.093 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.56526.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56526.log.gz 2024-09-12T16:19:48.093 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41543.log 2024-09-12T16:19:48.093 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52021.log 2024-09-12T16:19:48.093 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36626.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36626.log.gz 2024-09-12T16:19:48.093 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61420.log 2024-09-12T16:19:48.093 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41543.log.gz 2024-09-12T16:19:48.093 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.52021.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52021.log.gz 2024-09-12T16:19:48.093 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39247.log 2024-09-12T16:19:48.093 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53752.log 2024-09-12T16:19:48.094 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.61420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61420.log.gz 2024-09-12T16:19:48.094 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39247.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39247.log.gz 2024-09-12T16:19:48.094 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47434.log 2024-09-12T16:19:48.094 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43437.log 2024-09-12T16:19:48.094 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.53752.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53752.log.gz 2024-09-12T16:19:48.094 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.47434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46900.log 2024-09-12T16:19:48.094 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47434.log.gz 2024-09-12T16:19:48.094 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48736.log 2024-09-12T16:19:48.094 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43437.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43437.log.gz 2024-09-12T16:19:48.094 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.46900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53670.log 2024-09-12T16:19:48.094 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46900.log.gz 2024-09-12T16:19:48.094 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42110.log 2024-09-12T16:19:48.094 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.48736.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48736.log.gz 2024-09-12T16:19:48.095 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.53670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61966.log 2024-09-12T16:19:48.095 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53670.log.gz 2024-09-12T16:19:48.095 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.42110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39732.log 2024-09-12T16:19:48.095 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42110.log.gz 2024-09-12T16:19:48.095 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54559.log 2024-09-12T16:19:48.095 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.61966.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61966.log.gz 2024-09-12T16:19:48.095 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35556.log 2024-09-12T16:19:48.095 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39732.log.gz 2024-09-12T16:19:48.095 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54559.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54559.log.gz 2024-09-12T16:19:48.095 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45418.log 2024-09-12T16:19:48.095 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35514.log 2024-09-12T16:19:48.095 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35556.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35556.log.gz 2024-09-12T16:19:48.095 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.45418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41839.log 2024-09-12T16:19:48.095 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45418.log.gz 2024-09-12T16:19:48.095 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35514.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35514.log.gz 2024-09-12T16:19:48.096 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T16:19:48.096 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48312.log 2024-09-12T16:19:48.096 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41839.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41839.log.gz 2024-09-12T16:19:48.096 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48670.log 2024-09-12T16:19:48.096 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.48312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60536.log 2024-09-12T16:19:48.096 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48312.log.gz 2024-09-12T16:19:48.096 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.48670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35598.log 2024-09-12T16:19:48.096 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48670.log.gz 2024-09-12T16:19:48.096 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.60536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61882.log 2024-09-12T16:19:48.096 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60536.log.gz 2024-09-12T16:19:48.096 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51123.log 2024-09-12T16:19:48.096 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35598.log.gz 2024-09-12T16:19:48.096 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.61882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37950.log 2024-09-12T16:19:48.096 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61882.log.gz 2024-09-12T16:19:48.096 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.51123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35778.log 2024-09-12T16:19:48.097 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51123.log.gz 2024-09-12T16:19:48.097 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.37950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46631.log 2024-09-12T16:19:48.097 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37950.log.gz 2024-09-12T16:19:48.097 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35954.log 2024-09-12T16:19:48.097 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35778.log.gz 2024-09-12T16:19:48.097 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.46631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44815.log 2024-09-12T16:19:48.097 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46631.log.gz 2024-09-12T16:19:48.097 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58683.log 2024-09-12T16:19:48.097 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35954.log.gz 2024-09-12T16:19:48.097 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.44815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61798.log 2024-09-12T16:19:48.097 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44815.log.gz 2024-09-12T16:19:48.097 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.58683.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58683.log.gz 2024-09-12T16:19:48.097 INFO:teuthology.orchestra.run.smithi017.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43841.log 2024-09-12T16:19:48.098 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.61798.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.61798.log.gz --verbose 2024-09-12T16:19:48.098 INFO:teuthology.orchestra.run.smithi017.stderr: -- /var/log/ceph/ceph-client.admin.54896.log 2024-09-12T16:19:48.098 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43164.log 2024-09-12T16:19:48.098 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43841.log.gz 2024-09-12T16:19:48.098 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55667.log 2024-09-12T16:19:48.098 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54896.log.gz 2024-09-12T16:19:48.098 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49961.log 2024-09-12T16:19:48.098 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43164.log.gz 2024-09-12T16:19:48.098 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.55667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43710.log 2024-09-12T16:19:48.098 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55667.log.gz 2024-09-12T16:19:48.098 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49961.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49961.log.gz 2024-09-12T16:19:48.098 INFO:teuthology.orchestra.run.smithi017.stderr: --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T16:19:48.098 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43710.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43710.log.gz 2024-09-12T16:19:48.099 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60160.log 2024-09-12T16:19:48.099 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37644.log 2024-09-12T16:19:48.099 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.60160.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60160.log.gz 2024-09-12T16:19:48.099 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59866.log 2024-09-12T16:19:48.099 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.37644.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37644.log.gz 2024-09-12T16:19:48.099 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39983.log 2024-09-12T16:19:48.099 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.59866.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59866.log.gz 2024-09-12T16:19:48.099 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59908.log 2024-09-12T16:19:48.099 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39983.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39983.log.gz 2024-09-12T16:19:48.099 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37008.log 2024-09-12T16:19:48.100 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.59908.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59908.log.gz 2024-09-12T16:19:48.100 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35780.log 2024-09-12T16:19:48.100 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.37008.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37008.log.gz 2024-09-12T16:19:48.100 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32127.log 2024-09-12T16:19:48.100 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35780.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35780.log.gz 2024-09-12T16:19:48.100 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61462.log 2024-09-12T16:19:48.100 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32127.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32127.log.gz 2024-09-12T16:19:48.100 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41035.log 2024-09-12T16:19:48.100 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.61462.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61462.log.gz 2024-09-12T16:19:48.100 INFO:teuthology.orchestra.run.smithi017.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.61159.log 2024-09-12T16:19:48.100 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41035.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41035.log.gz 2024-09-12T16:19:48.100 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36746.log 2024-09-12T16:19:48.100 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.61159.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61159.log.gz 2024-09-12T16:19:48.100 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T16:19:48.101 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36746.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36746.log.gz 2024-09-12T16:19:48.101 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39984.log 2024-09-12T16:19:48.101 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42345.log 2024-09-12T16:19:48.101 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56068.log 2024-09-12T16:19:48.101 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39984.log.gz 2024-09-12T16:19:48.101 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.42345.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42345.log.gz 2024-09-12T16:19:48.101 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48587.log 2024-09-12T16:19:48.101 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59950.log 2024-09-12T16:19:48.101 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.56068.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56068.log.gz 2024-09-12T16:19:48.101 INFO:teuthology.orchestra.run.smithi017.stderr: 92.0%/var/log/ceph/ceph-client.admin.48587.log: -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T16:19:48.101 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48587.log.gz 2024-09-12T16:19:48.102 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47281.log 2024-09-12T16:19:48.102 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45930.log 2024-09-12T16:19:48.102 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.59950.log: /var/log/ceph/ceph-client.admin.47281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46775.log 2024-09-12T16:19:48.102 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59950.log.gz 2024-09-12T16:19:48.102 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47281.log.gz 2024-09-12T16:19:48.102 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.45930.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38371.log 2024-09-12T16:19:48.102 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45930.log.gz 2024-09-12T16:19:48.102 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.46775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48413.log 2024-09-12T16:19:48.102 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46775.log.gz 2024-09-12T16:19:48.102 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35438.log 2024-09-12T16:19:48.102 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.38371.log: /var/log/ceph/ceph-client.admin.48413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56460.log 2024-09-12T16:19:48.103 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48413.log.gz 2024-09-12T16:19:48.103 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38371.log.gz 2024-09-12T16:19:48.103 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35438.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35438.log.gz 2024-09-12T16:19:48.103 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35301.log 2024-09-12T16:19:48.103 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.56460.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56460.log.gz 2024-09-12T16:19:48.103 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37092.log 2024-09-12T16:19:48.104 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35301.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35301.log.gz 2024-09-12T16:19:48.104 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59824.log 2024-09-12T16:19:48.104 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36749.log 2024-09-12T16:19:48.104 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.37092.log: /var/log/ceph/ceph-client.admin.59824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43488.log 2024-09-12T16:19:48.104 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59824.log.gz 2024-09-12T16:19:48.104 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37092.log.gz 2024-09-12T16:19:48.104 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36749.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36749.log.gz 2024-09-12T16:19:48.104 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53342.log 2024-09-12T16:19:48.105 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.43488.log: /var/log/ceph/ceph-client.admin.52421.log 2024-09-12T16:19:48.105 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43488.log.gz 2024-09-12T16:19:48.105 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60532.log 2024-09-12T16:19:48.105 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.53342.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53342.log.gz 2024-09-12T16:19:48.105 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48037.log 2024-09-12T16:19:48.105 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.52421.log: /var/log/ceph/ceph-client.admin.60532.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52421.log.gz 2024-09-12T16:19:48.105 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60532.log.gz 2024-09-12T16:19:48.105 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61120.log 2024-09-12T16:19:48.105 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.48037.log: gzip -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48037.log.gz 2024-09-12T16:19:48.105 INFO:teuthology.orchestra.run.smithi017.stderr: /var/log/ceph/ceph-client.admin.62050.log 2024-09-12T16:19:48.106 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.61120.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61120.log.gz 2024-09-12T16:19:48.106 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47762.log 2024-09-12T16:19:48.106 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.62050.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62050.log.gz 2024-09-12T16:19:48.106 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62092.log 2024-09-12T16:19:48.106 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.47762.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47762.log.gz 2024-09-12T16:19:48.106 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50855.log 2024-09-12T16:19:48.106 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.62092.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62092.log.gz 2024-09-12T16:19:48.107 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45365.log 2024-09-12T16:19:48.107 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.50855.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50855.log.gz 2024-09-12T16:19:48.107 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55258.log 2024-09-12T16:19:48.107 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.45365.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45365.log.gz 2024-09-12T16:19:48.107 INFO:teuthology.orchestra.run.smithi017.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48179.log 2024-09-12T16:19:48.107 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.55258.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55258.log.gz 2024-09-12T16:19:48.107 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60334.log 2024-09-12T16:19:48.107 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.48179.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48179.log.gz 2024-09-12T16:19:48.107 INFO:teuthology.orchestra.run.smithi017.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46094.log 2024-09-12T16:19:48.107 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.60334.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60334.log.gz 2024-09-12T16:19:48.108 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45773.log 2024-09-12T16:19:48.108 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.46094.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46094.log.gz 2024-09-12T16:19:48.108 INFO:teuthology.orchestra.run.smithi017.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43982.log 2024-09-12T16:19:48.108 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.45773.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45773.log.gz 2024-09-12T16:19:48.108 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36186.log 2024-09-12T16:19:48.108 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43982.log: gzip 0.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.61546.log 2024-09-12T16:19:48.108 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43982.log.gz 2024-09-12T16:19:48.108 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60748.log 2024-09-12T16:19:48.108 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36186.log.gz 2024-09-12T16:19:48.108 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.61546.log: -- /var/log/ceph/ceph-client.admin.42618.log 2024-09-12T16:19:48.108 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61546.log.gz 2024-09-12T16:19:48.108 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.60748.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60748.log.gz 2024-09-12T16:19:48.108 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27515.log 2024-09-12T16:19:48.109 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.42618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53025.log 2024-09-12T16:19:48.109 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42618.log.gz 2024-09-12T16:19:48.109 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph.tmp-client.admin.27515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46982.log 2024-09-12T16:19:48.109 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27515.log.gz 2024-09-12T16:19:48.109 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46175.log 2024-09-12T16:19:48.109 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.53025.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53025.log.gz 2024-09-12T16:19:48.109 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41380.log 2024-09-12T16:19:48.109 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.46982.log: /var/log/ceph/ceph-client.admin.46175.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51398.log 2024-09-12T16:19:48.109 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46982.log.gz 2024-09-12T16:19:48.109 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46175.log.gz 2024-09-12T16:19:48.109 INFO:teuthology.orchestra.run.smithi017.stderr:gzip/var/log/ceph/ceph-client.admin.41380.log: -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41380.log.gz 2024-09-12T16:19:48.109 INFO:teuthology.orchestra.run.smithi017.stderr: /var/log/ceph/ceph-client.admin.55348.log 2024-09-12T16:19:48.109 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.51398.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51398.log.gz 2024-09-12T16:19:48.109 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35781.log 2024-09-12T16:19:48.110 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.55348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46837.log 2024-09-12T16:19:48.110 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55348.log.gz 2024-09-12T16:19:48.110 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35781.log: gzip -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35781.log.gz 2024-09-12T16:19:48.110 INFO:teuthology.orchestra.run.smithi017.stderr: /var/log/ceph/ceph-client.admin.55111.log 2024-09-12T16:19:48.110 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.46837.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46837.log.gz 2024-09-12T16:19:48.110 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36564.log 2024-09-12T16:19:48.110 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.55111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55111.log.gz 2024-09-12T16:19:48.110 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60076.log 2024-09-12T16:19:48.110 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36564.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36564.log.gz 2024-09-12T16:19:48.110 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47709.log 2024-09-12T16:19:48.110 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.60076.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60076.log.gz 2024-09-12T16:19:48.110 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35993.log 2024-09-12T16:19:48.110 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.47709.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47709.log.gz 2024-09-12T16:19:48.110 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46154.log 2024-09-12T16:19:48.111 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45854.log 2024-09-12T16:19:48.111 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35993.log.gz 2024-09-12T16:19:48.111 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.46154.log: -- /var/log/ceph/ceph-client.admin.32201.log 2024-09-12T16:19:48.111 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46154.log.gz 2024-09-12T16:19:48.111 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.45854.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45854.log.gz 2024-09-12T16:19:48.111 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52890.log 2024-09-12T16:19:48.111 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32201.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32201.log.gz 2024-09-12T16:19:48.111 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53575.log 2024-09-12T16:19:48.111 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.52890.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52890.log.gz 2024-09-12T16:19:48.111 INFO:teuthology.orchestra.run.smithi017.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44540.log 2024-09-12T16:19:48.111 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.53575.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53575.log.gz 2024-09-12T16:19:48.111 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35956.log 2024-09-12T16:19:48.111 INFO:teuthology.orchestra.run.smithi017.stderr:gzip/var/log/ceph/ceph-client.admin.44540.log: -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44540.log.gz 2024-09-12T16:19:48.111 INFO:teuthology.orchestra.run.smithi017.stderr: -- /var/log/ceph/ceph-client.admin.41757.log 2024-09-12T16:19:48.112 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35956.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35956.log.gz 2024-09-12T16:19:48.112 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43205.log 2024-09-12T16:19:48.112 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41757.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41757.log.gz 2024-09-12T16:19:48.112 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54426.log 2024-09-12T16:19:48.112 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43205.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43205.log.gz 2024-09-12T16:19:48.112 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60118.log 2024-09-12T16:19:48.112 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54426.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54426.log.gz 2024-09-12T16:19:48.112 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49653.log 2024-09-12T16:19:48.112 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.60118.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60118.log.gz 2024-09-12T16:19:48.112 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39469.log 2024-09-12T16:19:48.112 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46453.log 2024-09-12T16:19:48.112 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49653.log.gz 2024-09-12T16:19:48.112 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48692.log 2024-09-12T16:19:48.112 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39469.log.gz 2024-09-12T16:19:48.112 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53107.log 2024-09-12T16:19:48.112 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.46453.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46453.log.gz 2024-09-12T16:19:48.113 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41442.log 2024-09-12T16:19:48.113 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.48692.log: /var/log/ceph/ceph-client.admin.53107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47044.log 2024-09-12T16:19:48.113 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53107.log.gz 2024-09-12T16:19:48.113 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48692.log.gz 2024-09-12T16:19:48.113 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41442.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41442.log.gz 2024-09-12T16:19:48.113 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.47044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42436.log 2024-09-12T16:19:48.113 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47044.log.gz 2024-09-12T16:19:48.113 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44239.log 2024-09-12T16:19:48.113 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.42436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61117.log 2024-09-12T16:19:48.113 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42436.log.gz 2024-09-12T16:19:48.113 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.44239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55870.log 2024-09-12T16:19:48.113 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44239.log.gz 2024-09-12T16:19:48.114 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46568.log 2024-09-12T16:19:48.114 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.61117.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61117.log.gz 2024-09-12T16:19:48.114 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52614.log 2024-09-12T16:19:48.114 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.55870.log: /var/log/ceph/ceph-client.admin.46568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40530.log 2024-09-12T16:19:48.114 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55870.log.gz 2024-09-12T16:19:48.114 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46568.log.gz 2024-09-12T16:19:48.114 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.52614.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52614.log.gz 2024-09-12T16:19:48.114 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35782.log 2024-09-12T16:19:48.114 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.40530.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40530.log.gz 2024-09-12T16:19:48.114 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53975.log 2024-09-12T16:19:48.114 INFO:teuthology.orchestra.run.smithi017.stderr:gzip/var/log/ceph/ceph-client.admin.35782.log: -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35782.log.gz 2024-09-12T16:19:48.114 INFO:teuthology.orchestra.run.smithi017.stderr: /var/log/ceph/ceph-client.admin.38424.log 2024-09-12T16:19:48.114 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.53975.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53975.log.gz 2024-09-12T16:19:48.114 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59992.log 2024-09-12T16:19:48.115 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.38424.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38424.log.gz 2024-09-12T16:19:48.115 INFO:teuthology.orchestra.run.smithi017.stderr: --verbose -- /var/log/ceph/ceph-client.admin.61924.log 2024-09-12T16:19:48.115 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.59992.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59992.log.gz 2024-09-12T16:19:48.115 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49908.log 2024-09-12T16:19:48.115 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.61924.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61924.log.gz 2024-09-12T16:19:48.115 INFO:teuthology.orchestra.run.smithi017.stderr: --verbose -- /var/log/ceph/ceph-client.admin.60343.log 2024-09-12T16:19:48.115 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49908.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49908.log.gz 2024-09-12T16:19:48.115 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54191.log 2024-09-12T16:19:48.115 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.60343.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60343.log.gz 2024-09-12T16:19:48.116 INFO:teuthology.orchestra.run.smithi017.stderr: --verbose -- /var/log/ceph/ceph-client.admin.54029.log 2024-09-12T16:19:48.116 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54191.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54191.log.gz 2024-09-12T16:19:48.116 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54029.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54029.log.gz 2024-09-12T16:19:48.116 INFO:teuthology.orchestra.run.smithi017.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T16:19:48.187 INFO:teuthology.orchestra.run.smithi017.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T16:19:48.841 INFO:teuthology.orchestra.run.smithi047.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-12T16:19:55.196 INFO:teuthology.orchestra.run.smithi017.stderr: 95.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T16:19:55.380 INFO:teuthology.orchestra.run.smithi017.stderr: 95.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T16:19:56.500 INFO:teuthology.orchestra.run.smithi017.stderr: 95.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T16:19:56.502 INFO:teuthology.orchestra.run.smithi017.stderr: 2024-09-12T16:19:56.502 INFO:teuthology.orchestra.run.smithi017.stderr:real 0m8.675s 2024-09-12T16:19:56.502 INFO:teuthology.orchestra.run.smithi017.stderr:user 0m23.115s 2024-09-12T16:19:56.502 INFO:teuthology.orchestra.run.smithi017.stderr:sys 0m1.044s 2024-09-12T16:19:57.827 INFO:teuthology.orchestra.run.smithi047.stderr: 96.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-12T16:20:01.061 INFO:teuthology.orchestra.run.smithi047.stderr: 95.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T16:20:01.063 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-09-12T16:20:01.064 INFO:teuthology.orchestra.run.smithi047.stderr:real 0m13.236s 2024-09-12T16:20:01.064 INFO:teuthology.orchestra.run.smithi047.stderr:user 0m23.593s 2024-09-12T16:20:01.064 INFO:teuthology.orchestra.run.smithi047.stderr:sys 0m0.861s 2024-09-12T16:20:01.064 INFO:tasks.ceph:Archiving logs... 2024-09-12T16:20:01.064 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/log/ceph to /home/teuthworker/archive/dis-2024-09-12_15:21:08-rbd-wip-dis-testing-distro-default-smithi/7902667/remote/smithi017/log 2024-09-12T16:20:01.065 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T16:20:03.975 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/log/ceph to /home/teuthworker/archive/dis-2024-09-12_15:21:08-rbd-wip-dis-testing-distro-default-smithi/7902667/remote/smithi047/log 2024-09-12T16:20:03.976 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T16:20:06.764 DEBUG:teuthology.misc:Transferring archived files from smithi204:/var/log/ceph to /home/teuthworker/archive/dis-2024-09-12_15:21:08-rbd-wip-dis-testing-distro-default-smithi/7902667/remote/smithi204/log 2024-09-12T16:20:06.765 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T16:20:06.914 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T16:20:06.933 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T16:20:06.933 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T16:20:06.936 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T16:20:06.939 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T16:20:07.037 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T16:20:07.046 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T16:20:07.046 DEBUG:teuthology.orchestra.run.smithi017:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T16:20:07.049 DEBUG:teuthology.orchestra.run.smithi047:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T16:20:07.052 DEBUG:teuthology.orchestra.run.smithi204:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T16:20:07.064 INFO:teuthology.orchestra.run.smithi017.stderr:bash: line 1: ntpq: command not found 2024-09-12T16:20:07.067 INFO:teuthology.orchestra.run.smithi047.stderr:bash: line 1: ntpq: command not found 2024-09-12T16:20:07.069 INFO:teuthology.orchestra.run.smithi204.stderr:bash: line 1: ntpq: command not found 2024-09-12T16:20:07.069 INFO:teuthology.orchestra.run.smithi017.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T16:20:07.069 INFO:teuthology.orchestra.run.smithi017.stdout:=============================================================================== 2024-09-12T16:20:07.069 INFO:teuthology.orchestra.run.smithi017.stdout:^* hv01.front.sepia.ceph.com 3 6 377 59 -681us[ -688us] +/- 45ms 2024-09-12T16:20:07.069 INFO:teuthology.orchestra.run.smithi017.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 61 +376us[ +369us] +/- 56ms 2024-09-12T16:20:07.069 INFO:teuthology.orchestra.run.smithi017.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 61 +641us[ +634us] +/- 75ms 2024-09-12T16:20:07.069 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T16:20:07.071 INFO:teuthology.orchestra.run.smithi047.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T16:20:07.072 INFO:teuthology.orchestra.run.smithi047.stdout:=============================================================================== 2024-09-12T16:20:07.072 INFO:teuthology.orchestra.run.smithi047.stdout:^* hv01.front.sepia.ceph.com 3 6 377 61 -682us[ -692us] +/- 45ms 2024-09-12T16:20:07.072 INFO:teuthology.orchestra.run.smithi047.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 61 +386us[ +386us] +/- 56ms 2024-09-12T16:20:07.072 INFO:teuthology.orchestra.run.smithi047.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 61 +654us[ +645us] +/- 75ms 2024-09-12T16:20:07.072 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T16:20:07.074 INFO:teuthology.orchestra.run.smithi204.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T16:20:07.074 INFO:teuthology.orchestra.run.smithi204.stdout:=============================================================================== 2024-09-12T16:20:07.074 INFO:teuthology.orchestra.run.smithi204.stdout:^* hv01.front.sepia.ceph.com 3 6 377 61 -668us[ -658us] +/- 45ms 2024-09-12T16:20:07.074 INFO:teuthology.orchestra.run.smithi204.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 60 +394us[ +394us] +/- 56ms 2024-09-12T16:20:07.074 INFO:teuthology.orchestra.run.smithi204.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 61 +669us[ +669us] +/- 75ms 2024-09-12T16:20:07.074 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T16:20:07.075 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T16:20:07.082 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T16:20:07.083 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T16:20:07.091 DEBUG:teuthology.orchestra.run.smithi017:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T16:20:07.201 DEBUG:teuthology.orchestra.run.smithi047:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T16:20:07.282 DEBUG:teuthology.orchestra.run.smithi204:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T16:20:07.348 DEBUG:teuthology.orchestra.run.smithi017:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T16:20:07.381 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:20:07.381 DEBUG:teuthology.orchestra.run.smithi047:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T16:20:07.412 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:20:07.413 DEBUG:teuthology.orchestra.run.smithi204:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T16:20:07.442 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:20:07.442 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T16:20:07.452 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T16:20:07.462 INFO:teuthology.task.internal:Duration was 694.815790 seconds 2024-09-12T16:20:07.462 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T16:20:07.471 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T16:20:07.471 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T16:20:07.475 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T16:20:07.477 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T16:20:07.515 INFO:teuthology.orchestra.run.smithi017.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T16:20:07.517 INFO:teuthology.orchestra.run.smithi047.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T16:20:07.526 INFO:teuthology.orchestra.run.smithi204.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T16:20:07.888 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T16:20:07.888 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi017.front.sepia.ceph.com 2024-09-12T16:20:07.889 DEBUG:teuthology.orchestra.run.smithi017:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T16:20:07.954 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi047.front.sepia.ceph.com 2024-09-12T16:20:07.954 DEBUG:teuthology.orchestra.run.smithi047:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T16:20:07.988 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T16:20:07.988 DEBUG:teuthology.orchestra.run.smithi204:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T16:20:08.013 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T16:20:08.013 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T16:20:08.016 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T16:20:08.033 DEBUG:teuthology.orchestra.run.smithi204:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T16:20:08.082 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T16:20:08.082 DEBUG:teuthology.orchestra.run.smithi017:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T16:20:08.088 DEBUG:teuthology.orchestra.run.smithi047:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T16:20:08.101 DEBUG:teuthology.orchestra.run.smithi204:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T16:20:08.231 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T16:20:08.241 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T16:20:08.241 DEBUG:teuthology.orchestra.run.smithi017:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T16:20:08.267 DEBUG:teuthology.orchestra.run.smithi047:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T16:20:08.293 DEBUG:teuthology.orchestra.run.smithi204:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T16:20:08.318 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T16:20:08.327 DEBUG:teuthology.orchestra.run.smithi017:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T16:20:08.330 DEBUG:teuthology.orchestra.run.smithi047:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T16:20:08.336 DEBUG:teuthology.orchestra.run.smithi204:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T16:20:08.351 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = core 2024-09-12T16:20:08.357 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = core 2024-09-12T16:20:08.381 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern = core 2024-09-12T16:20:08.402 DEBUG:teuthology.orchestra.run.smithi017:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T16:20:08.444 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:20:08.444 DEBUG:teuthology.orchestra.run.smithi047:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T16:20:08.459 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:20:08.459 DEBUG:teuthology.orchestra.run.smithi204:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T16:20:08.473 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:20:08.474 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T16:20:08.484 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T16:20:08.485 DEBUG:teuthology.misc:Transferring archived files from smithi017:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/dis-2024-09-12_15:21:08-rbd-wip-dis-testing-distro-default-smithi/7902667/remote/smithi017 2024-09-12T16:20:08.485 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T16:20:08.521 DEBUG:teuthology.misc:Transferring archived files from smithi047:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/dis-2024-09-12_15:21:08-rbd-wip-dis-testing-distro-default-smithi/7902667/remote/smithi047 2024-09-12T16:20:08.521 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T16:20:08.555 DEBUG:teuthology.misc:Transferring archived files from smithi204:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/dis-2024-09-12_15:21:08-rbd-wip-dis-testing-distro-default-smithi/7902667/remote/smithi204 2024-09-12T16:20:08.556 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T16:20:08.592 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T16:20:08.592 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T16:20:08.594 DEBUG:teuthology.orchestra.run.smithi047:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T16:20:08.597 DEBUG:teuthology.orchestra.run.smithi204:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T16:20:08.640 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T16:20:08.651 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T16:20:08.651 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T16:20:08.660 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T16:20:08.660 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T16:20:08.662 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T16:20:08.665 DEBUG:teuthology.orchestra.run.smithi204:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T16:20:08.675 INFO:teuthology.orchestra.run.smithi017.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 16:20 /home/ubuntu/cephtest 2024-09-12T16:20:08.677 INFO:teuthology.orchestra.run.smithi047.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 16:20 /home/ubuntu/cephtest 2024-09-12T16:20:08.694 INFO:teuthology.orchestra.run.smithi204.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 16:20 /home/ubuntu/cephtest 2024-09-12T16:20:08.695 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T16:20:08.705 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T16:20:08.727 INFO:teuthology.run:Summary data: description: rbd/device/{base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/rbd_fsx_nbd} duration: 694.8157896995544 flavor: default owner: scheduled_dis@teuthology success: true 2024-09-12T16:20:08.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T16:20:08.816 INFO:teuthology.run:pass